2024-09-13T19:05:35.038 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-13T19:05:35.054 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T19:05:35.151 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-09-13_16:28:49-rgw-squid-distro-default-smithi/7904057 branch: squid description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{centos_latest}} email: null first_in_suite: false job_id: '7904057' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: cbodley-2024-09-13_16:28:49-rgw-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: 7741f7f9ee20524f89b8f61d1609b32fb3b1570a ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 7741f7f9ee20524f89b8f61d1609b32fb3b1570a rgw: ec-data-pool: true frontend: beast s3tests: slow_backend: true selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-qa-rgw-squid-65651 sha1: 24ee2aeecf070bf47d80960334abd82047ad2def owner: scheduled_cbodley@teuthology priority: 90 repo: https://github.com/ceph/ceph.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 seed: 9887 sha1: 7741f7f9ee20524f89b8f61d1609b32fb3b1570a sleep_before_teardown: 0 suite: rgw suite_branch: wip-qa-rgw-squid-65651 suite_path: /home/teuthworker/src/github.com_cbodley_ceph_24ee2aeecf070bf47d80960334abd82047ad2def/qa suite_relpath: qa suite_repo: https://github.com/cbodley/ceph.git suite_sha1: 24ee2aeecf070bf47d80960334abd82047ad2def targets: smithi053.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFDyaSQ/xxd6S1WNmtLKJE/WMOOLhBplKBder2lIeYo4hMGfCc9asF6wo+gSG41zWT1DpWye7KGIJTAWb65mY/o= smithi102.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG9ncRXyXh2/RhXG2gDll0zx5tgIkDuskPZtj9bNOGY8gjiDHLRC1uWCghrK2lPVcJjfInQgYptvqRvLrBq0nMU= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_16:28:49 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-13T19:05:35.152 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_cbodley_ceph_24ee2aeecf070bf47d80960334abd82047ad2def/qa; will attempt to use it 2024-09-13T19:05:35.152 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_cbodley_ceph_24ee2aeecf070bf47d80960334abd82047ad2def/qa/tasks 2024-09-13T19:05:35.152 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-13T19:05:35.154 INFO:teuthology.task.internal:Checking packages... 2024-09-13T19:05:35.174 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '7741f7f9ee20524f89b8f61d1609b32fb3b1570a' 2024-09-13T19:05:35.174 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T19:05:35.174 INFO:teuthology.packaging:ref: None 2024-09-13T19:05:35.175 INFO:teuthology.packaging:tag: None 2024-09-13T19:05:35.175 INFO:teuthology.packaging:branch: squid 2024-09-13T19:05:35.175 INFO:teuthology.packaging:sha1: 7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T19:05:35.175 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-13T19:05:35.415 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-324.gecab7be5 2024-09-13T19:05:35.416 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-13T19:05:35.423 INFO:teuthology.task.internal:no buildpackages task found 2024-09-13T19:05:35.423 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-13T19:05:35.442 INFO:teuthology.task.internal:Saving configuration 2024-09-13T19:05:35.453 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-13T19:05:35.460 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-13T19:05:35.493 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi053.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-13_16:28:49-rgw-squid-distro-default-smithi/7904057', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 19:00:45.252074', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFDyaSQ/xxd6S1WNmtLKJE/WMOOLhBplKBder2lIeYo4hMGfCc9asF6wo+gSG41zWT1DpWye7KGIJTAWb65mY/o='} 2024-09-13T19:05:35.523 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-13_16:28:49-rgw-squid-distro-default-smithi/7904057', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 19:00:45.250212', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG9ncRXyXh2/RhXG2gDll0zx5tgIkDuskPZtj9bNOGY8gjiDHLRC1uWCghrK2lPVcJjfInQgYptvqRvLrBq0nMU='} 2024-09-13T19:05:35.523 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-13T19:05:35.529 INFO:teuthology.task.internal:roles: ubuntu@smithi053.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2024-09-13T19:05:35.529 INFO:teuthology.task.internal:roles: ubuntu@smithi102.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2024-09-13T19:05:35.530 INFO:teuthology.run_tasks:Running task console_log... 2024-09-13T19:05:35.605 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff58b00fbe0>, signals=[15]) 2024-09-13T19:05:35.605 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-13T19:05:35.611 INFO:teuthology.task.internal:Opening connections... 2024-09-13T19:05:35.612 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi053.front.sepia.ceph.com 2024-09-13T19:05:35.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T19:05:35.699 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi102.front.sepia.ceph.com 2024-09-13T19:05:35.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T19:05:35.781 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-13T19:05:35.788 DEBUG:teuthology.orchestra.run.smithi053:> uname -m 2024-09-13T19:05:35.806 INFO:teuthology.orchestra.run.smithi053.stdout:x86_64 2024-09-13T19:05:35.806 DEBUG:teuthology.orchestra.run.smithi053:> cat /etc/os-release 2024-09-13T19:05:35.863 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="CentOS Stream" 2024-09-13T19:05:35.863 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="9" 2024-09-13T19:05:35.863 INFO:teuthology.orchestra.run.smithi053.stdout:ID="centos" 2024-09-13T19:05:35.864 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE="rhel fedora" 2024-09-13T19:05:35.864 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="9" 2024-09-13T19:05:35.864 INFO:teuthology.orchestra.run.smithi053.stdout:PLATFORM_ID="platform:el9" 2024-09-13T19:05:35.864 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T19:05:35.864 INFO:teuthology.orchestra.run.smithi053.stdout:ANSI_COLOR="0;31" 2024-09-13T19:05:35.864 INFO:teuthology.orchestra.run.smithi053.stdout:LOGO="fedora-logo-icon" 2024-09-13T19:05:35.864 INFO:teuthology.orchestra.run.smithi053.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T19:05:35.864 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://centos.org/" 2024-09-13T19:05:35.864 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T19:05:35.864 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T19:05:35.864 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T19:05:35.865 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server 2024-09-13T19:05:35.892 DEBUG:teuthology.orchestra.run.smithi102:> uname -m 2024-09-13T19:05:35.911 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64 2024-09-13T19:05:35.911 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2024-09-13T19:05:35.969 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="CentOS Stream" 2024-09-13T19:05:35.969 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="9" 2024-09-13T19:05:35.969 INFO:teuthology.orchestra.run.smithi102.stdout:ID="centos" 2024-09-13T19:05:35.970 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="rhel fedora" 2024-09-13T19:05:35.970 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="9" 2024-09-13T19:05:35.970 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el9" 2024-09-13T19:05:35.970 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T19:05:35.970 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31" 2024-09-13T19:05:35.970 INFO:teuthology.orchestra.run.smithi102.stdout:LOGO="fedora-logo-icon" 2024-09-13T19:05:35.970 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T19:05:35.970 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://centos.org/" 2024-09-13T19:05:35.970 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T19:05:35.970 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T19:05:35.971 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T19:05:35.971 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2024-09-13T19:05:35.992 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-13T19:05:36.000 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-13T19:05:36.006 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-13T19:05:36.006 DEBUG:teuthology.orchestra.run.smithi053:> test '!' -e /home/ubuntu/cephtest 2024-09-13T19:05:36.008 DEBUG:teuthology.orchestra.run.smithi102:> test '!' -e /home/ubuntu/cephtest 2024-09-13T19:05:36.026 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-13T19:05:36.031 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-13T19:05:36.032 DEBUG:teuthology.orchestra.run.smithi053:> test -z $(ls -A /var/lib/ceph) 2024-09-13T19:05:36.068 DEBUG:teuthology.orchestra.run.smithi102:> test -z $(ls -A /var/lib/ceph) 2024-09-13T19:05:36.171 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-13T19:05:36.242 INFO:teuthology.run_tasks:Running task kernel... 2024-09-13T19:05:36.255 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-13T19:05:36.256 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-13T19:05:36.256 DEBUG:teuthology.orchestra.run.smithi053:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T19:05:36.256 DEBUG:teuthology.orchestra.run.smithi102:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T19:05:36.273 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T19:05:36.273 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T19:05:36.274 DEBUG:teuthology.orchestra.run.smithi102:> uname -r 2024-09-13T19:05:36.274 DEBUG:teuthology.orchestra.run.smithi053:> uname -r 2024-09-13T19:05:36.333 INFO:teuthology.orchestra.run.smithi053.stdout:5.14.0-503.el9.x86_64 2024-09-13T19:05:36.333 INFO:teuthology.orchestra.run.smithi102.stdout:5.14.0-503.el9.x86_64 2024-09-13T19:05:36.333 INFO:teuthology.task.kernel:Running kernel on smithi053: 5.14.0-503.el9.x86_64 2024-09-13T19:05:36.333 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum install -y kernel 2024-09-13T19:05:36.334 INFO:teuthology.task.kernel:Running kernel on smithi102: 5.14.0-503.el9.x86_64 2024-09-13T19:05:36.334 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum install -y kernel 2024-09-13T19:05:38.665 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.2 MB 00:00 2024-09-13T19:05:38.728 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-09-13T19:05:40.358 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - AppStream 35 MB/s | 20 MB 00:00 2024-09-13T19:05:44.521 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - AppStream 4.4 MB/s | 20 MB 00:04 2024-09-13T19:05:44.792 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-13T19:05:46.276 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - Extras packages 68 kB/s | 19 kB 00:00 2024-09-13T19:05:47.106 INFO:teuthology.orchestra.run.smithi102.stdout:Extra Packages for Enterprise Linux 32 MB/s | 23 MB 00:00 2024-09-13T19:05:49.863 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - CRB 4.7 MB/s | 6.5 MB 00:01 2024-09-13T19:05:51.447 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - Extras packages 65 kB/s | 19 kB 00:00 2024-09-13T19:05:52.503 INFO:teuthology.orchestra.run.smithi102.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-09-13T19:05:52.651 INFO:teuthology.orchestra.run.smithi053.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-13T19:05:54.527 INFO:teuthology.orchestra.run.smithi102.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-13T19:05:54.527 INFO:teuthology.orchestra.run.smithi102.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-13T19:05:54.623 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-13T19:05:54.629 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-13T19:05:54.629 INFO:teuthology.orchestra.run.smithi102.stdout: Package Architecture Version Repository Size 2024-09-13T19:05:54.629 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-13T19:05:54.629 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-13T19:05:54.629 INFO:teuthology.orchestra.run.smithi102.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-13T19:05:54.629 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-09-13T19:05:54.630 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-13T19:05:54.630 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-13T19:05:54.630 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-13T19:05:54.630 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:05:54.630 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-13T19:05:54.630 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-13T19:05:54.630 INFO:teuthology.orchestra.run.smithi102.stdout:Install 4 Packages 2024-09-13T19:05:54.630 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:05:54.631 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 79 M 2024-09-13T19:05:54.631 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 126 M 2024-09-13T19:05:54.631 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-13T19:05:54.947 INFO:teuthology.orchestra.run.smithi102.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 77 kB/s | 23 kB 00:00 2024-09-13T19:05:58.323 INFO:teuthology.orchestra.run.smithi053.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-13T19:06:00.413 INFO:teuthology.orchestra.run.smithi053.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-13T19:06:00.414 INFO:teuthology.orchestra.run.smithi053.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-13T19:06:00.505 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-13T19:06:00.510 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-13T19:06:00.510 INFO:teuthology.orchestra.run.smithi053.stdout: Package Architecture Version Repository Size 2024-09-13T19:06:00.510 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-13T19:06:00.510 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-09-13T19:06:00.510 INFO:teuthology.orchestra.run.smithi053.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-13T19:06:00.510 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2024-09-13T19:06:00.510 INFO:teuthology.orchestra.run.smithi053.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-13T19:06:00.510 INFO:teuthology.orchestra.run.smithi053.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-13T19:06:00.510 INFO:teuthology.orchestra.run.smithi053.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-13T19:06:00.510 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:06:00.510 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-09-13T19:06:00.510 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-13T19:06:00.511 INFO:teuthology.orchestra.run.smithi053.stdout:Install 4 Packages 2024-09-13T19:06:00.511 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:06:00.511 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 79 M 2024-09-13T19:06:00.511 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 126 M 2024-09-13T19:06:00.511 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-09-13T19:06:00.667 INFO:teuthology.orchestra.run.smithi053.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 170 kB/s | 23 kB 00:00 2024-09-13T19:06:01.009 INFO:teuthology.orchestra.run.smithi053.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 33 MB/s | 16 MB 00:00 2024-09-13T19:06:01.384 INFO:teuthology.orchestra.run.smithi053.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 41 MB/s | 35 MB 00:00 2024-09-13T19:06:01.801 INFO:teuthology.orchestra.run.smithi053.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 25 MB/s | 29 MB 00:01 2024-09-13T19:06:01.801 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-13T19:06:01.801 INFO:teuthology.orchestra.run.smithi053.stdout:Total 61 MB/s | 79 MB 00:01 2024-09-13T19:06:02.513 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-09-13T19:06:02.913 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-09-13T19:06:02.913 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-09-13T19:06:03.871 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-09-13T19:06:03.871 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-09-13T19:06:05.087 INFO:teuthology.orchestra.run.smithi102.stdout:(2/4): kernel-modules-core-5.14.0-505.el9.x86_6 2.8 MB/s | 29 MB 00:10 2024-09-13T19:06:06.429 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-09-13T19:06:07.135 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-13T19:06:07.218 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T19:06:08.104 INFO:teuthology.orchestra.run.smithi102.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 2.6 MB/s | 35 MB 00:13 2024-09-13T19:06:10.020 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T19:06:10.164 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T19:06:10.187 INFO:teuthology.orchestra.run.smithi102.stdout:(4/4): kernel-core-5.14.0-505.el9.x86_64.rpm 1.0 MB/s | 16 MB 00:15 2024-09-13T19:06:10.187 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-13T19:06:10.188 INFO:teuthology.orchestra.run.smithi102.stdout:Total 5.1 MB/s | 79 MB 00:15 2024-09-13T19:06:10.872 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-13T19:06:11.231 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-13T19:06:11.231 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-13T19:06:12.238 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-13T19:06:12.239 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-13T19:06:14.674 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-13T19:06:15.289 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T19:06:15.313 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-13T19:06:15.332 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T19:06:15.397 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T19:06:18.302 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T19:06:18.434 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T19:06:20.464 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T19:06:23.258 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T19:06:23.294 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T19:06:28.141 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T19:07:00.044 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T19:07:00.087 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-13T19:07:00.388 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T19:07:00.389 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-13T19:07:00.389 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T19:07:00.389 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T19:07:01.277 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T19:07:01.277 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:07:01.277 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-09-13T19:07:01.277 INFO:teuthology.orchestra.run.smithi053.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-13T19:07:01.277 INFO:teuthology.orchestra.run.smithi053.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-13T19:07:01.277 INFO:teuthology.orchestra.run.smithi053.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-13T19:07:01.277 INFO:teuthology.orchestra.run.smithi053.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-13T19:07:01.278 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:07:01.278 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-13T19:07:01.637 DEBUG:teuthology.orchestra.run.smithi053:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T19:07:01.727 INFO:teuthology.orchestra.run.smithi053.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T19:07:01.727 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T19:07:01.727 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-13T19:07:01.727 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T19:07:01.728 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T19:07:01.728 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-13T19:07:01.728 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi053.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T19:07:01.728 DEBUG:teuthology.orchestra.run.smithi053:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T19:07:01.786 INFO:teuthology.orchestra.run.smithi053.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T19:07:01.786 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T19:07:01.786 DEBUG:teuthology.orchestra.run.smithi053:> sudo rpm -qi grub2-tools 2024-09-13T19:07:01.829 INFO:teuthology.orchestra.run.smithi053.stdout:Name : grub2-tools 2024-09-13T19:07:01.829 INFO:teuthology.orchestra.run.smithi053.stdout:Epoch : 1 2024-09-13T19:07:01.829 INFO:teuthology.orchestra.run.smithi053.stdout:Version : 2.06 2024-09-13T19:07:01.829 INFO:teuthology.orchestra.run.smithi053.stdout:Release : 82.el9 2024-09-13T19:07:01.830 INFO:teuthology.orchestra.run.smithi053.stdout:Architecture: x86_64 2024-09-13T19:07:01.830 INFO:teuthology.orchestra.run.smithi053.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-13T19:07:01.830 INFO:teuthology.orchestra.run.smithi053.stdout:Group : Unspecified 2024-09-13T19:07:01.830 INFO:teuthology.orchestra.run.smithi053.stdout:Size : 8274670 2024-09-13T19:07:01.830 INFO:teuthology.orchestra.run.smithi053.stdout:License : GPLv3+ 2024-09-13T19:07:01.830 INFO:teuthology.orchestra.run.smithi053.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-13T19:07:01.830 INFO:teuthology.orchestra.run.smithi053.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-13T19:07:01.830 INFO:teuthology.orchestra.run.smithi053.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-13T19:07:01.830 INFO:teuthology.orchestra.run.smithi053.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-13T19:07:01.830 INFO:teuthology.orchestra.run.smithi053.stdout:Packager : builder@centos.org 2024-09-13T19:07:01.830 INFO:teuthology.orchestra.run.smithi053.stdout:Vendor : CentOS 2024-09-13T19:07:01.830 INFO:teuthology.orchestra.run.smithi053.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-13T19:07:01.830 INFO:teuthology.orchestra.run.smithi053.stdout:Summary : Support tools for GRUB. 2024-09-13T19:07:01.830 INFO:teuthology.orchestra.run.smithi053.stdout:Description : 2024-09-13T19:07:01.831 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:07:01.831 INFO:teuthology.orchestra.run.smithi053.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-13T19:07:01.831 INFO:teuthology.orchestra.run.smithi053.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-13T19:07:01.831 INFO:teuthology.orchestra.run.smithi053.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-13T19:07:01.831 INFO:teuthology.orchestra.run.smithi053.stdout:hardware devices. 2024-09-13T19:07:01.831 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:07:01.831 INFO:teuthology.orchestra.run.smithi053.stdout:This subpackage provides tools for support of all platforms. 2024-09-13T19:07:01.832 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-13T19:07:01.832 INFO:teuthology.task.kernel:Updating grub on smithi053 to boot 5.14.0-505.el9.x86_64 2024-09-13T19:07:01.832 DEBUG:teuthology.orchestra.run.smithi053:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-13T19:07:02.477 INFO:teuthology.orchestra.run.smithi053.stderr:Generating grub configuration file ... 2024-09-13T19:07:03.861 INFO:teuthology.orchestra.run.smithi053.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-13T19:07:03.888 INFO:teuthology.orchestra.run.smithi053.stderr:done 2024-09-13T19:07:03.890 DEBUG:teuthology.orchestra.run.smithi053:> mktemp 2024-09-13T19:07:03.905 INFO:teuthology.orchestra.run.smithi053.stdout:/tmp/tmp.9dmHuoK7uw 2024-09-13T19:07:03.905 DEBUG:teuthology.orchestra.run.smithi053:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.9dmHuoK7uw 2024-09-13T19:07:03.974 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0666 /tmp/tmp.9dmHuoK7uw 2024-09-13T19:07:04.114 DEBUG:teuthology.orchestra.remote:smithi053:/tmp/tmp.9dmHuoK7uw is 6KB 2024-09-13T19:07:04.162 DEBUG:teuthology.orchestra.run.smithi053:> rm -fr /tmp/tmp.9dmHuoK7uw 2024-09-13T19:07:04.177 DEBUG:teuthology.orchestra.run.smithi053:> sudo /bin/ls /boot/loader/entries || true 2024-09-13T19:07:04.248 INFO:teuthology.orchestra.run.smithi053.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-13T19:07:04.248 INFO:teuthology.orchestra.run.smithi053.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-13T19:07:04.248 INFO:teuthology.orchestra.run.smithi053.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-13T19:07:04.248 INFO:teuthology.orchestra.run.smithi053.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-13T19:07:04.250 DEBUG:teuthology.orchestra.run.smithi053:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-13T19:07:04.419 DEBUG:teuthology.orchestra.run.smithi053:> sudo shutdown -r now 2024-09-13T19:07:06.581 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T19:07:06.626 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-13T19:07:06.953 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T19:07:06.953 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-13T19:07:06.953 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T19:07:06.953 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T19:07:07.809 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T19:07:07.810 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:07:07.810 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-13T19:07:07.810 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-13T19:07:07.810 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-13T19:07:07.810 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-13T19:07:07.810 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-13T19:07:07.810 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:07:07.810 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-13T19:07:08.150 DEBUG:teuthology.orchestra.run.smithi102:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T19:07:08.222 INFO:teuthology.orchestra.run.smithi102.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T19:07:08.222 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T19:07:08.223 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-13T19:07:08.223 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T19:07:08.223 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T19:07:08.223 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-09-13T19:07:08.223 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi102.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T19:07:08.223 DEBUG:teuthology.orchestra.run.smithi102:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T19:07:08.282 INFO:teuthology.orchestra.run.smithi102.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T19:07:08.282 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T19:07:08.282 DEBUG:teuthology.orchestra.run.smithi102:> sudo rpm -qi grub2-tools 2024-09-13T19:07:08.314 INFO:teuthology.orchestra.run.smithi102.stdout:Name : grub2-tools 2024-09-13T19:07:08.314 INFO:teuthology.orchestra.run.smithi102.stdout:Epoch : 1 2024-09-13T19:07:08.314 INFO:teuthology.orchestra.run.smithi102.stdout:Version : 2.06 2024-09-13T19:07:08.314 INFO:teuthology.orchestra.run.smithi102.stdout:Release : 82.el9 2024-09-13T19:07:08.314 INFO:teuthology.orchestra.run.smithi102.stdout:Architecture: x86_64 2024-09-13T19:07:08.314 INFO:teuthology.orchestra.run.smithi102.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-13T19:07:08.314 INFO:teuthology.orchestra.run.smithi102.stdout:Group : Unspecified 2024-09-13T19:07:08.314 INFO:teuthology.orchestra.run.smithi102.stdout:Size : 8274670 2024-09-13T19:07:08.315 INFO:teuthology.orchestra.run.smithi102.stdout:License : GPLv3+ 2024-09-13T19:07:08.315 INFO:teuthology.orchestra.run.smithi102.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-13T19:07:08.315 INFO:teuthology.orchestra.run.smithi102.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-13T19:07:08.315 INFO:teuthology.orchestra.run.smithi102.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-13T19:07:08.315 INFO:teuthology.orchestra.run.smithi102.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-13T19:07:08.315 INFO:teuthology.orchestra.run.smithi102.stdout:Packager : builder@centos.org 2024-09-13T19:07:08.315 INFO:teuthology.orchestra.run.smithi102.stdout:Vendor : CentOS 2024-09-13T19:07:08.315 INFO:teuthology.orchestra.run.smithi102.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-13T19:07:08.315 INFO:teuthology.orchestra.run.smithi102.stdout:Summary : Support tools for GRUB. 2024-09-13T19:07:08.315 INFO:teuthology.orchestra.run.smithi102.stdout:Description : 2024-09-13T19:07:08.315 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:07:08.315 INFO:teuthology.orchestra.run.smithi102.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-13T19:07:08.315 INFO:teuthology.orchestra.run.smithi102.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-13T19:07:08.315 INFO:teuthology.orchestra.run.smithi102.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-13T19:07:08.316 INFO:teuthology.orchestra.run.smithi102.stdout:hardware devices. 2024-09-13T19:07:08.316 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:07:08.316 INFO:teuthology.orchestra.run.smithi102.stdout:This subpackage provides tools for support of all platforms. 2024-09-13T19:07:08.316 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-13T19:07:08.317 INFO:teuthology.task.kernel:Updating grub on smithi102 to boot 5.14.0-505.el9.x86_64 2024-09-13T19:07:08.317 DEBUG:teuthology.orchestra.run.smithi102:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-13T19:07:08.976 INFO:teuthology.orchestra.run.smithi102.stderr:Generating grub configuration file ... 2024-09-13T19:07:10.271 INFO:teuthology.orchestra.run.smithi102.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-13T19:07:10.299 INFO:teuthology.orchestra.run.smithi102.stderr:done 2024-09-13T19:07:10.301 DEBUG:teuthology.orchestra.run.smithi102:> mktemp 2024-09-13T19:07:10.316 INFO:teuthology.orchestra.run.smithi102.stdout:/tmp/tmp.1ltn5zwZk4 2024-09-13T19:07:10.317 DEBUG:teuthology.orchestra.run.smithi102:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.1ltn5zwZk4 2024-09-13T19:07:10.383 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0666 /tmp/tmp.1ltn5zwZk4 2024-09-13T19:07:10.529 DEBUG:teuthology.orchestra.remote:smithi102:/tmp/tmp.1ltn5zwZk4 is 6KB 2024-09-13T19:07:10.578 DEBUG:teuthology.orchestra.run.smithi102:> rm -fr /tmp/tmp.1ltn5zwZk4 2024-09-13T19:07:10.593 DEBUG:teuthology.orchestra.run.smithi102:> sudo /bin/ls /boot/loader/entries || true 2024-09-13T19:07:10.658 INFO:teuthology.orchestra.run.smithi102.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-13T19:07:10.658 INFO:teuthology.orchestra.run.smithi102.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-13T19:07:10.658 INFO:teuthology.orchestra.run.smithi102.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-13T19:07:10.658 INFO:teuthology.orchestra.run.smithi102.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-13T19:07:10.659 DEBUG:teuthology.orchestra.run.smithi102:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-13T19:07:10.811 DEBUG:teuthology.orchestra.run.smithi102:> sudo shutdown -r now 2024-09-13T19:07:34.442 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-13T19:07:34.442 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-09-13T19:07:34.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T19:07:40.817 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-09-13T19:07:40.817 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-13T19:07:40.818 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T19:07:53.021 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.53 2024-09-13T19:07:59.169 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.102 2024-09-13T19:08:02.025 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-09-13T19:08:02.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T19:08:08.173 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-13T19:08:08.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T19:08:11.261 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.102 2024-09-13T19:08:20.413 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.53 2024-09-13T19:08:23.264 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-13T19:08:23.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T19:08:32.421 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-09-13T19:08:32.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T19:08:33.055 DEBUG:teuthology.orchestra.run.smithi053:> true 2024-09-13T19:08:33.469 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-09-13T19:08:33.469 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-13T19:08:33.470 DEBUG:teuthology.orchestra.run.smithi053:> uname -r 2024-09-13T19:08:33.485 INFO:teuthology.orchestra.run.smithi053.stdout:5.14.0-505.el9.x86_64 2024-09-13T19:08:33.485 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-13T19:08:33.485 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T19:08:33.485 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-13T19:08:34.486 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-13T19:08:34.487 DEBUG:teuthology.orchestra.run.smithi053:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T19:08:34.610 INFO:teuthology.orchestra.run.smithi053.stdout:ttyS1 2024-09-13T19:08:34.630 DEBUG:teuthology.parallel:result is None 2024-09-13T19:08:55.104 DEBUG:teuthology.orchestra.run.smithi102:> true 2024-09-13T19:08:55.446 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-13T19:08:55.446 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-505.el9.x86_64"... 2024-09-13T19:08:55.446 DEBUG:teuthology.orchestra.run.smithi102:> uname -r 2024-09-13T19:08:55.461 INFO:teuthology.orchestra.run.smithi102.stdout:5.14.0-505.el9.x86_64 2024-09-13T19:08:55.461 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-13T19:08:55.461 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T19:08:55.462 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-13T19:08:56.462 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-09-13T19:08:56.463 DEBUG:teuthology.orchestra.run.smithi102:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T19:08:56.531 INFO:teuthology.orchestra.run.smithi102.stdout:ttyS1 2024-09-13T19:08:56.558 DEBUG:teuthology.parallel:result is None 2024-09-13T19:08:56.558 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-13T19:08:56.566 INFO:teuthology.task.internal:Creating test directory... 2024-09-13T19:08:56.566 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T19:08:56.570 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T19:08:56.588 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-13T19:08:56.598 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-13T19:08:56.609 INFO:teuthology.task.internal:Creating archive directory... 2024-09-13T19:08:56.610 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T19:08:56.632 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T19:08:56.686 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-13T19:08:56.693 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-13T19:08:56.694 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T19:08:56.696 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T19:08:56.727 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T19:08:56.728 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T19:08:56.737 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T19:08:56.739 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T19:08:56.741 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-13T19:08:56.750 INFO:teuthology.task.internal:Configuring sudo... 2024-09-13T19:08:56.750 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T19:08:56.782 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T19:08:56.809 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-13T19:08:56.819 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-13T19:08:56.819 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T19:08:56.852 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T19:08:56.867 DEBUG:teuthology.orchestra.run.smithi053:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T19:08:56.956 DEBUG:teuthology.orchestra.run.smithi053:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T19:08:57.001 DEBUG:teuthology.orchestra.run.smithi053:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T19:08:57.092 DEBUG:teuthology.orchestra.run.smithi053:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T19:08:57.127 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T19:08:57.127 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T19:08:57.193 DEBUG:teuthology.orchestra.run.smithi102:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T19:08:57.245 DEBUG:teuthology.orchestra.run.smithi102:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T19:08:57.291 DEBUG:teuthology.orchestra.run.smithi102:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T19:08:57.381 DEBUG:teuthology.orchestra.run.smithi102:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T19:08:57.413 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-13T19:08:57.413 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T19:08:57.478 DEBUG:teuthology.orchestra.run.smithi053:> sudo service rsyslog restart 2024-09-13T19:08:57.481 DEBUG:teuthology.orchestra.run.smithi102:> sudo service rsyslog restart 2024-09-13T19:08:57.535 INFO:teuthology.orchestra.run.smithi053.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T19:08:57.566 INFO:teuthology.orchestra.run.smithi102.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T19:08:58.070 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-13T19:08:58.077 INFO:teuthology.task.internal:Starting timer... 2024-09-13T19:08:58.077 INFO:teuthology.run_tasks:Running task pcp... 2024-09-13T19:08:58.091 INFO:teuthology.run_tasks:Running task selinux... 2024-09-13T19:08:58.106 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-13T19:08:58.106 DEBUG:teuthology.orchestra.run.smithi053:> sudo service auditd rotate 2024-09-13T19:08:58.188 INFO:teuthology.orchestra.run.smithi053.stdout:Rotating logs: 2024-09-13T19:08:58.190 DEBUG:teuthology.orchestra.run.smithi102:> sudo service auditd rotate 2024-09-13T19:08:58.242 INFO:teuthology.orchestra.run.smithi102.stdout:Rotating logs: 2024-09-13T19:08:58.244 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-13T19:08:58.244 DEBUG:teuthology.orchestra.run.smithi053:> /usr/sbin/getenforce 2024-09-13T19:08:58.270 INFO:teuthology.orchestra.run.smithi053.stdout:Permissive 2024-09-13T19:08:58.270 DEBUG:teuthology.orchestra.run.smithi102:> /usr/sbin/getenforce 2024-09-13T19:08:58.301 INFO:teuthology.orchestra.run.smithi102.stdout:Permissive 2024-09-13T19:08:58.302 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi053.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi102.front.sepia.ceph.com': 'permissive'} 2024-09-13T19:08:58.302 DEBUG:teuthology.orchestra.run.smithi053:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T19:08:58.340 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T19:08:58.341 DEBUG:teuthology.orchestra.run.smithi102:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T19:08:58.368 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T19:08:58.368 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-13T19:08:58.369 DEBUG:teuthology.orchestra.run.smithi053:> sudo /usr/sbin/setenforce permissive 2024-09-13T19:08:58.414 DEBUG:teuthology.orchestra.run.smithi102:> sudo /usr/sbin/setenforce permissive 2024-09-13T19:08:58.450 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-13T19:08:58.477 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-13T19:08:58.480 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-13T19:08:58.609 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-13T19:08:58.621 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-13T19:08:58.622 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi053.front.sepia.ceph.com,smithi102.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-13T19:12:48.730 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi053.front.sepia.ceph.com'), Remote(name='ubuntu@smithi102.front.sepia.ceph.com')] 2024-09-13T19:12:48.732 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-09-13T19:12:48.733 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T19:12:48.840 DEBUG:teuthology.orchestra.run.smithi053:> true 2024-09-13T19:12:48.923 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-09-13T19:12:48.924 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-13T19:12:48.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T19:12:49.030 DEBUG:teuthology.orchestra.run.smithi102:> true 2024-09-13T19:12:49.112 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-13T19:12:49.113 INFO:teuthology.run_tasks:Running task clock... 2024-09-13T19:12:49.122 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-13T19:12:49.122 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T19:12:49.123 DEBUG:teuthology.orchestra.run.smithi053:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T19:12:49.126 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T19:12:49.126 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T19:12:49.160 INFO:teuthology.orchestra.run.smithi053.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T19:12:49.176 INFO:teuthology.orchestra.run.smithi053.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T19:12:49.181 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T19:12:49.196 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T19:12:49.204 INFO:teuthology.orchestra.run.smithi053.stderr:sudo: ntpd: command not found 2024-09-13T19:12:49.216 INFO:teuthology.orchestra.run.smithi053.stdout:506 Cannot talk to daemon 2024-09-13T19:12:49.219 INFO:teuthology.orchestra.run.smithi102.stderr:sudo: ntpd: command not found 2024-09-13T19:12:49.231 INFO:teuthology.orchestra.run.smithi102.stdout:506 Cannot talk to daemon 2024-09-13T19:12:49.232 INFO:teuthology.orchestra.run.smithi053.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T19:12:49.244 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T19:12:49.247 INFO:teuthology.orchestra.run.smithi053.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T19:12:49.258 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T19:12:49.305 INFO:teuthology.orchestra.run.smithi053.stderr:bash: line 1: ntpq: command not found 2024-09-13T19:12:49.309 INFO:teuthology.orchestra.run.smithi053.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T19:12:49.309 INFO:teuthology.orchestra.run.smithi053.stdout:=============================================================================== 2024-09-13T19:12:49.309 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T19:12:49.309 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T19:12:49.309 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T19:12:49.309 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T19:12:49.316 INFO:teuthology.orchestra.run.smithi102.stderr:bash: line 1: ntpq: command not found 2024-09-13T19:12:49.319 INFO:teuthology.orchestra.run.smithi102.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T19:12:49.319 INFO:teuthology.orchestra.run.smithi102.stdout:=============================================================================== 2024-09-13T19:12:49.319 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T19:12:49.319 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T19:12:49.319 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T19:12:49.319 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T19:12:49.320 INFO:teuthology.run_tasks:Running task install... 2024-09-13T19:12:49.329 DEBUG:teuthology.task.install:project ceph 2024-09-13T19:12:49.330 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '7741f7f9ee20524f89b8f61d1609b32fb3b1570a'}} 2024-09-13T19:12:49.330 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '7741f7f9ee20524f89b8f61d1609b32fb3b1570a'} 2024-09-13T19:12:49.330 INFO:teuthology.task.install:Using flavor: default 2024-09-13T19:12:49.337 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-13T19:12:49.337 INFO:teuthology.task.install:extra packages: [] 2024-09-13T19:12:49.338 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7741f7f9ee20524f89b8f61d1609b32fb3b1570a', 'tag': None, 'wait_for_package': False} 2024-09-13T19:12:49.339 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T19:12:49.341 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7741f7f9ee20524f89b8f61d1609b32fb3b1570a', 'tag': None, 'wait_for_package': False} 2024-09-13T19:12:49.342 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T19:12:49.494 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/centos/9/flavors/default/ 2024-09-13T19:12:49.494 INFO:teuthology.task.install.rpm:Package version is 19.1.1-322.g7741f7f9 2024-09-13T19:12:49.505 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/centos/9/flavors/default/ 2024-09-13T19:12:49.505 INFO:teuthology.task.install.rpm:Package version is 19.1.1-322.g7741f7f9 2024-09-13T19:12:49.612 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T19:12:49.612 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T19:12:49.612 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T19:12:49.624 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T19:12:49.624 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-13T19:12:49.624 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T19:12:49.640 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-13T19:12:49.641 DEBUG:teuthology.orchestra.run.smithi053:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T19:12:49.649 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-13T19:12:49.649 DEBUG:teuthology.orchestra.run.smithi102:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T19:12:49.708 DEBUG:teuthology.orchestra.run.smithi053:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T19:12:49.715 DEBUG:teuthology.orchestra.run.smithi102:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T19:12:49.786 DEBUG:teuthology.orchestra.run.smithi053:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T19:12:49.789 DEBUG:teuthology.orchestra.run.smithi102:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T19:12:49.852 INFO:teuthology.orchestra.run.smithi053.stdout:check_obsoletes = 1 2024-09-13T19:12:49.854 INFO:teuthology.orchestra.run.smithi102.stdout:check_obsoletes = 1 2024-09-13T19:12:49.854 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum clean all 2024-09-13T19:12:49.855 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum clean all 2024-09-13T19:12:50.086 INFO:teuthology.orchestra.run.smithi102.stdout:45 files removed 2024-09-13T19:12:50.098 INFO:teuthology.orchestra.run.smithi053.stdout:45 files removed 2024-09-13T19:12:50.113 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-radosgw 2024-09-13T19:12:50.125 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-radosgw 2024-09-13T19:12:50.659 INFO:teuthology.orchestra.run.smithi102.stdout:ceph packages for x86_64 317 kB/s | 84 kB 00:00 2024-09-13T19:12:50.691 INFO:teuthology.orchestra.run.smithi053.stdout:ceph packages for x86_64 311 kB/s | 84 kB 00:00 2024-09-13T19:12:50.948 INFO:teuthology.orchestra.run.smithi102.stdout:ceph noarch packages 48 kB/s | 12 kB 00:00 2024-09-13T19:12:50.983 INFO:teuthology.orchestra.run.smithi053.stdout:ceph noarch packages 48 kB/s | 12 kB 00:00 2024-09-13T19:12:51.220 INFO:teuthology.orchestra.run.smithi102.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-13T19:12:51.259 INFO:teuthology.orchestra.run.smithi053.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-13T19:12:52.771 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - BaseOS 5.4 MB/s | 8.2 MB 00:01 2024-09-13T19:12:53.092 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - BaseOS 4.6 MB/s | 8.2 MB 00:01 2024-09-13T19:12:54.839 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - AppStream 21 MB/s | 20 MB 00:00 2024-09-13T19:12:55.176 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - AppStream 21 MB/s | 20 MB 00:00 2024-09-13T19:13:00.986 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - CRB 3.5 MB/s | 6.5 MB 00:01 2024-09-13T19:13:01.323 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - CRB 2.5 MB/s | 6.5 MB 00:02 2024-09-13T19:13:02.553 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - Extras packages 64 kB/s | 19 kB 00:00 2024-09-13T19:13:03.032 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - Extras packages 52 kB/s | 19 kB 00:00 2024-09-13T19:13:03.749 INFO:teuthology.orchestra.run.smithi053.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-13T19:13:04.177 INFO:teuthology.orchestra.run.smithi102.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-13T19:13:09.364 INFO:teuthology.orchestra.run.smithi053.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-13T19:13:09.592 INFO:teuthology.orchestra.run.smithi102.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-13T19:13:11.810 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-13T19:13:11.813 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-13T19:13:11.813 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2024-09-13T19:13:11.813 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-13T19:13:11.814 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-09-13T19:13:11.814 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-radosgw x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 11 M 2024-09-13T19:13:11.814 INFO:teuthology.orchestra.run.smithi053.stdout:Upgrading: 2024-09-13T19:13:11.814 INFO:teuthology.orchestra.run.smithi053.stdout: librados2 x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 3.4 M 2024-09-13T19:13:11.814 INFO:teuthology.orchestra.run.smithi053.stdout: librbd1 x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 3.2 M 2024-09-13T19:13:11.814 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2024-09-13T19:13:11.814 INFO:teuthology.orchestra.run.smithi053.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-13T19:13:11.814 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-base x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 5.4 M 2024-09-13T19:13:11.814 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-common x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 21 M 2024-09-13T19:13:11.814 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-selinux x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 25 k 2024-09-13T19:13:11.814 INFO:teuthology.orchestra.run.smithi053.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T19:13:11.815 INFO:teuthology.orchestra.run.smithi053.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-13T19:13:11.815 INFO:teuthology.orchestra.run.smithi053.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-13T19:13:11.815 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs2 x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 751 k 2024-09-13T19:13:11.815 INFO:teuthology.orchestra.run.smithi053.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T19:13:11.815 INFO:teuthology.orchestra.run.smithi053.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T19:13:11.815 INFO:teuthology.orchestra.run.smithi053.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T19:13:11.815 INFO:teuthology.orchestra.run.smithi053.stdout: libradosstriper1 x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 506 k 2024-09-13T19:13:11.815 INFO:teuthology.orchestra.run.smithi053.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T19:13:11.815 INFO:teuthology.orchestra.run.smithi053.stdout: librgw2 x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 5.3 M 2024-09-13T19:13:11.815 INFO:teuthology.orchestra.run.smithi053.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T19:13:11.815 INFO:teuthology.orchestra.run.smithi053.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T19:13:11.815 INFO:teuthology.orchestra.run.smithi053.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-13T19:13:11.816 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-argparse x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 45 k 2024-09-13T19:13:11.816 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-common x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 136 k 2024-09-13T19:13:11.816 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cephfs x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 162 k 2024-09-13T19:13:11.816 INFO:teuthology.orchestra.run.smithi053.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T19:13:11.816 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rados x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 321 k 2024-09-13T19:13:11.816 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rbd x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 301 k 2024-09-13T19:13:11.816 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rgw x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 99 k 2024-09-13T19:13:11.816 INFO:teuthology.orchestra.run.smithi053.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-13T19:13:11.816 INFO:teuthology.orchestra.run.smithi053.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-13T19:13:11.816 INFO:teuthology.orchestra.run.smithi053.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-13T19:13:11.816 INFO:teuthology.orchestra.run.smithi053.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T19:13:11.816 INFO:teuthology.orchestra.run.smithi053.stdout:Installing weak dependencies: 2024-09-13T19:13:11.816 INFO:teuthology.orchestra.run.smithi053.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-13T19:13:11.817 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:13:11.817 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-09-13T19:13:11.817 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-13T19:13:11.817 INFO:teuthology.orchestra.run.smithi053.stdout:Install 30 Packages 2024-09-13T19:13:11.817 INFO:teuthology.orchestra.run.smithi053.stdout:Upgrade 2 Packages 2024-09-13T19:13:11.817 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:13:11.817 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 60 M 2024-09-13T19:13:11.817 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-09-13T19:13:11.959 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-13T19:13:11.972 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-13T19:13:11.973 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-09-13T19:13:11.973 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-13T19:13:11.973 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-13T19:13:11.973 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-radosgw x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 11 M 2024-09-13T19:13:11.973 INFO:teuthology.orchestra.run.smithi102.stdout:Upgrading: 2024-09-13T19:13:11.973 INFO:teuthology.orchestra.run.smithi102.stdout: librados2 x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 3.4 M 2024-09-13T19:13:11.973 INFO:teuthology.orchestra.run.smithi102.stdout: librbd1 x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 3.2 M 2024-09-13T19:13:11.973 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-09-13T19:13:11.973 INFO:teuthology.orchestra.run.smithi102.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-13T19:13:11.973 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-base x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 5.4 M 2024-09-13T19:13:11.973 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-common x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 21 M 2024-09-13T19:13:11.974 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-selinux x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 25 k 2024-09-13T19:13:11.974 INFO:teuthology.orchestra.run.smithi102.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T19:13:11.974 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-13T19:13:11.974 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-13T19:13:11.974 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs2 x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 751 k 2024-09-13T19:13:11.974 INFO:teuthology.orchestra.run.smithi102.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T19:13:11.974 INFO:teuthology.orchestra.run.smithi102.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T19:13:11.974 INFO:teuthology.orchestra.run.smithi102.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T19:13:11.974 INFO:teuthology.orchestra.run.smithi102.stdout: libradosstriper1 x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 506 k 2024-09-13T19:13:11.974 INFO:teuthology.orchestra.run.smithi102.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T19:13:11.974 INFO:teuthology.orchestra.run.smithi102.stdout: librgw2 x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 5.3 M 2024-09-13T19:13:11.975 INFO:teuthology.orchestra.run.smithi102.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T19:13:11.975 INFO:teuthology.orchestra.run.smithi102.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T19:13:11.975 INFO:teuthology.orchestra.run.smithi102.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-13T19:13:11.975 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-argparse x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 45 k 2024-09-13T19:13:11.975 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-common x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 136 k 2024-09-13T19:13:11.975 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cephfs x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 162 k 2024-09-13T19:13:11.975 INFO:teuthology.orchestra.run.smithi102.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T19:13:11.975 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rados x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 321 k 2024-09-13T19:13:11.975 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rbd x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 301 k 2024-09-13T19:13:11.975 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rgw x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 99 k 2024-09-13T19:13:11.975 INFO:teuthology.orchestra.run.smithi102.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-13T19:13:11.975 INFO:teuthology.orchestra.run.smithi102.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-13T19:13:11.975 INFO:teuthology.orchestra.run.smithi102.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-13T19:13:11.975 INFO:teuthology.orchestra.run.smithi102.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T19:13:11.976 INFO:teuthology.orchestra.run.smithi102.stdout:Installing weak dependencies: 2024-09-13T19:13:11.976 INFO:teuthology.orchestra.run.smithi102.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-13T19:13:11.976 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:13:11.976 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-13T19:13:11.976 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-13T19:13:11.976 INFO:teuthology.orchestra.run.smithi102.stdout:Install 30 Packages 2024-09-13T19:13:11.976 INFO:teuthology.orchestra.run.smithi102.stdout:Upgrade 2 Packages 2024-09-13T19:13:11.976 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:13:11.977 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 60 M 2024-09-13T19:13:11.977 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-13T19:13:12.785 INFO:teuthology.orchestra.run.smithi102.stdout:(1/32): ceph-base-19.1.1-322.g7741f7f9.el9.x86_ 7.4 MB/s | 5.4 MB 00:00 2024-09-13T19:13:12.844 INFO:teuthology.orchestra.run.smithi102.stdout:(2/32): ceph-selinux-19.1.1-322.g7741f7f9.el9.x 433 kB/s | 25 kB 00:00 2024-09-13T19:13:12.923 INFO:teuthology.orchestra.run.smithi053.stdout:(1/32): ceph-base-19.1.1-322.g7741f7f9.el9.x86_ 7.0 MB/s | 5.4 MB 00:00 2024-09-13T19:13:12.944 INFO:teuthology.orchestra.run.smithi102.stdout:(3/32): libcephfs2-19.1.1-322.g7741f7f9.el9.x86 7.4 MB/s | 751 kB 00:00 2024-09-13T19:13:12.981 INFO:teuthology.orchestra.run.smithi053.stdout:(2/32): ceph-selinux-19.1.1-322.g7741f7f9.el9.x 432 kB/s | 25 kB 00:00 2024-09-13T19:13:13.086 INFO:teuthology.orchestra.run.smithi102.stdout:(4/32): libradosstriper1-19.1.1-322.g7741f7f9.e 3.5 MB/s | 506 kB 00:00 2024-09-13T19:13:13.115 INFO:teuthology.orchestra.run.smithi053.stdout:(3/32): libcephfs2-19.1.1-322.g7741f7f9.el9.x86 5.5 MB/s | 751 kB 00:00 2024-09-13T19:13:13.248 INFO:teuthology.orchestra.run.smithi053.stdout:(4/32): libradosstriper1-19.1.1-322.g7741f7f9.e 3.7 MB/s | 506 kB 00:00 2024-09-13T19:13:13.252 INFO:teuthology.orchestra.run.smithi102.stdout:(5/32): ceph-radosgw-19.1.1-322.g7741f7f9.el9.x 8.8 MB/s | 11 MB 00:01 2024-09-13T19:13:13.345 INFO:teuthology.orchestra.run.smithi102.stdout:(6/32): python3-ceph-argparse-19.1.1-322.g7741f 493 kB/s | 45 kB 00:00 2024-09-13T19:13:13.420 INFO:teuthology.orchestra.run.smithi102.stdout:(7/32): python3-ceph-common-19.1.1-322.g7741f7f 1.8 MB/s | 136 kB 00:00 2024-09-13T19:13:13.441 INFO:teuthology.orchestra.run.smithi053.stdout:(5/32): ceph-radosgw-19.1.1-322.g7741f7f9.el9.x 8.2 MB/s | 11 MB 00:01 2024-09-13T19:13:13.495 INFO:teuthology.orchestra.run.smithi102.stdout:(8/32): python3-cephfs-19.1.1-322.g7741f7f9.el9 2.1 MB/s | 162 kB 00:00 2024-09-13T19:13:13.516 INFO:teuthology.orchestra.run.smithi053.stdout:(6/32): python3-ceph-argparse-19.1.1-322.g7741f 604 kB/s | 45 kB 00:00 2024-09-13T19:13:13.587 INFO:teuthology.orchestra.run.smithi102.stdout:(9/32): python3-rados-19.1.1-322.g7741f7f9.el9. 3.4 MB/s | 321 kB 00:00 2024-09-13T19:13:13.608 INFO:teuthology.orchestra.run.smithi053.stdout:(7/32): python3-ceph-common-19.1.1-322.g7741f7f 1.5 MB/s | 136 kB 00:00 2024-09-13T19:13:13.654 INFO:teuthology.orchestra.run.smithi102.stdout:(10/32): librgw2-19.1.1-322.g7741f7f9.el9.x86_6 9.4 MB/s | 5.3 MB 00:00 2024-09-13T19:13:13.679 INFO:teuthology.orchestra.run.smithi102.stdout:(11/32): python3-rbd-19.1.1-322.g7741f7f9.el9.x 3.2 MB/s | 301 kB 00:00 2024-09-13T19:13:13.683 INFO:teuthology.orchestra.run.smithi053.stdout:(8/32): python3-cephfs-19.1.1-322.g7741f7f9.el9 2.1 MB/s | 162 kB 00:00 2024-09-13T19:13:13.730 INFO:teuthology.orchestra.run.smithi102.stdout:(12/32): python3-rgw-19.1.1-322.g7741f7f9.el9.x 1.3 MB/s | 99 kB 00:00 2024-09-13T19:13:13.767 INFO:teuthology.orchestra.run.smithi053.stdout:(9/32): python3-rados-19.1.1-322.g7741f7f9.el9. 3.7 MB/s | 321 kB 00:00 2024-09-13T19:13:13.842 INFO:teuthology.orchestra.run.smithi053.stdout:(10/32): librgw2-19.1.1-322.g7741f7f9.el9.x86_6 9.0 MB/s | 5.3 MB 00:00 2024-09-13T19:13:13.875 INFO:teuthology.orchestra.run.smithi053.stdout:(11/32): python3-rbd-19.1.1-322.g7741f7f9.el9.x 2.7 MB/s | 301 kB 00:00 2024-09-13T19:13:13.901 INFO:teuthology.orchestra.run.smithi053.stdout:(12/32): python3-rgw-19.1.1-322.g7741f7f9.el9.x 1.7 MB/s | 99 kB 00:00 2024-09-13T19:13:13.930 INFO:teuthology.orchestra.run.smithi102.stdout:(13/32): ceph-common-19.1.1-322.g7741f7f9.el9.x 11 MB/s | 21 MB 00:01 2024-09-13T19:13:14.118 INFO:teuthology.orchestra.run.smithi053.stdout:(13/32): ceph-common-19.1.1-322.g7741f7f9.el9.x 11 MB/s | 21 MB 00:01 2024-09-13T19:13:14.251 INFO:teuthology.orchestra.run.smithi053.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 284 kB/s | 107 kB 00:00 2024-09-13T19:13:14.277 INFO:teuthology.orchestra.run.smithi053.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 285 kB/s | 45 kB 00:00 2024-09-13T19:13:14.297 INFO:teuthology.orchestra.run.smithi102.stdout:(14/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 123 kB/s | 45 kB 00:00 2024-09-13T19:13:14.302 INFO:teuthology.orchestra.run.smithi053.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 400 kB/s | 160 kB 00:00 2024-09-13T19:13:14.322 INFO:teuthology.orchestra.run.smithi102.stdout:(15/32): boost-program-options-1.75.0-8.el9.x86 166 kB/s | 107 kB 00:00 2024-09-13T19:13:14.352 INFO:teuthology.orchestra.run.smithi053.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 844 kB/s | 42 kB 00:00 2024-09-13T19:13:14.386 INFO:teuthology.orchestra.run.smithi053.stdout:(18/32): librdkafka-1.6.1-102.el9.x86_64.rpm 4.8 MB/s | 662 kB 00:00 2024-09-13T19:13:14.389 INFO:teuthology.orchestra.run.smithi102.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 243 kB/s | 160 kB 00:00 2024-09-13T19:13:14.411 INFO:teuthology.orchestra.run.smithi053.stdout:(19/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2024-09-13T19:13:14.445 INFO:teuthology.orchestra.run.smithi053.stdout:(20/32): qatlib-24.02.0-1.el9.x86_64.rpm 2.3 MB/s | 221 kB 00:00 2024-09-13T19:13:14.470 INFO:teuthology.orchestra.run.smithi053.stdout:(21/32): qatlib-service-24.02.0-1.el9.x86_64.rp 429 kB/s | 36 kB 00:00 2024-09-13T19:13:14.495 INFO:teuthology.orchestra.run.smithi053.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 565 kB/s | 47 kB 00:00 2024-09-13T19:13:14.554 INFO:teuthology.orchestra.run.smithi053.stdout:(23/32): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.8 MB/s | 308 kB 00:00 2024-09-13T19:13:14.579 INFO:teuthology.orchestra.run.smithi053.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-13T19:13:14.604 INFO:teuthology.orchestra.run.smithi053.stdout:(25/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 282 kB/s | 26 kB 00:00 2024-09-13T19:13:14.629 INFO:teuthology.orchestra.run.smithi053.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-13T19:13:14.639 INFO:teuthology.orchestra.run.smithi102.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 169 kB/s | 42 kB 00:00 2024-09-13T19:13:14.663 INFO:teuthology.orchestra.run.smithi053.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-13T19:13:14.664 INFO:teuthology.orchestra.run.smithi102.stdout:(18/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 854 kB/s | 292 kB 00:00 2024-09-13T19:13:14.705 INFO:teuthology.orchestra.run.smithi053.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 839 kB 00:00 2024-09-13T19:13:14.755 INFO:teuthology.orchestra.run.smithi053.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-13T19:13:14.781 INFO:teuthology.orchestra.run.smithi102.stdout:(19/32): qatlib-service-24.02.0-1.el9.x86_64.rp 308 kB/s | 36 kB 00:00 2024-09-13T19:13:14.839 INFO:teuthology.orchestra.run.smithi053.stdout:(30/32): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-13T19:13:14.890 INFO:teuthology.orchestra.run.smithi102.stdout:(20/32): librdkafka-1.6.1-102.el9.x86_64.rpm 1.1 MB/s | 662 kB 00:00 2024-09-13T19:13:14.907 INFO:teuthology.orchestra.run.smithi102.stdout:(21/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 378 kB/s | 47 kB 00:00 2024-09-13T19:13:14.932 INFO:teuthology.orchestra.run.smithi102.stdout:(22/32): qatlib-24.02.0-1.el9.x86_64.rpm 754 kB/s | 221 kB 00:00 2024-09-13T19:13:14.972 INFO:teuthology.orchestra.run.smithi053.stdout:(31/32): librbd1-19.1.1-322.g7741f7f9.el9.x86_6 15 MB/s | 3.2 MB 00:00 2024-09-13T19:13:14.991 INFO:teuthology.orchestra.run.smithi102.stdout:(23/32): gperftools-libs-2.9.1-3.el9.x86_64.rpm 3.0 MB/s | 308 kB 00:00 2024-09-13T19:13:15.023 INFO:teuthology.orchestra.run.smithi053.stdout:(32/32): librados2-19.1.1-322.g7741f7f9.el9.x86 11 MB/s | 3.4 MB 00:00 2024-09-13T19:13:15.024 INFO:teuthology.orchestra.run.smithi102.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 1.5 MB/s | 49 kB 00:00 2024-09-13T19:13:15.028 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-13T19:13:15.028 INFO:teuthology.orchestra.run.smithi053.stdout:Total 19 MB/s | 60 MB 00:03 2024-09-13T19:13:15.050 INFO:teuthology.orchestra.run.smithi102.stdout:(25/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 253 kB/s | 26 kB 00:00 2024-09-13T19:13:15.075 INFO:teuthology.orchestra.run.smithi102.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-13T19:13:15.100 INFO:teuthology.orchestra.run.smithi102.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-13T19:13:15.136 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-09-13T19:13:15.142 INFO:teuthology.orchestra.run.smithi102.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 839 kB 00:00 2024-09-13T19:13:15.176 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-09-13T19:13:15.176 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-09-13T19:13:15.193 INFO:teuthology.orchestra.run.smithi102.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-13T19:13:15.285 INFO:teuthology.orchestra.run.smithi102.stdout:(30/32): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-13T19:13:15.452 INFO:teuthology.orchestra.run.smithi102.stdout:(31/32): librbd1-19.1.1-322.g7741f7f9.el9.x86_6 12 MB/s | 3.2 MB 00:00 2024-09-13T19:13:15.510 INFO:teuthology.orchestra.run.smithi102.stdout:(32/32): librados2-19.1.1-322.g7741f7f9.el9.x86 9.3 MB/s | 3.4 MB 00:00 2024-09-13T19:13:15.515 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-13T19:13:15.515 INFO:teuthology.orchestra.run.smithi102.stdout:Total 17 MB/s | 60 MB 00:03 2024-09-13T19:13:15.614 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-13T19:13:15.651 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-13T19:13:15.652 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-13T19:13:15.875 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-09-13T19:13:15.876 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-09-13T19:13:16.321 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-13T19:13:16.322 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-13T19:13:17.459 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-09-13T19:13:17.550 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-13T19:13:17.578 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-13T19:13:17.603 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-13T19:13:17.626 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-13T19:13:17.651 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-13T19:13:17.793 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-13T19:13:17.846 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-13T19:13:17.884 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-13T19:13:17.899 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-13T19:13:17.915 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-13T19:13:17.940 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-13T19:13:17.963 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-13T19:13:17.989 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-13T19:13:18.182 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-13T19:13:18.234 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-13T19:13:18.260 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-13T19:13:18.371 INFO:teuthology.orchestra.run.smithi053.stdout: Upgrading : librados2-2:19.1.1-322.g7741f7f9.el9.x86_64 7/34 2024-09-13T19:13:18.464 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librados2-2:19.1.1-322.g7741f7f9.el9.x86_64 7/34 2024-09-13T19:13:18.555 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-rados-2:19.1.1-322.g7741f7f9.el9.x86_64 8/34 2024-09-13T19:13:18.565 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-13T19:13:18.589 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libcephfs2-2:19.1.1-322.g7741f7f9.el9.x86_64 9/34 2024-09-13T19:13:18.653 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libcephfs2-2:19.1.1-322.g7741f7f9.el9.x86_64 9/34 2024-09-13T19:13:18.698 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-13T19:13:18.704 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : librados2-2:19.1.1-322.g7741f7f9.el9.x86_64 7/34 2024-09-13T19:13:18.752 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-ceph-argparse-2:19.1.1-322.g7741f7f9.el9.x 11/34 2024-09-13T19:13:18.784 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librados2-2:19.1.1-322.g7741f7f9.el9.x86_64 7/34 2024-09-13T19:13:18.821 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cephfs-2:19.1.1-322.g7741f7f9.el9.x86_64 12/34 2024-09-13T19:13:18.850 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libradosstriper1-2:19.1.1-322.g7741f7f9.el9.x86_64 13/34 2024-09-13T19:13:18.874 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rados-2:19.1.1-322.g7741f7f9.el9.x86_64 8/34 2024-09-13T19:13:18.902 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcephfs2-2:19.1.1-322.g7741f7f9.el9.x86_64 9/34 2024-09-13T19:13:18.915 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libradosstriper1-2:19.1.1-322.g7741f7f9.el9.x86_64 13/34 2024-09-13T19:13:18.949 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-13T19:13:18.965 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libcephfs2-2:19.1.1-322.g7741f7f9.el9.x86_64 9/34 2024-09-13T19:13:19.002 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-13T19:13:19.046 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-ceph-argparse-2:19.1.1-322.g7741f7f9.el9.x 11/34 2024-09-13T19:13:19.067 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-13T19:13:19.100 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-13T19:13:19.114 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cephfs-2:19.1.1-322.g7741f7f9.el9.x86_64 12/34 2024-09-13T19:13:19.137 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libradosstriper1-2:19.1.1-322.g7741f7f9.el9.x86_64 13/34 2024-09-13T19:13:19.140 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-13T19:13:19.173 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/34 2024-09-13T19:13:19.202 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libradosstriper1-2:19.1.1-322.g7741f7f9.el9.x86_64 13/34 2024-09-13T19:13:19.202 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-13T19:13:19.236 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-13T19:13:19.252 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-13T19:13:19.344 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-13T19:13:19.378 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-13T19:13:19.419 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-13T19:13:19.452 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/34 2024-09-13T19:13:19.481 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-13T19:13:19.514 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-13T19:13:19.588 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-13T19:13:19.630 INFO:teuthology.orchestra.run.smithi053.stdout: Upgrading : librbd1-2:19.1.1-322.g7741f7f9.el9.x86_64 22/34 2024-09-13T19:13:19.722 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librbd1-2:19.1.1-322.g7741f7f9.el9.x86_64 22/34 2024-09-13T19:13:19.752 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-rbd-2:19.1.1-322.g7741f7f9.el9.x86_64 23/34 2024-09-13T19:13:19.788 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-13T19:13:19.834 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-13T19:13:19.877 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : librbd1-2:19.1.1-322.g7741f7f9.el9.x86_64 22/34 2024-09-13T19:13:19.959 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librbd1-2:19.1.1-322.g7741f7f9.el9.x86_64 22/34 2024-09-13T19:13:19.990 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rbd-2:19.1.1-322.g7741f7f9.el9.x86_64 23/34 2024-09-13T19:13:20.026 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-13T19:13:20.296 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-13T19:13:20.324 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : librgw2-2:19.1.1-322.g7741f7f9.el9.x86_64 26/34 2024-09-13T19:13:20.405 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librgw2-2:19.1.1-322.g7741f7f9.el9.x86_64 26/34 2024-09-13T19:13:20.485 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-rgw-2:19.1.1-322.g7741f7f9.el9.x86_64 27/34 2024-09-13T19:13:20.507 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-13T19:13:20.519 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-ceph-common-2:19.1.1-322.g7741f7f9.el9.x86 28/34 2024-09-13T19:13:20.538 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librgw2-2:19.1.1-322.g7741f7f9.el9.x86_64 26/34 2024-09-13T19:13:20.592 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librgw2-2:19.1.1-322.g7741f7f9.el9.x86_64 26/34 2024-09-13T19:13:20.669 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rgw-2:19.1.1-322.g7741f7f9.el9.x86_64 27/34 2024-09-13T19:13:20.698 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-ceph-common-2:19.1.1-322.g7741f7f9.el9.x86 28/34 2024-09-13T19:13:22.986 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-common-2:19.1.1-322.g7741f7f9.el9.x86_64 29/34 2024-09-13T19:13:23.011 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-common-2:19.1.1-322.g7741f7f9.el9.x86_64 29/34 2024-09-13T19:13:23.031 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-common-2:19.1.1-322.g7741f7f9.el9.x86_64 29/34 2024-09-13T19:13:23.053 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-common-2:19.1.1-322.g7741f7f9.el9.x86_64 29/34 2024-09-13T19:13:23.609 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-common-2:19.1.1-322.g7741f7f9.el9.x86_64 29/34 2024-09-13T19:13:23.633 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-common-2:19.1.1-322.g7741f7f9.el9.x86_64 29/34 2024-09-13T19:13:23.648 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-base-2:19.1.1-322.g7741f7f9.el9.x86_64 30/34 2024-09-13T19:13:23.726 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-base-2:19.1.1-322.g7741f7f9.el9.x86_64 30/34 2024-09-13T19:13:23.761 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-base-2:19.1.1-322.g7741f7f9.el9.x86_64 30/34 2024-09-13T19:13:23.761 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T19:13:23.761 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T19:13:23.761 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:13:23.799 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-selinux-2:19.1.1-322.g7741f7f9.el9.x86_64 31/34 2024-09-13T19:13:23.829 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-base-2:19.1.1-322.g7741f7f9.el9.x86_64 30/34 2024-09-13T19:13:23.829 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T19:13:23.829 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T19:13:23.829 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:13:23.860 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-selinux-2:19.1.1-322.g7741f7f9.el9.x86_64 31/34 2024-09-13T19:13:33.715 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-selinux-2:19.1.1-322.g7741f7f9.el9.x86_64 31/34 2024-09-13T19:13:33.716 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /sys 2024-09-13T19:13:33.716 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /proc 2024-09-13T19:13:33.716 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /mnt 2024-09-13T19:13:33.716 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /var/tmp 2024-09-13T19:13:33.716 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /home 2024-09-13T19:13:33.716 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /root 2024-09-13T19:13:33.716 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /tmp 2024-09-13T19:13:33.716 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:13:34.336 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-selinux-2:19.1.1-322.g7741f7f9.el9.x86_64 31/34 2024-09-13T19:13:34.336 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /sys 2024-09-13T19:13:34.336 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /proc 2024-09-13T19:13:34.336 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /mnt 2024-09-13T19:13:34.336 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /var/tmp 2024-09-13T19:13:34.336 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /home 2024-09-13T19:13:34.336 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /root 2024-09-13T19:13:34.336 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /tmp 2024-09-13T19:13:34.337 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:13:34.694 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-radosgw-2:19.1.1-322.g7741f7f9.el9.x86_64 32/34 2024-09-13T19:13:34.719 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-322.g7741f7f9.el9.x86_64 32/34 2024-09-13T19:13:34.719 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T19:13:34.719 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T19:13:34.719 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T19:13:34.719 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T19:13:34.719 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:13:34.721 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-13T19:13:34.805 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-13T19:13:34.805 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-13T19:13:35.324 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-radosgw-2:19.1.1-322.g7741f7f9.el9.x86_64 32/34 2024-09-13T19:13:35.351 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-322.g7741f7f9.el9.x86_64 32/34 2024-09-13T19:13:35.351 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T19:13:35.352 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T19:13:35.352 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T19:13:35.352 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T19:13:35.352 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:13:35.353 INFO:teuthology.orchestra.run.smithi053.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-13T19:13:35.443 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-13T19:13:35.443 INFO:teuthology.orchestra.run.smithi053.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-13T19:13:35.964 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-13T19:13:35.964 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-base-2:19.1.1-322.g7741f7f9.el9.x86_64 1/34 2024-09-13T19:13:35.965 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-common-2:19.1.1-322.g7741f7f9.el9.x86_64 2/34 2024-09-13T19:13:35.965 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-radosgw-2:19.1.1-322.g7741f7f9.el9.x86_64 3/34 2024-09-13T19:13:35.965 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-selinux-2:19.1.1-322.g7741f7f9.el9.x86_64 4/34 2024-09-13T19:13:35.965 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcephfs2-2:19.1.1-322.g7741f7f9.el9.x86_64 5/34 2024-09-13T19:13:35.965 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libradosstriper1-2:19.1.1-322.g7741f7f9.el9.x86_64 6/34 2024-09-13T19:13:35.965 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librgw2-2:19.1.1-322.g7741f7f9.el9.x86_64 7/34 2024-09-13T19:13:35.965 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-ceph-argparse-2:19.1.1-322.g7741f7f9.el9.x 8/34 2024-09-13T19:13:35.965 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-ceph-common-2:19.1.1-322.g7741f7f9.el9.x86 9/34 2024-09-13T19:13:35.965 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cephfs-2:19.1.1-322.g7741f7f9.el9.x86_64 10/34 2024-09-13T19:13:35.965 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rados-2:19.1.1-322.g7741f7f9.el9.x86_64 11/34 2024-09-13T19:13:35.965 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rbd-2:19.1.1-322.g7741f7f9.el9.x86_64 12/34 2024-09-13T19:13:35.966 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rgw-2:19.1.1-322.g7741f7f9.el9.x86_64 13/34 2024-09-13T19:13:35.966 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-13T19:13:35.966 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-13T19:13:35.966 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-13T19:13:35.966 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-13T19:13:35.966 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-13T19:13:35.966 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-13T19:13:35.966 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-13T19:13:35.966 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-13T19:13:35.967 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-13T19:13:35.967 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 23/34 2024-09-13T19:13:35.967 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-13T19:13:35.967 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-13T19:13:35.967 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-13T19:13:35.967 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-13T19:13:35.968 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-13T19:13:35.968 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-13T19:13:35.968 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-13T19:13:35.968 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados2-2:19.1.1-322.g7741f7f9.el9.x86_64 31/34 2024-09-13T19:13:35.968 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-13T19:13:35.969 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librbd1-2:19.1.1-322.g7741f7f9.el9.x86_64 33/34 2024-09-13T19:13:36.678 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-13T19:13:36.679 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-base-2:19.1.1-322.g7741f7f9.el9.x86_64 1/34 2024-09-13T19:13:36.679 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-common-2:19.1.1-322.g7741f7f9.el9.x86_64 2/34 2024-09-13T19:13:36.679 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-radosgw-2:19.1.1-322.g7741f7f9.el9.x86_64 3/34 2024-09-13T19:13:36.679 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-selinux-2:19.1.1-322.g7741f7f9.el9.x86_64 4/34 2024-09-13T19:13:36.679 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libcephfs2-2:19.1.1-322.g7741f7f9.el9.x86_64 5/34 2024-09-13T19:13:36.679 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libradosstriper1-2:19.1.1-322.g7741f7f9.el9.x86_64 6/34 2024-09-13T19:13:36.679 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librgw2-2:19.1.1-322.g7741f7f9.el9.x86_64 7/34 2024-09-13T19:13:36.679 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-ceph-argparse-2:19.1.1-322.g7741f7f9.el9.x 8/34 2024-09-13T19:13:36.679 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-ceph-common-2:19.1.1-322.g7741f7f9.el9.x86 9/34 2024-09-13T19:13:36.679 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cephfs-2:19.1.1-322.g7741f7f9.el9.x86_64 10/34 2024-09-13T19:13:36.679 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-rados-2:19.1.1-322.g7741f7f9.el9.x86_64 11/34 2024-09-13T19:13:36.679 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-rbd-2:19.1.1-322.g7741f7f9.el9.x86_64 12/34 2024-09-13T19:13:36.679 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-rgw-2:19.1.1-322.g7741f7f9.el9.x86_64 13/34 2024-09-13T19:13:36.680 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-13T19:13:36.680 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-13T19:13:36.680 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-13T19:13:36.680 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-13T19:13:36.680 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-13T19:13:36.680 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-13T19:13:36.680 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-13T19:13:36.680 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-13T19:13:36.680 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-13T19:13:36.680 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 23/34 2024-09-13T19:13:36.680 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-13T19:13:36.680 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-13T19:13:36.680 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-13T19:13:36.681 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-13T19:13:36.681 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-13T19:13:36.681 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-13T19:13:36.681 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-13T19:13:36.681 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librados2-2:19.1.1-322.g7741f7f9.el9.x86_64 31/34 2024-09-13T19:13:36.681 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-13T19:13:36.681 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librbd1-2:19.1.1-322.g7741f7f9.el9.x86_64 33/34 2024-09-13T19:13:36.954 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-13T19:13:36.954 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:13:36.954 INFO:teuthology.orchestra.run.smithi102.stdout:Upgraded: 2024-09-13T19:13:36.954 INFO:teuthology.orchestra.run.smithi102.stdout: librados2-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:13:36.954 INFO:teuthology.orchestra.run.smithi102.stdout: librbd1-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:13:36.955 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-13T19:13:36.955 INFO:teuthology.orchestra.run.smithi102.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-13T19:13:36.955 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-base-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:13:36.955 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-common-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:13:36.955 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-radosgw-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:13:36.956 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-selinux-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:13:36.956 INFO:teuthology.orchestra.run.smithi102.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T19:13:36.956 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-13T19:13:36.956 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-13T19:13:36.956 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs2-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:13:36.957 INFO:teuthology.orchestra.run.smithi102.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T19:13:36.957 INFO:teuthology.orchestra.run.smithi102.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T19:13:36.957 INFO:teuthology.orchestra.run.smithi102.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T19:13:36.957 INFO:teuthology.orchestra.run.smithi102.stdout: libradosstriper1-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:13:36.957 INFO:teuthology.orchestra.run.smithi102.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T19:13:36.958 INFO:teuthology.orchestra.run.smithi102.stdout: librgw2-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:13:36.958 INFO:teuthology.orchestra.run.smithi102.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T19:13:36.958 INFO:teuthology.orchestra.run.smithi102.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T19:13:36.958 INFO:teuthology.orchestra.run.smithi102.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-13T19:13:36.958 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-argparse-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:13:36.958 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-common-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:13:36.958 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cephfs-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:13:36.958 INFO:teuthology.orchestra.run.smithi102.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T19:13:36.958 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rados-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:13:36.958 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rbd-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:13:36.958 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rgw-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:13:36.959 INFO:teuthology.orchestra.run.smithi102.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-13T19:13:36.959 INFO:teuthology.orchestra.run.smithi102.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-13T19:13:36.959 INFO:teuthology.orchestra.run.smithi102.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-13T19:13:36.959 INFO:teuthology.orchestra.run.smithi102.stdout: re2-1:20211101-20.el9.x86_64 2024-09-13T19:13:36.959 INFO:teuthology.orchestra.run.smithi102.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T19:13:36.959 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:13:36.959 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-13T19:13:37.325 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-test 2024-09-13T19:13:37.686 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-13T19:13:37.687 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:13:37.687 INFO:teuthology.orchestra.run.smithi053.stdout:Upgraded: 2024-09-13T19:13:37.687 INFO:teuthology.orchestra.run.smithi053.stdout: librados2-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:13:37.687 INFO:teuthology.orchestra.run.smithi053.stdout: librbd1-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:13:37.687 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-09-13T19:13:37.687 INFO:teuthology.orchestra.run.smithi053.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-13T19:13:37.687 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-base-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:13:37.687 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-common-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:13:37.687 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-radosgw-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:13:37.687 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-selinux-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:13:37.687 INFO:teuthology.orchestra.run.smithi053.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T19:13:37.688 INFO:teuthology.orchestra.run.smithi053.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-13T19:13:37.688 INFO:teuthology.orchestra.run.smithi053.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-13T19:13:37.688 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs2-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:13:37.688 INFO:teuthology.orchestra.run.smithi053.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T19:13:37.688 INFO:teuthology.orchestra.run.smithi053.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T19:13:37.688 INFO:teuthology.orchestra.run.smithi053.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T19:13:37.688 INFO:teuthology.orchestra.run.smithi053.stdout: libradosstriper1-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:13:37.688 INFO:teuthology.orchestra.run.smithi053.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T19:13:37.688 INFO:teuthology.orchestra.run.smithi053.stdout: librgw2-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:13:37.688 INFO:teuthology.orchestra.run.smithi053.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T19:13:37.688 INFO:teuthology.orchestra.run.smithi053.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T19:13:37.688 INFO:teuthology.orchestra.run.smithi053.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-13T19:13:37.689 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-argparse-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:13:37.689 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-common-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:13:37.689 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cephfs-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:13:37.689 INFO:teuthology.orchestra.run.smithi053.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T19:13:37.689 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rados-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:13:37.689 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rbd-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:13:37.689 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rgw-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:13:37.689 INFO:teuthology.orchestra.run.smithi053.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-13T19:13:37.689 INFO:teuthology.orchestra.run.smithi053.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-13T19:13:37.689 INFO:teuthology.orchestra.run.smithi053.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-13T19:13:37.689 INFO:teuthology.orchestra.run.smithi053.stdout: re2-1:20211101-20.el9.x86_64 2024-09-13T19:13:37.689 INFO:teuthology.orchestra.run.smithi053.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T19:13:37.689 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:13:37.689 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-13T19:13:37.889 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:00:28 ago on Fri 13 Sep 2024 07:13:09 PM UTC. 2024-09-13T19:13:38.024 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-13T19:13:38.024 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-13T19:13:38.024 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-09-13T19:13:38.024 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-13T19:13:38.024 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-13T19:13:38.024 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-test x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 49 M 2024-09-13T19:13:38.025 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-09-13T19:13:38.025 INFO:teuthology.orchestra.run.smithi102.stdout: libcephsqlite x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 163 k 2024-09-13T19:13:38.025 INFO:teuthology.orchestra.run.smithi102.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T19:13:38.025 INFO:teuthology.orchestra.run.smithi102.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T19:13:38.025 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:13:38.025 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-13T19:13:38.025 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-13T19:13:38.025 INFO:teuthology.orchestra.run.smithi102.stdout:Install 4 Packages 2024-09-13T19:13:38.025 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:13:38.026 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 49 M 2024-09-13T19:13:38.026 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 209 M 2024-09-13T19:13:38.026 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-13T19:13:38.027 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-test 2024-09-13T19:13:38.277 INFO:teuthology.orchestra.run.smithi102.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 2.0 MB/s | 304 kB 00:00 2024-09-13T19:13:38.310 INFO:teuthology.orchestra.run.smithi102.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.9 MB/s | 64 kB 00:00 2024-09-13T19:13:38.360 INFO:teuthology.orchestra.run.smithi102.stdout:(3/4): libcephsqlite-19.1.1-322.g7741f7f9.el9.x 697 kB/s | 163 kB 00:00 2024-09-13T19:13:38.616 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:00:29 ago on Fri 13 Sep 2024 07:13:09 PM UTC. 2024-09-13T19:13:38.754 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-13T19:13:38.755 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-13T19:13:38.755 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2024-09-13T19:13:38.755 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-13T19:13:38.755 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-09-13T19:13:38.755 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-test x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 49 M 2024-09-13T19:13:38.755 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2024-09-13T19:13:38.756 INFO:teuthology.orchestra.run.smithi053.stdout: libcephsqlite x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 163 k 2024-09-13T19:13:38.756 INFO:teuthology.orchestra.run.smithi053.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T19:13:38.756 INFO:teuthology.orchestra.run.smithi053.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T19:13:38.756 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:13:38.756 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-09-13T19:13:38.756 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-13T19:13:38.756 INFO:teuthology.orchestra.run.smithi053.stdout:Install 4 Packages 2024-09-13T19:13:38.756 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:13:38.757 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 49 M 2024-09-13T19:13:38.757 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 209 M 2024-09-13T19:13:38.757 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-09-13T19:13:39.008 INFO:teuthology.orchestra.run.smithi053.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 2.4 MB/s | 304 kB 00:00 2024-09-13T19:13:39.059 INFO:teuthology.orchestra.run.smithi053.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.3 MB/s | 64 kB 00:00 2024-09-13T19:13:39.267 INFO:teuthology.orchestra.run.smithi053.stdout:(3/4): libcephsqlite-19.1.1-322.g7741f7f9.el9.x 429 kB/s | 163 kB 00:00 2024-09-13T19:13:39.619 INFO:teuthology.orchestra.run.smithi102.stdout:(4/4): ceph-test-19.1.1-322.g7741f7f9.el9.x86_6 33 MB/s | 49 MB 00:01 2024-09-13T19:13:39.621 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-13T19:13:39.621 INFO:teuthology.orchestra.run.smithi102.stdout:Total 31 MB/s | 49 MB 00:01 2024-09-13T19:13:39.647 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-13T19:13:39.667 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-13T19:13:39.667 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-13T19:13:40.038 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-13T19:13:40.038 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-13T19:13:40.551 INFO:teuthology.orchestra.run.smithi053.stdout:(4/4): ceph-test-19.1.1-322.g7741f7f9.el9.x86_6 29 MB/s | 49 MB 00:01 2024-09-13T19:13:40.553 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-13T19:13:40.553 INFO:teuthology.orchestra.run.smithi053.stdout:Total 27 MB/s | 49 MB 00:01 2024-09-13T19:13:40.558 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-13T19:13:40.582 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-09-13T19:13:40.604 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-09-13T19:13:40.604 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-09-13T19:13:40.636 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-13T19:13:40.675 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-13T19:13:40.704 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcephsqlite-2:19.1.1-322.g7741f7f9.el9.x86_64 3/4 2024-09-13T19:13:40.995 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-09-13T19:13:40.995 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-09-13T19:13:41.545 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-09-13T19:13:41.632 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-13T19:13:41.692 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-13T19:13:41.719 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libcephsqlite-2:19.1.1-322.g7741f7f9.el9.x86_64 3/4 2024-09-13T19:13:45.305 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libcephsqlite-2:19.1.1-322.g7741f7f9.el9.x86_64 3/4 2024-09-13T19:13:45.385 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-test-2:19.1.1-322.g7741f7f9.el9.x86_64 4/4 2024-09-13T19:13:46.612 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libcephsqlite-2:19.1.1-322.g7741f7f9.el9.x86_64 3/4 2024-09-13T19:13:46.695 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-test-2:19.1.1-322.g7741f7f9.el9.x86_64 4/4 2024-09-13T19:13:47.780 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-test-2:19.1.1-322.g7741f7f9.el9.x86_64 4/4 2024-09-13T19:13:47.780 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-test-2:19.1.1-322.g7741f7f9.el9.x86_64 1/4 2024-09-13T19:13:47.780 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcephsqlite-2:19.1.1-322.g7741f7f9.el9.x86_64 2/4 2024-09-13T19:13:47.780 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-13T19:13:48.117 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-13T19:13:48.117 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:13:48.118 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-13T19:13:48.118 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-test-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:13:48.118 INFO:teuthology.orchestra.run.smithi102.stdout: libcephsqlite-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:13:48.118 INFO:teuthology.orchestra.run.smithi102.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T19:13:48.118 INFO:teuthology.orchestra.run.smithi102.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T19:13:48.118 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:13:48.118 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-13T19:13:48.412 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph 2024-09-13T19:13:48.988 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:00:39 ago on Fri 13 Sep 2024 07:13:09 PM UTC. 2024-09-13T19:13:49.123 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-test-2:19.1.1-322.g7741f7f9.el9.x86_64 4/4 2024-09-13T19:13:49.124 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-test-2:19.1.1-322.g7741f7f9.el9.x86_64 1/4 2024-09-13T19:13:49.124 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libcephsqlite-2:19.1.1-322.g7741f7f9.el9.x86_64 2/4 2024-09-13T19:13:49.124 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-13T19:13:49.143 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-13T19:13:49.145 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-13T19:13:49.145 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-09-13T19:13:49.145 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-13T19:13:49.145 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-13T19:13:49.145 INFO:teuthology.orchestra.run.smithi102.stdout: ceph x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 6.6 k 2024-09-13T19:13:49.145 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-09-13T19:13:49.146 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mds x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 2.4 M 2024-09-13T19:13:49.146 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 1.5 M 2024-09-13T19:13:49.146 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-modules-core noarch 2:19.1.1-322.g7741f7f9.el9 ceph-noarch 249 k 2024-09-13T19:13:49.146 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mon x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 4.7 M 2024-09-13T19:13:49.146 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-osd x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 17 M 2024-09-13T19:13:49.146 INFO:teuthology.orchestra.run.smithi102.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-13T19:13:49.146 INFO:teuthology.orchestra.run.smithi102.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-13T19:13:49.146 INFO:teuthology.orchestra.run.smithi102.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-13T19:13:49.146 INFO:teuthology.orchestra.run.smithi102.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T19:13:49.146 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T19:13:49.146 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T19:13:49.146 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T19:13:49.147 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T19:13:49.147 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T19:13:49.147 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T19:13:49.147 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-13T19:13:49.147 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T19:13:49.147 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T19:13:49.147 INFO:teuthology.orchestra.run.smithi102.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T19:13:49.147 INFO:teuthology.orchestra.run.smithi102.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T19:13:49.147 INFO:teuthology.orchestra.run.smithi102.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T19:13:49.147 INFO:teuthology.orchestra.run.smithi102.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T19:13:49.147 INFO:teuthology.orchestra.run.smithi102.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-13T19:13:49.147 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T19:13:49.147 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T19:13:49.148 INFO:teuthology.orchestra.run.smithi102.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T19:13:49.148 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T19:13:49.148 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T19:13:49.148 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T19:13:49.148 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T19:13:49.148 INFO:teuthology.orchestra.run.smithi102.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T19:13:49.148 INFO:teuthology.orchestra.run.smithi102.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T19:13:49.148 INFO:teuthology.orchestra.run.smithi102.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T19:13:49.148 INFO:teuthology.orchestra.run.smithi102.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T19:13:49.148 INFO:teuthology.orchestra.run.smithi102.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T19:13:49.148 INFO:teuthology.orchestra.run.smithi102.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T19:13:49.148 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:13:49.149 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-13T19:13:49.149 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-13T19:13:49.149 INFO:teuthology.orchestra.run.smithi102.stdout:Install 37 Packages 2024-09-13T19:13:49.149 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:13:49.149 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 30 M 2024-09-13T19:13:49.149 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 108 M 2024-09-13T19:13:49.149 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-13T19:13:49.494 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-13T19:13:49.495 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:13:49.495 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-09-13T19:13:49.495 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-test-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:13:49.495 INFO:teuthology.orchestra.run.smithi053.stdout: libcephsqlite-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:13:49.495 INFO:teuthology.orchestra.run.smithi053.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T19:13:49.495 INFO:teuthology.orchestra.run.smithi053.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T19:13:49.495 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:13:49.495 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-13T19:13:49.765 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph 2024-09-13T19:13:50.112 INFO:teuthology.orchestra.run.smithi102.stdout:(1/37): ceph-19.1.1-322.g7741f7f9.el9.x86_64.rp 49 kB/s | 6.6 kB 00:00 2024-09-13T19:13:50.279 INFO:teuthology.orchestra.run.smithi102.stdout:(2/37): ceph-mgr-19.1.1-322.g7741f7f9.el9.x86_6 5.1 MB/s | 1.5 MB 00:00 2024-09-13T19:13:50.350 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:00:41 ago on Fri 13 Sep 2024 07:13:09 PM UTC. 2024-09-13T19:13:50.356 INFO:teuthology.orchestra.run.smithi102.stdout:(3/37): ceph-mds-19.1.1-322.g7741f7f9.el9.x86_6 6.3 MB/s | 2.4 MB 00:00 2024-09-13T19:13:50.446 INFO:teuthology.orchestra.run.smithi102.stdout:(4/37): ceph-mgr-modules-core-19.1.1-322.g7741f 2.7 MB/s | 249 kB 00:00 2024-09-13T19:13:50.498 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-13T19:13:50.501 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-13T19:13:50.501 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2024-09-13T19:13:50.501 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-13T19:13:50.501 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-09-13T19:13:50.501 INFO:teuthology.orchestra.run.smithi053.stdout: ceph x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 6.6 k 2024-09-13T19:13:50.501 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2024-09-13T19:13:50.501 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mds x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 2.4 M 2024-09-13T19:13:50.501 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 1.5 M 2024-09-13T19:13:50.501 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-modules-core noarch 2:19.1.1-322.g7741f7f9.el9 ceph-noarch 249 k 2024-09-13T19:13:50.501 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mon x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 4.7 M 2024-09-13T19:13:50.501 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-osd x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 17 M 2024-09-13T19:13:50.502 INFO:teuthology.orchestra.run.smithi053.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-13T19:13:50.502 INFO:teuthology.orchestra.run.smithi053.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-13T19:13:50.502 INFO:teuthology.orchestra.run.smithi053.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-13T19:13:50.502 INFO:teuthology.orchestra.run.smithi053.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T19:13:50.502 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T19:13:50.502 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T19:13:50.502 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T19:13:50.502 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T19:13:50.502 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T19:13:50.502 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T19:13:50.502 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-13T19:13:50.502 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T19:13:50.502 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T19:13:50.502 INFO:teuthology.orchestra.run.smithi053.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T19:13:50.503 INFO:teuthology.orchestra.run.smithi053.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T19:13:50.503 INFO:teuthology.orchestra.run.smithi053.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T19:13:50.503 INFO:teuthology.orchestra.run.smithi053.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T19:13:50.503 INFO:teuthology.orchestra.run.smithi053.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-13T19:13:50.503 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T19:13:50.503 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T19:13:50.503 INFO:teuthology.orchestra.run.smithi053.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T19:13:50.503 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T19:13:50.503 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T19:13:50.503 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T19:13:50.503 INFO:teuthology.orchestra.run.smithi053.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T19:13:50.503 INFO:teuthology.orchestra.run.smithi053.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T19:13:50.503 INFO:teuthology.orchestra.run.smithi053.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T19:13:50.503 INFO:teuthology.orchestra.run.smithi053.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T19:13:50.504 INFO:teuthology.orchestra.run.smithi053.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T19:13:50.504 INFO:teuthology.orchestra.run.smithi053.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T19:13:50.504 INFO:teuthology.orchestra.run.smithi053.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T19:13:50.504 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:13:50.504 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-09-13T19:13:50.504 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-13T19:13:50.504 INFO:teuthology.orchestra.run.smithi053.stdout:Install 37 Packages 2024-09-13T19:13:50.504 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:13:50.505 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 30 M 2024-09-13T19:13:50.505 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 108 M 2024-09-13T19:13:50.505 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-09-13T19:13:50.513 INFO:teuthology.orchestra.run.smithi102.stdout:(5/37): ceph-mon-19.1.1-322.g7741f7f9.el9.x86_6 12 MB/s | 4.7 MB 00:00 2024-09-13T19:13:50.855 INFO:teuthology.orchestra.run.smithi102.stdout:(6/37): ceph-osd-19.1.1-322.g7741f7f9.el9.x86_6 29 MB/s | 17 MB 00:00 2024-09-13T19:13:50.938 INFO:teuthology.orchestra.run.smithi053.stdout:(1/37): ceph-19.1.1-322.g7741f7f9.el9.x86_64.rp 49 kB/s | 6.6 kB 00:00 2024-09-13T19:13:51.114 INFO:teuthology.orchestra.run.smithi053.stdout:(2/37): ceph-mgr-19.1.1-322.g7741f7f9.el9.x86_6 4.9 MB/s | 1.5 MB 00:00 2024-09-13T19:13:51.189 INFO:teuthology.orchestra.run.smithi053.stdout:(3/37): ceph-mds-19.1.1-322.g7741f7f9.el9.x86_6 6.2 MB/s | 2.4 MB 00:00 2024-09-13T19:13:51.273 INFO:teuthology.orchestra.run.smithi053.stdout:(4/37): ceph-mgr-modules-core-19.1.1-322.g7741f 2.9 MB/s | 249 kB 00:00 2024-09-13T19:13:51.330 INFO:teuthology.orchestra.run.smithi102.stdout:(7/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 287 kB/s | 253 kB 00:00 2024-09-13T19:13:51.339 INFO:teuthology.orchestra.run.smithi053.stdout:(5/37): ceph-mon-19.1.1-322.g7741f7f9.el9.x86_6 12 MB/s | 4.7 MB 00:00 2024-09-13T19:13:51.522 INFO:teuthology.orchestra.run.smithi102.stdout:(8/37): python3-ply-3.11-14.el9.noarch.rpm 162 kB/s | 106 kB 00:00 2024-09-13T19:13:51.531 INFO:teuthology.orchestra.run.smithi053.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 980 kB/s | 253 kB 00:00 2024-09-13T19:13:51.681 INFO:teuthology.orchestra.run.smithi102.stdout:(9/37): python3-cryptography-36.0.1-4.el9.x86_6 1.0 MB/s | 1.2 MB 00:01 2024-09-13T19:13:51.715 INFO:teuthology.orchestra.run.smithi053.stdout:(7/37): ceph-osd-19.1.1-322.g7741f7f9.el9.x86_6 28 MB/s | 17 MB 00:00 2024-09-13T19:13:51.749 INFO:teuthology.orchestra.run.smithi053.stdout:(8/37): python3-ply-3.11-14.el9.noarch.rpm 491 kB/s | 106 kB 00:00 2024-09-13T19:13:51.799 INFO:teuthology.orchestra.run.smithi053.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 2.4 MB/s | 125 kB 00:00 2024-09-13T19:13:51.866 INFO:teuthology.orchestra.run.smithi053.stdout:(10/37): python3-urllib3-1.26.5-6.el9.noarch.rp 3.1 MB/s | 215 kB 00:00 2024-09-13T19:13:51.900 INFO:teuthology.orchestra.run.smithi053.stdout:(11/37): python3-pycparser-2.20-6.el9.noarch.rp 734 kB/s | 135 kB 00:00 2024-09-13T19:13:52.025 INFO:teuthology.orchestra.run.smithi053.stdout:(12/37): python3-cryptography-36.0.1-4.el9.x86_ 1.8 MB/s | 1.2 MB 00:00 2024-09-13T19:13:52.081 INFO:teuthology.orchestra.run.smithi102.stdout:(10/37): python3-pycparser-2.20-6.el9.noarch.rp 180 kB/s | 135 kB 00:00 2024-09-13T19:13:52.084 INFO:teuthology.orchestra.run.smithi053.stdout:(13/37): lua-5.4.4-4.el9.x86_64.rpm 868 kB/s | 188 kB 00:00 2024-09-13T19:13:52.117 INFO:teuthology.orchestra.run.smithi053.stdout:(14/37): python3-mako-1.1.4-6.el9.noarch.rpm 794 kB/s | 172 kB 00:00 2024-09-13T19:13:52.142 INFO:teuthology.orchestra.run.smithi053.stdout:(15/37): python3-packaging-20.9-5.el9.noarch.rp 1.3 MB/s | 77 kB 00:00 2024-09-13T19:13:52.168 INFO:teuthology.orchestra.run.smithi053.stdout:(16/37): python3-markupsafe-1.1.1-12.el9.x86_64 244 kB/s | 35 kB 00:00 2024-09-13T19:13:52.193 INFO:teuthology.orchestra.run.smithi053.stdout:(17/37): python3-pytz-2021.1-5.el9.noarch.rpm 675 kB/s | 51 kB 00:00 2024-09-13T19:13:52.198 INFO:teuthology.orchestra.run.smithi102.stdout:(11/37): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-13T19:13:52.218 INFO:teuthology.orchestra.run.smithi053.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 551 kB/s | 42 kB 00:00 2024-09-13T19:13:52.223 INFO:teuthology.orchestra.run.smithi102.stdout:(12/37): python3-requests-2.25.1-8.el9.noarch.r 178 kB/s | 125 kB 00:00 2024-09-13T19:13:52.248 INFO:teuthology.orchestra.run.smithi102.stdout:(13/37): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-13T19:13:52.277 INFO:teuthology.orchestra.run.smithi053.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 1.8 MB/s | 151 kB 00:00 2024-09-13T19:13:52.290 INFO:teuthology.orchestra.run.smithi102.stdout:(14/37): python3-packaging-20.9-5.el9.noarch.rp 1.8 MB/s | 77 kB 00:00 2024-09-13T19:13:52.302 INFO:teuthology.orchestra.run.smithi053.stdout:(20/37): lua-devel-5.4.4-4.el9.x86_64.rpm 166 kB/s | 22 kB 00:00 2024-09-13T19:13:52.316 INFO:teuthology.orchestra.run.smithi102.stdout:(15/37): python3-markupsafe-1.1.1-12.el9.x86_64 377 kB/s | 35 kB 00:00 2024-09-13T19:13:52.336 INFO:teuthology.orchestra.run.smithi053.stdout:(21/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 371 kB/s | 43 kB 00:00 2024-09-13T19:13:52.341 INFO:teuthology.orchestra.run.smithi102.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-13T19:13:52.361 INFO:teuthology.orchestra.run.smithi053.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 466 kB/s | 11 kB 00:00 2024-09-13T19:13:52.366 INFO:teuthology.orchestra.run.smithi102.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 833 kB/s | 42 kB 00:00 2024-09-13T19:13:52.395 INFO:teuthology.orchestra.run.smithi053.stdout:(23/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.5 MB/s | 172 kB 00:00 2024-09-13T19:13:52.408 INFO:teuthology.orchestra.run.smithi102.stdout:(18/37): luarocks-3.9.2-5.el9.noarch.rpm 3.5 MB/s | 151 kB 00:00 2024-09-13T19:13:52.420 INFO:teuthology.orchestra.run.smithi053.stdout:(24/37): python3-jaraco-classes-3.2.1-5.el9.noa 302 kB/s | 18 kB 00:00 2024-09-13T19:13:52.434 INFO:teuthology.orchestra.run.smithi102.stdout:(19/37): lua-devel-5.4.4-4.el9.x86_64.rpm 242 kB/s | 22 kB 00:00 2024-09-13T19:13:52.445 INFO:teuthology.orchestra.run.smithi053.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 462 kB/s | 23 kB 00:00 2024-09-13T19:13:52.459 INFO:teuthology.orchestra.run.smithi102.stdout:(20/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 865 kB/s | 43 kB 00:00 2024-09-13T19:13:52.470 INFO:teuthology.orchestra.run.smithi053.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 387 kB/s | 19 kB 00:00 2024-09-13T19:13:52.493 INFO:teuthology.orchestra.run.smithi102.stdout:(21/37): python3-urllib3-1.26.5-6.el9.noarch.rp 265 kB/s | 215 kB 00:00 2024-09-13T19:13:52.496 INFO:teuthology.orchestra.run.smithi053.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 392 kB/s | 20 kB 00:00 2024-09-13T19:13:52.521 INFO:teuthology.orchestra.run.smithi053.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 921 kB/s | 46 kB 00:00 2024-09-13T19:13:52.535 INFO:teuthology.orchestra.run.smithi102.stdout:(22/37): python3-cherrypy-18.6.1-2.el9.noarch.r 5.2 MB/s | 358 kB 00:00 2024-09-13T19:13:52.555 INFO:teuthology.orchestra.run.smithi053.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.3 MB/s | 79 kB 00:00 2024-09-13T19:13:52.560 INFO:teuthology.orchestra.run.smithi102.stdout:(23/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-13T19:13:52.580 INFO:teuthology.orchestra.run.smithi053.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 659 kB/s | 16 kB 00:00 2024-09-13T19:13:52.585 INFO:teuthology.orchestra.run.smithi102.stdout:(24/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 118 kB/s | 11 kB 00:00 2024-09-13T19:13:52.613 INFO:teuthology.orchestra.run.smithi102.stdout:(25/37): python3-jaraco-classes-3.2.1-5.el9.noa 239 kB/s | 18 kB 00:00 2024-09-13T19:13:52.622 INFO:teuthology.orchestra.run.smithi053.stdout:(31/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.1 MB/s | 358 kB 00:00 2024-09-13T19:13:52.641 INFO:teuthology.orchestra.run.smithi102.stdout:(26/37): python3-jaraco-collections-3.0.0-8.el9 307 kB/s | 23 kB 00:00 2024-09-13T19:13:52.656 INFO:teuthology.orchestra.run.smithi053.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2024-09-13T19:13:52.661 INFO:teuthology.orchestra.run.smithi102.stdout:(27/37): python3-jaraco-functools-3.5.0-2.el9.n 258 kB/s | 19 kB 00:00 2024-09-13T19:13:52.681 INFO:teuthology.orchestra.run.smithi053.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 611 kB/s | 36 kB 00:00 2024-09-13T19:13:52.686 INFO:teuthology.orchestra.run.smithi102.stdout:(28/37): python3-jaraco-text-3.2.0-6.el9.noarch 261 kB/s | 20 kB 00:00 2024-09-13T19:13:52.706 INFO:teuthology.orchestra.run.smithi053.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.4 MB/s | 272 kB 00:00 2024-09-13T19:13:52.711 INFO:teuthology.orchestra.run.smithi102.stdout:(29/37): python3-logutils-0.3.5-21.el9.noarch.r 923 kB/s | 46 kB 00:00 2024-09-13T19:13:52.731 INFO:teuthology.orchestra.run.smithi053.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 805 kB/s | 20 kB 00:00 2024-09-13T19:13:52.736 INFO:teuthology.orchestra.run.smithi102.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-09-13T19:13:52.762 INFO:teuthology.orchestra.run.smithi102.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 327 kB/s | 16 kB 00:00 2024-09-13T19:13:52.765 INFO:teuthology.orchestra.run.smithi053.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-13T19:13:52.787 INFO:teuthology.orchestra.run.smithi102.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.7 MB/s | 90 kB 00:00 2024-09-13T19:13:52.798 INFO:teuthology.orchestra.run.smithi053.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.6 MB/s | 427 kB 00:00 2024-09-13T19:13:52.802 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-13T19:13:52.802 INFO:teuthology.orchestra.run.smithi053.stdout:Total 13 MB/s | 30 MB 00:02 2024-09-13T19:13:52.814 INFO:teuthology.orchestra.run.smithi102.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 717 kB/s | 36 kB 00:00 2024-09-13T19:13:52.838 INFO:teuthology.orchestra.run.smithi102.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-13T19:13:52.863 INFO:teuthology.orchestra.run.smithi102.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 805 kB/s | 20 kB 00:00 2024-09-13T19:13:52.891 INFO:teuthology.orchestra.run.smithi102.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.9 MB/s | 230 kB 00:00 2024-09-13T19:13:52.925 INFO:teuthology.orchestra.run.smithi102.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.7 MB/s | 427 kB 00:00 2024-09-13T19:13:52.930 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-13T19:13:52.930 INFO:teuthology.orchestra.run.smithi102.stdout:Total 8.0 MB/s | 30 MB 00:03 2024-09-13T19:13:52.961 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-09-13T19:13:53.004 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-09-13T19:13:53.004 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-09-13T19:13:53.079 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-13T19:13:53.118 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-13T19:13:53.119 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-13T19:13:53.515 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-09-13T19:13:53.515 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-09-13T19:13:53.585 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-13T19:13:53.586 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-13T19:13:54.922 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-09-13T19:13:54.963 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-13T19:13:54.993 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-13T19:13:55.027 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-13T19:13:55.037 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-13T19:13:55.066 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-13T19:13:55.086 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-13T19:13:55.122 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-13T19:13:55.145 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-13T19:13:55.193 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-13T19:13:55.194 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-13T19:13:55.235 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-13T19:13:55.246 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-13T19:13:55.279 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-13T19:13:55.339 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-13T19:13:55.379 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-13T19:13:55.417 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-13T19:13:55.449 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-13T19:13:55.463 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-13T19:13:55.490 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-13T19:13:55.498 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-13T19:13:55.525 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-13T19:13:55.527 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-13T19:13:55.555 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-13T19:13:55.562 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-13T19:13:55.590 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-13T19:13:55.603 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-13T19:13:55.623 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-13T19:13:55.653 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-13T19:13:55.663 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-13T19:13:55.696 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-13T19:13:55.706 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-13T19:13:55.730 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-13T19:13:55.749 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-13T19:13:55.779 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-13T19:13:55.798 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-13T19:13:55.819 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-13T19:13:55.830 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-13T19:13:55.895 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-13T19:13:55.903 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-13T19:13:56.041 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-13T19:13:56.047 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-13T19:13:56.122 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-13T19:13:56.138 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-13T19:13:56.175 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-13T19:13:56.197 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-13T19:13:56.222 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-13T19:13:56.235 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-13T19:13:56.278 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-13T19:13:56.293 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-13T19:13:56.344 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-13T19:13:56.357 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-13T19:13:56.530 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-13T19:13:56.560 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-13T19:13:56.577 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-13T19:13:56.606 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-13T19:13:56.655 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-13T19:13:56.686 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-13T19:13:56.752 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-13T19:13:56.776 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-13T19:13:56.793 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-13T19:13:56.813 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-13T19:13:56.910 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-13T19:13:56.944 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-13T19:13:57.073 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-322.g7741f7f9.el9.n 32/37 2024-09-13T19:13:57.117 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-322.g7741f7f9.el9.n 32/37 2024-09-13T19:13:57.125 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-2:19.1.1-322.g7741f7f9.el9.x86_64 33/37 2024-09-13T19:13:57.147 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-2:19.1.1-322.g7741f7f9.el9.x86_64 33/37 2024-09-13T19:13:57.151 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-2:19.1.1-322.g7741f7f9.el9.x86_64 33/37 2024-09-13T19:13:57.151 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T19:13:57.151 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T19:13:57.151 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T19:13:57.151 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T19:13:57.152 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:13:57.176 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-2:19.1.1-322.g7741f7f9.el9.x86_64 33/37 2024-09-13T19:13:57.176 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T19:13:57.176 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T19:13:57.176 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T19:13:57.176 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T19:13:57.176 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:13:58.588 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-osd-2:19.1.1-322.g7741f7f9.el9.x86_64 34/37 2024-09-13T19:13:58.615 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-osd-2:19.1.1-322.g7741f7f9.el9.x86_64 34/37 2024-09-13T19:13:58.615 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T19:13:58.615 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T19:13:58.615 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T19:13:58.615 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T19:13:58.615 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:13:58.706 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-osd-2:19.1.1-322.g7741f7f9.el9.x86_64 34/37 2024-09-13T19:13:58.735 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-osd-2:19.1.1-322.g7741f7f9.el9.x86_64 34/37 2024-09-13T19:13:58.736 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T19:13:58.736 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T19:13:58.736 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T19:13:58.736 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T19:13:58.737 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:13:59.055 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mon-2:19.1.1-322.g7741f7f9.el9.x86_64 35/37 2024-09-13T19:13:59.079 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mon-2:19.1.1-322.g7741f7f9.el9.x86_64 35/37 2024-09-13T19:13:59.079 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T19:13:59.079 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T19:13:59.079 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T19:13:59.079 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T19:13:59.079 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:13:59.199 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mon-2:19.1.1-322.g7741f7f9.el9.x86_64 35/37 2024-09-13T19:13:59.224 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mon-2:19.1.1-322.g7741f7f9.el9.x86_64 35/37 2024-09-13T19:13:59.224 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T19:13:59.224 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T19:13:59.224 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T19:13:59.225 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T19:13:59.225 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:13:59.306 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mds-2:19.1.1-322.g7741f7f9.el9.x86_64 36/37 2024-09-13T19:13:59.330 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mds-2:19.1.1-322.g7741f7f9.el9.x86_64 36/37 2024-09-13T19:13:59.330 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T19:13:59.330 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T19:13:59.330 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T19:13:59.330 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T19:13:59.330 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:13:59.395 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-2:19.1.1-322.g7741f7f9.el9.x86_64 37/37 2024-09-13T19:13:59.466 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mds-2:19.1.1-322.g7741f7f9.el9.x86_64 36/37 2024-09-13T19:13:59.494 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mds-2:19.1.1-322.g7741f7f9.el9.x86_64 36/37 2024-09-13T19:13:59.494 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T19:13:59.494 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T19:13:59.494 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T19:13:59.494 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T19:13:59.494 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:13:59.557 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-2:19.1.1-322.g7741f7f9.el9.x86_64 37/37 2024-09-13T19:14:01.150 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-2:19.1.1-322.g7741f7f9.el9.x86_64 37/37 2024-09-13T19:14:01.150 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-2:19.1.1-322.g7741f7f9.el9.x86_64 1/37 2024-09-13T19:14:01.150 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mds-2:19.1.1-322.g7741f7f9.el9.x86_64 2/37 2024-09-13T19:14:01.151 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-2:19.1.1-322.g7741f7f9.el9.x86_64 3/37 2024-09-13T19:14:01.151 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mon-2:19.1.1-322.g7741f7f9.el9.x86_64 4/37 2024-09-13T19:14:01.151 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-osd-2:19.1.1-322.g7741f7f9.el9.x86_64 5/37 2024-09-13T19:14:01.151 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-322.g7741f7f9.el9.n 6/37 2024-09-13T19:14:01.151 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-13T19:14:01.151 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-13T19:14:01.151 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-13T19:14:01.151 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-13T19:14:01.151 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-13T19:14:01.151 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-13T19:14:01.151 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-13T19:14:01.151 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-13T19:14:01.151 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-13T19:14:01.151 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-13T19:14:01.151 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-13T19:14:01.152 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-13T19:14:01.152 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-13T19:14:01.152 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-13T19:14:01.152 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-13T19:14:01.152 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-13T19:14:01.152 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-13T19:14:01.152 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-13T19:14:01.152 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-13T19:14:01.152 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-13T19:14:01.152 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-13T19:14:01.152 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-13T19:14:01.152 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-13T19:14:01.153 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-13T19:14:01.153 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-13T19:14:01.153 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-13T19:14:01.153 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-13T19:14:01.153 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-13T19:14:01.153 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-13T19:14:01.153 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-13T19:14:01.426 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-2:19.1.1-322.g7741f7f9.el9.x86_64 37/37 2024-09-13T19:14:01.426 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-2:19.1.1-322.g7741f7f9.el9.x86_64 1/37 2024-09-13T19:14:01.427 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mds-2:19.1.1-322.g7741f7f9.el9.x86_64 2/37 2024-09-13T19:14:01.427 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-2:19.1.1-322.g7741f7f9.el9.x86_64 3/37 2024-09-13T19:14:01.427 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mon-2:19.1.1-322.g7741f7f9.el9.x86_64 4/37 2024-09-13T19:14:01.427 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-osd-2:19.1.1-322.g7741f7f9.el9.x86_64 5/37 2024-09-13T19:14:01.427 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-322.g7741f7f9.el9.n 6/37 2024-09-13T19:14:01.427 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-13T19:14:01.427 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-13T19:14:01.427 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-13T19:14:01.427 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-13T19:14:01.427 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-13T19:14:01.427 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-13T19:14:01.428 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-13T19:14:01.428 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-13T19:14:01.428 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-13T19:14:01.428 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-13T19:14:01.428 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-13T19:14:01.428 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-13T19:14:01.428 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-13T19:14:01.428 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-13T19:14:01.428 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-13T19:14:01.429 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-13T19:14:01.429 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-13T19:14:01.429 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-13T19:14:01.429 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-13T19:14:01.429 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-13T19:14:01.429 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-13T19:14:01.429 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-13T19:14:01.429 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-13T19:14:01.429 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-13T19:14:01.429 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-13T19:14:01.429 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-13T19:14:01.429 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-13T19:14:01.429 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-13T19:14:01.430 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-13T19:14:01.430 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-13T19:14:02.259 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-13T19:14:02.260 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:14:02.260 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-13T19:14:02.260 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:14:02.260 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mds-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:14:02.260 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:14:02.260 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-modules-core-2:19.1.1-322.g7741f7f9.el9.noarch 2024-09-13T19:14:02.260 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mon-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:14:02.260 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-osd-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:14:02.260 INFO:teuthology.orchestra.run.smithi102.stdout: lua-5.4.4-4.el9.x86_64 2024-09-13T19:14:02.260 INFO:teuthology.orchestra.run.smithi102.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-13T19:14:02.261 INFO:teuthology.orchestra.run.smithi102.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-13T19:14:02.261 INFO:teuthology.orchestra.run.smithi102.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T19:14:02.261 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T19:14:02.261 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T19:14:02.261 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T19:14:02.261 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T19:14:02.261 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T19:14:02.261 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T19:14:02.261 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T19:14:02.261 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T19:14:02.261 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T19:14:02.261 INFO:teuthology.orchestra.run.smithi102.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T19:14:02.262 INFO:teuthology.orchestra.run.smithi102.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T19:14:02.262 INFO:teuthology.orchestra.run.smithi102.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T19:14:02.262 INFO:teuthology.orchestra.run.smithi102.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T19:14:02.262 INFO:teuthology.orchestra.run.smithi102.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-13T19:14:02.262 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T19:14:02.262 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T19:14:02.262 INFO:teuthology.orchestra.run.smithi102.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T19:14:02.262 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T19:14:02.262 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T19:14:02.262 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T19:14:02.262 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T19:14:02.262 INFO:teuthology.orchestra.run.smithi102.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T19:14:02.262 INFO:teuthology.orchestra.run.smithi102.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T19:14:02.262 INFO:teuthology.orchestra.run.smithi102.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T19:14:02.262 INFO:teuthology.orchestra.run.smithi102.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T19:14:02.263 INFO:teuthology.orchestra.run.smithi102.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T19:14:02.263 INFO:teuthology.orchestra.run.smithi102.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T19:14:02.263 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:14:02.263 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-13T19:14:02.339 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-13T19:14:02.340 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:02.340 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-09-13T19:14:02.340 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:14:02.340 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mds-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:14:02.340 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:14:02.340 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-modules-core-2:19.1.1-322.g7741f7f9.el9.noarch 2024-09-13T19:14:02.340 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mon-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:14:02.340 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-osd-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:14:02.340 INFO:teuthology.orchestra.run.smithi053.stdout: lua-5.4.4-4.el9.x86_64 2024-09-13T19:14:02.340 INFO:teuthology.orchestra.run.smithi053.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-13T19:14:02.340 INFO:teuthology.orchestra.run.smithi053.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-13T19:14:02.342 INFO:teuthology.orchestra.run.smithi053.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T19:14:02.342 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T19:14:02.343 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T19:14:02.343 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T19:14:02.343 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T19:14:02.343 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T19:14:02.343 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T19:14:02.343 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T19:14:02.343 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T19:14:02.343 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T19:14:02.343 INFO:teuthology.orchestra.run.smithi053.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T19:14:02.343 INFO:teuthology.orchestra.run.smithi053.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T19:14:02.343 INFO:teuthology.orchestra.run.smithi053.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T19:14:02.343 INFO:teuthology.orchestra.run.smithi053.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T19:14:02.343 INFO:teuthology.orchestra.run.smithi053.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-13T19:14:02.344 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T19:14:02.344 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T19:14:02.344 INFO:teuthology.orchestra.run.smithi053.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T19:14:02.344 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T19:14:02.344 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T19:14:02.344 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T19:14:02.344 INFO:teuthology.orchestra.run.smithi053.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T19:14:02.344 INFO:teuthology.orchestra.run.smithi053.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T19:14:02.344 INFO:teuthology.orchestra.run.smithi053.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T19:14:02.344 INFO:teuthology.orchestra.run.smithi053.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T19:14:02.344 INFO:teuthology.orchestra.run.smithi053.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T19:14:02.344 INFO:teuthology.orchestra.run.smithi053.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T19:14:02.344 INFO:teuthology.orchestra.run.smithi053.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T19:14:02.345 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:02.345 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-13T19:14:02.649 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-base 2024-09-13T19:14:02.735 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-base 2024-09-13T19:14:03.212 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:00:54 ago on Fri 13 Sep 2024 07:13:09 PM UTC. 2024-09-13T19:14:03.301 INFO:teuthology.orchestra.run.smithi102.stdout:Package ceph-base-2:19.1.1-322.g7741f7f9.el9.x86_64 is already installed. 2024-09-13T19:14:03.342 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-13T19:14:03.343 INFO:teuthology.orchestra.run.smithi102.stdout:Nothing to do. 2024-09-13T19:14:03.343 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-13T19:14:03.345 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:00:54 ago on Fri 13 Sep 2024 07:13:09 PM UTC. 2024-09-13T19:14:03.426 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install cephadm 2024-09-13T19:14:03.439 INFO:teuthology.orchestra.run.smithi053.stdout:Package ceph-base-2:19.1.1-322.g7741f7f9.el9.x86_64 is already installed. 2024-09-13T19:14:03.483 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-13T19:14:03.484 INFO:teuthology.orchestra.run.smithi053.stdout:Nothing to do. 2024-09-13T19:14:03.485 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-13T19:14:03.545 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install cephadm 2024-09-13T19:14:03.986 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:00:54 ago on Fri 13 Sep 2024 07:13:09 PM UTC. 2024-09-13T19:14:04.118 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-13T19:14:04.118 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-13T19:14:04.118 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-09-13T19:14:04.119 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-13T19:14:04.119 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-13T19:14:04.119 INFO:teuthology.orchestra.run.smithi102.stdout: cephadm noarch 2:19.1.1-322.g7741f7f9.el9 ceph-noarch 765 k 2024-09-13T19:14:04.119 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:14:04.119 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-13T19:14:04.119 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-13T19:14:04.119 INFO:teuthology.orchestra.run.smithi102.stdout:Install 1 Package 2024-09-13T19:14:04.119 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:14:04.119 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 765 k 2024-09-13T19:14:04.119 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 771 k 2024-09-13T19:14:04.119 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-13T19:14:04.131 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:00:55 ago on Fri 13 Sep 2024 07:13:09 PM UTC. 2024-09-13T19:14:04.268 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-13T19:14:04.268 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-13T19:14:04.268 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2024-09-13T19:14:04.268 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-13T19:14:04.268 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-09-13T19:14:04.268 INFO:teuthology.orchestra.run.smithi053.stdout: cephadm noarch 2:19.1.1-322.g7741f7f9.el9 ceph-noarch 765 k 2024-09-13T19:14:04.268 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:04.268 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-09-13T19:14:04.268 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-13T19:14:04.269 INFO:teuthology.orchestra.run.smithi053.stdout:Install 1 Package 2024-09-13T19:14:04.269 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:04.269 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 765 k 2024-09-13T19:14:04.269 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 771 k 2024-09-13T19:14:04.269 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-09-13T19:14:04.380 INFO:teuthology.orchestra.run.smithi102.stdout:cephadm-19.1.1-322.g7741f7f9.el9.noarch.rpm 2.9 MB/s | 765 kB 00:00 2024-09-13T19:14:04.380 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-13T19:14:04.381 INFO:teuthology.orchestra.run.smithi102.stdout:Total 2.9 MB/s | 765 kB 00:00 2024-09-13T19:14:04.381 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-13T19:14:04.386 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-13T19:14:04.386 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-13T19:14:04.392 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-13T19:14:04.392 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-13T19:14:04.464 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-13T19:14:04.525 INFO:teuthology.orchestra.run.smithi053.stdout:cephadm-19.1.1-322.g7741f7f9.el9.noarch.rpm 2.9 MB/s | 765 kB 00:00 2024-09-13T19:14:04.525 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-13T19:14:04.526 INFO:teuthology.orchestra.run.smithi053.stdout:Total 2.9 MB/s | 765 kB 00:00 2024-09-13T19:14:04.526 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-09-13T19:14:04.532 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-09-13T19:14:04.532 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-09-13T19:14:04.538 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-09-13T19:14:04.538 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-09-13T19:14:04.614 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-09-13T19:14:04.933 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: cephadm-2:19.1.1-322.g7741f7f9.el9.noarch 1/1 2024-09-13T19:14:05.035 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : cephadm-2:19.1.1-322.g7741f7f9.el9.noarch 1/1 2024-09-13T19:14:05.097 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: cephadm-2:19.1.1-322.g7741f7f9.el9.noarch 1/1 2024-09-13T19:14:05.182 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : cephadm-2:19.1.1-322.g7741f7f9.el9.noarch 1/1 2024-09-13T19:14:05.441 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: cephadm-2:19.1.1-322.g7741f7f9.el9.noarch 1/1 2024-09-13T19:14:05.585 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: cephadm-2:19.1.1-322.g7741f7f9.el9.noarch 1/1 2024-09-13T19:14:05.683 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : cephadm-2:19.1.1-322.g7741f7f9.el9.noarch 1/1 2024-09-13T19:14:05.684 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:14:05.684 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-13T19:14:05.684 INFO:teuthology.orchestra.run.smithi102.stdout: cephadm-2:19.1.1-322.g7741f7f9.el9.noarch 2024-09-13T19:14:05.684 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:14:05.684 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-13T19:14:05.843 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : cephadm-2:19.1.1-322.g7741f7f9.el9.noarch 1/1 2024-09-13T19:14:05.843 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:05.843 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-09-13T19:14:05.843 INFO:teuthology.orchestra.run.smithi053.stdout: cephadm-2:19.1.1-322.g7741f7f9.el9.noarch 2024-09-13T19:14:05.843 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:05.843 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-13T19:14:05.908 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-immutable-object-cache 2024-09-13T19:14:06.051 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-immutable-object-cache 2024-09-13T19:14:06.478 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:00:57 ago on Fri 13 Sep 2024 07:13:09 PM UTC. 2024-09-13T19:14:06.611 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-13T19:14:06.612 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-13T19:14:06.612 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repo Size 2024-09-13T19:14:06.612 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-13T19:14:06.612 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-13T19:14:06.612 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 145 k 2024-09-13T19:14:06.613 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:14:06.613 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-13T19:14:06.613 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-13T19:14:06.613 INFO:teuthology.orchestra.run.smithi102.stdout:Install 1 Package 2024-09-13T19:14:06.613 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:14:06.613 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 145 k 2024-09-13T19:14:06.613 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 435 k 2024-09-13T19:14:06.613 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-13T19:14:06.638 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:00:57 ago on Fri 13 Sep 2024 07:13:09 PM UTC. 2024-09-13T19:14:06.776 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-13T19:14:06.777 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-13T19:14:06.777 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repo Size 2024-09-13T19:14:06.777 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-13T19:14:06.777 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-09-13T19:14:06.777 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 145 k 2024-09-13T19:14:06.778 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:06.778 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-09-13T19:14:06.778 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-13T19:14:06.778 INFO:teuthology.orchestra.run.smithi053.stdout:Install 1 Package 2024-09-13T19:14:06.778 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:06.778 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 145 k 2024-09-13T19:14:06.778 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 435 k 2024-09-13T19:14:06.778 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-09-13T19:14:06.822 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-immutable-object-cache-19.1.1-322.g7741f7f 696 kB/s | 145 kB 00:00 2024-09-13T19:14:06.822 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-13T19:14:06.823 INFO:teuthology.orchestra.run.smithi102.stdout:Total 691 kB/s | 145 kB 00:00 2024-09-13T19:14:06.823 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-13T19:14:06.830 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-13T19:14:06.830 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-13T19:14:06.887 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-13T19:14:06.887 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-13T19:14:06.981 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-immutable-object-cache-19.1.1-322.g7741f7f 715 kB/s | 145 kB 00:00 2024-09-13T19:14:06.981 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-13T19:14:06.981 INFO:teuthology.orchestra.run.smithi053.stdout:Total 710 kB/s | 145 kB 00:00 2024-09-13T19:14:06.982 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-09-13T19:14:06.991 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-09-13T19:14:06.991 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-09-13T19:14:07.041 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-13T19:14:07.050 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-09-13T19:14:07.050 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-09-13T19:14:07.122 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-322.g7741f7f9.e 1/1 2024-09-13T19:14:07.148 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-322.g7741f7f9.e 1/1 2024-09-13T19:14:07.148 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T19:14:07.148 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T19:14:07.148 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:14:07.195 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-09-13T19:14:07.273 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-322.g7741f7f9.e 1/1 2024-09-13T19:14:07.299 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-322.g7741f7f9.e 1/1 2024-09-13T19:14:07.299 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T19:14:07.299 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T19:14:07.299 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:08.092 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-322.g7741f7f9.e 1/1 2024-09-13T19:14:08.093 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:14:08.093 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-13T19:14:08.093 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-immutable-object-cache-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:14:08.093 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:14:08.093 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-13T19:14:08.292 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-322.g7741f7f9.e 1/1 2024-09-13T19:14:08.292 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:08.292 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-09-13T19:14:08.292 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-immutable-object-cache-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:14:08.292 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:08.292 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-13T19:14:08.332 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-mgr 2024-09-13T19:14:08.555 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-mgr 2024-09-13T19:14:08.909 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:00:59 ago on Fri 13 Sep 2024 07:13:09 PM UTC. 2024-09-13T19:14:09.000 INFO:teuthology.orchestra.run.smithi102.stdout:Package ceph-mgr-2:19.1.1-322.g7741f7f9.el9.x86_64 is already installed. 2024-09-13T19:14:09.042 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-13T19:14:09.043 INFO:teuthology.orchestra.run.smithi102.stdout:Nothing to do. 2024-09-13T19:14:09.044 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-13T19:14:09.131 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-mgr-dashboard 2024-09-13T19:14:09.152 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:00 ago on Fri 13 Sep 2024 07:13:09 PM UTC. 2024-09-13T19:14:09.249 INFO:teuthology.orchestra.run.smithi053.stdout:Package ceph-mgr-2:19.1.1-322.g7741f7f9.el9.x86_64 is already installed. 2024-09-13T19:14:09.293 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-13T19:14:09.294 INFO:teuthology.orchestra.run.smithi053.stdout:Nothing to do. 2024-09-13T19:14:09.295 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-13T19:14:09.367 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-mgr-dashboard 2024-09-13T19:14:09.689 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:00 ago on Fri 13 Sep 2024 07:13:09 PM UTC. 2024-09-13T19:14:09.821 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-13T19:14:09.822 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-13T19:14:09.822 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-09-13T19:14:09.822 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-13T19:14:09.822 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-13T19:14:09.822 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-dashboard noarch 2:19.1.1-322.g7741f7f9.el9 ceph-noarch 3.6 M 2024-09-13T19:14:09.822 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-09-13T19:14:09.822 INFO:teuthology.orchestra.run.smithi102.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-13T19:14:09.822 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-grafana-dashboards noarch 2:19.1.1-322.g7741f7f9.el9 ceph-noarch 32 k 2024-09-13T19:14:09.822 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-prometheus-alerts noarch 2:19.1.1-322.g7741f7f9.el9 ceph-noarch 16 k 2024-09-13T19:14:09.822 INFO:teuthology.orchestra.run.smithi102.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-13T19:14:09.823 INFO:teuthology.orchestra.run.smithi102.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-13T19:14:09.823 INFO:teuthology.orchestra.run.smithi102.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-13T19:14:09.823 INFO:teuthology.orchestra.run.smithi102.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-13T19:14:09.823 INFO:teuthology.orchestra.run.smithi102.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-13T19:14:09.823 INFO:teuthology.orchestra.run.smithi102.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-13T19:14:09.823 INFO:teuthology.orchestra.run.smithi102.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T19:14:09.823 INFO:teuthology.orchestra.run.smithi102.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T19:14:09.823 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:14:09.823 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-13T19:14:09.823 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-13T19:14:09.823 INFO:teuthology.orchestra.run.smithi102.stdout:Install 12 Packages 2024-09-13T19:14:09.823 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:14:09.824 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 8.7 M 2024-09-13T19:14:09.824 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 104 M 2024-09-13T19:14:09.824 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-13T19:14:09.953 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:00 ago on Fri 13 Sep 2024 07:13:09 PM UTC. 2024-09-13T19:14:10.092 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-13T19:14:10.093 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-13T19:14:10.093 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2024-09-13T19:14:10.093 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-13T19:14:10.093 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-09-13T19:14:10.093 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-dashboard noarch 2:19.1.1-322.g7741f7f9.el9 ceph-noarch 3.6 M 2024-09-13T19:14:10.093 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2024-09-13T19:14:10.093 INFO:teuthology.orchestra.run.smithi053.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-13T19:14:10.093 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-grafana-dashboards noarch 2:19.1.1-322.g7741f7f9.el9 ceph-noarch 32 k 2024-09-13T19:14:10.094 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-prometheus-alerts noarch 2:19.1.1-322.g7741f7f9.el9 ceph-noarch 16 k 2024-09-13T19:14:10.094 INFO:teuthology.orchestra.run.smithi053.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-13T19:14:10.094 INFO:teuthology.orchestra.run.smithi053.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-13T19:14:10.094 INFO:teuthology.orchestra.run.smithi053.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-13T19:14:10.094 INFO:teuthology.orchestra.run.smithi053.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-13T19:14:10.094 INFO:teuthology.orchestra.run.smithi053.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-13T19:14:10.094 INFO:teuthology.orchestra.run.smithi053.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-13T19:14:10.094 INFO:teuthology.orchestra.run.smithi053.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T19:14:10.094 INFO:teuthology.orchestra.run.smithi053.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T19:14:10.094 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:10.094 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-09-13T19:14:10.094 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-13T19:14:10.095 INFO:teuthology.orchestra.run.smithi053.stdout:Install 12 Packages 2024-09-13T19:14:10.095 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:10.095 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 8.7 M 2024-09-13T19:14:10.095 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 104 M 2024-09-13T19:14:10.095 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-09-13T19:14:10.175 INFO:teuthology.orchestra.run.smithi102.stdout:(1/12): ceph-grafana-dashboards-19.1.1-322.g774 229 kB/s | 32 kB 00:00 2024-09-13T19:14:10.200 INFO:teuthology.orchestra.run.smithi102.stdout:(2/12): ceph-prometheus-alerts-19.1.1-322.g7741 100 kB/s | 16 kB 00:00 2024-09-13T19:14:10.367 INFO:teuthology.orchestra.run.smithi102.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.6 MB/s | 269 kB 00:00 2024-09-13T19:14:10.426 INFO:teuthology.orchestra.run.smithi102.stdout:(4/12): ceph-mgr-dashboard-19.1.1-322.g7741f7f9 9.1 MB/s | 3.6 MB 00:00 2024-09-13T19:14:10.476 INFO:teuthology.orchestra.run.smithi102.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 11 MB/s | 548 kB 00:00 2024-09-13T19:14:10.501 INFO:teuthology.orchestra.run.smithi102.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 780 kB/s | 19 kB 00:00 2024-09-13T19:14:10.560 INFO:teuthology.orchestra.run.smithi102.stdout:(7/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 35 MB/s | 2.0 MB 00:00 2024-09-13T19:14:10.592 INFO:teuthology.orchestra.run.smithi053.stdout:(1/12): ceph-grafana-dashboards-19.1.1-322.g774 226 kB/s | 32 kB 00:00 2024-09-13T19:14:10.593 INFO:teuthology.orchestra.run.smithi102.stdout:(8/12): protobuf-3.14.0-13.el9.x86_64.rpm 2.4 MB/s | 1.0 MB 00:00 2024-09-13T19:14:10.609 INFO:teuthology.orchestra.run.smithi053.stdout:(2/12): ceph-prometheus-alerts-19.1.1-322.g7741 104 kB/s | 16 kB 00:00 2024-09-13T19:14:10.627 INFO:teuthology.orchestra.run.smithi102.stdout:(9/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 2.1 MB/s | 144 kB 00:00 2024-09-13T19:14:10.669 INFO:teuthology.orchestra.run.smithi102.stdout:(10/12): protobuf-compiler-3.14.0-13.el9.x86_64 2.8 MB/s | 863 kB 00:00 2024-09-13T19:14:10.694 INFO:teuthology.orchestra.run.smithi102.stdout:(11/12): python3-repoze-lru-0.7-16.el9.noarch.r 306 kB/s | 31 kB 00:00 2024-09-13T19:14:10.719 INFO:teuthology.orchestra.run.smithi102.stdout:(12/12): python3-routes-2.5.1-5.el9.noarch.rpm 2.0 MB/s | 188 kB 00:00 2024-09-13T19:14:10.723 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-13T19:14:10.723 INFO:teuthology.orchestra.run.smithi102.stdout:Total 9.6 MB/s | 8.7 MB 00:00 2024-09-13T19:14:10.771 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-13T19:14:10.789 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-13T19:14:10.789 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-13T19:14:10.818 INFO:teuthology.orchestra.run.smithi053.stdout:(3/12): ceph-mgr-dashboard-19.1.1-322.g7741f7f9 9.7 MB/s | 3.6 MB 00:00 2024-09-13T19:14:10.851 INFO:teuthology.orchestra.run.smithi053.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.1 MB/s | 269 kB 00:00 2024-09-13T19:14:10.902 INFO:teuthology.orchestra.run.smithi053.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 11 MB/s | 548 kB 00:00 2024-09-13T19:14:10.919 INFO:teuthology.orchestra.run.smithi053.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 1.1 MB/s | 19 kB 00:00 2024-09-13T19:14:10.952 INFO:teuthology.orchestra.run.smithi053.stdout:(7/12): protobuf-3.14.0-13.el9.x86_64.rpm 2.8 MB/s | 1.0 MB 00:00 2024-09-13T19:14:10.997 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-13T19:14:10.997 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-13T19:14:11.020 INFO:teuthology.orchestra.run.smithi053.stdout:(8/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 20 MB/s | 2.0 MB 00:00 2024-09-13T19:14:11.045 INFO:teuthology.orchestra.run.smithi053.stdout:(9/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 1.5 MB/s | 144 kB 00:00 2024-09-13T19:14:11.062 INFO:teuthology.orchestra.run.smithi053.stdout:(10/12): python3-repoze-lru-0.7-16.el9.noarch.r 739 kB/s | 31 kB 00:00 2024-09-13T19:14:11.087 INFO:teuthology.orchestra.run.smithi053.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 4.4 MB/s | 188 kB 00:00 2024-09-13T19:14:11.154 INFO:teuthology.orchestra.run.smithi053.stdout:(12/12): protobuf-compiler-3.14.0-13.el9.x86_64 2.5 MB/s | 863 kB 00:00 2024-09-13T19:14:11.158 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-13T19:14:11.158 INFO:teuthology.orchestra.run.smithi053.stdout:Total 8.2 MB/s | 8.7 MB 00:01 2024-09-13T19:14:11.209 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-09-13T19:14:11.229 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-09-13T19:14:11.229 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-09-13T19:14:11.443 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-09-13T19:14:11.443 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-09-13T19:14:11.532 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-13T19:14:11.612 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-13T19:14:11.656 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-13T19:14:11.702 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-13T19:14:11.733 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-13T19:14:11.840 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-13T19:14:11.966 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-13T19:14:11.990 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-09-13T19:14:12.051 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-13T19:14:12.080 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-13T19:14:12.112 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-13T19:14:12.115 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-13T19:14:12.149 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-13T19:14:12.163 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-13T19:14:12.181 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-322.g7741f7f9.el9. 10/12 2024-09-13T19:14:12.200 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-13T19:14:12.310 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-13T19:14:12.441 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-13T19:14:12.540 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-13T19:14:12.589 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-13T19:14:12.616 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-13T19:14:12.648 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-322.g7741f7f9.el9. 10/12 2024-09-13T19:14:13.244 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-322.g7741f7f9.el9 11/12 2024-09-13T19:14:13.273 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-322.g7741f7f9.el9.noar 12/12 2024-09-13T19:14:13.777 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-322.g7741f7f9.el9 11/12 2024-09-13T19:14:13.815 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-322.g7741f7f9.el9.noar 12/12 2024-09-13T19:14:14.443 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-322.g7741f7f9.el9.noar 12/12 2024-09-13T19:14:14.443 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-322.g7741f7f9.el9 1/12 2024-09-13T19:14:14.443 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-322.g7741f7f9.el9.noar 2/12 2024-09-13T19:14:14.443 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-322.g7741f7f9.el9. 3/12 2024-09-13T19:14:14.443 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-13T19:14:14.444 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-13T19:14:14.444 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-13T19:14:14.444 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-13T19:14:14.444 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-13T19:14:14.444 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-13T19:14:14.444 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-13T19:14:14.444 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-13T19:14:14.755 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-13T19:14:14.756 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:14:14.756 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-13T19:14:14.756 INFO:teuthology.orchestra.run.smithi102.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-13T19:14:14.756 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-grafana-dashboards-2:19.1.1-322.g7741f7f9.el9.noarch 2024-09-13T19:14:14.756 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-dashboard-2:19.1.1-322.g7741f7f9.el9.noarch 2024-09-13T19:14:14.756 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-prometheus-alerts-2:19.1.1-322.g7741f7f9.el9.noarch 2024-09-13T19:14:14.756 INFO:teuthology.orchestra.run.smithi102.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-13T19:14:14.756 INFO:teuthology.orchestra.run.smithi102.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-13T19:14:14.756 INFO:teuthology.orchestra.run.smithi102.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-13T19:14:14.756 INFO:teuthology.orchestra.run.smithi102.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-13T19:14:14.757 INFO:teuthology.orchestra.run.smithi102.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-13T19:14:14.757 INFO:teuthology.orchestra.run.smithi102.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-13T19:14:14.757 INFO:teuthology.orchestra.run.smithi102.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T19:14:14.757 INFO:teuthology.orchestra.run.smithi102.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T19:14:14.757 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:14:14.757 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-13T19:14:14.998 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-13T19:14:15.220 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-322.g7741f7f9.el9.noar 12/12 2024-09-13T19:14:15.221 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-322.g7741f7f9.el9 1/12 2024-09-13T19:14:15.221 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-322.g7741f7f9.el9.noar 2/12 2024-09-13T19:14:15.221 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-322.g7741f7f9.el9. 3/12 2024-09-13T19:14:15.221 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-13T19:14:15.221 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-13T19:14:15.221 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-13T19:14:15.221 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-13T19:14:15.221 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-13T19:14:15.221 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-13T19:14:15.221 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-13T19:14:15.221 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-13T19:14:15.564 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:06 ago on Fri 13 Sep 2024 07:13:09 PM UTC. 2024-09-13T19:14:15.565 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-13T19:14:15.565 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:15.565 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-09-13T19:14:15.565 INFO:teuthology.orchestra.run.smithi053.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-13T19:14:15.565 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-grafana-dashboards-2:19.1.1-322.g7741f7f9.el9.noarch 2024-09-13T19:14:15.565 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-dashboard-2:19.1.1-322.g7741f7f9.el9.noarch 2024-09-13T19:14:15.566 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-prometheus-alerts-2:19.1.1-322.g7741f7f9.el9.noarch 2024-09-13T19:14:15.566 INFO:teuthology.orchestra.run.smithi053.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-13T19:14:15.566 INFO:teuthology.orchestra.run.smithi053.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-13T19:14:15.566 INFO:teuthology.orchestra.run.smithi053.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-13T19:14:15.566 INFO:teuthology.orchestra.run.smithi053.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-13T19:14:15.566 INFO:teuthology.orchestra.run.smithi053.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-13T19:14:15.566 INFO:teuthology.orchestra.run.smithi053.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-13T19:14:15.566 INFO:teuthology.orchestra.run.smithi053.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T19:14:15.566 INFO:teuthology.orchestra.run.smithi053.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T19:14:15.566 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:15.566 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-13T19:14:15.699 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-13T19:14:15.700 INFO:teuthology.orchestra.run.smithi102.stdout:====================================================================================== 2024-09-13T19:14:15.700 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-09-13T19:14:15.700 INFO:teuthology.orchestra.run.smithi102.stdout:====================================================================================== 2024-09-13T19:14:15.700 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-13T19:14:15.700 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-322.g7741f7f9.el9 ceph-noarch 7.4 M 2024-09-13T19:14:15.700 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-09-13T19:14:15.700 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T19:14:15.700 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T19:14:15.701 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T19:14:15.701 INFO:teuthology.orchestra.run.smithi102.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T19:14:15.701 INFO:teuthology.orchestra.run.smithi102.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T19:14:15.701 INFO:teuthology.orchestra.run.smithi102.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T19:14:15.701 INFO:teuthology.orchestra.run.smithi102.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T19:14:15.701 INFO:teuthology.orchestra.run.smithi102.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T19:14:15.701 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T19:14:15.701 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T19:14:15.701 INFO:teuthology.orchestra.run.smithi102.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T19:14:15.701 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:14:15.701 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-13T19:14:15.701 INFO:teuthology.orchestra.run.smithi102.stdout:====================================================================================== 2024-09-13T19:14:15.701 INFO:teuthology.orchestra.run.smithi102.stdout:Install 12 Packages 2024-09-13T19:14:15.701 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:14:15.702 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 38 M 2024-09-13T19:14:15.702 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 212 M 2024-09-13T19:14:15.702 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-13T19:14:15.815 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-13T19:14:16.405 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:07 ago on Fri 13 Sep 2024 07:13:09 PM UTC. 2024-09-13T19:14:16.528 INFO:teuthology.orchestra.run.smithi102.stdout:(1/12): ceph-mgr-diskprediction-local-19.1.1-32 17 MB/s | 7.4 MB 00:00 2024-09-13T19:14:16.545 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-13T19:14:16.546 INFO:teuthology.orchestra.run.smithi053.stdout:====================================================================================== 2024-09-13T19:14:16.546 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2024-09-13T19:14:16.546 INFO:teuthology.orchestra.run.smithi053.stdout:====================================================================================== 2024-09-13T19:14:16.546 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-09-13T19:14:16.546 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-322.g7741f7f9.el9 ceph-noarch 7.4 M 2024-09-13T19:14:16.547 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2024-09-13T19:14:16.547 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T19:14:16.547 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T19:14:16.547 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T19:14:16.547 INFO:teuthology.orchestra.run.smithi053.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T19:14:16.547 INFO:teuthology.orchestra.run.smithi053.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T19:14:16.547 INFO:teuthology.orchestra.run.smithi053.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T19:14:16.547 INFO:teuthology.orchestra.run.smithi053.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T19:14:16.547 INFO:teuthology.orchestra.run.smithi053.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T19:14:16.547 INFO:teuthology.orchestra.run.smithi053.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T19:14:16.547 INFO:teuthology.orchestra.run.smithi053.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T19:14:16.547 INFO:teuthology.orchestra.run.smithi053.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T19:14:16.547 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:16.548 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-09-13T19:14:16.548 INFO:teuthology.orchestra.run.smithi053.stdout:====================================================================================== 2024-09-13T19:14:16.548 INFO:teuthology.orchestra.run.smithi053.stdout:Install 12 Packages 2024-09-13T19:14:16.548 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:16.548 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 38 M 2024-09-13T19:14:16.548 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 212 M 2024-09-13T19:14:16.548 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-09-13T19:14:16.561 INFO:teuthology.orchestra.run.smithi102.stdout:(2/12): libquadmath-11.5.0-2.el9.x86_64.rpm 399 kB/s | 191 kB 00:00 2024-09-13T19:14:16.728 INFO:teuthology.orchestra.run.smithi102.stdout:(3/12): libgfortran-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 801 kB 00:00 2024-09-13T19:14:16.879 INFO:teuthology.orchestra.run.smithi102.stdout:(4/12): flexiblas-3.0.4-8.el9.x86_64.rpm 93 kB/s | 33 kB 00:00 2024-09-13T19:14:16.903 INFO:teuthology.orchestra.run.smithi053.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 960 kB/s | 191 kB 00:00 2024-09-13T19:14:16.961 INFO:teuthology.orchestra.run.smithi053.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 3.0 MB/s | 801 kB 00:00 2024-09-13T19:14:17.003 INFO:teuthology.orchestra.run.smithi053.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 327 kB/s | 33 kB 00:00 2024-09-13T19:14:17.029 INFO:teuthology.orchestra.run.smithi102.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 61 kB/s | 18 kB 00:00 2024-09-13T19:14:17.087 INFO:teuthology.orchestra.run.smithi053.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 218 kB/s | 18 kB 00:00 2024-09-13T19:14:17.171 INFO:teuthology.orchestra.run.smithi102.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 132 kB/s | 38 kB 00:00 2024-09-13T19:14:17.179 INFO:teuthology.orchestra.run.smithi053.stdout:(5/12): ceph-mgr-diskprediction-local-19.1.1-32 16 MB/s | 7.4 MB 00:00 2024-09-13T19:14:17.195 INFO:teuthology.orchestra.run.smithi053.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 355 kB/s | 38 kB 00:00 2024-09-13T19:14:17.263 INFO:teuthology.orchestra.run.smithi053.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 9.9 MB/s | 3.0 MB 00:00 2024-09-13T19:14:17.297 INFO:teuthology.orchestra.run.smithi053.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-13T19:14:17.354 INFO:teuthology.orchestra.run.smithi102.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 3.8 MB/s | 3.0 MB 00:00 2024-09-13T19:14:17.380 INFO:teuthology.orchestra.run.smithi053.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.9 MB/s | 250 kB 00:00 2024-09-13T19:14:17.489 INFO:teuthology.orchestra.run.smithi053.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 23 MB/s | 5.1 MB 00:00 2024-09-13T19:14:17.564 INFO:teuthology.orchestra.run.smithi053.stdout:(11/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 13 MB/s | 4.9 MB 00:00 2024-09-13T19:14:17.730 INFO:teuthology.orchestra.run.smithi102.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 438 kB/s | 245 kB 00:00 2024-09-13T19:14:17.814 INFO:teuthology.orchestra.run.smithi053.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 37 MB/s | 16 MB 00:00 2024-09-13T19:14:17.815 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-13T19:14:17.815 INFO:teuthology.orchestra.run.smithi053.stdout:Total 30 MB/s | 38 MB 00:01 2024-09-13T19:14:18.180 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-09-13T19:14:18.207 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-09-13T19:14:18.208 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-09-13T19:14:18.238 INFO:teuthology.orchestra.run.smithi102.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 493 kB/s | 250 kB 00:00 2024-09-13T19:14:18.660 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-09-13T19:14:18.660 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-09-13T19:14:18.705 INFO:teuthology.orchestra.run.smithi102.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 2.9 MB/s | 4.9 MB 00:01 2024-09-13T19:14:19.450 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-09-13T19:14:19.523 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-13T19:14:19.571 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-13T19:14:19.676 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-13T19:14:19.714 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-13T19:14:19.906 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-13T19:14:19.937 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-13T19:14:20.016 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-13T19:14:20.700 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-13T19:14:20.830 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-13T19:14:22.168 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T19:14:22.430 INFO:teuthology.orchestra.run.smithi102.stdout:(11/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.9 MB/s | 16 MB 00:04 2024-09-13T19:14:22.538 INFO:teuthology.orchestra.run.smithi102.stdout:(12/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 1.0 MB/s | 5.1 MB 00:05 2024-09-13T19:14:22.539 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-13T19:14:22.539 INFO:teuthology.orchestra.run.smithi102.stdout:Total 5.6 MB/s | 38 MB 00:06 2024-09-13T19:14:22.901 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-13T19:14:22.926 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-13T19:14:22.927 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-13T19:14:23.266 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-13T19:14:23.302 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-322.g7741f7 12/12 2024-09-13T19:14:23.354 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-13T19:14:23.354 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-13T19:14:24.132 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-13T19:14:24.203 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-13T19:14:24.244 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-13T19:14:24.344 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-13T19:14:24.379 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-13T19:14:24.564 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-13T19:14:24.603 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-13T19:14:24.683 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-13T19:14:25.324 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-13T19:14:25.441 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-13T19:14:25.784 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-322.g7741f7 12/12 2024-09-13T19:14:25.784 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-322.g7741f7 1/12 2024-09-13T19:14:25.785 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-13T19:14:25.785 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-13T19:14:25.785 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-13T19:14:25.785 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-13T19:14:25.785 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-13T19:14:25.785 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-13T19:14:25.785 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-13T19:14:25.785 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-13T19:14:25.785 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T19:14:25.785 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-13T19:14:26.291 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-13T19:14:26.291 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:26.291 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-09-13T19:14:26.291 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-diskprediction-local-2:19.1.1-322.g7741f7f9.el9.noarch 2024-09-13T19:14:26.291 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T19:14:26.291 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T19:14:26.291 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T19:14:26.291 INFO:teuthology.orchestra.run.smithi053.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T19:14:26.292 INFO:teuthology.orchestra.run.smithi053.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T19:14:26.292 INFO:teuthology.orchestra.run.smithi053.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T19:14:26.292 INFO:teuthology.orchestra.run.smithi053.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T19:14:26.292 INFO:teuthology.orchestra.run.smithi053.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T19:14:26.292 INFO:teuthology.orchestra.run.smithi053.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T19:14:26.292 INFO:teuthology.orchestra.run.smithi053.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T19:14:26.292 INFO:teuthology.orchestra.run.smithi053.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T19:14:26.292 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:26.292 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-13T19:14:26.669 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-mgr-rook 2024-09-13T19:14:26.685 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T19:14:27.269 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:18 ago on Fri 13 Sep 2024 07:13:09 PM UTC. 2024-09-13T19:14:27.409 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-13T19:14:27.410 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-13T19:14:27.410 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2024-09-13T19:14:27.410 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-13T19:14:27.410 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-09-13T19:14:27.410 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-rook noarch 2:19.1.1-322.g7741f7f9.el9 ceph-noarch 49 k 2024-09-13T19:14:27.410 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2024-09-13T19:14:27.411 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T19:14:27.411 INFO:teuthology.orchestra.run.smithi053.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T19:14:27.411 INFO:teuthology.orchestra.run.smithi053.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T19:14:27.411 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T19:14:27.411 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T19:14:27.411 INFO:teuthology.orchestra.run.smithi053.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T19:14:27.411 INFO:teuthology.orchestra.run.smithi053.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T19:14:27.411 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T19:14:27.411 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T19:14:27.411 INFO:teuthology.orchestra.run.smithi053.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T19:14:27.411 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T19:14:27.411 INFO:teuthology.orchestra.run.smithi053.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T19:14:27.411 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:27.412 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-09-13T19:14:27.412 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-13T19:14:27.412 INFO:teuthology.orchestra.run.smithi053.stdout:Install 13 Packages 2024-09-13T19:14:27.412 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:27.412 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 2.2 M 2024-09-13T19:14:27.412 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 26 M 2024-09-13T19:14:27.413 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-09-13T19:14:27.872 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-13T19:14:27.928 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-322.g7741f7 12/12 2024-09-13T19:14:28.044 INFO:teuthology.orchestra.run.smithi053.stdout:(1/13): ceph-mgr-rook-19.1.1-322.g7741f7f9.el9. 288 kB/s | 49 kB 00:00 2024-09-13T19:14:28.161 INFO:teuthology.orchestra.run.smithi053.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 89 kB/s | 26 kB 00:00 2024-09-13T19:14:28.186 INFO:teuthology.orchestra.run.smithi053.stdout:(3/13): python3-jsonpointer-2.0-4.el9.noarch.rp 61 kB/s | 19 kB 00:00 2024-09-13T19:14:28.553 INFO:teuthology.orchestra.run.smithi053.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 433 kB/s | 159 kB 00:00 2024-09-13T19:14:28.587 INFO:teuthology.orchestra.run.smithi053.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 410 kB/s | 222 kB 00:00 2024-09-13T19:14:28.629 INFO:teuthology.orchestra.run.smithi053.stdout:(6/13): python3-cachetools-4.2.4-1.el9.noarch.r 776 kB/s | 32 kB 00:00 2024-09-13T19:14:28.654 INFO:teuthology.orchestra.run.smithi053.stdout:(7/13): python3-certifi-2023.05.07-4.el9.noarch 563 kB/s | 14 kB 00:00 2024-09-13T19:14:28.682 INFO:teuthology.orchestra.run.smithi053.stdout:(8/13): python3-requests-oauthlib-1.3.0-12.el9. 427 kB/s | 54 kB 00:00 2024-09-13T19:14:28.713 INFO:teuthology.orchestra.run.smithi053.stdout:(9/13): python3-google-auth-2.34.0-1.el9.noarch 3.7 MB/s | 220 kB 00:00 2024-09-13T19:14:28.738 INFO:teuthology.orchestra.run.smithi053.stdout:(10/13): python3-pyasn1-modules-0.4.8-6.el9.noa 506 kB/s | 279 kB 00:00 2024-09-13T19:14:28.763 INFO:teuthology.orchestra.run.smithi053.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-13T19:14:28.805 INFO:teuthology.orchestra.run.smithi053.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.3 MB/s | 90 kB 00:00 2024-09-13T19:14:28.847 INFO:teuthology.orchestra.run.smithi053.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.1 MB/s | 1.0 MB 00:00 2024-09-13T19:14:28.850 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-13T19:14:28.851 INFO:teuthology.orchestra.run.smithi053.stdout:Total 1.5 MB/s | 2.2 MB 00:01 2024-09-13T19:14:28.923 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-09-13T19:14:28.940 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-09-13T19:14:28.940 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-09-13T19:14:29.036 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-09-13T19:14:29.036 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-09-13T19:14:29.554 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-09-13T19:14:29.728 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-13T19:14:29.800 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-13T19:14:29.873 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-13T19:14:29.917 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-13T19:14:29.958 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-13T19:14:30.065 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-13T19:14:30.177 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-13T19:14:30.228 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-13T19:14:30.546 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-322.g7741f7 12/12 2024-09-13T19:14:30.546 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-322.g7741f7 1/12 2024-09-13T19:14:30.546 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-13T19:14:30.546 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-13T19:14:30.546 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-13T19:14:30.546 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-13T19:14:30.546 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-13T19:14:30.546 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-13T19:14:30.546 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-13T19:14:30.546 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-13T19:14:30.547 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T19:14:30.547 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-13T19:14:30.980 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-13T19:14:30.981 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:14:30.981 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-13T19:14:30.981 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-diskprediction-local-2:19.1.1-322.g7741f7f9.el9.noarch 2024-09-13T19:14:30.981 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T19:14:30.981 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T19:14:30.981 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T19:14:30.981 INFO:teuthology.orchestra.run.smithi102.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T19:14:30.981 INFO:teuthology.orchestra.run.smithi102.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T19:14:30.981 INFO:teuthology.orchestra.run.smithi102.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T19:14:30.981 INFO:teuthology.orchestra.run.smithi102.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T19:14:30.981 INFO:teuthology.orchestra.run.smithi102.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T19:14:30.981 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T19:14:30.981 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T19:14:30.982 INFO:teuthology.orchestra.run.smithi102.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T19:14:30.982 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:14:30.982 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-13T19:14:30.991 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-13T19:14:31.049 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-13T19:14:31.082 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-13T19:14:31.139 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-13T19:14:31.168 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-rook-2:19.1.1-322.g7741f7f9.el9.noarch 13/13 2024-09-13T19:14:31.366 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-mgr-rook 2024-09-13T19:14:31.949 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:22 ago on Fri 13 Sep 2024 07:13:09 PM UTC. 2024-09-13T19:14:31.972 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-322.g7741f7f9.el9.noarch 13/13 2024-09-13T19:14:31.973 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-rook-2:19.1.1-322.g7741f7f9.el9.noarch 1/13 2024-09-13T19:14:31.973 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-13T19:14:31.973 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-13T19:14:31.973 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-13T19:14:31.973 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-13T19:14:31.973 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-13T19:14:31.973 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-13T19:14:31.973 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-13T19:14:31.973 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-13T19:14:31.973 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-13T19:14:31.973 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-13T19:14:31.973 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-13T19:14:32.082 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-13T19:14:32.084 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-13T19:14:32.084 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-09-13T19:14:32.084 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-13T19:14:32.084 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-13T19:14:32.084 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-rook noarch 2:19.1.1-322.g7741f7f9.el9 ceph-noarch 49 k 2024-09-13T19:14:32.084 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-09-13T19:14:32.084 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T19:14:32.084 INFO:teuthology.orchestra.run.smithi102.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T19:14:32.084 INFO:teuthology.orchestra.run.smithi102.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T19:14:32.084 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T19:14:32.084 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T19:14:32.085 INFO:teuthology.orchestra.run.smithi102.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T19:14:32.085 INFO:teuthology.orchestra.run.smithi102.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T19:14:32.085 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T19:14:32.085 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T19:14:32.085 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T19:14:32.085 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T19:14:32.085 INFO:teuthology.orchestra.run.smithi102.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T19:14:32.085 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:14:32.085 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-13T19:14:32.085 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-13T19:14:32.085 INFO:teuthology.orchestra.run.smithi102.stdout:Install 13 Packages 2024-09-13T19:14:32.085 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:14:32.086 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 2.2 M 2024-09-13T19:14:32.086 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 26 M 2024-09-13T19:14:32.086 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-13T19:14:32.338 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-13T19:14:32.338 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:32.339 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-09-13T19:14:32.339 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-rook-2:19.1.1-322.g7741f7f9.el9.noarch 2024-09-13T19:14:32.339 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T19:14:32.339 INFO:teuthology.orchestra.run.smithi053.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T19:14:32.339 INFO:teuthology.orchestra.run.smithi053.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T19:14:32.339 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T19:14:32.339 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T19:14:32.339 INFO:teuthology.orchestra.run.smithi053.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T19:14:32.339 INFO:teuthology.orchestra.run.smithi053.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T19:14:32.339 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T19:14:32.339 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T19:14:32.339 INFO:teuthology.orchestra.run.smithi053.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T19:14:32.339 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T19:14:32.339 INFO:teuthology.orchestra.run.smithi053.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T19:14:32.340 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:32.340 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-13T19:14:32.606 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-mgr-cephadm 2024-09-13T19:14:32.771 INFO:teuthology.orchestra.run.smithi102.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 182 kB/s | 19 kB 00:00 2024-09-13T19:14:32.796 INFO:teuthology.orchestra.run.smithi102.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 196 kB/s | 26 kB 00:00 2024-09-13T19:14:32.855 INFO:teuthology.orchestra.run.smithi102.stdout:(3/13): ceph-mgr-rook-19.1.1-322.g7741f7f9.el9. 261 kB/s | 49 kB 00:00 2024-09-13T19:14:32.880 INFO:teuthology.orchestra.run.smithi102.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.0 MB/s | 222 kB 00:00 2024-09-13T19:14:32.930 INFO:teuthology.orchestra.run.smithi102.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-09-13T19:14:32.955 INFO:teuthology.orchestra.run.smithi102.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 714 kB/s | 54 kB 00:00 2024-09-13T19:14:32.997 INFO:teuthology.orchestra.run.smithi102.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 481 kB/s | 32 kB 00:00 2024-09-13T19:14:33.023 INFO:teuthology.orchestra.run.smithi102.stdout:(8/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.6 MB/s | 279 kB 00:00 2024-09-13T19:14:33.048 INFO:teuthology.orchestra.run.smithi102.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 165 kB/s | 14 kB 00:00 2024-09-13T19:14:33.082 INFO:teuthology.orchestra.run.smithi102.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.2 MB/s | 59 kB 00:00 2024-09-13T19:14:33.107 INFO:teuthology.orchestra.run.smithi102.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 2.0 MB/s | 220 kB 00:00 2024-09-13T19:14:33.132 INFO:teuthology.orchestra.run.smithi102.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.8 MB/s | 90 kB 00:00 2024-09-13T19:14:33.165 INFO:teuthology.orchestra.run.smithi102.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.2 MB/s | 1.0 MB 00:00 2024-09-13T19:14:33.168 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-13T19:14:33.169 INFO:teuthology.orchestra.run.smithi102.stdout:Total 2.0 MB/s | 2.2 MB 00:01 2024-09-13T19:14:33.200 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:24 ago on Fri 13 Sep 2024 07:13:09 PM UTC. 2024-09-13T19:14:33.233 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-13T19:14:33.249 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-13T19:14:33.249 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-13T19:14:33.338 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-13T19:14:33.339 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-13T19:14:33.340 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-13T19:14:33.341 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-13T19:14:33.341 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2024-09-13T19:14:33.341 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-13T19:14:33.341 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-09-13T19:14:33.341 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-cephadm noarch 2:19.1.1-322.g7741f7f9.el9 ceph-noarch 146 k 2024-09-13T19:14:33.341 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2024-09-13T19:14:33.341 INFO:teuthology.orchestra.run.smithi053.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T19:14:33.341 INFO:teuthology.orchestra.run.smithi053.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T19:14:33.341 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T19:14:33.341 INFO:teuthology.orchestra.run.smithi053.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T19:14:33.341 INFO:teuthology.orchestra.run.smithi053.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T19:14:33.342 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:33.342 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-09-13T19:14:33.342 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-13T19:14:33.342 INFO:teuthology.orchestra.run.smithi053.stdout:Install 6 Packages 2024-09-13T19:14:33.342 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:33.342 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 7.0 M 2024-09-13T19:14:33.343 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 33 M 2024-09-13T19:14:33.343 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-09-13T19:14:33.816 INFO:teuthology.orchestra.run.smithi053.stdout:(1/6): ceph-mgr-cephadm-19.1.1-322.g7741f7f9.el 735 kB/s | 146 kB 00:00 2024-09-13T19:14:33.842 INFO:teuthology.orchestra.run.smithi053.stdout:(2/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.1 MB/s | 248 kB 00:00 2024-09-13T19:14:33.844 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-13T19:14:33.883 INFO:teuthology.orchestra.run.smithi053.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.4 MB/s | 58 kB 00:00 2024-09-13T19:14:33.908 INFO:teuthology.orchestra.run.smithi053.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-09-13T19:14:33.934 INFO:teuthology.orchestra.run.smithi053.stdout:(5/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 4.6 MB/s | 548 kB 00:00 2024-09-13T19:14:34.039 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-13T19:14:34.092 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-13T19:14:34.155 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-13T19:14:34.193 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-13T19:14:34.234 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-13T19:14:34.336 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-13T19:14:34.400 INFO:teuthology.orchestra.run.smithi053.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 7.6 MB/s | 6.0 MB 00:00 2024-09-13T19:14:34.402 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-13T19:14:34.402 INFO:teuthology.orchestra.run.smithi053.stdout:Total 6.6 MB/s | 7.0 MB 00:01 2024-09-13T19:14:34.438 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-13T19:14:34.475 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-09-13T19:14:34.487 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-09-13T19:14:34.487 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-09-13T19:14:34.494 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-13T19:14:34.594 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-09-13T19:14:34.594 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-09-13T19:14:34.919 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-09-13T19:14:35.099 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-13T19:14:35.154 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-13T19:14:35.209 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-13T19:14:35.258 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-13T19:14:35.292 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-13T19:14:35.340 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-13T19:14:35.370 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-rook-2:19.1.1-322.g7741f7f9.el9.noarch 13/13 2024-09-13T19:14:35.718 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-13T19:14:35.808 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-13T19:14:35.879 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-13T19:14:35.906 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-322.g7741f7f9.el9.noarch 6/6 2024-09-13T19:14:36.180 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-322.g7741f7f9.el9.noarch 13/13 2024-09-13T19:14:36.180 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-rook-2:19.1.1-322.g7741f7f9.el9.noarch 1/13 2024-09-13T19:14:36.180 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-13T19:14:36.180 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-13T19:14:36.180 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-13T19:14:36.180 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-13T19:14:36.180 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-13T19:14:36.180 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-13T19:14:36.181 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-13T19:14:36.181 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-13T19:14:36.181 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-13T19:14:36.181 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-13T19:14:36.181 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-13T19:14:36.512 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-13T19:14:36.512 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:14:36.512 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-13T19:14:36.512 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-rook-2:19.1.1-322.g7741f7f9.el9.noarch 2024-09-13T19:14:36.512 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T19:14:36.512 INFO:teuthology.orchestra.run.smithi102.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T19:14:36.512 INFO:teuthology.orchestra.run.smithi102.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T19:14:36.512 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T19:14:36.512 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T19:14:36.512 INFO:teuthology.orchestra.run.smithi102.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T19:14:36.513 INFO:teuthology.orchestra.run.smithi102.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T19:14:36.513 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T19:14:36.513 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T19:14:36.513 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T19:14:36.513 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T19:14:36.513 INFO:teuthology.orchestra.run.smithi102.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T19:14:36.513 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:14:36.513 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-13T19:14:36.696 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-322.g7741f7f9.el9.noarch 6/6 2024-09-13T19:14:36.696 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-322.g7741f7f9.el9.noarch 1/6 2024-09-13T19:14:36.696 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-13T19:14:36.696 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-13T19:14:36.696 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-13T19:14:36.697 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-13T19:14:36.775 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-mgr-cephadm 2024-09-13T19:14:36.964 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-13T19:14:36.964 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:36.964 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-09-13T19:14:36.964 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-cephadm-2:19.1.1-322.g7741f7f9.el9.noarch 2024-09-13T19:14:36.964 INFO:teuthology.orchestra.run.smithi053.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T19:14:36.964 INFO:teuthology.orchestra.run.smithi053.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T19:14:36.965 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T19:14:36.965 INFO:teuthology.orchestra.run.smithi053.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T19:14:36.965 INFO:teuthology.orchestra.run.smithi053.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T19:14:36.965 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:36.965 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-13T19:14:37.197 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-fuse 2024-09-13T19:14:37.334 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:28 ago on Fri 13 Sep 2024 07:13:09 PM UTC. 2024-09-13T19:14:37.467 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-13T19:14:37.468 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-13T19:14:37.468 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-09-13T19:14:37.468 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-13T19:14:37.468 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-13T19:14:37.468 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-cephadm noarch 2:19.1.1-322.g7741f7f9.el9 ceph-noarch 146 k 2024-09-13T19:14:37.468 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-09-13T19:14:37.469 INFO:teuthology.orchestra.run.smithi102.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T19:14:37.469 INFO:teuthology.orchestra.run.smithi102.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T19:14:37.469 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T19:14:37.469 INFO:teuthology.orchestra.run.smithi102.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T19:14:37.469 INFO:teuthology.orchestra.run.smithi102.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T19:14:37.469 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:14:37.469 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-13T19:14:37.469 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-13T19:14:37.469 INFO:teuthology.orchestra.run.smithi102.stdout:Install 6 Packages 2024-09-13T19:14:37.469 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:14:37.470 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 7.0 M 2024-09-13T19:14:37.470 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 33 M 2024-09-13T19:14:37.470 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-13T19:14:37.701 INFO:teuthology.orchestra.run.smithi102.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.6 MB/s | 248 kB 00:00 2024-09-13T19:14:37.751 INFO:teuthology.orchestra.run.smithi102.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-13T19:14:37.776 INFO:teuthology.orchestra.run.smithi102.stdout:(3/6): ceph-mgr-cephadm-19.1.1-322.g7741f7f9.el 639 kB/s | 146 kB 00:00 2024-09-13T19:14:37.793 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:28 ago on Fri 13 Sep 2024 07:13:09 PM UTC. 2024-09-13T19:14:37.802 INFO:teuthology.orchestra.run.smithi102.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.1 MB/s | 58 kB 00:00 2024-09-13T19:14:37.852 INFO:teuthology.orchestra.run.smithi102.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 992 kB/s | 74 kB 00:00 2024-09-13T19:14:37.932 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-13T19:14:37.933 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-13T19:14:37.933 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2024-09-13T19:14:37.933 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-13T19:14:37.934 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-09-13T19:14:37.934 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-fuse x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 896 k 2024-09-13T19:14:37.934 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2024-09-13T19:14:37.934 INFO:teuthology.orchestra.run.smithi053.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T19:14:37.934 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:37.934 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-09-13T19:14:37.934 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-13T19:14:37.934 INFO:teuthology.orchestra.run.smithi053.stdout:Install 2 Packages 2024-09-13T19:14:37.934 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:37.934 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 975 k 2024-09-13T19:14:37.934 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 2.9 M 2024-09-13T19:14:37.934 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-09-13T19:14:37.935 INFO:teuthology.orchestra.run.smithi102.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-13T19:14:37.937 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-13T19:14:37.938 INFO:teuthology.orchestra.run.smithi102.stdout:Total 15 MB/s | 7.0 MB 00:00 2024-09-13T19:14:38.008 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-13T19:14:38.019 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-13T19:14:38.020 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-13T19:14:38.094 INFO:teuthology.orchestra.run.smithi053.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 719 kB/s | 80 kB 00:00 2024-09-13T19:14:38.118 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-13T19:14:38.119 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-13T19:14:38.252 INFO:teuthology.orchestra.run.smithi053.stdout:(2/2): ceph-fuse-19.1.1-322.g7741f7f9.el9.x86_6 3.2 MB/s | 896 kB 00:00 2024-09-13T19:14:38.253 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-13T19:14:38.253 INFO:teuthology.orchestra.run.smithi053.stdout:Total 3.0 MB/s | 975 kB 00:00 2024-09-13T19:14:38.265 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-09-13T19:14:38.288 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-09-13T19:14:38.288 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-09-13T19:14:38.375 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-09-13T19:14:38.375 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-09-13T19:14:38.420 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-13T19:14:38.570 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-09-13T19:14:38.582 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-13T19:14:38.628 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-13T19:14:38.725 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-13T19:14:38.796 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-fuse-2:19.1.1-322.g7741f7f9.el9.x86_64 2/2 2024-09-13T19:14:39.148 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-13T19:14:39.240 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-13T19:14:39.311 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-13T19:14:39.345 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-322.g7741f7f9.el9.noarch 6/6 2024-09-13T19:14:39.470 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-fuse-2:19.1.1-322.g7741f7f9.el9.x86_64 2/2 2024-09-13T19:14:39.470 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-fuse-2:19.1.1-322.g7741f7f9.el9.x86_64 1/2 2024-09-13T19:14:39.747 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-13T19:14:39.748 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:39.748 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-09-13T19:14:39.748 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-fuse-2:19.1.1-322.g7741f7f9.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-13T19:14:39.748 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:39.748 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-13T19:14:40.022 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-volume 2024-09-13T19:14:40.140 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-322.g7741f7f9.el9.noarch 6/6 2024-09-13T19:14:40.140 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-322.g7741f7f9.el9.noarch 1/6 2024-09-13T19:14:40.140 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-13T19:14:40.140 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-13T19:14:40.140 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-13T19:14:40.140 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-13T19:14:40.428 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-13T19:14:40.428 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:14:40.428 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-13T19:14:40.428 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-cephadm-2:19.1.1-322.g7741f7f9.el9.noarch 2024-09-13T19:14:40.428 INFO:teuthology.orchestra.run.smithi102.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T19:14:40.428 INFO:teuthology.orchestra.run.smithi102.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T19:14:40.429 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T19:14:40.429 INFO:teuthology.orchestra.run.smithi102.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T19:14:40.429 INFO:teuthology.orchestra.run.smithi102.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T19:14:40.429 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:14:40.429 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-13T19:14:40.624 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:31 ago on Fri 13 Sep 2024 07:13:09 PM UTC. 2024-09-13T19:14:40.692 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-fuse 2024-09-13T19:14:40.764 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-13T19:14:40.765 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-13T19:14:40.765 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2024-09-13T19:14:40.765 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-13T19:14:40.765 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-09-13T19:14:40.765 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-volume noarch 2:19.1.1-322.g7741f7f9.el9 ceph-noarch 285 k 2024-09-13T19:14:40.765 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:40.765 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-09-13T19:14:40.765 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-13T19:14:40.765 INFO:teuthology.orchestra.run.smithi053.stdout:Install 1 Package 2024-09-13T19:14:40.765 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:40.765 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 285 k 2024-09-13T19:14:40.765 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 1.3 M 2024-09-13T19:14:40.766 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-09-13T19:14:40.998 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-volume-19.1.1-322.g7741f7f9.el9.noarch.rpm 1.2 MB/s | 285 kB 00:00 2024-09-13T19:14:40.999 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-13T19:14:40.999 INFO:teuthology.orchestra.run.smithi053.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-13T19:14:40.999 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-09-13T19:14:41.008 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-09-13T19:14:41.008 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-09-13T19:14:41.043 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-09-13T19:14:41.043 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-09-13T19:14:41.261 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:32 ago on Fri 13 Sep 2024 07:13:09 PM UTC. 2024-09-13T19:14:41.276 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-09-13T19:14:41.342 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-volume-2:19.1.1-322.g7741f7f9.el9.noarch 1/1 2024-09-13T19:14:41.358 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-volume-2:19.1.1-322.g7741f7f9.el9.noarch 1/1 2024-09-13T19:14:41.358 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T19:14:41.358 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-13T19:14:41.358 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:41.394 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-13T19:14:41.394 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-13T19:14:41.395 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-09-13T19:14:41.395 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-13T19:14:41.395 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-13T19:14:41.395 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-fuse x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 896 k 2024-09-13T19:14:41.395 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-09-13T19:14:41.395 INFO:teuthology.orchestra.run.smithi102.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T19:14:41.395 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:14:41.395 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-13T19:14:41.395 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-13T19:14:41.395 INFO:teuthology.orchestra.run.smithi102.stdout:Install 2 Packages 2024-09-13T19:14:41.395 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:14:41.396 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 975 k 2024-09-13T19:14:41.396 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 2.9 M 2024-09-13T19:14:41.396 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-13T19:14:41.763 INFO:teuthology.orchestra.run.smithi102.stdout:(1/2): ceph-fuse-19.1.1-322.g7741f7f9.el9.x86_6 3.5 MB/s | 896 kB 00:00 2024-09-13T19:14:41.971 INFO:teuthology.orchestra.run.smithi102.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 174 kB/s | 80 kB 00:00 2024-09-13T19:14:41.972 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-13T19:14:41.972 INFO:teuthology.orchestra.run.smithi102.stdout:Total 1.7 MB/s | 975 kB 00:00 2024-09-13T19:14:41.984 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-13T19:14:42.006 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-13T19:14:42.006 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-13T19:14:42.087 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-13T19:14:42.087 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-13T19:14:42.274 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-13T19:14:42.363 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-volume-2:19.1.1-322.g7741f7f9.el9.noarch 1/1 2024-09-13T19:14:42.363 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:42.363 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-09-13T19:14:42.363 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-volume-2:19.1.1-322.g7741f7f9.el9.noarch 2024-09-13T19:14:42.363 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:42.363 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-13T19:14:42.414 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-13T19:14:42.496 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-fuse-2:19.1.1-322.g7741f7f9.el9.x86_64 2/2 2024-09-13T19:14:42.643 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install librados-devel 2024-09-13T19:14:43.189 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-fuse-2:19.1.1-322.g7741f7f9.el9.x86_64 2/2 2024-09-13T19:14:43.189 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-fuse-2:19.1.1-322.g7741f7f9.el9.x86_64 1/2 2024-09-13T19:14:43.238 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:34 ago on Fri 13 Sep 2024 07:13:09 PM UTC. 2024-09-13T19:14:43.378 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-13T19:14:43.378 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-13T19:14:43.378 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repo Size 2024-09-13T19:14:43.378 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-13T19:14:43.379 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-09-13T19:14:43.379 INFO:teuthology.orchestra.run.smithi053.stdout: librados-devel x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 127 k 2024-09-13T19:14:43.379 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:43.379 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-09-13T19:14:43.379 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-13T19:14:43.379 INFO:teuthology.orchestra.run.smithi053.stdout:Install 1 Package 2024-09-13T19:14:43.379 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:43.379 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 127 k 2024-09-13T19:14:43.379 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 456 k 2024-09-13T19:14:43.379 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-09-13T19:14:43.460 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-13T19:14:43.461 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:14:43.461 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-13T19:14:43.461 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-fuse-2:19.1.1-322.g7741f7f9.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-13T19:14:43.461 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:14:43.461 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-13T19:14:43.614 INFO:teuthology.orchestra.run.smithi053.stdout:librados-devel-19.1.1-322.g7741f7f9.el9.x86_64. 539 kB/s | 127 kB 00:00 2024-09-13T19:14:43.615 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-13T19:14:43.615 INFO:teuthology.orchestra.run.smithi053.stdout:Total 535 kB/s | 127 kB 00:00 2024-09-13T19:14:43.615 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-09-13T19:14:43.622 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-09-13T19:14:43.622 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-09-13T19:14:43.690 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-09-13T19:14:43.690 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-09-13T19:14:43.724 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-volume 2024-09-13T19:14:43.851 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-09-13T19:14:43.962 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : librados-devel-2:19.1.1-322.g7741f7f9.el9.x86_64 1/1 2024-09-13T19:14:44.299 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:35 ago on Fri 13 Sep 2024 07:13:09 PM UTC. 2024-09-13T19:14:44.406 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librados-devel-2:19.1.1-322.g7741f7f9.el9.x86_64 1/1 2024-09-13T19:14:44.436 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-13T19:14:44.437 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-13T19:14:44.437 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-09-13T19:14:44.437 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-13T19:14:44.437 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-13T19:14:44.437 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-volume noarch 2:19.1.1-322.g7741f7f9.el9 ceph-noarch 285 k 2024-09-13T19:14:44.437 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:14:44.437 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-13T19:14:44.437 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-13T19:14:44.438 INFO:teuthology.orchestra.run.smithi102.stdout:Install 1 Package 2024-09-13T19:14:44.438 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:14:44.438 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 285 k 2024-09-13T19:14:44.438 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 1.3 M 2024-09-13T19:14:44.438 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-13T19:14:44.651 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-volume-19.1.1-322.g7741f7f9.el9.noarch.rpm 1.3 MB/s | 285 kB 00:00 2024-09-13T19:14:44.651 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-13T19:14:44.651 INFO:teuthology.orchestra.run.smithi102.stdout:Total 1.3 MB/s | 285 kB 00:00 2024-09-13T19:14:44.652 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-13T19:14:44.659 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-13T19:14:44.660 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-13T19:14:44.661 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librados-devel-2:19.1.1-322.g7741f7f9.el9.x86_64 1/1 2024-09-13T19:14:44.661 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:44.661 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-09-13T19:14:44.662 INFO:teuthology.orchestra.run.smithi053.stdout: librados-devel-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:14:44.662 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:44.662 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-13T19:14:44.687 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-13T19:14:44.687 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-13T19:14:44.906 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install libcephfs2 2024-09-13T19:14:44.907 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-13T19:14:44.961 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-volume-2:19.1.1-322.g7741f7f9.el9.noarch 1/1 2024-09-13T19:14:44.977 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-volume-2:19.1.1-322.g7741f7f9.el9.noarch 1/1 2024-09-13T19:14:44.977 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T19:14:44.977 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-13T19:14:44.977 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:14:45.504 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:36 ago on Fri 13 Sep 2024 07:13:09 PM UTC. 2024-09-13T19:14:45.597 INFO:teuthology.orchestra.run.smithi053.stdout:Package libcephfs2-2:19.1.1-322.g7741f7f9.el9.x86_64 is already installed. 2024-09-13T19:14:45.647 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-13T19:14:45.648 INFO:teuthology.orchestra.run.smithi053.stdout:Nothing to do. 2024-09-13T19:14:45.648 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-13T19:14:45.735 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install libcephfs-devel 2024-09-13T19:14:45.960 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-volume-2:19.1.1-322.g7741f7f9.el9.noarch 1/1 2024-09-13T19:14:45.961 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:14:45.961 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-13T19:14:45.961 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-volume-2:19.1.1-322.g7741f7f9.el9.noarch 2024-09-13T19:14:45.961 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:14:45.961 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-13T19:14:46.272 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install librados-devel 2024-09-13T19:14:46.330 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:37 ago on Fri 13 Sep 2024 07:13:09 PM UTC. 2024-09-13T19:14:46.470 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-13T19:14:46.471 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-13T19:14:46.471 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repo Size 2024-09-13T19:14:46.471 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-13T19:14:46.471 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-09-13T19:14:46.471 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs-devel x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 32 k 2024-09-13T19:14:46.471 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:46.471 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-09-13T19:14:46.471 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-13T19:14:46.471 INFO:teuthology.orchestra.run.smithi053.stdout:Install 1 Package 2024-09-13T19:14:46.471 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:46.472 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 32 k 2024-09-13T19:14:46.472 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 142 k 2024-09-13T19:14:46.472 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-09-13T19:14:46.616 INFO:teuthology.orchestra.run.smithi053.stdout:libcephfs-devel-19.1.1-322.g7741f7f9.el9.x86_64 220 kB/s | 32 kB 00:00 2024-09-13T19:14:46.616 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-13T19:14:46.616 INFO:teuthology.orchestra.run.smithi053.stdout:Total 218 kB/s | 32 kB 00:00 2024-09-13T19:14:46.616 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-09-13T19:14:46.620 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-09-13T19:14:46.620 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-09-13T19:14:46.633 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-09-13T19:14:46.633 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-09-13T19:14:46.728 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-09-13T19:14:46.841 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libcephfs-devel-2:19.1.1-322.g7741f7f9.el9.x86_64 1/1 2024-09-13T19:14:46.845 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:37 ago on Fri 13 Sep 2024 07:13:09 PM UTC. 2024-09-13T19:14:46.980 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-13T19:14:46.981 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-13T19:14:46.981 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repo Size 2024-09-13T19:14:46.981 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-13T19:14:46.981 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-13T19:14:46.981 INFO:teuthology.orchestra.run.smithi102.stdout: librados-devel x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 127 k 2024-09-13T19:14:46.981 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:14:46.981 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-13T19:14:46.981 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-13T19:14:46.982 INFO:teuthology.orchestra.run.smithi102.stdout:Install 1 Package 2024-09-13T19:14:46.982 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:14:46.982 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 127 k 2024-09-13T19:14:46.982 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 456 k 2024-09-13T19:14:46.982 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-13T19:14:47.189 INFO:teuthology.orchestra.run.smithi102.stdout:librados-devel-19.1.1-322.g7741f7f9.el9.x86_64. 610 kB/s | 127 kB 00:00 2024-09-13T19:14:47.190 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-13T19:14:47.190 INFO:teuthology.orchestra.run.smithi102.stdout:Total 606 kB/s | 127 kB 00:00 2024-09-13T19:14:47.190 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-13T19:14:47.195 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-13T19:14:47.195 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-13T19:14:47.260 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-13T19:14:47.260 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-13T19:14:47.276 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libcephfs-devel-2:19.1.1-322.g7741f7f9.el9.x86_64 1/1 2024-09-13T19:14:47.412 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-13T19:14:47.512 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librados-devel-2:19.1.1-322.g7741f7f9.el9.x86_64 1/1 2024-09-13T19:14:47.527 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libcephfs-devel-2:19.1.1-322.g7741f7f9.el9.x86_64 1/1 2024-09-13T19:14:47.527 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:47.527 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-09-13T19:14:47.527 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs-devel-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:14:47.527 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:47.527 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-13T19:14:47.706 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install librados2 2024-09-13T19:14:47.944 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librados-devel-2:19.1.1-322.g7741f7f9.el9.x86_64 1/1 2024-09-13T19:14:48.193 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados-devel-2:19.1.1-322.g7741f7f9.el9.x86_64 1/1 2024-09-13T19:14:48.193 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:14:48.194 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-13T19:14:48.194 INFO:teuthology.orchestra.run.smithi102.stdout: librados-devel-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:14:48.194 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:14:48.194 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-13T19:14:48.299 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:39 ago on Fri 13 Sep 2024 07:13:09 PM UTC. 2024-09-13T19:14:48.393 INFO:teuthology.orchestra.run.smithi053.stdout:Package librados2-2:19.1.1-322.g7741f7f9.el9.x86_64 is already installed. 2024-09-13T19:14:48.414 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install libcephfs2 2024-09-13T19:14:48.439 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-13T19:14:48.441 INFO:teuthology.orchestra.run.smithi053.stdout:Nothing to do. 2024-09-13T19:14:48.441 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-13T19:14:48.503 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install librbd1 2024-09-13T19:14:48.998 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:39 ago on Fri 13 Sep 2024 07:13:09 PM UTC. 2024-09-13T19:14:49.090 INFO:teuthology.orchestra.run.smithi102.stdout:Package libcephfs2-2:19.1.1-322.g7741f7f9.el9.x86_64 is already installed. 2024-09-13T19:14:49.096 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:40 ago on Fri 13 Sep 2024 07:13:09 PM UTC. 2024-09-13T19:14:49.134 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-13T19:14:49.135 INFO:teuthology.orchestra.run.smithi102.stdout:Nothing to do. 2024-09-13T19:14:49.135 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-13T19:14:49.191 INFO:teuthology.orchestra.run.smithi053.stdout:Package librbd1-2:19.1.1-322.g7741f7f9.el9.x86_64 is already installed. 2024-09-13T19:14:49.209 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install libcephfs-devel 2024-09-13T19:14:49.237 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-13T19:14:49.238 INFO:teuthology.orchestra.run.smithi053.stdout:Nothing to do. 2024-09-13T19:14:49.239 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-13T19:14:49.302 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install python3-rados 2024-09-13T19:14:49.773 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:40 ago on Fri 13 Sep 2024 07:13:09 PM UTC. 2024-09-13T19:14:49.896 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:40 ago on Fri 13 Sep 2024 07:13:09 PM UTC. 2024-09-13T19:14:49.906 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-13T19:14:49.907 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-13T19:14:49.907 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repo Size 2024-09-13T19:14:49.908 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-13T19:14:49.908 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-13T19:14:49.908 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs-devel x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 32 k 2024-09-13T19:14:49.908 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:14:49.908 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-13T19:14:49.908 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-13T19:14:49.908 INFO:teuthology.orchestra.run.smithi102.stdout:Install 1 Package 2024-09-13T19:14:49.908 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:14:49.908 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 32 k 2024-09-13T19:14:49.908 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 142 k 2024-09-13T19:14:49.908 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-13T19:14:49.990 INFO:teuthology.orchestra.run.smithi053.stdout:Package python3-rados-2:19.1.1-322.g7741f7f9.el9.x86_64 is already installed. 2024-09-13T19:14:50.036 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-13T19:14:50.037 INFO:teuthology.orchestra.run.smithi053.stdout:Nothing to do. 2024-09-13T19:14:50.037 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-13T19:14:50.059 INFO:teuthology.orchestra.run.smithi102.stdout:libcephfs-devel-19.1.1-322.g7741f7f9.el9.x86_64 209 kB/s | 32 kB 00:00 2024-09-13T19:14:50.060 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-13T19:14:50.060 INFO:teuthology.orchestra.run.smithi102.stdout:Total 207 kB/s | 32 kB 00:00 2024-09-13T19:14:50.060 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-13T19:14:50.064 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-13T19:14:50.064 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-13T19:14:50.079 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-13T19:14:50.079 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-13T19:14:50.101 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install python3-rgw 2024-09-13T19:14:50.169 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-13T19:14:50.290 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcephfs-devel-2:19.1.1-322.g7741f7f9.el9.x86_64 1/1 2024-09-13T19:14:50.662 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libcephfs-devel-2:19.1.1-322.g7741f7f9.el9.x86_64 1/1 2024-09-13T19:14:50.692 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:41 ago on Fri 13 Sep 2024 07:13:09 PM UTC. 2024-09-13T19:14:50.785 INFO:teuthology.orchestra.run.smithi053.stdout:Package python3-rgw-2:19.1.1-322.g7741f7f9.el9.x86_64 is already installed. 2024-09-13T19:14:50.831 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-13T19:14:50.832 INFO:teuthology.orchestra.run.smithi053.stdout:Nothing to do. 2024-09-13T19:14:50.832 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-13T19:14:50.892 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcephfs-devel-2:19.1.1-322.g7741f7f9.el9.x86_64 1/1 2024-09-13T19:14:50.892 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:14:50.892 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-13T19:14:50.892 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs-devel-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:14:50.892 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:14:50.892 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-13T19:14:50.895 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install python3-cephfs 2024-09-13T19:14:51.131 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install librados2 2024-09-13T19:14:51.490 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:42 ago on Fri 13 Sep 2024 07:13:09 PM UTC. 2024-09-13T19:14:51.585 INFO:teuthology.orchestra.run.smithi053.stdout:Package python3-cephfs-2:19.1.1-322.g7741f7f9.el9.x86_64 is already installed. 2024-09-13T19:14:51.631 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-13T19:14:51.632 INFO:teuthology.orchestra.run.smithi053.stdout:Nothing to do. 2024-09-13T19:14:51.632 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-13T19:14:51.693 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install python3-rbd 2024-09-13T19:14:51.698 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:42 ago on Fri 13 Sep 2024 07:13:09 PM UTC. 2024-09-13T19:14:51.789 INFO:teuthology.orchestra.run.smithi102.stdout:Package librados2-2:19.1.1-322.g7741f7f9.el9.x86_64 is already installed. 2024-09-13T19:14:51.835 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-13T19:14:51.836 INFO:teuthology.orchestra.run.smithi102.stdout:Nothing to do. 2024-09-13T19:14:51.836 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-13T19:14:51.919 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install librbd1 2024-09-13T19:14:52.286 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:43 ago on Fri 13 Sep 2024 07:13:09 PM UTC. 2024-09-13T19:14:52.380 INFO:teuthology.orchestra.run.smithi053.stdout:Package python3-rbd-2:19.1.1-322.g7741f7f9.el9.x86_64 is already installed. 2024-09-13T19:14:52.426 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-13T19:14:52.427 INFO:teuthology.orchestra.run.smithi053.stdout:Nothing to do. 2024-09-13T19:14:52.427 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-13T19:14:52.486 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:43 ago on Fri 13 Sep 2024 07:13:09 PM UTC. 2024-09-13T19:14:52.493 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install rbd-fuse 2024-09-13T19:14:52.575 INFO:teuthology.orchestra.run.smithi102.stdout:Package librbd1-2:19.1.1-322.g7741f7f9.el9.x86_64 is already installed. 2024-09-13T19:14:52.619 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-13T19:14:52.620 INFO:teuthology.orchestra.run.smithi102.stdout:Nothing to do. 2024-09-13T19:14:52.620 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-13T19:14:52.701 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install python3-rados 2024-09-13T19:14:53.087 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:44 ago on Fri 13 Sep 2024 07:13:09 PM UTC. 2024-09-13T19:14:53.228 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-13T19:14:53.229 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-13T19:14:53.229 INFO:teuthology.orchestra.run.smithi053.stdout: Package Architecture Version Repository Size 2024-09-13T19:14:53.229 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-13T19:14:53.229 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-09-13T19:14:53.230 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-fuse x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 85 k 2024-09-13T19:14:53.230 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:53.230 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-09-13T19:14:53.230 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-13T19:14:53.230 INFO:teuthology.orchestra.run.smithi053.stdout:Install 1 Package 2024-09-13T19:14:53.230 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:53.230 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 85 k 2024-09-13T19:14:53.230 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 231 k 2024-09-13T19:14:53.230 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-09-13T19:14:53.271 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:44 ago on Fri 13 Sep 2024 07:13:09 PM UTC. 2024-09-13T19:14:53.361 INFO:teuthology.orchestra.run.smithi102.stdout:Package python3-rados-2:19.1.1-322.g7741f7f9.el9.x86_64 is already installed. 2024-09-13T19:14:53.405 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-13T19:14:53.405 INFO:teuthology.orchestra.run.smithi102.stdout:Nothing to do. 2024-09-13T19:14:53.406 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-13T19:14:53.419 INFO:teuthology.orchestra.run.smithi053.stdout:rbd-fuse-19.1.1-322.g7741f7f9.el9.x86_64.rpm 452 kB/s | 85 kB 00:00 2024-09-13T19:14:53.419 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-13T19:14:53.420 INFO:teuthology.orchestra.run.smithi053.stdout:Total 449 kB/s | 85 kB 00:00 2024-09-13T19:14:53.420 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-09-13T19:14:53.427 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-09-13T19:14:53.427 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-09-13T19:14:53.484 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install python3-rgw 2024-09-13T19:14:53.495 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-09-13T19:14:53.496 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-09-13T19:14:53.653 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-09-13T19:14:53.753 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : rbd-fuse-2:19.1.1-322.g7741f7f9.el9.x86_64 1/1 2024-09-13T19:14:54.054 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:45 ago on Fri 13 Sep 2024 07:13:09 PM UTC. 2024-09-13T19:14:54.136 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: rbd-fuse-2:19.1.1-322.g7741f7f9.el9.x86_64 1/1 2024-09-13T19:14:54.145 INFO:teuthology.orchestra.run.smithi102.stdout:Package python3-rgw-2:19.1.1-322.g7741f7f9.el9.x86_64 is already installed. 2024-09-13T19:14:54.188 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-13T19:14:54.189 INFO:teuthology.orchestra.run.smithi102.stdout:Nothing to do. 2024-09-13T19:14:54.189 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-13T19:14:54.268 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install python3-cephfs 2024-09-13T19:14:54.420 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : rbd-fuse-2:19.1.1-322.g7741f7f9.el9.x86_64 1/1 2024-09-13T19:14:54.421 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:54.421 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-09-13T19:14:54.421 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-fuse-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:14:54.421 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:54.421 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-13T19:14:54.717 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install rbd-mirror 2024-09-13T19:14:54.830 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:45 ago on Fri 13 Sep 2024 07:13:09 PM UTC. 2024-09-13T19:14:54.919 INFO:teuthology.orchestra.run.smithi102.stdout:Package python3-cephfs-2:19.1.1-322.g7741f7f9.el9.x86_64 is already installed. 2024-09-13T19:14:54.963 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-13T19:14:54.964 INFO:teuthology.orchestra.run.smithi102.stdout:Nothing to do. 2024-09-13T19:14:54.964 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-13T19:14:55.040 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install python3-rbd 2024-09-13T19:14:55.328 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:46 ago on Fri 13 Sep 2024 07:13:09 PM UTC. 2024-09-13T19:14:55.470 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-13T19:14:55.471 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-13T19:14:55.471 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repo Size 2024-09-13T19:14:55.471 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-13T19:14:55.472 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-09-13T19:14:55.472 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-mirror x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 3.1 M 2024-09-13T19:14:55.472 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:55.472 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-09-13T19:14:55.472 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-13T19:14:55.472 INFO:teuthology.orchestra.run.smithi053.stdout:Install 1 Package 2024-09-13T19:14:55.472 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:55.472 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 3.1 M 2024-09-13T19:14:55.472 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 13 M 2024-09-13T19:14:55.472 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-09-13T19:14:55.610 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:46 ago on Fri 13 Sep 2024 07:13:09 PM UTC. 2024-09-13T19:14:55.702 INFO:teuthology.orchestra.run.smithi102.stdout:Package python3-rbd-2:19.1.1-322.g7741f7f9.el9.x86_64 is already installed. 2024-09-13T19:14:55.746 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-13T19:14:55.747 INFO:teuthology.orchestra.run.smithi102.stdout:Nothing to do. 2024-09-13T19:14:55.747 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-13T19:14:55.790 INFO:teuthology.orchestra.run.smithi053.stdout:rbd-mirror-19.1.1-322.g7741f7f9.el9.x86_64.rpm 9.8 MB/s | 3.1 MB 00:00 2024-09-13T19:14:55.790 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-13T19:14:55.791 INFO:teuthology.orchestra.run.smithi053.stdout:Total 9.7 MB/s | 3.1 MB 00:00 2024-09-13T19:14:55.791 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-09-13T19:14:55.801 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-09-13T19:14:55.801 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-09-13T19:14:55.827 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install rbd-fuse 2024-09-13T19:14:55.886 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-09-13T19:14:55.886 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-09-13T19:14:56.354 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-09-13T19:14:56.388 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:47 ago on Fri 13 Sep 2024 07:13:09 PM UTC. 2024-09-13T19:14:56.416 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : rbd-mirror-2:19.1.1-322.g7741f7f9.el9.x86_64 1/1 2024-09-13T19:14:56.443 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: rbd-mirror-2:19.1.1-322.g7741f7f9.el9.x86_64 1/1 2024-09-13T19:14:56.444 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T19:14:56.444 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T19:14:56.444 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T19:14:56.444 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T19:14:56.444 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:56.522 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-13T19:14:56.523 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-13T19:14:56.523 INFO:teuthology.orchestra.run.smithi102.stdout: Package Architecture Version Repository Size 2024-09-13T19:14:56.523 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-13T19:14:56.523 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-13T19:14:56.523 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-fuse x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 85 k 2024-09-13T19:14:56.523 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:14:56.523 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-13T19:14:56.523 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-13T19:14:56.523 INFO:teuthology.orchestra.run.smithi102.stdout:Install 1 Package 2024-09-13T19:14:56.523 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:14:56.524 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 85 k 2024-09-13T19:14:56.524 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 231 k 2024-09-13T19:14:56.524 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-13T19:14:56.713 INFO:teuthology.orchestra.run.smithi102.stdout:rbd-fuse-19.1.1-322.g7741f7f9.el9.x86_64.rpm 451 kB/s | 85 kB 00:00 2024-09-13T19:14:56.713 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-13T19:14:56.714 INFO:teuthology.orchestra.run.smithi102.stdout:Total 448 kB/s | 85 kB 00:00 2024-09-13T19:14:56.714 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-13T19:14:56.720 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-13T19:14:56.720 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-13T19:14:56.783 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-13T19:14:56.783 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-13T19:14:56.931 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-13T19:14:57.027 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-fuse-2:19.1.1-322.g7741f7f9.el9.x86_64 1/1 2024-09-13T19:14:57.404 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: rbd-fuse-2:19.1.1-322.g7741f7f9.el9.x86_64 1/1 2024-09-13T19:14:57.568 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : rbd-mirror-2:19.1.1-322.g7741f7f9.el9.x86_64 1/1 2024-09-13T19:14:57.568 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:57.568 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-09-13T19:14:57.568 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-mirror-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:14:57.568 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:57.568 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-13T19:14:57.662 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-fuse-2:19.1.1-322.g7741f7f9.el9.x86_64 1/1 2024-09-13T19:14:57.662 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:14:57.662 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-13T19:14:57.662 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-fuse-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:14:57.662 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:14:57.662 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-13T19:14:57.812 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install rbd-nbd 2024-09-13T19:14:57.935 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install rbd-mirror 2024-09-13T19:14:58.412 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:49 ago on Fri 13 Sep 2024 07:13:09 PM UTC. 2024-09-13T19:14:58.517 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:49 ago on Fri 13 Sep 2024 07:13:09 PM UTC. 2024-09-13T19:14:58.552 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-13T19:14:58.552 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-13T19:14:58.552 INFO:teuthology.orchestra.run.smithi053.stdout: Package Architecture Version Repository Size 2024-09-13T19:14:58.552 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-13T19:14:58.553 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-09-13T19:14:58.553 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-nbd x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 171 k 2024-09-13T19:14:58.553 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:58.553 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-09-13T19:14:58.553 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-13T19:14:58.553 INFO:teuthology.orchestra.run.smithi053.stdout:Install 1 Package 2024-09-13T19:14:58.553 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:58.553 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 171 k 2024-09-13T19:14:58.553 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 494 k 2024-09-13T19:14:58.553 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-09-13T19:14:58.655 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-13T19:14:58.656 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-13T19:14:58.656 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repo Size 2024-09-13T19:14:58.656 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-13T19:14:58.656 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-13T19:14:58.656 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-mirror x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 3.1 M 2024-09-13T19:14:58.657 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:14:58.657 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-13T19:14:58.657 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-13T19:14:58.657 INFO:teuthology.orchestra.run.smithi102.stdout:Install 1 Package 2024-09-13T19:14:58.657 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:14:58.657 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 3.1 M 2024-09-13T19:14:58.657 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 13 M 2024-09-13T19:14:58.657 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-13T19:14:58.768 INFO:teuthology.orchestra.run.smithi053.stdout:rbd-nbd-19.1.1-322.g7741f7f9.el9.x86_64.rpm 794 kB/s | 171 kB 00:00 2024-09-13T19:14:58.769 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-13T19:14:58.769 INFO:teuthology.orchestra.run.smithi053.stdout:Total 789 kB/s | 171 kB 00:00 2024-09-13T19:14:58.769 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-09-13T19:14:58.778 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-09-13T19:14:58.778 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-09-13T19:14:58.845 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-09-13T19:14:58.846 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-09-13T19:14:59.003 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-09-13T19:14:59.008 INFO:teuthology.orchestra.run.smithi102.stdout:rbd-mirror-19.1.1-322.g7741f7f9.el9.x86_64.rpm 8.8 MB/s | 3.1 MB 00:00 2024-09-13T19:14:59.009 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-13T19:14:59.009 INFO:teuthology.orchestra.run.smithi102.stdout:Total 8.8 MB/s | 3.1 MB 00:00 2024-09-13T19:14:59.009 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-13T19:14:59.018 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-13T19:14:59.019 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-13T19:14:59.102 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : rbd-nbd-2:19.1.1-322.g7741f7f9.el9.x86_64 1/1 2024-09-13T19:14:59.104 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-13T19:14:59.104 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-13T19:14:59.544 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: rbd-nbd-2:19.1.1-322.g7741f7f9.el9.x86_64 1/1 2024-09-13T19:14:59.550 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-13T19:14:59.617 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-mirror-2:19.1.1-322.g7741f7f9.el9.x86_64 1/1 2024-09-13T19:14:59.643 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: rbd-mirror-2:19.1.1-322.g7741f7f9.el9.x86_64 1/1 2024-09-13T19:14:59.643 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T19:14:59.643 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T19:14:59.643 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T19:14:59.644 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T19:14:59.644 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:14:59.810 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : rbd-nbd-2:19.1.1-322.g7741f7f9.el9.x86_64 1/1 2024-09-13T19:14:59.810 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:59.810 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-09-13T19:14:59.810 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-nbd-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:14:59.810 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:14:59.810 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-13T19:15:00.022 DEBUG:teuthology.parallel:result is None 2024-09-13T19:15:00.792 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-mirror-2:19.1.1-322.g7741f7f9.el9.x86_64 1/1 2024-09-13T19:15:00.792 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:15:00.792 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-13T19:15:00.793 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-mirror-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:15:00.793 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:15:00.793 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-13T19:15:01.045 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install rbd-nbd 2024-09-13T19:15:01.630 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:52 ago on Fri 13 Sep 2024 07:13:09 PM UTC. 2024-09-13T19:15:01.766 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-13T19:15:01.767 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-13T19:15:01.767 INFO:teuthology.orchestra.run.smithi102.stdout: Package Architecture Version Repository Size 2024-09-13T19:15:01.767 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-13T19:15:01.767 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-13T19:15:01.767 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-nbd x86_64 2:19.1.1-322.g7741f7f9.el9 ceph 171 k 2024-09-13T19:15:01.767 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:15:01.767 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-13T19:15:01.767 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-13T19:15:01.767 INFO:teuthology.orchestra.run.smithi102.stdout:Install 1 Package 2024-09-13T19:15:01.767 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:15:01.768 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 171 k 2024-09-13T19:15:01.768 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 494 k 2024-09-13T19:15:01.768 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-13T19:15:01.979 INFO:teuthology.orchestra.run.smithi102.stdout:rbd-nbd-19.1.1-322.g7741f7f9.el9.x86_64.rpm 809 kB/s | 171 kB 00:00 2024-09-13T19:15:01.979 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-13T19:15:01.980 INFO:teuthology.orchestra.run.smithi102.stdout:Total 804 kB/s | 171 kB 00:00 2024-09-13T19:15:01.980 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-13T19:15:01.987 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-13T19:15:01.987 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-13T19:15:02.052 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-13T19:15:02.052 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-13T19:15:02.206 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-13T19:15:02.311 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-nbd-2:19.1.1-322.g7741f7f9.el9.x86_64 1/1 2024-09-13T19:15:02.768 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: rbd-nbd-2:19.1.1-322.g7741f7f9.el9.x86_64 1/1 2024-09-13T19:15:03.052 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-nbd-2:19.1.1-322.g7741f7f9.el9.x86_64 1/1 2024-09-13T19:15:03.052 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:15:03.052 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-13T19:15:03.052 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-nbd-2:19.1.1-322.g7741f7f9.el9.x86_64 2024-09-13T19:15:03.052 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:15:03.052 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-13T19:15:03.284 DEBUG:teuthology.parallel:result is None 2024-09-13T19:15:03.285 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T19:15:03.436 DEBUG:teuthology.orchestra.run.smithi053:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T19:15:03.462 INFO:teuthology.orchestra.run.smithi053.stdout:19.1.1-322.g7741f7f9.el9 2024-09-13T19:15:03.463 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-322.g7741f7f9.el9 2024-09-13T19:15:03.463 INFO:teuthology.task.install:The correct ceph version 19.1.1-322.g7741f7f9 is installed. 2024-09-13T19:15:03.465 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T19:15:03.616 DEBUG:teuthology.orchestra.run.smithi102:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T19:15:03.637 INFO:teuthology.orchestra.run.smithi102.stdout:19.1.1-322.g7741f7f9.el9 2024-09-13T19:15:03.638 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-322.g7741f7f9.el9 2024-09-13T19:15:03.638 INFO:teuthology.task.install:The correct ceph version 19.1.1-322.g7741f7f9 is installed. 2024-09-13T19:15:03.639 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-13T19:15:03.640 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T19:15:03.640 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T19:15:03.671 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-13T19:15:03.671 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T19:15:03.703 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-13T19:15:03.704 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T19:15:03.704 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T19:15:03.742 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T19:15:03.812 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-13T19:15:03.812 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T19:15:03.837 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T19:15:03.901 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-13T19:15:03.902 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T19:15:03.902 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T19:15:03.932 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T19:15:04.001 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-13T19:15:04.001 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T19:15:04.033 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T19:15:04.101 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-13T19:15:04.102 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T19:15:04.102 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T19:15:04.131 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T19:15:04.201 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-13T19:15:04.201 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T19:15:04.226 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T19:15:04.291 INFO:teuthology.run_tasks:Running task ceph... 2024-09-13T19:15:04.378 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-13T19:15:04.379 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 777 /var/log/ceph 2024-09-13T19:15:04.382 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 777 /var/log/ceph 2024-09-13T19:15:04.408 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-13T19:15:04.409 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T19:15:04.451 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T19:15:04.479 INFO:tasks.ceph:Creating extra log directories... 2024-09-13T19:15:04.479 DEBUG:teuthology.orchestra.run.smithi053:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T19:15:04.523 DEBUG:teuthology.orchestra.run.smithi102:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T19:15:04.557 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-13T19:15:04.557 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-13T19:15:04.557 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-09-13_16:28:49-rgw-squid-distro-default-smithi/7904057', 'branch': 'squid', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{centos_latest}}', 'email': None, 'first_in_suite': False, 'job_id': '7904057', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-09-13_16:28:49-rgw-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '7741f7f9ee20524f89b8f61d1609b32fb3b1570a'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '7741f7f9ee20524f89b8f61d1609b32fb3b1570a'}}, 'rgw': {'ec-data-pool': True, 'frontend': 'beast'}, 's3tests': {'slow_backend': True}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-qa-rgw-squid-65651', 'sha1': '24ee2aeecf070bf47d80960334abd82047ad2def'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 90, 'repo': 'https://github.com/ceph/ceph.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 9887, 'sha1': '7741f7f9ee20524f89b8f61d1609b32fb3b1570a', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-qa-rgw-squid-65651', 'suite_path': '/home/teuthworker/src/github.com_cbodley_ceph_24ee2aeecf070bf47d80960334abd82047ad2def/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/cbodley/ceph.git', 'suite_sha1': '24ee2aeecf070bf47d80960334abd82047ad2def', 'targets': {'smithi053.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFDyaSQ/xxd6S1WNmtLKJE/WMOOLhBplKBder2lIeYo4hMGfCc9asF6wo+gSG41zWT1DpWye7KGIJTAWb65mY/o=', 'smithi102.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG9ncRXyXh2/RhXG2gDll0zx5tgIkDuskPZtj9bNOGY8gjiDHLRC1uWCghrK2lPVcJjfInQgYptvqRvLrBq0nMU='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '7741f7f9ee20524f89b8f61d1609b32fb3b1570a', 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-13_16:28:49', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-13T19:15:04.558 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T19:15:04.592 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T19:15:04.609 DEBUG:teuthology.orchestra.run.smithi053:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T19:15:04.650 DEBUG:teuthology.orchestra.run.smithi102:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T19:15:04.920 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T19:15:04.921 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T19:15:04.967 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T19:15:04.968 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_1 2024-09-13T19:15:05.038 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T19:15:05.038 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T19:15:05.038 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 670 Links: 1 2024-09-13T19:15:05.038 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T19:15:05.038 INFO:teuthology.orchestra.run.smithi053.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T19:15:05.038 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-09-13 19:14:56.702168214 +0000 2024-09-13T19:15:05.038 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-09-13 19:12:28.219293644 +0000 2024-09-13T19:15:05.038 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-09-13 19:12:28.219293644 +0000 2024-09-13T19:15:05.039 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: 2024-09-13 19:12:28.219293644 +0000 2024-09-13T19:15:05.039 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T19:15:05.116 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-09-13T19:15:05.116 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-09-13T19:15:05.116 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000107733 s, 4.8 MB/s 2024-09-13T19:15:05.117 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T19:15:05.187 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_2 2024-09-13T19:15:05.255 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T19:15:05.255 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T19:15:05.255 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 688 Links: 1 2024-09-13T19:15:05.255 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T19:15:05.255 INFO:teuthology.orchestra.run.smithi053.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T19:15:05.255 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-09-13 19:14:56.702168214 +0000 2024-09-13T19:15:05.256 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-09-13 19:12:28.550286826 +0000 2024-09-13T19:15:05.256 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-09-13 19:12:28.550286826 +0000 2024-09-13T19:15:05.256 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: 2024-09-13 19:12:28.550286826 +0000 2024-09-13T19:15:05.256 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T19:15:05.324 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-09-13T19:15:05.324 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-09-13T19:15:05.324 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 8.9434e-05 s, 5.7 MB/s 2024-09-13T19:15:05.325 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T19:15:05.384 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_3 2024-09-13T19:15:05.442 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T19:15:05.442 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T19:15:05.442 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-13T19:15:05.442 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T19:15:05.442 INFO:teuthology.orchestra.run.smithi053.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T19:15:05.442 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-09-13 19:14:56.703168194 +0000 2024-09-13T19:15:05.442 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-09-13 19:12:28.871280214 +0000 2024-09-13T19:15:05.443 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-09-13 19:12:28.871280214 +0000 2024-09-13T19:15:05.443 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: 2024-09-13 19:12:28.871280214 +0000 2024-09-13T19:15:05.443 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T19:15:05.508 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-09-13T19:15:05.508 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-09-13T19:15:05.509 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 9.5444e-05 s, 5.4 MB/s 2024-09-13T19:15:05.510 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T19:15:05.568 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_4 2024-09-13T19:15:05.624 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T19:15:05.625 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T19:15:05.625 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 727 Links: 1 2024-09-13T19:15:05.625 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T19:15:05.625 INFO:teuthology.orchestra.run.smithi053.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T19:15:05.625 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-09-13 19:14:56.703168194 +0000 2024-09-13T19:15:05.625 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-09-13 19:12:29.195273540 +0000 2024-09-13T19:15:05.626 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-09-13 19:12:29.195273540 +0000 2024-09-13T19:15:05.626 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: 2024-09-13 19:12:29.195273540 +0000 2024-09-13T19:15:05.626 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T19:15:05.689 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-09-13T19:15:05.690 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-09-13T19:15:05.690 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 9.4185e-05 s, 5.4 MB/s 2024-09-13T19:15:05.691 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T19:15:05.749 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-13T19:15:05.749 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-13T19:15:05.749 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T19:15:05.766 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T19:15:05.767 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_1 2024-09-13T19:15:05.825 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T19:15:05.825 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T19:15:05.825 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-13T19:15:05.825 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T19:15:05.825 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T19:15:05.825 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-13 19:14:59.905475042 +0000 2024-09-13T19:15:05.825 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-13 19:12:21.832655211 +0000 2024-09-13T19:15:05.825 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-13 19:12:21.832655211 +0000 2024-09-13T19:15:05.825 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-09-13 19:12:21.832655211 +0000 2024-09-13T19:15:05.826 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T19:15:05.890 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-09-13T19:15:05.890 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-09-13T19:15:05.890 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000289133 s, 1.8 MB/s 2024-09-13T19:15:05.892 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T19:15:05.950 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_2 2024-09-13T19:15:06.006 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T19:15:06.006 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T19:15:06.007 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-13T19:15:06.007 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T19:15:06.007 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T19:15:06.007 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-13 19:14:59.905475042 +0000 2024-09-13T19:15:06.007 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-13 19:12:22.143648938 +0000 2024-09-13T19:15:06.007 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-13 19:12:22.143648938 +0000 2024-09-13T19:15:06.007 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-09-13 19:12:22.143648938 +0000 2024-09-13T19:15:06.007 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T19:15:06.073 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-09-13T19:15:06.073 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-09-13T19:15:06.073 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.0002836 s, 1.8 MB/s 2024-09-13T19:15:06.074 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T19:15:06.131 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_3 2024-09-13T19:15:06.188 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T19:15:06.188 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T19:15:06.188 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-13T19:15:06.189 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T19:15:06.189 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T19:15:06.189 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-13 19:14:59.905475042 +0000 2024-09-13T19:15:06.189 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-13 19:12:22.456642624 +0000 2024-09-13T19:15:06.189 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-13 19:12:22.456642624 +0000 2024-09-13T19:15:06.189 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-09-13 19:12:22.456642624 +0000 2024-09-13T19:15:06.189 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T19:15:06.255 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-09-13T19:15:06.255 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-09-13T19:15:06.255 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000244367 s, 2.1 MB/s 2024-09-13T19:15:06.256 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T19:15:06.313 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_4 2024-09-13T19:15:06.369 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T19:15:06.369 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T19:15:06.369 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-13T19:15:06.369 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T19:15:06.370 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T19:15:06.370 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-13 19:14:59.906475021 +0000 2024-09-13T19:15:06.370 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-13 19:12:22.777636150 +0000 2024-09-13T19:15:06.370 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-13 19:12:22.777636150 +0000 2024-09-13T19:15:06.370 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-09-13 19:12:22.777636150 +0000 2024-09-13T19:15:06.370 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T19:15:06.433 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-09-13T19:15:06.433 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-09-13T19:15:06.433 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000198892 s, 2.6 MB/s 2024-09-13T19:15:06.434 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T19:15:06.491 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-13T19:15:06.491 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi053.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi102.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-13T19:15:06.491 INFO:tasks.ceph:Generating config... 2024-09-13T19:15:06.492 INFO:tasks.ceph:[client] debug ms = 1 2024-09-13T19:15:06.493 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2024-09-13T19:15:06.493 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-13T19:15:06.493 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-13T19:15:06.493 INFO:tasks.ceph:[client] setuser = ceph 2024-09-13T19:15:06.493 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-13T19:15:06.493 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-13T19:15:06.493 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-13T19:15:06.493 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-13T19:15:06.493 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-13T19:15:06.493 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-13T19:15:06.493 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-13T19:15:06.493 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-13T19:15:06.493 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-13T19:15:06.493 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-13T19:15:06.494 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-13T19:15:06.494 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-13T19:15:06.494 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-13T19:15:06.494 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-13T19:15:06.494 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-13T19:15:06.494 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-13T19:15:06.494 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-13T19:15:06.494 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-13T19:15:06.494 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-13T19:15:06.494 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-13T19:15:06.494 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-13T19:15:06.495 INFO:tasks.ceph:Setting up mon.a... 2024-09-13T19:15:06.495 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-13T19:15:06.562 INFO:teuthology.orchestra.run.smithi053.stdout:creating /etc/ceph/ceph.keyring 2024-09-13T19:15:06.565 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-13T19:15:06.613 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T19:15:06.640 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.53')] 2024-09-13T19:15:06.640 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.53'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2024-09-13T19:15:06.641 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T19:15:06.641 DEBUG:teuthology.orchestra.run.smithi053:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T19:15:06.696 DEBUG:teuthology.orchestra.run.smithi053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.53 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-13T19:15:06.778 INFO:teuthology.orchestra.run.smithi053.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:15:06.778 INFO:teuthology.orchestra.run.smithi053.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:15:06.779 INFO:teuthology.orchestra.run.smithi053.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-13T19:15:06.779 INFO:teuthology.orchestra.run.smithi053.stdout:monmaptool: generated fsid 69e598bd-9014-4d1e-9444-0be214085a05 2024-09-13T19:15:06.779 INFO:teuthology.orchestra.run.smithi053.stdout:setting min_mon_release = quincy 2024-09-13T19:15:06.779 INFO:teuthology.orchestra.run.smithi053.stdout:epoch 0 2024-09-13T19:15:06.779 INFO:teuthology.orchestra.run.smithi053.stdout:fsid 69e598bd-9014-4d1e-9444-0be214085a05 2024-09-13T19:15:06.779 INFO:teuthology.orchestra.run.smithi053.stdout:last_changed 2024-09-13T19:15:06.776853+0000 2024-09-13T19:15:06.779 INFO:teuthology.orchestra.run.smithi053.stdout:created 2024-09-13T19:15:06.776853+0000 2024-09-13T19:15:06.779 INFO:teuthology.orchestra.run.smithi053.stdout:min_mon_release 17 (quincy) 2024-09-13T19:15:06.780 INFO:teuthology.orchestra.run.smithi053.stdout:election_strategy: 1 2024-09-13T19:15:06.780 INFO:teuthology.orchestra.run.smithi053.stdout:0: [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] mon.a 2024-09-13T19:15:06.780 INFO:teuthology.orchestra.run.smithi053.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-13T19:15:06.781 DEBUG:teuthology.orchestra.run.smithi053:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T19:15:06.837 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 69e598bd-9014-4d1e-9444-0be214085a05... 2024-09-13T19:15:06.838 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T19:15:06.879 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T19:15:06.922 INFO:teuthology.orchestra.run.smithi053.stdout:[global] 2024-09-13T19:15:06.922 INFO:teuthology.orchestra.run.smithi053.stdout: chdir = "" 2024-09-13T19:15:06.922 INFO:teuthology.orchestra.run.smithi053.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T19:15:06.922 INFO:teuthology.orchestra.run.smithi053.stdout: auth supported = cephx 2024-09-13T19:15:06.922 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:15:06.922 INFO:teuthology.orchestra.run.smithi053.stdout: filestore xattr use omap = true 2024-09-13T19:15:06.922 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:15:06.922 INFO:teuthology.orchestra.run.smithi053.stdout: mon clock drift allowed = 1.000 2024-09-13T19:15:06.922 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:15:06.923 INFO:teuthology.orchestra.run.smithi053.stdout: osd crush chooseleaf type = 0 2024-09-13T19:15:06.923 INFO:teuthology.orchestra.run.smithi053.stdout: auth debug = true 2024-09-13T19:15:06.923 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:15:06.923 INFO:teuthology.orchestra.run.smithi053.stdout: ms die on old message = true 2024-09-13T19:15:06.923 INFO:teuthology.orchestra.run.smithi053.stdout: ms die on bug = true 2024-09-13T19:15:06.923 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:15:06.923 INFO:teuthology.orchestra.run.smithi053.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T19:15:06.923 INFO:teuthology.orchestra.run.smithi053.stdout: mon pg warn max object skew = 0 2024-09-13T19:15:06.923 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:15:06.923 INFO:teuthology.orchestra.run.smithi053.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T19:15:06.923 INFO:teuthology.orchestra.run.smithi053.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T19:15:06.923 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:15:06.924 INFO:teuthology.orchestra.run.smithi053.stdout: osd pool default size = 2 2024-09-13T19:15:06.924 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:15:06.924 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd allow primary affinity = true 2024-09-13T19:15:06.924 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd allow pg remap = true 2024-09-13T19:15:06.924 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on legacy crush tunables = false 2024-09-13T19:15:06.924 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on crush straw calc version zero = false 2024-09-13T19:15:06.924 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on no sortbitwise = false 2024-09-13T19:15:06.924 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on osd down out interval zero = false 2024-09-13T19:15:06.924 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on too few osds = false 2024-09-13T19:15:06.925 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T19:15:06.925 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T19:15:06.925 INFO:teuthology.orchestra.run.smithi053.stdout: mon_allow_pool_size_one = true 2024-09-13T19:15:06.925 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:15:06.925 INFO:teuthology.orchestra.run.smithi053.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T19:15:06.925 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:15:06.925 INFO:teuthology.orchestra.run.smithi053.stdout: osd default data pool replay window = 5 2024-09-13T19:15:06.925 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:15:06.925 INFO:teuthology.orchestra.run.smithi053.stdout: mon allow pool delete = true 2024-09-13T19:15:06.925 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:15:06.926 INFO:teuthology.orchestra.run.smithi053.stdout: mon cluster log file level = debug 2024-09-13T19:15:06.926 INFO:teuthology.orchestra.run.smithi053.stdout: debug asserts on shutdown = true 2024-09-13T19:15:06.926 INFO:teuthology.orchestra.run.smithi053.stdout: mon health detail to clog = false 2024-09-13T19:15:06.926 INFO:teuthology.orchestra.run.smithi053.stdout: mon host = 172.21.15.53 2024-09-13T19:15:06.926 INFO:teuthology.orchestra.run.smithi053.stdout: fsid = 69e598bd-9014-4d1e-9444-0be214085a05 2024-09-13T19:15:06.926 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:15:06.926 INFO:teuthology.orchestra.run.smithi053.stdout:[osd] 2024-09-13T19:15:06.926 INFO:teuthology.orchestra.run.smithi053.stdout: osd journal size = 100 2024-09-13T19:15:06.926 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:15:06.926 INFO:teuthology.orchestra.run.smithi053.stdout: osd scrub load threshold = 5.0 2024-09-13T19:15:06.927 INFO:teuthology.orchestra.run.smithi053.stdout: osd scrub max interval = 600 2024-09-13T19:15:06.927 INFO:teuthology.orchestra.run.smithi053.stdout: osd mclock profile = high_recovery_ops 2024-09-13T19:15:06.927 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:15:06.927 INFO:teuthology.orchestra.run.smithi053.stdout: osd recover clone overlap = true 2024-09-13T19:15:06.927 INFO:teuthology.orchestra.run.smithi053.stdout: osd recovery max chunk = 1048576 2024-09-13T19:15:06.927 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:15:06.927 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug shutdown = true 2024-09-13T19:15:06.927 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug op order = true 2024-09-13T19:15:06.927 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug verify stray on activate = true 2024-09-13T19:15:06.927 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug trim objects = true 2024-09-13T19:15:06.927 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:15:06.928 INFO:teuthology.orchestra.run.smithi053.stdout: osd open classes on start = true 2024-09-13T19:15:06.928 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug pg log writeout = true 2024-09-13T19:15:06.928 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:15:06.928 INFO:teuthology.orchestra.run.smithi053.stdout: osd deep scrub update digest min age = 30 2024-09-13T19:15:06.928 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:15:06.928 INFO:teuthology.orchestra.run.smithi053.stdout: osd map max advance = 10 2024-09-13T19:15:06.928 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:15:06.928 INFO:teuthology.orchestra.run.smithi053.stdout: journal zero on create = true 2024-09-13T19:15:06.928 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:15:06.928 INFO:teuthology.orchestra.run.smithi053.stdout: filestore ondisk finisher threads = 3 2024-09-13T19:15:06.929 INFO:teuthology.orchestra.run.smithi053.stdout: filestore apply finisher threads = 3 2024-09-13T19:15:06.929 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:15:06.929 INFO:teuthology.orchestra.run.smithi053.stdout: bdev debug aio = true 2024-09-13T19:15:06.929 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug misdirected ops = true 2024-09-13T19:15:06.929 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2024-09-13T19:15:06.929 INFO:teuthology.orchestra.run.smithi053.stdout: debug objclass = 20 2024-09-13T19:15:06.929 INFO:teuthology.orchestra.run.smithi053.stdout: bdev async discard = True 2024-09-13T19:15:06.929 INFO:teuthology.orchestra.run.smithi053.stdout: bdev enable discard = True 2024-09-13T19:15:06.930 INFO:teuthology.orchestra.run.smithi053.stdout: bluestore allocator = bitmap 2024-09-13T19:15:06.930 INFO:teuthology.orchestra.run.smithi053.stdout: bluestore block size = 96636764160 2024-09-13T19:15:06.930 INFO:teuthology.orchestra.run.smithi053.stdout: bluestore fsck on mount = True 2024-09-13T19:15:06.930 INFO:teuthology.orchestra.run.smithi053.stdout: debug bluefs = 1/20 2024-09-13T19:15:06.930 INFO:teuthology.orchestra.run.smithi053.stdout: debug bluestore = 1/20 2024-09-13T19:15:06.930 INFO:teuthology.orchestra.run.smithi053.stdout: debug osd = 20 2024-09-13T19:15:06.930 INFO:teuthology.orchestra.run.smithi053.stdout: debug rocksdb = 4/10 2024-09-13T19:15:06.930 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T19:15:06.931 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd full ratio = 0.9 2024-09-13T19:15:06.931 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd nearfull ratio = 0.8 2024-09-13T19:15:06.931 INFO:teuthology.orchestra.run.smithi053.stdout: osd failsafe full ratio = 0.95 2024-09-13T19:15:06.931 INFO:teuthology.orchestra.run.smithi053.stdout: osd objectstore = bluestore 2024-09-13T19:15:06.931 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:15:06.931 INFO:teuthology.orchestra.run.smithi053.stdout:[mgr] 2024-09-13T19:15:06.931 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2024-09-13T19:15:06.932 INFO:teuthology.orchestra.run.smithi053.stdout: debug mgr = 20 2024-09-13T19:15:06.932 INFO:teuthology.orchestra.run.smithi053.stdout: debug mon = 20 2024-09-13T19:15:06.932 INFO:teuthology.orchestra.run.smithi053.stdout: debug auth = 20 2024-09-13T19:15:06.932 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min pgs per osd = 4 2024-09-13T19:15:06.932 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min bytes per osd = 10 2024-09-13T19:15:06.932 INFO:teuthology.orchestra.run.smithi053.stdout: mgr/telemetry/nag = false 2024-09-13T19:15:06.932 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:15:06.932 INFO:teuthology.orchestra.run.smithi053.stdout:[mon] 2024-09-13T19:15:06.932 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2024-09-13T19:15:06.932 INFO:teuthology.orchestra.run.smithi053.stdout: debug mon = 20 2024-09-13T19:15:06.932 INFO:teuthology.orchestra.run.smithi053.stdout: debug paxos = 20 2024-09-13T19:15:06.932 INFO:teuthology.orchestra.run.smithi053.stdout: debug auth = 20 2024-09-13T19:15:06.933 INFO:teuthology.orchestra.run.smithi053.stdout: mon data avail warn = 5 2024-09-13T19:15:06.933 INFO:teuthology.orchestra.run.smithi053.stdout: mon mgr mkfs grace = 240 2024-09-13T19:15:06.933 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min pgs per osd = 4 2024-09-13T19:15:06.933 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd reporter subtree level = osd 2024-09-13T19:15:06.933 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd prime pg temp = true 2024-09-13T19:15:06.933 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min bytes per osd = 10 2024-09-13T19:15:06.934 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:15:06.934 INFO:teuthology.orchestra.run.smithi053.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T19:15:06.934 INFO:teuthology.orchestra.run.smithi053.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T19:15:06.934 INFO:teuthology.orchestra.run.smithi053.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T19:15:06.934 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:15:06.934 INFO:teuthology.orchestra.run.smithi053.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T19:15:06.934 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T19:15:06.934 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T19:15:06.934 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:15:06.935 INFO:teuthology.orchestra.run.smithi053.stdout: # 1m isn't quite enough 2024-09-13T19:15:06.935 INFO:teuthology.orchestra.run.smithi053.stdout: mon_down_mkfs_grace = 2m 2024-09-13T19:15:06.935 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:15:06.935 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_filestore_osds = false 2024-09-13T19:15:06.935 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:15:06.935 INFO:teuthology.orchestra.run.smithi053.stdout:[client] 2024-09-13T19:15:06.935 INFO:teuthology.orchestra.run.smithi053.stdout: rgw cache enabled = true 2024-09-13T19:15:06.935 INFO:teuthology.orchestra.run.smithi053.stdout: rgw enable ops log = true 2024-09-13T19:15:06.935 INFO:teuthology.orchestra.run.smithi053.stdout: rgw enable usage log = true 2024-09-13T19:15:06.936 INFO:teuthology.orchestra.run.smithi053.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T19:15:06.936 INFO:teuthology.orchestra.run.smithi053.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T19:15:06.936 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2024-09-13T19:15:06.936 INFO:teuthology.orchestra.run.smithi053.stdout: rgw gc obj min wait = 15 2024-09-13T19:15:06.936 INFO:teuthology.orchestra.run.smithi053.stdout: debug rgw = 20 2024-09-13T19:15:06.936 INFO:teuthology.orchestra.run.smithi053.stdout: setgroup = ceph 2024-09-13T19:15:06.936 INFO:teuthology.orchestra.run.smithi053.stdout: setuser = ceph 2024-09-13T19:15:06.936 INFO:teuthology.orchestra.run.smithi053.stdout:[mon.a] 2024-09-13T19:15:06.938 INFO:teuthology.orchestra.run.smithi102.stdout:[global] 2024-09-13T19:15:06.938 INFO:teuthology.orchestra.run.smithi102.stdout: chdir = "" 2024-09-13T19:15:06.938 INFO:teuthology.orchestra.run.smithi102.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T19:15:06.939 INFO:teuthology.orchestra.run.smithi102.stdout: auth supported = cephx 2024-09-13T19:15:06.939 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:15:06.939 INFO:teuthology.orchestra.run.smithi102.stdout: filestore xattr use omap = true 2024-09-13T19:15:06.939 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:15:06.939 INFO:teuthology.orchestra.run.smithi102.stdout: mon clock drift allowed = 1.000 2024-09-13T19:15:06.939 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:15:06.939 INFO:teuthology.orchestra.run.smithi102.stdout: osd crush chooseleaf type = 0 2024-09-13T19:15:06.939 INFO:teuthology.orchestra.run.smithi102.stdout: auth debug = true 2024-09-13T19:15:06.940 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:15:06.940 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on old message = true 2024-09-13T19:15:06.940 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on bug = true 2024-09-13T19:15:06.940 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:15:06.940 INFO:teuthology.orchestra.run.smithi102.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T19:15:06.940 INFO:teuthology.orchestra.run.smithi102.stdout: mon pg warn max object skew = 0 2024-09-13T19:15:06.940 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:15:06.940 INFO:teuthology.orchestra.run.smithi102.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T19:15:06.940 INFO:teuthology.orchestra.run.smithi102.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T19:15:06.940 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:15:06.941 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default size = 2 2024-09-13T19:15:06.941 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:15:06.941 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow primary affinity = true 2024-09-13T19:15:06.941 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow pg remap = true 2024-09-13T19:15:06.941 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on legacy crush tunables = false 2024-09-13T19:15:06.941 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on crush straw calc version zero = false 2024-09-13T19:15:06.941 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on no sortbitwise = false 2024-09-13T19:15:06.941 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on osd down out interval zero = false 2024-09-13T19:15:06.942 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on too few osds = false 2024-09-13T19:15:06.942 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T19:15:06.942 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T19:15:06.942 INFO:teuthology.orchestra.run.smithi102.stdout: mon_allow_pool_size_one = true 2024-09-13T19:15:06.942 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:15:06.942 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T19:15:06.942 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:15:06.942 INFO:teuthology.orchestra.run.smithi102.stdout: osd default data pool replay window = 5 2024-09-13T19:15:06.943 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:15:06.943 INFO:teuthology.orchestra.run.smithi102.stdout: mon allow pool delete = true 2024-09-13T19:15:06.943 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:15:06.943 INFO:teuthology.orchestra.run.smithi102.stdout: mon cluster log file level = debug 2024-09-13T19:15:06.943 INFO:teuthology.orchestra.run.smithi102.stdout: debug asserts on shutdown = true 2024-09-13T19:15:06.943 INFO:teuthology.orchestra.run.smithi102.stdout: mon health detail to clog = false 2024-09-13T19:15:06.943 INFO:teuthology.orchestra.run.smithi102.stdout: mon host = 172.21.15.53 2024-09-13T19:15:06.943 INFO:teuthology.orchestra.run.smithi102.stdout: fsid = 69e598bd-9014-4d1e-9444-0be214085a05 2024-09-13T19:15:06.944 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:15:06.944 INFO:teuthology.orchestra.run.smithi102.stdout:[osd] 2024-09-13T19:15:06.944 INFO:teuthology.orchestra.run.smithi102.stdout: osd journal size = 100 2024-09-13T19:15:06.944 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:15:06.944 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub load threshold = 5.0 2024-09-13T19:15:06.944 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub max interval = 600 2024-09-13T19:15:06.944 INFO:teuthology.orchestra.run.smithi102.stdout: osd mclock profile = high_recovery_ops 2024-09-13T19:15:06.944 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:15:06.944 INFO:teuthology.orchestra.run.smithi102.stdout: osd recover clone overlap = true 2024-09-13T19:15:06.944 INFO:teuthology.orchestra.run.smithi102.stdout: osd recovery max chunk = 1048576 2024-09-13T19:15:06.945 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:15:06.945 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug shutdown = true 2024-09-13T19:15:06.945 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug op order = true 2024-09-13T19:15:06.945 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug verify stray on activate = true 2024-09-13T19:15:06.945 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug trim objects = true 2024-09-13T19:15:06.945 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:15:06.945 INFO:teuthology.orchestra.run.smithi102.stdout: osd open classes on start = true 2024-09-13T19:15:06.945 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug pg log writeout = true 2024-09-13T19:15:06.946 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:15:06.946 INFO:teuthology.orchestra.run.smithi102.stdout: osd deep scrub update digest min age = 30 2024-09-13T19:15:06.946 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:15:06.946 INFO:teuthology.orchestra.run.smithi102.stdout: osd map max advance = 10 2024-09-13T19:15:06.946 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:15:06.946 INFO:teuthology.orchestra.run.smithi102.stdout: journal zero on create = true 2024-09-13T19:15:06.946 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:15:06.946 INFO:teuthology.orchestra.run.smithi102.stdout: filestore ondisk finisher threads = 3 2024-09-13T19:15:06.946 INFO:teuthology.orchestra.run.smithi102.stdout: filestore apply finisher threads = 3 2024-09-13T19:15:06.946 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:15:06.946 INFO:teuthology.orchestra.run.smithi102.stdout: bdev debug aio = true 2024-09-13T19:15:06.946 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug misdirected ops = true 2024-09-13T19:15:06.947 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-09-13T19:15:06.947 INFO:teuthology.orchestra.run.smithi102.stdout: debug objclass = 20 2024-09-13T19:15:06.947 INFO:teuthology.orchestra.run.smithi102.stdout: bdev async discard = True 2024-09-13T19:15:06.947 INFO:teuthology.orchestra.run.smithi102.stdout: bdev enable discard = True 2024-09-13T19:15:06.947 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore allocator = bitmap 2024-09-13T19:15:06.947 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore block size = 96636764160 2024-09-13T19:15:06.947 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore fsck on mount = True 2024-09-13T19:15:06.947 INFO:teuthology.orchestra.run.smithi102.stdout: debug bluefs = 1/20 2024-09-13T19:15:06.947 INFO:teuthology.orchestra.run.smithi102.stdout: debug bluestore = 1/20 2024-09-13T19:15:06.947 INFO:teuthology.orchestra.run.smithi102.stdout: debug osd = 20 2024-09-13T19:15:06.947 INFO:teuthology.orchestra.run.smithi102.stdout: debug rocksdb = 4/10 2024-09-13T19:15:06.947 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T19:15:06.948 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd full ratio = 0.9 2024-09-13T19:15:06.948 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd nearfull ratio = 0.8 2024-09-13T19:15:06.948 INFO:teuthology.orchestra.run.smithi102.stdout: osd failsafe full ratio = 0.95 2024-09-13T19:15:06.948 INFO:teuthology.orchestra.run.smithi102.stdout: osd objectstore = bluestore 2024-09-13T19:15:06.948 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:15:06.948 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr] 2024-09-13T19:15:06.948 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-09-13T19:15:06.948 INFO:teuthology.orchestra.run.smithi102.stdout: debug mgr = 20 2024-09-13T19:15:06.948 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2024-09-13T19:15:06.948 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2024-09-13T19:15:06.948 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2024-09-13T19:15:06.948 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2024-09-13T19:15:06.949 INFO:teuthology.orchestra.run.smithi102.stdout: mgr/telemetry/nag = false 2024-09-13T19:15:06.949 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:15:06.949 INFO:teuthology.orchestra.run.smithi102.stdout:[mon] 2024-09-13T19:15:06.949 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-09-13T19:15:06.949 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2024-09-13T19:15:06.949 INFO:teuthology.orchestra.run.smithi102.stdout: debug paxos = 20 2024-09-13T19:15:06.949 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2024-09-13T19:15:06.949 INFO:teuthology.orchestra.run.smithi102.stdout: mon data avail warn = 5 2024-09-13T19:15:06.949 INFO:teuthology.orchestra.run.smithi102.stdout: mon mgr mkfs grace = 240 2024-09-13T19:15:06.949 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2024-09-13T19:15:06.949 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd reporter subtree level = osd 2024-09-13T19:15:06.949 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd prime pg temp = true 2024-09-13T19:15:06.950 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2024-09-13T19:15:06.950 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:15:06.950 INFO:teuthology.orchestra.run.smithi102.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T19:15:06.950 INFO:teuthology.orchestra.run.smithi102.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T19:15:06.950 INFO:teuthology.orchestra.run.smithi102.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T19:15:06.950 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:15:06.950 INFO:teuthology.orchestra.run.smithi102.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T19:15:06.950 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T19:15:06.950 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T19:15:06.951 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:15:06.951 INFO:teuthology.orchestra.run.smithi102.stdout: # 1m isn't quite enough 2024-09-13T19:15:06.951 INFO:teuthology.orchestra.run.smithi102.stdout: mon_down_mkfs_grace = 2m 2024-09-13T19:15:06.951 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:15:06.951 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_filestore_osds = false 2024-09-13T19:15:06.951 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T19:15:06.951 INFO:teuthology.orchestra.run.smithi102.stdout:[client] 2024-09-13T19:15:06.951 INFO:teuthology.orchestra.run.smithi102.stdout: rgw cache enabled = true 2024-09-13T19:15:06.951 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable ops log = true 2024-09-13T19:15:06.951 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable usage log = true 2024-09-13T19:15:06.951 INFO:teuthology.orchestra.run.smithi102.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T19:15:06.951 INFO:teuthology.orchestra.run.smithi102.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T19:15:06.951 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-09-13T19:15:06.952 INFO:teuthology.orchestra.run.smithi102.stdout: rgw gc obj min wait = 15 2024-09-13T19:15:06.952 INFO:teuthology.orchestra.run.smithi102.stdout: debug rgw = 20 2024-09-13T19:15:06.952 INFO:teuthology.orchestra.run.smithi102.stdout: setgroup = ceph 2024-09-13T19:15:06.952 INFO:teuthology.orchestra.run.smithi102.stdout: setuser = ceph 2024-09-13T19:15:06.952 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.a] 2024-09-13T19:15:06.953 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-13T19:15:06.953 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-13T19:15:07.035 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-13T19:15:07.035 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T19:15:07.035 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-13T19:15:07.051 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T19:15:07.051 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-13T19:15:07.106 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi053.front.sepia.ceph.com 2024-09-13T19:15:07.106 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T19:15:07.106 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T19:15:07.106 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T19:15:07.181 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T19:15:07.182 DEBUG:teuthology.orchestra.run.smithi053:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T19:15:07.238 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi102.front.sepia.ceph.com 2024-09-13T19:15:07.238 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-13T19:15:07.238 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T19:15:07.238 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T19:15:07.274 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-13T19:15:07.274 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T19:15:07.330 INFO:tasks.ceph:Setting up mon nodes... 2024-09-13T19:15:07.330 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-13T19:15:07.330 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T19:15:07.452 INFO:teuthology.orchestra.run.smithi102.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T19:15:07.454 INFO:tasks.ceph:Setting up mds nodes... 2024-09-13T19:15:07.454 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-13T19:15:07.455 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-13T19:15:07.495 INFO:teuthology.orchestra.run.smithi102.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-13T19:15:07.508 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-13T19:15:07.508 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi053.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi102.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-13T19:15:07.508 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-13T19:15:07.535 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-13T19:15:07.535 INFO:tasks.ceph:role: osd.0 2024-09-13T19:15:07.535 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi053.front.sepia.ceph.com 2024-09-13T19:15:07.535 DEBUG:teuthology.orchestra.run.smithi053:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T19:15:07.600 INFO:teuthology.orchestra.run.smithi053.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T19:15:07.601 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T19:15:07.601 INFO:teuthology.orchestra.run.smithi053.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T19:15:07.601 INFO:teuthology.orchestra.run.smithi053.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T19:15:07.601 INFO:teuthology.orchestra.run.smithi053.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T19:15:07.601 INFO:teuthology.orchestra.run.smithi053.stdout: = sunit=0 swidth=0 blks 2024-09-13T19:15:07.601 INFO:teuthology.orchestra.run.smithi053.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T19:15:07.601 INFO:teuthology.orchestra.run.smithi053.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T19:15:07.601 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T19:15:07.601 INFO:teuthology.orchestra.run.smithi053.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T19:15:07.633 INFO:teuthology.orchestra.run.smithi053.stdout:Discarding blocks...Done. 2024-09-13T19:15:07.635 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi053.front.sepia.ceph.com -o noatime 2024-09-13T19:15:07.635 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-13T19:15:07.704 DEBUG:teuthology.orchestra.run.smithi053:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-13T19:15:07.775 DEBUG:teuthology.orchestra.run.smithi053:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T19:15:07.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:07.864+0000 7f7a1342e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-13T19:15:07.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:07.864+0000 7f7a1342e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-13T19:15:07.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:07.864+0000 7f7a1342e640 -1 bdev(0x561c47e57800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-13T19:15:07.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:07.864+0000 7f7a1342e640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-13T19:15:11.783 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T19:15:11.816 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-13T19:15:11.846 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-13T19:15:11.846 INFO:tasks.ceph:role: osd.1 2024-09-13T19:15:11.846 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-13T19:15:11.846 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T19:15:11.921 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T19:15:11.921 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T19:15:11.921 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T19:15:11.921 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T19:15:11.921 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T19:15:11.921 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2024-09-13T19:15:11.921 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T19:15:11.921 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T19:15:11.922 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T19:15:11.922 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T19:15:12.423 INFO:teuthology.orchestra.run.smithi102.stdout:Discarding blocks...Done. 2024-09-13T19:15:12.425 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2024-09-13T19:15:12.425 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-09-13T19:15:12.532 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-13T19:15:12.569 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-13T19:15:12.639 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-13T19:15:12.639 INFO:tasks.ceph:role: osd.2 2024-09-13T19:15:12.639 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-13T19:15:12.639 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-13T19:15:12.716 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T19:15:12.716 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T19:15:12.717 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T19:15:12.717 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T19:15:12.717 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T19:15:12.717 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2024-09-13T19:15:12.717 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T19:15:12.717 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T19:15:12.717 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T19:15:12.717 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T19:15:13.188 INFO:teuthology.orchestra.run.smithi102.stdout:Discarding blocks...Done. 2024-09-13T19:15:13.190 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2024-09-13T19:15:13.190 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-09-13T19:15:13.273 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-13T19:15:13.343 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-13T19:15:13.409 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-13T19:15:13.409 INFO:tasks.ceph:role: osd.3 2024-09-13T19:15:13.409 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-13T19:15:13.409 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-13T19:15:13.481 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T19:15:13.481 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T19:15:13.481 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T19:15:13.481 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T19:15:13.481 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T19:15:13.482 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2024-09-13T19:15:13.483 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T19:15:13.484 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T19:15:13.484 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T19:15:13.484 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T19:15:14.005 INFO:teuthology.orchestra.run.smithi102.stdout:Discarding blocks...Done. 2024-09-13T19:15:14.007 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2024-09-13T19:15:14.007 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-09-13T19:15:14.152 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-13T19:15:14.183 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T19:15:14.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:14.293+0000 7f74bc80c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-13T19:15:14.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:14.295+0000 7f74bc80c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-13T19:15:14.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:14.295+0000 7f74bc80c640 -1 bdev(0x5630d8d11800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-13T19:15:14.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:14.295+0000 7f74bc80c640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-13T19:15:17.948 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T19:15:17.977 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T19:15:18.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:18.067+0000 7fcb99e44640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-13T19:15:18.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:18.067+0000 7fcb99e44640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-13T19:15:18.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:18.067+0000 7fcb99e44640 -1 bdev(0x557ce5feb800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-13T19:15:18.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:18.067+0000 7fcb99e44640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-13T19:15:21.735 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T19:15:21.764 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T19:15:21.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:21.851+0000 7f969a1b2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-13T19:15:21.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:21.851+0000 7f969a1b2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-13T19:15:21.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:21.851+0000 7f969a1b2640 -1 bdev(0x55adf6adb800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-13T19:15:21.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:21.851+0000 7f969a1b2640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-13T19:15:25.770 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T19:15:25.800 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-13T19:15:25.801 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T19:15:25.801 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-13T19:15:25.832 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-13T19:15:25.832 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-13T19:15:25.869 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-13T19:15:25.870 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-13T19:15:25.938 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-13T19:15:25.939 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-13T19:15:26.007 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-13T19:15:26.007 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-13T19:15:26.074 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-13T19:15:26.074 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-13T19:15:26.130 INFO:tasks.ceph:Adding keys to all mons... 2024-09-13T19:15:26.130 DEBUG:teuthology.orchestra.run.smithi053:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-13T19:15:26.159 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.0] 2024-09-13T19:15:26.160 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQA7j+RmhcOjMxAARBr7sL6UORRGspGVdC64HQ== 2024-09-13T19:15:26.160 INFO:teuthology.orchestra.run.smithi053.stdout:[mgr.x] 2024-09-13T19:15:26.160 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQA7j+RmkA7RGhAAtCC65dFOnHZ/wfiqoOOCMw== 2024-09-13T19:15:26.160 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.1] 2024-09-13T19:15:26.160 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBCj+Rm8BqGERAA6BiJhkim613ZEOSQCePXVQ== 2024-09-13T19:15:26.160 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.2] 2024-09-13T19:15:26.160 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBGj+RmifkRBBAAwlzc2ORCPhT4W8gE1Sl7Vw== 2024-09-13T19:15:26.160 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.3] 2024-09-13T19:15:26.160 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBJj+RmCuPNMhAATM6N6Wp/kmacoZdvFFoU+Q== 2024-09-13T19:15:26.161 INFO:teuthology.orchestra.run.smithi053.stdout:[client.0] 2024-09-13T19:15:26.161 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQA7j+RmCW1oHRAAtTBb0b2fSS/oOwQ//UjOeg== 2024-09-13T19:15:26.161 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T19:15:26.261 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T19:15:26.317 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T19:15:26.370 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T19:15:26.422 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T19:15:26.474 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T19:15:26.529 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-13T19:15:26.529 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-13T19:15:26.555 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T19:15:26.651 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-13T19:15:26.677 DEBUG:teuthology.orchestra.run.smithi053:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-13T19:15:26.732 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-13T19:15:26.732 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-13T19:15:26.732 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-13T19:15:26.775 INFO:tasks.ceph.mon.a:Started 2024-09-13T19:15:26.775 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-13T19:15:26.775 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-13T19:15:26.775 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-13T19:15:26.778 INFO:tasks.ceph.mgr.x:Started 2024-09-13T19:15:26.778 INFO:tasks.ceph:Setting crush tunables to default 2024-09-13T19:15:26.778 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd crush tunables default 2024-09-13T19:15:26.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:26.878+0000 7fbc630ac640 1 Processor -- start 2024-09-13T19:15:26.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:26.878+0000 7fbc630ac640 1 -- start start 2024-09-13T19:15:26.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:26.878+0000 7fbc630ac640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbc5c09a100 0x7fbc5c133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:26.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:26.878+0000 7fbc630ac640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc5c09d3b0 con 0x7fbc5c09bd50 2024-09-13T19:15:26.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:26.878+0000 7fbc630ac640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fbc5c09c840 con 0x7fbc5c09a100 2024-09-13T19:15:26.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:26.878+0000 7fbc5bfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbc5c09a100 0x7fbc5c133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:26.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:26.878+0000 7fbc60e48640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fbc5c09bd50 0x7fbc5c09c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:53834/0 (socket says 172.21.15.53:53834) 2024-09-13T19:15:26.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:26.878+0000 7fbc5bfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbc5c09a100 0x7fbc5c133da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47350/0 (socket says 172.21.15.53:47350) 2024-09-13T19:15:26.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:26.878+0000 7fbc60e48640 1 -- 172.21.15.53:0/3439903258 learned_addr learned my addr 172.21.15.53:0/3439903258 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T19:15:26.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:26.879+0000 7fbc5bfff640 1 -- 172.21.15.53:0/3439903258 >> v1:172.21.15.53:6789/0 conn(0x7fbc5c09bd50 legacy=0x7fbc5c09c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:26.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:26.879+0000 7fbc5b7fe640 1 -- 172.21.15.53:0/3439903258 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1908441280 0 0) 0x7fbc4c001490 con 0x7fbc5c09bd50 2024-09-13T19:15:26.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:26.879+0000 7fbc5bfff640 1 -- 172.21.15.53:0/3439903258 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc5c098230 con 0x7fbc5c09a100 2024-09-13T19:15:26.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:26.879+0000 7fbc5bfff640 1 --2- 172.21.15.53:0/3439903258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc5c09a100 0x7fbc5c133da0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fbc44009720 tx=0x7fbc4402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f61042d772f41f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:26.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:26.880+0000 7fbc5b7fe640 1 -- 172.21.15.53:0/3439903258 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc44037070 con 0x7fbc5c09a100 2024-09-13T19:15:26.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:26.880+0000 7fbc5b7fe640 1 -- 172.21.15.53:0/3439903258 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc4402ad90 con 0x7fbc5c09a100 2024-09-13T19:15:26.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:26.880+0000 7fbc5b7fe640 1 -- 172.21.15.53:0/3439903258 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc44032590 con 0x7fbc5c09a100 2024-09-13T19:15:26.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:26.880+0000 7fbc630ac640 1 -- 172.21.15.53:0/3439903258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc5c09a100 msgr2=0x7fbc5c133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:26.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:26.880+0000 7fbc630ac640 1 --2- 172.21.15.53:0/3439903258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc5c09a100 0x7fbc5c133da0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fbc44009720 tx=0x7fbc4402a110 comp rx=0 tx=0).stop 2024-09-13T19:15:26.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:26.880+0000 7fbc630ac640 1 -- 172.21.15.53:0/3439903258 shutdown_connections 2024-09-13T19:15:26.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:26.880+0000 7fbc630ac640 1 --2- 172.21.15.53:0/3439903258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc5c09a100 0x7fbc5c133da0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:26.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:26.880+0000 7fbc630ac640 1 -- 172.21.15.53:0/3439903258 >> 172.21.15.53:0/3439903258 conn(0x7fbc5c06d4a0 msgr2=0x7fbc5c06d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:26.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:26.880+0000 7fbc630ac640 1 -- 172.21.15.53:0/3439903258 shutdown_connections 2024-09-13T19:15:26.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:26.880+0000 7fbc630ac640 1 -- 172.21.15.53:0/3439903258 wait complete. 2024-09-13T19:15:26.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:26.881+0000 7fbc630ac640 1 Processor -- start 2024-09-13T19:15:26.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:26.881+0000 7fbc630ac640 1 -- start start 2024-09-13T19:15:26.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:26.882+0000 7fbc630ac640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc5c09a100 0x7fbc5c094770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:26.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:26.882+0000 7fbc630ac640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbc5c134670 con 0x7fbc5c09a100 2024-09-13T19:15:26.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:26.882+0000 7fbc60e48640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc5c09a100 0x7fbc5c094770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:26.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:26.882+0000 7fbc60e48640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc5c09a100 0x7fbc5c094770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47352/0 (socket says 172.21.15.53:47352) 2024-09-13T19:15:26.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:26.882+0000 7fbc60e48640 1 -- 172.21.15.53:0/2429831965 learned_addr learned my addr 172.21.15.53:0/2429831965 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:15:26.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:26.882+0000 7fbc60e48640 1 -- 172.21.15.53:0/2429831965 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc5c097170 con 0x7fbc5c09a100 2024-09-13T19:15:26.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:26.882+0000 7fbc60e48640 1 --2- 172.21.15.53:0/2429831965 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc5c09a100 0x7fbc5c094770 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c00c790 tx=0x7fbc4c00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:26.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:26.882+0000 7fbc597fa640 1 -- 172.21.15.53:0/2429831965 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc4c018070 con 0x7fbc5c09a100 2024-09-13T19:15:26.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:26.882+0000 7fbc597fa640 1 -- 172.21.15.53:0/2429831965 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc4c004d70 con 0x7fbc5c09a100 2024-09-13T19:15:26.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:26.882+0000 7fbc630ac640 1 -- 172.21.15.53:0/2429831965 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc5c0978e0 con 0x7fbc5c09a100 2024-09-13T19:15:26.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:26.882+0000 7fbc597fa640 1 -- 172.21.15.53:0/2429831965 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc4c00a7f0 con 0x7fbc5c09a100 2024-09-13T19:15:26.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:26.882+0000 7fbc630ac640 1 -- 172.21.15.53:0/2429831965 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc5c094e90 con 0x7fbc5c09a100 2024-09-13T19:15:26.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:26.883+0000 7fbc597fa640 1 -- 172.21.15.53:0/2429831965 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbc4c01b070 con 0x7fbc5c09a100 2024-09-13T19:15:26.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:26.883+0000 7fbc597fa640 1 -- 172.21.15.53:0/2429831965 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fbc4c01d780 con 0x7fbc5c09a100 2024-09-13T19:15:26.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:26.883+0000 7fbc630ac640 1 -- 172.21.15.53:0/2429831965 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc5c133e00 con 0x7fbc5c09a100 2024-09-13T19:15:26.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:26.886+0000 7fbc597fa640 1 -- 172.21.15.53:0/2429831965 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fbc4c022020 con 0x7fbc5c09a100 2024-09-13T19:15:26.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:26.950+0000 7fbc630ac640 1 -- 172.21.15.53:0/2429831965 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fbc5c09d020 con 0x7fbc5c09a100 2024-09-13T19:15:26.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:26.951+0000 7fbc597fa640 1 -- 172.21.15.53:0/2429831965 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fbc5c09d3b0 con 0x7fbc5c09a100 2024-09-13T19:15:26.954 INFO:teuthology.orchestra.run.smithi053.stderr:adjusted tunables profile to default 2024-09-13T19:15:26.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:26.952+0000 7fbc630ac640 1 -- 172.21.15.53:0/2429831965 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc5c09a100 msgr2=0x7fbc5c094770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:26.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:26.952+0000 7fbc630ac640 1 --2- 172.21.15.53:0/2429831965 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc5c09a100 0x7fbc5c094770 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c00c790 tx=0x7fbc4c00cc50 comp rx=0 tx=0).stop 2024-09-13T19:15:26.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:26.952+0000 7fbc630ac640 1 -- 172.21.15.53:0/2429831965 shutdown_connections 2024-09-13T19:15:26.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:26.952+0000 7fbc630ac640 1 --2- 172.21.15.53:0/2429831965 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc5c09a100 0x7fbc5c094770 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:26.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:26.952+0000 7fbc630ac640 1 -- 172.21.15.53:0/2429831965 >> 172.21.15.53:0/2429831965 conn(0x7fbc5c06d4a0 msgr2=0x7fbc5c08d770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:26.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:26.952+0000 7fbc630ac640 1 -- 172.21.15.53:0/2429831965 shutdown_connections 2024-09-13T19:15:26.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:26.952+0000 7fbc630ac640 1 -- 172.21.15.53:0/2429831965 wait complete. 2024-09-13T19:15:26.965 INFO:tasks.ceph:check_enable_crimson: False 2024-09-13T19:15:26.965 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-13T19:15:26.965 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T19:15:26.965 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-13T19:15:26.974 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-13T19:15:26.971+0000 7f5ccdb23040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T19:15:26.990 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-13T19:15:26.991 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-13T19:15:27.016 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-13T19:15:27.016 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-13T19:15:27.016 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-13T19:15:27.013+0000 7f5ccdb23040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T19:15:27.040 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-13T19:15:27.040 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-13T19:15:27.105 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new d078da3c-b2bc-4d4e-940d-e3a343202a5e 0 2024-09-13T19:15:27.162 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-13T19:15:27.159+0000 7f5ccdb23040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T19:15:27.216 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-13T19:15:27.212+0000 7f5ccdb23040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T19:15:27.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.241+0000 7f6a963c2640 1 Processor -- start 2024-09-13T19:15:27.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.241+0000 7f6a963c2640 1 -- start start 2024-09-13T19:15:27.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.241+0000 7f6a963c2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6a9006d540 0x7f6a9006d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:27.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.241+0000 7f6a963c2640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a9006e310 con 0x7f6a9006de60 2024-09-13T19:15:27.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.241+0000 7f6a963c2640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f6a9011e930 con 0x7f6a9006d540 2024-09-13T19:15:27.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.241+0000 7f6a8ffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6a9006d540 0x7f6a9006d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:27.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.241+0000 7f6a8f7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f6a9006de60 0x7f6a9011c200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:32836/0 (socket says 172.21.15.102:32836) 2024-09-13T19:15:27.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.241+0000 7f6a8ffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6a9006d540 0x7f6a9006d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:39954/0 (socket says 172.21.15.102:39954) 2024-09-13T19:15:27.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.241+0000 7f6a8f7fe640 1 -- 172.21.15.102:0/3683055782 learned_addr learned my addr 172.21.15.102:0/3683055782 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:15:27.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.242+0000 7f6a8ffff640 1 -- 172.21.15.102:0/3683055782 >> v1:172.21.15.53:6789/0 conn(0x7f6a9006de60 legacy=0x7f6a9011c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:27.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.242+0000 7f6a8ffff640 1 -- 172.21.15.102:0/3683055782 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a9011eab0 con 0x7f6a9006d540 2024-09-13T19:15:27.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.242+0000 7f6a8ffff640 1 --2- 172.21.15.102:0/3683055782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a9006d540 0x7f6a9006d920 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6a80009720 tx=0x7f6a8002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b13bb5d0494f02c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:27.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.242+0000 7f6a8effd640 1 -- 172.21.15.102:0/3683055782 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a80037070 con 0x7f6a9006d540 2024-09-13T19:15:27.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.243+0000 7f6a8effd640 1 -- 172.21.15.102:0/3683055782 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a8002ad90 con 0x7f6a9006d540 2024-09-13T19:15:27.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.243+0000 7f6a8effd640 1 -- 172.21.15.102:0/3683055782 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a80032590 con 0x7f6a9006d540 2024-09-13T19:15:27.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.243+0000 7f6a963c2640 1 -- 172.21.15.102:0/3683055782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a9006d540 msgr2=0x7f6a9006d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:27.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.243+0000 7f6a963c2640 1 --2- 172.21.15.102:0/3683055782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a9006d540 0x7f6a9006d920 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6a80009720 tx=0x7f6a8002a110 comp rx=0 tx=0).stop 2024-09-13T19:15:27.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.243+0000 7f6a963c2640 1 -- 172.21.15.102:0/3683055782 shutdown_connections 2024-09-13T19:15:27.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.243+0000 7f6a963c2640 1 --2- 172.21.15.102:0/3683055782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a9006d540 0x7f6a9006d920 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:27.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.243+0000 7f6a963c2640 1 -- 172.21.15.102:0/3683055782 >> 172.21.15.102:0/3683055782 conn(0x7f6a90071040 msgr2=0x7f6a90073460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:27.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.243+0000 7f6a963c2640 1 -- 172.21.15.102:0/3683055782 shutdown_connections 2024-09-13T19:15:27.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.243+0000 7f6a963c2640 1 -- 172.21.15.102:0/3683055782 wait complete. 2024-09-13T19:15:27.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.244+0000 7f6a963c2640 1 Processor -- start 2024-09-13T19:15:27.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.244+0000 7f6a963c2640 1 -- start start 2024-09-13T19:15:27.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.244+0000 7f6a963c2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a9006d540 0x7f6a901a6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:27.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.244+0000 7f6a963c2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6a9011de00 con 0x7f6a9006d540 2024-09-13T19:15:27.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.245+0000 7f6a8ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a9006d540 0x7f6a901a6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:27.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.245+0000 7f6a8ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a9006d540 0x7f6a901a6ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:39968/0 (socket says 172.21.15.102:39968) 2024-09-13T19:15:27.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.245+0000 7f6a8ffff640 1 -- 172.21.15.102:0/1034412614 learned_addr learned my addr 172.21.15.102:0/1034412614 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:15:27.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.245+0000 7f6a8ffff640 1 -- 172.21.15.102:0/1034412614 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a901a7220 con 0x7f6a9006d540 2024-09-13T19:15:27.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.245+0000 7f6a8ffff640 1 --2- 172.21.15.102:0/1034412614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a9006d540 0x7f6a901a6ce0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6a80009720 tx=0x7f6a800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:27.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.245+0000 7f6a8cff9640 1 -- 172.21.15.102:0/1034412614 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a80041070 con 0x7f6a9006d540 2024-09-13T19:15:27.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.245+0000 7f6a8cff9640 1 -- 172.21.15.102:0/1034412614 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a8003c460 con 0x7f6a9006d540 2024-09-13T19:15:27.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.245+0000 7f6a8cff9640 1 -- 172.21.15.102:0/1034412614 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a80037040 con 0x7f6a9006d540 2024-09-13T19:15:27.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.245+0000 7f6a963c2640 1 -- 172.21.15.102:0/1034412614 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a901a74b0 con 0x7f6a9006d540 2024-09-13T19:15:27.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.245+0000 7f6a963c2640 1 -- 172.21.15.102:0/1034412614 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a901ab500 con 0x7f6a9006d540 2024-09-13T19:15:27.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.246+0000 7f6a8cff9640 1 -- 172.21.15.102:0/1034412614 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6a80044070 con 0x7f6a9006d540 2024-09-13T19:15:27.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.246+0000 7f6a8cff9640 1 -- 172.21.15.102:0/1034412614 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f6a80046c80 con 0x7f6a9006d540 2024-09-13T19:15:27.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.246+0000 7f6a963c2640 1 -- 172.21.15.102:0/1034412614 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a9006d9a0 con 0x7f6a9006d540 2024-09-13T19:15:27.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.249+0000 7f6a8cff9640 1 -- 172.21.15.102:0/1034412614 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f6a80046450 con 0x7f6a9006d540 2024-09-13T19:15:27.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.318+0000 7f6a963c2640 1 -- 172.21.15.102:0/1034412614 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d078da3c-b2bc-4d4e-940d-e3a343202a5e", "id": 0} v 0) -- 0x7f6a901a7680 con 0x7f6a9006d540 2024-09-13T19:15:27.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.319+0000 7f6a8cff9640 1 -- 172.21.15.102:0/1034412614 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d078da3c-b2bc-4d4e-940d-e3a343202a5e", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f6a8003c950 con 0x7f6a9006d540 2024-09-13T19:15:27.322 INFO:teuthology.orchestra.run.smithi102.stdout:0 2024-09-13T19:15:27.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.320+0000 7f6a963c2640 1 -- 172.21.15.102:0/1034412614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a9006d540 msgr2=0x7f6a901a6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:27.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.320+0000 7f6a963c2640 1 --2- 172.21.15.102:0/1034412614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a9006d540 0x7f6a901a6ce0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6a80009720 tx=0x7f6a800046c0 comp rx=0 tx=0).stop 2024-09-13T19:15:27.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.320+0000 7f6a963c2640 1 -- 172.21.15.102:0/1034412614 shutdown_connections 2024-09-13T19:15:27.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.320+0000 7f6a963c2640 1 --2- 172.21.15.102:0/1034412614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a9006d540 0x7f6a901a6ce0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:27.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.320+0000 7f6a963c2640 1 -- 172.21.15.102:0/1034412614 >> 172.21.15.102:0/1034412614 conn(0x7f6a90071040 msgr2=0x7f6a9011d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:27.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.320+0000 7f6a963c2640 1 -- 172.21.15.102:0/1034412614 shutdown_connections 2024-09-13T19:15:27.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.320+0000 7f6a963c2640 1 -- 172.21.15.102:0/1034412614 wait complete. 2024-09-13T19:15:27.333 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new b461168d-7796-4d47-934f-2e5992d5a05e 1 2024-09-13T19:15:27.390 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-13T19:15:27.387+0000 7f5ccdb23040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T19:15:27.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.469+0000 7f86eda5e640 1 Processor -- start 2024-09-13T19:15:27.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.469+0000 7f86eda5e640 1 -- start start 2024-09-13T19:15:27.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.469+0000 7f86eda5e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f86e811acd0 0x7f86e811d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:27.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.469+0000 7f86eda5e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86e811d690 con 0x7f86e8117f00 2024-09-13T19:15:27.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.469+0000 7f86eda5e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f86e811e870 con 0x7f86e811acd0 2024-09-13T19:15:27.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.470+0000 7f86e67fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f86e811acd0 0x7f86e811d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:27.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.470+0000 7f86e6ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f86e8117f00 0x7f86e81182e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:32846/0 (socket says 172.21.15.102:32846) 2024-09-13T19:15:27.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.470+0000 7f86e6ffd640 1 -- 172.21.15.102:0/1651153383 learned_addr learned my addr 172.21.15.102:0/1651153383 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:15:27.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.470+0000 7f86e67fc640 1 -- 172.21.15.102:0/1651153383 >> v1:172.21.15.53:6789/0 conn(0x7f86e8117f00 legacy=0x7f86e81182e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:27.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.470+0000 7f86e67fc640 1 -- 172.21.15.102:0/1651153383 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86e811e9f0 con 0x7f86e811acd0 2024-09-13T19:15:27.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.470+0000 7f86e5ffb640 1 -- 172.21.15.102:0/1651153383 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3585327458 0 0) 0x7f86e811d690 con 0x7f86e8117f00 2024-09-13T19:15:27.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.471+0000 7f86e67fc640 1 --2- 172.21.15.102:0/1651153383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86e811acd0 0x7f86e811d0c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f86d8009720 tx=0x7f86d802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bd1688c5309d4f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:27.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.471+0000 7f86e5ffb640 1 -- 172.21.15.102:0/1651153383 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86d8037070 con 0x7f86e811acd0 2024-09-13T19:15:27.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.471+0000 7f86e5ffb640 1 -- 172.21.15.102:0/1651153383 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86d802ad90 con 0x7f86e811acd0 2024-09-13T19:15:27.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.471+0000 7f86e5ffb640 1 -- 172.21.15.102:0/1651153383 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86d8032590 con 0x7f86e811acd0 2024-09-13T19:15:27.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.471+0000 7f86eda5e640 1 -- 172.21.15.102:0/1651153383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86e811acd0 msgr2=0x7f86e811d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:27.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.471+0000 7f86eda5e640 1 --2- 172.21.15.102:0/1651153383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86e811acd0 0x7f86e811d0c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f86d8009720 tx=0x7f86d802a110 comp rx=0 tx=0).stop 2024-09-13T19:15:27.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.472+0000 7f86eda5e640 1 -- 172.21.15.102:0/1651153383 shutdown_connections 2024-09-13T19:15:27.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.472+0000 7f86eda5e640 1 --2- 172.21.15.102:0/1651153383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86e811acd0 0x7f86e811d0c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:27.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.472+0000 7f86eda5e640 1 -- 172.21.15.102:0/1651153383 >> 172.21.15.102:0/1651153383 conn(0x7f86e806e6c0 msgr2=0x7f86e806ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:27.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.472+0000 7f86eda5e640 1 -- 172.21.15.102:0/1651153383 shutdown_connections 2024-09-13T19:15:27.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.472+0000 7f86eda5e640 1 -- 172.21.15.102:0/1651153383 wait complete. 2024-09-13T19:15:27.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.472+0000 7f86eda5e640 1 Processor -- start 2024-09-13T19:15:27.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.472+0000 7f86eda5e640 1 -- start start 2024-09-13T19:15:27.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.473+0000 7f86eda5e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86e8117f00 0x7f86e81a69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:27.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.473+0000 7f86eda5e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f86e811dd50 con 0x7f86e8117f00 2024-09-13T19:15:27.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.473+0000 7f86e6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86e8117f00 0x7f86e81a69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:27.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.473+0000 7f86e6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86e8117f00 0x7f86e81a69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:39996/0 (socket says 172.21.15.102:39996) 2024-09-13T19:15:27.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.473+0000 7f86e6ffd640 1 -- 172.21.15.102:0/2956353956 learned_addr learned my addr 172.21.15.102:0/2956353956 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:15:27.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.473+0000 7f86e6ffd640 1 -- 172.21.15.102:0/2956353956 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86e81a6ef0 con 0x7f86e8117f00 2024-09-13T19:15:27.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.473+0000 7f86e6ffd640 1 --2- 172.21.15.102:0/2956353956 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86e8117f00 0x7f86e81a69b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f86dc00c420 tx=0x7f86dc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:27.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.474+0000 7f86cffff640 1 -- 172.21.15.102:0/2956353956 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86dc018070 con 0x7f86e8117f00 2024-09-13T19:15:27.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.474+0000 7f86cffff640 1 -- 172.21.15.102:0/2956353956 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86dc0074d0 con 0x7f86e8117f00 2024-09-13T19:15:27.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.474+0000 7f86eda5e640 1 -- 172.21.15.102:0/2956353956 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86e81a71e0 con 0x7f86e8117f00 2024-09-13T19:15:27.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.474+0000 7f86cffff640 1 -- 172.21.15.102:0/2956353956 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86dc004950 con 0x7f86e8117f00 2024-09-13T19:15:27.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.474+0000 7f86eda5e640 1 -- 172.21.15.102:0/2956353956 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86e81ab310 con 0x7f86e8117f00 2024-09-13T19:15:27.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.474+0000 7f86cffff640 1 -- 172.21.15.102:0/2956353956 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f86dc01b070 con 0x7f86e8117f00 2024-09-13T19:15:27.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.474+0000 7f86cffff640 1 -- 172.21.15.102:0/2956353956 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f86dc01c3b0 con 0x7f86e8117f00 2024-09-13T19:15:27.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.475+0000 7f86eda5e640 1 -- 172.21.15.102:0/2956353956 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86e811e330 con 0x7f86e8117f00 2024-09-13T19:15:27.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.477+0000 7f86cffff640 1 -- 172.21.15.102:0/2956353956 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f86dc022070 con 0x7f86e8117f00 2024-09-13T19:15:27.507 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-13T19:15:27.504+0000 7f5ccdb23040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T19:15:27.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.546+0000 7f86eda5e640 1 -- 172.21.15.102:0/2956353956 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b461168d-7796-4d47-934f-2e5992d5a05e", "id": 1} v 0) -- 0x7f86e81a7410 con 0x7f86e8117f00 2024-09-13T19:15:27.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.547+0000 7f86cffff640 1 -- 172.21.15.102:0/2956353956 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b461168d-7796-4d47-934f-2e5992d5a05e", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f86dc004bc0 con 0x7f86e8117f00 2024-09-13T19:15:27.550 INFO:teuthology.orchestra.run.smithi102.stdout:1 2024-09-13T19:15:27.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.547+0000 7f86eda5e640 1 -- 172.21.15.102:0/2956353956 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86e8117f00 msgr2=0x7f86e81a69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:27.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.547+0000 7f86eda5e640 1 --2- 172.21.15.102:0/2956353956 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86e8117f00 0x7f86e81a69b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f86dc00c420 tx=0x7f86dc00c8e0 comp rx=0 tx=0).stop 2024-09-13T19:15:27.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.548+0000 7f86eda5e640 1 -- 172.21.15.102:0/2956353956 shutdown_connections 2024-09-13T19:15:27.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.548+0000 7f86eda5e640 1 --2- 172.21.15.102:0/2956353956 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86e8117f00 0x7f86e81a69b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:27.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.548+0000 7f86eda5e640 1 -- 172.21.15.102:0/2956353956 >> 172.21.15.102:0/2956353956 conn(0x7f86e806e6c0 msgr2=0x7f86e811b480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:27.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.548+0000 7f86eda5e640 1 -- 172.21.15.102:0/2956353956 shutdown_connections 2024-09-13T19:15:27.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.548+0000 7f86eda5e640 1 -- 172.21.15.102:0/2956353956 wait complete. 2024-09-13T19:15:27.561 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new 0eb25aef-9bcf-4e31-9896-d9d2c1c6bc40 2 2024-09-13T19:15:27.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.696+0000 7f1e3db9f640 1 Processor -- start 2024-09-13T19:15:27.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.696+0000 7f1e3db9f640 1 -- start start 2024-09-13T19:15:27.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.697+0000 7f1e3db9f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1e3810f490 0x7f1e3811b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:27.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.697+0000 7f1e3db9f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e3810f970 con 0x7f1e38073f60 2024-09-13T19:15:27.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.697+0000 7f1e3db9f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f1e3810fb40 con 0x7f1e3810f490 2024-09-13T19:15:27.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.697+0000 7f1e37fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1e3810f490 0x7f1e3811b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:27.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.697+0000 7f1e37fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1e3810f490 0x7f1e3811b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:40010/0 (socket says 172.21.15.102:40010) 2024-09-13T19:15:27.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.697+0000 7f1e3cb9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f1e38073f60 0x7f1e3810ed80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:32862/0 (socket says 172.21.15.102:32862) 2024-09-13T19:15:27.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.697+0000 7f1e37fff640 1 -- 172.21.15.102:0/3481469598 learned_addr learned my addr 172.21.15.102:0/3481469598 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:15:27.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.697+0000 7f1e37fff640 1 -- 172.21.15.102:0/3481469598 >> v1:172.21.15.53:6789/0 conn(0x7f1e38073f60 legacy=0x7f1e3810ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:27.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.697+0000 7f1e37fff640 1 -- 172.21.15.102:0/3481469598 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e3811c660 con 0x7f1e3810f490 2024-09-13T19:15:27.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.698+0000 7f1e37fff640 1 --2- 172.21.15.102:0/3481469598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e3810f490 0x7f1e3811b110 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1e240097f0 tx=0x7f1e2402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa60e0b8d303e66 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:27.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.698+0000 7f1e377fe640 1 -- 172.21.15.102:0/3481469598 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e24037070 con 0x7f1e3810f490 2024-09-13T19:15:27.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.698+0000 7f1e377fe640 1 -- 172.21.15.102:0/3481469598 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e24032440 con 0x7f1e3810f490 2024-09-13T19:15:27.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.698+0000 7f1e377fe640 1 -- 172.21.15.102:0/3481469598 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e2402ae60 con 0x7f1e3810f490 2024-09-13T19:15:27.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.699+0000 7f1e3db9f640 1 -- 172.21.15.102:0/3481469598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e3810f490 msgr2=0x7f1e3811b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:27.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.699+0000 7f1e3db9f640 1 --2- 172.21.15.102:0/3481469598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e3810f490 0x7f1e3811b110 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1e240097f0 tx=0x7f1e2402a1e0 comp rx=0 tx=0).stop 2024-09-13T19:15:27.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.699+0000 7f1e3db9f640 1 -- 172.21.15.102:0/3481469598 shutdown_connections 2024-09-13T19:15:27.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.699+0000 7f1e3db9f640 1 --2- 172.21.15.102:0/3481469598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e3810f490 0x7f1e3811b110 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:27.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.699+0000 7f1e3db9f640 1 -- 172.21.15.102:0/3481469598 >> 172.21.15.102:0/3481469598 conn(0x7f1e3806f620 msgr2=0x7f1e38071a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:27.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.699+0000 7f1e3db9f640 1 -- 172.21.15.102:0/3481469598 shutdown_connections 2024-09-13T19:15:27.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.699+0000 7f1e3db9f640 1 -- 172.21.15.102:0/3481469598 wait complete. 2024-09-13T19:15:27.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.699+0000 7f1e3db9f640 1 Processor -- start 2024-09-13T19:15:27.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.700+0000 7f1e3db9f640 1 -- start start 2024-09-13T19:15:27.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.700+0000 7f1e3db9f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e38073f60 0x7f1e381aa410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:27.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.700+0000 7f1e3db9f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1e3811bb30 con 0x7f1e38073f60 2024-09-13T19:15:27.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.700+0000 7f1e3cb9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e38073f60 0x7f1e381aa410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:27.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.700+0000 7f1e3cb9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e38073f60 0x7f1e381aa410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:40018/0 (socket says 172.21.15.102:40018) 2024-09-13T19:15:27.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.700+0000 7f1e3cb9d640 1 -- 172.21.15.102:0/2666614076 learned_addr learned my addr 172.21.15.102:0/2666614076 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:15:27.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.700+0000 7f1e3cb9d640 1 -- 172.21.15.102:0/2666614076 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e381aa9e0 con 0x7f1e38073f60 2024-09-13T19:15:27.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.701+0000 7f1e3cb9d640 1 --2- 172.21.15.102:0/2666614076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e38073f60 0x7f1e381aa410 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c00c450 tx=0x7f1e2c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:27.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.701+0000 7f1e357fa640 1 -- 172.21.15.102:0/2666614076 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e2c007410 con 0x7f1e38073f60 2024-09-13T19:15:27.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.701+0000 7f1e357fa640 1 -- 172.21.15.102:0/2666614076 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e2c0075b0 con 0x7f1e38073f60 2024-09-13T19:15:27.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.701+0000 7f1e3db9f640 1 -- 172.21.15.102:0/2666614076 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e381aac70 con 0x7f1e38073f60 2024-09-13T19:15:27.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.701+0000 7f1e357fa640 1 -- 172.21.15.102:0/2666614076 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e2c004910 con 0x7f1e38073f60 2024-09-13T19:15:27.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.701+0000 7f1e3db9f640 1 -- 172.21.15.102:0/2666614076 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e381a4680 con 0x7f1e38073f60 2024-09-13T19:15:27.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.701+0000 7f1e357fa640 1 -- 172.21.15.102:0/2666614076 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1e2c01a020 con 0x7f1e38073f60 2024-09-13T19:15:27.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.701+0000 7f1e357fa640 1 -- 172.21.15.102:0/2666614076 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f1e2c012810 con 0x7f1e38073f60 2024-09-13T19:15:27.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.702+0000 7f1e3db9f640 1 -- 172.21.15.102:0/2666614076 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e3811c0f0 con 0x7f1e38073f60 2024-09-13T19:15:27.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.704+0000 7f1e357fa640 1 -- 172.21.15.102:0/2666614076 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f1e2c021070 con 0x7f1e38073f60 2024-09-13T19:15:27.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.772+0000 7f1e3db9f640 1 -- 172.21.15.102:0/2666614076 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0eb25aef-9bcf-4e31-9896-d9d2c1c6bc40", "id": 2} v 0) -- 0x7f1e381aaea0 con 0x7f1e38073f60 2024-09-13T19:15:27.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.774+0000 7f1e357fa640 1 -- 172.21.15.102:0/2666614076 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0eb25aef-9bcf-4e31-9896-d9d2c1c6bc40", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f1e2c0125d0 con 0x7f1e38073f60 2024-09-13T19:15:27.777 INFO:teuthology.orchestra.run.smithi102.stdout:2 2024-09-13T19:15:27.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.774+0000 7f1e3db9f640 1 -- 172.21.15.102:0/2666614076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e38073f60 msgr2=0x7f1e381aa410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:27.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.774+0000 7f1e3db9f640 1 --2- 172.21.15.102:0/2666614076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e38073f60 0x7f1e381aa410 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c00c450 tx=0x7f1e2c00c910 comp rx=0 tx=0).stop 2024-09-13T19:15:27.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.774+0000 7f1e3db9f640 1 -- 172.21.15.102:0/2666614076 shutdown_connections 2024-09-13T19:15:27.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.774+0000 7f1e3db9f640 1 --2- 172.21.15.102:0/2666614076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e38073f60 0x7f1e381aa410 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:27.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.775+0000 7f1e3db9f640 1 -- 172.21.15.102:0/2666614076 >> 172.21.15.102:0/2666614076 conn(0x7f1e3806f620 msgr2=0x7f1e38118640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:27.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.775+0000 7f1e3db9f640 1 -- 172.21.15.102:0/2666614076 shutdown_connections 2024-09-13T19:15:27.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.775+0000 7f1e3db9f640 1 -- 172.21.15.102:0/2666614076 wait complete. 2024-09-13T19:15:27.788 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new c84cc8db-3bd3-432e-b84a-58235ad2888e 3 2024-09-13T19:15:27.848 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-13T19:15:27.845+0000 7f5ccdb23040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T19:15:27.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.882+0000 7fa964bdb640 1 Processor -- start 2024-09-13T19:15:27.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.882+0000 7fa964bdb640 1 -- start start 2024-09-13T19:15:27.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.882+0000 7fa964bdb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa96011ac10 0x7fa96011d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:27.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.882+0000 7fa964bdb640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa96011d5d0 con 0x7fa960117fb0 2024-09-13T19:15:27.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.882+0000 7fa964bdb640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fa96011e7b0 con 0x7fa96011ac10 2024-09-13T19:15:27.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.883+0000 7fa95dd9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa96011ac10 0x7fa96011d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:27.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.883+0000 7fa95dd9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa96011ac10 0x7fa96011d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:40020/0 (socket says 172.21.15.102:40020) 2024-09-13T19:15:27.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.883+0000 7fa95dd9b640 1 -- 172.21.15.102:0/3277505664 learned_addr learned my addr 172.21.15.102:0/3277505664 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:15:27.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.883+0000 7fa95e59c640 1 --1- 172.21.15.102:0/3277505664 >> v1:172.21.15.53:6789/0 conn(0x7fa960117fb0 0x7fa960118390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:32868/0 (socket says 172.21.15.102:32868) 2024-09-13T19:15:27.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.883+0000 7fa95dd9b640 1 -- 172.21.15.102:0/3277505664 >> v1:172.21.15.53:6789/0 conn(0x7fa960117fb0 legacy=0x7fa960118390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:27.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.883+0000 7fa95dd9b640 1 -- 172.21.15.102:0/3277505664 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa96011e960 con 0x7fa96011ac10 2024-09-13T19:15:27.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.884+0000 7fa95dd9b640 1 --2- 172.21.15.102:0/3277505664 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa96011ac10 0x7fa96011d000 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa9540097f0 tx=0x7fa95402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de7405e6ac925e72 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:27.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.884+0000 7fa95d59a640 1 -- 172.21.15.102:0/3277505664 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa954037070 con 0x7fa96011ac10 2024-09-13T19:15:27.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.884+0000 7fa95d59a640 1 -- 172.21.15.102:0/3277505664 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa954032440 con 0x7fa96011ac10 2024-09-13T19:15:27.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.884+0000 7fa95d59a640 1 -- 172.21.15.102:0/3277505664 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa95402ae60 con 0x7fa96011ac10 2024-09-13T19:15:27.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.884+0000 7fa964bdb640 1 -- 172.21.15.102:0/3277505664 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa96011ac10 msgr2=0x7fa96011d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:27.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.884+0000 7fa964bdb640 1 --2- 172.21.15.102:0/3277505664 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa96011ac10 0x7fa96011d000 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa9540097f0 tx=0x7fa95402a1e0 comp rx=0 tx=0).stop 2024-09-13T19:15:27.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.884+0000 7fa964bdb640 1 -- 172.21.15.102:0/3277505664 shutdown_connections 2024-09-13T19:15:27.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.884+0000 7fa964bdb640 1 --2- 172.21.15.102:0/3277505664 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa96011ac10 0x7fa96011d000 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:27.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.884+0000 7fa964bdb640 1 -- 172.21.15.102:0/3277505664 >> 172.21.15.102:0/3277505664 conn(0x7fa96006e5e0 msgr2=0x7fa96006e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:27.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.885+0000 7fa964bdb640 1 -- 172.21.15.102:0/3277505664 shutdown_connections 2024-09-13T19:15:27.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.885+0000 7fa964bdb640 1 -- 172.21.15.102:0/3277505664 wait complete. 2024-09-13T19:15:27.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.885+0000 7fa964bdb640 1 Processor -- start 2024-09-13T19:15:27.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.885+0000 7fa964bdb640 1 -- start start 2024-09-13T19:15:27.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.886+0000 7fa964bdb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa960117fb0 0x7fa9601a6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:27.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.886+0000 7fa964bdb640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa96011dcc0 con 0x7fa960117fb0 2024-09-13T19:15:27.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.886+0000 7fa95e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa960117fb0 0x7fa9601a6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:27.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.886+0000 7fa95e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa960117fb0 0x7fa9601a6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:40036/0 (socket says 172.21.15.102:40036) 2024-09-13T19:15:27.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.886+0000 7fa95e59c640 1 -- 172.21.15.102:0/3670338138 learned_addr learned my addr 172.21.15.102:0/3670338138 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:15:27.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.886+0000 7fa95e59c640 1 -- 172.21.15.102:0/3670338138 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9601a71d0 con 0x7fa960117fb0 2024-09-13T19:15:27.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.886+0000 7fa95e59c640 1 --2- 172.21.15.102:0/3670338138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa960117fb0 0x7fa9601a6c00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa95000c450 tx=0x7fa95000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:27.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.887+0000 7fa94effd640 1 -- 172.21.15.102:0/3670338138 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa950007410 con 0x7fa960117fb0 2024-09-13T19:15:27.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.887+0000 7fa94effd640 1 -- 172.21.15.102:0/3670338138 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9500075b0 con 0x7fa960117fb0 2024-09-13T19:15:27.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.887+0000 7fa964bdb640 1 -- 172.21.15.102:0/3670338138 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9601a74c0 con 0x7fa960117fb0 2024-09-13T19:15:27.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.887+0000 7fa94effd640 1 -- 172.21.15.102:0/3670338138 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa950004910 con 0x7fa960117fb0 2024-09-13T19:15:27.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.887+0000 7fa964bdb640 1 -- 172.21.15.102:0/3670338138 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9601ab530 con 0x7fa960117fb0 2024-09-13T19:15:27.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.887+0000 7fa94effd640 1 -- 172.21.15.102:0/3670338138 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa95001a020 con 0x7fa960117fb0 2024-09-13T19:15:27.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.887+0000 7fa94effd640 1 -- 172.21.15.102:0/3670338138 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fa950012880 con 0x7fa960117fb0 2024-09-13T19:15:27.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.888+0000 7fa964bdb640 1 -- 172.21.15.102:0/3670338138 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9601a76f0 con 0x7fa960117fb0 2024-09-13T19:15:27.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.890+0000 7fa94effd640 1 -- 172.21.15.102:0/3670338138 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fa950021070 con 0x7fa960117fb0 2024-09-13T19:15:27.900 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-13T19:15:27.897+0000 7f5ccdb23040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T19:15:27.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.959+0000 7fa964bdb640 1 -- 172.21.15.102:0/3670338138 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c84cc8db-3bd3-432e-b84a-58235ad2888e", "id": 3} v 0) -- 0x7fa96011e280 con 0x7fa960117fb0 2024-09-13T19:15:27.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.960+0000 7fa94effd640 1 -- 172.21.15.102:0/3670338138 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c84cc8db-3bd3-432e-b84a-58235ad2888e", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fa9500125d0 con 0x7fa960117fb0 2024-09-13T19:15:27.963 INFO:teuthology.orchestra.run.smithi102.stdout:3 2024-09-13T19:15:27.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.961+0000 7fa964bdb640 1 -- 172.21.15.102:0/3670338138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa960117fb0 msgr2=0x7fa9601a6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:27.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.961+0000 7fa964bdb640 1 --2- 172.21.15.102:0/3670338138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa960117fb0 0x7fa9601a6c00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa95000c450 tx=0x7fa95000c910 comp rx=0 tx=0).stop 2024-09-13T19:15:27.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.961+0000 7fa964bdb640 1 -- 172.21.15.102:0/3670338138 shutdown_connections 2024-09-13T19:15:27.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.961+0000 7fa964bdb640 1 --2- 172.21.15.102:0/3670338138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa960117fb0 0x7fa9601a6c00 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:27.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.961+0000 7fa964bdb640 1 -- 172.21.15.102:0/3670338138 >> 172.21.15.102:0/3670338138 conn(0x7fa96006e5e0 msgr2=0x7fa960110d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:27.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.961+0000 7fa964bdb640 1 -- 172.21.15.102:0/3670338138 shutdown_connections 2024-09-13T19:15:27.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:27.961+0000 7fa964bdb640 1 -- 172.21.15.102:0/3670338138 wait complete. 2024-09-13T19:15:27.975 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-13T19:15:27.975 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-13T19:15:27.977 INFO:tasks.ceph.osd.0:Started 2024-09-13T19:15:27.978 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-13T19:15:27.978 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-13T19:15:27.980 INFO:tasks.ceph.osd.1:Started 2024-09-13T19:15:27.980 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-13T19:15:27.980 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-13T19:15:27.982 INFO:tasks.ceph.osd.2:Started 2024-09-13T19:15:27.982 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-13T19:15:27.982 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-13T19:15:27.984 INFO:tasks.ceph.osd.3:Started 2024-09-13T19:15:27.984 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T19:15:28.061 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-13T19:15:28.058+0000 7f5ccdb23040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T19:15:28.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:28.092+0000 7fc164d4b640 1 Processor -- start 2024-09-13T19:15:28.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:28.092+0000 7fc164d4b640 1 -- start start 2024-09-13T19:15:28.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:28.093+0000 7fc164d4b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc16012f7b0 0x7fc160131ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:28.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:28.093+0000 7fc164d4b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc160095ff0 con 0x7fc160129460 2024-09-13T19:15:28.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:28.093+0000 7fc164d4b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fc160096a70 con 0x7fc16012f7b0 2024-09-13T19:15:28.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:28.093+0000 7fc15dd9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc16012f7b0 0x7fc160131ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:28.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:28.093+0000 7fc15e59c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc160129460 0x7fc160129840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:53850/0 (socket says 172.21.15.53:53850) 2024-09-13T19:15:28.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:28.093+0000 7fc15e59c640 1 -- 172.21.15.53:0/3711642380 learned_addr learned my addr 172.21.15.53:0/3711642380 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T19:15:28.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:28.093+0000 7fc15dd9b640 1 -- 172.21.15.53:0/3711642380 >> v1:172.21.15.53:6789/0 conn(0x7fc160129460 legacy=0x7fc160129840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:28.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:28.094+0000 7fc15dd9b640 1 -- 172.21.15.53:0/3711642380 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1600957a0 con 0x7fc16012f7b0 2024-09-13T19:15:28.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:28.094+0000 7fc15dd9b640 1 --2- 172.21.15.53:0/3711642380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc16012f7b0 0x7fc160131ba0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc154009720 tx=0x7fc15402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5442c5570649ed2d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:28.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:28.094+0000 7fc15d59a640 1 -- 172.21.15.53:0/3711642380 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc154037070 con 0x7fc16012f7b0 2024-09-13T19:15:28.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:28.094+0000 7fc15d59a640 1 -- 172.21.15.53:0/3711642380 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc15402ae20 con 0x7fc16012f7b0 2024-09-13T19:15:28.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:28.094+0000 7fc15d59a640 1 -- 172.21.15.53:0/3711642380 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc154032590 con 0x7fc16012f7b0 2024-09-13T19:15:28.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:28.095+0000 7fc164d4b640 1 -- 172.21.15.53:0/3711642380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc16012f7b0 msgr2=0x7fc160131ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:28.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:28.095+0000 7fc164d4b640 1 --2- 172.21.15.53:0/3711642380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc16012f7b0 0x7fc160131ba0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc154009720 tx=0x7fc15402a1a0 comp rx=0 tx=0).stop 2024-09-13T19:15:28.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:28.095+0000 7fc164d4b640 1 -- 172.21.15.53:0/3711642380 shutdown_connections 2024-09-13T19:15:28.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:28.095+0000 7fc164d4b640 1 --2- 172.21.15.53:0/3711642380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc16012f7b0 0x7fc160131ba0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:28.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:28.095+0000 7fc164d4b640 1 -- 172.21.15.53:0/3711642380 >> 172.21.15.53:0/3711642380 conn(0x7fc16009ccf0 msgr2=0x7fc16009d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:28.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:28.095+0000 7fc164d4b640 1 -- 172.21.15.53:0/3711642380 shutdown_connections 2024-09-13T19:15:28.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:28.095+0000 7fc164d4b640 1 -- 172.21.15.53:0/3711642380 wait complete. 2024-09-13T19:15:28.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:28.096+0000 7fc164d4b640 1 Processor -- start 2024-09-13T19:15:28.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:28.096+0000 7fc164d4b640 1 -- start start 2024-09-13T19:15:28.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:28.096+0000 7fc164d4b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc160129460 0x7fc1601c3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:28.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:28.096+0000 7fc164d4b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc1601320e0 con 0x7fc160129460 2024-09-13T19:15:28.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:28.096+0000 7fc15e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc160129460 0x7fc1601c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:28.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:28.097+0000 7fc15e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc160129460 0x7fc1601c3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47366/0 (socket says 172.21.15.53:47366) 2024-09-13T19:15:28.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:28.097+0000 7fc15e59c640 1 -- 172.21.15.53:0/693540158 learned_addr learned my addr 172.21.15.53:0/693540158 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:15:28.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:28.097+0000 7fc15e59c640 1 -- 172.21.15.53:0/693540158 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc16006f230 con 0x7fc160129460 2024-09-13T19:15:28.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:28.097+0000 7fc15e59c640 1 --2- 172.21.15.53:0/693540158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc160129460 0x7fc1601c3220 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc15000c480 tx=0x7fc15000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:28.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:28.097+0000 7fc14effd640 1 -- 172.21.15.53:0/693540158 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc150017070 con 0x7fc160129460 2024-09-13T19:15:28.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:28.097+0000 7fc14effd640 1 -- 172.21.15.53:0/693540158 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc150005c10 con 0x7fc160129460 2024-09-13T19:15:28.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:28.097+0000 7fc164d4b640 1 -- 172.21.15.53:0/693540158 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc160072370 con 0x7fc160129460 2024-09-13T19:15:28.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:28.097+0000 7fc14effd640 1 -- 172.21.15.53:0/693540158 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1500070d0 con 0x7fc160129460 2024-09-13T19:15:28.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:28.097+0000 7fc164d4b640 1 -- 172.21.15.53:0/693540158 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc16006eca0 con 0x7fc160129460 2024-09-13T19:15:28.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:28.097+0000 7fc14effd640 1 -- 172.21.15.53:0/693540158 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc15001a070 con 0x7fc160129460 2024-09-13T19:15:28.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:28.097+0000 7fc14effd640 1 -- 172.21.15.53:0/693540158 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fc15001cbf0 con 0x7fc160129460 2024-09-13T19:15:28.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:28.098+0000 7fc164d4b640 1 -- 172.21.15.53:0/693540158 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc160068350 con 0x7fc160129460 2024-09-13T19:15:28.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:28.100+0000 7fc14effd640 1 -- 172.21.15.53:0/693540158 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fc16006eca0 con 0x7fc160129460 2024-09-13T19:15:28.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:28.159+0000 7fc164d4b640 1 -- 172.21.15.53:0/693540158 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc160129840 con 0x7fc160129460 2024-09-13T19:15:28.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:28.160+0000 7fc14effd640 1 -- 172.21.15.53:0/693540158 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7fc15001c440 con 0x7fc160129460 2024-09-13T19:15:28.163 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:15:28.163 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":6,"fsid":"69e598bd-9014-4d1e-9444-0be214085a05","created":"2024-09-13T19:15:26.858539+0000","modified":"2024-09-13T19:15:27.961132+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T19:15:27.961132+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d078da3c-b2bc-4d4e-940d-e3a343202a5e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b461168d-7796-4d47-934f-2e5992d5a05e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0eb25aef-9bcf-4e31-9896-d9d2c1c6bc40","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c84cc8db-3bd3-432e-b84a-58235ad2888e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T19:15:28.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:28.160+0000 7fc164d4b640 1 -- 172.21.15.53:0/693540158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc160129460 msgr2=0x7fc1601c3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:28.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:28.160+0000 7fc164d4b640 1 --2- 172.21.15.53:0/693540158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc160129460 0x7fc1601c3220 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc15000c480 tx=0x7fc15000c940 comp rx=0 tx=0).stop 2024-09-13T19:15:28.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:28.161+0000 7fc164d4b640 1 -- 172.21.15.53:0/693540158 shutdown_connections 2024-09-13T19:15:28.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:28.161+0000 7fc164d4b640 1 --2- 172.21.15.53:0/693540158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc160129460 0x7fc1601c3220 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:28.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:28.161+0000 7fc164d4b640 1 -- 172.21.15.53:0/693540158 >> 172.21.15.53:0/693540158 conn(0x7fc16009ccf0 msgr2=0x7fc16012e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:28.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:28.161+0000 7fc164d4b640 1 -- 172.21.15.53:0/693540158 shutdown_connections 2024-09-13T19:15:28.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:28.161+0000 7fc164d4b640 1 -- 172.21.15.53:0/693540158 wait complete. 2024-09-13T19:15:28.174 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-13T19:15:28.174 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-13T19:15:28.577 DEBUG:teuthology.orchestra.run.smithi053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T19:15:28.672 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:28.668+0000 7ff12de1e640 1 Processor -- start 2024-09-13T19:15:28.672 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:28.668+0000 7ff12de1e640 1 -- start start 2024-09-13T19:15:28.672 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:28.669+0000 7ff12de1e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff12812c670 0x7ff12812ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:28.672 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:28.669+0000 7ff12de1e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff12809ac40 con 0x7ff12812cf90 2024-09-13T19:15:28.672 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:28.669+0000 7ff12de1e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7ff128072cc0 con 0x7ff12812c670 2024-09-13T19:15:28.672 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:28.669+0000 7ff1277fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff12812c670 0x7ff12812ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:28.672 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:28.669+0000 7ff126ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff12812cf90 0x7ff12806f2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:53866/0 (socket says 172.21.15.53:53866) 2024-09-13T19:15:28.673 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:28.669+0000 7ff126ffd640 1 -- 172.21.15.53:0/2341696677 learned_addr learned my addr 172.21.15.53:0/2341696677 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T19:15:28.673 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:28.669+0000 7ff1277fe640 1 -- 172.21.15.53:0/2341696677 >> v1:172.21.15.53:6789/0 conn(0x7ff12812cf90 legacy=0x7ff12806f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:28.673 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:28.669+0000 7ff1277fe640 1 -- 172.21.15.53:0/2341696677 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1280731b0 con 0x7ff12812c670 2024-09-13T19:15:28.673 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:28.669+0000 7ff1267fc640 1 -- 172.21.15.53:0/2341696677 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 754950935 0 0) 0x7ff12809ac40 con 0x7ff12812cf90 2024-09-13T19:15:28.674 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:28.670+0000 7ff1277fe640 1 --2- 172.21.15.53:0/2341696677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff12812c670 0x7ff12812ca50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff118009720 tx=0x7ff11802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11780a88fa177a2c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:28.674 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:28.670+0000 7ff1267fc640 1 -- 172.21.15.53:0/2341696677 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff118037070 con 0x7ff12812c670 2024-09-13T19:15:28.674 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:28.670+0000 7ff1267fc640 1 -- 172.21.15.53:0/2341696677 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff11802ad90 con 0x7ff12812c670 2024-09-13T19:15:28.675 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:28.670+0000 7ff1267fc640 1 -- 172.21.15.53:0/2341696677 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff118032590 con 0x7ff12812c670 2024-09-13T19:15:28.675 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:28.670+0000 7ff12de1e640 1 -- 172.21.15.53:0/2341696677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff12812c670 msgr2=0x7ff12812ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:28.675 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:28.670+0000 7ff12de1e640 1 --2- 172.21.15.53:0/2341696677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff12812c670 0x7ff12812ca50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff118009720 tx=0x7ff11802a110 comp rx=0 tx=0).stop 2024-09-13T19:15:28.675 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:28.671+0000 7ff12de1e640 1 -- 172.21.15.53:0/2341696677 shutdown_connections 2024-09-13T19:15:28.675 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:28.671+0000 7ff12de1e640 1 --2- 172.21.15.53:0/2341696677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff12812c670 0x7ff12812ca50 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:28.675 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:28.671+0000 7ff12de1e640 1 -- 172.21.15.53:0/2341696677 >> 172.21.15.53:0/2341696677 conn(0x7ff128099a00 msgr2=0x7ff128099e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:28.675 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:28.671+0000 7ff12de1e640 1 -- 172.21.15.53:0/2341696677 shutdown_connections 2024-09-13T19:15:28.675 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:28.671+0000 7ff12de1e640 1 -- 172.21.15.53:0/2341696677 wait complete. 2024-09-13T19:15:28.675 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:28.671+0000 7ff12de1e640 1 Processor -- start 2024-09-13T19:15:28.675 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:28.672+0000 7ff12de1e640 1 -- start start 2024-09-13T19:15:28.677 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:28.672+0000 7ff12de1e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff12812c670 0x7ff128116ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:28.677 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:28.672+0000 7ff12de1e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff12806fb80 con 0x7ff12812c670 2024-09-13T19:15:28.677 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:28.672+0000 7ff1277fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff12812c670 0x7ff128116ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:28.677 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:28.672+0000 7ff1277fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff12812c670 0x7ff128116ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47384/0 (socket says 172.21.15.53:47384) 2024-09-13T19:15:28.677 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:28.672+0000 7ff1277fe640 1 -- 172.21.15.53:0/3283822790 learned_addr learned my addr 172.21.15.53:0/3283822790 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:15:28.677 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:28.672+0000 7ff1277fe640 1 -- 172.21.15.53:0/3283822790 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff128118c50 con 0x7ff12812c670 2024-09-13T19:15:28.677 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:28.672+0000 7ff1277fe640 1 --2- 172.21.15.53:0/3283822790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff12812c670 0x7ff128116ee0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff118009720 tx=0x7ff1180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:28.677 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:28.673+0000 7ff10ffff640 1 -- 172.21.15.53:0/3283822790 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff118041070 con 0x7ff12812c670 2024-09-13T19:15:28.678 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:28.673+0000 7ff10ffff640 1 -- 172.21.15.53:0/3283822790 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff11803c460 con 0x7ff12812c670 2024-09-13T19:15:28.678 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:28.673+0000 7ff12de1e640 1 -- 172.21.15.53:0/3283822790 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff128126a40 con 0x7ff12812c670 2024-09-13T19:15:28.678 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:28.673+0000 7ff10ffff640 1 -- 172.21.15.53:0/3283822790 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff118037040 con 0x7ff12812c670 2024-09-13T19:15:28.678 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:28.673+0000 7ff12de1e640 1 -- 172.21.15.53:0/3283822790 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1281198e0 con 0x7ff12812c670 2024-09-13T19:15:28.678 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:28.673+0000 7ff10ffff640 1 -- 172.21.15.53:0/3283822790 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff118044070 con 0x7ff12812c670 2024-09-13T19:15:28.678 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:28.673+0000 7ff10ffff640 1 -- 172.21.15.53:0/3283822790 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7ff11803d3f0 con 0x7ff12812c670 2024-09-13T19:15:28.678 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:28.674+0000 7ff12de1e640 1 -- 172.21.15.53:0/3283822790 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff128123330 con 0x7ff12812c670 2024-09-13T19:15:28.678 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:28.676+0000 7ff10ffff640 1 -- 172.21.15.53:0/3283822790 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7ff118046450 con 0x7ff12812c670 2024-09-13T19:15:28.738 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:28.735+0000 7ff12de1e640 1 -- 172.21.15.53:0/3283822790 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff12809ac40 con 0x7ff12812c670 2024-09-13T19:15:28.739 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:28.736+0000 7ff10ffff640 1 -- 172.21.15.53:0/3283822790 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7ff11803c950 con 0x7ff12812c670 2024-09-13T19:15:28.739 INFO:teuthology.misc.health.smithi053.stdout: 2024-09-13T19:15:28.739 INFO:teuthology.misc.health.smithi053.stdout:{"epoch":6,"fsid":"69e598bd-9014-4d1e-9444-0be214085a05","created":"2024-09-13T19:15:26.858539+0000","modified":"2024-09-13T19:15:27.961132+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T19:15:27.961132+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d078da3c-b2bc-4d4e-940d-e3a343202a5e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b461168d-7796-4d47-934f-2e5992d5a05e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0eb25aef-9bcf-4e31-9896-d9d2c1c6bc40","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c84cc8db-3bd3-432e-b84a-58235ad2888e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T19:15:28.740 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:28.736+0000 7ff12de1e640 1 -- 172.21.15.53:0/3283822790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff12812c670 msgr2=0x7ff128116ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:28.740 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:28.736+0000 7ff12de1e640 1 --2- 172.21.15.53:0/3283822790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff12812c670 0x7ff128116ee0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff118009720 tx=0x7ff1180046c0 comp rx=0 tx=0).stop 2024-09-13T19:15:28.740 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:28.736+0000 7ff12de1e640 1 -- 172.21.15.53:0/3283822790 shutdown_connections 2024-09-13T19:15:28.740 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:28.736+0000 7ff12de1e640 1 --2- 172.21.15.53:0/3283822790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff12812c670 0x7ff128116ee0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:28.740 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:28.736+0000 7ff12de1e640 1 -- 172.21.15.53:0/3283822790 >> 172.21.15.53:0/3283822790 conn(0x7ff128099a00 msgr2=0x7ff12809bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:28.740 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:28.737+0000 7ff12de1e640 1 -- 172.21.15.53:0/3283822790 shutdown_connections 2024-09-13T19:15:28.740 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:28.737+0000 7ff12de1e640 1 -- 172.21.15.53:0/3283822790 wait complete. 2024-09-13T19:15:28.748 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-13T19:15:29.014 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-13T19:15:29.011+0000 7f5ccdb23040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T19:15:29.066 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-13T19:15:29.063+0000 7f5ccdb23040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T19:15:29.407 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-09-13T19:15:29.404+0000 7f8b8389c640 -1 Falling back to public interface 2024-09-13T19:15:29.433 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-13T19:15:29.430+0000 7f5ccdb23040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T19:15:29.479 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-13T19:15:29.476+0000 7fc04101a640 -1 Falling back to public interface 2024-09-13T19:15:29.521 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-13T19:15:29.518+0000 7f5ccdb23040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T19:15:29.625 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-13T19:15:29.622+0000 7f5ccdb23040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T19:15:29.671 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-13T19:15:29.668+0000 7f5ccdb23040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T19:15:29.786 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-13T19:15:29.783+0000 7f5ccdb23040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T19:15:29.839 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-13T19:15:29.835+0000 7f5ccdb23040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T19:15:29.883 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-13T19:15:29.880+0000 7f5ccdb23040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T19:15:29.978 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-13T19:15:29.975+0000 7fe5d97bb640 -1 Falling back to public interface 2024-09-13T19:15:29.995 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-13T19:15:29.992+0000 7f5ccdb23040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T19:15:30.003 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-13T19:15:30.000+0000 7f271f615640 -1 Falling back to public interface 2024-09-13T19:15:30.046 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-13T19:15:30.043+0000 7f5ccdb23040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T19:15:30.097 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-13T19:15:30.094+0000 7f5ccdb23040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T19:15:30.164 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-13T19:15:30.161+0000 7f5ccdb23040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T19:15:30.207 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-13T19:15:30.204+0000 7f5ccdb23040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T19:15:30.251 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-13T19:15:30.248+0000 7f5ccdb23040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T19:15:30.901 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-13T19:15:30.898+0000 7f5ccdb23040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T19:15:31.910 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-13T19:15:31.907+0000 7f5c6db09640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-13T19:15:33.643 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-09-13T19:15:33.640+0000 7f8b8389c640 -1 osd.0 0 log_to_monitors true 2024-09-13T19:15:34.040 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-13T19:15:34.036+0000 7fc04101a640 -1 osd.3 0 log_to_monitors true 2024-09-13T19:15:34.267 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-13T19:15:34.264+0000 7f271f615640 -1 osd.2 0 log_to_monitors true 2024-09-13T19:15:34.482 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-13T19:15:34.479+0000 7fe5d97bb640 -1 osd.1 0 log_to_monitors true 2024-09-13T19:15:35.153 DEBUG:teuthology.orchestra.run.smithi053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T19:15:35.288 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.285+0000 7f5b49265640 1 Processor -- start 2024-09-13T19:15:35.288 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.285+0000 7f5b49265640 1 -- start start 2024-09-13T19:15:35.289 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.286+0000 7f5b49265640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5b44131a40 0x7f5b44133e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:35.289 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.286+0000 7f5b49265640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b44098260 con 0x7f5b44097770 2024-09-13T19:15:35.289 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.286+0000 7f5b49265640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f5b440a0da0 con 0x7f5b44131a40 2024-09-13T19:15:35.289 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.286+0000 7f5b427fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5b44131a40 0x7f5b44133e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:35.290 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.286+0000 7f5b427fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5b44131a40 0x7f5b44133e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50626/0 (socket says 172.21.15.53:50626) 2024-09-13T19:15:35.290 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.286+0000 7f5b427fc640 1 -- 172.21.15.53:0/675943963 learned_addr learned my addr 172.21.15.53:0/675943963 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:15:35.290 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.286+0000 7f5b427fc640 1 -- 172.21.15.53:0/675943963 >> v1:172.21.15.53:6789/0 conn(0x7f5b44097770 legacy=0x7f5b44097b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:35.290 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.286+0000 7f5b427fc640 1 -- 172.21.15.53:0/675943963 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b4409ac90 con 0x7f5b44131a40 2024-09-13T19:15:35.290 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.287+0000 7f5b427fc640 1 --2- 172.21.15.53:0/675943963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b44131a40 0x7f5b44133e30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5b380097f0 tx=0x7f5b3802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e5389c7a3a8a394 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:35.291 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.288+0000 7f5b41ffb640 1 -- 172.21.15.53:0/675943963 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b38037070 con 0x7f5b44131a40 2024-09-13T19:15:35.291 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.288+0000 7f5b41ffb640 1 -- 172.21.15.53:0/675943963 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b38032440 con 0x7f5b44131a40 2024-09-13T19:15:35.291 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.288+0000 7f5b41ffb640 1 -- 172.21.15.53:0/675943963 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b3802ae60 con 0x7f5b44131a40 2024-09-13T19:15:35.292 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.288+0000 7f5b49265640 1 -- 172.21.15.53:0/675943963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b44131a40 msgr2=0x7f5b44133e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:35.292 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.288+0000 7f5b49265640 1 --2- 172.21.15.53:0/675943963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b44131a40 0x7f5b44133e30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5b380097f0 tx=0x7f5b3802a1e0 comp rx=0 tx=0).stop 2024-09-13T19:15:35.292 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.289+0000 7f5b49265640 1 -- 172.21.15.53:0/675943963 shutdown_connections 2024-09-13T19:15:35.292 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.289+0000 7f5b49265640 1 --2- 172.21.15.53:0/675943963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b44131a40 0x7f5b44133e30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:35.292 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.289+0000 7f5b49265640 1 -- 172.21.15.53:0/675943963 >> 172.21.15.53:0/675943963 conn(0x7f5b440a15f0 msgr2=0x7f5b4409dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:35.292 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.289+0000 7f5b49265640 1 -- 172.21.15.53:0/675943963 shutdown_connections 2024-09-13T19:15:35.292 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.289+0000 7f5b49265640 1 -- 172.21.15.53:0/675943963 wait complete. 2024-09-13T19:15:35.293 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.290+0000 7f5b49265640 1 Processor -- start 2024-09-13T19:15:35.293 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.290+0000 7f5b49265640 1 -- start start 2024-09-13T19:15:35.294 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.291+0000 7f5b49265640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b44097770 0x7f5b441c3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:35.294 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.291+0000 7f5b49265640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5b4409a620 con 0x7f5b44097770 2024-09-13T19:15:35.294 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.291+0000 7f5b42ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b44097770 0x7f5b441c3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:35.294 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.291+0000 7f5b42ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b44097770 0x7f5b441c3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50634/0 (socket says 172.21.15.53:50634) 2024-09-13T19:15:35.294 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.291+0000 7f5b42ffd640 1 -- 172.21.15.53:0/2941898216 learned_addr learned my addr 172.21.15.53:0/2941898216 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:15:35.294 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.291+0000 7f5b42ffd640 1 -- 172.21.15.53:0/2941898216 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b4412e600 con 0x7f5b44097770 2024-09-13T19:15:35.295 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.292+0000 7f5b42ffd640 1 --2- 172.21.15.53:0/2941898216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b44097770 0x7f5b441c3540 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5b3400c450 tx=0x7f5b3400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:35.295 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.292+0000 7f5b2b7fe640 1 -- 172.21.15.53:0/2941898216 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b34017070 con 0x7f5b44097770 2024-09-13T19:15:35.295 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.292+0000 7f5b49265640 1 -- 172.21.15.53:0/2941898216 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b441292c0 con 0x7f5b44097770 2024-09-13T19:15:35.295 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.292+0000 7f5b2b7fe640 1 -- 172.21.15.53:0/2941898216 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b34005220 con 0x7f5b44097770 2024-09-13T19:15:35.295 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.292+0000 7f5b2b7fe640 1 -- 172.21.15.53:0/2941898216 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b340035f0 con 0x7f5b44097770 2024-09-13T19:15:35.296 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.292+0000 7f5b49265640 1 -- 172.21.15.53:0/2941898216 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b4412f370 con 0x7f5b44097770 2024-09-13T19:15:35.296 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.293+0000 7f5b2b7fe640 1 -- 172.21.15.53:0/2941898216 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 4) ==== 45681+0+0 (secure 0 0 0) 0x7f5b3401a070 con 0x7f5b44097770 2024-09-13T19:15:35.297 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.293+0000 7f5b2b7fe640 1 --2- 172.21.15.53:0/2941898216 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5b30038210 0x7f5b3003a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:35.297 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.293+0000 7f5b2b7fe640 1 -- 172.21.15.53:0/2941898216 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1465+0+0 (secure 0 0 0) 0x7f5b34049ca0 con 0x7f5b44097770 2024-09-13T19:15:35.297 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.293+0000 7f5b49265640 1 -- 172.21.15.53:0/2941898216 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b4412f600 con 0x7f5b44097770 2024-09-13T19:15:35.297 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.293+0000 7f5b427fc640 1 --2- 172.21.15.53:0/2941898216 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5b30038210 0x7f5b3003a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:35.297 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.294+0000 7f5b427fc640 1 --2- 172.21.15.53:0/2941898216 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5b30038210 0x7f5b3003a6d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5b38034000 tx=0x7f5b3802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:35.301 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.298+0000 7f5b2b7fe640 1 -- 172.21.15.53:0/2941898216 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5b3401ac60 con 0x7f5b44097770 2024-09-13T19:15:35.606 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.603+0000 7f5b49265640 1 -- 172.21.15.53:0/2941898216 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5b44097b50 con 0x7f5b44097770 2024-09-13T19:15:35.606 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.603+0000 7f5b2b7fe640 1 -- 172.21.15.53:0/2941898216 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+4153 (secure 0 0 0) 0x7f5b3401a9a0 con 0x7f5b44097770 2024-09-13T19:15:35.606 INFO:teuthology.misc.health.smithi053.stdout: 2024-09-13T19:15:35.606 INFO:teuthology.misc.health.smithi053.stdout:{"epoch":8,"fsid":"69e598bd-9014-4d1e-9444-0be214085a05","created":"2024-09-13T19:15:26.858539+0000","modified":"2024-09-13T19:15:34.909068+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T19:15:27.961132+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d078da3c-b2bc-4d4e-940d-e3a343202a5e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b461168d-7796-4d47-934f-2e5992d5a05e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0eb25aef-9bcf-4e31-9896-d9d2c1c6bc40","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c84cc8db-3bd3-432e-b84a-58235ad2888e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T19:15:35.609 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.605+0000 7f5b49265640 1 -- 172.21.15.53:0/2941898216 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5b30038210 msgr2=0x7f5b3003a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:35.609 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.605+0000 7f5b49265640 1 --2- 172.21.15.53:0/2941898216 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5b30038210 0x7f5b3003a6d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5b38034000 tx=0x7f5b3802e000 comp rx=0 tx=0).stop 2024-09-13T19:15:35.609 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.605+0000 7f5b49265640 1 -- 172.21.15.53:0/2941898216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b44097770 msgr2=0x7f5b441c3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:35.609 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.605+0000 7f5b49265640 1 --2- 172.21.15.53:0/2941898216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b44097770 0x7f5b441c3540 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5b3400c450 tx=0x7f5b3400c910 comp rx=0 tx=0).stop 2024-09-13T19:15:35.609 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.606+0000 7f5b49265640 1 -- 172.21.15.53:0/2941898216 shutdown_connections 2024-09-13T19:15:35.609 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.606+0000 7f5b49265640 1 --2- 172.21.15.53:0/2941898216 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5b30038210 0x7f5b3003a6d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:35.609 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.606+0000 7f5b49265640 1 --2- 172.21.15.53:0/2941898216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b44097770 0x7f5b441c3540 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:35.609 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.606+0000 7f5b49265640 1 -- 172.21.15.53:0/2941898216 >> 172.21.15.53:0/2941898216 conn(0x7f5b440a15f0 msgr2=0x7f5b44098530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:35.609 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.606+0000 7f5b49265640 1 -- 172.21.15.53:0/2941898216 shutdown_connections 2024-09-13T19:15:35.609 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:35.606+0000 7f5b49265640 1 -- 172.21.15.53:0/2941898216 wait complete. 2024-09-13T19:15:35.619 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-13T19:15:35.706 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-09-13T19:15:35.680+0000 7f8b7f008640 -1 osd.0 0 waiting for initial osdmap 2024-09-13T19:15:35.706 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-09-13T19:15:35.693+0000 7f8b7763a640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T19:15:37.558 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-13T19:15:37.555+0000 7fc03d1fc640 -1 osd.3 0 waiting for initial osdmap 2024-09-13T19:15:37.573 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-13T19:15:37.570+0000 7fc0347f7640 -1 osd.3 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T19:15:37.586 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-13T19:15:37.583+0000 7fe5d4f27640 -1 osd.1 0 waiting for initial osdmap 2024-09-13T19:15:37.587 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-13T19:15:37.584+0000 7f271a6d2640 -1 osd.2 0 waiting for initial osdmap 2024-09-13T19:15:37.601 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-13T19:15:37.598+0000 7fe5cd559640 -1 osd.1 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T19:15:37.607 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-13T19:15:37.604+0000 7f2712d04640 -1 osd.2 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T19:15:42.109 DEBUG:teuthology.orchestra.run.smithi053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T19:15:42.207 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.202+0000 7fc44dcb7640 1 Processor -- start 2024-09-13T19:15:42.208 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.202+0000 7fc44dcb7640 1 -- start start 2024-09-13T19:15:42.208 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.202+0000 7fc44dcb7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc448094540 0x7fc448130650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:42.208 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.202+0000 7fc44dcb7640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc448127ec0 con 0x7fc448128310 2024-09-13T19:15:42.208 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.202+0000 7fc44dcb7640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fc44806e430 con 0x7fc448094540 2024-09-13T19:15:42.208 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.203+0000 7fc446ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc448094540 0x7fc448130650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:42.208 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.203+0000 7fc446ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc448094540 0x7fc448130650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50644/0 (socket says 172.21.15.53:50644) 2024-09-13T19:15:42.208 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.203+0000 7fc4477fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc448128310 0x7fc4481286f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33400/0 (socket says 172.21.15.53:33400) 2024-09-13T19:15:42.208 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.203+0000 7fc446ffd640 1 -- 172.21.15.53:0/1953793762 learned_addr learned my addr 172.21.15.53:0/1953793762 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:15:42.208 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.203+0000 7fc446ffd640 1 -- 172.21.15.53:0/1953793762 >> v1:172.21.15.53:6789/0 conn(0x7fc448128310 legacy=0x7fc4481286f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:42.208 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.203+0000 7fc446ffd640 1 -- 172.21.15.53:0/1953793762 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc448094970 con 0x7fc448094540 2024-09-13T19:15:42.208 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.204+0000 7fc446ffd640 1 --2- 172.21.15.53:0/1953793762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc448094540 0x7fc448130650 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc43c0097f0 tx=0x7fc43c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb4e2415c110cfbe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:42.209 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.204+0000 7fc4467fc640 1 -- 172.21.15.53:0/1953793762 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc43c037070 con 0x7fc448094540 2024-09-13T19:15:42.209 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.204+0000 7fc4467fc640 1 -- 172.21.15.53:0/1953793762 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc43c032440 con 0x7fc448094540 2024-09-13T19:15:42.209 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.204+0000 7fc4467fc640 1 -- 172.21.15.53:0/1953793762 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc43c02ae60 con 0x7fc448094540 2024-09-13T19:15:42.209 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.204+0000 7fc44dcb7640 1 -- 172.21.15.53:0/1953793762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc448094540 msgr2=0x7fc448130650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:42.209 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.204+0000 7fc44dcb7640 1 --2- 172.21.15.53:0/1953793762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc448094540 0x7fc448130650 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc43c0097f0 tx=0x7fc43c02a1e0 comp rx=0 tx=0).stop 2024-09-13T19:15:42.209 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.204+0000 7fc44dcb7640 1 -- 172.21.15.53:0/1953793762 shutdown_connections 2024-09-13T19:15:42.209 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.204+0000 7fc44dcb7640 1 --2- 172.21.15.53:0/1953793762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc448094540 0x7fc448130650 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:42.209 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.204+0000 7fc44dcb7640 1 -- 172.21.15.53:0/1953793762 >> 172.21.15.53:0/1953793762 conn(0x7fc44809ac90 msgr2=0x7fc44809b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:42.209 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.204+0000 7fc44dcb7640 1 -- 172.21.15.53:0/1953793762 shutdown_connections 2024-09-13T19:15:42.209 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.204+0000 7fc44dcb7640 1 -- 172.21.15.53:0/1953793762 wait complete. 2024-09-13T19:15:42.211 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.205+0000 7fc44dcb7640 1 Processor -- start 2024-09-13T19:15:42.212 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.205+0000 7fc44dcb7640 1 -- start start 2024-09-13T19:15:42.212 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.206+0000 7fc44dcb7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc448094540 0x7fc448126080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:42.212 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.206+0000 7fc44dcb7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc448130d10 con 0x7fc448094540 2024-09-13T19:15:42.212 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.206+0000 7fc4477fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc448094540 0x7fc448126080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:42.212 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.206+0000 7fc4477fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc448094540 0x7fc448126080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50658/0 (socket says 172.21.15.53:50658) 2024-09-13T19:15:42.212 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.206+0000 7fc4477fe640 1 -- 172.21.15.53:0/3804997651 learned_addr learned my addr 172.21.15.53:0/3804997651 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:15:42.212 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.206+0000 7fc4477fe640 1 -- 172.21.15.53:0/3804997651 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc448072b70 con 0x7fc448094540 2024-09-13T19:15:42.212 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.206+0000 7fc4477fe640 1 --2- 172.21.15.53:0/3804997651 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc448094540 0x7fc448126080 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc43800c450 tx=0x7fc43800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:42.212 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.206+0000 7fc42ffff640 1 -- 172.21.15.53:0/3804997651 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc438007410 con 0x7fc448094540 2024-09-13T19:15:42.212 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.207+0000 7fc42ffff640 1 -- 172.21.15.53:0/3804997651 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4380075b0 con 0x7fc448094540 2024-09-13T19:15:42.212 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.207+0000 7fc44dcb7640 1 -- 172.21.15.53:0/3804997651 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc448127910 con 0x7fc448094540 2024-09-13T19:15:42.212 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.207+0000 7fc42ffff640 1 -- 172.21.15.53:0/3804997651 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc438004910 con 0x7fc448094540 2024-09-13T19:15:42.212 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.207+0000 7fc44dcb7640 1 -- 172.21.15.53:0/3804997651 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4481265c0 con 0x7fc448094540 2024-09-13T19:15:42.213 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.208+0000 7fc42ffff640 1 -- 172.21.15.53:0/3804997651 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 4) ==== 45681+0+0 (secure 0 0 0) 0x7fc43801a020 con 0x7fc448094540 2024-09-13T19:15:42.213 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.208+0000 7fc44dcb7640 1 -- 172.21.15.53:0/3804997651 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4480008d0 con 0x7fc448094540 2024-09-13T19:15:42.213 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.208+0000 7fc42ffff640 1 --2- 172.21.15.53:0/3804997651 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc434038210 0x7fc43403a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:42.213 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.208+0000 7fc42ffff640 1 -- 172.21.15.53:0/3804997651 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3129+0+0 (secure 0 0 0) 0x7fc43804a7e0 con 0x7fc448094540 2024-09-13T19:15:42.213 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.208+0000 7fc446ffd640 1 --2- 172.21.15.53:0/3804997651 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc434038210 0x7fc43403a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:42.213 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.208+0000 7fc446ffd640 1 --2- 172.21.15.53:0/3804997651 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc434038210 0x7fc43403a6d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc43c034000 tx=0x7fc43c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:42.216 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.213+0000 7fc42ffff640 1 -- 172.21.15.53:0/3804997651 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc43801b9c0 con 0x7fc448094540 2024-09-13T19:15:42.393 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.390+0000 7fc44dcb7640 1 -- 172.21.15.53:0/3804997651 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc44812cc30 con 0x7fc448094540 2024-09-13T19:15:42.394 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.391+0000 7fc42ffff640 1 -- 172.21.15.53:0/3804997651 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+8014 (secure 0 0 0) 0x7fc43801bc20 con 0x7fc448094540 2024-09-13T19:15:42.394 INFO:teuthology.misc.health.smithi053.stdout: 2024-09-13T19:15:42.394 INFO:teuthology.misc.health.smithi053.stdout:{"epoch":14,"fsid":"69e598bd-9014-4d1e-9444-0be214085a05","created":"2024-09-13T19:15:26.858539+0000","modified":"2024-09-13T19:15:41.562649+0000","last_up_change":"2024-09-13T19:15:38.556807+0000","last_in_change":"2024-09-13T19:15:27.961132+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T19:15:38.950231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d078da3c-b2bc-4d4e-940d-e3a343202a5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":4021716951},{"type":"v1","addr":"172.21.15.53:6801","nonce":4021716951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":4021716951},{"type":"v1","addr":"172.21.15.53:6803","nonce":4021716951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":4021716951},{"type":"v1","addr":"172.21.15.53:6807","nonce":4021716951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":4021716951},{"type":"v1","addr":"172.21.15.53:6805","nonce":4021716951}]},"public_addr":"172.21.15.53:6801/4021716951","cluster_addr":"172.21.15.53:6803/4021716951","heartbeat_back_addr":"172.21.15.53:6807/4021716951","heartbeat_front_addr":"172.21.15.53:6805/4021716951","state":["exists","up"]},{"osd":1,"uuid":"b461168d-7796-4d47-934f-2e5992d5a05e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2204418452},{"type":"v1","addr":"172.21.15.102:6809","nonce":2204418452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":2204418452},{"type":"v1","addr":"172.21.15.102:6811","nonce":2204418452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":2204418452},{"type":"v1","addr":"172.21.15.102:6815","nonce":2204418452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2204418452},{"type":"v1","addr":"172.21.15.102:6813","nonce":2204418452}]},"public_addr":"172.21.15.102:6809/2204418452","cluster_addr":"172.21.15.102:6811/2204418452","heartbeat_back_addr":"172.21.15.102:6815/2204418452","heartbeat_front_addr":"172.21.15.102:6813/2204418452","state":["exists","up"]},{"osd":2,"uuid":"0eb25aef-9bcf-4e31-9896-d9d2c1c6bc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2238176080},{"type":"v1","addr":"172.21.15.102:6817","nonce":2238176080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":2238176080},{"type":"v1","addr":"172.21.15.102:6819","nonce":2238176080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2238176080},{"type":"v1","addr":"172.21.15.102:6823","nonce":2238176080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2238176080},{"type":"v1","addr":"172.21.15.102:6821","nonce":2238176080}]},"public_addr":"172.21.15.102:6817/2238176080","cluster_addr":"172.21.15.102:6819/2238176080","heartbeat_back_addr":"172.21.15.102:6823/2238176080","heartbeat_front_addr":"172.21.15.102:6821/2238176080","state":["exists","up"]},{"osd":3,"uuid":"c84cc8db-3bd3-432e-b84a-58235ad2888e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":3096737090},{"type":"v1","addr":"172.21.15.102:6801","nonce":3096737090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3096737090},{"type":"v1","addr":"172.21.15.102:6803","nonce":3096737090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3096737090},{"type":"v1","addr":"172.21.15.102:6807","nonce":3096737090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3096737090},{"type":"v1","addr":"172.21.15.102:6805","nonce":3096737090}]},"public_addr":"172.21.15.102:6801/3096737090","cluster_addr":"172.21.15.102:6803/3096737090","heartbeat_back_addr":"172.21.15.102:6807/3096737090","heartbeat_front_addr":"172.21.15.102:6805/3096737090","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T19:15:34.603524+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T19:15:35.432574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T19:15:35.230750+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T19:15:35.026997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T19:15:42.396 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.393+0000 7fc44dcb7640 1 -- 172.21.15.53:0/3804997651 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc434038210 msgr2=0x7fc43403a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:42.396 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.393+0000 7fc44dcb7640 1 --2- 172.21.15.53:0/3804997651 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc434038210 0x7fc43403a6d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc43c034000 tx=0x7fc43c02e000 comp rx=0 tx=0).stop 2024-09-13T19:15:42.396 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.393+0000 7fc44dcb7640 1 -- 172.21.15.53:0/3804997651 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc448094540 msgr2=0x7fc448126080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:42.396 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.393+0000 7fc44dcb7640 1 --2- 172.21.15.53:0/3804997651 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc448094540 0x7fc448126080 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc43800c450 tx=0x7fc43800c910 comp rx=0 tx=0).stop 2024-09-13T19:15:42.396 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.393+0000 7fc44dcb7640 1 -- 172.21.15.53:0/3804997651 shutdown_connections 2024-09-13T19:15:42.396 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.393+0000 7fc44dcb7640 1 --2- 172.21.15.53:0/3804997651 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc434038210 0x7fc43403a6d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:42.397 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.393+0000 7fc44dcb7640 1 --2- 172.21.15.53:0/3804997651 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc448094540 0x7fc448126080 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:42.397 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.393+0000 7fc44dcb7640 1 -- 172.21.15.53:0/3804997651 >> 172.21.15.53:0/3804997651 conn(0x7fc44809ac90 msgr2=0x7fc448094bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:42.397 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.393+0000 7fc44dcb7640 1 -- 172.21.15.53:0/3804997651 shutdown_connections 2024-09-13T19:15:42.397 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T19:15:42.393+0000 7fc44dcb7640 1 -- 172.21.15.53:0/3804997651 wait complete. 2024-09-13T19:15:42.405 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-09-13T19:15:42.405 INFO:tasks.ceph:Creating RBD pool 2024-09-13T19:15:42.405 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-13T19:15:42.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:42.503+0000 7f8b724d2640 1 Processor -- start 2024-09-13T19:15:42.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:42.503+0000 7f8b724d2640 1 -- start start 2024-09-13T19:15:42.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:42.504+0000 7f8b724d2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8b6c12f9d0 0x7f8b6c131dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:42.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:42.504+0000 7f8b724d2640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b6c071f70 con 0x7f8b6c12cca0 2024-09-13T19:15:42.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:42.504+0000 7f8b724d2640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f8b6c06e350 con 0x7f8b6c12f9d0 2024-09-13T19:15:42.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:42.504+0000 7f8b6b7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8b6c12f9d0 0x7f8b6c131dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:42.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:42.504+0000 7f8b6bfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f8b6c12cca0 0x7f8b6c12d080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33404/0 (socket says 172.21.15.53:33404) 2024-09-13T19:15:42.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:42.504+0000 7f8b6bfff640 1 -- 172.21.15.53:0/3091899750 learned_addr learned my addr 172.21.15.53:0/3091899750 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T19:15:42.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:42.504+0000 7f8b6b7fe640 1 -- 172.21.15.53:0/3091899750 >> v1:172.21.15.53:6789/0 conn(0x7f8b6c12cca0 legacy=0x7f8b6c12d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:42.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:42.504+0000 7f8b6b7fe640 1 -- 172.21.15.53:0/3091899750 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b6c0715c0 con 0x7f8b6c12f9d0 2024-09-13T19:15:42.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:42.504+0000 7f8b6affd640 1 -- 172.21.15.53:0/3091899750 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2658657090 0 0) 0x7f8b6c071f70 con 0x7f8b6c12cca0 2024-09-13T19:15:42.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:42.505+0000 7f8b6b7fe640 1 --2- 172.21.15.53:0/3091899750 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b6c12f9d0 0x7f8b6c131dc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8b60009720 tx=0x7f8b6002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e99b399df55e436e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:42.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:42.505+0000 7f8b6affd640 1 -- 172.21.15.53:0/3091899750 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b60037070 con 0x7f8b6c12f9d0 2024-09-13T19:15:42.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:42.505+0000 7f8b6affd640 1 -- 172.21.15.53:0/3091899750 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b6002ad90 con 0x7f8b6c12f9d0 2024-09-13T19:15:42.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:42.505+0000 7f8b6affd640 1 -- 172.21.15.53:0/3091899750 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b60032590 con 0x7f8b6c12f9d0 2024-09-13T19:15:42.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:42.505+0000 7f8b724d2640 1 -- 172.21.15.53:0/3091899750 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b6c12f9d0 msgr2=0x7f8b6c131dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:42.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:42.505+0000 7f8b724d2640 1 --2- 172.21.15.53:0/3091899750 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b6c12f9d0 0x7f8b6c131dc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8b60009720 tx=0x7f8b6002a110 comp rx=0 tx=0).stop 2024-09-13T19:15:42.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:42.506+0000 7f8b724d2640 1 -- 172.21.15.53:0/3091899750 shutdown_connections 2024-09-13T19:15:42.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:42.506+0000 7f8b724d2640 1 --2- 172.21.15.53:0/3091899750 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b6c12f9d0 0x7f8b6c131dc0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:42.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:42.506+0000 7f8b724d2640 1 -- 172.21.15.53:0/3091899750 >> 172.21.15.53:0/3091899750 conn(0x7f8b6c09a890 msgr2=0x7f8b6c09aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:42.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:42.506+0000 7f8b724d2640 1 -- 172.21.15.53:0/3091899750 shutdown_connections 2024-09-13T19:15:42.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:42.506+0000 7f8b724d2640 1 -- 172.21.15.53:0/3091899750 wait complete. 2024-09-13T19:15:42.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:42.506+0000 7f8b724d2640 1 Processor -- start 2024-09-13T19:15:42.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:42.507+0000 7f8b724d2640 1 -- start start 2024-09-13T19:15:42.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:42.507+0000 7f8b724d2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b6c12cca0 0x7f8b6c06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:42.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:42.507+0000 7f8b724d2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8b6c12ca50 con 0x7f8b6c12cca0 2024-09-13T19:15:42.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:42.507+0000 7f8b6bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b6c12cca0 0x7f8b6c06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:42.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:42.507+0000 7f8b6bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b6c12cca0 0x7f8b6c06ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50670/0 (socket says 172.21.15.53:50670) 2024-09-13T19:15:42.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:42.507+0000 7f8b6bfff640 1 -- 172.21.15.53:0/3707048166 learned_addr learned my addr 172.21.15.53:0/3707048166 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:15:42.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:42.507+0000 7f8b6bfff640 1 -- 172.21.15.53:0/3707048166 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b6c129ca0 con 0x7f8b6c12cca0 2024-09-13T19:15:42.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:42.508+0000 7f8b6bfff640 1 --2- 172.21.15.53:0/3707048166 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b6c12cca0 0x7f8b6c06ea20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c00c370 tx=0x7f8b5c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:42.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:42.508+0000 7f8b68ff9640 1 -- 172.21.15.53:0/3707048166 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b5c007410 con 0x7f8b6c12cca0 2024-09-13T19:15:42.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:42.508+0000 7f8b68ff9640 1 -- 172.21.15.53:0/3707048166 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b5c0075d0 con 0x7f8b6c12cca0 2024-09-13T19:15:42.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:42.508+0000 7f8b724d2640 1 -- 172.21.15.53:0/3707048166 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b6c08b310 con 0x7f8b6c12cca0 2024-09-13T19:15:42.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:42.508+0000 7f8b68ff9640 1 -- 172.21.15.53:0/3707048166 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b5c004950 con 0x7f8b6c12cca0 2024-09-13T19:15:42.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:42.508+0000 7f8b724d2640 1 -- 172.21.15.53:0/3707048166 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b6c06ff40 con 0x7f8b6c12cca0 2024-09-13T19:15:42.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:42.509+0000 7f8b68ff9640 1 -- 172.21.15.53:0/3707048166 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 4) ==== 45681+0+0 (secure 0 0 0) 0x7f8b5c011070 con 0x7f8b6c12cca0 2024-09-13T19:15:42.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:42.509+0000 7f8b724d2640 1 -- 172.21.15.53:0/3707048166 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b6c12e200 con 0x7f8b6c12cca0 2024-09-13T19:15:42.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:42.509+0000 7f8b68ff9640 1 --2- 172.21.15.53:0/3707048166 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8b58038210 0x7f8b5803a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:42.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:42.509+0000 7f8b68ff9640 1 -- 172.21.15.53:0/3707048166 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3129+0+0 (secure 0 0 0) 0x7f8b5c04ab70 con 0x7f8b6c12cca0 2024-09-13T19:15:42.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:42.509+0000 7f8b6b7fe640 1 --2- 172.21.15.53:0/3707048166 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8b58038210 0x7f8b5803a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:42.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:42.510+0000 7f8b6b7fe640 1 --2- 172.21.15.53:0/3707048166 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8b58038210 0x7f8b5803a6d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8b60009720 tx=0x7f8b6002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:42.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:42.513+0000 7f8b68ff9640 1 -- 172.21.15.53:0/3707048166 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8b5c01cbd0 con 0x7f8b6c12cca0 2024-09-13T19:15:42.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:42.689+0000 7f8b724d2640 1 -- 172.21.15.53:0/3707048166 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f8b6c06e510 con 0x7f8b6c12cca0 2024-09-13T19:15:43.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.567+0000 7f8b68ff9640 1 -- 172.21.15.53:0/3707048166 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v15) ==== 109+0+0 (secure 0 0 0) 0x7f8b5c004cd0 con 0x7f8b6c12cca0 2024-09-13T19:15:43.571 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'rbd' created 2024-09-13T19:15:43.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.572+0000 7f8b724d2640 1 -- 172.21.15.53:0/3707048166 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8b58038210 msgr2=0x7f8b5803a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:43.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.572+0000 7f8b724d2640 1 --2- 172.21.15.53:0/3707048166 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8b58038210 0x7f8b5803a6d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8b60009720 tx=0x7f8b6002e000 comp rx=0 tx=0).stop 2024-09-13T19:15:43.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.572+0000 7f8b724d2640 1 -- 172.21.15.53:0/3707048166 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b6c12cca0 msgr2=0x7f8b6c06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:43.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.572+0000 7f8b724d2640 1 --2- 172.21.15.53:0/3707048166 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b6c12cca0 0x7f8b6c06ea20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c00c370 tx=0x7f8b5c00c830 comp rx=0 tx=0).stop 2024-09-13T19:15:43.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.572+0000 7f8b724d2640 1 -- 172.21.15.53:0/3707048166 shutdown_connections 2024-09-13T19:15:43.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.572+0000 7f8b724d2640 1 --2- 172.21.15.53:0/3707048166 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8b58038210 0x7f8b5803a6d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:43.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.572+0000 7f8b724d2640 1 --2- 172.21.15.53:0/3707048166 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b6c12cca0 0x7f8b6c06ea20 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:43.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.572+0000 7f8b724d2640 1 -- 172.21.15.53:0/3707048166 >> 172.21.15.53:0/3707048166 conn(0x7f8b6c09a890 msgr2=0x7f8b6c12fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:43.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.572+0000 7f8b724d2640 1 -- 172.21.15.53:0/3707048166 shutdown_connections 2024-09-13T19:15:43.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.572+0000 7f8b724d2640 1 -- 172.21.15.53:0/3707048166 wait complete. 2024-09-13T19:15:43.589 DEBUG:teuthology.orchestra.run.smithi053:> rbd --cluster ceph pool init rbd 2024-09-13T19:15:43.651 INFO:teuthology.orchestra.run.smithi053.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:15:43.652 INFO:teuthology.orchestra.run.smithi053.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:15:43.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.649+0000 7f31a89d0d80 1 Processor -- start 2024-09-13T19:15:43.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.649+0000 7f31a89d0d80 1 -- start start 2024-09-13T19:15:43.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.650+0000 7f31a89d0d80 1 --2- >> v2:172.21.15.53:3300/0 conn(0x558b0917fc10 0x558b0921a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:43.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.650+0000 7f31a89d0d80 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x558b08ff1050 con 0x558b0917f120 2024-09-13T19:15:43.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.650+0000 7f31a89d0d80 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x558b08fff930 con 0x558b0917fc10 2024-09-13T19:15:43.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.650+0000 7f31a6cc5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x558b0917fc10 0x558b0921a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:43.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.650+0000 7f31a74c6640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x558b0917f120 0x558b0917f500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33416/0 (socket says 172.21.15.53:33416) 2024-09-13T19:15:43.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.650+0000 7f31a74c6640 1 -- 172.21.15.53:0/2346255754 learned_addr learned my addr 172.21.15.53:0/2346255754 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T19:15:43.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.650+0000 7f31a6cc5640 1 --2- 172.21.15.53:0/2346255754 >> v2:172.21.15.53:3300/0 conn(0x558b0917fc10 0x558b0921a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50684/0 (socket says 172.21.15.53:50684) 2024-09-13T19:15:43.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.650+0000 7f31a6cc5640 1 -- 172.21.15.53:0/2346255754 >> v1:172.21.15.53:6789/0 conn(0x558b0917f120 legacy=0x558b0917f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:43.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.650+0000 7f31a64c4640 1 -- 172.21.15.53:0/2346255754 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1958051937 0 0) 0x558b08ff1050 con 0x558b0917f120 2024-09-13T19:15:43.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.651+0000 7f31a6cc5640 1 -- 172.21.15.53:0/2346255754 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b08fdace0 con 0x558b0917fc10 2024-09-13T19:15:43.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.652+0000 7f31a6cc5640 1 --2- 172.21.15.53:0/2346255754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b0917fc10 0x558b0921a5b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f319c00a470 tx=0x7f319c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5e5f606c1617acc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:43.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.653+0000 7f31a64c4640 1 -- 172.21.15.53:0/2346255754 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f319c053570 con 0x558b0917fc10 2024-09-13T19:15:43.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.653+0000 7f31a64c4640 1 -- 172.21.15.53:0/2346255754 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f319c058070 con 0x558b0917fc10 2024-09-13T19:15:43.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.653+0000 7f31a64c4640 1 -- 172.21.15.53:0/2346255754 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f319c053880 con 0x558b0917fc10 2024-09-13T19:15:43.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.653+0000 7f31a89d0d80 1 -- 172.21.15.53:0/2346255754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b0917fc10 msgr2=0x558b0921a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:43.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.653+0000 7f31a89d0d80 1 --2- 172.21.15.53:0/2346255754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b0917fc10 0x558b0921a5b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f319c00a470 tx=0x7f319c045a20 comp rx=0 tx=0).stop 2024-09-13T19:15:43.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.653+0000 7f31a89d0d80 1 -- 172.21.15.53:0/2346255754 shutdown_connections 2024-09-13T19:15:43.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.653+0000 7f31a89d0d80 1 --2- 172.21.15.53:0/2346255754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b0917fc10 0x558b0921a5b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:43.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.653+0000 7f31a89d0d80 1 -- 172.21.15.53:0/2346255754 >> 172.21.15.53:0/2346255754 conn(0x558b09188060 msgr2=0x558b091844a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:43.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.653+0000 7f31a89d0d80 1 -- 172.21.15.53:0/2346255754 shutdown_connections 2024-09-13T19:15:43.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.653+0000 7f31a89d0d80 1 -- 172.21.15.53:0/2346255754 wait complete. 2024-09-13T19:15:43.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.654+0000 7f31a89d0d80 1 Processor -- start 2024-09-13T19:15:43.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.654+0000 7f31a89d0d80 1 -- start start 2024-09-13T19:15:43.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.654+0000 7f31a89d0d80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b0917f120 0x558b09208fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:43.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.654+0000 7f31a89d0d80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558b09001540 con 0x558b0917f120 2024-09-13T19:15:43.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.655+0000 7f31a74c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b0917f120 0x558b09208fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:43.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.655+0000 7f31a74c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b0917f120 0x558b09208fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50688/0 (socket says 172.21.15.53:50688) 2024-09-13T19:15:43.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.655+0000 7f31a74c6640 1 -- 172.21.15.53:0/3476863616 learned_addr learned my addr 172.21.15.53:0/3476863616 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:15:43.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.655+0000 7f31a74c6640 1 -- 172.21.15.53:0/3476863616 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b0920a8b0 con 0x558b0917f120 2024-09-13T19:15:43.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.655+0000 7f31a74c6640 1 --2- 172.21.15.53:0/3476863616 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b0917f120 0x558b09208fd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3198001e50 tx=0x7f3198009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:43.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.655+0000 7f31977fe640 1 -- 172.21.15.53:0/3476863616 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3198008070 con 0x558b0917f120 2024-09-13T19:15:43.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.655+0000 7f31977fe640 1 -- 172.21.15.53:0/3476863616 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f319800f430 con 0x558b0917f120 2024-09-13T19:15:43.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.655+0000 7f31a89d0d80 1 -- 172.21.15.53:0/3476863616 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558b0920c590 con 0x558b0917f120 2024-09-13T19:15:43.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.655+0000 7f31977fe640 1 -- 172.21.15.53:0/3476863616 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f319800f770 con 0x558b0917f120 2024-09-13T19:15:43.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.655+0000 7f31a89d0d80 1 -- 172.21.15.53:0/3476863616 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b0920b9e0 con 0x558b0917f120 2024-09-13T19:15:43.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.656+0000 7f31977fe640 1 -- 172.21.15.53:0/3476863616 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f319800fa20 con 0x558b0917f120 2024-09-13T19:15:43.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.656+0000 7f31977fe640 1 --2- 172.21.15.53:0/3476863616 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f318c036b40 0x7f318c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:43.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.656+0000 7f31977fe640 1 -- 172.21.15.53:0/3476863616 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3471+0+0 (secure 0 0 0) 0x7f3198049f00 con 0x558b0917f120 2024-09-13T19:15:43.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.657+0000 7f31a89d0d80 1 -- 172.21.15.53:0/3476863616 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x558b09209870 con 0x558b0917f120 2024-09-13T19:15:43.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.657+0000 7f31a6cc5640 1 --2- 172.21.15.53:0/3476863616 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f318c036b40 0x7f318c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:43.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:43.657+0000 7f31a6cc5640 1 --2- 172.21.15.53:0/3476863616 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f318c036b40 0x7f318c039000 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f319c057000 tx=0x7f319c052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:44.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:44.568+0000 7f31977fe640 1 -- 172.21.15.53:0/3476863616 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v16) ==== 141+0+0 (secure 0 0 0) 0x7f319800fd10 con 0x558b0917f120 2024-09-13T19:15:44.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:44.568+0000 7f31a89d0d80 1 -- 172.21.15.53:0/3476863616 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f319c058070 con 0x558b0917f120 2024-09-13T19:15:44.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:44.571+0000 7f31977fe640 1 -- 172.21.15.53:0/3476863616 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f31980193d0 con 0x558b0917f120 2024-09-13T19:15:44.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:44.571+0000 7f31a5cc3640 1 -- 172.21.15.53:0/3476863616 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=16}) -- 0x7f3184002ae0 con 0x558b0917f120 2024-09-13T19:15:44.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:44.573+0000 7f31977fe640 1 -- 172.21.15.53:0/3476863616 <== mon.0 v2:172.21.15.53:3300/0 8 ==== osd_map(16..16 src has 1..16) ==== 650+0+0 (secure 0 0 0) 0x7f3198017a70 con 0x558b0917f120 2024-09-13T19:15:44.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:44.573+0000 7f31a89d0d80 1 --2- 172.21.15.53:0/3476863616 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x558b0917fc10 0x558b09225600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:44.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:44.573+0000 7f31a89d0d80 1 -- 172.21.15.53:0/3476863616 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16) -- 0x558b09229e50 con 0x558b0917fc10 2024-09-13T19:15:44.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:44.573+0000 7f31a8728640 1 --2- 172.21.15.53:0/3476863616 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x558b0917fc10 0x558b09225600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:44.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:44.574+0000 7f31a8728640 1 --2- 172.21.15.53:0/3476863616 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x558b0917fc10 0x558b09225600 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:44.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:44.578+0000 7f31a8728640 1 -- 172.21.15.53:0/3476863616 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(1 rbd_trash [create] v16'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7f31a0002040 con 0x558b0917fc10 2024-09-13T19:15:44.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:44.581+0000 7f31a89d0d80 1 -- 172.21.15.53:0/3476863616 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e16) -- 0x558b0927b930 con 0x558b0917fc10 2024-09-13T19:15:44.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:44.581+0000 7f31a8728640 1 -- 172.21.15.53:0/3476863616 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f31a0002040 con 0x558b0917fc10 2024-09-13T19:15:44.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:44.581+0000 7f31a89d0d80 1 -- 172.21.15.53:0/3476863616 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e16) -- 0x558b0927aa40 con 0x558b0917fc10 2024-09-13T19:15:44.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:44.581+0000 7f31a8728640 1 -- 172.21.15.53:0/3476863616 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f31a0002040 con 0x558b0917fc10 2024-09-13T19:15:44.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:44.581+0000 7f31a54c2640 1 -- 172.21.15.53:0/3476863616 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7f3188001f00 con 0x558b0917f120 2024-09-13T19:15:45.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:45.575+0000 7f31977fe640 1 -- 172.21.15.53:0/3476863616 <== mon.0 v2:172.21.15.53:3300/0 9 ==== pool_op_reply(tid 4 (0) Success v17) ==== 55+0+0 (secure 0 0 0) 0x7f3198017c70 con 0x558b0917f120 2024-09-13T19:15:45.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:45.575+0000 7f31977fe640 1 -- 172.21.15.53:0/3476863616 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=17}) -- 0x7f318c03c6f0 con 0x558b0917f120 2024-09-13T19:15:45.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:45.575+0000 7f31977fe640 1 -- 172.21.15.53:0/3476863616 <== mon.0 v2:172.21.15.53:3300/0 10 ==== osd_map(17..17 src has 1..17) ==== 626+0+0 (secure 0 0 0) 0x7f31980177c0 con 0x558b0917f120 2024-09-13T19:15:45.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:45.575+0000 7f31a5cc3640 1 -- 172.21.15.53:0/3476863616 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17) -- 0x7f31840056e0 con 0x558b0917fc10 2024-09-13T19:15:45.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:45.579+0000 7f31a8728640 1 -- 172.21.15.53:0/3476863616 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(5 rbd_info [create,write 0~8] v17'1 uv1 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f31a0002040 con 0x558b0917fc10 2024-09-13T19:15:45.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:45.579+0000 7f31a54c2640 1 -- 172.21.15.53:0/3476863616 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v17) -- 0x7f3188003350 con 0x558b0917f120 2024-09-13T19:15:46.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.577+0000 7f31977fe640 1 -- 172.21.15.53:0/3476863616 <== mon.0 v2:172.21.15.53:3300/0 11 ==== pool_op_reply(tid 6 (0) Success v18) ==== 43+0+0 (secure 0 0 0) 0x7f319800d930 con 0x558b0917f120 2024-09-13T19:15:46.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.577+0000 7f31977fe640 1 -- 172.21.15.53:0/3476863616 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=18}) -- 0x7f318c03c970 con 0x558b0917f120 2024-09-13T19:15:46.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.577+0000 7f31977fe640 1 -- 172.21.15.53:0/3476863616 <== mon.0 v2:172.21.15.53:3300/0 12 ==== osd_map(18..18 src has 1..18) ==== 654+0+0 (secure 0 0 0) 0x7f319801a470 con 0x558b0917f120 2024-09-13T19:15:46.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.577+0000 7f31a5cc3640 1 -- 172.21.15.53:0/3476863616 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18) -- 0x7f3184005aa0 con 0x558b0917fc10 2024-09-13T19:15:46.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.586+0000 7f31a8728640 1 -- 172.21.15.53:0/3476863616 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(7 rbd_info [write 0~19] v18'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31a0002040 con 0x558b0917fc10 2024-09-13T19:15:46.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.587+0000 7f31a89d0d80 1 -- 172.21.15.53:0/3476863616 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x558b0917fc10 msgr2=0x558b09225600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:46.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.587+0000 7f31a89d0d80 1 --2- 172.21.15.53:0/3476863616 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x558b0917fc10 0x558b09225600 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:46.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.587+0000 7f31a89d0d80 1 -- 172.21.15.53:0/3476863616 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f318c036b40 msgr2=0x7f318c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:46.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.587+0000 7f31a89d0d80 1 --2- 172.21.15.53:0/3476863616 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f318c036b40 0x7f318c039000 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f319c057000 tx=0x7f319c052000 comp rx=0 tx=0).stop 2024-09-13T19:15:46.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.587+0000 7f31a89d0d80 1 -- 172.21.15.53:0/3476863616 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b0917f120 msgr2=0x558b09208fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:46.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.587+0000 7f31a89d0d80 1 --2- 172.21.15.53:0/3476863616 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b0917f120 0x558b09208fd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3198001e50 tx=0x7f3198009560 comp rx=0 tx=0).stop 2024-09-13T19:15:46.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.587+0000 7f31a89d0d80 1 -- 172.21.15.53:0/3476863616 shutdown_connections 2024-09-13T19:15:46.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.587+0000 7f31a89d0d80 1 --2- 172.21.15.53:0/3476863616 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x558b0917fc10 0x558b09225600 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:46.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.587+0000 7f31a89d0d80 1 --2- 172.21.15.53:0/3476863616 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f318c036b40 0x7f318c039000 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:46.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.587+0000 7f31a89d0d80 1 --2- 172.21.15.53:0/3476863616 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b0917f120 0x558b09208fd0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:46.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.587+0000 7f31a89d0d80 1 -- 172.21.15.53:0/3476863616 >> 172.21.15.53:0/3476863616 conn(0x558b09188060 msgr2=0x558b09202a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:46.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.587+0000 7f31a89d0d80 1 -- 172.21.15.53:0/3476863616 shutdown_connections 2024-09-13T19:15:46.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.587+0000 7f31a89d0d80 1 -- 172.21.15.53:0/3476863616 wait complete. 2024-09-13T19:15:46.594 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-13T19:15:46.594 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-13T19:15:46.595 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-13T19:15:46.595 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-13T19:15:46.595 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-13T19:15:46.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.703+0000 7f26e6cd0640 1 Processor -- start 2024-09-13T19:15:46.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.703+0000 7f26e6cd0640 1 -- start start 2024-09-13T19:15:46.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.704+0000 7f26e6cd0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f26e012e940 0x7f26e0130d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:46.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.704+0000 7f26e6cd0640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26e006eba0 con 0x7f26e006eda0 2024-09-13T19:15:46.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.704+0000 7f26e6cd0640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f26e006d2f0 con 0x7f26e012e940 2024-09-13T19:15:46.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.704+0000 7f26dffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f26e012e940 0x7f26e0130d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:46.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.704+0000 7f26e4a6c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f26e006eda0 0x7f26e006f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33942/0 (socket says 172.21.15.53:33942) 2024-09-13T19:15:46.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.704+0000 7f26e4a6c640 1 -- 172.21.15.53:0/1375428590 learned_addr learned my addr 172.21.15.53:0/1375428590 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T19:15:46.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.704+0000 7f26dffff640 1 -- 172.21.15.53:0/1375428590 >> v1:172.21.15.53:6789/0 conn(0x7f26e006eda0 legacy=0x7f26e006f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:46.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.704+0000 7f26dffff640 1 -- 172.21.15.53:0/1375428590 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26e0070d50 con 0x7f26e012e940 2024-09-13T19:15:46.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.705+0000 7f26dffff640 1 --2- 172.21.15.53:0/1375428590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f26e012e940 0x7f26e0130d30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f26d4009720 tx=0x7f26d402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5531e5652908439 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:46.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.705+0000 7f26df7fe640 1 -- 172.21.15.53:0/1375428590 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26d4037070 con 0x7f26e012e940 2024-09-13T19:15:46.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.705+0000 7f26df7fe640 1 -- 172.21.15.53:0/1375428590 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26d402ae20 con 0x7f26e012e940 2024-09-13T19:15:46.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.705+0000 7f26df7fe640 1 -- 172.21.15.53:0/1375428590 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26d4032590 con 0x7f26e012e940 2024-09-13T19:15:46.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.706+0000 7f26e6cd0640 1 -- 172.21.15.53:0/1375428590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f26e012e940 msgr2=0x7f26e0130d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:46.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.706+0000 7f26e6cd0640 1 --2- 172.21.15.53:0/1375428590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f26e012e940 0x7f26e0130d30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f26d4009720 tx=0x7f26d402a1a0 comp rx=0 tx=0).stop 2024-09-13T19:15:46.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.706+0000 7f26e6cd0640 1 -- 172.21.15.53:0/1375428590 shutdown_connections 2024-09-13T19:15:46.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.706+0000 7f26e6cd0640 1 --2- 172.21.15.53:0/1375428590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f26e012e940 0x7f26e0130d30 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:46.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.706+0000 7f26e6cd0640 1 -- 172.21.15.53:0/1375428590 >> 172.21.15.53:0/1375428590 conn(0x7f26e009a890 msgr2=0x7f26e009aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:46.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.706+0000 7f26e6cd0640 1 -- 172.21.15.53:0/1375428590 shutdown_connections 2024-09-13T19:15:46.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.706+0000 7f26e6cd0640 1 -- 172.21.15.53:0/1375428590 wait complete. 2024-09-13T19:15:46.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.707+0000 7f26e6cd0640 1 Processor -- start 2024-09-13T19:15:46.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.707+0000 7f26e6cd0640 1 -- start start 2024-09-13T19:15:46.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.707+0000 7f26e6cd0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f26e006eda0 0x7f26e00969a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:46.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.707+0000 7f26e6cd0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f26e006fcd0 con 0x7f26e006eda0 2024-09-13T19:15:46.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.707+0000 7f26e4a6c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f26e006eda0 0x7f26e00969a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:46.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.707+0000 7f26e4a6c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f26e006eda0 0x7f26e00969a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60604/0 (socket says 172.21.15.53:60604) 2024-09-13T19:15:46.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.707+0000 7f26e4a6c640 1 -- 172.21.15.53:0/2416313486 learned_addr learned my addr 172.21.15.53:0/2416313486 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:15:46.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.708+0000 7f26e4a6c640 1 -- 172.21.15.53:0/2416313486 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26e0125740 con 0x7f26e006eda0 2024-09-13T19:15:46.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.708+0000 7f26e4a6c640 1 --2- 172.21.15.53:0/2416313486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f26e006eda0 0x7f26e00969a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f26d000c4a0 tx=0x7f26d000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:46.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.708+0000 7f26dd7fa640 1 -- 172.21.15.53:0/2416313486 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26d0017070 con 0x7f26e006eda0 2024-09-13T19:15:46.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.708+0000 7f26dd7fa640 1 -- 172.21.15.53:0/2416313486 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26d0005c10 con 0x7f26e006eda0 2024-09-13T19:15:46.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.708+0000 7f26e6cd0640 1 -- 172.21.15.53:0/2416313486 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26e006dbb0 con 0x7f26e006eda0 2024-09-13T19:15:46.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.708+0000 7f26dd7fa640 1 -- 172.21.15.53:0/2416313486 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26d0007070 con 0x7f26e006eda0 2024-09-13T19:15:46.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.708+0000 7f26e6cd0640 1 -- 172.21.15.53:0/2416313486 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26e01250c0 con 0x7f26e006eda0 2024-09-13T19:15:46.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.709+0000 7f26dd7fa640 1 -- 172.21.15.53:0/2416313486 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f26d001a070 con 0x7f26e006eda0 2024-09-13T19:15:46.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.709+0000 7f26dd7fa640 1 --2- 172.21.15.53:0/2416313486 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f26cc0382a0 0x7f26cc03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:46.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.709+0000 7f26dd7fa640 1 -- 172.21.15.53:0/2416313486 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f26d004a540 con 0x7f26e006eda0 2024-09-13T19:15:46.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.709+0000 7f26e6cd0640 1 -- 172.21.15.53:0/2416313486 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26e0125910 con 0x7f26e006eda0 2024-09-13T19:15:46.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.709+0000 7f26dffff640 1 --2- 172.21.15.53:0/2416313486 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f26cc0382a0 0x7f26cc03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:46.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.710+0000 7f26dffff640 1 --2- 172.21.15.53:0/2416313486 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f26cc0382a0 0x7f26cc03a760 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f26d4034000 tx=0x7f26d402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:46.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.714+0000 7f26dd7fa640 1 -- 172.21.15.53:0/2416313486 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f26d0007210 con 0x7f26e006eda0 2024-09-13T19:15:46.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.937+0000 7f26e6cd0640 1 -- 172.21.15.53:0/2416313486 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f26e006f180 con 0x7f26e006eda0 2024-09-13T19:15:46.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.939+0000 7f26dd7fa640 1 -- 172.21.15.53:0/2416313486 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+87489 (secure 0 0 0) 0x7f26d0012400 con 0x7f26e006eda0 2024-09-13T19:15:46.943 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:15:46.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.941+0000 7f26e6cd0640 1 -- 172.21.15.53:0/2416313486 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f26cc0382a0 msgr2=0x7f26cc03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:46.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.941+0000 7f26e6cd0640 1 --2- 172.21.15.53:0/2416313486 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f26cc0382a0 0x7f26cc03a760 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f26d4034000 tx=0x7f26d402e000 comp rx=0 tx=0).stop 2024-09-13T19:15:46.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.941+0000 7f26e6cd0640 1 -- 172.21.15.53:0/2416313486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f26e006eda0 msgr2=0x7f26e00969a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:46.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.941+0000 7f26e6cd0640 1 --2- 172.21.15.53:0/2416313486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f26e006eda0 0x7f26e00969a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f26d000c4a0 tx=0x7f26d000c960 comp rx=0 tx=0).stop 2024-09-13T19:15:46.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.941+0000 7f26e6cd0640 1 -- 172.21.15.53:0/2416313486 shutdown_connections 2024-09-13T19:15:46.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.941+0000 7f26e6cd0640 1 --2- 172.21.15.53:0/2416313486 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f26cc0382a0 0x7f26cc03a760 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:46.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.941+0000 7f26e6cd0640 1 --2- 172.21.15.53:0/2416313486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f26e006eda0 0x7f26e00969a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:46.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.941+0000 7f26e6cd0640 1 -- 172.21.15.53:0/2416313486 >> 172.21.15.53:0/2416313486 conn(0x7f26e009a890 msgr2=0x7f26e0097390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:46.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.941+0000 7f26e6cd0640 1 -- 172.21.15.53:0/2416313486 shutdown_connections 2024-09-13T19:15:46.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:46.941+0000 7f26e6cd0640 1 -- 172.21.15.53:0/2416313486 wait complete. 2024-09-13T19:15:46.955 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":5,"flags":0,"active_gid":4098,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4283826432},{"type":"v1","addr":"172.21.15.102:6825","nonce":4283826432}]},"active_addr":"172.21.15.102:6825/4283826432","active_change":"2024-09-13T19:15:30.901149+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.102:0","nonce":2473156689}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.102:0","nonce":1368158968}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.102:0","nonce":186841138}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.102:0","nonce":1470243191}]}]} 2024-09-13T19:15:46.957 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-13T19:15:46.957 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-13T19:15:46.957 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T19:15:47.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.056+0000 7f71b59a6640 1 Processor -- start 2024-09-13T19:15:47.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.056+0000 7f71b59a6640 1 -- start start 2024-09-13T19:15:47.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.056+0000 7f71b59a6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f71b012f9d0 0x7f71b0131dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:47.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.056+0000 7f71b59a6640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71b0071f70 con 0x7f71b012cca0 2024-09-13T19:15:47.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.056+0000 7f71b59a6640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f71b006e350 con 0x7f71b012f9d0 2024-09-13T19:15:47.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.056+0000 7f71ae7fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f71b012f9d0 0x7f71b0131dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:47.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.056+0000 7f71aeffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f71b012cca0 0x7f71b012d080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33958/0 (socket says 172.21.15.53:33958) 2024-09-13T19:15:47.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.056+0000 7f71aeffd640 1 -- 172.21.15.53:0/4073426041 learned_addr learned my addr 172.21.15.53:0/4073426041 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T19:15:47.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.057+0000 7f71ae7fc640 1 -- 172.21.15.53:0/4073426041 >> v1:172.21.15.53:6789/0 conn(0x7f71b012cca0 legacy=0x7f71b012d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:47.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.057+0000 7f71ae7fc640 1 -- 172.21.15.53:0/4073426041 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71b00715c0 con 0x7f71b012f9d0 2024-09-13T19:15:47.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.057+0000 7f71ae7fc640 1 --2- 172.21.15.53:0/4073426041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71b012f9d0 0x7f71b0131dc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f71a4009720 tx=0x7f71a402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a8c52c53aecc38a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:47.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.057+0000 7f71adffb640 1 -- 172.21.15.53:0/4073426041 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71a4037070 con 0x7f71b012f9d0 2024-09-13T19:15:47.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.057+0000 7f71adffb640 1 -- 172.21.15.53:0/4073426041 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71a402ad90 con 0x7f71b012f9d0 2024-09-13T19:15:47.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.057+0000 7f71adffb640 1 -- 172.21.15.53:0/4073426041 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71a4032590 con 0x7f71b012f9d0 2024-09-13T19:15:47.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.058+0000 7f71b59a6640 1 -- 172.21.15.53:0/4073426041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71b012f9d0 msgr2=0x7f71b0131dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:47.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.058+0000 7f71b59a6640 1 --2- 172.21.15.53:0/4073426041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71b012f9d0 0x7f71b0131dc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f71a4009720 tx=0x7f71a402a110 comp rx=0 tx=0).stop 2024-09-13T19:15:47.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.058+0000 7f71b59a6640 1 -- 172.21.15.53:0/4073426041 shutdown_connections 2024-09-13T19:15:47.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.058+0000 7f71b59a6640 1 --2- 172.21.15.53:0/4073426041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71b012f9d0 0x7f71b0131dc0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:47.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.058+0000 7f71b59a6640 1 -- 172.21.15.53:0/4073426041 >> 172.21.15.53:0/4073426041 conn(0x7f71b009a890 msgr2=0x7f71b009aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:47.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.058+0000 7f71b59a6640 1 -- 172.21.15.53:0/4073426041 shutdown_connections 2024-09-13T19:15:47.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.058+0000 7f71b59a6640 1 -- 172.21.15.53:0/4073426041 wait complete. 2024-09-13T19:15:47.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.059+0000 7f71b59a6640 1 Processor -- start 2024-09-13T19:15:47.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.059+0000 7f71b59a6640 1 -- start start 2024-09-13T19:15:47.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.059+0000 7f71b59a6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71b012cca0 0x7f71b01258b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:47.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.059+0000 7f71b59a6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f71b012ca50 con 0x7f71b012cca0 2024-09-13T19:15:47.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.059+0000 7f71aeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71b012cca0 0x7f71b01258b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:47.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.060+0000 7f71aeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71b012cca0 0x7f71b01258b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60612/0 (socket says 172.21.15.53:60612) 2024-09-13T19:15:47.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.060+0000 7f71aeffd640 1 -- 172.21.15.53:0/268483436 learned_addr learned my addr 172.21.15.53:0/268483436 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:15:47.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.060+0000 7f71aeffd640 1 -- 172.21.15.53:0/268483436 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71b0123af0 con 0x7f71b012cca0 2024-09-13T19:15:47.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.060+0000 7f71aeffd640 1 --2- 172.21.15.53:0/268483436 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71b012cca0 0x7f71b01258b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f71a000c480 tx=0x7f71a000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:47.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.060+0000 7f7197fff640 1 -- 172.21.15.53:0/268483436 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71a0017070 con 0x7f71b012cca0 2024-09-13T19:15:47.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.060+0000 7f7197fff640 1 -- 172.21.15.53:0/268483436 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71a0005c10 con 0x7f71b012cca0 2024-09-13T19:15:47.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.060+0000 7f71b59a6640 1 -- 172.21.15.53:0/268483436 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71b0126db0 con 0x7f71b012cca0 2024-09-13T19:15:47.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.060+0000 7f7197fff640 1 -- 172.21.15.53:0/268483436 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71a00070d0 con 0x7f71b012cca0 2024-09-13T19:15:47.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.060+0000 7f71b59a6640 1 -- 172.21.15.53:0/268483436 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71b0125df0 con 0x7f71b012cca0 2024-09-13T19:15:47.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.061+0000 7f7197fff640 1 -- 172.21.15.53:0/268483436 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f71a001a070 con 0x7f71b012cca0 2024-09-13T19:15:47.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.061+0000 7f71b59a6640 1 -- 172.21.15.53:0/268483436 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71b0073120 con 0x7f71b012cca0 2024-09-13T19:15:47.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.061+0000 7f7197fff640 1 --2- 172.21.15.53:0/268483436 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f719c0382a0 0x7f719c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:47.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.061+0000 7f7197fff640 1 -- 172.21.15.53:0/268483436 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f71a004a580 con 0x7f71b012cca0 2024-09-13T19:15:47.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.062+0000 7f71ae7fc640 1 --2- 172.21.15.53:0/268483436 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f719c0382a0 0x7f719c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:47.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.062+0000 7f71ae7fc640 1 --2- 172.21.15.53:0/268483436 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f719c0382a0 0x7f719c03a760 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f71a4009720 tx=0x7f71a402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:47.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.066+0000 7f7197fff640 1 -- 172.21.15.53:0/268483436 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f71b0073120 con 0x7f71b012cca0 2024-09-13T19:15:47.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.240+0000 7f71b59a6640 1 -- 172.21.15.53:0/268483436 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f71b012d080 con 0x7f71b012cca0 2024-09-13T19:15:47.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.241+0000 7f7197fff640 1 -- 172.21.15.53:0/268483436 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+9914 (secure 0 0 0) 0x7f71a001a520 con 0x7f71b012cca0 2024-09-13T19:15:47.244 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:15:47.244 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":18,"fsid":"69e598bd-9014-4d1e-9444-0be214085a05","created":"2024-09-13T19:15:26.858539+0000","modified":"2024-09-13T19:15:46.574682+0000","last_up_change":"2024-09-13T19:15:38.556807+0000","last_in_change":"2024-09-13T19:15:27.961132+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T19:15:38.950231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T19:15:42.720446+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d078da3c-b2bc-4d4e-940d-e3a343202a5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":4021716951},{"type":"v1","addr":"172.21.15.53:6801","nonce":4021716951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":4021716951},{"type":"v1","addr":"172.21.15.53:6803","nonce":4021716951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":4021716951},{"type":"v1","addr":"172.21.15.53:6807","nonce":4021716951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":4021716951},{"type":"v1","addr":"172.21.15.53:6805","nonce":4021716951}]},"public_addr":"172.21.15.53:6801/4021716951","cluster_addr":"172.21.15.53:6803/4021716951","heartbeat_back_addr":"172.21.15.53:6807/4021716951","heartbeat_front_addr":"172.21.15.53:6805/4021716951","state":["exists","up"]},{"osd":1,"uuid":"b461168d-7796-4d47-934f-2e5992d5a05e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2204418452},{"type":"v1","addr":"172.21.15.102:6809","nonce":2204418452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":2204418452},{"type":"v1","addr":"172.21.15.102:6811","nonce":2204418452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":2204418452},{"type":"v1","addr":"172.21.15.102:6815","nonce":2204418452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2204418452},{"type":"v1","addr":"172.21.15.102:6813","nonce":2204418452}]},"public_addr":"172.21.15.102:6809/2204418452","cluster_addr":"172.21.15.102:6811/2204418452","heartbeat_back_addr":"172.21.15.102:6815/2204418452","heartbeat_front_addr":"172.21.15.102:6813/2204418452","state":["exists","up"]},{"osd":2,"uuid":"0eb25aef-9bcf-4e31-9896-d9d2c1c6bc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2238176080},{"type":"v1","addr":"172.21.15.102:6817","nonce":2238176080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":2238176080},{"type":"v1","addr":"172.21.15.102:6819","nonce":2238176080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2238176080},{"type":"v1","addr":"172.21.15.102:6823","nonce":2238176080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2238176080},{"type":"v1","addr":"172.21.15.102:6821","nonce":2238176080}]},"public_addr":"172.21.15.102:6817/2238176080","cluster_addr":"172.21.15.102:6819/2238176080","heartbeat_back_addr":"172.21.15.102:6823/2238176080","heartbeat_front_addr":"172.21.15.102:6821/2238176080","state":["exists","up"]},{"osd":3,"uuid":"c84cc8db-3bd3-432e-b84a-58235ad2888e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":3096737090},{"type":"v1","addr":"172.21.15.102:6801","nonce":3096737090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3096737090},{"type":"v1","addr":"172.21.15.102:6803","nonce":3096737090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3096737090},{"type":"v1","addr":"172.21.15.102:6807","nonce":3096737090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3096737090},{"type":"v1","addr":"172.21.15.102:6805","nonce":3096737090}]},"public_addr":"172.21.15.102:6801/3096737090","cluster_addr":"172.21.15.102:6803/3096737090","heartbeat_back_addr":"172.21.15.102:6807/3096737090","heartbeat_front_addr":"172.21.15.102:6805/3096737090","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T19:15:34.603524+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T19:15:35.432574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T19:15:35.230750+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T19:15:35.026997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T19:15:47.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.243+0000 7f71b59a6640 1 -- 172.21.15.53:0/268483436 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f719c0382a0 msgr2=0x7f719c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:47.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.243+0000 7f71b59a6640 1 --2- 172.21.15.53:0/268483436 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f719c0382a0 0x7f719c03a760 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f71a4009720 tx=0x7f71a402e000 comp rx=0 tx=0).stop 2024-09-13T19:15:47.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.243+0000 7f71b59a6640 1 -- 172.21.15.53:0/268483436 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71b012cca0 msgr2=0x7f71b01258b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:47.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.243+0000 7f71b59a6640 1 --2- 172.21.15.53:0/268483436 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71b012cca0 0x7f71b01258b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f71a000c480 tx=0x7f71a000c940 comp rx=0 tx=0).stop 2024-09-13T19:15:47.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.243+0000 7f71b59a6640 1 -- 172.21.15.53:0/268483436 shutdown_connections 2024-09-13T19:15:47.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.244+0000 7f71b59a6640 1 --2- 172.21.15.53:0/268483436 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f719c0382a0 0x7f719c03a760 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:47.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.244+0000 7f71b59a6640 1 --2- 172.21.15.53:0/268483436 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71b012cca0 0x7f71b01258b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:47.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.244+0000 7f71b59a6640 1 -- 172.21.15.53:0/268483436 >> 172.21.15.53:0/268483436 conn(0x7f71b009a890 msgr2=0x7f71b0097ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:47.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.244+0000 7f71b59a6640 1 -- 172.21.15.53:0/268483436 shutdown_connections 2024-09-13T19:15:47.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.244+0000 7f71b59a6640 1 -- 172.21.15.53:0/268483436 wait complete. 2024-09-13T19:15:47.258 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-13T19:15:47.258 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T19:15:47.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.356+0000 7effe5966640 1 Processor -- start 2024-09-13T19:15:47.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.356+0000 7effe5966640 1 -- start start 2024-09-13T19:15:47.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.356+0000 7effe5966640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7effe006e080 0x7effe006e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:47.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.356+0000 7effe5966640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effe006c740 con 0x7effe006e9a0 2024-09-13T19:15:47.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.356+0000 7effe5966640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7effe006fca0 con 0x7effe006e080 2024-09-13T19:15:47.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.356+0000 7effdeffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7effe006e080 0x7effe006e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:47.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.356+0000 7effde7fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7effe006e9a0 0x7effe0132d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33968/0 (socket says 172.21.15.53:33968) 2024-09-13T19:15:47.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.356+0000 7effde7fc640 1 -- 172.21.15.53:0/1845613344 learned_addr learned my addr 172.21.15.53:0/1845613344 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T19:15:47.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.356+0000 7effdeffd640 1 -- 172.21.15.53:0/1845613344 >> v1:172.21.15.53:6789/0 conn(0x7effe006e9a0 legacy=0x7effe0132d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:47.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.357+0000 7effdeffd640 1 -- 172.21.15.53:0/1845613344 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effe006bd80 con 0x7effe006e080 2024-09-13T19:15:47.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.357+0000 7effdeffd640 1 --2- 172.21.15.53:0/1845613344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effe006e080 0x7effe006e460 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7effd0009720 tx=0x7effd002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34ff43f971930c48 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:47.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.357+0000 7effddffb640 1 -- 172.21.15.53:0/1845613344 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effd0037070 con 0x7effe006e080 2024-09-13T19:15:47.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.357+0000 7effddffb640 1 -- 172.21.15.53:0/1845613344 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effd002ad90 con 0x7effe006e080 2024-09-13T19:15:47.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.357+0000 7effddffb640 1 -- 172.21.15.53:0/1845613344 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effd0032590 con 0x7effe006e080 2024-09-13T19:15:47.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.358+0000 7effe5966640 1 -- 172.21.15.53:0/1845613344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effe006e080 msgr2=0x7effe006e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:47.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.358+0000 7effe5966640 1 --2- 172.21.15.53:0/1845613344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effe006e080 0x7effe006e460 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7effd0009720 tx=0x7effd002a110 comp rx=0 tx=0).stop 2024-09-13T19:15:47.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.358+0000 7effe5966640 1 -- 172.21.15.53:0/1845613344 shutdown_connections 2024-09-13T19:15:47.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.358+0000 7effe5966640 1 --2- 172.21.15.53:0/1845613344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effe006e080 0x7effe006e460 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:47.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.358+0000 7effe5966640 1 -- 172.21.15.53:0/1845613344 >> 172.21.15.53:0/1845613344 conn(0x7effe009dd40 msgr2=0x7effe009e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:47.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.358+0000 7effe5966640 1 -- 172.21.15.53:0/1845613344 shutdown_connections 2024-09-13T19:15:47.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.358+0000 7effe5966640 1 -- 172.21.15.53:0/1845613344 wait complete. 2024-09-13T19:15:47.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.359+0000 7effe5966640 1 Processor -- start 2024-09-13T19:15:47.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.359+0000 7effe5966640 1 -- start start 2024-09-13T19:15:47.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.359+0000 7effe5966640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effe006e080 0x7effe01a7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:47.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.359+0000 7effe5966640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7effe006f130 con 0x7effe006e080 2024-09-13T19:15:47.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.360+0000 7effdeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effe006e080 0x7effe01a7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:47.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.360+0000 7effdeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effe006e080 0x7effe01a7de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60630/0 (socket says 172.21.15.53:60630) 2024-09-13T19:15:47.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.360+0000 7effdeffd640 1 -- 172.21.15.53:0/4095124112 learned_addr learned my addr 172.21.15.53:0/4095124112 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:15:47.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.360+0000 7effdeffd640 1 -- 172.21.15.53:0/4095124112 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effe01ab0a0 con 0x7effe006e080 2024-09-13T19:15:47.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.360+0000 7effdeffd640 1 --2- 172.21.15.53:0/4095124112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effe006e080 0x7effe01a7de0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7effd0009840 tx=0x7effd00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:47.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.360+0000 7effc7fff640 1 -- 172.21.15.53:0/4095124112 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effd0041020 con 0x7effe006e080 2024-09-13T19:15:47.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.360+0000 7effc7fff640 1 -- 172.21.15.53:0/4095124112 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effd003d550 con 0x7effe006e080 2024-09-13T19:15:47.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.360+0000 7effc7fff640 1 -- 172.21.15.53:0/4095124112 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effd0037040 con 0x7effe006e080 2024-09-13T19:15:47.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.360+0000 7effe5966640 1 -- 172.21.15.53:0/4095124112 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effe0097450 con 0x7effe006e080 2024-09-13T19:15:47.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.360+0000 7effe5966640 1 -- 172.21.15.53:0/4095124112 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effe01ab340 con 0x7effe006e080 2024-09-13T19:15:47.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.361+0000 7effc7fff640 1 -- 172.21.15.53:0/4095124112 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7effd0044020 con 0x7effe006e080 2024-09-13T19:15:47.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.361+0000 7effe5966640 1 -- 172.21.15.53:0/4095124112 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effe006e460 con 0x7effe006e080 2024-09-13T19:15:47.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.361+0000 7effc7fff640 1 --2- 172.21.15.53:0/4095124112 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7effcc0382a0 0x7effcc03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:47.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.361+0000 7effc7fff640 1 -- 172.21.15.53:0/4095124112 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7effd006b920 con 0x7effe006e080 2024-09-13T19:15:47.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.362+0000 7effde7fc640 1 --2- 172.21.15.53:0/4095124112 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7effcc0382a0 0x7effcc03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:47.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.362+0000 7effde7fc640 1 --2- 172.21.15.53:0/4095124112 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7effcc0382a0 0x7effcc03a760 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7effd4007fd0 tx=0x7effd4007ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:47.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.366+0000 7effc7fff640 1 -- 172.21.15.53:0/4095124112 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7effd004b030 con 0x7effe006e080 2024-09-13T19:15:47.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.543+0000 7effe5966640 1 -- 172.21.15.53:0/4095124112 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7effe01aa6f0 con 0x7effe006e080 2024-09-13T19:15:47.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.543+0000 7effc7fff640 1 -- 172.21.15.53:0/4095124112 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+9914 (secure 0 0 0) 0x7effe01ab0a0 con 0x7effe006e080 2024-09-13T19:15:47.547 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:15:47.547 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":18,"fsid":"69e598bd-9014-4d1e-9444-0be214085a05","created":"2024-09-13T19:15:26.858539+0000","modified":"2024-09-13T19:15:46.574682+0000","last_up_change":"2024-09-13T19:15:38.556807+0000","last_in_change":"2024-09-13T19:15:27.961132+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T19:15:38.950231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T19:15:42.720446+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d078da3c-b2bc-4d4e-940d-e3a343202a5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":4021716951},{"type":"v1","addr":"172.21.15.53:6801","nonce":4021716951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":4021716951},{"type":"v1","addr":"172.21.15.53:6803","nonce":4021716951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":4021716951},{"type":"v1","addr":"172.21.15.53:6807","nonce":4021716951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":4021716951},{"type":"v1","addr":"172.21.15.53:6805","nonce":4021716951}]},"public_addr":"172.21.15.53:6801/4021716951","cluster_addr":"172.21.15.53:6803/4021716951","heartbeat_back_addr":"172.21.15.53:6807/4021716951","heartbeat_front_addr":"172.21.15.53:6805/4021716951","state":["exists","up"]},{"osd":1,"uuid":"b461168d-7796-4d47-934f-2e5992d5a05e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2204418452},{"type":"v1","addr":"172.21.15.102:6809","nonce":2204418452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":2204418452},{"type":"v1","addr":"172.21.15.102:6811","nonce":2204418452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":2204418452},{"type":"v1","addr":"172.21.15.102:6815","nonce":2204418452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2204418452},{"type":"v1","addr":"172.21.15.102:6813","nonce":2204418452}]},"public_addr":"172.21.15.102:6809/2204418452","cluster_addr":"172.21.15.102:6811/2204418452","heartbeat_back_addr":"172.21.15.102:6815/2204418452","heartbeat_front_addr":"172.21.15.102:6813/2204418452","state":["exists","up"]},{"osd":2,"uuid":"0eb25aef-9bcf-4e31-9896-d9d2c1c6bc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2238176080},{"type":"v1","addr":"172.21.15.102:6817","nonce":2238176080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":2238176080},{"type":"v1","addr":"172.21.15.102:6819","nonce":2238176080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2238176080},{"type":"v1","addr":"172.21.15.102:6823","nonce":2238176080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2238176080},{"type":"v1","addr":"172.21.15.102:6821","nonce":2238176080}]},"public_addr":"172.21.15.102:6817/2238176080","cluster_addr":"172.21.15.102:6819/2238176080","heartbeat_back_addr":"172.21.15.102:6823/2238176080","heartbeat_front_addr":"172.21.15.102:6821/2238176080","state":["exists","up"]},{"osd":3,"uuid":"c84cc8db-3bd3-432e-b84a-58235ad2888e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":3096737090},{"type":"v1","addr":"172.21.15.102:6801","nonce":3096737090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3096737090},{"type":"v1","addr":"172.21.15.102:6803","nonce":3096737090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3096737090},{"type":"v1","addr":"172.21.15.102:6807","nonce":3096737090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3096737090},{"type":"v1","addr":"172.21.15.102:6805","nonce":3096737090}]},"public_addr":"172.21.15.102:6801/3096737090","cluster_addr":"172.21.15.102:6803/3096737090","heartbeat_back_addr":"172.21.15.102:6807/3096737090","heartbeat_front_addr":"172.21.15.102:6805/3096737090","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T19:15:34.603524+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T19:15:35.432574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T19:15:35.230750+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T19:15:35.026997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T19:15:47.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.546+0000 7effe5966640 1 -- 172.21.15.53:0/4095124112 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7effcc0382a0 msgr2=0x7effcc03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:47.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.546+0000 7effe5966640 1 --2- 172.21.15.53:0/4095124112 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7effcc0382a0 0x7effcc03a760 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7effd4007fd0 tx=0x7effd4007ac0 comp rx=0 tx=0).stop 2024-09-13T19:15:47.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.546+0000 7effe5966640 1 -- 172.21.15.53:0/4095124112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effe006e080 msgr2=0x7effe01a7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:47.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.546+0000 7effe5966640 1 --2- 172.21.15.53:0/4095124112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effe006e080 0x7effe01a7de0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7effd0009840 tx=0x7effd00046c0 comp rx=0 tx=0).stop 2024-09-13T19:15:47.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.546+0000 7effe5966640 1 -- 172.21.15.53:0/4095124112 shutdown_connections 2024-09-13T19:15:47.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.546+0000 7effe5966640 1 --2- 172.21.15.53:0/4095124112 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7effcc0382a0 0x7effcc03a760 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:47.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.546+0000 7effe5966640 1 --2- 172.21.15.53:0/4095124112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effe006e080 0x7effe01a7de0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:47.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.546+0000 7effe5966640 1 -- 172.21.15.53:0/4095124112 >> 172.21.15.53:0/4095124112 conn(0x7effe009dd40 msgr2=0x7effe00993f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:47.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.546+0000 7effe5966640 1 -- 172.21.15.53:0/4095124112 shutdown_connections 2024-09-13T19:15:47.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.546+0000 7effe5966640 1 -- 172.21.15.53:0/4095124112 wait complete. 2024-09-13T19:15:47.560 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-13T19:15:47.561 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-13T19:15:47.561 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-13T19:15:47.562 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-13T19:15:47.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.666+0000 7f8544e8c640 1 Processor -- start 2024-09-13T19:15:47.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.666+0000 7f8544e8c640 1 -- start start 2024-09-13T19:15:47.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.666+0000 7f7c79742640 1 Processor -- start 2024-09-13T19:15:47.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.666+0000 7f7c79742640 1 -- start start 2024-09-13T19:15:47.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.666+0000 7f3ee2cf8640 1 Processor -- start 2024-09-13T19:15:47.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.666+0000 7fa53d1c4640 1 Processor -- start 2024-09-13T19:15:47.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.667+0000 7f3ee2cf8640 1 -- start start 2024-09-13T19:15:47.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.667+0000 7fa53d1c4640 1 -- start start 2024-09-13T19:15:47.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.667+0000 7f7c79742640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7c7409bd50 0x7f7c7409c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:47.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.667+0000 7f7c79742640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c7409d3b0 con 0x7f7c7409c670 2024-09-13T19:15:47.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.667+0000 7f7c79742640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f7c74098230 con 0x7f7c7409bd50 2024-09-13T19:15:47.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.667+0000 7f8544e8c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f854009a100 0x7f8540133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:47.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.667+0000 7fa53d1c4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa53812e850 0x7fa53812ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:47.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.667+0000 7f3ee2cf8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3edc06e5c0 0x7f3edc06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:47.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.667+0000 7fa53d1c4640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa53809aa10 con 0x7fa53812f170 2024-09-13T19:15:47.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.667+0000 7fa53d1c4640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fa538090940 con 0x7fa53812e850 2024-09-13T19:15:47.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.667+0000 7f8544e8c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f854009d3b0 con 0x7f854009bd50 2024-09-13T19:15:47.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.667+0000 7f7c727fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7c7409c670 0x7f7c740990f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33980/0 (socket says 172.21.15.53:33980) 2024-09-13T19:15:47.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.667+0000 7f7c727fc640 1 -- 172.21.15.53:0/3243397468 learned_addr learned my addr 172.21.15.53:0/3243397468 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T19:15:47.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.667+0000 7f8544e8c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f854009c840 con 0x7f854009a100 2024-09-13T19:15:47.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.667+0000 7f853e59c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f854009bd50 0x7f854009c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33994/0 (socket says 172.21.15.53:33994) 2024-09-13T19:15:47.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.667+0000 7f853e59c640 1 -- 172.21.15.53:0/1439755766 learned_addr learned my addr 172.21.15.53:0/1439755766 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T19:15:47.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.667+0000 7f3ee2cf8640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3edc06be10 con 0x7f3edc06eee0 2024-09-13T19:15:47.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.667+0000 7f3ee2cf8640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f3edc09b5a0 con 0x7f3edc06e5c0 2024-09-13T19:15:47.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.667+0000 7f853dd9b640 1 --2- 172.21.15.53:0/1439755766 >> v2:172.21.15.53:3300/0 conn(0x7f854009a100 0x7f8540133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:47.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.667+0000 7fa536d9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa53812e850 0x7fa53812ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:47.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.667+0000 7fa53659c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa53812f170 0x7fa53812a2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:34008/0 (socket says 172.21.15.53:34008) 2024-09-13T19:15:47.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.667+0000 7fa536d9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa53812e850 0x7fa53812ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60660/0 (socket says 172.21.15.53:60660) 2024-09-13T19:15:47.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.667+0000 7fa53659c640 1 -- 172.21.15.53:0/346219117 learned_addr learned my addr 172.21.15.53:0/346219117 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T19:15:47.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.667+0000 7f7c72ffd640 1 --2- 172.21.15.53:0/3243397468 >> v2:172.21.15.53:3300/0 conn(0x7f7c7409bd50 0x7f7c7409c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:47.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.668+0000 7f3edbfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f3edc06eee0 0x7f3edc132d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:34022/0 (socket says 172.21.15.53:34022) 2024-09-13T19:15:47.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.668+0000 7f3edbfff640 1 -- 172.21.15.53:0/2447629921 learned_addr learned my addr 172.21.15.53:0/2447629921 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T19:15:47.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.668+0000 7f3ee0a94640 1 --2- 172.21.15.53:0/2447629921 >> v2:172.21.15.53:3300/0 conn(0x7f3edc06e5c0 0x7f3edc06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:47.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.668+0000 7f853d59a640 1 -- 172.21.15.53:0/1439755766 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 336188820 0 0) 0x7f8530001110 con 0x7f854009bd50 2024-09-13T19:15:47.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.668+0000 7f853d59a640 1 -- 172.21.15.53:0/1439755766 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8528003520 con 0x7f854009bd50 2024-09-13T19:15:47.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.668+0000 7f853dd9b640 1 -- 172.21.15.53:0/1439755766 >> v1:172.21.15.53:6789/0 conn(0x7f854009bd50 legacy=0x7f854009c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:47.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.668+0000 7f853dd9b640 1 -- 172.21.15.53:0/1439755766 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8540098230 con 0x7f854009a100 2024-09-13T19:15:47.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.668+0000 7fa536d9d640 1 -- 172.21.15.53:0/346219117 >> v1:172.21.15.53:6789/0 conn(0x7fa53812f170 legacy=0x7fa53812a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:47.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.668+0000 7fa536d9d640 1 -- 172.21.15.53:0/346219117 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa53809dff0 con 0x7fa53812e850 2024-09-13T19:15:47.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.668+0000 7f7c71ffb640 1 -- 172.21.15.53:0/3243397468 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3528533384 0 0) 0x7f7c68001110 con 0x7f7c7409c670 2024-09-13T19:15:47.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.668+0000 7f7c71ffb640 1 -- 172.21.15.53:0/3243397468 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c5c003520 con 0x7f7c7409c670 2024-09-13T19:15:47.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.668+0000 7f3edb7fe640 1 -- 172.21.15.53:0/2447629921 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 186890774 0 0) 0x7f3edc06be10 con 0x7f3edc06eee0 2024-09-13T19:15:47.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.668+0000 7f3edb7fe640 1 -- 172.21.15.53:0/2447629921 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ecc003520 con 0x7f3edc06eee0 2024-09-13T19:15:47.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.668+0000 7f7c72ffd640 1 -- 172.21.15.53:0/3243397468 >> v1:172.21.15.53:6789/0 conn(0x7f7c7409c670 legacy=0x7f7c740990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:47.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.668+0000 7f7c72ffd640 1 -- 172.21.15.53:0/3243397468 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c740983e0 con 0x7f7c7409bd50 2024-09-13T19:15:47.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.668+0000 7f3ee0a94640 1 -- 172.21.15.53:0/2447629921 >> v1:172.21.15.53:6789/0 conn(0x7f3edc06eee0 legacy=0x7f3edc132d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:47.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.668+0000 7f3ee0a94640 1 -- 172.21.15.53:0/2447629921 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3edc06c400 con 0x7f3edc06e5c0 2024-09-13T19:15:47.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.669+0000 7f7c72ffd640 1 --2- 172.21.15.53:0/3243397468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c7409bd50 0x7f7c7409c130 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7c64009720 tx=0x7f7c6402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6752f60d51e578fc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:47.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.669+0000 7f853dd9b640 1 --2- 172.21.15.53:0/1439755766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f854009a100 0x7f8540133da0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8534009720 tx=0x7f853402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdcf1af0d8a9ec8d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:47.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.669+0000 7fa536d9d640 1 --2- 172.21.15.53:0/346219117 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa53812e850 0x7fa53812ec30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa528009720 tx=0x7fa52802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b1eb735eea3f1db server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:47.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.669+0000 7f3ee0a94640 1 --2- 172.21.15.53:0/2447629921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3edc06e5c0 0x7f3edc06e9a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0009720 tx=0x7f3ed002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=913ece8c1fdbb8ff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:47.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.669+0000 7f853d59a640 1 -- 172.21.15.53:0/1439755766 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8534037070 con 0x7f854009a100 2024-09-13T19:15:47.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.669+0000 7f853d59a640 1 -- 172.21.15.53:0/1439755766 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f853402ad90 con 0x7f854009a100 2024-09-13T19:15:47.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.669+0000 7f853d59a640 1 -- 172.21.15.53:0/1439755766 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8534032590 con 0x7f854009a100 2024-09-13T19:15:47.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.669+0000 7fa535d9b640 1 -- 172.21.15.53:0/346219117 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa528037070 con 0x7fa53812e850 2024-09-13T19:15:47.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.669+0000 7f3edb7fe640 1 -- 172.21.15.53:0/2447629921 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ed0037070 con 0x7f3edc06e5c0 2024-09-13T19:15:47.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.669+0000 7fa535d9b640 1 -- 172.21.15.53:0/346219117 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa52802ad90 con 0x7fa53812e850 2024-09-13T19:15:47.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.669+0000 7fa535d9b640 1 -- 172.21.15.53:0/346219117 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa528032590 con 0x7fa53812e850 2024-09-13T19:15:47.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.669+0000 7f3edb7fe640 1 -- 172.21.15.53:0/2447629921 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ed002ae20 con 0x7f3edc06e5c0 2024-09-13T19:15:47.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.669+0000 7f3edb7fe640 1 -- 172.21.15.53:0/2447629921 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ed0032570 con 0x7f3edc06e5c0 2024-09-13T19:15:47.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.670+0000 7f8544e8c640 1 -- 172.21.15.53:0/1439755766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f854009a100 msgr2=0x7f8540133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:47.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.670+0000 7f8544e8c640 1 --2- 172.21.15.53:0/1439755766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f854009a100 0x7f8540133da0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8534009720 tx=0x7f853402a110 comp rx=0 tx=0).stop 2024-09-13T19:15:47.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.670+0000 7fa53d1c4640 1 -- 172.21.15.53:0/346219117 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa53812e850 msgr2=0x7fa53812ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:47.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.670+0000 7fa53d1c4640 1 --2- 172.21.15.53:0/346219117 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa53812e850 0x7fa53812ec30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa528009720 tx=0x7fa52802a110 comp rx=0 tx=0).stop 2024-09-13T19:15:47.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.669+0000 7f7c71ffb640 1 -- 172.21.15.53:0/3243397468 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c64037070 con 0x7f7c7409bd50 2024-09-13T19:15:47.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.669+0000 7f7c71ffb640 1 -- 172.21.15.53:0/3243397468 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c6402ad90 con 0x7f7c7409bd50 2024-09-13T19:15:47.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.670+0000 7f7c79742640 1 -- 172.21.15.53:0/3243397468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c7409bd50 msgr2=0x7f7c7409c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:47.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.670+0000 7f3ee2cf8640 1 -- 172.21.15.53:0/2447629921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3edc06e5c0 msgr2=0x7f3edc06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:47.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.670+0000 7f3ee2cf8640 1 --2- 172.21.15.53:0/2447629921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3edc06e5c0 0x7f3edc06e9a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0009720 tx=0x7f3ed002a1a0 comp rx=0 tx=0).stop 2024-09-13T19:15:47.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.670+0000 7f7c71ffb640 1 -- 172.21.15.53:0/3243397468 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c64037070 con 0x7f7c7409bd50 2024-09-13T19:15:47.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.670+0000 7f7c79742640 1 --2- 172.21.15.53:0/3243397468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c7409bd50 0x7f7c7409c130 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7c64009720 tx=0x7f7c6402a110 comp rx=0 tx=0).stop 2024-09-13T19:15:47.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.670+0000 7fa53d1c4640 1 -- 172.21.15.53:0/346219117 shutdown_connections 2024-09-13T19:15:47.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.670+0000 7fa53d1c4640 1 --2- 172.21.15.53:0/346219117 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa53812e850 0x7fa53812ec30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:47.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.670+0000 7f8544e8c640 1 -- 172.21.15.53:0/1439755766 shutdown_connections 2024-09-13T19:15:47.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.670+0000 7fa53d1c4640 1 -- 172.21.15.53:0/346219117 >> 172.21.15.53:0/346219117 conn(0x7fa53809d7c0 msgr2=0x7fa538099c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:47.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.670+0000 7f3ee2cf8640 1 -- 172.21.15.53:0/2447629921 shutdown_connections 2024-09-13T19:15:47.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.670+0000 7f8544e8c640 1 --2- 172.21.15.53:0/1439755766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f854009a100 0x7f8540133da0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:47.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.670+0000 7f8544e8c640 1 -- 172.21.15.53:0/1439755766 >> 172.21.15.53:0/1439755766 conn(0x7f854006d4a0 msgr2=0x7f854006d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:47.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.670+0000 7f3ee2cf8640 1 --2- 172.21.15.53:0/2447629921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3edc06e5c0 0x7f3edc06e9a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:47.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.670+0000 7f3ee2cf8640 1 -- 172.21.15.53:0/2447629921 >> 172.21.15.53:0/2447629921 conn(0x7f3edc09aa80 msgr2=0x7f3edc09ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:47.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.671+0000 7f7c79742640 1 -- 172.21.15.53:0/3243397468 shutdown_connections 2024-09-13T19:15:47.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.671+0000 7f7c79742640 1 --2- 172.21.15.53:0/3243397468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c7409bd50 0x7f7c7409c130 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:47.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.671+0000 7f7c79742640 1 -- 172.21.15.53:0/3243397468 >> 172.21.15.53:0/3243397468 conn(0x7f7c7406d4a0 msgr2=0x7f7c7406d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:47.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.671+0000 7f8544e8c640 1 -- 172.21.15.53:0/1439755766 shutdown_connections 2024-09-13T19:15:47.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.671+0000 7f8544e8c640 1 -- 172.21.15.53:0/1439755766 wait complete. 2024-09-13T19:15:47.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.671+0000 7f3ee2cf8640 1 -- 172.21.15.53:0/2447629921 shutdown_connections 2024-09-13T19:15:47.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.671+0000 7f7c79742640 1 -- 172.21.15.53:0/3243397468 shutdown_connections 2024-09-13T19:15:47.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.671+0000 7f3ee2cf8640 1 -- 172.21.15.53:0/2447629921 wait complete. 2024-09-13T19:15:47.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.671+0000 7f7c79742640 1 -- 172.21.15.53:0/3243397468 wait complete. 2024-09-13T19:15:47.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.671+0000 7fa53d1c4640 1 -- 172.21.15.53:0/346219117 shutdown_connections 2024-09-13T19:15:47.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.671+0000 7fa53d1c4640 1 -- 172.21.15.53:0/346219117 wait complete. 2024-09-13T19:15:47.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.672+0000 7f8544e8c640 1 Processor -- start 2024-09-13T19:15:47.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.672+0000 7f8544e8c640 1 -- start start 2024-09-13T19:15:47.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.672+0000 7f7c79742640 1 Processor -- start 2024-09-13T19:15:47.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.672+0000 7f3ee2cf8640 1 Processor -- start 2024-09-13T19:15:47.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.672+0000 7f7c79742640 1 -- start start 2024-09-13T19:15:47.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.672+0000 7f3ee2cf8640 1 -- start start 2024-09-13T19:15:47.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.672+0000 7f8544e8c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f854009a100 0x7f8540092f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:47.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.672+0000 7f7c79742640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c7409bd50 0x7f7c741b0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:47.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.672+0000 7f7c79742640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7c74099b90 con 0x7f7c7409bd50 2024-09-13T19:15:47.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.672+0000 7f8544e8c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8540134670 con 0x7f854009a100 2024-09-13T19:15:47.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.672+0000 7f853e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f854009a100 0x7f8540092f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:47.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.672+0000 7f7c72ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c7409bd50 0x7f7c741b0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:47.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.672+0000 7f7c72ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c7409bd50 0x7f7c741b0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60668/0 (socket says 172.21.15.53:60668) 2024-09-13T19:15:47.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.672+0000 7f7c72ffd640 1 -- 172.21.15.53:0/2419384845 learned_addr learned my addr 172.21.15.53:0/2419384845 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:15:47.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.673+0000 7fa53d1c4640 1 Processor -- start 2024-09-13T19:15:47.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.673+0000 7f853e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f854009a100 0x7f8540092f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60678/0 (socket says 172.21.15.53:60678) 2024-09-13T19:15:47.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.673+0000 7f853e59c640 1 -- 172.21.15.53:0/3591795805 learned_addr learned my addr 172.21.15.53:0/3591795805 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:15:47.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.673+0000 7f3ee2cf8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3edc06eee0 0x7f3edc095350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:47.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.673+0000 7f3ee2cf8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f3edc06f2f0 con 0x7f3edc06eee0 2024-09-13T19:15:47.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.673+0000 7fa53d1c4640 1 -- start start 2024-09-13T19:15:47.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.673+0000 7f3ee0a94640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3edc06eee0 0x7f3edc095350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:47.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.673+0000 7f3ee0a94640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3edc06eee0 0x7f3edc095350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60684/0 (socket says 172.21.15.53:60684) 2024-09-13T19:15:47.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.673+0000 7f3ee0a94640 1 -- 172.21.15.53:0/1631551090 learned_addr learned my addr 172.21.15.53:0/1631551090 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:15:47.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.673+0000 7f853e59c640 1 -- 172.21.15.53:0/3591795805 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8540094be0 con 0x7f854009a100 2024-09-13T19:15:47.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.673+0000 7f7c72ffd640 1 -- 172.21.15.53:0/2419384845 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c741b3130 con 0x7f7c7409bd50 2024-09-13T19:15:47.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.673+0000 7f7c72ffd640 1 --2- 172.21.15.53:0/2419384845 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c7409bd50 0x7f7c741b0e10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7c6402a150 tx=0x7f7c640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:47.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.673+0000 7f3ee0a94640 1 -- 172.21.15.53:0/1631551090 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3edc097430 con 0x7f3edc06eee0 2024-09-13T19:15:47.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.673+0000 7f853e59c640 1 --2- 172.21.15.53:0/3591795805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f854009a100 0x7f8540092f40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f853000c6b0 tx=0x7f853000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:47.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.673+0000 7fa53d1c4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa53812e850 0x7fa5380700f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:47.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.673+0000 7fa53d1c4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa53812f5a0 con 0x7fa53812e850 2024-09-13T19:15:47.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.674+0000 7f3ee0a94640 1 --2- 172.21.15.53:0/1631551090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3edc06eee0 0x7f3edc095350 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0009720 tx=0x7f3ed00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:47.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.674+0000 7f7c5b7fe640 1 -- 172.21.15.53:0/2419384845 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c64037050 con 0x7f7c7409bd50 2024-09-13T19:15:47.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.674+0000 7f7c5b7fe640 1 -- 172.21.15.53:0/2419384845 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c64043070 con 0x7f7c7409bd50 2024-09-13T19:15:47.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.674+0000 7f7c5b7fe640 1 -- 172.21.15.53:0/2419384845 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c6403e450 con 0x7f7c7409bd50 2024-09-13T19:15:47.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.674+0000 7f7c79742640 1 -- 172.21.15.53:0/2419384845 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c741b3570 con 0x7f7c7409bd50 2024-09-13T19:15:47.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.674+0000 7f852effd640 1 -- 172.21.15.53:0/3591795805 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8530017070 con 0x7f854009a100 2024-09-13T19:15:47.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.674+0000 7f7c79742640 1 -- 172.21.15.53:0/2419384845 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c740979e0 con 0x7f7c7409bd50 2024-09-13T19:15:47.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.674+0000 7f852effd640 1 -- 172.21.15.53:0/3591795805 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85300058b0 con 0x7f854009a100 2024-09-13T19:15:47.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.674+0000 7fa536d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa53812e850 0x7fa5380700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:47.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.674+0000 7fa536d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa53812e850 0x7fa5380700f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60696/0 (socket says 172.21.15.53:60696) 2024-09-13T19:15:47.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.674+0000 7fa536d9d640 1 -- 172.21.15.53:0/2243324282 learned_addr learned my addr 172.21.15.53:0/2243324282 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:15:47.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.674+0000 7f852effd640 1 -- 172.21.15.53:0/3591795805 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8530005bd0 con 0x7f854009a100 2024-09-13T19:15:47.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.674+0000 7f8544e8c640 1 -- 172.21.15.53:0/3591795805 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f854009a760 con 0x7f854009a100 2024-09-13T19:15:47.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.674+0000 7f8544e8c640 1 -- 172.21.15.53:0/3591795805 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8540095a50 con 0x7f854009a100 2024-09-13T19:15:47.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.674+0000 7fa536d9d640 1 -- 172.21.15.53:0/2243324282 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa538072670 con 0x7fa53812e850 2024-09-13T19:15:47.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.674+0000 7f3ed97fa640 1 -- 172.21.15.53:0/1631551090 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ed0042070 con 0x7f3edc06eee0 2024-09-13T19:15:47.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.675+0000 7f3ed97fa640 1 -- 172.21.15.53:0/1631551090 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ed003e670 con 0x7f3edc06eee0 2024-09-13T19:15:47.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.675+0000 7f3ed97fa640 1 -- 172.21.15.53:0/1631551090 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ed0037040 con 0x7f3edc06eee0 2024-09-13T19:15:47.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.675+0000 7f3ee2cf8640 1 -- 172.21.15.53:0/1631551090 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3edc123e90 con 0x7f3edc06eee0 2024-09-13T19:15:47.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.675+0000 7f3ee2cf8640 1 -- 172.21.15.53:0/1631551090 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3edc123970 con 0x7f3edc06eee0 2024-09-13T19:15:47.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.675+0000 7f7c79742640 1 -- 172.21.15.53:0/2419384845 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7c7409a130 con 0x7f7c7409bd50 2024-09-13T19:15:47.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.675+0000 7f8544e8c640 1 -- 172.21.15.53:0/3591795805 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8540074990 con 0x7f854009a100 2024-09-13T19:15:47.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.675+0000 7f7c5b7fe640 1 -- 172.21.15.53:0/2419384845 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7c6403e700 con 0x7f7c7409bd50 2024-09-13T19:15:47.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.675+0000 7f852effd640 1 -- 172.21.15.53:0/3591795805 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f853001a070 con 0x7f854009a100 2024-09-13T19:15:47.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.676+0000 7f7c5b7fe640 1 --2- 172.21.15.53:0/2419384845 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7c60038250 0x7f7c6003a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:47.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.676+0000 7f7c5b7fe640 1 -- 172.21.15.53:0/2419384845 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f7c6406bd70 con 0x7f7c7409bd50 2024-09-13T19:15:47.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.676+0000 7f852effd640 1 --2- 172.21.15.53:0/3591795805 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8520038340 0x7f852003a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:47.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.676+0000 7f852effd640 1 -- 172.21.15.53:0/3591795805 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f853004a5b0 con 0x7f854009a100 2024-09-13T19:15:47.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.675+0000 7fa536d9d640 1 --2- 172.21.15.53:0/2243324282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa53812e850 0x7fa5380700f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa528009840 tx=0x7fa5280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:47.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.676+0000 7f3ed97fa640 1 -- 172.21.15.53:0/1631551090 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3ed0045070 con 0x7f3edc06eee0 2024-09-13T19:15:47.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.676+0000 7fa51f7fe640 1 -- 172.21.15.53:0/2243324282 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa528041070 con 0x7fa53812e850 2024-09-13T19:15:47.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.676+0000 7fa51f7fe640 1 -- 172.21.15.53:0/2243324282 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa52803c460 con 0x7fa53812e850 2024-09-13T19:15:47.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.676+0000 7fa51f7fe640 1 -- 172.21.15.53:0/2243324282 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa528037040 con 0x7fa53812e850 2024-09-13T19:15:47.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.676+0000 7fa53d1c4640 1 -- 172.21.15.53:0/2243324282 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa538072b30 con 0x7fa53812e850 2024-09-13T19:15:47.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.676+0000 7f852effd640 1 --2- 172.21.15.53:0/3591795805 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f852003db40 0x7f852003ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:47.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.676+0000 7f852effd640 1 -- 172.21.15.53:0/3591795805 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8520040690 con 0x7f852003db40 2024-09-13T19:15:47.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.676+0000 7f852effd640 1 -- 172.21.15.53:0/3591795805 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f8530051050 con 0x7f854009a100 2024-09-13T19:15:47.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.676+0000 7f7c5b7fe640 1 --2- 172.21.15.53:0/2419384845 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x7f7c6003d9d0 0x7f7c6003fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:47.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.676+0000 7f7c5b7fe640 1 -- 172.21.15.53:0/2419384845 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7c6404be80 con 0x7f7c6003d9d0 2024-09-13T19:15:47.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.676+0000 7f7c5b7fe640 1 -- 172.21.15.53:0/2419384845 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f7c6403edc0 con 0x7f7c7409bd50 2024-09-13T19:15:47.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.676+0000 7f7c727fc640 1 --2- 172.21.15.53:0/2419384845 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7c60038250 0x7f7c6003a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:47.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.676+0000 7f3ed97fa640 1 --2- 172.21.15.53:0/1631551090 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3ec0038340 0x7f3ec003a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:47.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.676+0000 7f3ed97fa640 1 -- 172.21.15.53:0/1631551090 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f3ed006bac0 con 0x7f3edc06eee0 2024-09-13T19:15:47.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.676+0000 7f7c737fe640 1 --2- 172.21.15.53:0/2419384845 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x7f7c6003d9d0 0x7f7c6003fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:47.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.676+0000 7f853ed9d640 1 --2- 172.21.15.53:0/3591795805 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f852003db40 0x7f852003ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:47.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.676+0000 7f853dd9b640 1 --2- 172.21.15.53:0/3591795805 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8520038340 0x7f852003a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:47.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.676+0000 7f3ee2cf8640 1 --2- 172.21.15.53:0/1631551090 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f3edc072900 0x7f3edc095890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:47.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.676+0000 7f3ee2cf8640 1 -- 172.21.15.53:0/1631551090 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3edc122ff0 con 0x7f3edc072900 2024-09-13T19:15:47.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.676+0000 7f3edbfff640 1 --2- 172.21.15.53:0/1631551090 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3ec0038340 0x7f3ec003a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:47.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.677+0000 7f3ee1295640 1 --2- 172.21.15.53:0/1631551090 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f3edc072900 0x7f3edc095890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:47.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.676+0000 7fa53d1c4640 1 -- 172.21.15.53:0/2243324282 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa538070810 con 0x7fa53812e850 2024-09-13T19:15:47.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.677+0000 7f7c737fe640 1 --2- 172.21.15.53:0/2419384845 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x7f7c6003d9d0 0x7f7c6003fe50 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:47.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.677+0000 7f7c727fc640 1 --2- 172.21.15.53:0/2419384845 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7c60038250 0x7f7c6003a710 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7c680012b0 tx=0x7f7c68001140 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:47.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.677+0000 7f853ed9d640 1 --2- 172.21.15.53:0/3591795805 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f852003db40 0x7f852003ffc0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:47.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.677+0000 7f3edbfff640 1 --2- 172.21.15.53:0/1631551090 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3ec0038340 0x7f3ec003a800 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3ec8001610 tx=0x7f3ec8007970 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:47.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.677+0000 7f3ee1295640 1 --2- 172.21.15.53:0/1631551090 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f3edc072900 0x7f3edc095890 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:47.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.677+0000 7fa51f7fe640 1 -- 172.21.15.53:0/2243324282 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa528044070 con 0x7fa53812e850 2024-09-13T19:15:47.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.677+0000 7fa53d1c4640 1 -- 172.21.15.53:0/2243324282 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa538072e10 con 0x7fa53812e850 2024-09-13T19:15:47.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.678+0000 7f7c5b7fe640 1 -- 172.21.15.53:0/2419384845 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7c6404be80 con 0x7f7c6003d9d0 2024-09-13T19:15:47.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.678+0000 7f852effd640 1 -- 172.21.15.53:0/3591795805 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8520040690 con 0x7f852003db40 2024-09-13T19:15:47.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.678+0000 7fa51f7fe640 1 --2- 172.21.15.53:0/2243324282 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa5240382f0 0x7fa52403a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:47.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.678+0000 7f853dd9b640 1 --2- 172.21.15.53:0/3591795805 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8520038340 0x7f852003a800 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8534034000 tx=0x7f853402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:47.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.678+0000 7fa51f7fe640 1 -- 172.21.15.53:0/2243324282 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7fa52806bd50 con 0x7fa53812e850 2024-09-13T19:15:47.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.678+0000 7fa51f7fe640 1 --2- 172.21.15.53:0/2243324282 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x7fa52403da70 0x7fa52403fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:47.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.678+0000 7fa51f7fe640 1 -- 172.21.15.53:0/2243324282 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa528036e90 con 0x7fa52403da70 2024-09-13T19:15:47.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.678+0000 7fa51f7fe640 1 -- 172.21.15.53:0/2243324282 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fa528071070 con 0x7fa53812e850 2024-09-13T19:15:47.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.678+0000 7fa53659c640 1 --2- 172.21.15.53:0/2243324282 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa5240382f0 0x7fa52403a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:47.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.678+0000 7f3ed97fa640 1 -- 172.21.15.53:0/1631551090 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3ed400ad90 con 0x7f3edc072900 2024-09-13T19:15:47.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.678+0000 7fa53759e640 1 --2- 172.21.15.53:0/2243324282 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x7fa52403da70 0x7fa52403fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:47.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.679+0000 7fa53659c640 1 --2- 172.21.15.53:0/2243324282 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa5240382f0 0x7fa52403a7b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa52c007fd0 tx=0x7fa52c007ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:47.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.679+0000 7fa53759e640 1 --2- 172.21.15.53:0/2243324282 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x7fa52403da70 0x7fa52403fef0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:47.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.679+0000 7fa51f7fe640 1 -- 172.21.15.53:0/2243324282 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa528036e90 con 0x7fa52403da70 2024-09-13T19:15:47.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.692+0000 7f7c79742640 1 -- 172.21.15.53:0/2419384845 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7c7409c670 con 0x7f7c6003d9d0 2024-09-13T19:15:47.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.692+0000 7f3ee2cf8640 1 -- 172.21.15.53:0/1631551090 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3edc06e9a0 con 0x7f3edc072900 2024-09-13T19:15:47.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.692+0000 7f3ed97fa640 1 -- 172.21.15.53:0/1631551090 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3edc06e9a0 con 0x7f3edc072900 2024-09-13T19:15:47.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.692+0000 7f7c5b7fe640 1 -- 172.21.15.53:0/2419384845 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7c7409c670 con 0x7f7c6003d9d0 2024-09-13T19:15:47.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.692+0000 7f3ee2cf8640 1 -- 172.21.15.53:0/1631551090 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f3edc072900 msgr2=0x7f3edc095890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:47.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.692+0000 7f3ee2cf8640 1 --2- 172.21.15.53:0/1631551090 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f3edc072900 0x7f3edc095890 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:47.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.692+0000 7f7c79742640 1 -- 172.21.15.53:0/2419384845 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x7f7c6003d9d0 msgr2=0x7f7c6003fe50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:47.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.692+0000 7f7c79742640 1 --2- 172.21.15.53:0/2419384845 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x7f7c6003d9d0 0x7f7c6003fe50 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:47.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.692+0000 7f3ee2cf8640 1 -- 172.21.15.53:0/1631551090 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3ec0038340 msgr2=0x7f3ec003a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:47.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.692+0000 7f3ee2cf8640 1 --2- 172.21.15.53:0/1631551090 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3ec0038340 0x7f3ec003a800 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3ec8001610 tx=0x7f3ec8007970 comp rx=0 tx=0).stop 2024-09-13T19:15:47.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.692+0000 7f3ee2cf8640 1 -- 172.21.15.53:0/1631551090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3edc06eee0 msgr2=0x7f3edc095350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:47.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.692+0000 7f3ee2cf8640 1 --2- 172.21.15.53:0/1631551090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3edc06eee0 0x7f3edc095350 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0009720 tx=0x7f3ed00046c0 comp rx=0 tx=0).stop 2024-09-13T19:15:47.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.693+0000 7f7c79742640 1 -- 172.21.15.53:0/2419384845 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7c60038250 msgr2=0x7f7c6003a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:47.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.693+0000 7f7c79742640 1 --2- 172.21.15.53:0/2419384845 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7c60038250 0x7f7c6003a710 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7c680012b0 tx=0x7f7c68001140 comp rx=0 tx=0).stop 2024-09-13T19:15:47.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.693+0000 7f7c79742640 1 -- 172.21.15.53:0/2419384845 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c7409bd50 msgr2=0x7f7c741b0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:47.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.693+0000 7f7c79742640 1 --2- 172.21.15.53:0/2419384845 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c7409bd50 0x7f7c741b0e10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7c6402a150 tx=0x7f7c640046c0 comp rx=0 tx=0).stop 2024-09-13T19:15:47.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.693+0000 7f7c79742640 1 -- 172.21.15.53:0/2419384845 shutdown_connections 2024-09-13T19:15:47.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.693+0000 7f7c79742640 1 --2- 172.21.15.53:0/2419384845 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x7f7c6003d9d0 0x7f7c6003fe50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:47.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.693+0000 7f7c79742640 1 --2- 172.21.15.53:0/2419384845 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7c60038250 0x7f7c6003a710 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:47.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.693+0000 7f7c79742640 1 --2- 172.21.15.53:0/2419384845 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c7409bd50 0x7f7c741b0e10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:47.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.693+0000 7f7c79742640 1 -- 172.21.15.53:0/2419384845 >> 172.21.15.53:0/2419384845 conn(0x7f7c7406d4a0 msgr2=0x7f7c7409eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:47.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.693+0000 7f3ee2cf8640 1 -- 172.21.15.53:0/1631551090 shutdown_connections 2024-09-13T19:15:47.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.693+0000 7f3ee2cf8640 1 --2- 172.21.15.53:0/1631551090 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f3edc072900 0x7f3edc095890 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:47.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.693+0000 7f3ee2cf8640 1 --2- 172.21.15.53:0/1631551090 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3ec0038340 0x7f3ec003a800 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:47.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.693+0000 7f3ee2cf8640 1 --2- 172.21.15.53:0/1631551090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3edc06eee0 0x7f3edc095350 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:47.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.693+0000 7f3ee2cf8640 1 -- 172.21.15.53:0/1631551090 >> 172.21.15.53:0/1631551090 conn(0x7f3edc09aa80 msgr2=0x7f3edc071ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:47.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.693+0000 7f7c79742640 1 -- 172.21.15.53:0/2419384845 shutdown_connections 2024-09-13T19:15:47.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.693+0000 7f7c79742640 1 -- 172.21.15.53:0/2419384845 wait complete. 2024-09-13T19:15:47.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.693+0000 7f3ee2cf8640 1 -- 172.21.15.53:0/1631551090 shutdown_connections 2024-09-13T19:15:47.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.693+0000 7f3ee2cf8640 1 -- 172.21.15.53:0/1631551090 wait complete. 2024-09-13T19:15:47.720 INFO:teuthology.orchestra.run.smithi053.stdout:38654705670 2024-09-13T19:15:47.720 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T19:15:47.721 INFO:teuthology.orchestra.run.smithi053.stdout:47244640262 2024-09-13T19:15:47.722 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T19:15:47.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.708+0000 7f8544e8c640 1 -- 172.21.15.53:0/3591795805 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f854009bd50 con 0x7f852003db40 2024-09-13T19:15:47.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.709+0000 7f852effd640 1 -- 172.21.15.53:0/3591795805 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f854009bd50 con 0x7f852003db40 2024-09-13T19:15:47.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.709+0000 7f8544e8c640 1 -- 172.21.15.53:0/3591795805 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f852003db40 msgr2=0x7f852003ffc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:47.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.709+0000 7f8544e8c640 1 --2- 172.21.15.53:0/3591795805 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f852003db40 0x7f852003ffc0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:47.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.709+0000 7f8544e8c640 1 -- 172.21.15.53:0/3591795805 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8520038340 msgr2=0x7f852003a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:47.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.709+0000 7f8544e8c640 1 --2- 172.21.15.53:0/3591795805 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8520038340 0x7f852003a800 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8534034000 tx=0x7f853402e000 comp rx=0 tx=0).stop 2024-09-13T19:15:47.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.709+0000 7f8544e8c640 1 -- 172.21.15.53:0/3591795805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f854009a100 msgr2=0x7f8540092f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:47.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.709+0000 7f8544e8c640 1 --2- 172.21.15.53:0/3591795805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f854009a100 0x7f8540092f40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f853000c6b0 tx=0x7f853000cb70 comp rx=0 tx=0).stop 2024-09-13T19:15:47.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.709+0000 7f8544e8c640 1 -- 172.21.15.53:0/3591795805 shutdown_connections 2024-09-13T19:15:47.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.709+0000 7f8544e8c640 1 --2- 172.21.15.53:0/3591795805 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f852003db40 0x7f852003ffc0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:47.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.709+0000 7f8544e8c640 1 --2- 172.21.15.53:0/3591795805 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8520038340 0x7f852003a800 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:47.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.709+0000 7f8544e8c640 1 --2- 172.21.15.53:0/3591795805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f854009a100 0x7f8540092f40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:47.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.709+0000 7f8544e8c640 1 -- 172.21.15.53:0/3591795805 >> 172.21.15.53:0/3591795805 conn(0x7f854006d4a0 msgr2=0x7f854009f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:47.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.709+0000 7f8544e8c640 1 -- 172.21.15.53:0/3591795805 shutdown_connections 2024-09-13T19:15:47.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.709+0000 7f8544e8c640 1 -- 172.21.15.53:0/3591795805 wait complete. 2024-09-13T19:15:47.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.710+0000 7fa53d1c4640 1 -- 172.21.15.53:0/2243324282 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa53812ec30 con 0x7fa52403da70 2024-09-13T19:15:47.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.711+0000 7fa51f7fe640 1 -- 172.21.15.53:0/2243324282 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa53812ec30 con 0x7fa52403da70 2024-09-13T19:15:47.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.711+0000 7fa53d1c4640 1 -- 172.21.15.53:0/2243324282 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x7fa52403da70 msgr2=0x7fa52403fef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:47.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.711+0000 7fa53d1c4640 1 --2- 172.21.15.53:0/2243324282 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x7fa52403da70 0x7fa52403fef0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:47.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.711+0000 7fa53d1c4640 1 -- 172.21.15.53:0/2243324282 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa5240382f0 msgr2=0x7fa52403a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:47.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.711+0000 7fa53d1c4640 1 --2- 172.21.15.53:0/2243324282 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa5240382f0 0x7fa52403a7b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa52c007fd0 tx=0x7fa52c007ac0 comp rx=0 tx=0).stop 2024-09-13T19:15:47.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.711+0000 7fa53d1c4640 1 -- 172.21.15.53:0/2243324282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa53812e850 msgr2=0x7fa5380700f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:47.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.711+0000 7fa53d1c4640 1 --2- 172.21.15.53:0/2243324282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa53812e850 0x7fa5380700f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa528009840 tx=0x7fa5280046c0 comp rx=0 tx=0).stop 2024-09-13T19:15:47.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.711+0000 7fa53d1c4640 1 -- 172.21.15.53:0/2243324282 shutdown_connections 2024-09-13T19:15:47.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.711+0000 7fa53d1c4640 1 --2- 172.21.15.53:0/2243324282 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x7fa52403da70 0x7fa52403fef0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:47.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.711+0000 7fa53d1c4640 1 --2- 172.21.15.53:0/2243324282 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa5240382f0 0x7fa52403a7b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:47.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.711+0000 7fa53d1c4640 1 --2- 172.21.15.53:0/2243324282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa53812e850 0x7fa5380700f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:47.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.711+0000 7fa53d1c4640 1 -- 172.21.15.53:0/2243324282 >> 172.21.15.53:0/2243324282 conn(0x7fa53809d7c0 msgr2=0x7fa5380985c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:47.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.711+0000 7fa53d1c4640 1 -- 172.21.15.53:0/2243324282 shutdown_connections 2024-09-13T19:15:47.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.711+0000 7fa53d1c4640 1 -- 172.21.15.53:0/2243324282 wait complete. 2024-09-13T19:15:47.728 INFO:teuthology.orchestra.run.smithi053.stdout:47244640261 2024-09-13T19:15:47.728 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T19:15:47.729 INFO:teuthology.orchestra.run.smithi053.stdout:47244640261 2024-09-13T19:15:47.730 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T19:15:47.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.829+0000 7f1888f26640 1 Processor -- start 2024-09-13T19:15:47.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.829+0000 7f1888f26640 1 -- start start 2024-09-13T19:15:47.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.829+0000 7fa7b2e38640 1 Processor -- start 2024-09-13T19:15:47.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.829+0000 7fa7b2e38640 1 -- start start 2024-09-13T19:15:47.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.829+0000 7f1888f26640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f188409a100 0x7f1884133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:47.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.829+0000 7f1888f26640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f188409d3b0 con 0x7f188409bd50 2024-09-13T19:15:47.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.829+0000 7f1888f26640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f188409c840 con 0x7f188409a100 2024-09-13T19:15:47.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.830+0000 7fa7b2e38640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa7ac06e5c0 0x7fa7ac06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:47.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.830+0000 7f1881d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f188409a100 0x7f1884133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:47.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.830+0000 7f188259c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f188409bd50 0x7f188409c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:34038/0 (socket says 172.21.15.53:34038) 2024-09-13T19:15:47.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.830+0000 7f188259c640 1 -- 172.21.15.53:0/433697161 learned_addr learned my addr 172.21.15.53:0/433697161 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T19:15:47.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.830+0000 7fa7b2e38640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7ac06be10 con 0x7fa7ac06eee0 2024-09-13T19:15:47.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.830+0000 7fa7abfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa7ac06eee0 0x7fa7ac132d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:34054/0 (socket says 172.21.15.53:34054) 2024-09-13T19:15:47.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.830+0000 7fa7abfff640 1 -- 172.21.15.53:0/2969600180 learned_addr learned my addr 172.21.15.53:0/2969600180 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T19:15:47.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.830+0000 7fa7b0bd4640 1 --2- 172.21.15.53:0/2969600180 >> v2:172.21.15.53:3300/0 conn(0x7fa7ac06e5c0 0x7fa7ac06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:47.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.830+0000 7fa7b2e38640 1 -- 172.21.15.53:0/2969600180 --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fa7ac09b5a0 con 0x7fa7ac06e5c0 2024-09-13T19:15:47.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.830+0000 7f188159a640 1 -- 172.21.15.53:0/433697161 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 392355570 0 0) 0x7f1874001110 con 0x7f188409bd50 2024-09-13T19:15:47.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.830+0000 7f188159a640 1 -- 172.21.15.53:0/433697161 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f186c003520 con 0x7f188409bd50 2024-09-13T19:15:47.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.830+0000 7f1881d9b640 1 -- 172.21.15.53:0/433697161 >> v1:172.21.15.53:6789/0 conn(0x7f188409bd50 legacy=0x7f188409c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:47.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.830+0000 7f1881d9b640 1 -- 172.21.15.53:0/433697161 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1884098230 con 0x7f188409a100 2024-09-13T19:15:47.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.830+0000 7fa7b0bd4640 1 -- 172.21.15.53:0/2969600180 >> v1:172.21.15.53:6789/0 conn(0x7fa7ac06eee0 legacy=0x7fa7ac132d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:47.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.830+0000 7fa7b0bd4640 1 -- 172.21.15.53:0/2969600180 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7ac06c400 con 0x7fa7ac06e5c0 2024-09-13T19:15:47.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.831+0000 7f1881d9b640 1 --2- 172.21.15.53:0/433697161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f188409a100 0x7f1884133da0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1878009720 tx=0x7f187802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a730deba562376a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:47.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.831+0000 7fa7b0bd4640 1 --2- 172.21.15.53:0/2969600180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7ac06e5c0 0x7fa7ac06e9a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0009720 tx=0x7fa7a002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f5091c8a7e51569 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:47.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.831+0000 7f188159a640 1 -- 172.21.15.53:0/433697161 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1878037070 con 0x7f188409a100 2024-09-13T19:15:47.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.831+0000 7f188159a640 1 -- 172.21.15.53:0/433697161 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f187802ad90 con 0x7f188409a100 2024-09-13T19:15:47.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.831+0000 7f188159a640 1 -- 172.21.15.53:0/433697161 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1878032590 con 0x7f188409a100 2024-09-13T19:15:47.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.831+0000 7fa7ab7fe640 1 -- 172.21.15.53:0/2969600180 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7a0037070 con 0x7fa7ac06e5c0 2024-09-13T19:15:47.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.831+0000 7fa7ab7fe640 1 -- 172.21.15.53:0/2969600180 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7a002ae20 con 0x7fa7ac06e5c0 2024-09-13T19:15:47.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.831+0000 7fa7ab7fe640 1 -- 172.21.15.53:0/2969600180 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7a0037070 con 0x7fa7ac06e5c0 2024-09-13T19:15:47.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.832+0000 7fa7b2e38640 1 -- 172.21.15.53:0/2969600180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7ac06e5c0 msgr2=0x7fa7ac06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:47.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.832+0000 7fa7b2e38640 1 --2- 172.21.15.53:0/2969600180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7ac06e5c0 0x7fa7ac06e9a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0009720 tx=0x7fa7a002a1a0 comp rx=0 tx=0).stop 2024-09-13T19:15:47.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.832+0000 7f1888f26640 1 -- 172.21.15.53:0/433697161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f188409a100 msgr2=0x7f1884133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:47.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.832+0000 7f1888f26640 1 --2- 172.21.15.53:0/433697161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f188409a100 0x7f1884133da0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1878009720 tx=0x7f187802a110 comp rx=0 tx=0).stop 2024-09-13T19:15:47.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.832+0000 7fa7b2e38640 1 -- 172.21.15.53:0/2969600180 shutdown_connections 2024-09-13T19:15:47.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.832+0000 7fa7b2e38640 1 --2- 172.21.15.53:0/2969600180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7ac06e5c0 0x7fa7ac06e9a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:47.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.832+0000 7fa7b2e38640 1 -- 172.21.15.53:0/2969600180 >> 172.21.15.53:0/2969600180 conn(0x7fa7ac09aa80 msgr2=0x7fa7ac09ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:47.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.832+0000 7f1888f26640 1 -- 172.21.15.53:0/433697161 shutdown_connections 2024-09-13T19:15:47.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.832+0000 7fa7b2e38640 1 -- 172.21.15.53:0/2969600180 shutdown_connections 2024-09-13T19:15:47.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.832+0000 7fa7b2e38640 1 -- 172.21.15.53:0/2969600180 wait complete. 2024-09-13T19:15:47.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.832+0000 7f1888f26640 1 --2- 172.21.15.53:0/433697161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f188409a100 0x7f1884133da0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:47.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.832+0000 7f1888f26640 1 -- 172.21.15.53:0/433697161 >> 172.21.15.53:0/433697161 conn(0x7f188406d4a0 msgr2=0x7f188406d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:47.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.832+0000 7f1888f26640 1 -- 172.21.15.53:0/433697161 shutdown_connections 2024-09-13T19:15:47.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.832+0000 7f1888f26640 1 -- 172.21.15.53:0/433697161 wait complete. 2024-09-13T19:15:47.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.833+0000 7fa7b2e38640 1 Processor -- start 2024-09-13T19:15:47.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.833+0000 7fa7b2e38640 1 -- start start 2024-09-13T19:15:47.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.834+0000 7f1888f26640 1 Processor -- start 2024-09-13T19:15:47.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.834+0000 7f1888f26640 1 -- start start 2024-09-13T19:15:47.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.834+0000 7fa7b2e38640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7ac06e5c0 0x7fa7ac092490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:47.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.834+0000 7fa7b2e38640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ac06f2f0 con 0x7fa7ac06e5c0 2024-09-13T19:15:47.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.834+0000 7f1888f26640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f188409a100 0x7f1884092f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:47.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.834+0000 7fa7b0bd4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7ac06e5c0 0x7fa7ac092490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:47.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.834+0000 7f1888f26640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1884134670 con 0x7f188409a100 2024-09-13T19:15:47.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.834+0000 7fa7b0bd4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7ac06e5c0 0x7fa7ac092490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60736/0 (socket says 172.21.15.53:60736) 2024-09-13T19:15:47.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.834+0000 7fa7b0bd4640 1 -- 172.21.15.53:0/3671431493 learned_addr learned my addr 172.21.15.53:0/3671431493 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:15:47.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.834+0000 7f188259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f188409a100 0x7f1884092f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:47.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.834+0000 7f188259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f188409a100 0x7f1884092f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60744/0 (socket says 172.21.15.53:60744) 2024-09-13T19:15:47.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.834+0000 7f188259c640 1 -- 172.21.15.53:0/3352792249 learned_addr learned my addr 172.21.15.53:0/3352792249 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:15:47.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.834+0000 7fa7b0bd4640 1 -- 172.21.15.53:0/3671431493 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7ac0947e0 con 0x7fa7ac06e5c0 2024-09-13T19:15:47.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.835+0000 7fa7b0bd4640 1 --2- 172.21.15.53:0/3671431493 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7ac06e5c0 0x7fa7ac092490 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa7a002a1e0 tx=0x7fa7a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:47.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.835+0000 7f188259c640 1 -- 172.21.15.53:0/3352792249 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1884094be0 con 0x7f188409a100 2024-09-13T19:15:47.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.835+0000 7fa7a97fa640 1 -- 172.21.15.53:0/3671431493 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7a0041070 con 0x7fa7ac06e5c0 2024-09-13T19:15:47.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.835+0000 7f188259c640 1 --2- 172.21.15.53:0/3352792249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f188409a100 0x7f1884092f40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f187400c6b0 tx=0x7f187400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:47.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.835+0000 7f1872ffd640 1 -- 172.21.15.53:0/3352792249 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1874017070 con 0x7f188409a100 2024-09-13T19:15:47.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.835+0000 7f1872ffd640 1 -- 172.21.15.53:0/3352792249 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1874007e40 con 0x7f188409a100 2024-09-13T19:15:47.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.835+0000 7f1872ffd640 1 -- 172.21.15.53:0/3352792249 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18740059e0 con 0x7f188409a100 2024-09-13T19:15:47.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.835+0000 7f1888f26640 1 -- 172.21.15.53:0/3352792249 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f188409a760 con 0x7f188409a100 2024-09-13T19:15:47.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.835+0000 7fa7a97fa640 1 -- 172.21.15.53:0/3671431493 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7a0003d20 con 0x7fa7ac06e5c0 2024-09-13T19:15:47.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.835+0000 7fa7a97fa640 1 -- 172.21.15.53:0/3671431493 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7a0037040 con 0x7fa7ac06e5c0 2024-09-13T19:15:47.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.835+0000 7fa7b2e38640 1 -- 172.21.15.53:0/3671431493 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7ac094e30 con 0x7fa7ac06e5c0 2024-09-13T19:15:47.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.835+0000 7fa7b2e38640 1 -- 172.21.15.53:0/3671431493 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7ac092bb0 con 0x7fa7ac06e5c0 2024-09-13T19:15:47.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.836+0000 7f1888f26640 1 -- 172.21.15.53:0/3352792249 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1884095a50 con 0x7f188409a100 2024-09-13T19:15:47.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.836+0000 7fa7b2e38640 1 -- 172.21.15.53:0/3671431493 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7ac06e9a0 con 0x7fa7ac06e5c0 2024-09-13T19:15:47.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.837+0000 7f1888f26640 1 -- 172.21.15.53:0/3352792249 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1884094030 con 0x7f188409a100 2024-09-13T19:15:47.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.837+0000 7fa7a97fa640 1 -- 172.21.15.53:0/3671431493 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa7a0044070 con 0x7fa7ac06e5c0 2024-09-13T19:15:47.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.837+0000 7f1872ffd640 1 -- 172.21.15.53:0/3352792249 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f187401a070 con 0x7f188409a100 2024-09-13T19:15:47.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.837+0000 7fa7a97fa640 1 --2- 172.21.15.53:0/3671431493 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa7900382a0 0x7fa79003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:47.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.837+0000 7fa7a97fa640 1 -- 172.21.15.53:0/3671431493 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7fa7a006bb90 con 0x7fa7ac06e5c0 2024-09-13T19:15:47.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.837+0000 7f1872ffd640 1 --2- 172.21.15.53:0/3352792249 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f1864038250 0x7f186403a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:47.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.837+0000 7fa7abfff640 1 --2- 172.21.15.53:0/3671431493 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa7900382a0 0x7fa79003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:47.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.837+0000 7f1872ffd640 1 -- 172.21.15.53:0/3352792249 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f187404a670 con 0x7f188409a100 2024-09-13T19:15:47.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.837+0000 7f1881d9b640 1 --2- 172.21.15.53:0/3352792249 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f1864038250 0x7f186403a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:47.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.838+0000 7f1881d9b640 1 --2- 172.21.15.53:0/3352792249 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f1864038250 0x7f186403a710 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1878034000 tx=0x7f187802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:47.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.838+0000 7fa7abfff640 1 --2- 172.21.15.53:0/3671431493 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa7900382a0 0x7fa79003a760 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa798007fd0 tx=0x7fa798007ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:47.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.846+0000 7fa7a97fa640 1 -- 172.21.15.53:0/3671431493 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa7a003b580 con 0x7fa7ac06e5c0 2024-09-13T19:15:47.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.855+0000 7f1872ffd640 1 -- 172.21.15.53:0/3352792249 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f188409d3b0 con 0x7f188409a100 2024-09-13T19:15:47.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.875+0000 7efc099bd640 1 Processor -- start 2024-09-13T19:15:47.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.876+0000 7efc099bd640 1 -- start start 2024-09-13T19:15:47.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.876+0000 7efc099bd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efc0409bd50 0x7efc0409c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:47.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.876+0000 7efc099bd640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc0409d3b0 con 0x7efc0409c670 2024-09-13T19:15:47.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.876+0000 7efc099bd640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7efc04098230 con 0x7efc0409bd50 2024-09-13T19:15:47.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.876+0000 7efc02ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efc0409bd50 0x7efc0409c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:47.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.876+0000 7efc027fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7efc0409c670 0x7efc040990f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:34068/0 (socket says 172.21.15.53:34068) 2024-09-13T19:15:47.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.876+0000 7efc027fc640 1 -- 172.21.15.53:0/3833357966 learned_addr learned my addr 172.21.15.53:0/3833357966 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T19:15:47.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.877+0000 7efc02ffd640 1 -- 172.21.15.53:0/3833357966 >> v1:172.21.15.53:6789/0 conn(0x7efc0409c670 legacy=0x7efc040990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:47.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.877+0000 7efc02ffd640 1 -- 172.21.15.53:0/3833357966 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc040983e0 con 0x7efc0409bd50 2024-09-13T19:15:47.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.877+0000 7efc02ffd640 1 --2- 172.21.15.53:0/3833357966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc0409bd50 0x7efc0409c130 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efbf4009720 tx=0x7efbf402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c516ade993ac93a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:47.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.878+0000 7efc01ffb640 1 -- 172.21.15.53:0/3833357966 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efbf4037070 con 0x7efc0409bd50 2024-09-13T19:15:47.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.878+0000 7efc01ffb640 1 -- 172.21.15.53:0/3833357966 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbf402ad90 con 0x7efc0409bd50 2024-09-13T19:15:47.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.878+0000 7efc01ffb640 1 -- 172.21.15.53:0/3833357966 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efbf4032590 con 0x7efc0409bd50 2024-09-13T19:15:47.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.878+0000 7efc099bd640 1 -- 172.21.15.53:0/3833357966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc0409bd50 msgr2=0x7efc0409c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:47.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.878+0000 7efc099bd640 1 --2- 172.21.15.53:0/3833357966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc0409bd50 0x7efc0409c130 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efbf4009720 tx=0x7efbf402a110 comp rx=0 tx=0).stop 2024-09-13T19:15:47.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.878+0000 7efc099bd640 1 -- 172.21.15.53:0/3833357966 shutdown_connections 2024-09-13T19:15:47.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.878+0000 7efc099bd640 1 --2- 172.21.15.53:0/3833357966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc0409bd50 0x7efc0409c130 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:47.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.878+0000 7efc099bd640 1 -- 172.21.15.53:0/3833357966 >> 172.21.15.53:0/3833357966 conn(0x7efc0406d4a0 msgr2=0x7efc0406d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:47.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.878+0000 7efc099bd640 1 -- 172.21.15.53:0/3833357966 shutdown_connections 2024-09-13T19:15:47.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.878+0000 7efc099bd640 1 -- 172.21.15.53:0/3833357966 wait complete. 2024-09-13T19:15:47.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.879+0000 7efc099bd640 1 Processor -- start 2024-09-13T19:15:47.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.879+0000 7efc099bd640 1 -- start start 2024-09-13T19:15:47.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.880+0000 7efc099bd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc0409bd50 0x7efc041c3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:47.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.880+0000 7efc099bd640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7efc04099b90 con 0x7efc0409bd50 2024-09-13T19:15:47.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.880+0000 7efc02ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc0409bd50 0x7efc041c3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:47.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.880+0000 7efc02ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc0409bd50 0x7efc041c3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60774/0 (socket says 172.21.15.53:60774) 2024-09-13T19:15:47.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.880+0000 7efc02ffd640 1 -- 172.21.15.53:0/634826678 learned_addr learned my addr 172.21.15.53:0/634826678 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:15:47.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.880+0000 7efc02ffd640 1 -- 172.21.15.53:0/634826678 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc041b3080 con 0x7efc0409bd50 2024-09-13T19:15:47.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.880+0000 7efc02ffd640 1 --2- 172.21.15.53:0/634826678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc0409bd50 0x7efc041c3900 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efbf4009840 tx=0x7efbf40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:47.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.881+0000 7efbebfff640 1 -- 172.21.15.53:0/634826678 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efbf4041070 con 0x7efc0409bd50 2024-09-13T19:15:47.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.881+0000 7efbebfff640 1 -- 172.21.15.53:0/634826678 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbf403c460 con 0x7efc0409bd50 2024-09-13T19:15:47.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.881+0000 7efbebfff640 1 -- 172.21.15.53:0/634826678 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efbf4041070 con 0x7efc0409bd50 2024-09-13T19:15:47.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.881+0000 7efc099bd640 1 -- 172.21.15.53:0/634826678 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc041b4880 con 0x7efc0409bd50 2024-09-13T19:15:47.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.881+0000 7efc099bd640 1 -- 172.21.15.53:0/634826678 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc041b1a80 con 0x7efc0409bd50 2024-09-13T19:15:47.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.882+0000 7efbebfff640 1 -- 172.21.15.53:0/634826678 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7efbf4044070 con 0x7efc0409bd50 2024-09-13T19:15:47.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.882+0000 7efc099bd640 1 -- 172.21.15.53:0/634826678 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc0409a130 con 0x7efc0409bd50 2024-09-13T19:15:47.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.882+0000 7efbebfff640 1 --2- 172.21.15.53:0/634826678 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7efbf0038660 0x7efbf003ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:47.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.882+0000 7efbebfff640 1 -- 172.21.15.53:0/634826678 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7efbf406b820 con 0x7efc0409bd50 2024-09-13T19:15:47.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.883+0000 7efc027fc640 1 --2- 172.21.15.53:0/634826678 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7efbf0038660 0x7efbf003ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:47.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.883+0000 7efc027fc640 1 --2- 172.21.15.53:0/634826678 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7efbf0038660 0x7efbf003ab20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7efbf8007fd0 tx=0x7efbf8007ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:47.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.885+0000 7fa62e786640 1 Processor -- start 2024-09-13T19:15:47.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.885+0000 7fa62e786640 1 -- start start 2024-09-13T19:15:47.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.885+0000 7fa62e786640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa62812f1e0 0x7fa628133a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:47.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.885+0000 7fa62e786640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa62806e9a0 con 0x7fa62812e6f0 2024-09-13T19:15:47.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.885+0000 7fa62e786640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fa62812f5f0 con 0x7fa62812f1e0 2024-09-13T19:15:47.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.886+0000 7fa6277fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa62812f1e0 0x7fa628133a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:47.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.886+0000 7fa6277fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa62812f1e0 0x7fa628133a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60790/0 (socket says 172.21.15.53:60790) 2024-09-13T19:15:47.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.886+0000 7fa6277fe640 1 -- 172.21.15.53:0/178539558 learned_addr learned my addr 172.21.15.53:0/178539558 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:15:47.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.886+0000 7fa6277fe640 1 -- 172.21.15.53:0/178539558 >> v1:172.21.15.53:6789/0 conn(0x7fa62812e6f0 legacy=0x7fa62812ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:47.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.886+0000 7fa6277fe640 1 -- 172.21.15.53:0/178539558 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa628134fc0 con 0x7fa62812f1e0 2024-09-13T19:15:47.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.887+0000 7fa6277fe640 1 --2- 172.21.15.53:0/178539558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa62812f1e0 0x7fa628133a70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa61c0097f0 tx=0x7fa61c02a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6665918092d281ec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:47.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.888+0000 7fa626ffd640 1 -- 172.21.15.53:0/178539558 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa61c037070 con 0x7fa62812f1e0 2024-09-13T19:15:47.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.888+0000 7fa626ffd640 1 -- 172.21.15.53:0/178539558 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa61c032440 con 0x7fa62812f1e0 2024-09-13T19:15:47.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.888+0000 7fa626ffd640 1 -- 172.21.15.53:0/178539558 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa61c032740 con 0x7fa62812f1e0 2024-09-13T19:15:47.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.888+0000 7efbebfff640 1 -- 172.21.15.53:0/634826678 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efc041b3080 con 0x7efc0409bd50 2024-09-13T19:15:47.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.889+0000 7fa62e786640 1 -- 172.21.15.53:0/178539558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa62812f1e0 msgr2=0x7fa628133a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:47.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.889+0000 7fa62e786640 1 --2- 172.21.15.53:0/178539558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa62812f1e0 0x7fa628133a70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa61c0097f0 tx=0x7fa61c02a1f0 comp rx=0 tx=0).stop 2024-09-13T19:15:47.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.889+0000 7fa62e786640 1 -- 172.21.15.53:0/178539558 shutdown_connections 2024-09-13T19:15:47.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.889+0000 7fa62e786640 1 --2- 172.21.15.53:0/178539558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa62812f1e0 0x7fa628133a70 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:47.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.889+0000 7fa62e786640 1 -- 172.21.15.53:0/178539558 >> 172.21.15.53:0/178539558 conn(0x7fa62809f020 msgr2=0x7fa62809f430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:47.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.889+0000 7fa62e786640 1 -- 172.21.15.53:0/178539558 shutdown_connections 2024-09-13T19:15:47.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.889+0000 7fa62e786640 1 -- 172.21.15.53:0/178539558 wait complete. 2024-09-13T19:15:47.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.890+0000 7fa62e786640 1 Processor -- start 2024-09-13T19:15:47.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.890+0000 7fa62e786640 1 -- start start 2024-09-13T19:15:47.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.891+0000 7fa62e786640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa62812e6f0 0x7fa628131e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:47.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.891+0000 7fa62e786640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa628134340 con 0x7fa62812e6f0 2024-09-13T19:15:47.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.891+0000 7fa627fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa62812e6f0 0x7fa628131e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:47.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.891+0000 7fa627fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa62812e6f0 0x7fa628131e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60802/0 (socket says 172.21.15.53:60802) 2024-09-13T19:15:47.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.891+0000 7fa627fff640 1 -- 172.21.15.53:0/1484116514 learned_addr learned my addr 172.21.15.53:0/1484116514 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:15:47.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.891+0000 7fa627fff640 1 -- 172.21.15.53:0/1484116514 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa628133610 con 0x7fa62812e6f0 2024-09-13T19:15:47.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.891+0000 7fa627fff640 1 --2- 172.21.15.53:0/1484116514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa62812e6f0 0x7fa628131e00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa61800c340 tx=0x7fa61800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:47.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.891+0000 7fa624ff9640 1 -- 172.21.15.53:0/1484116514 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa618017070 con 0x7fa62812e6f0 2024-09-13T19:15:47.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.891+0000 7fa62e786640 1 -- 172.21.15.53:0/1484116514 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa628125250 con 0x7fa62812e6f0 2024-09-13T19:15:47.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.891+0000 7fa624ff9640 1 -- 172.21.15.53:0/1484116514 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa618005200 con 0x7fa62812e6f0 2024-09-13T19:15:47.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.891+0000 7fa624ff9640 1 -- 172.21.15.53:0/1484116514 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa618017070 con 0x7fa62812e6f0 2024-09-13T19:15:47.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.892+0000 7fa62e786640 1 -- 172.21.15.53:0/1484116514 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa628132340 con 0x7fa62812e6f0 2024-09-13T19:15:47.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.893+0000 7fa62e786640 1 -- 172.21.15.53:0/1484116514 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa628124a40 con 0x7fa62812e6f0 2024-09-13T19:15:47.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.893+0000 7fa624ff9640 1 -- 172.21.15.53:0/1484116514 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa61801a070 con 0x7fa62812e6f0 2024-09-13T19:15:47.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.893+0000 7fa624ff9640 1 --2- 172.21.15.53:0/1484116514 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa614038660 0x7fa61403ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:47.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.893+0000 7fa624ff9640 1 -- 172.21.15.53:0/1484116514 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7fa618011db0 con 0x7fa62812e6f0 2024-09-13T19:15:47.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.894+0000 7fa6277fe640 1 --2- 172.21.15.53:0/1484116514 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa614038660 0x7fa61403ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:47.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.894+0000 7fa6277fe640 1 --2- 172.21.15.53:0/1484116514 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa614038660 0x7fa61403ab20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa61c034000 tx=0x7fa61c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:47.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:47.903+0000 7fa624ff9640 1 -- 172.21.15.53:0/1484116514 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa61801a360 con 0x7fa62812e6f0 2024-09-13T19:15:48.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:48.033+0000 7fa7b2e38640 1 -- 172.21.15.53:0/3671431493 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fa7ac06c020 con 0x7fa7ac06e5c0 2024-09-13T19:15:48.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:48.033+0000 7fa7a97fa640 1 -- 172.21.15.53:0/3671431493 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa7a002ae20 con 0x7fa7ac06e5c0 2024-09-13T19:15:48.036 INFO:teuthology.orchestra.run.smithi053.stdout:47244640261 2024-09-13T19:15:48.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:48.035+0000 7fa7b2e38640 1 -- 172.21.15.53:0/3671431493 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa7900382a0 msgr2=0x7fa79003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:48.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:48.035+0000 7fa7b2e38640 1 --2- 172.21.15.53:0/3671431493 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa7900382a0 0x7fa79003a760 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa798007fd0 tx=0x7fa798007ac0 comp rx=0 tx=0).stop 2024-09-13T19:15:48.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:48.035+0000 7fa7b2e38640 1 -- 172.21.15.53:0/3671431493 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7ac06e5c0 msgr2=0x7fa7ac092490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:48.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:48.035+0000 7fa7b2e38640 1 --2- 172.21.15.53:0/3671431493 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7ac06e5c0 0x7fa7ac092490 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa7a002a1e0 tx=0x7fa7a00046c0 comp rx=0 tx=0).stop 2024-09-13T19:15:48.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:48.035+0000 7fa7b2e38640 1 -- 172.21.15.53:0/3671431493 shutdown_connections 2024-09-13T19:15:48.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:48.035+0000 7fa7b2e38640 1 --2- 172.21.15.53:0/3671431493 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa7900382a0 0x7fa79003a760 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:48.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:48.035+0000 7fa7b2e38640 1 --2- 172.21.15.53:0/3671431493 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7ac06e5c0 0x7fa7ac092490 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:48.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:48.035+0000 7fa7b2e38640 1 -- 172.21.15.53:0/3671431493 >> 172.21.15.53:0/3671431493 conn(0x7fa7ac09aa80 msgr2=0x7fa7ac0993f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:48.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:48.036+0000 7fa7b2e38640 1 -- 172.21.15.53:0/3671431493 shutdown_connections 2024-09-13T19:15:48.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:48.036+0000 7fa7b2e38640 1 -- 172.21.15.53:0/3671431493 wait complete. 2024-09-13T19:15:48.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:48.037+0000 7f1888f26640 1 -- 172.21.15.53:0/3352792249 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f188409d020 con 0x7f188409a100 2024-09-13T19:15:48.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:48.038+0000 7f1872ffd640 1 -- 172.21.15.53:0/3352792249 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1874005e20 con 0x7f188409a100 2024-09-13T19:15:48.041 INFO:teuthology.orchestra.run.smithi053.stdout:38654705668 2024-09-13T19:15:48.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:48.040+0000 7f1888f26640 1 -- 172.21.15.53:0/3352792249 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f1864038250 msgr2=0x7f186403a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:48.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:48.040+0000 7f1888f26640 1 --2- 172.21.15.53:0/3352792249 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f1864038250 0x7f186403a710 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1878034000 tx=0x7f187802e000 comp rx=0 tx=0).stop 2024-09-13T19:15:48.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:48.040+0000 7f1888f26640 1 -- 172.21.15.53:0/3352792249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f188409a100 msgr2=0x7f1884092f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:48.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:48.040+0000 7f1888f26640 1 --2- 172.21.15.53:0/3352792249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f188409a100 0x7f1884092f40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f187400c6b0 tx=0x7f187400cb70 comp rx=0 tx=0).stop 2024-09-13T19:15:48.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:48.040+0000 7f1888f26640 1 -- 172.21.15.53:0/3352792249 shutdown_connections 2024-09-13T19:15:48.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:48.040+0000 7f1888f26640 1 --2- 172.21.15.53:0/3352792249 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f1864038250 0x7f186403a710 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:48.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:48.040+0000 7f1888f26640 1 --2- 172.21.15.53:0/3352792249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f188409a100 0x7f1884092f40 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:48.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:48.040+0000 7f1888f26640 1 -- 172.21.15.53:0/3352792249 >> 172.21.15.53:0/3352792249 conn(0x7f188406d4a0 msgr2=0x7f188409f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:48.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:48.040+0000 7f1888f26640 1 -- 172.21.15.53:0/3352792249 shutdown_connections 2024-09-13T19:15:48.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:48.040+0000 7f1888f26640 1 -- 172.21.15.53:0/3352792249 wait complete. 2024-09-13T19:15:48.050 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640261 for osd.3 2024-09-13T19:15:48.054 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705668 for osd.0 2024-09-13T19:15:48.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:48.072+0000 7efc099bd640 1 -- 172.21.15.53:0/634826678 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7efc0409d020 con 0x7efc0409bd50 2024-09-13T19:15:48.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:48.073+0000 7efbebfff640 1 -- 172.21.15.53:0/634826678 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efbf403bc50 con 0x7efc0409bd50 2024-09-13T19:15:48.076 INFO:teuthology.orchestra.run.smithi053.stdout:47244640260 2024-09-13T19:15:48.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:48.075+0000 7efc099bd640 1 -- 172.21.15.53:0/634826678 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7efbf0038660 msgr2=0x7efbf003ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:48.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:48.075+0000 7efc099bd640 1 --2- 172.21.15.53:0/634826678 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7efbf0038660 0x7efbf003ab20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7efbf8007fd0 tx=0x7efbf8007ac0 comp rx=0 tx=0).stop 2024-09-13T19:15:48.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:48.075+0000 7efc099bd640 1 -- 172.21.15.53:0/634826678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc0409bd50 msgr2=0x7efc041c3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:48.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:48.075+0000 7efc099bd640 1 --2- 172.21.15.53:0/634826678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc0409bd50 0x7efc041c3900 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efbf4009840 tx=0x7efbf40046c0 comp rx=0 tx=0).stop 2024-09-13T19:15:48.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:48.075+0000 7efc099bd640 1 -- 172.21.15.53:0/634826678 shutdown_connections 2024-09-13T19:15:48.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:48.075+0000 7efc099bd640 1 --2- 172.21.15.53:0/634826678 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7efbf0038660 0x7efbf003ab20 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:48.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:48.075+0000 7efc099bd640 1 --2- 172.21.15.53:0/634826678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc0409bd50 0x7efc041c3900 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:48.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:48.075+0000 7efc099bd640 1 -- 172.21.15.53:0/634826678 >> 172.21.15.53:0/634826678 conn(0x7efc0406d4a0 msgr2=0x7efc0409eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:48.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:48.075+0000 7efc099bd640 1 -- 172.21.15.53:0/634826678 shutdown_connections 2024-09-13T19:15:48.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:48.075+0000 7efc099bd640 1 -- 172.21.15.53:0/634826678 wait complete. 2024-09-13T19:15:48.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:48.082+0000 7fa62e786640 1 -- 172.21.15.53:0/1484116514 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fa62812ead0 con 0x7fa62812e6f0 2024-09-13T19:15:48.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:48.082+0000 7fa624ff9640 1 -- 172.21.15.53:0/1484116514 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa61801a360 con 0x7fa62812e6f0 2024-09-13T19:15:48.085 INFO:teuthology.orchestra.run.smithi053.stdout:47244640260 2024-09-13T19:15:48.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:48.084+0000 7fa62e786640 1 -- 172.21.15.53:0/1484116514 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa614038660 msgr2=0x7fa61403ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:48.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:48.084+0000 7fa62e786640 1 --2- 172.21.15.53:0/1484116514 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa614038660 0x7fa61403ab20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa61c034000 tx=0x7fa61c02e000 comp rx=0 tx=0).stop 2024-09-13T19:15:48.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:48.084+0000 7fa62e786640 1 -- 172.21.15.53:0/1484116514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa62812e6f0 msgr2=0x7fa628131e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:48.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:48.084+0000 7fa62e786640 1 --2- 172.21.15.53:0/1484116514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa62812e6f0 0x7fa628131e00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa61800c340 tx=0x7fa61800c800 comp rx=0 tx=0).stop 2024-09-13T19:15:48.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:48.084+0000 7fa62e786640 1 -- 172.21.15.53:0/1484116514 shutdown_connections 2024-09-13T19:15:48.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:48.084+0000 7fa62e786640 1 --2- 172.21.15.53:0/1484116514 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa614038660 0x7fa61403ab20 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:48.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:48.084+0000 7fa62e786640 1 --2- 172.21.15.53:0/1484116514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa62812e6f0 0x7fa628131e00 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:48.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:48.084+0000 7fa62e786640 1 -- 172.21.15.53:0/1484116514 >> 172.21.15.53:0/1484116514 conn(0x7fa62809f020 msgr2=0x7fa6280974c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:48.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:48.084+0000 7fa62e786640 1 -- 172.21.15.53:0/1484116514 shutdown_connections 2024-09-13T19:15:48.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:48.084+0000 7fa62e786640 1 -- 172.21.15.53:0/1484116514 wait complete. 2024-09-13T19:15:48.089 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640260 for osd.1 2024-09-13T19:15:48.098 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640260 for osd.2 2024-09-13T19:15:49.051 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T19:15:49.055 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T19:15:49.090 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T19:15:49.098 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T19:15:49.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.169+0000 7efc39ca5640 1 Processor -- start 2024-09-13T19:15:49.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.169+0000 7efc39ca5640 1 -- start start 2024-09-13T19:15:49.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.169+0000 7efc39ca5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efc3412c570 0x7efc3412c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:49.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.169+0000 7efc39ca5640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc34131890 con 0x7efc34098a20 2024-09-13T19:15:49.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.169+0000 7efc39ca5640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7efc34098550 con 0x7efc3412c570 2024-09-13T19:15:49.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.170+0000 7efc337fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efc3412c570 0x7efc3412c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:49.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.170+0000 7efc32ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7efc34098a20 0x7efc3412ce90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:34078/0 (socket says 172.21.15.53:34078) 2024-09-13T19:15:49.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.170+0000 7efc32ffd640 1 -- 172.21.15.53:0/3879137335 learned_addr learned my addr 172.21.15.53:0/3879137335 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T19:15:49.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.170+0000 7efc337fe640 1 -- 172.21.15.53:0/3879137335 >> v1:172.21.15.53:6789/0 conn(0x7efc34098a20 legacy=0x7efc3412ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:49.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.170+0000 7efc337fe640 1 -- 172.21.15.53:0/3879137335 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc34132a70 con 0x7efc3412c570 2024-09-13T19:15:49.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.171+0000 7efc337fe640 1 --2- 172.21.15.53:0/3879137335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc3412c570 0x7efc3412c950 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7efc24009720 tx=0x7efc2402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be5385b4c19315bd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:49.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.171+0000 7efc327fc640 1 -- 172.21.15.53:0/3879137335 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc24037070 con 0x7efc3412c570 2024-09-13T19:15:49.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.171+0000 7efc327fc640 1 -- 172.21.15.53:0/3879137335 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc2402ad90 con 0x7efc3412c570 2024-09-13T19:15:49.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.171+0000 7efc327fc640 1 -- 172.21.15.53:0/3879137335 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc24032590 con 0x7efc3412c570 2024-09-13T19:15:49.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.172+0000 7efc39ca5640 1 -- 172.21.15.53:0/3879137335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc3412c570 msgr2=0x7efc3412c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:49.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.172+0000 7efc39ca5640 1 --2- 172.21.15.53:0/3879137335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc3412c570 0x7efc3412c950 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7efc24009720 tx=0x7efc2402a110 comp rx=0 tx=0).stop 2024-09-13T19:15:49.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.172+0000 7efc39ca5640 1 -- 172.21.15.53:0/3879137335 shutdown_connections 2024-09-13T19:15:49.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.172+0000 7efc39ca5640 1 --2- 172.21.15.53:0/3879137335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc3412c570 0x7efc3412c950 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:49.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.172+0000 7efc39ca5640 1 -- 172.21.15.53:0/3879137335 >> 172.21.15.53:0/3879137335 conn(0x7efc3409f020 msgr2=0x7efc3409f430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:49.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.172+0000 7efc39ca5640 1 -- 172.21.15.53:0/3879137335 shutdown_connections 2024-09-13T19:15:49.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.172+0000 7efc39ca5640 1 -- 172.21.15.53:0/3879137335 wait complete. 2024-09-13T19:15:49.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.173+0000 7efc39ca5640 1 Processor -- start 2024-09-13T19:15:49.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.173+0000 7efc39ca5640 1 -- start start 2024-09-13T19:15:49.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.174+0000 7efc39ca5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc34098a20 0x7efc34130800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:49.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.174+0000 7efc39ca5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7efc34131df0 con 0x7efc34098a20 2024-09-13T19:15:49.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.174+0000 7efc337fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc34098a20 0x7efc34130800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:49.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.174+0000 7efc337fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc34098a20 0x7efc34130800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60808/0 (socket says 172.21.15.53:60808) 2024-09-13T19:15:49.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.174+0000 7efc337fe640 1 -- 172.21.15.53:0/1684043112 learned_addr learned my addr 172.21.15.53:0/1684043112 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:15:49.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.174+0000 7efc337fe640 1 -- 172.21.15.53:0/1684043112 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc34073190 con 0x7efc34098a20 2024-09-13T19:15:49.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.174+0000 7efc337fe640 1 --2- 172.21.15.53:0/1684043112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc34098a20 0x7efc34130800 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efc24009720 tx=0x7efc240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:49.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.175+0000 7efc1bfff640 1 -- 172.21.15.53:0/1684043112 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc24041070 con 0x7efc34098a20 2024-09-13T19:15:49.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.175+0000 7efc1bfff640 1 -- 172.21.15.53:0/1684043112 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc2403c460 con 0x7efc34098a20 2024-09-13T19:15:49.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.175+0000 7efc1bfff640 1 -- 172.21.15.53:0/1684043112 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc24037040 con 0x7efc34098a20 2024-09-13T19:15:49.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.175+0000 7efc39ca5640 1 -- 172.21.15.53:0/1684043112 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc3412e810 con 0x7efc34098a20 2024-09-13T19:15:49.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.175+0000 7efc39ca5640 1 -- 172.21.15.53:0/1684043112 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc3412fb60 con 0x7efc34098a20 2024-09-13T19:15:49.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.176+0000 7efc39ca5640 1 -- 172.21.15.53:0/1684043112 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc341322a0 con 0x7efc34098a20 2024-09-13T19:15:49.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.176+0000 7efc1bfff640 1 -- 172.21.15.53:0/1684043112 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7efc24044070 con 0x7efc34098a20 2024-09-13T19:15:49.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.176+0000 7efc1bfff640 1 --2- 172.21.15.53:0/1684043112 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7efc200382a0 0x7efc2003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:49.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.176+0000 7efc1bfff640 1 -- 172.21.15.53:0/1684043112 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7efc2406bcc0 con 0x7efc34098a20 2024-09-13T19:15:49.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.177+0000 7efc32ffd640 1 --2- 172.21.15.53:0/1684043112 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7efc200382a0 0x7efc2003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:49.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.177+0000 7efc32ffd640 1 --2- 172.21.15.53:0/1684043112 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7efc200382a0 0x7efc2003a760 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efc28007fd0 tx=0x7efc28007ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:49.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.185+0000 7efc1bfff640 1 -- 172.21.15.53:0/1684043112 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efc34073190 con 0x7efc34098a20 2024-09-13T19:15:49.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.206+0000 7f6dae8f1640 1 Processor -- start 2024-09-13T19:15:49.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.207+0000 7f6dae8f1640 1 -- start start 2024-09-13T19:15:49.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.207+0000 7f6dae8f1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6da809bd50 0x7f6da809c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:49.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.207+0000 7f6dae8f1640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6da809d3b0 con 0x7f6da809c670 2024-09-13T19:15:49.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.207+0000 7f6dae8f1640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f6da8098230 con 0x7f6da809bd50 2024-09-13T19:15:49.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.207+0000 7f6da7fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6da809bd50 0x7f6da809c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:49.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.207+0000 7f6da7fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6da809bd50 0x7f6da809c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60810/0 (socket says 172.21.15.53:60810) 2024-09-13T19:15:49.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.207+0000 7f6da7fff640 1 -- 172.21.15.53:0/2275891534 learned_addr learned my addr 172.21.15.53:0/2275891534 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:15:49.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.208+0000 7f6da7fff640 1 -- 172.21.15.53:0/2275891534 >> v1:172.21.15.53:6789/0 conn(0x7f6da809c670 legacy=0x7f6da80990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:49.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.208+0000 7f6da7fff640 1 -- 172.21.15.53:0/2275891534 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6da80983e0 con 0x7f6da809bd50 2024-09-13T19:15:49.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.209+0000 7f6da7fff640 1 --2- 172.21.15.53:0/2275891534 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6da809bd50 0x7f6da809c130 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6d980097f0 tx=0x7f6d9802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ef8716275d88c2b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:49.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.209+0000 7f6da6ffd640 1 -- 172.21.15.53:0/2275891534 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d98037070 con 0x7f6da809bd50 2024-09-13T19:15:49.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.209+0000 7f6da6ffd640 1 -- 172.21.15.53:0/2275891534 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d98032440 con 0x7f6da809bd50 2024-09-13T19:15:49.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.209+0000 7f6da6ffd640 1 -- 172.21.15.53:0/2275891534 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d9802ae60 con 0x7f6da809bd50 2024-09-13T19:15:49.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.210+0000 7f6dae8f1640 1 -- 172.21.15.53:0/2275891534 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6da809bd50 msgr2=0x7f6da809c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:49.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.210+0000 7f6dae8f1640 1 --2- 172.21.15.53:0/2275891534 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6da809bd50 0x7f6da809c130 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6d980097f0 tx=0x7f6d9802a1e0 comp rx=0 tx=0).stop 2024-09-13T19:15:49.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.210+0000 7f6dae8f1640 1 -- 172.21.15.53:0/2275891534 shutdown_connections 2024-09-13T19:15:49.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.210+0000 7f6dae8f1640 1 --2- 172.21.15.53:0/2275891534 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6da809bd50 0x7f6da809c130 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:49.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.210+0000 7f6dae8f1640 1 -- 172.21.15.53:0/2275891534 >> 172.21.15.53:0/2275891534 conn(0x7f6da806d4a0 msgr2=0x7f6da806d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:49.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.210+0000 7ff351f3e640 1 Processor -- start 2024-09-13T19:15:49.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.210+0000 7f6dae8f1640 1 -- 172.21.15.53:0/2275891534 shutdown_connections 2024-09-13T19:15:49.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.210+0000 7f6dae8f1640 1 -- 172.21.15.53:0/2275891534 wait complete. 2024-09-13T19:15:49.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.210+0000 7ff351f3e640 1 -- start start 2024-09-13T19:15:49.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.211+0000 7ff351f3e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff34c09a100 0x7ff34c133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:49.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.211+0000 7ff351f3e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff34c09d3b0 con 0x7ff34c09bd50 2024-09-13T19:15:49.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.211+0000 7ff351f3e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7ff34c09c840 con 0x7ff34c09a100 2024-09-13T19:15:49.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.211+0000 7ff34b7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff34c09bd50 0x7ff34c09c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:34094/0 (socket says 172.21.15.53:34094) 2024-09-13T19:15:49.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.211+0000 7ff34b7fe640 1 -- 172.21.15.53:0/1994991968 learned_addr learned my addr 172.21.15.53:0/1994991968 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T19:15:49.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.211+0000 7ff34affd640 1 --2- 172.21.15.53:0/1994991968 >> v2:172.21.15.53:3300/0 conn(0x7ff34c09a100 0x7ff34c133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:49.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.211+0000 7f6dae8f1640 1 Processor -- start 2024-09-13T19:15:49.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.212+0000 7ff34a7fc640 1 -- 172.21.15.53:0/1994991968 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1781827231 0 0) 0x7ff33c001110 con 0x7ff34c09bd50 2024-09-13T19:15:49.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.212+0000 7ff34affd640 1 -- 172.21.15.53:0/1994991968 >> v1:172.21.15.53:6789/0 conn(0x7ff34c09bd50 legacy=0x7ff34c09c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:49.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.212+0000 7f6dae8f1640 1 -- start start 2024-09-13T19:15:49.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.212+0000 7ff34affd640 1 -- 172.21.15.53:0/1994991968 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff34c098230 con 0x7ff34c09a100 2024-09-13T19:15:49.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.212+0000 7f6dae8f1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6da809bd50 0x7f6da81c3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:49.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.212+0000 7f6dae8f1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6da8099b90 con 0x7f6da809bd50 2024-09-13T19:15:49.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.212+0000 7f6da7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6da809bd50 0x7f6da81c3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:49.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.212+0000 7f6da7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6da809bd50 0x7f6da81c3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60820/0 (socket says 172.21.15.53:60820) 2024-09-13T19:15:49.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.212+0000 7f6da7fff640 1 -- 172.21.15.53:0/3258505529 learned_addr learned my addr 172.21.15.53:0/3258505529 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:15:49.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.212+0000 7f6da7fff640 1 -- 172.21.15.53:0/3258505529 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6da81b3080 con 0x7f6da809bd50 2024-09-13T19:15:49.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.213+0000 7f6da7fff640 1 --2- 172.21.15.53:0/3258505529 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6da809bd50 0x7f6da81c3900 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6d980097f0 tx=0x7f6d980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:49.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.213+0000 7ff34affd640 1 --2- 172.21.15.53:0/1994991968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff34c09a100 0x7ff34c133da0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff340009720 tx=0x7ff34002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54638d6bd6268261 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:49.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.213+0000 7f6da4ff9640 1 -- 172.21.15.53:0/3258505529 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d98041070 con 0x7f6da809bd50 2024-09-13T19:15:49.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.213+0000 7f6da4ff9640 1 -- 172.21.15.53:0/3258505529 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d9803c7c0 con 0x7f6da809bd50 2024-09-13T19:15:49.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.213+0000 7ff34a7fc640 1 -- 172.21.15.53:0/1994991968 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff340037070 con 0x7ff34c09a100 2024-09-13T19:15:49.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.213+0000 7ff34a7fc640 1 -- 172.21.15.53:0/1994991968 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff34002ad90 con 0x7ff34c09a100 2024-09-13T19:15:49.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.213+0000 7ff34a7fc640 1 -- 172.21.15.53:0/1994991968 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff340037070 con 0x7ff34c09a100 2024-09-13T19:15:49.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.214+0000 7f6da4ff9640 1 -- 172.21.15.53:0/3258505529 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d98037040 con 0x7f6da809bd50 2024-09-13T19:15:49.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.214+0000 7f6dae8f1640 1 -- 172.21.15.53:0/3258505529 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6da81b4880 con 0x7f6da809bd50 2024-09-13T19:15:49.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.214+0000 7f6dae8f1640 1 -- 172.21.15.53:0/3258505529 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6da81b1a80 con 0x7f6da809bd50 2024-09-13T19:15:49.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.214+0000 7ff351f3e640 1 -- 172.21.15.53:0/1994991968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff34c09a100 msgr2=0x7ff34c133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:49.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.214+0000 7ff351f3e640 1 --2- 172.21.15.53:0/1994991968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff34c09a100 0x7ff34c133da0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff340009720 tx=0x7ff34002a110 comp rx=0 tx=0).stop 2024-09-13T19:15:49.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.215+0000 7f6dae8f1640 1 -- 172.21.15.53:0/3258505529 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6da809a130 con 0x7f6da809bd50 2024-09-13T19:15:49.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.215+0000 7ff351f3e640 1 -- 172.21.15.53:0/1994991968 shutdown_connections 2024-09-13T19:15:49.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.215+0000 7ff351f3e640 1 --2- 172.21.15.53:0/1994991968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff34c09a100 0x7ff34c133da0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:49.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.215+0000 7ff351f3e640 1 -- 172.21.15.53:0/1994991968 >> 172.21.15.53:0/1994991968 conn(0x7ff34c06d4a0 msgr2=0x7ff34c06d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:49.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.215+0000 7f6da4ff9640 1 -- 172.21.15.53:0/3258505529 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6d98044070 con 0x7f6da809bd50 2024-09-13T19:15:49.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.215+0000 7ff351f3e640 1 -- 172.21.15.53:0/1994991968 shutdown_connections 2024-09-13T19:15:49.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.215+0000 7ff351f3e640 1 -- 172.21.15.53:0/1994991968 wait complete. 2024-09-13T19:15:49.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.215+0000 7f6da4ff9640 1 --2- 172.21.15.53:0/3258505529 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6d940382d0 0x7f6d9403a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:49.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.215+0000 7f6da4ff9640 1 -- 172.21.15.53:0/3258505529 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f6d9806bf10 con 0x7f6da809bd50 2024-09-13T19:15:49.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.215+0000 7f6da77fe640 1 --2- 172.21.15.53:0/3258505529 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6d940382d0 0x7f6d9403a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:49.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.216+0000 7f6da77fe640 1 --2- 172.21.15.53:0/3258505529 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6d940382d0 0x7f6d9403a790 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6da809cac0 tx=0x7f6d9c007a50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:49.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.216+0000 7ff351f3e640 1 Processor -- start 2024-09-13T19:15:49.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.217+0000 7ff351f3e640 1 -- start start 2024-09-13T19:15:49.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.218+0000 7ff351f3e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff34c09a100 0x7ff34c1329b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:49.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.218+0000 7ff351f3e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff34c134670 con 0x7ff34c09a100 2024-09-13T19:15:49.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.218+0000 7ff34b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff34c09a100 0x7ff34c1329b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:49.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.218+0000 7ff34b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff34c09a100 0x7ff34c1329b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60836/0 (socket says 172.21.15.53:60836) 2024-09-13T19:15:49.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.218+0000 7ff34b7fe640 1 -- 172.21.15.53:0/2411955560 learned_addr learned my addr 172.21.15.53:0/2411955560 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:15:49.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.218+0000 7ff34b7fe640 1 -- 172.21.15.53:0/2411955560 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff34c096a30 con 0x7ff34c09a100 2024-09-13T19:15:49.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.218+0000 7ff34b7fe640 1 --2- 172.21.15.53:0/2411955560 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff34c09a100 0x7ff34c1329b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff33c00c700 tx=0x7ff33c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:49.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.221+0000 7ff333fff640 1 -- 172.21.15.53:0/2411955560 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff33c018070 con 0x7ff34c09a100 2024-09-13T19:15:49.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.221+0000 7ff333fff640 1 -- 172.21.15.53:0/2411955560 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff33c0070d0 con 0x7ff34c09a100 2024-09-13T19:15:49.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.221+0000 7ff333fff640 1 -- 172.21.15.53:0/2411955560 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff33c0073f0 con 0x7ff34c09a100 2024-09-13T19:15:49.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.221+0000 7ff351f3e640 1 -- 172.21.15.53:0/2411955560 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff34c1340e0 con 0x7ff34c09a100 2024-09-13T19:15:49.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.221+0000 7ff351f3e640 1 -- 172.21.15.53:0/2411955560 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff34c097480 con 0x7ff34c09a100 2024-09-13T19:15:49.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.221+0000 7f6da4ff9640 1 -- 172.21.15.53:0/3258505529 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6da81b3080 con 0x7f6da809bd50 2024-09-13T19:15:49.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.222+0000 7ff333fff640 1 -- 172.21.15.53:0/2411955560 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff33c01b070 con 0x7ff34c09a100 2024-09-13T19:15:49.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.222+0000 7ff351f3e640 1 -- 172.21.15.53:0/2411955560 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff34c0967f0 con 0x7ff34c09a100 2024-09-13T19:15:49.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.223+0000 7ff333fff640 1 --2- 172.21.15.53:0/2411955560 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff3380382a0 0x7ff33803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:49.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.223+0000 7ff333fff640 1 -- 172.21.15.53:0/2411955560 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7ff33c04a6b0 con 0x7ff34c09a100 2024-09-13T19:15:49.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.223+0000 7ff34affd640 1 --2- 172.21.15.53:0/2411955560 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff3380382a0 0x7ff33803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:49.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.223+0000 7ff34affd640 1 --2- 172.21.15.53:0/2411955560 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff3380382a0 0x7ff33803a760 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff340034000 tx=0x7ff34002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:49.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.232+0000 7ff333fff640 1 -- 172.21.15.53:0/2411955560 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff34c09d3b0 con 0x7ff34c09a100 2024-09-13T19:15:49.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.248+0000 7f79a2e0a640 1 Processor -- start 2024-09-13T19:15:49.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.248+0000 7f79a2e0a640 1 -- start start 2024-09-13T19:15:49.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.249+0000 7f79a2e0a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f799c096630 0x7f799c096a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:49.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.249+0000 7f79a2e0a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f799c0702f0 con 0x7f799c06d910 2024-09-13T19:15:49.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.249+0000 7f79a2e0a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f799c06f1f0 con 0x7f799c096630 2024-09-13T19:15:49.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.249+0000 7f79a0ba6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f799c096630 0x7f799c096a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:49.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.249+0000 7f799bfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f799c06d910 0x7f799c06dd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:34104/0 (socket says 172.21.15.53:34104) 2024-09-13T19:15:49.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.249+0000 7f799bfff640 1 -- 172.21.15.53:0/2816840160 learned_addr learned my addr 172.21.15.53:0/2816840160 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T19:15:49.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.249+0000 7f79a0ba6640 1 -- 172.21.15.53:0/2816840160 >> v1:172.21.15.53:6789/0 conn(0x7f799c06d910 legacy=0x7f799c06dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:49.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.249+0000 7f79a0ba6640 1 -- 172.21.15.53:0/2816840160 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f799c06fb80 con 0x7f799c096630 2024-09-13T19:15:49.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.250+0000 7f79a0ba6640 1 --2- 172.21.15.53:0/2816840160 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f799c096630 0x7f799c096a10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7990009720 tx=0x7f799002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac2753b96338dde6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:49.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.250+0000 7f799b7fe640 1 -- 172.21.15.53:0/2816840160 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7990037070 con 0x7f799c096630 2024-09-13T19:15:49.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.250+0000 7f799b7fe640 1 -- 172.21.15.53:0/2816840160 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f799002ad90 con 0x7f799c096630 2024-09-13T19:15:49.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.250+0000 7f799b7fe640 1 -- 172.21.15.53:0/2816840160 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7990032590 con 0x7f799c096630 2024-09-13T19:15:49.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.251+0000 7f79a2e0a640 1 -- 172.21.15.53:0/2816840160 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f799c096630 msgr2=0x7f799c096a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:49.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.251+0000 7f79a2e0a640 1 --2- 172.21.15.53:0/2816840160 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f799c096630 0x7f799c096a10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7990009720 tx=0x7f799002a110 comp rx=0 tx=0).stop 2024-09-13T19:15:49.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.251+0000 7f79a2e0a640 1 -- 172.21.15.53:0/2816840160 shutdown_connections 2024-09-13T19:15:49.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.251+0000 7f79a2e0a640 1 --2- 172.21.15.53:0/2816840160 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f799c096630 0x7f799c096a10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:49.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.251+0000 7f79a2e0a640 1 -- 172.21.15.53:0/2816840160 >> 172.21.15.53:0/2816840160 conn(0x7f799c09a890 msgr2=0x7f799c09aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:49.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.251+0000 7f79a2e0a640 1 -- 172.21.15.53:0/2816840160 shutdown_connections 2024-09-13T19:15:49.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.251+0000 7f79a2e0a640 1 -- 172.21.15.53:0/2816840160 wait complete. 2024-09-13T19:15:49.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.252+0000 7f79a2e0a640 1 Processor -- start 2024-09-13T19:15:49.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.252+0000 7f79a2e0a640 1 -- start start 2024-09-13T19:15:49.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.252+0000 7f79a2e0a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f799c06d910 0x7f799c08c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:49.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.252+0000 7f79a2e0a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f799c06d410 con 0x7f799c06d910 2024-09-13T19:15:49.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.253+0000 7f79a0ba6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f799c06d910 0x7f799c08c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:49.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.253+0000 7f79a0ba6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f799c06d910 0x7f799c08c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60846/0 (socket says 172.21.15.53:60846) 2024-09-13T19:15:49.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.253+0000 7f79a0ba6640 1 -- 172.21.15.53:0/193776985 learned_addr learned my addr 172.21.15.53:0/193776985 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:15:49.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.253+0000 7f79a0ba6640 1 -- 172.21.15.53:0/193776985 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f799c08db10 con 0x7f799c06d910 2024-09-13T19:15:49.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.253+0000 7f79a0ba6640 1 --2- 172.21.15.53:0/193776985 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f799c06d910 0x7f799c08c090 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7990009720 tx=0x7f79900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:49.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.253+0000 7f79997fa640 1 -- 172.21.15.53:0/193776985 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7990041020 con 0x7f799c06d910 2024-09-13T19:15:49.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.253+0000 7f79a2e0a640 1 -- 172.21.15.53:0/193776985 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f799c08ec00 con 0x7f799c06d910 2024-09-13T19:15:49.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.253+0000 7f79997fa640 1 -- 172.21.15.53:0/193776985 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f799003d550 con 0x7f799c06d910 2024-09-13T19:15:49.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.253+0000 7f79a2e0a640 1 -- 172.21.15.53:0/193776985 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f799c08f370 con 0x7f799c06d910 2024-09-13T19:15:49.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.254+0000 7f79997fa640 1 -- 172.21.15.53:0/193776985 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7990037040 con 0x7f799c06d910 2024-09-13T19:15:49.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.254+0000 7f79997fa640 1 -- 172.21.15.53:0/193776985 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7990044020 con 0x7f799c06d910 2024-09-13T19:15:49.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.255+0000 7f79a2e0a640 1 -- 172.21.15.53:0/193776985 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f799c08dce0 con 0x7f799c06d910 2024-09-13T19:15:49.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.255+0000 7f79997fa640 1 --2- 172.21.15.53:0/193776985 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7980038250 0x7f798003a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:49.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.255+0000 7f79997fa640 1 -- 172.21.15.53:0/193776985 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f799006bb00 con 0x7f799c06d910 2024-09-13T19:15:49.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.255+0000 7f799bfff640 1 --2- 172.21.15.53:0/193776985 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7980038250 0x7f798003a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:49.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.255+0000 7f799bfff640 1 --2- 172.21.15.53:0/193776985 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7980038250 0x7f798003a710 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7988000f60 tx=0x7f7988007a80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:49.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.264+0000 7f79997fa640 1 -- 172.21.15.53:0/193776985 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f799004b030 con 0x7f799c06d910 2024-09-13T19:15:49.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.398+0000 7efc39ca5640 1 -- 172.21.15.53:0/1684043112 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7efc3412f880 con 0x7efc34098a20 2024-09-13T19:15:49.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.398+0000 7efc1bfff640 1 -- 172.21.15.53:0/1684043112 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efc2403a520 con 0x7efc34098a20 2024-09-13T19:15:49.401 INFO:teuthology.orchestra.run.smithi053.stdout:47244640261 2024-09-13T19:15:49.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.400+0000 7efc39ca5640 1 -- 172.21.15.53:0/1684043112 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7efc200382a0 msgr2=0x7efc2003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:49.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.400+0000 7efc39ca5640 1 --2- 172.21.15.53:0/1684043112 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7efc200382a0 0x7efc2003a760 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efc28007fd0 tx=0x7efc28007ac0 comp rx=0 tx=0).stop 2024-09-13T19:15:49.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.400+0000 7efc39ca5640 1 -- 172.21.15.53:0/1684043112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc34098a20 msgr2=0x7efc34130800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:49.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.400+0000 7efc39ca5640 1 --2- 172.21.15.53:0/1684043112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc34098a20 0x7efc34130800 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efc24009720 tx=0x7efc240046c0 comp rx=0 tx=0).stop 2024-09-13T19:15:49.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.400+0000 7efc39ca5640 1 -- 172.21.15.53:0/1684043112 shutdown_connections 2024-09-13T19:15:49.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.400+0000 7efc39ca5640 1 --2- 172.21.15.53:0/1684043112 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7efc200382a0 0x7efc2003a760 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:49.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.400+0000 7efc39ca5640 1 --2- 172.21.15.53:0/1684043112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc34098a20 0x7efc34130800 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:49.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.400+0000 7efc39ca5640 1 -- 172.21.15.53:0/1684043112 >> 172.21.15.53:0/1684043112 conn(0x7efc3409f020 msgr2=0x7efc34099600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:49.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.401+0000 7efc39ca5640 1 -- 172.21.15.53:0/1684043112 shutdown_connections 2024-09-13T19:15:49.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.401+0000 7efc39ca5640 1 -- 172.21.15.53:0/1684043112 wait complete. 2024-09-13T19:15:49.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.411+0000 7f6dae8f1640 1 -- 172.21.15.53:0/3258505529 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f6da809d020 con 0x7f6da809bd50 2024-09-13T19:15:49.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.411+0000 7f6da4ff9640 1 -- 172.21.15.53:0/3258505529 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6d9806ada0 con 0x7f6da809bd50 2024-09-13T19:15:49.414 INFO:teuthology.orchestra.run.smithi053.stdout:47244640260 2024-09-13T19:15:49.415 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640261 for osd.3 2024-09-13T19:15:49.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.413+0000 7f6dae8f1640 1 -- 172.21.15.53:0/3258505529 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6d940382d0 msgr2=0x7f6d9403a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:49.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.413+0000 7f6dae8f1640 1 --2- 172.21.15.53:0/3258505529 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6d940382d0 0x7f6d9403a790 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6da809cac0 tx=0x7f6d9c007a50 comp rx=0 tx=0).stop 2024-09-13T19:15:49.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.413+0000 7f6dae8f1640 1 -- 172.21.15.53:0/3258505529 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6da809bd50 msgr2=0x7f6da81c3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:49.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.413+0000 7f6dae8f1640 1 --2- 172.21.15.53:0/3258505529 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6da809bd50 0x7f6da81c3900 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6d980097f0 tx=0x7f6d980046c0 comp rx=0 tx=0).stop 2024-09-13T19:15:49.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.413+0000 7f6dae8f1640 1 -- 172.21.15.53:0/3258505529 shutdown_connections 2024-09-13T19:15:49.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.413+0000 7f6dae8f1640 1 --2- 172.21.15.53:0/3258505529 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6d940382d0 0x7f6d9403a790 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:49.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.413+0000 7f6dae8f1640 1 --2- 172.21.15.53:0/3258505529 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6da809bd50 0x7f6da81c3900 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:49.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.413+0000 7f6dae8f1640 1 -- 172.21.15.53:0/3258505529 >> 172.21.15.53:0/3258505529 conn(0x7f6da806d4a0 msgr2=0x7f6da809eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:49.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.414+0000 7f6dae8f1640 1 -- 172.21.15.53:0/3258505529 shutdown_connections 2024-09-13T19:15:49.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.414+0000 7f6dae8f1640 1 -- 172.21.15.53:0/3258505529 wait complete. 2024-09-13T19:15:49.427 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640260 for osd.1 2024-09-13T19:15:49.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.442+0000 7ff351f3e640 1 -- 172.21.15.53:0/2411955560 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7ff34c1261e0 con 0x7ff34c09a100 2024-09-13T19:15:49.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.442+0000 7ff333fff640 1 -- 172.21.15.53:0/2411955560 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff33c004890 con 0x7ff34c09a100 2024-09-13T19:15:49.445 INFO:teuthology.orchestra.run.smithi053.stdout:38654705668 2024-09-13T19:15:49.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.442+0000 7f79a2e0a640 1 -- 172.21.15.53:0/193776985 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f799c08f710 con 0x7f799c06d910 2024-09-13T19:15:49.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.443+0000 7f79997fa640 1 -- 172.21.15.53:0/193776985 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f79900457b0 con 0x7f799c06d910 2024-09-13T19:15:49.446 INFO:teuthology.orchestra.run.smithi053.stdout:47244640260 2024-09-13T19:15:49.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.444+0000 7ff351f3e640 1 -- 172.21.15.53:0/2411955560 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff3380382a0 msgr2=0x7ff33803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:49.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.444+0000 7ff351f3e640 1 --2- 172.21.15.53:0/2411955560 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff3380382a0 0x7ff33803a760 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff340034000 tx=0x7ff34002e000 comp rx=0 tx=0).stop 2024-09-13T19:15:49.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.444+0000 7ff351f3e640 1 -- 172.21.15.53:0/2411955560 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff34c09a100 msgr2=0x7ff34c1329b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:49.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.444+0000 7ff351f3e640 1 --2- 172.21.15.53:0/2411955560 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff34c09a100 0x7ff34c1329b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff33c00c700 tx=0x7ff33c00cbc0 comp rx=0 tx=0).stop 2024-09-13T19:15:49.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.444+0000 7ff351f3e640 1 -- 172.21.15.53:0/2411955560 shutdown_connections 2024-09-13T19:15:49.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.444+0000 7ff351f3e640 1 --2- 172.21.15.53:0/2411955560 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff3380382a0 0x7ff33803a760 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:49.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.444+0000 7ff351f3e640 1 --2- 172.21.15.53:0/2411955560 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff34c09a100 0x7ff34c1329b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:49.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.444+0000 7ff351f3e640 1 -- 172.21.15.53:0/2411955560 >> 172.21.15.53:0/2411955560 conn(0x7ff34c06d4a0 msgr2=0x7ff34c08d720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:49.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.444+0000 7ff351f3e640 1 -- 172.21.15.53:0/2411955560 shutdown_connections 2024-09-13T19:15:49.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.444+0000 7ff351f3e640 1 -- 172.21.15.53:0/2411955560 wait complete. 2024-09-13T19:15:49.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.445+0000 7f79a2e0a640 1 -- 172.21.15.53:0/193776985 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7980038250 msgr2=0x7f798003a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:49.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.445+0000 7f79a2e0a640 1 --2- 172.21.15.53:0/193776985 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7980038250 0x7f798003a710 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7988000f60 tx=0x7f7988007a80 comp rx=0 tx=0).stop 2024-09-13T19:15:49.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.445+0000 7f79a2e0a640 1 -- 172.21.15.53:0/193776985 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f799c06d910 msgr2=0x7f799c08c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:49.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.445+0000 7f79a2e0a640 1 --2- 172.21.15.53:0/193776985 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f799c06d910 0x7f799c08c090 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7990009720 tx=0x7f79900046c0 comp rx=0 tx=0).stop 2024-09-13T19:15:49.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.445+0000 7f79a2e0a640 1 -- 172.21.15.53:0/193776985 shutdown_connections 2024-09-13T19:15:49.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.445+0000 7f79a2e0a640 1 --2- 172.21.15.53:0/193776985 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7980038250 0x7f798003a710 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:49.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.445+0000 7f79a2e0a640 1 --2- 172.21.15.53:0/193776985 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f799c06d910 0x7f799c08c090 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:49.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.445+0000 7f79a2e0a640 1 -- 172.21.15.53:0/193776985 >> 172.21.15.53:0/193776985 conn(0x7f799c09a890 msgr2=0x7f799c097390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:49.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.445+0000 7f79a2e0a640 1 -- 172.21.15.53:0/193776985 shutdown_connections 2024-09-13T19:15:49.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:49.445+0000 7f79a2e0a640 1 -- 172.21.15.53:0/193776985 wait complete. 2024-09-13T19:15:49.458 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705668 for osd.0 2024-09-13T19:15:49.459 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640260 for osd.2 2024-09-13T19:15:50.416 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T19:15:50.428 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T19:15:50.459 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T19:15:50.459 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T19:15:50.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.534+0000 7f68b1b4b640 1 Processor -- start 2024-09-13T19:15:50.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.534+0000 7f68b1b4b640 1 -- start start 2024-09-13T19:15:50.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.534+0000 7f68b1b4b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f68ac09bd50 0x7f68ac09c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:50.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.534+0000 7f68b1b4b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68ac09d3b0 con 0x7f68ac09c670 2024-09-13T19:15:50.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.534+0000 7f68b1b4b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f68ac098230 con 0x7f68ac09bd50 2024-09-13T19:15:50.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.534+0000 7f68ab7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f68ac09bd50 0x7f68ac09c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:50.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.534+0000 7f68aaffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f68ac09c670 0x7f68ac0990f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:34112/0 (socket says 172.21.15.53:34112) 2024-09-13T19:15:50.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.534+0000 7f68aaffd640 1 -- 172.21.15.53:0/3656098883 learned_addr learned my addr 172.21.15.53:0/3656098883 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T19:15:50.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.535+0000 7f68ab7fe640 1 -- 172.21.15.53:0/3656098883 >> v1:172.21.15.53:6789/0 conn(0x7f68ac09c670 legacy=0x7f68ac0990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:50.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.535+0000 7f68ab7fe640 1 -- 172.21.15.53:0/3656098883 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68ac0983e0 con 0x7f68ac09bd50 2024-09-13T19:15:50.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.535+0000 7f68aa7fc640 1 -- 172.21.15.53:0/3656098883 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2503625630 0 0) 0x7f68a0001110 con 0x7f68ac09c670 2024-09-13T19:15:50.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.536+0000 7f68ab7fe640 1 --2- 172.21.15.53:0/3656098883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68ac09bd50 0x7f68ac09c130 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f689c009720 tx=0x7f689c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bf208f26e8d191a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:50.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.536+0000 7f68aa7fc640 1 -- 172.21.15.53:0/3656098883 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f689c037070 con 0x7f68ac09bd50 2024-09-13T19:15:50.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.536+0000 7f68aa7fc640 1 -- 172.21.15.53:0/3656098883 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f689c02ad90 con 0x7f68ac09bd50 2024-09-13T19:15:50.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.536+0000 7f68aa7fc640 1 -- 172.21.15.53:0/3656098883 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f689c032590 con 0x7f68ac09bd50 2024-09-13T19:15:50.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.537+0000 7f68b1b4b640 1 -- 172.21.15.53:0/3656098883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68ac09bd50 msgr2=0x7f68ac09c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:50.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.537+0000 7f68b1b4b640 1 --2- 172.21.15.53:0/3656098883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68ac09bd50 0x7f68ac09c130 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f689c009720 tx=0x7f689c02a110 comp rx=0 tx=0).stop 2024-09-13T19:15:50.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.537+0000 7f68b1b4b640 1 -- 172.21.15.53:0/3656098883 shutdown_connections 2024-09-13T19:15:50.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.537+0000 7f68b1b4b640 1 --2- 172.21.15.53:0/3656098883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68ac09bd50 0x7f68ac09c130 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:50.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.537+0000 7f68b1b4b640 1 -- 172.21.15.53:0/3656098883 >> 172.21.15.53:0/3656098883 conn(0x7f68ac06d4a0 msgr2=0x7f68ac06d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:50.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.537+0000 7f68b1b4b640 1 -- 172.21.15.53:0/3656098883 shutdown_connections 2024-09-13T19:15:50.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.537+0000 7f68b1b4b640 1 -- 172.21.15.53:0/3656098883 wait complete. 2024-09-13T19:15:50.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.538+0000 7f68b1b4b640 1 Processor -- start 2024-09-13T19:15:50.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.539+0000 7f68b1b4b640 1 -- start start 2024-09-13T19:15:50.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.539+0000 7f68b1b4b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68ac09c670 0x7f68ac1bff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:50.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.539+0000 7f68b1b4b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f68ac099b90 con 0x7f68ac09c670 2024-09-13T19:15:50.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.540+0000 7f68ab7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68ac09c670 0x7f68ac1bff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:50.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.540+0000 7f68ab7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68ac09c670 0x7f68ac1bff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60866/0 (socket says 172.21.15.53:60866) 2024-09-13T19:15:50.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.540+0000 7f68ab7fe640 1 -- 172.21.15.53:0/2527328062 learned_addr learned my addr 172.21.15.53:0/2527328062 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:15:50.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.540+0000 7f68ab7fe640 1 -- 172.21.15.53:0/2527328062 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68ac094d70 con 0x7f68ac09c670 2024-09-13T19:15:50.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.540+0000 7f68ab7fe640 1 --2- 172.21.15.53:0/2527328062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68ac09c670 0x7f68ac1bff80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f689c02a150 tx=0x7f689c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:50.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.540+0000 7f6893fff640 1 -- 172.21.15.53:0/2527328062 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f689c041070 con 0x7f68ac09c670 2024-09-13T19:15:50.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.540+0000 7f6893fff640 1 -- 172.21.15.53:0/2527328062 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f689c03c460 con 0x7f68ac09c670 2024-09-13T19:15:50.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.540+0000 7f68b1b4b640 1 -- 172.21.15.53:0/2527328062 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68ac096d60 con 0x7f68ac09c670 2024-09-13T19:15:50.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.540+0000 7f6893fff640 1 -- 172.21.15.53:0/2527328062 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f689c037040 con 0x7f68ac09c670 2024-09-13T19:15:50.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.541+0000 7f68b1b4b640 1 -- 172.21.15.53:0/2527328062 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68ac0960e0 con 0x7f68ac09c670 2024-09-13T19:15:50.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.542+0000 7f68b1b4b640 1 -- 172.21.15.53:0/2527328062 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68ac09a130 con 0x7f68ac09c670 2024-09-13T19:15:50.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.542+0000 7f6893fff640 1 -- 172.21.15.53:0/2527328062 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f689c044070 con 0x7f68ac09c670 2024-09-13T19:15:50.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.542+0000 7f6893fff640 1 --2- 172.21.15.53:0/2527328062 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f68980382d0 0x7f689803a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:50.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.542+0000 7f6893fff640 1 -- 172.21.15.53:0/2527328062 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f689c06bd20 con 0x7f68ac09c670 2024-09-13T19:15:50.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.543+0000 7f68aaffd640 1 --2- 172.21.15.53:0/2527328062 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f68980382d0 0x7f689803a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:50.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.543+0000 7f68aaffd640 1 --2- 172.21.15.53:0/2527328062 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f68980382d0 0x7f689803a790 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f68a0000c00 tx=0x7f68a0001250 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:50.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.547+0000 7f6893fff640 1 -- 172.21.15.53:0/2527328062 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f689c070070 con 0x7f68ac09c670 2024-09-13T19:15:50.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.572+0000 7f6a21753640 1 Processor -- start 2024-09-13T19:15:50.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.572+0000 7f6a21753640 1 -- start start 2024-09-13T19:15:50.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.572+0000 7f5828733640 1 Processor -- start 2024-09-13T19:15:50.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.573+0000 7f5828733640 1 -- start start 2024-09-13T19:15:50.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.573+0000 7f6a21753640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6a1c096a10 0x7f6a1c06e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:50.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.573+0000 7f6a21753640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a1c0702f0 con 0x7f6a1c096630 2024-09-13T19:15:50.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.573+0000 7f6a21753640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f6a1c096e20 con 0x7f6a1c096a10 2024-09-13T19:15:50.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.573+0000 7f6a1affd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f6a1c096630 0x7f6a1c06d910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:34118/0 (socket says 172.21.15.53:34118) 2024-09-13T19:15:50.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.573+0000 7f6a1affd640 1 -- 172.21.15.53:0/3721753439 learned_addr learned my addr 172.21.15.53:0/3721753439 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T19:15:50.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.573+0000 7f6a1a7fc640 1 --2- 172.21.15.53:0/3721753439 >> v2:172.21.15.53:3300/0 conn(0x7f6a1c096a10 0x7f6a1c06e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:50.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.573+0000 7f6a19ffb640 1 -- 172.21.15.53:0/3721753439 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 98919875 0 0) 0x7f6a1c0702f0 con 0x7f6a1c096630 2024-09-13T19:15:50.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.573+0000 7f6a1a7fc640 1 -- 172.21.15.53:0/3721753439 >> v1:172.21.15.53:6789/0 conn(0x7f6a1c096630 legacy=0x7f6a1c06d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:50.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.573+0000 7f6a1a7fc640 1 -- 172.21.15.53:0/3721753439 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a1c06f1f0 con 0x7f6a1c096a10 2024-09-13T19:15:50.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.573+0000 7f5828733640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f582006f290 0x7f5820133eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:50.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.573+0000 7f5828733640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f582006be10 con 0x7f582006e7a0 2024-09-13T19:15:50.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.573+0000 7f5828733640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f582006ffb0 con 0x7f582006f290 2024-09-13T19:15:50.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.573+0000 7f5825cce640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f582006f290 0x7f5820133eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:50.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.573+0000 7f58264cf640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f582006e7a0 0x7f582006eb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:34128/0 (socket says 172.21.15.53:34128) 2024-09-13T19:15:50.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.574+0000 7f58264cf640 1 -- 172.21.15.53:0/3432913185 learned_addr learned my addr 172.21.15.53:0/3432913185 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T19:15:50.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.574+0000 7f5825cce640 1 -- 172.21.15.53:0/3432913185 >> v1:172.21.15.53:6789/0 conn(0x7f582006e7a0 legacy=0x7f582006eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:50.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.574+0000 7f5825cce640 1 -- 172.21.15.53:0/3432913185 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f582006c470 con 0x7f582006f290 2024-09-13T19:15:50.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.574+0000 7f6a1a7fc640 1 --2- 172.21.15.53:0/3721753439 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a1c096a10 0x7f6a1c06e020 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6a10009720 tx=0x7f6a1002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95afc43336377679 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:50.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.575+0000 7f5825cce640 1 --2- 172.21.15.53:0/3432913185 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f582006f290 0x7f5820133eb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5810009720 tx=0x7f581002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a3a4152e445be24 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:50.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.575+0000 7f6a19ffb640 1 -- 172.21.15.53:0/3721753439 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a10037070 con 0x7f6a1c096a10 2024-09-13T19:15:50.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.575+0000 7f6a19ffb640 1 -- 172.21.15.53:0/3721753439 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a1002ad90 con 0x7f6a1c096a10 2024-09-13T19:15:50.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.575+0000 7f58254cd640 1 -- 172.21.15.53:0/3432913185 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5810037070 con 0x7f582006f290 2024-09-13T19:15:50.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.575+0000 7f58254cd640 1 -- 172.21.15.53:0/3432913185 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f581002ad90 con 0x7f582006f290 2024-09-13T19:15:50.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.575+0000 7f58254cd640 1 -- 172.21.15.53:0/3432913185 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5810032590 con 0x7f582006f290 2024-09-13T19:15:50.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.576+0000 7f5828733640 1 -- 172.21.15.53:0/3432913185 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f582006f290 msgr2=0x7f5820133eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:50.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.576+0000 7f5828733640 1 --2- 172.21.15.53:0/3432913185 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f582006f290 0x7f5820133eb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5810009720 tx=0x7f581002a110 comp rx=0 tx=0).stop 2024-09-13T19:15:50.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.576+0000 7f6a19ffb640 1 -- 172.21.15.53:0/3721753439 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a10037070 con 0x7f6a1c096a10 2024-09-13T19:15:50.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.576+0000 7f6a21753640 1 -- 172.21.15.53:0/3721753439 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a1c096a10 msgr2=0x7f6a1c06e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:50.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.576+0000 7f6a21753640 1 --2- 172.21.15.53:0/3721753439 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a1c096a10 0x7f6a1c06e020 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6a10009720 tx=0x7f6a1002a110 comp rx=0 tx=0).stop 2024-09-13T19:15:50.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.576+0000 7f5828733640 1 -- 172.21.15.53:0/3432913185 shutdown_connections 2024-09-13T19:15:50.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.576+0000 7f5828733640 1 --2- 172.21.15.53:0/3432913185 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f582006f290 0x7f5820133eb0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:50.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.576+0000 7f5828733640 1 -- 172.21.15.53:0/3432913185 >> 172.21.15.53:0/3432913185 conn(0x7f582009ac20 msgr2=0x7f582006d080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:50.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.576+0000 7f6a21753640 1 -- 172.21.15.53:0/3721753439 shutdown_connections 2024-09-13T19:15:50.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.576+0000 7f5828733640 1 -- 172.21.15.53:0/3432913185 shutdown_connections 2024-09-13T19:15:50.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.576+0000 7f6a21753640 1 --2- 172.21.15.53:0/3721753439 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a1c096a10 0x7f6a1c06e020 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:50.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.576+0000 7f6a21753640 1 -- 172.21.15.53:0/3721753439 >> 172.21.15.53:0/3721753439 conn(0x7f6a1c09a890 msgr2=0x7f6a1c09aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:50.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.576+0000 7f5828733640 1 -- 172.21.15.53:0/3432913185 wait complete. 2024-09-13T19:15:50.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.576+0000 7f6a21753640 1 -- 172.21.15.53:0/3721753439 shutdown_connections 2024-09-13T19:15:50.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.576+0000 7f6a21753640 1 -- 172.21.15.53:0/3721753439 wait complete. 2024-09-13T19:15:50.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.577+0000 7f5828733640 1 Processor -- start 2024-09-13T19:15:50.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.577+0000 7f5828733640 1 -- start start 2024-09-13T19:15:50.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.577+0000 7f6a21753640 1 Processor -- start 2024-09-13T19:15:50.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.577+0000 7f6a21753640 1 -- start start 2024-09-13T19:15:50.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.578+0000 7f5828733640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f582006e7a0 0x7f582012eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:50.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.578+0000 7f5828733640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f582009b4d0 con 0x7f582006e7a0 2024-09-13T19:15:50.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.578+0000 7f6a21753640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a1c096630 0x7f6a1c124f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:50.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.578+0000 7f6a21753640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1c06e6e0 con 0x7f6a1c096630 2024-09-13T19:15:50.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.578+0000 7f58264cf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f582006e7a0 0x7f582012eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:50.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.578+0000 7f58264cf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f582006e7a0 0x7f582012eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60886/0 (socket says 172.21.15.53:60886) 2024-09-13T19:15:50.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.578+0000 7f58264cf640 1 -- 172.21.15.53:0/4048914793 learned_addr learned my addr 172.21.15.53:0/4048914793 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:15:50.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.578+0000 7f6a1affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a1c096630 0x7f6a1c124f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:50.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.578+0000 7f6a1affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a1c096630 0x7f6a1c124f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60898/0 (socket says 172.21.15.53:60898) 2024-09-13T19:15:50.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.578+0000 7f6a1affd640 1 -- 172.21.15.53:0/202742648 learned_addr learned my addr 172.21.15.53:0/202742648 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:15:50.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.578+0000 7f6a1affd640 1 -- 172.21.15.53:0/202742648 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a1c127c20 con 0x7f6a1c096630 2024-09-13T19:15:50.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.578+0000 7f58264cf640 1 -- 172.21.15.53:0/4048914793 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5820096ab0 con 0x7f582006e7a0 2024-09-13T19:15:50.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.578+0000 7f6a1affd640 1 --2- 172.21.15.53:0/202742648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a1c096630 0x7f6a1c124f70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c00c420 tx=0x7f6a0c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:50.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.578+0000 7f58264cf640 1 --2- 172.21.15.53:0/4048914793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f582006e7a0 0x7f582012eee0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f581c00c4a0 tx=0x7f581c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:50.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.579+0000 7f5816ffd640 1 -- 172.21.15.53:0/4048914793 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f581c017070 con 0x7f582006e7a0 2024-09-13T19:15:50.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.579+0000 7f5828733640 1 -- 172.21.15.53:0/4048914793 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5820094f60 con 0x7f582006e7a0 2024-09-13T19:15:50.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.579+0000 7f5816ffd640 1 -- 172.21.15.53:0/4048914793 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f581c005c10 con 0x7f582006e7a0 2024-09-13T19:15:50.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.579+0000 7f5816ffd640 1 -- 172.21.15.53:0/4048914793 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f581c017070 con 0x7f582006e7a0 2024-09-13T19:15:50.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.579+0000 7f5828733640 1 -- 172.21.15.53:0/4048914793 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f582012f420 con 0x7f582006e7a0 2024-09-13T19:15:50.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.579+0000 7f6a037fe640 1 -- 172.21.15.53:0/202742648 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a0c018070 con 0x7f6a1c096630 2024-09-13T19:15:50.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.579+0000 7f6a037fe640 1 -- 172.21.15.53:0/202742648 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a0c0074d0 con 0x7f6a1c096630 2024-09-13T19:15:50.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.579+0000 7f6a037fe640 1 -- 172.21.15.53:0/202742648 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a0c004950 con 0x7f6a1c096630 2024-09-13T19:15:50.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.579+0000 7f6a21753640 1 -- 172.21.15.53:0/202742648 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a1c126d30 con 0x7f6a1c096630 2024-09-13T19:15:50.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.579+0000 7f6a21753640 1 -- 172.21.15.53:0/202742648 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a1c1254b0 con 0x7f6a1c096630 2024-09-13T19:15:50.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.580+0000 7f5816ffd640 1 -- 172.21.15.53:0/4048914793 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f581c01a070 con 0x7f582006e7a0 2024-09-13T19:15:50.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.580+0000 7f5816ffd640 1 --2- 172.21.15.53:0/4048914793 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5804038430 0x7f580403a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:50.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.580+0000 7f5816ffd640 1 -- 172.21.15.53:0/4048914793 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f581c04a260 con 0x7f582006e7a0 2024-09-13T19:15:50.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.580+0000 7f5828733640 1 -- 172.21.15.53:0/4048914793 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f582006eb80 con 0x7f582006e7a0 2024-09-13T19:15:50.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.580+0000 7f6a21753640 1 -- 172.21.15.53:0/202742648 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a1c1283e0 con 0x7f6a1c096630 2024-09-13T19:15:50.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.581+0000 7f5825cce640 1 --2- 172.21.15.53:0/4048914793 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5804038430 0x7f580403a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:50.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.581+0000 7f6a037fe640 1 -- 172.21.15.53:0/202742648 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6a0c01b070 con 0x7f6a1c096630 2024-09-13T19:15:50.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.581+0000 7f5825cce640 1 --2- 172.21.15.53:0/4048914793 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5804038430 0x7f580403a8f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5810009720 tx=0x7f581002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:50.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.581+0000 7f6a037fe640 1 --2- 172.21.15.53:0/202742648 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6a080382f0 0x7f6a0803a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:50.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.581+0000 7f6a037fe640 1 -- 172.21.15.53:0/202742648 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f6a0c04a590 con 0x7f6a1c096630 2024-09-13T19:15:50.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.582+0000 7f6a1a7fc640 1 --2- 172.21.15.53:0/202742648 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6a080382f0 0x7f6a0803a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:50.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.582+0000 7f6a1a7fc640 1 --2- 172.21.15.53:0/202742648 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6a080382f0 0x7f6a0803a7b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6a10034000 tx=0x7f6a1002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:50.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.585+0000 7fe8f1f42640 1 Processor -- start 2024-09-13T19:15:50.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.585+0000 7fe8f1f42640 1 -- start start 2024-09-13T19:15:50.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.585+0000 7f5816ffd640 1 -- 172.21.15.53:0/4048914793 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f581c0075e0 con 0x7f582006e7a0 2024-09-13T19:15:50.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.586+0000 7fe8f1f42640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe8ec09a100 0x7fe8ec133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:50.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.586+0000 7fe8f1f42640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8ec09d3b0 con 0x7fe8ec09bd50 2024-09-13T19:15:50.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.586+0000 7fe8f1f42640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fe8ec09c840 con 0x7fe8ec09a100 2024-09-13T19:15:50.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.586+0000 7fe8eb7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe8ec09bd50 0x7fe8ec09c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:34138/0 (socket says 172.21.15.53:34138) 2024-09-13T19:15:50.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.586+0000 7fe8eb7fe640 1 -- 172.21.15.53:0/805214925 learned_addr learned my addr 172.21.15.53:0/805214925 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T19:15:50.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.586+0000 7fe8e3fff640 1 --2- 172.21.15.53:0/805214925 >> v2:172.21.15.53:3300/0 conn(0x7fe8ec09a100 0x7fe8ec133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:50.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.586+0000 7fe8e3fff640 1 -- 172.21.15.53:0/805214925 >> v1:172.21.15.53:6789/0 conn(0x7fe8ec09bd50 legacy=0x7fe8ec09c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:50.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.586+0000 7fe8e3fff640 1 -- 172.21.15.53:0/805214925 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8ec098230 con 0x7fe8ec09a100 2024-09-13T19:15:50.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.587+0000 7fe8e3fff640 1 --2- 172.21.15.53:0/805214925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8ec09a100 0x7fe8ec133da0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4009720 tx=0x7fe8d402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=766c950dcbab01c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:50.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.595+0000 7f6a037fe640 1 -- 172.21.15.53:0/202742648 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6a0c01ca00 con 0x7f6a1c096630 2024-09-13T19:15:50.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.597+0000 7fe8eaffd640 1 -- 172.21.15.53:0/805214925 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8d4037070 con 0x7fe8ec09a100 2024-09-13T19:15:50.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.597+0000 7fe8eaffd640 1 -- 172.21.15.53:0/805214925 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8d402ad90 con 0x7fe8ec09a100 2024-09-13T19:15:50.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.597+0000 7fe8eaffd640 1 -- 172.21.15.53:0/805214925 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8d4032590 con 0x7fe8ec09a100 2024-09-13T19:15:50.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.598+0000 7fe8f1f42640 1 -- 172.21.15.53:0/805214925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8ec09a100 msgr2=0x7fe8ec133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:50.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.598+0000 7fe8f1f42640 1 --2- 172.21.15.53:0/805214925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8ec09a100 0x7fe8ec133da0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4009720 tx=0x7fe8d402a110 comp rx=0 tx=0).stop 2024-09-13T19:15:50.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.598+0000 7fe8f1f42640 1 -- 172.21.15.53:0/805214925 shutdown_connections 2024-09-13T19:15:50.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.598+0000 7fe8f1f42640 1 --2- 172.21.15.53:0/805214925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8ec09a100 0x7fe8ec133da0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:50.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.598+0000 7fe8f1f42640 1 -- 172.21.15.53:0/805214925 >> 172.21.15.53:0/805214925 conn(0x7fe8ec06d4a0 msgr2=0x7fe8ec06d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:50.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.598+0000 7fe8f1f42640 1 -- 172.21.15.53:0/805214925 shutdown_connections 2024-09-13T19:15:50.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.598+0000 7fe8f1f42640 1 -- 172.21.15.53:0/805214925 wait complete. 2024-09-13T19:15:50.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.599+0000 7fe8f1f42640 1 Processor -- start 2024-09-13T19:15:50.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.599+0000 7fe8f1f42640 1 -- start start 2024-09-13T19:15:50.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.599+0000 7fe8f1f42640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8ec09a100 0x7fe8ec1c3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:50.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.599+0000 7fe8f1f42640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe8ec134670 con 0x7fe8ec09a100 2024-09-13T19:15:50.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.599+0000 7fe8eb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8ec09a100 0x7fe8ec1c3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:50.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.599+0000 7fe8eb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8ec09a100 0x7fe8ec1c3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60910/0 (socket says 172.21.15.53:60910) 2024-09-13T19:15:50.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.599+0000 7fe8eb7fe640 1 -- 172.21.15.53:0/2413317380 learned_addr learned my addr 172.21.15.53:0/2413317380 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:15:50.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.600+0000 7fe8eb7fe640 1 -- 172.21.15.53:0/2413317380 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8ec0963e0 con 0x7fe8ec09a100 2024-09-13T19:15:50.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.600+0000 7fe8eb7fe640 1 --2- 172.21.15.53:0/2413317380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8ec09a100 0x7fe8ec1c3990 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc00c380 tx=0x7fe8dc00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:50.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.600+0000 7fe8e8ff9640 1 -- 172.21.15.53:0/2413317380 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8dc005c10 con 0x7fe8ec09a100 2024-09-13T19:15:50.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.600+0000 7fe8f1f42640 1 -- 172.21.15.53:0/2413317380 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8ec126090 con 0x7fe8ec09a100 2024-09-13T19:15:50.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.600+0000 7fe8f1f42640 1 -- 172.21.15.53:0/2413317380 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8ec1c3ed0 con 0x7fe8ec09a100 2024-09-13T19:15:50.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.600+0000 7fe8e8ff9640 1 -- 172.21.15.53:0/2413317380 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8dc005db0 con 0x7fe8ec09a100 2024-09-13T19:15:50.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.600+0000 7fe8e8ff9640 1 -- 172.21.15.53:0/2413317380 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8dc004910 con 0x7fe8ec09a100 2024-09-13T19:15:50.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.601+0000 7fe8e8ff9640 1 -- 172.21.15.53:0/2413317380 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe8dc01a020 con 0x7fe8ec09a100 2024-09-13T19:15:50.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.602+0000 7fe8e8ff9640 1 --2- 172.21.15.53:0/2413317380 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe8cc0382a0 0x7fe8cc03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:50.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.602+0000 7fe8e8ff9640 1 -- 172.21.15.53:0/2413317380 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7fe8dc04ab50 con 0x7fe8ec09a100 2024-09-13T19:15:50.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.602+0000 7fe8f1f42640 1 -- 172.21.15.53:0/2413317380 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8d0005080 con 0x7fe8ec09a100 2024-09-13T19:15:50.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.602+0000 7fe8e3fff640 1 --2- 172.21.15.53:0/2413317380 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe8cc0382a0 0x7fe8cc03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:50.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.603+0000 7fe8e3fff640 1 --2- 172.21.15.53:0/2413317380 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe8cc0382a0 0x7fe8cc03a760 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4034000 tx=0x7fe8d402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:50.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.611+0000 7fe8e8ff9640 1 -- 172.21.15.53:0/2413317380 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe8ec09d3b0 con 0x7fe8ec09a100 2024-09-13T19:15:50.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.772+0000 7f5828733640 1 -- 172.21.15.53:0/4048914793 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f582006c020 con 0x7f582006e7a0 2024-09-13T19:15:50.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.773+0000 7f5816ffd640 1 -- 172.21.15.53:0/4048914793 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f581c04a020 con 0x7f582006e7a0 2024-09-13T19:15:50.776 INFO:teuthology.orchestra.run.smithi053.stdout:47244640261 2024-09-13T19:15:50.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.775+0000 7f5828733640 1 -- 172.21.15.53:0/4048914793 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5804038430 msgr2=0x7f580403a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:50.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.775+0000 7f5828733640 1 --2- 172.21.15.53:0/4048914793 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5804038430 0x7f580403a8f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5810009720 tx=0x7f581002e000 comp rx=0 tx=0).stop 2024-09-13T19:15:50.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.775+0000 7f5828733640 1 -- 172.21.15.53:0/4048914793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f582006e7a0 msgr2=0x7f582012eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:50.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.775+0000 7f5828733640 1 --2- 172.21.15.53:0/4048914793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f582006e7a0 0x7f582012eee0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f581c00c4a0 tx=0x7f581c00c960 comp rx=0 tx=0).stop 2024-09-13T19:15:50.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.775+0000 7f5828733640 1 -- 172.21.15.53:0/4048914793 shutdown_connections 2024-09-13T19:15:50.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.775+0000 7f5828733640 1 --2- 172.21.15.53:0/4048914793 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5804038430 0x7f580403a8f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:50.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.775+0000 7f5828733640 1 --2- 172.21.15.53:0/4048914793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f582006e7a0 0x7f582012eee0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:50.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.775+0000 7f5828733640 1 -- 172.21.15.53:0/4048914793 >> 172.21.15.53:0/4048914793 conn(0x7f582009ac20 msgr2=0x7f5820098930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:50.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.775+0000 7f5828733640 1 -- 172.21.15.53:0/4048914793 shutdown_connections 2024-09-13T19:15:50.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.775+0000 7f5828733640 1 -- 172.21.15.53:0/4048914793 wait complete. 2024-09-13T19:15:50.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.778+0000 7f6a21753640 1 -- 172.21.15.53:0/202742648 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f6a1c06d910 con 0x7f6a1c096630 2024-09-13T19:15:50.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.779+0000 7f6a037fe640 1 -- 172.21.15.53:0/202742648 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6a0c01cc60 con 0x7f6a1c096630 2024-09-13T19:15:50.782 INFO:teuthology.orchestra.run.smithi053.stdout:47244640261 2024-09-13T19:15:50.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.782+0000 7f6a21753640 1 -- 172.21.15.53:0/202742648 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6a080382f0 msgr2=0x7f6a0803a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:50.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.782+0000 7f6a21753640 1 --2- 172.21.15.53:0/202742648 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6a080382f0 0x7f6a0803a7b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6a10034000 tx=0x7f6a1002e000 comp rx=0 tx=0).stop 2024-09-13T19:15:50.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.782+0000 7f6a21753640 1 -- 172.21.15.53:0/202742648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a1c096630 msgr2=0x7f6a1c124f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:50.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.782+0000 7f6a21753640 1 --2- 172.21.15.53:0/202742648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a1c096630 0x7f6a1c124f70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c00c420 tx=0x7f6a0c00c8e0 comp rx=0 tx=0).stop 2024-09-13T19:15:50.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.783+0000 7f6a21753640 1 -- 172.21.15.53:0/202742648 shutdown_connections 2024-09-13T19:15:50.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.783+0000 7f6a21753640 1 --2- 172.21.15.53:0/202742648 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6a080382f0 0x7f6a0803a7b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:50.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.783+0000 7f6a21753640 1 --2- 172.21.15.53:0/202742648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a1c096630 0x7f6a1c124f70 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:50.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.783+0000 7f6a21753640 1 -- 172.21.15.53:0/202742648 >> 172.21.15.53:0/202742648 conn(0x7f6a1c09a890 msgr2=0x7f6a1c1b0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:50.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.783+0000 7f6a21753640 1 -- 172.21.15.53:0/202742648 shutdown_connections 2024-09-13T19:15:50.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.783+0000 7f6a21753640 1 -- 172.21.15.53:0/202742648 wait complete. 2024-09-13T19:15:50.792 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640261 for osd.1 2024-09-13T19:15:50.792 DEBUG:teuthology.parallel:result is None 2024-09-13T19:15:50.798 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640261 for osd.2 2024-09-13T19:15:50.798 DEBUG:teuthology.parallel:result is None 2024-09-13T19:15:50.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.798+0000 7f68b1b4b640 1 -- 172.21.15.53:0/2527328062 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f68ac0969b0 con 0x7f68ac09c670 2024-09-13T19:15:50.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.799+0000 7f6893fff640 1 -- 172.21.15.53:0/2527328062 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f689c03bdd0 con 0x7f68ac09c670 2024-09-13T19:15:50.802 INFO:teuthology.orchestra.run.smithi053.stdout:47244640262 2024-09-13T19:15:50.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.801+0000 7f68b1b4b640 1 -- 172.21.15.53:0/2527328062 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f68980382d0 msgr2=0x7f689803a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:50.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.801+0000 7f68b1b4b640 1 --2- 172.21.15.53:0/2527328062 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f68980382d0 0x7f689803a790 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f68a0000c00 tx=0x7f68a0001250 comp rx=0 tx=0).stop 2024-09-13T19:15:50.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.801+0000 7f68b1b4b640 1 -- 172.21.15.53:0/2527328062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68ac09c670 msgr2=0x7f68ac1bff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:50.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.801+0000 7f68b1b4b640 1 --2- 172.21.15.53:0/2527328062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68ac09c670 0x7f68ac1bff80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f689c02a150 tx=0x7f689c0046c0 comp rx=0 tx=0).stop 2024-09-13T19:15:50.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.801+0000 7f68b1b4b640 1 -- 172.21.15.53:0/2527328062 shutdown_connections 2024-09-13T19:15:50.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.801+0000 7f68b1b4b640 1 --2- 172.21.15.53:0/2527328062 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f68980382d0 0x7f689803a790 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:50.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.801+0000 7f68b1b4b640 1 --2- 172.21.15.53:0/2527328062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68ac09c670 0x7f68ac1bff80 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:50.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.801+0000 7f68b1b4b640 1 -- 172.21.15.53:0/2527328062 >> 172.21.15.53:0/2527328062 conn(0x7f68ac06d4a0 msgr2=0x7f68ac09eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:50.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.801+0000 7f68b1b4b640 1 -- 172.21.15.53:0/2527328062 shutdown_connections 2024-09-13T19:15:50.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.801+0000 7f68b1b4b640 1 -- 172.21.15.53:0/2527328062 wait complete. 2024-09-13T19:15:50.815 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640262 for osd.3 2024-09-13T19:15:50.815 DEBUG:teuthology.parallel:result is None 2024-09-13T19:15:50.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.843+0000 7fe8f1f42640 1 -- 172.21.15.53:0/2413317380 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fe8d0005370 con 0x7fe8ec09a100 2024-09-13T19:15:50.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.844+0000 7fe8e8ff9640 1 -- 172.21.15.53:0/2413317380 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe8dc0127f0 con 0x7fe8ec09a100 2024-09-13T19:15:50.847 INFO:teuthology.orchestra.run.smithi053.stdout:38654705670 2024-09-13T19:15:50.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.846+0000 7fe8f1f42640 1 -- 172.21.15.53:0/2413317380 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe8cc0382a0 msgr2=0x7fe8cc03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:50.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.846+0000 7fe8f1f42640 1 --2- 172.21.15.53:0/2413317380 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe8cc0382a0 0x7fe8cc03a760 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4034000 tx=0x7fe8d402e000 comp rx=0 tx=0).stop 2024-09-13T19:15:50.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.846+0000 7fe8f1f42640 1 -- 172.21.15.53:0/2413317380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8ec09a100 msgr2=0x7fe8ec1c3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:50.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.846+0000 7fe8f1f42640 1 --2- 172.21.15.53:0/2413317380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8ec09a100 0x7fe8ec1c3990 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc00c380 tx=0x7fe8dc00c840 comp rx=0 tx=0).stop 2024-09-13T19:15:50.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.846+0000 7fe8f1f42640 1 -- 172.21.15.53:0/2413317380 shutdown_connections 2024-09-13T19:15:50.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.846+0000 7fe8f1f42640 1 --2- 172.21.15.53:0/2413317380 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe8cc0382a0 0x7fe8cc03a760 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:50.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.846+0000 7fe8f1f42640 1 --2- 172.21.15.53:0/2413317380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8ec09a100 0x7fe8ec1c3990 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:50.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.846+0000 7fe8f1f42640 1 -- 172.21.15.53:0/2413317380 >> 172.21.15.53:0/2413317380 conn(0x7fe8ec06d4a0 msgr2=0x7fe8ec08d790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:50.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.846+0000 7fe8f1f42640 1 -- 172.21.15.53:0/2413317380 shutdown_connections 2024-09-13T19:15:50.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.846+0000 7fe8f1f42640 1 -- 172.21.15.53:0/2413317380 wait complete. 2024-09-13T19:15:50.859 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.0 2024-09-13T19:15:50.860 DEBUG:teuthology.parallel:result is None 2024-09-13T19:15:50.860 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T19:15:50.860 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T19:15:51.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.998+0000 7f4d47531640 1 Processor -- start 2024-09-13T19:15:51.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.998+0000 7f4d47531640 1 -- start start 2024-09-13T19:15:51.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.998+0000 7f4d47531640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4d4006eda0 0x7f4d4006f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:51.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.998+0000 7f4d47531640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d4006eba0 con 0x7f4d4006f6c0 2024-09-13T19:15:51.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.998+0000 7f4d47531640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f4d4006d2f0 con 0x7f4d4006eda0 2024-09-13T19:15:51.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.998+0000 7f4d452cd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4d4006eda0 0x7f4d4006f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:51.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.998+0000 7f4d44acc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f4d4006f6c0 0x7f4d40121a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:34152/0 (socket says 172.21.15.53:34152) 2024-09-13T19:15:51.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.998+0000 7f4d44acc640 1 -- 172.21.15.53:0/3359174510 learned_addr learned my addr 172.21.15.53:0/3359174510 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T19:15:51.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.999+0000 7f4d452cd640 1 -- 172.21.15.53:0/3359174510 >> v1:172.21.15.53:6789/0 conn(0x7f4d4006f6c0 legacy=0x7f4d40121a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:51.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.999+0000 7f4d452cd640 1 -- 172.21.15.53:0/3359174510 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d40070d50 con 0x7f4d4006eda0 2024-09-13T19:15:51.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:50.999+0000 7f4d37fff640 1 -- 172.21.15.53:0/3359174510 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3099418456 0 0) 0x7f4d4006eba0 con 0x7f4d4006f6c0 2024-09-13T19:15:51.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.000+0000 7f4d452cd640 1 --2- 172.21.15.53:0/3359174510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d4006eda0 0x7f4d4006f180 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c009720 tx=0x7f4d3c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=977a3a1e5514cf3d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:51.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.000+0000 7f4d37fff640 1 -- 172.21.15.53:0/3359174510 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d3c037070 con 0x7f4d4006eda0 2024-09-13T19:15:51.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.000+0000 7f4d37fff640 1 -- 172.21.15.53:0/3359174510 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d3c02ae20 con 0x7f4d4006eda0 2024-09-13T19:15:51.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.000+0000 7f4d37fff640 1 -- 172.21.15.53:0/3359174510 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d3c032590 con 0x7f4d4006eda0 2024-09-13T19:15:51.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.000+0000 7f4d47531640 1 -- 172.21.15.53:0/3359174510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d4006eda0 msgr2=0x7f4d4006f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:51.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.000+0000 7f4d47531640 1 --2- 172.21.15.53:0/3359174510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d4006eda0 0x7f4d4006f180 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c009720 tx=0x7f4d3c02a1a0 comp rx=0 tx=0).stop 2024-09-13T19:15:51.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.000+0000 7f4d47531640 1 -- 172.21.15.53:0/3359174510 shutdown_connections 2024-09-13T19:15:51.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.000+0000 7f4d47531640 1 --2- 172.21.15.53:0/3359174510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d4006eda0 0x7f4d4006f180 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:51.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.000+0000 7f4d47531640 1 -- 172.21.15.53:0/3359174510 >> 172.21.15.53:0/3359174510 conn(0x7f4d4009a890 msgr2=0x7f4d4009aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:51.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.000+0000 7f4d47531640 1 -- 172.21.15.53:0/3359174510 shutdown_connections 2024-09-13T19:15:51.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.000+0000 7f4d47531640 1 -- 172.21.15.53:0/3359174510 wait complete. 2024-09-13T19:15:51.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.001+0000 7f4d47531640 1 Processor -- start 2024-09-13T19:15:51.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.001+0000 7f4d47531640 1 -- start start 2024-09-13T19:15:51.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.002+0000 7f4d47531640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d4006eda0 0x7f4d4006d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:51.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.002+0000 7f4d47531640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f4d40122160 con 0x7f4d4006eda0 2024-09-13T19:15:51.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.002+0000 7f4d452cd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d4006eda0 0x7f4d4006d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:51.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.002+0000 7f4d452cd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d4006eda0 0x7f4d4006d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60920/0 (socket says 172.21.15.53:60920) 2024-09-13T19:15:51.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.002+0000 7f4d452cd640 1 -- 172.21.15.53:0/1755863382 learned_addr learned my addr 172.21.15.53:0/1755863382 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:15:51.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.002+0000 7f4d452cd640 1 -- 172.21.15.53:0/1755863382 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d4008b880 con 0x7f4d4006eda0 2024-09-13T19:15:51.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.002+0000 7f4d452cd640 1 --2- 172.21.15.53:0/1755863382 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d4006eda0 0x7f4d4006d910 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c02a1e0 tx=0x7f4d3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:51.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.002+0000 7f4d35ffb640 1 -- 172.21.15.53:0/1755863382 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d3c042070 con 0x7f4d4006eda0 2024-09-13T19:15:51.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.002+0000 7f4d35ffb640 1 -- 172.21.15.53:0/1755863382 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d3c03e590 con 0x7f4d4006eda0 2024-09-13T19:15:51.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.002+0000 7f4d35ffb640 1 -- 172.21.15.53:0/1755863382 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d3c037040 con 0x7f4d4006eda0 2024-09-13T19:15:51.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.002+0000 7f4d47531640 1 -- 172.21.15.53:0/1755863382 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d40128cc0 con 0x7f4d4006eda0 2024-09-13T19:15:51.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.003+0000 7f4d47531640 1 -- 172.21.15.53:0/1755863382 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d4008c340 con 0x7f4d4006eda0 2024-09-13T19:15:51.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.003+0000 7f4d35ffb640 1 -- 172.21.15.53:0/1755863382 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4d3c045070 con 0x7f4d4006eda0 2024-09-13T19:15:51.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.004+0000 7f4d47531640 1 -- 172.21.15.53:0/1755863382 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d40122670 con 0x7f4d4006eda0 2024-09-13T19:15:51.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.004+0000 7f4d35ffb640 1 --2- 172.21.15.53:0/1755863382 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4d240382a0 0x7f4d2403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:51.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.004+0000 7f4d35ffb640 1 -- 172.21.15.53:0/1755863382 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f4d3c06b980 con 0x7f4d4006eda0 2024-09-13T19:15:51.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.004+0000 7f4d44acc640 1 --2- 172.21.15.53:0/1755863382 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4d240382a0 0x7f4d2403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:51.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.004+0000 7f4d44acc640 1 --2- 172.21.15.53:0/1755863382 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4d240382a0 0x7f4d2403a760 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4d300011e0 tx=0x7f4d30007930 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:51.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.008+0000 7f4d35ffb640 1 -- 172.21.15.53:0/1755863382 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4d3c02ae20 con 0x7f4d4006eda0 2024-09-13T19:15:51.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.186+0000 7f4d47531640 1 -- 172.21.15.53:0/1755863382 --> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4d4008b3e0 con 0x7f4d240382a0 2024-09-13T19:15:51.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.188+0000 7f4d35ffb640 1 -- 172.21.15.53:0/1755863382 <== mgr.4098 v2:172.21.15.102:6824/4283826432 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32213 (secure 0 0 0) 0x7f4d4008b3e0 con 0x7f4d240382a0 2024-09-13T19:15:51.191 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:15:51.191 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T19:15:51.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.190+0000 7f4d47531640 1 -- 172.21.15.53:0/1755863382 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4d240382a0 msgr2=0x7f4d2403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:51.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.190+0000 7f4d47531640 1 --2- 172.21.15.53:0/1755863382 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4d240382a0 0x7f4d2403a760 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4d300011e0 tx=0x7f4d30007930 comp rx=0 tx=0).stop 2024-09-13T19:15:51.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.190+0000 7f4d47531640 1 -- 172.21.15.53:0/1755863382 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d4006eda0 msgr2=0x7f4d4006d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:51.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.190+0000 7f4d47531640 1 --2- 172.21.15.53:0/1755863382 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d4006eda0 0x7f4d4006d910 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c02a1e0 tx=0x7f4d3c0046c0 comp rx=0 tx=0).stop 2024-09-13T19:15:51.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.190+0000 7f4d47531640 1 -- 172.21.15.53:0/1755863382 shutdown_connections 2024-09-13T19:15:51.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.190+0000 7f4d47531640 1 --2- 172.21.15.53:0/1755863382 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4d240382a0 0x7f4d2403a760 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:51.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.190+0000 7f4d47531640 1 --2- 172.21.15.53:0/1755863382 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d4006eda0 0x7f4d4006d910 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:51.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.190+0000 7f4d47531640 1 -- 172.21.15.53:0/1755863382 >> 172.21.15.53:0/1755863382 conn(0x7f4d4009a890 msgr2=0x7f4d40097f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:51.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.190+0000 7f4d47531640 1 -- 172.21.15.53:0/1755863382 shutdown_connections 2024-09-13T19:15:51.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.190+0000 7f4d47531640 1 -- 172.21.15.53:0/1755863382 wait complete. 2024-09-13T19:15:51.203 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-13T19:15:50.908241+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":118220,"kb_used_data":1776,"kb_used_omap":6,"kb_used_meta":116345,"kb_avail":377369140,"statfs":{"total":386547056640,"available":386425999360,"internally_reserved":0,"allocated":1818624,"data_stored":1379590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":119138071},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.338330"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T19:15:46.580871+0000","last_change":"2024-09-13T19:15:46.581172+0000","last_active":"2024-09-13T19:15:46.580871+0000","last_peered":"2024-09-13T19:15:46.580871+0000","last_clean":"2024-09-13T19:15:46.580871+0000","last_became_active":"2024-09-13T19:15:44.607248+0000","last_became_peered":"2024-09-13T19:15:44.607248+0000","last_unstale":"2024-09-13T19:15:46.580871+0000","last_undegraded":"2024-09-13T19:15:46.580871+0000","last_fullsized":"2024-09-13T19:15:46.580871+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:09:50.029342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086245899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T19:15:46.583177+0000","last_change":"2024-09-13T19:15:46.583177+0000","last_active":"2024-09-13T19:15:46.583177+0000","last_peered":"2024-09-13T19:15:46.583177+0000","last_clean":"2024-09-13T19:15:46.583177+0000","last_became_active":"2024-09-13T19:15:44.574967+0000","last_became_peered":"2024-09-13T19:15:44.574967+0000","last_unstale":"2024-09-13T19:15:46.583177+0000","last_undegraded":"2024-09-13T19:15:46.583177+0000","last_fullsized":"2024-09-13T19:15:46.583177+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:20:13.639706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049330999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T19:15:46.581507+0000","last_change":"2024-09-13T19:15:46.581685+0000","last_active":"2024-09-13T19:15:46.581507+0000","last_peered":"2024-09-13T19:15:46.581507+0000","last_clean":"2024-09-13T19:15:46.581507+0000","last_became_active":"2024-09-13T19:15:44.576006+0000","last_became_peered":"2024-09-13T19:15:44.576006+0000","last_unstale":"2024-09-13T19:15:46.581507+0000","last_undegraded":"2024-09-13T19:15:46.581507+0000","last_fullsized":"2024-09-13T19:15:46.581507+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:52:37.043288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013309299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T19:15:46.583117+0000","last_change":"2024-09-13T19:15:46.583117+0000","last_active":"2024-09-13T19:15:46.583117+0000","last_peered":"2024-09-13T19:15:46.583117+0000","last_clean":"2024-09-13T19:15:46.583117+0000","last_became_active":"2024-09-13T19:15:44.575726+0000","last_became_peered":"2024-09-13T19:15:44.575726+0000","last_unstale":"2024-09-13T19:15:46.583117+0000","last_undegraded":"2024-09-13T19:15:46.583117+0000","last_fullsized":"2024-09-13T19:15:46.583117+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:27.090413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041430200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"18'2","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T19:15:46.581526+0000","last_change":"2024-09-13T19:15:46.581526+0000","last_active":"2024-09-13T19:15:46.581526+0000","last_peered":"2024-09-13T19:15:46.581526+0000","last_clean":"2024-09-13T19:15:46.581526+0000","last_became_active":"2024-09-13T19:15:44.576052+0000","last_became_peered":"2024-09-13T19:15:44.576052+0000","last_unstale":"2024-09-13T19:15:46.581526+0000","last_undegraded":"2024-09-13T19:15:46.581526+0000","last_fullsized":"2024-09-13T19:15:46.581526+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:33.633045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012221599999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T19:15:47.256357+0000","last_change":"2024-09-13T19:15:47.256565+0000","last_active":"2024-09-13T19:15:47.256357+0000","last_peered":"2024-09-13T19:15:47.256357+0000","last_clean":"2024-09-13T19:15:47.256357+0000","last_became_active":"2024-09-13T19:15:44.575483+0000","last_became_peered":"2024-09-13T19:15:44.575483+0000","last_unstale":"2024-09-13T19:15:47.256357+0000","last_undegraded":"2024-09-13T19:15:47.256357+0000","last_fullsized":"2024-09-13T19:15:47.256357+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:05:11.992289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036796000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T19:15:46.581228+0000","last_change":"2024-09-13T19:15:46.581436+0000","last_active":"2024-09-13T19:15:46.581228+0000","last_peered":"2024-09-13T19:15:46.581228+0000","last_clean":"2024-09-13T19:15:46.581228+0000","last_became_active":"2024-09-13T19:15:44.576304+0000","last_became_peered":"2024-09-13T19:15:44.576304+0000","last_unstale":"2024-09-13T19:15:46.581228+0000","last_undegraded":"2024-09-13T19:15:46.581228+0000","last_fullsized":"2024-09-13T19:15:46.581228+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:57.538288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011332060000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"16'1","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T19:15:46.580543+0000","last_change":"2024-09-13T19:15:46.580815+0000","last_active":"2024-09-13T19:15:46.580543+0000","last_peered":"2024-09-13T19:15:46.580543+0000","last_clean":"2024-09-13T19:15:46.580543+0000","last_became_active":"2024-09-13T19:15:44.577382+0000","last_became_peered":"2024-09-13T19:15:44.577382+0000","last_unstale":"2024-09-13T19:15:46.580543+0000","last_undegraded":"2024-09-13T19:15:46.580543+0000","last_fullsized":"2024-09-13T19:15:46.580543+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:47.750191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047916199999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"13'117","reported_seq":170,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T19:15:46.578533+0000","last_change":"2024-09-13T19:15:41.170734+0000","last_active":"2024-09-13T19:15:46.578533+0000","last_peered":"2024-09-13T19:15:46.578533+0000","last_clean":"2024-09-13T19:15:46.578533+0000","last_became_active":"2024-09-13T19:15:41.169707+0000","last_became_peered":"2024-09-13T19:15:41.169707+0000","last_unstale":"2024-09-13T19:15:46.578533+0000","last_undegraded":"2024-09-13T19:15:46.578533+0000","last_fullsized":"2024-09-13T19:15:46.578533+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:39.557965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:39.557965+0000","last_clean_scrub_stamp":"2024-09-13T19:15:39.557965+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:40:20.817136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640263,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":159744,"data_stored":49723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640262,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":749568,"data_stored":640072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640262,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":749568,"data_stored":640072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35508,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336332,"statfs":{"total":96636764160,"available":96600403968,"internally_reserved":0,"allocated":159744,"data_stored":49723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T19:15:51.204 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T19:15:51.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.301+0000 7f688d1e4640 1 Processor -- start 2024-09-13T19:15:51.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.302+0000 7f688d1e4640 1 -- start start 2024-09-13T19:15:51.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.302+0000 7f688d1e4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f688809a100 0x7f6888133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:51.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.302+0000 7f688d1e4640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f688809d3b0 con 0x7f688809bd50 2024-09-13T19:15:51.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.302+0000 7f688d1e4640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f688809c840 con 0x7f688809a100 2024-09-13T19:15:51.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.302+0000 7f687ffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f688809a100 0x7f6888133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:51.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.302+0000 7f6886d9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f688809bd50 0x7f688809c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:34158/0 (socket says 172.21.15.53:34158) 2024-09-13T19:15:51.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.302+0000 7f6886d9d640 1 -- 172.21.15.53:0/3858855770 learned_addr learned my addr 172.21.15.53:0/3858855770 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T19:15:51.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.302+0000 7f687ffff640 1 -- 172.21.15.53:0/3858855770 >> v1:172.21.15.53:6789/0 conn(0x7f688809bd50 legacy=0x7f688809c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:51.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.302+0000 7f687ffff640 1 -- 172.21.15.53:0/3858855770 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6888098230 con 0x7f688809a100 2024-09-13T19:15:51.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.303+0000 7f687ffff640 1 --2- 172.21.15.53:0/3858855770 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f688809a100 0x7f6888133da0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6870009720 tx=0x7f687002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e2e0359450424fb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:51.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.303+0000 7f688659c640 1 -- 172.21.15.53:0/3858855770 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6870037070 con 0x7f688809a100 2024-09-13T19:15:51.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.303+0000 7f688659c640 1 -- 172.21.15.53:0/3858855770 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f687002ad90 con 0x7f688809a100 2024-09-13T19:15:51.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.303+0000 7f688659c640 1 -- 172.21.15.53:0/3858855770 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6870032590 con 0x7f688809a100 2024-09-13T19:15:51.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.304+0000 7f688d1e4640 1 -- 172.21.15.53:0/3858855770 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f688809a100 msgr2=0x7f6888133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:51.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.304+0000 7f688d1e4640 1 --2- 172.21.15.53:0/3858855770 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f688809a100 0x7f6888133da0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6870009720 tx=0x7f687002a110 comp rx=0 tx=0).stop 2024-09-13T19:15:51.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.304+0000 7f688d1e4640 1 -- 172.21.15.53:0/3858855770 shutdown_connections 2024-09-13T19:15:51.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.304+0000 7f688d1e4640 1 --2- 172.21.15.53:0/3858855770 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f688809a100 0x7f6888133da0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:51.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.304+0000 7f688d1e4640 1 -- 172.21.15.53:0/3858855770 >> 172.21.15.53:0/3858855770 conn(0x7f688806d4a0 msgr2=0x7f688806d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:51.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.304+0000 7f688d1e4640 1 -- 172.21.15.53:0/3858855770 shutdown_connections 2024-09-13T19:15:51.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.304+0000 7f688d1e4640 1 -- 172.21.15.53:0/3858855770 wait complete. 2024-09-13T19:15:51.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.305+0000 7f688d1e4640 1 Processor -- start 2024-09-13T19:15:51.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.305+0000 7f688d1e4640 1 -- start start 2024-09-13T19:15:51.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.305+0000 7f688d1e4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f688809a100 0x7f6888132880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:51.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.305+0000 7f688d1e4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6888134670 con 0x7f688809a100 2024-09-13T19:15:51.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.305+0000 7f6886d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f688809a100 0x7f6888132880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:51.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.305+0000 7f6886d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f688809a100 0x7f6888132880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60930/0 (socket says 172.21.15.53:60930) 2024-09-13T19:15:51.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.305+0000 7f6886d9d640 1 -- 172.21.15.53:0/2278336703 learned_addr learned my addr 172.21.15.53:0/2278336703 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:15:51.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.306+0000 7f6886d9d640 1 -- 172.21.15.53:0/2278336703 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6888095540 con 0x7f688809a100 2024-09-13T19:15:51.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.306+0000 7f6886d9d640 1 --2- 172.21.15.53:0/2278336703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f688809a100 0x7f6888132880 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f687800c4a0 tx=0x7f687800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:51.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.306+0000 7f687f7fe640 1 -- 172.21.15.53:0/2278336703 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6878017070 con 0x7f688809a100 2024-09-13T19:15:51.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.306+0000 7f687f7fe640 1 -- 172.21.15.53:0/2278336703 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6878005c10 con 0x7f688809a100 2024-09-13T19:15:51.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.306+0000 7f687f7fe640 1 -- 172.21.15.53:0/2278336703 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6878007070 con 0x7f688809a100 2024-09-13T19:15:51.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.306+0000 7f688d1e4640 1 -- 172.21.15.53:0/2278336703 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68880950a0 con 0x7f688809a100 2024-09-13T19:15:51.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.306+0000 7f688d1e4640 1 -- 172.21.15.53:0/2278336703 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68880963b0 con 0x7f688809a100 2024-09-13T19:15:51.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.307+0000 7f687f7fe640 1 -- 172.21.15.53:0/2278336703 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f687801a070 con 0x7f688809a100 2024-09-13T19:15:51.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.307+0000 7f687f7fe640 1 --2- 172.21.15.53:0/2278336703 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f68680382a0 0x7f686803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:51.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.307+0000 7f688d1e4640 1 -- 172.21.15.53:0/2278336703 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68880008d0 con 0x7f688809a100 2024-09-13T19:15:51.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.307+0000 7f687f7fe640 1 -- 172.21.15.53:0/2278336703 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f687804a530 con 0x7f688809a100 2024-09-13T19:15:51.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.307+0000 7f687ffff640 1 --2- 172.21.15.53:0/2278336703 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f68680382a0 0x7f686803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:51.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.308+0000 7f687ffff640 1 --2- 172.21.15.53:0/2278336703 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f68680382a0 0x7f686803a760 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6870034000 tx=0x7f687002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:51.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.312+0000 7f687f7fe640 1 -- 172.21.15.53:0/2278336703 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f68880963b0 con 0x7f688809a100 2024-09-13T19:15:51.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.482+0000 7f688d1e4640 1 -- 172.21.15.53:0/2278336703 --> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6888074970 con 0x7f68680382a0 2024-09-13T19:15:51.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.484+0000 7f687f7fe640 1 -- 172.21.15.53:0/2278336703 <== mgr.4098 v2:172.21.15.102:6824/4283826432 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32213 (secure 0 0 0) 0x7f6888074970 con 0x7f68680382a0 2024-09-13T19:15:51.487 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:15:51.487 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T19:15:51.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.485+0000 7f688d1e4640 1 -- 172.21.15.53:0/2278336703 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f68680382a0 msgr2=0x7f686803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:51.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.485+0000 7f688d1e4640 1 --2- 172.21.15.53:0/2278336703 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f68680382a0 0x7f686803a760 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6870034000 tx=0x7f687002e000 comp rx=0 tx=0).stop 2024-09-13T19:15:51.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.485+0000 7f688d1e4640 1 -- 172.21.15.53:0/2278336703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f688809a100 msgr2=0x7f6888132880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:51.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.485+0000 7f688d1e4640 1 --2- 172.21.15.53:0/2278336703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f688809a100 0x7f6888132880 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f687800c4a0 tx=0x7f687800c960 comp rx=0 tx=0).stop 2024-09-13T19:15:51.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.485+0000 7f688d1e4640 1 -- 172.21.15.53:0/2278336703 shutdown_connections 2024-09-13T19:15:51.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.485+0000 7f688d1e4640 1 --2- 172.21.15.53:0/2278336703 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f68680382a0 0x7f686803a760 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:51.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.485+0000 7f688d1e4640 1 --2- 172.21.15.53:0/2278336703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f688809a100 0x7f6888132880 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:51.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.485+0000 7f688d1e4640 1 -- 172.21.15.53:0/2278336703 >> 172.21.15.53:0/2278336703 conn(0x7f688806d4a0 msgr2=0x7f6888096a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:51.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.485+0000 7f688d1e4640 1 -- 172.21.15.53:0/2278336703 shutdown_connections 2024-09-13T19:15:51.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.485+0000 7f688d1e4640 1 -- 172.21.15.53:0/2278336703 wait complete. 2024-09-13T19:15:51.499 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-13T19:15:50.908241+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":118220,"kb_used_data":1776,"kb_used_omap":6,"kb_used_meta":116345,"kb_avail":377369140,"statfs":{"total":386547056640,"available":386425999360,"internally_reserved":0,"allocated":1818624,"data_stored":1379590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":119138071},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.338330"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T19:15:46.580871+0000","last_change":"2024-09-13T19:15:46.581172+0000","last_active":"2024-09-13T19:15:46.580871+0000","last_peered":"2024-09-13T19:15:46.580871+0000","last_clean":"2024-09-13T19:15:46.580871+0000","last_became_active":"2024-09-13T19:15:44.607248+0000","last_became_peered":"2024-09-13T19:15:44.607248+0000","last_unstale":"2024-09-13T19:15:46.580871+0000","last_undegraded":"2024-09-13T19:15:46.580871+0000","last_fullsized":"2024-09-13T19:15:46.580871+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:09:50.029342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086245899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T19:15:46.583177+0000","last_change":"2024-09-13T19:15:46.583177+0000","last_active":"2024-09-13T19:15:46.583177+0000","last_peered":"2024-09-13T19:15:46.583177+0000","last_clean":"2024-09-13T19:15:46.583177+0000","last_became_active":"2024-09-13T19:15:44.574967+0000","last_became_peered":"2024-09-13T19:15:44.574967+0000","last_unstale":"2024-09-13T19:15:46.583177+0000","last_undegraded":"2024-09-13T19:15:46.583177+0000","last_fullsized":"2024-09-13T19:15:46.583177+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:20:13.639706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049330999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T19:15:46.581507+0000","last_change":"2024-09-13T19:15:46.581685+0000","last_active":"2024-09-13T19:15:46.581507+0000","last_peered":"2024-09-13T19:15:46.581507+0000","last_clean":"2024-09-13T19:15:46.581507+0000","last_became_active":"2024-09-13T19:15:44.576006+0000","last_became_peered":"2024-09-13T19:15:44.576006+0000","last_unstale":"2024-09-13T19:15:46.581507+0000","last_undegraded":"2024-09-13T19:15:46.581507+0000","last_fullsized":"2024-09-13T19:15:46.581507+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:52:37.043288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013309299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T19:15:46.583117+0000","last_change":"2024-09-13T19:15:46.583117+0000","last_active":"2024-09-13T19:15:46.583117+0000","last_peered":"2024-09-13T19:15:46.583117+0000","last_clean":"2024-09-13T19:15:46.583117+0000","last_became_active":"2024-09-13T19:15:44.575726+0000","last_became_peered":"2024-09-13T19:15:44.575726+0000","last_unstale":"2024-09-13T19:15:46.583117+0000","last_undegraded":"2024-09-13T19:15:46.583117+0000","last_fullsized":"2024-09-13T19:15:46.583117+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:27.090413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041430200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"18'2","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T19:15:46.581526+0000","last_change":"2024-09-13T19:15:46.581526+0000","last_active":"2024-09-13T19:15:46.581526+0000","last_peered":"2024-09-13T19:15:46.581526+0000","last_clean":"2024-09-13T19:15:46.581526+0000","last_became_active":"2024-09-13T19:15:44.576052+0000","last_became_peered":"2024-09-13T19:15:44.576052+0000","last_unstale":"2024-09-13T19:15:46.581526+0000","last_undegraded":"2024-09-13T19:15:46.581526+0000","last_fullsized":"2024-09-13T19:15:46.581526+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:33.633045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012221599999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T19:15:47.256357+0000","last_change":"2024-09-13T19:15:47.256565+0000","last_active":"2024-09-13T19:15:47.256357+0000","last_peered":"2024-09-13T19:15:47.256357+0000","last_clean":"2024-09-13T19:15:47.256357+0000","last_became_active":"2024-09-13T19:15:44.575483+0000","last_became_peered":"2024-09-13T19:15:44.575483+0000","last_unstale":"2024-09-13T19:15:47.256357+0000","last_undegraded":"2024-09-13T19:15:47.256357+0000","last_fullsized":"2024-09-13T19:15:47.256357+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:05:11.992289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036796000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T19:15:46.581228+0000","last_change":"2024-09-13T19:15:46.581436+0000","last_active":"2024-09-13T19:15:46.581228+0000","last_peered":"2024-09-13T19:15:46.581228+0000","last_clean":"2024-09-13T19:15:46.581228+0000","last_became_active":"2024-09-13T19:15:44.576304+0000","last_became_peered":"2024-09-13T19:15:44.576304+0000","last_unstale":"2024-09-13T19:15:46.581228+0000","last_undegraded":"2024-09-13T19:15:46.581228+0000","last_fullsized":"2024-09-13T19:15:46.581228+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:57.538288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011332060000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"16'1","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T19:15:46.580543+0000","last_change":"2024-09-13T19:15:46.580815+0000","last_active":"2024-09-13T19:15:46.580543+0000","last_peered":"2024-09-13T19:15:46.580543+0000","last_clean":"2024-09-13T19:15:46.580543+0000","last_became_active":"2024-09-13T19:15:44.577382+0000","last_became_peered":"2024-09-13T19:15:44.577382+0000","last_unstale":"2024-09-13T19:15:46.580543+0000","last_undegraded":"2024-09-13T19:15:46.580543+0000","last_fullsized":"2024-09-13T19:15:46.580543+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:47.750191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047916199999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"13'117","reported_seq":170,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T19:15:46.578533+0000","last_change":"2024-09-13T19:15:41.170734+0000","last_active":"2024-09-13T19:15:46.578533+0000","last_peered":"2024-09-13T19:15:46.578533+0000","last_clean":"2024-09-13T19:15:46.578533+0000","last_became_active":"2024-09-13T19:15:41.169707+0000","last_became_peered":"2024-09-13T19:15:41.169707+0000","last_unstale":"2024-09-13T19:15:46.578533+0000","last_undegraded":"2024-09-13T19:15:46.578533+0000","last_fullsized":"2024-09-13T19:15:46.578533+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:39.557965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:39.557965+0000","last_clean_scrub_stamp":"2024-09-13T19:15:39.557965+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:40:20.817136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640263,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":159744,"data_stored":49723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640262,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":749568,"data_stored":640072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640262,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":749568,"data_stored":640072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35508,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336332,"statfs":{"total":96636764160,"available":96600403968,"internally_reserved":0,"allocated":159744,"data_stored":49723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T19:15:51.500 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T19:15:51.500 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-13T19:15:51.500 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-13T19:15:51.500 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-13T19:15:51.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.598+0000 7ff6023d8640 1 Processor -- start 2024-09-13T19:15:51.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.598+0000 7ff6023d8640 1 -- start start 2024-09-13T19:15:51.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.598+0000 7ff6023d8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff5fc09bd50 0x7ff5fc09c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:51.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.598+0000 7ff6023d8640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5fc09d3b0 con 0x7ff5fc09c670 2024-09-13T19:15:51.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.598+0000 7ff6023d8640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7ff5fc098230 con 0x7ff5fc09bd50 2024-09-13T19:15:51.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.598+0000 7ff5fbfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff5fc09bd50 0x7ff5fc09c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:51.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.598+0000 7ff5f3fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff5fc09c670 0x7ff5fc0990f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:34164/0 (socket says 172.21.15.53:34164) 2024-09-13T19:15:51.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.598+0000 7ff5f3fff640 1 -- 172.21.15.53:0/3751967298 learned_addr learned my addr 172.21.15.53:0/3751967298 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T19:15:51.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.598+0000 7ff5fbfff640 1 -- 172.21.15.53:0/3751967298 >> v1:172.21.15.53:6789/0 conn(0x7ff5fc09c670 legacy=0x7ff5fc0990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:51.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.599+0000 7ff5fbfff640 1 -- 172.21.15.53:0/3751967298 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5fc0983e0 con 0x7ff5fc09bd50 2024-09-13T19:15:51.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.599+0000 7ff5fbfff640 1 --2- 172.21.15.53:0/3751967298 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5fc09bd50 0x7ff5fc09c130 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec009720 tx=0x7ff5ec02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4df489f52b499661 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:51.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.599+0000 7ff5fb7fe640 1 -- 172.21.15.53:0/3751967298 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5ec037070 con 0x7ff5fc09bd50 2024-09-13T19:15:51.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.599+0000 7ff5fb7fe640 1 -- 172.21.15.53:0/3751967298 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5ec02ad90 con 0x7ff5fc09bd50 2024-09-13T19:15:51.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.599+0000 7ff5fb7fe640 1 -- 172.21.15.53:0/3751967298 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5ec032590 con 0x7ff5fc09bd50 2024-09-13T19:15:51.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.600+0000 7ff6023d8640 1 -- 172.21.15.53:0/3751967298 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5fc09bd50 msgr2=0x7ff5fc09c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:51.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.600+0000 7ff6023d8640 1 --2- 172.21.15.53:0/3751967298 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5fc09bd50 0x7ff5fc09c130 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec009720 tx=0x7ff5ec02a110 comp rx=0 tx=0).stop 2024-09-13T19:15:51.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.600+0000 7ff6023d8640 1 -- 172.21.15.53:0/3751967298 shutdown_connections 2024-09-13T19:15:51.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.600+0000 7ff6023d8640 1 --2- 172.21.15.53:0/3751967298 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5fc09bd50 0x7ff5fc09c130 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:51.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.600+0000 7ff6023d8640 1 -- 172.21.15.53:0/3751967298 >> 172.21.15.53:0/3751967298 conn(0x7ff5fc06d4a0 msgr2=0x7ff5fc06d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:51.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.600+0000 7ff6023d8640 1 -- 172.21.15.53:0/3751967298 shutdown_connections 2024-09-13T19:15:51.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.600+0000 7ff6023d8640 1 -- 172.21.15.53:0/3751967298 wait complete. 2024-09-13T19:15:51.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.601+0000 7ff6023d8640 1 Processor -- start 2024-09-13T19:15:51.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.601+0000 7ff6023d8640 1 -- start start 2024-09-13T19:15:51.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.601+0000 7ff6023d8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5fc09bd50 0x7ff5fc093570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:51.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.601+0000 7ff6023d8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff5fc099b90 con 0x7ff5fc09bd50 2024-09-13T19:15:51.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.601+0000 7ff5fbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5fc09bd50 0x7ff5fc093570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:51.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.601+0000 7ff5fbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5fc09bd50 0x7ff5fc093570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60942/0 (socket says 172.21.15.53:60942) 2024-09-13T19:15:51.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.601+0000 7ff5fbfff640 1 -- 172.21.15.53:0/3873421165 learned_addr learned my addr 172.21.15.53:0/3873421165 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:15:51.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.602+0000 7ff5fbfff640 1 -- 172.21.15.53:0/3873421165 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5fc094eb0 con 0x7ff5fc09bd50 2024-09-13T19:15:51.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.602+0000 7ff5fbfff640 1 --2- 172.21.15.53:0/3873421165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5fc09bd50 0x7ff5fc093570 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec009840 tx=0x7ff5ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:51.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.602+0000 7ff5f97fa640 1 -- 172.21.15.53:0/3873421165 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5ec041070 con 0x7ff5fc09bd50 2024-09-13T19:15:51.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.602+0000 7ff5f97fa640 1 -- 172.21.15.53:0/3873421165 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5ec03c460 con 0x7ff5fc09bd50 2024-09-13T19:15:51.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.602+0000 7ff6023d8640 1 -- 172.21.15.53:0/3873421165 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5fc095590 con 0x7ff5fc09bd50 2024-09-13T19:15:51.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.602+0000 7ff5f97fa640 1 -- 172.21.15.53:0/3873421165 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5ec037040 con 0x7ff5fc09bd50 2024-09-13T19:15:51.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.602+0000 7ff6023d8640 1 -- 172.21.15.53:0/3873421165 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5fc0961c0 con 0x7ff5fc09bd50 2024-09-13T19:15:51.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.603+0000 7ff5f97fa640 1 -- 172.21.15.53:0/3873421165 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff5ec044070 con 0x7ff5fc09bd50 2024-09-13T19:15:51.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.603+0000 7ff5f97fa640 1 --2- 172.21.15.53:0/3873421165 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff5dc0382a0 0x7ff5dc03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:51.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.603+0000 7ff6023d8640 1 -- 172.21.15.53:0/3873421165 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5fc09a130 con 0x7ff5fc09bd50 2024-09-13T19:15:51.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.603+0000 7ff5f97fa640 1 -- 172.21.15.53:0/3873421165 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7ff5ec06bcc0 con 0x7ff5fc09bd50 2024-09-13T19:15:51.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.603+0000 7ff5f3fff640 1 --2- 172.21.15.53:0/3873421165 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff5dc0382a0 0x7ff5dc03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:51.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.604+0000 7ff5f3fff640 1 --2- 172.21.15.53:0/3873421165 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff5dc0382a0 0x7ff5dc03a760 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff5e4007fd0 tx=0x7ff5e4007ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:51.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.608+0000 7ff5f97fa640 1 -- 172.21.15.53:0/3873421165 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff5fc0961c0 con 0x7ff5fc09bd50 2024-09-13T19:15:51.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.822+0000 7ff6023d8640 1 -- 172.21.15.53:0/3873421165 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff5fc09d020 con 0x7ff5fc09bd50 2024-09-13T19:15:51.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.822+0000 7ff5f97fa640 1 -- 172.21.15.53:0/3873421165 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7ff5ec044760 con 0x7ff5fc09bd50 2024-09-13T19:15:51.825 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:15:51.826 INFO:teuthology.orchestra.run.smithi053.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-13T19:15:51.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.824+0000 7ff6023d8640 1 -- 172.21.15.53:0/3873421165 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff5dc0382a0 msgr2=0x7ff5dc03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:51.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.824+0000 7ff6023d8640 1 --2- 172.21.15.53:0/3873421165 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff5dc0382a0 0x7ff5dc03a760 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff5e4007fd0 tx=0x7ff5e4007ac0 comp rx=0 tx=0).stop 2024-09-13T19:15:51.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.824+0000 7ff6023d8640 1 -- 172.21.15.53:0/3873421165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5fc09bd50 msgr2=0x7ff5fc093570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:51.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.824+0000 7ff6023d8640 1 --2- 172.21.15.53:0/3873421165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5fc09bd50 0x7ff5fc093570 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec009840 tx=0x7ff5ec0046c0 comp rx=0 tx=0).stop 2024-09-13T19:15:51.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.824+0000 7ff6023d8640 1 -- 172.21.15.53:0/3873421165 shutdown_connections 2024-09-13T19:15:51.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.824+0000 7ff6023d8640 1 --2- 172.21.15.53:0/3873421165 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff5dc0382a0 0x7ff5dc03a760 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:51.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.824+0000 7ff6023d8640 1 --2- 172.21.15.53:0/3873421165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5fc09bd50 0x7ff5fc093570 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:51.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.824+0000 7ff6023d8640 1 -- 172.21.15.53:0/3873421165 >> 172.21.15.53:0/3873421165 conn(0x7ff5fc06d4a0 msgr2=0x7ff5fc09eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:51.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.824+0000 7ff6023d8640 1 -- 172.21.15.53:0/3873421165 shutdown_connections 2024-09-13T19:15:51.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:15:51.825+0000 7ff6023d8640 1 -- 172.21.15.53:0/3873421165 wait complete. 2024-09-13T19:15:51.838 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-13T19:15:51.839 INFO:teuthology.run_tasks:Running task rgw... 2024-09-13T19:15:51.854 DEBUG:tasks.rgw:config is {'client.0': None} 2024-09-13T19:15:51.854 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-13T19:15:51.855 INFO:tasks.rgw:Creating data pools 2024-09-13T19:15:51.855 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-13T19:15:51.855 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph osd erasure-code-profile set client.0 k=2 m=1 crush-failure-domain=osd --cluster ceph 2024-09-13T19:15:51.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:51.966+0000 7fb4c15e8640 1 Processor -- start 2024-09-13T19:15:51.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:51.966+0000 7fb4c15e8640 1 -- start start 2024-09-13T19:15:51.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:51.966+0000 7fb4c15e8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb4bc10f870 0x7fb4bc11b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:51.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:51.966+0000 7fb4c15e8640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4bc11b650 con 0x7fb4bc10ed80 2024-09-13T19:15:51.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:51.966+0000 7fb4c15e8640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fb4bc11c830 con 0x7fb4bc10f870 2024-09-13T19:15:51.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:51.966+0000 7fb4b27fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb4bc10f870 0x7fb4bc11b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:51.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:51.967+0000 7fb4baffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb4bc10ed80 0x7fb4bc10f160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:60148/0 (socket says 172.21.15.102:60148) 2024-09-13T19:15:51.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:51.967+0000 7fb4baffd640 1 -- 172.21.15.102:0/2969375762 learned_addr learned my addr 172.21.15.102:0/2969375762 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:15:51.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:51.967+0000 7fb4b27fc640 1 -- 172.21.15.102:0/2969375762 >> v1:172.21.15.53:6789/0 conn(0x7fb4bc10ed80 legacy=0x7fb4bc10f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:51.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:51.967+0000 7fb4b27fc640 1 -- 172.21.15.102:0/2969375762 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4bc11c9b0 con 0x7fb4bc10f870 2024-09-13T19:15:51.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:51.967+0000 7fb4ba7fc640 1 -- 172.21.15.102:0/2969375762 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4130295060 0 0) 0x7fb4bc11b650 con 0x7fb4bc10ed80 2024-09-13T19:15:51.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:51.968+0000 7fb4b27fc640 1 --2- 172.21.15.102:0/2969375762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4bc10f870 0x7fb4bc11b110 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb4a4009720 tx=0x7fb4a402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0e012baaa5d8b9e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:51.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:51.968+0000 7fb4ba7fc640 1 -- 172.21.15.102:0/2969375762 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4a4037070 con 0x7fb4bc10f870 2024-09-13T19:15:51.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:51.968+0000 7fb4ba7fc640 1 -- 172.21.15.102:0/2969375762 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4a402ad90 con 0x7fb4bc10f870 2024-09-13T19:15:51.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:51.968+0000 7fb4ba7fc640 1 -- 172.21.15.102:0/2969375762 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4a4032590 con 0x7fb4bc10f870 2024-09-13T19:15:51.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:51.968+0000 7fb4c15e8640 1 -- 172.21.15.102:0/2969375762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4bc10f870 msgr2=0x7fb4bc11b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:51.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:51.968+0000 7fb4c15e8640 1 --2- 172.21.15.102:0/2969375762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4bc10f870 0x7fb4bc11b110 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb4a4009720 tx=0x7fb4a402a110 comp rx=0 tx=0).stop 2024-09-13T19:15:51.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:51.968+0000 7fb4c15e8640 1 -- 172.21.15.102:0/2969375762 shutdown_connections 2024-09-13T19:15:51.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:51.968+0000 7fb4c15e8640 1 --2- 172.21.15.102:0/2969375762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4bc10f870 0x7fb4bc11b110 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:51.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:51.968+0000 7fb4c15e8640 1 -- 172.21.15.102:0/2969375762 >> 172.21.15.102:0/2969375762 conn(0x7fb4bc06f300 msgr2=0x7fb4bc071720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:51.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:51.968+0000 7fb4c15e8640 1 -- 172.21.15.102:0/2969375762 shutdown_connections 2024-09-13T19:15:51.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:51.969+0000 7fb4c15e8640 1 -- 172.21.15.102:0/2969375762 wait complete. 2024-09-13T19:15:51.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:51.969+0000 7fb4c15e8640 1 Processor -- start 2024-09-13T19:15:51.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:51.969+0000 7fb4c15e8640 1 -- start start 2024-09-13T19:15:51.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:51.970+0000 7fb4c15e8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4bc10ed80 0x7fb4bc1aa2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:51.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:51.970+0000 7fb4c15e8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb4bc11bc70 con 0x7fb4bc10ed80 2024-09-13T19:15:51.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:51.970+0000 7fb4baffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4bc10ed80 0x7fb4bc1aa2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:51.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:51.970+0000 7fb4baffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4bc10ed80 0x7fb4bc1aa2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:43200/0 (socket says 172.21.15.102:43200) 2024-09-13T19:15:51.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:51.970+0000 7fb4baffd640 1 -- 172.21.15.102:0/638354535 learned_addr learned my addr 172.21.15.102:0/638354535 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:15:51.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:51.970+0000 7fb4baffd640 1 -- 172.21.15.102:0/638354535 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4bc1aa8b0 con 0x7fb4bc10ed80 2024-09-13T19:15:51.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:51.970+0000 7fb4baffd640 1 --2- 172.21.15.102:0/638354535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4bc10ed80 0x7fb4bc1aa2e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac00c3e0 tx=0x7fb4ac00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:51.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:51.970+0000 7fb4b3fff640 1 -- 172.21.15.102:0/638354535 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4ac007410 con 0x7fb4bc10ed80 2024-09-13T19:15:51.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:51.971+0000 7fb4b3fff640 1 -- 172.21.15.102:0/638354535 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4ac0075d0 con 0x7fb4bc10ed80 2024-09-13T19:15:51.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:51.971+0000 7fb4c15e8640 1 -- 172.21.15.102:0/638354535 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4bc1aab40 con 0x7fb4bc10ed80 2024-09-13T19:15:51.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:51.971+0000 7fb4b3fff640 1 -- 172.21.15.102:0/638354535 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4ac004950 con 0x7fb4bc10ed80 2024-09-13T19:15:51.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:51.971+0000 7fb4c15e8640 1 -- 172.21.15.102:0/638354535 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4bc1a45d0 con 0x7fb4bc10ed80 2024-09-13T19:15:51.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:51.971+0000 7fb4b3fff640 1 -- 172.21.15.102:0/638354535 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb4ac011070 con 0x7fb4bc10ed80 2024-09-13T19:15:51.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:51.972+0000 7fb4c15e8640 1 -- 172.21.15.102:0/638354535 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4bc11c1d0 con 0x7fb4bc10ed80 2024-09-13T19:15:51.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:51.972+0000 7fb4b3fff640 1 --2- 172.21.15.102:0/638354535 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb49c0382a0 0x7fb49c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:51.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:51.972+0000 7fb4b3fff640 1 -- 172.21.15.102:0/638354535 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3510+0+0 (secure 0 0 0) 0x7fb4ac04af10 con 0x7fb4bc10ed80 2024-09-13T19:15:51.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:51.972+0000 7fb4b27fc640 1 --2- 172.21.15.102:0/638354535 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb49c0382a0 0x7fb49c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:51.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:51.972+0000 7fb4b27fc640 1 --2- 172.21.15.102:0/638354535 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb49c0382a0 0x7fb49c03a760 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb4a4034000 tx=0x7fb4a402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:51.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:51.977+0000 7fb4b3fff640 1 -- 172.21.15.102:0/638354535 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb4ac011c60 con 0x7fb4bc10ed80 2024-09-13T19:15:52.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.154+0000 7fb4c15e8640 1 -- 172.21.15.102:0/638354535 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]} v 0) -- 0x7fb4bc1aad70 con 0x7fb4bc10ed80 2024-09-13T19:15:52.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.856+0000 7fb4b3fff640 1 -- 172.21.15.102:0/638354535 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]}]=0 v20) ==== 151+0+0 (secure 0 0 0) 0x7fb4ac049dc0 con 0x7fb4bc10ed80 2024-09-13T19:15:52.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.859+0000 7fb4c15e8640 1 -- 172.21.15.102:0/638354535 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb49c0382a0 msgr2=0x7fb49c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:52.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.859+0000 7fb4c15e8640 1 --2- 172.21.15.102:0/638354535 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb49c0382a0 0x7fb49c03a760 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb4a4034000 tx=0x7fb4a402e000 comp rx=0 tx=0).stop 2024-09-13T19:15:52.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.859+0000 7fb4c15e8640 1 -- 172.21.15.102:0/638354535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4bc10ed80 msgr2=0x7fb4bc1aa2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:52.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.859+0000 7fb4c15e8640 1 --2- 172.21.15.102:0/638354535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4bc10ed80 0x7fb4bc1aa2e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac00c3e0 tx=0x7fb4ac00c8a0 comp rx=0 tx=0).stop 2024-09-13T19:15:52.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.859+0000 7fb4c15e8640 1 -- 172.21.15.102:0/638354535 shutdown_connections 2024-09-13T19:15:52.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.859+0000 7fb4c15e8640 1 --2- 172.21.15.102:0/638354535 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb49c0382a0 0x7fb49c03a760 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:52.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.859+0000 7fb4c15e8640 1 --2- 172.21.15.102:0/638354535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4bc10ed80 0x7fb4bc1aa2e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:52.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.859+0000 7fb4c15e8640 1 -- 172.21.15.102:0/638354535 >> 172.21.15.102:0/638354535 conn(0x7fb4bc06f300 msgr2=0x7fb4bc1128b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:52.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.859+0000 7fb4c15e8640 1 -- 172.21.15.102:0/638354535 shutdown_connections 2024-09-13T19:15:52.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.859+0000 7fb4c15e8640 1 -- 172.21.15.102:0/638354535 wait complete. 2024-09-13T19:15:52.874 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-09-13T19:15:52.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.974+0000 7f73fbdd6640 1 Processor -- start 2024-09-13T19:15:52.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.974+0000 7f73fbdd6640 1 -- start start 2024-09-13T19:15:52.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.974+0000 7f73fbdd6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f73f410f870 0x7f73f411b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:52.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.974+0000 7f73fbdd6640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73f411b650 con 0x7f73f410ed80 2024-09-13T19:15:52.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.974+0000 7f73fbdd6640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f73f411c830 con 0x7f73f410f870 2024-09-13T19:15:52.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.975+0000 7f73f9371640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f73f410f870 0x7f73f411b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:52.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.975+0000 7f73f9371640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f73f410f870 0x7f73f411b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:43210/0 (socket says 172.21.15.102:43210) 2024-09-13T19:15:52.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.975+0000 7f73f9371640 1 -- 172.21.15.102:0/3440125351 learned_addr learned my addr 172.21.15.102:0/3440125351 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:15:52.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.975+0000 7f73f9371640 1 -- 172.21.15.102:0/3440125351 >> v1:172.21.15.53:6789/0 conn(0x7f73f410ed80 legacy=0x7f73f410f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:52.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.975+0000 7f73f9371640 1 -- 172.21.15.102:0/3440125351 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73f411c9b0 con 0x7f73f410f870 2024-09-13T19:15:52.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.976+0000 7f73f9371640 1 --2- 172.21.15.102:0/3440125351 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73f410f870 0x7f73f411b110 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f73e40097f0 tx=0x7f73e402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58a24344a755a5d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:52.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.976+0000 7f73f8b70640 1 -- 172.21.15.102:0/3440125351 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73e4037070 con 0x7f73f410f870 2024-09-13T19:15:52.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.976+0000 7f73f8b70640 1 -- 172.21.15.102:0/3440125351 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73e4032440 con 0x7f73f410f870 2024-09-13T19:15:52.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.976+0000 7f73f8b70640 1 -- 172.21.15.102:0/3440125351 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73e402ae60 con 0x7f73f410f870 2024-09-13T19:15:52.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.976+0000 7f73fbdd6640 1 -- 172.21.15.102:0/3440125351 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73f410f870 msgr2=0x7f73f411b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:52.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.976+0000 7f73fbdd6640 1 --2- 172.21.15.102:0/3440125351 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73f410f870 0x7f73f411b110 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f73e40097f0 tx=0x7f73e402a1e0 comp rx=0 tx=0).stop 2024-09-13T19:15:52.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.976+0000 7f73fbdd6640 1 -- 172.21.15.102:0/3440125351 shutdown_connections 2024-09-13T19:15:52.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.976+0000 7f73fbdd6640 1 --2- 172.21.15.102:0/3440125351 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73f410f870 0x7f73f411b110 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:52.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.976+0000 7f73fbdd6640 1 -- 172.21.15.102:0/3440125351 >> 172.21.15.102:0/3440125351 conn(0x7f73f406f330 msgr2=0x7f73f4071750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:52.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.976+0000 7f73fbdd6640 1 -- 172.21.15.102:0/3440125351 shutdown_connections 2024-09-13T19:15:52.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.976+0000 7f73fbdd6640 1 -- 172.21.15.102:0/3440125351 wait complete. 2024-09-13T19:15:52.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.977+0000 7f73fbdd6640 1 Processor -- start 2024-09-13T19:15:52.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.977+0000 7f73fbdd6640 1 -- start start 2024-09-13T19:15:52.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.977+0000 7f73fbdd6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73f410ed80 0x7f73f41a6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:52.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.977+0000 7f73fbdd6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f73f411bc40 con 0x7f73f410ed80 2024-09-13T19:15:52.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.978+0000 7f73f9b72640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73f410ed80 0x7f73f41a6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:52.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.978+0000 7f73f9b72640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73f410ed80 0x7f73f41a6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:43220/0 (socket says 172.21.15.102:43220) 2024-09-13T19:15:52.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.978+0000 7f73f9b72640 1 -- 172.21.15.102:0/3698924905 learned_addr learned my addr 172.21.15.102:0/3698924905 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:15:52.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.978+0000 7f73f9b72640 1 -- 172.21.15.102:0/3698924905 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73f41a7210 con 0x7f73f410ed80 2024-09-13T19:15:52.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.978+0000 7f73f9b72640 1 --2- 172.21.15.102:0/3698924905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73f410ed80 0x7f73f41a6c40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f73f000c380 tx=0x7f73f000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:52.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.978+0000 7f73ea7fc640 1 -- 172.21.15.102:0/3698924905 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73f0005150 con 0x7f73f410ed80 2024-09-13T19:15:52.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.978+0000 7f73ea7fc640 1 -- 172.21.15.102:0/3698924905 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73f00052f0 con 0x7f73f410ed80 2024-09-13T19:15:52.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.978+0000 7f73fbdd6640 1 -- 172.21.15.102:0/3698924905 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73f41a7500 con 0x7f73f410ed80 2024-09-13T19:15:52.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.978+0000 7f73ea7fc640 1 -- 172.21.15.102:0/3698924905 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73f0007030 con 0x7f73f410ed80 2024-09-13T19:15:52.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.978+0000 7f73fbdd6640 1 -- 172.21.15.102:0/3698924905 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73f41ab570 con 0x7f73f410ed80 2024-09-13T19:15:52.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.979+0000 7f73fbdd6640 1 -- 172.21.15.102:0/3698924905 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73f41a7730 con 0x7f73f410ed80 2024-09-13T19:15:52.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.979+0000 7f73ea7fc640 1 -- 172.21.15.102:0/3698924905 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f73f0019020 con 0x7f73f410ed80 2024-09-13T19:15:52.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.979+0000 7f73ea7fc640 1 --2- 172.21.15.102:0/3698924905 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f73d8038250 0x7f73d803a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:52.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.979+0000 7f73ea7fc640 1 -- 172.21.15.102:0/3698924905 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3774+0+0 (secure 0 0 0) 0x7f73f004a710 con 0x7f73f410ed80 2024-09-13T19:15:52.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.979+0000 7f73f9371640 1 --2- 172.21.15.102:0/3698924905 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f73d8038250 0x7f73d803a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:52.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.980+0000 7f73f9371640 1 --2- 172.21.15.102:0/3698924905 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f73d8038250 0x7f73d803a710 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f73e4034000 tx=0x7f73e402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:52.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:52.984+0000 7f73ea7fc640 1 -- 172.21.15.102:0/3698924905 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f73f001a560 con 0x7f73f410ed80 2024-09-13T19:15:53.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:53.152+0000 7f73fbdd6640 1 -- 172.21.15.102:0/3698924905 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"} v 0) -- 0x7f73f411c180 con 0x7f73f410ed80 2024-09-13T19:15:54.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:54.862+0000 7f73ea7fc640 1 -- 172.21.15.102:0/3698924905 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"}]=0 pool 'default.rgw.buckets.data' created v22) ==== 227+0+0 (secure 0 0 0) 0x7f73f001a7c0 con 0x7f73f410ed80 2024-09-13T19:15:54.866 INFO:teuthology.orchestra.run.smithi102.stderr:pool 'default.rgw.buckets.data' created 2024-09-13T19:15:54.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:54.867+0000 7f73fbdd6640 1 -- 172.21.15.102:0/3698924905 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f73d8038250 msgr2=0x7f73d803a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:54.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:54.867+0000 7f73fbdd6640 1 --2- 172.21.15.102:0/3698924905 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f73d8038250 0x7f73d803a710 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f73e4034000 tx=0x7f73e402e000 comp rx=0 tx=0).stop 2024-09-13T19:15:54.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:54.867+0000 7f73fbdd6640 1 -- 172.21.15.102:0/3698924905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73f410ed80 msgr2=0x7f73f41a6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:54.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:54.867+0000 7f73fbdd6640 1 --2- 172.21.15.102:0/3698924905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73f410ed80 0x7f73f41a6c40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f73f000c380 tx=0x7f73f000c840 comp rx=0 tx=0).stop 2024-09-13T19:15:54.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:54.867+0000 7f73fbdd6640 1 -- 172.21.15.102:0/3698924905 shutdown_connections 2024-09-13T19:15:54.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:54.867+0000 7f73fbdd6640 1 --2- 172.21.15.102:0/3698924905 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f73d8038250 0x7f73d803a710 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:54.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:54.867+0000 7f73fbdd6640 1 --2- 172.21.15.102:0/3698924905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73f410ed80 0x7f73f41a6c40 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:54.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:54.867+0000 7f73fbdd6640 1 -- 172.21.15.102:0/3698924905 >> 172.21.15.102:0/3698924905 conn(0x7f73f406f330 msgr2=0x7f73f41101e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:54.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:54.868+0000 7f73fbdd6640 1 -- 172.21.15.102:0/3698924905 shutdown_connections 2024-09-13T19:15:54.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:54.870+0000 7f73fbdd6640 1 -- 172.21.15.102:0/3698924905 wait complete. 2024-09-13T19:15:54.892 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-13T19:15:54.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:54.992+0000 7f700f9c4640 1 Processor -- start 2024-09-13T19:15:54.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:54.992+0000 7f700f9c4640 1 -- start start 2024-09-13T19:15:54.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:54.992+0000 7f700f9c4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7008117a50 0x7f7008119e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:54.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:54.992+0000 7f700f9c4640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f700811a380 con 0x7f7008114c40 2024-09-13T19:15:54.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:54.992+0000 7f700f9c4640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f700811b560 con 0x7f7008117a50 2024-09-13T19:15:54.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:54.992+0000 7f700cf5f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7008117a50 0x7f7008119e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:54.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:54.992+0000 7f700d760640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7008114c40 0x7f7008115020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:60174/0 (socket says 172.21.15.102:60174) 2024-09-13T19:15:54.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:54.992+0000 7f700d760640 1 -- 172.21.15.102:0/1500979299 learned_addr learned my addr 172.21.15.102:0/1500979299 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:15:54.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:54.993+0000 7f700cf5f640 1 -- 172.21.15.102:0/1500979299 >> v1:172.21.15.53:6789/0 conn(0x7f7008114c40 legacy=0x7f7008115020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:54.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:54.993+0000 7f700cf5f640 1 -- 172.21.15.102:0/1500979299 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f700811b6e0 con 0x7f7008117a50 2024-09-13T19:15:55.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:54.993+0000 7f700cf5f640 1 --2- 172.21.15.102:0/1500979299 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7008117a50 0x7f7008119e40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8009720 tx=0x7f6ff802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=622cd75ad32b3c9b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:55.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:54.994+0000 7f6ffffff640 1 -- 172.21.15.102:0/1500979299 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ff8037070 con 0x7f7008117a50 2024-09-13T19:15:55.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:54.994+0000 7f6ffffff640 1 -- 172.21.15.102:0/1500979299 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ff802ad90 con 0x7f7008117a50 2024-09-13T19:15:55.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:54.994+0000 7f6ffffff640 1 -- 172.21.15.102:0/1500979299 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ff8032590 con 0x7f7008117a50 2024-09-13T19:15:55.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:54.994+0000 7f700f9c4640 1 -- 172.21.15.102:0/1500979299 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7008117a50 msgr2=0x7f7008119e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:55.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:54.994+0000 7f700f9c4640 1 --2- 172.21.15.102:0/1500979299 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7008117a50 0x7f7008119e40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8009720 tx=0x7f6ff802a110 comp rx=0 tx=0).stop 2024-09-13T19:15:55.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:54.994+0000 7f700f9c4640 1 -- 172.21.15.102:0/1500979299 shutdown_connections 2024-09-13T19:15:55.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:54.994+0000 7f700f9c4640 1 --2- 172.21.15.102:0/1500979299 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7008117a50 0x7f7008119e40 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:55.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:54.994+0000 7f700f9c4640 1 -- 172.21.15.102:0/1500979299 >> 172.21.15.102:0/1500979299 conn(0x7f700806f300 msgr2=0x7f7008071720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:55.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:54.994+0000 7f700f9c4640 1 -- 172.21.15.102:0/1500979299 shutdown_connections 2024-09-13T19:15:55.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:54.994+0000 7f700f9c4640 1 -- 172.21.15.102:0/1500979299 wait complete. 2024-09-13T19:15:55.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:54.995+0000 7f700f9c4640 1 Processor -- start 2024-09-13T19:15:55.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:54.995+0000 7f700f9c4640 1 -- start start 2024-09-13T19:15:55.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:54.995+0000 7f700f9c4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7008114c40 0x7f70081a5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:55.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:54.995+0000 7f700f9c4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f700811aa70 con 0x7f7008114c40 2024-09-13T19:15:55.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:54.995+0000 7f700d760640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7008114c40 0x7f70081a5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:55.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:54.995+0000 7f700d760640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7008114c40 0x7f70081a5640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:43230/0 (socket says 172.21.15.102:43230) 2024-09-13T19:15:55.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:54.996+0000 7f700d760640 1 -- 172.21.15.102:0/157549693 learned_addr learned my addr 172.21.15.102:0/157549693 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:15:55.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:54.996+0000 7f700d760640 1 -- 172.21.15.102:0/157549693 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70081a5b80 con 0x7f7008114c40 2024-09-13T19:15:55.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:54.996+0000 7f700d760640 1 --2- 172.21.15.102:0/157549693 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7008114c40 0x7f70081a5640 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f700000ca90 tx=0x7f700000cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:55.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:54.996+0000 7f6ffdffb640 1 -- 172.21.15.102:0/157549693 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7000018070 con 0x7f7008114c40 2024-09-13T19:15:55.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:54.996+0000 7f6ffdffb640 1 -- 172.21.15.102:0/157549693 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7000004c90 con 0x7f7008114c40 2024-09-13T19:15:55.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:54.996+0000 7f700f9c4640 1 -- 172.21.15.102:0/157549693 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70081a5e10 con 0x7f7008114c40 2024-09-13T19:15:55.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:54.996+0000 7f6ffdffb640 1 -- 172.21.15.102:0/157549693 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f700000aa50 con 0x7f7008114c40 2024-09-13T19:15:55.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:54.996+0000 7f700f9c4640 1 -- 172.21.15.102:0/157549693 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70081a6360 con 0x7f7008114c40 2024-09-13T19:15:55.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:54.997+0000 7f700f9c4640 1 -- 172.21.15.102:0/157549693 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f700811afb0 con 0x7f7008114c40 2024-09-13T19:15:55.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:54.997+0000 7f6ffdffb640 1 -- 172.21.15.102:0/157549693 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f700001b070 con 0x7f7008114c40 2024-09-13T19:15:55.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:54.998+0000 7f6ffdffb640 1 --2- 172.21.15.102:0/157549693 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6fec038250 0x7f6fec03a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:55.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:54.998+0000 7f6ffdffb640 1 -- 172.21.15.102:0/157549693 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 4249+0+0 (secure 0 0 0) 0x7f700004b380 con 0x7f7008114c40 2024-09-13T19:15:55.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:54.998+0000 7f700cf5f640 1 --2- 172.21.15.102:0/157549693 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6fec038250 0x7f6fec03a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:55.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:54.998+0000 7f700cf5f640 1 --2- 172.21.15.102:0/157549693 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6fec038250 0x7f6fec03a710 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8034000 tx=0x7f6ff802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:55.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:55.003+0000 7f6ffdffb640 1 -- 172.21.15.102:0/157549693 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7000007a30 con 0x7f7008114c40 2024-09-13T19:15:55.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:55.168+0000 7f700f9c4640 1 -- 172.21.15.102:0/157549693 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) -- 0x7f7008117a50 con 0x7f7008114c40 2024-09-13T19:15:55.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:55.866+0000 7f6ffdffb640 1 -- 172.21.15.102:0/157549693 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v23) ==== 185+0+0 (secure 0 0 0) 0x7f700001b360 con 0x7f7008114c40 2024-09-13T19:15:55.869 INFO:teuthology.orchestra.run.smithi102.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-13T19:15:55.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:55.870+0000 7f700f9c4640 1 -- 172.21.15.102:0/157549693 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6fec038250 msgr2=0x7f6fec03a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:55.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:55.870+0000 7f700f9c4640 1 --2- 172.21.15.102:0/157549693 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6fec038250 0x7f6fec03a710 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8034000 tx=0x7f6ff802e000 comp rx=0 tx=0).stop 2024-09-13T19:15:55.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:55.870+0000 7f700f9c4640 1 -- 172.21.15.102:0/157549693 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7008114c40 msgr2=0x7f70081a5640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:55.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:55.870+0000 7f700f9c4640 1 --2- 172.21.15.102:0/157549693 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7008114c40 0x7f70081a5640 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f700000ca90 tx=0x7f700000cf50 comp rx=0 tx=0).stop 2024-09-13T19:15:55.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:55.870+0000 7f700f9c4640 1 -- 172.21.15.102:0/157549693 shutdown_connections 2024-09-13T19:15:55.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:55.870+0000 7f700f9c4640 1 --2- 172.21.15.102:0/157549693 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6fec038250 0x7f6fec03a710 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:55.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:55.870+0000 7f700f9c4640 1 --2- 172.21.15.102:0/157549693 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7008114c40 0x7f70081a5640 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:55.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:55.870+0000 7f700f9c4640 1 -- 172.21.15.102:0/157549693 >> 172.21.15.102:0/157549693 conn(0x7f700806f300 msgr2=0x7f7008117e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:55.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:55.870+0000 7f700f9c4640 1 -- 172.21.15.102:0/157549693 shutdown_connections 2024-09-13T19:15:55.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:55.870+0000 7f700f9c4640 1 -- 172.21.15.102:0/157549693 wait complete. 2024-09-13T19:15:55.896 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-13T19:15:55.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:55.995+0000 7f11a6d18640 1 Processor -- start 2024-09-13T19:15:55.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:55.995+0000 7f11a6d18640 1 -- start start 2024-09-13T19:15:55.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:55.995+0000 7f11a6d18640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f11a0117a50 0x7f11a0119e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:55.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:55.995+0000 7f11a6d18640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11a011a380 con 0x7f11a0114c40 2024-09-13T19:15:55.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:55.995+0000 7f11a6d18640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f11a011b560 con 0x7f11a0117a50 2024-09-13T19:15:55.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:55.995+0000 7f119ffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f11a0117a50 0x7f11a0119e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:56.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:55.995+0000 7f11a4ab4640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f11a0114c40 0x7f11a0115020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:60190/0 (socket says 172.21.15.102:60190) 2024-09-13T19:15:56.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:55.995+0000 7f11a4ab4640 1 -- 172.21.15.102:0/3805295993 learned_addr learned my addr 172.21.15.102:0/3805295993 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:15:56.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:55.996+0000 7f119ffff640 1 -- 172.21.15.102:0/3805295993 >> v1:172.21.15.53:6789/0 conn(0x7f11a0114c40 legacy=0x7f11a0115020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:56.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:55.996+0000 7f119ffff640 1 -- 172.21.15.102:0/3805295993 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11a011b6e0 con 0x7f11a0117a50 2024-09-13T19:15:56.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:55.997+0000 7f119ffff640 1 --2- 172.21.15.102:0/3805295993 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11a0117a50 0x7f11a0119e40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1190009d90 tx=0x7f119002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d395cafad02e8714 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:56.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:55.997+0000 7f119f7fe640 1 -- 172.21.15.102:0/3805295993 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1190007670 con 0x7f11a0117a50 2024-09-13T19:15:56.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:55.997+0000 7f119f7fe640 1 -- 172.21.15.102:0/3805295993 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1190007810 con 0x7f11a0117a50 2024-09-13T19:15:56.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:55.997+0000 7f119f7fe640 1 -- 172.21.15.102:0/3805295993 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1190007b10 con 0x7f11a0117a50 2024-09-13T19:15:56.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:55.997+0000 7f11a6d18640 1 -- 172.21.15.102:0/3805295993 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11a0117a50 msgr2=0x7f11a0119e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:56.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:55.997+0000 7f11a6d18640 1 --2- 172.21.15.102:0/3805295993 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11a0117a50 0x7f11a0119e40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1190009d90 tx=0x7f119002a660 comp rx=0 tx=0).stop 2024-09-13T19:15:56.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:55.997+0000 7f11a6d18640 1 -- 172.21.15.102:0/3805295993 shutdown_connections 2024-09-13T19:15:56.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:55.997+0000 7f11a6d18640 1 --2- 172.21.15.102:0/3805295993 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11a0117a50 0x7f11a0119e40 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:56.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:55.997+0000 7f11a6d18640 1 -- 172.21.15.102:0/3805295993 >> 172.21.15.102:0/3805295993 conn(0x7f11a006f300 msgr2=0x7f11a0071720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:56.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:55.997+0000 7f11a6d18640 1 -- 172.21.15.102:0/3805295993 shutdown_connections 2024-09-13T19:15:56.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:55.997+0000 7f11a6d18640 1 -- 172.21.15.102:0/3805295993 wait complete. 2024-09-13T19:15:56.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:55.998+0000 7f11a6d18640 1 Processor -- start 2024-09-13T19:15:56.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:55.998+0000 7f11a6d18640 1 -- start start 2024-09-13T19:15:56.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:55.998+0000 7f11a6d18640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11a0114c40 0x7f11a01a4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:56.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:55.998+0000 7f11a6d18640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f11a011aa70 con 0x7f11a0114c40 2024-09-13T19:15:56.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:55.998+0000 7f11a4ab4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11a0114c40 0x7f11a01a4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:56.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:55.998+0000 7f11a4ab4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11a0114c40 0x7f11a01a4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:43240/0 (socket says 172.21.15.102:43240) 2024-09-13T19:15:56.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:55.999+0000 7f11a4ab4640 1 -- 172.21.15.102:0/1227110679 learned_addr learned my addr 172.21.15.102:0/1227110679 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:15:56.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:55.999+0000 7f11a4ab4640 1 -- 172.21.15.102:0/1227110679 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11a01a4f50 con 0x7f11a0114c40 2024-09-13T19:15:56.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:55.999+0000 7f11a4ab4640 1 --2- 172.21.15.102:0/1227110679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11a0114c40 0x7f11a01a4a10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f119800c380 tx=0x7f119800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:56.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:55.999+0000 7f119d7fa640 1 -- 172.21.15.102:0/1227110679 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1198005c10 con 0x7f11a0114c40 2024-09-13T19:15:56.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:55.999+0000 7f119d7fa640 1 -- 172.21.15.102:0/1227110679 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1198005db0 con 0x7f11a0114c40 2024-09-13T19:15:56.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:55.999+0000 7f11a6d18640 1 -- 172.21.15.102:0/1227110679 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11a01a51e0 con 0x7f11a0114c40 2024-09-13T19:15:56.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:55.999+0000 7f119d7fa640 1 -- 172.21.15.102:0/1227110679 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1198004930 con 0x7f11a0114c40 2024-09-13T19:15:56.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:55.999+0000 7f11a6d18640 1 -- 172.21.15.102:0/1227110679 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11a01a9110 con 0x7f11a0114c40 2024-09-13T19:15:56.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.000+0000 7f119d7fa640 1 -- 172.21.15.102:0/1227110679 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f119801a020 con 0x7f11a0114c40 2024-09-13T19:15:56.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.000+0000 7f11a6d18640 1 -- 172.21.15.102:0/1227110679 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11a011afb0 con 0x7f11a0114c40 2024-09-13T19:15:56.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.000+0000 7f119d7fa640 1 --2- 172.21.15.102:0/1227110679 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f1180038280 0x7f118003a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:56.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.001+0000 7f119d7fa640 1 -- 172.21.15.102:0/1227110679 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 4260+0+0 (secure 0 0 0) 0x7f119804ae20 con 0x7f11a0114c40 2024-09-13T19:15:56.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.001+0000 7f119ffff640 1 --2- 172.21.15.102:0/1227110679 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f1180038280 0x7f118003a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:56.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.001+0000 7f119ffff640 1 --2- 172.21.15.102:0/1227110679 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f1180038280 0x7f118003a740 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1190034000 tx=0x7f119002f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:56.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.006+0000 7f119d7fa640 1 -- 172.21.15.102:0/1227110679 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f11980499e0 con 0x7f11a0114c40 2024-09-13T19:15:56.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.170+0000 7f11a6d18640 1 -- 172.21.15.102:0/1227110679 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7f11a0117a50 con 0x7f11a0114c40 2024-09-13T19:15:56.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.869+0000 7f119d7fa640 1 -- 172.21.15.102:0/1227110679 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v24) ==== 169+0+0 (secure 0 0 0) 0x7f11980127f0 con 0x7f11a0114c40 2024-09-13T19:15:56.873 INFO:teuthology.orchestra.run.smithi102.stderr:pool 'default.rgw.buckets.index' created 2024-09-13T19:15:56.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.873+0000 7f11a6d18640 1 -- 172.21.15.102:0/1227110679 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f1180038280 msgr2=0x7f118003a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:56.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.873+0000 7f11a6d18640 1 --2- 172.21.15.102:0/1227110679 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f1180038280 0x7f118003a740 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1190034000 tx=0x7f119002f000 comp rx=0 tx=0).stop 2024-09-13T19:15:56.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.873+0000 7f11a6d18640 1 -- 172.21.15.102:0/1227110679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11a0114c40 msgr2=0x7f11a01a4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:56.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.873+0000 7f11a6d18640 1 --2- 172.21.15.102:0/1227110679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11a0114c40 0x7f11a01a4a10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f119800c380 tx=0x7f119800c840 comp rx=0 tx=0).stop 2024-09-13T19:15:56.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.874+0000 7f11a6d18640 1 -- 172.21.15.102:0/1227110679 shutdown_connections 2024-09-13T19:15:56.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.874+0000 7f11a6d18640 1 --2- 172.21.15.102:0/1227110679 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f1180038280 0x7f118003a740 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:56.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.874+0000 7f11a6d18640 1 --2- 172.21.15.102:0/1227110679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11a0114c40 0x7f11a01a4a10 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:56.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.874+0000 7f11a6d18640 1 -- 172.21.15.102:0/1227110679 >> 172.21.15.102:0/1227110679 conn(0x7f11a006f300 msgr2=0x7f11a00719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:56.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.874+0000 7f11a6d18640 1 -- 172.21.15.102:0/1227110679 shutdown_connections 2024-09-13T19:15:56.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.874+0000 7f11a6d18640 1 -- 172.21.15.102:0/1227110679 wait complete. 2024-09-13T19:15:56.895 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-13T19:15:56.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.993+0000 7f127f00a640 1 Processor -- start 2024-09-13T19:15:56.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.993+0000 7f127f00a640 1 -- start start 2024-09-13T19:15:56.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.993+0000 7f127f00a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f127811acb0 0x7f127811d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:56.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.993+0000 7f127f00a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f127811d5e0 con 0x7f1278117fe0 2024-09-13T19:15:56.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.993+0000 7f127f00a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f127811e7e0 con 0x7f127811acb0 2024-09-13T19:15:56.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.994+0000 7f1277fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f127811acb0 0x7f127811d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:56.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.994+0000 7f127cda6640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f1278117fe0 0x7f12781183c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:60206/0 (socket says 172.21.15.102:60206) 2024-09-13T19:15:56.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.994+0000 7f127cda6640 1 -- 172.21.15.102:0/3992526967 learned_addr learned my addr 172.21.15.102:0/3992526967 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:15:56.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.994+0000 7f1277fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f127811acb0 0x7f127811d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:43246/0 (socket says 172.21.15.102:43246) 2024-09-13T19:15:56.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.994+0000 7f1277fff640 1 -- 172.21.15.102:0/3992526967 >> v1:172.21.15.53:6789/0 conn(0x7f1278117fe0 legacy=0x7f12781183c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:56.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.994+0000 7f1277fff640 1 -- 172.21.15.102:0/3992526967 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f127811e990 con 0x7f127811acb0 2024-09-13T19:15:57.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.995+0000 7f1277fff640 1 --2- 172.21.15.102:0/3992526967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f127811acb0 0x7f127811d0a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f126c009720 tx=0x7f126c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=807b233ca6a27452 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:57.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.995+0000 7f12777fe640 1 -- 172.21.15.102:0/3992526967 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f126c037070 con 0x7f127811acb0 2024-09-13T19:15:57.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.995+0000 7f12777fe640 1 -- 172.21.15.102:0/3992526967 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f126c02ad90 con 0x7f127811acb0 2024-09-13T19:15:57.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.995+0000 7f12777fe640 1 -- 172.21.15.102:0/3992526967 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f126c032590 con 0x7f127811acb0 2024-09-13T19:15:57.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.996+0000 7f127f00a640 1 -- 172.21.15.102:0/3992526967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f127811acb0 msgr2=0x7f127811d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:57.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.996+0000 7f127f00a640 1 --2- 172.21.15.102:0/3992526967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f127811acb0 0x7f127811d0a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f126c009720 tx=0x7f126c02a110 comp rx=0 tx=0).stop 2024-09-13T19:15:57.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.996+0000 7f127f00a640 1 -- 172.21.15.102:0/3992526967 shutdown_connections 2024-09-13T19:15:57.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.996+0000 7f127f00a640 1 --2- 172.21.15.102:0/3992526967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f127811acb0 0x7f127811d0a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:57.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.996+0000 7f127f00a640 1 -- 172.21.15.102:0/3992526967 >> 172.21.15.102:0/3992526967 conn(0x7f127806e680 msgr2=0x7f127806ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:57.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.996+0000 7f127f00a640 1 -- 172.21.15.102:0/3992526967 shutdown_connections 2024-09-13T19:15:57.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.996+0000 7f127f00a640 1 -- 172.21.15.102:0/3992526967 wait complete. 2024-09-13T19:15:57.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.996+0000 7f127f00a640 1 Processor -- start 2024-09-13T19:15:57.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.996+0000 7f127f00a640 1 -- start start 2024-09-13T19:15:57.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.997+0000 7f127f00a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1278117fe0 0x7f12781a6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:57.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.997+0000 7f127f00a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f127811dcd0 con 0x7f1278117fe0 2024-09-13T19:15:57.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.997+0000 7f127cda6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1278117fe0 0x7f12781a6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:57.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.997+0000 7f127cda6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1278117fe0 0x7f12781a6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:43254/0 (socket says 172.21.15.102:43254) 2024-09-13T19:15:57.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.997+0000 7f127cda6640 1 -- 172.21.15.102:0/2159461940 learned_addr learned my addr 172.21.15.102:0/2159461940 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:15:57.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.997+0000 7f127cda6640 1 -- 172.21.15.102:0/2159461940 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12781a7160 con 0x7f1278117fe0 2024-09-13T19:15:57.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.997+0000 7f127cda6640 1 --2- 172.21.15.102:0/2159461940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1278117fe0 0x7f12781a6b90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f126800c380 tx=0x7f126800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:57.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.998+0000 7f12757fa640 1 -- 172.21.15.102:0/2159461940 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1268005c10 con 0x7f1278117fe0 2024-09-13T19:15:57.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.998+0000 7f12757fa640 1 -- 172.21.15.102:0/2159461940 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1268005db0 con 0x7f1278117fe0 2024-09-13T19:15:57.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.998+0000 7f127f00a640 1 -- 172.21.15.102:0/2159461940 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12781a73f0 con 0x7f1278117fe0 2024-09-13T19:15:57.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.998+0000 7f12757fa640 1 -- 172.21.15.102:0/2159461940 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1268004930 con 0x7f1278117fe0 2024-09-13T19:15:57.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.998+0000 7f127f00a640 1 -- 172.21.15.102:0/2159461940 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12781ab4c0 con 0x7f1278117fe0 2024-09-13T19:15:57.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.998+0000 7f127f00a640 1 -- 172.21.15.102:0/2159461940 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f127811e290 con 0x7f1278117fe0 2024-09-13T19:15:57.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.999+0000 7f12757fa640 1 -- 172.21.15.102:0/2159461940 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f126801a020 con 0x7f1278117fe0 2024-09-13T19:15:57.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.999+0000 7f12757fa640 1 --2- 172.21.15.102:0/2159461940 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f12640382a0 0x7f126403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:15:57.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.999+0000 7f12757fa640 1 -- 172.21.15.102:0/2159461940 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 4624+0+0 (secure 0 0 0) 0x7f126804af30 con 0x7f1278117fe0 2024-09-13T19:15:57.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.999+0000 7f1277fff640 1 --2- 172.21.15.102:0/2159461940 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f12640382a0 0x7f126403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:15:57.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:56.999+0000 7f1277fff640 1 --2- 172.21.15.102:0/2159461940 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f12640382a0 0x7f126403a760 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f126c034000 tx=0x7f126c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:15:57.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:57.004+0000 7f12757fa640 1 -- 172.21.15.102:0/2159461940 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f12680499b0 con 0x7f1278117fe0 2024-09-13T19:15:57.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:57.168+0000 7f127f00a640 1 -- 172.21.15.102:0/2159461940 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) -- 0x7f12781a7620 con 0x7f1278117fe0 2024-09-13T19:15:57.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:57.872+0000 7f12757fa640 1 -- 172.21.15.102:0/2159461940 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v25) ==== 187+0+0 (secure 0 0 0) 0x7f12680127f0 con 0x7f1278117fe0 2024-09-13T19:15:57.876 INFO:teuthology.orchestra.run.smithi102.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-13T19:15:57.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:57.875+0000 7f127f00a640 1 -- 172.21.15.102:0/2159461940 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f12640382a0 msgr2=0x7f126403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:57.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:57.875+0000 7f127f00a640 1 --2- 172.21.15.102:0/2159461940 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f12640382a0 0x7f126403a760 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f126c034000 tx=0x7f126c02e000 comp rx=0 tx=0).stop 2024-09-13T19:15:57.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:57.875+0000 7f127f00a640 1 -- 172.21.15.102:0/2159461940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1278117fe0 msgr2=0x7f12781a6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:15:57.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:57.875+0000 7f127f00a640 1 --2- 172.21.15.102:0/2159461940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1278117fe0 0x7f12781a6b90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f126800c380 tx=0x7f126800c840 comp rx=0 tx=0).stop 2024-09-13T19:15:57.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:57.875+0000 7f127f00a640 1 -- 172.21.15.102:0/2159461940 shutdown_connections 2024-09-13T19:15:57.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:57.875+0000 7f127f00a640 1 --2- 172.21.15.102:0/2159461940 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f12640382a0 0x7f126403a760 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:57.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:57.875+0000 7f127f00a640 1 --2- 172.21.15.102:0/2159461940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1278117fe0 0x7f12781a6b90 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:15:57.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:57.875+0000 7f127f00a640 1 -- 172.21.15.102:0/2159461940 >> 172.21.15.102:0/2159461940 conn(0x7f127806e680 msgr2=0x7f1278110d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:15:57.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:57.875+0000 7f127f00a640 1 -- 172.21.15.102:0/2159461940 shutdown_connections 2024-09-13T19:15:57.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:15:57.876+0000 7f127f00a640 1 -- 172.21.15.102:0/2159461940 wait complete. 2024-09-13T19:15:57.909 DEBUG:tasks.rgw:Pools created 2024-09-13T19:15:57.910 INFO:tasks.rgw:Starting rgw... 2024-09-13T19:15:57.910 INFO:tasks.rgw:rgw client.0 config is {} 2024-09-13T19:15:57.910 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-13T19:15:57.910 DEBUG:teuthology.orchestra.run.smithi102:> sudo echo -n http://smithi102.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-13T19:15:57.937 INFO:teuthology.orchestra.run.smithi102.stdout:http://smithi102.front.sepia.ceph.com:80 2024-09-13T19:15:57.938 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-13T19:15:58.004 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-13T19:15:58.004 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-13T19:15:58.046 INFO:tasks.rgw.client.0:Started 2024-09-13T19:15:58.047 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi102.front.sepia.ceph.com:80/ 2024-09-13T19:15:58.047 DEBUG:teuthology.orchestra.run.smithi102:> curl http://smithi102.front.sepia.ceph.com:80/ 2024-09-13T19:15:58.102 INFO:teuthology.orchestra.run.smithi102.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-13T19:15:58.102 INFO:teuthology.orchestra.run.smithi102.stderr: Dload Upload Total Spent Left Speed 2024-09-13T19:15:58.104 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-13T19:15:58.104 INFO:teuthology.orchestra.run.smithi102.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-13T19:15:58.104 INFO:teuthology.orchestra.run.smithi102.stderr:curl: (7) Failed to connect to smithi102.front.sepia.ceph.com port 80: Connection refused 2024-09-13T19:15:59.105 DEBUG:teuthology.orchestra.run.smithi102:> curl http://smithi102.front.sepia.ceph.com:80/ 2024-09-13T19:15:59.126 INFO:teuthology.orchestra.run.smithi102.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-13T19:15:59.126 INFO:teuthology.orchestra.run.smithi102.stderr: Dload Upload Total Spent Left Speed 2024-09-13T19:15:59.126 INFO:teuthology.orchestra.run.smithi102.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-13T19:15:59.127 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-13T19:15:59.128 INFO:teuthology.orchestra.run.smithi102.stderr:curl: (7) Failed to connect to smithi102.front.sepia.ceph.com port 80: Connection refused 2024-09-13T19:16:01.129 DEBUG:teuthology.orchestra.run.smithi102:> curl http://smithi102.front.sepia.ceph.com:80/ 2024-09-13T19:16:01.153 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-13T19:16:01.153 INFO:teuthology.orchestra.run.smithi102.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-13T19:16:01.153 INFO:teuthology.orchestra.run.smithi102.stderr: Dload Upload Total Spent Left Speed 2024-09-13T19:16:01.153 INFO:teuthology.orchestra.run.smithi102.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-13T19:16:01.153 INFO:teuthology.orchestra.run.smithi102.stderr:curl: (7) Failed to connect to smithi102.front.sepia.ceph.com port 80: Connection refused 2024-09-13T19:16:05.155 DEBUG:teuthology.orchestra.run.smithi102:> curl http://smithi102.front.sepia.ceph.com:80/ 2024-09-13T19:16:05.178 INFO:teuthology.orchestra.run.smithi102.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-13T19:16:05.179 INFO:teuthology.orchestra.run.smithi102.stderr: Dload Upload Total Spent Left Speed 2024-09-13T19:16:05.179 INFO:teuthology.orchestra.run.smithi102.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-13T19:16:05.180 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-13T19:16:05.180 INFO:teuthology.orchestra.run.smithi102.stderr:curl: (7) Failed to connect to smithi102.front.sepia.ceph.com port 80: Connection refused 2024-09-13T19:16:07.058 INFO:tasks.rgw.client.0.smithi102.stdout:2024-09-13T19:16:07.055+0000 7f571662f880 -1 LDAP not started since no server URIs were provided in the configuration. 2024-09-13T19:16:13.182 DEBUG:teuthology.orchestra.run.smithi102:> curl http://smithi102.front.sepia.ceph.com:80/ 2024-09-13T19:16:13.205 INFO:teuthology.orchestra.run.smithi102.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-13T19:16:13.205 INFO:teuthology.orchestra.run.smithi102.stderr: Dload Upload Total Spent Left Speed 2024-09-13T19:16:13.207 INFO:teuthology.orchestra.run.smithi102.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 93500 0 --:--:-- --:--:-- --:--:-- 93500 2024-09-13T19:16:13.207 INFO:teuthology.orchestra.run.smithi102.stdout:anonymous 2024-09-13T19:16:13.207 INFO:teuthology.run_tasks:Running task radosgw-admin... 2024-09-13T19:16:13.328 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2024-09-13T19:16:13.328 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-13T19:16:13.328 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-13T19:16:13.328 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-13T19:16:13.377 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:13.492 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:13.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.374+0000 7fd1da142800 1 Processor -- start 2024-09-13T19:16:13.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.374+0000 7fd1da142800 1 -- start start 2024-09-13T19:16:13.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.374+0000 7fd1da142800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55c2ebd3ee00 0x55c2ebdce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:13.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.374+0000 7fd1da142800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c2ebc8ab30 con 0x55c2ebdce6f0 2024-09-13T19:16:13.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.374+0000 7fd1da142800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55c2ebc6c360 con 0x55c2ebd3ee00 2024-09-13T19:16:13.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.375+0000 7fd1d5e97640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55c2ebd3ee00 0x55c2ebdce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:13.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.375+0000 7fd1d5e97640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55c2ebd3ee00 0x55c2ebdce1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53422/0 (socket says 172.21.15.102:53422) 2024-09-13T19:16:13.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.375+0000 7fd1cffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55c2ebdce6f0 0x55c2ebdd0ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:49710/0 (socket says 172.21.15.102:49710) 2024-09-13T19:16:13.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.375+0000 7fd1d5e97640 1 -- 172.21.15.102:0/623323081 learned_addr learned my addr 172.21.15.102:0/623323081 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:13.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.375+0000 7fd1d5e97640 1 -- 172.21.15.102:0/623323081 >> v1:172.21.15.53:6789/0 conn(0x55c2ebdce6f0 legacy=0x55c2ebdd0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:13.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.375+0000 7fd1d5e97640 1 -- 172.21.15.102:0/623323081 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2ebc92e00 con 0x55c2ebd3ee00 2024-09-13T19:16:13.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.377+0000 7fd1d5e97640 1 --2- 172.21.15.102:0/623323081 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c2ebd3ee00 0x55c2ebdce1b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd1c800a520 tx=0x7fd1c8045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=731e62f7536f005f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:13.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.377+0000 7fd1d5696640 1 -- 172.21.15.102:0/623323081 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1c8055070 con 0x55c2ebd3ee00 2024-09-13T19:16:13.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.377+0000 7fd1d5696640 1 -- 172.21.15.102:0/623323081 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1c80515b0 con 0x55c2ebd3ee00 2024-09-13T19:16:13.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.377+0000 7fd1d5696640 1 -- 172.21.15.102:0/623323081 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1c80518d0 con 0x55c2ebd3ee00 2024-09-13T19:16:13.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.378+0000 7fd1da142800 1 -- 172.21.15.102:0/623323081 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c2ebd3ee00 msgr2=0x55c2ebdce1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:13.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.378+0000 7fd1da142800 1 --2- 172.21.15.102:0/623323081 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c2ebd3ee00 0x55c2ebdce1b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd1c800a520 tx=0x7fd1c8045ba0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.378+0000 7fd1da142800 1 -- 172.21.15.102:0/623323081 shutdown_connections 2024-09-13T19:16:13.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.378+0000 7fd1da142800 1 --2- 172.21.15.102:0/623323081 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c2ebd3ee00 0x55c2ebdce1b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.378+0000 7fd1da142800 1 -- 172.21.15.102:0/623323081 >> 172.21.15.102:0/623323081 conn(0x55c2ebdc5de0 msgr2=0x55c2ebdc8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:13.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.378+0000 7fd1da142800 1 -- 172.21.15.102:0/623323081 shutdown_connections 2024-09-13T19:16:13.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.378+0000 7fd1da142800 1 -- 172.21.15.102:0/623323081 wait complete. 2024-09-13T19:16:13.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.394+0000 7fd1da142800 1 Processor -- start 2024-09-13T19:16:13.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.394+0000 7fd1da142800 1 -- start start 2024-09-13T19:16:13.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.394+0000 7fd1da142800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c2ebd3ee00 0x55c2ebeba850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:13.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.394+0000 7fd1da142800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c2ebd17320 con 0x55c2ebd3ee00 2024-09-13T19:16:13.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.394+0000 7fd1d5e97640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c2ebd3ee00 0x55c2ebeba850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:13.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.394+0000 7fd1d5e97640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c2ebd3ee00 0x55c2ebeba850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53438/0 (socket says 172.21.15.102:53438) 2024-09-13T19:16:13.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.394+0000 7fd1d5e97640 1 -- 172.21.15.102:0/2445870606 learned_addr learned my addr 172.21.15.102:0/2445870606 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:13.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.395+0000 7fd1d5e97640 1 -- 172.21.15.102:0/2445870606 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2ebc64bc0 con 0x55c2ebd3ee00 2024-09-13T19:16:13.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.395+0000 7fd1d5e97640 1 --2- 172.21.15.102:0/2445870606 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c2ebd3ee00 0x55c2ebeba850 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8025da0 tx=0x7fd1c8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=131707264d5119dd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:13.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.395+0000 7fd0c3e07640 1 -- 172.21.15.102:0/2445870606 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1c8051950 con 0x55c2ebd3ee00 2024-09-13T19:16:13.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.395+0000 7fd0c3e07640 1 -- 172.21.15.102:0/2445870606 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1c8051af0 con 0x55c2ebd3ee00 2024-09-13T19:16:13.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.395+0000 7fd0c3e07640 1 -- 172.21.15.102:0/2445870606 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1c8051dd0 con 0x55c2ebd3ee00 2024-09-13T19:16:13.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.396+0000 7fd1da142800 1 -- 172.21.15.102:0/2445870606 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c2ebd3ee00 msgr2=0x55c2ebeba850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:13.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.396+0000 7fd1da142800 1 --2- 172.21.15.102:0/2445870606 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c2ebd3ee00 0x55c2ebeba850 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8025da0 tx=0x7fd1c8051000 comp rx=0 tx=0).stop 2024-09-13T19:16:13.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.396+0000 7fd1da142800 1 -- 172.21.15.102:0/2445870606 shutdown_connections 2024-09-13T19:16:13.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.396+0000 7fd1da142800 1 --2- 172.21.15.102:0/2445870606 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c2ebd3ee00 0x55c2ebeba850 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.396+0000 7fd1da142800 1 -- 172.21.15.102:0/2445870606 >> 172.21.15.102:0/2445870606 conn(0x55c2ebdc5de0 msgr2=0x55c2ebeb6210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:13.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.396+0000 7fd1da142800 1 -- 172.21.15.102:0/2445870606 shutdown_connections 2024-09-13T19:16:13.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.396+0000 7fd1da142800 1 -- 172.21.15.102:0/2445870606 wait complete. 2024-09-13T19:16:13.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.396+0000 7fd1da142800 1 Processor -- start 2024-09-13T19:16:13.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.396+0000 7fd1da142800 1 -- start start 2024-09-13T19:16:13.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.396+0000 7fd1da142800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c2ebd3ee00 0x55c2ebec2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:13.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.396+0000 7fd1da142800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c2ebdd25f0 con 0x55c2ebd3ee00 2024-09-13T19:16:13.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.396+0000 7fd1d5e97640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c2ebd3ee00 0x55c2ebec2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:13.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.397+0000 7fd1d5e97640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c2ebd3ee00 0x55c2ebec2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53446/0 (socket says 172.21.15.102:53446) 2024-09-13T19:16:13.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.397+0000 7fd1d5e97640 1 -- 172.21.15.102:0/486893185 learned_addr learned my addr 172.21.15.102:0/486893185 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:13.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.397+0000 7fd1d5e97640 1 -- 172.21.15.102:0/486893185 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2ebc78fe0 con 0x55c2ebd3ee00 2024-09-13T19:16:13.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.397+0000 7fd1d5e97640 1 --2- 172.21.15.102:0/486893185 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c2ebd3ee00 0x55c2ebec2180 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8067040 tx=0x7fd1c8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:13.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.397+0000 7fd0c2604640 1 -- 172.21.15.102:0/486893185 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1c8073070 con 0x55c2ebd3ee00 2024-09-13T19:16:13.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.397+0000 7fd0c2604640 1 -- 172.21.15.102:0/486893185 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1c805a450 con 0x55c2ebd3ee00 2024-09-13T19:16:13.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.397+0000 7fd0c2604640 1 -- 172.21.15.102:0/486893185 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1c805a730 con 0x55c2ebd3ee00 2024-09-13T19:16:13.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.397+0000 7fd1da142800 1 -- 172.21.15.102:0/486893185 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c2ebec26c0 con 0x55c2ebd3ee00 2024-09-13T19:16:13.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.397+0000 7fd1da142800 1 -- 172.21.15.102:0/486893185 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2ebec2c40 con 0x55c2ebd3ee00 2024-09-13T19:16:13.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.398+0000 7fd0c2604640 1 -- 172.21.15.102:0/486893185 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd1c8076070 con 0x55c2ebd3ee00 2024-09-13T19:16:13.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.398+0000 7fd0c2604640 1 --2- 172.21.15.102:0/486893185 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd0bc036b40 0x7fd0bc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:13.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.398+0000 7fd0c2604640 1 -- 172.21.15.102:0/486893185 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fd1c8062070 con 0x55c2ebd3ee00 2024-09-13T19:16:13.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.398+0000 7fd1cffff640 1 --2- 172.21.15.102:0/486893185 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd0bc036b40 0x7fd0bc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:13.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.399+0000 7fd1da142800 1 --2- 172.21.15.102:0/486893185 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55c2ebdce6f0 0x55c2ebec91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:13.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.399+0000 7fd1da142800 1 -- 172.21.15.102:0/486893185 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebec9770 con 0x55c2ebdce6f0 2024-09-13T19:16:13.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.399+0000 7fd1d6698640 1 --2- 172.21.15.102:0/486893185 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55c2ebdce6f0 0x55c2ebec91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:13.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.399+0000 7fd1cffff640 1 --2- 172.21.15.102:0/486893185 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd0bc036b40 0x7fd0bc039000 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0000f60 tx=0x7fd1c0001370 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:13.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.399+0000 7fd1d6698640 1 --2- 172.21.15.102:0/486893185 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55c2ebdce6f0 0x55c2ebec91f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:13.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.399+0000 7fd1d6698640 1 -- 172.21.15.102:0/486893185 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd1d000a4a0 con 0x55c2ebdce6f0 2024-09-13T19:16:13.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.399+0000 7fd1da142800 1 -- 172.21.15.102:0/486893185 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebec67c0 con 0x55c2ebdce6f0 2024-09-13T19:16:13.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.400+0000 7fd1d6698640 1 -- 172.21.15.102:0/486893185 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd1d000a4a0 con 0x55c2ebdce6f0 2024-09-13T19:16:13.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.400+0000 7fd1da142800 1 --2- 172.21.15.102:0/486893185 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55c2ebecbaa0 0x55c2ebecde90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:13.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.400+0000 7fd1da142800 1 -- 172.21.15.102:0/486893185 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebece530 con 0x55c2ebecbaa0 2024-09-13T19:16:13.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.400+0000 7fd1d5e97640 1 --2- 172.21.15.102:0/486893185 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55c2ebecbaa0 0x55c2ebecde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:13.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.400+0000 7fd1d5e97640 1 --2- 172.21.15.102:0/486893185 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55c2ebecbaa0 0x55c2ebecde90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:13.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.400+0000 7fd1d5e97640 1 -- 172.21.15.102:0/486893185 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd1c8075030 con 0x55c2ebecbaa0 2024-09-13T19:16:13.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.400+0000 7fd1da142800 1 -- 172.21.15.102:0/486893185 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebeca940 con 0x55c2ebdce6f0 2024-09-13T19:16:13.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.401+0000 7fd1d6698640 1 -- 172.21.15.102:0/486893185 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd1d000a4a0 con 0x55c2ebdce6f0 2024-09-13T19:16:13.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.401+0000 7fd1da142800 1 -- 172.21.15.102:0/486893185 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebecae20 con 0x55c2ebecbaa0 2024-09-13T19:16:13.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.401+0000 7fd1d5e97640 1 -- 172.21.15.102:0/486893185 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd1c8075030 con 0x55c2ebecbaa0 2024-09-13T19:16:13.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.401+0000 7fd1da142800 1 Processor -- start 2024-09-13T19:16:13.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.401+0000 7fd1da142800 1 -- start start 2024-09-13T19:16:13.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.402+0000 7fd1da142800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c2ebdcbb60 0x55c2ebdca1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:13.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.402+0000 7fd1da142800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c2ebc66580 con 0x55c2ebdcbb60 2024-09-13T19:16:13.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.402+0000 7fd1d6698640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c2ebdcbb60 0x55c2ebdca1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:13.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.402+0000 7fd1d6698640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c2ebdcbb60 0x55c2ebdca1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53458/0 (socket says 172.21.15.102:53458) 2024-09-13T19:16:13.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.402+0000 7fd1d6698640 1 -- 172.21.15.102:0/2418158973 learned_addr learned my addr 172.21.15.102:0/2418158973 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:13.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.402+0000 7fd1d6698640 1 -- 172.21.15.102:0/2418158973 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2ebdcbf80 con 0x55c2ebdcbb60 2024-09-13T19:16:13.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.403+0000 7fd1d6698640 1 --2- 172.21.15.102:0/2418158973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c2ebdcbb60 0x55c2ebdca1b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x55c2ebec3230 tx=0x7fd1d00167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:13.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.403+0000 7fd0bb7fe640 1 -- 172.21.15.102:0/2418158973 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1d0013640 con 0x55c2ebdcbb60 2024-09-13T19:16:13.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.403+0000 7fd0bb7fe640 1 -- 172.21.15.102:0/2418158973 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1d00137e0 con 0x55c2ebdcbb60 2024-09-13T19:16:13.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.403+0000 7fd1da142800 1 -- 172.21.15.102:0/2418158973 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c2ebdca7b0 con 0x55c2ebdcbb60 2024-09-13T19:16:13.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.403+0000 7fd0bb7fe640 1 -- 172.21.15.102:0/2418158973 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1d0013ae0 con 0x55c2ebdcbb60 2024-09-13T19:16:13.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.403+0000 7fd1da142800 1 -- 172.21.15.102:0/2418158973 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2ebdcacb0 con 0x55c2ebdcbb60 2024-09-13T19:16:13.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.404+0000 7fd0bb7fe640 1 -- 172.21.15.102:0/2418158973 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd1d0011040 con 0x55c2ebdcbb60 2024-09-13T19:16:13.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.404+0000 7fd0bb7fe640 1 --2- 172.21.15.102:0/2418158973 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd0b0036b90 0x7fd0b0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:13.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.404+0000 7fd0bb7fe640 1 -- 172.21.15.102:0/2418158973 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fd1d000e040 con 0x55c2ebdcbb60 2024-09-13T19:16:13.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.404+0000 7fd1d5e97640 1 --2- 172.21.15.102:0/2418158973 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd0b0036b90 0x7fd0b0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:13.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.404+0000 7fd1da142800 1 Processor -- start 2024-09-13T19:16:13.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.405+0000 7fd1da142800 1 -- start start 2024-09-13T19:16:13.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.405+0000 7fd1d5e97640 1 --2- 172.21.15.102:0/2418158973 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd0b0036b90 0x7fd0b0039050 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd1c808f870 tx=0x7fd1c806e9f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:13.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.405+0000 7fd1da142800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c2ebeebca0 0x55c2ebeec0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:13.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.405+0000 7fd1da142800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c2ebebaf40 con 0x55c2ebeebca0 2024-09-13T19:16:13.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.405+0000 7fd1d6698640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c2ebeebca0 0x55c2ebeec0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:13.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.405+0000 7fd1d6698640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c2ebeebca0 0x55c2ebeec0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53466/0 (socket says 172.21.15.102:53466) 2024-09-13T19:16:13.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.405+0000 7fd1d6698640 1 -- 172.21.15.102:0/3627673411 learned_addr learned my addr 172.21.15.102:0/3627673411 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:13.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.406+0000 7fd1d6698640 1 -- 172.21.15.102:0/3627673411 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2ebeec670 con 0x55c2ebeebca0 2024-09-13T19:16:13.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.406+0000 7fd1d6698640 1 --2- 172.21.15.102:0/3627673411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c2ebeebca0 0x55c2ebeec0a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd1d000afb0 tx=0x7fd1d001fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88babff316372d09 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:13.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.406+0000 7fd0b97fa640 1 -- 172.21.15.102:0/3627673411 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1d0021440 con 0x55c2ebeebca0 2024-09-13T19:16:13.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.406+0000 7fd0b97fa640 1 -- 172.21.15.102:0/3627673411 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1d001f340 con 0x55c2ebeebca0 2024-09-13T19:16:13.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.406+0000 7fd0b97fa640 1 -- 172.21.15.102:0/3627673411 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1d00215e0 con 0x55c2ebeebca0 2024-09-13T19:16:13.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.406+0000 7fd1da142800 1 -- 172.21.15.102:0/3627673411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c2ebeebca0 msgr2=0x55c2ebeec0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:13.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.406+0000 7fd1da142800 1 --2- 172.21.15.102:0/3627673411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c2ebeebca0 0x55c2ebeec0a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd1d000afb0 tx=0x7fd1d001fce0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.406+0000 7fd1da142800 1 -- 172.21.15.102:0/3627673411 shutdown_connections 2024-09-13T19:16:13.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.406+0000 7fd1da142800 1 --2- 172.21.15.102:0/3627673411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c2ebeebca0 0x55c2ebeec0a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.406+0000 7fd1da142800 1 -- 172.21.15.102:0/3627673411 >> 172.21.15.102:0/3627673411 conn(0x55c2ebee8050 msgr2=0x55c2ebee6150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:13.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.406+0000 7fd1da142800 1 -- 172.21.15.102:0/3627673411 shutdown_connections 2024-09-13T19:16:13.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.406+0000 7fd1da142800 1 -- 172.21.15.102:0/3627673411 wait complete. 2024-09-13T19:16:13.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.407+0000 7fd1da142800 1 Processor -- start 2024-09-13T19:16:13.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.407+0000 7fd1da142800 1 -- start start 2024-09-13T19:16:13.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.407+0000 7fd1da142800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c2ebeebca0 0x55c2ebef31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:13.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.407+0000 7fd1da142800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c2ebeecc80 con 0x55c2ebeebca0 2024-09-13T19:16:13.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.407+0000 7fd1d6698640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c2ebeebca0 0x55c2ebef31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:13.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.407+0000 7fd1d6698640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c2ebeebca0 0x55c2ebef31f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53482/0 (socket says 172.21.15.102:53482) 2024-09-13T19:16:13.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.407+0000 7fd1d6698640 1 -- 172.21.15.102:0/2750887435 learned_addr learned my addr 172.21.15.102:0/2750887435 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:13.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.407+0000 7fd1d6698640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2ebef3730 con 0x55c2ebeebca0 2024-09-13T19:16:13.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.408+0000 7fd1d6698640 1 --2- 172.21.15.102:0/2750887435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c2ebeebca0 0x55c2ebef31f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd1d004cd60 tx=0x7fd1d004cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:13.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.408+0000 7fd0a77fe640 1 -- 172.21.15.102:0/2750887435 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1d0040360 con 0x55c2ebeebca0 2024-09-13T19:16:13.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.408+0000 7fd0a77fe640 1 -- 172.21.15.102:0/2750887435 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1d004e2b0 con 0x55c2ebeebca0 2024-09-13T19:16:13.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.408+0000 7fd1da142800 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c2ebef39c0 con 0x55c2ebeebca0 2024-09-13T19:16:13.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.408+0000 7fd0a77fe640 1 -- 172.21.15.102:0/2750887435 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1d004e590 con 0x55c2ebeebca0 2024-09-13T19:16:13.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.408+0000 7fd1da142800 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2ebef6670 con 0x55c2ebeebca0 2024-09-13T19:16:13.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.409+0000 7fd0a77fe640 1 -- 172.21.15.102:0/2750887435 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd1d003b060 con 0x55c2ebeebca0 2024-09-13T19:16:13.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.409+0000 7fd0a77fe640 1 --2- 172.21.15.102:0/2750887435 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd0a0036b40 0x7fd0a0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:13.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.409+0000 7fd0a77fe640 1 -- 172.21.15.102:0/2750887435 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fd1d0035c80 con 0x55c2ebeebca0 2024-09-13T19:16:13.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.409+0000 7fd1da142800 20 rados->read ofs=0 len=0 2024-09-13T19:16:13.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.409+0000 7fd1d5e97640 1 --2- 172.21.15.102:0/2750887435 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd0a0036b40 0x7fd0a0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:13.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.409+0000 7fd1da142800 1 --2- 172.21.15.102:0/2750887435 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55c2ebefec80 0x55c2ebf01120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:13.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.409+0000 7fd1da142800 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf01870 con 0x55c2ebefec80 2024-09-13T19:16:13.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.409+0000 7fd1cffff640 1 --2- 172.21.15.102:0/2750887435 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55c2ebefec80 0x55c2ebf01120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:13.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.410+0000 7fd1d5e97640 1 --2- 172.21.15.102:0/2750887435 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd0a0036b40 0x7fd0a0039000 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd1c801bb60 tx=0x7fd1c8097000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:13.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.410+0000 7fd1cffff640 1 --2- 172.21.15.102:0/2750887435 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55c2ebefec80 0x55c2ebf01120 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:13.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.410+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd1c000f610 con 0x55c2ebefec80 2024-09-13T19:16:13.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.410+0000 7fd1da142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:13.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.410+0000 7fd1da142800 20 realm 2024-09-13T19:16:13.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.410+0000 7fd1da142800 20 rados->read ofs=0 len=0 2024-09-13T19:16:13.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.410+0000 7fd1da142800 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebefe150 con 0x55c2ebefec80 2024-09-13T19:16:13.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.410+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd1c000f610 con 0x55c2ebefec80 2024-09-13T19:16:13.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.410+0000 7fd1da142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:13.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.410+0000 7fd1da142800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:13.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.410+0000 7fd1da142800 20 rados->read ofs=0 len=0 2024-09-13T19:16:13.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.410+0000 7fd1da142800 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf02350 con 0x55c2ebefec80 2024-09-13T19:16:13.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.410+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd1c000f610 con 0x55c2ebefec80 2024-09-13T19:16:13.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.410+0000 7fd1da142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:13.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.410+0000 7fd1da142800 20 rados->read ofs=0 len=0 2024-09-13T19:16:13.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.410+0000 7fd1da142800 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf02c20 con 0x55c2ebefec80 2024-09-13T19:16:13.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.411+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd1c000f610 con 0x55c2ebefec80 2024-09-13T19:16:13.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.411+0000 7fd1da142800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:13.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.411+0000 7fd1da142800 20 rados->read ofs=0 len=0 2024-09-13T19:16:13.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.411+0000 7fd1da142800 1 --2- 172.21.15.102:0/2750887435 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55c2ebf034d0 0x55c2ebf058e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:13.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.411+0000 7fd1da142800 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf06040 con 0x55c2ebf034d0 2024-09-13T19:16:13.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.411+0000 7fd1d6698640 1 --2- 172.21.15.102:0/2750887435 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55c2ebf034d0 0x55c2ebf058e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:13.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.411+0000 7fd1d6698640 1 --2- 172.21.15.102:0/2750887435 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55c2ebf034d0 0x55c2ebf058e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:13.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.411+0000 7fd1d6698640 1 -- 172.21.15.102:0/2750887435 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd1d000a4a0 con 0x55c2ebf034d0 2024-09-13T19:16:13.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.411+0000 7fd1da142800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:13.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.411+0000 7fd1da142800 20 searching for the correct realm 2024-09-13T19:16:13.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.411+0000 7fd1da142800 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf07a70 con 0x55c2ebf034d0 2024-09-13T19:16:13.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.412+0000 7fd1d6698640 1 -- 172.21.15.102:0/2750887435 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1d000a4a0 con 0x55c2ebf034d0 2024-09-13T19:16:13.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.412+0000 7fd1d6698640 1 --2- 172.21.15.102:0/2750887435 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fd1d0044070 0x7fd1d004b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:13.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.412+0000 7fd1d6698640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf07a70 con 0x7fd1d0044070 2024-09-13T19:16:13.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.412+0000 7fd1d5e97640 1 --2- 172.21.15.102:0/2750887435 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fd1d0044070 0x7fd1d004b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:13.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.412+0000 7fd1d5e97640 1 --2- 172.21.15.102:0/2750887435 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fd1d0044070 0x7fd1d004b250 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:13.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.412+0000 7fd1d5e97640 1 -- 172.21.15.102:0/2750887435 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c8075030 con 0x7fd1d0044070 2024-09-13T19:16:13.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.412+0000 7fd1d5e97640 1 --2- 172.21.15.102:0/2750887435 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fd1c80a1070 0x7fd1c808f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:13.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.412+0000 7fd1d5e97640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf07a70 con 0x7fd1c80a1070 2024-09-13T19:16:13.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.413+0000 7fd1cffff640 1 --2- 172.21.15.102:0/2750887435 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fd1c80a1070 0x7fd1c808f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:13.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.413+0000 7fd1cffff640 1 --2- 172.21.15.102:0/2750887435 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fd1c80a1070 0x7fd1c808f920 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:13.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.413+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c000f610 con 0x7fd1c80a1070 2024-09-13T19:16:13.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.413+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf07a70 con 0x55c2ebefec80 2024-09-13T19:16:13.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.414+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c000f610 con 0x55c2ebefec80 2024-09-13T19:16:13.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.414+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf07a70 con 0x55c2ebefec80 2024-09-13T19:16:13.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.414+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c002b040 con 0x55c2ebefec80 2024-09-13T19:16:13.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.414+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf07a70 con 0x7fd1c80a1070 2024-09-13T19:16:13.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.414+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c002b040 con 0x7fd1c80a1070 2024-09-13T19:16:13.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.414+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf07a70 con 0x7fd1c80a1070 2024-09-13T19:16:13.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.415+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c002b040 con 0x7fd1c80a1070 2024-09-13T19:16:13.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.415+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf07a70 con 0x7fd1d0044070 2024-09-13T19:16:13.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.415+0000 7fd1d5e97640 1 -- 172.21.15.102:0/2750887435 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c8075030 con 0x7fd1d0044070 2024-09-13T19:16:13.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.415+0000 7fd1d5e97640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf07a70 con 0x55c2ebf034d0 2024-09-13T19:16:13.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.415+0000 7fd1d6698640 1 -- 172.21.15.102:0/2750887435 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1d000a4a0 con 0x55c2ebf034d0 2024-09-13T19:16:13.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.415+0000 7fd1d6698640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf07a70 con 0x55c2ebefec80 2024-09-13T19:16:13.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.415+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c002b040 con 0x55c2ebefec80 2024-09-13T19:16:13.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.415+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf07a70 con 0x7fd1c80a1070 2024-09-13T19:16:13.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.416+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c002b040 con 0x7fd1c80a1070 2024-09-13T19:16:13.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.416+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf07a70 con 0x55c2ebefec80 2024-09-13T19:16:13.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.416+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c002b040 con 0x55c2ebefec80 2024-09-13T19:16:13.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.416+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf07a70 con 0x7fd1d0044070 2024-09-13T19:16:13.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.416+0000 7fd1d5e97640 1 -- 172.21.15.102:0/2750887435 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd1c8075030 con 0x7fd1d0044070 2024-09-13T19:16:13.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.416+0000 7fd1d5e97640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf07a70 con 0x55c2ebf034d0 2024-09-13T19:16:13.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.416+0000 7fd1d6698640 1 -- 172.21.15.102:0/2750887435 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1d000a4a0 con 0x55c2ebf034d0 2024-09-13T19:16:13.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.417+0000 7fd1d6698640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf07a70 con 0x55c2ebf034d0 2024-09-13T19:16:13.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.417+0000 7fd1d6698640 1 -- 172.21.15.102:0/2750887435 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=107b] v27'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd1d000a4a0 con 0x55c2ebf034d0 2024-09-13T19:16:13.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.417+0000 7fd1d6698640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf07a70 con 0x7fd1c80a1070 2024-09-13T19:16:13.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.417+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c002b040 con 0x7fd1c80a1070 2024-09-13T19:16:13.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.417+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf07a70 con 0x55c2ebf034d0 2024-09-13T19:16:13.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.417+0000 7fd1d6698640 1 -- 172.21.15.102:0/2750887435 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd1d000a4a0 con 0x55c2ebf034d0 2024-09-13T19:16:13.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.417+0000 7fd1d6698640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf07a70 con 0x55c2ebf034d0 2024-09-13T19:16:13.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.418+0000 7fd1d6698640 1 -- 172.21.15.102:0/2750887435 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1d000a4a0 con 0x55c2ebf034d0 2024-09-13T19:16:13.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.418+0000 7fd1d6698640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf07a70 con 0x55c2ebefec80 2024-09-13T19:16:13.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.418+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c002b040 con 0x55c2ebefec80 2024-09-13T19:16:13.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.418+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf07a70 con 0x55c2ebefec80 2024-09-13T19:16:13.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.418+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd1c002b040 con 0x55c2ebefec80 2024-09-13T19:16:13.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.418+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf07a70 con 0x7fd1c80a1070 2024-09-13T19:16:13.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.419+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c002b040 con 0x7fd1c80a1070 2024-09-13T19:16:13.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.419+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf07a70 con 0x55c2ebf034d0 2024-09-13T19:16:13.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.419+0000 7fd1d6698640 1 -- 172.21.15.102:0/2750887435 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1d000a4a0 con 0x55c2ebf034d0 2024-09-13T19:16:13.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.419+0000 7fd1d6698640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf07a70 con 0x7fd1d0044070 2024-09-13T19:16:13.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.419+0000 7fd1d5e97640 1 -- 172.21.15.102:0/2750887435 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c8075030 con 0x7fd1d0044070 2024-09-13T19:16:13.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.419+0000 7fd1d5e97640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf07a70 con 0x55c2ebefec80 2024-09-13T19:16:13.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.419+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c002b040 con 0x55c2ebefec80 2024-09-13T19:16:13.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.419+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf07a70 con 0x7fd1c80a1070 2024-09-13T19:16:13.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.420+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c003b040 con 0x7fd1c80a1070 2024-09-13T19:16:13.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.420+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf07a70 con 0x55c2ebf034d0 2024-09-13T19:16:13.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.420+0000 7fd1d6698640 1 -- 172.21.15.102:0/2750887435 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1d000a4a0 con 0x55c2ebf034d0 2024-09-13T19:16:13.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.420+0000 7fd1d6698640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf07a70 con 0x7fd1c80a1070 2024-09-13T19:16:13.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.420+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c003b040 con 0x7fd1c80a1070 2024-09-13T19:16:13.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.420+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf07a70 con 0x7fd1d0044070 2024-09-13T19:16:13.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.421+0000 7fd1d5e97640 1 -- 172.21.15.102:0/2750887435 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c8075030 con 0x7fd1d0044070 2024-09-13T19:16:13.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.421+0000 7fd1d5e97640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf07a70 con 0x55c2ebf034d0 2024-09-13T19:16:13.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.421+0000 7fd1d6698640 1 -- 172.21.15.102:0/2750887435 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1d000a4a0 con 0x55c2ebf034d0 2024-09-13T19:16:13.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.421+0000 7fd1d6698640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf07a70 con 0x7fd1c80a1070 2024-09-13T19:16:13.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.421+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c003b040 con 0x7fd1c80a1070 2024-09-13T19:16:13.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.421+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf07a70 con 0x55c2ebefec80 2024-09-13T19:16:13.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.422+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd1c003b040 con 0x55c2ebefec80 2024-09-13T19:16:13.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.422+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf07a70 con 0x7fd1d0044070 2024-09-13T19:16:13.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.422+0000 7fd1d5e97640 1 -- 172.21.15.102:0/2750887435 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c8075030 con 0x7fd1d0044070 2024-09-13T19:16:13.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.422+0000 7fd1da142800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:13.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.422+0000 7fd1da142800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:13.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.422+0000 7fd1da142800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:13.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.422+0000 7fd1da142800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:13.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.422+0000 7fd1da142800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:13.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.422+0000 7fd1da142800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:13.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.422+0000 7fd1da142800 20 rados->read ofs=0 len=0 2024-09-13T19:16:13.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.422+0000 7fd1da142800 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf06b70 con 0x55c2ebefec80 2024-09-13T19:16:13.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.422+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd1c003b040 con 0x55c2ebefec80 2024-09-13T19:16:13.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.422+0000 7fd1da142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:13.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.422+0000 7fd1da142800 20 rados->read ofs=0 len=0 2024-09-13T19:16:13.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.422+0000 7fd1da142800 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf07410 con 0x55c2ebefec80 2024-09-13T19:16:13.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.422+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd1c003b040 con 0x55c2ebefec80 2024-09-13T19:16:13.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.422+0000 7fd1da142800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:13.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.422+0000 7fd1da142800 20 rados->read ofs=0 len=0 2024-09-13T19:16:13.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.422+0000 7fd1da142800 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf067b0 con 0x55c2ebf034d0 2024-09-13T19:16:13.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.423+0000 7fd1d6698640 1 -- 172.21.15.102:0/2750887435 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd1d000a4a0 con 0x55c2ebf034d0 2024-09-13T19:16:13.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.423+0000 7fd1da142800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:13.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.423+0000 7fd1da142800 20 zone default found 2024-09-13T19:16:13.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.423+0000 7fd1da142800 4 Realm: () 2024-09-13T19:16:13.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.423+0000 7fd1da142800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:13.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.423+0000 7fd1da142800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:13.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.423+0000 7fd1da142800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:13.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.423+0000 7fd1da142800 20 zonegroup default 2024-09-13T19:16:13.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.423+0000 7fd1da142800 20 rados->read ofs=0 len=0 2024-09-13T19:16:13.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.423+0000 7fd1da142800 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf083f0 con 0x7fd1c80a1070 2024-09-13T19:16:13.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.423+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd1c003b040 con 0x7fd1c80a1070 2024-09-13T19:16:13.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.423+0000 7fd1da142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:13.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.423+0000 7fd1da142800 20 rados->read ofs=0 len=0 2024-09-13T19:16:13.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.423+0000 7fd1da142800 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf09e90 con 0x55c2ebf034d0 2024-09-13T19:16:13.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.423+0000 7fd1d6698640 1 -- 172.21.15.102:0/2750887435 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd1d000a4a0 con 0x55c2ebf034d0 2024-09-13T19:16:13.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.423+0000 7fd1da142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:13.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.423+0000 7fd1da142800 20 rados->read ofs=0 len=0 2024-09-13T19:16:13.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.423+0000 7fd1da142800 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf0a2f0 con 0x55c2ebf034d0 2024-09-13T19:16:13.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.424+0000 7fd1d6698640 1 -- 172.21.15.102:0/2750887435 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd1d000a4a0 con 0x55c2ebf034d0 2024-09-13T19:16:13.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.424+0000 7fd1da142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:13.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.424+0000 7fd1da142800 20 started sync module instance, tier type = 2024-09-13T19:16:13.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.424+0000 7fd1da142800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:13.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.424+0000 7fd1da142800 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf09260 con 0x7fd1d0044070 2024-09-13T19:16:13.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.425+0000 7fd1d5e97640 1 -- 172.21.15.102:0/2750887435 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(44 notify.0 [create] v34'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1c8075030 con 0x7fd1d0044070 2024-09-13T19:16:13.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.425+0000 7fd1da142800 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94295670429264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf09a70 con 0x7fd1d0044070 2024-09-13T19:16:13.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.425+0000 7fd1da142800 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf0b250 con 0x55c2ebefec80 2024-09-13T19:16:13.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.426+0000 7fd1d5e97640 1 -- 172.21.15.102:0/2750887435 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94295670429264] v34'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1c8075030 con 0x7fd1d0044070 2024-09-13T19:16:13.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.426+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v34'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1c003b040 con 0x55c2ebefec80 2024-09-13T19:16:13.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.426+0000 7fd1da142800 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94295670435232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf0b670 con 0x55c2ebefec80 2024-09-13T19:16:13.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.426+0000 7fd1da142800 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf0c030 con 0x55c2ebf034d0 2024-09-13T19:16:13.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.428+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94295670435232] v34'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1c003b040 con 0x55c2ebefec80 2024-09-13T19:16:13.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.429+0000 7fd1d6698640 1 -- 172.21.15.102:0/2750887435 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v34'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1d000a4a0 con 0x55c2ebf034d0 2024-09-13T19:16:13.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.429+0000 7fd1da142800 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94295670439264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf0b670 con 0x55c2ebf034d0 2024-09-13T19:16:13.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.429+0000 7fd1da142800 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf0cac0 con 0x7fd1d0044070 2024-09-13T19:16:13.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.432+0000 7fd1d5e97640 1 -- 172.21.15.102:0/2750887435 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(50 notify.3 [create] v34'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1c8075030 con 0x7fd1d0044070 2024-09-13T19:16:13.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.432+0000 7fd1d6698640 1 -- 172.21.15.102:0/2750887435 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94295670439264] v34'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1d000a4a0 con 0x55c2ebf034d0 2024-09-13T19:16:13.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.432+0000 7fd1da142800 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94295670441360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf0d360 con 0x7fd1d0044070 2024-09-13T19:16:13.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.432+0000 7fd1da142800 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf0b1e0 con 0x55c2ebefec80 2024-09-13T19:16:13.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.433+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v34'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1c003b040 con 0x55c2ebefec80 2024-09-13T19:16:13.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.433+0000 7fd1da142800 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94295670446416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf0d360 con 0x55c2ebefec80 2024-09-13T19:16:13.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.433+0000 7fd1da142800 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf0e8d0 con 0x7fd1c80a1070 2024-09-13T19:16:13.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.435+0000 7fd1d5e97640 1 -- 172.21.15.102:0/2750887435 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94295670441360] v34'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1c8075030 con 0x7fd1d0044070 2024-09-13T19:16:13.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.436+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(54 notify.5 [create] v34'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1c003b040 con 0x7fd1c80a1070 2024-09-13T19:16:13.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.436+0000 7fd1da142800 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94295670449088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf0d360 con 0x7fd1c80a1070 2024-09-13T19:16:13.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.436+0000 7fd1da142800 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf0f320 con 0x7fd1c80a1070 2024-09-13T19:16:13.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.438+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94295670446416] v34'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1c003b040 con 0x55c2ebefec80 2024-09-13T19:16:13.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.438+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94295670449088] v34'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1c003b040 con 0x7fd1c80a1070 2024-09-13T19:16:13.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.441+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(56 notify.6 [create] v34'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1c003b040 con 0x7fd1c80a1070 2024-09-13T19:16:13.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.441+0000 7fd1da142800 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94295670447472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf0ceb0 con 0x7fd1c80a1070 2024-09-13T19:16:13.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.441+0000 7fd1da142800 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf0fbc0 con 0x7fd1c80a1070 2024-09-13T19:16:13.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.442+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(58 notify.7 [create] v34'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1c003b040 con 0x7fd1c80a1070 2024-09-13T19:16:13.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.442+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94295670447472] v34'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1c003b040 con 0x7fd1c80a1070 2024-09-13T19:16:13.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.442+0000 7fd1da142800 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94295670454032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf0ceb0 con 0x7fd1c80a1070 2024-09-13T19:16:13.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.442+0000 7fd1da142800 20 add_watcher() i=0 2024-09-13T19:16:13.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.442+0000 7fd1da142800 20 add_watcher() i=1 2024-09-13T19:16:13.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.442+0000 7fd1da142800 20 add_watcher() i=2 2024-09-13T19:16:13.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.442+0000 7fd1da142800 20 add_watcher() i=3 2024-09-13T19:16:13.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.442+0000 7fd1da142800 20 add_watcher() i=4 2024-09-13T19:16:13.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.442+0000 7fd1da142800 20 add_watcher() i=5 2024-09-13T19:16:13.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.442+0000 7fd1da142800 20 add_watcher() i=6 2024-09-13T19:16:13.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.443+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94295670454032] v34'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1c003b040 con 0x7fd1c80a1070 2024-09-13T19:16:13.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.443+0000 7fd1da142800 20 add_watcher() i=7 2024-09-13T19:16:13.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.443+0000 7fd1da142800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:13.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.443+0000 7fd1da142800 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf0ee60 con 0x55c2ebefec80 2024-09-13T19:16:13.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.444+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd1c003b040 con 0x55c2ebefec80 2024-09-13T19:16:13.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.444+0000 7fd1da142800 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94295670455088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf0ee60 con 0x55c2ebefec80 2024-09-13T19:16:13.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.446+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94295670455088] v34'24 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd1c003b040 con 0x55c2ebefec80 2024-09-13T19:16:13.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.446+0000 7fd0877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:13.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.446+0000 7fd1da142800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:13.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.446+0000 7fd1da142800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:13.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.446+0000 7fd1da142800 5 note: GC not initialized 2024-09-13T19:16:13.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.446+0000 7fd0867fc640 20 reqs_thread_entry: start 2024-09-13T19:16:13.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.446+0000 7fd1da142800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:13.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.446+0000 7fd1da142800 20 Filter name: none 2024-09-13T19:16:13.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.446+0000 7fcff7fff640 20 reqs_thread_entry: start 2024-09-13T19:16:13.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.447+0000 7fd1da142800 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf45650 con 0x55c2ebf034d0 2024-09-13T19:16:13.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.447+0000 7fd1d6698640 1 -- 172.21.15.102:0/2750887435 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(62 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1d000a4a0 con 0x55c2ebf034d0 2024-09-13T19:16:13.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.447+0000 7fd1d6698640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf0a2f0 con 0x55c2ebf034d0 2024-09-13T19:16:13.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.447+0000 7fd1d6698640 1 -- 172.21.15.102:0/2750887435 <== osd.3 v2:172.21.15.102:6800/3096737090 17 ==== osd_op_reply(63 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1d000a4a0 con 0x55c2ebf034d0 2024-09-13T19:16:13.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.447+0000 7fd1d6698640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf0a2f0 con 0x55c2ebefec80 2024-09-13T19:16:13.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.447+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(64 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c003b040 con 0x55c2ebefec80 2024-09-13T19:16:13.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.447+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf07410 con 0x55c2ebefec80 2024-09-13T19:16:13.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.448+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(65 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c003b040 con 0x55c2ebefec80 2024-09-13T19:16:13.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.448+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf07410 con 0x7fd1d0044070 2024-09-13T19:16:13.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.448+0000 7fd1d5e97640 1 -- 172.21.15.102:0/2750887435 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(66 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c8075030 con 0x7fd1d0044070 2024-09-13T19:16:13.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.448+0000 7fd1d5e97640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf0cac0 con 0x55c2ebf034d0 2024-09-13T19:16:13.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.448+0000 7fd1d6698640 1 -- 172.21.15.102:0/2750887435 <== osd.3 v2:172.21.15.102:6800/3096737090 18 ==== osd_op_reply(67 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1d000a4a0 con 0x55c2ebf034d0 2024-09-13T19:16:13.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.448+0000 7fd1d6698640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf0cac0 con 0x55c2ebefec80 2024-09-13T19:16:13.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.448+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(68 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c003b040 con 0x55c2ebefec80 2024-09-13T19:16:13.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.448+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf0cac0 con 0x55c2ebf034d0 2024-09-13T19:16:13.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.449+0000 7fd1d6698640 1 -- 172.21.15.102:0/2750887435 <== osd.3 v2:172.21.15.102:6800/3096737090 19 ==== osd_op_reply(69 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1d000a4a0 con 0x55c2ebf034d0 2024-09-13T19:16:13.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.449+0000 7fd1d6698640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf0cac0 con 0x7fd1d0044070 2024-09-13T19:16:13.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.449+0000 7fd1d5e97640 1 -- 172.21.15.102:0/2750887435 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(70 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c8075030 con 0x7fd1d0044070 2024-09-13T19:16:13.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.449+0000 7fd1d5e97640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf0cac0 con 0x55c2ebf034d0 2024-09-13T19:16:13.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.449+0000 7fd1d6698640 1 -- 172.21.15.102:0/2750887435 <== osd.3 v2:172.21.15.102:6800/3096737090 20 ==== osd_op_reply(71 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1d000a4a0 con 0x55c2ebf034d0 2024-09-13T19:16:13.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.449+0000 7fd1d6698640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf0cac0 con 0x55c2ebefec80 2024-09-13T19:16:13.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.449+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(72 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c003b040 con 0x55c2ebefec80 2024-09-13T19:16:13.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.449+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf0cac0 con 0x7fd1c80a1070 2024-09-13T19:16:13.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.450+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(73 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c003b040 con 0x7fd1c80a1070 2024-09-13T19:16:13.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.450+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf0cac0 con 0x7fd1c80a1070 2024-09-13T19:16:13.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.450+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(74 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c003b040 con 0x7fd1c80a1070 2024-09-13T19:16:13.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.450+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf0cac0 con 0x55c2ebf034d0 2024-09-13T19:16:13.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.450+0000 7fd1d6698640 1 -- 172.21.15.102:0/2750887435 <== osd.3 v2:172.21.15.102:6800/3096737090 21 ==== osd_op_reply(75 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1d000a4a0 con 0x55c2ebf034d0 2024-09-13T19:16:13.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.450+0000 7fd1d6698640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf0cac0 con 0x7fd1c80a1070 2024-09-13T19:16:13.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.450+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(76 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c003b040 con 0x7fd1c80a1070 2024-09-13T19:16:13.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.450+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf0cac0 con 0x7fd1c80a1070 2024-09-13T19:16:13.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.451+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.0 v2:172.21.15.53:6800/4021716951 20 ==== osd_op_reply(77 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c003b040 con 0x7fd1c80a1070 2024-09-13T19:16:13.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.451+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf0cac0 con 0x7fd1c80a1070 2024-09-13T19:16:13.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.451+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.0 v2:172.21.15.53:6800/4021716951 21 ==== osd_op_reply(78 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c003b040 con 0x7fd1c80a1070 2024-09-13T19:16:13.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.451+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf0cac0 con 0x55c2ebf034d0 2024-09-13T19:16:13.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.451+0000 7fd1d6698640 1 -- 172.21.15.102:0/2750887435 <== osd.3 v2:172.21.15.102:6800/3096737090 22 ==== osd_op_reply(79 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1d000a4a0 con 0x55c2ebf034d0 2024-09-13T19:16:13.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.451+0000 7fd1d6698640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf0cac0 con 0x7fd1d0044070 2024-09-13T19:16:13.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.451+0000 7fd1d5e97640 1 -- 172.21.15.102:0/2750887435 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(80 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c8075030 con 0x7fd1d0044070 2024-09-13T19:16:13.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.451+0000 7fd1d5e97640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf0cac0 con 0x55c2ebefec80 2024-09-13T19:16:13.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.452+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(81 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c003b040 con 0x55c2ebefec80 2024-09-13T19:16:13.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.452+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf0cac0 con 0x55c2ebefec80 2024-09-13T19:16:13.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.452+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== osd_op_reply(82 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c003b040 con 0x55c2ebefec80 2024-09-13T19:16:13.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.452+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf0cac0 con 0x55c2ebf034d0 2024-09-13T19:16:13.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.452+0000 7fd1d6698640 1 -- 172.21.15.102:0/2750887435 <== osd.3 v2:172.21.15.102:6800/3096737090 23 ==== osd_op_reply(83 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1d000a4a0 con 0x55c2ebf034d0 2024-09-13T19:16:13.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.452+0000 7fd1d6698640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf0cac0 con 0x7fd1d0044070 2024-09-13T19:16:13.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.452+0000 7fd1d5e97640 1 -- 172.21.15.102:0/2750887435 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(84 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c8075030 con 0x7fd1d0044070 2024-09-13T19:16:13.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.452+0000 7fd1d5e97640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf0cac0 con 0x7fd1c80a1070 2024-09-13T19:16:13.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.453+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.0 v2:172.21.15.53:6800/4021716951 22 ==== osd_op_reply(85 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c003b040 con 0x7fd1c80a1070 2024-09-13T19:16:13.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.453+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf0cac0 con 0x55c2ebefec80 2024-09-13T19:16:13.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.453+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(86 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c003b040 con 0x55c2ebefec80 2024-09-13T19:16:13.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.453+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf0cac0 con 0x7fd1c80a1070 2024-09-13T19:16:13.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.453+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.0 v2:172.21.15.53:6800/4021716951 23 ==== osd_op_reply(87 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c003b040 con 0x7fd1c80a1070 2024-09-13T19:16:13.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.453+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf0cac0 con 0x55c2ebf034d0 2024-09-13T19:16:13.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.454+0000 7fd1d6698640 1 -- 172.21.15.102:0/2750887435 <== osd.3 v2:172.21.15.102:6800/3096737090 24 ==== osd_op_reply(88 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1d000a4a0 con 0x55c2ebf034d0 2024-09-13T19:16:13.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.454+0000 7fd1d6698640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf0cac0 con 0x7fd1d0044070 2024-09-13T19:16:13.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.454+0000 7fd1d5e97640 1 -- 172.21.15.102:0/2750887435 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(89 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c8075030 con 0x7fd1d0044070 2024-09-13T19:16:13.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.454+0000 7fd1d5e97640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf0cac0 con 0x7fd1c80a1070 2024-09-13T19:16:13.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.454+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.0 v2:172.21.15.53:6800/4021716951 24 ==== osd_op_reply(90 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c003b040 con 0x7fd1c80a1070 2024-09-13T19:16:13.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.454+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf0cac0 con 0x55c2ebefec80 2024-09-13T19:16:13.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.454+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.1 v2:172.21.15.102:6808/2204418452 28 ==== osd_op_reply(91 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c003b040 con 0x55c2ebefec80 2024-09-13T19:16:13.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.454+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf0cac0 con 0x55c2ebf034d0 2024-09-13T19:16:13.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.455+0000 7fd1d6698640 1 -- 172.21.15.102:0/2750887435 <== osd.3 v2:172.21.15.102:6800/3096737090 25 ==== osd_op_reply(92 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1d000a4a0 con 0x55c2ebf034d0 2024-09-13T19:16:13.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.455+0000 7fd1d6698640 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf0cac0 con 0x7fd1d0044070 2024-09-13T19:16:13.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.455+0000 7fd1d5e97640 1 -- 172.21.15.102:0/2750887435 <== osd.2 v2:172.21.15.102:6816/2238176080 16 ==== osd_op_reply(93 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1c8075030 con 0x7fd1d0044070 2024-09-13T19:16:13.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.456+0000 7fd0877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:13.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.456+0000 7fd1da142800 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94295670455088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf0a2f0 con 0x55c2ebefec80 2024-09-13T19:16:13.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.457+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.1 v2:172.21.15.102:6808/2204418452 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94295670455088] v34'25 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd1c003b040 con 0x55c2ebefec80 2024-09-13T19:16:13.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.457+0000 7fd1da142800 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94295670429264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf07410 con 0x7fd1d0044070 2024-09-13T19:16:13.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.460+0000 7fd1d5e97640 1 -- 172.21.15.102:0/2750887435 <== osd.2 v2:172.21.15.102:6816/2238176080 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94295670429264] v34'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1c8075030 con 0x7fd1d0044070 2024-09-13T19:16:13.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.460+0000 7fd1da142800 20 remove_watcher() i=0 2024-09-13T19:16:13.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.460+0000 7fd1da142800 2 removed watcher, disabling cache 2024-09-13T19:16:13.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.460+0000 7fd1da142800 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94295670435232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf07410 con 0x55c2ebefec80 2024-09-13T19:16:13.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.461+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.1 v2:172.21.15.102:6808/2204418452 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94295670435232] v34'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1c003b040 con 0x55c2ebefec80 2024-09-13T19:16:13.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.461+0000 7fd1da142800 20 remove_watcher() i=1 2024-09-13T19:16:13.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.461+0000 7fd1da142800 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94295670439264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf07410 con 0x55c2ebf034d0 2024-09-13T19:16:13.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.465+0000 7fd1d6698640 1 -- 172.21.15.102:0/2750887435 <== osd.3 v2:172.21.15.102:6800/3096737090 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94295670439264] v34'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1d000a4a0 con 0x55c2ebf034d0 2024-09-13T19:16:13.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.465+0000 7fd1da142800 20 remove_watcher() i=2 2024-09-13T19:16:13.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.465+0000 7fd1da142800 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94295670441360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf09650 con 0x7fd1d0044070 2024-09-13T19:16:13.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.466+0000 7fd1d5e97640 1 -- 172.21.15.102:0/2750887435 <== osd.2 v2:172.21.15.102:6816/2238176080 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94295670441360] v34'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1c8075030 con 0x7fd1d0044070 2024-09-13T19:16:13.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.466+0000 7fd1da142800 20 remove_watcher() i=3 2024-09-13T19:16:13.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.466+0000 7fd1da142800 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94295670446416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf0ada0 con 0x55c2ebefec80 2024-09-13T19:16:13.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.468+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.1 v2:172.21.15.102:6808/2204418452 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94295670446416] v34'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1c003b040 con 0x55c2ebefec80 2024-09-13T19:16:13.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.468+0000 7fd1da142800 20 remove_watcher() i=4 2024-09-13T19:16:13.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.468+0000 7fd1da142800 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94295670449088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf0bd60 con 0x7fd1c80a1070 2024-09-13T19:16:13.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.469+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.0 v2:172.21.15.53:6800/4021716951 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94295670449088] v34'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1c003b040 con 0x7fd1c80a1070 2024-09-13T19:16:13.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.469+0000 7fd1da142800 20 remove_watcher() i=5 2024-09-13T19:16:13.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.469+0000 7fd1da142800 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94295670447472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf09650 con 0x7fd1c80a1070 2024-09-13T19:16:13.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.470+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.0 v2:172.21.15.53:6800/4021716951 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94295670447472] v34'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1c003b040 con 0x7fd1c80a1070 2024-09-13T19:16:13.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.470+0000 7fd1da142800 20 remove_watcher() i=6 2024-09-13T19:16:13.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.470+0000 7fd1da142800 1 -- 172.21.15.102:0/2750887435 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94295670454032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2ebf0ada0 con 0x7fd1c80a1070 2024-09-13T19:16:13.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.471+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 <== osd.0 v2:172.21.15.53:6800/4021716951 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94295670454032] v34'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1c003b040 con 0x7fd1c80a1070 2024-09-13T19:16:13.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.471+0000 7fd1da142800 20 remove_watcher() i=7 2024-09-13T19:16:13.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.472+0000 7fd1da142800 1 -- 172.21.15.102:0/2750887435 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fd1c80a1070 msgr2=0x7fd1c808f920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:13.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.472+0000 7fd1da142800 1 --2- 172.21.15.102:0/2750887435 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fd1c80a1070 0x7fd1c808f920 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.472+0000 7fd1da142800 1 -- 172.21.15.102:0/2750887435 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55c2ebefec80 msgr2=0x55c2ebf01120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:13.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.472+0000 7fd1da142800 1 --2- 172.21.15.102:0/2750887435 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55c2ebefec80 0x55c2ebf01120 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.472+0000 7fd1da142800 1 -- 172.21.15.102:0/2750887435 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fd1d0044070 msgr2=0x7fd1d004b250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:13.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.472+0000 7fd1da142800 1 --2- 172.21.15.102:0/2750887435 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fd1d0044070 0x7fd1d004b250 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.472+0000 7fd1da142800 1 -- 172.21.15.102:0/2750887435 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55c2ebf034d0 msgr2=0x55c2ebf058e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:13.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.472+0000 7fd1da142800 1 --2- 172.21.15.102:0/2750887435 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55c2ebf034d0 0x55c2ebf058e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.472+0000 7fd1da142800 1 -- 172.21.15.102:0/2750887435 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd0a0036b40 msgr2=0x7fd0a0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:13.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.472+0000 7fd1da142800 1 --2- 172.21.15.102:0/2750887435 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd0a0036b40 0x7fd0a0039000 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd1c801bb60 tx=0x7fd1c8097000 comp rx=0 tx=0).stop 2024-09-13T19:16:13.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.472+0000 7fd1da142800 1 -- 172.21.15.102:0/2750887435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c2ebeebca0 msgr2=0x55c2ebef31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:13.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.472+0000 7fd1da142800 1 --2- 172.21.15.102:0/2750887435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c2ebeebca0 0x55c2ebef31f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd1d004cd60 tx=0x7fd1d004cd90 comp rx=0 tx=0).stop 2024-09-13T19:16:13.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.472+0000 7fd1cffff640 1 -- 172.21.15.102:0/2750887435 reap_dead start 2024-09-13T19:16:13.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.472+0000 7fd1da142800 1 -- 172.21.15.102:0/2750887435 shutdown_connections 2024-09-13T19:16:13.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.472+0000 7fd1da142800 1 --2- 172.21.15.102:0/2750887435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c2ebeebca0 0x55c2ebef31f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.472+0000 7fd1da142800 1 -- 172.21.15.102:0/2750887435 >> 172.21.15.102:0/2750887435 conn(0x55c2ebee8050 msgr2=0x55c2ebeed3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:13.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.472+0000 7fd1da142800 1 -- 172.21.15.102:0/2750887435 shutdown_connections 2024-09-13T19:16:13.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.472+0000 7fd1da142800 1 -- 172.21.15.102:0/2750887435 wait complete. 2024-09-13T19:16:13.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.472+0000 7fd1da142800 1 -- 172.21.15.102:0/2418158973 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd0b0036b90 msgr2=0x7fd0b0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:13.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.472+0000 7fd1da142800 1 --2- 172.21.15.102:0/2418158973 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd0b0036b90 0x7fd0b0039050 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd1c808f870 tx=0x7fd1c806e9f0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.472+0000 7fd1da142800 1 -- 172.21.15.102:0/2418158973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c2ebdcbb60 msgr2=0x55c2ebdca1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:13.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.472+0000 7fd1da142800 1 --2- 172.21.15.102:0/2418158973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c2ebdcbb60 0x55c2ebdca1b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x55c2ebec3230 tx=0x7fd1d00167b0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.472+0000 7fd1da142800 1 -- 172.21.15.102:0/2418158973 shutdown_connections 2024-09-13T19:16:13.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.472+0000 7fd1da142800 1 --2- 172.21.15.102:0/2418158973 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd0b0036b90 0x7fd0b0039050 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.472+0000 7fd1da142800 1 --2- 172.21.15.102:0/2418158973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c2ebdcbb60 0x55c2ebdca1b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.472+0000 7fd1da142800 1 -- 172.21.15.102:0/2418158973 >> 172.21.15.102:0/2418158973 conn(0x55c2ebed1dc0 msgr2=0x55c2ebed4940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:13.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.472+0000 7fd1da142800 1 -- 172.21.15.102:0/2418158973 shutdown_connections 2024-09-13T19:16:13.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.472+0000 7fd1da142800 1 -- 172.21.15.102:0/2418158973 wait complete. 2024-09-13T19:16:13.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.473+0000 7fd1da142800 1 -- 172.21.15.102:0/486893185 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55c2ebdce6f0 msgr2=0x55c2ebec91f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:13.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.473+0000 7fd1da142800 1 --2- 172.21.15.102:0/486893185 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55c2ebdce6f0 0x55c2ebec91f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.473+0000 7fd1da142800 1 -- 172.21.15.102:0/486893185 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55c2ebecbaa0 msgr2=0x55c2ebecde90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:13.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.473+0000 7fd1da142800 1 --2- 172.21.15.102:0/486893185 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55c2ebecbaa0 0x55c2ebecde90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.473+0000 7fd1da142800 1 -- 172.21.15.102:0/486893185 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd0bc036b40 msgr2=0x7fd0bc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:13.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.473+0000 7fd1da142800 1 --2- 172.21.15.102:0/486893185 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd0bc036b40 0x7fd0bc039000 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0000f60 tx=0x7fd1c0001370 comp rx=0 tx=0).stop 2024-09-13T19:16:13.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.473+0000 7fd1da142800 1 -- 172.21.15.102:0/486893185 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c2ebd3ee00 msgr2=0x55c2ebec2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:13.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.473+0000 7fd1da142800 1 --2- 172.21.15.102:0/486893185 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c2ebd3ee00 0x55c2ebec2180 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8067040 tx=0x7fd1c8002fb0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.473+0000 7fd1da142800 1 -- 172.21.15.102:0/486893185 shutdown_connections 2024-09-13T19:16:13.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.473+0000 7fd1da142800 1 --2- 172.21.15.102:0/486893185 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55c2ebecbaa0 0x55c2ebecde90 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.473+0000 7fd1da142800 1 --2- 172.21.15.102:0/486893185 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55c2ebdce6f0 0x55c2ebec91f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.473+0000 7fd1da142800 1 --2- 172.21.15.102:0/486893185 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd0bc036b40 0x7fd0bc039000 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.473+0000 7fd1da142800 1 --2- 172.21.15.102:0/486893185 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c2ebd3ee00 0x55c2ebec2180 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.473+0000 7fd1da142800 1 -- 172.21.15.102:0/486893185 >> 172.21.15.102:0/486893185 conn(0x55c2ebdc5de0 msgr2=0x55c2ebeb4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:13.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.473+0000 7fd1da142800 1 -- 172.21.15.102:0/486893185 shutdown_connections 2024-09-13T19:16:13.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.473+0000 7fd1da142800 1 -- 172.21.15.102:0/486893185 wait complete. 2024-09-13T19:16:13.566 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-13T19:16:13.566 DEBUG:tasks.util.rgw: json result: [] 2024-09-13T19:16:13.567 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2024-09-13T19:16:13.567 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2024-09-13T19:16:13.567 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2024-09-13T19:16:13.612 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:13.612 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:13.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.608+0000 7f0b5d126800 1 Processor -- start 2024-09-13T19:16:13.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.608+0000 7f0b5d126800 1 -- start start 2024-09-13T19:16:13.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.608+0000 7f0b5d126800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55827df7f900 0x55827df81cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:13.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.608+0000 7f0b5d126800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55827de3bb30 con 0x55827df7b4c0 2024-09-13T19:16:13.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.608+0000 7f0b5d126800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55827de1d360 con 0x55827df7f900 2024-09-13T19:16:13.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.609+0000 7f0b53fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55827df7f900 0x55827df81cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:13.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.609+0000 7f0b53fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55827df7f900 0x55827df81cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53490/0 (socket says 172.21.15.102:53490) 2024-09-13T19:16:13.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.609+0000 7f0b53fff640 1 -- 172.21.15.102:0/646741353 learned_addr learned my addr 172.21.15.102:0/646741353 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:13.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.609+0000 7f0b58dbf640 1 --1- 172.21.15.102:0/646741353 >> v1:172.21.15.53:6789/0 conn(0x55827df7b4c0 0x55827df7b8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:49718/0 (socket says 172.21.15.102:49718) 2024-09-13T19:16:13.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.609+0000 7f0b53fff640 1 -- 172.21.15.102:0/646741353 >> v1:172.21.15.53:6789/0 conn(0x55827df7b4c0 legacy=0x55827df7b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:13.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.609+0000 7f0b53fff640 1 -- 172.21.15.102:0/646741353 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55827de43e00 con 0x55827df7f900 2024-09-13T19:16:13.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.611+0000 7f0b53fff640 1 --2- 172.21.15.102:0/646741353 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55827df7f900 0x55827df81cf0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0b4400a520 tx=0x7f0b44045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4d08dfadcf3f6c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:13.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.611+0000 7f0b537fe640 1 -- 172.21.15.102:0/646741353 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b44055070 con 0x55827df7f900 2024-09-13T19:16:13.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.611+0000 7f0b537fe640 1 -- 172.21.15.102:0/646741353 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b440515b0 con 0x55827df7f900 2024-09-13T19:16:13.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.611+0000 7f0b537fe640 1 -- 172.21.15.102:0/646741353 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b440518d0 con 0x55827df7f900 2024-09-13T19:16:13.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.612+0000 7f0b5d126800 1 -- 172.21.15.102:0/646741353 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55827df7f900 msgr2=0x55827df81cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:13.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.612+0000 7f0b5d126800 1 --2- 172.21.15.102:0/646741353 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55827df7f900 0x55827df81cf0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0b4400a520 tx=0x7f0b44045ba0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.612+0000 7f0b5d126800 1 -- 172.21.15.102:0/646741353 shutdown_connections 2024-09-13T19:16:13.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.612+0000 7f0b5d126800 1 --2- 172.21.15.102:0/646741353 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55827df7f900 0x55827df81cf0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.612+0000 7f0b5d126800 1 -- 172.21.15.102:0/646741353 >> 172.21.15.102:0/646741353 conn(0x55827df76df0 msgr2=0x55827df79210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:13.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.612+0000 7f0b5d126800 1 -- 172.21.15.102:0/646741353 shutdown_connections 2024-09-13T19:16:13.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.612+0000 7f0b5d126800 1 -- 172.21.15.102:0/646741353 wait complete. 2024-09-13T19:16:13.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.626+0000 7f0b5d126800 1 Processor -- start 2024-09-13T19:16:13.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.626+0000 7f0b5d126800 1 -- start start 2024-09-13T19:16:13.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.626+0000 7f0b5d126800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55827df7b4c0 0x55827deefd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:13.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.626+0000 7f0b5d126800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55827dec8330 con 0x55827df7b4c0 2024-09-13T19:16:13.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.626+0000 7f0b58dbf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55827df7b4c0 0x55827deefd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:13.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.626+0000 7f0b58dbf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55827df7b4c0 0x55827deefd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53494/0 (socket says 172.21.15.102:53494) 2024-09-13T19:16:13.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.626+0000 7f0b58dbf640 1 -- 172.21.15.102:0/1931030344 learned_addr learned my addr 172.21.15.102:0/1931030344 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:13.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.626+0000 7f0b58dbf640 1 -- 172.21.15.102:0/1931030344 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55827de15bc0 con 0x55827df7b4c0 2024-09-13T19:16:13.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.627+0000 7f0b58dbf640 1 --2- 172.21.15.102:0/1931030344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55827df7b4c0 0x55827deefd60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c00b230 tx=0x7f0b4c00b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f3680f009bdcfb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:13.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.627+0000 7f0a46e05640 1 -- 172.21.15.102:0/1931030344 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b4c00e5c0 con 0x55827df7b4c0 2024-09-13T19:16:13.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.627+0000 7f0a46e05640 1 -- 172.21.15.102:0/1931030344 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b4c006070 con 0x55827df7b4c0 2024-09-13T19:16:13.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.627+0000 7f0a46e05640 1 -- 172.21.15.102:0/1931030344 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b4c00e890 con 0x55827df7b4c0 2024-09-13T19:16:13.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.627+0000 7f0b5d126800 1 -- 172.21.15.102:0/1931030344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55827df7b4c0 msgr2=0x55827deefd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:13.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.627+0000 7f0b5d126800 1 --2- 172.21.15.102:0/1931030344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55827df7b4c0 0x55827deefd60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c00b230 tx=0x7f0b4c00b6f0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.628+0000 7f0b5d126800 1 -- 172.21.15.102:0/1931030344 shutdown_connections 2024-09-13T19:16:13.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.628+0000 7f0b5d126800 1 --2- 172.21.15.102:0/1931030344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55827df7b4c0 0x55827deefd60 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.628+0000 7f0b5d126800 1 -- 172.21.15.102:0/1931030344 >> 172.21.15.102:0/1931030344 conn(0x55827df76df0 msgr2=0x55827e066110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:13.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.628+0000 7f0b5d126800 1 -- 172.21.15.102:0/1931030344 shutdown_connections 2024-09-13T19:16:13.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.628+0000 7f0b5d126800 1 -- 172.21.15.102:0/1931030344 wait complete. 2024-09-13T19:16:13.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.628+0000 7f0b5d126800 1 Processor -- start 2024-09-13T19:16:13.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.628+0000 7f0b5d126800 1 -- start start 2024-09-13T19:16:13.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.628+0000 7f0b5d126800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55827df7b4c0 0x55827e06bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:13.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.628+0000 7f0b5d126800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55827df82530 con 0x55827df7b4c0 2024-09-13T19:16:13.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.628+0000 7f0b58dbf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55827df7b4c0 0x55827e06bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:13.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.628+0000 7f0b58dbf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55827df7b4c0 0x55827e06bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53496/0 (socket says 172.21.15.102:53496) 2024-09-13T19:16:13.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.628+0000 7f0b58dbf640 1 -- 172.21.15.102:0/2103868006 learned_addr learned my addr 172.21.15.102:0/2103868006 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:13.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.628+0000 7f0b58dbf640 1 -- 172.21.15.102:0/2103868006 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55827de29fe0 con 0x55827df7b4c0 2024-09-13T19:16:13.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.629+0000 7f0b58dbf640 1 --2- 172.21.15.102:0/2103868006 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55827df7b4c0 0x55827e06bed0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c000c00 tx=0x7f0b4c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:13.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.629+0000 7f0a45602640 1 -- 172.21.15.102:0/2103868006 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b4c00f8d0 con 0x55827df7b4c0 2024-09-13T19:16:13.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.629+0000 7f0a45602640 1 -- 172.21.15.102:0/2103868006 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b4c00fa90 con 0x55827df7b4c0 2024-09-13T19:16:13.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.629+0000 7f0b5d126800 1 -- 172.21.15.102:0/2103868006 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55827e06a5c0 con 0x55827df7b4c0 2024-09-13T19:16:13.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.629+0000 7f0a45602640 1 -- 172.21.15.102:0/2103868006 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b4c00fdb0 con 0x55827df7b4c0 2024-09-13T19:16:13.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.629+0000 7f0b5d126800 1 -- 172.21.15.102:0/2103868006 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55827e06aae0 con 0x55827df7b4c0 2024-09-13T19:16:13.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.630+0000 7f0a45602640 1 -- 172.21.15.102:0/2103868006 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0b4c017070 con 0x55827df7b4c0 2024-09-13T19:16:13.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.630+0000 7f0a45602640 1 --2- 172.21.15.102:0/2103868006 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0a40036b40 0x7f0a40039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:13.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.630+0000 7f0a45602640 1 -- 172.21.15.102:0/2103868006 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f0b4c015020 con 0x55827df7b4c0 2024-09-13T19:16:13.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.630+0000 7f0b53fff640 1 --2- 172.21.15.102:0/2103868006 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0a40036b40 0x7f0a40039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:13.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.630+0000 7f0b5d126800 1 --2- 172.21.15.102:0/2103868006 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55827df7f900 0x55827e07c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:13.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.630+0000 7f0b5d126800 1 -- 172.21.15.102:0/2103868006 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55827e07cb90 con 0x55827df7f900 2024-09-13T19:16:13.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.630+0000 7f0b595c0640 1 --2- 172.21.15.102:0/2103868006 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55827df7f900 0x55827e07c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:13.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.631+0000 7f0b53fff640 1 --2- 172.21.15.102:0/2103868006 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0a40036b40 0x7f0a40039000 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0b44057000 tx=0x7f0b44052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:13.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.631+0000 7f0b595c0640 1 --2- 172.21.15.102:0/2103868006 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55827df7f900 0x55827e07c650 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:13.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.631+0000 7f0b595c0640 1 -- 172.21.15.102:0/2103868006 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0b5400a4a0 con 0x55827df7f900 2024-09-13T19:16:13.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.631+0000 7f0b5d126800 1 -- 172.21.15.102:0/2103868006 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55827e07d3e0 con 0x55827df7f900 2024-09-13T19:16:13.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.631+0000 7f0b595c0640 1 -- 172.21.15.102:0/2103868006 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0b5400a4a0 con 0x55827df7f900 2024-09-13T19:16:13.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.631+0000 7f0b5d126800 1 --2- 172.21.15.102:0/2103868006 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55827e07ee10 0x55827e081240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:13.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.631+0000 7f0b5d126800 1 -- 172.21.15.102:0/2103868006 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55827e0819d0 con 0x55827e07ee10 2024-09-13T19:16:13.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.631+0000 7f0b58dbf640 1 --2- 172.21.15.102:0/2103868006 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55827e07ee10 0x55827e081240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:13.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.632+0000 7f0b58dbf640 1 --2- 172.21.15.102:0/2103868006 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55827e07ee10 0x55827e081240 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:13.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.632+0000 7f0b58dbf640 1 -- 172.21.15.102:0/2103868006 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0b4c02e070 con 0x55827e07ee10 2024-09-13T19:16:13.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.632+0000 7f0b5d126800 1 -- 172.21.15.102:0/2103868006 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55827e07dc30 con 0x55827df7f900 2024-09-13T19:16:13.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.632+0000 7f0b595c0640 1 -- 172.21.15.102:0/2103868006 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0b5400a4a0 con 0x55827df7f900 2024-09-13T19:16:13.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.632+0000 7f0b5d126800 1 -- 172.21.15.102:0/2103868006 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55827e07dfd0 con 0x55827e07ee10 2024-09-13T19:16:13.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.633+0000 7f0b58dbf640 1 -- 172.21.15.102:0/2103868006 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0b4c02e070 con 0x55827e07ee10 2024-09-13T19:16:13.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.633+0000 7f0b5d126800 1 Processor -- start 2024-09-13T19:16:13.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.633+0000 7f0b5d126800 1 -- start start 2024-09-13T19:16:13.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.633+0000 7f0b5d126800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55827e090350 0x55827e090770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:13.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.633+0000 7f0b5d126800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55827e06c410 con 0x55827e090350 2024-09-13T19:16:13.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.633+0000 7f0b595c0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55827e090350 0x55827e090770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:13.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.633+0000 7f0b595c0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55827e090350 0x55827e090770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53512/0 (socket says 172.21.15.102:53512) 2024-09-13T19:16:13.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.633+0000 7f0b595c0640 1 -- 172.21.15.102:0/515857454 learned_addr learned my addr 172.21.15.102:0/515857454 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:13.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.634+0000 7f0b595c0640 1 -- 172.21.15.102:0/515857454 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55827e090cb0 con 0x55827e090350 2024-09-13T19:16:13.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.634+0000 7f0b595c0640 1 --2- 172.21.15.102:0/515857454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55827e090350 0x55827e090770 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x55827e06b570 tx=0x7f0b540167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:13.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.634+0000 7f0a3e7fc640 1 -- 172.21.15.102:0/515857454 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b54013640 con 0x55827e090350 2024-09-13T19:16:13.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.634+0000 7f0a3e7fc640 1 -- 172.21.15.102:0/515857454 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b540137e0 con 0x55827e090350 2024-09-13T19:16:13.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.634+0000 7f0b5d126800 1 -- 172.21.15.102:0/515857454 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55827e090f40 con 0x55827e090350 2024-09-13T19:16:13.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.634+0000 7f0a3e7fc640 1 -- 172.21.15.102:0/515857454 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b54013ae0 con 0x55827e090350 2024-09-13T19:16:13.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.634+0000 7f0b5d126800 1 -- 172.21.15.102:0/515857454 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55827e093c20 con 0x55827e090350 2024-09-13T19:16:13.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.635+0000 7f0a3e7fc640 1 -- 172.21.15.102:0/515857454 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0b54011040 con 0x55827e090350 2024-09-13T19:16:13.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.635+0000 7f0a3e7fc640 1 --2- 172.21.15.102:0/515857454 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0a30036b90 0x7f0a30039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:13.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.635+0000 7f0a3e7fc640 1 -- 172.21.15.102:0/515857454 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f0b5400e040 con 0x55827e090350 2024-09-13T19:16:13.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.635+0000 7f0b58dbf640 1 --2- 172.21.15.102:0/515857454 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0a30036b90 0x7f0a30039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:13.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.635+0000 7f0b5d126800 1 Processor -- start 2024-09-13T19:16:13.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.635+0000 7f0b5d126800 1 -- start start 2024-09-13T19:16:13.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.636+0000 7f0b58dbf640 1 --2- 172.21.15.102:0/515857454 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0a30036b90 0x7f0a30039050 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x55827e06aed0 tx=0x7f0b4c04b740 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:13.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.636+0000 7f0b5d126800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55827e09d020 0x55827e09d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:13.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.636+0000 7f0b5d126800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55827de17580 con 0x55827e09d020 2024-09-13T19:16:13.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.636+0000 7f0b595c0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55827e09d020 0x55827e09d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:13.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.636+0000 7f0b595c0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55827e09d020 0x55827e09d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53528/0 (socket says 172.21.15.102:53528) 2024-09-13T19:16:13.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.636+0000 7f0b595c0640 1 -- 172.21.15.102:0/2582880802 learned_addr learned my addr 172.21.15.102:0/2582880802 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:13.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.636+0000 7f0b595c0640 1 -- 172.21.15.102:0/2582880802 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55827e09d9f0 con 0x55827e09d020 2024-09-13T19:16:13.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.636+0000 7f0b595c0640 1 --2- 172.21.15.102:0/2582880802 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55827e09d020 0x55827e09d420 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0b54021fd0 tx=0x7f0b5401ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6862698888779ed server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:13.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.636+0000 7f0a2ffff640 1 -- 172.21.15.102:0/2582880802 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b54021a40 con 0x55827e09d020 2024-09-13T19:16:13.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.636+0000 7f0a2ffff640 1 -- 172.21.15.102:0/2582880802 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b5403be50 con 0x55827e09d020 2024-09-13T19:16:13.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.636+0000 7f0a2ffff640 1 -- 172.21.15.102:0/2582880802 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b54021570 con 0x55827e09d020 2024-09-13T19:16:13.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.637+0000 7f0b5d126800 1 -- 172.21.15.102:0/2582880802 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55827e09d020 msgr2=0x55827e09d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:13.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.637+0000 7f0b5d126800 1 --2- 172.21.15.102:0/2582880802 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55827e09d020 0x55827e09d420 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0b54021fd0 tx=0x7f0b5401ff90 comp rx=0 tx=0).stop 2024-09-13T19:16:13.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.637+0000 7f0b5d126800 1 -- 172.21.15.102:0/2582880802 shutdown_connections 2024-09-13T19:16:13.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.637+0000 7f0b5d126800 1 --2- 172.21.15.102:0/2582880802 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55827e09d020 0x55827e09d420 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.637+0000 7f0b5d126800 1 -- 172.21.15.102:0/2582880802 >> 172.21.15.102:0/2582880802 conn(0x55827e0993d0 msgr2=0x55827e0974d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:13.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.637+0000 7f0b5d126800 1 -- 172.21.15.102:0/2582880802 shutdown_connections 2024-09-13T19:16:13.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.637+0000 7f0b5d126800 1 -- 172.21.15.102:0/2582880802 wait complete. 2024-09-13T19:16:13.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.637+0000 7f0b5d126800 1 Processor -- start 2024-09-13T19:16:13.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.637+0000 7f0b5d126800 1 -- start start 2024-09-13T19:16:13.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.637+0000 7f0b5d126800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55827e09d020 0x55827e0a4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:13.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.637+0000 7f0b5d126800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55827e09de40 con 0x55827e09d020 2024-09-13T19:16:13.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.638+0000 7f0b595c0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55827e09d020 0x55827e0a4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:13.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.638+0000 7f0b595c0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55827e09d020 0x55827e0a4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53536/0 (socket says 172.21.15.102:53536) 2024-09-13T19:16:13.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.638+0000 7f0b595c0640 1 -- 172.21.15.102:0/2309329137 learned_addr learned my addr 172.21.15.102:0/2309329137 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:13.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.638+0000 7f0b595c0640 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55827e0a4840 con 0x55827e09d020 2024-09-13T19:16:13.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.638+0000 7f0b595c0640 1 --2- 172.21.15.102:0/2309329137 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55827e09d020 0x55827e0a4300 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0b54021fd0 tx=0x7f0b5404cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:13.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.638+0000 7f0a2e7fc640 1 -- 172.21.15.102:0/2309329137 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b540294f0 con 0x55827e09d020 2024-09-13T19:16:13.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.638+0000 7f0a2e7fc640 1 -- 172.21.15.102:0/2309329137 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b540296d0 con 0x55827e09d020 2024-09-13T19:16:13.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.638+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55827e0a4ad0 con 0x55827e09d020 2024-09-13T19:16:13.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.638+0000 7f0a2e7fc640 1 -- 172.21.15.102:0/2309329137 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b540299b0 con 0x55827e09d020 2024-09-13T19:16:13.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.638+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55827e0a7780 con 0x55827e09d020 2024-09-13T19:16:13.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.639+0000 7f0a2e7fc640 1 -- 172.21.15.102:0/2309329137 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0b5404eb50 con 0x55827e09d020 2024-09-13T19:16:13.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.639+0000 7f0a2e7fc640 1 --2- 172.21.15.102:0/2309329137 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0a24036b40 0x7f0a24039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:13.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.639+0000 7f0a2e7fc640 1 -- 172.21.15.102:0/2309329137 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f0b54036ca0 con 0x55827e09d020 2024-09-13T19:16:13.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.639+0000 7f0b58dbf640 1 --2- 172.21.15.102:0/2309329137 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0a24036b40 0x7f0a24039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:13.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.640+0000 7f0b58dbf640 1 --2- 172.21.15.102:0/2309329137 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0a24036b40 0x7f0a24039000 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c0197f0 tx=0x7f0b4c04d2d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:13.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.640+0000 7f0b5d126800 20 rados->read ofs=0 len=0 2024-09-13T19:16:13.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.640+0000 7f0b5d126800 1 --2- 172.21.15.102:0/2309329137 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55827e0afe40 0x55827e0b2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:13.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.640+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55827e0b2a50 con 0x55827e0afe40 2024-09-13T19:16:13.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.640+0000 7f0b53fff640 1 --2- 172.21.15.102:0/2309329137 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55827e0afe40 0x55827e0b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:13.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.640+0000 7f0b53fff640 1 --2- 172.21.15.102:0/2309329137 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55827e0afe40 0x55827e0b2300 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:13.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.641+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0b44057030 con 0x55827e0afe40 2024-09-13T19:16:13.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.641+0000 7f0b5d126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:13.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.641+0000 7f0b5d126800 20 realm 2024-09-13T19:16:13.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.641+0000 7f0b5d126800 20 rados->read ofs=0 len=0 2024-09-13T19:16:13.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.641+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55827e0b2e80 con 0x55827e0afe40 2024-09-13T19:16:13.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.641+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0b44057030 con 0x55827e0afe40 2024-09-13T19:16:13.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.641+0000 7f0b5d126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:13.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.641+0000 7f0b5d126800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:13.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.641+0000 7f0b5d126800 20 rados->read ofs=0 len=0 2024-09-13T19:16:13.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.641+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55827e0b3750 con 0x55827e0afe40 2024-09-13T19:16:13.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.641+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0b44057030 con 0x55827e0afe40 2024-09-13T19:16:13.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.641+0000 7f0b5d126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:13.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.641+0000 7f0b5d126800 20 rados->read ofs=0 len=0 2024-09-13T19:16:13.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.641+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55827e0b3af0 con 0x55827e0afe40 2024-09-13T19:16:13.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.641+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0b44057030 con 0x55827e0afe40 2024-09-13T19:16:13.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.641+0000 7f0b5d126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:13.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.641+0000 7f0b5d126800 20 rados->read ofs=0 len=0 2024-09-13T19:16:13.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.641+0000 7f0b5d126800 1 --2- 172.21.15.102:0/2309329137 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55827e0b4850 0x55827e0b6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:13.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.641+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55827e0b7290 con 0x55827e0b4850 2024-09-13T19:16:13.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.641+0000 7f0b595c0640 1 --2- 172.21.15.102:0/2309329137 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55827e0b4850 0x55827e0b6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:13.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.642+0000 7f0b595c0640 1 --2- 172.21.15.102:0/2309329137 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55827e0b4850 0x55827e0b6c40 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:13.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.642+0000 7f0b595c0640 1 -- 172.21.15.102:0/2309329137 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0b54056040 con 0x55827e0b4850 2024-09-13T19:16:13.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.642+0000 7f0b5d126800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:13.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.642+0000 7f0b5d126800 20 searching for the correct realm 2024-09-13T19:16:13.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.642+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55827e0b8bc0 con 0x55827e0b4850 2024-09-13T19:16:13.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.642+0000 7f0b595c0640 1 -- 172.21.15.102:0/2309329137 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b54056040 con 0x55827e0b4850 2024-09-13T19:16:13.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.642+0000 7f0b595c0640 1 --2- 172.21.15.102:0/2309329137 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f0b5403d0d0 0x7f0b5403b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:13.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.642+0000 7f0b595c0640 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55827e0b8bc0 con 0x7f0b5403d0d0 2024-09-13T19:16:13.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.642+0000 7f0b58dbf640 1 --2- 172.21.15.102:0/2309329137 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f0b5403d0d0 0x7f0b5403b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:13.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.643+0000 7f0b58dbf640 1 --2- 172.21.15.102:0/2309329137 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f0b5403d0d0 0x7f0b5403b850 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:13.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.643+0000 7f0b58dbf640 1 -- 172.21.15.102:0/2309329137 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b4c02e070 con 0x7f0b5403d0d0 2024-09-13T19:16:13.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.643+0000 7f0b58dbf640 1 --2- 172.21.15.102:0/2309329137 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f0b4c03e040 0x7f0b4c03f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:13.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.643+0000 7f0b58dbf640 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55827e0b8bc0 con 0x7f0b4c03e040 2024-09-13T19:16:13.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.643+0000 7f0b53fff640 1 --2- 172.21.15.102:0/2309329137 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f0b4c03e040 0x7f0b4c03f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:13.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.644+0000 7f0b53fff640 1 --2- 172.21.15.102:0/2309329137 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f0b4c03e040 0x7f0b4c03f430 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:13.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.644+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b44057030 con 0x7f0b4c03e040 2024-09-13T19:16:13.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.644+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55827e0b8bc0 con 0x55827e0afe40 2024-09-13T19:16:13.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.644+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b44057030 con 0x55827e0afe40 2024-09-13T19:16:13.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.644+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55827e0b8bc0 con 0x55827e0afe40 2024-09-13T19:16:13.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.644+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b44057030 con 0x55827e0afe40 2024-09-13T19:16:13.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.644+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55827e0b8bc0 con 0x7f0b4c03e040 2024-09-13T19:16:13.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.645+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b44057030 con 0x7f0b4c03e040 2024-09-13T19:16:13.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.645+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55827e0b8bc0 con 0x7f0b4c03e040 2024-09-13T19:16:13.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.645+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b44057030 con 0x7f0b4c03e040 2024-09-13T19:16:13.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.645+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55827e0b8bc0 con 0x7f0b5403d0d0 2024-09-13T19:16:13.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.645+0000 7f0b58dbf640 1 -- 172.21.15.102:0/2309329137 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b4c02e070 con 0x7f0b5403d0d0 2024-09-13T19:16:13.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.645+0000 7f0b58dbf640 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55827e0b8bc0 con 0x55827e0b4850 2024-09-13T19:16:13.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.645+0000 7f0b595c0640 1 -- 172.21.15.102:0/2309329137 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b54056040 con 0x55827e0b4850 2024-09-13T19:16:13.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.645+0000 7f0b595c0640 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55827e0b8bc0 con 0x55827e0afe40 2024-09-13T19:16:13.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.646+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b44057030 con 0x55827e0afe40 2024-09-13T19:16:13.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.646+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55827e0b8bc0 con 0x7f0b4c03e040 2024-09-13T19:16:13.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.646+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b44057030 con 0x7f0b4c03e040 2024-09-13T19:16:13.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.646+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55827e0b8bc0 con 0x55827e0afe40 2024-09-13T19:16:13.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.646+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b44057030 con 0x55827e0afe40 2024-09-13T19:16:13.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.646+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55827e0b8bc0 con 0x7f0b5403d0d0 2024-09-13T19:16:13.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.646+0000 7f0b58dbf640 1 -- 172.21.15.102:0/2309329137 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0b4c02e070 con 0x7f0b5403d0d0 2024-09-13T19:16:13.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.646+0000 7f0b58dbf640 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55827e0b8bc0 con 0x55827e0b4850 2024-09-13T19:16:13.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.647+0000 7f0b595c0640 1 -- 172.21.15.102:0/2309329137 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b54056040 con 0x55827e0b4850 2024-09-13T19:16:13.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.647+0000 7f0b595c0640 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55827e0b8bc0 con 0x55827e0b4850 2024-09-13T19:16:13.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.647+0000 7f0b595c0640 1 -- 172.21.15.102:0/2309329137 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=107b] v27'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0b54056040 con 0x55827e0b4850 2024-09-13T19:16:13.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.647+0000 7f0b595c0640 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55827e0b8bc0 con 0x7f0b4c03e040 2024-09-13T19:16:13.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.647+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b44057030 con 0x7f0b4c03e040 2024-09-13T19:16:13.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.647+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55827e0b8bc0 con 0x55827e0b4850 2024-09-13T19:16:13.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.647+0000 7f0b595c0640 1 -- 172.21.15.102:0/2309329137 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0b54056040 con 0x55827e0b4850 2024-09-13T19:16:13.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.647+0000 7f0b595c0640 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55827e0b8bc0 con 0x55827e0b4850 2024-09-13T19:16:13.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.648+0000 7f0b595c0640 1 -- 172.21.15.102:0/2309329137 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b54056040 con 0x55827e0b4850 2024-09-13T19:16:13.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.648+0000 7f0b595c0640 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55827e0b8bc0 con 0x55827e0afe40 2024-09-13T19:16:13.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.648+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b44057030 con 0x55827e0afe40 2024-09-13T19:16:13.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.648+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55827e0b8bc0 con 0x55827e0afe40 2024-09-13T19:16:13.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.648+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0b44057030 con 0x55827e0afe40 2024-09-13T19:16:13.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.648+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55827e0b8bc0 con 0x7f0b4c03e040 2024-09-13T19:16:13.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.649+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b44057030 con 0x7f0b4c03e040 2024-09-13T19:16:13.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.649+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55827e0b8bc0 con 0x55827e0b4850 2024-09-13T19:16:13.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.649+0000 7f0b595c0640 1 -- 172.21.15.102:0/2309329137 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b54056040 con 0x55827e0b4850 2024-09-13T19:16:13.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.649+0000 7f0b595c0640 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55827e0b8bc0 con 0x7f0b5403d0d0 2024-09-13T19:16:13.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.649+0000 7f0b58dbf640 1 -- 172.21.15.102:0/2309329137 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b4c02e070 con 0x7f0b5403d0d0 2024-09-13T19:16:13.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.649+0000 7f0b58dbf640 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55827e0b8bc0 con 0x55827e0afe40 2024-09-13T19:16:13.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.649+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b44057030 con 0x55827e0afe40 2024-09-13T19:16:13.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.649+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55827e0b8bc0 con 0x7f0b4c03e040 2024-09-13T19:16:13.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.650+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b44057030 con 0x7f0b4c03e040 2024-09-13T19:16:13.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.650+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55827e0b8bc0 con 0x55827e0b4850 2024-09-13T19:16:13.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.650+0000 7f0b595c0640 1 -- 172.21.15.102:0/2309329137 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b54056040 con 0x55827e0b4850 2024-09-13T19:16:13.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.650+0000 7f0b595c0640 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55827e0b8bc0 con 0x7f0b4c03e040 2024-09-13T19:16:13.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.650+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b44057030 con 0x7f0b4c03e040 2024-09-13T19:16:13.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.650+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55827e0b8bc0 con 0x7f0b5403d0d0 2024-09-13T19:16:13.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.651+0000 7f0b58dbf640 1 -- 172.21.15.102:0/2309329137 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b4c02e070 con 0x7f0b5403d0d0 2024-09-13T19:16:13.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.651+0000 7f0b58dbf640 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55827e0b8bc0 con 0x55827e0b4850 2024-09-13T19:16:13.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.651+0000 7f0b595c0640 1 -- 172.21.15.102:0/2309329137 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b54056040 con 0x55827e0b4850 2024-09-13T19:16:13.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.651+0000 7f0b595c0640 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55827e0b8bc0 con 0x7f0b4c03e040 2024-09-13T19:16:13.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.651+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b44057030 con 0x7f0b4c03e040 2024-09-13T19:16:13.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.651+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55827e0b8bc0 con 0x55827e0afe40 2024-09-13T19:16:13.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.652+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0b44057030 con 0x55827e0afe40 2024-09-13T19:16:13.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.652+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0b4408a080 con 0x7f0b5403d0d0 2024-09-13T19:16:13.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.652+0000 7f0b58dbf640 1 -- 172.21.15.102:0/2309329137 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b4c065040 con 0x7f0b5403d0d0 2024-09-13T19:16:13.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.652+0000 7f0b5d126800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:13.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.652+0000 7f0b5d126800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:13.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.652+0000 7f0b5d126800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:13.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.652+0000 7f0b5d126800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:13.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.652+0000 7f0b5d126800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:13.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.652+0000 7f0b5d126800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:13.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.652+0000 7f0b5d126800 20 rados->read ofs=0 len=0 2024-09-13T19:16:13.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.652+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55827e0b7c50 con 0x55827e0afe40 2024-09-13T19:16:13.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.652+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0b44057030 con 0x55827e0afe40 2024-09-13T19:16:13.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.652+0000 7f0b5d126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:13.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.652+0000 7f0b5d126800 20 rados->read ofs=0 len=0 2024-09-13T19:16:13.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.652+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55827e0b84f0 con 0x55827e0afe40 2024-09-13T19:16:13.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.652+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0b44057030 con 0x55827e0afe40 2024-09-13T19:16:13.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.652+0000 7f0b5d126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:13.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.652+0000 7f0b5d126800 20 rados->read ofs=0 len=0 2024-09-13T19:16:13.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.652+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55827e0b9040 con 0x55827e0b4850 2024-09-13T19:16:13.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.653+0000 7f0b595c0640 1 -- 172.21.15.102:0/2309329137 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0b54056040 con 0x55827e0b4850 2024-09-13T19:16:13.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.653+0000 7f0b5d126800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:13.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.653+0000 7f0b5d126800 20 zone default found 2024-09-13T19:16:13.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.653+0000 7f0b5d126800 4 Realm: () 2024-09-13T19:16:13.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.653+0000 7f0b5d126800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:13.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.653+0000 7f0b5d126800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:13.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.653+0000 7f0b5d126800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:13.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.653+0000 7f0b5d126800 20 zonegroup default 2024-09-13T19:16:13.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.653+0000 7f0b5d126800 20 rados->read ofs=0 len=0 2024-09-13T19:16:13.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.653+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55827e0b9890 con 0x7f0b4c03e040 2024-09-13T19:16:13.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.653+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0b44057030 con 0x7f0b4c03e040 2024-09-13T19:16:13.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.653+0000 7f0b5d126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:13.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.653+0000 7f0b5d126800 20 rados->read ofs=0 len=0 2024-09-13T19:16:13.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.653+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55827e0bb270 con 0x55827e0b4850 2024-09-13T19:16:13.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.653+0000 7f0b595c0640 1 -- 172.21.15.102:0/2309329137 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0b54056040 con 0x55827e0b4850 2024-09-13T19:16:13.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.653+0000 7f0b5d126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:13.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.653+0000 7f0b5d126800 20 rados->read ofs=0 len=0 2024-09-13T19:16:13.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.653+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55827e0bb680 con 0x55827e0b4850 2024-09-13T19:16:13.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.654+0000 7f0b595c0640 1 -- 172.21.15.102:0/2309329137 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0b54056040 con 0x55827e0b4850 2024-09-13T19:16:13.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.654+0000 7f0b5d126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:13.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.654+0000 7f0b5d126800 20 started sync module instance, tier type = 2024-09-13T19:16:13.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.654+0000 7f0b5d126800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:13.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.654+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0ba700 con 0x7f0b5403d0d0 2024-09-13T19:16:13.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.655+0000 7f0b58dbf640 1 -- 172.21.15.102:0/2309329137 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(44 notify.0 [create] v34'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b4c065040 con 0x7f0b5403d0d0 2024-09-13T19:16:13.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.655+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94018948803312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0ba360 con 0x7f0b5403d0d0 2024-09-13T19:16:13.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.655+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0bc4c0 con 0x55827e0afe40 2024-09-13T19:16:13.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.658+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v34'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b44057030 con 0x55827e0afe40 2024-09-13T19:16:13.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.658+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94018948808592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0bcd60 con 0x55827e0afe40 2024-09-13T19:16:13.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.658+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0bd860 con 0x55827e0b4850 2024-09-13T19:16:13.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.658+0000 7f0b58dbf640 1 -- 172.21.15.102:0/2309329137 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94018948803312] v34'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b4c065040 con 0x7f0b5403d0d0 2024-09-13T19:16:13.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.660+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94018948808592] v34'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b44057030 con 0x55827e0afe40 2024-09-13T19:16:13.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.663+0000 7f0b595c0640 1 -- 172.21.15.102:0/2309329137 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v34'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b54056040 con 0x55827e0b4850 2024-09-13T19:16:13.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.663+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94018948813648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0bc8b0 con 0x55827e0b4850 2024-09-13T19:16:13.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.663+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0be100 con 0x7f0b5403d0d0 2024-09-13T19:16:13.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.664+0000 7f0b58dbf640 1 -- 172.21.15.102:0/2309329137 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(50 notify.3 [create] v34'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b4c065040 con 0x7f0b5403d0d0 2024-09-13T19:16:13.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.664+0000 7f0b595c0640 1 -- 172.21.15.102:0/2309329137 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94018948813648] v34'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b54056040 con 0x55827e0b4850 2024-09-13T19:16:13.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.664+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94018948815952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0be950 con 0x7f0b5403d0d0 2024-09-13T19:16:13.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.664+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0bbae0 con 0x55827e0afe40 2024-09-13T19:16:13.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.666+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v34'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b44057030 con 0x55827e0afe40 2024-09-13T19:16:13.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.666+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94018948820208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0bf5c0 con 0x55827e0afe40 2024-09-13T19:16:13.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.666+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0bff80 con 0x7f0b4c03e040 2024-09-13T19:16:13.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.667+0000 7f0b58dbf640 1 -- 172.21.15.102:0/2309329137 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94018948815952] v34'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b4c065040 con 0x7f0b5403d0d0 2024-09-13T19:16:13.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.669+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94018948820208] v34'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b44057030 con 0x55827e0afe40 2024-09-13T19:16:13.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.669+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(54 notify.5 [create] v34'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b44057030 con 0x7f0b4c03e040 2024-09-13T19:16:13.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.669+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94018948823760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0bf5c0 con 0x7f0b4c03e040 2024-09-13T19:16:13.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.669+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0bff30 con 0x7f0b4c03e040 2024-09-13T19:16:13.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.672+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(56 notify.6 [create] v34'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b44057030 con 0x7f0b4c03e040 2024-09-13T19:16:13.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.672+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94018948824816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0c0860 con 0x7f0b4c03e040 2024-09-13T19:16:13.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.672+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0c1350 con 0x7f0b4c03e040 2024-09-13T19:16:13.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.672+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94018948823760] v34'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b44057030 con 0x7f0b4c03e040 2024-09-13T19:16:13.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.673+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94018948824816] v34'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b44057030 con 0x7f0b4c03e040 2024-09-13T19:16:13.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.673+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(58 notify.7 [create] v34'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b44057030 con 0x7f0b4c03e040 2024-09-13T19:16:13.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.673+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94018948828704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0c0320 con 0x7f0b4c03e040 2024-09-13T19:16:13.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.673+0000 7f0b5d126800 20 add_watcher() i=0 2024-09-13T19:16:13.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.673+0000 7f0b5d126800 20 add_watcher() i=1 2024-09-13T19:16:13.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.673+0000 7f0b5d126800 20 add_watcher() i=2 2024-09-13T19:16:13.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.673+0000 7f0b5d126800 20 add_watcher() i=3 2024-09-13T19:16:13.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.673+0000 7f0b5d126800 20 add_watcher() i=4 2024-09-13T19:16:13.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.673+0000 7f0b5d126800 20 add_watcher() i=5 2024-09-13T19:16:13.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.673+0000 7f0b5d126800 20 add_watcher() i=6 2024-09-13T19:16:13.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.674+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94018948828704] v34'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b44057030 con 0x7f0b4c03e040 2024-09-13T19:16:13.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.674+0000 7f0b5d126800 20 add_watcher() i=7 2024-09-13T19:16:13.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.674+0000 7f0b5d126800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:13.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.674+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55827e0c4340 con 0x55827e0afe40 2024-09-13T19:16:13.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.675+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0b44057030 con 0x55827e0afe40 2024-09-13T19:16:13.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.675+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94018948821264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0c17c0 con 0x55827e0afe40 2024-09-13T19:16:13.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.676+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94018948821264] v34'26 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0b44057030 con 0x55827e0afe40 2024-09-13T19:16:13.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.676+0000 7f0a0efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:13.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.676+0000 7f0b5d126800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:13.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.676+0000 7f0b5d126800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:13.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.676+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0ccc50 con 0x55827e0afe40 2024-09-13T19:16:13.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.677+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0b44057030 con 0x55827e0afe40 2024-09-13T19:16:13.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.677+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0cd320 con 0x7f0b4c03e040 2024-09-13T19:16:13.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.678+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'10 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0b44057030 con 0x7f0b4c03e040 2024-09-13T19:16:13.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.678+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0cd740 con 0x55827e0b4850 2024-09-13T19:16:13.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.679+0000 7f0b595c0640 1 -- 172.21.15.102:0/2309329137 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0b54056040 con 0x55827e0b4850 2024-09-13T19:16:13.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.679+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0cd5e0 con 0x55827e0afe40 2024-09-13T19:16:13.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.681+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'27 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0b44057030 con 0x55827e0afe40 2024-09-13T19:16:13.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.681+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0cdc60 con 0x7f0b5403d0d0 2024-09-13T19:16:13.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.684+0000 7f0b58dbf640 1 -- 172.21.15.102:0/2309329137 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'20 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0b4c065040 con 0x7f0b5403d0d0 2024-09-13T19:16:13.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.684+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0ce080 con 0x55827e0b4850 2024-09-13T19:16:13.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.685+0000 7f0b595c0640 1 -- 172.21.15.102:0/2309329137 <== osd.3 v2:172.21.15.102:6800/3096737090 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'13 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0b54056040 con 0x55827e0b4850 2024-09-13T19:16:13.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.685+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0ce080 con 0x55827e0afe40 2024-09-13T19:16:13.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.686+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0b44057030 con 0x55827e0afe40 2024-09-13T19:16:13.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.686+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0ce140 con 0x7f0b4c03e040 2024-09-13T19:16:13.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.687+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'13 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0b44057030 con 0x7f0b4c03e040 2024-09-13T19:16:13.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.687+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0ce220 con 0x7f0b5403d0d0 2024-09-13T19:16:13.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.689+0000 7f0b58dbf640 1 -- 172.21.15.102:0/2309329137 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0b4c065040 con 0x7f0b5403d0d0 2024-09-13T19:16:13.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.689+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0ce220 con 0x55827e0b4850 2024-09-13T19:16:13.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.690+0000 7f0b595c0640 1 -- 172.21.15.102:0/2309329137 <== osd.3 v2:172.21.15.102:6800/3096737090 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0b54056040 con 0x55827e0b4850 2024-09-13T19:16:13.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.690+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0ce220 con 0x7f0b5403d0d0 2024-09-13T19:16:13.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.692+0000 7f0b58dbf640 1 -- 172.21.15.102:0/2309329137 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b4c065040 con 0x7f0b5403d0d0 2024-09-13T19:16:13.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.692+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0ce800 con 0x7f0b4c03e040 2024-09-13T19:16:13.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.694+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b44057030 con 0x7f0b4c03e040 2024-09-13T19:16:13.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.694+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0ce800 con 0x7f0b5403d0d0 2024-09-13T19:16:13.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.695+0000 7f0b58dbf640 1 -- 172.21.15.102:0/2309329137 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b4c065040 con 0x7f0b5403d0d0 2024-09-13T19:16:13.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.695+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0ce800 con 0x7f0b4c03e040 2024-09-13T19:16:13.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.698+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.0 v2:172.21.15.53:6800/4021716951 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'19 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b44057030 con 0x7f0b4c03e040 2024-09-13T19:16:13.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.698+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0ce800 con 0x55827e0afe40 2024-09-13T19:16:13.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.700+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'28 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b44057030 con 0x55827e0afe40 2024-09-13T19:16:13.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.700+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0ce800 con 0x55827e0b4850 2024-09-13T19:16:13.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.701+0000 7f0b595c0640 1 -- 172.21.15.102:0/2309329137 <== osd.3 v2:172.21.15.102:6800/3096737090 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b54056040 con 0x55827e0b4850 2024-09-13T19:16:13.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.701+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0ce800 con 0x7f0b5403d0d0 2024-09-13T19:16:13.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.702+0000 7f0b58dbf640 1 -- 172.21.15.102:0/2309329137 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'22 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b4c065040 con 0x7f0b5403d0d0 2024-09-13T19:16:13.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.702+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0ce800 con 0x55827e0b4850 2024-09-13T19:16:13.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.703+0000 7f0b595c0640 1 -- 172.21.15.102:0/2309329137 <== osd.3 v2:172.21.15.102:6800/3096737090 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'10 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b54056040 con 0x55827e0b4850 2024-09-13T19:16:13.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.703+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0ce800 con 0x55827e0afe40 2024-09-13T19:16:13.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.704+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b44057030 con 0x55827e0afe40 2024-09-13T19:16:13.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.704+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0ce800 con 0x55827e0afe40 2024-09-13T19:16:13.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.707+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'29 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b44057030 con 0x55827e0afe40 2024-09-13T19:16:13.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.707+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0ce800 con 0x55827e0b4850 2024-09-13T19:16:13.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.708+0000 7f0b595c0640 1 -- 172.21.15.102:0/2309329137 <== osd.3 v2:172.21.15.102:6800/3096737090 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'15 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b54056040 con 0x55827e0b4850 2024-09-13T19:16:13.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.708+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0ce800 con 0x7f0b5403d0d0 2024-09-13T19:16:13.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.709+0000 7f0b58dbf640 1 -- 172.21.15.102:0/2309329137 <== osd.2 v2:172.21.15.102:6816/2238176080 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b4c065040 con 0x7f0b5403d0d0 2024-09-13T19:16:13.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.709+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0ce800 con 0x55827e0b4850 2024-09-13T19:16:13.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.710+0000 7f0b595c0640 1 -- 172.21.15.102:0/2309329137 <== osd.3 v2:172.21.15.102:6800/3096737090 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b54056040 con 0x55827e0b4850 2024-09-13T19:16:13.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.710+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0ce800 con 0x55827e0b4850 2024-09-13T19:16:13.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.711+0000 7f0b595c0640 1 -- 172.21.15.102:0/2309329137 <== osd.3 v2:172.21.15.102:6800/3096737090 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b54056040 con 0x55827e0b4850 2024-09-13T19:16:13.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.711+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0ce800 con 0x55827e0b4850 2024-09-13T19:16:13.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.712+0000 7f0b595c0640 1 -- 172.21.15.102:0/2309329137 <== osd.3 v2:172.21.15.102:6800/3096737090 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'6 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b54056040 con 0x55827e0b4850 2024-09-13T19:16:13.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.712+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0ce800 con 0x55827e0b4850 2024-09-13T19:16:13.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.713+0000 7f0b595c0640 1 -- 172.21.15.102:0/2309329137 <== osd.3 v2:172.21.15.102:6800/3096737090 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'14 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b54056040 con 0x55827e0b4850 2024-09-13T19:16:13.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.713+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0ce800 con 0x7f0b4c03e040 2024-09-13T19:16:13.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.714+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.0 v2:172.21.15.53:6800/4021716951 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b44057030 con 0x7f0b4c03e040 2024-09-13T19:16:13.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.714+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0ce800 con 0x55827e0b4850 2024-09-13T19:16:13.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.715+0000 7f0b595c0640 1 -- 172.21.15.102:0/2309329137 <== osd.3 v2:172.21.15.102:6800/3096737090 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b54056040 con 0x55827e0b4850 2024-09-13T19:16:13.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.715+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0ce800 con 0x7f0b4c03e040 2024-09-13T19:16:13.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.716+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.0 v2:172.21.15.53:6800/4021716951 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'14 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b44057030 con 0x7f0b4c03e040 2024-09-13T19:16:13.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.716+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0ce800 con 0x55827e0b4850 2024-09-13T19:16:13.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.717+0000 7f0b595c0640 1 -- 172.21.15.102:0/2309329137 <== osd.3 v2:172.21.15.102:6800/3096737090 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'16 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b54056040 con 0x55827e0b4850 2024-09-13T19:16:13.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.717+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0ce800 con 0x7f0b4c03e040 2024-09-13T19:16:13.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.718+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.0 v2:172.21.15.53:6800/4021716951 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'20 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b44057030 con 0x7f0b4c03e040 2024-09-13T19:16:13.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.718+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0ce800 con 0x7f0b5403d0d0 2024-09-13T19:16:13.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.719+0000 7f0b58dbf640 1 -- 172.21.15.102:0/2309329137 <== osd.2 v2:172.21.15.102:6816/2238176080 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b4c065040 con 0x7f0b5403d0d0 2024-09-13T19:16:13.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.720+0000 7f0a0dfe3640 20 reqs_thread_entry: start 2024-09-13T19:16:13.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.720+0000 7f0b5d126800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:13.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.720+0000 7f0b5d126800 20 Filter name: none 2024-09-13T19:16:13.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.720+0000 7f097f7fe640 20 reqs_thread_entry: start 2024-09-13T19:16:13.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.720+0000 7f0b5d126800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-13T19:16:13.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.720+0000 7f0b5d126800 20 rados->read ofs=0 len=0 2024-09-13T19:16:13.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.720+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55827e0f9860 con 0x7f0b5403d0d0 2024-09-13T19:16:13.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.720+0000 7f0b58dbf640 1 -- 172.21.15.102:0/2309329137 <== osd.2 v2:172.21.15.102:6816/2238176080 18 ==== osd_op_reply(94 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f0b4c065040 con 0x7f0b5403d0d0 2024-09-13T19:16:13.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.720+0000 7f0b5d126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:13.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.720+0000 7f0b5d126800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2024-09-13T19:16:13.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.720+0000 7f0b5d126800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T19:16:13.725 INFO:teuthology.orchestra.run.smithi102.stderr:could not remove user: unable to remove user, user does not exist 2024-09-13T19:16:13.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.721+0000 7f0a0efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:13.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.721+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94018948821264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0c85b0 con 0x55827e0afe40 2024-09-13T19:16:13.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.722+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94018948821264] v34'30 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0b44057030 con 0x55827e0afe40 2024-09-13T19:16:13.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.722+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94018948803312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0bf110 con 0x7f0b5403d0d0 2024-09-13T19:16:13.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.723+0000 7f0b58dbf640 1 -- 172.21.15.102:0/2309329137 <== osd.2 v2:172.21.15.102:6816/2238176080 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94018948803312] v34'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b4c065040 con 0x7f0b5403d0d0 2024-09-13T19:16:13.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.723+0000 7f0b5d126800 20 remove_watcher() i=0 2024-09-13T19:16:13.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.723+0000 7f0b5d126800 2 removed watcher, disabling cache 2024-09-13T19:16:13.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.723+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94018948808592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0bf110 con 0x55827e0afe40 2024-09-13T19:16:13.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.724+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.1 v2:172.21.15.102:6808/2204418452 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94018948808592] v34'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b44057030 con 0x55827e0afe40 2024-09-13T19:16:13.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.724+0000 7f0b5d126800 20 remove_watcher() i=1 2024-09-13T19:16:13.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.724+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94018948813648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0bf110 con 0x55827e0b4850 2024-09-13T19:16:13.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.725+0000 7f0b595c0640 1 -- 172.21.15.102:0/2309329137 <== osd.3 v2:172.21.15.102:6800/3096737090 28 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94018948813648] v34'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b54056040 con 0x55827e0b4850 2024-09-13T19:16:13.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.725+0000 7f0b5d126800 20 remove_watcher() i=2 2024-09-13T19:16:13.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.725+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94018948815952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0bd350 con 0x7f0b5403d0d0 2024-09-13T19:16:13.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.726+0000 7f0b58dbf640 1 -- 172.21.15.102:0/2309329137 <== osd.2 v2:172.21.15.102:6816/2238176080 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94018948815952] v34'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b4c065040 con 0x7f0b5403d0d0 2024-09-13T19:16:13.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.726+0000 7f0b5d126800 20 remove_watcher() i=3 2024-09-13T19:16:13.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.726+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94018948820208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0bf110 con 0x55827e0afe40 2024-09-13T19:16:13.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.727+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.1 v2:172.21.15.102:6808/2204418452 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94018948820208] v34'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b44057030 con 0x55827e0afe40 2024-09-13T19:16:13.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.727+0000 7f0b5d126800 20 remove_watcher() i=4 2024-09-13T19:16:13.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.727+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94018948823760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0bdc50 con 0x7f0b4c03e040 2024-09-13T19:16:13.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.728+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.0 v2:172.21.15.53:6800/4021716951 24 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94018948823760] v34'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b44057030 con 0x7f0b4c03e040 2024-09-13T19:16:13.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.728+0000 7f0b5d126800 20 remove_watcher() i=5 2024-09-13T19:16:13.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.728+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94018948824816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0bd350 con 0x7f0b4c03e040 2024-09-13T19:16:13.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.729+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.0 v2:172.21.15.53:6800/4021716951 25 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94018948824816] v34'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b44057030 con 0x7f0b4c03e040 2024-09-13T19:16:13.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.729+0000 7f0b5d126800 20 remove_watcher() i=6 2024-09-13T19:16:13.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.729+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94018948828704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55827e0bdc50 con 0x7f0b4c03e040 2024-09-13T19:16:13.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.730+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 <== osd.0 v2:172.21.15.53:6800/4021716951 26 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94018948828704] v34'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b44057030 con 0x7f0b4c03e040 2024-09-13T19:16:13.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.730+0000 7f0b5d126800 20 remove_watcher() i=7 2024-09-13T19:16:13.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.730+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f0b4c03e040 msgr2=0x7f0b4c03f430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:13.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.730+0000 7f0b5d126800 1 --2- 172.21.15.102:0/2309329137 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f0b4c03e040 0x7f0b4c03f430 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.731+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55827e0afe40 msgr2=0x55827e0b2300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:13.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.731+0000 7f0b5d126800 1 --2- 172.21.15.102:0/2309329137 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55827e0afe40 0x55827e0b2300 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.731+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f0b5403d0d0 msgr2=0x7f0b5403b850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:13.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.731+0000 7f0b5d126800 1 --2- 172.21.15.102:0/2309329137 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f0b5403d0d0 0x7f0b5403b850 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.731+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55827e0b4850 msgr2=0x55827e0b6c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:13.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.731+0000 7f0b5d126800 1 --2- 172.21.15.102:0/2309329137 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55827e0b4850 0x55827e0b6c40 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.731+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0a24036b40 msgr2=0x7f0a24039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:13.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.731+0000 7f0b5d126800 1 --2- 172.21.15.102:0/2309329137 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0a24036b40 0x7f0a24039000 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c0197f0 tx=0x7f0b4c04d2d0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.731+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55827e09d020 msgr2=0x55827e0a4300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:13.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.731+0000 7f0b53fff640 1 -- 172.21.15.102:0/2309329137 reap_dead start 2024-09-13T19:16:13.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.731+0000 7f0b5d126800 1 --2- 172.21.15.102:0/2309329137 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55827e09d020 0x55827e0a4300 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0b54021fd0 tx=0x7f0b5404cdd0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.731+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 shutdown_connections 2024-09-13T19:16:13.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.731+0000 7f0b5d126800 1 --2- 172.21.15.102:0/2309329137 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55827e09d020 0x55827e0a4300 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.731+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 >> 172.21.15.102:0/2309329137 conn(0x55827e0993d0 msgr2=0x55827e0974a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:13.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.731+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 shutdown_connections 2024-09-13T19:16:13.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.731+0000 7f0b5d126800 1 -- 172.21.15.102:0/2309329137 wait complete. 2024-09-13T19:16:13.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.731+0000 7f0b5d126800 1 -- 172.21.15.102:0/515857454 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0a30036b90 msgr2=0x7f0a30039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:13.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.731+0000 7f0b5d126800 1 --2- 172.21.15.102:0/515857454 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0a30036b90 0x7f0a30039050 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x55827e06aed0 tx=0x7f0b4c04b740 comp rx=0 tx=0).stop 2024-09-13T19:16:13.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.731+0000 7f0b5d126800 1 -- 172.21.15.102:0/515857454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55827e090350 msgr2=0x55827e090770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:13.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.731+0000 7f0b5d126800 1 --2- 172.21.15.102:0/515857454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55827e090350 0x55827e090770 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x55827e06b570 tx=0x7f0b540167b0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.731+0000 7f0b5d126800 1 -- 172.21.15.102:0/515857454 shutdown_connections 2024-09-13T19:16:13.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.731+0000 7f0b5d126800 1 --2- 172.21.15.102:0/515857454 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0a30036b90 0x7f0a30039050 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.731+0000 7f0b5d126800 1 --2- 172.21.15.102:0/515857454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55827e090350 0x55827e090770 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.731+0000 7f0b5d126800 1 -- 172.21.15.102:0/515857454 >> 172.21.15.102:0/515857454 conn(0x55827e0852e0 msgr2=0x55827e087e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:13.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.731+0000 7f0b5d126800 1 -- 172.21.15.102:0/515857454 shutdown_connections 2024-09-13T19:16:13.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.731+0000 7f0b5d126800 1 -- 172.21.15.102:0/515857454 wait complete. 2024-09-13T19:16:13.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.731+0000 7f0b5d126800 1 -- 172.21.15.102:0/2103868006 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55827df7f900 msgr2=0x55827e07c650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:13.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.731+0000 7f0b5d126800 1 --2- 172.21.15.102:0/2103868006 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55827df7f900 0x55827e07c650 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.731+0000 7f0b5d126800 1 -- 172.21.15.102:0/2103868006 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55827e07ee10 msgr2=0x55827e081240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:13.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.731+0000 7f0b5d126800 1 --2- 172.21.15.102:0/2103868006 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55827e07ee10 0x55827e081240 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.732+0000 7f0b5d126800 1 -- 172.21.15.102:0/2103868006 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0a40036b40 msgr2=0x7f0a40039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:13.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.732+0000 7f0b5d126800 1 --2- 172.21.15.102:0/2103868006 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0a40036b40 0x7f0a40039000 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0b44057000 tx=0x7f0b44052000 comp rx=0 tx=0).stop 2024-09-13T19:16:13.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.732+0000 7f0b5d126800 1 -- 172.21.15.102:0/2103868006 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55827df7b4c0 msgr2=0x55827e06bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:13.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.732+0000 7f0b5d126800 1 --2- 172.21.15.102:0/2103868006 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55827df7b4c0 0x55827e06bed0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c000c00 tx=0x7f0b4c000ed0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.732+0000 7f0b5d126800 1 -- 172.21.15.102:0/2103868006 shutdown_connections 2024-09-13T19:16:13.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.732+0000 7f0b5d126800 1 --2- 172.21.15.102:0/2103868006 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55827e07ee10 0x55827e081240 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.732+0000 7f0b5d126800 1 --2- 172.21.15.102:0/2103868006 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55827df7f900 0x55827e07c650 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.732+0000 7f0b5d126800 1 --2- 172.21.15.102:0/2103868006 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0a40036b40 0x7f0a40039000 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.732+0000 7f0b5d126800 1 --2- 172.21.15.102:0/2103868006 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55827df7b4c0 0x55827e06bed0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.732+0000 7f0b5d126800 1 -- 172.21.15.102:0/2103868006 >> 172.21.15.102:0/2103868006 conn(0x55827df76df0 msgr2=0x55827e064a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:13.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.732+0000 7f0b5d126800 1 -- 172.21.15.102:0/2103868006 shutdown_connections 2024-09-13T19:16:13.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.732+0000 7f0b5d126800 1 -- 172.21.15.102:0/2103868006 wait complete. 2024-09-13T19:16:13.744 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T19:16:13.744 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2024-09-13T19:16:13.744 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2024-09-13T19:16:13.744 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2024-09-13T19:16:13.828 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:13.828 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:13.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.824+0000 7f88a6737800 1 Processor -- start 2024-09-13T19:16:13.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.824+0000 7f88a6737800 1 -- start start 2024-09-13T19:16:13.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.825+0000 7f88a6737800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x559b5230a630 0x559b52399250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:13.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.825+0000 7f88a6737800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559b52255b30 con 0x559b52399790 2024-09-13T19:16:13.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.825+0000 7f88a6737800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x559b52237360 con 0x559b5230a630 2024-09-13T19:16:13.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.825+0000 7f88a242b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x559b5230a630 0x559b52399250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:13.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.825+0000 7f8899c2a640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x559b52399790 0x559b5239bb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:49728/0 (socket says 172.21.15.102:49728) 2024-09-13T19:16:13.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.825+0000 7f88a242b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x559b5230a630 0x559b52399250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53552/0 (socket says 172.21.15.102:53552) 2024-09-13T19:16:13.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.825+0000 7f8899c2a640 1 -- 172.21.15.102:0/139690893 learned_addr learned my addr 172.21.15.102:0/139690893 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:16:13.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.825+0000 7f88a242b640 1 -- 172.21.15.102:0/139690893 >> v1:172.21.15.53:6789/0 conn(0x559b52399790 legacy=0x559b5239bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:13.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.825+0000 7f88a242b640 1 -- 172.21.15.102:0/139690893 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b5225de00 con 0x559b5230a630 2024-09-13T19:16:13.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.827+0000 7f88a242b640 1 --2- 172.21.15.102:0/139690893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b5230a630 0x559b52399250 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f889400a470 tx=0x7f8894045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1277b49798040ee3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:13.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.827+0000 7f88a1c2a640 1 -- 172.21.15.102:0/139690893 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8894053570 con 0x559b5230a630 2024-09-13T19:16:13.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.827+0000 7f88a1c2a640 1 -- 172.21.15.102:0/139690893 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8894058070 con 0x559b5230a630 2024-09-13T19:16:13.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.827+0000 7f88a1c2a640 1 -- 172.21.15.102:0/139690893 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8894053880 con 0x559b5230a630 2024-09-13T19:16:13.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.828+0000 7f88a6737800 1 -- 172.21.15.102:0/139690893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b5230a630 msgr2=0x559b52399250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:13.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.828+0000 7f88a6737800 1 --2- 172.21.15.102:0/139690893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b5230a630 0x559b52399250 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f889400a470 tx=0x7f8894045a20 comp rx=0 tx=0).stop 2024-09-13T19:16:13.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.828+0000 7f88a6737800 1 -- 172.21.15.102:0/139690893 shutdown_connections 2024-09-13T19:16:13.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.828+0000 7f88a6737800 1 --2- 172.21.15.102:0/139690893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b5230a630 0x559b52399250 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.828+0000 7f88a6737800 1 -- 172.21.15.102:0/139690893 >> 172.21.15.102:0/139690893 conn(0x559b52390de0 msgr2=0x559b52393200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:13.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.828+0000 7f88a6737800 1 -- 172.21.15.102:0/139690893 shutdown_connections 2024-09-13T19:16:13.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.828+0000 7f88a6737800 1 -- 172.21.15.102:0/139690893 wait complete. 2024-09-13T19:16:13.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.842+0000 7f88a6737800 1 Processor -- start 2024-09-13T19:16:13.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.842+0000 7f88a6737800 1 -- start start 2024-09-13T19:16:13.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.842+0000 7f88a6737800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b5230a630 0x559b52396b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:13.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.842+0000 7f88a6737800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559b522e2330 con 0x559b5230a630 2024-09-13T19:16:13.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.842+0000 7f88a242b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b5230a630 0x559b52396b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:13.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.842+0000 7f88a242b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b5230a630 0x559b52396b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53554/0 (socket says 172.21.15.102:53554) 2024-09-13T19:16:13.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.842+0000 7f88a242b640 1 -- 172.21.15.102:0/1620068710 learned_addr learned my addr 172.21.15.102:0/1620068710 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:13.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.842+0000 7f88a242b640 1 -- 172.21.15.102:0/1620068710 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b5222fbc0 con 0x559b5230a630 2024-09-13T19:16:13.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.843+0000 7f88a242b640 1 --2- 172.21.15.102:0/1620068710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b5230a630 0x559b52396b80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8894025c20 tx=0x7f8894051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=709fffbcee1f5f67 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:13.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.843+0000 7f8790608640 1 -- 172.21.15.102:0/1620068710 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f889405c580 con 0x559b5230a630 2024-09-13T19:16:13.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.843+0000 7f8790608640 1 -- 172.21.15.102:0/1620068710 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8894063030 con 0x559b5230a630 2024-09-13T19:16:13.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.843+0000 7f8790608640 1 -- 172.21.15.102:0/1620068710 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f889405c850 con 0x559b5230a630 2024-09-13T19:16:13.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.844+0000 7f88a6737800 1 -- 172.21.15.102:0/1620068710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b5230a630 msgr2=0x559b52396b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:13.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.844+0000 7f88a6737800 1 --2- 172.21.15.102:0/1620068710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b5230a630 0x559b52396b80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8894025c20 tx=0x7f8894051000 comp rx=0 tx=0).stop 2024-09-13T19:16:13.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.844+0000 7f88a6737800 1 -- 172.21.15.102:0/1620068710 shutdown_connections 2024-09-13T19:16:13.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.844+0000 7f88a6737800 1 --2- 172.21.15.102:0/1620068710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b5230a630 0x559b52396b80 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.844+0000 7f88a6737800 1 -- 172.21.15.102:0/1620068710 >> 172.21.15.102:0/1620068710 conn(0x559b52390de0 msgr2=0x559b52481250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:13.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.844+0000 7f88a6737800 1 -- 172.21.15.102:0/1620068710 shutdown_connections 2024-09-13T19:16:13.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.844+0000 7f88a6737800 1 -- 172.21.15.102:0/1620068710 wait complete. 2024-09-13T19:16:13.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.844+0000 7f88a6737800 1 Processor -- start 2024-09-13T19:16:13.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.844+0000 7f88a6737800 1 -- start start 2024-09-13T19:16:13.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.844+0000 7f88a6737800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b5230a630 0x559b5248f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:13.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.844+0000 7f88a6737800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559b5239d690 con 0x559b5230a630 2024-09-13T19:16:13.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.844+0000 7f88a242b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b5230a630 0x559b5248f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:13.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.844+0000 7f88a242b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b5230a630 0x559b5248f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53560/0 (socket says 172.21.15.102:53560) 2024-09-13T19:16:13.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.844+0000 7f88a242b640 1 -- 172.21.15.102:0/3907593970 learned_addr learned my addr 172.21.15.102:0/3907593970 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:13.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.845+0000 7f88a242b640 1 -- 172.21.15.102:0/3907593970 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b52243fe0 con 0x559b5230a630 2024-09-13T19:16:13.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.845+0000 7f88a242b640 1 --2- 172.21.15.102:0/3907593970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b5230a630 0x559b5248f490 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x559b52396280 tx=0x7f8894002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:13.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.845+0000 7f878ee05640 1 -- 172.21.15.102:0/3907593970 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8894054ad0 con 0x559b5230a630 2024-09-13T19:16:13.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.845+0000 7f878ee05640 1 -- 172.21.15.102:0/3907593970 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8894054c70 con 0x559b5230a630 2024-09-13T19:16:13.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.845+0000 7f88a6737800 1 -- 172.21.15.102:0/3907593970 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559b5248f9d0 con 0x559b5230a630 2024-09-13T19:16:13.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.845+0000 7f878ee05640 1 -- 172.21.15.102:0/3907593970 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8894068420 con 0x559b5230a630 2024-09-13T19:16:13.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.845+0000 7f88a6737800 1 -- 172.21.15.102:0/3907593970 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b5248fef0 con 0x559b5230a630 2024-09-13T19:16:13.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.846+0000 7f878ee05640 1 -- 172.21.15.102:0/3907593970 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f88940685c0 con 0x559b5230a630 2024-09-13T19:16:13.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.846+0000 7f878ee05640 1 --2- 172.21.15.102:0/3907593970 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8788036b90 0x7f8788039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:13.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.846+0000 7f878ee05640 1 -- 172.21.15.102:0/3907593970 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f8894070030 con 0x559b5230a630 2024-09-13T19:16:13.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.846+0000 7f8899c2a640 1 --2- 172.21.15.102:0/3907593970 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8788036b90 0x7f8788039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:13.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.846+0000 7f88a6737800 1 --2- 172.21.15.102:0/3907593970 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x559b52399790 0x559b52496500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:13.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.846+0000 7f88a6737800 1 -- 172.21.15.102:0/3907593970 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559b52496a90 con 0x559b52399790 2024-09-13T19:16:13.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.846+0000 7f88a2c2c640 1 --2- 172.21.15.102:0/3907593970 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x559b52399790 0x559b52496500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:13.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.847+0000 7f8899c2a640 1 --2- 172.21.15.102:0/3907593970 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8788036b90 0x7f8788039050 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f888c000f60 tx=0x7f888c0012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:13.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.847+0000 7f88a2c2c640 1 --2- 172.21.15.102:0/3907593970 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x559b52399790 0x559b52496500 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:13.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.847+0000 7f88a2c2c640 1 -- 172.21.15.102:0/3907593970 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f889c00a4a0 con 0x559b52399790 2024-09-13T19:16:13.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.847+0000 7f88a6737800 1 -- 172.21.15.102:0/3907593970 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559b52493ad0 con 0x559b52399790 2024-09-13T19:16:13.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.847+0000 7f88a2c2c640 1 -- 172.21.15.102:0/3907593970 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f889c00a4a0 con 0x559b52399790 2024-09-13T19:16:13.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.847+0000 7f88a6737800 1 --2- 172.21.15.102:0/3907593970 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x559b52498e30 0x559b5249b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:13.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.847+0000 7f88a6737800 1 -- 172.21.15.102:0/3907593970 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559b5249b910 con 0x559b52498e30 2024-09-13T19:16:13.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.847+0000 7f88a242b640 1 --2- 172.21.15.102:0/3907593970 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x559b52498e30 0x559b5249b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:13.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.848+0000 7f88a242b640 1 --2- 172.21.15.102:0/3907593970 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x559b52498e30 0x559b5249b220 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:13.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.848+0000 7f88a242b640 1 -- 172.21.15.102:0/3907593970 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8894051070 con 0x559b52498e30 2024-09-13T19:16:13.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.848+0000 7f88a6737800 1 -- 172.21.15.102:0/3907593970 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559b52497cd0 con 0x559b52399790 2024-09-13T19:16:13.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.848+0000 7f88a2c2c640 1 -- 172.21.15.102:0/3907593970 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f889c00a4a0 con 0x559b52399790 2024-09-13T19:16:13.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.848+0000 7f88a6737800 1 -- 172.21.15.102:0/3907593970 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559b52498170 con 0x559b52498e30 2024-09-13T19:16:13.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.848+0000 7f88a242b640 1 -- 172.21.15.102:0/3907593970 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8894051070 con 0x559b52498e30 2024-09-13T19:16:13.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.849+0000 7f88a6737800 1 Processor -- start 2024-09-13T19:16:13.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.849+0000 7f88a6737800 1 -- start start 2024-09-13T19:16:13.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.849+0000 7f88a6737800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b524aa210 0x559b524aa630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:13.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.849+0000 7f88a6737800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559b52231580 con 0x559b524aa210 2024-09-13T19:16:13.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.849+0000 7f88a2c2c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b524aa210 0x559b524aa630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:13.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.849+0000 7f88a2c2c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b524aa210 0x559b524aa630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53574/0 (socket says 172.21.15.102:53574) 2024-09-13T19:16:13.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.849+0000 7f88a2c2c640 1 -- 172.21.15.102:0/950053300 learned_addr learned my addr 172.21.15.102:0/950053300 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:13.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.849+0000 7f88a2c2c640 1 -- 172.21.15.102:0/950053300 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b524aab70 con 0x559b524aa210 2024-09-13T19:16:13.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.850+0000 7f88a2c2c640 1 --2- 172.21.15.102:0/950053300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b524aa210 0x559b524aa630 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x559b524906b0 tx=0x7f889c0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:13.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.850+0000 7f8787fff640 1 -- 172.21.15.102:0/950053300 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f889c013640 con 0x559b524aa210 2024-09-13T19:16:13.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.850+0000 7f8787fff640 1 -- 172.21.15.102:0/950053300 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f889c0137e0 con 0x559b524aa210 2024-09-13T19:16:13.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.850+0000 7f88a6737800 1 -- 172.21.15.102:0/950053300 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559b524aae00 con 0x559b524aa210 2024-09-13T19:16:13.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.850+0000 7f8787fff640 1 -- 172.21.15.102:0/950053300 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f889c013ae0 con 0x559b524aa210 2024-09-13T19:16:13.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.850+0000 7f88a6737800 1 -- 172.21.15.102:0/950053300 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b524adae0 con 0x559b524aa210 2024-09-13T19:16:13.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.851+0000 7f8787fff640 1 -- 172.21.15.102:0/950053300 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f889c011040 con 0x559b524aa210 2024-09-13T19:16:13.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.851+0000 7f8787fff640 1 --2- 172.21.15.102:0/950053300 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f877c036b90 0x7f877c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:13.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.851+0000 7f8787fff640 1 -- 172.21.15.102:0/950053300 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f889c00e040 con 0x559b524aa210 2024-09-13T19:16:13.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.851+0000 7f88a242b640 1 --2- 172.21.15.102:0/950053300 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f877c036b90 0x7f877c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:13.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.851+0000 7f88a6737800 1 Processor -- start 2024-09-13T19:16:13.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.851+0000 7f88a6737800 1 -- start start 2024-09-13T19:16:13.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.851+0000 7f88a242b640 1 --2- 172.21.15.102:0/950053300 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f877c036b90 0x7f877c039050 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x559b52497ca0 tx=0x7f8894060ee0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:13.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.851+0000 7f88a6737800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b524b6eb0 0x559b524b72b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:13.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.851+0000 7f88a6737800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559b523951f0 con 0x559b524b6eb0 2024-09-13T19:16:13.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.852+0000 7f88a2c2c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b524b6eb0 0x559b524b72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:13.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.852+0000 7f88a2c2c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b524b6eb0 0x559b524b72b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53578/0 (socket says 172.21.15.102:53578) 2024-09-13T19:16:13.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.852+0000 7f88a2c2c640 1 -- 172.21.15.102:0/3253168720 learned_addr learned my addr 172.21.15.102:0/3253168720 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:13.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.852+0000 7f88a2c2c640 1 -- 172.21.15.102:0/3253168720 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b524b7880 con 0x559b524b6eb0 2024-09-13T19:16:13.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.852+0000 7f88a2c2c640 1 --2- 172.21.15.102:0/3253168720 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b524b6eb0 0x559b524b72b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f889c00b010 tx=0x7f889c020460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad3183fe66de21e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:13.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.852+0000 7f8785ffb640 1 -- 172.21.15.102:0/3253168720 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f889c04e050 con 0x559b524b6eb0 2024-09-13T19:16:13.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.852+0000 7f8785ffb640 1 -- 172.21.15.102:0/3253168720 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f889c014c10 con 0x559b524b6eb0 2024-09-13T19:16:13.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.852+0000 7f8785ffb640 1 -- 172.21.15.102:0/3253168720 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f889c02aa40 con 0x559b524b6eb0 2024-09-13T19:16:13.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.853+0000 7f88a6737800 1 -- 172.21.15.102:0/3253168720 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b524b6eb0 msgr2=0x559b524b72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:13.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.853+0000 7f88a6737800 1 --2- 172.21.15.102:0/3253168720 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b524b6eb0 0x559b524b72b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f889c00b010 tx=0x7f889c020460 comp rx=0 tx=0).stop 2024-09-13T19:16:13.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.853+0000 7f88a6737800 1 -- 172.21.15.102:0/3253168720 shutdown_connections 2024-09-13T19:16:13.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.853+0000 7f88a6737800 1 --2- 172.21.15.102:0/3253168720 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b524b6eb0 0x559b524b72b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.853+0000 7f88a6737800 1 -- 172.21.15.102:0/3253168720 >> 172.21.15.102:0/3253168720 conn(0x559b524b3210 msgr2=0x559b524b1310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:13.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.853+0000 7f88a6737800 1 -- 172.21.15.102:0/3253168720 shutdown_connections 2024-09-13T19:16:13.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.853+0000 7f88a6737800 1 -- 172.21.15.102:0/3253168720 wait complete. 2024-09-13T19:16:13.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.853+0000 7f88a6737800 1 Processor -- start 2024-09-13T19:16:13.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.853+0000 7f88a6737800 1 -- start start 2024-09-13T19:16:13.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.853+0000 7f88a6737800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b524b6eb0 0x559b524be320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:13.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.853+0000 7f88a6737800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559b524b7ef0 con 0x559b524b6eb0 2024-09-13T19:16:13.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.853+0000 7f88a2c2c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b524b6eb0 0x559b524be320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:13.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.853+0000 7f88a2c2c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b524b6eb0 0x559b524be320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53582/0 (socket says 172.21.15.102:53582) 2024-09-13T19:16:13.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.853+0000 7f88a2c2c640 1 -- 172.21.15.102:0/2688497751 learned_addr learned my addr 172.21.15.102:0/2688497751 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:13.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.854+0000 7f88a2c2c640 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b524be860 con 0x559b524b6eb0 2024-09-13T19:16:13.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.854+0000 7f88a2c2c640 1 --2- 172.21.15.102:0/2688497751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b524b6eb0 0x559b524be320 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f889c03f040 tx=0x7f889c04cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:13.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.854+0000 7f8773fff640 1 -- 172.21.15.102:0/2688497751 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f889c02e070 con 0x559b524b6eb0 2024-09-13T19:16:13.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.854+0000 7f8773fff640 1 -- 172.21.15.102:0/2688497751 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f889c029ca0 con 0x559b524b6eb0 2024-09-13T19:16:13.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.854+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559b524beaf0 con 0x559b524b6eb0 2024-09-13T19:16:13.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.854+0000 7f8773fff640 1 -- 172.21.15.102:0/2688497751 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f889c040140 con 0x559b524b6eb0 2024-09-13T19:16:13.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.854+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b524c17a0 con 0x559b524b6eb0 2024-09-13T19:16:13.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.855+0000 7f8773fff640 1 -- 172.21.15.102:0/2688497751 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f889c039060 con 0x559b524b6eb0 2024-09-13T19:16:13.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.855+0000 7f8773fff640 1 --2- 172.21.15.102:0/2688497751 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f876c036b40 0x7f876c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:13.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.855+0000 7f8773fff640 1 -- 172.21.15.102:0/2688497751 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f889c033c40 con 0x559b524b6eb0 2024-09-13T19:16:13.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.855+0000 7f88a242b640 1 --2- 172.21.15.102:0/2688497751 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f876c036b40 0x7f876c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:13.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.855+0000 7f88a242b640 1 --2- 172.21.15.102:0/2688497751 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f876c036b40 0x7f876c039000 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f88940547e0 tx=0x7f8894093000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:13.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.856+0000 7f88a6737800 20 rados->read ofs=0 len=0 2024-09-13T19:16:13.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.856+0000 7f88a6737800 1 --2- 172.21.15.102:0/2688497751 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x559b524c9da0 0x559b524cc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:13.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.856+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559b524cc9b0 con 0x559b524c9da0 2024-09-13T19:16:13.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.856+0000 7f8899c2a640 1 --2- 172.21.15.102:0/2688497751 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x559b524c9da0 0x559b524cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:13.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.856+0000 7f8899c2a640 1 --2- 172.21.15.102:0/2688497751 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x559b524c9da0 0x559b524cc260 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:13.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.856+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f888c009050 con 0x559b524c9da0 2024-09-13T19:16:13.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.856+0000 7f88a6737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:13.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.856+0000 7f88a6737800 20 realm 2024-09-13T19:16:13.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.856+0000 7f88a6737800 20 rados->read ofs=0 len=0 2024-09-13T19:16:13.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.856+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559b524c91f0 con 0x559b524c9da0 2024-09-13T19:16:13.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.856+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f888c009050 con 0x559b524c9da0 2024-09-13T19:16:13.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.856+0000 7f88a6737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:13.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.856+0000 7f88a6737800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:13.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.856+0000 7f88a6737800 20 rados->read ofs=0 len=0 2024-09-13T19:16:13.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.856+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559b524cd4a0 con 0x559b524c9da0 2024-09-13T19:16:13.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.857+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f888c009050 con 0x559b524c9da0 2024-09-13T19:16:13.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.857+0000 7f88a6737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:13.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.857+0000 7f88a6737800 20 rados->read ofs=0 len=0 2024-09-13T19:16:13.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.857+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559b524cdd70 con 0x559b524c9da0 2024-09-13T19:16:13.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.857+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f888c009050 con 0x559b524c9da0 2024-09-13T19:16:13.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.857+0000 7f88a6737800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:13.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.857+0000 7f88a6737800 20 rados->read ofs=0 len=0 2024-09-13T19:16:13.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.857+0000 7f88a6737800 1 --2- 172.21.15.102:0/2688497751 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x559b524ce6b0 0x559b524d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:13.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.857+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559b524d1230 con 0x559b524ce6b0 2024-09-13T19:16:13.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.857+0000 7f88a2c2c640 1 --2- 172.21.15.102:0/2688497751 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x559b524ce6b0 0x559b524d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:13.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.857+0000 7f88a2c2c640 1 --2- 172.21.15.102:0/2688497751 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x559b524ce6b0 0x559b524d0aa0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:13.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.857+0000 7f88a2c2c640 1 -- 172.21.15.102:0/2688497751 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f889c00a4a0 con 0x559b524ce6b0 2024-09-13T19:16:13.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.857+0000 7f88a6737800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:13.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.857+0000 7f88a6737800 20 searching for the correct realm 2024-09-13T19:16:13.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.857+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559b524d2b80 con 0x559b524ce6b0 2024-09-13T19:16:13.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.858+0000 7f88a2c2c640 1 -- 172.21.15.102:0/2688497751 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f889c00a4a0 con 0x559b524ce6b0 2024-09-13T19:16:13.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.858+0000 7f88a2c2c640 1 --2- 172.21.15.102:0/2688497751 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f889c03b070 0x7f889c029540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:13.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.858+0000 7f88a2c2c640 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559b524d2b80 con 0x7f889c03b070 2024-09-13T19:16:13.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.858+0000 7f88a242b640 1 --2- 172.21.15.102:0/2688497751 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f889c03b070 0x7f889c029540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:13.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.858+0000 7f88a242b640 1 --2- 172.21.15.102:0/2688497751 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f889c03b070 0x7f889c029540 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:13.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.858+0000 7f88a242b640 1 -- 172.21.15.102:0/2688497751 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8894051070 con 0x7f889c03b070 2024-09-13T19:16:13.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.858+0000 7f88a242b640 1 --2- 172.21.15.102:0/2688497751 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f889405c070 0x7f8894009640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:13.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.858+0000 7f88a242b640 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559b524d2b80 con 0x7f889405c070 2024-09-13T19:16:13.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.859+0000 7f8899c2a640 1 --2- 172.21.15.102:0/2688497751 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f889405c070 0x7f8894009640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:13.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.859+0000 7f8899c2a640 1 --2- 172.21.15.102:0/2688497751 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f889405c070 0x7f8894009640 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:13.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.859+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f888c009050 con 0x7f889405c070 2024-09-13T19:16:13.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.859+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559b524d2b80 con 0x559b524c9da0 2024-09-13T19:16:13.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.859+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f888c009050 con 0x559b524c9da0 2024-09-13T19:16:13.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.859+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559b524d2b80 con 0x559b524c9da0 2024-09-13T19:16:13.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.860+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f888c029040 con 0x559b524c9da0 2024-09-13T19:16:13.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.860+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559b524d2b80 con 0x7f889405c070 2024-09-13T19:16:13.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.860+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f888c029040 con 0x7f889405c070 2024-09-13T19:16:13.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.860+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559b524d2b80 con 0x7f889405c070 2024-09-13T19:16:13.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.860+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f888c029040 con 0x7f889405c070 2024-09-13T19:16:13.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.860+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559b524d2b80 con 0x7f889c03b070 2024-09-13T19:16:13.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.860+0000 7f88a242b640 1 -- 172.21.15.102:0/2688497751 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8894051070 con 0x7f889c03b070 2024-09-13T19:16:13.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.861+0000 7f88a242b640 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559b524d2b80 con 0x559b524ce6b0 2024-09-13T19:16:13.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.861+0000 7f88a2c2c640 1 -- 172.21.15.102:0/2688497751 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f889c00a4a0 con 0x559b524ce6b0 2024-09-13T19:16:13.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.861+0000 7f88a2c2c640 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559b524d2b80 con 0x559b524c9da0 2024-09-13T19:16:13.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.861+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f888c029040 con 0x559b524c9da0 2024-09-13T19:16:13.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.861+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559b524d2b80 con 0x7f889405c070 2024-09-13T19:16:13.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.861+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f888c029040 con 0x7f889405c070 2024-09-13T19:16:13.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.861+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559b524d2b80 con 0x559b524c9da0 2024-09-13T19:16:13.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.862+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f888c029040 con 0x559b524c9da0 2024-09-13T19:16:13.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.862+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559b524d2b80 con 0x7f889c03b070 2024-09-13T19:16:13.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.862+0000 7f88a242b640 1 -- 172.21.15.102:0/2688497751 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8894051070 con 0x7f889c03b070 2024-09-13T19:16:13.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.862+0000 7f88a242b640 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559b524d2b80 con 0x559b524ce6b0 2024-09-13T19:16:13.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.862+0000 7f88a2c2c640 1 -- 172.21.15.102:0/2688497751 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f889c00a4a0 con 0x559b524ce6b0 2024-09-13T19:16:13.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.862+0000 7f88a2c2c640 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559b524d2b80 con 0x559b524ce6b0 2024-09-13T19:16:13.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.862+0000 7f88a2c2c640 1 -- 172.21.15.102:0/2688497751 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=107b] v27'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f889c00a4a0 con 0x559b524ce6b0 2024-09-13T19:16:13.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.862+0000 7f88a2c2c640 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559b524d2b80 con 0x7f889405c070 2024-09-13T19:16:13.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.863+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f888c029040 con 0x7f889405c070 2024-09-13T19:16:13.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.863+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559b524d2b80 con 0x559b524ce6b0 2024-09-13T19:16:13.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.863+0000 7f88a2c2c640 1 -- 172.21.15.102:0/2688497751 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f889c00a4a0 con 0x559b524ce6b0 2024-09-13T19:16:13.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.863+0000 7f88a2c2c640 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559b524d2b80 con 0x559b524ce6b0 2024-09-13T19:16:13.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.863+0000 7f88a2c2c640 1 -- 172.21.15.102:0/2688497751 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f889c00a4a0 con 0x559b524ce6b0 2024-09-13T19:16:13.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.863+0000 7f88a2c2c640 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559b524d2b80 con 0x559b524c9da0 2024-09-13T19:16:13.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.863+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f888c029040 con 0x559b524c9da0 2024-09-13T19:16:13.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.863+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559b524d2b80 con 0x559b524c9da0 2024-09-13T19:16:13.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.864+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f888c029040 con 0x559b524c9da0 2024-09-13T19:16:13.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.864+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559b524d2b80 con 0x7f889405c070 2024-09-13T19:16:13.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.864+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f888c029040 con 0x7f889405c070 2024-09-13T19:16:13.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.864+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559b524d2b80 con 0x559b524ce6b0 2024-09-13T19:16:13.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.864+0000 7f88a2c2c640 1 -- 172.21.15.102:0/2688497751 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f889c00a4a0 con 0x559b524ce6b0 2024-09-13T19:16:13.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.864+0000 7f88a2c2c640 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559b524d2b80 con 0x7f889c03b070 2024-09-13T19:16:13.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.864+0000 7f88a242b640 1 -- 172.21.15.102:0/2688497751 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8894051070 con 0x7f889c03b070 2024-09-13T19:16:13.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.864+0000 7f88a242b640 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559b524d2b80 con 0x559b524c9da0 2024-09-13T19:16:13.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.865+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f888c029040 con 0x559b524c9da0 2024-09-13T19:16:13.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.865+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559b524d2b80 con 0x7f889405c070 2024-09-13T19:16:13.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.865+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f888c029040 con 0x7f889405c070 2024-09-13T19:16:13.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.865+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559b524d2b80 con 0x559b524ce6b0 2024-09-13T19:16:13.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.865+0000 7f88a2c2c640 1 -- 172.21.15.102:0/2688497751 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f889c00a4a0 con 0x559b524ce6b0 2024-09-13T19:16:13.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.865+0000 7f88a2c2c640 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559b524d2b80 con 0x7f889405c070 2024-09-13T19:16:13.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.866+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f888c029040 con 0x7f889405c070 2024-09-13T19:16:13.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.866+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559b524d2b80 con 0x7f889c03b070 2024-09-13T19:16:13.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.866+0000 7f88a242b640 1 -- 172.21.15.102:0/2688497751 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8894051070 con 0x7f889c03b070 2024-09-13T19:16:13.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.866+0000 7f88a242b640 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559b524d2b80 con 0x559b524ce6b0 2024-09-13T19:16:13.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.866+0000 7f88a2c2c640 1 -- 172.21.15.102:0/2688497751 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f889c00a4a0 con 0x559b524ce6b0 2024-09-13T19:16:13.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.866+0000 7f88a2c2c640 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559b524d2b80 con 0x7f889405c070 2024-09-13T19:16:13.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.866+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f888c029040 con 0x7f889405c070 2024-09-13T19:16:13.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.866+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559b524d2b80 con 0x559b524c9da0 2024-09-13T19:16:13.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.867+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f888c029040 con 0x559b524c9da0 2024-09-13T19:16:13.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.867+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559b524d2b80 con 0x7f889c03b070 2024-09-13T19:16:13.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.867+0000 7f88a242b640 1 -- 172.21.15.102:0/2688497751 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8894051070 con 0x7f889c03b070 2024-09-13T19:16:13.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.867+0000 7f88a6737800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:13.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.867+0000 7f88a6737800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:13.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.867+0000 7f88a6737800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:13.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.867+0000 7f88a6737800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:13.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.867+0000 7f88a6737800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:13.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.867+0000 7f88a6737800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:13.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.867+0000 7f88a6737800 20 rados->read ofs=0 len=0 2024-09-13T19:16:13.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.867+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559b524d1bf0 con 0x559b524c9da0 2024-09-13T19:16:13.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.867+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f888c029040 con 0x559b524c9da0 2024-09-13T19:16:13.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.867+0000 7f88a6737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:13.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.867+0000 7f88a6737800 20 rados->read ofs=0 len=0 2024-09-13T19:16:13.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.867+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559b524d2490 con 0x559b524c9da0 2024-09-13T19:16:13.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.867+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f888c029040 con 0x559b524c9da0 2024-09-13T19:16:13.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.867+0000 7f88a6737800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:13.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.867+0000 7f88a6737800 20 rados->read ofs=0 len=0 2024-09-13T19:16:13.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.867+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559b524d3000 con 0x559b524ce6b0 2024-09-13T19:16:13.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.868+0000 7f88a2c2c640 1 -- 172.21.15.102:0/2688497751 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f889c00a4a0 con 0x559b524ce6b0 2024-09-13T19:16:13.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.868+0000 7f88a6737800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:13.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.868+0000 7f88a6737800 20 zone default found 2024-09-13T19:16:13.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.868+0000 7f88a6737800 4 Realm: () 2024-09-13T19:16:13.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.868+0000 7f88a6737800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:13.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.868+0000 7f88a6737800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:13.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.868+0000 7f88a6737800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:13.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.868+0000 7f88a6737800 20 zonegroup default 2024-09-13T19:16:13.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.868+0000 7f88a6737800 20 rados->read ofs=0 len=0 2024-09-13T19:16:13.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.868+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559b524d3850 con 0x7f889405c070 2024-09-13T19:16:13.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.868+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f888c029040 con 0x7f889405c070 2024-09-13T19:16:13.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.868+0000 7f88a6737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:13.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.868+0000 7f88a6737800 20 rados->read ofs=0 len=0 2024-09-13T19:16:13.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.868+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559b524d55d0 con 0x559b524ce6b0 2024-09-13T19:16:13.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.868+0000 7f88a2c2c640 1 -- 172.21.15.102:0/2688497751 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f889c00a4a0 con 0x559b524ce6b0 2024-09-13T19:16:13.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.868+0000 7f88a6737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:13.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.868+0000 7f88a6737800 20 rados->read ofs=0 len=0 2024-09-13T19:16:13.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.868+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559b524d5a00 con 0x559b524ce6b0 2024-09-13T19:16:13.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.868+0000 7f88a2c2c640 1 -- 172.21.15.102:0/2688497751 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f889c00a4a0 con 0x559b524ce6b0 2024-09-13T19:16:13.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.868+0000 7f88a6737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:13.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.868+0000 7f88a6737800 20 started sync module instance, tier type = 2024-09-13T19:16:13.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.868+0000 7f88a6737800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:13.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.868+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524d4a70 con 0x7f889c03b070 2024-09-13T19:16:13.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.869+0000 7f88a242b640 1 -- 172.21.15.102:0/2688497751 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(44 notify.0 [create] v34'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8894051070 con 0x7f889c03b070 2024-09-13T19:16:13.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.869+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94125589089888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524d6340 con 0x7f889c03b070 2024-09-13T19:16:13.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.869+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524d6b90 con 0x559b524c9da0 2024-09-13T19:16:13.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.870+0000 7f88a242b640 1 -- 172.21.15.102:0/2688497751 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94125589089888] v34'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8894051070 con 0x7f889c03b070 2024-09-13T19:16:13.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.871+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v34'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f888c029040 con 0x559b524c9da0 2024-09-13T19:16:13.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.871+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94125589094032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524d6b90 con 0x559b524c9da0 2024-09-13T19:16:13.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.871+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524d7610 con 0x559b524ce6b0 2024-09-13T19:16:13.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.872+0000 7f88a2c2c640 1 -- 172.21.15.102:0/2688497751 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v34'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f889c00a4a0 con 0x559b524ce6b0 2024-09-13T19:16:13.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.872+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94125589098784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524d7610 con 0x559b524ce6b0 2024-09-13T19:16:13.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.872+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524d8610 con 0x7f889c03b070 2024-09-13T19:16:13.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.872+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94125589094032] v34'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f888c029040 con 0x559b524c9da0 2024-09-13T19:16:13.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.873+0000 7f88a242b640 1 -- 172.21.15.102:0/2688497751 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(50 notify.3 [create] v34'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8894051070 con 0x7f889c03b070 2024-09-13T19:16:13.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.873+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94125589102848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524d85d0 con 0x7f889c03b070 2024-09-13T19:16:13.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.873+0000 7f88a2c2c640 1 -- 172.21.15.102:0/2688497751 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94125589098784] v34'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f889c00a4a0 con 0x559b524ce6b0 2024-09-13T19:16:13.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.873+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524d7a70 con 0x559b524c9da0 2024-09-13T19:16:13.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.874+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v34'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f888c029040 con 0x559b524c9da0 2024-09-13T19:16:13.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.874+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94125589105568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524d85d0 con 0x559b524c9da0 2024-09-13T19:16:13.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.874+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524d9b50 con 0x7f889405c070 2024-09-13T19:16:13.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.875+0000 7f88a242b640 1 -- 172.21.15.102:0/2688497751 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94125589102848] v34'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8894051070 con 0x7f889c03b070 2024-09-13T19:16:13.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.875+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(54 notify.5 [create] v34'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f888c029040 con 0x7f889405c070 2024-09-13T19:16:13.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.875+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94125589096160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524d9b50 con 0x7f889405c070 2024-09-13T19:16:13.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.875+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524da5a0 con 0x7f889405c070 2024-09-13T19:16:13.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.875+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94125589105568] v34'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f888c029040 con 0x559b524c9da0 2024-09-13T19:16:13.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.876+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94125589096160] v34'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f888c029040 con 0x7f889405c070 2024-09-13T19:16:13.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.877+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(56 notify.6 [create] v34'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f888c029040 con 0x7f889405c070 2024-09-13T19:16:13.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.877+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94125589108272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524da0b0 con 0x7f889405c070 2024-09-13T19:16:13.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.877+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524daa70 con 0x7f889405c070 2024-09-13T19:16:13.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.877+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94125589108272] v34'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f888c029040 con 0x7f889405c070 2024-09-13T19:16:13.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.878+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(58 notify.7 [create] v34'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f888c029040 con 0x7f889405c070 2024-09-13T19:16:13.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.878+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94125589106624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524daa70 con 0x7f889405c070 2024-09-13T19:16:13.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.878+0000 7f88a6737800 20 add_watcher() i=0 2024-09-13T19:16:13.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.878+0000 7f88a6737800 20 add_watcher() i=1 2024-09-13T19:16:13.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.878+0000 7f88a6737800 20 add_watcher() i=2 2024-09-13T19:16:13.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.878+0000 7f88a6737800 20 add_watcher() i=3 2024-09-13T19:16:13.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.878+0000 7f88a6737800 20 add_watcher() i=4 2024-09-13T19:16:13.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.878+0000 7f88a6737800 20 add_watcher() i=5 2024-09-13T19:16:13.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.878+0000 7f88a6737800 20 add_watcher() i=6 2024-09-13T19:16:13.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.879+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94125589106624] v34'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f888c029040 con 0x7f889405c070 2024-09-13T19:16:13.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.879+0000 7f88a6737800 20 add_watcher() i=7 2024-09-13T19:16:13.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.879+0000 7f88a6737800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:13.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.879+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559b524ddd60 con 0x559b524c9da0 2024-09-13T19:16:13.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.879+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f888c029040 con 0x559b524c9da0 2024-09-13T19:16:13.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.879+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94125589112624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524db000 con 0x559b524c9da0 2024-09-13T19:16:13.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.880+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94125589112624] v34'31 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f888c029040 con 0x559b524c9da0 2024-09-13T19:16:13.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.880+0000 7f8758fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:13.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.880+0000 7f88a6737800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:13.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.880+0000 7f88a6737800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:13.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.880+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524dd690 con 0x559b524c9da0 2024-09-13T19:16:13.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.881+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f888c029040 con 0x559b524c9da0 2024-09-13T19:16:13.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.881+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524e6f00 con 0x7f889405c070 2024-09-13T19:16:13.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.882+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'11 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f888c029040 con 0x7f889405c070 2024-09-13T19:16:13.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.882+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524e7340 con 0x559b524ce6b0 2024-09-13T19:16:13.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.883+0000 7f88a2c2c640 1 -- 172.21.15.102:0/2688497751 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f889c00a4a0 con 0x559b524ce6b0 2024-09-13T19:16:13.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.883+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524e72c0 con 0x559b524c9da0 2024-09-13T19:16:13.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.884+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'32 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f888c029040 con 0x559b524c9da0 2024-09-13T19:16:13.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.884+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524e7870 con 0x7f889c03b070 2024-09-13T19:16:13.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.885+0000 7f88a242b640 1 -- 172.21.15.102:0/2688497751 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'23 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8894051070 con 0x7f889c03b070 2024-09-13T19:16:13.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.885+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524e7d20 con 0x559b524ce6b0 2024-09-13T19:16:13.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.886+0000 7f88a2c2c640 1 -- 172.21.15.102:0/2688497751 <== osd.3 v2:172.21.15.102:6800/3096737090 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'15 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f889c00a4a0 con 0x559b524ce6b0 2024-09-13T19:16:13.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.886+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524e7d20 con 0x559b524c9da0 2024-09-13T19:16:13.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.888+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f888c029040 con 0x559b524c9da0 2024-09-13T19:16:13.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.888+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524e6490 con 0x7f889405c070 2024-09-13T19:16:13.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.889+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'15 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f888c029040 con 0x7f889405c070 2024-09-13T19:16:13.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.889+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524e6490 con 0x7f889c03b070 2024-09-13T19:16:13.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.890+0000 7f88a242b640 1 -- 172.21.15.102:0/2688497751 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8894051070 con 0x7f889c03b070 2024-09-13T19:16:13.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.890+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524e6490 con 0x559b524ce6b0 2024-09-13T19:16:13.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.891+0000 7f88a2c2c640 1 -- 172.21.15.102:0/2688497751 <== osd.3 v2:172.21.15.102:6800/3096737090 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f889c00a4a0 con 0x559b524ce6b0 2024-09-13T19:16:13.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.891+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524e6490 con 0x7f889c03b070 2024-09-13T19:16:13.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.892+0000 7f88a242b640 1 -- 172.21.15.102:0/2688497751 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'24 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8894051070 con 0x7f889c03b070 2024-09-13T19:16:13.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.892+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524e6490 con 0x7f889405c070 2024-09-13T19:16:13.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.893+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f888c029040 con 0x7f889405c070 2024-09-13T19:16:13.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.893+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524e6490 con 0x7f889c03b070 2024-09-13T19:16:13.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.894+0000 7f88a242b640 1 -- 172.21.15.102:0/2688497751 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8894051070 con 0x7f889c03b070 2024-09-13T19:16:13.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.894+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524e6490 con 0x7f889405c070 2024-09-13T19:16:13.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.895+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.0 v2:172.21.15.53:6800/4021716951 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'21 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f888c029040 con 0x7f889405c070 2024-09-13T19:16:13.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.895+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524e6490 con 0x559b524c9da0 2024-09-13T19:16:13.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.896+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'33 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f888c029040 con 0x559b524c9da0 2024-09-13T19:16:13.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.896+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524e6490 con 0x559b524ce6b0 2024-09-13T19:16:13.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.897+0000 7f88a2c2c640 1 -- 172.21.15.102:0/2688497751 <== osd.3 v2:172.21.15.102:6800/3096737090 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f889c00a4a0 con 0x559b524ce6b0 2024-09-13T19:16:13.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.897+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524e6490 con 0x7f889c03b070 2024-09-13T19:16:13.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.898+0000 7f88a242b640 1 -- 172.21.15.102:0/2688497751 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'25 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8894051070 con 0x7f889c03b070 2024-09-13T19:16:13.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.899+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524e6490 con 0x559b524ce6b0 2024-09-13T19:16:13.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.900+0000 7f88a2c2c640 1 -- 172.21.15.102:0/2688497751 <== osd.3 v2:172.21.15.102:6800/3096737090 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'11 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f889c00a4a0 con 0x559b524ce6b0 2024-09-13T19:16:13.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.900+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524e6490 con 0x559b524c9da0 2024-09-13T19:16:13.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.902+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f888c029040 con 0x559b524c9da0 2024-09-13T19:16:13.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.902+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524e6490 con 0x559b524c9da0 2024-09-13T19:16:13.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.905+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'34 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f888c029040 con 0x559b524c9da0 2024-09-13T19:16:13.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.905+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524e6490 con 0x559b524ce6b0 2024-09-13T19:16:13.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.908+0000 7f88a2c2c640 1 -- 172.21.15.102:0/2688497751 <== osd.3 v2:172.21.15.102:6800/3096737090 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f889c00a4a0 con 0x559b524ce6b0 2024-09-13T19:16:13.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.908+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524e6490 con 0x7f889c03b070 2024-09-13T19:16:13.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.909+0000 7f88a242b640 1 -- 172.21.15.102:0/2688497751 <== osd.2 v2:172.21.15.102:6816/2238176080 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8894051070 con 0x7f889c03b070 2024-09-13T19:16:13.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.909+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524e6490 con 0x559b524ce6b0 2024-09-13T19:16:13.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.910+0000 7f88a2c2c640 1 -- 172.21.15.102:0/2688497751 <== osd.3 v2:172.21.15.102:6800/3096737090 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f889c00a4a0 con 0x559b524ce6b0 2024-09-13T19:16:13.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.910+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524e6490 con 0x559b524ce6b0 2024-09-13T19:16:13.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.911+0000 7f88a2c2c640 1 -- 172.21.15.102:0/2688497751 <== osd.3 v2:172.21.15.102:6800/3096737090 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f889c00a4a0 con 0x559b524ce6b0 2024-09-13T19:16:13.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.911+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524e6490 con 0x559b524ce6b0 2024-09-13T19:16:13.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.912+0000 7f88a2c2c640 1 -- 172.21.15.102:0/2688497751 <== osd.3 v2:172.21.15.102:6800/3096737090 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'7 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f889c00a4a0 con 0x559b524ce6b0 2024-09-13T19:16:13.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.912+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524e6490 con 0x559b524ce6b0 2024-09-13T19:16:13.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.913+0000 7f88a2c2c640 1 -- 172.21.15.102:0/2688497751 <== osd.3 v2:172.21.15.102:6800/3096737090 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'16 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f889c00a4a0 con 0x559b524ce6b0 2024-09-13T19:16:13.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.913+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524e6490 con 0x7f889405c070 2024-09-13T19:16:13.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.914+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.0 v2:172.21.15.53:6800/4021716951 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f888c029040 con 0x7f889405c070 2024-09-13T19:16:13.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.914+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524e6490 con 0x559b524ce6b0 2024-09-13T19:16:13.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.915+0000 7f88a2c2c640 1 -- 172.21.15.102:0/2688497751 <== osd.3 v2:172.21.15.102:6800/3096737090 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f889c00a4a0 con 0x559b524ce6b0 2024-09-13T19:16:13.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.915+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524e6490 con 0x7f889405c070 2024-09-13T19:16:13.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.916+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.0 v2:172.21.15.53:6800/4021716951 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'16 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f888c029040 con 0x7f889405c070 2024-09-13T19:16:13.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.916+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524e6490 con 0x559b524ce6b0 2024-09-13T19:16:13.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.917+0000 7f88a2c2c640 1 -- 172.21.15.102:0/2688497751 <== osd.3 v2:172.21.15.102:6800/3096737090 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'19 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f889c00a4a0 con 0x559b524ce6b0 2024-09-13T19:16:13.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.917+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524e6490 con 0x7f889405c070 2024-09-13T19:16:13.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.918+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.0 v2:172.21.15.53:6800/4021716951 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'22 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f888c029040 con 0x7f889405c070 2024-09-13T19:16:13.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.918+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524e6490 con 0x7f889c03b070 2024-09-13T19:16:13.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.919+0000 7f88a242b640 1 -- 172.21.15.102:0/2688497751 <== osd.2 v2:172.21.15.102:6816/2238176080 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8894051070 con 0x7f889c03b070 2024-09-13T19:16:13.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.919+0000 7f86d37fe640 20 reqs_thread_entry: start 2024-09-13T19:16:13.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.919+0000 7f88a6737800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:13.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.919+0000 7f88a6737800 20 Filter name: none 2024-09-13T19:16:13.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.919+0000 7f86d17fa640 20 reqs_thread_entry: start 2024-09-13T19:16:13.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.919+0000 7f88a6737800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-13T19:16:13.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.919+0000 7f88a6737800 20 rados->read ofs=0 len=0 2024-09-13T19:16:13.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.919+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559b525132b0 con 0x7f889405c070 2024-09-13T19:16:13.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.920+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.0 v2:172.21.15.53:6800/4021716951 24 ==== osd_op_reply(94 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f888c029040 con 0x7f889405c070 2024-09-13T19:16:13.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.920+0000 7f88a6737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:13.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.920+0000 7f88a6737800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-13T19:16:13.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.920+0000 7f88a6737800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-13T19:16:13.925 INFO:teuthology.orchestra.run.smithi102.stderr:could not remove user: unable to remove user, user does not exist 2024-09-13T19:16:13.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.921+0000 7f8758fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:13.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.921+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94125589112624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524e5bf0 con 0x559b524c9da0 2024-09-13T19:16:13.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.922+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94125589112624] v34'35 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f888c029040 con 0x559b524c9da0 2024-09-13T19:16:13.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.922+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94125589089888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524da730 con 0x7f889c03b070 2024-09-13T19:16:13.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.923+0000 7f88a242b640 1 -- 172.21.15.102:0/2688497751 <== osd.2 v2:172.21.15.102:6816/2238176080 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94125589089888] v34'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8894051070 con 0x7f889c03b070 2024-09-13T19:16:13.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.923+0000 7f88a6737800 20 remove_watcher() i=0 2024-09-13T19:16:13.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.923+0000 7f88a6737800 2 removed watcher, disabling cache 2024-09-13T19:16:13.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.923+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94125589094032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524da730 con 0x559b524c9da0 2024-09-13T19:16:13.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.924+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.1 v2:172.21.15.102:6808/2204418452 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94125589094032] v34'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f888c029040 con 0x559b524c9da0 2024-09-13T19:16:13.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.924+0000 7f88a6737800 20 remove_watcher() i=1 2024-09-13T19:16:13.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.924+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94125589098784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524d5e90 con 0x559b524ce6b0 2024-09-13T19:16:13.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.925+0000 7f88a2c2c640 1 -- 172.21.15.102:0/2688497751 <== osd.3 v2:172.21.15.102:6800/3096737090 28 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94125589098784] v34'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f889c00a4a0 con 0x559b524ce6b0 2024-09-13T19:16:13.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.925+0000 7f88a6737800 20 remove_watcher() i=2 2024-09-13T19:16:13.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.925+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94125589102848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524da730 con 0x7f889c03b070 2024-09-13T19:16:13.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.926+0000 7f88a242b640 1 -- 172.21.15.102:0/2688497751 <== osd.2 v2:172.21.15.102:6816/2238176080 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94125589102848] v34'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8894051070 con 0x7f889c03b070 2024-09-13T19:16:13.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.926+0000 7f88a6737800 20 remove_watcher() i=3 2024-09-13T19:16:13.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.926+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94125589105568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524d7120 con 0x559b524c9da0 2024-09-13T19:16:13.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.927+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.1 v2:172.21.15.102:6808/2204418452 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94125589105568] v34'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f888c029040 con 0x559b524c9da0 2024-09-13T19:16:13.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.927+0000 7f88a6737800 20 remove_watcher() i=4 2024-09-13T19:16:13.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.927+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94125589096160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524da730 con 0x7f889405c070 2024-09-13T19:16:13.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.928+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.0 v2:172.21.15.53:6800/4021716951 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94125589096160] v34'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f888c029040 con 0x7f889405c070 2024-09-13T19:16:13.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.928+0000 7f88a6737800 20 remove_watcher() i=5 2024-09-13T19:16:13.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.928+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94125589108272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524d8ba0 con 0x7f889405c070 2024-09-13T19:16:13.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.929+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.0 v2:172.21.15.53:6800/4021716951 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94125589108272] v34'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f888c029040 con 0x7f889405c070 2024-09-13T19:16:13.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.929+0000 7f88a6737800 20 remove_watcher() i=6 2024-09-13T19:16:13.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.929+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94125589106624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559b524d7120 con 0x7f889405c070 2024-09-13T19:16:13.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.930+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 <== osd.0 v2:172.21.15.53:6800/4021716951 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94125589106624] v34'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f888c029040 con 0x7f889405c070 2024-09-13T19:16:13.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.930+0000 7f88a6737800 20 remove_watcher() i=7 2024-09-13T19:16:13.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.930+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f889405c070 msgr2=0x7f8894009640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:13.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.930+0000 7f88a6737800 1 --2- 172.21.15.102:0/2688497751 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f889405c070 0x7f8894009640 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.930+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x559b524c9da0 msgr2=0x559b524cc260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:13.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.930+0000 7f88a6737800 1 --2- 172.21.15.102:0/2688497751 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x559b524c9da0 0x559b524cc260 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.930+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f889c03b070 msgr2=0x7f889c029540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:13.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.930+0000 7f88a6737800 1 --2- 172.21.15.102:0/2688497751 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f889c03b070 0x7f889c029540 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.930+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x559b524ce6b0 msgr2=0x559b524d0aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:13.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.930+0000 7f88a6737800 1 --2- 172.21.15.102:0/2688497751 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x559b524ce6b0 0x559b524d0aa0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.930+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f876c036b40 msgr2=0x7f876c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:13.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.930+0000 7f88a6737800 1 --2- 172.21.15.102:0/2688497751 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f876c036b40 0x7f876c039000 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f88940547e0 tx=0x7f8894093000 comp rx=0 tx=0).stop 2024-09-13T19:16:13.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.930+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b524b6eb0 msgr2=0x559b524be320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:13.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.930+0000 7f8899c2a640 1 -- 172.21.15.102:0/2688497751 reap_dead start 2024-09-13T19:16:13.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.930+0000 7f88a6737800 1 --2- 172.21.15.102:0/2688497751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b524b6eb0 0x559b524be320 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f889c03f040 tx=0x7f889c04cd30 comp rx=0 tx=0).stop 2024-09-13T19:16:13.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.930+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 shutdown_connections 2024-09-13T19:16:13.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.930+0000 7f88a6737800 1 --2- 172.21.15.102:0/2688497751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b524b6eb0 0x559b524be320 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.930+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 >> 172.21.15.102:0/2688497751 conn(0x559b524b3210 msgr2=0x559b524b12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:13.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.930+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 shutdown_connections 2024-09-13T19:16:13.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.930+0000 7f88a6737800 1 -- 172.21.15.102:0/2688497751 wait complete. 2024-09-13T19:16:13.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.930+0000 7f88a6737800 1 -- 172.21.15.102:0/950053300 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f877c036b90 msgr2=0x7f877c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:13.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.930+0000 7f88a6737800 1 --2- 172.21.15.102:0/950053300 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f877c036b90 0x7f877c039050 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x559b52497ca0 tx=0x7f8894060ee0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.930+0000 7f88a6737800 1 -- 172.21.15.102:0/950053300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b524aa210 msgr2=0x559b524aa630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:13.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.930+0000 7f88a6737800 1 --2- 172.21.15.102:0/950053300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b524aa210 0x559b524aa630 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x559b524906b0 tx=0x7f889c0167b0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.930+0000 7f88a6737800 1 -- 172.21.15.102:0/950053300 shutdown_connections 2024-09-13T19:16:13.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.930+0000 7f88a6737800 1 --2- 172.21.15.102:0/950053300 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f877c036b90 0x7f877c039050 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.930+0000 7f88a6737800 1 --2- 172.21.15.102:0/950053300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b524aa210 0x559b524aa630 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.930+0000 7f88a6737800 1 -- 172.21.15.102:0/950053300 >> 172.21.15.102:0/950053300 conn(0x559b5249f1a0 msgr2=0x559b524a1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:13.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.931+0000 7f88a6737800 1 -- 172.21.15.102:0/950053300 shutdown_connections 2024-09-13T19:16:13.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.931+0000 7f88a6737800 1 -- 172.21.15.102:0/950053300 wait complete. 2024-09-13T19:16:13.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.931+0000 7f88a6737800 1 -- 172.21.15.102:0/3907593970 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x559b52399790 msgr2=0x559b52496500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:13.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.931+0000 7f88a6737800 1 --2- 172.21.15.102:0/3907593970 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x559b52399790 0x559b52496500 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.931+0000 7f88a6737800 1 -- 172.21.15.102:0/3907593970 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x559b52498e30 msgr2=0x559b5249b220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:13.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.931+0000 7f88a6737800 1 --2- 172.21.15.102:0/3907593970 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x559b52498e30 0x559b5249b220 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.931+0000 7f88a6737800 1 -- 172.21.15.102:0/3907593970 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8788036b90 msgr2=0x7f8788039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:13.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.931+0000 7f88a6737800 1 --2- 172.21.15.102:0/3907593970 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8788036b90 0x7f8788039050 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f888c000f60 tx=0x7f888c0012b0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.931+0000 7f88a6737800 1 -- 172.21.15.102:0/3907593970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b5230a630 msgr2=0x559b5248f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:13.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.931+0000 7f88a6737800 1 --2- 172.21.15.102:0/3907593970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b5230a630 0x559b5248f490 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x559b52396280 tx=0x7f8894002fb0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.931+0000 7f88a6737800 1 -- 172.21.15.102:0/3907593970 shutdown_connections 2024-09-13T19:16:13.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.931+0000 7f88a6737800 1 --2- 172.21.15.102:0/3907593970 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x559b52498e30 0x559b5249b220 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.931+0000 7f88a6737800 1 --2- 172.21.15.102:0/3907593970 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x559b52399790 0x559b52496500 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.931+0000 7f88a6737800 1 --2- 172.21.15.102:0/3907593970 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8788036b90 0x7f8788039050 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.931+0000 7f88a6737800 1 --2- 172.21.15.102:0/3907593970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b5230a630 0x559b5248f490 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.931+0000 7f88a6737800 1 -- 172.21.15.102:0/3907593970 >> 172.21.15.102:0/3907593970 conn(0x559b52390de0 msgr2=0x559b52480e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:13.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.931+0000 7f88a6737800 1 -- 172.21.15.102:0/3907593970 shutdown_connections 2024-09-13T19:16:13.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.931+0000 7f88a6737800 1 -- 172.21.15.102:0/3907593970 wait complete. 2024-09-13T19:16:13.943 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T19:16:13.944 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-13T19:16:13.944 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-13T19:16:13.944 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-13T19:16:13.989 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:13.989 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:13.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.985+0000 7f1dbdf21800 1 Processor -- start 2024-09-13T19:16:13.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.985+0000 7f1dbdf21800 1 -- start start 2024-09-13T19:16:13.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.985+0000 7f1dbdf21800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55e93844b990 0x55e93844bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:13.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.985+0000 7f1dbdf21800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e93830cb30 con 0x55e93844c2d0 2024-09-13T19:16:13.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.986+0000 7f1dbdf21800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55e9382ee360 con 0x55e93844b990 2024-09-13T19:16:13.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.986+0000 7f1db9cac640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55e93844b990 0x55e93844bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:13.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.986+0000 7f1db94ab640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55e93844c2d0 0x55e938452af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:49744/0 (socket says 172.21.15.102:49744) 2024-09-13T19:16:13.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.986+0000 7f1db94ab640 1 -- 172.21.15.102:0/3141414685 learned_addr learned my addr 172.21.15.102:0/3141414685 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:16:13.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.986+0000 7f1db9cac640 1 -- 172.21.15.102:0/3141414685 >> v1:172.21.15.53:6789/0 conn(0x55e93844c2d0 legacy=0x55e938452af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:13.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.986+0000 7f1db9cac640 1 -- 172.21.15.102:0/3141414685 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e938314e00 con 0x55e93844b990 2024-09-13T19:16:13.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.988+0000 7f1db9cac640 1 --2- 172.21.15.102:0/3141414685 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e93844b990 0x55e93844bd90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1dac00a470 tx=0x7f1dac045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef902eee87b5644f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:13.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.988+0000 7f1db8caa640 1 -- 172.21.15.102:0/3141414685 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1dac053570 con 0x55e93844b990 2024-09-13T19:16:13.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.988+0000 7f1db8caa640 1 -- 172.21.15.102:0/3141414685 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dac058070 con 0x55e93844b990 2024-09-13T19:16:13.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.988+0000 7f1db8caa640 1 -- 172.21.15.102:0/3141414685 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1dac053880 con 0x55e93844b990 2024-09-13T19:16:13.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.989+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3141414685 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e93844b990 msgr2=0x55e93844bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:13.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.989+0000 7f1dbdf21800 1 --2- 172.21.15.102:0/3141414685 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e93844b990 0x55e93844bd90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1dac00a470 tx=0x7f1dac045a20 comp rx=0 tx=0).stop 2024-09-13T19:16:13.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.989+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3141414685 shutdown_connections 2024-09-13T19:16:13.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.989+0000 7f1dbdf21800 1 --2- 172.21.15.102:0/3141414685 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e93844b990 0x55e93844bd90 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:13.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.989+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3141414685 >> 172.21.15.102:0/3141414685 conn(0x55e9384475c0 msgr2=0x55e9384499e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:13.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.989+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3141414685 shutdown_connections 2024-09-13T19:16:13.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:13.989+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3141414685 wait complete. 2024-09-13T19:16:14.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.002+0000 7f1dbdf21800 1 Processor -- start 2024-09-13T19:16:14.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.002+0000 7f1dbdf21800 1 -- start start 2024-09-13T19:16:14.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.002+0000 7f1dbdf21800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e93844b990 0x55e93844e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.002+0000 7f1dbdf21800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e938399330 con 0x55e93844b990 2024-09-13T19:16:14.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.003+0000 7f1db9cac640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e93844b990 0x55e93844e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.003+0000 7f1db9cac640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e93844b990 0x55e93844e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53604/0 (socket says 172.21.15.102:53604) 2024-09-13T19:16:14.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.003+0000 7f1db9cac640 1 -- 172.21.15.102:0/4174940429 learned_addr learned my addr 172.21.15.102:0/4174940429 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:14.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.003+0000 7f1db9cac640 1 -- 172.21.15.102:0/4174940429 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9382e6bc0 con 0x55e93844b990 2024-09-13T19:16:14.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.003+0000 7f1db9cac640 1 --2- 172.21.15.102:0/4174940429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e93844b990 0x55e93844e350 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1dac025c20 tx=0x7f1dac051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eccd51e5844e99f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.003+0000 7f1ca7e07640 1 -- 172.21.15.102:0/4174940429 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1dac053ba0 con 0x55e93844b990 2024-09-13T19:16:14.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.003+0000 7f1ca7e07640 1 -- 172.21.15.102:0/4174940429 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dac063030 con 0x55e93844b990 2024-09-13T19:16:14.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.003+0000 7f1ca7e07640 1 -- 172.21.15.102:0/4174940429 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1dac053440 con 0x55e93844b990 2024-09-13T19:16:14.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.004+0000 7f1dbdf21800 1 -- 172.21.15.102:0/4174940429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e93844b990 msgr2=0x55e93844e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.004+0000 7f1dbdf21800 1 --2- 172.21.15.102:0/4174940429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e93844b990 0x55e93844e350 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1dac025c20 tx=0x7f1dac051000 comp rx=0 tx=0).stop 2024-09-13T19:16:14.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.004+0000 7f1dbdf21800 1 -- 172.21.15.102:0/4174940429 shutdown_connections 2024-09-13T19:16:14.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.004+0000 7f1dbdf21800 1 --2- 172.21.15.102:0/4174940429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e93844b990 0x55e93844e350 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.004+0000 7f1dbdf21800 1 -- 172.21.15.102:0/4174940429 >> 172.21.15.102:0/4174940429 conn(0x55e9384475c0 msgr2=0x55e938538230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:14.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.004+0000 7f1dbdf21800 1 -- 172.21.15.102:0/4174940429 shutdown_connections 2024-09-13T19:16:14.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.004+0000 7f1dbdf21800 1 -- 172.21.15.102:0/4174940429 wait complete. 2024-09-13T19:16:14.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.004+0000 7f1dbdf21800 1 Processor -- start 2024-09-13T19:16:14.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.004+0000 7f1dbdf21800 1 -- start start 2024-09-13T19:16:14.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.005+0000 7f1dbdf21800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e93844c2d0 0x55e9385464c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.005+0000 7f1dbdf21800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e938454650 con 0x55e93844c2d0 2024-09-13T19:16:14.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.005+0000 7f1db9cac640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e93844c2d0 0x55e9385464c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.005+0000 7f1db9cac640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e93844c2d0 0x55e9385464c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53606/0 (socket says 172.21.15.102:53606) 2024-09-13T19:16:14.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.005+0000 7f1db9cac640 1 -- 172.21.15.102:0/3576710063 learned_addr learned my addr 172.21.15.102:0/3576710063 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:14.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.005+0000 7f1db9cac640 1 -- 172.21.15.102:0/3576710063 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9382fafe0 con 0x55e93844c2d0 2024-09-13T19:16:14.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.005+0000 7f1db9cac640 1 --2- 172.21.15.102:0/3576710063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e93844c2d0 0x55e9385464c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x55e93844da50 tx=0x7f1dac002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.005+0000 7f1ca6604640 1 -- 172.21.15.102:0/3576710063 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1dac078070 con 0x55e93844c2d0 2024-09-13T19:16:14.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.005+0000 7f1ca6604640 1 -- 172.21.15.102:0/3576710063 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dac053440 con 0x55e93844c2d0 2024-09-13T19:16:14.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.005+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3576710063 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e938546a00 con 0x55e93844c2d0 2024-09-13T19:16:14.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.005+0000 7f1ca6604640 1 -- 172.21.15.102:0/3576710063 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1dac053720 con 0x55e93844c2d0 2024-09-13T19:16:14.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.006+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3576710063 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e938546f80 con 0x55e93844c2d0 2024-09-13T19:16:14.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.006+0000 7f1ca6604640 1 -- 172.21.15.102:0/3576710063 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1dac07b070 con 0x55e93844c2d0 2024-09-13T19:16:14.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.006+0000 7f1ca6604640 1 --2- 172.21.15.102:0/3576710063 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f1ca0036b40 0x7f1ca0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.007+0000 7f1ca6604640 1 -- 172.21.15.102:0/3576710063 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f1dac070070 con 0x55e93844c2d0 2024-09-13T19:16:14.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.007+0000 7f1db94ab640 1 --2- 172.21.15.102:0/3576710063 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f1ca0036b40 0x7f1ca0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.007+0000 7f1dbdf21800 1 --2- 172.21.15.102:0/3576710063 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e93854b520 0x55e93854d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.007+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3576710063 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e93854df30 con 0x55e93854b520 2024-09-13T19:16:14.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.007+0000 7f1dba4ad640 1 --2- 172.21.15.102:0/3576710063 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e93854b520 0x55e93854d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.007+0000 7f1db94ab640 1 --2- 172.21.15.102:0/3576710063 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f1ca0036b40 0x7f1ca0039000 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1db0000f60 tx=0x7f1db00012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.007+0000 7f1dba4ad640 1 --2- 172.21.15.102:0/3576710063 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e93854b520 0x55e93854d910 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.007+0000 7f1dba4ad640 1 -- 172.21.15.102:0/3576710063 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1db400a4a0 con 0x55e93854b520 2024-09-13T19:16:14.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.007+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3576710063 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e93854ab00 con 0x55e93854b520 2024-09-13T19:16:14.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.008+0000 7f1dba4ad640 1 -- 172.21.15.102:0/3576710063 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1db400a4a0 con 0x55e93854b520 2024-09-13T19:16:14.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.008+0000 7f1dbdf21800 1 --2- 172.21.15.102:0/3576710063 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e938550280 0x55e938552670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.008+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3576710063 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e938552d60 con 0x55e938550280 2024-09-13T19:16:14.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.008+0000 7f1db9cac640 1 --2- 172.21.15.102:0/3576710063 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e938550280 0x55e938552670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.008+0000 7f1db9cac640 1 --2- 172.21.15.102:0/3576710063 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e938550280 0x55e938552670 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.008+0000 7f1db9cac640 1 -- 172.21.15.102:0/3576710063 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1dac07a030 con 0x55e938550280 2024-09-13T19:16:14.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.008+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3576710063 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e93854f120 con 0x55e93854b520 2024-09-13T19:16:14.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.009+0000 7f1dba4ad640 1 -- 172.21.15.102:0/3576710063 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1db400a4a0 con 0x55e93854b520 2024-09-13T19:16:14.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.009+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3576710063 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e93854f600 con 0x55e938550280 2024-09-13T19:16:14.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.009+0000 7f1db9cac640 1 -- 172.21.15.102:0/3576710063 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1dac07a030 con 0x55e938550280 2024-09-13T19:16:14.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.009+0000 7f1dbdf21800 1 Processor -- start 2024-09-13T19:16:14.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.009+0000 7f1dbdf21800 1 -- start start 2024-09-13T19:16:14.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.009+0000 7f1dbdf21800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e938561740 0x55e938561b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.009+0000 7f1dbdf21800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e9382e8580 con 0x55e938561740 2024-09-13T19:16:14.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.010+0000 7f1dba4ad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e938561740 0x55e938561b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.010+0000 7f1dba4ad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e938561740 0x55e938561b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53610/0 (socket says 172.21.15.102:53610) 2024-09-13T19:16:14.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.010+0000 7f1dba4ad640 1 -- 172.21.15.102:0/2185495538 learned_addr learned my addr 172.21.15.102:0/2185495538 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:14.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.010+0000 7f1dba4ad640 1 -- 172.21.15.102:0/2185495538 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9385620a0 con 0x55e938561740 2024-09-13T19:16:14.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.010+0000 7f1dba4ad640 1 --2- 172.21.15.102:0/2185495538 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e938561740 0x55e938561b60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x55e93854e330 tx=0x7f1db40163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.010+0000 7f1c9f7fe640 1 -- 172.21.15.102:0/2185495538 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1db4013450 con 0x55e938561740 2024-09-13T19:16:14.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.010+0000 7f1c9f7fe640 1 -- 172.21.15.102:0/2185495538 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1db40135f0 con 0x55e938561740 2024-09-13T19:16:14.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.010+0000 7f1c9f7fe640 1 -- 172.21.15.102:0/2185495538 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1db40138d0 con 0x55e938561740 2024-09-13T19:16:14.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.010+0000 7f1dbdf21800 1 -- 172.21.15.102:0/2185495538 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e938562330 con 0x55e938561740 2024-09-13T19:16:14.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.010+0000 7f1dbdf21800 1 -- 172.21.15.102:0/2185495538 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e938565010 con 0x55e938561740 2024-09-13T19:16:14.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.011+0000 7f1c9f7fe640 1 -- 172.21.15.102:0/2185495538 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1db4011040 con 0x55e938561740 2024-09-13T19:16:14.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.011+0000 7f1c9f7fe640 1 --2- 172.21.15.102:0/2185495538 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f1c94036b40 0x7f1c94039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.011+0000 7f1c9f7fe640 1 -- 172.21.15.102:0/2185495538 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f1db400e040 con 0x55e938561740 2024-09-13T19:16:14.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.011+0000 7f1db9cac640 1 --2- 172.21.15.102:0/2185495538 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f1c94036b40 0x7f1c94039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.012+0000 7f1dbdf21800 1 Processor -- start 2024-09-13T19:16:14.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.012+0000 7f1db9cac640 1 --2- 172.21.15.102:0/2185495538 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f1c94036b40 0x7f1c94039000 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x55e93854e830 tx=0x7f1dac08eb20 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.012+0000 7f1dbdf21800 1 -- start start 2024-09-13T19:16:14.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.012+0000 7f1dbdf21800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e93856e470 0x55e93856e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.012+0000 7f1dbdf21800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e93844c9c0 con 0x55e93856e470 2024-09-13T19:16:14.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.012+0000 7f1dba4ad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e93856e470 0x55e93856e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.012+0000 7f1dba4ad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e93856e470 0x55e93856e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53620/0 (socket says 172.21.15.102:53620) 2024-09-13T19:16:14.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.012+0000 7f1dba4ad640 1 -- 172.21.15.102:0/3891707778 learned_addr learned my addr 172.21.15.102:0/3891707778 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:14.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.012+0000 7f1dba4ad640 1 -- 172.21.15.102:0/3891707778 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e93856ee40 con 0x55e93856e470 2024-09-13T19:16:14.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.012+0000 7f1dba4ad640 1 --2- 172.21.15.102:0/3891707778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e93856e470 0x55e93856e870 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1db404cdd0 tx=0x7f1db4014ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1f231221f2a01ab server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.013+0000 7f1c9d7fa640 1 -- 172.21.15.102:0/3891707778 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1db401f390 con 0x55e93856e470 2024-09-13T19:16:14.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.013+0000 7f1c9d7fa640 1 -- 172.21.15.102:0/3891707778 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1db4012cb0 con 0x55e93856e470 2024-09-13T19:16:14.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.013+0000 7f1c9d7fa640 1 -- 172.21.15.102:0/3891707778 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1db401f530 con 0x55e93856e470 2024-09-13T19:16:14.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.013+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3891707778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e93856e470 msgr2=0x55e93856e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.013+0000 7f1dbdf21800 1 --2- 172.21.15.102:0/3891707778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e93856e470 0x55e93856e870 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1db404cdd0 tx=0x7f1db4014ae0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.013+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3891707778 shutdown_connections 2024-09-13T19:16:14.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.013+0000 7f1dbdf21800 1 --2- 172.21.15.102:0/3891707778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e93856e470 0x55e93856e870 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.013+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3891707778 >> 172.21.15.102:0/3891707778 conn(0x55e93856a810 msgr2=0x55e938568910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:14.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.013+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3891707778 shutdown_connections 2024-09-13T19:16:14.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.013+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3891707778 wait complete. 2024-09-13T19:16:14.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.013+0000 7f1dbdf21800 1 Processor -- start 2024-09-13T19:16:14.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.013+0000 7f1dbdf21800 1 -- start start 2024-09-13T19:16:14.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.013+0000 7f1dbdf21800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e93856e470 0x55e9385758c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.013+0000 7f1dbdf21800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e93856f460 con 0x55e93856e470 2024-09-13T19:16:14.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.014+0000 7f1dba4ad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e93856e470 0x55e9385758c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.014+0000 7f1dba4ad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e93856e470 0x55e9385758c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53628/0 (socket says 172.21.15.102:53628) 2024-09-13T19:16:14.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.014+0000 7f1dba4ad640 1 -- 172.21.15.102:0/3091870218 learned_addr learned my addr 172.21.15.102:0/3091870218 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:14.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.014+0000 7f1dba4ad640 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e938575e00 con 0x55e93856e470 2024-09-13T19:16:14.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.014+0000 7f1dba4ad640 1 --2- 172.21.15.102:0/3091870218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e93856e470 0x55e9385758c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x55e938569500 tx=0x7f1db404cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.014+0000 7f1c8b7fe640 1 -- 172.21.15.102:0/3091870218 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1db4039020 con 0x55e93856e470 2024-09-13T19:16:14.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.014+0000 7f1c8b7fe640 1 -- 172.21.15.102:0/3091870218 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1db401f990 con 0x55e93856e470 2024-09-13T19:16:14.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.014+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e938576090 con 0x55e93856e470 2024-09-13T19:16:14.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.014+0000 7f1c8b7fe640 1 -- 172.21.15.102:0/3091870218 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1db4030040 con 0x55e93856e470 2024-09-13T19:16:14.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.014+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e938578d40 con 0x55e93856e470 2024-09-13T19:16:14.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.015+0000 7f1c8b7fe640 1 -- 172.21.15.102:0/3091870218 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1db403c020 con 0x55e93856e470 2024-09-13T19:16:14.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.015+0000 7f1c8b7fe640 1 --2- 172.21.15.102:0/3091870218 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f1c84036b90 0x7f1c84039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.015+0000 7f1c8b7fe640 1 -- 172.21.15.102:0/3091870218 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f1db403fc40 con 0x55e93856e470 2024-09-13T19:16:14.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.015+0000 7f1db9cac640 1 --2- 172.21.15.102:0/3091870218 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f1c84036b90 0x7f1c84039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.016+0000 7f1db9cac640 1 --2- 172.21.15.102:0/3091870218 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f1c84036b90 0x7f1c84039050 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x55e93854e400 tx=0x7f1dac083000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.016+0000 7f1dbdf21800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.016+0000 7f1dbdf21800 1 --2- 172.21.15.102:0/3091870218 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e9385815c0 0x55e938583a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.016+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e9385841d0 con 0x55e9385815c0 2024-09-13T19:16:14.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.016+0000 7f1db94ab640 1 --2- 172.21.15.102:0/3091870218 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e9385815c0 0x55e938583a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.016+0000 7f1db94ab640 1 --2- 172.21.15.102:0/3091870218 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e9385815c0 0x55e938583a80 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.017+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1db0009050 con 0x55e9385815c0 2024-09-13T19:16:14.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.017+0000 7f1dbdf21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:14.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.017+0000 7f1dbdf21800 20 realm 2024-09-13T19:16:14.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.017+0000 7f1dbdf21800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.017+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e938580a10 con 0x55e9385815c0 2024-09-13T19:16:14.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.017+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1db0009050 con 0x55e9385815c0 2024-09-13T19:16:14.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.017+0000 7f1dbdf21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:14.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.017+0000 7f1dbdf21800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:14.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.017+0000 7f1dbdf21800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.017+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e938584cc0 con 0x55e9385815c0 2024-09-13T19:16:14.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.017+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1db0009050 con 0x55e9385815c0 2024-09-13T19:16:14.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.017+0000 7f1dbdf21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:14.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.017+0000 7f1dbdf21800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.017+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e938585590 con 0x55e9385815c0 2024-09-13T19:16:14.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.017+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1db0009050 con 0x55e9385815c0 2024-09-13T19:16:14.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.017+0000 7f1dbdf21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:14.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.017+0000 7f1dbdf21800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.017+0000 7f1dbdf21800 1 --2- 172.21.15.102:0/3091870218 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e938585ed0 0x55e9385882c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.017+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e938588a50 con 0x55e938585ed0 2024-09-13T19:16:14.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.017+0000 7f1dba4ad640 1 --2- 172.21.15.102:0/3091870218 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e938585ed0 0x55e9385882c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.018+0000 7f1dba4ad640 1 --2- 172.21.15.102:0/3091870218 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e938585ed0 0x55e9385882c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.018+0000 7f1dba4ad640 1 -- 172.21.15.102:0/3091870218 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1db4033040 con 0x55e938585ed0 2024-09-13T19:16:14.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.018+0000 7f1dbdf21800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:14.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.018+0000 7f1dbdf21800 20 searching for the correct realm 2024-09-13T19:16:14.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.018+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e93858a380 con 0x55e938585ed0 2024-09-13T19:16:14.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.018+0000 7f1dba4ad640 1 -- 172.21.15.102:0/3091870218 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1db4033040 con 0x55e938585ed0 2024-09-13T19:16:14.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.018+0000 7f1dba4ad640 1 --2- 172.21.15.102:0/3091870218 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f1db403e020 0x7f1db40123b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.018+0000 7f1dba4ad640 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e93858a380 con 0x7f1db403e020 2024-09-13T19:16:14.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.018+0000 7f1db9cac640 1 --2- 172.21.15.102:0/3091870218 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f1db403e020 0x7f1db40123b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.019+0000 7f1db9cac640 1 --2- 172.21.15.102:0/3091870218 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f1db403e020 0x7f1db40123b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.019+0000 7f1db9cac640 1 -- 172.21.15.102:0/3091870218 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1dac08b040 con 0x7f1db403e020 2024-09-13T19:16:14.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.019+0000 7f1db9cac640 1 --2- 172.21.15.102:0/3091870218 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f1dac07d060 0x7f1dac068420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.019+0000 7f1db9cac640 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e93858a380 con 0x7f1dac07d060 2024-09-13T19:16:14.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.019+0000 7f1db94ab640 1 --2- 172.21.15.102:0/3091870218 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f1dac07d060 0x7f1dac068420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.020+0000 7f1db94ab640 1 --2- 172.21.15.102:0/3091870218 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f1dac07d060 0x7f1dac068420 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.020+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1db0009050 con 0x7f1dac07d060 2024-09-13T19:16:14.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.020+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e93858a380 con 0x55e9385815c0 2024-09-13T19:16:14.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.020+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1db0009050 con 0x55e9385815c0 2024-09-13T19:16:14.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.020+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e93858a380 con 0x55e9385815c0 2024-09-13T19:16:14.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.020+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1db0029040 con 0x55e9385815c0 2024-09-13T19:16:14.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.020+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e93858a380 con 0x7f1dac07d060 2024-09-13T19:16:14.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.021+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1db0029040 con 0x7f1dac07d060 2024-09-13T19:16:14.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.021+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e93858a380 con 0x7f1dac07d060 2024-09-13T19:16:14.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.021+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1db0029040 con 0x7f1dac07d060 2024-09-13T19:16:14.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.021+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e93858a380 con 0x7f1db403e020 2024-09-13T19:16:14.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.021+0000 7f1db9cac640 1 -- 172.21.15.102:0/3091870218 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1dac08b040 con 0x7f1db403e020 2024-09-13T19:16:14.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.021+0000 7f1db9cac640 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e93858a380 con 0x55e938585ed0 2024-09-13T19:16:14.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.021+0000 7f1dba4ad640 1 -- 172.21.15.102:0/3091870218 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1db4033040 con 0x55e938585ed0 2024-09-13T19:16:14.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.021+0000 7f1dba4ad640 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e93858a380 con 0x55e9385815c0 2024-09-13T19:16:14.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.022+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1db0029040 con 0x55e9385815c0 2024-09-13T19:16:14.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.022+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e93858a380 con 0x7f1dac07d060 2024-09-13T19:16:14.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.022+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1db0029040 con 0x7f1dac07d060 2024-09-13T19:16:14.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.022+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e93858a380 con 0x55e9385815c0 2024-09-13T19:16:14.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.022+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1db0029040 con 0x55e9385815c0 2024-09-13T19:16:14.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.022+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e93858a380 con 0x7f1db403e020 2024-09-13T19:16:14.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.022+0000 7f1db9cac640 1 -- 172.21.15.102:0/3091870218 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1dac08b040 con 0x7f1db403e020 2024-09-13T19:16:14.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.022+0000 7f1db9cac640 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e93858a380 con 0x55e938585ed0 2024-09-13T19:16:14.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.023+0000 7f1dba4ad640 1 -- 172.21.15.102:0/3091870218 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1db4033040 con 0x55e938585ed0 2024-09-13T19:16:14.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.023+0000 7f1dba4ad640 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e93858a380 con 0x55e938585ed0 2024-09-13T19:16:14.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.023+0000 7f1dba4ad640 1 -- 172.21.15.102:0/3091870218 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=107b] v27'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1db4033040 con 0x55e938585ed0 2024-09-13T19:16:14.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.023+0000 7f1dba4ad640 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e93858a380 con 0x7f1dac07d060 2024-09-13T19:16:14.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.024+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1db0029040 con 0x7f1dac07d060 2024-09-13T19:16:14.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.024+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e93858a380 con 0x55e938585ed0 2024-09-13T19:16:14.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.024+0000 7f1dba4ad640 1 -- 172.21.15.102:0/3091870218 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1db4033040 con 0x55e938585ed0 2024-09-13T19:16:14.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.024+0000 7f1dba4ad640 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e93858a380 con 0x55e938585ed0 2024-09-13T19:16:14.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.024+0000 7f1dba4ad640 1 -- 172.21.15.102:0/3091870218 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1db4033040 con 0x55e938585ed0 2024-09-13T19:16:14.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.024+0000 7f1dba4ad640 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e93858a380 con 0x55e9385815c0 2024-09-13T19:16:14.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.024+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1db0029040 con 0x55e9385815c0 2024-09-13T19:16:14.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.024+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e93858a380 con 0x55e9385815c0 2024-09-13T19:16:14.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.024+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1db0029040 con 0x55e9385815c0 2024-09-13T19:16:14.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.024+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e93858a380 con 0x7f1dac07d060 2024-09-13T19:16:14.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.025+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1db0029040 con 0x7f1dac07d060 2024-09-13T19:16:14.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.025+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e93858a380 con 0x55e938585ed0 2024-09-13T19:16:14.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.025+0000 7f1dba4ad640 1 -- 172.21.15.102:0/3091870218 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1db4033040 con 0x55e938585ed0 2024-09-13T19:16:14.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.025+0000 7f1dba4ad640 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e93858a380 con 0x7f1db403e020 2024-09-13T19:16:14.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.025+0000 7f1db9cac640 1 -- 172.21.15.102:0/3091870218 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1dac08b040 con 0x7f1db403e020 2024-09-13T19:16:14.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.025+0000 7f1db9cac640 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e93858a380 con 0x55e9385815c0 2024-09-13T19:16:14.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.025+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1db0029040 con 0x55e9385815c0 2024-09-13T19:16:14.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.026+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e93858a380 con 0x7f1dac07d060 2024-09-13T19:16:14.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.026+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1db0029040 con 0x7f1dac07d060 2024-09-13T19:16:14.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.026+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e93858a380 con 0x55e938585ed0 2024-09-13T19:16:14.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.026+0000 7f1dba4ad640 1 -- 172.21.15.102:0/3091870218 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1db4033040 con 0x55e938585ed0 2024-09-13T19:16:14.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.026+0000 7f1dba4ad640 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e93858a380 con 0x7f1dac07d060 2024-09-13T19:16:14.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.026+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1db0029040 con 0x7f1dac07d060 2024-09-13T19:16:14.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.026+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e93858a380 con 0x7f1db403e020 2024-09-13T19:16:14.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.027+0000 7f1db9cac640 1 -- 172.21.15.102:0/3091870218 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1dac08b040 con 0x7f1db403e020 2024-09-13T19:16:14.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.027+0000 7f1db9cac640 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e93858a380 con 0x55e938585ed0 2024-09-13T19:16:14.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.027+0000 7f1dba4ad640 1 -- 172.21.15.102:0/3091870218 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1db4033040 con 0x55e938585ed0 2024-09-13T19:16:14.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.027+0000 7f1dba4ad640 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e93858a380 con 0x7f1dac07d060 2024-09-13T19:16:14.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.027+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1db0029040 con 0x7f1dac07d060 2024-09-13T19:16:14.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.027+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e93858a380 con 0x55e9385815c0 2024-09-13T19:16:14.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.027+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1db0029040 con 0x55e9385815c0 2024-09-13T19:16:14.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.027+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e93858a380 con 0x7f1db403e020 2024-09-13T19:16:14.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.028+0000 7f1db9cac640 1 -- 172.21.15.102:0/3091870218 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1dac08b040 con 0x7f1db403e020 2024-09-13T19:16:14.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.028+0000 7f1dbdf21800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:14.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.028+0000 7f1dbdf21800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:14.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.028+0000 7f1dbdf21800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:14.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.028+0000 7f1dbdf21800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:14.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.028+0000 7f1dbdf21800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:14.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.028+0000 7f1dbdf21800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:14.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.028+0000 7f1dbdf21800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.028+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e938589410 con 0x55e9385815c0 2024-09-13T19:16:14.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.028+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1db0029040 con 0x55e9385815c0 2024-09-13T19:16:14.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.028+0000 7f1dbdf21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:14.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.028+0000 7f1dbdf21800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.028+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e938589cb0 con 0x55e9385815c0 2024-09-13T19:16:14.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.028+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1db0029040 con 0x55e9385815c0 2024-09-13T19:16:14.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.028+0000 7f1dbdf21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:14.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.028+0000 7f1dbdf21800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.028+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e93858a800 con 0x55e938585ed0 2024-09-13T19:16:14.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.028+0000 7f1dba4ad640 1 -- 172.21.15.102:0/3091870218 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1db4033040 con 0x55e938585ed0 2024-09-13T19:16:14.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.028+0000 7f1dbdf21800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:14.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.028+0000 7f1dbdf21800 20 zone default found 2024-09-13T19:16:14.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.028+0000 7f1dbdf21800 4 Realm: () 2024-09-13T19:16:14.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.028+0000 7f1dbdf21800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:14.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.028+0000 7f1dbdf21800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:14.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.028+0000 7f1dbdf21800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:14.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.028+0000 7f1dbdf21800 20 zonegroup default 2024-09-13T19:16:14.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.028+0000 7f1dbdf21800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.028+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e93858b050 con 0x7f1dac07d060 2024-09-13T19:16:14.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.029+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1db0029040 con 0x7f1dac07d060 2024-09-13T19:16:14.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.029+0000 7f1dbdf21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:14.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.029+0000 7f1dbdf21800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.029+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e93858cdd0 con 0x55e938585ed0 2024-09-13T19:16:14.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.029+0000 7f1dba4ad640 1 -- 172.21.15.102:0/3091870218 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1db4033040 con 0x55e938585ed0 2024-09-13T19:16:14.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.029+0000 7f1dbdf21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:14.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.029+0000 7f1dbdf21800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.029+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e93858cdf0 con 0x55e938585ed0 2024-09-13T19:16:14.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.029+0000 7f1dba4ad640 1 -- 172.21.15.102:0/3091870218 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1db4033040 con 0x55e938585ed0 2024-09-13T19:16:14.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.029+0000 7f1dbdf21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:14.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.029+0000 7f1dbdf21800 20 started sync module instance, tier type = 2024-09-13T19:16:14.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.029+0000 7f1dbdf21800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:14.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.029+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e93858c270 con 0x7f1db403e020 2024-09-13T19:16:14.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.030+0000 7f1db9cac640 1 -- 172.21.15.102:0/3091870218 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(44 notify.0 [create] v34'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1dac08b040 con 0x7f1db403e020 2024-09-13T19:16:14.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.030+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94460161080768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e93858d2c0 con 0x7f1db403e020 2024-09-13T19:16:14.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.030+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e93858db10 con 0x55e9385815c0 2024-09-13T19:16:14.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.033+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v34'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1db0029040 con 0x55e9385815c0 2024-09-13T19:16:14.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.033+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94460161087344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e93858e1c0 con 0x55e9385815c0 2024-09-13T19:16:14.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.033+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e93858ece0 con 0x55e938585ed0 2024-09-13T19:16:14.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.033+0000 7f1db9cac640 1 -- 172.21.15.102:0/3091870218 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94460161080768] v34'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1dac08b040 con 0x7f1db403e020 2024-09-13T19:16:14.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.034+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94460161087344] v34'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1db0029040 con 0x55e9385815c0 2024-09-13T19:16:14.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.034+0000 7f1dba4ad640 1 -- 172.21.15.102:0/3091870218 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v34'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1db4033040 con 0x55e938585ed0 2024-09-13T19:16:14.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.034+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94460161091504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e93858eca0 con 0x55e938585ed0 2024-09-13T19:16:14.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.034+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e93858f580 con 0x7f1db403e020 2024-09-13T19:16:14.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.036+0000 7f1dba4ad640 1 -- 172.21.15.102:0/3091870218 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94460161091504] v34'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1db4033040 con 0x55e938585ed0 2024-09-13T19:16:14.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.036+0000 7f1db9cac640 1 -- 172.21.15.102:0/3091870218 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(50 notify.3 [create] v34'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1dac08b040 con 0x7f1db403e020 2024-09-13T19:16:14.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.036+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94460161093840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e93858eca0 con 0x7f1db403e020 2024-09-13T19:16:14.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.036+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e938590010 con 0x55e9385815c0 2024-09-13T19:16:14.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.039+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v34'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1db0029040 con 0x55e9385815c0 2024-09-13T19:16:14.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.039+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94460161096480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e938590010 con 0x55e9385815c0 2024-09-13T19:16:14.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.039+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e938590fd0 con 0x7f1dac07d060 2024-09-13T19:16:14.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.042+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(54 notify.5 [create] v34'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1db0029040 con 0x7f1dac07d060 2024-09-13T19:16:14.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.042+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94460161100448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e938590f90 con 0x7f1dac07d060 2024-09-13T19:16:14.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.042+0000 7f1db9cac640 1 -- 172.21.15.102:0/3091870218 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94460161093840] v34'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1dac08b040 con 0x7f1db403e020 2024-09-13T19:16:14.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.042+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e93858c6b0 con 0x7f1dac07d060 2024-09-13T19:16:14.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.044+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94460161096480] v34'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1db0029040 con 0x55e9385815c0 2024-09-13T19:16:14.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.044+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(56 notify.6 [create] v34'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1db0029040 con 0x7f1dac07d060 2024-09-13T19:16:14.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.044+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94460161083056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e938591a70 con 0x7f1dac07d060 2024-09-13T19:16:14.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.044+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e938592430 con 0x7f1dac07d060 2024-09-13T19:16:14.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.047+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(58 notify.7 [create] v34'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1db0029040 con 0x7f1dac07d060 2024-09-13T19:16:14.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.047+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94460161105792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e938592850 con 0x7f1dac07d060 2024-09-13T19:16:14.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.047+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94460161100448] v34'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1db0029040 con 0x7f1dac07d060 2024-09-13T19:16:14.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.047+0000 7f1dbdf21800 20 add_watcher() i=0 2024-09-13T19:16:14.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.047+0000 7f1dbdf21800 20 add_watcher() i=1 2024-09-13T19:16:14.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.047+0000 7f1dbdf21800 20 add_watcher() i=2 2024-09-13T19:16:14.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.047+0000 7f1dbdf21800 20 add_watcher() i=3 2024-09-13T19:16:14.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.047+0000 7f1dbdf21800 20 add_watcher() i=4 2024-09-13T19:16:14.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.047+0000 7f1dbdf21800 20 add_watcher() i=5 2024-09-13T19:16:14.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.047+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94460161083056] v34'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1db0029040 con 0x7f1dac07d060 2024-09-13T19:16:14.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.047+0000 7f1dbdf21800 20 add_watcher() i=6 2024-09-13T19:16:14.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.048+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94460161105792] v34'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1db0029040 con 0x7f1dac07d060 2024-09-13T19:16:14.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.048+0000 7f1dbdf21800 20 add_watcher() i=7 2024-09-13T19:16:14.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.048+0000 7f1dbdf21800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:14.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.048+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e9385953d0 con 0x55e9385815c0 2024-09-13T19:16:14.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.048+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1db0029040 con 0x55e9385815c0 2024-09-13T19:16:14.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.048+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94460161098720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e938592850 con 0x55e9385815c0 2024-09-13T19:16:14.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.050+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94460161098720] v34'36 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1db0029040 con 0x55e9385815c0 2024-09-13T19:16:14.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.050+0000 7f1c6b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:14.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.050+0000 7f1dbdf21800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:14.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.050+0000 7f1dbdf21800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:14.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.050+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e93859dce0 con 0x55e9385815c0 2024-09-13T19:16:14.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.051+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1db0029040 con 0x55e9385815c0 2024-09-13T19:16:14.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.051+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e93859e3b0 con 0x7f1dac07d060 2024-09-13T19:16:14.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.052+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'12 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1db0029040 con 0x7f1dac07d060 2024-09-13T19:16:14.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.052+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e93859e7b0 con 0x55e938585ed0 2024-09-13T19:16:14.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.054+0000 7f1dba4ad640 1 -- 172.21.15.102:0/3091870218 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1db4033040 con 0x55e938585ed0 2024-09-13T19:16:14.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.054+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e93859e720 con 0x55e9385815c0 2024-09-13T19:16:14.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.056+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'37 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1db0029040 con 0x55e9385815c0 2024-09-13T19:16:14.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.056+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e93859ecb0 con 0x7f1db403e020 2024-09-13T19:16:14.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.057+0000 7f1db9cac640 1 -- 172.21.15.102:0/3091870218 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'26 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1dac08b040 con 0x7f1db403e020 2024-09-13T19:16:14.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.057+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e93859f160 con 0x55e938585ed0 2024-09-13T19:16:14.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.059+0000 7f1dba4ad640 1 -- 172.21.15.102:0/3091870218 <== osd.3 v2:172.21.15.102:6800/3096737090 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'17 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1db4033040 con 0x55e938585ed0 2024-09-13T19:16:14.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.059+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e93859f160 con 0x55e9385815c0 2024-09-13T19:16:14.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.062+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1db0029040 con 0x55e9385815c0 2024-09-13T19:16:14.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.062+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e93859f160 con 0x7f1dac07d060 2024-09-13T19:16:14.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.063+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'17 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1db0029040 con 0x7f1dac07d060 2024-09-13T19:16:14.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.063+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e93859f1f0 con 0x7f1db403e020 2024-09-13T19:16:14.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.065+0000 7f1db9cac640 1 -- 172.21.15.102:0/3091870218 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1dac08b040 con 0x7f1db403e020 2024-09-13T19:16:14.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.065+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e93859f780 con 0x55e938585ed0 2024-09-13T19:16:14.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.066+0000 7f1dba4ad640 1 -- 172.21.15.102:0/3091870218 <== osd.3 v2:172.21.15.102:6800/3096737090 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1db4033040 con 0x55e938585ed0 2024-09-13T19:16:14.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.066+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e93859f780 con 0x7f1db403e020 2024-09-13T19:16:14.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.068+0000 7f1db9cac640 1 -- 172.21.15.102:0/3091870218 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1dac08b040 con 0x7f1db403e020 2024-09-13T19:16:14.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.068+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e93859f780 con 0x7f1dac07d060 2024-09-13T19:16:14.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.070+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1db0029040 con 0x7f1dac07d060 2024-09-13T19:16:14.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.070+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e93859f780 con 0x7f1db403e020 2024-09-13T19:16:14.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.071+0000 7f1db9cac640 1 -- 172.21.15.102:0/3091870218 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1dac08b040 con 0x7f1db403e020 2024-09-13T19:16:14.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.071+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e93859f780 con 0x7f1dac07d060 2024-09-13T19:16:14.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.074+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.0 v2:172.21.15.53:6800/4021716951 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'23 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1db0029040 con 0x7f1dac07d060 2024-09-13T19:16:14.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.074+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e93859f780 con 0x55e9385815c0 2024-09-13T19:16:14.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.076+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'38 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1db0029040 con 0x55e9385815c0 2024-09-13T19:16:14.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.076+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e93859f780 con 0x55e938585ed0 2024-09-13T19:16:14.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.077+0000 7f1dba4ad640 1 -- 172.21.15.102:0/3091870218 <== osd.3 v2:172.21.15.102:6800/3096737090 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1db4033040 con 0x55e938585ed0 2024-09-13T19:16:14.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.077+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e93859f780 con 0x7f1db403e020 2024-09-13T19:16:14.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.078+0000 7f1db9cac640 1 -- 172.21.15.102:0/3091870218 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'28 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1dac08b040 con 0x7f1db403e020 2024-09-13T19:16:14.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.078+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e93859f780 con 0x55e938585ed0 2024-09-13T19:16:14.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.079+0000 7f1dba4ad640 1 -- 172.21.15.102:0/3091870218 <== osd.3 v2:172.21.15.102:6800/3096737090 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1db4033040 con 0x55e938585ed0 2024-09-13T19:16:14.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.079+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e93859f780 con 0x55e9385815c0 2024-09-13T19:16:14.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.081+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1db0029040 con 0x55e9385815c0 2024-09-13T19:16:14.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.081+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e93859f780 con 0x55e9385815c0 2024-09-13T19:16:14.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.082+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'39 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1db0029040 con 0x55e9385815c0 2024-09-13T19:16:14.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.082+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e93859f780 con 0x55e938585ed0 2024-09-13T19:16:14.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.083+0000 7f1dba4ad640 1 -- 172.21.15.102:0/3091870218 <== osd.3 v2:172.21.15.102:6800/3096737090 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1db4033040 con 0x55e938585ed0 2024-09-13T19:16:14.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.083+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e93859f780 con 0x7f1db403e020 2024-09-13T19:16:14.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.084+0000 7f1db9cac640 1 -- 172.21.15.102:0/3091870218 <== osd.2 v2:172.21.15.102:6816/2238176080 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1dac08b040 con 0x7f1db403e020 2024-09-13T19:16:14.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.084+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e93859ecb0 con 0x55e938585ed0 2024-09-13T19:16:14.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.085+0000 7f1dba4ad640 1 -- 172.21.15.102:0/3091870218 <== osd.3 v2:172.21.15.102:6800/3096737090 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1db4033040 con 0x55e938585ed0 2024-09-13T19:16:14.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.085+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e93859ecb0 con 0x55e938585ed0 2024-09-13T19:16:14.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.085+0000 7f1dba4ad640 1 -- 172.21.15.102:0/3091870218 <== osd.3 v2:172.21.15.102:6800/3096737090 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1db4033040 con 0x55e938585ed0 2024-09-13T19:16:14.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.085+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e93859ecb0 con 0x55e938585ed0 2024-09-13T19:16:14.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.086+0000 7f1dba4ad640 1 -- 172.21.15.102:0/3091870218 <== osd.3 v2:172.21.15.102:6800/3096737090 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'8 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1db4033040 con 0x55e938585ed0 2024-09-13T19:16:14.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.086+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e93859ecb0 con 0x55e938585ed0 2024-09-13T19:16:14.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.087+0000 7f1dba4ad640 1 -- 172.21.15.102:0/3091870218 <== osd.3 v2:172.21.15.102:6800/3096737090 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'18 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1db4033040 con 0x55e938585ed0 2024-09-13T19:16:14.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.087+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e93859f780 con 0x7f1dac07d060 2024-09-13T19:16:14.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.088+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.0 v2:172.21.15.53:6800/4021716951 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1db0029040 con 0x7f1dac07d060 2024-09-13T19:16:14.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.089+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e93859f780 con 0x55e938585ed0 2024-09-13T19:16:14.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.089+0000 7f1dba4ad640 1 -- 172.21.15.102:0/3091870218 <== osd.3 v2:172.21.15.102:6800/3096737090 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1db4033040 con 0x55e938585ed0 2024-09-13T19:16:14.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.089+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e93859f780 con 0x7f1dac07d060 2024-09-13T19:16:14.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.090+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.0 v2:172.21.15.53:6800/4021716951 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'18 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1db0029040 con 0x7f1dac07d060 2024-09-13T19:16:14.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.090+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e93859f780 con 0x55e938585ed0 2024-09-13T19:16:14.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.091+0000 7f1dba4ad640 1 -- 172.21.15.102:0/3091870218 <== osd.3 v2:172.21.15.102:6800/3096737090 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'22 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1db4033040 con 0x55e938585ed0 2024-09-13T19:16:14.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.091+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e93859f780 con 0x7f1dac07d060 2024-09-13T19:16:14.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.092+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.0 v2:172.21.15.53:6800/4021716951 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'24 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1db0029040 con 0x7f1dac07d060 2024-09-13T19:16:14.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.092+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e93859f780 con 0x7f1db403e020 2024-09-13T19:16:14.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.093+0000 7f1db9cac640 1 -- 172.21.15.102:0/3091870218 <== osd.2 v2:172.21.15.102:6816/2238176080 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1dac08b040 con 0x7f1db403e020 2024-09-13T19:16:14.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.094+0000 7f1c6a7fc640 20 reqs_thread_entry: start 2024-09-13T19:16:14.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.094+0000 7f1dbdf21800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:14.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.094+0000 7f1dbdf21800 20 Filter name: none 2024-09-13T19:16:14.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.094+0000 7f1bdbfff640 20 reqs_thread_entry: start 2024-09-13T19:16:14.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.094+0000 7f1dbdf21800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T19:16:14.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.094+0000 7f1dbdf21800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.094+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e9385ca590 con 0x7f1dac07d060 2024-09-13T19:16:14.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.095+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.0 v2:172.21.15.53:6800/4021716951 24 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f1db0029040 con 0x7f1dac07d060 2024-09-13T19:16:14.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.095+0000 7f1dbdf21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:14.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.095+0000 7f1dbdf21800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-13T19:16:14.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.095+0000 7f1dbdf21800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T19:16:14.100 INFO:teuthology.orchestra.run.smithi102.stderr:could not remove user: unable to remove user, user does not exist 2024-09-13T19:16:14.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.096+0000 7f1c6b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:14.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.096+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94460161098720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e938599540 con 0x55e9385815c0 2024-09-13T19:16:14.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.097+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94460161098720] v34'40 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1db0029040 con 0x55e9385815c0 2024-09-13T19:16:14.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.097+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94460161080768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e938599540 con 0x7f1db403e020 2024-09-13T19:16:14.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.098+0000 7f1db9cac640 1 -- 172.21.15.102:0/3091870218 <== osd.2 v2:172.21.15.102:6816/2238176080 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94460161080768] v34'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1dac08b040 con 0x7f1db403e020 2024-09-13T19:16:14.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.098+0000 7f1dbdf21800 20 remove_watcher() i=0 2024-09-13T19:16:14.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.098+0000 7f1dbdf21800 2 removed watcher, disabling cache 2024-09-13T19:16:14.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.098+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94460161087344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e93858bdc0 con 0x55e9385815c0 2024-09-13T19:16:14.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.099+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.1 v2:172.21.15.102:6808/2204418452 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94460161087344] v34'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1db0029040 con 0x55e9385815c0 2024-09-13T19:16:14.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.099+0000 7f1dbdf21800 20 remove_watcher() i=1 2024-09-13T19:16:14.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.099+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94460161091504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e93858bdc0 con 0x55e938585ed0 2024-09-13T19:16:14.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.100+0000 7f1dba4ad640 1 -- 172.21.15.102:0/3091870218 <== osd.3 v2:172.21.15.102:6800/3096737090 28 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94460161091504] v34'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1db4033040 con 0x55e938585ed0 2024-09-13T19:16:14.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.100+0000 7f1dbdf21800 20 remove_watcher() i=2 2024-09-13T19:16:14.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.100+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94460161093840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e93858e7b0 con 0x7f1db403e020 2024-09-13T19:16:14.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.101+0000 7f1db9cac640 1 -- 172.21.15.102:0/3091870218 <== osd.2 v2:172.21.15.102:6816/2238176080 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94460161093840] v34'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1dac08b040 con 0x7f1db403e020 2024-09-13T19:16:14.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.101+0000 7f1dbdf21800 20 remove_watcher() i=3 2024-09-13T19:16:14.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.101+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94460161096480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e93858bdc0 con 0x55e9385815c0 2024-09-13T19:16:14.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.102+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.1 v2:172.21.15.102:6808/2204418452 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94460161096480] v34'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1db0029040 con 0x55e9385815c0 2024-09-13T19:16:14.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.102+0000 7f1dbdf21800 20 remove_watcher() i=4 2024-09-13T19:16:14.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.102+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94460161100448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e93858f0d0 con 0x7f1dac07d060 2024-09-13T19:16:14.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.103+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.0 v2:172.21.15.53:6800/4021716951 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94460161100448] v34'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1db0029040 con 0x7f1dac07d060 2024-09-13T19:16:14.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.103+0000 7f1dbdf21800 20 remove_watcher() i=5 2024-09-13T19:16:14.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.103+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94460161083056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e93858e7b0 con 0x7f1dac07d060 2024-09-13T19:16:14.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.104+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.0 v2:172.21.15.53:6800/4021716951 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94460161083056] v34'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1db0029040 con 0x7f1dac07d060 2024-09-13T19:16:14.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.104+0000 7f1dbdf21800 20 remove_watcher() i=6 2024-09-13T19:16:14.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.104+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94460161105792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e93858fb20 con 0x7f1dac07d060 2024-09-13T19:16:14.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.105+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 <== osd.0 v2:172.21.15.53:6800/4021716951 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94460161105792] v34'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1db0029040 con 0x7f1dac07d060 2024-09-13T19:16:14.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.105+0000 7f1dbdf21800 20 remove_watcher() i=7 2024-09-13T19:16:14.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.105+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f1dac07d060 msgr2=0x7f1dac068420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.105+0000 7f1dbdf21800 1 --2- 172.21.15.102:0/3091870218 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f1dac07d060 0x7f1dac068420 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.105+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e9385815c0 msgr2=0x55e938583a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.105+0000 7f1dbdf21800 1 --2- 172.21.15.102:0/3091870218 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e9385815c0 0x55e938583a80 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.105+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f1db403e020 msgr2=0x7f1db40123b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.105+0000 7f1dbdf21800 1 --2- 172.21.15.102:0/3091870218 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f1db403e020 0x7f1db40123b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.105+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e938585ed0 msgr2=0x55e9385882c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.105+0000 7f1dbdf21800 1 --2- 172.21.15.102:0/3091870218 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e938585ed0 0x55e9385882c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.105+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f1c84036b90 msgr2=0x7f1c84039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.105+0000 7f1dbdf21800 1 --2- 172.21.15.102:0/3091870218 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f1c84036b90 0x7f1c84039050 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x55e93854e400 tx=0x7f1dac083000 comp rx=0 tx=0).stop 2024-09-13T19:16:14.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.105+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e93856e470 msgr2=0x55e9385758c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.105+0000 7f1db94ab640 1 -- 172.21.15.102:0/3091870218 reap_dead start 2024-09-13T19:16:14.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.105+0000 7f1dbdf21800 1 --2- 172.21.15.102:0/3091870218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e93856e470 0x55e9385758c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x55e938569500 tx=0x7f1db404cd60 comp rx=0 tx=0).stop 2024-09-13T19:16:14.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.105+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 shutdown_connections 2024-09-13T19:16:14.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.105+0000 7f1dbdf21800 1 --2- 172.21.15.102:0/3091870218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e93856e470 0x55e9385758c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.105+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 >> 172.21.15.102:0/3091870218 conn(0x55e93856a810 msgr2=0x55e9385688e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:14.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.105+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 shutdown_connections 2024-09-13T19:16:14.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.105+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3091870218 wait complete. 2024-09-13T19:16:14.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.106+0000 7f1dbdf21800 1 -- 172.21.15.102:0/2185495538 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f1c94036b40 msgr2=0x7f1c94039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.106+0000 7f1dbdf21800 1 --2- 172.21.15.102:0/2185495538 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f1c94036b40 0x7f1c94039000 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x55e93854e830 tx=0x7f1dac08eb20 comp rx=0 tx=0).stop 2024-09-13T19:16:14.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.106+0000 7f1dbdf21800 1 -- 172.21.15.102:0/2185495538 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e938561740 msgr2=0x55e938561b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.106+0000 7f1dbdf21800 1 --2- 172.21.15.102:0/2185495538 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e938561740 0x55e938561b60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x55e93854e330 tx=0x7f1db40163e0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.106+0000 7f1dbdf21800 1 -- 172.21.15.102:0/2185495538 shutdown_connections 2024-09-13T19:16:14.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.106+0000 7f1dbdf21800 1 --2- 172.21.15.102:0/2185495538 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f1c94036b40 0x7f1c94039000 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.106+0000 7f1dbdf21800 1 --2- 172.21.15.102:0/2185495538 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e938561740 0x55e938561b60 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.106+0000 7f1dbdf21800 1 -- 172.21.15.102:0/2185495538 >> 172.21.15.102:0/2185495538 conn(0x55e9385566d0 msgr2=0x55e938559250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:14.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.106+0000 7f1dbdf21800 1 -- 172.21.15.102:0/2185495538 shutdown_connections 2024-09-13T19:16:14.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.106+0000 7f1dbdf21800 1 -- 172.21.15.102:0/2185495538 wait complete. 2024-09-13T19:16:14.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.106+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3576710063 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e93854b520 msgr2=0x55e93854d910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.106+0000 7f1dbdf21800 1 --2- 172.21.15.102:0/3576710063 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e93854b520 0x55e93854d910 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.106+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3576710063 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e938550280 msgr2=0x55e938552670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.106+0000 7f1dbdf21800 1 --2- 172.21.15.102:0/3576710063 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e938550280 0x55e938552670 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.106+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3576710063 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f1ca0036b40 msgr2=0x7f1ca0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.106+0000 7f1dbdf21800 1 --2- 172.21.15.102:0/3576710063 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f1ca0036b40 0x7f1ca0039000 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1db0000f60 tx=0x7f1db00012b0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.106+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3576710063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e93844c2d0 msgr2=0x55e9385464c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.106+0000 7f1dbdf21800 1 --2- 172.21.15.102:0/3576710063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e93844c2d0 0x55e9385464c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x55e93844da50 tx=0x7f1dac002fb0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.106+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3576710063 shutdown_connections 2024-09-13T19:16:14.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.106+0000 7f1dbdf21800 1 --2- 172.21.15.102:0/3576710063 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e938550280 0x55e938552670 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.106+0000 7f1dbdf21800 1 --2- 172.21.15.102:0/3576710063 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e93854b520 0x55e93854d910 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.106+0000 7f1dbdf21800 1 --2- 172.21.15.102:0/3576710063 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f1ca0036b40 0x7f1ca0039000 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.106+0000 7f1dbdf21800 1 --2- 172.21.15.102:0/3576710063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e93844c2d0 0x55e9385464c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.106+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3576710063 >> 172.21.15.102:0/3576710063 conn(0x55e9384475c0 msgr2=0x55e938537e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:14.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.106+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3576710063 shutdown_connections 2024-09-13T19:16:14.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.106+0000 7f1dbdf21800 1 -- 172.21.15.102:0/3576710063 wait complete. 2024-09-13T19:16:14.118 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T19:16:14.119 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-13T19:16:14.119 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-13T19:16:14.119 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-13T19:16:14.163 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:14.163 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:14.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.159+0000 7fb257b26800 1 Processor -- start 2024-09-13T19:16:14.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.160+0000 7fb257b26800 1 -- start start 2024-09-13T19:16:14.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.160+0000 7fb257b26800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55bb58934550 0x55bb58934950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.160+0000 7fb257b26800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bb587f4b30 con 0x55bb58934e90 2024-09-13T19:16:14.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.160+0000 7fb257b26800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55bb587d6360 con 0x55bb58934550 2024-09-13T19:16:14.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.160+0000 7fb25381d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55bb58934550 0x55bb58934950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.160+0000 7fb25381d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55bb58934550 0x55bb58934950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53638/0 (socket says 172.21.15.102:53638) 2024-09-13T19:16:14.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.160+0000 7fb25381d640 1 -- 172.21.15.102:0/4003258530 learned_addr learned my addr 172.21.15.102:0/4003258530 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:14.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.160+0000 7fb24b01c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55bb58934e90 0x55bb58939a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:49754/0 (socket says 172.21.15.102:49754) 2024-09-13T19:16:14.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.160+0000 7fb25381d640 1 -- 172.21.15.102:0/4003258530 >> v1:172.21.15.53:6789/0 conn(0x55bb58934e90 legacy=0x55bb58939a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.160+0000 7fb25381d640 1 -- 172.21.15.102:0/4003258530 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb587fce00 con 0x55bb58934550 2024-09-13T19:16:14.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.162+0000 7fb25381d640 1 --2- 172.21.15.102:0/4003258530 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb58934550 0x55bb58934950 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb24400a520 tx=0x7fb244045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ba9054a9c925db6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.162+0000 7fb25301c640 1 -- 172.21.15.102:0/4003258530 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb244055070 con 0x55bb58934550 2024-09-13T19:16:14.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.162+0000 7fb25301c640 1 -- 172.21.15.102:0/4003258530 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2440515b0 con 0x55bb58934550 2024-09-13T19:16:14.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.162+0000 7fb25301c640 1 -- 172.21.15.102:0/4003258530 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2440518d0 con 0x55bb58934550 2024-09-13T19:16:14.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.163+0000 7fb257b26800 1 -- 172.21.15.102:0/4003258530 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb58934550 msgr2=0x55bb58934950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.163+0000 7fb257b26800 1 --2- 172.21.15.102:0/4003258530 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb58934550 0x55bb58934950 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb24400a520 tx=0x7fb244045ba0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.163+0000 7fb257b26800 1 -- 172.21.15.102:0/4003258530 shutdown_connections 2024-09-13T19:16:14.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.163+0000 7fb257b26800 1 --2- 172.21.15.102:0/4003258530 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb58934550 0x55bb58934950 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.163+0000 7fb257b26800 1 -- 172.21.15.102:0/4003258530 >> 172.21.15.102:0/4003258530 conn(0x55bb5892fde0 msgr2=0x55bb58932200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:14.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.163+0000 7fb257b26800 1 -- 172.21.15.102:0/4003258530 shutdown_connections 2024-09-13T19:16:14.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.163+0000 7fb257b26800 1 -- 172.21.15.102:0/4003258530 wait complete. 2024-09-13T19:16:14.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.177+0000 7fb257b26800 1 Processor -- start 2024-09-13T19:16:14.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.177+0000 7fb257b26800 1 -- start start 2024-09-13T19:16:14.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.177+0000 7fb257b26800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb58934550 0x55bb588a95a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.177+0000 7fb257b26800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bb58881330 con 0x55bb58934550 2024-09-13T19:16:14.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.177+0000 7fb25381d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb58934550 0x55bb588a95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.177+0000 7fb25381d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb58934550 0x55bb588a95a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53650/0 (socket says 172.21.15.102:53650) 2024-09-13T19:16:14.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.177+0000 7fb25381d640 1 -- 172.21.15.102:0/2890131854 learned_addr learned my addr 172.21.15.102:0/2890131854 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:14.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.178+0000 7fb25381d640 1 -- 172.21.15.102:0/2890131854 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb587cebc0 con 0x55bb58934550 2024-09-13T19:16:14.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.178+0000 7fb25381d640 1 --2- 172.21.15.102:0/2890131854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb58934550 0x55bb588a95a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb244025da0 tx=0x7fb244051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edf07339d27bc2f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.178+0000 7fb141e0b640 1 -- 172.21.15.102:0/2890131854 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb244051890 con 0x55bb58934550 2024-09-13T19:16:14.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.178+0000 7fb141e0b640 1 -- 172.21.15.102:0/2890131854 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb244051ac0 con 0x55bb58934550 2024-09-13T19:16:14.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.178+0000 7fb141e0b640 1 -- 172.21.15.102:0/2890131854 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb244051da0 con 0x55bb58934550 2024-09-13T19:16:14.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.179+0000 7fb257b26800 1 -- 172.21.15.102:0/2890131854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb58934550 msgr2=0x55bb588a95a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.179+0000 7fb257b26800 1 --2- 172.21.15.102:0/2890131854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb58934550 0x55bb588a95a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb244025da0 tx=0x7fb244051000 comp rx=0 tx=0).stop 2024-09-13T19:16:14.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.179+0000 7fb257b26800 1 -- 172.21.15.102:0/2890131854 shutdown_connections 2024-09-13T19:16:14.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.179+0000 7fb257b26800 1 --2- 172.21.15.102:0/2890131854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb58934550 0x55bb588a95a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.179+0000 7fb257b26800 1 -- 172.21.15.102:0/2890131854 >> 172.21.15.102:0/2890131854 conn(0x55bb5892fde0 msgr2=0x55bb58a1f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:14.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.179+0000 7fb257b26800 1 -- 172.21.15.102:0/2890131854 shutdown_connections 2024-09-13T19:16:14.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.179+0000 7fb257b26800 1 -- 172.21.15.102:0/2890131854 wait complete. 2024-09-13T19:16:14.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.179+0000 7fb257b26800 1 Processor -- start 2024-09-13T19:16:14.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.179+0000 7fb257b26800 1 -- start start 2024-09-13T19:16:14.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.179+0000 7fb257b26800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb58934550 0x55bb58a24ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.179+0000 7fb257b26800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bb5893b570 con 0x55bb58934550 2024-09-13T19:16:14.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.180+0000 7fb25381d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb58934550 0x55bb58a24ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.180+0000 7fb25381d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb58934550 0x55bb58a24ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53652/0 (socket says 172.21.15.102:53652) 2024-09-13T19:16:14.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.180+0000 7fb25381d640 1 -- 172.21.15.102:0/3517822131 learned_addr learned my addr 172.21.15.102:0/3517822131 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:14.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.180+0000 7fb25381d640 1 -- 172.21.15.102:0/3517822131 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb587e2fe0 con 0x55bb58934550 2024-09-13T19:16:14.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.180+0000 7fb25381d640 1 --2- 172.21.15.102:0/3517822131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb58934550 0x55bb58a24ed0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb244025da0 tx=0x7fb244002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.180+0000 7fb13bfff640 1 -- 172.21.15.102:0/3517822131 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb244073070 con 0x55bb58934550 2024-09-13T19:16:14.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.180+0000 7fb13bfff640 1 -- 172.21.15.102:0/3517822131 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb24405a580 con 0x55bb58934550 2024-09-13T19:16:14.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.180+0000 7fb257b26800 1 -- 172.21.15.102:0/3517822131 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bb58a235c0 con 0x55bb58934550 2024-09-13T19:16:14.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.180+0000 7fb13bfff640 1 -- 172.21.15.102:0/3517822131 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb24405a860 con 0x55bb58934550 2024-09-13T19:16:14.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.180+0000 7fb257b26800 1 -- 172.21.15.102:0/3517822131 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb58a23b40 con 0x55bb58934550 2024-09-13T19:16:14.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.181+0000 7fb13bfff640 1 -- 172.21.15.102:0/3517822131 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb244076070 con 0x55bb58934550 2024-09-13T19:16:14.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.181+0000 7fb13bfff640 1 --2- 172.21.15.102:0/3517822131 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb13c036b40 0x7fb13c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.181+0000 7fb13bfff640 1 -- 172.21.15.102:0/3517822131 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fb244062070 con 0x55bb58934550 2024-09-13T19:16:14.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.181+0000 7fb24b01c640 1 --2- 172.21.15.102:0/3517822131 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb13c036b40 0x7fb13c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.181+0000 7fb257b26800 1 --2- 172.21.15.102:0/3517822131 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55bb58934e90 0x55bb58a35560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.181+0000 7fb257b26800 1 -- 172.21.15.102:0/3517822131 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a35aa0 con 0x55bb58934e90 2024-09-13T19:16:14.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.182+0000 7fb25401e640 1 --2- 172.21.15.102:0/3517822131 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55bb58934e90 0x55bb58a35560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.182+0000 7fb24b01c640 1 --2- 172.21.15.102:0/3517822131 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb13c036b40 0x7fb13c039000 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb23c000f60 tx=0x7fb23c001370 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.182+0000 7fb25401e640 1 --2- 172.21.15.102:0/3517822131 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55bb58934e90 0x55bb58a35560 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.182+0000 7fb25401e640 1 -- 172.21.15.102:0/3517822131 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb24c00a4a0 con 0x55bb58934e90 2024-09-13T19:16:14.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.182+0000 7fb257b26800 1 -- 172.21.15.102:0/3517822131 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a23e90 con 0x55bb58934e90 2024-09-13T19:16:14.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.182+0000 7fb25401e640 1 -- 172.21.15.102:0/3517822131 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb24c00a4a0 con 0x55bb58934e90 2024-09-13T19:16:14.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.182+0000 7fb257b26800 1 --2- 172.21.15.102:0/3517822131 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55bb58a37d70 0x55bb58a3a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.182+0000 7fb257b26800 1 -- 172.21.15.102:0/3517822131 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a3a800 con 0x55bb58a37d70 2024-09-13T19:16:14.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.183+0000 7fb25381d640 1 --2- 172.21.15.102:0/3517822131 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55bb58a37d70 0x55bb58a3a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.183+0000 7fb25381d640 1 --2- 172.21.15.102:0/3517822131 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55bb58a37d70 0x55bb58a3a160 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.183+0000 7fb25381d640 1 -- 172.21.15.102:0/3517822131 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb24407f070 con 0x55bb58a37d70 2024-09-13T19:16:14.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.183+0000 7fb257b26800 1 -- 172.21.15.102:0/3517822131 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a36c10 con 0x55bb58934e90 2024-09-13T19:16:14.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.183+0000 7fb25401e640 1 -- 172.21.15.102:0/3517822131 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb24c00a4a0 con 0x55bb58934e90 2024-09-13T19:16:14.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.183+0000 7fb257b26800 1 -- 172.21.15.102:0/3517822131 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a370b0 con 0x55bb58a37d70 2024-09-13T19:16:14.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.184+0000 7fb25381d640 1 -- 172.21.15.102:0/3517822131 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb24407f070 con 0x55bb58a37d70 2024-09-13T19:16:14.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.184+0000 7fb257b26800 1 Processor -- start 2024-09-13T19:16:14.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.184+0000 7fb257b26800 1 -- start start 2024-09-13T19:16:14.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.184+0000 7fb257b26800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb58a491c0 0x55bb58a495e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.184+0000 7fb257b26800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bb587d0580 con 0x55bb58a491c0 2024-09-13T19:16:14.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.184+0000 7fb25401e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb58a491c0 0x55bb58a495e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.185+0000 7fb25401e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb58a491c0 0x55bb58a495e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53660/0 (socket says 172.21.15.102:53660) 2024-09-13T19:16:14.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.185+0000 7fb25401e640 1 -- 172.21.15.102:0/4114544870 learned_addr learned my addr 172.21.15.102:0/4114544870 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:14.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.185+0000 7fb25401e640 1 -- 172.21.15.102:0/4114544870 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb58a49b20 con 0x55bb58a491c0 2024-09-13T19:16:14.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.185+0000 7fb25401e640 1 --2- 172.21.15.102:0/4114544870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb58a491c0 0x55bb58a495e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x55bb58a24a30 tx=0x7fb24c0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.185+0000 7fb1397fa640 1 -- 172.21.15.102:0/4114544870 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb24c013640 con 0x55bb58a491c0 2024-09-13T19:16:14.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.185+0000 7fb1397fa640 1 -- 172.21.15.102:0/4114544870 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb24c0137e0 con 0x55bb58a491c0 2024-09-13T19:16:14.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.185+0000 7fb1397fa640 1 -- 172.21.15.102:0/4114544870 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb24c013ac0 con 0x55bb58a491c0 2024-09-13T19:16:14.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.185+0000 7fb257b26800 1 -- 172.21.15.102:0/4114544870 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bb58a49db0 con 0x55bb58a491c0 2024-09-13T19:16:14.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.185+0000 7fb257b26800 1 -- 172.21.15.102:0/4114544870 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb58a4ca90 con 0x55bb58a491c0 2024-09-13T19:16:14.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.186+0000 7fb1397fa640 1 -- 172.21.15.102:0/4114544870 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb24c011040 con 0x55bb58a491c0 2024-09-13T19:16:14.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.186+0000 7fb1397fa640 1 --2- 172.21.15.102:0/4114544870 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb12c036b90 0x7fb12c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.186+0000 7fb1397fa640 1 -- 172.21.15.102:0/4114544870 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fb24c00e040 con 0x55bb58a491c0 2024-09-13T19:16:14.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.186+0000 7fb25381d640 1 --2- 172.21.15.102:0/4114544870 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb12c036b90 0x7fb12c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.186+0000 7fb257b26800 1 Processor -- start 2024-09-13T19:16:14.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.186+0000 7fb257b26800 1 -- start start 2024-09-13T19:16:14.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.187+0000 7fb25381d640 1 --2- 172.21.15.102:0/4114544870 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb12c036b90 0x7fb12c039050 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x55bb58a23df0 tx=0x7fb24408f3b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.187+0000 7fb257b26800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb58a55e90 0x55bb58a56290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.187+0000 7fb257b26800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bb58a276b0 con 0x55bb58a55e90 2024-09-13T19:16:14.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.187+0000 7fb25401e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb58a55e90 0x55bb58a56290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.187+0000 7fb25401e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb58a55e90 0x55bb58a56290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53670/0 (socket says 172.21.15.102:53670) 2024-09-13T19:16:14.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.187+0000 7fb25401e640 1 -- 172.21.15.102:0/2346310462 learned_addr learned my addr 172.21.15.102:0/2346310462 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:14.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.187+0000 7fb25401e640 1 -- 172.21.15.102:0/2346310462 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb58a56860 con 0x55bb58a55e90 2024-09-13T19:16:14.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.187+0000 7fb25401e640 1 --2- 172.21.15.102:0/2346310462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb58a55e90 0x55bb58a56290 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb24c005a10 tx=0x7fb24c012f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=482f180876ea9c99 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.187+0000 7fb132ffd640 1 -- 172.21.15.102:0/2346310462 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb24c021440 con 0x55bb58a55e90 2024-09-13T19:16:14.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.187+0000 7fb132ffd640 1 -- 172.21.15.102:0/2346310462 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb24c020c50 con 0x55bb58a55e90 2024-09-13T19:16:14.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.187+0000 7fb132ffd640 1 -- 172.21.15.102:0/2346310462 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb24c0215e0 con 0x55bb58a55e90 2024-09-13T19:16:14.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.188+0000 7fb257b26800 1 -- 172.21.15.102:0/2346310462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb58a55e90 msgr2=0x55bb58a56290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.188+0000 7fb257b26800 1 --2- 172.21.15.102:0/2346310462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb58a55e90 0x55bb58a56290 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb24c005a10 tx=0x7fb24c012f20 comp rx=0 tx=0).stop 2024-09-13T19:16:14.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.188+0000 7fb257b26800 1 -- 172.21.15.102:0/2346310462 shutdown_connections 2024-09-13T19:16:14.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.188+0000 7fb257b26800 1 --2- 172.21.15.102:0/2346310462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb58a55e90 0x55bb58a56290 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.188+0000 7fb257b26800 1 -- 172.21.15.102:0/2346310462 >> 172.21.15.102:0/2346310462 conn(0x55bb58a52240 msgr2=0x55bb58a50340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:14.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.188+0000 7fb257b26800 1 -- 172.21.15.102:0/2346310462 shutdown_connections 2024-09-13T19:16:14.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.188+0000 7fb257b26800 1 -- 172.21.15.102:0/2346310462 wait complete. 2024-09-13T19:16:14.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.188+0000 7fb257b26800 1 Processor -- start 2024-09-13T19:16:14.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.188+0000 7fb257b26800 1 -- start start 2024-09-13T19:16:14.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.188+0000 7fb257b26800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb58a55e90 0x55bb58a5d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.188+0000 7fb257b26800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bb58a56e30 con 0x55bb58a55e90 2024-09-13T19:16:14.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.189+0000 7fb25401e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb58a55e90 0x55bb58a5d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.189+0000 7fb25401e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb58a55e90 0x55bb58a5d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53674/0 (socket says 172.21.15.102:53674) 2024-09-13T19:16:14.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.189+0000 7fb25401e640 1 -- 172.21.15.102:0/735022024 learned_addr learned my addr 172.21.15.102:0/735022024 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:14.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.189+0000 7fb25401e640 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb58a5d860 con 0x55bb58a55e90 2024-09-13T19:16:14.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.189+0000 7fb25401e640 1 --2- 172.21.15.102:0/735022024 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb58a55e90 0x55bb58a5d320 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb24c01fbf0 tx=0x7fb24c04ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.189+0000 7fb1317fa640 1 -- 172.21.15.102:0/735022024 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb24c01f470 con 0x55bb58a55e90 2024-09-13T19:16:14.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.189+0000 7fb1317fa640 1 -- 172.21.15.102:0/735022024 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb24c01f610 con 0x55bb58a55e90 2024-09-13T19:16:14.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.189+0000 7fb1317fa640 1 -- 172.21.15.102:0/735022024 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb24c0204d0 con 0x55bb58a55e90 2024-09-13T19:16:14.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.189+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bb58a5daf0 con 0x55bb58a55e90 2024-09-13T19:16:14.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.189+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb58a5daf0 con 0x55bb58a55e90 2024-09-13T19:16:14.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.190+0000 7fb1317fa640 1 -- 172.21.15.102:0/735022024 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb24c020730 con 0x55bb58a55e90 2024-09-13T19:16:14.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.190+0000 7fb1317fa640 1 --2- 172.21.15.102:0/735022024 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb11c036b40 0x7fb11c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.190+0000 7fb1317fa640 1 -- 172.21.15.102:0/735022024 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fb24c007050 con 0x55bb58a55e90 2024-09-13T19:16:14.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.190+0000 7fb25381d640 1 --2- 172.21.15.102:0/735022024 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb11c036b40 0x7fb11c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.191+0000 7fb25381d640 1 --2- 172.21.15.102:0/735022024 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb11c036b40 0x7fb11c039000 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb24405cfd0 tx=0x7fb24408a000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.191+0000 7fb257b26800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.191+0000 7fb257b26800 1 --2- 172.21.15.102:0/735022024 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55bb58a68c40 0x55bb58a6b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.191+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a6b850 con 0x55bb58a68c40 2024-09-13T19:16:14.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.191+0000 7fb24b01c640 1 --2- 172.21.15.102:0/735022024 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55bb58a68c40 0x55bb58a6b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.191+0000 7fb24b01c640 1 --2- 172.21.15.102:0/735022024 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55bb58a68c40 0x55bb58a6b100 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.191+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb23c00f610 con 0x55bb58a68c40 2024-09-13T19:16:14.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.191+0000 7fb257b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:14.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.192+0000 7fb257b26800 20 realm 2024-09-13T19:16:14.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.192+0000 7fb257b26800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.192+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a68090 con 0x55bb58a68c40 2024-09-13T19:16:14.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.192+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb23c00f610 con 0x55bb58a68c40 2024-09-13T19:16:14.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.192+0000 7fb257b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:14.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.192+0000 7fb257b26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:14.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.192+0000 7fb257b26800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.192+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a6c340 con 0x55bb58a68c40 2024-09-13T19:16:14.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.192+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb23c00f610 con 0x55bb58a68c40 2024-09-13T19:16:14.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.192+0000 7fb257b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:14.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.192+0000 7fb257b26800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.192+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a6cc10 con 0x55bb58a68c40 2024-09-13T19:16:14.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.192+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb23c00f610 con 0x55bb58a68c40 2024-09-13T19:16:14.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.192+0000 7fb257b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:14.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.192+0000 7fb257b26800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.192+0000 7fb257b26800 1 --2- 172.21.15.102:0/735022024 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55bb58a6d630 0x55bb58a6fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.192+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a70110 con 0x55bb58a6d630 2024-09-13T19:16:14.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.192+0000 7fb25401e640 1 --2- 172.21.15.102:0/735022024 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55bb58a6d630 0x55bb58a6fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.193+0000 7fb25401e640 1 --2- 172.21.15.102:0/735022024 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55bb58a6d630 0x55bb58a6fa20 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.193+0000 7fb25401e640 1 -- 172.21.15.102:0/735022024 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb24c055070 con 0x55bb58a6d630 2024-09-13T19:16:14.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.193+0000 7fb257b26800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:14.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.193+0000 7fb257b26800 20 searching for the correct realm 2024-09-13T19:16:14.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.193+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a71a60 con 0x55bb58a6d630 2024-09-13T19:16:14.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.193+0000 7fb25401e640 1 -- 172.21.15.102:0/735022024 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb24c055070 con 0x55bb58a6d630 2024-09-13T19:16:14.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.193+0000 7fb25401e640 1 --2- 172.21.15.102:0/735022024 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fb24c011a60 0x7fb24c04d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.193+0000 7fb25401e640 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a71a60 con 0x7fb24c011a60 2024-09-13T19:16:14.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.193+0000 7fb25381d640 1 --2- 172.21.15.102:0/735022024 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fb24c011a60 0x7fb24c04d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.194+0000 7fb25381d640 1 --2- 172.21.15.102:0/735022024 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fb24c011a60 0x7fb24c04d990 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.194+0000 7fb25381d640 1 -- 172.21.15.102:0/735022024 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb24407f070 con 0x7fb24c011a60 2024-09-13T19:16:14.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.194+0000 7fb25381d640 1 --2- 172.21.15.102:0/735022024 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fb244078070 0x7fb2440643b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.194+0000 7fb25381d640 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a71a60 con 0x7fb244078070 2024-09-13T19:16:14.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.194+0000 7fb24b01c640 1 --2- 172.21.15.102:0/735022024 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fb244078070 0x7fb2440643b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.195+0000 7fb24b01c640 1 --2- 172.21.15.102:0/735022024 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fb244078070 0x7fb2440643b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.195+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb23c00f610 con 0x7fb244078070 2024-09-13T19:16:14.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.195+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a71a60 con 0x55bb58a68c40 2024-09-13T19:16:14.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.195+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb23c00f610 con 0x55bb58a68c40 2024-09-13T19:16:14.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.195+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a71a60 con 0x55bb58a68c40 2024-09-13T19:16:14.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.195+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb23c02b040 con 0x55bb58a68c40 2024-09-13T19:16:14.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.195+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a71a60 con 0x7fb244078070 2024-09-13T19:16:14.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.196+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb23c02b040 con 0x7fb244078070 2024-09-13T19:16:14.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.196+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a71a60 con 0x7fb244078070 2024-09-13T19:16:14.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.196+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb23c02b040 con 0x7fb244078070 2024-09-13T19:16:14.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.196+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a71a60 con 0x7fb24c011a60 2024-09-13T19:16:14.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.196+0000 7fb25381d640 1 -- 172.21.15.102:0/735022024 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb24407f070 con 0x7fb24c011a60 2024-09-13T19:16:14.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.196+0000 7fb25381d640 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a71a60 con 0x55bb58a6d630 2024-09-13T19:16:14.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.196+0000 7fb25401e640 1 -- 172.21.15.102:0/735022024 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb24c055070 con 0x55bb58a6d630 2024-09-13T19:16:14.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.196+0000 7fb25401e640 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a71a60 con 0x55bb58a68c40 2024-09-13T19:16:14.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.196+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb23c02b040 con 0x55bb58a68c40 2024-09-13T19:16:14.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.196+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a71a60 con 0x7fb244078070 2024-09-13T19:16:14.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.197+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb23c02b040 con 0x7fb244078070 2024-09-13T19:16:14.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.197+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a71a60 con 0x55bb58a68c40 2024-09-13T19:16:14.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.197+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb23c02b040 con 0x55bb58a68c40 2024-09-13T19:16:14.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.197+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a71a60 con 0x7fb24c011a60 2024-09-13T19:16:14.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.197+0000 7fb25381d640 1 -- 172.21.15.102:0/735022024 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb24407f070 con 0x7fb24c011a60 2024-09-13T19:16:14.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.197+0000 7fb25381d640 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a71a60 con 0x55bb58a6d630 2024-09-13T19:16:14.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.197+0000 7fb25401e640 1 -- 172.21.15.102:0/735022024 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb24c055070 con 0x55bb58a6d630 2024-09-13T19:16:14.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.197+0000 7fb25401e640 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a71a60 con 0x55bb58a6d630 2024-09-13T19:16:14.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.198+0000 7fb25401e640 1 -- 172.21.15.102:0/735022024 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=107b] v27'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb24c055070 con 0x55bb58a6d630 2024-09-13T19:16:14.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.198+0000 7fb25401e640 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a71a60 con 0x7fb244078070 2024-09-13T19:16:14.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.198+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb23c02b040 con 0x7fb244078070 2024-09-13T19:16:14.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.198+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a71a60 con 0x55bb58a6d630 2024-09-13T19:16:14.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.198+0000 7fb25401e640 1 -- 172.21.15.102:0/735022024 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb24c055070 con 0x55bb58a6d630 2024-09-13T19:16:14.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.198+0000 7fb25401e640 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a71a60 con 0x55bb58a6d630 2024-09-13T19:16:14.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.198+0000 7fb25401e640 1 -- 172.21.15.102:0/735022024 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb24c055070 con 0x55bb58a6d630 2024-09-13T19:16:14.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.198+0000 7fb25401e640 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a71a60 con 0x55bb58a68c40 2024-09-13T19:16:14.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.199+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb23c02b040 con 0x55bb58a68c40 2024-09-13T19:16:14.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.199+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a71a60 con 0x55bb58a68c40 2024-09-13T19:16:14.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.199+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb23c02b040 con 0x55bb58a68c40 2024-09-13T19:16:14.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.199+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a71a60 con 0x7fb244078070 2024-09-13T19:16:14.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.199+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb23c02b040 con 0x7fb244078070 2024-09-13T19:16:14.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.199+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a71a60 con 0x55bb58a6d630 2024-09-13T19:16:14.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.199+0000 7fb25401e640 1 -- 172.21.15.102:0/735022024 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb24c055070 con 0x55bb58a6d630 2024-09-13T19:16:14.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.199+0000 7fb25401e640 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a71a60 con 0x7fb24c011a60 2024-09-13T19:16:14.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.200+0000 7fb25381d640 1 -- 172.21.15.102:0/735022024 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb24407f070 con 0x7fb24c011a60 2024-09-13T19:16:14.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.200+0000 7fb25381d640 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a71a60 con 0x55bb58a68c40 2024-09-13T19:16:14.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.200+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb23c02b040 con 0x55bb58a68c40 2024-09-13T19:16:14.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.200+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a71a60 con 0x7fb244078070 2024-09-13T19:16:14.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.200+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb23c03b040 con 0x7fb244078070 2024-09-13T19:16:14.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.200+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a71a60 con 0x55bb58a6d630 2024-09-13T19:16:14.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.200+0000 7fb25401e640 1 -- 172.21.15.102:0/735022024 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb24c055070 con 0x55bb58a6d630 2024-09-13T19:16:14.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.200+0000 7fb25401e640 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a71a60 con 0x7fb244078070 2024-09-13T19:16:14.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.201+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb23c03b040 con 0x7fb244078070 2024-09-13T19:16:14.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.201+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a71a60 con 0x7fb24c011a60 2024-09-13T19:16:14.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.201+0000 7fb25381d640 1 -- 172.21.15.102:0/735022024 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb24407f070 con 0x7fb24c011a60 2024-09-13T19:16:14.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.201+0000 7fb25381d640 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a71a60 con 0x55bb58a6d630 2024-09-13T19:16:14.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.201+0000 7fb25401e640 1 -- 172.21.15.102:0/735022024 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb24c055070 con 0x55bb58a6d630 2024-09-13T19:16:14.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.201+0000 7fb25401e640 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a71a60 con 0x7fb244078070 2024-09-13T19:16:14.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.201+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb23c03b040 con 0x7fb244078070 2024-09-13T19:16:14.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.201+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a71a60 con 0x55bb58a68c40 2024-09-13T19:16:14.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.202+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb23c03b040 con 0x55bb58a68c40 2024-09-13T19:16:14.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.202+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a71a60 con 0x7fb24c011a60 2024-09-13T19:16:14.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.202+0000 7fb25381d640 1 -- 172.21.15.102:0/735022024 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb24407f070 con 0x7fb24c011a60 2024-09-13T19:16:14.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.202+0000 7fb257b26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:14.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.202+0000 7fb257b26800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:14.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.202+0000 7fb257b26800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:14.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.202+0000 7fb257b26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:14.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.202+0000 7fb257b26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:14.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.202+0000 7fb257b26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:14.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.202+0000 7fb257b26800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.202+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a70b00 con 0x55bb58a68c40 2024-09-13T19:16:14.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.202+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb23c03b040 con 0x55bb58a68c40 2024-09-13T19:16:14.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.202+0000 7fb257b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:14.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.202+0000 7fb257b26800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.202+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a713a0 con 0x55bb58a68c40 2024-09-13T19:16:14.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.202+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb23c03b040 con 0x55bb58a68c40 2024-09-13T19:16:14.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.202+0000 7fb257b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:14.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.202+0000 7fb257b26800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.202+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a71ee0 con 0x55bb58a6d630 2024-09-13T19:16:14.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.203+0000 7fb25401e640 1 -- 172.21.15.102:0/735022024 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb24c055070 con 0x55bb58a6d630 2024-09-13T19:16:14.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.203+0000 7fb257b26800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:14.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.203+0000 7fb257b26800 20 zone default found 2024-09-13T19:16:14.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.203+0000 7fb257b26800 4 Realm: () 2024-09-13T19:16:14.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.203+0000 7fb257b26800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:14.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.203+0000 7fb257b26800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:14.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.203+0000 7fb257b26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:14.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.203+0000 7fb257b26800 20 zonegroup default 2024-09-13T19:16:14.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.203+0000 7fb257b26800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.203+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a71000 con 0x7fb244078070 2024-09-13T19:16:14.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.203+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb23c03b040 con 0x7fb244078070 2024-09-13T19:16:14.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.203+0000 7fb257b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:14.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.203+0000 7fb257b26800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.203+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a741b0 con 0x55bb58a6d630 2024-09-13T19:16:14.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.203+0000 7fb25401e640 1 -- 172.21.15.102:0/735022024 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb24c055070 con 0x55bb58a6d630 2024-09-13T19:16:14.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.203+0000 7fb257b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:14.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.203+0000 7fb257b26800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.203+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a74550 con 0x55bb58a6d630 2024-09-13T19:16:14.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.204+0000 7fb25401e640 1 -- 172.21.15.102:0/735022024 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb24c055070 con 0x55bb58a6d630 2024-09-13T19:16:14.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.204+0000 7fb257b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:14.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.204+0000 7fb257b26800 20 started sync module instance, tier type = 2024-09-13T19:16:14.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.204+0000 7fb257b26800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:14.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.204+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a73650 con 0x7fb24c011a60 2024-09-13T19:16:14.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.205+0000 7fb25381d640 1 -- 172.21.15.102:0/735022024 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(44 notify.0 [create] v34'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb24407f070 con 0x7fb24c011a60 2024-09-13T19:16:14.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.205+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94263134599792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a732b0 con 0x7fb24c011a60 2024-09-13T19:16:14.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.205+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a75430 con 0x55bb58a68c40 2024-09-13T19:16:14.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.206+0000 7fb25381d640 1 -- 172.21.15.102:0/735022024 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94263134599792] v34'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb24407f070 con 0x7fb24c011a60 2024-09-13T19:16:14.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.206+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v34'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb23c03b040 con 0x55bb58a68c40 2024-09-13T19:16:14.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.206+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94263134605184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a75850 con 0x55bb58a68c40 2024-09-13T19:16:14.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.206+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a76210 con 0x55bb58a6d630 2024-09-13T19:16:14.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.207+0000 7fb25401e640 1 -- 172.21.15.102:0/735022024 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v34'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb24c055070 con 0x55bb58a6d630 2024-09-13T19:16:14.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.207+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94263134608736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a761c0 con 0x55bb58a6d630 2024-09-13T19:16:14.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.207+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a771e0 con 0x7fb24c011a60 2024-09-13T19:16:14.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.208+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94263134605184] v34'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb23c03b040 con 0x55bb58a68c40 2024-09-13T19:16:14.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.208+0000 7fb25401e640 1 -- 172.21.15.102:0/735022024 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94263134608736] v34'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb24c055070 con 0x55bb58a6d630 2024-09-13T19:16:14.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.208+0000 7fb25381d640 1 -- 172.21.15.102:0/735022024 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(50 notify.3 [create] v34'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb24407f070 con 0x7fb24c011a60 2024-09-13T19:16:14.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.208+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94263134610944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a753a0 con 0x7fb24c011a60 2024-09-13T19:16:14.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.209+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a77a80 con 0x55bb58a68c40 2024-09-13T19:16:14.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.210+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v34'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb23c03b040 con 0x55bb58a68c40 2024-09-13T19:16:14.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.210+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94263134615504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a78350 con 0x55bb58a68c40 2024-09-13T19:16:14.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.210+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a78e10 con 0x7fb244078070 2024-09-13T19:16:14.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.210+0000 7fb25381d640 1 -- 172.21.15.102:0/735022024 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94263134610944] v34'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb24407f070 con 0x7fb24c011a60 2024-09-13T19:16:14.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.211+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(54 notify.5 [create] v34'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb23c03b040 con 0x7fb244078070 2024-09-13T19:16:14.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.211+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94263134619872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a78dd0 con 0x7fb244078070 2024-09-13T19:16:14.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.211+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a79840 con 0x7fb244078070 2024-09-13T19:16:14.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.211+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94263134615504] v34'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb23c03b040 con 0x55bb58a68c40 2024-09-13T19:16:14.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.212+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94263134619872] v34'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb23c03b040 con 0x7fb244078070 2024-09-13T19:16:14.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.212+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(56 notify.6 [create] v34'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb23c03b040 con 0x7fb244078070 2024-09-13T19:16:14.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.212+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94263134612688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a77e50 con 0x7fb244078070 2024-09-13T19:16:14.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.212+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a79cf0 con 0x7fb244078070 2024-09-13T19:16:14.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.213+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94263134612688] v34'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb23c03b040 con 0x7fb244078070 2024-09-13T19:16:14.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.213+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(58 notify.7 [create] v34'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb23c03b040 con 0x7fb244078070 2024-09-13T19:16:14.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.213+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94263134622576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a79cf0 con 0x7fb244078070 2024-09-13T19:16:14.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.213+0000 7fb257b26800 20 add_watcher() i=0 2024-09-13T19:16:14.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.213+0000 7fb257b26800 20 add_watcher() i=1 2024-09-13T19:16:14.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.213+0000 7fb257b26800 20 add_watcher() i=2 2024-09-13T19:16:14.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.213+0000 7fb257b26800 20 add_watcher() i=3 2024-09-13T19:16:14.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.213+0000 7fb257b26800 20 add_watcher() i=4 2024-09-13T19:16:14.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.213+0000 7fb257b26800 20 add_watcher() i=5 2024-09-13T19:16:14.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.213+0000 7fb257b26800 20 add_watcher() i=6 2024-09-13T19:16:14.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.214+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94263134622576] v34'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb23c03b040 con 0x7fb244078070 2024-09-13T19:16:14.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.214+0000 7fb257b26800 20 add_watcher() i=7 2024-09-13T19:16:14.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.214+0000 7fb257b26800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:14.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.214+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a7d090 con 0x55bb58a68c40 2024-09-13T19:16:14.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.214+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb23c03b040 con 0x55bb58a68c40 2024-09-13T19:16:14.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.214+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94263134636624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a79e60 con 0x55bb58a68c40 2024-09-13T19:16:14.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.215+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94263134636624] v34'41 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb23c03b040 con 0x55bb58a68c40 2024-09-13T19:16:14.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.215+0000 7fb109fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:14.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.215+0000 7fb257b26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:14.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.215+0000 7fb257b26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:14.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.215+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a85b80 con 0x55bb58a68c40 2024-09-13T19:16:14.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.217+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb23c03b040 con 0x55bb58a68c40 2024-09-13T19:16:14.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.217+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a861d0 con 0x7fb244078070 2024-09-13T19:16:14.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.218+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'13 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb23c03b040 con 0x7fb244078070 2024-09-13T19:16:14.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.218+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a86630 con 0x55bb58a6d630 2024-09-13T19:16:14.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.219+0000 7fb25401e640 1 -- 172.21.15.102:0/735022024 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb24c055070 con 0x55bb58a6d630 2024-09-13T19:16:14.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.219+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a86490 con 0x55bb58a68c40 2024-09-13T19:16:14.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.220+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'42 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb23c03b040 con 0x55bb58a68c40 2024-09-13T19:16:14.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.220+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a85610 con 0x7fb24c011a60 2024-09-13T19:16:14.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.221+0000 7fb25381d640 1 -- 172.21.15.102:0/735022024 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'29 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb24407f070 con 0x7fb24c011a60 2024-09-13T19:16:14.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.221+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a86ae0 con 0x55bb58a6d630 2024-09-13T19:16:14.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.222+0000 7fb25401e640 1 -- 172.21.15.102:0/735022024 <== osd.3 v2:172.21.15.102:6800/3096737090 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'19 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb24c055070 con 0x55bb58a6d630 2024-09-13T19:16:14.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.222+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a86ae0 con 0x55bb58a68c40 2024-09-13T19:16:14.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.223+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb23c03b040 con 0x55bb58a68c40 2024-09-13T19:16:14.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.223+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a86f90 con 0x7fb244078070 2024-09-13T19:16:14.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.224+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'19 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb23c03b040 con 0x7fb244078070 2024-09-13T19:16:14.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.224+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a86f90 con 0x7fb24c011a60 2024-09-13T19:16:14.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.226+0000 7fb25381d640 1 -- 172.21.15.102:0/735022024 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb24407f070 con 0x7fb24c011a60 2024-09-13T19:16:14.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.226+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a86f90 con 0x55bb58a6d630 2024-09-13T19:16:14.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.227+0000 7fb25401e640 1 -- 172.21.15.102:0/735022024 <== osd.3 v2:172.21.15.102:6800/3096737090 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb24c055070 con 0x55bb58a6d630 2024-09-13T19:16:14.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.227+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a86f90 con 0x7fb24c011a60 2024-09-13T19:16:14.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.228+0000 7fb25381d640 1 -- 172.21.15.102:0/735022024 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'30 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb24407f070 con 0x7fb24c011a60 2024-09-13T19:16:14.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.228+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a86f90 con 0x7fb244078070 2024-09-13T19:16:14.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.229+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb23c03b040 con 0x7fb244078070 2024-09-13T19:16:14.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.229+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a86f90 con 0x7fb24c011a60 2024-09-13T19:16:14.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.230+0000 7fb25381d640 1 -- 172.21.15.102:0/735022024 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb24407f070 con 0x7fb24c011a60 2024-09-13T19:16:14.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.230+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a87070 con 0x7fb244078070 2024-09-13T19:16:14.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.231+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.0 v2:172.21.15.53:6800/4021716951 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'25 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb23c03b040 con 0x7fb244078070 2024-09-13T19:16:14.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.231+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a86ae0 con 0x55bb58a68c40 2024-09-13T19:16:14.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.232+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'43 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb23c03b040 con 0x55bb58a68c40 2024-09-13T19:16:14.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.232+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a87070 con 0x55bb58a6d630 2024-09-13T19:16:14.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.233+0000 7fb25401e640 1 -- 172.21.15.102:0/735022024 <== osd.3 v2:172.21.15.102:6800/3096737090 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb24c055070 con 0x55bb58a6d630 2024-09-13T19:16:14.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.233+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a87070 con 0x7fb24c011a60 2024-09-13T19:16:14.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.234+0000 7fb25381d640 1 -- 172.21.15.102:0/735022024 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'31 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb24407f070 con 0x7fb24c011a60 2024-09-13T19:16:14.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.234+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a86bd0 con 0x55bb58a6d630 2024-09-13T19:16:14.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.235+0000 7fb25401e640 1 -- 172.21.15.102:0/735022024 <== osd.3 v2:172.21.15.102:6800/3096737090 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb24c055070 con 0x55bb58a6d630 2024-09-13T19:16:14.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.235+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a86bd0 con 0x55bb58a68c40 2024-09-13T19:16:14.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.236+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb23c03b040 con 0x55bb58a68c40 2024-09-13T19:16:14.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.236+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a87160 con 0x55bb58a68c40 2024-09-13T19:16:14.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.237+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'44 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb23c03b040 con 0x55bb58a68c40 2024-09-13T19:16:14.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.237+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a87160 con 0x55bb58a6d630 2024-09-13T19:16:14.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.238+0000 7fb25401e640 1 -- 172.21.15.102:0/735022024 <== osd.3 v2:172.21.15.102:6800/3096737090 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'24 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb24c055070 con 0x55bb58a6d630 2024-09-13T19:16:14.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.238+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a87100 con 0x7fb24c011a60 2024-09-13T19:16:14.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.239+0000 7fb25381d640 1 -- 172.21.15.102:0/735022024 <== osd.2 v2:172.21.15.102:6816/2238176080 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb24407f070 con 0x7fb24c011a60 2024-09-13T19:16:14.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.239+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a87100 con 0x55bb58a6d630 2024-09-13T19:16:14.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.240+0000 7fb25401e640 1 -- 172.21.15.102:0/735022024 <== osd.3 v2:172.21.15.102:6800/3096737090 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb24c055070 con 0x55bb58a6d630 2024-09-13T19:16:14.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.240+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a87070 con 0x55bb58a6d630 2024-09-13T19:16:14.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.241+0000 7fb25401e640 1 -- 172.21.15.102:0/735022024 <== osd.3 v2:172.21.15.102:6800/3096737090 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb24c055070 con 0x55bb58a6d630 2024-09-13T19:16:14.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.241+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a87070 con 0x55bb58a6d630 2024-09-13T19:16:14.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.242+0000 7fb25401e640 1 -- 172.21.15.102:0/735022024 <== osd.3 v2:172.21.15.102:6800/3096737090 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'9 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb24c055070 con 0x55bb58a6d630 2024-09-13T19:16:14.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.242+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a87070 con 0x55bb58a6d630 2024-09-13T19:16:14.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.243+0000 7fb25401e640 1 -- 172.21.15.102:0/735022024 <== osd.3 v2:172.21.15.102:6800/3096737090 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'20 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb24c055070 con 0x55bb58a6d630 2024-09-13T19:16:14.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.243+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a87070 con 0x7fb244078070 2024-09-13T19:16:14.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.244+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.0 v2:172.21.15.53:6800/4021716951 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb23c03b040 con 0x7fb244078070 2024-09-13T19:16:14.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.244+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a875c0 con 0x55bb58a6d630 2024-09-13T19:16:14.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.245+0000 7fb25401e640 1 -- 172.21.15.102:0/735022024 <== osd.3 v2:172.21.15.102:6800/3096737090 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb24c055070 con 0x55bb58a6d630 2024-09-13T19:16:14.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.245+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a875c0 con 0x7fb244078070 2024-09-13T19:16:14.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.246+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.0 v2:172.21.15.53:6800/4021716951 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'20 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb23c03b040 con 0x7fb244078070 2024-09-13T19:16:14.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.246+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a875c0 con 0x55bb58a6d630 2024-09-13T19:16:14.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.247+0000 7fb25401e640 1 -- 172.21.15.102:0/735022024 <== osd.3 v2:172.21.15.102:6800/3096737090 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'25 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb24c055070 con 0x55bb58a6d630 2024-09-13T19:16:14.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.247+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a875c0 con 0x7fb244078070 2024-09-13T19:16:14.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.248+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.0 v2:172.21.15.53:6800/4021716951 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'26 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb23c03b040 con 0x7fb244078070 2024-09-13T19:16:14.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.248+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a875c0 con 0x7fb24c011a60 2024-09-13T19:16:14.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.249+0000 7fb25381d640 1 -- 172.21.15.102:0/735022024 <== osd.2 v2:172.21.15.102:6816/2238176080 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb24407f070 con 0x7fb24c011a60 2024-09-13T19:16:14.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.250+0000 7fb108fe1640 20 reqs_thread_entry: start 2024-09-13T19:16:14.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.250+0000 7fb257b26800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:14.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.250+0000 7fb257b26800 20 Filter name: none 2024-09-13T19:16:14.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.250+0000 7fb0827fc640 20 reqs_thread_entry: start 2024-09-13T19:16:14.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.250+0000 7fb257b26800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:16:14.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.250+0000 7fb257b26800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.250+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb58ab20a0 con 0x55bb58a68c40 2024-09-13T19:16:14.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.250+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fb23c03b040 con 0x55bb58a68c40 2024-09-13T19:16:14.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.250+0000 7fb257b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:14.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.250+0000 7fb257b26800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-13T19:16:14.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.250+0000 7fb257b26800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:16:14.255 INFO:teuthology.orchestra.run.smithi102.stderr:could not remove user: unable to remove user, user does not exist 2024-09-13T19:16:14.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.251+0000 7fb109fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:14.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.251+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94263134636624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a81560 con 0x55bb58a68c40 2024-09-13T19:16:14.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.252+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.1 v2:172.21.15.102:6808/2204418452 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94263134636624] v34'45 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb23c03b040 con 0x55bb58a68c40 2024-09-13T19:16:14.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.252+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94263134599792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a81560 con 0x7fb24c011a60 2024-09-13T19:16:14.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.253+0000 7fb25381d640 1 -- 172.21.15.102:0/735022024 <== osd.2 v2:172.21.15.102:6816/2238176080 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94263134599792] v34'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb24407f070 con 0x7fb24c011a60 2024-09-13T19:16:14.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.253+0000 7fb257b26800 20 remove_watcher() i=0 2024-09-13T19:16:14.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.253+0000 7fb257b26800 2 removed watcher, disabling cache 2024-09-13T19:16:14.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.253+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94263134605184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a73a70 con 0x55bb58a68c40 2024-09-13T19:16:14.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.254+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.1 v2:172.21.15.102:6808/2204418452 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94263134605184] v34'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb23c03b040 con 0x55bb58a68c40 2024-09-13T19:16:14.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.254+0000 7fb257b26800 20 remove_watcher() i=1 2024-09-13T19:16:14.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.254+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94263134608736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a74f80 con 0x55bb58a6d630 2024-09-13T19:16:14.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.256+0000 7fb25401e640 1 -- 172.21.15.102:0/735022024 <== osd.3 v2:172.21.15.102:6800/3096737090 28 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94263134608736] v34'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb24c055070 con 0x55bb58a6d630 2024-09-13T19:16:14.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.256+0000 7fb257b26800 20 remove_watcher() i=2 2024-09-13T19:16:14.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.256+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94263134610944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a74f80 con 0x7fb24c011a60 2024-09-13T19:16:14.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.256+0000 7fb25381d640 1 -- 172.21.15.102:0/735022024 <== osd.2 v2:172.21.15.102:6816/2238176080 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94263134610944] v34'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb24407f070 con 0x7fb24c011a60 2024-09-13T19:16:14.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.257+0000 7fb257b26800 20 remove_watcher() i=3 2024-09-13T19:16:14.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.257+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94263134615504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a76600 con 0x55bb58a68c40 2024-09-13T19:16:14.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.258+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.1 v2:172.21.15.102:6808/2204418452 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94263134615504] v34'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb23c03b040 con 0x55bb58a68c40 2024-09-13T19:16:14.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.258+0000 7fb257b26800 20 remove_watcher() i=4 2024-09-13T19:16:14.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.258+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94263134619872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a74f80 con 0x7fb244078070 2024-09-13T19:16:14.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.259+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.0 v2:172.21.15.53:6800/4021716951 24 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94263134619872] v34'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb23c03b040 con 0x7fb244078070 2024-09-13T19:16:14.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.259+0000 7fb257b26800 20 remove_watcher() i=5 2024-09-13T19:16:14.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.259+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94263134612688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a788e0 con 0x7fb244078070 2024-09-13T19:16:14.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.260+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.0 v2:172.21.15.53:6800/4021716951 25 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94263134612688] v34'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb23c03b040 con 0x7fb244078070 2024-09-13T19:16:14.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.260+0000 7fb257b26800 20 remove_watcher() i=6 2024-09-13T19:16:14.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.260+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94263134622576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb58a76cd0 con 0x7fb244078070 2024-09-13T19:16:14.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.261+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 <== osd.0 v2:172.21.15.53:6800/4021716951 26 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94263134622576] v34'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb23c03b040 con 0x7fb244078070 2024-09-13T19:16:14.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.261+0000 7fb257b26800 20 remove_watcher() i=7 2024-09-13T19:16:14.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.261+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fb244078070 msgr2=0x7fb2440643b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.261+0000 7fb257b26800 1 --2- 172.21.15.102:0/735022024 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fb244078070 0x7fb2440643b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.261+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55bb58a68c40 msgr2=0x55bb58a6b100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.261+0000 7fb257b26800 1 --2- 172.21.15.102:0/735022024 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55bb58a68c40 0x55bb58a6b100 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.261+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fb24c011a60 msgr2=0x7fb24c04d990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.261+0000 7fb257b26800 1 --2- 172.21.15.102:0/735022024 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fb24c011a60 0x7fb24c04d990 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.261+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55bb58a6d630 msgr2=0x55bb58a6fa20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.261+0000 7fb257b26800 1 --2- 172.21.15.102:0/735022024 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55bb58a6d630 0x55bb58a6fa20 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.261+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb11c036b40 msgr2=0x7fb11c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.261+0000 7fb257b26800 1 --2- 172.21.15.102:0/735022024 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb11c036b40 0x7fb11c039000 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb24405cfd0 tx=0x7fb24408a000 comp rx=0 tx=0).stop 2024-09-13T19:16:14.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.261+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb58a55e90 msgr2=0x55bb58a5d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.261+0000 7fb24b01c640 1 -- 172.21.15.102:0/735022024 reap_dead start 2024-09-13T19:16:14.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.261+0000 7fb257b26800 1 --2- 172.21.15.102:0/735022024 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb58a55e90 0x55bb58a5d320 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb24c01fbf0 tx=0x7fb24c04ccc0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.261+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 shutdown_connections 2024-09-13T19:16:14.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.261+0000 7fb257b26800 1 --2- 172.21.15.102:0/735022024 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb58a55e90 0x55bb58a5d320 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.261+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 >> 172.21.15.102:0/735022024 conn(0x55bb58a52240 msgr2=0x55bb58a575a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:14.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.261+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 shutdown_connections 2024-09-13T19:16:14.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.261+0000 7fb257b26800 1 -- 172.21.15.102:0/735022024 wait complete. 2024-09-13T19:16:14.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.261+0000 7fb257b26800 1 -- 172.21.15.102:0/4114544870 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb12c036b90 msgr2=0x7fb12c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.262+0000 7fb257b26800 1 --2- 172.21.15.102:0/4114544870 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb12c036b90 0x7fb12c039050 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x55bb58a23df0 tx=0x7fb24408f3b0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.262+0000 7fb257b26800 1 -- 172.21.15.102:0/4114544870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb58a491c0 msgr2=0x55bb58a495e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.262+0000 7fb257b26800 1 --2- 172.21.15.102:0/4114544870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb58a491c0 0x55bb58a495e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x55bb58a24a30 tx=0x7fb24c0167b0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.262+0000 7fb257b26800 1 -- 172.21.15.102:0/4114544870 shutdown_connections 2024-09-13T19:16:14.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.262+0000 7fb257b26800 1 --2- 172.21.15.102:0/4114544870 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb12c036b90 0x7fb12c039050 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.262+0000 7fb257b26800 1 --2- 172.21.15.102:0/4114544870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb58a491c0 0x55bb58a495e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.262+0000 7fb257b26800 1 -- 172.21.15.102:0/4114544870 >> 172.21.15.102:0/4114544870 conn(0x55bb58a3e150 msgr2=0x55bb58a40cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:14.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.262+0000 7fb257b26800 1 -- 172.21.15.102:0/4114544870 shutdown_connections 2024-09-13T19:16:14.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.262+0000 7fb257b26800 1 -- 172.21.15.102:0/4114544870 wait complete. 2024-09-13T19:16:14.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.262+0000 7fb257b26800 1 -- 172.21.15.102:0/3517822131 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55bb58934e90 msgr2=0x55bb58a35560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.262+0000 7fb257b26800 1 --2- 172.21.15.102:0/3517822131 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55bb58934e90 0x55bb58a35560 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.262+0000 7fb257b26800 1 -- 172.21.15.102:0/3517822131 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55bb58a37d70 msgr2=0x55bb58a3a160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.262+0000 7fb257b26800 1 --2- 172.21.15.102:0/3517822131 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55bb58a37d70 0x55bb58a3a160 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.262+0000 7fb257b26800 1 -- 172.21.15.102:0/3517822131 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb13c036b40 msgr2=0x7fb13c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.262+0000 7fb257b26800 1 --2- 172.21.15.102:0/3517822131 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb13c036b40 0x7fb13c039000 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb23c000f60 tx=0x7fb23c001370 comp rx=0 tx=0).stop 2024-09-13T19:16:14.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.262+0000 7fb257b26800 1 -- 172.21.15.102:0/3517822131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb58934550 msgr2=0x55bb58a24ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.262+0000 7fb257b26800 1 --2- 172.21.15.102:0/3517822131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb58934550 0x55bb58a24ed0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb244025da0 tx=0x7fb244002fb0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.262+0000 7fb257b26800 1 -- 172.21.15.102:0/3517822131 shutdown_connections 2024-09-13T19:16:14.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.262+0000 7fb257b26800 1 --2- 172.21.15.102:0/3517822131 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55bb58a37d70 0x55bb58a3a160 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.262+0000 7fb257b26800 1 --2- 172.21.15.102:0/3517822131 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55bb58934e90 0x55bb58a35560 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.262+0000 7fb257b26800 1 --2- 172.21.15.102:0/3517822131 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb13c036b40 0x7fb13c039000 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.262+0000 7fb257b26800 1 --2- 172.21.15.102:0/3517822131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb58934550 0x55bb58a24ed0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.262+0000 7fb257b26800 1 -- 172.21.15.102:0/3517822131 >> 172.21.15.102:0/3517822131 conn(0x55bb5892fde0 msgr2=0x55bb58a1d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:14.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.262+0000 7fb257b26800 1 -- 172.21.15.102:0/3517822131 shutdown_connections 2024-09-13T19:16:14.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.262+0000 7fb257b26800 1 -- 172.21.15.102:0/3517822131 wait complete. 2024-09-13T19:16:14.274 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T19:16:14.275 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-13T19:16:14.275 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-13T19:16:14.275 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-13T19:16:14.321 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:14.321 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:14.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.317+0000 7f64be922800 1 Processor -- start 2024-09-13T19:16:14.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.318+0000 7f64be922800 1 -- start start 2024-09-13T19:16:14.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.318+0000 7f64be922800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5651dc0ed5e0 0x5651dc0ed9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.318+0000 7f64be922800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5651dbfadb30 con 0x5651dc0edf20 2024-09-13T19:16:14.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.318+0000 7f64be922800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5651dbf8f360 con 0x5651dc0ed5e0 2024-09-13T19:16:14.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.318+0000 7f64ba5b8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5651dc0ed5e0 0x5651dc0ed9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.318+0000 7f64ba5b8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5651dc0ed5e0 0x5651dc0ed9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53684/0 (socket says 172.21.15.102:53684) 2024-09-13T19:16:14.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.318+0000 7f64ba5b8640 1 -- 172.21.15.102:0/1100820297 learned_addr learned my addr 172.21.15.102:0/1100820297 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:14.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.318+0000 7f64b1db7640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5651dc0edf20 0x5651dc0f2aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:49760/0 (socket says 172.21.15.102:49760) 2024-09-13T19:16:14.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.318+0000 7f64ba5b8640 1 -- 172.21.15.102:0/1100820297 >> v1:172.21.15.53:6789/0 conn(0x5651dc0edf20 legacy=0x5651dc0f2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.318+0000 7f64ba5b8640 1 -- 172.21.15.102:0/1100820297 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651dbfb5e00 con 0x5651dc0ed5e0 2024-09-13T19:16:14.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.320+0000 7f64ba5b8640 1 --2- 172.21.15.102:0/1100820297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651dc0ed5e0 0x5651dc0ed9e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f64ac00a6b0 tx=0x7f64ac047e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65c1687ae2609387 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.320+0000 7f64b9db7640 1 -- 172.21.15.102:0/1100820297 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64ac00a200 con 0x5651dc0ed5e0 2024-09-13T19:16:14.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.320+0000 7f64b9db7640 1 -- 172.21.15.102:0/1100820297 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64ac00a3a0 con 0x5651dc0ed5e0 2024-09-13T19:16:14.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.320+0000 7f64b9db7640 1 -- 172.21.15.102:0/1100820297 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64ac008700 con 0x5651dc0ed5e0 2024-09-13T19:16:14.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.321+0000 7f64be922800 1 -- 172.21.15.102:0/1100820297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651dc0ed5e0 msgr2=0x5651dc0ed9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.321+0000 7f64be922800 1 --2- 172.21.15.102:0/1100820297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651dc0ed5e0 0x5651dc0ed9e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f64ac00a6b0 tx=0x7f64ac047e30 comp rx=0 tx=0).stop 2024-09-13T19:16:14.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.321+0000 7f64be922800 1 -- 172.21.15.102:0/1100820297 shutdown_connections 2024-09-13T19:16:14.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.321+0000 7f64be922800 1 --2- 172.21.15.102:0/1100820297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651dc0ed5e0 0x5651dc0ed9e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.321+0000 7f64be922800 1 -- 172.21.15.102:0/1100820297 >> 172.21.15.102:0/1100820297 conn(0x5651dc0e8e90 msgr2=0x5651dc0eb2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:14.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.321+0000 7f64be922800 1 -- 172.21.15.102:0/1100820297 shutdown_connections 2024-09-13T19:16:14.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.321+0000 7f64be922800 1 -- 172.21.15.102:0/1100820297 wait complete. 2024-09-13T19:16:14.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.334+0000 7f64be922800 1 Processor -- start 2024-09-13T19:16:14.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.334+0000 7f64be922800 1 -- start start 2024-09-13T19:16:14.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.334+0000 7f64be922800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651dc0ed5e0 0x5651dc1db720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.334+0000 7f64be922800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5651dc03a350 con 0x5651dc0ed5e0 2024-09-13T19:16:14.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.335+0000 7f64ba5b8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651dc0ed5e0 0x5651dc1db720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.335+0000 7f64ba5b8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651dc0ed5e0 0x5651dc1db720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53686/0 (socket says 172.21.15.102:53686) 2024-09-13T19:16:14.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.335+0000 7f64ba5b8640 1 -- 172.21.15.102:0/3564576403 learned_addr learned my addr 172.21.15.102:0/3564576403 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:14.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.335+0000 7f64ba5b8640 1 -- 172.21.15.102:0/3564576403 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651dbf87bc0 con 0x5651dc0ed5e0 2024-09-13T19:16:14.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.335+0000 7f64ba5b8640 1 --2- 172.21.15.102:0/3564576403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651dc0ed5e0 0x5651dc1db720 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f64ac048360 tx=0x7f64ac051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6749d57da398a0f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.335+0000 7f63a8608640 1 -- 172.21.15.102:0/3564576403 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64ac00a200 con 0x5651dc0ed5e0 2024-09-13T19:16:14.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.335+0000 7f63a8608640 1 -- 172.21.15.102:0/3564576403 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64ac008590 con 0x5651dc0ed5e0 2024-09-13T19:16:14.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.335+0000 7f63a8608640 1 -- 172.21.15.102:0/3564576403 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64ac0088f0 con 0x5651dc0ed5e0 2024-09-13T19:16:14.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.336+0000 7f64be922800 1 -- 172.21.15.102:0/3564576403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651dc0ed5e0 msgr2=0x5651dc1db720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.336+0000 7f64be922800 1 --2- 172.21.15.102:0/3564576403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651dc0ed5e0 0x5651dc1db720 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f64ac048360 tx=0x7f64ac051000 comp rx=0 tx=0).stop 2024-09-13T19:16:14.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.336+0000 7f64be922800 1 -- 172.21.15.102:0/3564576403 shutdown_connections 2024-09-13T19:16:14.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.336+0000 7f64be922800 1 --2- 172.21.15.102:0/3564576403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651dc0ed5e0 0x5651dc1db720 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.336+0000 7f64be922800 1 -- 172.21.15.102:0/3564576403 >> 172.21.15.102:0/3564576403 conn(0x5651dc0e8e90 msgr2=0x5651dc1d70e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:14.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.336+0000 7f64be922800 1 -- 172.21.15.102:0/3564576403 shutdown_connections 2024-09-13T19:16:14.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.336+0000 7f64be922800 1 -- 172.21.15.102:0/3564576403 wait complete. 2024-09-13T19:16:14.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.336+0000 7f64be922800 1 Processor -- start 2024-09-13T19:16:14.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.337+0000 7f64be922800 1 -- start start 2024-09-13T19:16:14.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.337+0000 7f64be922800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651dc0ed5e0 0x5651dc1e3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.337+0000 7f64be922800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5651dc0f45a0 con 0x5651dc0ed5e0 2024-09-13T19:16:14.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.337+0000 7f64ba5b8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651dc0ed5e0 0x5651dc1e3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.337+0000 7f64ba5b8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651dc0ed5e0 0x5651dc1e3020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53692/0 (socket says 172.21.15.102:53692) 2024-09-13T19:16:14.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.337+0000 7f64ba5b8640 1 -- 172.21.15.102:0/452714561 learned_addr learned my addr 172.21.15.102:0/452714561 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:14.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.337+0000 7f64ba5b8640 1 -- 172.21.15.102:0/452714561 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651dbf9bfe0 con 0x5651dc0ed5e0 2024-09-13T19:16:14.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.338+0000 7f64ba5b8640 1 --2- 172.21.15.102:0/452714561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651dc0ed5e0 0x5651dc1e3020 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f64ac059040 tx=0x7f64ac002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.338+0000 7f63a6e05640 1 -- 172.21.15.102:0/452714561 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64ac070070 con 0x5651dc0ed5e0 2024-09-13T19:16:14.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.338+0000 7f63a6e05640 1 -- 172.21.15.102:0/452714561 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64ac04f4c0 con 0x5651dc0ed5e0 2024-09-13T19:16:14.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.338+0000 7f63a6e05640 1 -- 172.21.15.102:0/452714561 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64ac04f7a0 con 0x5651dc0ed5e0 2024-09-13T19:16:14.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.338+0000 7f64be922800 1 -- 172.21.15.102:0/452714561 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5651dc1e3560 con 0x5651dc0ed5e0 2024-09-13T19:16:14.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.338+0000 7f64be922800 1 -- 172.21.15.102:0/452714561 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651dc1e3a20 con 0x5651dc0ed5e0 2024-09-13T19:16:14.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.338+0000 7f64be922800 1 Processor -- start 2024-09-13T19:16:14.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.338+0000 7f64be922800 1 -- start start 2024-09-13T19:16:14.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.339+0000 7f63a6e05640 1 -- 172.21.15.102:0/452714561 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f64ac073070 con 0x5651dc0ed5e0 2024-09-13T19:16:14.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.339+0000 7f64be922800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651dc1efd40 0x5651dc1f0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.339+0000 7f64be922800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5651dbf89580 con 0x5651dc1efd40 2024-09-13T19:16:14.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.339+0000 7f63a6e05640 1 --2- 172.21.15.102:0/452714561 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f63a0036b40 0x7f63a0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.339+0000 7f63a6e05640 1 -- 172.21.15.102:0/452714561 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f64ac065020 con 0x5651dc0ed5e0 2024-09-13T19:16:14.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.339+0000 7f64ba5b8640 1 --2- 172.21.15.102:0/452714561 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f63a0036b40 0x7f63a0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.339+0000 7f64badb9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651dc1efd40 0x5651dc1f0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.339+0000 7f64badb9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651dc1efd40 0x5651dc1f0140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53700/0 (socket says 172.21.15.102:53700) 2024-09-13T19:16:14.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.339+0000 7f64badb9640 1 -- 172.21.15.102:0/3310328098 learned_addr learned my addr 172.21.15.102:0/3310328098 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:14.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.339+0000 7f64ba5b8640 1 --2- 172.21.15.102:0/452714561 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f63a0036b40 0x7f63a0039000 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f64ac06b590 tx=0x7f64ac06c540 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.339+0000 7f64badb9640 1 -- 172.21.15.102:0/3310328098 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651dc1f0680 con 0x5651dc1efd40 2024-09-13T19:16:14.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.339+0000 7f64badb9640 1 --2- 172.21.15.102:0/3310328098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651dc1efd40 0x5651dc1f0140 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f64b400a430 tx=0x7f64b400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b443c6f04a67591e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.340+0000 7f63a4e01640 1 -- 172.21.15.102:0/3310328098 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64b4015070 con 0x5651dc1efd40 2024-09-13T19:16:14.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.340+0000 7f63a4e01640 1 -- 172.21.15.102:0/3310328098 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64b4001670 con 0x5651dc1efd40 2024-09-13T19:16:14.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.340+0000 7f63a4e01640 1 -- 172.21.15.102:0/3310328098 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64b4001990 con 0x5651dc1efd40 2024-09-13T19:16:14.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.340+0000 7f64be922800 1 -- 172.21.15.102:0/3310328098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651dc1efd40 msgr2=0x5651dc1f0140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.340+0000 7f64be922800 1 --2- 172.21.15.102:0/3310328098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651dc1efd40 0x5651dc1f0140 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f64b400a430 tx=0x7f64b400a8f0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.340+0000 7f64be922800 1 -- 172.21.15.102:0/3310328098 shutdown_connections 2024-09-13T19:16:14.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.340+0000 7f64be922800 1 --2- 172.21.15.102:0/3310328098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651dc1efd40 0x5651dc1f0140 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.340+0000 7f64be922800 1 -- 172.21.15.102:0/3310328098 >> 172.21.15.102:0/3310328098 conn(0x5651dc0edf20 msgr2=0x5651dc1eb4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:14.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.340+0000 7f64be922800 1 -- 172.21.15.102:0/3310328098 shutdown_connections 2024-09-13T19:16:14.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.340+0000 7f64be922800 1 -- 172.21.15.102:0/3310328098 wait complete. 2024-09-13T19:16:14.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.340+0000 7f64be922800 1 Processor -- start 2024-09-13T19:16:14.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.340+0000 7f64be922800 1 -- start start 2024-09-13T19:16:14.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.341+0000 7f64be922800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651dc1efd40 0x5651dc1f7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.341+0000 7f64be922800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5651dc1f1030 con 0x5651dc1efd40 2024-09-13T19:16:14.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.341+0000 7f64badb9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651dc1efd40 0x5651dc1f7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.341+0000 7f64badb9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651dc1efd40 0x5651dc1f7370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53708/0 (socket says 172.21.15.102:53708) 2024-09-13T19:16:14.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.341+0000 7f64badb9640 1 -- 172.21.15.102:0/1656406264 learned_addr learned my addr 172.21.15.102:0/1656406264 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:14.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.341+0000 7f64badb9640 1 -- 172.21.15.102:0/1656406264 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651dc1f78b0 con 0x5651dc1efd40 2024-09-13T19:16:14.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.341+0000 7f64badb9640 1 --2- 172.21.15.102:0/1656406264 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651dc1efd40 0x5651dc1f7370 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f64b400a930 tx=0x7f64b4003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.342+0000 7f639effd640 1 -- 172.21.15.102:0/1656406264 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64b4020020 con 0x5651dc1efd40 2024-09-13T19:16:14.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.342+0000 7f639effd640 1 -- 172.21.15.102:0/1656406264 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64b40108b0 con 0x5651dc1efd40 2024-09-13T19:16:14.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.342+0000 7f64be922800 1 -- 172.21.15.102:0/1656406264 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5651dc1f7b40 con 0x5651dc1efd40 2024-09-13T19:16:14.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.342+0000 7f639effd640 1 -- 172.21.15.102:0/1656406264 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64b4015040 con 0x5651dc1efd40 2024-09-13T19:16:14.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.342+0000 7f64be922800 1 -- 172.21.15.102:0/1656406264 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651dc1fa7f0 con 0x5651dc1efd40 2024-09-13T19:16:14.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.342+0000 7f639effd640 1 -- 172.21.15.102:0/1656406264 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f64b4023020 con 0x5651dc1efd40 2024-09-13T19:16:14.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.343+0000 7f639effd640 1 --2- 172.21.15.102:0/1656406264 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6394036b90 0x7f6394039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.343+0000 7f639effd640 1 -- 172.21.15.102:0/1656406264 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f64b404c210 con 0x5651dc1efd40 2024-09-13T19:16:14.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.343+0000 7f64b1db7640 1 --2- 172.21.15.102:0/1656406264 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6394036b90 0x7f6394039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.343+0000 7f64be922800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:14.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.343+0000 7f64be922800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:14.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.343+0000 7f64be922800 1 Processor -- start 2024-09-13T19:16:14.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.343+0000 7f64b1db7640 1 --2- 172.21.15.102:0/1656406264 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6394036b90 0x7f6394039050 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f64a4000f60 tx=0x7f64a40012f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.343+0000 7f64be922800 1 -- start start 2024-09-13T19:16:14.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.344+0000 7f64be922800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651dc2157a0 0x5651dc215bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.344+0000 7f64be922800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5651dc1dbe70 con 0x5651dc2157a0 2024-09-13T19:16:14.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.344+0000 7f64ba5b8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651dc2157a0 0x5651dc215bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.344+0000 7f64ba5b8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651dc2157a0 0x5651dc215bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53718/0 (socket says 172.21.15.102:53718) 2024-09-13T19:16:14.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.344+0000 7f64ba5b8640 1 -- 172.21.15.102:0/2758186399 learned_addr learned my addr 172.21.15.102:0/2758186399 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:14.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.344+0000 7f64ba5b8640 1 -- 172.21.15.102:0/2758186399 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651dc216190 con 0x5651dc2157a0 2024-09-13T19:16:14.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.344+0000 7f64ba5b8640 1 --2- 172.21.15.102:0/2758186399 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651dc2157a0 0x5651dc215bc0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f64ac090eb0 tx=0x7f64ac090e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.344+0000 7f637f7e6640 1 -- 172.21.15.102:0/2758186399 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64ac097070 con 0x5651dc2157a0 2024-09-13T19:16:14.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.344+0000 7f637f7e6640 1 -- 172.21.15.102:0/2758186399 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64ac08e1d0 con 0x5651dc2157a0 2024-09-13T19:16:14.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.344+0000 7f64be922800 1 -- 172.21.15.102:0/2758186399 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5651dc218de0 con 0x5651dc2157a0 2024-09-13T19:16:14.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.344+0000 7f637f7e6640 1 -- 172.21.15.102:0/2758186399 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64ac060e60 con 0x5651dc2157a0 2024-09-13T19:16:14.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.344+0000 7f64be922800 1 -- 172.21.15.102:0/2758186399 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651dc2191c0 con 0x5651dc2157a0 2024-09-13T19:16:14.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.345+0000 7f637f7e6640 1 -- 172.21.15.102:0/2758186399 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f64ac09a070 con 0x5651dc2157a0 2024-09-13T19:16:14.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.345+0000 7f637f7e6640 1 --2- 172.21.15.102:0/2758186399 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f62f8036b90 0x7f62f8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.345+0000 7f637f7e6640 1 -- 172.21.15.102:0/2758186399 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f64ac05d040 con 0x5651dc2157a0 2024-09-13T19:16:14.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.345+0000 7f64b1db7640 1 --2- 172.21.15.102:0/2758186399 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f62f8036b90 0x7f62f8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.345+0000 7f637d7e2640 20 reqs_thread_entry: start 2024-09-13T19:16:14.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.346+0000 7f64b1db7640 1 --2- 172.21.15.102:0/2758186399 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f62f8036b90 0x7f62f8039050 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f64a4001ed0 tx=0x7f64a400f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.346+0000 7f64be922800 1 --2- 172.21.15.102:0/452714561 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5651dc2231a0 0x5651dc225610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.346+0000 7f64be922800 1 -- 172.21.15.102:0/452714561 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5651dc225ce0 con 0x5651dc2231a0 2024-09-13T19:16:14.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.346+0000 7f64badb9640 1 --2- 172.21.15.102:0/452714561 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5651dc2231a0 0x5651dc225610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.346+0000 7f64badb9640 1 --2- 172.21.15.102:0/452714561 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5651dc2231a0 0x5651dc225610 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.346+0000 7f64badb9640 1 -- 172.21.15.102:0/452714561 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f64b4010d70 con 0x5651dc2231a0 2024-09-13T19:16:14.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.346+0000 7f64be922800 1 --2- 172.21.15.102:0/452714561 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5651dc227b00 0x5651dc229ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.346+0000 7f64be922800 1 -- 172.21.15.102:0/452714561 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:2 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5651dc22a500 con 0x5651dc227b00 2024-09-13T19:16:14.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.346+0000 7f64ba5b8640 1 --2- 172.21.15.102:0/452714561 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5651dc227b00 0x5651dc229ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.347+0000 7f64ba5b8640 1 --2- 172.21.15.102:0/452714561 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5651dc227b00 0x5651dc229ef0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.347+0000 7f64ba5b8640 1 -- 172.21.15.102:0/452714561 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(2 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f64ac099030 con 0x5651dc227b00 2024-09-13T19:16:14.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.347+0000 7f64be922800 1 -- 172.21.15.102:0/452714561 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5651dc226fc0 con 0x5651dc227b00 2024-09-13T19:16:14.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.348+0000 7f64ba5b8640 1 -- 172.21.15.102:0/452714561 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [stat,call,call,writefull 0~993] v34'2 uv2 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f64ac099030 con 0x5651dc227b00 2024-09-13T19:16:14.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.349+0000 7f64be922800 1 -- 172.21.15.102:0/1656406264 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6394036b90 msgr2=0x7f6394039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.349+0000 7f64be922800 1 --2- 172.21.15.102:0/1656406264 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6394036b90 0x7f6394039050 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f64a4000f60 tx=0x7f64a40012f0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.349+0000 7f64be922800 1 -- 172.21.15.102:0/1656406264 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651dc1efd40 msgr2=0x5651dc1f7370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.349+0000 7f64be922800 1 --2- 172.21.15.102:0/1656406264 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651dc1efd40 0x5651dc1f7370 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f64b400a930 tx=0x7f64b4003370 comp rx=0 tx=0).stop 2024-09-13T19:16:14.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.349+0000 7f64be922800 1 -- 172.21.15.102:0/1656406264 shutdown_connections 2024-09-13T19:16:14.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.349+0000 7f64be922800 1 --2- 172.21.15.102:0/1656406264 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6394036b90 0x7f6394039050 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.349+0000 7f64be922800 1 --2- 172.21.15.102:0/1656406264 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651dc1efd40 0x5651dc1f7370 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.349+0000 7f64be922800 1 -- 172.21.15.102:0/1656406264 >> 172.21.15.102:0/1656406264 conn(0x5651dc0edf20 msgr2=0x5651dc1eb090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:14.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.349+0000 7f64be922800 1 -- 172.21.15.102:0/1656406264 shutdown_connections 2024-09-13T19:16:14.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.349+0000 7f64be922800 1 -- 172.21.15.102:0/1656406264 wait complete. 2024-09-13T19:16:14.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.349+0000 7f64be922800 1 -- 172.21.15.102:0/2758186399 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f62f8036b90 msgr2=0x7f62f8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.349+0000 7f64be922800 1 --2- 172.21.15.102:0/2758186399 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f62f8036b90 0x7f62f8039050 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f64a4001ed0 tx=0x7f64a400f000 comp rx=0 tx=0).stop 2024-09-13T19:16:14.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.349+0000 7f64be922800 1 -- 172.21.15.102:0/2758186399 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651dc2157a0 msgr2=0x5651dc215bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.349+0000 7f64be922800 1 --2- 172.21.15.102:0/2758186399 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651dc2157a0 0x5651dc215bc0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f64ac090eb0 tx=0x7f64ac090e10 comp rx=0 tx=0).stop 2024-09-13T19:16:14.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.349+0000 7f64be922800 1 -- 172.21.15.102:0/2758186399 shutdown_connections 2024-09-13T19:16:14.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.349+0000 7f64be922800 1 --2- 172.21.15.102:0/2758186399 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f62f8036b90 0x7f62f8039050 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.349+0000 7f64be922800 1 --2- 172.21.15.102:0/2758186399 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651dc2157a0 0x5651dc215bc0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.349+0000 7f64be922800 1 -- 172.21.15.102:0/2758186399 >> 172.21.15.102:0/2758186399 conn(0x5651dc2062c0 msgr2=0x5651dc208bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:14.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.350+0000 7f64be922800 1 -- 172.21.15.102:0/2758186399 shutdown_connections 2024-09-13T19:16:14.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.350+0000 7f64be922800 1 -- 172.21.15.102:0/2758186399 wait complete. 2024-09-13T19:16:14.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.350+0000 7f64be922800 1 -- 172.21.15.102:0/452714561 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5651dc2231a0 msgr2=0x5651dc225610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.350+0000 7f64be922800 1 --2- 172.21.15.102:0/452714561 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5651dc2231a0 0x5651dc225610 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.350+0000 7f64be922800 1 -- 172.21.15.102:0/452714561 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5651dc227b00 msgr2=0x5651dc229ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.350+0000 7f64be922800 1 --2- 172.21.15.102:0/452714561 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5651dc227b00 0x5651dc229ef0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.350+0000 7f64be922800 1 -- 172.21.15.102:0/452714561 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f63a0036b40 msgr2=0x7f63a0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.350+0000 7f64be922800 1 --2- 172.21.15.102:0/452714561 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f63a0036b40 0x7f63a0039000 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f64ac06b590 tx=0x7f64ac06c540 comp rx=0 tx=0).stop 2024-09-13T19:16:14.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.350+0000 7f64be922800 1 -- 172.21.15.102:0/452714561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651dc0ed5e0 msgr2=0x5651dc1e3020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.350+0000 7f64be922800 1 --2- 172.21.15.102:0/452714561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651dc0ed5e0 0x5651dc1e3020 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f64ac059040 tx=0x7f64ac002fb0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.350+0000 7f64be922800 1 -- 172.21.15.102:0/452714561 shutdown_connections 2024-09-13T19:16:14.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.350+0000 7f64be922800 1 --2- 172.21.15.102:0/452714561 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5651dc227b00 0x5651dc229ef0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.350+0000 7f64be922800 1 --2- 172.21.15.102:0/452714561 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5651dc2231a0 0x5651dc225610 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.350+0000 7f64be922800 1 --2- 172.21.15.102:0/452714561 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f63a0036b40 0x7f63a0039000 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.350+0000 7f64be922800 1 --2- 172.21.15.102:0/452714561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5651dc0ed5e0 0x5651dc1e3020 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.350+0000 7f64be922800 1 -- 172.21.15.102:0/452714561 >> 172.21.15.102:0/452714561 conn(0x5651dc0e8e90 msgr2=0x5651dc1d5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:14.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.350+0000 7f64be922800 1 -- 172.21.15.102:0/452714561 shutdown_connections 2024-09-13T19:16:14.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.350+0000 7f64be922800 1 -- 172.21.15.102:0/452714561 wait complete. 2024-09-13T19:16:14.363 INFO:teuthology.orchestra.run.smithi102.stdout:{"id":"509740b4-c081-4f37-bd6d-df9ca851489b","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-13T19:16:14.363 DEBUG:tasks.util.rgw: json result: {'id': '509740b4-c081-4f37-bd6d-df9ca851489b', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-13T19:16:14.364 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-13T19:16:14.364 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-13T19:16:14.365 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-13T19:16:14.407 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:14.407 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:14.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.403+0000 7f3849232800 1 Processor -- start 2024-09-13T19:16:14.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.403+0000 7f3849232800 1 -- start start 2024-09-13T19:16:14.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.403+0000 7f3849232800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b46b372e80 0x55b46b402130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.403+0000 7f3849232800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b46b2beb30 con 0x55b46b402670 2024-09-13T19:16:14.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.403+0000 7f3849232800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55b46b2a0360 con 0x55b46b372e80 2024-09-13T19:16:14.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.404+0000 7f3844473640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b46b372e80 0x55b46b402130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.404+0000 7f3844473640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b46b372e80 0x55b46b402130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53720/0 (socket says 172.21.15.102:53720) 2024-09-13T19:16:14.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.404+0000 7f3844473640 1 -- 172.21.15.102:0/3438940601 learned_addr learned my addr 172.21.15.102:0/3438940601 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:14.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.404+0000 7f383bc72640 1 --1- 172.21.15.102:0/3438940601 >> v1:172.21.15.53:6789/0 conn(0x55b46b402670 0x55b46b404a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:49762/0 (socket says 172.21.15.102:49762) 2024-09-13T19:16:14.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.404+0000 7f3844473640 1 -- 172.21.15.102:0/3438940601 >> v1:172.21.15.53:6789/0 conn(0x55b46b402670 legacy=0x55b46b404a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.404+0000 7f3843c72640 1 -- 172.21.15.102:0/3438940601 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 705220477 0 0) 0x55b46b2beb30 con 0x55b46b402670 2024-09-13T19:16:14.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.404+0000 7f3844473640 1 -- 172.21.15.102:0/3438940601 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b46b2c6e00 con 0x55b46b372e80 2024-09-13T19:16:14.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.406+0000 7f3844473640 1 --2- 172.21.15.102:0/3438940601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b46b372e80 0x55b46b402130 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f383400a520 tx=0x7f3834045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb24db58f4e8bfe1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.406+0000 7f3843c72640 1 -- 172.21.15.102:0/3438940601 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3834055070 con 0x55b46b372e80 2024-09-13T19:16:14.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.406+0000 7f3843c72640 1 -- 172.21.15.102:0/3438940601 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38340515b0 con 0x55b46b372e80 2024-09-13T19:16:14.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.406+0000 7f3843c72640 1 -- 172.21.15.102:0/3438940601 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38340518d0 con 0x55b46b372e80 2024-09-13T19:16:14.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.406+0000 7f3849232800 1 -- 172.21.15.102:0/3438940601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b46b372e80 msgr2=0x55b46b402130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.406+0000 7f3849232800 1 --2- 172.21.15.102:0/3438940601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b46b372e80 0x55b46b402130 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f383400a520 tx=0x7f3834045ba0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.406+0000 7f3849232800 1 -- 172.21.15.102:0/3438940601 shutdown_connections 2024-09-13T19:16:14.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.406+0000 7f3849232800 1 --2- 172.21.15.102:0/3438940601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b46b372e80 0x55b46b402130 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.406+0000 7f3849232800 1 -- 172.21.15.102:0/3438940601 >> 172.21.15.102:0/3438940601 conn(0x55b46b3f9de0 msgr2=0x55b46b3fc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:14.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.406+0000 7f3849232800 1 -- 172.21.15.102:0/3438940601 shutdown_connections 2024-09-13T19:16:14.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.406+0000 7f3849232800 1 -- 172.21.15.102:0/3438940601 wait complete. 2024-09-13T19:16:14.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.420+0000 7f3849232800 1 Processor -- start 2024-09-13T19:16:14.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.420+0000 7f3849232800 1 -- start start 2024-09-13T19:16:14.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.421+0000 7f3849232800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b46b372e80 0x55b46b4f2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.421+0000 7f3849232800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b46b34b320 con 0x55b46b372e80 2024-09-13T19:16:14.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.421+0000 7f3844473640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b46b372e80 0x55b46b4f2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.421+0000 7f3844473640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b46b372e80 0x55b46b4f2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53734/0 (socket says 172.21.15.102:53734) 2024-09-13T19:16:14.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.421+0000 7f3844473640 1 -- 172.21.15.102:0/3336718066 learned_addr learned my addr 172.21.15.102:0/3336718066 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:14.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.421+0000 7f3844473640 1 -- 172.21.15.102:0/3336718066 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b46b298bc0 con 0x55b46b372e80 2024-09-13T19:16:14.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.421+0000 7f3844473640 1 --2- 172.21.15.102:0/3336718066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b46b372e80 0x55b46b4f2fd0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3834025da0 tx=0x7f3834051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71848d32a49364c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.421+0000 7f373260c640 1 -- 172.21.15.102:0/3336718066 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3834051ac0 con 0x55b46b372e80 2024-09-13T19:16:14.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.421+0000 7f373260c640 1 -- 172.21.15.102:0/3336718066 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3834051c60 con 0x55b46b372e80 2024-09-13T19:16:14.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.421+0000 7f373260c640 1 -- 172.21.15.102:0/3336718066 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3834066460 con 0x55b46b372e80 2024-09-13T19:16:14.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.422+0000 7f3849232800 1 -- 172.21.15.102:0/3336718066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b46b372e80 msgr2=0x55b46b4f2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.422+0000 7f3849232800 1 --2- 172.21.15.102:0/3336718066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b46b372e80 0x55b46b4f2fd0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3834025da0 tx=0x7f3834051000 comp rx=0 tx=0).stop 2024-09-13T19:16:14.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.422+0000 7f3849232800 1 -- 172.21.15.102:0/3336718066 shutdown_connections 2024-09-13T19:16:14.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.422+0000 7f3849232800 1 --2- 172.21.15.102:0/3336718066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b46b372e80 0x55b46b4f2fd0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.422+0000 7f3849232800 1 -- 172.21.15.102:0/3336718066 >> 172.21.15.102:0/3336718066 conn(0x55b46b3f9de0 msgr2=0x55b46b3fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:14.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.422+0000 7f3849232800 1 -- 172.21.15.102:0/3336718066 shutdown_connections 2024-09-13T19:16:14.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.422+0000 7f3849232800 1 -- 172.21.15.102:0/3336718066 wait complete. 2024-09-13T19:16:14.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.422+0000 7f3849232800 1 Processor -- start 2024-09-13T19:16:14.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.423+0000 7f3849232800 1 -- start start 2024-09-13T19:16:14.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.423+0000 7f3849232800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b46b372e80 0x55b46b4f8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.423+0000 7f3849232800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b46b4065e0 con 0x55b46b372e80 2024-09-13T19:16:14.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.423+0000 7f3844473640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b46b372e80 0x55b46b4f8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.423+0000 7f3844473640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b46b372e80 0x55b46b4f8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53740/0 (socket says 172.21.15.102:53740) 2024-09-13T19:16:14.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.423+0000 7f3844473640 1 -- 172.21.15.102:0/2291584488 learned_addr learned my addr 172.21.15.102:0/2291584488 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:14.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.423+0000 7f3844473640 1 -- 172.21.15.102:0/2291584488 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b46b2acfe0 con 0x55b46b372e80 2024-09-13T19:16:14.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.423+0000 7f3844473640 1 --2- 172.21.15.102:0/2291584488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b46b372e80 0x55b46b4f8110 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f38340460a0 tx=0x7f3834003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.424+0000 7f3730e09640 1 -- 172.21.15.102:0/2291584488 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3834066650 con 0x55b46b372e80 2024-09-13T19:16:14.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.424+0000 7f3730e09640 1 -- 172.21.15.102:0/2291584488 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38340667f0 con 0x55b46b372e80 2024-09-13T19:16:14.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.424+0000 7f3849232800 1 -- 172.21.15.102:0/2291584488 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b46b4f8650 con 0x55b46b372e80 2024-09-13T19:16:14.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.424+0000 7f3730e09640 1 -- 172.21.15.102:0/2291584488 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3834066af0 con 0x55b46b372e80 2024-09-13T19:16:14.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.424+0000 7f3849232800 1 -- 172.21.15.102:0/2291584488 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b46b4f8b70 con 0x55b46b372e80 2024-09-13T19:16:14.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.424+0000 7f3730e09640 1 -- 172.21.15.102:0/2291584488 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3834079060 con 0x55b46b372e80 2024-09-13T19:16:14.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.425+0000 7f3730e09640 1 --2- 172.21.15.102:0/2291584488 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f372c036be0 0x7f372c0390a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.425+0000 7f3730e09640 1 -- 172.21.15.102:0/2291584488 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f3834062070 con 0x55b46b372e80 2024-09-13T19:16:14.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.425+0000 7f383bc72640 1 --2- 172.21.15.102:0/2291584488 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f372c036be0 0x7f372c0390a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.425+0000 7f3849232800 1 --2- 172.21.15.102:0/2291584488 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55b46b402670 0x55b46b4ff180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.425+0000 7f3849232800 1 -- 172.21.15.102:0/2291584488 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b46b4ff6c0 con 0x55b46b402670 2024-09-13T19:16:14.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.425+0000 7f3844c74640 1 --2- 172.21.15.102:0/2291584488 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55b46b402670 0x55b46b4ff180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.425+0000 7f383bc72640 1 --2- 172.21.15.102:0/2291584488 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f372c036be0 0x7f372c0390a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f382c000c00 tx=0x7f382c0013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.425+0000 7f3844c74640 1 --2- 172.21.15.102:0/2291584488 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55b46b402670 0x55b46b4ff180 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.425+0000 7f3844c74640 1 -- 172.21.15.102:0/2291584488 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f383c00a4a0 con 0x55b46b402670 2024-09-13T19:16:14.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.425+0000 7f3849232800 1 -- 172.21.15.102:0/2291584488 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b46b4fc730 con 0x55b46b402670 2024-09-13T19:16:14.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.426+0000 7f3844c74640 1 -- 172.21.15.102:0/2291584488 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f383c00a4a0 con 0x55b46b402670 2024-09-13T19:16:14.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.426+0000 7f3849232800 1 --2- 172.21.15.102:0/2291584488 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55b46b5019b0 0x55b46b503da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.426+0000 7f3849232800 1 -- 172.21.15.102:0/2291584488 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b46b504440 con 0x55b46b5019b0 2024-09-13T19:16:14.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.426+0000 7f3844473640 1 --2- 172.21.15.102:0/2291584488 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55b46b5019b0 0x55b46b503da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.426+0000 7f3844473640 1 --2- 172.21.15.102:0/2291584488 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55b46b5019b0 0x55b46b503da0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.426+0000 7f3844473640 1 -- 172.21.15.102:0/2291584488 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3834057030 con 0x55b46b5019b0 2024-09-13T19:16:14.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.426+0000 7f3849232800 1 -- 172.21.15.102:0/2291584488 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b46b500820 con 0x55b46b402670 2024-09-13T19:16:14.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.427+0000 7f3844c74640 1 -- 172.21.15.102:0/2291584488 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f383c00a4a0 con 0x55b46b402670 2024-09-13T19:16:14.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.427+0000 7f3849232800 1 -- 172.21.15.102:0/2291584488 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b46b500cb0 con 0x55b46b5019b0 2024-09-13T19:16:14.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.427+0000 7f3844473640 1 -- 172.21.15.102:0/2291584488 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3834057030 con 0x55b46b5019b0 2024-09-13T19:16:14.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.427+0000 7f3849232800 1 Processor -- start 2024-09-13T19:16:14.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.427+0000 7f3849232800 1 -- start start 2024-09-13T19:16:14.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.427+0000 7f3849232800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b46b512dc0 0x55b46b5131e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.427+0000 7f3849232800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b46b29a580 con 0x55b46b512dc0 2024-09-13T19:16:14.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.428+0000 7f3844c74640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b46b512dc0 0x55b46b5131e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.428+0000 7f3844c74640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b46b512dc0 0x55b46b5131e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53742/0 (socket says 172.21.15.102:53742) 2024-09-13T19:16:14.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.428+0000 7f3844c74640 1 -- 172.21.15.102:0/173348558 learned_addr learned my addr 172.21.15.102:0/173348558 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:14.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.428+0000 7f3844c74640 1 -- 172.21.15.102:0/173348558 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b46b513720 con 0x55b46b512dc0 2024-09-13T19:16:14.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.428+0000 7f3844c74640 1 --2- 172.21.15.102:0/173348558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b46b512dc0 0x55b46b5131e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x55b46b4f91c0 tx=0x7f383c0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.428+0000 7f3729ffb640 1 -- 172.21.15.102:0/173348558 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f383c013640 con 0x55b46b512dc0 2024-09-13T19:16:14.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.428+0000 7f3729ffb640 1 -- 172.21.15.102:0/173348558 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f383c0137e0 con 0x55b46b512dc0 2024-09-13T19:16:14.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.428+0000 7f3849232800 1 -- 172.21.15.102:0/173348558 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b46b5139b0 con 0x55b46b512dc0 2024-09-13T19:16:14.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.428+0000 7f3729ffb640 1 -- 172.21.15.102:0/173348558 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f383c013ac0 con 0x55b46b512dc0 2024-09-13T19:16:14.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.428+0000 7f3849232800 1 -- 172.21.15.102:0/173348558 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b46b516690 con 0x55b46b512dc0 2024-09-13T19:16:14.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.429+0000 7f3729ffb640 1 -- 172.21.15.102:0/173348558 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f383c011040 con 0x55b46b512dc0 2024-09-13T19:16:14.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.429+0000 7f3729ffb640 1 --2- 172.21.15.102:0/173348558 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f371c036b90 0x7f371c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.429+0000 7f3729ffb640 1 -- 172.21.15.102:0/173348558 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f383c00e040 con 0x55b46b512dc0 2024-09-13T19:16:14.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.429+0000 7f3844473640 1 --2- 172.21.15.102:0/173348558 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f371c036b90 0x7f371c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.429+0000 7f3849232800 1 Processor -- start 2024-09-13T19:16:14.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.430+0000 7f3849232800 1 -- start start 2024-09-13T19:16:14.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.430+0000 7f3844473640 1 --2- 172.21.15.102:0/173348558 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f371c036b90 0x7f371c039050 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3834051580 tx=0x7f38340832f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.430+0000 7f3849232800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b46b51fa10 0x55b46b51fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.430+0000 7f3849232800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b46b4f3690 con 0x55b46b51fa10 2024-09-13T19:16:14.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.430+0000 7f3844c74640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b46b51fa10 0x55b46b51fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.430+0000 7f3844c74640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b46b51fa10 0x55b46b51fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53754/0 (socket says 172.21.15.102:53754) 2024-09-13T19:16:14.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.430+0000 7f3844c74640 1 -- 172.21.15.102:0/3191166017 learned_addr learned my addr 172.21.15.102:0/3191166017 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:14.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.430+0000 7f3844c74640 1 -- 172.21.15.102:0/3191166017 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b46b5203e0 con 0x55b46b51fa10 2024-09-13T19:16:14.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.431+0000 7f3844c74640 1 --2- 172.21.15.102:0/3191166017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b46b51fa10 0x55b46b51fe10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f383c005a10 tx=0x7f383c020f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bcc4edc156b0600 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.431+0000 7f37237fe640 1 -- 172.21.15.102:0/3191166017 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f383c02a910 con 0x55b46b51fa10 2024-09-13T19:16:14.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.431+0000 7f37237fe640 1 -- 172.21.15.102:0/3191166017 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f383c04a020 con 0x55b46b51fa10 2024-09-13T19:16:14.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.431+0000 7f37237fe640 1 -- 172.21.15.102:0/3191166017 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f383c02a3f0 con 0x55b46b51fa10 2024-09-13T19:16:14.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.431+0000 7f3849232800 1 -- 172.21.15.102:0/3191166017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b46b51fa10 msgr2=0x55b46b51fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.431+0000 7f3849232800 1 --2- 172.21.15.102:0/3191166017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b46b51fa10 0x55b46b51fe10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f383c005a10 tx=0x7f383c020f60 comp rx=0 tx=0).stop 2024-09-13T19:16:14.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.431+0000 7f3849232800 1 -- 172.21.15.102:0/3191166017 shutdown_connections 2024-09-13T19:16:14.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.431+0000 7f3849232800 1 --2- 172.21.15.102:0/3191166017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b46b51fa10 0x55b46b51fe10 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.431+0000 7f3849232800 1 -- 172.21.15.102:0/3191166017 >> 172.21.15.102:0/3191166017 conn(0x55b46b51bdc0 msgr2=0x55b46b519ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:14.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.431+0000 7f3849232800 1 -- 172.21.15.102:0/3191166017 shutdown_connections 2024-09-13T19:16:14.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.431+0000 7f3849232800 1 -- 172.21.15.102:0/3191166017 wait complete. 2024-09-13T19:16:14.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.431+0000 7f3849232800 1 Processor -- start 2024-09-13T19:16:14.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.431+0000 7f3849232800 1 -- start start 2024-09-13T19:16:14.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.432+0000 7f3849232800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b46b51fa10 0x55b46b526e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.432+0000 7f3849232800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b46b5209f0 con 0x55b46b51fa10 2024-09-13T19:16:14.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.432+0000 7f3844c74640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b46b51fa10 0x55b46b526e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.432+0000 7f3844c74640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b46b51fa10 0x55b46b526e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53766/0 (socket says 172.21.15.102:53766) 2024-09-13T19:16:14.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.432+0000 7f3844c74640 1 -- 172.21.15.102:0/1445284560 learned_addr learned my addr 172.21.15.102:0/1445284560 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:14.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.432+0000 7f3844c74640 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b46b5273d0 con 0x55b46b51fa10 2024-09-13T19:16:14.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.432+0000 7f3844c74640 1 --2- 172.21.15.102:0/1445284560 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b46b51fa10 0x55b46b526e90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f383c016cd0 tx=0x7f383c04ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.432+0000 7f3721ffb640 1 -- 172.21.15.102:0/1445284560 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f383c038070 con 0x55b46b51fa10 2024-09-13T19:16:14.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.432+0000 7f3721ffb640 1 -- 172.21.15.102:0/1445284560 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f383c020580 con 0x55b46b51fa10 2024-09-13T19:16:14.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.432+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b46b527660 con 0x55b46b51fa10 2024-09-13T19:16:14.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.432+0000 7f3721ffb640 1 -- 172.21.15.102:0/1445284560 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f383c020880 con 0x55b46b51fa10 2024-09-13T19:16:14.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.432+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b46b52a310 con 0x55b46b51fa10 2024-09-13T19:16:14.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.433+0000 7f3721ffb640 1 -- 172.21.15.102:0/1445284560 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f383c03b070 con 0x55b46b51fa10 2024-09-13T19:16:14.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.433+0000 7f3721ffb640 1 --2- 172.21.15.102:0/1445284560 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3714036aa0 0x7f3714038f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.433+0000 7f3721ffb640 1 -- 172.21.15.102:0/1445284560 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f383c04b030 con 0x55b46b51fa10 2024-09-13T19:16:14.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.434+0000 7f3844473640 1 --2- 172.21.15.102:0/1445284560 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3714036aa0 0x7f3714038f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.434+0000 7f3849232800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.434+0000 7f3849232800 1 --2- 172.21.15.102:0/1445284560 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55b46b532980 0x55b46b534e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.434+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b46b535590 con 0x55b46b532980 2024-09-13T19:16:14.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.434+0000 7f383bc72640 1 --2- 172.21.15.102:0/1445284560 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55b46b532980 0x55b46b534e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.434+0000 7f3844473640 1 --2- 172.21.15.102:0/1445284560 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3714036aa0 0x7f3714038f60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3834050020 tx=0x7f3834093000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.434+0000 7f383bc72640 1 --2- 172.21.15.102:0/1445284560 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55b46b532980 0x55b46b534e40 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.434+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f382c00f5a0 con 0x55b46b532980 2024-09-13T19:16:14.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.434+0000 7f3849232800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:14.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.434+0000 7f3849232800 20 realm 2024-09-13T19:16:14.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.434+0000 7f3849232800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.434+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b46b531dd0 con 0x55b46b532980 2024-09-13T19:16:14.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.435+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f382c00f5a0 con 0x55b46b532980 2024-09-13T19:16:14.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.435+0000 7f3849232800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:14.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.435+0000 7f3849232800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:14.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.435+0000 7f3849232800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.435+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b46b536070 con 0x55b46b532980 2024-09-13T19:16:14.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.435+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f382c00f5a0 con 0x55b46b532980 2024-09-13T19:16:14.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.435+0000 7f3849232800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:14.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.435+0000 7f3849232800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.435+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b46b536940 con 0x55b46b532980 2024-09-13T19:16:14.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.435+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f382c00f5a0 con 0x55b46b532980 2024-09-13T19:16:14.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.435+0000 7f3849232800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:14.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.435+0000 7f3849232800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.435+0000 7f3849232800 1 --2- 172.21.15.102:0/1445284560 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55b46b537240 0x55b46b539650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.435+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b46b539db0 con 0x55b46b537240 2024-09-13T19:16:14.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.435+0000 7f3844c74640 1 --2- 172.21.15.102:0/1445284560 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55b46b537240 0x55b46b539650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.435+0000 7f3844c74640 1 --2- 172.21.15.102:0/1445284560 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55b46b537240 0x55b46b539650 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.436+0000 7f3844c74640 1 -- 172.21.15.102:0/1445284560 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f383c03a030 con 0x55b46b537240 2024-09-13T19:16:14.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.436+0000 7f3849232800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:14.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.436+0000 7f3849232800 20 searching for the correct realm 2024-09-13T19:16:14.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.436+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b46b53b790 con 0x55b46b537240 2024-09-13T19:16:14.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.436+0000 7f3844c74640 1 -- 172.21.15.102:0/1445284560 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f383c03a030 con 0x55b46b537240 2024-09-13T19:16:14.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.436+0000 7f3844c74640 1 --2- 172.21.15.102:0/1445284560 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f383c024bb0 0x7f383c040960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.436+0000 7f3844c74640 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b46b53b790 con 0x7f383c024bb0 2024-09-13T19:16:14.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.436+0000 7f3844473640 1 --2- 172.21.15.102:0/1445284560 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f383c024bb0 0x7f383c040960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.436+0000 7f3844473640 1 --2- 172.21.15.102:0/1445284560 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f383c024bb0 0x7f383c040960 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.437+0000 7f3844473640 1 -- 172.21.15.102:0/1445284560 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3834057030 con 0x7f383c024bb0 2024-09-13T19:16:14.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.437+0000 7f3844473640 1 --2- 172.21.15.102:0/1445284560 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f383407b070 0x7f3834050600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.437+0000 7f3844473640 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b46b53b790 con 0x7f383407b070 2024-09-13T19:16:14.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.437+0000 7f383bc72640 1 --2- 172.21.15.102:0/1445284560 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f383407b070 0x7f3834050600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.437+0000 7f383bc72640 1 --2- 172.21.15.102:0/1445284560 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f383407b070 0x7f3834050600 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.438+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f382c00f5a0 con 0x7f383407b070 2024-09-13T19:16:14.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.438+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b46b53b790 con 0x55b46b532980 2024-09-13T19:16:14.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.438+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f382c00f5a0 con 0x55b46b532980 2024-09-13T19:16:14.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.438+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b46b53b790 con 0x55b46b532980 2024-09-13T19:16:14.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.438+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f382c02b040 con 0x55b46b532980 2024-09-13T19:16:14.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.438+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b46b53b790 con 0x7f383407b070 2024-09-13T19:16:14.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.438+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f382c02b040 con 0x7f383407b070 2024-09-13T19:16:14.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.438+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b46b53b790 con 0x7f383407b070 2024-09-13T19:16:14.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.438+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f382c02b040 con 0x7f383407b070 2024-09-13T19:16:14.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.438+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b46b53b790 con 0x7f383c024bb0 2024-09-13T19:16:14.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.439+0000 7f3844473640 1 -- 172.21.15.102:0/1445284560 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3834057030 con 0x7f383c024bb0 2024-09-13T19:16:14.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.439+0000 7f3844473640 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b46b53b790 con 0x55b46b537240 2024-09-13T19:16:14.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.439+0000 7f3844c74640 1 -- 172.21.15.102:0/1445284560 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f383c03a030 con 0x55b46b537240 2024-09-13T19:16:14.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.439+0000 7f3844c74640 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b46b53b790 con 0x55b46b532980 2024-09-13T19:16:14.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.439+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f382c02b040 con 0x55b46b532980 2024-09-13T19:16:14.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.439+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b46b53b790 con 0x7f383407b070 2024-09-13T19:16:14.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.439+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f382c02b040 con 0x7f383407b070 2024-09-13T19:16:14.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.439+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b46b53b790 con 0x55b46b532980 2024-09-13T19:16:14.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.440+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f382c02b040 con 0x55b46b532980 2024-09-13T19:16:14.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.440+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b46b53b790 con 0x7f383c024bb0 2024-09-13T19:16:14.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.440+0000 7f3844473640 1 -- 172.21.15.102:0/1445284560 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3834057030 con 0x7f383c024bb0 2024-09-13T19:16:14.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.440+0000 7f3844473640 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b46b53b790 con 0x55b46b537240 2024-09-13T19:16:14.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.440+0000 7f3844c74640 1 -- 172.21.15.102:0/1445284560 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f383c03a030 con 0x55b46b537240 2024-09-13T19:16:14.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.440+0000 7f3844c74640 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b46b53b790 con 0x55b46b537240 2024-09-13T19:16:14.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.440+0000 7f3844c74640 1 -- 172.21.15.102:0/1445284560 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f383c03a030 con 0x55b46b537240 2024-09-13T19:16:14.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.440+0000 7f3844c74640 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b46b53b790 con 0x7f383407b070 2024-09-13T19:16:14.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.441+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f382c02b040 con 0x7f383407b070 2024-09-13T19:16:14.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.441+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b46b53b790 con 0x55b46b537240 2024-09-13T19:16:14.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.441+0000 7f3844c74640 1 -- 172.21.15.102:0/1445284560 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f383c03a030 con 0x55b46b537240 2024-09-13T19:16:14.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.441+0000 7f3844c74640 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b46b53b790 con 0x55b46b537240 2024-09-13T19:16:14.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.441+0000 7f3844c74640 1 -- 172.21.15.102:0/1445284560 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f383c03a030 con 0x55b46b537240 2024-09-13T19:16:14.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.441+0000 7f3844c74640 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b46b53b790 con 0x55b46b532980 2024-09-13T19:16:14.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.441+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f382c02b040 con 0x55b46b532980 2024-09-13T19:16:14.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.441+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b46b53b790 con 0x55b46b532980 2024-09-13T19:16:14.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.442+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f382c02b040 con 0x55b46b532980 2024-09-13T19:16:14.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.442+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b46b53b790 con 0x7f383407b070 2024-09-13T19:16:14.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.442+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f382c02b040 con 0x7f383407b070 2024-09-13T19:16:14.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.442+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b46b53b790 con 0x55b46b537240 2024-09-13T19:16:14.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.442+0000 7f3844c74640 1 -- 172.21.15.102:0/1445284560 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f383c03a030 con 0x55b46b537240 2024-09-13T19:16:14.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.442+0000 7f3844c74640 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b46b53b790 con 0x7f383c024bb0 2024-09-13T19:16:14.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.442+0000 7f3844473640 1 -- 172.21.15.102:0/1445284560 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3834057030 con 0x7f383c024bb0 2024-09-13T19:16:14.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.442+0000 7f3844473640 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b46b53b790 con 0x55b46b532980 2024-09-13T19:16:14.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.443+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f382c02b040 con 0x55b46b532980 2024-09-13T19:16:14.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.443+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b46b53b790 con 0x7f383407b070 2024-09-13T19:16:14.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.443+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f382c03b040 con 0x7f383407b070 2024-09-13T19:16:14.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.443+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b46b53b790 con 0x55b46b537240 2024-09-13T19:16:14.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.443+0000 7f3844c74640 1 -- 172.21.15.102:0/1445284560 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f383c03a030 con 0x55b46b537240 2024-09-13T19:16:14.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.443+0000 7f3844c74640 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b46b53b790 con 0x7f383407b070 2024-09-13T19:16:14.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.444+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f382c03b040 con 0x7f383407b070 2024-09-13T19:16:14.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.444+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b46b53b790 con 0x7f383c024bb0 2024-09-13T19:16:14.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.444+0000 7f3844473640 1 -- 172.21.15.102:0/1445284560 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3834057030 con 0x7f383c024bb0 2024-09-13T19:16:14.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.444+0000 7f3844473640 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b46b53b790 con 0x55b46b537240 2024-09-13T19:16:14.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.444+0000 7f3844c74640 1 -- 172.21.15.102:0/1445284560 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f383c03a030 con 0x55b46b537240 2024-09-13T19:16:14.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.444+0000 7f3844c74640 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b46b53b790 con 0x7f383407b070 2024-09-13T19:16:14.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.444+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f382c03b040 con 0x7f383407b070 2024-09-13T19:16:14.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.444+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b46b53b790 con 0x55b46b532980 2024-09-13T19:16:14.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.445+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f382c03b040 con 0x55b46b532980 2024-09-13T19:16:14.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.445+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b46b53b790 con 0x7f383c024bb0 2024-09-13T19:16:14.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.445+0000 7f3844473640 1 -- 172.21.15.102:0/1445284560 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3834057030 con 0x7f383c024bb0 2024-09-13T19:16:14.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.445+0000 7f3849232800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:14.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.445+0000 7f3849232800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:14.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.445+0000 7f3849232800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:14.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.445+0000 7f3849232800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:14.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.445+0000 7f3849232800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:14.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.445+0000 7f3849232800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:14.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.445+0000 7f3849232800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.445+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b46b53a860 con 0x55b46b532980 2024-09-13T19:16:14.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.445+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f382c03b040 con 0x55b46b532980 2024-09-13T19:16:14.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.445+0000 7f3849232800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:14.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.445+0000 7f3849232800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.445+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b46b53b100 con 0x55b46b532980 2024-09-13T19:16:14.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.445+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f382c03b040 con 0x55b46b532980 2024-09-13T19:16:14.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.445+0000 7f3849232800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:14.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.445+0000 7f3849232800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.445+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b46b53a4a0 con 0x55b46b537240 2024-09-13T19:16:14.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.446+0000 7f3844c74640 1 -- 172.21.15.102:0/1445284560 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f383c03a030 con 0x55b46b537240 2024-09-13T19:16:14.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.446+0000 7f3849232800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:14.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.446+0000 7f3849232800 20 zone default found 2024-09-13T19:16:14.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.446+0000 7f3849232800 4 Realm: () 2024-09-13T19:16:14.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.446+0000 7f3849232800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:14.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.446+0000 7f3849232800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:14.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.446+0000 7f3849232800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:14.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.446+0000 7f3849232800 20 zonegroup default 2024-09-13T19:16:14.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.446+0000 7f3849232800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.446+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b46b53c110 con 0x7f383407b070 2024-09-13T19:16:14.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.446+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f382c03b040 con 0x7f383407b070 2024-09-13T19:16:14.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.446+0000 7f3849232800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:14.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.446+0000 7f3849232800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.446+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b46b53db80 con 0x55b46b537240 2024-09-13T19:16:14.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.446+0000 7f3844c74640 1 -- 172.21.15.102:0/1445284560 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f383c03a030 con 0x55b46b537240 2024-09-13T19:16:14.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.446+0000 7f3849232800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:14.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.446+0000 7f3849232800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.446+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b46b53dfa0 con 0x55b46b537240 2024-09-13T19:16:14.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.446+0000 7f3844c74640 1 -- 172.21.15.102:0/1445284560 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f383c03a030 con 0x55b46b537240 2024-09-13T19:16:14.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.447+0000 7f3849232800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:14.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.447+0000 7f3849232800 20 started sync module instance, tier type = 2024-09-13T19:16:14.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.447+0000 7f3849232800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:14.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.447+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b46b53cf30 con 0x7f383c024bb0 2024-09-13T19:16:14.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.448+0000 7f3844473640 1 -- 172.21.15.102:0/1445284560 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(44 notify.0 [create] v34'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3834057030 con 0x7f383c024bb0 2024-09-13T19:16:14.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.448+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94233383127680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b46b53e3b0 con 0x7f383c024bb0 2024-09-13T19:16:14.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.448+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b46b53ec00 con 0x55b46b532980 2024-09-13T19:16:14.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.449+0000 7f3844473640 1 -- 172.21.15.102:0/1445284560 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94233383127680] v34'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3834057030 con 0x7f383c024bb0 2024-09-13T19:16:14.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.449+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v34'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f382c03b040 con 0x55b46b532980 2024-09-13T19:16:14.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.449+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94233383135056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b46b53f020 con 0x55b46b532980 2024-09-13T19:16:14.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.449+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b46b53f8b0 con 0x55b46b537240 2024-09-13T19:16:14.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.450+0000 7f3844c74640 1 -- 172.21.15.102:0/1445284560 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v34'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f383c03a030 con 0x55b46b537240 2024-09-13T19:16:14.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.450+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94233383137312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b46b53f4e0 con 0x55b46b537240 2024-09-13T19:16:14.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.450+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b46b5408a0 con 0x7f383c024bb0 2024-09-13T19:16:14.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.450+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94233383135056] v34'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f382c03b040 con 0x55b46b532980 2024-09-13T19:16:14.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.453+0000 7f3844c74640 1 -- 172.21.15.102:0/1445284560 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94233383137312] v34'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f383c03a030 con 0x55b46b537240 2024-09-13T19:16:14.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.453+0000 7f3844473640 1 -- 172.21.15.102:0/1445284560 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(50 notify.3 [create] v34'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3834057030 con 0x7f383c024bb0 2024-09-13T19:16:14.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.453+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94233383140512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b46b540860 con 0x7f383c024bb0 2024-09-13T19:16:14.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.453+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b46b541140 con 0x55b46b532980 2024-09-13T19:16:14.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.455+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v34'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f382c03b040 con 0x55b46b532980 2024-09-13T19:16:14.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.455+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94233383144592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b46b541560 con 0x55b46b532980 2024-09-13T19:16:14.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.455+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b46b541db0 con 0x7f383407b070 2024-09-13T19:16:14.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.456+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(54 notify.5 [create] v34'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f382c03b040 con 0x7f383407b070 2024-09-13T19:16:14.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.456+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94233383147408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b46b542200 con 0x7f383407b070 2024-09-13T19:16:14.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.456+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b46b542d20 con 0x7f383407b070 2024-09-13T19:16:14.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.458+0000 7f3844473640 1 -- 172.21.15.102:0/1445284560 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94233383140512] v34'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3834057030 con 0x7f383c024bb0 2024-09-13T19:16:14.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.458+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94233383147408] v34'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f382c03b040 con 0x7f383407b070 2024-09-13T19:16:14.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.458+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(56 notify.6 [create] v34'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f382c03b040 con 0x7f383407b070 2024-09-13T19:16:14.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.458+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94233383151600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b46b541c50 con 0x7f383407b070 2024-09-13T19:16:14.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.458+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b46b543190 con 0x7f383407b070 2024-09-13T19:16:14.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.459+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94233383151600] v34'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f382c03b040 con 0x7f383407b070 2024-09-13T19:16:14.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.461+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94233383144592] v34'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f382c03b040 con 0x55b46b532980 2024-09-13T19:16:14.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.461+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(58 notify.7 [create] v34'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f382c03b040 con 0x7f383407b070 2024-09-13T19:16:14.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.461+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94233383145648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b46b542ce0 con 0x7f383407b070 2024-09-13T19:16:14.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.461+0000 7f3849232800 20 add_watcher() i=0 2024-09-13T19:16:14.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.461+0000 7f3849232800 20 add_watcher() i=1 2024-09-13T19:16:14.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.461+0000 7f3849232800 20 add_watcher() i=2 2024-09-13T19:16:14.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.461+0000 7f3849232800 20 add_watcher() i=3 2024-09-13T19:16:14.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.461+0000 7f3849232800 20 add_watcher() i=4 2024-09-13T19:16:14.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.461+0000 7f3849232800 20 add_watcher() i=5 2024-09-13T19:16:14.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.461+0000 7f3849232800 20 add_watcher() i=6 2024-09-13T19:16:14.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.464+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94233383145648] v34'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f382c03b040 con 0x7f383407b070 2024-09-13T19:16:14.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.464+0000 7f3849232800 20 add_watcher() i=7 2024-09-13T19:16:14.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.464+0000 7f3849232800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:14.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.464+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b46b5461c0 con 0x55b46b532980 2024-09-13T19:16:14.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.464+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f382c03b040 con 0x55b46b532980 2024-09-13T19:16:14.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.464+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94233383152864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b46b5435b0 con 0x55b46b532980 2024-09-13T19:16:14.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.465+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94233383152864] v34'46 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f382c03b040 con 0x55b46b532980 2024-09-13T19:16:14.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.465+0000 7f36fa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:14.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.465+0000 7f3849232800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:14.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.465+0000 7f3849232800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:14.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.465+0000 7f3849232800 5 note: GC not initialized 2024-09-13T19:16:14.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.465+0000 7f36f97e2640 20 reqs_thread_entry: start 2024-09-13T19:16:14.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.465+0000 7f3849232800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:14.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.465+0000 7f3849232800 20 Filter name: none 2024-09-13T19:16:14.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.465+0000 7f366affd640 20 reqs_thread_entry: start 2024-09-13T19:16:14.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.466+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b46b579880 con 0x55b46b532980 2024-09-13T19:16:14.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.466+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f382c03b040 con 0x55b46b532980 2024-09-13T19:16:14.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.466+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b46b579880 con 0x7f383c024bb0 2024-09-13T19:16:14.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.466+0000 7f3844473640 1 -- 172.21.15.102:0/1445284560 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f3834057030 con 0x7f383c024bb0 2024-09-13T19:16:14.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.466+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b46b579880 con 0x55b46b532980 2024-09-13T19:16:14.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.466+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f382c03b040 con 0x55b46b532980 2024-09-13T19:16:14.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.466+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b46b579840 con 0x55b46b537240 2024-09-13T19:16:14.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.466+0000 7f3844c74640 1 -- 172.21.15.102:0/1445284560 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f383c03a030 con 0x55b46b537240 2024-09-13T19:16:14.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.466+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b46b579840 con 0x55b46b537240 2024-09-13T19:16:14.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.467+0000 7f3844c74640 1 -- 172.21.15.102:0/1445284560 <== osd.3 v2:172.21.15.102:6800/3096737090 17 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f383c03a030 con 0x55b46b537240 2024-09-13T19:16:14.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.467+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b46b579840 con 0x55b46b537240 2024-09-13T19:16:14.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.467+0000 7f3844c74640 1 -- 172.21.15.102:0/1445284560 <== osd.3 v2:172.21.15.102:6800/3096737090 18 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f383c03a030 con 0x55b46b537240 2024-09-13T19:16:14.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.467+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b46b579840 con 0x55b46b532980 2024-09-13T19:16:14.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.467+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f382c03b040 con 0x55b46b532980 2024-09-13T19:16:14.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.467+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b46b579840 con 0x55b46b532980 2024-09-13T19:16:14.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.467+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f382c03b040 con 0x55b46b532980 2024-09-13T19:16:14.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.467+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b46b579840 con 0x55b46b537240 2024-09-13T19:16:14.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.467+0000 7f3844c74640 1 -- 172.21.15.102:0/1445284560 <== osd.3 v2:172.21.15.102:6800/3096737090 19 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f383c03a030 con 0x55b46b537240 2024-09-13T19:16:14.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.467+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b46b579840 con 0x55b46b537240 2024-09-13T19:16:14.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.468+0000 7f3844c74640 1 -- 172.21.15.102:0/1445284560 <== osd.3 v2:172.21.15.102:6800/3096737090 20 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f383c03a030 con 0x55b46b537240 2024-09-13T19:16:14.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.468+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b46b579840 con 0x7f383407b070 2024-09-13T19:16:14.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.468+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(72 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f382c03b040 con 0x7f383407b070 2024-09-13T19:16:14.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.468+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b46b579840 con 0x55b46b532980 2024-09-13T19:16:14.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.468+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f382c03b040 con 0x55b46b532980 2024-09-13T19:16:14.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.468+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b46b579840 con 0x7f383c024bb0 2024-09-13T19:16:14.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.469+0000 7f3844473640 1 -- 172.21.15.102:0/1445284560 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f3834057030 con 0x7f383c024bb0 2024-09-13T19:16:14.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.469+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b46b579840 con 0x55b46b537240 2024-09-13T19:16:14.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.469+0000 7f3844c74640 1 -- 172.21.15.102:0/1445284560 <== osd.3 v2:172.21.15.102:6800/3096737090 21 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f383c03a030 con 0x55b46b537240 2024-09-13T19:16:14.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.469+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b46b579840 con 0x7f383407b070 2024-09-13T19:16:14.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.469+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f382c03b040 con 0x7f383407b070 2024-09-13T19:16:14.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.469+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b46b579840 con 0x7f383407b070 2024-09-13T19:16:14.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.469+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f382c03b040 con 0x7f383407b070 2024-09-13T19:16:14.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.469+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b46b579840 con 0x55b46b537240 2024-09-13T19:16:14.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.470+0000 7f3844c74640 1 -- 172.21.15.102:0/1445284560 <== osd.3 v2:172.21.15.102:6800/3096737090 22 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f383c03a030 con 0x55b46b537240 2024-09-13T19:16:14.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.470+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b46b579840 con 0x7f383407b070 2024-09-13T19:16:14.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.470+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.0 v2:172.21.15.53:6800/4021716951 20 ==== osd_op_reply(79 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f382c03b040 con 0x7f383407b070 2024-09-13T19:16:14.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.470+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b46b579840 con 0x55b46b532980 2024-09-13T19:16:14.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.470+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f382c03b040 con 0x55b46b532980 2024-09-13T19:16:14.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.470+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b46b579840 con 0x55b46b537240 2024-09-13T19:16:14.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.470+0000 7f3844c74640 1 -- 172.21.15.102:0/1445284560 <== osd.3 v2:172.21.15.102:6800/3096737090 23 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f383c03a030 con 0x55b46b537240 2024-09-13T19:16:14.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.470+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b46b579840 con 0x7f383407b070 2024-09-13T19:16:14.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.470+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.0 v2:172.21.15.53:6800/4021716951 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f382c03b040 con 0x7f383407b070 2024-09-13T19:16:14.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.470+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b46b579840 con 0x7f383c024bb0 2024-09-13T19:16:14.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.471+0000 7f3844473640 1 -- 172.21.15.102:0/1445284560 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f3834057030 con 0x7f383c024bb0 2024-09-13T19:16:14.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.471+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b46b579840 con 0x7f383407b070 2024-09-13T19:16:14.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.471+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.0 v2:172.21.15.53:6800/4021716951 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f382c03b040 con 0x7f383407b070 2024-09-13T19:16:14.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.471+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b46b579840 con 0x55b46b532980 2024-09-13T19:16:14.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.471+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f382c03b040 con 0x55b46b532980 2024-09-13T19:16:14.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.471+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b46b579840 con 0x55b46b532980 2024-09-13T19:16:14.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.471+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.1 v2:172.21.15.102:6808/2204418452 28 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f382c03b040 con 0x55b46b532980 2024-09-13T19:16:14.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.471+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b46b579840 con 0x55b46b537240 2024-09-13T19:16:14.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.472+0000 7f3844c74640 1 -- 172.21.15.102:0/1445284560 <== osd.3 v2:172.21.15.102:6800/3096737090 24 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f383c03a030 con 0x55b46b537240 2024-09-13T19:16:14.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.472+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b46b579840 con 0x55b46b532980 2024-09-13T19:16:14.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.472+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.1 v2:172.21.15.102:6808/2204418452 29 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f382c03b040 con 0x55b46b532980 2024-09-13T19:16:14.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.472+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b46b579840 con 0x55b46b532980 2024-09-13T19:16:14.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.472+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.1 v2:172.21.15.102:6808/2204418452 30 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f382c03b040 con 0x55b46b532980 2024-09-13T19:16:14.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.472+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b46b579840 con 0x55b46b537240 2024-09-13T19:16:14.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.472+0000 7f3844c74640 1 -- 172.21.15.102:0/1445284560 <== osd.3 v2:172.21.15.102:6800/3096737090 25 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f383c03a030 con 0x55b46b537240 2024-09-13T19:16:14.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.472+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b46b579840 con 0x55b46b537240 2024-09-13T19:16:14.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.472+0000 7f3844c74640 1 -- 172.21.15.102:0/1445284560 <== osd.3 v2:172.21.15.102:6800/3096737090 26 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f383c03a030 con 0x55b46b537240 2024-09-13T19:16:14.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.472+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b46b579840 con 0x55b46b537240 2024-09-13T19:16:14.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.472+0000 7f3844c74640 1 -- 172.21.15.102:0/1445284560 <== osd.3 v2:172.21.15.102:6800/3096737090 27 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f383c03a030 con 0x55b46b537240 2024-09-13T19:16:14.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.473+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b46b579840 con 0x7f383407b070 2024-09-13T19:16:14.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.473+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.0 v2:172.21.15.53:6800/4021716951 23 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f382c03b040 con 0x7f383407b070 2024-09-13T19:16:14.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.474+0000 7f36fa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:14.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.474+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94233383152864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b46b579840 con 0x55b46b532980 2024-09-13T19:16:14.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.475+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.1 v2:172.21.15.102:6808/2204418452 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94233383152864] v34'47 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f382c03b040 con 0x55b46b532980 2024-09-13T19:16:14.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.475+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94233383127680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b46b579840 con 0x7f383c024bb0 2024-09-13T19:16:14.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.477+0000 7f3844473640 1 -- 172.21.15.102:0/1445284560 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94233383127680] v34'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3834057030 con 0x7f383c024bb0 2024-09-13T19:16:14.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.478+0000 7f3849232800 20 remove_watcher() i=0 2024-09-13T19:16:14.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.478+0000 7f3849232800 2 removed watcher, disabling cache 2024-09-13T19:16:14.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.478+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94233383135056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b46b579840 con 0x55b46b532980 2024-09-13T19:16:14.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.479+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.1 v2:172.21.15.102:6808/2204418452 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94233383135056] v34'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f382c03b040 con 0x55b46b532980 2024-09-13T19:16:14.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.479+0000 7f3849232800 20 remove_watcher() i=1 2024-09-13T19:16:14.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.479+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94233383137312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b46b579840 con 0x55b46b537240 2024-09-13T19:16:14.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.480+0000 7f3844c74640 1 -- 172.21.15.102:0/1445284560 <== osd.3 v2:172.21.15.102:6800/3096737090 28 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94233383137312] v34'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f383c03a030 con 0x55b46b537240 2024-09-13T19:16:14.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.480+0000 7f3849232800 20 remove_watcher() i=2 2024-09-13T19:16:14.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.480+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94233383140512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b46b579840 con 0x7f383c024bb0 2024-09-13T19:16:14.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.481+0000 7f3844473640 1 -- 172.21.15.102:0/1445284560 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94233383140512] v34'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3834057030 con 0x7f383c024bb0 2024-09-13T19:16:14.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.481+0000 7f3849232800 20 remove_watcher() i=3 2024-09-13T19:16:14.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.481+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94233383144592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b46b579840 con 0x55b46b532980 2024-09-13T19:16:14.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.482+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.1 v2:172.21.15.102:6808/2204418452 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94233383144592] v34'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f382c03b040 con 0x55b46b532980 2024-09-13T19:16:14.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.482+0000 7f3849232800 20 remove_watcher() i=4 2024-09-13T19:16:14.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.482+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94233383147408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b46b579840 con 0x7f383407b070 2024-09-13T19:16:14.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.483+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.0 v2:172.21.15.53:6800/4021716951 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94233383147408] v34'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f382c03b040 con 0x7f383407b070 2024-09-13T19:16:14.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.483+0000 7f3849232800 20 remove_watcher() i=5 2024-09-13T19:16:14.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.483+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94233383151600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b46b579840 con 0x7f383407b070 2024-09-13T19:16:14.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.484+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.0 v2:172.21.15.53:6800/4021716951 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94233383151600] v34'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f382c03b040 con 0x7f383407b070 2024-09-13T19:16:14.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.484+0000 7f3849232800 20 remove_watcher() i=6 2024-09-13T19:16:14.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.484+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94233383145648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b46b579840 con 0x7f383407b070 2024-09-13T19:16:14.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.485+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 <== osd.0 v2:172.21.15.53:6800/4021716951 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94233383145648] v34'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f382c03b040 con 0x7f383407b070 2024-09-13T19:16:14.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.485+0000 7f3849232800 20 remove_watcher() i=7 2024-09-13T19:16:14.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.485+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f383407b070 msgr2=0x7f3834050600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.485+0000 7f3849232800 1 --2- 172.21.15.102:0/1445284560 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f383407b070 0x7f3834050600 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.485+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55b46b532980 msgr2=0x55b46b534e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.485+0000 7f3849232800 1 --2- 172.21.15.102:0/1445284560 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55b46b532980 0x55b46b534e40 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.485+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f383c024bb0 msgr2=0x7f383c040960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.485+0000 7f3849232800 1 --2- 172.21.15.102:0/1445284560 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f383c024bb0 0x7f383c040960 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.485+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55b46b537240 msgr2=0x55b46b539650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.485+0000 7f3849232800 1 --2- 172.21.15.102:0/1445284560 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55b46b537240 0x55b46b539650 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.485+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3714036aa0 msgr2=0x7f3714038f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.485+0000 7f3849232800 1 --2- 172.21.15.102:0/1445284560 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3714036aa0 0x7f3714038f60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3834050020 tx=0x7f3834093000 comp rx=0 tx=0).stop 2024-09-13T19:16:14.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.485+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b46b51fa10 msgr2=0x55b46b526e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.485+0000 7f383bc72640 1 -- 172.21.15.102:0/1445284560 reap_dead start 2024-09-13T19:16:14.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.485+0000 7f3849232800 1 --2- 172.21.15.102:0/1445284560 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b46b51fa10 0x55b46b526e90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f383c016cd0 tx=0x7f383c04ccd0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.485+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 shutdown_connections 2024-09-13T19:16:14.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.485+0000 7f3849232800 1 --2- 172.21.15.102:0/1445284560 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b46b51fa10 0x55b46b526e90 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.485+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 >> 172.21.15.102:0/1445284560 conn(0x55b46b51bdc0 msgr2=0x55b46b521150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:14.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.485+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 shutdown_connections 2024-09-13T19:16:14.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.485+0000 7f3849232800 1 -- 172.21.15.102:0/1445284560 wait complete. 2024-09-13T19:16:14.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.486+0000 7f3849232800 1 -- 172.21.15.102:0/173348558 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f371c036b90 msgr2=0x7f371c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.486+0000 7f3849232800 1 --2- 172.21.15.102:0/173348558 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f371c036b90 0x7f371c039050 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3834051580 tx=0x7f38340832f0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.486+0000 7f3849232800 1 -- 172.21.15.102:0/173348558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b46b512dc0 msgr2=0x55b46b5131e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.486+0000 7f3849232800 1 --2- 172.21.15.102:0/173348558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b46b512dc0 0x55b46b5131e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x55b46b4f91c0 tx=0x7f383c0167b0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.486+0000 7f3849232800 1 -- 172.21.15.102:0/173348558 shutdown_connections 2024-09-13T19:16:14.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.486+0000 7f3849232800 1 --2- 172.21.15.102:0/173348558 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f371c036b90 0x7f371c039050 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.486+0000 7f3849232800 1 --2- 172.21.15.102:0/173348558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b46b512dc0 0x55b46b5131e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.486+0000 7f3849232800 1 -- 172.21.15.102:0/173348558 >> 172.21.15.102:0/173348558 conn(0x55b46b507d50 msgr2=0x55b46b50a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:14.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.486+0000 7f3849232800 1 -- 172.21.15.102:0/173348558 shutdown_connections 2024-09-13T19:16:14.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.486+0000 7f3849232800 1 -- 172.21.15.102:0/173348558 wait complete. 2024-09-13T19:16:14.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.486+0000 7f3849232800 1 -- 172.21.15.102:0/2291584488 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55b46b402670 msgr2=0x55b46b4ff180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.486+0000 7f3849232800 1 --2- 172.21.15.102:0/2291584488 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55b46b402670 0x55b46b4ff180 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.486+0000 7f3849232800 1 -- 172.21.15.102:0/2291584488 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55b46b5019b0 msgr2=0x55b46b503da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.486+0000 7f3849232800 1 --2- 172.21.15.102:0/2291584488 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55b46b5019b0 0x55b46b503da0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.486+0000 7f3849232800 1 -- 172.21.15.102:0/2291584488 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f372c036be0 msgr2=0x7f372c0390a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.486+0000 7f3849232800 1 --2- 172.21.15.102:0/2291584488 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f372c036be0 0x7f372c0390a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f382c000c00 tx=0x7f382c0013b0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.486+0000 7f3849232800 1 -- 172.21.15.102:0/2291584488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b46b372e80 msgr2=0x55b46b4f8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.486+0000 7f3849232800 1 --2- 172.21.15.102:0/2291584488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b46b372e80 0x55b46b4f8110 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f38340460a0 tx=0x7f3834003020 comp rx=0 tx=0).stop 2024-09-13T19:16:14.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.486+0000 7f3849232800 1 -- 172.21.15.102:0/2291584488 shutdown_connections 2024-09-13T19:16:14.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.486+0000 7f3849232800 1 --2- 172.21.15.102:0/2291584488 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55b46b5019b0 0x55b46b503da0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.486+0000 7f3849232800 1 --2- 172.21.15.102:0/2291584488 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55b46b402670 0x55b46b4ff180 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.486+0000 7f3849232800 1 --2- 172.21.15.102:0/2291584488 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f372c036be0 0x7f372c0390a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.486+0000 7f3849232800 1 --2- 172.21.15.102:0/2291584488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b46b372e80 0x55b46b4f8110 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.486+0000 7f3849232800 1 -- 172.21.15.102:0/2291584488 >> 172.21.15.102:0/2291584488 conn(0x55b46b3f9de0 msgr2=0x55b46b4e9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:14.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.486+0000 7f3849232800 1 -- 172.21.15.102:0/2291584488 shutdown_connections 2024-09-13T19:16:14.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.486+0000 7f3849232800 1 -- 172.21.15.102:0/2291584488 wait complete. 2024-09-13T19:16:14.499 INFO:teuthology.orchestra.run.smithi102.stdout:{"entries":[],"summary":[]} 2024-09-13T19:16:14.499 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-13T19:16:14.499 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T19:16:14.499 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T19:16:14.499 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T19:16:14.583 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:14.583 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:14.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.580+0000 7f9431e11800 1 Processor -- start 2024-09-13T19:16:14.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.580+0000 7f9431e11800 1 -- start start 2024-09-13T19:16:14.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.580+0000 7f9431e11800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f85d0fc610 0x55f85d18d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.580+0000 7f9431e11800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f85d047b30 con 0x55f85d18dbb0 2024-09-13T19:16:14.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.580+0000 7f9431e11800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55f85d029360 con 0x55f85d0fc610 2024-09-13T19:16:14.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.580+0000 7f942d63b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f85d0fc610 0x55f85d18d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.580+0000 7f9427fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55f85d18dbb0 0x55f85d18ffa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:49764/0 (socket says 172.21.15.102:49764) 2024-09-13T19:16:14.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.580+0000 7f9427fff640 1 -- 172.21.15.102:0/345600863 learned_addr learned my addr 172.21.15.102:0/345600863 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:16:14.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.581+0000 7f942d63b640 1 -- 172.21.15.102:0/345600863 >> v1:172.21.15.53:6789/0 conn(0x55f85d18dbb0 legacy=0x55f85d18ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.581+0000 7f942d63b640 1 -- 172.21.15.102:0/345600863 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f85d04fe00 con 0x55f85d0fc610 2024-09-13T19:16:14.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.582+0000 7f942d63b640 1 --2- 172.21.15.102:0/345600863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f85d0fc610 0x55f85d18d670 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f942000a470 tx=0x7f9420045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92bc58e1cbefb963 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.583+0000 7f942ce3a640 1 -- 172.21.15.102:0/345600863 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9420053570 con 0x55f85d0fc610 2024-09-13T19:16:14.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.583+0000 7f942ce3a640 1 -- 172.21.15.102:0/345600863 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9420058070 con 0x55f85d0fc610 2024-09-13T19:16:14.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.583+0000 7f942ce3a640 1 -- 172.21.15.102:0/345600863 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9420053880 con 0x55f85d0fc610 2024-09-13T19:16:14.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.583+0000 7f9431e11800 1 -- 172.21.15.102:0/345600863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f85d0fc610 msgr2=0x55f85d18d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.583+0000 7f9431e11800 1 --2- 172.21.15.102:0/345600863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f85d0fc610 0x55f85d18d670 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f942000a470 tx=0x7f9420045a20 comp rx=0 tx=0).stop 2024-09-13T19:16:14.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.583+0000 7f9431e11800 1 -- 172.21.15.102:0/345600863 shutdown_connections 2024-09-13T19:16:14.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.583+0000 7f9431e11800 1 --2- 172.21.15.102:0/345600863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f85d0fc610 0x55f85d18d670 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.583+0000 7f9431e11800 1 -- 172.21.15.102:0/345600863 >> 172.21.15.102:0/345600863 conn(0x55f85d182de0 msgr2=0x55f85d185200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:14.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.583+0000 7f9431e11800 1 -- 172.21.15.102:0/345600863 shutdown_connections 2024-09-13T19:16:14.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.583+0000 7f9431e11800 1 -- 172.21.15.102:0/345600863 wait complete. 2024-09-13T19:16:14.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.597+0000 7f9431e11800 1 Processor -- start 2024-09-13T19:16:14.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.597+0000 7f9431e11800 1 -- start start 2024-09-13T19:16:14.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.597+0000 7f9431e11800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f85d0fc610 0x55f85d279a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.597+0000 7f9431e11800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f85d0d4330 con 0x55f85d0fc610 2024-09-13T19:16:14.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.597+0000 7f942d63b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f85d0fc610 0x55f85d279a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.597+0000 7f942d63b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f85d0fc610 0x55f85d279a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53778/0 (socket says 172.21.15.102:53778) 2024-09-13T19:16:14.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.597+0000 7f942d63b640 1 -- 172.21.15.102:0/1417274630 learned_addr learned my addr 172.21.15.102:0/1417274630 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:14.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.598+0000 7f942d63b640 1 -- 172.21.15.102:0/1417274630 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f85d021bc0 con 0x55f85d0fc610 2024-09-13T19:16:14.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.598+0000 7f942d63b640 1 --2- 172.21.15.102:0/1417274630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f85d0fc610 0x55f85d279a80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9420025c20 tx=0x7f9420051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d65af159ffce3e61 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.598+0000 7f931b606640 1 -- 172.21.15.102:0/1417274630 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9420053ba0 con 0x55f85d0fc610 2024-09-13T19:16:14.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.598+0000 7f931b606640 1 -- 172.21.15.102:0/1417274630 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9420063030 con 0x55f85d0fc610 2024-09-13T19:16:14.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.598+0000 7f931b606640 1 -- 172.21.15.102:0/1417274630 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9420053440 con 0x55f85d0fc610 2024-09-13T19:16:14.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.599+0000 7f9431e11800 1 -- 172.21.15.102:0/1417274630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f85d0fc610 msgr2=0x55f85d279a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.599+0000 7f9431e11800 1 --2- 172.21.15.102:0/1417274630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f85d0fc610 0x55f85d279a80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9420025c20 tx=0x7f9420051000 comp rx=0 tx=0).stop 2024-09-13T19:16:14.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.599+0000 7f9431e11800 1 -- 172.21.15.102:0/1417274630 shutdown_connections 2024-09-13T19:16:14.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.599+0000 7f9431e11800 1 --2- 172.21.15.102:0/1417274630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f85d0fc610 0x55f85d279a80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.599+0000 7f9431e11800 1 -- 172.21.15.102:0/1417274630 >> 172.21.15.102:0/1417274630 conn(0x55f85d182de0 msgr2=0x55f85d275440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:14.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.599+0000 7f9431e11800 1 -- 172.21.15.102:0/1417274630 shutdown_connections 2024-09-13T19:16:14.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.599+0000 7f9431e11800 1 -- 172.21.15.102:0/1417274630 wait complete. 2024-09-13T19:16:14.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.599+0000 7f9431e11800 1 Processor -- start 2024-09-13T19:16:14.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.599+0000 7f9431e11800 1 -- start start 2024-09-13T19:16:14.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.599+0000 7f9431e11800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f85d0fc610 0x55f85d281380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.599+0000 7f9431e11800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f85d191990 con 0x55f85d0fc610 2024-09-13T19:16:14.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.600+0000 7f942d63b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f85d0fc610 0x55f85d281380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.600+0000 7f942d63b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f85d0fc610 0x55f85d281380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53790/0 (socket says 172.21.15.102:53790) 2024-09-13T19:16:14.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.600+0000 7f942d63b640 1 -- 172.21.15.102:0/3569053184 learned_addr learned my addr 172.21.15.102:0/3569053184 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:14.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.600+0000 7f942d63b640 1 -- 172.21.15.102:0/3569053184 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f85d035fe0 con 0x55f85d0fc610 2024-09-13T19:16:14.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.600+0000 7f942d63b640 1 --2- 172.21.15.102:0/3569053184 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f85d0fc610 0x55f85d281380 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x55f85d27a8e0 tx=0x7f9420002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.600+0000 7f9319e03640 1 -- 172.21.15.102:0/3569053184 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9420078070 con 0x55f85d0fc610 2024-09-13T19:16:14.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.600+0000 7f9319e03640 1 -- 172.21.15.102:0/3569053184 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9420053570 con 0x55f85d0fc610 2024-09-13T19:16:14.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.600+0000 7f9319e03640 1 -- 172.21.15.102:0/3569053184 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9420053850 con 0x55f85d0fc610 2024-09-13T19:16:14.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.600+0000 7f9431e11800 1 -- 172.21.15.102:0/3569053184 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f85d2818c0 con 0x55f85d0fc610 2024-09-13T19:16:14.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.600+0000 7f9431e11800 1 -- 172.21.15.102:0/3569053184 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f85d281e40 con 0x55f85d0fc610 2024-09-13T19:16:14.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.601+0000 7f9319e03640 1 -- 172.21.15.102:0/3569053184 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f942007b070 con 0x55f85d0fc610 2024-09-13T19:16:14.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.601+0000 7f9319e03640 1 --2- 172.21.15.102:0/3569053184 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9314036b90 0x7f9314039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.601+0000 7f9319e03640 1 -- 172.21.15.102:0/3569053184 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f9420070070 con 0x55f85d0fc610 2024-09-13T19:16:14.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.601+0000 7f9427fff640 1 --2- 172.21.15.102:0/3569053184 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9314036b90 0x7f9314039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.601+0000 7f9431e11800 1 --2- 172.21.15.102:0/3569053184 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55f85d18dbb0 0x55f85d2883f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.601+0000 7f9431e11800 1 -- 172.21.15.102:0/3569053184 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2889c0 con 0x55f85d18dbb0 2024-09-13T19:16:14.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.602+0000 7f942de3c640 1 --2- 172.21.15.102:0/3569053184 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55f85d18dbb0 0x55f85d2883f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.602+0000 7f9427fff640 1 --2- 172.21.15.102:0/3569053184 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9314036b90 0x7f9314039050 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9418000f60 tx=0x7f94180012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.602+0000 7f942de3c640 1 --2- 172.21.15.102:0/3569053184 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55f85d18dbb0 0x55f85d2883f0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.602+0000 7f942de3c640 1 -- 172.21.15.102:0/3569053184 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f942800a4a0 con 0x55f85d18dbb0 2024-09-13T19:16:14.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.602+0000 7f9431e11800 1 -- 172.21.15.102:0/3569053184 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2859c0 con 0x55f85d18dbb0 2024-09-13T19:16:14.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.603+0000 7f942de3c640 1 -- 172.21.15.102:0/3569053184 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f942800a4a0 con 0x55f85d18dbb0 2024-09-13T19:16:14.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.603+0000 7f9431e11800 1 --2- 172.21.15.102:0/3569053184 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55f85d28ad10 0x55f85d28d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.603+0000 7f9431e11800 1 -- 172.21.15.102:0/3569053184 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f85d28d7f0 con 0x55f85d28ad10 2024-09-13T19:16:14.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.603+0000 7f942d63b640 1 --2- 172.21.15.102:0/3569053184 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55f85d28ad10 0x55f85d28d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.603+0000 7f942d63b640 1 --2- 172.21.15.102:0/3569053184 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55f85d28ad10 0x55f85d28d100 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.603+0000 7f942d63b640 1 -- 172.21.15.102:0/3569053184 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f942007a030 con 0x55f85d28ad10 2024-09-13T19:16:14.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.603+0000 7f9431e11800 1 -- 172.21.15.102:0/3569053184 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f85d289af0 con 0x55f85d18dbb0 2024-09-13T19:16:14.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.603+0000 7f942de3c640 1 -- 172.21.15.102:0/3569053184 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f942800a4a0 con 0x55f85d18dbb0 2024-09-13T19:16:14.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.604+0000 7f9431e11800 1 -- 172.21.15.102:0/3569053184 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f85d289fd0 con 0x55f85d28ad10 2024-09-13T19:16:14.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.604+0000 7f942d63b640 1 -- 172.21.15.102:0/3569053184 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f942007a030 con 0x55f85d28ad10 2024-09-13T19:16:14.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.604+0000 7f9431e11800 1 Processor -- start 2024-09-13T19:16:14.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.604+0000 7f9431e11800 1 -- start start 2024-09-13T19:16:14.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.604+0000 7f9431e11800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f85d29c110 0x55f85d29c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.604+0000 7f9431e11800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f85d023580 con 0x55f85d29c110 2024-09-13T19:16:14.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.605+0000 7f942de3c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f85d29c110 0x55f85d29c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.605+0000 7f942de3c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f85d29c110 0x55f85d29c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53800/0 (socket says 172.21.15.102:53800) 2024-09-13T19:16:14.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.605+0000 7f942de3c640 1 -- 172.21.15.102:0/1489171209 learned_addr learned my addr 172.21.15.102:0/1489171209 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:14.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.605+0000 7f942de3c640 1 -- 172.21.15.102:0/1489171209 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f85d29ca70 con 0x55f85d29c110 2024-09-13T19:16:14.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.605+0000 7f942de3c640 1 --2- 172.21.15.102:0/1489171209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f85d29c110 0x55f85d29c530 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x55f85d2825a0 tx=0x7f94280163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.605+0000 7f9312ffd640 1 -- 172.21.15.102:0/1489171209 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9428013450 con 0x55f85d29c110 2024-09-13T19:16:14.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.605+0000 7f9312ffd640 1 -- 172.21.15.102:0/1489171209 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94280135f0 con 0x55f85d29c110 2024-09-13T19:16:14.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.605+0000 7f9431e11800 1 -- 172.21.15.102:0/1489171209 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f85d29cd00 con 0x55f85d29c110 2024-09-13T19:16:14.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.605+0000 7f9312ffd640 1 -- 172.21.15.102:0/1489171209 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9428013910 con 0x55f85d29c110 2024-09-13T19:16:14.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.605+0000 7f9431e11800 1 -- 172.21.15.102:0/1489171209 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f85d29f9e0 con 0x55f85d29c110 2024-09-13T19:16:14.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.606+0000 7f9312ffd640 1 -- 172.21.15.102:0/1489171209 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9428011040 con 0x55f85d29c110 2024-09-13T19:16:14.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.606+0000 7f9312ffd640 1 --2- 172.21.15.102:0/1489171209 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9308036c00 0x7f93080390c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.606+0000 7f9312ffd640 1 -- 172.21.15.102:0/1489171209 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f942800e040 con 0x55f85d29c110 2024-09-13T19:16:14.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.606+0000 7f942d63b640 1 --2- 172.21.15.102:0/1489171209 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9308036c00 0x7f93080390c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.606+0000 7f9431e11800 1 Processor -- start 2024-09-13T19:16:14.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.607+0000 7f9431e11800 1 -- start start 2024-09-13T19:16:14.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.607+0000 7f942d63b640 1 --2- 172.21.15.102:0/1489171209 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9308036c00 0x7f93080390c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9420090010 tx=0x7f942008ebc0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.607+0000 7f9431e11800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f85d2a8e60 0x55f85d2a9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.607+0000 7f9431e11800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f85d27a1d0 con 0x55f85d2a8e60 2024-09-13T19:16:14.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.607+0000 7f942de3c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f85d2a8e60 0x55f85d2a9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.607+0000 7f942de3c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f85d2a8e60 0x55f85d2a9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53808/0 (socket says 172.21.15.102:53808) 2024-09-13T19:16:14.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.607+0000 7f942de3c640 1 -- 172.21.15.102:0/3964109512 learned_addr learned my addr 172.21.15.102:0/3964109512 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:14.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.607+0000 7f942de3c640 1 -- 172.21.15.102:0/3964109512 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f85d2a9830 con 0x55f85d2a8e60 2024-09-13T19:16:14.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.607+0000 7f942de3c640 1 --2- 172.21.15.102:0/3964109512 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f85d2a8e60 0x55f85d2a9260 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f942804ce00 tx=0x7f9428029fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffa4df914413ecec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.608+0000 7f9310ff9640 1 -- 172.21.15.102:0/3964109512 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9428046120 con 0x55f85d2a8e60 2024-09-13T19:16:14.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.608+0000 7f9310ff9640 1 -- 172.21.15.102:0/3964109512 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f942801f390 con 0x55f85d2a8e60 2024-09-13T19:16:14.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.608+0000 7f9310ff9640 1 -- 172.21.15.102:0/3964109512 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9428012cb0 con 0x55f85d2a8e60 2024-09-13T19:16:14.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.608+0000 7f9431e11800 1 -- 172.21.15.102:0/3964109512 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f85d2a8e60 msgr2=0x55f85d2a9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.608+0000 7f9431e11800 1 --2- 172.21.15.102:0/3964109512 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f85d2a8e60 0x55f85d2a9260 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f942804ce00 tx=0x7f9428029fb0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.608+0000 7f9431e11800 1 -- 172.21.15.102:0/3964109512 shutdown_connections 2024-09-13T19:16:14.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.608+0000 7f9431e11800 1 --2- 172.21.15.102:0/3964109512 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f85d2a8e60 0x55f85d2a9260 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.608+0000 7f9431e11800 1 -- 172.21.15.102:0/3964109512 >> 172.21.15.102:0/3964109512 conn(0x55f85d2a51c0 msgr2=0x55f85d2a32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:14.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.608+0000 7f9431e11800 1 -- 172.21.15.102:0/3964109512 shutdown_connections 2024-09-13T19:16:14.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.608+0000 7f9431e11800 1 -- 172.21.15.102:0/3964109512 wait complete. 2024-09-13T19:16:14.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.608+0000 7f9431e11800 1 Processor -- start 2024-09-13T19:16:14.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.609+0000 7f9431e11800 1 -- start start 2024-09-13T19:16:14.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.609+0000 7f9431e11800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f85d2a8e60 0x55f85d2b0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.609+0000 7f9431e11800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f85d2a9ea0 con 0x55f85d2a8e60 2024-09-13T19:16:14.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.609+0000 7f942de3c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f85d2a8e60 0x55f85d2b0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.609+0000 7f942de3c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f85d2a8e60 0x55f85d2b0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53822/0 (socket says 172.21.15.102:53822) 2024-09-13T19:16:14.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.609+0000 7f942de3c640 1 -- 172.21.15.102:0/2021793118 learned_addr learned my addr 172.21.15.102:0/2021793118 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:14.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.609+0000 7f942de3c640 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f85d2b0870 con 0x55f85d2a8e60 2024-09-13T19:16:14.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.609+0000 7f942de3c640 1 --2- 172.21.15.102:0/2021793118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f85d2a8e60 0x55f85d2b0330 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f942804bcd0 tx=0x7f942804cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.609+0000 7f92feffd640 1 -- 172.21.15.102:0/2021793118 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9428038020 con 0x55f85d2a8e60 2024-09-13T19:16:14.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.610+0000 7f92feffd640 1 -- 172.21.15.102:0/2021793118 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9428030040 con 0x55f85d2a8e60 2024-09-13T19:16:14.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.610+0000 7f9431e11800 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f85d2b0b00 con 0x55f85d2a8e60 2024-09-13T19:16:14.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.610+0000 7f92feffd640 1 -- 172.21.15.102:0/2021793118 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f942802f070 con 0x55f85d2a8e60 2024-09-13T19:16:14.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.610+0000 7f9431e11800 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f85d2b37b0 con 0x55f85d2a8e60 2024-09-13T19:16:14.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.610+0000 7f92feffd640 1 -- 172.21.15.102:0/2021793118 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f942803b020 con 0x55f85d2a8e60 2024-09-13T19:16:14.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.610+0000 7f92feffd640 1 --2- 172.21.15.102:0/2021793118 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f92f8036b90 0x7f92f8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.610+0000 7f92feffd640 1 -- 172.21.15.102:0/2021793118 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f942803ec40 con 0x55f85d2a8e60 2024-09-13T19:16:14.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.611+0000 7f942d63b640 1 --2- 172.21.15.102:0/2021793118 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f92f8036b90 0x7f92f8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.611+0000 7f9431e11800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.611+0000 7f9431e11800 1 --2- 172.21.15.102:0/2021793118 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55f85d2bbf80 0x55f85d2be440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.611+0000 7f9431e11800 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2beb90 con 0x55f85d2bbf80 2024-09-13T19:16:14.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.611+0000 7f9427fff640 1 --2- 172.21.15.102:0/2021793118 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55f85d2bbf80 0x55f85d2be440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.611+0000 7f942d63b640 1 --2- 172.21.15.102:0/2021793118 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f92f8036b90 0x7f92f8039050 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9420050020 tx=0x7f9420092000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.611+0000 7f9427fff640 1 --2- 172.21.15.102:0/2021793118 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55f85d2bbf80 0x55f85d2be440 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.611+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9418009050 con 0x55f85d2bbf80 2024-09-13T19:16:14.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.611+0000 7f9431e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:14.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.611+0000 7f9431e11800 20 realm 2024-09-13T19:16:14.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.611+0000 7f9431e11800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.611+0000 7f9431e11800 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2bb3d0 con 0x55f85d2bbf80 2024-09-13T19:16:14.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.612+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9418009050 con 0x55f85d2bbf80 2024-09-13T19:16:14.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.612+0000 7f9431e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:14.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.612+0000 7f9431e11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:14.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.612+0000 7f9431e11800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.612+0000 7f9431e11800 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2bf670 con 0x55f85d2bbf80 2024-09-13T19:16:14.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.612+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9418009050 con 0x55f85d2bbf80 2024-09-13T19:16:14.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.612+0000 7f9431e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:14.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.612+0000 7f9431e11800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.612+0000 7f9431e11800 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2bff40 con 0x55f85d2bbf80 2024-09-13T19:16:14.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.612+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9418009050 con 0x55f85d2bbf80 2024-09-13T19:16:14.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.612+0000 7f9431e11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:14.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.612+0000 7f9431e11800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.612+0000 7f9431e11800 1 --2- 172.21.15.102:0/2021793118 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55f85d2c07f0 0x55f85d2c2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.612+0000 7f9431e11800 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2c3320 con 0x55f85d2c07f0 2024-09-13T19:16:14.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.612+0000 7f942de3c640 1 --2- 172.21.15.102:0/2021793118 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55f85d2c07f0 0x55f85d2c2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.613+0000 7f942de3c640 1 --2- 172.21.15.102:0/2021793118 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55f85d2c07f0 0x55f85d2c2be0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.613+0000 7f942de3c640 1 -- 172.21.15.102:0/2021793118 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9428032070 con 0x55f85d2c07f0 2024-09-13T19:16:14.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.613+0000 7f9431e11800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:14.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.613+0000 7f9431e11800 20 searching for the correct realm 2024-09-13T19:16:14.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.613+0000 7f9431e11800 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2c4cf0 con 0x55f85d2c07f0 2024-09-13T19:16:14.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.613+0000 7f942de3c640 1 -- 172.21.15.102:0/2021793118 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9428032070 con 0x55f85d2c07f0 2024-09-13T19:16:14.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.613+0000 7f942de3c640 1 --2- 172.21.15.102:0/2021793118 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f942803d020 0x7f9428021440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.613+0000 7f942de3c640 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2c4cf0 con 0x7f942803d020 2024-09-13T19:16:14.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.613+0000 7f942d63b640 1 --2- 172.21.15.102:0/2021793118 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f942803d020 0x7f9428021440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.613+0000 7f942d63b640 1 --2- 172.21.15.102:0/2021793118 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f942803d020 0x7f9428021440 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.614+0000 7f942d63b640 1 -- 172.21.15.102:0/2021793118 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f942007a030 con 0x7f942803d020 2024-09-13T19:16:14.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.614+0000 7f942d63b640 1 --2- 172.21.15.102:0/2021793118 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f942009d070 0x7f9420004280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.614+0000 7f942d63b640 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2c4cf0 con 0x7f942009d070 2024-09-13T19:16:14.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.614+0000 7f9427fff640 1 --2- 172.21.15.102:0/2021793118 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f942009d070 0x7f9420004280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.614+0000 7f9427fff640 1 --2- 172.21.15.102:0/2021793118 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f942009d070 0x7f9420004280 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.615+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9418009050 con 0x7f942009d070 2024-09-13T19:16:14.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.615+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2c4cf0 con 0x55f85d2bbf80 2024-09-13T19:16:14.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.615+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9418009050 con 0x55f85d2bbf80 2024-09-13T19:16:14.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.615+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2c4cf0 con 0x55f85d2bbf80 2024-09-13T19:16:14.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.615+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9418029040 con 0x55f85d2bbf80 2024-09-13T19:16:14.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.615+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2c4cf0 con 0x7f942009d070 2024-09-13T19:16:14.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.615+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9418029040 con 0x7f942009d070 2024-09-13T19:16:14.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.615+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2c4cf0 con 0x7f942009d070 2024-09-13T19:16:14.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.615+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9418029040 con 0x7f942009d070 2024-09-13T19:16:14.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.615+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2c4cf0 con 0x7f942803d020 2024-09-13T19:16:14.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.616+0000 7f942d63b640 1 -- 172.21.15.102:0/2021793118 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f942007a030 con 0x7f942803d020 2024-09-13T19:16:14.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.616+0000 7f942d63b640 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2c4cf0 con 0x55f85d2c07f0 2024-09-13T19:16:14.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.616+0000 7f942de3c640 1 -- 172.21.15.102:0/2021793118 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9428032070 con 0x55f85d2c07f0 2024-09-13T19:16:14.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.616+0000 7f942de3c640 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2c4cf0 con 0x55f85d2bbf80 2024-09-13T19:16:14.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.616+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9418029040 con 0x55f85d2bbf80 2024-09-13T19:16:14.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.616+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2c4cf0 con 0x7f942009d070 2024-09-13T19:16:14.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.617+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9418029040 con 0x7f942009d070 2024-09-13T19:16:14.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.617+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2c4cf0 con 0x55f85d2bbf80 2024-09-13T19:16:14.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.617+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9418029040 con 0x55f85d2bbf80 2024-09-13T19:16:14.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.617+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2c4cf0 con 0x7f942803d020 2024-09-13T19:16:14.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.617+0000 7f942d63b640 1 -- 172.21.15.102:0/2021793118 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f942007a030 con 0x7f942803d020 2024-09-13T19:16:14.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.617+0000 7f942d63b640 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2c4cf0 con 0x55f85d2c07f0 2024-09-13T19:16:14.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.617+0000 7f942de3c640 1 -- 172.21.15.102:0/2021793118 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9428032070 con 0x55f85d2c07f0 2024-09-13T19:16:14.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.617+0000 7f942de3c640 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2c4cf0 con 0x55f85d2c07f0 2024-09-13T19:16:14.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.617+0000 7f942de3c640 1 -- 172.21.15.102:0/2021793118 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9428032070 con 0x55f85d2c07f0 2024-09-13T19:16:14.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.617+0000 7f942de3c640 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2c4cf0 con 0x7f942009d070 2024-09-13T19:16:14.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.618+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9418029040 con 0x7f942009d070 2024-09-13T19:16:14.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.618+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2c4cf0 con 0x55f85d2c07f0 2024-09-13T19:16:14.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.618+0000 7f942de3c640 1 -- 172.21.15.102:0/2021793118 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9428032070 con 0x55f85d2c07f0 2024-09-13T19:16:14.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.618+0000 7f942de3c640 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2c4cf0 con 0x55f85d2c07f0 2024-09-13T19:16:14.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.618+0000 7f942de3c640 1 -- 172.21.15.102:0/2021793118 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9428032070 con 0x55f85d2c07f0 2024-09-13T19:16:14.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.618+0000 7f942de3c640 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2c4cf0 con 0x55f85d2bbf80 2024-09-13T19:16:14.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.618+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9418029040 con 0x55f85d2bbf80 2024-09-13T19:16:14.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.618+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2c4cf0 con 0x55f85d2bbf80 2024-09-13T19:16:14.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.619+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9418029040 con 0x55f85d2bbf80 2024-09-13T19:16:14.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.619+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2c4cf0 con 0x7f942009d070 2024-09-13T19:16:14.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.619+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9418029040 con 0x7f942009d070 2024-09-13T19:16:14.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.619+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2c4cf0 con 0x55f85d2c07f0 2024-09-13T19:16:14.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.619+0000 7f942de3c640 1 -- 172.21.15.102:0/2021793118 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9428032070 con 0x55f85d2c07f0 2024-09-13T19:16:14.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.619+0000 7f942de3c640 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2c4cf0 con 0x7f942803d020 2024-09-13T19:16:14.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.619+0000 7f942d63b640 1 -- 172.21.15.102:0/2021793118 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f942007a030 con 0x7f942803d020 2024-09-13T19:16:14.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.619+0000 7f942d63b640 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2c4cf0 con 0x55f85d2bbf80 2024-09-13T19:16:14.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.620+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9418029040 con 0x55f85d2bbf80 2024-09-13T19:16:14.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.620+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2c4cf0 con 0x7f942009d070 2024-09-13T19:16:14.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.620+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9418029040 con 0x7f942009d070 2024-09-13T19:16:14.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.620+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2c4cf0 con 0x55f85d2c07f0 2024-09-13T19:16:14.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.620+0000 7f942de3c640 1 -- 172.21.15.102:0/2021793118 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9428032070 con 0x55f85d2c07f0 2024-09-13T19:16:14.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.620+0000 7f942de3c640 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2c4cf0 con 0x7f942009d070 2024-09-13T19:16:14.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.620+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9418029040 con 0x7f942009d070 2024-09-13T19:16:14.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.620+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2c4cf0 con 0x7f942803d020 2024-09-13T19:16:14.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.621+0000 7f942d63b640 1 -- 172.21.15.102:0/2021793118 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f942007a030 con 0x7f942803d020 2024-09-13T19:16:14.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.621+0000 7f942d63b640 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2c4cf0 con 0x55f85d2c07f0 2024-09-13T19:16:14.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.621+0000 7f942de3c640 1 -- 172.21.15.102:0/2021793118 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9428032070 con 0x55f85d2c07f0 2024-09-13T19:16:14.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.621+0000 7f942de3c640 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2c4cf0 con 0x7f942009d070 2024-09-13T19:16:14.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.621+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9418029040 con 0x7f942009d070 2024-09-13T19:16:14.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.622+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2c4cf0 con 0x55f85d2bbf80 2024-09-13T19:16:14.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.622+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9418029040 con 0x55f85d2bbf80 2024-09-13T19:16:14.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.622+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2c4cf0 con 0x7f942803d020 2024-09-13T19:16:14.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.622+0000 7f942d63b640 1 -- 172.21.15.102:0/2021793118 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f942007a030 con 0x7f942803d020 2024-09-13T19:16:14.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.622+0000 7f9431e11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:14.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.622+0000 7f9431e11800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:14.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.622+0000 7f9431e11800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:14.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.622+0000 7f9431e11800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:14.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.622+0000 7f9431e11800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:14.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.622+0000 7f9431e11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:14.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.622+0000 7f9431e11800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.622+0000 7f9431e11800 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2c3dc0 con 0x55f85d2bbf80 2024-09-13T19:16:14.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.622+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9418029040 con 0x55f85d2bbf80 2024-09-13T19:16:14.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.622+0000 7f9431e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:14.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.622+0000 7f9431e11800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.622+0000 7f9431e11800 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2c3a00 con 0x55f85d2bbf80 2024-09-13T19:16:14.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.623+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9418029040 con 0x55f85d2bbf80 2024-09-13T19:16:14.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.623+0000 7f9431e11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:14.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.623+0000 7f9431e11800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.623+0000 7f9431e11800 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2c46e0 con 0x55f85d2c07f0 2024-09-13T19:16:14.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.623+0000 7f942de3c640 1 -- 172.21.15.102:0/2021793118 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9428032070 con 0x55f85d2c07f0 2024-09-13T19:16:14.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.623+0000 7f9431e11800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:14.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.623+0000 7f9431e11800 20 zone default found 2024-09-13T19:16:14.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.623+0000 7f9431e11800 4 Realm: () 2024-09-13T19:16:14.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.623+0000 7f9431e11800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:14.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.623+0000 7f9431e11800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:14.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.623+0000 7f9431e11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:14.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.623+0000 7f9431e11800 20 zonegroup default 2024-09-13T19:16:14.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.623+0000 7f9431e11800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.623+0000 7f9431e11800 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2c5670 con 0x7f942009d070 2024-09-13T19:16:14.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.623+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9418029040 con 0x7f942009d070 2024-09-13T19:16:14.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.623+0000 7f9431e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:14.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.623+0000 7f9431e11800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.623+0000 7f9431e11800 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2c7480 con 0x55f85d2c07f0 2024-09-13T19:16:14.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.623+0000 7f942de3c640 1 -- 172.21.15.102:0/2021793118 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9428032070 con 0x55f85d2c07f0 2024-09-13T19:16:14.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.623+0000 7f9431e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:14.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.624+0000 7f9431e11800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.624+0000 7f9431e11800 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2c78f0 con 0x55f85d2c07f0 2024-09-13T19:16:14.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.624+0000 7f942de3c640 1 -- 172.21.15.102:0/2021793118 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9428032070 con 0x55f85d2c07f0 2024-09-13T19:16:14.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.624+0000 7f9431e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:14.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.624+0000 7f9431e11800 20 started sync module instance, tier type = 2024-09-13T19:16:14.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.624+0000 7f9431e11800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:14.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.624+0000 7f9431e11800 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2c6890 con 0x7f942803d020 2024-09-13T19:16:14.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.625+0000 7f942d63b640 1 -- 172.21.15.102:0/2021793118 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(44 notify.0 [create] v34'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f942007a030 con 0x7f942803d020 2024-09-13T19:16:14.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.625+0000 7f9431e11800 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94525203440608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2c7d50 con 0x7f942803d020 2024-09-13T19:16:14.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.625+0000 7f9431e11800 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2c85a0 con 0x55f85d2bbf80 2024-09-13T19:16:14.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.627+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v34'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9418029040 con 0x55f85d2bbf80 2024-09-13T19:16:14.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.627+0000 7f942d63b640 1 -- 172.21.15.102:0/2021793118 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94525203440608] v34'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f942007a030 con 0x7f942803d020 2024-09-13T19:16:14.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.627+0000 7f9431e11800 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94525203448528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2c8d40 con 0x55f85d2bbf80 2024-09-13T19:16:14.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.627+0000 7f9431e11800 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2c6ca0 con 0x55f85d2c07f0 2024-09-13T19:16:14.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.628+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94525203448528] v34'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9418029040 con 0x55f85d2bbf80 2024-09-13T19:16:14.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.629+0000 7f942de3c640 1 -- 172.21.15.102:0/2021793118 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v34'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9428032070 con 0x55f85d2c07f0 2024-09-13T19:16:14.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.629+0000 7f9431e11800 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94525203449744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2c8d00 con 0x55f85d2c07f0 2024-09-13T19:16:14.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.629+0000 7f9431e11800 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2c9e00 con 0x7f942803d020 2024-09-13T19:16:14.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.630+0000 7f942de3c640 1 -- 172.21.15.102:0/2021793118 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94525203449744] v34'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9428032070 con 0x55f85d2c07f0 2024-09-13T19:16:14.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.630+0000 7f942d63b640 1 -- 172.21.15.102:0/2021793118 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(50 notify.3 [create] v34'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f942007a030 con 0x7f942803d020 2024-09-13T19:16:14.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.630+0000 7f9431e11800 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94525203454288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2ca1a0 con 0x7f942803d020 2024-09-13T19:16:14.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.630+0000 7f9431e11800 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2cac50 con 0x55f85d2bbf80 2024-09-13T19:16:14.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.631+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v34'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9418029040 con 0x55f85d2bbf80 2024-09-13T19:16:14.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.631+0000 7f9431e11800 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94525203457840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2cac50 con 0x55f85d2bbf80 2024-09-13T19:16:14.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.631+0000 7f9431e11800 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2cbc50 con 0x7f942009d070 2024-09-13T19:16:14.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.631+0000 7f942d63b640 1 -- 172.21.15.102:0/2021793118 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94525203454288] v34'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f942007a030 con 0x7f942803d020 2024-09-13T19:16:14.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.632+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94525203457840] v34'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9418029040 con 0x55f85d2bbf80 2024-09-13T19:16:14.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.632+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(54 notify.5 [create] v34'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9418029040 con 0x7f942009d070 2024-09-13T19:16:14.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.632+0000 7f9431e11800 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94525203461952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2cae30 con 0x7f942009d070 2024-09-13T19:16:14.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.632+0000 7f9431e11800 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2cc4f0 con 0x7f942009d070 2024-09-13T19:16:14.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.633+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94525203461952] v34'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9418029040 con 0x7f942009d070 2024-09-13T19:16:14.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.633+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(56 notify.6 [create] v34'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9418029040 con 0x7f942009d070 2024-09-13T19:16:14.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.633+0000 7f9431e11800 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94525203452720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2cae30 con 0x7f942009d070 2024-09-13T19:16:14.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.633+0000 7f9431e11800 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2ccb10 con 0x7f942009d070 2024-09-13T19:16:14.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.634+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94525203452720] v34'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9418029040 con 0x7f942009d070 2024-09-13T19:16:14.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.634+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(58 notify.7 [create] v34'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9418029040 con 0x7f942009d070 2024-09-13T19:16:14.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.634+0000 7f9431e11800 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94525203463984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2ccb10 con 0x7f942009d070 2024-09-13T19:16:14.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.634+0000 7f9431e11800 20 add_watcher() i=0 2024-09-13T19:16:14.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.634+0000 7f9431e11800 20 add_watcher() i=1 2024-09-13T19:16:14.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.634+0000 7f9431e11800 20 add_watcher() i=2 2024-09-13T19:16:14.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.634+0000 7f9431e11800 20 add_watcher() i=3 2024-09-13T19:16:14.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.634+0000 7f9431e11800 20 add_watcher() i=4 2024-09-13T19:16:14.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.634+0000 7f9431e11800 20 add_watcher() i=5 2024-09-13T19:16:14.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.634+0000 7f9431e11800 20 add_watcher() i=6 2024-09-13T19:16:14.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.635+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94525203463984] v34'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9418029040 con 0x7f942009d070 2024-09-13T19:16:14.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.635+0000 7f9431e11800 20 add_watcher() i=7 2024-09-13T19:16:14.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.635+0000 7f9431e11800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:14.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.635+0000 7f9431e11800 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2cfe30 con 0x55f85d2bbf80 2024-09-13T19:16:14.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.636+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9418029040 con 0x55f85d2bbf80 2024-09-13T19:16:14.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.636+0000 7f9431e11800 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94525203466192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f85d2cd0a0 con 0x55f85d2bbf80 2024-09-13T19:16:14.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.637+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94525203466192] v34'48 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9418029040 con 0x55f85d2bbf80 2024-09-13T19:16:14.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.637+0000 7f92e37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:14.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.637+0000 7f9431e11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:14.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.637+0000 7f9431e11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:14.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.637+0000 7f9431e11800 5 note: GC not initialized 2024-09-13T19:16:14.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.637+0000 7f92e27e4640 20 reqs_thread_entry: start 2024-09-13T19:16:14.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.637+0000 7f9431e11800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:14.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.637+0000 7f9431e11800 20 Filter name: none 2024-09-13T19:16:14.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.637+0000 7f9253fff640 20 reqs_thread_entry: start 2024-09-13T19:16:14.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.637+0000 7f9431e11800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.637+0000 7f9431e11800 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f85d302eb0 con 0x55f85d2bbf80 2024-09-13T19:16:14.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.638+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f9418029040 con 0x55f85d2bbf80 2024-09-13T19:16:14.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.638+0000 7f9431e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:14.652 INFO:teuthology.orchestra.run.smithi102.stderr:could not fetch user info: no user info saved 2024-09-13T19:16:14.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.639+0000 7f92e37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:14.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.639+0000 7f9431e11800 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94525203466192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f85d302e70 con 0x55f85d2bbf80 2024-09-13T19:16:14.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.639+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94525203466192] v34'49 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9418029040 con 0x55f85d2bbf80 2024-09-13T19:16:14.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.639+0000 7f9431e11800 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94525203440608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f85d300ca0 con 0x7f942803d020 2024-09-13T19:16:14.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.640+0000 7f942d63b640 1 -- 172.21.15.102:0/2021793118 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94525203440608] v34'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f942007a030 con 0x7f942803d020 2024-09-13T19:16:14.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.640+0000 7f9431e11800 20 remove_watcher() i=0 2024-09-13T19:16:14.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.640+0000 7f9431e11800 2 removed watcher, disabling cache 2024-09-13T19:16:14.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.640+0000 7f9431e11800 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94525203448528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f85d300ca0 con 0x55f85d2bbf80 2024-09-13T19:16:14.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.642+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94525203448528] v34'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9418029040 con 0x55f85d2bbf80 2024-09-13T19:16:14.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.642+0000 7f9431e11800 20 remove_watcher() i=1 2024-09-13T19:16:14.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.642+0000 7f9431e11800 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94525203449744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f85d300ca0 con 0x55f85d2c07f0 2024-09-13T19:16:14.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.643+0000 7f942de3c640 1 -- 172.21.15.102:0/2021793118 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94525203449744] v34'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9428032070 con 0x55f85d2c07f0 2024-09-13T19:16:14.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.643+0000 7f9431e11800 20 remove_watcher() i=2 2024-09-13T19:16:14.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.643+0000 7f9431e11800 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94525203454288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f85d300ca0 con 0x7f942803d020 2024-09-13T19:16:14.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.644+0000 7f942d63b640 1 -- 172.21.15.102:0/2021793118 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94525203454288] v34'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f942007a030 con 0x7f942803d020 2024-09-13T19:16:14.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.644+0000 7f9431e11800 20 remove_watcher() i=3 2024-09-13T19:16:14.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.644+0000 7f9431e11800 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94525203457840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f85d300ca0 con 0x55f85d2bbf80 2024-09-13T19:16:14.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.645+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94525203457840] v34'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9418029040 con 0x55f85d2bbf80 2024-09-13T19:16:14.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.645+0000 7f9431e11800 20 remove_watcher() i=4 2024-09-13T19:16:14.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.645+0000 7f9431e11800 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94525203461952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f85d300ca0 con 0x7f942009d070 2024-09-13T19:16:14.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.645+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94525203461952] v34'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9418029040 con 0x7f942009d070 2024-09-13T19:16:14.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.645+0000 7f9431e11800 20 remove_watcher() i=5 2024-09-13T19:16:14.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.646+0000 7f9431e11800 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94525203452720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f85d300ca0 con 0x7f942009d070 2024-09-13T19:16:14.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.647+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94525203452720] v34'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9418029040 con 0x7f942009d070 2024-09-13T19:16:14.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.647+0000 7f9431e11800 20 remove_watcher() i=6 2024-09-13T19:16:14.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.647+0000 7f9431e11800 1 -- 172.21.15.102:0/2021793118 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94525203463984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f85d300ca0 con 0x7f942009d070 2024-09-13T19:16:14.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.648+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94525203463984] v34'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9418029040 con 0x7f942009d070 2024-09-13T19:16:14.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.648+0000 7f9431e11800 20 remove_watcher() i=7 2024-09-13T19:16:14.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.648+0000 7f9431e11800 1 -- 172.21.15.102:0/2021793118 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f942009d070 msgr2=0x7f9420004280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.648+0000 7f9431e11800 1 --2- 172.21.15.102:0/2021793118 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f942009d070 0x7f9420004280 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.648+0000 7f9431e11800 1 -- 172.21.15.102:0/2021793118 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55f85d2bbf80 msgr2=0x55f85d2be440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.648+0000 7f9431e11800 1 --2- 172.21.15.102:0/2021793118 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55f85d2bbf80 0x55f85d2be440 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.648+0000 7f9431e11800 1 -- 172.21.15.102:0/2021793118 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f942803d020 msgr2=0x7f9428021440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.648+0000 7f9431e11800 1 --2- 172.21.15.102:0/2021793118 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f942803d020 0x7f9428021440 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.648+0000 7f9431e11800 1 -- 172.21.15.102:0/2021793118 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55f85d2c07f0 msgr2=0x55f85d2c2be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.648+0000 7f9431e11800 1 --2- 172.21.15.102:0/2021793118 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55f85d2c07f0 0x55f85d2c2be0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.649+0000 7f9431e11800 1 -- 172.21.15.102:0/2021793118 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f92f8036b90 msgr2=0x7f92f8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.649+0000 7f9431e11800 1 --2- 172.21.15.102:0/2021793118 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f92f8036b90 0x7f92f8039050 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9420050020 tx=0x7f9420092000 comp rx=0 tx=0).stop 2024-09-13T19:16:14.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.649+0000 7f9431e11800 1 -- 172.21.15.102:0/2021793118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f85d2a8e60 msgr2=0x55f85d2b0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.649+0000 7f9431e11800 1 --2- 172.21.15.102:0/2021793118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f85d2a8e60 0x55f85d2b0330 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f942804bcd0 tx=0x7f942804cd90 comp rx=0 tx=0).stop 2024-09-13T19:16:14.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.649+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 reap_dead start 2024-09-13T19:16:14.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.649+0000 7f9427fff640 1 -- 172.21.15.102:0/2021793118 reap_dead start 2024-09-13T19:16:14.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.649+0000 7f9431e11800 1 -- 172.21.15.102:0/2021793118 shutdown_connections 2024-09-13T19:16:14.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.649+0000 7f9431e11800 1 -- 172.21.15.102:0/2021793118 >> 172.21.15.102:0/2021793118 conn(0x55f85d2a51c0 msgr2=0x55f85d2a3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:14.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.649+0000 7f9431e11800 1 -- 172.21.15.102:0/2021793118 shutdown_connections 2024-09-13T19:16:14.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.649+0000 7f9431e11800 1 -- 172.21.15.102:0/2021793118 wait complete. 2024-09-13T19:16:14.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.649+0000 7f9431e11800 1 -- 172.21.15.102:0/1489171209 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9308036c00 msgr2=0x7f93080390c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.649+0000 7f9431e11800 1 --2- 172.21.15.102:0/1489171209 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9308036c00 0x7f93080390c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9420090010 tx=0x7f942008ebc0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.649+0000 7f9431e11800 1 -- 172.21.15.102:0/1489171209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f85d29c110 msgr2=0x55f85d29c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.649+0000 7f9431e11800 1 --2- 172.21.15.102:0/1489171209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f85d29c110 0x55f85d29c530 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x55f85d2825a0 tx=0x7f94280163e0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.649+0000 7f9431e11800 1 -- 172.21.15.102:0/1489171209 shutdown_connections 2024-09-13T19:16:14.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.649+0000 7f9431e11800 1 --2- 172.21.15.102:0/1489171209 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9308036c00 0x7f93080390c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.649+0000 7f9431e11800 1 --2- 172.21.15.102:0/1489171209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f85d29c110 0x55f85d29c530 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.649+0000 7f9431e11800 1 -- 172.21.15.102:0/1489171209 >> 172.21.15.102:0/1489171209 conn(0x55f85d2910a0 msgr2=0x55f85d293c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:14.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.649+0000 7f9431e11800 1 -- 172.21.15.102:0/1489171209 shutdown_connections 2024-09-13T19:16:14.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.649+0000 7f9431e11800 1 -- 172.21.15.102:0/1489171209 wait complete. 2024-09-13T19:16:14.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.649+0000 7f9431e11800 1 -- 172.21.15.102:0/3569053184 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55f85d18dbb0 msgr2=0x55f85d2883f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.649+0000 7f9431e11800 1 --2- 172.21.15.102:0/3569053184 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55f85d18dbb0 0x55f85d2883f0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.649+0000 7f9431e11800 1 -- 172.21.15.102:0/3569053184 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55f85d28ad10 msgr2=0x55f85d28d100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.649+0000 7f9431e11800 1 --2- 172.21.15.102:0/3569053184 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55f85d28ad10 0x55f85d28d100 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.650+0000 7f9431e11800 1 -- 172.21.15.102:0/3569053184 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9314036b90 msgr2=0x7f9314039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.650+0000 7f9431e11800 1 --2- 172.21.15.102:0/3569053184 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9314036b90 0x7f9314039050 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9418000f60 tx=0x7f94180012b0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.650+0000 7f9431e11800 1 -- 172.21.15.102:0/3569053184 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f85d0fc610 msgr2=0x55f85d281380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.650+0000 7f9431e11800 1 --2- 172.21.15.102:0/3569053184 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f85d0fc610 0x55f85d281380 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x55f85d27a8e0 tx=0x7f9420002fb0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.650+0000 7f9431e11800 1 -- 172.21.15.102:0/3569053184 shutdown_connections 2024-09-13T19:16:14.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.650+0000 7f9431e11800 1 --2- 172.21.15.102:0/3569053184 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55f85d28ad10 0x55f85d28d100 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.650+0000 7f9431e11800 1 --2- 172.21.15.102:0/3569053184 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55f85d18dbb0 0x55f85d2883f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.650+0000 7f9431e11800 1 --2- 172.21.15.102:0/3569053184 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9314036b90 0x7f9314039050 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.650+0000 7f9431e11800 1 --2- 172.21.15.102:0/3569053184 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f85d0fc610 0x55f85d281380 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.650+0000 7f9431e11800 1 -- 172.21.15.102:0/3569053184 >> 172.21.15.102:0/3569053184 conn(0x55f85d182de0 msgr2=0x55f85d273cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:14.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.650+0000 7f9431e11800 1 -- 172.21.15.102:0/3569053184 shutdown_connections 2024-09-13T19:16:14.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.650+0000 7f9431e11800 1 -- 172.21.15.102:0/3569053184 wait complete. 2024-09-13T19:16:14.662 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-13T19:16:14.662 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-13T19:16:14.663 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-13T19:16:14.663 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2024-09-13T19:16:14.716 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:14.717 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:14.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.713+0000 7f576c72c800 1 Processor -- start 2024-09-13T19:16:14.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.713+0000 7f576c72c800 1 -- start start 2024-09-13T19:16:14.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.713+0000 7f576c72c800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55cb85680640 0x55cb85711650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.713+0000 7f576c72c800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cb855cbb30 con 0x55cb85711b90 2024-09-13T19:16:14.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.713+0000 7f576c72c800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55cb855ad360 con 0x55cb85680640 2024-09-13T19:16:14.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.714+0000 7f57684b7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55cb85680640 0x55cb85711650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.714+0000 7f5767cb6640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55cb85711b90 0x55cb85713f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:49780/0 (socket says 172.21.15.102:49780) 2024-09-13T19:16:14.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.714+0000 7f5767cb6640 1 -- 172.21.15.102:0/3335021028 learned_addr learned my addr 172.21.15.102:0/3335021028 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:16:14.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.714+0000 7f57684b7640 1 -- 172.21.15.102:0/3335021028 >> v1:172.21.15.53:6789/0 conn(0x55cb85711b90 legacy=0x55cb85713f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.714+0000 7f57684b7640 1 -- 172.21.15.102:0/3335021028 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb855d3e00 con 0x55cb85680640 2024-09-13T19:16:14.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.716+0000 7f57684b7640 1 --2- 172.21.15.102:0/3335021028 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb85680640 0x55cb85711650 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f575800a470 tx=0x7f5758045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=217002e7fbde34a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.716+0000 7f57674b5640 1 -- 172.21.15.102:0/3335021028 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5758053570 con 0x55cb85680640 2024-09-13T19:16:14.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.716+0000 7f57674b5640 1 -- 172.21.15.102:0/3335021028 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5758058070 con 0x55cb85680640 2024-09-13T19:16:14.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.716+0000 7f57674b5640 1 -- 172.21.15.102:0/3335021028 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5758053880 con 0x55cb85680640 2024-09-13T19:16:14.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.716+0000 7f576c72c800 1 -- 172.21.15.102:0/3335021028 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb85680640 msgr2=0x55cb85711650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.716+0000 7f576c72c800 1 --2- 172.21.15.102:0/3335021028 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb85680640 0x55cb85711650 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f575800a470 tx=0x7f5758045a20 comp rx=0 tx=0).stop 2024-09-13T19:16:14.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.716+0000 7f576c72c800 1 -- 172.21.15.102:0/3335021028 shutdown_connections 2024-09-13T19:16:14.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.716+0000 7f576c72c800 1 --2- 172.21.15.102:0/3335021028 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb85680640 0x55cb85711650 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.716+0000 7f576c72c800 1 -- 172.21.15.102:0/3335021028 >> 172.21.15.102:0/3335021028 conn(0x55cb85706de0 msgr2=0x55cb85709200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:14.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.716+0000 7f576c72c800 1 -- 172.21.15.102:0/3335021028 shutdown_connections 2024-09-13T19:16:14.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.716+0000 7f576c72c800 1 -- 172.21.15.102:0/3335021028 wait complete. 2024-09-13T19:16:14.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.730+0000 7f576c72c800 1 Processor -- start 2024-09-13T19:16:14.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.730+0000 7f576c72c800 1 -- start start 2024-09-13T19:16:14.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.730+0000 7f576c72c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb85680640 0x55cb857fdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.730+0000 7f576c72c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55cb85658450 con 0x55cb85680640 2024-09-13T19:16:14.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.731+0000 7f57684b7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb85680640 0x55cb857fdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.731+0000 7f57684b7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb85680640 0x55cb857fdb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53834/0 (socket says 172.21.15.102:53834) 2024-09-13T19:16:14.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.731+0000 7f57684b7640 1 -- 172.21.15.102:0/1740914366 learned_addr learned my addr 172.21.15.102:0/1740914366 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:14.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.731+0000 7f57684b7640 1 -- 172.21.15.102:0/1740914366 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb855a5bc0 con 0x55cb85680640 2024-09-13T19:16:14.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.731+0000 7f57684b7640 1 --2- 172.21.15.102:0/1740914366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb85680640 0x55cb857fdb50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5758025c20 tx=0x7f5758051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56c4fb0f616ae095 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.731+0000 7f565660c640 1 -- 172.21.15.102:0/1740914366 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5758053ba0 con 0x55cb85680640 2024-09-13T19:16:14.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.731+0000 7f565660c640 1 -- 172.21.15.102:0/1740914366 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5758063030 con 0x55cb85680640 2024-09-13T19:16:14.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.731+0000 7f565660c640 1 -- 172.21.15.102:0/1740914366 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5758053440 con 0x55cb85680640 2024-09-13T19:16:14.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.732+0000 7f576c72c800 1 -- 172.21.15.102:0/1740914366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb85680640 msgr2=0x55cb857fdb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.732+0000 7f576c72c800 1 --2- 172.21.15.102:0/1740914366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb85680640 0x55cb857fdb50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5758025c20 tx=0x7f5758051000 comp rx=0 tx=0).stop 2024-09-13T19:16:14.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.732+0000 7f576c72c800 1 -- 172.21.15.102:0/1740914366 shutdown_connections 2024-09-13T19:16:14.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.732+0000 7f576c72c800 1 --2- 172.21.15.102:0/1740914366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb85680640 0x55cb857fdb50 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.732+0000 7f576c72c800 1 -- 172.21.15.102:0/1740914366 >> 172.21.15.102:0/1740914366 conn(0x55cb85706de0 msgr2=0x55cb857f9510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:14.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.732+0000 7f576c72c800 1 -- 172.21.15.102:0/1740914366 shutdown_connections 2024-09-13T19:16:14.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.732+0000 7f576c72c800 1 -- 172.21.15.102:0/1740914366 wait complete. 2024-09-13T19:16:14.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.732+0000 7f576c72c800 1 Processor -- start 2024-09-13T19:16:14.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.732+0000 7f576c72c800 1 -- start start 2024-09-13T19:16:14.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.733+0000 7f576c72c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb85680640 0x55cb858054d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.733+0000 7f576c72c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55cb85715940 con 0x55cb85680640 2024-09-13T19:16:14.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.733+0000 7f57684b7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb85680640 0x55cb858054d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.733+0000 7f57684b7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb85680640 0x55cb858054d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53848/0 (socket says 172.21.15.102:53848) 2024-09-13T19:16:14.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.733+0000 7f57684b7640 1 -- 172.21.15.102:0/3047287843 learned_addr learned my addr 172.21.15.102:0/3047287843 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:14.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.733+0000 7f57684b7640 1 -- 172.21.15.102:0/3047287843 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb855b9fe0 con 0x55cb85680640 2024-09-13T19:16:14.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.733+0000 7f57684b7640 1 --2- 172.21.15.102:0/3047287843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb85680640 0x55cb858054d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x55cb857fe9b0 tx=0x7f5758002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.733+0000 7f5654e09640 1 -- 172.21.15.102:0/3047287843 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5758078070 con 0x55cb85680640 2024-09-13T19:16:14.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.734+0000 7f5654e09640 1 -- 172.21.15.102:0/3047287843 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5758053570 con 0x55cb85680640 2024-09-13T19:16:14.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.734+0000 7f576c72c800 1 -- 172.21.15.102:0/3047287843 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cb85805a10 con 0x55cb85680640 2024-09-13T19:16:14.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.734+0000 7f5654e09640 1 -- 172.21.15.102:0/3047287843 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5758053850 con 0x55cb85680640 2024-09-13T19:16:14.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.734+0000 7f576c72c800 1 -- 172.21.15.102:0/3047287843 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb85805f90 con 0x55cb85680640 2024-09-13T19:16:14.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.734+0000 7f5654e09640 1 -- 172.21.15.102:0/3047287843 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f575807b070 con 0x55cb85680640 2024-09-13T19:16:14.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.734+0000 7f5654e09640 1 --2- 172.21.15.102:0/3047287843 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5650036b90 0x7f5650039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.735+0000 7f5654e09640 1 -- 172.21.15.102:0/3047287843 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f5758070070 con 0x55cb85680640 2024-09-13T19:16:14.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.735+0000 7f5767cb6640 1 --2- 172.21.15.102:0/3047287843 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5650036b90 0x7f5650039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.735+0000 7f576c72c800 1 --2- 172.21.15.102:0/3047287843 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55cb85711b90 0x55cb8580c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.735+0000 7f576c72c800 1 -- 172.21.15.102:0/3047287843 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb8580cad0 con 0x55cb85711b90 2024-09-13T19:16:14.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.735+0000 7f5768cb8640 1 --2- 172.21.15.102:0/3047287843 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55cb85711b90 0x55cb8580c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.735+0000 7f5767cb6640 1 --2- 172.21.15.102:0/3047287843 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5650036b90 0x7f5650039050 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f575c000f60 tx=0x7f575c0012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.735+0000 7f5768cb8640 1 --2- 172.21.15.102:0/3047287843 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55cb85711b90 0x55cb8580c540 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.735+0000 7f5768cb8640 1 -- 172.21.15.102:0/3047287843 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f576000a4a0 con 0x55cb85711b90 2024-09-13T19:16:14.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.735+0000 7f576c72c800 1 -- 172.21.15.102:0/3047287843 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb85809b10 con 0x55cb85711b90 2024-09-13T19:16:14.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.736+0000 7f5768cb8640 1 -- 172.21.15.102:0/3047287843 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f576000a4a0 con 0x55cb85711b90 2024-09-13T19:16:14.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.736+0000 7f576c72c800 1 --2- 172.21.15.102:0/3047287843 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55cb8580ee20 0x55cb85811210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.736+0000 7f576c72c800 1 -- 172.21.15.102:0/3047287843 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb85811900 con 0x55cb8580ee20 2024-09-13T19:16:14.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.736+0000 7f57684b7640 1 --2- 172.21.15.102:0/3047287843 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55cb8580ee20 0x55cb85811210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.736+0000 7f57684b7640 1 --2- 172.21.15.102:0/3047287843 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55cb8580ee20 0x55cb85811210 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.736+0000 7f57684b7640 1 -- 172.21.15.102:0/3047287843 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f575807a030 con 0x55cb8580ee20 2024-09-13T19:16:14.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.736+0000 7f576c72c800 1 -- 172.21.15.102:0/3047287843 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb8580dbd0 con 0x55cb85711b90 2024-09-13T19:16:14.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.737+0000 7f5768cb8640 1 -- 172.21.15.102:0/3047287843 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f576000a4a0 con 0x55cb85711b90 2024-09-13T19:16:14.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.737+0000 7f576c72c800 1 -- 172.21.15.102:0/3047287843 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb8580e0b0 con 0x55cb8580ee20 2024-09-13T19:16:14.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.737+0000 7f57684b7640 1 -- 172.21.15.102:0/3047287843 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f575807a030 con 0x55cb8580ee20 2024-09-13T19:16:14.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.737+0000 7f576c72c800 1 Processor -- start 2024-09-13T19:16:14.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.737+0000 7f576c72c800 1 -- start start 2024-09-13T19:16:14.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.737+0000 7f576c72c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb858201c0 0x55cb858205e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.737+0000 7f576c72c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55cb855a7580 con 0x55cb858201c0 2024-09-13T19:16:14.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.738+0000 7f5768cb8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb858201c0 0x55cb858205e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.738+0000 7f5768cb8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb858201c0 0x55cb858205e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53860/0 (socket says 172.21.15.102:53860) 2024-09-13T19:16:14.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.738+0000 7f5768cb8640 1 -- 172.21.15.102:0/409143414 learned_addr learned my addr 172.21.15.102:0/409143414 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:14.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.738+0000 7f5768cb8640 1 -- 172.21.15.102:0/409143414 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb85820b20 con 0x55cb858201c0 2024-09-13T19:16:14.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.738+0000 7f5768cb8640 1 --2- 172.21.15.102:0/409143414 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb858201c0 0x55cb858205e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x55cb858066f0 tx=0x7f57600163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.738+0000 7f564dffb640 1 -- 172.21.15.102:0/409143414 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5760013450 con 0x55cb858201c0 2024-09-13T19:16:14.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.738+0000 7f564dffb640 1 -- 172.21.15.102:0/409143414 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57600135f0 con 0x55cb858201c0 2024-09-13T19:16:14.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.738+0000 7f564dffb640 1 -- 172.21.15.102:0/409143414 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5760013910 con 0x55cb858201c0 2024-09-13T19:16:14.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.738+0000 7f576c72c800 1 -- 172.21.15.102:0/409143414 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cb85820db0 con 0x55cb858201c0 2024-09-13T19:16:14.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.739+0000 7f576c72c800 1 -- 172.21.15.102:0/409143414 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb85823a90 con 0x55cb858201c0 2024-09-13T19:16:14.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.739+0000 7f564dffb640 1 -- 172.21.15.102:0/409143414 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5760011040 con 0x55cb858201c0 2024-09-13T19:16:14.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.739+0000 7f564dffb640 1 --2- 172.21.15.102:0/409143414 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5640036b90 0x7f5640039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.739+0000 7f564dffb640 1 -- 172.21.15.102:0/409143414 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f576000e040 con 0x55cb858201c0 2024-09-13T19:16:14.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.739+0000 7f57684b7640 1 --2- 172.21.15.102:0/409143414 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5640036b90 0x7f5640039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.740+0000 7f576c72c800 1 Processor -- start 2024-09-13T19:16:14.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.740+0000 7f57684b7640 1 --2- 172.21.15.102:0/409143414 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5640036b90 0x7f5640039050 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x55cb8580d3d0 tx=0x7f575808ec10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.740+0000 7f576c72c800 1 -- start start 2024-09-13T19:16:14.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.740+0000 7f576c72c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb8582cf10 0x55cb8582d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.740+0000 7f576c72c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55cb857fe2a0 con 0x55cb8582cf10 2024-09-13T19:16:14.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.740+0000 7f5768cb8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb8582cf10 0x55cb8582d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.740+0000 7f5768cb8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb8582cf10 0x55cb8582d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53868/0 (socket says 172.21.15.102:53868) 2024-09-13T19:16:14.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.740+0000 7f5768cb8640 1 -- 172.21.15.102:0/4064391768 learned_addr learned my addr 172.21.15.102:0/4064391768 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:14.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.740+0000 7f5768cb8640 1 -- 172.21.15.102:0/4064391768 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb8582d8e0 con 0x55cb8582cf10 2024-09-13T19:16:14.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.741+0000 7f5768cb8640 1 --2- 172.21.15.102:0/4064391768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb8582cf10 0x55cb8582d310 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f576004cde0 tx=0x7f576001fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7327aa389593dc32 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.741+0000 7f563f7fe640 1 -- 172.21.15.102:0/4064391768 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5760046250 con 0x55cb8582cf10 2024-09-13T19:16:14.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.741+0000 7f563f7fe640 1 -- 172.21.15.102:0/4064391768 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f576002a440 con 0x55cb8582cf10 2024-09-13T19:16:14.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.741+0000 7f563f7fe640 1 -- 172.21.15.102:0/4064391768 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f576001f390 con 0x55cb8582cf10 2024-09-13T19:16:14.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.741+0000 7f576c72c800 1 -- 172.21.15.102:0/4064391768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb8582cf10 msgr2=0x55cb8582d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.741+0000 7f576c72c800 1 --2- 172.21.15.102:0/4064391768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb8582cf10 0x55cb8582d310 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f576004cde0 tx=0x7f576001fd40 comp rx=0 tx=0).stop 2024-09-13T19:16:14.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.741+0000 7f576c72c800 1 -- 172.21.15.102:0/4064391768 shutdown_connections 2024-09-13T19:16:14.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.741+0000 7f576c72c800 1 --2- 172.21.15.102:0/4064391768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb8582cf10 0x55cb8582d310 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.741+0000 7f576c72c800 1 -- 172.21.15.102:0/4064391768 >> 172.21.15.102:0/4064391768 conn(0x55cb85829270 msgr2=0x55cb85827370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:14.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.741+0000 7f576c72c800 1 -- 172.21.15.102:0/4064391768 shutdown_connections 2024-09-13T19:16:14.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.741+0000 7f576c72c800 1 -- 172.21.15.102:0/4064391768 wait complete. 2024-09-13T19:16:14.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.741+0000 7f576c72c800 1 Processor -- start 2024-09-13T19:16:14.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.742+0000 7f576c72c800 1 -- start start 2024-09-13T19:16:14.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.742+0000 7f576c72c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb8582cf10 0x55cb85834390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.742+0000 7f576c72c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55cb8582df50 con 0x55cb8582cf10 2024-09-13T19:16:14.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.742+0000 7f5768cb8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb8582cf10 0x55cb85834390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.742+0000 7f5768cb8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb8582cf10 0x55cb85834390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53880/0 (socket says 172.21.15.102:53880) 2024-09-13T19:16:14.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.742+0000 7f5768cb8640 1 -- 172.21.15.102:0/1861982694 learned_addr learned my addr 172.21.15.102:0/1861982694 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:14.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.742+0000 7f5768cb8640 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb858348d0 con 0x55cb8582cf10 2024-09-13T19:16:14.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.742+0000 7f5768cb8640 1 --2- 172.21.15.102:0/1861982694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb8582cf10 0x55cb85834390 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f576004cd40 tx=0x7f576004cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.742+0000 7f563dffb640 1 -- 172.21.15.102:0/1861982694 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5760039070 con 0x55cb8582cf10 2024-09-13T19:16:14.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.742+0000 7f563dffb640 1 -- 172.21.15.102:0/1861982694 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f576004e480 con 0x55cb8582cf10 2024-09-13T19:16:14.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.742+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cb85834b60 con 0x55cb8582cf10 2024-09-13T19:16:14.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.742+0000 7f563dffb640 1 -- 172.21.15.102:0/1861982694 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f576004e760 con 0x55cb8582cf10 2024-09-13T19:16:14.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.742+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb85837810 con 0x55cb8582cf10 2024-09-13T19:16:14.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.743+0000 7f563dffb640 1 -- 172.21.15.102:0/1861982694 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f576003c070 con 0x55cb8582cf10 2024-09-13T19:16:14.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.743+0000 7f563dffb640 1 --2- 172.21.15.102:0/1861982694 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5630036b40 0x7f5630039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.743+0000 7f563dffb640 1 -- 172.21.15.102:0/1861982694 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f576003fc90 con 0x55cb8582cf10 2024-09-13T19:16:14.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.743+0000 7f57684b7640 1 --2- 172.21.15.102:0/1861982694 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5630036b40 0x7f5630039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.744+0000 7f57684b7640 1 --2- 172.21.15.102:0/1861982694 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5630036b40 0x7f5630039000 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f575800a330 tx=0x7f5758092000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.744+0000 7f576c72c800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.744+0000 7f576c72c800 1 --2- 172.21.15.102:0/1861982694 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55cb8583fe40 0x55cb85842300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.744+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb85842a50 con 0x55cb8583fe40 2024-09-13T19:16:14.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.744+0000 7f5767cb6640 1 --2- 172.21.15.102:0/1861982694 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55cb8583fe40 0x55cb85842300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.744+0000 7f5767cb6640 1 --2- 172.21.15.102:0/1861982694 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55cb8583fe40 0x55cb85842300 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.745+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f575c009050 con 0x55cb8583fe40 2024-09-13T19:16:14.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.745+0000 7f576c72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:14.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.745+0000 7f576c72c800 20 realm 2024-09-13T19:16:14.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.745+0000 7f576c72c800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.745+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb8583f290 con 0x55cb8583fe40 2024-09-13T19:16:14.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.745+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f575c009050 con 0x55cb8583fe40 2024-09-13T19:16:14.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.745+0000 7f576c72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:14.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.745+0000 7f576c72c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:14.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.745+0000 7f576c72c800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.745+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb85843540 con 0x55cb8583fe40 2024-09-13T19:16:14.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.745+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f575c009050 con 0x55cb8583fe40 2024-09-13T19:16:14.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.745+0000 7f576c72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:14.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.745+0000 7f576c72c800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.745+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb85843e10 con 0x55cb8583fe40 2024-09-13T19:16:14.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.745+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f575c009050 con 0x55cb8583fe40 2024-09-13T19:16:14.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.745+0000 7f576c72c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:14.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.745+0000 7f576c72c800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.745+0000 7f576c72c800 1 --2- 172.21.15.102:0/1861982694 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55cb85844750 0x55cb85846b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.745+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb858472d0 con 0x55cb85844750 2024-09-13T19:16:14.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.745+0000 7f5768cb8640 1 --2- 172.21.15.102:0/1861982694 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55cb85844750 0x55cb85846b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.746+0000 7f5768cb8640 1 --2- 172.21.15.102:0/1861982694 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55cb85844750 0x55cb85846b40 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.746+0000 7f5768cb8640 1 -- 172.21.15.102:0/1861982694 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f576003b030 con 0x55cb85844750 2024-09-13T19:16:14.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.746+0000 7f576c72c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:14.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.746+0000 7f576c72c800 20 searching for the correct realm 2024-09-13T19:16:14.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.746+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb85848c50 con 0x55cb85844750 2024-09-13T19:16:14.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.746+0000 7f5768cb8640 1 -- 172.21.15.102:0/1861982694 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f576003b030 con 0x55cb85844750 2024-09-13T19:16:14.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.746+0000 7f5768cb8640 1 --2- 172.21.15.102:0/1861982694 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f576003e070 0x7f57600484f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.746+0000 7f5768cb8640 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb85848c50 con 0x7f576003e070 2024-09-13T19:16:14.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.746+0000 7f57684b7640 1 --2- 172.21.15.102:0/1861982694 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f576003e070 0x7f57600484f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.747+0000 7f57684b7640 1 --2- 172.21.15.102:0/1861982694 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f576003e070 0x7f57600484f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.747+0000 7f57684b7640 1 -- 172.21.15.102:0/1861982694 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f575807a030 con 0x7f576003e070 2024-09-13T19:16:14.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.747+0000 7f57684b7640 1 --2- 172.21.15.102:0/1861982694 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f575809d070 0x7f575805e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.747+0000 7f57684b7640 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb85848c50 con 0x7f575809d070 2024-09-13T19:16:14.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.747+0000 7f5767cb6640 1 --2- 172.21.15.102:0/1861982694 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f575809d070 0x7f575805e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.748+0000 7f5767cb6640 1 --2- 172.21.15.102:0/1861982694 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f575809d070 0x7f575805e8a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.748+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f575c009050 con 0x7f575809d070 2024-09-13T19:16:14.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.748+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb85848c50 con 0x55cb8583fe40 2024-09-13T19:16:14.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.748+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f575c009050 con 0x55cb8583fe40 2024-09-13T19:16:14.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.748+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb85848c50 con 0x55cb8583fe40 2024-09-13T19:16:14.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.748+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f575c029040 con 0x55cb8583fe40 2024-09-13T19:16:14.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.748+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb85848c50 con 0x7f575809d070 2024-09-13T19:16:14.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.749+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f575c029040 con 0x7f575809d070 2024-09-13T19:16:14.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.749+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb85848c50 con 0x7f575809d070 2024-09-13T19:16:14.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.749+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f575c029040 con 0x7f575809d070 2024-09-13T19:16:14.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.749+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb85848c50 con 0x7f576003e070 2024-09-13T19:16:14.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.749+0000 7f57684b7640 1 -- 172.21.15.102:0/1861982694 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f575807a030 con 0x7f576003e070 2024-09-13T19:16:14.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.749+0000 7f57684b7640 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb85848c50 con 0x55cb85844750 2024-09-13T19:16:14.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.749+0000 7f5768cb8640 1 -- 172.21.15.102:0/1861982694 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f576003b030 con 0x55cb85844750 2024-09-13T19:16:14.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.749+0000 7f5768cb8640 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb85848c50 con 0x55cb8583fe40 2024-09-13T19:16:14.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.749+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f575c029040 con 0x55cb8583fe40 2024-09-13T19:16:14.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.749+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb85848c50 con 0x7f575809d070 2024-09-13T19:16:14.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.750+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f575c029040 con 0x7f575809d070 2024-09-13T19:16:14.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.750+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb85848c50 con 0x55cb8583fe40 2024-09-13T19:16:14.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.750+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f575c029040 con 0x55cb8583fe40 2024-09-13T19:16:14.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.750+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb85848c50 con 0x7f576003e070 2024-09-13T19:16:14.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.750+0000 7f57684b7640 1 -- 172.21.15.102:0/1861982694 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f575807a030 con 0x7f576003e070 2024-09-13T19:16:14.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.750+0000 7f57684b7640 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb85848c50 con 0x55cb85844750 2024-09-13T19:16:14.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.750+0000 7f5768cb8640 1 -- 172.21.15.102:0/1861982694 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f576003b030 con 0x55cb85844750 2024-09-13T19:16:14.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.750+0000 7f5768cb8640 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb85848c50 con 0x55cb85844750 2024-09-13T19:16:14.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.751+0000 7f5768cb8640 1 -- 172.21.15.102:0/1861982694 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f576003b030 con 0x55cb85844750 2024-09-13T19:16:14.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.751+0000 7f5768cb8640 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb85848c50 con 0x7f575809d070 2024-09-13T19:16:14.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.751+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f575c029040 con 0x7f575809d070 2024-09-13T19:16:14.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.751+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb85848c50 con 0x55cb85844750 2024-09-13T19:16:14.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.751+0000 7f5768cb8640 1 -- 172.21.15.102:0/1861982694 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f576003b030 con 0x55cb85844750 2024-09-13T19:16:14.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.751+0000 7f5768cb8640 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb85848c50 con 0x55cb85844750 2024-09-13T19:16:14.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.751+0000 7f5768cb8640 1 -- 172.21.15.102:0/1861982694 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f576003b030 con 0x55cb85844750 2024-09-13T19:16:14.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.751+0000 7f5768cb8640 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb85848c50 con 0x55cb8583fe40 2024-09-13T19:16:14.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.751+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f575c029040 con 0x55cb8583fe40 2024-09-13T19:16:14.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.751+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb85848c50 con 0x55cb8583fe40 2024-09-13T19:16:14.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.752+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f575c029040 con 0x55cb8583fe40 2024-09-13T19:16:14.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.752+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb85848c50 con 0x7f575809d070 2024-09-13T19:16:14.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.752+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f575c029040 con 0x7f575809d070 2024-09-13T19:16:14.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.752+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb85848c50 con 0x55cb85844750 2024-09-13T19:16:14.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.752+0000 7f5768cb8640 1 -- 172.21.15.102:0/1861982694 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f576003b030 con 0x55cb85844750 2024-09-13T19:16:14.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.752+0000 7f5768cb8640 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb85848c50 con 0x7f576003e070 2024-09-13T19:16:14.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.752+0000 7f57684b7640 1 -- 172.21.15.102:0/1861982694 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f575807a030 con 0x7f576003e070 2024-09-13T19:16:14.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.752+0000 7f57684b7640 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb85848c50 con 0x55cb8583fe40 2024-09-13T19:16:14.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.753+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f575c029040 con 0x55cb8583fe40 2024-09-13T19:16:14.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.753+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb85848c50 con 0x7f575809d070 2024-09-13T19:16:14.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.753+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f575c029040 con 0x7f575809d070 2024-09-13T19:16:14.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.753+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb85848c50 con 0x55cb85844750 2024-09-13T19:16:14.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.753+0000 7f5768cb8640 1 -- 172.21.15.102:0/1861982694 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f576003b030 con 0x55cb85844750 2024-09-13T19:16:14.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.753+0000 7f5768cb8640 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb85848c50 con 0x7f575809d070 2024-09-13T19:16:14.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.753+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f575c029040 con 0x7f575809d070 2024-09-13T19:16:14.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.753+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb85848c50 con 0x7f576003e070 2024-09-13T19:16:14.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.754+0000 7f57684b7640 1 -- 172.21.15.102:0/1861982694 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f575807a030 con 0x7f576003e070 2024-09-13T19:16:14.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.754+0000 7f57684b7640 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb85848c50 con 0x55cb85844750 2024-09-13T19:16:14.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.754+0000 7f5768cb8640 1 -- 172.21.15.102:0/1861982694 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f576003b030 con 0x55cb85844750 2024-09-13T19:16:14.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.754+0000 7f5768cb8640 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb85848c50 con 0x7f575809d070 2024-09-13T19:16:14.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.754+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f575c029040 con 0x7f575809d070 2024-09-13T19:16:14.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.754+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb85848c50 con 0x55cb8583fe40 2024-09-13T19:16:14.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.754+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f575c029040 con 0x55cb8583fe40 2024-09-13T19:16:14.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.754+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55cb85848c50 con 0x7f576003e070 2024-09-13T19:16:14.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.755+0000 7f57684b7640 1 -- 172.21.15.102:0/1861982694 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f575807a030 con 0x7f576003e070 2024-09-13T19:16:14.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.755+0000 7f576c72c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:14.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.755+0000 7f576c72c800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:14.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.755+0000 7f576c72c800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:14.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.755+0000 7f576c72c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:14.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.755+0000 7f576c72c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:14.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.755+0000 7f576c72c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:14.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.755+0000 7f576c72c800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.755+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb85847b90 con 0x55cb8583fe40 2024-09-13T19:16:14.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.755+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f575c029040 con 0x55cb8583fe40 2024-09-13T19:16:14.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.755+0000 7f576c72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:14.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.755+0000 7f576c72c800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.755+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb85847f80 con 0x55cb8583fe40 2024-09-13T19:16:14.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.755+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f575c029040 con 0x55cb8583fe40 2024-09-13T19:16:14.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.755+0000 7f576c72c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:14.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.755+0000 7f576c72c800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.755+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb858490d0 con 0x55cb85844750 2024-09-13T19:16:14.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.755+0000 7f5768cb8640 1 -- 172.21.15.102:0/1861982694 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f576003b030 con 0x55cb85844750 2024-09-13T19:16:14.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.755+0000 7f576c72c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:14.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.755+0000 7f576c72c800 20 zone default found 2024-09-13T19:16:14.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.755+0000 7f576c72c800 4 Realm: () 2024-09-13T19:16:14.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.755+0000 7f576c72c800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:14.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.755+0000 7f576c72c800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:14.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.755+0000 7f576c72c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:14.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.755+0000 7f576c72c800 20 zonegroup default 2024-09-13T19:16:14.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.755+0000 7f576c72c800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.755+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb85849920 con 0x7f575809d070 2024-09-13T19:16:14.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.756+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f575c029040 con 0x7f575809d070 2024-09-13T19:16:14.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.756+0000 7f576c72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:14.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.756+0000 7f576c72c800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.756+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb8584b6a0 con 0x55cb85844750 2024-09-13T19:16:14.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.756+0000 7f5768cb8640 1 -- 172.21.15.102:0/1861982694 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f576003b030 con 0x55cb85844750 2024-09-13T19:16:14.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.756+0000 7f576c72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:14.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.756+0000 7f576c72c800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.756+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb8584bb30 con 0x55cb85844750 2024-09-13T19:16:14.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.756+0000 7f5768cb8640 1 -- 172.21.15.102:0/1861982694 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f576003b030 con 0x55cb85844750 2024-09-13T19:16:14.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.756+0000 7f576c72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:14.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.756+0000 7f576c72c800 20 started sync module instance, tier type = 2024-09-13T19:16:14.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.756+0000 7f576c72c800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:14.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.756+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb8584ab40 con 0x7f576003e070 2024-09-13T19:16:14.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.757+0000 7f57684b7640 1 -- 172.21.15.102:0/1861982694 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(44 notify.0 [create] v34'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f575807a030 con 0x7f576003e070 2024-09-13T19:16:14.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.757+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94332606787376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb8584c440 con 0x7f576003e070 2024-09-13T19:16:14.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.757+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb8584cc90 con 0x55cb8583fe40 2024-09-13T19:16:14.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.758+0000 7f57684b7640 1 -- 172.21.15.102:0/1861982694 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94332606787376] v34'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f575807a030 con 0x7f576003e070 2024-09-13T19:16:14.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.759+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v34'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f575c029040 con 0x55cb8583fe40 2024-09-13T19:16:14.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.759+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94332606791568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb8584cc90 con 0x55cb8583fe40 2024-09-13T19:16:14.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.759+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb8584d780 con 0x55cb85844750 2024-09-13T19:16:14.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.760+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94332606791568] v34'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f575c029040 con 0x55cb8583fe40 2024-09-13T19:16:14.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.760+0000 7f5768cb8640 1 -- 172.21.15.102:0/1861982694 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v34'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f576003b030 con 0x55cb85844750 2024-09-13T19:16:14.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.760+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94332606796368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb8584cc90 con 0x55cb85844750 2024-09-13T19:16:14.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.760+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb8584e230 con 0x7f576003e070 2024-09-13T19:16:14.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.761+0000 7f5768cb8640 1 -- 172.21.15.102:0/1861982694 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94332606796368] v34'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f576003b030 con 0x55cb85844750 2024-09-13T19:16:14.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.761+0000 7f57684b7640 1 -- 172.21.15.102:0/1861982694 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(50 notify.3 [create] v34'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f575807a030 con 0x7f576003e070 2024-09-13T19:16:14.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.761+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94332606793696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb8584cc00 con 0x7f576003e070 2024-09-13T19:16:14.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.761+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb8584f0f0 con 0x55cb8583fe40 2024-09-13T19:16:14.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.763+0000 7f57684b7640 1 -- 172.21.15.102:0/1861982694 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94332606793696] v34'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f575807a030 con 0x7f576003e070 2024-09-13T19:16:14.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.766+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v34'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f575c029040 con 0x55cb8583fe40 2024-09-13T19:16:14.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.766+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94332606801440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb8584f0f0 con 0x55cb8583fe40 2024-09-13T19:16:14.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.766+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb8584fb60 con 0x7f575809d070 2024-09-13T19:16:14.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.769+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94332606801440] v34'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f575c029040 con 0x55cb8583fe40 2024-09-13T19:16:14.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.769+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(54 notify.5 [create] v34'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f575c029040 con 0x7f575809d070 2024-09-13T19:16:14.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.769+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94332606805584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb8584f0f0 con 0x7f575809d070 2024-09-13T19:16:14.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.769+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb85850570 con 0x7f575809d070 2024-09-13T19:16:14.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.772+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94332606805584] v34'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f575c029040 con 0x7f575809d070 2024-09-13T19:16:14.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.772+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(56 notify.6 [create] v34'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f575c029040 con 0x7f575809d070 2024-09-13T19:16:14.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.772+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94332606803008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb85850750 con 0x7f575809d070 2024-09-13T19:16:14.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.772+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb85850fa0 con 0x7f575809d070 2024-09-13T19:16:14.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.773+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94332606803008] v34'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f575c029040 con 0x7f575809d070 2024-09-13T19:16:14.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.773+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(58 notify.7 [create] v34'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f575c029040 con 0x7f575809d070 2024-09-13T19:16:14.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.773+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94332606809216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb85850e10 con 0x7f575809d070 2024-09-13T19:16:14.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.773+0000 7f576c72c800 20 add_watcher() i=0 2024-09-13T19:16:14.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.773+0000 7f576c72c800 20 add_watcher() i=1 2024-09-13T19:16:14.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.773+0000 7f576c72c800 20 add_watcher() i=2 2024-09-13T19:16:14.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.773+0000 7f576c72c800 20 add_watcher() i=3 2024-09-13T19:16:14.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.773+0000 7f576c72c800 20 add_watcher() i=4 2024-09-13T19:16:14.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.773+0000 7f576c72c800 20 add_watcher() i=5 2024-09-13T19:16:14.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.773+0000 7f576c72c800 20 add_watcher() i=6 2024-09-13T19:16:14.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.774+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94332606809216] v34'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f575c029040 con 0x7f575809d070 2024-09-13T19:16:14.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.774+0000 7f576c72c800 20 add_watcher() i=7 2024-09-13T19:16:14.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.774+0000 7f576c72c800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:14.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.774+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb85854380 con 0x55cb8583fe40 2024-09-13T19:16:14.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.774+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f575c029040 con 0x55cb8583fe40 2024-09-13T19:16:14.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.774+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94332606810272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb858518a0 con 0x55cb8583fe40 2024-09-13T19:16:14.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.775+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94332606810272] v34'50 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f575c029040 con 0x55cb8583fe40 2024-09-13T19:16:14.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.776+0000 7f561e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:14.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.776+0000 7f576c72c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:14.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.776+0000 7f576c72c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:14.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.776+0000 7f576c72c800 5 note: GC not initialized 2024-09-13T19:16:14.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.776+0000 7f561d7e2640 20 reqs_thread_entry: start 2024-09-13T19:16:14.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.776+0000 7f576c72c800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:14.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.776+0000 7f576c72c800 20 Filter name: none 2024-09-13T19:16:14.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.776+0000 7f558effd640 20 reqs_thread_entry: start 2024-09-13T19:16:14.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.776+0000 7f576c72c800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:16:14.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.776+0000 7f576c72c800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.776+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb85887860 con 0x55cb8583fe40 2024-09-13T19:16:14.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.776+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f575c029040 con 0x55cb8583fe40 2024-09-13T19:16:14.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.776+0000 7f576c72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:14.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.776+0000 7f576c72c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-13T19:16:14.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.776+0000 7f576c72c800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:16:14.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.776+0000 7f576c72c800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-13T19:16:14.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.776+0000 7f576c72c800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.777+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb85885ea0 con 0x55cb8583fe40 2024-09-13T19:16:14.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.777+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(63 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f575c029040 con 0x55cb8583fe40 2024-09-13T19:16:14.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.777+0000 7f576c72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:14.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.777+0000 7f576c72c800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2024-09-13T19:16:14.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.777+0000 7f576c72c800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-13T19:16:14.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.777+0000 7f576c72c800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2024-09-13T19:16:14.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.777+0000 7f576c72c800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.777+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:64 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb85885ea0 con 0x7f575809d070 2024-09-13T19:16:14.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.777+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(64 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f575c029040 con 0x7f575809d070 2024-09-13T19:16:14.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.777+0000 7f576c72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:14.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.777+0000 7f576c72c800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2024-09-13T19:16:14.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.777+0000 7f576c72c800 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-13T19:16:14.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.777+0000 7f576c72c800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-13T19:16:14.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.777+0000 7f576c72c800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-13T19:16:14.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.777+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb858868c0 con 0x55cb8583fe40 2024-09-13T19:16:14.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.778+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(65 foo [delete,create,call,writefull 0~391] v34'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f575c029040 con 0x55cb8583fe40 2024-09-13T19:16:14.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.778+0000 7f576c72c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:16:14.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.778+0000 7f576c72c800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:16:14.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.778+0000 7f576c72c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T19:16:14.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.778+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify cookie 94332607029984 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb8588b310 con 0x55cb8583fe40 2024-09-13T19:16:14.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.779+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== watch-notify(notify (1) cookie 94332606801440 notify 146028888064 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55cb85886c60 con 0x55cb8583fe40 2024-09-13T19:16:14.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.779+0000 7f563f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888064 cookie 94332606801440 notifier 4300 bl.length()=567 2024-09-13T19:16:14.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.779+0000 7f563f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:16:14.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.779+0000 7f563f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:16:14.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.779+0000 7f563f7fe640 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f562c003ea0 con 0x55cb8583fe40 2024-09-13T19:16:14.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.779+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(66 notify.4 [notify cookie 94332607029984 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f575c029040 con 0x55cb8583fe40 2024-09-13T19:16:14.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.779+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== osd_op_reply(67 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f575c029040 con 0x55cb8583fe40 2024-09-13T19:16:14.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.779+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== watch-notify(notify_complete (2) cookie 94332607029984 notify 146028888064 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55cb858874c0 con 0x55cb8583fe40 2024-09-13T19:16:14.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.779+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb85886290 con 0x55cb8583fe40 2024-09-13T19:16:14.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.780+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 <== osd.1 v2:172.21.15.102:6808/2204418452 28 ==== osd_op_reply(68 foo@foo.com [delete,create,writefull 0~7] v34'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f575c029040 con 0x55cb8583fe40 2024-09-13T19:16:14.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.780+0000 7f576c72c800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-13T19:16:14.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.780+0000 7f576c72c800 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-13T19:16:14.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.780+0000 7f576c72c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-13T19:16:14.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.780+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94332607029856 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb8588b2b0 con 0x7f576003e070 2024-09-13T19:16:14.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.781+0000 7f57684b7640 1 -- 172.21.15.102:0/1861982694 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== watch-notify(notify (1) cookie 94332606793696 notify 146028888064 ret 0) ==== 211+0+0 (crc 0 0 0) 0x55cb85805f90 con 0x7f576003e070 2024-09-13T19:16:14.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.781+0000 7f563effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888064 cookie 94332606793696 notifier 4300 bl.length()=169 2024-09-13T19:16:14.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.781+0000 7f563effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-13T19:16:14.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.781+0000 7f563effd640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-13T19:16:14.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.781+0000 7f57684b7640 1 -- 172.21.15.102:0/1861982694 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(69 notify.3 [notify cookie 94332607029856 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f575807a030 con 0x7f576003e070 2024-09-13T19:16:14.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.781+0000 7f563effd640 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f559c003400 con 0x7f576003e070 2024-09-13T19:16:14.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.781+0000 7f57684b7640 1 -- 172.21.15.102:0/1861982694 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== watch-notify(notify_complete (2) cookie 94332607029856 notify 146028888064 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55cb85805a10 con 0x7f576003e070 2024-09-13T19:16:14.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.781+0000 7f57684b7640 1 -- 172.21.15.102:0/1861982694 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f575807a030 con 0x7f576003e070 2024-09-13T19:16:14.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.781+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:71 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb85889290 con 0x7f575809d070 2024-09-13T19:16:14.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.782+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(71 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v34'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f575c029040 con 0x7f575809d070 2024-09-13T19:16:14.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.782+0000 7f576c72c800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-13T19:16:14.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.782+0000 7f576c72c800 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-13T19:16:14.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.782+0000 7f576c72c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-13T19:16:14.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.782+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify cookie 94332607040992 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55cb8588a7f0 con 0x7f576003e070 2024-09-13T19:16:14.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.782+0000 7f57684b7640 1 -- 172.21.15.102:0/1861982694 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== watch-notify(notify (1) cookie 94332606793696 notify 146028888065 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55cb85805a10 con 0x7f576003e070 2024-09-13T19:16:14.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.782+0000 7f563f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888065 cookie 94332606793696 notifier 4300 bl.length()=177 2024-09-13T19:16:14.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.782+0000 7f563f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-13T19:16:14.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.782+0000 7f563f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-13T19:16:14.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.783+0000 7f563f7fe640 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f562c003ea0 con 0x7f576003e070 2024-09-13T19:16:14.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.783+0000 7f57684b7640 1 -- 172.21.15.102:0/1861982694 <== osd.2 v2:172.21.15.102:6816/2238176080 16 ==== osd_op_reply(72 notify.3 [notify cookie 94332607040992 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f575807a030 con 0x7f576003e070 2024-09-13T19:16:14.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.783+0000 7f57684b7640 1 -- 172.21.15.102:0/1861982694 <== osd.2 v2:172.21.15.102:6816/2238176080 17 ==== osd_op_reply(73 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f575807a030 con 0x7f576003e070 2024-09-13T19:16:14.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.783+0000 7f57684b7640 1 -- 172.21.15.102:0/1861982694 <== osd.2 v2:172.21.15.102:6816/2238176080 18 ==== watch-notify(notify_complete (2) cookie 94332607040992 notify 146028888065 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55cb855b9fe0 con 0x7f576003e070 2024-09-13T19:16:14.793 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:16:14.779675Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:16:14.779665Z","tags":[],"group_ids":[]} 2024-09-13T19:16:14.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.784+0000 7f561e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:14.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.784+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:74 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94332606810272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb85885540 con 0x55cb8583fe40 2024-09-13T19:16:14.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.784+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 <== osd.1 v2:172.21.15.102:6808/2204418452 29 ==== osd_op_reply(74 data_loggenerations_metadata [watch unwatch cookie 94332606810272] v34'51 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f575c029040 con 0x55cb8583fe40 2024-09-13T19:16:14.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.785+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:75 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94332606787376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb85885540 con 0x7f576003e070 2024-09-13T19:16:14.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.785+0000 7f57684b7640 1 -- 172.21.15.102:0/1861982694 <== osd.2 v2:172.21.15.102:6816/2238176080 19 ==== osd_op_reply(75 notify.0 [watch unwatch cookie 94332606787376] v34'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f575807a030 con 0x7f576003e070 2024-09-13T19:16:14.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.786+0000 7f576c72c800 20 remove_watcher() i=0 2024-09-13T19:16:14.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.786+0000 7f576c72c800 2 removed watcher, disabling cache 2024-09-13T19:16:14.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.786+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94332606791568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb85885540 con 0x55cb8583fe40 2024-09-13T19:16:14.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.787+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 <== osd.1 v2:172.21.15.102:6808/2204418452 30 ==== osd_op_reply(76 notify.1 [watch unwatch cookie 94332606791568] v34'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f575c029040 con 0x55cb8583fe40 2024-09-13T19:16:14.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.787+0000 7f576c72c800 20 remove_watcher() i=1 2024-09-13T19:16:14.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.787+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94332606796368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb85885540 con 0x55cb85844750 2024-09-13T19:16:14.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.788+0000 7f5768cb8640 1 -- 172.21.15.102:0/1861982694 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(77 notify.2 [watch unwatch cookie 94332606796368] v34'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f576003b030 con 0x55cb85844750 2024-09-13T19:16:14.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.788+0000 7f576c72c800 20 remove_watcher() i=2 2024-09-13T19:16:14.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.788+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94332606793696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb85885540 con 0x7f576003e070 2024-09-13T19:16:14.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.789+0000 7f57684b7640 1 -- 172.21.15.102:0/1861982694 <== osd.2 v2:172.21.15.102:6816/2238176080 20 ==== osd_op_reply(78 notify.3 [watch unwatch cookie 94332606793696] v34'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f575807a030 con 0x7f576003e070 2024-09-13T19:16:14.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.789+0000 7f576c72c800 20 remove_watcher() i=3 2024-09-13T19:16:14.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.789+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:79 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94332606801440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb85885540 con 0x55cb8583fe40 2024-09-13T19:16:14.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.790+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 <== osd.1 v2:172.21.15.102:6808/2204418452 31 ==== osd_op_reply(79 notify.4 [watch unwatch cookie 94332606801440] v34'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f575c029040 con 0x55cb8583fe40 2024-09-13T19:16:14.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.790+0000 7f576c72c800 20 remove_watcher() i=4 2024-09-13T19:16:14.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.790+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:80 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94332606805584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb85885540 con 0x7f575809d070 2024-09-13T19:16:14.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.791+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(80 notify.5 [watch unwatch cookie 94332606805584] v34'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f575c029040 con 0x7f575809d070 2024-09-13T19:16:14.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.791+0000 7f576c72c800 20 remove_watcher() i=5 2024-09-13T19:16:14.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.791+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:81 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94332606803008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb85885540 con 0x7f575809d070 2024-09-13T19:16:14.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.792+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 <== osd.0 v2:172.21.15.53:6800/4021716951 20 ==== osd_op_reply(81 notify.6 [watch unwatch cookie 94332606803008] v34'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f575c029040 con 0x7f575809d070 2024-09-13T19:16:14.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.792+0000 7f576c72c800 20 remove_watcher() i=6 2024-09-13T19:16:14.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.792+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:82 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94332606809216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55cb85885540 con 0x7f575809d070 2024-09-13T19:16:14.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.793+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 <== osd.0 v2:172.21.15.53:6800/4021716951 21 ==== osd_op_reply(82 notify.7 [watch unwatch cookie 94332606809216] v34'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f575c029040 con 0x7f575809d070 2024-09-13T19:16:14.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.793+0000 7f576c72c800 20 remove_watcher() i=7 2024-09-13T19:16:14.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.793+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f575809d070 msgr2=0x7f575805e8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.793+0000 7f576c72c800 1 --2- 172.21.15.102:0/1861982694 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f575809d070 0x7f575805e8a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.793+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55cb8583fe40 msgr2=0x55cb85842300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.793+0000 7f576c72c800 1 --2- 172.21.15.102:0/1861982694 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55cb8583fe40 0x55cb85842300 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.793+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f576003e070 msgr2=0x7f57600484f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.793+0000 7f576c72c800 1 --2- 172.21.15.102:0/1861982694 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f576003e070 0x7f57600484f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.793+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55cb85844750 msgr2=0x55cb85846b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.793+0000 7f576c72c800 1 --2- 172.21.15.102:0/1861982694 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55cb85844750 0x55cb85846b40 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.793+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5630036b40 msgr2=0x7f5630039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.793+0000 7f576c72c800 1 --2- 172.21.15.102:0/1861982694 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5630036b40 0x7f5630039000 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f575800a330 tx=0x7f5758092000 comp rx=0 tx=0).stop 2024-09-13T19:16:14.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.793+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb8582cf10 msgr2=0x55cb85834390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.793+0000 7f5767cb6640 1 -- 172.21.15.102:0/1861982694 reap_dead start 2024-09-13T19:16:14.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.793+0000 7f576c72c800 1 --2- 172.21.15.102:0/1861982694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb8582cf10 0x55cb85834390 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f576004cd40 tx=0x7f576004cd70 comp rx=0 tx=0).stop 2024-09-13T19:16:14.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.794+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 shutdown_connections 2024-09-13T19:16:14.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.794+0000 7f576c72c800 1 --2- 172.21.15.102:0/1861982694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb8582cf10 0x55cb85834390 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.794+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 >> 172.21.15.102:0/1861982694 conn(0x55cb85829270 msgr2=0x55cb85827340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:14.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.794+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 shutdown_connections 2024-09-13T19:16:14.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.794+0000 7f576c72c800 1 -- 172.21.15.102:0/1861982694 wait complete. 2024-09-13T19:16:14.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.794+0000 7f576c72c800 1 -- 172.21.15.102:0/409143414 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5640036b90 msgr2=0x7f5640039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.794+0000 7f576c72c800 1 --2- 172.21.15.102:0/409143414 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5640036b90 0x7f5640039050 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x55cb8580d3d0 tx=0x7f575808ec10 comp rx=0 tx=0).stop 2024-09-13T19:16:14.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.794+0000 7f576c72c800 1 -- 172.21.15.102:0/409143414 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb858201c0 msgr2=0x55cb858205e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.794+0000 7f576c72c800 1 --2- 172.21.15.102:0/409143414 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb858201c0 0x55cb858205e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x55cb858066f0 tx=0x7f57600163e0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.794+0000 7f576c72c800 1 -- 172.21.15.102:0/409143414 shutdown_connections 2024-09-13T19:16:14.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.794+0000 7f576c72c800 1 --2- 172.21.15.102:0/409143414 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5640036b90 0x7f5640039050 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.794+0000 7f576c72c800 1 --2- 172.21.15.102:0/409143414 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb858201c0 0x55cb858205e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.794+0000 7f576c72c800 1 -- 172.21.15.102:0/409143414 >> 172.21.15.102:0/409143414 conn(0x55cb85815150 msgr2=0x55cb85817cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:14.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.794+0000 7f576c72c800 1 -- 172.21.15.102:0/409143414 shutdown_connections 2024-09-13T19:16:14.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.794+0000 7f576c72c800 1 -- 172.21.15.102:0/409143414 wait complete. 2024-09-13T19:16:14.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.794+0000 7f576c72c800 1 -- 172.21.15.102:0/3047287843 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55cb85711b90 msgr2=0x55cb8580c540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.794+0000 7f576c72c800 1 --2- 172.21.15.102:0/3047287843 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55cb85711b90 0x55cb8580c540 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.794+0000 7f576c72c800 1 -- 172.21.15.102:0/3047287843 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55cb8580ee20 msgr2=0x55cb85811210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.794+0000 7f576c72c800 1 --2- 172.21.15.102:0/3047287843 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55cb8580ee20 0x55cb85811210 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.794+0000 7f576c72c800 1 -- 172.21.15.102:0/3047287843 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5650036b90 msgr2=0x7f5650039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.794+0000 7f576c72c800 1 --2- 172.21.15.102:0/3047287843 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5650036b90 0x7f5650039050 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f575c000f60 tx=0x7f575c0012b0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.794+0000 7f576c72c800 1 -- 172.21.15.102:0/3047287843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb85680640 msgr2=0x55cb858054d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.794+0000 7f576c72c800 1 --2- 172.21.15.102:0/3047287843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb85680640 0x55cb858054d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x55cb857fe9b0 tx=0x7f5758002fb0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.795+0000 7f576c72c800 1 -- 172.21.15.102:0/3047287843 shutdown_connections 2024-09-13T19:16:14.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.795+0000 7f576c72c800 1 --2- 172.21.15.102:0/3047287843 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55cb8580ee20 0x55cb85811210 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.795+0000 7f576c72c800 1 --2- 172.21.15.102:0/3047287843 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55cb85711b90 0x55cb8580c540 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.795+0000 7f576c72c800 1 --2- 172.21.15.102:0/3047287843 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5650036b90 0x7f5650039050 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.795+0000 7f576c72c800 1 --2- 172.21.15.102:0/3047287843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb85680640 0x55cb858054d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.795+0000 7f576c72c800 1 -- 172.21.15.102:0/3047287843 >> 172.21.15.102:0/3047287843 conn(0x55cb85706de0 msgr2=0x55cb857f7d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:14.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.795+0000 7f576c72c800 1 -- 172.21.15.102:0/3047287843 shutdown_connections 2024-09-13T19:16:14.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.795+0000 7f576c72c800 1 -- 172.21.15.102:0/3047287843 wait complete. 2024-09-13T19:16:14.807 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:16:14.779675Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:16:14.779665Z', 'tags': [], 'group_ids': []} 2024-09-13T19:16:14.808 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-13T19:16:14.808 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-13T19:16:14.808 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2024-09-13T19:16:14.856 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:14.856 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:14.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.852+0000 7f6ff6d2a800 1 Processor -- start 2024-09-13T19:16:14.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.852+0000 7f6ff6d2a800 1 -- start start 2024-09-13T19:16:14.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.853+0000 7f6ff6d2a800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55efd5232db0 0x55efd52351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.853+0000 7f6ff6d2a800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55efd50ebb30 con 0x55efd51a0630 2024-09-13T19:16:14.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.853+0000 7f6ff6d2a800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55efd50cd360 con 0x55efd5232db0 2024-09-13T19:16:14.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.853+0000 7f6fea220640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55efd5232db0 0x55efd52351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.853+0000 7f6ff2a21640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55efd51a0630 0x55efd5231690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:49782/0 (socket says 172.21.15.102:49782) 2024-09-13T19:16:14.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.853+0000 7f6fea220640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55efd5232db0 0x55efd52351a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53888/0 (socket says 172.21.15.102:53888) 2024-09-13T19:16:14.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.853+0000 7f6ff2a21640 1 -- 172.21.15.102:0/4084641898 learned_addr learned my addr 172.21.15.102:0/4084641898 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:16:14.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.853+0000 7f6fea220640 1 -- 172.21.15.102:0/4084641898 >> v1:172.21.15.53:6789/0 conn(0x55efd51a0630 legacy=0x55efd5231690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.853+0000 7f6fea220640 1 -- 172.21.15.102:0/4084641898 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efd50f3e00 con 0x55efd5232db0 2024-09-13T19:16:14.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.855+0000 7f6fea220640 1 --2- 172.21.15.102:0/4084641898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55efd5232db0 0x55efd52351a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc00a470 tx=0x7f6fdc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27869f99d0965ab6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.855+0000 7f6ff2220640 1 -- 172.21.15.102:0/4084641898 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fdc053570 con 0x55efd5232db0 2024-09-13T19:16:14.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.855+0000 7f6ff2220640 1 -- 172.21.15.102:0/4084641898 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fdc058070 con 0x55efd5232db0 2024-09-13T19:16:14.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.855+0000 7f6ff2220640 1 -- 172.21.15.102:0/4084641898 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fdc053880 con 0x55efd5232db0 2024-09-13T19:16:14.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.856+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/4084641898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55efd5232db0 msgr2=0x55efd52351a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.856+0000 7f6ff6d2a800 1 --2- 172.21.15.102:0/4084641898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55efd5232db0 0x55efd52351a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc00a470 tx=0x7f6fdc045a20 comp rx=0 tx=0).stop 2024-09-13T19:16:14.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.856+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/4084641898 shutdown_connections 2024-09-13T19:16:14.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.856+0000 7f6ff6d2a800 1 --2- 172.21.15.102:0/4084641898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55efd5232db0 0x55efd52351a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.856+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/4084641898 >> 172.21.15.102:0/4084641898 conn(0x55efd5226e00 msgr2=0x55efd5229220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:14.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.856+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/4084641898 shutdown_connections 2024-09-13T19:16:14.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.856+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/4084641898 wait complete. 2024-09-13T19:16:14.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.869+0000 7f6ff6d2a800 1 Processor -- start 2024-09-13T19:16:14.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.869+0000 7f6ff6d2a800 1 -- start start 2024-09-13T19:16:14.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.869+0000 7f6ff6d2a800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55efd51a0630 0x55efd531dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.869+0000 7f6ff6d2a800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55efd5178350 con 0x55efd51a0630 2024-09-13T19:16:14.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.870+0000 7f6ff2a21640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55efd51a0630 0x55efd531dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.870+0000 7f6ff2a21640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55efd51a0630 0x55efd531dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53896/0 (socket says 172.21.15.102:53896) 2024-09-13T19:16:14.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.870+0000 7f6ff2a21640 1 -- 172.21.15.102:0/2411207704 learned_addr learned my addr 172.21.15.102:0/2411207704 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:14.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.870+0000 7f6ff2a21640 1 -- 172.21.15.102:0/2411207704 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efd50c5bc0 con 0x55efd51a0630 2024-09-13T19:16:14.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.870+0000 7f6ff2a21640 1 --2- 172.21.15.102:0/2411207704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55efd51a0630 0x55efd531dab0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4001d80 tx=0x7f6fe4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af16ec8b57aec55 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.870+0000 7f6ee0e09640 1 -- 172.21.15.102:0/2411207704 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fe4013030 con 0x55efd51a0630 2024-09-13T19:16:14.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.870+0000 7f6ee0e09640 1 -- 172.21.15.102:0/2411207704 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fe400e470 con 0x55efd51a0630 2024-09-13T19:16:14.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.870+0000 7f6ee0e09640 1 -- 172.21.15.102:0/2411207704 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fe400e810 con 0x55efd51a0630 2024-09-13T19:16:14.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.871+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/2411207704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55efd51a0630 msgr2=0x55efd531dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.871+0000 7f6ff6d2a800 1 --2- 172.21.15.102:0/2411207704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55efd51a0630 0x55efd531dab0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4001d80 tx=0x7f6fe4001e70 comp rx=0 tx=0).stop 2024-09-13T19:16:14.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.871+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/2411207704 shutdown_connections 2024-09-13T19:16:14.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.871+0000 7f6ff6d2a800 1 --2- 172.21.15.102:0/2411207704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55efd51a0630 0x55efd531dab0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.871+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/2411207704 >> 172.21.15.102:0/2411207704 conn(0x55efd5226e00 msgr2=0x55efd5319470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:14.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.871+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/2411207704 shutdown_connections 2024-09-13T19:16:14.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.871+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/2411207704 wait complete. 2024-09-13T19:16:14.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.871+0000 7f6ff6d2a800 1 Processor -- start 2024-09-13T19:16:14.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.871+0000 7f6ff6d2a800 1 -- start start 2024-09-13T19:16:14.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.871+0000 7f6ff6d2a800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55efd51a0630 0x55efd53254e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.871+0000 7f6ff6d2a800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55efd52359b0 con 0x55efd51a0630 2024-09-13T19:16:14.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.872+0000 7f6ff2a21640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55efd51a0630 0x55efd53254e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.872+0000 7f6ff2a21640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55efd51a0630 0x55efd53254e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53910/0 (socket says 172.21.15.102:53910) 2024-09-13T19:16:14.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.872+0000 7f6ff2a21640 1 -- 172.21.15.102:0/639252199 learned_addr learned my addr 172.21.15.102:0/639252199 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:14.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.872+0000 7f6ff2a21640 1 -- 172.21.15.102:0/639252199 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efd50d9fe0 con 0x55efd51a0630 2024-09-13T19:16:14.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.872+0000 7f6ff2a21640 1 --2- 172.21.15.102:0/639252199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55efd51a0630 0x55efd53254e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4004000 tx=0x7f6fe4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.872+0000 7f6edf606640 1 -- 172.21.15.102:0/639252199 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fe4027070 con 0x55efd51a0630 2024-09-13T19:16:14.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.872+0000 7f6edf606640 1 -- 172.21.15.102:0/639252199 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fe4019900 con 0x55efd51a0630 2024-09-13T19:16:14.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.872+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/639252199 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55efd5325a20 con 0x55efd51a0630 2024-09-13T19:16:14.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.872+0000 7f6edf606640 1 -- 172.21.15.102:0/639252199 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fe4019c60 con 0x55efd51a0630 2024-09-13T19:16:14.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.872+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/639252199 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efd5325f40 con 0x55efd51a0630 2024-09-13T19:16:14.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.873+0000 7f6edf606640 1 -- 172.21.15.102:0/639252199 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6fe402a070 con 0x55efd51a0630 2024-09-13T19:16:14.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.873+0000 7f6edf606640 1 --2- 172.21.15.102:0/639252199 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6ed8036b40 0x7f6ed8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.873+0000 7f6edf606640 1 -- 172.21.15.102:0/639252199 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f6fe401f070 con 0x55efd51a0630 2024-09-13T19:16:14.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.873+0000 7f6fea220640 1 --2- 172.21.15.102:0/639252199 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6ed8036b40 0x7f6ed8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.874+0000 7f6ff6d2a800 1 --2- 172.21.15.102:0/639252199 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55efd5232db0 0x55efd532c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.874+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/639252199 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55efd532cad0 con 0x55efd5232db0 2024-09-13T19:16:14.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.874+0000 7f6ff3222640 1 --2- 172.21.15.102:0/639252199 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55efd5232db0 0x55efd532c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.874+0000 7f6fea220640 1 --2- 172.21.15.102:0/639252199 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6ed8036b40 0x7f6ed8039000 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc057000 tx=0x7f6fdc052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.874+0000 7f6ff3222640 1 --2- 172.21.15.102:0/639252199 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55efd5232db0 0x55efd532c550 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.874+0000 7f6ff3222640 1 -- 172.21.15.102:0/639252199 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6fec00a4a0 con 0x55efd5232db0 2024-09-13T19:16:14.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.874+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/639252199 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55efd5329b20 con 0x55efd5232db0 2024-09-13T19:16:14.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.875+0000 7f6ff3222640 1 -- 172.21.15.102:0/639252199 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6fec00a4a0 con 0x55efd5232db0 2024-09-13T19:16:14.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.875+0000 7f6ff6d2a800 1 --2- 172.21.15.102:0/639252199 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55efd532ee20 0x55efd5331210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.875+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/639252199 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55efd5331900 con 0x55efd532ee20 2024-09-13T19:16:14.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.875+0000 7f6ff2a21640 1 --2- 172.21.15.102:0/639252199 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55efd532ee20 0x55efd5331210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.875+0000 7f6ff2a21640 1 --2- 172.21.15.102:0/639252199 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55efd532ee20 0x55efd5331210 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.875+0000 7f6ff2a21640 1 -- 172.21.15.102:0/639252199 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6fe4029030 con 0x55efd532ee20 2024-09-13T19:16:14.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.875+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/639252199 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55efd532dcc0 con 0x55efd5232db0 2024-09-13T19:16:14.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.876+0000 7f6ff3222640 1 -- 172.21.15.102:0/639252199 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6fec00a4a0 con 0x55efd5232db0 2024-09-13T19:16:14.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.876+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/639252199 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55efd532e1a0 con 0x55efd532ee20 2024-09-13T19:16:14.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.876+0000 7f6ff2a21640 1 -- 172.21.15.102:0/639252199 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6fe4029030 con 0x55efd532ee20 2024-09-13T19:16:14.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.876+0000 7f6ff6d2a800 1 Processor -- start 2024-09-13T19:16:14.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.876+0000 7f6ff6d2a800 1 -- start start 2024-09-13T19:16:14.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.876+0000 7f6ff6d2a800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55efd5340290 0x55efd53406b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.876+0000 7f6ff6d2a800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55efd50c7580 con 0x55efd5340290 2024-09-13T19:16:14.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.877+0000 7f6ff3222640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55efd5340290 0x55efd53406b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.877+0000 7f6ff3222640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55efd5340290 0x55efd53406b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53914/0 (socket says 172.21.15.102:53914) 2024-09-13T19:16:14.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.877+0000 7f6ff3222640 1 -- 172.21.15.102:0/2744629821 learned_addr learned my addr 172.21.15.102:0/2744629821 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:14.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.877+0000 7f6ff3222640 1 -- 172.21.15.102:0/2744629821 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efd5340bf0 con 0x55efd5340290 2024-09-13T19:16:14.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.877+0000 7f6ff3222640 1 --2- 172.21.15.102:0/2744629821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55efd5340290 0x55efd53406b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x55efd53268e0 tx=0x7f6fec0163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.877+0000 7f6edce01640 1 -- 172.21.15.102:0/2744629821 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fec013450 con 0x55efd5340290 2024-09-13T19:16:14.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.877+0000 7f6edce01640 1 -- 172.21.15.102:0/2744629821 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fec0135f0 con 0x55efd5340290 2024-09-13T19:16:14.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.877+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/2744629821 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55efd5340e80 con 0x55efd5340290 2024-09-13T19:16:14.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.877+0000 7f6edce01640 1 -- 172.21.15.102:0/2744629821 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fec013910 con 0x55efd5340290 2024-09-13T19:16:14.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.877+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/2744629821 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efd5343b60 con 0x55efd5340290 2024-09-13T19:16:14.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.878+0000 7f6edce01640 1 -- 172.21.15.102:0/2744629821 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6fec011040 con 0x55efd5340290 2024-09-13T19:16:14.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.878+0000 7f6edce01640 1 --2- 172.21.15.102:0/2744629821 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6ecc036b40 0x7f6ecc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.878+0000 7f6edce01640 1 -- 172.21.15.102:0/2744629821 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f6fec00e040 con 0x55efd5340290 2024-09-13T19:16:14.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.878+0000 7f6ff2a21640 1 --2- 172.21.15.102:0/2744629821 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6ecc036b40 0x7f6ecc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.878+0000 7f6ff6d2a800 1 Processor -- start 2024-09-13T19:16:14.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.878+0000 7f6ff6d2a800 1 -- start start 2024-09-13T19:16:14.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.878+0000 7f6ff2a21640 1 --2- 172.21.15.102:0/2744629821 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6ecc036b40 0x7f6ecc039000 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x55efd532d3d0 tx=0x7f6fe402ae80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.879+0000 7f6ff6d2a800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55efd534cf50 0x55efd534d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.879+0000 7f6ff6d2a800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55efd531e260 con 0x55efd534cf50 2024-09-13T19:16:14.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.879+0000 7f6ff3222640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55efd534cf50 0x55efd534d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.879+0000 7f6ff3222640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55efd534cf50 0x55efd534d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53928/0 (socket says 172.21.15.102:53928) 2024-09-13T19:16:14.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.879+0000 7f6ff3222640 1 -- 172.21.15.102:0/3701952257 learned_addr learned my addr 172.21.15.102:0/3701952257 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:14.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.879+0000 7f6ff3222640 1 -- 172.21.15.102:0/3701952257 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efd534d920 con 0x55efd534cf50 2024-09-13T19:16:14.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.879+0000 7f6ff3222640 1 --2- 172.21.15.102:0/3701952257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55efd534cf50 0x55efd534d350 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6fec04ce30 tx=0x7f6fec01ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36abfd89507561a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.879+0000 7f6ed67fc640 1 -- 172.21.15.102:0/3701952257 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fec03de60 con 0x55efd534cf50 2024-09-13T19:16:14.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.879+0000 7f6ed67fc640 1 -- 172.21.15.102:0/3701952257 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fec02a960 con 0x55efd534cf50 2024-09-13T19:16:14.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.879+0000 7f6ed67fc640 1 -- 172.21.15.102:0/3701952257 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fec02a440 con 0x55efd534cf50 2024-09-13T19:16:14.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.880+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3701952257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55efd534cf50 msgr2=0x55efd534d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.880+0000 7f6ff6d2a800 1 --2- 172.21.15.102:0/3701952257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55efd534cf50 0x55efd534d350 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6fec04ce30 tx=0x7f6fec01ff70 comp rx=0 tx=0).stop 2024-09-13T19:16:14.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.880+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3701952257 shutdown_connections 2024-09-13T19:16:14.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.880+0000 7f6ff6d2a800 1 --2- 172.21.15.102:0/3701952257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55efd534cf50 0x55efd534d350 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.880+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3701952257 >> 172.21.15.102:0/3701952257 conn(0x55efd53492b0 msgr2=0x55efd53473b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:14.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.880+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3701952257 shutdown_connections 2024-09-13T19:16:14.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.880+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3701952257 wait complete. 2024-09-13T19:16:14.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.880+0000 7f6ff6d2a800 1 Processor -- start 2024-09-13T19:16:14.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.880+0000 7f6ff6d2a800 1 -- start start 2024-09-13T19:16:14.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.880+0000 7f6ff6d2a800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55efd534cf50 0x55efd53543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.880+0000 7f6ff6d2a800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55efd534df90 con 0x55efd534cf50 2024-09-13T19:16:14.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.880+0000 7f6ff3222640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55efd534cf50 0x55efd53543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.880+0000 7f6ff3222640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55efd534cf50 0x55efd53543d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53932/0 (socket says 172.21.15.102:53932) 2024-09-13T19:16:14.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.880+0000 7f6ff3222640 1 -- 172.21.15.102:0/3413332723 learned_addr learned my addr 172.21.15.102:0/3413332723 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:14.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.881+0000 7f6ff3222640 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efd5354910 con 0x55efd534cf50 2024-09-13T19:16:14.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.881+0000 7f6ff3222640 1 --2- 172.21.15.102:0/3413332723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55efd534cf50 0x55efd53543d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6fec013fb0 tx=0x7f6fec04cdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.881+0000 7f6ed4ff9640 1 -- 172.21.15.102:0/3413332723 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fec039070 con 0x55efd534cf50 2024-09-13T19:16:14.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.881+0000 7f6ed4ff9640 1 -- 172.21.15.102:0/3413332723 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fec01f920 con 0x55efd534cf50 2024-09-13T19:16:14.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.881+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55efd5354ba0 con 0x55efd534cf50 2024-09-13T19:16:14.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.881+0000 7f6ed4ff9640 1 -- 172.21.15.102:0/3413332723 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fec0402e0 con 0x55efd534cf50 2024-09-13T19:16:14.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.881+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efd5357850 con 0x55efd534cf50 2024-09-13T19:16:14.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.882+0000 7f6ed4ff9640 1 -- 172.21.15.102:0/3413332723 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6fec04e2c0 con 0x55efd534cf50 2024-09-13T19:16:14.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.882+0000 7f6ed4ff9640 1 --2- 172.21.15.102:0/3413332723 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6ebc036b90 0x7f6ebc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.882+0000 7f6ed4ff9640 1 -- 172.21.15.102:0/3413332723 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f6fec035cc0 con 0x55efd534cf50 2024-09-13T19:16:14.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.882+0000 7f6ff2a21640 1 --2- 172.21.15.102:0/3413332723 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6ebc036b90 0x7f6ebc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.882+0000 7f6ff2a21640 1 --2- 172.21.15.102:0/3413332723 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6ebc036b90 0x7f6ebc039050 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4016fd0 tx=0x7f6fe4038000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.883+0000 7f6ff6d2a800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.883+0000 7f6ff6d2a800 1 --2- 172.21.15.102:0/3413332723 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55efd535fe20 0x55efd53622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.883+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55efd5362a30 con 0x55efd535fe20 2024-09-13T19:16:14.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.883+0000 7f6fea220640 1 --2- 172.21.15.102:0/3413332723 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55efd535fe20 0x55efd53622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.883+0000 7f6fea220640 1 --2- 172.21.15.102:0/3413332723 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55efd535fe20 0x55efd53622e0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.883+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x55efd535fe20 2024-09-13T19:16:14.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.883+0000 7f6ff6d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:14.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.883+0000 7f6ff6d2a800 20 realm 2024-09-13T19:16:14.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.883+0000 7f6ff6d2a800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.883+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55efd5362e60 con 0x55efd535fe20 2024-09-13T19:16:14.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.884+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x55efd535fe20 2024-09-13T19:16:14.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.884+0000 7f6ff6d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:14.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.884+0000 7f6ff6d2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:14.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.884+0000 7f6ff6d2a800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.884+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55efd5363730 con 0x55efd535fe20 2024-09-13T19:16:14.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.884+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x55efd535fe20 2024-09-13T19:16:14.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.884+0000 7f6ff6d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:14.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.884+0000 7f6ff6d2a800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.884+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55efd5363ad0 con 0x55efd535fe20 2024-09-13T19:16:14.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.884+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6fdc051070 con 0x55efd535fe20 2024-09-13T19:16:14.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.884+0000 7f6ff6d2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:14.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.884+0000 7f6ff6d2a800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.884+0000 7f6ff6d2a800 1 --2- 172.21.15.102:0/3413332723 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55efd5364830 0x55efd5366c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.884+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55efd5367270 con 0x55efd5364830 2024-09-13T19:16:14.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.884+0000 7f6ff3222640 1 --2- 172.21.15.102:0/3413332723 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55efd5364830 0x55efd5366c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.884+0000 7f6ff3222640 1 --2- 172.21.15.102:0/3413332723 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55efd5364830 0x55efd5366c20 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.885+0000 7f6ff3222640 1 -- 172.21.15.102:0/3413332723 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6fec03b030 con 0x55efd5364830 2024-09-13T19:16:14.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.885+0000 7f6ff6d2a800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:14.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.885+0000 7f6ff6d2a800 20 searching for the correct realm 2024-09-13T19:16:14.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.885+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efd5368ba0 con 0x55efd5364830 2024-09-13T19:16:14.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.885+0000 7f6ff3222640 1 -- 172.21.15.102:0/3413332723 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fec03b030 con 0x55efd5364830 2024-09-13T19:16:14.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.885+0000 7f6ff3222640 1 --2- 172.21.15.102:0/3413332723 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f6fec046c20 0x7f6fec04b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.885+0000 7f6ff3222640 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efd5368ba0 con 0x7f6fec046c20 2024-09-13T19:16:14.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.885+0000 7f6ff2a21640 1 --2- 172.21.15.102:0/3413332723 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f6fec046c20 0x7f6fec04b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.885+0000 7f6ff2a21640 1 --2- 172.21.15.102:0/3413332723 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f6fec046c20 0x7f6fec04b570 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.886+0000 7f6ff2a21640 1 -- 172.21.15.102:0/3413332723 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fe4029030 con 0x7f6fec046c20 2024-09-13T19:16:14.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.886+0000 7f6ff2a21640 1 --2- 172.21.15.102:0/3413332723 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f6fe4059040 0x7f6fe402a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.886+0000 7f6ff2a21640 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efd5368ba0 con 0x7f6fe4059040 2024-09-13T19:16:14.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.886+0000 7f6fea220640 1 --2- 172.21.15.102:0/3413332723 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f6fe4059040 0x7f6fe402a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.886+0000 7f6fea220640 1 --2- 172.21.15.102:0/3413332723 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f6fe4059040 0x7f6fe402a580 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.886+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fdc051070 con 0x7f6fe4059040 2024-09-13T19:16:14.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.886+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efd5368ba0 con 0x55efd535fe20 2024-09-13T19:16:14.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.887+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fdc051070 con 0x55efd535fe20 2024-09-13T19:16:14.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.887+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efd5368ba0 con 0x55efd535fe20 2024-09-13T19:16:14.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.887+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fdc051070 con 0x55efd535fe20 2024-09-13T19:16:14.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.887+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efd5368ba0 con 0x7f6fe4059040 2024-09-13T19:16:14.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.887+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fdc051070 con 0x7f6fe4059040 2024-09-13T19:16:14.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.887+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efd5368ba0 con 0x7f6fe4059040 2024-09-13T19:16:14.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.887+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fdc051070 con 0x7f6fe4059040 2024-09-13T19:16:14.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.887+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efd5368ba0 con 0x7f6fec046c20 2024-09-13T19:16:14.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.888+0000 7f6ff2a21640 1 -- 172.21.15.102:0/3413332723 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fe4029030 con 0x7f6fec046c20 2024-09-13T19:16:14.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.888+0000 7f6ff2a21640 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efd5368ba0 con 0x55efd5364830 2024-09-13T19:16:14.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.888+0000 7f6ff3222640 1 -- 172.21.15.102:0/3413332723 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fec03b030 con 0x55efd5364830 2024-09-13T19:16:14.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.888+0000 7f6ff3222640 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efd5368ba0 con 0x55efd535fe20 2024-09-13T19:16:14.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.888+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fdc051070 con 0x55efd535fe20 2024-09-13T19:16:14.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.888+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efd5368ba0 con 0x7f6fe4059040 2024-09-13T19:16:14.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.888+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fdc051070 con 0x7f6fe4059040 2024-09-13T19:16:14.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.888+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efd5368ba0 con 0x55efd535fe20 2024-09-13T19:16:14.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.889+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fdc051070 con 0x55efd535fe20 2024-09-13T19:16:14.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.889+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efd5368ba0 con 0x7f6fec046c20 2024-09-13T19:16:14.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.889+0000 7f6ff2a21640 1 -- 172.21.15.102:0/3413332723 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6fe4029030 con 0x7f6fec046c20 2024-09-13T19:16:14.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.889+0000 7f6ff2a21640 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efd5368ba0 con 0x55efd5364830 2024-09-13T19:16:14.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.889+0000 7f6ff3222640 1 -- 172.21.15.102:0/3413332723 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fec03b030 con 0x55efd5364830 2024-09-13T19:16:14.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.889+0000 7f6ff3222640 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efd5368ba0 con 0x55efd5364830 2024-09-13T19:16:14.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.889+0000 7f6ff3222640 1 -- 172.21.15.102:0/3413332723 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6fec03b030 con 0x55efd5364830 2024-09-13T19:16:14.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.889+0000 7f6ff3222640 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efd5368ba0 con 0x7f6fe4059040 2024-09-13T19:16:14.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.890+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fdc051070 con 0x7f6fe4059040 2024-09-13T19:16:14.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.890+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efd5368ba0 con 0x55efd5364830 2024-09-13T19:16:14.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.890+0000 7f6ff3222640 1 -- 172.21.15.102:0/3413332723 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6fec03b030 con 0x55efd5364830 2024-09-13T19:16:14.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.890+0000 7f6ff3222640 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efd5368ba0 con 0x55efd5364830 2024-09-13T19:16:14.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.890+0000 7f6ff3222640 1 -- 172.21.15.102:0/3413332723 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fec03b030 con 0x55efd5364830 2024-09-13T19:16:14.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.890+0000 7f6ff3222640 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efd5368ba0 con 0x55efd535fe20 2024-09-13T19:16:14.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.890+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fdc051070 con 0x55efd535fe20 2024-09-13T19:16:14.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.890+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efd5368ba0 con 0x55efd535fe20 2024-09-13T19:16:14.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.890+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6fdc051070 con 0x55efd535fe20 2024-09-13T19:16:14.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.890+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efd5368ba0 con 0x7f6fe4059040 2024-09-13T19:16:14.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.891+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fdc051070 con 0x7f6fe4059040 2024-09-13T19:16:14.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.891+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efd5368ba0 con 0x55efd5364830 2024-09-13T19:16:14.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.891+0000 7f6ff3222640 1 -- 172.21.15.102:0/3413332723 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fec03b030 con 0x55efd5364830 2024-09-13T19:16:14.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.891+0000 7f6ff3222640 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efd5368ba0 con 0x7f6fec046c20 2024-09-13T19:16:14.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.891+0000 7f6ff2a21640 1 -- 172.21.15.102:0/3413332723 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fe4029030 con 0x7f6fec046c20 2024-09-13T19:16:14.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.891+0000 7f6ff2a21640 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efd5368ba0 con 0x55efd535fe20 2024-09-13T19:16:14.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.891+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fdc051070 con 0x55efd535fe20 2024-09-13T19:16:14.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.891+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efd5368ba0 con 0x7f6fe4059040 2024-09-13T19:16:14.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.892+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fdc051070 con 0x7f6fe4059040 2024-09-13T19:16:14.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.892+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efd5368ba0 con 0x55efd5364830 2024-09-13T19:16:14.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.892+0000 7f6ff3222640 1 -- 172.21.15.102:0/3413332723 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fec03b030 con 0x55efd5364830 2024-09-13T19:16:14.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.892+0000 7f6ff3222640 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efd5368ba0 con 0x7f6fe4059040 2024-09-13T19:16:14.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.892+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fdc051070 con 0x7f6fe4059040 2024-09-13T19:16:14.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.892+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f6fdc087040 con 0x7f6fec046c20 2024-09-13T19:16:14.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.892+0000 7f6ff2a21640 1 -- 172.21.15.102:0/3413332723 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fe4029030 con 0x7f6fec046c20 2024-09-13T19:16:14.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.892+0000 7f6ff2a21640 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f6fdc087040 con 0x55efd5364830 2024-09-13T19:16:14.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.893+0000 7f6ff3222640 1 -- 172.21.15.102:0/3413332723 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fec03b030 con 0x55efd5364830 2024-09-13T19:16:14.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.893+0000 7f6ff3222640 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f6fdc087040 con 0x7f6fe4059040 2024-09-13T19:16:14.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.893+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fdc051070 con 0x7f6fe4059040 2024-09-13T19:16:14.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.893+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f6fdc087040 con 0x55efd535fe20 2024-09-13T19:16:14.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.893+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6fdc051070 con 0x55efd535fe20 2024-09-13T19:16:14.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.893+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f6fdc087040 con 0x7f6fec046c20 2024-09-13T19:16:14.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.893+0000 7f6ff2a21640 1 -- 172.21.15.102:0/3413332723 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fe4029030 con 0x7f6fec046c20 2024-09-13T19:16:14.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.893+0000 7f6ff6d2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:14.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.893+0000 7f6ff6d2a800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:14.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.893+0000 7f6ff6d2a800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:14.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.893+0000 7f6ff6d2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:14.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.893+0000 7f6ff6d2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:14.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.893+0000 7f6ff6d2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:14.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.893+0000 7f6ff6d2a800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.893+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55efd5367c60 con 0x55efd535fe20 2024-09-13T19:16:14.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.894+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x55efd535fe20 2024-09-13T19:16:14.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.894+0000 7f6ff6d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:14.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.894+0000 7f6ff6d2a800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.894+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55efd5368500 con 0x55efd535fe20 2024-09-13T19:16:14.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.894+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6fdc051070 con 0x55efd535fe20 2024-09-13T19:16:14.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.894+0000 7f6ff6d2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:14.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.894+0000 7f6ff6d2a800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.894+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55efd5369020 con 0x55efd5364830 2024-09-13T19:16:14.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.894+0000 7f6ff3222640 1 -- 172.21.15.102:0/3413332723 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6fec03b030 con 0x55efd5364830 2024-09-13T19:16:14.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.894+0000 7f6ff6d2a800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:14.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.894+0000 7f6ff6d2a800 20 zone default found 2024-09-13T19:16:14.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.894+0000 7f6ff6d2a800 4 Realm: () 2024-09-13T19:16:14.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.894+0000 7f6ff6d2a800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:14.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.894+0000 7f6ff6d2a800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:14.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.894+0000 7f6ff6d2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:14.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.894+0000 7f6ff6d2a800 20 zonegroup default 2024-09-13T19:16:14.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.894+0000 7f6ff6d2a800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.894+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55efd5369870 con 0x7f6fe4059040 2024-09-13T19:16:14.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.895+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x7f6fe4059040 2024-09-13T19:16:14.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.895+0000 7f6ff6d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:14.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.895+0000 7f6ff6d2a800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.895+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55efd536b250 con 0x55efd5364830 2024-09-13T19:16:14.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.895+0000 7f6ff3222640 1 -- 172.21.15.102:0/3413332723 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6fec03b030 con 0x55efd5364830 2024-09-13T19:16:14.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.895+0000 7f6ff6d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:14.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.895+0000 7f6ff6d2a800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.895+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55efd536b660 con 0x55efd5364830 2024-09-13T19:16:14.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.895+0000 7f6ff3222640 1 -- 172.21.15.102:0/3413332723 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6fec03b030 con 0x55efd5364830 2024-09-13T19:16:14.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.895+0000 7f6ff6d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:14.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.895+0000 7f6ff6d2a800 20 started sync module instance, tier type = 2024-09-13T19:16:14.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.895+0000 7f6ff6d2a800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:14.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.895+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55efd536a6e0 con 0x7f6fec046c20 2024-09-13T19:16:14.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.896+0000 7f6ff2a21640 1 -- 172.21.15.102:0/3413332723 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(44 notify.0 [create] v34'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fe4029030 con 0x7f6fec046c20 2024-09-13T19:16:14.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.896+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94488562674384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55efd536bf70 con 0x7f6fec046c20 2024-09-13T19:16:14.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.896+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55efd536c7c0 con 0x55efd535fe20 2024-09-13T19:16:14.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.897+0000 7f6ff2a21640 1 -- 172.21.15.102:0/3413332723 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94488562674384] v34'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fe4029030 con 0x7f6fec046c20 2024-09-13T19:16:14.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.898+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v34'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x55efd535fe20 2024-09-13T19:16:14.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.898+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94488562678464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55efd536c7c0 con 0x55efd535fe20 2024-09-13T19:16:14.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.898+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55efd536d2e0 con 0x55efd5364830 2024-09-13T19:16:14.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.900+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94488562678464] v34'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x55efd535fe20 2024-09-13T19:16:14.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.900+0000 7f6ff3222640 1 -- 172.21.15.102:0/3413332723 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v34'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fec03b030 con 0x55efd5364830 2024-09-13T19:16:14.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.900+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94488562683312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55efd536c7c0 con 0x55efd5364830 2024-09-13T19:16:14.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.900+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55efd536dd70 con 0x7f6fec046c20 2024-09-13T19:16:14.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.902+0000 7f6ff3222640 1 -- 172.21.15.102:0/3413332723 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94488562683312] v34'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fec03b030 con 0x55efd5364830 2024-09-13T19:16:14.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.902+0000 7f6ff2a21640 1 -- 172.21.15.102:0/3413332723 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(50 notify.3 [create] v34'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fe4029030 con 0x7f6fec046c20 2024-09-13T19:16:14.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.902+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94488562680592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55efd536c730 con 0x7f6fec046c20 2024-09-13T19:16:14.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.902+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55efd536ec30 con 0x55efd535fe20 2024-09-13T19:16:14.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.905+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v34'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x55efd535fe20 2024-09-13T19:16:14.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.905+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94488562689920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55efd536f050 con 0x55efd535fe20 2024-09-13T19:16:14.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.905+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55efd536fb70 con 0x7f6fe4059040 2024-09-13T19:16:14.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.905+0000 7f6ff2a21640 1 -- 172.21.15.102:0/3413332723 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94488562680592] v34'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fe4029030 con 0x7f6fec046c20 2024-09-13T19:16:14.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.906+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94488562689920] v34'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x55efd535fe20 2024-09-13T19:16:14.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.908+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(54 notify.5 [create] v34'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x7f6fe4059040 2024-09-13T19:16:14.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.908+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94488562693696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55efd536eba0 con 0x7f6fe4059040 2024-09-13T19:16:14.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.908+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55efd5370410 con 0x7f6fe4059040 2024-09-13T19:16:14.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.909+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94488562693696] v34'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x7f6fe4059040 2024-09-13T19:16:14.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.909+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(56 notify.6 [create] v34'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x7f6fe4059040 2024-09-13T19:16:14.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.909+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94488562688352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55efd536eba0 con 0x7f6fe4059040 2024-09-13T19:16:14.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.909+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55efd5370a30 con 0x7f6fe4059040 2024-09-13T19:16:14.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.910+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(58 notify.7 [create] v34'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x7f6fe4059040 2024-09-13T19:16:14.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.910+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94488562697600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55efd5370e50 con 0x7f6fe4059040 2024-09-13T19:16:14.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.910+0000 7f6ff6d2a800 20 add_watcher() i=0 2024-09-13T19:16:14.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.910+0000 7f6ff6d2a800 20 add_watcher() i=1 2024-09-13T19:16:14.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.910+0000 7f6ff6d2a800 20 add_watcher() i=2 2024-09-13T19:16:14.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.910+0000 7f6ff6d2a800 20 add_watcher() i=3 2024-09-13T19:16:14.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.910+0000 7f6ff6d2a800 20 add_watcher() i=4 2024-09-13T19:16:14.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.910+0000 7f6ff6d2a800 20 add_watcher() i=5 2024-09-13T19:16:14.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.910+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94488562688352] v34'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x7f6fe4059040 2024-09-13T19:16:14.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.910+0000 7f6ff6d2a800 20 add_watcher() i=6 2024-09-13T19:16:14.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.911+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94488562697600] v34'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x7f6fe4059040 2024-09-13T19:16:14.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.911+0000 7f6ff6d2a800 20 add_watcher() i=7 2024-09-13T19:16:14.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.911+0000 7f6ff6d2a800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:14.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.911+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55efd5370e50 con 0x55efd535fe20 2024-09-13T19:16:14.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.911+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6fdc051070 con 0x55efd535fe20 2024-09-13T19:16:14.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.911+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94488562698656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55efd5370dc0 con 0x55efd535fe20 2024-09-13T19:16:14.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.912+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94488562698656] v34'52 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x55efd535fe20 2024-09-13T19:16:14.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.912+0000 7f6ea97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:14.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.912+0000 7f6ff6d2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:14.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.912+0000 7f6ff6d2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:14.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.912+0000 7f6ff6d2a800 5 note: GC not initialized 2024-09-13T19:16:14.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.913+0000 7f6e23fff640 20 reqs_thread_entry: start 2024-09-13T19:16:14.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.913+0000 7f6ff6d2a800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:14.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.913+0000 7f6ff6d2a800 20 Filter name: none 2024-09-13T19:16:14.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.913+0000 7f6e21ffb640 20 reqs_thread_entry: start 2024-09-13T19:16:14.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.913+0000 7f6ff6d2a800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T19:16:14.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.913+0000 7f6ff6d2a800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.913+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55efd53a7280 con 0x7f6fe4059040 2024-09-13T19:16:14.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.913+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x7f6fe4059040 2024-09-13T19:16:14.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.913+0000 7f6ff6d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:14.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.913+0000 7f6ff6d2a800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-13T19:16:14.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.913+0000 7f6ff6d2a800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T19:16:14.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.913+0000 7f6ff6d2a800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-13T19:16:14.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.913+0000 7f6ff6d2a800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.913+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55efd53a58c0 con 0x55efd535fe20 2024-09-13T19:16:14.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.914+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(63 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) ==== 197+0+23 (crc 0 0 0) 0x7f6fdc051070 con 0x55efd535fe20 2024-09-13T19:16:14.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.914+0000 7f6ff6d2a800 20 rados_obj.operate() r=0 bl.length=7 2024-09-13T19:16:14.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.914+0000 7f6ff6d2a800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2024-09-13T19:16:14.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.914+0000 7f6ff6d2a800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-13T19:16:14.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.914+0000 7f6ff6d2a800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:16:14.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.914+0000 7f6ff6d2a800 20 rados->read ofs=0 len=0 2024-09-13T19:16:14.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.914+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55efd53a5cb0 con 0x55efd535fe20 2024-09-13T19:16:14.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.914+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(64 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f6fdc051070 con 0x55efd535fe20 2024-09-13T19:16:14.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.914+0000 7f6ff6d2a800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:16:14.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.914+0000 7f6ff6d2a800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:16:14.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.914+0000 7f6ff6d2a800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:16:14.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.914+0000 7f6ff6d2a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:16:14.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.914+0000 7f6ff6d2a800 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2024-09-13T19:16:14.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.914+0000 7f6ff6d2a800 20 get_user_info_from_index found 0 xattrs 2024-09-13T19:16:14.933 INFO:teuthology.orchestra.run.smithi102.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2024-09-13T19:16:14.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.915+0000 7f6ea97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:14.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.915+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94488562698656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55efd535c020 con 0x55efd535fe20 2024-09-13T19:16:14.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.916+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94488562698656] v34'53 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x55efd535fe20 2024-09-13T19:16:14.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.916+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94488562674384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55efd53a4fd0 con 0x7f6fec046c20 2024-09-13T19:16:14.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.917+0000 7f6ff2a21640 1 -- 172.21.15.102:0/3413332723 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94488562674384] v34'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fe4029030 con 0x7f6fec046c20 2024-09-13T19:16:14.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.917+0000 7f6ff6d2a800 20 remove_watcher() i=0 2024-09-13T19:16:14.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.917+0000 7f6ff6d2a800 2 removed watcher, disabling cache 2024-09-13T19:16:14.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.917+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94488562678464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55efd53a4fd0 con 0x55efd535fe20 2024-09-13T19:16:14.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.918+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94488562678464] v34'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x55efd535fe20 2024-09-13T19:16:14.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.918+0000 7f6ff6d2a800 20 remove_watcher() i=1 2024-09-13T19:16:14.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.918+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94488562683312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55efd53a4fd0 con 0x55efd5364830 2024-09-13T19:16:14.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.919+0000 7f6ff3222640 1 -- 172.21.15.102:0/3413332723 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94488562683312] v34'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fec03b030 con 0x55efd5364830 2024-09-13T19:16:14.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.919+0000 7f6ff6d2a800 20 remove_watcher() i=2 2024-09-13T19:16:14.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.919+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94488562680592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55efd53a4fd0 con 0x7f6fec046c20 2024-09-13T19:16:14.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.920+0000 7f6ff2a21640 1 -- 172.21.15.102:0/3413332723 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94488562680592] v34'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fe4029030 con 0x7f6fec046c20 2024-09-13T19:16:14.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.920+0000 7f6ff6d2a800 20 remove_watcher() i=3 2024-09-13T19:16:14.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.920+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94488562689920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55efd53a4fd0 con 0x55efd535fe20 2024-09-13T19:16:14.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.921+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94488562689920] v34'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x55efd535fe20 2024-09-13T19:16:14.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.921+0000 7f6ff6d2a800 20 remove_watcher() i=4 2024-09-13T19:16:14.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.921+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94488562693696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55efd53a4fd0 con 0x7f6fe4059040 2024-09-13T19:16:14.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.922+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94488562693696] v34'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x7f6fe4059040 2024-09-13T19:16:14.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.922+0000 7f6ff6d2a800 20 remove_watcher() i=5 2024-09-13T19:16:14.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.922+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94488562688352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55efd53a4fd0 con 0x7f6fe4059040 2024-09-13T19:16:14.938 DEBUG:teuthology.orchestra.run:got remote process result: 240 2024-09-13T19:16:14.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.923+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94488562688352] v34'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x7f6fe4059040 2024-09-13T19:16:14.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.923+0000 7f6ff6d2a800 20 remove_watcher() i=6 2024-09-13T19:16:14.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.923+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94488562697600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55efd53a4fd0 con 0x7f6fe4059040 2024-09-13T19:16:14.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.924+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 <== osd.0 v2:172.21.15.53:6800/4021716951 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94488562697600] v34'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x7f6fe4059040 2024-09-13T19:16:14.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.924+0000 7f6ff6d2a800 20 remove_watcher() i=7 2024-09-13T19:16:14.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.924+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f6fe4059040 msgr2=0x7f6fe402a580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.924+0000 7f6ff6d2a800 1 --2- 172.21.15.102:0/3413332723 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f6fe4059040 0x7f6fe402a580 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.924+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55efd535fe20 msgr2=0x55efd53622e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.924+0000 7f6ff6d2a800 1 --2- 172.21.15.102:0/3413332723 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55efd535fe20 0x55efd53622e0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.924+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f6fec046c20 msgr2=0x7f6fec04b570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.924+0000 7f6ff6d2a800 1 --2- 172.21.15.102:0/3413332723 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f6fec046c20 0x7f6fec04b570 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.924+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55efd5364830 msgr2=0x55efd5366c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.924+0000 7f6ff6d2a800 1 --2- 172.21.15.102:0/3413332723 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55efd5364830 0x55efd5366c20 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.924+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6ebc036b90 msgr2=0x7f6ebc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.924+0000 7f6ff6d2a800 1 --2- 172.21.15.102:0/3413332723 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6ebc036b90 0x7f6ebc039050 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4016fd0 tx=0x7f6fe4038000 comp rx=0 tx=0).stop 2024-09-13T19:16:14.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.924+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55efd534cf50 msgr2=0x55efd53543d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.924+0000 7f6ff6d2a800 1 --2- 172.21.15.102:0/3413332723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55efd534cf50 0x55efd53543d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6fec013fb0 tx=0x7f6fec04cdc0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.924+0000 7f6fea220640 1 -- 172.21.15.102:0/3413332723 reap_dead start 2024-09-13T19:16:14.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.924+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 shutdown_connections 2024-09-13T19:16:14.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.924+0000 7f6ff6d2a800 1 --2- 172.21.15.102:0/3413332723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55efd534cf50 0x55efd53543d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.924+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 >> 172.21.15.102:0/3413332723 conn(0x55efd53492b0 msgr2=0x55efd5347380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:14.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.924+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 shutdown_connections 2024-09-13T19:16:14.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.924+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/3413332723 wait complete. 2024-09-13T19:16:14.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.925+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/2744629821 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6ecc036b40 msgr2=0x7f6ecc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.925+0000 7f6ff6d2a800 1 --2- 172.21.15.102:0/2744629821 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6ecc036b40 0x7f6ecc039000 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x55efd532d3d0 tx=0x7f6fe402ae80 comp rx=0 tx=0).stop 2024-09-13T19:16:14.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.925+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/2744629821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55efd5340290 msgr2=0x55efd53406b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.925+0000 7f6ff6d2a800 1 --2- 172.21.15.102:0/2744629821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55efd5340290 0x55efd53406b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x55efd53268e0 tx=0x7f6fec0163e0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.925+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/2744629821 shutdown_connections 2024-09-13T19:16:14.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.925+0000 7f6ff6d2a800 1 --2- 172.21.15.102:0/2744629821 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6ecc036b40 0x7f6ecc039000 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.925+0000 7f6ff6d2a800 1 --2- 172.21.15.102:0/2744629821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55efd5340290 0x55efd53406b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.925+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/2744629821 >> 172.21.15.102:0/2744629821 conn(0x55efd5335220 msgr2=0x55efd5337da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:14.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.925+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/2744629821 shutdown_connections 2024-09-13T19:16:14.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.925+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/2744629821 wait complete. 2024-09-13T19:16:14.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.925+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/639252199 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55efd5232db0 msgr2=0x55efd532c550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.925+0000 7f6ff6d2a800 1 --2- 172.21.15.102:0/639252199 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55efd5232db0 0x55efd532c550 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.925+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/639252199 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55efd532ee20 msgr2=0x55efd5331210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.925+0000 7f6ff6d2a800 1 --2- 172.21.15.102:0/639252199 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55efd532ee20 0x55efd5331210 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.925+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/639252199 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6ed8036b40 msgr2=0x7f6ed8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.925+0000 7f6ff6d2a800 1 --2- 172.21.15.102:0/639252199 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6ed8036b40 0x7f6ed8039000 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc057000 tx=0x7f6fdc052000 comp rx=0 tx=0).stop 2024-09-13T19:16:14.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.925+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/639252199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55efd51a0630 msgr2=0x55efd53254e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.925+0000 7f6ff6d2a800 1 --2- 172.21.15.102:0/639252199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55efd51a0630 0x55efd53254e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4004000 tx=0x7f6fe4000bc0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.925+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/639252199 shutdown_connections 2024-09-13T19:16:14.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.925+0000 7f6ff6d2a800 1 --2- 172.21.15.102:0/639252199 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55efd532ee20 0x55efd5331210 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.925+0000 7f6ff6d2a800 1 --2- 172.21.15.102:0/639252199 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55efd5232db0 0x55efd532c550 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.925+0000 7f6ff6d2a800 1 --2- 172.21.15.102:0/639252199 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6ed8036b40 0x7f6ed8039000 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.925+0000 7f6ff6d2a800 1 --2- 172.21.15.102:0/639252199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55efd51a0630 0x55efd53254e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.925+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/639252199 >> 172.21.15.102:0/639252199 conn(0x55efd5226e00 msgr2=0x55efd5317ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:14.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.925+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/639252199 shutdown_connections 2024-09-13T19:16:14.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.925+0000 7f6ff6d2a800 1 -- 172.21.15.102:0/639252199 wait complete. 2024-09-13T19:16:14.943 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T19:16:14.943 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T19:16:14.943 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T19:16:14.987 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:14.987 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:14.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.984+0000 7fca5eb2b800 1 Processor -- start 2024-09-13T19:16:14.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.984+0000 7fca5eb2b800 1 -- start start 2024-09-13T19:16:14.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.984+0000 7fca5eb2b800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5635ee75ddf0 0x5635ee7ed1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:14.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.984+0000 7fca5eb2b800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5635ee6a9b30 con 0x5635ee7ed720 2024-09-13T19:16:14.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.984+0000 7fca5eb2b800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5635ee68b360 con 0x5635ee75ddf0 2024-09-13T19:16:14.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.984+0000 7fca5a7c3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5635ee75ddf0 0x5635ee7ed1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:14.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.984+0000 7fca59fc2640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5635ee7ed720 0x5635ee7efb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:49786/0 (socket says 172.21.15.102:49786) 2024-09-13T19:16:14.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.984+0000 7fca59fc2640 1 -- 172.21.15.102:0/3051837610 learned_addr learned my addr 172.21.15.102:0/3051837610 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:16:14.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.984+0000 7fca5a7c3640 1 --2- 172.21.15.102:0/3051837610 >> v2:172.21.15.53:3300/0 conn(0x5635ee75ddf0 0x5635ee7ed1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53936/0 (socket says 172.21.15.102:53936) 2024-09-13T19:16:14.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.984+0000 7fca5a7c3640 1 -- 172.21.15.102:0/3051837610 >> v1:172.21.15.53:6789/0 conn(0x5635ee7ed720 legacy=0x5635ee7efb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.984+0000 7fca5a7c3640 1 -- 172.21.15.102:0/3051837610 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635ee6b1e00 con 0x5635ee75ddf0 2024-09-13T19:16:14.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.986+0000 7fca5a7c3640 1 --2- 172.21.15.102:0/3051837610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635ee75ddf0 0x5635ee7ed1e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fca54005fd0 tx=0x7fca54045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e251af913878723 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:14.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.986+0000 7fca597c1640 1 -- 172.21.15.102:0/3051837610 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca54058530 con 0x5635ee75ddf0 2024-09-13T19:16:14.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.986+0000 7fca597c1640 1 -- 172.21.15.102:0/3051837610 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca540586d0 con 0x5635ee75ddf0 2024-09-13T19:16:14.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.986+0000 7fca597c1640 1 -- 172.21.15.102:0/3051837610 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca540589d0 con 0x5635ee75ddf0 2024-09-13T19:16:14.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.987+0000 7fca5eb2b800 1 -- 172.21.15.102:0/3051837610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635ee75ddf0 msgr2=0x5635ee7ed1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:14.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.987+0000 7fca5eb2b800 1 --2- 172.21.15.102:0/3051837610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635ee75ddf0 0x5635ee7ed1e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fca54005fd0 tx=0x7fca54045c30 comp rx=0 tx=0).stop 2024-09-13T19:16:14.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.987+0000 7fca5eb2b800 1 -- 172.21.15.102:0/3051837610 shutdown_connections 2024-09-13T19:16:14.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.987+0000 7fca5eb2b800 1 --2- 172.21.15.102:0/3051837610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635ee75ddf0 0x5635ee7ed1e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:14.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.987+0000 7fca5eb2b800 1 -- 172.21.15.102:0/3051837610 >> 172.21.15.102:0/3051837610 conn(0x5635ee7e4df0 msgr2=0x5635ee7e7210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:14.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.987+0000 7fca5eb2b800 1 -- 172.21.15.102:0/3051837610 shutdown_connections 2024-09-13T19:16:14.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:14.987+0000 7fca5eb2b800 1 -- 172.21.15.102:0/3051837610 wait complete. 2024-09-13T19:16:15.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.001+0000 7fca5eb2b800 1 Processor -- start 2024-09-13T19:16:15.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.001+0000 7fca5eb2b800 1 -- start start 2024-09-13T19:16:15.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.001+0000 7fca5eb2b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635ee75ddf0 0x5635ee7eab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.001+0000 7fca5eb2b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5635ee736330 con 0x5635ee75ddf0 2024-09-13T19:16:15.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.001+0000 7fca5a7c3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635ee75ddf0 0x5635ee7eab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.001+0000 7fca5a7c3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635ee75ddf0 0x5635ee7eab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53944/0 (socket says 172.21.15.102:53944) 2024-09-13T19:16:15.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.001+0000 7fca5a7c3640 1 -- 172.21.15.102:0/3320283703 learned_addr learned my addr 172.21.15.102:0/3320283703 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:15.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.001+0000 7fca5a7c3640 1 -- 172.21.15.102:0/3320283703 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635ee683bc0 con 0x5635ee75ddf0 2024-09-13T19:16:15.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.002+0000 7fca5a7c3640 1 --2- 172.21.15.102:0/3320283703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635ee75ddf0 0x5635ee7eab10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fca5400a3f0 tx=0x7fca54051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4e769b676005d21 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.002+0000 7fc948608640 1 -- 172.21.15.102:0/3320283703 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca540589b0 con 0x5635ee75ddf0 2024-09-13T19:16:15.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.002+0000 7fc948608640 1 -- 172.21.15.102:0/3320283703 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca54068070 con 0x5635ee75ddf0 2024-09-13T19:16:15.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.002+0000 7fc948608640 1 -- 172.21.15.102:0/3320283703 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca54058c80 con 0x5635ee75ddf0 2024-09-13T19:16:15.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.003+0000 7fca5eb2b800 1 -- 172.21.15.102:0/3320283703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635ee75ddf0 msgr2=0x5635ee7eab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.003+0000 7fca5eb2b800 1 --2- 172.21.15.102:0/3320283703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635ee75ddf0 0x5635ee7eab10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fca5400a3f0 tx=0x7fca54051000 comp rx=0 tx=0).stop 2024-09-13T19:16:15.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.003+0000 7fca5eb2b800 1 -- 172.21.15.102:0/3320283703 shutdown_connections 2024-09-13T19:16:15.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.003+0000 7fca5eb2b800 1 --2- 172.21.15.102:0/3320283703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635ee75ddf0 0x5635ee7eab10 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.003+0000 7fca5eb2b800 1 -- 172.21.15.102:0/3320283703 >> 172.21.15.102:0/3320283703 conn(0x5635ee7e4df0 msgr2=0x5635ee8d5270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:15.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.003+0000 7fca5eb2b800 1 -- 172.21.15.102:0/3320283703 shutdown_connections 2024-09-13T19:16:15.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.003+0000 7fca5eb2b800 1 -- 172.21.15.102:0/3320283703 wait complete. 2024-09-13T19:16:15.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.003+0000 7fca5eb2b800 1 Processor -- start 2024-09-13T19:16:15.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.003+0000 7fca5eb2b800 1 -- start start 2024-09-13T19:16:15.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.003+0000 7fca5eb2b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635ee75ddf0 0x5635ee8e33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.003+0000 7fca5eb2b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5635ee7f15f0 con 0x5635ee75ddf0 2024-09-13T19:16:15.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.003+0000 7fca5a7c3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635ee75ddf0 0x5635ee8e33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.003+0000 7fca5a7c3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635ee75ddf0 0x5635ee8e33e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53954/0 (socket says 172.21.15.102:53954) 2024-09-13T19:16:15.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.003+0000 7fca5a7c3640 1 -- 172.21.15.102:0/2446822340 learned_addr learned my addr 172.21.15.102:0/2446822340 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:15.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.004+0000 7fca5a7c3640 1 -- 172.21.15.102:0/2446822340 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635ee697fe0 con 0x5635ee75ddf0 2024-09-13T19:16:15.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.004+0000 7fca5a7c3640 1 --2- 172.21.15.102:0/2446822340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635ee75ddf0 0x5635ee8e33e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fca54065040 tx=0x7fca54003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.004+0000 7fc946e05640 1 -- 172.21.15.102:0/2446822340 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca54063650 con 0x5635ee75ddf0 2024-09-13T19:16:15.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.004+0000 7fc946e05640 1 -- 172.21.15.102:0/2446822340 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca540637f0 con 0x5635ee75ddf0 2024-09-13T19:16:15.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.004+0000 7fc946e05640 1 -- 172.21.15.102:0/2446822340 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca54063af0 con 0x5635ee75ddf0 2024-09-13T19:16:15.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.004+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2446822340 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5635ee8e3920 con 0x5635ee75ddf0 2024-09-13T19:16:15.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.004+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2446822340 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635ee8e3e40 con 0x5635ee75ddf0 2024-09-13T19:16:15.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.005+0000 7fc946e05640 1 -- 172.21.15.102:0/2446822340 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fca54074020 con 0x5635ee75ddf0 2024-09-13T19:16:15.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.005+0000 7fc946e05640 1 --2- 172.21.15.102:0/2446822340 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc940036b40 0x7fc940039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.005+0000 7fc946e05640 1 -- 172.21.15.102:0/2446822340 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fca54090950 con 0x5635ee75ddf0 2024-09-13T19:16:15.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.005+0000 7fca59fc2640 1 --2- 172.21.15.102:0/2446822340 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc940036b40 0x7fc940039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.005+0000 7fca5eb2b800 1 --2- 172.21.15.102:0/2446822340 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5635ee7ed720 0x5635ee8ea450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.005+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2446822340 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635ee8ea990 con 0x5635ee7ed720 2024-09-13T19:16:15.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.005+0000 7fca5afc4640 1 --2- 172.21.15.102:0/2446822340 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5635ee7ed720 0x5635ee8ea450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.005+0000 7fca59fc2640 1 --2- 172.21.15.102:0/2446822340 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc940036b40 0x7fc940039000 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fca44000f60 tx=0x7fca440012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.006+0000 7fca5afc4640 1 --2- 172.21.15.102:0/2446822340 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5635ee7ed720 0x5635ee8ea450 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.006+0000 7fca5afc4640 1 -- 172.21.15.102:0/2446822340 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca4c0083e0 con 0x5635ee7ed720 2024-09-13T19:16:15.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.006+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2446822340 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635ee8e7a00 con 0x5635ee7ed720 2024-09-13T19:16:15.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.006+0000 7fca5afc4640 1 -- 172.21.15.102:0/2446822340 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fca4c0083e0 con 0x5635ee7ed720 2024-09-13T19:16:15.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.006+0000 7fca5eb2b800 1 --2- 172.21.15.102:0/2446822340 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5635ee8ecca0 0x5635ee8ef090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.006+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2446822340 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635ee8ef780 con 0x5635ee8ecca0 2024-09-13T19:16:15.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.006+0000 7fca5a7c3640 1 --2- 172.21.15.102:0/2446822340 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5635ee8ecca0 0x5635ee8ef090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.006+0000 7fca5a7c3640 1 --2- 172.21.15.102:0/2446822340 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5635ee8ecca0 0x5635ee8ef090 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.007+0000 7fca5a7c3640 1 -- 172.21.15.102:0/2446822340 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fca54063c90 con 0x5635ee8ecca0 2024-09-13T19:16:15.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.007+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2446822340 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635ee8ebb40 con 0x5635ee7ed720 2024-09-13T19:16:15.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.007+0000 7fca5afc4640 1 -- 172.21.15.102:0/2446822340 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fca4c0083e0 con 0x5635ee7ed720 2024-09-13T19:16:15.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.007+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2446822340 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635ee8ec000 con 0x5635ee8ecca0 2024-09-13T19:16:15.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.007+0000 7fca5a7c3640 1 -- 172.21.15.102:0/2446822340 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fca54063c90 con 0x5635ee8ecca0 2024-09-13T19:16:15.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.008+0000 7fca5eb2b800 1 Processor -- start 2024-09-13T19:16:15.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.008+0000 7fca5eb2b800 1 -- start start 2024-09-13T19:16:15.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.008+0000 7fca5eb2b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635ee8fe110 0x5635ee8fe530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.008+0000 7fca5eb2b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5635ee685580 con 0x5635ee8fe110 2024-09-13T19:16:15.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.008+0000 7fca5afc4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635ee8fe110 0x5635ee8fe530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.008+0000 7fca5afc4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635ee8fe110 0x5635ee8fe530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53960/0 (socket says 172.21.15.102:53960) 2024-09-13T19:16:15.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.008+0000 7fca5afc4640 1 -- 172.21.15.102:0/2653485141 learned_addr learned my addr 172.21.15.102:0/2653485141 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:15.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.008+0000 7fca5afc4640 1 -- 172.21.15.102:0/2653485141 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635ee8fea70 con 0x5635ee8fe110 2024-09-13T19:16:15.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.009+0000 7fca5afc4640 1 --2- 172.21.15.102:0/2653485141 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635ee8fe110 0x5635ee8fe530 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x5635ee8e47e0 tx=0x7fca4c00beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.009+0000 7fc93ffff640 1 -- 172.21.15.102:0/2653485141 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca4c01c020 con 0x5635ee8fe110 2024-09-13T19:16:15.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.009+0000 7fc93ffff640 1 -- 172.21.15.102:0/2653485141 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca4c007cf0 con 0x5635ee8fe110 2024-09-13T19:16:15.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.009+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2653485141 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5635ee8fed00 con 0x5635ee8fe110 2024-09-13T19:16:15.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.009+0000 7fc93ffff640 1 -- 172.21.15.102:0/2653485141 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca4c018440 con 0x5635ee8fe110 2024-09-13T19:16:15.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.009+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2653485141 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635ee9019e0 con 0x5635ee8fe110 2024-09-13T19:16:15.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.009+0000 7fc93ffff640 1 -- 172.21.15.102:0/2653485141 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fca4c01f020 con 0x5635ee8fe110 2024-09-13T19:16:15.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.010+0000 7fc93ffff640 1 --2- 172.21.15.102:0/2653485141 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc934036b90 0x7fc934039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.010+0000 7fc93ffff640 1 -- 172.21.15.102:0/2653485141 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fca4c04e2a0 con 0x5635ee8fe110 2024-09-13T19:16:15.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.010+0000 7fca5a7c3640 1 --2- 172.21.15.102:0/2653485141 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc934036b90 0x7fc934039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.010+0000 7fca5eb2b800 1 Processor -- start 2024-09-13T19:16:15.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.010+0000 7fca5eb2b800 1 -- start start 2024-09-13T19:16:15.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.010+0000 7fca5a7c3640 1 --2- 172.21.15.102:0/2653485141 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc934036b90 0x7fc934039050 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fca5408ee80 tx=0x7fca5406ca10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.010+0000 7fca5eb2b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635ee90ad10 0x5635ee90b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.010+0000 7fca5eb2b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5635ee7e90f0 con 0x5635ee90ad10 2024-09-13T19:16:15.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.010+0000 7fca5afc4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635ee90ad10 0x5635ee90b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.010+0000 7fca5afc4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635ee90ad10 0x5635ee90b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53976/0 (socket says 172.21.15.102:53976) 2024-09-13T19:16:15.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.010+0000 7fca5afc4640 1 -- 172.21.15.102:0/797588827 learned_addr learned my addr 172.21.15.102:0/797588827 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:15.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.011+0000 7fca5afc4640 1 -- 172.21.15.102:0/797588827 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635ee90b6e0 con 0x5635ee90ad10 2024-09-13T19:16:15.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.011+0000 7fca5afc4640 1 --2- 172.21.15.102:0/797588827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635ee90ad10 0x5635ee90b110 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fca4c04c5f0 tx=0x7fca4c04c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c27e25cfc5d37478 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.011+0000 7fc93dffb640 1 -- 172.21.15.102:0/797588827 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca4c045070 con 0x5635ee90ad10 2024-09-13T19:16:15.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.011+0000 7fc93dffb640 1 -- 172.21.15.102:0/797588827 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca4c04e070 con 0x5635ee90ad10 2024-09-13T19:16:15.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.011+0000 7fc93dffb640 1 -- 172.21.15.102:0/797588827 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca4c021530 con 0x5635ee90ad10 2024-09-13T19:16:15.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.011+0000 7fca5eb2b800 1 -- 172.21.15.102:0/797588827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635ee90ad10 msgr2=0x5635ee90b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.011+0000 7fca5eb2b800 1 --2- 172.21.15.102:0/797588827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635ee90ad10 0x5635ee90b110 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fca4c04c5f0 tx=0x7fca4c04c8a0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.011+0000 7fca5eb2b800 1 -- 172.21.15.102:0/797588827 shutdown_connections 2024-09-13T19:16:15.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.011+0000 7fca5eb2b800 1 --2- 172.21.15.102:0/797588827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635ee90ad10 0x5635ee90b110 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.011+0000 7fca5eb2b800 1 -- 172.21.15.102:0/797588827 >> 172.21.15.102:0/797588827 conn(0x5635ee907100 msgr2=0x5635ee905200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:15.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.011+0000 7fca5eb2b800 1 -- 172.21.15.102:0/797588827 shutdown_connections 2024-09-13T19:16:15.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.011+0000 7fca5eb2b800 1 -- 172.21.15.102:0/797588827 wait complete. 2024-09-13T19:16:15.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.012+0000 7fca5eb2b800 1 Processor -- start 2024-09-13T19:16:15.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.012+0000 7fca5eb2b800 1 -- start start 2024-09-13T19:16:15.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.012+0000 7fca5eb2b800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635ee90ad10 0x5635ee9122c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.012+0000 7fca5eb2b800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5635ee90bd20 con 0x5635ee90ad10 2024-09-13T19:16:15.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.012+0000 7fca5afc4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635ee90ad10 0x5635ee9122c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.012+0000 7fca5afc4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635ee90ad10 0x5635ee9122c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53980/0 (socket says 172.21.15.102:53980) 2024-09-13T19:16:15.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.012+0000 7fca5afc4640 1 -- 172.21.15.102:0/2347807319 learned_addr learned my addr 172.21.15.102:0/2347807319 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:15.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.012+0000 7fca5afc4640 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635ee912800 con 0x5635ee90ad10 2024-09-13T19:16:15.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.013+0000 7fca5afc4640 1 --2- 172.21.15.102:0/2347807319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635ee90ad10 0x5635ee9122c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fca4c04b510 tx=0x7fca4c04c580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.013+0000 7fc92bfff640 1 -- 172.21.15.102:0/2347807319 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca4c045030 con 0x5635ee90ad10 2024-09-13T19:16:15.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.013+0000 7fc92bfff640 1 -- 172.21.15.102:0/2347807319 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca4c029c70 con 0x5635ee90ad10 2024-09-13T19:16:15.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.013+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5635ee912a90 con 0x5635ee90ad10 2024-09-13T19:16:15.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.013+0000 7fc92bfff640 1 -- 172.21.15.102:0/2347807319 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca4c03f040 con 0x5635ee90ad10 2024-09-13T19:16:15.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.013+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635ee915740 con 0x5635ee90ad10 2024-09-13T19:16:15.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.014+0000 7fc92bfff640 1 -- 172.21.15.102:0/2347807319 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fca4c016040 con 0x5635ee90ad10 2024-09-13T19:16:15.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.014+0000 7fc92bfff640 1 --2- 172.21.15.102:0/2347807319 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc924036b40 0x7fc924039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.014+0000 7fc92bfff640 1 -- 172.21.15.102:0/2347807319 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fca4c046070 con 0x5635ee90ad10 2024-09-13T19:16:15.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.014+0000 7fca5a7c3640 1 --2- 172.21.15.102:0/2347807319 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc924036b40 0x7fc924039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.014+0000 7fca5eb2b800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.014+0000 7fca5eb2b800 1 --2- 172.21.15.102:0/2347807319 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5635ee91dc70 0x5635ee920130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.014+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635ee920880 con 0x5635ee91dc70 2024-09-13T19:16:15.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.014+0000 7fca59fc2640 1 --2- 172.21.15.102:0/2347807319 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5635ee91dc70 0x5635ee920130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.014+0000 7fca5a7c3640 1 --2- 172.21.15.102:0/2347807319 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc924036b40 0x7fc924039000 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x5635ee8eae10 tx=0x7fca54093000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.014+0000 7fca59fc2640 1 --2- 172.21.15.102:0/2347807319 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5635ee91dc70 0x5635ee920130 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.015+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca44009050 con 0x5635ee91dc70 2024-09-13T19:16:15.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.015+0000 7fca5eb2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.015+0000 7fca5eb2b800 20 realm 2024-09-13T19:16:15.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.015+0000 7fca5eb2b800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.015+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635ee91d0c0 con 0x5635ee91dc70 2024-09-13T19:16:15.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.015+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca44009050 con 0x5635ee91dc70 2024-09-13T19:16:15.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.015+0000 7fca5eb2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.015+0000 7fca5eb2b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:15.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.015+0000 7fca5eb2b800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.015+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635ee921360 con 0x5635ee91dc70 2024-09-13T19:16:15.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.015+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca44009050 con 0x5635ee91dc70 2024-09-13T19:16:15.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.015+0000 7fca5eb2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.015+0000 7fca5eb2b800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.015+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635ee921c30 con 0x5635ee91dc70 2024-09-13T19:16:15.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.015+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fca44009050 con 0x5635ee91dc70 2024-09-13T19:16:15.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.015+0000 7fca5eb2b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:15.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.015+0000 7fca5eb2b800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.015+0000 7fca5eb2b800 1 --2- 172.21.15.102:0/2347807319 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5635ee9224e0 0x5635ee9248d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.015+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635ee925010 con 0x5635ee9224e0 2024-09-13T19:16:15.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.015+0000 7fca5afc4640 1 --2- 172.21.15.102:0/2347807319 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5635ee9224e0 0x5635ee9248d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.016+0000 7fca5afc4640 1 --2- 172.21.15.102:0/2347807319 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5635ee9224e0 0x5635ee9248d0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.016+0000 7fca5afc4640 1 -- 172.21.15.102:0/2347807319 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fca4c028070 con 0x5635ee9224e0 2024-09-13T19:16:15.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.016+0000 7fca5eb2b800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:15.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.016+0000 7fca5eb2b800 20 searching for the correct realm 2024-09-13T19:16:15.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.016+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ee9269f0 con 0x5635ee9224e0 2024-09-13T19:16:15.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.016+0000 7fca5afc4640 1 -- 172.21.15.102:0/2347807319 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca4c028070 con 0x5635ee9224e0 2024-09-13T19:16:15.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.016+0000 7fca5afc4640 1 --2- 172.21.15.102:0/2347807319 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fca4c021020 0x7fca4c035860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.016+0000 7fca5afc4640 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ee9269f0 con 0x7fca4c021020 2024-09-13T19:16:15.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.016+0000 7fca5a7c3640 1 --2- 172.21.15.102:0/2347807319 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fca4c021020 0x7fca4c035860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.017+0000 7fca5a7c3640 1 --2- 172.21.15.102:0/2347807319 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fca4c021020 0x7fca4c035860 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.017+0000 7fca5a7c3640 1 -- 172.21.15.102:0/2347807319 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca54089050 con 0x7fca4c021020 2024-09-13T19:16:15.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.017+0000 7fca5a7c3640 1 --2- 172.21.15.102:0/2347807319 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fca5408e920 0x7fca54090050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.017+0000 7fca5a7c3640 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ee9269f0 con 0x7fca5408e920 2024-09-13T19:16:15.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.017+0000 7fca59fc2640 1 --2- 172.21.15.102:0/2347807319 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fca5408e920 0x7fca54090050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.018+0000 7fca59fc2640 1 --2- 172.21.15.102:0/2347807319 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fca5408e920 0x7fca54090050 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.018+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca44009050 con 0x7fca5408e920 2024-09-13T19:16:15.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.018+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ee9269f0 con 0x5635ee91dc70 2024-09-13T19:16:15.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.018+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca44009050 con 0x5635ee91dc70 2024-09-13T19:16:15.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.018+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ee9269f0 con 0x5635ee91dc70 2024-09-13T19:16:15.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.018+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca44029040 con 0x5635ee91dc70 2024-09-13T19:16:15.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.018+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ee9269f0 con 0x7fca5408e920 2024-09-13T19:16:15.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.019+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca44029040 con 0x7fca5408e920 2024-09-13T19:16:15.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.019+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ee9269f0 con 0x7fca5408e920 2024-09-13T19:16:15.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.019+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca44029040 con 0x7fca5408e920 2024-09-13T19:16:15.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.019+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ee9269f0 con 0x7fca4c021020 2024-09-13T19:16:15.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.019+0000 7fca5a7c3640 1 -- 172.21.15.102:0/2347807319 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca54089050 con 0x7fca4c021020 2024-09-13T19:16:15.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.019+0000 7fca5a7c3640 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ee9269f0 con 0x5635ee9224e0 2024-09-13T19:16:15.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.019+0000 7fca5afc4640 1 -- 172.21.15.102:0/2347807319 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca4c028070 con 0x5635ee9224e0 2024-09-13T19:16:15.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.019+0000 7fca5afc4640 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ee9269f0 con 0x5635ee91dc70 2024-09-13T19:16:15.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.019+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca44029040 con 0x5635ee91dc70 2024-09-13T19:16:15.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.020+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ee9269f0 con 0x7fca5408e920 2024-09-13T19:16:15.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.020+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca44029040 con 0x7fca5408e920 2024-09-13T19:16:15.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.020+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ee9269f0 con 0x5635ee91dc70 2024-09-13T19:16:15.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.020+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca44029040 con 0x5635ee91dc70 2024-09-13T19:16:15.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.020+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ee9269f0 con 0x7fca4c021020 2024-09-13T19:16:15.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.020+0000 7fca5a7c3640 1 -- 172.21.15.102:0/2347807319 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fca54089050 con 0x7fca4c021020 2024-09-13T19:16:15.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.020+0000 7fca5a7c3640 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ee9269f0 con 0x5635ee9224e0 2024-09-13T19:16:15.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.020+0000 7fca5afc4640 1 -- 172.21.15.102:0/2347807319 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca4c028070 con 0x5635ee9224e0 2024-09-13T19:16:15.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.020+0000 7fca5afc4640 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ee9269f0 con 0x5635ee9224e0 2024-09-13T19:16:15.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.021+0000 7fca5afc4640 1 -- 172.21.15.102:0/2347807319 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fca4c028070 con 0x5635ee9224e0 2024-09-13T19:16:15.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.021+0000 7fca5afc4640 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ee9269f0 con 0x7fca5408e920 2024-09-13T19:16:15.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.021+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca44029040 con 0x7fca5408e920 2024-09-13T19:16:15.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.021+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ee9269f0 con 0x5635ee9224e0 2024-09-13T19:16:15.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.021+0000 7fca5afc4640 1 -- 172.21.15.102:0/2347807319 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fca4c028070 con 0x5635ee9224e0 2024-09-13T19:16:15.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.021+0000 7fca5afc4640 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ee9269f0 con 0x5635ee9224e0 2024-09-13T19:16:15.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.021+0000 7fca5afc4640 1 -- 172.21.15.102:0/2347807319 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca4c028070 con 0x5635ee9224e0 2024-09-13T19:16:15.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.021+0000 7fca5afc4640 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ee9269f0 con 0x5635ee91dc70 2024-09-13T19:16:15.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.022+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca44029040 con 0x5635ee91dc70 2024-09-13T19:16:15.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.022+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ee9269f0 con 0x5635ee91dc70 2024-09-13T19:16:15.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.022+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fca44029040 con 0x5635ee91dc70 2024-09-13T19:16:15.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.022+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ee9269f0 con 0x7fca5408e920 2024-09-13T19:16:15.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.022+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca44029040 con 0x7fca5408e920 2024-09-13T19:16:15.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.022+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ee9269f0 con 0x5635ee9224e0 2024-09-13T19:16:15.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.022+0000 7fca5afc4640 1 -- 172.21.15.102:0/2347807319 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca4c069040 con 0x5635ee9224e0 2024-09-13T19:16:15.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.022+0000 7fca5afc4640 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ee9269f0 con 0x7fca4c021020 2024-09-13T19:16:15.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.023+0000 7fca5a7c3640 1 -- 172.21.15.102:0/2347807319 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca54089050 con 0x7fca4c021020 2024-09-13T19:16:15.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.023+0000 7fca5a7c3640 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ee9269f0 con 0x5635ee91dc70 2024-09-13T19:16:15.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.023+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca44029040 con 0x5635ee91dc70 2024-09-13T19:16:15.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.023+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ee9269f0 con 0x7fca5408e920 2024-09-13T19:16:15.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.023+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca44029040 con 0x7fca5408e920 2024-09-13T19:16:15.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.023+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ee9269f0 con 0x5635ee9224e0 2024-09-13T19:16:15.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.023+0000 7fca5afc4640 1 -- 172.21.15.102:0/2347807319 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca4c069040 con 0x5635ee9224e0 2024-09-13T19:16:15.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.023+0000 7fca5afc4640 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ee9269f0 con 0x7fca5408e920 2024-09-13T19:16:15.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.024+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca44029040 con 0x7fca5408e920 2024-09-13T19:16:15.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.024+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ee9269f0 con 0x7fca4c021020 2024-09-13T19:16:15.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.024+0000 7fca5a7c3640 1 -- 172.21.15.102:0/2347807319 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca54089050 con 0x7fca4c021020 2024-09-13T19:16:15.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.024+0000 7fca5a7c3640 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ee9269f0 con 0x5635ee9224e0 2024-09-13T19:16:15.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.024+0000 7fca5afc4640 1 -- 172.21.15.102:0/2347807319 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca4c069040 con 0x5635ee9224e0 2024-09-13T19:16:15.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.024+0000 7fca5afc4640 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ee9269f0 con 0x7fca5408e920 2024-09-13T19:16:15.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.024+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca44029040 con 0x7fca5408e920 2024-09-13T19:16:15.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.024+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ee9269f0 con 0x5635ee91dc70 2024-09-13T19:16:15.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.025+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fca44029040 con 0x5635ee91dc70 2024-09-13T19:16:15.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.025+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635ee9269f0 con 0x7fca4c021020 2024-09-13T19:16:15.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.025+0000 7fca5a7c3640 1 -- 172.21.15.102:0/2347807319 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca54089050 con 0x7fca4c021020 2024-09-13T19:16:15.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.025+0000 7fca5eb2b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:15.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.025+0000 7fca5eb2b800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:15.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.025+0000 7fca5eb2b800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:15.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.025+0000 7fca5eb2b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:15.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.025+0000 7fca5eb2b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:15.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.025+0000 7fca5eb2b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:15.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.025+0000 7fca5eb2b800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.025+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635ee925ac0 con 0x5635ee91dc70 2024-09-13T19:16:15.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.025+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca44029040 con 0x5635ee91dc70 2024-09-13T19:16:15.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.025+0000 7fca5eb2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.025+0000 7fca5eb2b800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.025+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635ee925700 con 0x5635ee91dc70 2024-09-13T19:16:15.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.025+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fca44029040 con 0x5635ee91dc70 2024-09-13T19:16:15.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.025+0000 7fca5eb2b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:15.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.025+0000 7fca5eb2b800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.025+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635ee926420 con 0x5635ee9224e0 2024-09-13T19:16:15.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.026+0000 7fca5afc4640 1 -- 172.21.15.102:0/2347807319 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fca4c069040 con 0x5635ee9224e0 2024-09-13T19:16:15.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.026+0000 7fca5eb2b800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:15.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.026+0000 7fca5eb2b800 20 zone default found 2024-09-13T19:16:15.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.026+0000 7fca5eb2b800 4 Realm: () 2024-09-13T19:16:15.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.026+0000 7fca5eb2b800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:15.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.026+0000 7fca5eb2b800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:15.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.026+0000 7fca5eb2b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:15.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.026+0000 7fca5eb2b800 20 zonegroup default 2024-09-13T19:16:15.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.026+0000 7fca5eb2b800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.026+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635ee927370 con 0x7fca5408e920 2024-09-13T19:16:15.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.026+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fca44029040 con 0x7fca5408e920 2024-09-13T19:16:15.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.026+0000 7fca5eb2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.026+0000 7fca5eb2b800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.026+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635ee929150 con 0x5635ee9224e0 2024-09-13T19:16:15.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.026+0000 7fca5afc4640 1 -- 172.21.15.102:0/2347807319 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fca4c069040 con 0x5635ee9224e0 2024-09-13T19:16:15.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.026+0000 7fca5eb2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.026+0000 7fca5eb2b800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.026+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635ee9295c0 con 0x5635ee9224e0 2024-09-13T19:16:15.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.026+0000 7fca5afc4640 1 -- 172.21.15.102:0/2347807319 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fca4c069040 con 0x5635ee9224e0 2024-09-13T19:16:15.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.026+0000 7fca5eb2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.026+0000 7fca5eb2b800 20 started sync module instance, tier type = 2024-09-13T19:16:15.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.026+0000 7fca5eb2b800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:15.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.026+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635ee928590 con 0x7fca4c021020 2024-09-13T19:16:15.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.027+0000 7fca5a7c3640 1 -- 172.21.15.102:0/2347807319 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(44 notify.0 [create] v34'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca54089050 con 0x7fca4c021020 2024-09-13T19:16:15.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.027+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94789635834080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635ee929a00 con 0x7fca4c021020 2024-09-13T19:16:15.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.028+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635ee92a250 con 0x5635ee91dc70 2024-09-13T19:16:15.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.028+0000 7fca5a7c3640 1 -- 172.21.15.102:0/2347807319 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94789635834080] v34'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca54089050 con 0x7fca4c021020 2024-09-13T19:16:15.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.029+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v34'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca44029040 con 0x5635ee91dc70 2024-09-13T19:16:15.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.029+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94789635841440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635ee92a670 con 0x5635ee91dc70 2024-09-13T19:16:15.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.029+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635ee92af40 con 0x5635ee9224e0 2024-09-13T19:16:15.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.030+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94789635841440] v34'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca44029040 con 0x5635ee91dc70 2024-09-13T19:16:15.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.030+0000 7fca5afc4640 1 -- 172.21.15.102:0/2347807319 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v34'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca4c069040 con 0x5635ee9224e0 2024-09-13T19:16:15.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.030+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94789635842496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635ee92aa90 con 0x5635ee9224e0 2024-09-13T19:16:15.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.030+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635ee92ba20 con 0x7fca4c021020 2024-09-13T19:16:15.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.031+0000 7fca5a7c3640 1 -- 172.21.15.102:0/2347807319 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(50 notify.3 [create] v34'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca54089050 con 0x7fca4c021020 2024-09-13T19:16:15.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.031+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94789635847408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635ee92bf30 con 0x7fca4c021020 2024-09-13T19:16:15.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.031+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635ee92ca20 con 0x5635ee91dc70 2024-09-13T19:16:15.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.031+0000 7fca5afc4640 1 -- 172.21.15.102:0/2347807319 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94789635842496] v34'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca4c069040 con 0x5635ee9224e0 2024-09-13T19:16:15.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.032+0000 7fca5a7c3640 1 -- 172.21.15.102:0/2347807319 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94789635847408] v34'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca54089050 con 0x7fca4c021020 2024-09-13T19:16:15.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.032+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v34'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca44029040 con 0x5635ee91dc70 2024-09-13T19:16:15.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.032+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94789635848672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635ee92c9e0 con 0x5635ee91dc70 2024-09-13T19:16:15.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.032+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635ee92d2f0 con 0x7fca5408e920 2024-09-13T19:16:15.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.033+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(54 notify.5 [create] v34'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca44029040 con 0x7fca5408e920 2024-09-13T19:16:15.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.033+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94789635853808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635ee92d6c0 con 0x7fca5408e920 2024-09-13T19:16:15.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.033+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635ee92df50 con 0x7fca5408e920 2024-09-13T19:16:15.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.033+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94789635848672] v34'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca44029040 con 0x5635ee91dc70 2024-09-13T19:16:15.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.034+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94789635853808] v34'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca44029040 con 0x7fca5408e920 2024-09-13T19:16:15.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.034+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(56 notify.6 [create] v34'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca44029040 con 0x7fca5408e920 2024-09-13T19:16:15.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.034+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94789635851504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635ee92d6c0 con 0x7fca5408e920 2024-09-13T19:16:15.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.034+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635ee92e5e0 con 0x7fca5408e920 2024-09-13T19:16:15.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.035+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94789635851504] v34'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca44029040 con 0x7fca5408e920 2024-09-13T19:16:15.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.035+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(58 notify.7 [create] v34'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca44029040 con 0x7fca5408e920 2024-09-13T19:16:15.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.035+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94789635854864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635ee92e5e0 con 0x7fca5408e920 2024-09-13T19:16:15.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.035+0000 7fca5eb2b800 20 add_watcher() i=0 2024-09-13T19:16:15.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.035+0000 7fca5eb2b800 20 add_watcher() i=1 2024-09-13T19:16:15.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.035+0000 7fca5eb2b800 20 add_watcher() i=2 2024-09-13T19:16:15.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.035+0000 7fca5eb2b800 20 add_watcher() i=3 2024-09-13T19:16:15.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.035+0000 7fca5eb2b800 20 add_watcher() i=4 2024-09-13T19:16:15.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.035+0000 7fca5eb2b800 20 add_watcher() i=5 2024-09-13T19:16:15.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.035+0000 7fca5eb2b800 20 add_watcher() i=6 2024-09-13T19:16:15.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.036+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94789635854864] v34'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca44029040 con 0x7fca5408e920 2024-09-13T19:16:15.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.036+0000 7fca5eb2b800 20 add_watcher() i=7 2024-09-13T19:16:15.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.036+0000 7fca5eb2b800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:15.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.036+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635ee931750 con 0x5635ee91dc70 2024-09-13T19:16:15.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.036+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fca44029040 con 0x5635ee91dc70 2024-09-13T19:16:15.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.037+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94789635858736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635ee92ea00 con 0x5635ee91dc70 2024-09-13T19:16:15.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.037+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94789635858736] v34'54 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fca44029040 con 0x5635ee91dc70 2024-09-13T19:16:15.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.038+0000 7fc910fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:15.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.038+0000 7fca5eb2b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:15.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.038+0000 7fca5eb2b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:15.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.038+0000 7fca5eb2b800 5 note: GC not initialized 2024-09-13T19:16:15.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.038+0000 7fc88b7fe640 20 reqs_thread_entry: start 2024-09-13T19:16:15.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.038+0000 7fca5eb2b800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:15.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.038+0000 7fca5eb2b800 20 Filter name: none 2024-09-13T19:16:15.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.038+0000 7fc8897fa640 20 reqs_thread_entry: start 2024-09-13T19:16:15.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.038+0000 7fca5eb2b800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.038+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635ee964700 con 0x5635ee91dc70 2024-09-13T19:16:15.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.038+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fca44029040 con 0x5635ee91dc70 2024-09-13T19:16:15.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.038+0000 7fca5eb2b800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:16:15.054 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:16:14.779675Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:16:14.779665Z","tags":[],"group_ids":[]} 2024-09-13T19:16:15.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.039+0000 7fc910fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:15.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.039+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94789635858736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635ee930b70 con 0x5635ee91dc70 2024-09-13T19:16:15.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.040+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94789635858736] v34'55 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fca44029040 con 0x5635ee91dc70 2024-09-13T19:16:15.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.040+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94789635834080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635ee92e130 con 0x7fca4c021020 2024-09-13T19:16:15.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.041+0000 7fca5a7c3640 1 -- 172.21.15.102:0/2347807319 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94789635834080] v34'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca54089050 con 0x7fca4c021020 2024-09-13T19:16:15.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.041+0000 7fca5eb2b800 20 remove_watcher() i=0 2024-09-13T19:16:15.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.041+0000 7fca5eb2b800 2 removed watcher, disabling cache 2024-09-13T19:16:15.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.041+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94789635841440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635ee92e130 con 0x5635ee91dc70 2024-09-13T19:16:15.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.042+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94789635841440] v34'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca44029040 con 0x5635ee91dc70 2024-09-13T19:16:15.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.042+0000 7fca5eb2b800 20 remove_watcher() i=1 2024-09-13T19:16:15.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.042+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94789635842496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635ee929da0 con 0x5635ee9224e0 2024-09-13T19:16:15.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.043+0000 7fca5afc4640 1 -- 172.21.15.102:0/2347807319 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94789635842496] v34'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca4c069040 con 0x5635ee9224e0 2024-09-13T19:16:15.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.043+0000 7fca5eb2b800 20 remove_watcher() i=2 2024-09-13T19:16:15.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.043+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94789635847408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635ee92e130 con 0x7fca4c021020 2024-09-13T19:16:15.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.044+0000 7fca5a7c3640 1 -- 172.21.15.102:0/2347807319 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94789635847408] v34'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca54089050 con 0x7fca4c021020 2024-09-13T19:16:15.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.044+0000 7fca5eb2b800 20 remove_watcher() i=3 2024-09-13T19:16:15.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.044+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94789635848672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635ee92e130 con 0x5635ee91dc70 2024-09-13T19:16:15.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.045+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94789635848672] v34'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca44029040 con 0x5635ee91dc70 2024-09-13T19:16:15.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.045+0000 7fca5eb2b800 20 remove_watcher() i=4 2024-09-13T19:16:15.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.045+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94789635853808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635ee92b9e0 con 0x7fca5408e920 2024-09-13T19:16:15.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.046+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94789635853808] v34'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca44029040 con 0x7fca5408e920 2024-09-13T19:16:15.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.046+0000 7fca5eb2b800 20 remove_watcher() i=5 2024-09-13T19:16:15.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.046+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94789635851504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635ee92e130 con 0x7fca5408e920 2024-09-13T19:16:15.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.047+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94789635851504] v34'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca44029040 con 0x7fca5408e920 2024-09-13T19:16:15.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.047+0000 7fca5eb2b800 20 remove_watcher() i=6 2024-09-13T19:16:15.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.047+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2347807319 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94789635854864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635ee92c4f0 con 0x7fca5408e920 2024-09-13T19:16:15.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.048+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94789635854864] v34'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca44029040 con 0x7fca5408e920 2024-09-13T19:16:15.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.048+0000 7fca5eb2b800 20 remove_watcher() i=7 2024-09-13T19:16:15.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.049+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2347807319 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fca5408e920 msgr2=0x7fca54090050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.049+0000 7fca5eb2b800 1 --2- 172.21.15.102:0/2347807319 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fca5408e920 0x7fca54090050 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.049+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2347807319 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5635ee91dc70 msgr2=0x5635ee920130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.049+0000 7fca5eb2b800 1 --2- 172.21.15.102:0/2347807319 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5635ee91dc70 0x5635ee920130 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.049+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2347807319 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fca4c021020 msgr2=0x7fca4c035860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.049+0000 7fca5eb2b800 1 --2- 172.21.15.102:0/2347807319 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fca4c021020 0x7fca4c035860 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.049+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2347807319 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5635ee9224e0 msgr2=0x5635ee9248d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.049+0000 7fca5eb2b800 1 --2- 172.21.15.102:0/2347807319 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5635ee9224e0 0x5635ee9248d0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.049+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2347807319 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc924036b40 msgr2=0x7fc924039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.049+0000 7fca5eb2b800 1 --2- 172.21.15.102:0/2347807319 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc924036b40 0x7fc924039000 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x5635ee8eae10 tx=0x7fca54093000 comp rx=0 tx=0).stop 2024-09-13T19:16:15.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.049+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2347807319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635ee90ad10 msgr2=0x5635ee9122c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.049+0000 7fca5eb2b800 1 --2- 172.21.15.102:0/2347807319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635ee90ad10 0x5635ee9122c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fca4c04b510 tx=0x7fca4c04c580 comp rx=0 tx=0).stop 2024-09-13T19:16:15.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.049+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 reap_dead start 2024-09-13T19:16:15.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.049+0000 7fca59fc2640 1 -- 172.21.15.102:0/2347807319 reap_dead start 2024-09-13T19:16:15.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.049+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2347807319 shutdown_connections 2024-09-13T19:16:15.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.049+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2347807319 >> 172.21.15.102:0/2347807319 conn(0x5635ee907100 msgr2=0x5635ee9051d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:15.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.049+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2347807319 shutdown_connections 2024-09-13T19:16:15.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.049+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2347807319 wait complete. 2024-09-13T19:16:15.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.049+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2653485141 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc934036b90 msgr2=0x7fc934039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.049+0000 7fca5eb2b800 1 --2- 172.21.15.102:0/2653485141 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc934036b90 0x7fc934039050 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fca5408ee80 tx=0x7fca5406ca10 comp rx=0 tx=0).stop 2024-09-13T19:16:15.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.049+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2653485141 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635ee8fe110 msgr2=0x5635ee8fe530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.049+0000 7fca5eb2b800 1 --2- 172.21.15.102:0/2653485141 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635ee8fe110 0x5635ee8fe530 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x5635ee8e47e0 tx=0x7fca4c00beb0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.049+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2653485141 shutdown_connections 2024-09-13T19:16:15.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.049+0000 7fca5eb2b800 1 --2- 172.21.15.102:0/2653485141 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc934036b90 0x7fc934039050 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.049+0000 7fca5eb2b800 1 --2- 172.21.15.102:0/2653485141 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635ee8fe110 0x5635ee8fe530 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.049+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2653485141 >> 172.21.15.102:0/2653485141 conn(0x5635ee8f30a0 msgr2=0x5635ee8f5c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:15.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.049+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2653485141 shutdown_connections 2024-09-13T19:16:15.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.049+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2653485141 wait complete. 2024-09-13T19:16:15.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.049+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2446822340 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5635ee7ed720 msgr2=0x5635ee8ea450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.050+0000 7fca5eb2b800 1 --2- 172.21.15.102:0/2446822340 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5635ee7ed720 0x5635ee8ea450 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.050+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2446822340 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5635ee8ecca0 msgr2=0x5635ee8ef090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.050+0000 7fca5eb2b800 1 --2- 172.21.15.102:0/2446822340 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5635ee8ecca0 0x5635ee8ef090 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.050+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2446822340 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc940036b40 msgr2=0x7fc940039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.050+0000 7fca5eb2b800 1 --2- 172.21.15.102:0/2446822340 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc940036b40 0x7fc940039000 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fca44000f60 tx=0x7fca440012b0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.050+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2446822340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635ee75ddf0 msgr2=0x5635ee8e33e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.050+0000 7fca5eb2b800 1 --2- 172.21.15.102:0/2446822340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635ee75ddf0 0x5635ee8e33e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fca54065040 tx=0x7fca54003330 comp rx=0 tx=0).stop 2024-09-13T19:16:15.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.050+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2446822340 shutdown_connections 2024-09-13T19:16:15.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.050+0000 7fca5eb2b800 1 --2- 172.21.15.102:0/2446822340 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5635ee8ecca0 0x5635ee8ef090 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.050+0000 7fca5eb2b800 1 --2- 172.21.15.102:0/2446822340 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5635ee7ed720 0x5635ee8ea450 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.050+0000 7fca5eb2b800 1 --2- 172.21.15.102:0/2446822340 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc940036b40 0x7fc940039000 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.050+0000 7fca5eb2b800 1 --2- 172.21.15.102:0/2446822340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5635ee75ddf0 0x5635ee8e33e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.050+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2446822340 >> 172.21.15.102:0/2446822340 conn(0x5635ee7e4df0 msgr2=0x5635ee8d4e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:15.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.050+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2446822340 shutdown_connections 2024-09-13T19:16:15.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.050+0000 7fca5eb2b800 1 -- 172.21.15.102:0/2446822340 wait complete. 2024-09-13T19:16:15.065 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:16:14.779675Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:16:14.779665Z', 'tags': [], 'group_ids': []} 2024-09-13T19:16:15.065 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-13T19:16:15.065 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-13T19:16:15.065 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-13T19:16:15.109 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:15.109 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:15.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.106+0000 7fca1ad3d800 1 Processor -- start 2024-09-13T19:16:15.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.106+0000 7fca1ad3d800 1 -- start start 2024-09-13T19:16:15.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.106+0000 7fca1ad3d800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55eb9afecd90 0x55eb9afef180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.106+0000 7fca1ad3d800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55eb9aea5b30 con 0x55eb9af5a610 2024-09-13T19:16:15.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.106+0000 7fca1ad3d800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55eb9ae87360 con 0x55eb9afecd90 2024-09-13T19:16:15.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.106+0000 7fca1628f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55eb9afecd90 0x55eb9afef180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.106+0000 7fca16a90640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55eb9af5a610 0x55eb9afeb670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:49794/0 (socket says 172.21.15.102:49794) 2024-09-13T19:16:15.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.106+0000 7fca16a90640 1 -- 172.21.15.102:0/171808095 learned_addr learned my addr 172.21.15.102:0/171808095 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:16:15.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.107+0000 7fca1628f640 1 -- 172.21.15.102:0/171808095 >> v1:172.21.15.53:6789/0 conn(0x55eb9af5a610 legacy=0x55eb9afeb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.107+0000 7fca1628f640 1 -- 172.21.15.102:0/171808095 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb9aeade00 con 0x55eb9afecd90 2024-09-13T19:16:15.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.108+0000 7fca1628f640 1 --2- 172.21.15.102:0/171808095 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb9afecd90 0x55eb9afef180 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fca0c00a470 tx=0x7fca0c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c038cabca03c0a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.109+0000 7fca15a8e640 1 -- 172.21.15.102:0/171808095 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca0c053570 con 0x55eb9afecd90 2024-09-13T19:16:15.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.109+0000 7fca15a8e640 1 -- 172.21.15.102:0/171808095 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca0c058070 con 0x55eb9afecd90 2024-09-13T19:16:15.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.109+0000 7fca15a8e640 1 -- 172.21.15.102:0/171808095 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca0c053880 con 0x55eb9afecd90 2024-09-13T19:16:15.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.109+0000 7fca1ad3d800 1 -- 172.21.15.102:0/171808095 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb9afecd90 msgr2=0x55eb9afef180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.109+0000 7fca1ad3d800 1 --2- 172.21.15.102:0/171808095 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb9afecd90 0x55eb9afef180 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fca0c00a470 tx=0x7fca0c045a20 comp rx=0 tx=0).stop 2024-09-13T19:16:15.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.109+0000 7fca1ad3d800 1 -- 172.21.15.102:0/171808095 shutdown_connections 2024-09-13T19:16:15.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.109+0000 7fca1ad3d800 1 --2- 172.21.15.102:0/171808095 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb9afecd90 0x55eb9afef180 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.109+0000 7fca1ad3d800 1 -- 172.21.15.102:0/171808095 >> 172.21.15.102:0/171808095 conn(0x55eb9afe0de0 msgr2=0x55eb9afe3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:15.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.109+0000 7fca1ad3d800 1 -- 172.21.15.102:0/171808095 shutdown_connections 2024-09-13T19:16:15.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.109+0000 7fca1ad3d800 1 -- 172.21.15.102:0/171808095 wait complete. 2024-09-13T19:16:15.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.123+0000 7fca1ad3d800 1 Processor -- start 2024-09-13T19:16:15.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.123+0000 7fca1ad3d800 1 -- start start 2024-09-13T19:16:15.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.123+0000 7fca1ad3d800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb9af5a610 0x55eb9b0d7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.123+0000 7fca1ad3d800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55eb9af32330 con 0x55eb9af5a610 2024-09-13T19:16:15.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.123+0000 7fca16a90640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb9af5a610 0x55eb9b0d7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.123+0000 7fca16a90640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb9af5a610 0x55eb9b0d7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53986/0 (socket says 172.21.15.102:53986) 2024-09-13T19:16:15.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.123+0000 7fca16a90640 1 -- 172.21.15.102:0/3150313919 learned_addr learned my addr 172.21.15.102:0/3150313919 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:15.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.124+0000 7fca16a90640 1 -- 172.21.15.102:0/3150313919 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb9ae7fbc0 con 0x55eb9af5a610 2024-09-13T19:16:15.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.124+0000 7fca16a90640 1 --2- 172.21.15.102:0/3150313919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb9af5a610 0x55eb9b0d7a90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fca10001610 tx=0x7fca10001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4117561641cd6db9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.124+0000 7fc904e09640 1 -- 172.21.15.102:0/3150313919 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca10004520 con 0x55eb9af5a610 2024-09-13T19:16:15.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.124+0000 7fc904e09640 1 -- 172.21.15.102:0/3150313919 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca100046c0 con 0x55eb9af5a610 2024-09-13T19:16:15.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.124+0000 7fc904e09640 1 -- 172.21.15.102:0/3150313919 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca10004a20 con 0x55eb9af5a610 2024-09-13T19:16:15.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.125+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3150313919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb9af5a610 msgr2=0x55eb9b0d7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.125+0000 7fca1ad3d800 1 --2- 172.21.15.102:0/3150313919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb9af5a610 0x55eb9b0d7a90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fca10001610 tx=0x7fca10001ad0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.125+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3150313919 shutdown_connections 2024-09-13T19:16:15.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.125+0000 7fca1ad3d800 1 --2- 172.21.15.102:0/3150313919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb9af5a610 0x55eb9b0d7a90 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.125+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3150313919 >> 172.21.15.102:0/3150313919 conn(0x55eb9afe0de0 msgr2=0x55eb9b0d3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:15.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.125+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3150313919 shutdown_connections 2024-09-13T19:16:15.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.125+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3150313919 wait complete. 2024-09-13T19:16:15.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.125+0000 7fca1ad3d800 1 Processor -- start 2024-09-13T19:16:15.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.125+0000 7fca1ad3d800 1 -- start start 2024-09-13T19:16:15.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.125+0000 7fca1ad3d800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb9af5a610 0x55eb9b0df4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.125+0000 7fca1ad3d800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55eb9afef990 con 0x55eb9af5a610 2024-09-13T19:16:15.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.125+0000 7fca16a90640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb9af5a610 0x55eb9b0df4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.125+0000 7fca16a90640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb9af5a610 0x55eb9b0df4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:53996/0 (socket says 172.21.15.102:53996) 2024-09-13T19:16:15.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.125+0000 7fca16a90640 1 -- 172.21.15.102:0/532277177 learned_addr learned my addr 172.21.15.102:0/532277177 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:15.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.126+0000 7fca16a90640 1 -- 172.21.15.102:0/532277177 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb9ae93fe0 con 0x55eb9af5a610 2024-09-13T19:16:15.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.126+0000 7fca16a90640 1 --2- 172.21.15.102:0/532277177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb9af5a610 0x55eb9b0df4c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fca10001b10 tx=0x7fca10000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.126+0000 7fc903606640 1 -- 172.21.15.102:0/532277177 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca10022030 con 0x55eb9af5a610 2024-09-13T19:16:15.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.126+0000 7fc903606640 1 -- 172.21.15.102:0/532277177 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca10019040 con 0x55eb9af5a610 2024-09-13T19:16:15.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.126+0000 7fca1ad3d800 1 -- 172.21.15.102:0/532277177 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eb9b0dfa00 con 0x55eb9af5a610 2024-09-13T19:16:15.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.126+0000 7fc903606640 1 -- 172.21.15.102:0/532277177 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca100042c0 con 0x55eb9af5a610 2024-09-13T19:16:15.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.126+0000 7fca1ad3d800 1 -- 172.21.15.102:0/532277177 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb9b0dfec0 con 0x55eb9af5a610 2024-09-13T19:16:15.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.127+0000 7fc903606640 1 -- 172.21.15.102:0/532277177 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fca10025070 con 0x55eb9af5a610 2024-09-13T19:16:15.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.127+0000 7fc903606640 1 --2- 172.21.15.102:0/532277177 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc8fc036b40 0x7fc8fc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.127+0000 7fc903606640 1 -- 172.21.15.102:0/532277177 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fca10023070 con 0x55eb9af5a610 2024-09-13T19:16:15.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.127+0000 7fca1628f640 1 --2- 172.21.15.102:0/532277177 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc8fc036b40 0x7fc8fc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.127+0000 7fca1ad3d800 1 --2- 172.21.15.102:0/532277177 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55eb9afecd90 0x55eb9b0e6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.127+0000 7fca1ad3d800 1 -- 172.21.15.102:0/532277177 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b0e6ab0 con 0x55eb9afecd90 2024-09-13T19:16:15.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.127+0000 7fca17291640 1 --2- 172.21.15.102:0/532277177 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55eb9afecd90 0x55eb9b0e6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.128+0000 7fca1628f640 1 --2- 172.21.15.102:0/532277177 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc8fc036b40 0x7fc8fc039000 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fca0c057000 tx=0x7fca0c052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.128+0000 7fca17291640 1 --2- 172.21.15.102:0/532277177 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55eb9afecd90 0x55eb9b0e6470 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.128+0000 7fca17291640 1 -- 172.21.15.102:0/532277177 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca080083e0 con 0x55eb9afecd90 2024-09-13T19:16:15.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.128+0000 7fca1ad3d800 1 -- 172.21.15.102:0/532277177 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b0e3ae0 con 0x55eb9afecd90 2024-09-13T19:16:15.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.128+0000 7fca17291640 1 -- 172.21.15.102:0/532277177 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fca080083e0 con 0x55eb9afecd90 2024-09-13T19:16:15.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.128+0000 7fca1ad3d800 1 --2- 172.21.15.102:0/532277177 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55eb9b0e8d90 0x55eb9b0eb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.128+0000 7fca1ad3d800 1 -- 172.21.15.102:0/532277177 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b0eb870 con 0x55eb9b0e8d90 2024-09-13T19:16:15.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.128+0000 7fca16a90640 1 --2- 172.21.15.102:0/532277177 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55eb9b0e8d90 0x55eb9b0eb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.129+0000 7fca16a90640 1 --2- 172.21.15.102:0/532277177 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55eb9b0e8d90 0x55eb9b0eb180 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.129+0000 7fca16a90640 1 -- 172.21.15.102:0/532277177 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fca1000f030 con 0x55eb9b0e8d90 2024-09-13T19:16:15.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.129+0000 7fca1ad3d800 1 -- 172.21.15.102:0/532277177 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b0e7c30 con 0x55eb9afecd90 2024-09-13T19:16:15.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.129+0000 7fca17291640 1 -- 172.21.15.102:0/532277177 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fca080083e0 con 0x55eb9afecd90 2024-09-13T19:16:15.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.129+0000 7fca1ad3d800 1 -- 172.21.15.102:0/532277177 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b0e80f0 con 0x55eb9b0e8d90 2024-09-13T19:16:15.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.129+0000 7fca16a90640 1 -- 172.21.15.102:0/532277177 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fca1000f030 con 0x55eb9b0e8d90 2024-09-13T19:16:15.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.130+0000 7fca1ad3d800 1 Processor -- start 2024-09-13T19:16:15.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.130+0000 7fca1ad3d800 1 -- start start 2024-09-13T19:16:15.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.130+0000 7fca1ad3d800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb9b0fa270 0x55eb9b0fa690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.130+0000 7fca1ad3d800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55eb9ae81580 con 0x55eb9b0fa270 2024-09-13T19:16:15.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.130+0000 7fca17291640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb9b0fa270 0x55eb9b0fa690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.130+0000 7fca17291640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb9b0fa270 0x55eb9b0fa690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54000/0 (socket says 172.21.15.102:54000) 2024-09-13T19:16:15.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.130+0000 7fca17291640 1 -- 172.21.15.102:0/147193714 learned_addr learned my addr 172.21.15.102:0/147193714 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:15.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.130+0000 7fca17291640 1 -- 172.21.15.102:0/147193714 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb9b0fabd0 con 0x55eb9b0fa270 2024-09-13T19:16:15.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.131+0000 7fca17291640 1 --2- 172.21.15.102:0/147193714 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb9b0fa270 0x55eb9b0fa690 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x55eb9b0e00b0 tx=0x7fca0800beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.131+0000 7fc900e01640 1 -- 172.21.15.102:0/147193714 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca0801c020 con 0x55eb9b0fa270 2024-09-13T19:16:15.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.131+0000 7fc900e01640 1 -- 172.21.15.102:0/147193714 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca08007c30 con 0x55eb9b0fa270 2024-09-13T19:16:15.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.131+0000 7fca1ad3d800 1 -- 172.21.15.102:0/147193714 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eb9b0fae60 con 0x55eb9b0fa270 2024-09-13T19:16:15.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.131+0000 7fc900e01640 1 -- 172.21.15.102:0/147193714 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca08018440 con 0x55eb9b0fa270 2024-09-13T19:16:15.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.131+0000 7fca1ad3d800 1 -- 172.21.15.102:0/147193714 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb9b0fdb40 con 0x55eb9b0fa270 2024-09-13T19:16:15.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.132+0000 7fc900e01640 1 -- 172.21.15.102:0/147193714 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fca0801f020 con 0x55eb9b0fa270 2024-09-13T19:16:15.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.132+0000 7fc900e01640 1 --2- 172.21.15.102:0/147193714 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc8f0036b90 0x7fc8f0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.132+0000 7fc900e01640 1 -- 172.21.15.102:0/147193714 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fca0804e270 con 0x55eb9b0fa270 2024-09-13T19:16:15.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.132+0000 7fca16a90640 1 --2- 172.21.15.102:0/147193714 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc8f0036b90 0x7fc8f0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.132+0000 7fca1ad3d800 1 Processor -- start 2024-09-13T19:16:15.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.132+0000 7fca1ad3d800 1 -- start start 2024-09-13T19:16:15.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.132+0000 7fca16a90640 1 --2- 172.21.15.102:0/147193714 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc8f0036b90 0x7fc8f0039050 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x55eb9b0e6f30 tx=0x7fca1004ae50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.132+0000 7fca1ad3d800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb9b106ed0 0x55eb9b1072d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.132+0000 7fca1ad3d800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55eb9b0d8240 con 0x55eb9b106ed0 2024-09-13T19:16:15.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.132+0000 7fca17291640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb9b106ed0 0x55eb9b1072d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.132+0000 7fca17291640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb9b106ed0 0x55eb9b1072d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54012/0 (socket says 172.21.15.102:54012) 2024-09-13T19:16:15.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.132+0000 7fca17291640 1 -- 172.21.15.102:0/768742755 learned_addr learned my addr 172.21.15.102:0/768742755 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:15.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.133+0000 7fca17291640 1 -- 172.21.15.102:0/768742755 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb9b1078a0 con 0x55eb9b106ed0 2024-09-13T19:16:15.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.133+0000 7fca17291640 1 --2- 172.21.15.102:0/768742755 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb9b106ed0 0x55eb9b1072d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fca0804c5c0 tx=0x7fca0804c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=155049ee3f0ac1f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.133+0000 7fc8fa7fc640 1 -- 172.21.15.102:0/768742755 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca08045070 con 0x55eb9b106ed0 2024-09-13T19:16:15.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.133+0000 7fc8fa7fc640 1 -- 172.21.15.102:0/768742755 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca0804b210 con 0x55eb9b106ed0 2024-09-13T19:16:15.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.133+0000 7fc8fa7fc640 1 -- 172.21.15.102:0/768742755 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca08021530 con 0x55eb9b106ed0 2024-09-13T19:16:15.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.133+0000 7fca1ad3d800 1 -- 172.21.15.102:0/768742755 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb9b106ed0 msgr2=0x55eb9b1072d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.133+0000 7fca1ad3d800 1 --2- 172.21.15.102:0/768742755 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb9b106ed0 0x55eb9b1072d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fca0804c5c0 tx=0x7fca0804c870 comp rx=0 tx=0).stop 2024-09-13T19:16:15.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.133+0000 7fca1ad3d800 1 -- 172.21.15.102:0/768742755 shutdown_connections 2024-09-13T19:16:15.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.133+0000 7fca1ad3d800 1 --2- 172.21.15.102:0/768742755 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb9b106ed0 0x55eb9b1072d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.133+0000 7fca1ad3d800 1 -- 172.21.15.102:0/768742755 >> 172.21.15.102:0/768742755 conn(0x55eb9b103280 msgr2=0x55eb9b101380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:15.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.133+0000 7fca1ad3d800 1 -- 172.21.15.102:0/768742755 shutdown_connections 2024-09-13T19:16:15.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.133+0000 7fca1ad3d800 1 -- 172.21.15.102:0/768742755 wait complete. 2024-09-13T19:16:15.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.134+0000 7fca1ad3d800 1 Processor -- start 2024-09-13T19:16:15.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.134+0000 7fca1ad3d800 1 -- start start 2024-09-13T19:16:15.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.134+0000 7fca1ad3d800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb9b106ed0 0x55eb9b10e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.134+0000 7fca1ad3d800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55eb9b107e70 con 0x55eb9b106ed0 2024-09-13T19:16:15.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.134+0000 7fca17291640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb9b106ed0 0x55eb9b10e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.134+0000 7fca17291640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb9b106ed0 0x55eb9b10e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54014/0 (socket says 172.21.15.102:54014) 2024-09-13T19:16:15.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.134+0000 7fca17291640 1 -- 172.21.15.102:0/3362233219 learned_addr learned my addr 172.21.15.102:0/3362233219 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:15.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.134+0000 7fca17291640 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb9b10e890 con 0x55eb9b106ed0 2024-09-13T19:16:15.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.135+0000 7fca17291640 1 --2- 172.21.15.102:0/3362233219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb9b106ed0 0x55eb9b10e350 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fca080168b0 tx=0x7fca0804c550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.135+0000 7fc8f8ff9640 1 -- 172.21.15.102:0/3362233219 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca08045030 con 0x55eb9b106ed0 2024-09-13T19:16:15.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.135+0000 7fc8f8ff9640 1 -- 172.21.15.102:0/3362233219 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca0803fe50 con 0x55eb9b106ed0 2024-09-13T19:16:15.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.135+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eb9b10eb20 con 0x55eb9b106ed0 2024-09-13T19:16:15.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.135+0000 7fc8f8ff9640 1 -- 172.21.15.102:0/3362233219 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca0803f040 con 0x55eb9b106ed0 2024-09-13T19:16:15.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.135+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb9b1117d0 con 0x55eb9b106ed0 2024-09-13T19:16:15.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.135+0000 7fc8f8ff9640 1 -- 172.21.15.102:0/3362233219 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fca08016040 con 0x55eb9b106ed0 2024-09-13T19:16:15.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.136+0000 7fc8f8ff9640 1 --2- 172.21.15.102:0/3362233219 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc8e0036b90 0x7fc8e0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.136+0000 7fc8f8ff9640 1 -- 172.21.15.102:0/3362233219 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fca08046070 con 0x55eb9b106ed0 2024-09-13T19:16:15.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.136+0000 7fca16a90640 1 --2- 172.21.15.102:0/3362233219 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc8e0036b90 0x7fc8e0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.136+0000 7fca16a90640 1 --2- 172.21.15.102:0/3362233219 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc8e0036b90 0x7fc8e0039050 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fca1004c010 tx=0x7fca10036000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.136+0000 7fca1ad3d800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.136+0000 7fca1ad3d800 1 --2- 172.21.15.102:0/3362233219 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55eb9b119db0 0x55eb9b11c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.136+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b11c9c0 con 0x55eb9b119db0 2024-09-13T19:16:15.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.136+0000 7fca1628f640 1 --2- 172.21.15.102:0/3362233219 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55eb9b119db0 0x55eb9b11c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.137+0000 7fca1628f640 1 --2- 172.21.15.102:0/3362233219 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55eb9b119db0 0x55eb9b11c270 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.137+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca0c051070 con 0x55eb9b119db0 2024-09-13T19:16:15.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.137+0000 7fca1ad3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.137+0000 7fca1ad3d800 20 realm 2024-09-13T19:16:15.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.137+0000 7fca1ad3d800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.137+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b11cdf0 con 0x55eb9b119db0 2024-09-13T19:16:15.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.137+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca0c051070 con 0x55eb9b119db0 2024-09-13T19:16:15.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.137+0000 7fca1ad3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.137+0000 7fca1ad3d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:15.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.137+0000 7fca1ad3d800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.137+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b11d6c0 con 0x55eb9b119db0 2024-09-13T19:16:15.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.137+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca0c051070 con 0x55eb9b119db0 2024-09-13T19:16:15.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.137+0000 7fca1ad3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.137+0000 7fca1ad3d800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.138+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b11da60 con 0x55eb9b119db0 2024-09-13T19:16:15.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.138+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fca0c051070 con 0x55eb9b119db0 2024-09-13T19:16:15.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.138+0000 7fca1ad3d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:15.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.138+0000 7fca1ad3d800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.138+0000 7fca1ad3d800 1 --2- 172.21.15.102:0/3362233219 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55eb9b11e7c0 0x55eb9b120bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.138+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b121200 con 0x55eb9b11e7c0 2024-09-13T19:16:15.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.138+0000 7fca17291640 1 --2- 172.21.15.102:0/3362233219 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55eb9b11e7c0 0x55eb9b120bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.138+0000 7fca17291640 1 --2- 172.21.15.102:0/3362233219 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55eb9b11e7c0 0x55eb9b120bb0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.138+0000 7fca17291640 1 -- 172.21.15.102:0/3362233219 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fca08028070 con 0x55eb9b11e7c0 2024-09-13T19:16:15.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.138+0000 7fca1ad3d800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:15.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.138+0000 7fca1ad3d800 20 searching for the correct realm 2024-09-13T19:16:15.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.138+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b122b30 con 0x55eb9b11e7c0 2024-09-13T19:16:15.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.139+0000 7fca17291640 1 -- 172.21.15.102:0/3362233219 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca08028070 con 0x55eb9b11e7c0 2024-09-13T19:16:15.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.139+0000 7fca17291640 1 --2- 172.21.15.102:0/3362233219 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fca080203b0 0x7fca08035660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.139+0000 7fca17291640 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b122b30 con 0x7fca080203b0 2024-09-13T19:16:15.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.139+0000 7fca16a90640 1 --2- 172.21.15.102:0/3362233219 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fca080203b0 0x7fca08035660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.139+0000 7fca16a90640 1 --2- 172.21.15.102:0/3362233219 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fca080203b0 0x7fca08035660 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.139+0000 7fca16a90640 1 -- 172.21.15.102:0/3362233219 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca1000f030 con 0x7fca080203b0 2024-09-13T19:16:15.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.139+0000 7fca16a90640 1 --2- 172.21.15.102:0/3362233219 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fca10027030 0x7fca100265c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.139+0000 7fca16a90640 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b122b30 con 0x7fca10027030 2024-09-13T19:16:15.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.140+0000 7fca1628f640 1 --2- 172.21.15.102:0/3362233219 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fca10027030 0x7fca100265c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.140+0000 7fca1628f640 1 --2- 172.21.15.102:0/3362233219 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fca10027030 0x7fca100265c0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.140+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca0c051070 con 0x7fca10027030 2024-09-13T19:16:15.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.140+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b122b30 con 0x55eb9b119db0 2024-09-13T19:16:15.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.140+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca0c051070 con 0x55eb9b119db0 2024-09-13T19:16:15.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.140+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b122b30 con 0x55eb9b119db0 2024-09-13T19:16:15.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.141+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca0c051070 con 0x55eb9b119db0 2024-09-13T19:16:15.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.141+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b122b30 con 0x7fca10027030 2024-09-13T19:16:15.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.141+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca0c051070 con 0x7fca10027030 2024-09-13T19:16:15.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.141+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b122b30 con 0x7fca10027030 2024-09-13T19:16:15.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.141+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca0c051070 con 0x7fca10027030 2024-09-13T19:16:15.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.141+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b122b30 con 0x7fca080203b0 2024-09-13T19:16:15.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.141+0000 7fca16a90640 1 -- 172.21.15.102:0/3362233219 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca1000f030 con 0x7fca080203b0 2024-09-13T19:16:15.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.141+0000 7fca16a90640 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b122b30 con 0x55eb9b11e7c0 2024-09-13T19:16:15.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.142+0000 7fca17291640 1 -- 172.21.15.102:0/3362233219 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca08028070 con 0x55eb9b11e7c0 2024-09-13T19:16:15.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.142+0000 7fca17291640 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b122b30 con 0x55eb9b119db0 2024-09-13T19:16:15.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.142+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca0c051070 con 0x55eb9b119db0 2024-09-13T19:16:15.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.142+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b122b30 con 0x7fca10027030 2024-09-13T19:16:15.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.142+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca0c051070 con 0x7fca10027030 2024-09-13T19:16:15.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.142+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b122b30 con 0x55eb9b119db0 2024-09-13T19:16:15.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.142+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca0c051070 con 0x55eb9b119db0 2024-09-13T19:16:15.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.142+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b122b30 con 0x7fca080203b0 2024-09-13T19:16:15.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.143+0000 7fca16a90640 1 -- 172.21.15.102:0/3362233219 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fca1000f030 con 0x7fca080203b0 2024-09-13T19:16:15.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.143+0000 7fca16a90640 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b122b30 con 0x55eb9b11e7c0 2024-09-13T19:16:15.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.143+0000 7fca17291640 1 -- 172.21.15.102:0/3362233219 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca08028070 con 0x55eb9b11e7c0 2024-09-13T19:16:15.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.143+0000 7fca17291640 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b122b30 con 0x55eb9b11e7c0 2024-09-13T19:16:15.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.143+0000 7fca17291640 1 -- 172.21.15.102:0/3362233219 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fca08028070 con 0x55eb9b11e7c0 2024-09-13T19:16:15.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.143+0000 7fca17291640 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b122b30 con 0x7fca10027030 2024-09-13T19:16:15.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.143+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca0c051070 con 0x7fca10027030 2024-09-13T19:16:15.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.143+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b122b30 con 0x55eb9b11e7c0 2024-09-13T19:16:15.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.143+0000 7fca17291640 1 -- 172.21.15.102:0/3362233219 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fca08028070 con 0x55eb9b11e7c0 2024-09-13T19:16:15.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.143+0000 7fca17291640 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b122b30 con 0x55eb9b11e7c0 2024-09-13T19:16:15.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.144+0000 7fca17291640 1 -- 172.21.15.102:0/3362233219 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca08028070 con 0x55eb9b11e7c0 2024-09-13T19:16:15.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.144+0000 7fca17291640 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b122b30 con 0x55eb9b119db0 2024-09-13T19:16:15.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.144+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca0c051070 con 0x55eb9b119db0 2024-09-13T19:16:15.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.144+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b122b30 con 0x55eb9b119db0 2024-09-13T19:16:15.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.144+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fca0c051070 con 0x55eb9b119db0 2024-09-13T19:16:15.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.144+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b122b30 con 0x7fca10027030 2024-09-13T19:16:15.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.144+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca0c051070 con 0x7fca10027030 2024-09-13T19:16:15.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.144+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b122b30 con 0x55eb9b11e7c0 2024-09-13T19:16:15.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.145+0000 7fca17291640 1 -- 172.21.15.102:0/3362233219 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca08069040 con 0x55eb9b11e7c0 2024-09-13T19:16:15.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.145+0000 7fca17291640 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b122b30 con 0x7fca080203b0 2024-09-13T19:16:15.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.145+0000 7fca16a90640 1 -- 172.21.15.102:0/3362233219 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca1000f030 con 0x7fca080203b0 2024-09-13T19:16:15.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.145+0000 7fca16a90640 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b122b30 con 0x55eb9b119db0 2024-09-13T19:16:15.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.145+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca0c051070 con 0x55eb9b119db0 2024-09-13T19:16:15.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.145+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b122b30 con 0x7fca10027030 2024-09-13T19:16:15.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.145+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca0c051070 con 0x7fca10027030 2024-09-13T19:16:15.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.145+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b122b30 con 0x55eb9b11e7c0 2024-09-13T19:16:15.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.146+0000 7fca17291640 1 -- 172.21.15.102:0/3362233219 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca08069040 con 0x55eb9b11e7c0 2024-09-13T19:16:15.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.146+0000 7fca17291640 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b122b30 con 0x7fca10027030 2024-09-13T19:16:15.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.146+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca0c051070 con 0x7fca10027030 2024-09-13T19:16:15.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.146+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fca0c087040 con 0x7fca080203b0 2024-09-13T19:16:15.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.146+0000 7fca16a90640 1 -- 172.21.15.102:0/3362233219 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca1000f030 con 0x7fca080203b0 2024-09-13T19:16:15.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.146+0000 7fca16a90640 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fca0c087040 con 0x55eb9b11e7c0 2024-09-13T19:16:15.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.146+0000 7fca17291640 1 -- 172.21.15.102:0/3362233219 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca08069040 con 0x55eb9b11e7c0 2024-09-13T19:16:15.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.146+0000 7fca17291640 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fca0c087040 con 0x7fca10027030 2024-09-13T19:16:15.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.147+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca0c051070 con 0x7fca10027030 2024-09-13T19:16:15.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.147+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fca0c087040 con 0x55eb9b119db0 2024-09-13T19:16:15.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.147+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fca0c051070 con 0x55eb9b119db0 2024-09-13T19:16:15.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.147+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fca0c087040 con 0x7fca080203b0 2024-09-13T19:16:15.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.147+0000 7fca16a90640 1 -- 172.21.15.102:0/3362233219 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca1000f030 con 0x7fca080203b0 2024-09-13T19:16:15.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.147+0000 7fca1ad3d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:15.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.147+0000 7fca1ad3d800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:15.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.147+0000 7fca1ad3d800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:15.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.147+0000 7fca1ad3d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:15.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.147+0000 7fca1ad3d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:15.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.147+0000 7fca1ad3d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:15.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.147+0000 7fca1ad3d800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.147+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b121bf0 con 0x55eb9b119db0 2024-09-13T19:16:15.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.147+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca0c051070 con 0x55eb9b119db0 2024-09-13T19:16:15.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.147+0000 7fca1ad3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.147+0000 7fca1ad3d800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.147+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b122490 con 0x55eb9b119db0 2024-09-13T19:16:15.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.147+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fca0c051070 con 0x55eb9b119db0 2024-09-13T19:16:15.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.148+0000 7fca1ad3d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:15.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.148+0000 7fca1ad3d800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.148+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b122fb0 con 0x55eb9b11e7c0 2024-09-13T19:16:15.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.148+0000 7fca17291640 1 -- 172.21.15.102:0/3362233219 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fca08069040 con 0x55eb9b11e7c0 2024-09-13T19:16:15.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.148+0000 7fca1ad3d800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:15.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.148+0000 7fca1ad3d800 20 zone default found 2024-09-13T19:16:15.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.148+0000 7fca1ad3d800 4 Realm: () 2024-09-13T19:16:15.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.148+0000 7fca1ad3d800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:15.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.148+0000 7fca1ad3d800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:15.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.148+0000 7fca1ad3d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:15.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.148+0000 7fca1ad3d800 20 zonegroup default 2024-09-13T19:16:15.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.148+0000 7fca1ad3d800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.148+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b1220c0 con 0x7fca10027030 2024-09-13T19:16:15.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.148+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fca0c051070 con 0x7fca10027030 2024-09-13T19:16:15.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.148+0000 7fca1ad3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.148+0000 7fca1ad3d800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.148+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b125260 con 0x55eb9b11e7c0 2024-09-13T19:16:15.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.148+0000 7fca17291640 1 -- 172.21.15.102:0/3362233219 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fca08069040 con 0x55eb9b11e7c0 2024-09-13T19:16:15.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.148+0000 7fca1ad3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.148+0000 7fca1ad3d800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.148+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b125600 con 0x55eb9b11e7c0 2024-09-13T19:16:15.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.149+0000 7fca17291640 1 -- 172.21.15.102:0/3362233219 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fca08069040 con 0x55eb9b11e7c0 2024-09-13T19:16:15.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.149+0000 7fca1ad3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.149+0000 7fca1ad3d800 20 started sync module instance, tier type = 2024-09-13T19:16:15.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.149+0000 7fca1ad3d800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:15.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.149+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b124700 con 0x7fca080203b0 2024-09-13T19:16:15.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.150+0000 7fca16a90640 1 -- 172.21.15.102:0/3362233219 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(44 notify.0 [create] v34'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca1000f030 con 0x7fca080203b0 2024-09-13T19:16:15.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.150+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94470407340624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b1259f0 con 0x7fca080203b0 2024-09-13T19:16:15.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.150+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b126240 con 0x55eb9b119db0 2024-09-13T19:16:15.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.151+0000 7fca16a90640 1 -- 172.21.15.102:0/3362233219 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94470407340624] v34'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca1000f030 con 0x7fca080203b0 2024-09-13T19:16:15.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.151+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v34'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca0c051070 con 0x55eb9b119db0 2024-09-13T19:16:15.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.151+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94470407347600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b126660 con 0x55eb9b119db0 2024-09-13T19:16:15.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.151+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b126eb0 con 0x55eb9b11e7c0 2024-09-13T19:16:15.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.152+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94470407347600] v34'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca0c051070 con 0x55eb9b119db0 2024-09-13T19:16:15.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.152+0000 7fca17291640 1 -- 172.21.15.102:0/3362233219 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v34'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca08069040 con 0x55eb9b11e7c0 2024-09-13T19:16:15.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.152+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94470407349136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b126da0 con 0x55eb9b11e7c0 2024-09-13T19:16:15.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.152+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b127920 con 0x7fca080203b0 2024-09-13T19:16:15.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.153+0000 7fca16a90640 1 -- 172.21.15.102:0/3362233219 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(50 notify.3 [create] v34'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca1000f030 con 0x7fca080203b0 2024-09-13T19:16:15.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.153+0000 7fca17291640 1 -- 172.21.15.102:0/3362233219 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94470407349136] v34'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca08069040 con 0x55eb9b11e7c0 2024-09-13T19:16:15.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.153+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94470407350320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b1278e0 con 0x7fca080203b0 2024-09-13T19:16:15.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.153+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b1283a0 con 0x55eb9b119db0 2024-09-13T19:16:15.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.154+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v34'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca0c051070 con 0x55eb9b119db0 2024-09-13T19:16:15.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.154+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94470407356080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b1283a0 con 0x55eb9b119db0 2024-09-13T19:16:15.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.154+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b129380 con 0x7fca10027030 2024-09-13T19:16:15.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.154+0000 7fca16a90640 1 -- 172.21.15.102:0/3362233219 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94470407350320] v34'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca1000f030 con 0x7fca080203b0 2024-09-13T19:16:15.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.155+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(54 notify.5 [create] v34'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca0c051070 con 0x7fca10027030 2024-09-13T19:16:15.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.155+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94470407356080] v34'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca0c051070 con 0x55eb9b119db0 2024-09-13T19:16:15.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.155+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94470407360144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b129380 con 0x7fca10027030 2024-09-13T19:16:15.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.155+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b128740 con 0x7fca10027030 2024-09-13T19:16:15.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.156+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(56 notify.6 [create] v34'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca0c051070 con 0x7fca10027030 2024-09-13T19:16:15.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.156+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94470407358272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b129d90 con 0x7fca10027030 2024-09-13T19:16:15.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.156+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b12a750 con 0x7fca10027030 2024-09-13T19:16:15.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.156+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94470407360144] v34'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca0c051070 con 0x7fca10027030 2024-09-13T19:16:15.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.157+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(58 notify.7 [create] v34'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca0c051070 con 0x7fca10027030 2024-09-13T19:16:15.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.157+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94470407353360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b12a750 con 0x7fca10027030 2024-09-13T19:16:15.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.157+0000 7fca1ad3d800 20 add_watcher() i=0 2024-09-13T19:16:15.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.157+0000 7fca1ad3d800 20 add_watcher() i=1 2024-09-13T19:16:15.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.157+0000 7fca1ad3d800 20 add_watcher() i=2 2024-09-13T19:16:15.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.157+0000 7fca1ad3d800 20 add_watcher() i=3 2024-09-13T19:16:15.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.157+0000 7fca1ad3d800 20 add_watcher() i=4 2024-09-13T19:16:15.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.157+0000 7fca1ad3d800 20 add_watcher() i=5 2024-09-13T19:16:15.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.157+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94470407358272] v34'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca0c051070 con 0x7fca10027030 2024-09-13T19:16:15.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.157+0000 7fca1ad3d800 20 add_watcher() i=6 2024-09-13T19:16:15.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.158+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94470407353360] v34'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca0c051070 con 0x7fca10027030 2024-09-13T19:16:15.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.158+0000 7fca1ad3d800 20 add_watcher() i=7 2024-09-13T19:16:15.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.158+0000 7fca1ad3d800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:15.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.158+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b12a750 con 0x55eb9b119db0 2024-09-13T19:16:15.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.158+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fca0c051070 con 0x55eb9b119db0 2024-09-13T19:16:15.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.158+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94470407365280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b12a6c0 con 0x55eb9b119db0 2024-09-13T19:16:15.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.159+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94470407365280] v34'56 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fca0c051070 con 0x55eb9b119db0 2024-09-13T19:16:15.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.159+0000 7fc8cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:15.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.159+0000 7fca1ad3d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:15.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.159+0000 7fca1ad3d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:15.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.159+0000 7fca1ad3d800 5 note: GC not initialized 2024-09-13T19:16:15.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.160+0000 7fc847fff640 20 reqs_thread_entry: start 2024-09-13T19:16:15.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.160+0000 7fca1ad3d800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:15.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.160+0000 7fca1ad3d800 20 Filter name: none 2024-09-13T19:16:15.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.160+0000 7fc845ffb640 20 reqs_thread_entry: start 2024-09-13T19:16:15.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.160+0000 7fca1ad3d800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:16:15.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.160+0000 7fca1ad3d800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.160+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b160aa0 con 0x55eb9b119db0 2024-09-13T19:16:15.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.160+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fca0c051070 con 0x55eb9b119db0 2024-09-13T19:16:15.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.160+0000 7fca1ad3d800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:16:15.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.160+0000 7fca1ad3d800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:16:15.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.160+0000 7fca1ad3d800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:16:15.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.160+0000 7fca1ad3d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:16:15.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.160+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b160580 con 0x7fca080203b0 2024-09-13T19:16:15.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.161+0000 7fca16a90640 1 -- 172.21.15.102:0/3362233219 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fca1000f030 con 0x7fca080203b0 2024-09-13T19:16:15.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.161+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b166de0 con 0x55eb9b119db0 2024-09-13T19:16:15.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.162+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v34'2 uv2 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fca0c051070 con 0x55eb9b119db0 2024-09-13T19:16:15.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.162+0000 7fca1ad3d800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:16:15.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.162+0000 7fca1ad3d800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:16:15.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.162+0000 7fca1ad3d800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T19:16:15.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.162+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94470407612544 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b163a50 con 0x55eb9b119db0 2024-09-13T19:16:15.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.162+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== watch-notify(notify (1) cookie 94470407356080 notify 146028888065 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7fca0c08e040 con 0x55eb9b119db0 2024-09-13T19:16:15.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.162+0000 7fc8fa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888065 cookie 94470407356080 notifier 4321 bl.length()=567 2024-09-13T19:16:15.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.162+0000 7fc8fa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:16:15.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.162+0000 7fc8fa7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:16:15.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.162+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(65 notify.4 [notify cookie 94470407612544 out=8b] v0'0 uv33 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fca0c051070 con 0x55eb9b119db0 2024-09-13T19:16:15.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.162+0000 7fc8fa7fc640 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fc8dc003ea0 con 0x55eb9b119db0 2024-09-13T19:16:15.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.162+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca0c051070 con 0x55eb9b119db0 2024-09-13T19:16:15.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.162+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== watch-notify(notify_complete (2) cookie 94470407612544 notify 146028888065 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fca0c082040 con 0x55eb9b119db0 2024-09-13T19:16:15.187 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:16:14.779675Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:16:14.779665Z","tags":[],"group_ids":[]} 2024-09-13T19:16:15.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.163+0000 7fc8cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:15.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.163+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94470407365280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b15e7f0 con 0x55eb9b119db0 2024-09-13T19:16:15.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.164+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94470407365280] v34'57 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fca0c051070 con 0x55eb9b119db0 2024-09-13T19:16:15.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.164+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94470407340624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b15e7f0 con 0x7fca080203b0 2024-09-13T19:16:15.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.165+0000 7fca16a90640 1 -- 172.21.15.102:0/3362233219 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94470407340624] v34'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca1000f030 con 0x7fca080203b0 2024-09-13T19:16:15.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.165+0000 7fca1ad3d800 20 remove_watcher() i=0 2024-09-13T19:16:15.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.165+0000 7fca1ad3d800 2 removed watcher, disabling cache 2024-09-13T19:16:15.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.165+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94470407347600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b15e7f0 con 0x55eb9b119db0 2024-09-13T19:16:15.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.166+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 <== osd.1 v2:172.21.15.102:6808/2204418452 28 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94470407347600] v34'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca0c051070 con 0x55eb9b119db0 2024-09-13T19:16:15.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.166+0000 7fca1ad3d800 20 remove_watcher() i=1 2024-09-13T19:16:15.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.166+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94470407349136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b15e7f0 con 0x55eb9b11e7c0 2024-09-13T19:16:15.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.167+0000 7fca17291640 1 -- 172.21.15.102:0/3362233219 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94470407349136] v34'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca08069040 con 0x55eb9b11e7c0 2024-09-13T19:16:15.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.167+0000 7fca1ad3d800 20 remove_watcher() i=2 2024-09-13T19:16:15.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.167+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94470407350320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b15e7f0 con 0x7fca080203b0 2024-09-13T19:16:15.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.168+0000 7fca16a90640 1 -- 172.21.15.102:0/3362233219 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94470407350320] v34'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca1000f030 con 0x7fca080203b0 2024-09-13T19:16:15.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.168+0000 7fca1ad3d800 20 remove_watcher() i=3 2024-09-13T19:16:15.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.168+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94470407356080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b15e7f0 con 0x55eb9b119db0 2024-09-13T19:16:15.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.169+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 <== osd.1 v2:172.21.15.102:6808/2204418452 29 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94470407356080] v34'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca0c051070 con 0x55eb9b119db0 2024-09-13T19:16:15.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.169+0000 7fca1ad3d800 20 remove_watcher() i=4 2024-09-13T19:16:15.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.169+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94470407360144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b15e7f0 con 0x7fca10027030 2024-09-13T19:16:15.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.170+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94470407360144] v34'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca0c051070 con 0x7fca10027030 2024-09-13T19:16:15.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.170+0000 7fca1ad3d800 20 remove_watcher() i=5 2024-09-13T19:16:15.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.170+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94470407358272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b15e7f0 con 0x7fca10027030 2024-09-13T19:16:15.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.171+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94470407358272] v34'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca0c051070 con 0x7fca10027030 2024-09-13T19:16:15.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.171+0000 7fca1ad3d800 20 remove_watcher() i=6 2024-09-13T19:16:15.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.171+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94470407353360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb9b15e7f0 con 0x7fca10027030 2024-09-13T19:16:15.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.172+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94470407353360] v34'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca0c051070 con 0x7fca10027030 2024-09-13T19:16:15.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.172+0000 7fca1ad3d800 20 remove_watcher() i=7 2024-09-13T19:16:15.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.173+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fca10027030 msgr2=0x7fca100265c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.173+0000 7fca1ad3d800 1 --2- 172.21.15.102:0/3362233219 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fca10027030 0x7fca100265c0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.173+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55eb9b119db0 msgr2=0x55eb9b11c270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.173+0000 7fca1ad3d800 1 --2- 172.21.15.102:0/3362233219 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55eb9b119db0 0x55eb9b11c270 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.173+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fca080203b0 msgr2=0x7fca08035660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.173+0000 7fca1ad3d800 1 --2- 172.21.15.102:0/3362233219 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fca080203b0 0x7fca08035660 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.173+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55eb9b11e7c0 msgr2=0x55eb9b120bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.173+0000 7fca1ad3d800 1 --2- 172.21.15.102:0/3362233219 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55eb9b11e7c0 0x55eb9b120bb0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.173+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc8e0036b90 msgr2=0x7fc8e0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.173+0000 7fca1ad3d800 1 --2- 172.21.15.102:0/3362233219 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc8e0036b90 0x7fc8e0039050 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fca1004c010 tx=0x7fca10036000 comp rx=0 tx=0).stop 2024-09-13T19:16:15.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.173+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb9b106ed0 msgr2=0x55eb9b10e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.173+0000 7fca1ad3d800 1 --2- 172.21.15.102:0/3362233219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb9b106ed0 0x55eb9b10e350 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fca080168b0 tx=0x7fca0804c550 comp rx=0 tx=0).stop 2024-09-13T19:16:15.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.173+0000 7fca1628f640 1 -- 172.21.15.102:0/3362233219 reap_dead start 2024-09-13T19:16:15.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.173+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 shutdown_connections 2024-09-13T19:16:15.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.173+0000 7fca1ad3d800 1 --2- 172.21.15.102:0/3362233219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb9b106ed0 0x55eb9b10e350 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.173+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 >> 172.21.15.102:0/3362233219 conn(0x55eb9b103280 msgr2=0x55eb9b1085e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:15.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.173+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 shutdown_connections 2024-09-13T19:16:15.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.173+0000 7fca1ad3d800 1 -- 172.21.15.102:0/3362233219 wait complete. 2024-09-13T19:16:15.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.173+0000 7fca1ad3d800 1 -- 172.21.15.102:0/147193714 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc8f0036b90 msgr2=0x7fc8f0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.173+0000 7fca1ad3d800 1 --2- 172.21.15.102:0/147193714 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc8f0036b90 0x7fc8f0039050 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x55eb9b0e6f30 tx=0x7fca1004ae50 comp rx=0 tx=0).stop 2024-09-13T19:16:15.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.173+0000 7fca1ad3d800 1 -- 172.21.15.102:0/147193714 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb9b0fa270 msgr2=0x55eb9b0fa690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.173+0000 7fca1ad3d800 1 --2- 172.21.15.102:0/147193714 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb9b0fa270 0x55eb9b0fa690 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x55eb9b0e00b0 tx=0x7fca0800beb0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.173+0000 7fca1ad3d800 1 -- 172.21.15.102:0/147193714 shutdown_connections 2024-09-13T19:16:15.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.173+0000 7fca1ad3d800 1 --2- 172.21.15.102:0/147193714 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc8f0036b90 0x7fc8f0039050 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.173+0000 7fca1ad3d800 1 --2- 172.21.15.102:0/147193714 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb9b0fa270 0x55eb9b0fa690 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.173+0000 7fca1ad3d800 1 -- 172.21.15.102:0/147193714 >> 172.21.15.102:0/147193714 conn(0x55eb9b0ef200 msgr2=0x55eb9b0f1d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:15.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.173+0000 7fca1ad3d800 1 -- 172.21.15.102:0/147193714 shutdown_connections 2024-09-13T19:16:15.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.173+0000 7fca1ad3d800 1 -- 172.21.15.102:0/147193714 wait complete. 2024-09-13T19:16:15.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.174+0000 7fca1ad3d800 1 -- 172.21.15.102:0/532277177 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55eb9afecd90 msgr2=0x55eb9b0e6470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.174+0000 7fca1ad3d800 1 --2- 172.21.15.102:0/532277177 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55eb9afecd90 0x55eb9b0e6470 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.174+0000 7fca1ad3d800 1 -- 172.21.15.102:0/532277177 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55eb9b0e8d90 msgr2=0x55eb9b0eb180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.174+0000 7fca1ad3d800 1 --2- 172.21.15.102:0/532277177 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55eb9b0e8d90 0x55eb9b0eb180 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.174+0000 7fca1ad3d800 1 -- 172.21.15.102:0/532277177 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc8fc036b40 msgr2=0x7fc8fc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.174+0000 7fca1ad3d800 1 --2- 172.21.15.102:0/532277177 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc8fc036b40 0x7fc8fc039000 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fca0c057000 tx=0x7fca0c052000 comp rx=0 tx=0).stop 2024-09-13T19:16:15.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.174+0000 7fca1ad3d800 1 -- 172.21.15.102:0/532277177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb9af5a610 msgr2=0x55eb9b0df4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.174+0000 7fca1ad3d800 1 --2- 172.21.15.102:0/532277177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb9af5a610 0x55eb9b0df4c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fca10001b10 tx=0x7fca10000f40 comp rx=0 tx=0).stop 2024-09-13T19:16:15.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.174+0000 7fca1ad3d800 1 -- 172.21.15.102:0/532277177 shutdown_connections 2024-09-13T19:16:15.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.174+0000 7fca1ad3d800 1 --2- 172.21.15.102:0/532277177 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55eb9b0e8d90 0x55eb9b0eb180 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.174+0000 7fca1ad3d800 1 --2- 172.21.15.102:0/532277177 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55eb9afecd90 0x55eb9b0e6470 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.174+0000 7fca1ad3d800 1 --2- 172.21.15.102:0/532277177 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc8fc036b40 0x7fc8fc039000 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.174+0000 7fca1ad3d800 1 --2- 172.21.15.102:0/532277177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb9af5a610 0x55eb9b0df4c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.174+0000 7fca1ad3d800 1 -- 172.21.15.102:0/532277177 >> 172.21.15.102:0/532277177 conn(0x55eb9afe0de0 msgr2=0x55eb9b0d1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:15.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.174+0000 7fca1ad3d800 1 -- 172.21.15.102:0/532277177 shutdown_connections 2024-09-13T19:16:15.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.174+0000 7fca1ad3d800 1 -- 172.21.15.102:0/532277177 wait complete. 2024-09-13T19:16:15.200 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:16:14.779675Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:16:14.779665Z', 'tags': [], 'group_ids': []} 2024-09-13T19:16:15.200 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T19:16:15.201 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T19:16:15.201 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T19:16:15.245 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:15.245 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:15.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.242+0000 7f87b8b22800 1 Processor -- start 2024-09-13T19:16:15.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.242+0000 7f87b8b22800 1 -- start start 2024-09-13T19:16:15.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.242+0000 7f87b8b22800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55ce9632c990 0x55ce9632ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.242+0000 7f87b8b22800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ce961e7b30 con 0x55ce9629c610 2024-09-13T19:16:15.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.242+0000 7f87b8b22800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55ce961c9360 con 0x55ce9632c990 2024-09-13T19:16:15.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.242+0000 7f87affff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55ce9632c990 0x55ce9632ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.242+0000 7f87b4816640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55ce9629c610 0x55ce9632b270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:49810/0 (socket says 172.21.15.102:49810) 2024-09-13T19:16:15.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.242+0000 7f87b4816640 1 -- 172.21.15.102:0/3965922694 learned_addr learned my addr 172.21.15.102:0/3965922694 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:16:15.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.242+0000 7f87affff640 1 -- 172.21.15.102:0/3965922694 >> v1:172.21.15.53:6789/0 conn(0x55ce9629c610 legacy=0x55ce9632b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.242+0000 7f87affff640 1 -- 172.21.15.102:0/3965922694 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce961efe00 con 0x55ce9632c990 2024-09-13T19:16:15.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.244+0000 7f87affff640 1 --2- 172.21.15.102:0/3965922694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce9632c990 0x55ce9632ed80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f87a000a470 tx=0x7f87a0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=794a59e29b7ee947 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.244+0000 7f87af7fe640 1 -- 172.21.15.102:0/3965922694 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87a0053570 con 0x55ce9632c990 2024-09-13T19:16:15.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.244+0000 7f87af7fe640 1 -- 172.21.15.102:0/3965922694 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87a0058070 con 0x55ce9632c990 2024-09-13T19:16:15.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.244+0000 7f87af7fe640 1 -- 172.21.15.102:0/3965922694 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87a0053880 con 0x55ce9632c990 2024-09-13T19:16:15.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.245+0000 7f87b8b22800 1 -- 172.21.15.102:0/3965922694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce9632c990 msgr2=0x55ce9632ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.245+0000 7f87b8b22800 1 --2- 172.21.15.102:0/3965922694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce9632c990 0x55ce9632ed80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f87a000a470 tx=0x7f87a0045a20 comp rx=0 tx=0).stop 2024-09-13T19:16:15.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.245+0000 7f87b8b22800 1 -- 172.21.15.102:0/3965922694 shutdown_connections 2024-09-13T19:16:15.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.245+0000 7f87b8b22800 1 --2- 172.21.15.102:0/3965922694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce9632c990 0x55ce9632ed80 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.245+0000 7f87b8b22800 1 -- 172.21.15.102:0/3965922694 >> 172.21.15.102:0/3965922694 conn(0x55ce96322de0 msgr2=0x55ce96325200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:15.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.245+0000 7f87b8b22800 1 -- 172.21.15.102:0/3965922694 shutdown_connections 2024-09-13T19:16:15.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.245+0000 7f87b8b22800 1 -- 172.21.15.102:0/3965922694 wait complete. 2024-09-13T19:16:15.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.259+0000 7f87b8b22800 1 Processor -- start 2024-09-13T19:16:15.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.259+0000 7f87b8b22800 1 -- start start 2024-09-13T19:16:15.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.259+0000 7f87b8b22800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce9629c610 0x55ce96328ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.259+0000 7f87b8b22800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ce96274330 con 0x55ce9629c610 2024-09-13T19:16:15.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.259+0000 7f87b4816640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce9629c610 0x55ce96328ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.259+0000 7f87b4816640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce9629c610 0x55ce96328ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54034/0 (socket says 172.21.15.102:54034) 2024-09-13T19:16:15.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.259+0000 7f87b4816640 1 -- 172.21.15.102:0/1527348175 learned_addr learned my addr 172.21.15.102:0/1527348175 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:15.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.260+0000 7f87b4816640 1 -- 172.21.15.102:0/1527348175 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce961c1bc0 con 0x55ce9629c610 2024-09-13T19:16:15.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.260+0000 7f87b4816640 1 --2- 172.21.15.102:0/1527348175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce9629c610 0x55ce96328ba0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f87a8001d80 tx=0x7f87a8001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=872da9f4f12dd606 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.260+0000 7f86a2e05640 1 -- 172.21.15.102:0/1527348175 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87a8013030 con 0x55ce9629c610 2024-09-13T19:16:15.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.260+0000 7f86a2e05640 1 -- 172.21.15.102:0/1527348175 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87a800e470 con 0x55ce9629c610 2024-09-13T19:16:15.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.260+0000 7f86a2e05640 1 -- 172.21.15.102:0/1527348175 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87a800e810 con 0x55ce9629c610 2024-09-13T19:16:15.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.261+0000 7f87b8b22800 1 -- 172.21.15.102:0/1527348175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce9629c610 msgr2=0x55ce96328ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.261+0000 7f87b8b22800 1 --2- 172.21.15.102:0/1527348175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce9629c610 0x55ce96328ba0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f87a8001d80 tx=0x7f87a8001e70 comp rx=0 tx=0).stop 2024-09-13T19:16:15.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.261+0000 7f87b8b22800 1 -- 172.21.15.102:0/1527348175 shutdown_connections 2024-09-13T19:16:15.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.261+0000 7f87b8b22800 1 --2- 172.21.15.102:0/1527348175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce9629c610 0x55ce96328ba0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.261+0000 7f87b8b22800 1 -- 172.21.15.102:0/1527348175 >> 172.21.15.102:0/1527348175 conn(0x55ce96322de0 msgr2=0x55ce96413240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:15.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.261+0000 7f87b8b22800 1 -- 172.21.15.102:0/1527348175 shutdown_connections 2024-09-13T19:16:15.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.261+0000 7f87b8b22800 1 -- 172.21.15.102:0/1527348175 wait complete. 2024-09-13T19:16:15.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.261+0000 7f87b8b22800 1 Processor -- start 2024-09-13T19:16:15.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.261+0000 7f87b8b22800 1 -- start start 2024-09-13T19:16:15.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.261+0000 7f87b8b22800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce9629c610 0x55ce96421480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.261+0000 7f87b8b22800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ce9632f680 con 0x55ce9629c610 2024-09-13T19:16:15.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.261+0000 7f87b4816640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce9629c610 0x55ce96421480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.261+0000 7f87b4816640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce9629c610 0x55ce96421480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54048/0 (socket says 172.21.15.102:54048) 2024-09-13T19:16:15.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.261+0000 7f87b4816640 1 -- 172.21.15.102:0/3405122535 learned_addr learned my addr 172.21.15.102:0/3405122535 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:15.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.262+0000 7f87b4816640 1 -- 172.21.15.102:0/3405122535 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce961d5fe0 con 0x55ce9629c610 2024-09-13T19:16:15.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.262+0000 7f87b4816640 1 --2- 172.21.15.102:0/3405122535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce9629c610 0x55ce96421480 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f87a8004000 tx=0x7f87a8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.262+0000 7f86a1602640 1 -- 172.21.15.102:0/3405122535 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87a8027070 con 0x55ce9629c610 2024-09-13T19:16:15.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.262+0000 7f86a1602640 1 -- 172.21.15.102:0/3405122535 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87a8019900 con 0x55ce9629c610 2024-09-13T19:16:15.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.262+0000 7f87b8b22800 1 -- 172.21.15.102:0/3405122535 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ce964219c0 con 0x55ce9629c610 2024-09-13T19:16:15.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.262+0000 7f86a1602640 1 -- 172.21.15.102:0/3405122535 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87a8019c60 con 0x55ce9629c610 2024-09-13T19:16:15.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.262+0000 7f87b8b22800 1 -- 172.21.15.102:0/3405122535 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce96421ee0 con 0x55ce9629c610 2024-09-13T19:16:15.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.263+0000 7f86a1602640 1 -- 172.21.15.102:0/3405122535 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f87a802a070 con 0x55ce9629c610 2024-09-13T19:16:15.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.263+0000 7f86a1602640 1 --2- 172.21.15.102:0/3405122535 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f869c036b40 0x7f869c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.263+0000 7f86a1602640 1 -- 172.21.15.102:0/3405122535 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f87a801f070 con 0x55ce9629c610 2024-09-13T19:16:15.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.263+0000 7f87affff640 1 --2- 172.21.15.102:0/3405122535 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f869c036b40 0x7f869c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.263+0000 7f87b8b22800 1 --2- 172.21.15.102:0/3405122535 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55ce9632c990 0x55ce964284f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.263+0000 7f87b8b22800 1 -- 172.21.15.102:0/3405122535 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce96428ac0 con 0x55ce9632c990 2024-09-13T19:16:15.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.263+0000 7f87b5017640 1 --2- 172.21.15.102:0/3405122535 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55ce9632c990 0x55ce964284f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.264+0000 7f87affff640 1 --2- 172.21.15.102:0/3405122535 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f869c036b40 0x7f869c039000 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f87a0057000 tx=0x7f87a0052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.264+0000 7f87b5017640 1 --2- 172.21.15.102:0/3405122535 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55ce9632c990 0x55ce964284f0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.264+0000 7f87b5017640 1 -- 172.21.15.102:0/3405122535 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f87b000a4a0 con 0x55ce9632c990 2024-09-13T19:16:15.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.264+0000 7f87b8b22800 1 -- 172.21.15.102:0/3405122535 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce96425ac0 con 0x55ce9632c990 2024-09-13T19:16:15.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.264+0000 7f87b5017640 1 -- 172.21.15.102:0/3405122535 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f87b000a4a0 con 0x55ce9632c990 2024-09-13T19:16:15.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.264+0000 7f87b8b22800 1 --2- 172.21.15.102:0/3405122535 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55ce9642add0 0x55ce9642d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.264+0000 7f87b8b22800 1 -- 172.21.15.102:0/3405122535 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce9642d860 con 0x55ce9642add0 2024-09-13T19:16:15.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.264+0000 7f87b4816640 1 --2- 172.21.15.102:0/3405122535 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55ce9642add0 0x55ce9642d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.265+0000 7f87b4816640 1 --2- 172.21.15.102:0/3405122535 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55ce9642add0 0x55ce9642d1c0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.265+0000 7f87b4816640 1 -- 172.21.15.102:0/3405122535 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f87a8029030 con 0x55ce9642add0 2024-09-13T19:16:15.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.265+0000 7f87b8b22800 1 -- 172.21.15.102:0/3405122535 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce96429c70 con 0x55ce9632c990 2024-09-13T19:16:15.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.265+0000 7f87b5017640 1 -- 172.21.15.102:0/3405122535 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f87b000a4a0 con 0x55ce9632c990 2024-09-13T19:16:15.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.265+0000 7f87b8b22800 1 -- 172.21.15.102:0/3405122535 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce9642a150 con 0x55ce9642add0 2024-09-13T19:16:15.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.265+0000 7f87b4816640 1 -- 172.21.15.102:0/3405122535 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f87a8029030 con 0x55ce9642add0 2024-09-13T19:16:15.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.266+0000 7f87b8b22800 1 Processor -- start 2024-09-13T19:16:15.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.266+0000 7f87b8b22800 1 -- start start 2024-09-13T19:16:15.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.266+0000 7f87b8b22800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce9643c1f0 0x55ce9643c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.266+0000 7f87b8b22800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ce961c3580 con 0x55ce9643c1f0 2024-09-13T19:16:15.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.266+0000 7f87b5017640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce9643c1f0 0x55ce9643c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.266+0000 7f87b5017640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce9643c1f0 0x55ce9643c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54054/0 (socket says 172.21.15.102:54054) 2024-09-13T19:16:15.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.266+0000 7f87b5017640 1 -- 172.21.15.102:0/225441645 learned_addr learned my addr 172.21.15.102:0/225441645 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:15.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.267+0000 7f87b5017640 1 -- 172.21.15.102:0/225441645 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce9643cb50 con 0x55ce9643c1f0 2024-09-13T19:16:15.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.267+0000 7f87b5017640 1 --2- 172.21.15.102:0/225441645 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce9643c1f0 0x55ce9643c610 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x55ce96428e80 tx=0x7f87b00167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.267+0000 7f869a7fc640 1 -- 172.21.15.102:0/225441645 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87b0013640 con 0x55ce9643c1f0 2024-09-13T19:16:15.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.267+0000 7f869a7fc640 1 -- 172.21.15.102:0/225441645 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87b00137e0 con 0x55ce9643c1f0 2024-09-13T19:16:15.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.267+0000 7f87b8b22800 1 -- 172.21.15.102:0/225441645 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ce9643cde0 con 0x55ce9643c1f0 2024-09-13T19:16:15.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.267+0000 7f869a7fc640 1 -- 172.21.15.102:0/225441645 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87b0013ae0 con 0x55ce9643c1f0 2024-09-13T19:16:15.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.267+0000 7f87b8b22800 1 -- 172.21.15.102:0/225441645 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce9643fac0 con 0x55ce9643c1f0 2024-09-13T19:16:15.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.268+0000 7f869a7fc640 1 -- 172.21.15.102:0/225441645 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f87b0011040 con 0x55ce9643c1f0 2024-09-13T19:16:15.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.268+0000 7f869a7fc640 1 --2- 172.21.15.102:0/225441645 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f868c036b90 0x7f868c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.268+0000 7f869a7fc640 1 -- 172.21.15.102:0/225441645 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f87b000e040 con 0x55ce9643c1f0 2024-09-13T19:16:15.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.268+0000 7f87b4816640 1 --2- 172.21.15.102:0/225441645 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f868c036b90 0x7f868c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.268+0000 7f87b8b22800 1 Processor -- start 2024-09-13T19:16:15.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.268+0000 7f87b4816640 1 --2- 172.21.15.102:0/225441645 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f868c036b90 0x7f868c039050 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x55ce964259e0 tx=0x7f87a802ae80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.268+0000 7f87b8b22800 1 -- start start 2024-09-13T19:16:15.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.268+0000 7f87b8b22800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce96448ef0 0x55ce964492f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.268+0000 7f87b8b22800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ce96327270 con 0x55ce96448ef0 2024-09-13T19:16:15.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.269+0000 7f87b5017640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce96448ef0 0x55ce964492f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.269+0000 7f87b5017640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce96448ef0 0x55ce964492f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54056/0 (socket says 172.21.15.102:54056) 2024-09-13T19:16:15.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.269+0000 7f87b5017640 1 -- 172.21.15.102:0/2112123427 learned_addr learned my addr 172.21.15.102:0/2112123427 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:15.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.269+0000 7f87b5017640 1 -- 172.21.15.102:0/2112123427 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce964498c0 con 0x55ce96448ef0 2024-09-13T19:16:15.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.269+0000 7f87b5017640 1 --2- 172.21.15.102:0/2112123427 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce96448ef0 0x55ce964492f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f87b004cd70 tx=0x7f87b004cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=599beb63b087996c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.269+0000 7f868bfff640 1 -- 172.21.15.102:0/2112123427 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87b0021a90 con 0x55ce96448ef0 2024-09-13T19:16:15.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.269+0000 7f868bfff640 1 -- 172.21.15.102:0/2112123427 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87b0021440 con 0x55ce96448ef0 2024-09-13T19:16:15.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.269+0000 7f868bfff640 1 -- 172.21.15.102:0/2112123427 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87b001f340 con 0x55ce96448ef0 2024-09-13T19:16:15.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.269+0000 7f87b8b22800 1 -- 172.21.15.102:0/2112123427 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce96448ef0 msgr2=0x55ce964492f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.270+0000 7f87b8b22800 1 --2- 172.21.15.102:0/2112123427 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce96448ef0 0x55ce964492f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f87b004cd70 tx=0x7f87b004cf40 comp rx=0 tx=0).stop 2024-09-13T19:16:15.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.270+0000 7f87b8b22800 1 -- 172.21.15.102:0/2112123427 shutdown_connections 2024-09-13T19:16:15.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.270+0000 7f87b8b22800 1 --2- 172.21.15.102:0/2112123427 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce96448ef0 0x55ce964492f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.270+0000 7f87b8b22800 1 -- 172.21.15.102:0/2112123427 >> 172.21.15.102:0/2112123427 conn(0x55ce96445250 msgr2=0x55ce96443350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:15.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.270+0000 7f87b8b22800 1 -- 172.21.15.102:0/2112123427 shutdown_connections 2024-09-13T19:16:15.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.270+0000 7f87b8b22800 1 -- 172.21.15.102:0/2112123427 wait complete. 2024-09-13T19:16:15.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.270+0000 7f87b8b22800 1 Processor -- start 2024-09-13T19:16:15.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.270+0000 7f87b8b22800 1 -- start start 2024-09-13T19:16:15.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.270+0000 7f87b8b22800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce96448ef0 0x55ce964502d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.270+0000 7f87b8b22800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ce96449f30 con 0x55ce96448ef0 2024-09-13T19:16:15.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.270+0000 7f87b5017640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce96448ef0 0x55ce964502d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.270+0000 7f87b5017640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce96448ef0 0x55ce964502d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54058/0 (socket says 172.21.15.102:54058) 2024-09-13T19:16:15.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.270+0000 7f87b5017640 1 -- 172.21.15.102:0/1456019167 learned_addr learned my addr 172.21.15.102:0/1456019167 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:15.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.271+0000 7f87b5017640 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce96450810 con 0x55ce96448ef0 2024-09-13T19:16:15.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.271+0000 7f87b5017640 1 --2- 172.21.15.102:0/1456019167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce96448ef0 0x55ce964502d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f87b003d040 tx=0x7f87b004ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.271+0000 7f868a7fc640 1 -- 172.21.15.102:0/1456019167 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87b0013c80 con 0x55ce96448ef0 2024-09-13T19:16:15.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.271+0000 7f868a7fc640 1 -- 172.21.15.102:0/1456019167 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87b0013e20 con 0x55ce96448ef0 2024-09-13T19:16:15.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.271+0000 7f868a7fc640 1 -- 172.21.15.102:0/1456019167 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87b001f810 con 0x55ce96448ef0 2024-09-13T19:16:15.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.271+0000 7f87b8b22800 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ce96450aa0 con 0x55ce96448ef0 2024-09-13T19:16:15.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.271+0000 7f87b8b22800 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce96450aa0 con 0x55ce96448ef0 2024-09-13T19:16:15.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.272+0000 7f868a7fc640 1 -- 172.21.15.102:0/1456019167 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f87b00123d0 con 0x55ce96448ef0 2024-09-13T19:16:15.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.272+0000 7f868a7fc640 1 --2- 172.21.15.102:0/1456019167 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8680036b90 0x7f8680039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.272+0000 7f868a7fc640 1 -- 172.21.15.102:0/1456019167 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f87b0036070 con 0x55ce96448ef0 2024-09-13T19:16:15.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.272+0000 7f87b4816640 1 --2- 172.21.15.102:0/1456019167 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8680036b90 0x7f8680039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.272+0000 7f87b8b22800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.272+0000 7f87b8b22800 1 --2- 172.21.15.102:0/1456019167 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55ce9645bbe0 0x55ce9645e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.272+0000 7f87b8b22800 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce9645e7f0 con 0x55ce9645bbe0 2024-09-13T19:16:15.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.272+0000 7f87affff640 1 --2- 172.21.15.102:0/1456019167 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55ce9645bbe0 0x55ce9645e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.272+0000 7f87b4816640 1 --2- 172.21.15.102:0/1456019167 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8680036b90 0x7f8680039050 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f87a8016fd0 tx=0x7f87a8038000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.273+0000 7f87affff640 1 --2- 172.21.15.102:0/1456019167 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55ce9645bbe0 0x55ce9645e0a0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.273+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f87a0051070 con 0x55ce9645bbe0 2024-09-13T19:16:15.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.273+0000 7f87b8b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.273+0000 7f87b8b22800 20 realm 2024-09-13T19:16:15.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.273+0000 7f87b8b22800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.273+0000 7f87b8b22800 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce9645ec20 con 0x55ce9645bbe0 2024-09-13T19:16:15.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.273+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f87a0051070 con 0x55ce9645bbe0 2024-09-13T19:16:15.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.273+0000 7f87b8b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.273+0000 7f87b8b22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:15.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.273+0000 7f87b8b22800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.273+0000 7f87b8b22800 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce9645f4f0 con 0x55ce9645bbe0 2024-09-13T19:16:15.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.273+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f87a0051070 con 0x55ce9645bbe0 2024-09-13T19:16:15.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.273+0000 7f87b8b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.273+0000 7f87b8b22800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.273+0000 7f87b8b22800 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce9645f890 con 0x55ce9645bbe0 2024-09-13T19:16:15.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.274+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f87a0051070 con 0x55ce9645bbe0 2024-09-13T19:16:15.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.274+0000 7f87b8b22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:15.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.274+0000 7f87b8b22800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.274+0000 7f87b8b22800 1 --2- 172.21.15.102:0/1456019167 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55ce964605f0 0x55ce964629e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.274+0000 7f87b8b22800 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce96462f20 con 0x55ce964605f0 2024-09-13T19:16:15.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.274+0000 7f87b5017640 1 --2- 172.21.15.102:0/1456019167 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55ce964605f0 0x55ce964629e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.274+0000 7f87b5017640 1 --2- 172.21.15.102:0/1456019167 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55ce964605f0 0x55ce964629e0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.274+0000 7f87b5017640 1 -- 172.21.15.102:0/1456019167 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f87b000a4a0 con 0x55ce964605f0 2024-09-13T19:16:15.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.274+0000 7f87b8b22800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:15.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.274+0000 7f87b8b22800 20 searching for the correct realm 2024-09-13T19:16:15.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.274+0000 7f87b8b22800 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce964648d0 con 0x55ce964605f0 2024-09-13T19:16:15.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.274+0000 7f87b5017640 1 -- 172.21.15.102:0/1456019167 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87b000a4a0 con 0x55ce964605f0 2024-09-13T19:16:15.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.274+0000 7f87b5017640 1 --2- 172.21.15.102:0/1456019167 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f87b001bbc0 0x7f87b002c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.274+0000 7f87b5017640 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce964648d0 con 0x7f87b001bbc0 2024-09-13T19:16:15.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.275+0000 7f87b4816640 1 --2- 172.21.15.102:0/1456019167 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f87b001bbc0 0x7f87b002c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.275+0000 7f87b4816640 1 --2- 172.21.15.102:0/1456019167 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f87b001bbc0 0x7f87b002c0b0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.275+0000 7f87b4816640 1 -- 172.21.15.102:0/1456019167 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87a8029030 con 0x7f87b001bbc0 2024-09-13T19:16:15.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.275+0000 7f87b4816640 1 --2- 172.21.15.102:0/1456019167 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f87a8059040 0x7f87a802a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.275+0000 7f87b4816640 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce964648d0 con 0x7f87a8059040 2024-09-13T19:16:15.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.275+0000 7f87affff640 1 --2- 172.21.15.102:0/1456019167 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f87a8059040 0x7f87a802a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.276+0000 7f87affff640 1 --2- 172.21.15.102:0/1456019167 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f87a8059040 0x7f87a802a580 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.276+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87a0051070 con 0x7f87a8059040 2024-09-13T19:16:15.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.276+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce964648d0 con 0x55ce9645bbe0 2024-09-13T19:16:15.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.276+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87a0051070 con 0x55ce9645bbe0 2024-09-13T19:16:15.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.276+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce964648d0 con 0x55ce9645bbe0 2024-09-13T19:16:15.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.277+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87a0051070 con 0x55ce9645bbe0 2024-09-13T19:16:15.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.277+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce964648d0 con 0x7f87a8059040 2024-09-13T19:16:15.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.277+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87a0051070 con 0x7f87a8059040 2024-09-13T19:16:15.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.277+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce964648d0 con 0x7f87a8059040 2024-09-13T19:16:15.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.277+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87a0051070 con 0x7f87a8059040 2024-09-13T19:16:15.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.277+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce964648d0 con 0x7f87b001bbc0 2024-09-13T19:16:15.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.277+0000 7f87b4816640 1 -- 172.21.15.102:0/1456019167 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87a8029030 con 0x7f87b001bbc0 2024-09-13T19:16:15.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.277+0000 7f87b4816640 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce964648d0 con 0x55ce964605f0 2024-09-13T19:16:15.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.277+0000 7f87b5017640 1 -- 172.21.15.102:0/1456019167 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87b000a4a0 con 0x55ce964605f0 2024-09-13T19:16:15.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.277+0000 7f87b5017640 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce964648d0 con 0x55ce9645bbe0 2024-09-13T19:16:15.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.278+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87a0051070 con 0x55ce9645bbe0 2024-09-13T19:16:15.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.278+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce964648d0 con 0x7f87a8059040 2024-09-13T19:16:15.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.278+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87a0051070 con 0x7f87a8059040 2024-09-13T19:16:15.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.278+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce964648d0 con 0x55ce9645bbe0 2024-09-13T19:16:15.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.278+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87a0051070 con 0x55ce9645bbe0 2024-09-13T19:16:15.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.278+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce964648d0 con 0x7f87b001bbc0 2024-09-13T19:16:15.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.278+0000 7f87b4816640 1 -- 172.21.15.102:0/1456019167 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f87a8029030 con 0x7f87b001bbc0 2024-09-13T19:16:15.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.278+0000 7f87b4816640 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce964648d0 con 0x55ce964605f0 2024-09-13T19:16:15.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.279+0000 7f87b5017640 1 -- 172.21.15.102:0/1456019167 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87b000a4a0 con 0x55ce964605f0 2024-09-13T19:16:15.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.279+0000 7f87b5017640 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce964648d0 con 0x55ce964605f0 2024-09-13T19:16:15.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.279+0000 7f87b5017640 1 -- 172.21.15.102:0/1456019167 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f87b000a4a0 con 0x55ce964605f0 2024-09-13T19:16:15.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.279+0000 7f87b5017640 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce964648d0 con 0x7f87a8059040 2024-09-13T19:16:15.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.279+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87a0051070 con 0x7f87a8059040 2024-09-13T19:16:15.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.279+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce964648d0 con 0x55ce964605f0 2024-09-13T19:16:15.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.279+0000 7f87b5017640 1 -- 172.21.15.102:0/1456019167 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f87b000a4a0 con 0x55ce964605f0 2024-09-13T19:16:15.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.279+0000 7f87b5017640 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce964648d0 con 0x55ce964605f0 2024-09-13T19:16:15.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.279+0000 7f87b5017640 1 -- 172.21.15.102:0/1456019167 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87b000a4a0 con 0x55ce964605f0 2024-09-13T19:16:15.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.279+0000 7f87b5017640 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce964648d0 con 0x55ce9645bbe0 2024-09-13T19:16:15.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.280+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87a0051070 con 0x55ce9645bbe0 2024-09-13T19:16:15.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.280+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce964648d0 con 0x55ce9645bbe0 2024-09-13T19:16:15.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.280+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f87a0051070 con 0x55ce9645bbe0 2024-09-13T19:16:15.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.280+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce964648d0 con 0x7f87a8059040 2024-09-13T19:16:15.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.280+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87a0051070 con 0x7f87a8059040 2024-09-13T19:16:15.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.280+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce964648d0 con 0x55ce964605f0 2024-09-13T19:16:15.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.281+0000 7f87b5017640 1 -- 172.21.15.102:0/1456019167 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87b000a4a0 con 0x55ce964605f0 2024-09-13T19:16:15.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.281+0000 7f87b5017640 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce964648d0 con 0x7f87b001bbc0 2024-09-13T19:16:15.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.281+0000 7f87b4816640 1 -- 172.21.15.102:0/1456019167 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87a8029030 con 0x7f87b001bbc0 2024-09-13T19:16:15.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.281+0000 7f87b4816640 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce964648d0 con 0x55ce9645bbe0 2024-09-13T19:16:15.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.281+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87a0051070 con 0x55ce9645bbe0 2024-09-13T19:16:15.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.281+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce964648d0 con 0x7f87a8059040 2024-09-13T19:16:15.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.281+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87a0051070 con 0x7f87a8059040 2024-09-13T19:16:15.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.281+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce964648d0 con 0x55ce964605f0 2024-09-13T19:16:15.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.282+0000 7f87b5017640 1 -- 172.21.15.102:0/1456019167 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87b000a4a0 con 0x55ce964605f0 2024-09-13T19:16:15.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.282+0000 7f87b5017640 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce964648d0 con 0x7f87a8059040 2024-09-13T19:16:15.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.282+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87a0051070 con 0x7f87a8059040 2024-09-13T19:16:15.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.282+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f87a0087040 con 0x7f87b001bbc0 2024-09-13T19:16:15.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.282+0000 7f87b4816640 1 -- 172.21.15.102:0/1456019167 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87a8029030 con 0x7f87b001bbc0 2024-09-13T19:16:15.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.282+0000 7f87b4816640 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f87a0087040 con 0x55ce964605f0 2024-09-13T19:16:15.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.282+0000 7f87b5017640 1 -- 172.21.15.102:0/1456019167 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87b000a4a0 con 0x55ce964605f0 2024-09-13T19:16:15.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.282+0000 7f87b5017640 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f87a0087040 con 0x7f87a8059040 2024-09-13T19:16:15.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.283+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87a0051070 con 0x7f87a8059040 2024-09-13T19:16:15.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.283+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f87a0087040 con 0x55ce9645bbe0 2024-09-13T19:16:15.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.283+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f87a0051070 con 0x55ce9645bbe0 2024-09-13T19:16:15.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.283+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f87a0087040 con 0x7f87b001bbc0 2024-09-13T19:16:15.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.283+0000 7f87b4816640 1 -- 172.21.15.102:0/1456019167 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87a8029030 con 0x7f87b001bbc0 2024-09-13T19:16:15.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.283+0000 7f87b8b22800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:15.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.283+0000 7f87b8b22800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:15.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.283+0000 7f87b8b22800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:15.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.283+0000 7f87b8b22800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:15.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.283+0000 7f87b8b22800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:15.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.283+0000 7f87b8b22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:15.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.283+0000 7f87b8b22800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.283+0000 7f87b8b22800 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce964639d0 con 0x55ce9645bbe0 2024-09-13T19:16:15.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.283+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f87a0051070 con 0x55ce9645bbe0 2024-09-13T19:16:15.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.283+0000 7f87b8b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.283+0000 7f87b8b22800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.283+0000 7f87b8b22800 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce96464270 con 0x55ce9645bbe0 2024-09-13T19:16:15.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.283+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f87a0051070 con 0x55ce9645bbe0 2024-09-13T19:16:15.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.283+0000 7f87b8b22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:15.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.283+0000 7f87b8b22800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.283+0000 7f87b8b22800 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce96463610 con 0x55ce964605f0 2024-09-13T19:16:15.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.284+0000 7f87b5017640 1 -- 172.21.15.102:0/1456019167 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f87b000a4a0 con 0x55ce964605f0 2024-09-13T19:16:15.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.284+0000 7f87b8b22800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:15.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.284+0000 7f87b8b22800 20 zone default found 2024-09-13T19:16:15.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.284+0000 7f87b8b22800 4 Realm: () 2024-09-13T19:16:15.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.284+0000 7f87b8b22800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:15.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.284+0000 7f87b8b22800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:15.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.284+0000 7f87b8b22800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:15.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.284+0000 7f87b8b22800 20 zonegroup default 2024-09-13T19:16:15.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.284+0000 7f87b8b22800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.284+0000 7f87b8b22800 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce96465250 con 0x7f87a8059040 2024-09-13T19:16:15.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.284+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f87a0051070 con 0x7f87a8059040 2024-09-13T19:16:15.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.284+0000 7f87b8b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.284+0000 7f87b8b22800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.284+0000 7f87b8b22800 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce96466cf0 con 0x55ce964605f0 2024-09-13T19:16:15.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.284+0000 7f87b5017640 1 -- 172.21.15.102:0/1456019167 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f87b000a4a0 con 0x55ce964605f0 2024-09-13T19:16:15.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.284+0000 7f87b8b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.284+0000 7f87b8b22800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.284+0000 7f87b8b22800 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce96467140 con 0x55ce964605f0 2024-09-13T19:16:15.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.285+0000 7f87b5017640 1 -- 172.21.15.102:0/1456019167 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f87b000a4a0 con 0x55ce964605f0 2024-09-13T19:16:15.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.285+0000 7f87b8b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.285+0000 7f87b8b22800 20 started sync module instance, tier type = 2024-09-13T19:16:15.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.285+0000 7f87b8b22800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:15.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.285+0000 7f87b8b22800 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce964660c0 con 0x7f87b001bbc0 2024-09-13T19:16:15.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.286+0000 7f87b4816640 1 -- 172.21.15.102:0/1456019167 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(44 notify.0 [create] v34'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87a8029030 con 0x7f87b001bbc0 2024-09-13T19:16:15.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.286+0000 7f87b8b22800 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94345772819632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce96465d20 con 0x7f87b001bbc0 2024-09-13T19:16:15.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.286+0000 7f87b8b22800 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce96468050 con 0x55ce9645bbe0 2024-09-13T19:16:15.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.287+0000 7f87b4816640 1 -- 172.21.15.102:0/1456019167 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94345772819632] v34'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87a8029030 con 0x7f87b001bbc0 2024-09-13T19:16:15.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.287+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v34'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87a0051070 con 0x55ce9645bbe0 2024-09-13T19:16:15.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.287+0000 7f87b8b22800 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94345772825504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce96467fc0 con 0x55ce9645bbe0 2024-09-13T19:16:15.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.287+0000 7f87b8b22800 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce96468f10 con 0x55ce964605f0 2024-09-13T19:16:15.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.288+0000 7f87b5017640 1 -- 172.21.15.102:0/1456019167 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v34'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87b000a4a0 con 0x55ce964605f0 2024-09-13T19:16:15.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.288+0000 7f87b8b22800 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94345772829280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce96468e80 con 0x55ce964605f0 2024-09-13T19:16:15.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.288+0000 7f87b8b22800 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce96469f00 con 0x7f87b001bbc0 2024-09-13T19:16:15.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.288+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94345772825504] v34'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87a0051070 con 0x55ce9645bbe0 2024-09-13T19:16:15.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.289+0000 7f87b5017640 1 -- 172.21.15.102:0/1456019167 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94345772829280] v34'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87b000a4a0 con 0x55ce964605f0 2024-09-13T19:16:15.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.289+0000 7f87b4816640 1 -- 172.21.15.102:0/1456019167 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(50 notify.3 [create] v34'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87a8029030 con 0x7f87b001bbc0 2024-09-13T19:16:15.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.289+0000 7f87b8b22800 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94345772831488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce96468440 con 0x7f87b001bbc0 2024-09-13T19:16:15.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.289+0000 7f87b8b22800 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce9646a7a0 con 0x55ce9645bbe0 2024-09-13T19:16:15.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.290+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v34'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87a0051070 con 0x55ce9645bbe0 2024-09-13T19:16:15.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.290+0000 7f87b8b22800 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94345772835568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce9646a770 con 0x55ce9645bbe0 2024-09-13T19:16:15.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.290+0000 7f87b8b22800 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce9646b790 con 0x7f87a8059040 2024-09-13T19:16:15.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.293+0000 7f87b4816640 1 -- 172.21.15.102:0/1456019167 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94345772831488] v34'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87a8029030 con 0x7f87b001bbc0 2024-09-13T19:16:15.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.293+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(54 notify.5 [create] v34'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87a0051070 con 0x7f87a8059040 2024-09-13T19:16:15.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.293+0000 7f87b8b22800 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94345772839520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce9646b750 con 0x7f87a8059040 2024-09-13T19:16:15.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.293+0000 7f87b8b22800 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce9646c240 con 0x7f87a8059040 2024-09-13T19:16:15.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.293+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94345772835568] v34'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87a0051070 con 0x55ce9645bbe0 2024-09-13T19:16:15.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.293+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(56 notify.6 [create] v34'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87a0051070 con 0x7f87a8059040 2024-09-13T19:16:15.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.294+0000 7f87b8b22800 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94345772842272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce9646c240 con 0x7f87a8059040 2024-09-13T19:16:15.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.294+0000 7f87b8b22800 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce9646cc80 con 0x7f87a8059040 2024-09-13T19:16:15.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.294+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94345772839520] v34'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87a0051070 con 0x7f87a8059040 2024-09-13T19:16:15.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.294+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(58 notify.7 [create] v34'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87a0051070 con 0x7f87a8059040 2024-09-13T19:16:15.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.294+0000 7f87b8b22800 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94345772833232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce9646cc80 con 0x7f87a8059040 2024-09-13T19:16:15.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.294+0000 7f87b8b22800 20 add_watcher() i=0 2024-09-13T19:16:15.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.294+0000 7f87b8b22800 20 add_watcher() i=1 2024-09-13T19:16:15.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.294+0000 7f87b8b22800 20 add_watcher() i=2 2024-09-13T19:16:15.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.294+0000 7f87b8b22800 20 add_watcher() i=3 2024-09-13T19:16:15.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.294+0000 7f87b8b22800 20 add_watcher() i=4 2024-09-13T19:16:15.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.294+0000 7f87b8b22800 20 add_watcher() i=5 2024-09-13T19:16:15.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.295+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94345772842272] v34'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87a0051070 con 0x7f87a8059040 2024-09-13T19:16:15.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.295+0000 7f87b8b22800 20 add_watcher() i=6 2024-09-13T19:16:15.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.295+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94345772833232] v34'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87a0051070 con 0x7f87a8059040 2024-09-13T19:16:15.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.295+0000 7f87b8b22800 20 add_watcher() i=7 2024-09-13T19:16:15.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.295+0000 7f87b8b22800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:15.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.295+0000 7f87b8b22800 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce9646fcb0 con 0x55ce9645bbe0 2024-09-13T19:16:15.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.296+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f87a0051070 con 0x55ce9645bbe0 2024-09-13T19:16:15.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.296+0000 7f87b8b22800 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94345772845008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce9646d0a0 con 0x55ce9645bbe0 2024-09-13T19:16:15.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.297+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94345772845008] v34'58 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f87a0051070 con 0x55ce9645bbe0 2024-09-13T19:16:15.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.297+0000 7f866b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:15.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.297+0000 7f87b8b22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:15.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.297+0000 7f87b8b22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:15.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.297+0000 7f87b8b22800 5 note: GC not initialized 2024-09-13T19:16:15.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.297+0000 7f866a7e4640 20 reqs_thread_entry: start 2024-09-13T19:16:15.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.297+0000 7f87b8b22800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:15.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.297+0000 7f87b8b22800 20 Filter name: none 2024-09-13T19:16:15.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.297+0000 7f8663fff640 20 reqs_thread_entry: start 2024-09-13T19:16:15.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.297+0000 7f87b8b22800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.297+0000 7f87b8b22800 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce964a2a50 con 0x55ce9645bbe0 2024-09-13T19:16:15.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.298+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f87a0051070 con 0x55ce9645bbe0 2024-09-13T19:16:15.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.298+0000 7f87b8b22800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:16:15.319 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:16:14.779675Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:16:14.779665Z","tags":[],"group_ids":[]} 2024-09-13T19:16:15.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.299+0000 7f866b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:15.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.299+0000 7f87b8b22800 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94345772845008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce964a1880 con 0x55ce9645bbe0 2024-09-13T19:16:15.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.300+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94345772845008] v34'59 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f87a0051070 con 0x55ce9645bbe0 2024-09-13T19:16:15.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.300+0000 7f87b8b22800 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94345772819632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce964a1880 con 0x7f87b001bbc0 2024-09-13T19:16:15.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.301+0000 7f87b4816640 1 -- 172.21.15.102:0/1456019167 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94345772819632] v34'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87a8029030 con 0x7f87b001bbc0 2024-09-13T19:16:15.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.301+0000 7f87b8b22800 20 remove_watcher() i=0 2024-09-13T19:16:15.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.301+0000 7f87b8b22800 2 removed watcher, disabling cache 2024-09-13T19:16:15.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.301+0000 7f87b8b22800 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94345772825504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce964664b0 con 0x55ce9645bbe0 2024-09-13T19:16:15.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.302+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94345772825504] v34'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87a0051070 con 0x55ce9645bbe0 2024-09-13T19:16:15.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.302+0000 7f87b8b22800 20 remove_watcher() i=1 2024-09-13T19:16:15.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.302+0000 7f87b8b22800 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94345772829280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce964664b0 con 0x55ce964605f0 2024-09-13T19:16:15.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.303+0000 7f87b5017640 1 -- 172.21.15.102:0/1456019167 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94345772829280] v34'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87b000a4a0 con 0x55ce964605f0 2024-09-13T19:16:15.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.303+0000 7f87b8b22800 20 remove_watcher() i=2 2024-09-13T19:16:15.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.303+0000 7f87b8b22800 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94345772831488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce96468a60 con 0x7f87b001bbc0 2024-09-13T19:16:15.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.303+0000 7f87b4816640 1 -- 172.21.15.102:0/1456019167 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94345772831488] v34'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87a8029030 con 0x7f87b001bbc0 2024-09-13T19:16:15.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.304+0000 7f87b8b22800 20 remove_watcher() i=3 2024-09-13T19:16:15.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.304+0000 7f87b8b22800 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94345772835568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce964664b0 con 0x55ce9645bbe0 2024-09-13T19:16:15.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.304+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94345772835568] v34'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87a0051070 con 0x55ce9645bbe0 2024-09-13T19:16:15.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.304+0000 7f87b8b22800 20 remove_watcher() i=4 2024-09-13T19:16:15.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.304+0000 7f87b8b22800 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94345772839520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce96468a60 con 0x7f87a8059040 2024-09-13T19:16:15.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.305+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94345772839520] v34'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87a0051070 con 0x7f87a8059040 2024-09-13T19:16:15.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.306+0000 7f87b8b22800 20 remove_watcher() i=5 2024-09-13T19:16:15.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.306+0000 7f87b8b22800 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94345772842272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce9646a2f0 con 0x7f87a8059040 2024-09-13T19:16:15.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.307+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94345772842272] v34'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87a0051070 con 0x7f87a8059040 2024-09-13T19:16:15.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.307+0000 7f87b8b22800 20 remove_watcher() i=6 2024-09-13T19:16:15.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.307+0000 7f87b8b22800 1 -- 172.21.15.102:0/1456019167 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94345772833232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce964664b0 con 0x7f87a8059040 2024-09-13T19:16:15.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.307+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94345772833232] v34'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87a0051070 con 0x7f87a8059040 2024-09-13T19:16:15.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.307+0000 7f87b8b22800 20 remove_watcher() i=7 2024-09-13T19:16:15.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.308+0000 7f87b8b22800 1 -- 172.21.15.102:0/1456019167 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f87a8059040 msgr2=0x7f87a802a580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.308+0000 7f87b8b22800 1 --2- 172.21.15.102:0/1456019167 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f87a8059040 0x7f87a802a580 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.308+0000 7f87b8b22800 1 -- 172.21.15.102:0/1456019167 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55ce9645bbe0 msgr2=0x55ce9645e0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.308+0000 7f87b8b22800 1 --2- 172.21.15.102:0/1456019167 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55ce9645bbe0 0x55ce9645e0a0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.308+0000 7f87b8b22800 1 -- 172.21.15.102:0/1456019167 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f87b001bbc0 msgr2=0x7f87b002c0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.308+0000 7f87b8b22800 1 --2- 172.21.15.102:0/1456019167 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f87b001bbc0 0x7f87b002c0b0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.308+0000 7f87b8b22800 1 -- 172.21.15.102:0/1456019167 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55ce964605f0 msgr2=0x55ce964629e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.308+0000 7f87b8b22800 1 --2- 172.21.15.102:0/1456019167 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55ce964605f0 0x55ce964629e0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.308+0000 7f87b8b22800 1 -- 172.21.15.102:0/1456019167 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8680036b90 msgr2=0x7f8680039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.308+0000 7f87b8b22800 1 --2- 172.21.15.102:0/1456019167 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8680036b90 0x7f8680039050 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f87a8016fd0 tx=0x7f87a8038000 comp rx=0 tx=0).stop 2024-09-13T19:16:15.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.308+0000 7f87affff640 1 -- 172.21.15.102:0/1456019167 reap_dead start 2024-09-13T19:16:15.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.308+0000 7f87b8b22800 1 -- 172.21.15.102:0/1456019167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce96448ef0 msgr2=0x55ce964502d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.308+0000 7f87b8b22800 1 --2- 172.21.15.102:0/1456019167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce96448ef0 0x55ce964502d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f87b003d040 tx=0x7f87b004ccd0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.308+0000 7f87b8b22800 1 -- 172.21.15.102:0/1456019167 shutdown_connections 2024-09-13T19:16:15.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.308+0000 7f87b8b22800 1 --2- 172.21.15.102:0/1456019167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce96448ef0 0x55ce964502d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.308+0000 7f87b8b22800 1 -- 172.21.15.102:0/1456019167 >> 172.21.15.102:0/1456019167 conn(0x55ce96445250 msgr2=0x55ce96443320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:15.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.308+0000 7f87b8b22800 1 -- 172.21.15.102:0/1456019167 shutdown_connections 2024-09-13T19:16:15.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.308+0000 7f87b8b22800 1 -- 172.21.15.102:0/1456019167 wait complete. 2024-09-13T19:16:15.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.308+0000 7f87b8b22800 1 -- 172.21.15.102:0/225441645 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f868c036b90 msgr2=0x7f868c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.308+0000 7f87b8b22800 1 --2- 172.21.15.102:0/225441645 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f868c036b90 0x7f868c039050 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x55ce964259e0 tx=0x7f87a802ae80 comp rx=0 tx=0).stop 2024-09-13T19:16:15.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.308+0000 7f87b8b22800 1 -- 172.21.15.102:0/225441645 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce9643c1f0 msgr2=0x55ce9643c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.308+0000 7f87b8b22800 1 --2- 172.21.15.102:0/225441645 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce9643c1f0 0x55ce9643c610 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x55ce96428e80 tx=0x7f87b00167b0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.308+0000 7f87b8b22800 1 -- 172.21.15.102:0/225441645 shutdown_connections 2024-09-13T19:16:15.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.308+0000 7f87b8b22800 1 --2- 172.21.15.102:0/225441645 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f868c036b90 0x7f868c039050 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.308+0000 7f87b8b22800 1 --2- 172.21.15.102:0/225441645 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce9643c1f0 0x55ce9643c610 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.308+0000 7f87b8b22800 1 -- 172.21.15.102:0/225441645 >> 172.21.15.102:0/225441645 conn(0x55ce96431180 msgr2=0x55ce96433d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:15.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.308+0000 7f87b8b22800 1 -- 172.21.15.102:0/225441645 shutdown_connections 2024-09-13T19:16:15.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.308+0000 7f87b8b22800 1 -- 172.21.15.102:0/225441645 wait complete. 2024-09-13T19:16:15.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.309+0000 7f87b8b22800 1 -- 172.21.15.102:0/3405122535 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55ce9632c990 msgr2=0x55ce964284f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.309+0000 7f87b8b22800 1 --2- 172.21.15.102:0/3405122535 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55ce9632c990 0x55ce964284f0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.309+0000 7f87b8b22800 1 -- 172.21.15.102:0/3405122535 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55ce9642add0 msgr2=0x55ce9642d1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.309+0000 7f87b8b22800 1 --2- 172.21.15.102:0/3405122535 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55ce9642add0 0x55ce9642d1c0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.309+0000 7f87b8b22800 1 -- 172.21.15.102:0/3405122535 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f869c036b40 msgr2=0x7f869c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.309+0000 7f87b8b22800 1 --2- 172.21.15.102:0/3405122535 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f869c036b40 0x7f869c039000 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f87a0057000 tx=0x7f87a0052000 comp rx=0 tx=0).stop 2024-09-13T19:16:15.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.309+0000 7f87b8b22800 1 -- 172.21.15.102:0/3405122535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce9629c610 msgr2=0x55ce96421480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.309+0000 7f87b8b22800 1 --2- 172.21.15.102:0/3405122535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce9629c610 0x55ce96421480 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f87a8004000 tx=0x7f87a8000bc0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.309+0000 7f87b8b22800 1 -- 172.21.15.102:0/3405122535 shutdown_connections 2024-09-13T19:16:15.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.309+0000 7f87b8b22800 1 --2- 172.21.15.102:0/3405122535 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55ce9642add0 0x55ce9642d1c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.309+0000 7f87b8b22800 1 --2- 172.21.15.102:0/3405122535 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55ce9632c990 0x55ce964284f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.309+0000 7f87b8b22800 1 --2- 172.21.15.102:0/3405122535 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f869c036b40 0x7f869c039000 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.309+0000 7f87b8b22800 1 --2- 172.21.15.102:0/3405122535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce9629c610 0x55ce96421480 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.309+0000 7f87b8b22800 1 -- 172.21.15.102:0/3405122535 >> 172.21.15.102:0/3405122535 conn(0x55ce96322de0 msgr2=0x55ce96412e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:15.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.309+0000 7f87b8b22800 1 -- 172.21.15.102:0/3405122535 shutdown_connections 2024-09-13T19:16:15.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.309+0000 7f87b8b22800 1 -- 172.21.15.102:0/3405122535 wait complete. 2024-09-13T19:16:15.332 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:16:14.779675Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:16:14.779665Z', 'tags': [], 'group_ids': []} 2024-09-13T19:16:15.332 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-13T19:16:15.332 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-13T19:16:15.332 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-13T19:16:15.376 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:15.377 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:15.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.373+0000 7f9719151800 1 Processor -- start 2024-09-13T19:16:15.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.373+0000 7f9719151800 1 -- start start 2024-09-13T19:16:15.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.373+0000 7f9719151800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5647a7c698f0 0x5647a7c6bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.373+0000 7f9719151800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5647a7b24b30 con 0x5647a7bd96b0 2024-09-13T19:16:15.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.373+0000 7f9719151800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5647a7b06360 con 0x5647a7c698f0 2024-09-13T19:16:15.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.374+0000 7f9716444640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5647a7c698f0 0x5647a7c6bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.374+0000 7f9716444640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5647a7c698f0 0x5647a7c6bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54064/0 (socket says 172.21.15.102:54064) 2024-09-13T19:16:15.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.374+0000 7f9716444640 1 -- 172.21.15.102:0/1894554998 learned_addr learned my addr 172.21.15.102:0/1894554998 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:15.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.374+0000 7f9716c45640 1 --1- 172.21.15.102:0/1894554998 >> v1:172.21.15.53:6789/0 conn(0x5647a7bd96b0 0x5647a7c681d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:49820/0 (socket says 172.21.15.102:49820) 2024-09-13T19:16:15.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.374+0000 7f9716444640 1 -- 172.21.15.102:0/1894554998 >> v1:172.21.15.53:6789/0 conn(0x5647a7bd96b0 legacy=0x5647a7c681d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.374+0000 7f9716444640 1 -- 172.21.15.102:0/1894554998 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647a7b2ce00 con 0x5647a7c698f0 2024-09-13T19:16:15.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.376+0000 7f9716444640 1 --2- 172.21.15.102:0/1894554998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647a7c698f0 0x5647a7c6bd00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f970000a520 tx=0x7f9700045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b13cc86b5623b491 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.376+0000 7f9715c43640 1 -- 172.21.15.102:0/1894554998 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9700055070 con 0x5647a7c698f0 2024-09-13T19:16:15.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.376+0000 7f9715c43640 1 -- 172.21.15.102:0/1894554998 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97000515b0 con 0x5647a7c698f0 2024-09-13T19:16:15.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.376+0000 7f9715c43640 1 -- 172.21.15.102:0/1894554998 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97000518d0 con 0x5647a7c698f0 2024-09-13T19:16:15.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.376+0000 7f9719151800 1 -- 172.21.15.102:0/1894554998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647a7c698f0 msgr2=0x5647a7c6bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.376+0000 7f9719151800 1 --2- 172.21.15.102:0/1894554998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647a7c698f0 0x5647a7c6bd00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f970000a520 tx=0x7f9700045ba0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.376+0000 7f9719151800 1 -- 172.21.15.102:0/1894554998 shutdown_connections 2024-09-13T19:16:15.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.376+0000 7f9719151800 1 --2- 172.21.15.102:0/1894554998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647a7c698f0 0x5647a7c6bd00 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.376+0000 7f9719151800 1 -- 172.21.15.102:0/1894554998 >> 172.21.15.102:0/1894554998 conn(0x5647a7c5fde0 msgr2=0x5647a7c62200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:15.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.377+0000 7f9719151800 1 -- 172.21.15.102:0/1894554998 shutdown_connections 2024-09-13T19:16:15.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.377+0000 7f9719151800 1 -- 172.21.15.102:0/1894554998 wait complete. 2024-09-13T19:16:15.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.391+0000 7f9719151800 1 Processor -- start 2024-09-13T19:16:15.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.391+0000 7f9719151800 1 -- start start 2024-09-13T19:16:15.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.391+0000 7f9719151800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647a7bd96b0 0x5647a7c65b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.391+0000 7f9719151800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5647a7bb1330 con 0x5647a7bd96b0 2024-09-13T19:16:15.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.391+0000 7f9716c45640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647a7bd96b0 0x5647a7c65b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.391+0000 7f9716c45640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647a7bd96b0 0x5647a7c65b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54078/0 (socket says 172.21.15.102:54078) 2024-09-13T19:16:15.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.391+0000 7f9716c45640 1 -- 172.21.15.102:0/2509957175 learned_addr learned my addr 172.21.15.102:0/2509957175 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:15.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.391+0000 7f9716c45640 1 -- 172.21.15.102:0/2509957175 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647a7afebc0 con 0x5647a7bd96b0 2024-09-13T19:16:15.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.391+0000 7f9716c45640 1 --2- 172.21.15.102:0/2509957175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647a7bd96b0 0x5647a7c65b00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f970800b230 tx=0x7f970800b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=374f9223b4c96671 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.391+0000 7f9604e09640 1 -- 172.21.15.102:0/2509957175 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f970800e5c0 con 0x5647a7bd96b0 2024-09-13T19:16:15.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.391+0000 7f9604e09640 1 -- 172.21.15.102:0/2509957175 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9708006070 con 0x5647a7bd96b0 2024-09-13T19:16:15.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.391+0000 7f9604e09640 1 -- 172.21.15.102:0/2509957175 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f970800e890 con 0x5647a7bd96b0 2024-09-13T19:16:15.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.392+0000 7f9719151800 1 -- 172.21.15.102:0/2509957175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647a7bd96b0 msgr2=0x5647a7c65b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.392+0000 7f9719151800 1 --2- 172.21.15.102:0/2509957175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647a7bd96b0 0x5647a7c65b00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f970800b230 tx=0x7f970800b6f0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.392+0000 7f9719151800 1 -- 172.21.15.102:0/2509957175 shutdown_connections 2024-09-13T19:16:15.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.392+0000 7f9719151800 1 --2- 172.21.15.102:0/2509957175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647a7bd96b0 0x5647a7c65b00 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.392+0000 7f9719151800 1 -- 172.21.15.102:0/2509957175 >> 172.21.15.102:0/2509957175 conn(0x5647a7c5fde0 msgr2=0x5647a7d50240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:15.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.392+0000 7f9719151800 1 -- 172.21.15.102:0/2509957175 shutdown_connections 2024-09-13T19:16:15.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.392+0000 7f9719151800 1 -- 172.21.15.102:0/2509957175 wait complete. 2024-09-13T19:16:15.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.393+0000 7f9719151800 1 Processor -- start 2024-09-13T19:16:15.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.393+0000 7f9719151800 1 -- start start 2024-09-13T19:16:15.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.393+0000 7f9719151800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647a7bd96b0 0x5647a7d5e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.393+0000 7f9719151800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5647a7c6c680 con 0x5647a7bd96b0 2024-09-13T19:16:15.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.393+0000 7f9716c45640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647a7bd96b0 0x5647a7d5e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.393+0000 7f9716c45640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647a7bd96b0 0x5647a7d5e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54080/0 (socket says 172.21.15.102:54080) 2024-09-13T19:16:15.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.393+0000 7f9716c45640 1 -- 172.21.15.102:0/811702586 learned_addr learned my addr 172.21.15.102:0/811702586 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:15.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.393+0000 7f9716c45640 1 -- 172.21.15.102:0/811702586 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647a7b12fe0 con 0x5647a7bd96b0 2024-09-13T19:16:15.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.393+0000 7f9716c45640 1 --2- 172.21.15.102:0/811702586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647a7bd96b0 0x5647a7d5e540 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9708000c00 tx=0x7f9708000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.394+0000 7f9603606640 1 -- 172.21.15.102:0/811702586 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f970800f8d0 con 0x5647a7bd96b0 2024-09-13T19:16:15.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.394+0000 7f9603606640 1 -- 172.21.15.102:0/811702586 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f970800fa90 con 0x5647a7bd96b0 2024-09-13T19:16:15.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.394+0000 7f9719151800 1 -- 172.21.15.102:0/811702586 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5647a7d5ea80 con 0x5647a7bd96b0 2024-09-13T19:16:15.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.394+0000 7f9603606640 1 -- 172.21.15.102:0/811702586 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f970800fdb0 con 0x5647a7bd96b0 2024-09-13T19:16:15.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.394+0000 7f9719151800 1 -- 172.21.15.102:0/811702586 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647a7d5efa0 con 0x5647a7bd96b0 2024-09-13T19:16:15.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.394+0000 7f9603606640 1 -- 172.21.15.102:0/811702586 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9708017070 con 0x5647a7bd96b0 2024-09-13T19:16:15.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.395+0000 7f9603606640 1 --2- 172.21.15.102:0/811702586 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f95fc036be0 0x7f95fc0390a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.395+0000 7f9603606640 1 -- 172.21.15.102:0/811702586 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f9708015020 con 0x5647a7bd96b0 2024-09-13T19:16:15.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.395+0000 7f9716444640 1 --2- 172.21.15.102:0/811702586 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f95fc036be0 0x7f95fc0390a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.395+0000 7f9719151800 1 --2- 172.21.15.102:0/811702586 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5647a7c698f0 0x5647a7d655b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.395+0000 7f9719151800 1 -- 172.21.15.102:0/811702586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5647a7d65b80 con 0x5647a7c698f0 2024-09-13T19:16:15.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.395+0000 7f9717446640 1 --2- 172.21.15.102:0/811702586 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5647a7c698f0 0x5647a7d655b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.395+0000 7f9716444640 1 --2- 172.21.15.102:0/811702586 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f95fc036be0 0x7f95fc0390a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9700057000 tx=0x7f9700052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.395+0000 7f9717446640 1 --2- 172.21.15.102:0/811702586 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5647a7c698f0 0x5647a7d655b0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.396+0000 7f9717446640 1 -- 172.21.15.102:0/811702586 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f971000a4a0 con 0x5647a7c698f0 2024-09-13T19:16:15.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.396+0000 7f9719151800 1 -- 172.21.15.102:0/811702586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5647a7d62b80 con 0x5647a7c698f0 2024-09-13T19:16:15.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.396+0000 7f9717446640 1 -- 172.21.15.102:0/811702586 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f971000a4a0 con 0x5647a7c698f0 2024-09-13T19:16:15.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.396+0000 7f9719151800 1 --2- 172.21.15.102:0/811702586 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5647a7d67e90 0x5647a7d6a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.396+0000 7f9719151800 1 -- 172.21.15.102:0/811702586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5647a7d6a920 con 0x5647a7d67e90 2024-09-13T19:16:15.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.396+0000 7f9716c45640 1 --2- 172.21.15.102:0/811702586 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5647a7d67e90 0x5647a7d6a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.396+0000 7f9716c45640 1 --2- 172.21.15.102:0/811702586 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5647a7d67e90 0x5647a7d6a280 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.396+0000 7f9716c45640 1 -- 172.21.15.102:0/811702586 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f970802e070 con 0x5647a7d67e90 2024-09-13T19:16:15.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.396+0000 7f9719151800 1 -- 172.21.15.102:0/811702586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5647a7d66d30 con 0x5647a7c698f0 2024-09-13T19:16:15.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.397+0000 7f9717446640 1 -- 172.21.15.102:0/811702586 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f971000a4a0 con 0x5647a7c698f0 2024-09-13T19:16:15.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.397+0000 7f9719151800 1 -- 172.21.15.102:0/811702586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5647a7d67210 con 0x5647a7d67e90 2024-09-13T19:16:15.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.397+0000 7f9716c45640 1 -- 172.21.15.102:0/811702586 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f970802e070 con 0x5647a7d67e90 2024-09-13T19:16:15.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.397+0000 7f9719151800 1 Processor -- start 2024-09-13T19:16:15.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.397+0000 7f9719151800 1 -- start start 2024-09-13T19:16:15.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.398+0000 7f9719151800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647a7d79220 0x5647a7d79640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.398+0000 7f9719151800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5647a7b00580 con 0x5647a7d79220 2024-09-13T19:16:15.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.398+0000 7f9717446640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647a7d79220 0x5647a7d79640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.398+0000 7f9717446640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647a7d79220 0x5647a7d79640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54082/0 (socket says 172.21.15.102:54082) 2024-09-13T19:16:15.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.398+0000 7f9717446640 1 -- 172.21.15.102:0/1900077174 learned_addr learned my addr 172.21.15.102:0/1900077174 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:15.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.398+0000 7f9717446640 1 -- 172.21.15.102:0/1900077174 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647a7d79b80 con 0x5647a7d79220 2024-09-13T19:16:15.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.399+0000 7f9717446640 1 --2- 172.21.15.102:0/1900077174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647a7d79220 0x5647a7d79640 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x5647a7d5f5f0 tx=0x7f97100167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.399+0000 7f9600e01640 1 -- 172.21.15.102:0/1900077174 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9710013640 con 0x5647a7d79220 2024-09-13T19:16:15.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.399+0000 7f9600e01640 1 -- 172.21.15.102:0/1900077174 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97100137e0 con 0x5647a7d79220 2024-09-13T19:16:15.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.399+0000 7f9719151800 1 -- 172.21.15.102:0/1900077174 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5647a7d79e10 con 0x5647a7d79220 2024-09-13T19:16:15.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.399+0000 7f9600e01640 1 -- 172.21.15.102:0/1900077174 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9710013ae0 con 0x5647a7d79220 2024-09-13T19:16:15.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.399+0000 7f9719151800 1 -- 172.21.15.102:0/1900077174 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647a7d7caf0 con 0x5647a7d79220 2024-09-13T19:16:15.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.399+0000 7f9600e01640 1 -- 172.21.15.102:0/1900077174 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9710011040 con 0x5647a7d79220 2024-09-13T19:16:15.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.400+0000 7f9600e01640 1 --2- 172.21.15.102:0/1900077174 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f95f0036b90 0x7f95f0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.400+0000 7f9600e01640 1 -- 172.21.15.102:0/1900077174 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f971000e040 con 0x5647a7d79220 2024-09-13T19:16:15.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.400+0000 7f9716c45640 1 --2- 172.21.15.102:0/1900077174 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f95f0036b90 0x7f95f0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.400+0000 7f9719151800 1 Processor -- start 2024-09-13T19:16:15.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.400+0000 7f9719151800 1 -- start start 2024-09-13T19:16:15.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.400+0000 7f9716c45640 1 --2- 172.21.15.102:0/1900077174 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f95f0036b90 0x7f95f0039050 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f970804b910 tx=0x7f970804b7e0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.400+0000 7f9719151800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647a7d85ef0 0x5647a7d862f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.400+0000 7f9719151800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5647a7c641d0 con 0x5647a7d85ef0 2024-09-13T19:16:15.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.401+0000 7f9717446640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647a7d85ef0 0x5647a7d862f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.401+0000 7f9717446640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647a7d85ef0 0x5647a7d862f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54088/0 (socket says 172.21.15.102:54088) 2024-09-13T19:16:15.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.401+0000 7f9717446640 1 -- 172.21.15.102:0/1550625530 learned_addr learned my addr 172.21.15.102:0/1550625530 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:15.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.401+0000 7f9717446640 1 -- 172.21.15.102:0/1550625530 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647a7d868c0 con 0x5647a7d85ef0 2024-09-13T19:16:15.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.401+0000 7f9717446640 1 --2- 172.21.15.102:0/1550625530 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647a7d85ef0 0x5647a7d862f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f971004ce10 tx=0x7f9710020450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77f75d31c23349c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.401+0000 7f95fa7fc640 1 -- 172.21.15.102:0/1550625530 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9710012c00 con 0x5647a7d85ef0 2024-09-13T19:16:15.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.401+0000 7f95fa7fc640 1 -- 172.21.15.102:0/1550625530 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9710021960 con 0x5647a7d85ef0 2024-09-13T19:16:15.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.401+0000 7f95fa7fc640 1 -- 172.21.15.102:0/1550625530 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9710021440 con 0x5647a7d85ef0 2024-09-13T19:16:15.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.402+0000 7f9719151800 1 -- 172.21.15.102:0/1550625530 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647a7d85ef0 msgr2=0x5647a7d862f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.402+0000 7f9719151800 1 --2- 172.21.15.102:0/1550625530 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647a7d85ef0 0x5647a7d862f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f971004ce10 tx=0x7f9710020450 comp rx=0 tx=0).stop 2024-09-13T19:16:15.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.402+0000 7f9719151800 1 -- 172.21.15.102:0/1550625530 shutdown_connections 2024-09-13T19:16:15.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.402+0000 7f9719151800 1 --2- 172.21.15.102:0/1550625530 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647a7d85ef0 0x5647a7d862f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.402+0000 7f9719151800 1 -- 172.21.15.102:0/1550625530 >> 172.21.15.102:0/1550625530 conn(0x5647a7d82250 msgr2=0x5647a7d803a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:15.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.402+0000 7f9719151800 1 -- 172.21.15.102:0/1550625530 shutdown_connections 2024-09-13T19:16:15.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.402+0000 7f9719151800 1 -- 172.21.15.102:0/1550625530 wait complete. 2024-09-13T19:16:15.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.402+0000 7f9719151800 1 Processor -- start 2024-09-13T19:16:15.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.402+0000 7f9719151800 1 -- start start 2024-09-13T19:16:15.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.402+0000 7f9719151800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647a7d85ef0 0x5647a7d8d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.402+0000 7f9719151800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5647a7d86e90 con 0x5647a7d85ef0 2024-09-13T19:16:15.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.402+0000 7f9717446640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647a7d85ef0 0x5647a7d8d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.402+0000 7f9717446640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647a7d85ef0 0x5647a7d8d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54102/0 (socket says 172.21.15.102:54102) 2024-09-13T19:16:15.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.402+0000 7f9717446640 1 -- 172.21.15.102:0/3577411909 learned_addr learned my addr 172.21.15.102:0/3577411909 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:15.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.403+0000 7f9717446640 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647a7d8d920 con 0x5647a7d85ef0 2024-09-13T19:16:15.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.403+0000 7f9717446640 1 --2- 172.21.15.102:0/3577411909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647a7d85ef0 0x5647a7d8d3e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f971003d040 tx=0x7f971000af70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.403+0000 7f95f8ff9640 1 -- 172.21.15.102:0/3577411909 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9710039070 con 0x5647a7d85ef0 2024-09-13T19:16:15.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.403+0000 7f95f8ff9640 1 -- 172.21.15.102:0/3577411909 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f971004cfe0 con 0x5647a7d85ef0 2024-09-13T19:16:15.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.403+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5647a7d8dbb0 con 0x5647a7d85ef0 2024-09-13T19:16:15.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.403+0000 7f95f8ff9640 1 -- 172.21.15.102:0/3577411909 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9710021590 con 0x5647a7d85ef0 2024-09-13T19:16:15.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.403+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647a7d90860 con 0x5647a7d85ef0 2024-09-13T19:16:15.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.403+0000 7f95f8ff9640 1 -- 172.21.15.102:0/3577411909 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f971004eb30 con 0x5647a7d85ef0 2024-09-13T19:16:15.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.404+0000 7f95f8ff9640 1 --2- 172.21.15.102:0/3577411909 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f95e0036af0 0x7f95e0038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.404+0000 7f95f8ff9640 1 -- 172.21.15.102:0/3577411909 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f9710031050 con 0x5647a7d85ef0 2024-09-13T19:16:15.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.404+0000 7f9716c45640 1 --2- 172.21.15.102:0/3577411909 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f95e0036af0 0x7f95e0038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.404+0000 7f9716c45640 1 --2- 172.21.15.102:0/3577411909 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f95e0036af0 0x7f95e0038fb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f970801dfd0 tx=0x7f9708031000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.404+0000 7f9719151800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.404+0000 7f9719151800 1 --2- 172.21.15.102:0/3577411909 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5647a7d98e40 0x5647a7d9b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.404+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5647a7d9ba50 con 0x5647a7d98e40 2024-09-13T19:16:15.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.405+0000 7f9716444640 1 --2- 172.21.15.102:0/3577411909 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5647a7d98e40 0x5647a7d9b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.405+0000 7f9716444640 1 --2- 172.21.15.102:0/3577411909 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5647a7d98e40 0x5647a7d9b300 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.405+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9700057030 con 0x5647a7d98e40 2024-09-13T19:16:15.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.405+0000 7f9719151800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.405+0000 7f9719151800 20 realm 2024-09-13T19:16:15.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.405+0000 7f9719151800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.405+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5647a7d9be80 con 0x5647a7d98e40 2024-09-13T19:16:15.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.405+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9700057030 con 0x5647a7d98e40 2024-09-13T19:16:15.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.405+0000 7f9719151800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.405+0000 7f9719151800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:15.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.405+0000 7f9719151800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.405+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5647a7d9c750 con 0x5647a7d98e40 2024-09-13T19:16:15.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.406+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9700057030 con 0x5647a7d98e40 2024-09-13T19:16:15.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.406+0000 7f9719151800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.406+0000 7f9719151800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.406+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5647a7d9caf0 con 0x5647a7d98e40 2024-09-13T19:16:15.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.406+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9700057030 con 0x5647a7d98e40 2024-09-13T19:16:15.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.406+0000 7f9719151800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:15.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.406+0000 7f9719151800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.406+0000 7f9719151800 1 --2- 172.21.15.102:0/3577411909 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5647a7d9d850 0x5647a7d9fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.406+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da0250 con 0x5647a7d9d850 2024-09-13T19:16:15.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.406+0000 7f9717446640 1 --2- 172.21.15.102:0/3577411909 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5647a7d9d850 0x5647a7d9fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.406+0000 7f9717446640 1 --2- 172.21.15.102:0/3577411909 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5647a7d9d850 0x5647a7d9fc40 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.406+0000 7f9717446640 1 -- 172.21.15.102:0/3577411909 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f971003b030 con 0x5647a7d9d850 2024-09-13T19:16:15.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.407+0000 7f9719151800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:15.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.407+0000 7f9719151800 20 searching for the correct realm 2024-09-13T19:16:15.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.407+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da1ba0 con 0x5647a7d9d850 2024-09-13T19:16:15.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.407+0000 7f9717446640 1 -- 172.21.15.102:0/3577411909 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f971003b030 con 0x5647a7d9d850 2024-09-13T19:16:15.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.407+0000 7f9717446640 1 --2- 172.21.15.102:0/3577411909 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f971004b290 0x7f971003fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.407+0000 7f9717446640 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da1ba0 con 0x7f971004b290 2024-09-13T19:16:15.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.407+0000 7f9716c45640 1 --2- 172.21.15.102:0/3577411909 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f971004b290 0x7f971003fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.407+0000 7f9716c45640 1 --2- 172.21.15.102:0/3577411909 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f971004b290 0x7f971003fa20 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.407+0000 7f9716c45640 1 -- 172.21.15.102:0/3577411909 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f970802e070 con 0x7f971004b290 2024-09-13T19:16:15.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.407+0000 7f9716c45640 1 --2- 172.21.15.102:0/3577411909 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f970803d040 0x7f970804d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.407+0000 7f9716c45640 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da1ba0 con 0x7f970803d040 2024-09-13T19:16:15.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.408+0000 7f9716444640 1 --2- 172.21.15.102:0/3577411909 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f970803d040 0x7f970804d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.408+0000 7f9716444640 1 --2- 172.21.15.102:0/3577411909 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f970803d040 0x7f970804d610 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.408+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9700057030 con 0x7f970803d040 2024-09-13T19:16:15.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.408+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da1ba0 con 0x5647a7d98e40 2024-09-13T19:16:15.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.409+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9700057030 con 0x5647a7d98e40 2024-09-13T19:16:15.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.409+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da1ba0 con 0x5647a7d98e40 2024-09-13T19:16:15.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.409+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9700057030 con 0x5647a7d98e40 2024-09-13T19:16:15.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.409+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da1ba0 con 0x7f970803d040 2024-09-13T19:16:15.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.409+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9700057030 con 0x7f970803d040 2024-09-13T19:16:15.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.409+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da1ba0 con 0x7f970803d040 2024-09-13T19:16:15.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.409+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9700057030 con 0x7f970803d040 2024-09-13T19:16:15.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.409+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da1ba0 con 0x7f971004b290 2024-09-13T19:16:15.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.410+0000 7f9716c45640 1 -- 172.21.15.102:0/3577411909 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f970802e070 con 0x7f971004b290 2024-09-13T19:16:15.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.410+0000 7f9716c45640 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da1ba0 con 0x5647a7d9d850 2024-09-13T19:16:15.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.410+0000 7f9717446640 1 -- 172.21.15.102:0/3577411909 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f971003b030 con 0x5647a7d9d850 2024-09-13T19:16:15.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.410+0000 7f9717446640 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da1ba0 con 0x5647a7d98e40 2024-09-13T19:16:15.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.410+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9700057030 con 0x5647a7d98e40 2024-09-13T19:16:15.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.410+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da1ba0 con 0x7f970803d040 2024-09-13T19:16:15.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.410+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9700057030 con 0x7f970803d040 2024-09-13T19:16:15.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.410+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da1ba0 con 0x5647a7d98e40 2024-09-13T19:16:15.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.411+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9700057030 con 0x5647a7d98e40 2024-09-13T19:16:15.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.411+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da1ba0 con 0x7f971004b290 2024-09-13T19:16:15.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.411+0000 7f9716c45640 1 -- 172.21.15.102:0/3577411909 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f970802e070 con 0x7f971004b290 2024-09-13T19:16:15.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.411+0000 7f9716c45640 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da1ba0 con 0x5647a7d9d850 2024-09-13T19:16:15.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.411+0000 7f9717446640 1 -- 172.21.15.102:0/3577411909 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f971003b030 con 0x5647a7d9d850 2024-09-13T19:16:15.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.411+0000 7f9717446640 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da1ba0 con 0x5647a7d9d850 2024-09-13T19:16:15.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.411+0000 7f9717446640 1 -- 172.21.15.102:0/3577411909 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f971003b030 con 0x5647a7d9d850 2024-09-13T19:16:15.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.411+0000 7f9717446640 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da1ba0 con 0x7f970803d040 2024-09-13T19:16:15.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.412+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9700057030 con 0x7f970803d040 2024-09-13T19:16:15.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.412+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da1ba0 con 0x5647a7d9d850 2024-09-13T19:16:15.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.412+0000 7f9717446640 1 -- 172.21.15.102:0/3577411909 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f971003b030 con 0x5647a7d9d850 2024-09-13T19:16:15.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.412+0000 7f9717446640 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da1ba0 con 0x5647a7d9d850 2024-09-13T19:16:15.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.412+0000 7f9717446640 1 -- 172.21.15.102:0/3577411909 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f971003b030 con 0x5647a7d9d850 2024-09-13T19:16:15.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.412+0000 7f9717446640 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da1ba0 con 0x5647a7d98e40 2024-09-13T19:16:15.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.412+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9700057030 con 0x5647a7d98e40 2024-09-13T19:16:15.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.412+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da1ba0 con 0x5647a7d98e40 2024-09-13T19:16:15.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.412+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9700057030 con 0x5647a7d98e40 2024-09-13T19:16:15.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.412+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da1ba0 con 0x7f970803d040 2024-09-13T19:16:15.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.413+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9700057030 con 0x7f970803d040 2024-09-13T19:16:15.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.413+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da1ba0 con 0x5647a7d9d850 2024-09-13T19:16:15.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.413+0000 7f9717446640 1 -- 172.21.15.102:0/3577411909 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f971003b030 con 0x5647a7d9d850 2024-09-13T19:16:15.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.413+0000 7f9717446640 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da1ba0 con 0x7f971004b290 2024-09-13T19:16:15.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.413+0000 7f9716c45640 1 -- 172.21.15.102:0/3577411909 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f970802e070 con 0x7f971004b290 2024-09-13T19:16:15.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.413+0000 7f9716c45640 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da1ba0 con 0x5647a7d98e40 2024-09-13T19:16:15.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.413+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9700057030 con 0x5647a7d98e40 2024-09-13T19:16:15.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.413+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da1ba0 con 0x7f970803d040 2024-09-13T19:16:15.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.414+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9700057030 con 0x7f970803d040 2024-09-13T19:16:15.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.414+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da1ba0 con 0x5647a7d9d850 2024-09-13T19:16:15.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.414+0000 7f9717446640 1 -- 172.21.15.102:0/3577411909 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f971003b030 con 0x5647a7d9d850 2024-09-13T19:16:15.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.414+0000 7f9717446640 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da1ba0 con 0x7f970803d040 2024-09-13T19:16:15.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.414+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9700057030 con 0x7f970803d040 2024-09-13T19:16:15.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.414+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da1ba0 con 0x7f971004b290 2024-09-13T19:16:15.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.414+0000 7f9716c45640 1 -- 172.21.15.102:0/3577411909 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f970802e070 con 0x7f971004b290 2024-09-13T19:16:15.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.414+0000 7f9716c45640 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da1ba0 con 0x5647a7d9d850 2024-09-13T19:16:15.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.415+0000 7f9717446640 1 -- 172.21.15.102:0/3577411909 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f971003b030 con 0x5647a7d9d850 2024-09-13T19:16:15.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.415+0000 7f9717446640 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da1ba0 con 0x7f970803d040 2024-09-13T19:16:15.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.415+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9700057030 con 0x7f970803d040 2024-09-13T19:16:15.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.415+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da1ba0 con 0x5647a7d98e40 2024-09-13T19:16:15.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.415+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9700057030 con 0x5647a7d98e40 2024-09-13T19:16:15.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.415+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f970008a080 con 0x7f971004b290 2024-09-13T19:16:15.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.415+0000 7f9716c45640 1 -- 172.21.15.102:0/3577411909 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f970802e070 con 0x7f971004b290 2024-09-13T19:16:15.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.415+0000 7f9719151800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:15.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.415+0000 7f9719151800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:15.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.415+0000 7f9719151800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:15.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.415+0000 7f9719151800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:15.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.415+0000 7f9719151800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:15.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.415+0000 7f9719151800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:15.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.415+0000 7f9719151800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.415+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da0c10 con 0x5647a7d98e40 2024-09-13T19:16:15.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.416+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9700057030 con 0x5647a7d98e40 2024-09-13T19:16:15.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.416+0000 7f9719151800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.416+0000 7f9719151800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.416+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da14b0 con 0x5647a7d98e40 2024-09-13T19:16:15.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.416+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9700057030 con 0x5647a7d98e40 2024-09-13T19:16:15.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.416+0000 7f9719151800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:15.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.416+0000 7f9719151800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.416+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da2020 con 0x5647a7d9d850 2024-09-13T19:16:15.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.416+0000 7f9717446640 1 -- 172.21.15.102:0/3577411909 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f971003b030 con 0x5647a7d9d850 2024-09-13T19:16:15.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.416+0000 7f9719151800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:15.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.416+0000 7f9719151800 20 zone default found 2024-09-13T19:16:15.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.416+0000 7f9719151800 4 Realm: () 2024-09-13T19:16:15.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.416+0000 7f9719151800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:15.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.416+0000 7f9719151800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:15.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.416+0000 7f9719151800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:15.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.416+0000 7f9719151800 20 zonegroup default 2024-09-13T19:16:15.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.416+0000 7f9719151800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.416+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da2870 con 0x7f970803d040 2024-09-13T19:16:15.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.417+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9700057030 con 0x7f970803d040 2024-09-13T19:16:15.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.417+0000 7f9719151800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.417+0000 7f9719151800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.417+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da4250 con 0x5647a7d9d850 2024-09-13T19:16:15.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.417+0000 7f9717446640 1 -- 172.21.15.102:0/3577411909 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f971003b030 con 0x5647a7d9d850 2024-09-13T19:16:15.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.417+0000 7f9719151800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.417+0000 7f9719151800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.417+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da4640 con 0x5647a7d9d850 2024-09-13T19:16:15.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.417+0000 7f9717446640 1 -- 172.21.15.102:0/3577411909 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f971003b030 con 0x5647a7d9d850 2024-09-13T19:16:15.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.417+0000 7f9719151800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.417+0000 7f9719151800 20 started sync module instance, tier type = 2024-09-13T19:16:15.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.417+0000 7f9719151800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:15.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.417+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da36e0 con 0x7f971004b290 2024-09-13T19:16:15.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.418+0000 7f9716c45640 1 -- 172.21.15.102:0/3577411909 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(44 notify.0 [create] v34'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f970802e070 con 0x7f971004b290 2024-09-13T19:16:15.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.418+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94865758763776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da3340 con 0x7f971004b290 2024-09-13T19:16:15.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.418+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da5450 con 0x5647a7d98e40 2024-09-13T19:16:15.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.419+0000 7f9716c45640 1 -- 172.21.15.102:0/3577411909 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94865758763776] v34'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f970802e070 con 0x7f971004b290 2024-09-13T19:16:15.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.420+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v34'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9700057030 con 0x5647a7d98e40 2024-09-13T19:16:15.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.420+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94865758767728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da5840 con 0x5647a7d98e40 2024-09-13T19:16:15.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.420+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da62a0 con 0x5647a7d9d850 2024-09-13T19:16:15.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.421+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94865758767728] v34'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9700057030 con 0x5647a7d98e40 2024-09-13T19:16:15.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.421+0000 7f9717446640 1 -- 172.21.15.102:0/3577411909 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v34'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f971003b030 con 0x5647a7d9d850 2024-09-13T19:16:15.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.421+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94865758772560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da6260 con 0x5647a7d9d850 2024-09-13T19:16:15.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.421+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da6d30 con 0x7f971004b290 2024-09-13T19:16:15.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.422+0000 7f9717446640 1 -- 172.21.15.102:0/3577411909 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94865758772560] v34'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f971003b030 con 0x5647a7d9d850 2024-09-13T19:16:15.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.422+0000 7f9716c45640 1 -- 172.21.15.102:0/3577411909 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(50 notify.3 [create] v34'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f970802e070 con 0x7f971004b290 2024-09-13T19:16:15.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.422+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94865758775296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da7120 con 0x7f971004b290 2024-09-13T19:16:15.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.422+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da7b60 con 0x5647a7d98e40 2024-09-13T19:16:15.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.423+0000 7f9716c45640 1 -- 172.21.15.102:0/3577411909 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94865758775296] v34'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f970802e070 con 0x7f971004b290 2024-09-13T19:16:15.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.423+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v34'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9700057030 con 0x5647a7d98e40 2024-09-13T19:16:15.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.423+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94865758778928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da7f50 con 0x5647a7d98e40 2024-09-13T19:16:15.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.423+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da8980 con 0x7f970803d040 2024-09-13T19:16:15.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.424+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94865758778928] v34'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9700057030 con 0x5647a7d98e40 2024-09-13T19:16:15.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.424+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(54 notify.5 [create] v34'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9700057030 con 0x7f970803d040 2024-09-13T19:16:15.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.424+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94865758782608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da8980 con 0x7f970803d040 2024-09-13T19:16:15.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.424+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da9400 con 0x7f970803d040 2024-09-13T19:16:15.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.425+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94865758782608] v34'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9700057030 con 0x7f970803d040 2024-09-13T19:16:15.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.425+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(56 notify.6 [create] v34'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9700057030 con 0x7f970803d040 2024-09-13T19:16:15.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.425+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94865758768784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da93c0 con 0x7f970803d040 2024-09-13T19:16:15.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.425+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da9d80 con 0x7f970803d040 2024-09-13T19:16:15.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.426+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(58 notify.7 [create] v34'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9700057030 con 0x7f970803d040 2024-09-13T19:16:15.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.426+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94865758787792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5647a7daa1a0 con 0x7f970803d040 2024-09-13T19:16:15.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.426+0000 7f9719151800 20 add_watcher() i=0 2024-09-13T19:16:15.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.426+0000 7f9719151800 20 add_watcher() i=1 2024-09-13T19:16:15.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.426+0000 7f9719151800 20 add_watcher() i=2 2024-09-13T19:16:15.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.426+0000 7f9719151800 20 add_watcher() i=3 2024-09-13T19:16:15.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.426+0000 7f9719151800 20 add_watcher() i=4 2024-09-13T19:16:15.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.426+0000 7f9719151800 20 add_watcher() i=5 2024-09-13T19:16:15.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.426+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94865758768784] v34'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9700057030 con 0x7f970803d040 2024-09-13T19:16:15.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.426+0000 7f9719151800 20 add_watcher() i=6 2024-09-13T19:16:15.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.427+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94865758787792] v34'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9700057030 con 0x7f970803d040 2024-09-13T19:16:15.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.427+0000 7f9719151800 20 add_watcher() i=7 2024-09-13T19:16:15.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.427+0000 7f9719151800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:15.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.427+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5647a7da8f10 con 0x5647a7d98e40 2024-09-13T19:16:15.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.427+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9700057030 con 0x5647a7d98e40 2024-09-13T19:16:15.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.428+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94865758785296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5647a7daa6e0 con 0x5647a7d98e40 2024-09-13T19:16:15.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.428+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94865758785296] v34'60 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9700057030 con 0x5647a7d98e40 2024-09-13T19:16:15.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.428+0000 7f95cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:15.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.429+0000 7f9719151800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:15.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.429+0000 7f9719151800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:15.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.429+0000 7f9719151800 5 note: GC not initialized 2024-09-13T19:16:15.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.429+0000 7f9547fff640 20 reqs_thread_entry: start 2024-09-13T19:16:15.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.429+0000 7f9719151800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:15.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.429+0000 7f9719151800 20 Filter name: none 2024-09-13T19:16:15.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.429+0000 7f9545ffb640 20 reqs_thread_entry: start 2024-09-13T19:16:15.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.429+0000 7f9719151800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:16:15.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.429+0000 7f9719151800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.429+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5647a7de05c0 con 0x5647a7d98e40 2024-09-13T19:16:15.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.430+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f9700057030 con 0x5647a7d98e40 2024-09-13T19:16:15.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.430+0000 7f9719151800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:16:15.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.430+0000 7f9719151800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:16:15.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.430+0000 7f9719151800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:16:15.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.430+0000 7f9719151800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:16:15.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.430+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5647a7de00e0 con 0x7f971004b290 2024-09-13T19:16:15.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.430+0000 7f9716c45640 1 -- 172.21.15.102:0/3577411909 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f970802e070 con 0x7f971004b290 2024-09-13T19:16:15.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.430+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5647a7de6930 con 0x5647a7d98e40 2024-09-13T19:16:15.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.431+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v34'3 uv3 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f9700057030 con 0x5647a7d98e40 2024-09-13T19:16:15.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.431+0000 7f9719151800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:16:15.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.431+0000 7f9719151800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:16:15.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.431+0000 7f9719151800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T19:16:15.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.431+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94865759036368 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5647a7de35a0 con 0x5647a7d98e40 2024-09-13T19:16:15.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.431+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== watch-notify(notify (1) cookie 94865758778928 notify 146028888066 ret 0) ==== 609+0+0 (crc 0 0 0) 0x5647a7b2ce00 con 0x5647a7d98e40 2024-09-13T19:16:15.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.431+0000 7f95fa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888066 cookie 94865758778928 notifier 4335 bl.length()=567 2024-09-13T19:16:15.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.431+0000 7f95fa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:16:15.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.431+0000 7f95fa7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:16:15.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.431+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(65 notify.4 [notify cookie 94865759036368 out=8b] v0'0 uv39 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9700057030 con 0x5647a7d98e40 2024-09-13T19:16:15.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.431+0000 7f95fa7fc640 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f95dc003ea0 con 0x5647a7d98e40 2024-09-13T19:16:15.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.432+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9700057030 con 0x5647a7d98e40 2024-09-13T19:16:15.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.432+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== watch-notify(notify_complete (2) cookie 94865759036368 notify 146028888066 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f970005bd40 con 0x5647a7d98e40 2024-09-13T19:16:15.455 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:16:14.779675Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:16:14.779665Z","tags":[],"group_ids":[]} 2024-09-13T19:16:15.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.432+0000 7f95cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:15.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.433+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94865758785296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5647a7dde310 con 0x5647a7d98e40 2024-09-13T19:16:15.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.433+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94865758785296] v34'61 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9700057030 con 0x5647a7d98e40 2024-09-13T19:16:15.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.433+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94865758763776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5647a7dde310 con 0x7f971004b290 2024-09-13T19:16:15.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.434+0000 7f9716c45640 1 -- 172.21.15.102:0/3577411909 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94865758763776] v34'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f970802e070 con 0x7f971004b290 2024-09-13T19:16:15.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.435+0000 7f9719151800 20 remove_watcher() i=0 2024-09-13T19:16:15.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.435+0000 7f9719151800 2 removed watcher, disabling cache 2024-09-13T19:16:15.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.435+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94865758767728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5647a7dde310 con 0x5647a7d98e40 2024-09-13T19:16:15.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.436+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 <== osd.1 v2:172.21.15.102:6808/2204418452 28 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94865758767728] v34'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9700057030 con 0x5647a7d98e40 2024-09-13T19:16:15.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.436+0000 7f9719151800 20 remove_watcher() i=1 2024-09-13T19:16:15.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.436+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94865758772560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5647a7dde310 con 0x5647a7d9d850 2024-09-13T19:16:15.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.437+0000 7f9717446640 1 -- 172.21.15.102:0/3577411909 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94865758772560] v34'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f971003b030 con 0x5647a7d9d850 2024-09-13T19:16:15.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.437+0000 7f9719151800 20 remove_watcher() i=2 2024-09-13T19:16:15.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.437+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94865758775296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5647a7dde310 con 0x7f971004b290 2024-09-13T19:16:15.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.438+0000 7f9716c45640 1 -- 172.21.15.102:0/3577411909 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94865758775296] v34'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f970802e070 con 0x7f971004b290 2024-09-13T19:16:15.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.438+0000 7f9719151800 20 remove_watcher() i=3 2024-09-13T19:16:15.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.438+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94865758778928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5647a7dde310 con 0x5647a7d98e40 2024-09-13T19:16:15.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.439+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 <== osd.1 v2:172.21.15.102:6808/2204418452 29 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94865758778928] v34'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9700057030 con 0x5647a7d98e40 2024-09-13T19:16:15.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.439+0000 7f9719151800 20 remove_watcher() i=4 2024-09-13T19:16:15.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.439+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94865758782608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5647a7dde310 con 0x7f970803d040 2024-09-13T19:16:15.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.440+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94865758782608] v34'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9700057030 con 0x7f970803d040 2024-09-13T19:16:15.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.440+0000 7f9719151800 20 remove_watcher() i=5 2024-09-13T19:16:15.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.440+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94865758768784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5647a7dde310 con 0x7f970803d040 2024-09-13T19:16:15.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.441+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94865758768784] v34'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9700057030 con 0x7f970803d040 2024-09-13T19:16:15.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.441+0000 7f9719151800 20 remove_watcher() i=6 2024-09-13T19:16:15.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.441+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94865758787792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5647a7dde310 con 0x7f970803d040 2024-09-13T19:16:15.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.442+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94865758787792] v34'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9700057030 con 0x7f970803d040 2024-09-13T19:16:15.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.442+0000 7f9719151800 20 remove_watcher() i=7 2024-09-13T19:16:15.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.442+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f970803d040 msgr2=0x7f970804d610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.442+0000 7f9719151800 1 --2- 172.21.15.102:0/3577411909 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f970803d040 0x7f970804d610 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.442+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5647a7d98e40 msgr2=0x5647a7d9b300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.442+0000 7f9719151800 1 --2- 172.21.15.102:0/3577411909 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5647a7d98e40 0x5647a7d9b300 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.442+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f971004b290 msgr2=0x7f971003fa20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.442+0000 7f9719151800 1 --2- 172.21.15.102:0/3577411909 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f971004b290 0x7f971003fa20 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.442+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5647a7d9d850 msgr2=0x5647a7d9fc40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.442+0000 7f9719151800 1 --2- 172.21.15.102:0/3577411909 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5647a7d9d850 0x5647a7d9fc40 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.442+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f95e0036af0 msgr2=0x7f95e0038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.442+0000 7f9719151800 1 --2- 172.21.15.102:0/3577411909 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f95e0036af0 0x7f95e0038fb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f970801dfd0 tx=0x7f9708031000 comp rx=0 tx=0).stop 2024-09-13T19:16:15.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.442+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647a7d85ef0 msgr2=0x5647a7d8d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.442+0000 7f9716444640 1 -- 172.21.15.102:0/3577411909 reap_dead start 2024-09-13T19:16:15.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.442+0000 7f9719151800 1 --2- 172.21.15.102:0/3577411909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647a7d85ef0 0x5647a7d8d3e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f971003d040 tx=0x7f971000af70 comp rx=0 tx=0).stop 2024-09-13T19:16:15.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.442+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 shutdown_connections 2024-09-13T19:16:15.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.442+0000 7f9719151800 1 --2- 172.21.15.102:0/3577411909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647a7d85ef0 0x5647a7d8d3e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.442+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 >> 172.21.15.102:0/3577411909 conn(0x5647a7d82250 msgr2=0x5647a7d80310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:15.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.442+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 shutdown_connections 2024-09-13T19:16:15.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.442+0000 7f9719151800 1 -- 172.21.15.102:0/3577411909 wait complete. 2024-09-13T19:16:15.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.443+0000 7f9719151800 1 -- 172.21.15.102:0/1900077174 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f95f0036b90 msgr2=0x7f95f0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.443+0000 7f9719151800 1 --2- 172.21.15.102:0/1900077174 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f95f0036b90 0x7f95f0039050 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f970804b910 tx=0x7f970804b7e0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.443+0000 7f9719151800 1 -- 172.21.15.102:0/1900077174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647a7d79220 msgr2=0x5647a7d79640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.443+0000 7f9719151800 1 --2- 172.21.15.102:0/1900077174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647a7d79220 0x5647a7d79640 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x5647a7d5f5f0 tx=0x7f97100167b0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.443+0000 7f9719151800 1 -- 172.21.15.102:0/1900077174 shutdown_connections 2024-09-13T19:16:15.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.443+0000 7f9719151800 1 --2- 172.21.15.102:0/1900077174 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f95f0036b90 0x7f95f0039050 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.443+0000 7f9719151800 1 --2- 172.21.15.102:0/1900077174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647a7d79220 0x5647a7d79640 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.443+0000 7f9719151800 1 -- 172.21.15.102:0/1900077174 >> 172.21.15.102:0/1900077174 conn(0x5647a7d6e1b0 msgr2=0x5647a7d70d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:15.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.443+0000 7f9719151800 1 -- 172.21.15.102:0/1900077174 shutdown_connections 2024-09-13T19:16:15.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.443+0000 7f9719151800 1 -- 172.21.15.102:0/1900077174 wait complete. 2024-09-13T19:16:15.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.443+0000 7f9719151800 1 -- 172.21.15.102:0/811702586 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5647a7c698f0 msgr2=0x5647a7d655b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.443+0000 7f9719151800 1 --2- 172.21.15.102:0/811702586 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5647a7c698f0 0x5647a7d655b0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.443+0000 7f9719151800 1 -- 172.21.15.102:0/811702586 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5647a7d67e90 msgr2=0x5647a7d6a280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.443+0000 7f9719151800 1 --2- 172.21.15.102:0/811702586 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5647a7d67e90 0x5647a7d6a280 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.443+0000 7f9719151800 1 -- 172.21.15.102:0/811702586 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f95fc036be0 msgr2=0x7f95fc0390a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.443+0000 7f9719151800 1 --2- 172.21.15.102:0/811702586 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f95fc036be0 0x7f95fc0390a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9700057000 tx=0x7f9700052000 comp rx=0 tx=0).stop 2024-09-13T19:16:15.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.443+0000 7f9719151800 1 -- 172.21.15.102:0/811702586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647a7bd96b0 msgr2=0x5647a7d5e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.443+0000 7f9719151800 1 --2- 172.21.15.102:0/811702586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647a7bd96b0 0x5647a7d5e540 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9708000c00 tx=0x7f9708000ed0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.443+0000 7f9719151800 1 -- 172.21.15.102:0/811702586 shutdown_connections 2024-09-13T19:16:15.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.443+0000 7f9719151800 1 --2- 172.21.15.102:0/811702586 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5647a7d67e90 0x5647a7d6a280 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.443+0000 7f9719151800 1 --2- 172.21.15.102:0/811702586 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5647a7c698f0 0x5647a7d655b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.443+0000 7f9719151800 1 --2- 172.21.15.102:0/811702586 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f95fc036be0 0x7f95fc0390a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.443+0000 7f9719151800 1 --2- 172.21.15.102:0/811702586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647a7bd96b0 0x5647a7d5e540 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.443+0000 7f9719151800 1 -- 172.21.15.102:0/811702586 >> 172.21.15.102:0/811702586 conn(0x5647a7c5fde0 msgr2=0x5647a7d4fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:15.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.443+0000 7f9719151800 1 -- 172.21.15.102:0/811702586 shutdown_connections 2024-09-13T19:16:15.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.443+0000 7f9719151800 1 -- 172.21.15.102:0/811702586 wait complete. 2024-09-13T19:16:15.468 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:16:14.779675Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:16:14.779665Z', 'tags': [], 'group_ids': []} 2024-09-13T19:16:15.468 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T19:16:15.468 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T19:16:15.468 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T19:16:15.546 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:15.546 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:15.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.543+0000 7fb08fa10800 1 Processor -- start 2024-09-13T19:16:15.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.543+0000 7fb08fa10800 1 -- start start 2024-09-13T19:16:15.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.543+0000 7fb08fa10800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5596f6786db0 0x5596f67891a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.543+0000 7fb08fa10800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5596f663fb30 con 0x5596f66f45f0 2024-09-13T19:16:15.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.543+0000 7fb08fa10800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5596f6621360 con 0x5596f6786db0 2024-09-13T19:16:15.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.543+0000 7fb08a9c5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5596f6786db0 0x5596f67891a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.543+0000 7fb08a9c5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5596f6786db0 0x5596f67891a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54116/0 (socket says 172.21.15.102:54116) 2024-09-13T19:16:15.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.543+0000 7fb08b1c6640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5596f66f45f0 0x5596f6785690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:49822/0 (socket says 172.21.15.102:49822) 2024-09-13T19:16:15.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.543+0000 7fb08a9c5640 1 -- 172.21.15.102:0/3264114060 learned_addr learned my addr 172.21.15.102:0/3264114060 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:15.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.543+0000 7fb08a9c5640 1 -- 172.21.15.102:0/3264114060 >> v1:172.21.15.53:6789/0 conn(0x5596f66f45f0 legacy=0x5596f6785690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.543+0000 7fb08a9c5640 1 -- 172.21.15.102:0/3264114060 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596f6647e00 con 0x5596f6786db0 2024-09-13T19:16:15.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.545+0000 7fb08a9c5640 1 --2- 172.21.15.102:0/3264114060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596f6786db0 0x5596f67891a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb08000a520 tx=0x7fb080045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80f45c7e51f9863d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.545+0000 7fb08a1c4640 1 -- 172.21.15.102:0/3264114060 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb080055070 con 0x5596f6786db0 2024-09-13T19:16:15.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.545+0000 7fb08a1c4640 1 -- 172.21.15.102:0/3264114060 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0800515b0 con 0x5596f6786db0 2024-09-13T19:16:15.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.545+0000 7fb08a1c4640 1 -- 172.21.15.102:0/3264114060 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0800518d0 con 0x5596f6786db0 2024-09-13T19:16:15.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.546+0000 7fb08fa10800 1 -- 172.21.15.102:0/3264114060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596f6786db0 msgr2=0x5596f67891a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.546+0000 7fb08fa10800 1 --2- 172.21.15.102:0/3264114060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596f6786db0 0x5596f67891a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb08000a520 tx=0x7fb080045ba0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.546+0000 7fb08fa10800 1 -- 172.21.15.102:0/3264114060 shutdown_connections 2024-09-13T19:16:15.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.546+0000 7fb08fa10800 1 --2- 172.21.15.102:0/3264114060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596f6786db0 0x5596f67891a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.546+0000 7fb08fa10800 1 -- 172.21.15.102:0/3264114060 >> 172.21.15.102:0/3264114060 conn(0x5596f677ade0 msgr2=0x5596f677d200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:15.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.546+0000 7fb08fa10800 1 -- 172.21.15.102:0/3264114060 shutdown_connections 2024-09-13T19:16:15.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.546+0000 7fb08fa10800 1 -- 172.21.15.102:0/3264114060 wait complete. 2024-09-13T19:16:15.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.559+0000 7fb08fa10800 1 Processor -- start 2024-09-13T19:16:15.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.559+0000 7fb08fa10800 1 -- start start 2024-09-13T19:16:15.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.560+0000 7fb08fa10800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596f66f45f0 0x5596f6871a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.560+0000 7fb08fa10800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5596f66cc330 con 0x5596f66f45f0 2024-09-13T19:16:15.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.560+0000 7fb08b1c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596f66f45f0 0x5596f6871a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.560+0000 7fb08b1c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596f66f45f0 0x5596f6871a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54132/0 (socket says 172.21.15.102:54132) 2024-09-13T19:16:15.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.560+0000 7fb08b1c6640 1 -- 172.21.15.102:0/926821303 learned_addr learned my addr 172.21.15.102:0/926821303 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:15.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.560+0000 7fb08b1c6640 1 -- 172.21.15.102:0/926821303 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596f6619bc0 con 0x5596f66f45f0 2024-09-13T19:16:15.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.560+0000 7fb08b1c6640 1 --2- 172.21.15.102:0/926821303 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596f66f45f0 0x5596f6871a80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb07c001e40 tx=0x7fb07c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc37fcbcce873803 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.560+0000 7faf7960a640 1 -- 172.21.15.102:0/926821303 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb07c00e5c0 con 0x5596f66f45f0 2024-09-13T19:16:15.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.561+0000 7faf7960a640 1 -- 172.21.15.102:0/926821303 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb07c006070 con 0x5596f66f45f0 2024-09-13T19:16:15.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.561+0000 7faf7960a640 1 -- 172.21.15.102:0/926821303 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb07c00e910 con 0x5596f66f45f0 2024-09-13T19:16:15.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.561+0000 7fb08fa10800 1 -- 172.21.15.102:0/926821303 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596f66f45f0 msgr2=0x5596f6871a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.561+0000 7fb08fa10800 1 --2- 172.21.15.102:0/926821303 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596f66f45f0 0x5596f6871a80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb07c001e40 tx=0x7fb07c001e70 comp rx=0 tx=0).stop 2024-09-13T19:16:15.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.561+0000 7fb08fa10800 1 -- 172.21.15.102:0/926821303 shutdown_connections 2024-09-13T19:16:15.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.561+0000 7fb08fa10800 1 --2- 172.21.15.102:0/926821303 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596f66f45f0 0x5596f6871a80 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.561+0000 7fb08fa10800 1 -- 172.21.15.102:0/926821303 >> 172.21.15.102:0/926821303 conn(0x5596f677ade0 msgr2=0x5596f686d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:15.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.561+0000 7fb08fa10800 1 -- 172.21.15.102:0/926821303 shutdown_connections 2024-09-13T19:16:15.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.561+0000 7fb08fa10800 1 -- 172.21.15.102:0/926821303 wait complete. 2024-09-13T19:16:15.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.562+0000 7fb08fa10800 1 Processor -- start 2024-09-13T19:16:15.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.562+0000 7fb08fa10800 1 -- start start 2024-09-13T19:16:15.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.562+0000 7fb08fa10800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596f66f45f0 0x5596f68794b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.562+0000 7fb08fa10800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5596f6789980 con 0x5596f66f45f0 2024-09-13T19:16:15.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.562+0000 7fb08b1c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596f66f45f0 0x5596f68794b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.562+0000 7fb08b1c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596f66f45f0 0x5596f68794b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54142/0 (socket says 172.21.15.102:54142) 2024-09-13T19:16:15.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.562+0000 7fb08b1c6640 1 -- 172.21.15.102:0/3156989125 learned_addr learned my addr 172.21.15.102:0/3156989125 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:15.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.562+0000 7fb08b1c6640 1 -- 172.21.15.102:0/3156989125 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596f662dfe0 con 0x5596f66f45f0 2024-09-13T19:16:15.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.562+0000 7fb08b1c6640 1 --2- 172.21.15.102:0/3156989125 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596f66f45f0 0x5596f68794b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb07c000f60 tx=0x7fb07c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.563+0000 7faf77e07640 1 -- 172.21.15.102:0/3156989125 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb07c00f8d0 con 0x5596f66f45f0 2024-09-13T19:16:15.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.563+0000 7faf77e07640 1 -- 172.21.15.102:0/3156989125 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb07c00fa70 con 0x5596f66f45f0 2024-09-13T19:16:15.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.563+0000 7fb08fa10800 1 -- 172.21.15.102:0/3156989125 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5596f68799f0 con 0x5596f66f45f0 2024-09-13T19:16:15.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.563+0000 7faf77e07640 1 -- 172.21.15.102:0/3156989125 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb07c00fd90 con 0x5596f66f45f0 2024-09-13T19:16:15.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.563+0000 7fb08fa10800 1 -- 172.21.15.102:0/3156989125 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596f6879f10 con 0x5596f66f45f0 2024-09-13T19:16:15.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.563+0000 7faf77e07640 1 -- 172.21.15.102:0/3156989125 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb07c017070 con 0x5596f66f45f0 2024-09-13T19:16:15.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.564+0000 7faf77e07640 1 --2- 172.21.15.102:0/3156989125 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7faf70036af0 0x7faf70038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.564+0000 7faf77e07640 1 -- 172.21.15.102:0/3156989125 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fb07c015020 con 0x5596f66f45f0 2024-09-13T19:16:15.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.564+0000 7fb08a9c5640 1 --2- 172.21.15.102:0/3156989125 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7faf70036af0 0x7faf70038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.564+0000 7fb08fa10800 1 --2- 172.21.15.102:0/3156989125 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5596f6786db0 0x5596f6880520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.564+0000 7fb08fa10800 1 -- 172.21.15.102:0/3156989125 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5596f6880aa0 con 0x5596f6786db0 2024-09-13T19:16:15.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.564+0000 7fb08b9c7640 1 --2- 172.21.15.102:0/3156989125 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5596f6786db0 0x5596f6880520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.564+0000 7fb08a9c5640 1 --2- 172.21.15.102:0/3156989125 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7faf70036af0 0x7faf70038fb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb080057000 tx=0x7fb080052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.564+0000 7fb08b9c7640 1 --2- 172.21.15.102:0/3156989125 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5596f6786db0 0x5596f6880520 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.565+0000 7fb08b9c7640 1 -- 172.21.15.102:0/3156989125 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb08400a4a0 con 0x5596f6786db0 2024-09-13T19:16:15.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.565+0000 7fb08fa10800 1 -- 172.21.15.102:0/3156989125 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5596f687daf0 con 0x5596f6786db0 2024-09-13T19:16:15.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.565+0000 7fb08b9c7640 1 -- 172.21.15.102:0/3156989125 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb08400a4a0 con 0x5596f6786db0 2024-09-13T19:16:15.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.565+0000 7fb08fa10800 1 --2- 172.21.15.102:0/3156989125 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5596f6882df0 0x5596f68851e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.565+0000 7fb08fa10800 1 -- 172.21.15.102:0/3156989125 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5596f68858d0 con 0x5596f6882df0 2024-09-13T19:16:15.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.565+0000 7fb08b1c6640 1 --2- 172.21.15.102:0/3156989125 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5596f6882df0 0x5596f68851e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.565+0000 7fb08b1c6640 1 --2- 172.21.15.102:0/3156989125 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5596f6882df0 0x5596f68851e0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.565+0000 7fb08b1c6640 1 -- 172.21.15.102:0/3156989125 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb07c02e070 con 0x5596f6882df0 2024-09-13T19:16:15.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.565+0000 7fb08fa10800 1 -- 172.21.15.102:0/3156989125 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5596f6881c90 con 0x5596f6786db0 2024-09-13T19:16:15.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.566+0000 7fb08b9c7640 1 -- 172.21.15.102:0/3156989125 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb08400a4a0 con 0x5596f6786db0 2024-09-13T19:16:15.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.566+0000 7fb08fa10800 1 -- 172.21.15.102:0/3156989125 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5596f6882130 con 0x5596f6882df0 2024-09-13T19:16:15.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.566+0000 7fb08b1c6640 1 -- 172.21.15.102:0/3156989125 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb07c02e070 con 0x5596f6882df0 2024-09-13T19:16:15.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.566+0000 7fb08fa10800 1 Processor -- start 2024-09-13T19:16:15.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.566+0000 7fb08fa10800 1 -- start start 2024-09-13T19:16:15.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.567+0000 7fb08fa10800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596f6894260 0x5596f6894680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.567+0000 7fb08fa10800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5596f661b580 con 0x5596f6894260 2024-09-13T19:16:15.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.567+0000 7fb08b9c7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596f6894260 0x5596f6894680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.567+0000 7fb08b9c7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596f6894260 0x5596f6894680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54156/0 (socket says 172.21.15.102:54156) 2024-09-13T19:16:15.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.567+0000 7fb08b9c7640 1 -- 172.21.15.102:0/3018906331 learned_addr learned my addr 172.21.15.102:0/3018906331 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:15.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.567+0000 7fb08b9c7640 1 -- 172.21.15.102:0/3018906331 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596f6894bc0 con 0x5596f6894260 2024-09-13T19:16:15.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.567+0000 7fb08b9c7640 1 --2- 172.21.15.102:0/3018906331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596f6894260 0x5596f6894680 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x5596f687a8b0 tx=0x7fb0840167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.568+0000 7faf75602640 1 -- 172.21.15.102:0/3018906331 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb084013640 con 0x5596f6894260 2024-09-13T19:16:15.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.568+0000 7faf75602640 1 -- 172.21.15.102:0/3018906331 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0840137e0 con 0x5596f6894260 2024-09-13T19:16:15.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.568+0000 7fb08fa10800 1 -- 172.21.15.102:0/3018906331 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5596f6894e50 con 0x5596f6894260 2024-09-13T19:16:15.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.568+0000 7faf75602640 1 -- 172.21.15.102:0/3018906331 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb084013ae0 con 0x5596f6894260 2024-09-13T19:16:15.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.568+0000 7fb08fa10800 1 -- 172.21.15.102:0/3018906331 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596f6897b30 con 0x5596f6894260 2024-09-13T19:16:15.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.568+0000 7faf75602640 1 -- 172.21.15.102:0/3018906331 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb084011040 con 0x5596f6894260 2024-09-13T19:16:15.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.569+0000 7faf75602640 1 --2- 172.21.15.102:0/3018906331 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7faf64036b90 0x7faf64039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.569+0000 7faf75602640 1 -- 172.21.15.102:0/3018906331 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fb08400e040 con 0x5596f6894260 2024-09-13T19:16:15.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.569+0000 7fb08b1c6640 1 --2- 172.21.15.102:0/3018906331 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7faf64036b90 0x7faf64039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.569+0000 7fb08fa10800 1 Processor -- start 2024-09-13T19:16:15.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.569+0000 7fb08b1c6640 1 --2- 172.21.15.102:0/3018906331 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7faf64036b90 0x7faf64039050 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x5596f6881c60 tx=0x7fb07c04b760 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.569+0000 7fb08fa10800 1 -- start start 2024-09-13T19:16:15.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.569+0000 7fb08fa10800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596f68a0e90 0x5596f68a1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.569+0000 7fb08fa10800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5596f6872230 con 0x5596f68a0e90 2024-09-13T19:16:15.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.569+0000 7fb08b9c7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596f68a0e90 0x5596f68a1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.569+0000 7fb08b9c7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596f68a0e90 0x5596f68a1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54168/0 (socket says 172.21.15.102:54168) 2024-09-13T19:16:15.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.569+0000 7fb08b9c7640 1 -- 172.21.15.102:0/758105738 learned_addr learned my addr 172.21.15.102:0/758105738 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:15.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.570+0000 7fb08b9c7640 1 -- 172.21.15.102:0/758105738 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596f68a17d0 con 0x5596f68a0e90 2024-09-13T19:16:15.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.570+0000 7fb08b9c7640 1 --2- 172.21.15.102:0/758105738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596f68a0e90 0x5596f68a1290 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb08400b010 tx=0x7fb084020460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84f377178453c736 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.570+0000 7faf6effd640 1 -- 172.21.15.102:0/758105738 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb08404e050 con 0x5596f68a0e90 2024-09-13T19:16:15.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.570+0000 7faf6effd640 1 -- 172.21.15.102:0/758105738 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb084014c10 con 0x5596f68a0e90 2024-09-13T19:16:15.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.570+0000 7faf6effd640 1 -- 172.21.15.102:0/758105738 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb08402aa40 con 0x5596f68a0e90 2024-09-13T19:16:15.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.570+0000 7fb08fa10800 1 -- 172.21.15.102:0/758105738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596f68a0e90 msgr2=0x5596f68a1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.570+0000 7fb08fa10800 1 --2- 172.21.15.102:0/758105738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596f68a0e90 0x5596f68a1290 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb08400b010 tx=0x7fb084020460 comp rx=0 tx=0).stop 2024-09-13T19:16:15.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.570+0000 7fb08fa10800 1 -- 172.21.15.102:0/758105738 shutdown_connections 2024-09-13T19:16:15.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.570+0000 7fb08fa10800 1 --2- 172.21.15.102:0/758105738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596f68a0e90 0x5596f68a1290 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.570+0000 7fb08fa10800 1 -- 172.21.15.102:0/758105738 >> 172.21.15.102:0/758105738 conn(0x5596f689d240 msgr2=0x5596f689b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:15.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.570+0000 7fb08fa10800 1 -- 172.21.15.102:0/758105738 shutdown_connections 2024-09-13T19:16:15.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.570+0000 7fb08fa10800 1 -- 172.21.15.102:0/758105738 wait complete. 2024-09-13T19:16:15.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.571+0000 7fb08fa10800 1 Processor -- start 2024-09-13T19:16:15.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.571+0000 7fb08fa10800 1 -- start start 2024-09-13T19:16:15.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.571+0000 7fb08fa10800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596f68a0e90 0x5596f68a8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.571+0000 7fb08fa10800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5596f68a1e70 con 0x5596f68a0e90 2024-09-13T19:16:15.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.571+0000 7fb08b9c7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596f68a0e90 0x5596f68a8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.571+0000 7fb08b9c7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596f68a0e90 0x5596f68a8390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54176/0 (socket says 172.21.15.102:54176) 2024-09-13T19:16:15.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.571+0000 7fb08b9c7640 1 -- 172.21.15.102:0/4092392203 learned_addr learned my addr 172.21.15.102:0/4092392203 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:15.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.571+0000 7fb08b9c7640 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596f68a88d0 con 0x5596f68a0e90 2024-09-13T19:16:15.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.571+0000 7fb08b9c7640 1 --2- 172.21.15.102:0/4092392203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596f68a0e90 0x5596f68a8390 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb08400b010 tx=0x7fb08404cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.572+0000 7faf6d7fa640 1 -- 172.21.15.102:0/4092392203 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb08402e070 con 0x5596f68a0e90 2024-09-13T19:16:15.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.572+0000 7faf6d7fa640 1 -- 172.21.15.102:0/4092392203 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb084029ca0 con 0x5596f68a0e90 2024-09-13T19:16:15.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.572+0000 7fb08fa10800 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5596f68a8b60 con 0x5596f68a0e90 2024-09-13T19:16:15.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.572+0000 7faf6d7fa640 1 -- 172.21.15.102:0/4092392203 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb084040140 con 0x5596f68a0e90 2024-09-13T19:16:15.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.572+0000 7fb08fa10800 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596f68ab810 con 0x5596f68a0e90 2024-09-13T19:16:15.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.572+0000 7faf6d7fa640 1 -- 172.21.15.102:0/4092392203 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb084039060 con 0x5596f68a0e90 2024-09-13T19:16:15.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.573+0000 7faf6d7fa640 1 --2- 172.21.15.102:0/4092392203 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7faf54036b90 0x7faf54039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.573+0000 7faf6d7fa640 1 -- 172.21.15.102:0/4092392203 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fb084033c40 con 0x5596f68a0e90 2024-09-13T19:16:15.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.573+0000 7fb08b1c6640 1 --2- 172.21.15.102:0/4092392203 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7faf54036b90 0x7faf54039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.573+0000 7fb08fa10800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.573+0000 7fb08fa10800 1 --2- 172.21.15.102:0/4092392203 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5596f68b3e20 0x5596f68b62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.573+0000 7fb08fa10800 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5596f68b6a30 con 0x5596f68b3e20 2024-09-13T19:16:15.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.573+0000 7fb08a9c5640 1 --2- 172.21.15.102:0/4092392203 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5596f68b3e20 0x5596f68b62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.573+0000 7fb08b1c6640 1 --2- 172.21.15.102:0/4092392203 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7faf54036b90 0x7faf54039050 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb07c04d290 tx=0x7fb07c046000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.573+0000 7fb08a9c5640 1 --2- 172.21.15.102:0/4092392203 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5596f68b3e20 0x5596f68b62e0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.574+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb080057030 con 0x5596f68b3e20 2024-09-13T19:16:15.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.574+0000 7fb08fa10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.574+0000 7fb08fa10800 20 realm 2024-09-13T19:16:15.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.574+0000 7fb08fa10800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.574+0000 7fb08fa10800 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5596f68b6e00 con 0x5596f68b3e20 2024-09-13T19:16:15.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.574+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb080057030 con 0x5596f68b3e20 2024-09-13T19:16:15.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.574+0000 7fb08fa10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.574+0000 7fb08fa10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:15.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.574+0000 7fb08fa10800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.574+0000 7fb08fa10800 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5596f68b76a0 con 0x5596f68b3e20 2024-09-13T19:16:15.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.574+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb080057030 con 0x5596f68b3e20 2024-09-13T19:16:15.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.574+0000 7fb08fa10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.574+0000 7fb08fa10800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.574+0000 7fb08fa10800 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5596f68b7a40 con 0x5596f68b3e20 2024-09-13T19:16:15.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.574+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb080057030 con 0x5596f68b3e20 2024-09-13T19:16:15.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.574+0000 7fb08fa10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:15.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.574+0000 7fb08fa10800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.574+0000 7fb08fa10800 1 --2- 172.21.15.102:0/4092392203 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5596f68b84f0 0x5596f68ba900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.574+0000 7fb08fa10800 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5596f68bb060 con 0x5596f68b84f0 2024-09-13T19:16:15.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.574+0000 7fb08b9c7640 1 --2- 172.21.15.102:0/4092392203 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5596f68b84f0 0x5596f68ba900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.575+0000 7fb08b9c7640 1 --2- 172.21.15.102:0/4092392203 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5596f68b84f0 0x5596f68ba900 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.575+0000 7fb08b9c7640 1 -- 172.21.15.102:0/4092392203 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb08400a4a0 con 0x5596f68b84f0 2024-09-13T19:16:15.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.575+0000 7fb08fa10800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:15.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.575+0000 7fb08fa10800 20 searching for the correct realm 2024-09-13T19:16:15.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.575+0000 7fb08fa10800 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5596f68bca40 con 0x5596f68b84f0 2024-09-13T19:16:15.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.575+0000 7fb08b9c7640 1 -- 172.21.15.102:0/4092392203 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb08400a4a0 con 0x5596f68b84f0 2024-09-13T19:16:15.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.575+0000 7fb08b9c7640 1 --2- 172.21.15.102:0/4092392203 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fb08403b070 0x7fb084029540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.575+0000 7fb08b9c7640 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5596f68bca40 con 0x7fb08403b070 2024-09-13T19:16:15.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.575+0000 7fb08b1c6640 1 --2- 172.21.15.102:0/4092392203 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fb08403b070 0x7fb084029540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.576+0000 7fb08b1c6640 1 --2- 172.21.15.102:0/4092392203 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fb08403b070 0x7fb084029540 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.576+0000 7fb08b1c6640 1 -- 172.21.15.102:0/4092392203 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb07c02e070 con 0x7fb08403b070 2024-09-13T19:16:15.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.576+0000 7fb08b1c6640 1 --2- 172.21.15.102:0/4092392203 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fb07c00f070 0x7fb07c019820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.576+0000 7fb08b1c6640 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5596f68bca40 con 0x7fb07c00f070 2024-09-13T19:16:15.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.576+0000 7fb08a9c5640 1 --2- 172.21.15.102:0/4092392203 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fb07c00f070 0x7fb07c019820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.577+0000 7fb08a9c5640 1 --2- 172.21.15.102:0/4092392203 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fb07c00f070 0x7fb07c019820 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.577+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb080057030 con 0x7fb07c00f070 2024-09-13T19:16:15.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.577+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5596f68bca40 con 0x5596f68b3e20 2024-09-13T19:16:15.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.577+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb080057030 con 0x5596f68b3e20 2024-09-13T19:16:15.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.577+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5596f68bca40 con 0x5596f68b3e20 2024-09-13T19:16:15.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.577+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb080057030 con 0x5596f68b3e20 2024-09-13T19:16:15.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.577+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5596f68bca40 con 0x7fb07c00f070 2024-09-13T19:16:15.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.577+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb080057030 con 0x7fb07c00f070 2024-09-13T19:16:15.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.578+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5596f68bca40 con 0x7fb07c00f070 2024-09-13T19:16:15.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.578+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb080057030 con 0x7fb07c00f070 2024-09-13T19:16:15.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.578+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5596f68bca40 con 0x7fb08403b070 2024-09-13T19:16:15.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.578+0000 7fb08b1c6640 1 -- 172.21.15.102:0/4092392203 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb07c02e070 con 0x7fb08403b070 2024-09-13T19:16:15.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.578+0000 7fb08b1c6640 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5596f68bca40 con 0x5596f68b84f0 2024-09-13T19:16:15.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.578+0000 7fb08b9c7640 1 -- 172.21.15.102:0/4092392203 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb08400a4a0 con 0x5596f68b84f0 2024-09-13T19:16:15.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.578+0000 7fb08b9c7640 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5596f68bca40 con 0x5596f68b3e20 2024-09-13T19:16:15.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.578+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb080057030 con 0x5596f68b3e20 2024-09-13T19:16:15.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.578+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5596f68bca40 con 0x7fb07c00f070 2024-09-13T19:16:15.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.579+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb080057030 con 0x7fb07c00f070 2024-09-13T19:16:15.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.579+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5596f68bca40 con 0x5596f68b3e20 2024-09-13T19:16:15.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.579+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb080057030 con 0x5596f68b3e20 2024-09-13T19:16:15.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.579+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5596f68bca40 con 0x7fb08403b070 2024-09-13T19:16:15.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.579+0000 7fb08b1c6640 1 -- 172.21.15.102:0/4092392203 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb07c02e070 con 0x7fb08403b070 2024-09-13T19:16:15.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.579+0000 7fb08b1c6640 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5596f68bca40 con 0x5596f68b84f0 2024-09-13T19:16:15.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.579+0000 7fb08b9c7640 1 -- 172.21.15.102:0/4092392203 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb08400a4a0 con 0x5596f68b84f0 2024-09-13T19:16:15.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.579+0000 7fb08b9c7640 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5596f68bca40 con 0x5596f68b84f0 2024-09-13T19:16:15.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.580+0000 7fb08b9c7640 1 -- 172.21.15.102:0/4092392203 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb08400a4a0 con 0x5596f68b84f0 2024-09-13T19:16:15.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.580+0000 7fb08b9c7640 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5596f68bca40 con 0x7fb07c00f070 2024-09-13T19:16:15.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.580+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb080057030 con 0x7fb07c00f070 2024-09-13T19:16:15.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.580+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5596f68bca40 con 0x5596f68b84f0 2024-09-13T19:16:15.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.580+0000 7fb08b9c7640 1 -- 172.21.15.102:0/4092392203 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb08400a4a0 con 0x5596f68b84f0 2024-09-13T19:16:15.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.580+0000 7fb08b9c7640 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5596f68bca40 con 0x5596f68b84f0 2024-09-13T19:16:15.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.580+0000 7fb08b9c7640 1 -- 172.21.15.102:0/4092392203 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb08400a4a0 con 0x5596f68b84f0 2024-09-13T19:16:15.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.580+0000 7fb08b9c7640 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5596f68bca40 con 0x5596f68b3e20 2024-09-13T19:16:15.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.580+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb080057030 con 0x5596f68b3e20 2024-09-13T19:16:15.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.580+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5596f68bca40 con 0x5596f68b3e20 2024-09-13T19:16:15.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.581+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb080057030 con 0x5596f68b3e20 2024-09-13T19:16:15.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.581+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5596f68bca40 con 0x7fb07c00f070 2024-09-13T19:16:15.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.581+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb080057030 con 0x7fb07c00f070 2024-09-13T19:16:15.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.581+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5596f68bca40 con 0x5596f68b84f0 2024-09-13T19:16:15.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.581+0000 7fb08b9c7640 1 -- 172.21.15.102:0/4092392203 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb084063040 con 0x5596f68b84f0 2024-09-13T19:16:15.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.581+0000 7fb08b9c7640 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5596f68bca40 con 0x7fb08403b070 2024-09-13T19:16:15.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.581+0000 7fb08b1c6640 1 -- 172.21.15.102:0/4092392203 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb07c02e070 con 0x7fb08403b070 2024-09-13T19:16:15.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.581+0000 7fb08b1c6640 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5596f68bca40 con 0x5596f68b3e20 2024-09-13T19:16:15.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.582+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb080057030 con 0x5596f68b3e20 2024-09-13T19:16:15.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.582+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5596f68bca40 con 0x7fb07c00f070 2024-09-13T19:16:15.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.582+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb080057030 con 0x7fb07c00f070 2024-09-13T19:16:15.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.582+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5596f68bca40 con 0x5596f68b84f0 2024-09-13T19:16:15.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.582+0000 7fb08b9c7640 1 -- 172.21.15.102:0/4092392203 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb084063040 con 0x5596f68b84f0 2024-09-13T19:16:15.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.582+0000 7fb08b9c7640 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5596f68bca40 con 0x7fb07c00f070 2024-09-13T19:16:15.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.583+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb080057030 con 0x7fb07c00f070 2024-09-13T19:16:15.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.583+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5596f68bca40 con 0x7fb08403b070 2024-09-13T19:16:15.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.583+0000 7fb08b1c6640 1 -- 172.21.15.102:0/4092392203 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb07c02e070 con 0x7fb08403b070 2024-09-13T19:16:15.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.583+0000 7fb08b1c6640 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5596f68bca40 con 0x5596f68b84f0 2024-09-13T19:16:15.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.583+0000 7fb08b9c7640 1 -- 172.21.15.102:0/4092392203 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb084063040 con 0x5596f68b84f0 2024-09-13T19:16:15.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.583+0000 7fb08b9c7640 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5596f68bca40 con 0x7fb07c00f070 2024-09-13T19:16:15.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.583+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb080057030 con 0x7fb07c00f070 2024-09-13T19:16:15.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.583+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5596f68bca40 con 0x5596f68b3e20 2024-09-13T19:16:15.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.584+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb080057030 con 0x5596f68b3e20 2024-09-13T19:16:15.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.584+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fb08008a080 con 0x7fb08403b070 2024-09-13T19:16:15.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.584+0000 7fb08b1c6640 1 -- 172.21.15.102:0/4092392203 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb07c02e070 con 0x7fb08403b070 2024-09-13T19:16:15.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.584+0000 7fb08fa10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:15.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.584+0000 7fb08fa10800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:15.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.584+0000 7fb08fa10800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:15.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.584+0000 7fb08fa10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:15.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.584+0000 7fb08fa10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:15.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.584+0000 7fb08fa10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:15.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.584+0000 7fb08fa10800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.584+0000 7fb08fa10800 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5596f68bbb10 con 0x5596f68b3e20 2024-09-13T19:16:15.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.584+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb080057030 con 0x5596f68b3e20 2024-09-13T19:16:15.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.584+0000 7fb08fa10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.584+0000 7fb08fa10800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.584+0000 7fb08fa10800 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5596f68bc3b0 con 0x5596f68b3e20 2024-09-13T19:16:15.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.584+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb080057030 con 0x5596f68b3e20 2024-09-13T19:16:15.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.584+0000 7fb08fa10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:15.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.584+0000 7fb08fa10800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.584+0000 7fb08fa10800 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5596f68bb750 con 0x5596f68b84f0 2024-09-13T19:16:15.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.584+0000 7fb08b9c7640 1 -- 172.21.15.102:0/4092392203 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb084063040 con 0x5596f68b84f0 2024-09-13T19:16:15.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.584+0000 7fb08fa10800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:15.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.585+0000 7fb08fa10800 20 zone default found 2024-09-13T19:16:15.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.585+0000 7fb08fa10800 4 Realm: () 2024-09-13T19:16:15.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.585+0000 7fb08fa10800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:15.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.585+0000 7fb08fa10800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:15.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.585+0000 7fb08fa10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:15.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.585+0000 7fb08fa10800 20 zonegroup default 2024-09-13T19:16:15.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.585+0000 7fb08fa10800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.585+0000 7fb08fa10800 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5596f68bd3c0 con 0x7fb07c00f070 2024-09-13T19:16:15.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.585+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb080057030 con 0x7fb07c00f070 2024-09-13T19:16:15.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.585+0000 7fb08fa10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.585+0000 7fb08fa10800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.585+0000 7fb08fa10800 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5596f68bee60 con 0x5596f68b84f0 2024-09-13T19:16:15.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.585+0000 7fb08b9c7640 1 -- 172.21.15.102:0/4092392203 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb084063040 con 0x5596f68b84f0 2024-09-13T19:16:15.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.585+0000 7fb08fa10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.585+0000 7fb08fa10800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.585+0000 7fb08fa10800 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5596f68bf280 con 0x5596f68b84f0 2024-09-13T19:16:15.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.586+0000 7fb08b9c7640 1 -- 172.21.15.102:0/4092392203 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb084063040 con 0x5596f68b84f0 2024-09-13T19:16:15.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.586+0000 7fb08fa10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.586+0000 7fb08fa10800 20 started sync module instance, tier type = 2024-09-13T19:16:15.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.586+0000 7fb08fa10800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:15.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.586+0000 7fb08fa10800 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5596f68be230 con 0x7fb08403b070 2024-09-13T19:16:15.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.587+0000 7fb08b1c6640 1 -- 172.21.15.102:0/4092392203 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(44 notify.0 [create] v34'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb07c02e070 con 0x7fb08403b070 2024-09-13T19:16:15.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.587+0000 7fb08fa10800 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94106869818960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5596f68bfb20 con 0x7fb08403b070 2024-09-13T19:16:15.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.587+0000 7fb08fa10800 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5596f68c0370 con 0x5596f68b3e20 2024-09-13T19:16:15.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.588+0000 7fb08b1c6640 1 -- 172.21.15.102:0/4092392203 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94106869818960] v34'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb07c02e070 con 0x7fb08403b070 2024-09-13T19:16:15.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.588+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v34'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb080057030 con 0x5596f68b3e20 2024-09-13T19:16:15.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.588+0000 7fb08fa10800 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94106869825216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5596f68c0790 con 0x5596f68b3e20 2024-09-13T19:16:15.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.588+0000 7fb08fa10800 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5596f68c0fe0 con 0x5596f68b84f0 2024-09-13T19:16:15.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.589+0000 7fb08b9c7640 1 -- 172.21.15.102:0/4092392203 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v34'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb084063040 con 0x5596f68b84f0 2024-09-13T19:16:15.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.589+0000 7fb08fa10800 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94106869827952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5596f68c1470 con 0x5596f68b84f0 2024-09-13T19:16:15.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.589+0000 7fb08fa10800 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5596f68c1f90 con 0x7fb08403b070 2024-09-13T19:16:15.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.589+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94106869825216] v34'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb080057030 con 0x5596f68b3e20 2024-09-13T19:16:15.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.590+0000 7fb08b9c7640 1 -- 172.21.15.102:0/4092392203 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94106869827952] v34'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb084063040 con 0x5596f68b84f0 2024-09-13T19:16:15.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.590+0000 7fb08b1c6640 1 -- 172.21.15.102:0/4092392203 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(50 notify.3 [create] v34'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb07c02e070 con 0x7fb08403b070 2024-09-13T19:16:15.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.590+0000 7fb08fa10800 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94106869832288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5596f68c0e90 con 0x7fb08403b070 2024-09-13T19:16:15.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.590+0000 7fb08fa10800 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5596f68c29a0 con 0x5596f68b3e20 2024-09-13T19:16:15.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.591+0000 7fb08b1c6640 1 -- 172.21.15.102:0/4092392203 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94106869832288] v34'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb07c02e070 con 0x7fb08403b070 2024-09-13T19:16:15.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.594+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v34'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb080057030 con 0x5596f68b3e20 2024-09-13T19:16:15.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.594+0000 7fb08fa10800 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94106869834992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5596f68c2dc0 con 0x5596f68b3e20 2024-09-13T19:16:15.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.594+0000 7fb08fa10800 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5596f68c3690 con 0x7fb07c00f070 2024-09-13T19:16:15.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.594+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94106869834992] v34'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb080057030 con 0x5596f68b3e20 2024-09-13T19:16:15.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.594+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(54 notify.5 [create] v34'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb080057030 con 0x7fb07c00f070 2024-09-13T19:16:15.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.595+0000 7fb08fa10800 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94106869836048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5596f68c31e0 con 0x7fb07c00f070 2024-09-13T19:16:15.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.595+0000 7fb08fa10800 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5596f68c4100 con 0x7fb07c00f070 2024-09-13T19:16:15.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.596+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94106869836048] v34'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb080057030 con 0x7fb07c00f070 2024-09-13T19:16:15.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.596+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(56 notify.6 [create] v34'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb080057030 con 0x7fb07c00f070 2024-09-13T19:16:15.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.596+0000 7fb08fa10800 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94106869840880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5596f68c40c0 con 0x7fb07c00f070 2024-09-13T19:16:15.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.596+0000 7fb08fa10800 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5596f68c4b20 con 0x7fb07c00f070 2024-09-13T19:16:15.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.596+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94106869840880] v34'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb080057030 con 0x7fb07c00f070 2024-09-13T19:16:15.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.596+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(58 notify.7 [create] v34'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb080057030 con 0x7fb07c00f070 2024-09-13T19:16:15.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.597+0000 7fb08fa10800 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94106869837104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5596f68c4b20 con 0x7fb07c00f070 2024-09-13T19:16:15.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.597+0000 7fb08fa10800 20 add_watcher() i=0 2024-09-13T19:16:15.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.597+0000 7fb08fa10800 20 add_watcher() i=1 2024-09-13T19:16:15.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.597+0000 7fb08fa10800 20 add_watcher() i=2 2024-09-13T19:16:15.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.597+0000 7fb08fa10800 20 add_watcher() i=3 2024-09-13T19:16:15.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.597+0000 7fb08fa10800 20 add_watcher() i=4 2024-09-13T19:16:15.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.597+0000 7fb08fa10800 20 add_watcher() i=5 2024-09-13T19:16:15.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.597+0000 7fb08fa10800 20 add_watcher() i=6 2024-09-13T19:16:15.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.597+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94106869837104] v34'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb080057030 con 0x7fb07c00f070 2024-09-13T19:16:15.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.597+0000 7fb08fa10800 20 add_watcher() i=7 2024-09-13T19:16:15.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.597+0000 7fb08fa10800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:15.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.597+0000 7fb08fa10800 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5596f68c7f50 con 0x5596f68b3e20 2024-09-13T19:16:15.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.598+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb080057030 con 0x5596f68b3e20 2024-09-13T19:16:15.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.598+0000 7fb08fa10800 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94106869843456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5596f68c5440 con 0x5596f68b3e20 2024-09-13T19:16:15.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.599+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94106869843456] v34'62 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb080057030 con 0x5596f68b3e20 2024-09-13T19:16:15.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.599+0000 7faf41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:15.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.599+0000 7fb08fa10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:15.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.599+0000 7fb08fa10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:15.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.599+0000 7fb08fa10800 5 note: GC not initialized 2024-09-13T19:16:15.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.599+0000 7faf40fe1640 20 reqs_thread_entry: start 2024-09-13T19:16:15.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.599+0000 7fb08fa10800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:15.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.599+0000 7fb08fa10800 20 Filter name: none 2024-09-13T19:16:15.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.599+0000 7faeba7fc640 20 reqs_thread_entry: start 2024-09-13T19:16:15.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.599+0000 7fb08fa10800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.599+0000 7fb08fa10800 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5596f68faea0 con 0x5596f68b3e20 2024-09-13T19:16:15.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.600+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb080057030 con 0x5596f68b3e20 2024-09-13T19:16:15.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.600+0000 7fb08fa10800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:16:15.621 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:16:14.779675Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:16:14.779665Z","tags":[],"group_ids":[]} 2024-09-13T19:16:15.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.601+0000 7faf41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:15.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.601+0000 7fb08fa10800 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94106869843456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5596f68c73d0 con 0x5596f68b3e20 2024-09-13T19:16:15.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.601+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94106869843456] v34'63 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb080057030 con 0x5596f68b3e20 2024-09-13T19:16:15.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.601+0000 7fb08fa10800 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94106869818960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5596f68c4600 con 0x7fb08403b070 2024-09-13T19:16:15.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.602+0000 7fb08b1c6640 1 -- 172.21.15.102:0/4092392203 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94106869818960] v34'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb07c02e070 con 0x7fb08403b070 2024-09-13T19:16:15.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.602+0000 7fb08fa10800 20 remove_watcher() i=0 2024-09-13T19:16:15.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.603+0000 7fb08fa10800 2 removed watcher, disabling cache 2024-09-13T19:16:15.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.603+0000 7fb08fa10800 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94106869825216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5596f68c4600 con 0x5596f68b3e20 2024-09-13T19:16:15.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.604+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94106869825216] v34'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb080057030 con 0x5596f68b3e20 2024-09-13T19:16:15.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.604+0000 7fb08fa10800 20 remove_watcher() i=1 2024-09-13T19:16:15.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.604+0000 7fb08fa10800 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94106869827952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5596f68bfec0 con 0x5596f68b84f0 2024-09-13T19:16:15.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.605+0000 7fb08b9c7640 1 -- 172.21.15.102:0/4092392203 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94106869827952] v34'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb084063040 con 0x5596f68b84f0 2024-09-13T19:16:15.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.605+0000 7fb08fa10800 20 remove_watcher() i=2 2024-09-13T19:16:15.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.605+0000 7fb08fa10800 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94106869832288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5596f68c4600 con 0x7fb08403b070 2024-09-13T19:16:15.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.605+0000 7fb08b1c6640 1 -- 172.21.15.102:0/4092392203 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94106869832288] v34'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb07c02e070 con 0x7fb08403b070 2024-09-13T19:16:15.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.605+0000 7fb08fa10800 20 remove_watcher() i=3 2024-09-13T19:16:15.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.605+0000 7fb08fa10800 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94106869834992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5596f68bfec0 con 0x5596f68b3e20 2024-09-13T19:16:15.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.606+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94106869834992] v34'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb080057030 con 0x5596f68b3e20 2024-09-13T19:16:15.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.606+0000 7fb08fa10800 20 remove_watcher() i=4 2024-09-13T19:16:15.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.606+0000 7fb08fa10800 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94106869836048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5596f68c4600 con 0x7fb07c00f070 2024-09-13T19:16:15.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.607+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94106869836048] v34'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb080057030 con 0x7fb07c00f070 2024-09-13T19:16:15.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.607+0000 7fb08fa10800 20 remove_watcher() i=5 2024-09-13T19:16:15.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.607+0000 7fb08fa10800 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94106869840880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5596f68bfec0 con 0x7fb07c00f070 2024-09-13T19:16:15.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.608+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94106869840880] v34'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb080057030 con 0x7fb07c00f070 2024-09-13T19:16:15.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.608+0000 7fb08fa10800 20 remove_watcher() i=6 2024-09-13T19:16:15.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.608+0000 7fb08fa10800 1 -- 172.21.15.102:0/4092392203 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94106869837104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5596f68c4600 con 0x7fb07c00f070 2024-09-13T19:16:15.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.609+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94106869837104] v34'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb080057030 con 0x7fb07c00f070 2024-09-13T19:16:15.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.609+0000 7fb08fa10800 20 remove_watcher() i=7 2024-09-13T19:16:15.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.609+0000 7fb08fa10800 1 -- 172.21.15.102:0/4092392203 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fb07c00f070 msgr2=0x7fb07c019820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.609+0000 7fb08fa10800 1 --2- 172.21.15.102:0/4092392203 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fb07c00f070 0x7fb07c019820 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.609+0000 7fb08fa10800 1 -- 172.21.15.102:0/4092392203 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5596f68b3e20 msgr2=0x5596f68b62e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.609+0000 7fb08fa10800 1 --2- 172.21.15.102:0/4092392203 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5596f68b3e20 0x5596f68b62e0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.609+0000 7fb08fa10800 1 -- 172.21.15.102:0/4092392203 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fb08403b070 msgr2=0x7fb084029540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.609+0000 7fb08fa10800 1 --2- 172.21.15.102:0/4092392203 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fb08403b070 0x7fb084029540 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.609+0000 7fb08fa10800 1 -- 172.21.15.102:0/4092392203 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5596f68b84f0 msgr2=0x5596f68ba900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.609+0000 7fb08fa10800 1 --2- 172.21.15.102:0/4092392203 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5596f68b84f0 0x5596f68ba900 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.610+0000 7fb08fa10800 1 -- 172.21.15.102:0/4092392203 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7faf54036b90 msgr2=0x7faf54039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.610+0000 7fb08fa10800 1 --2- 172.21.15.102:0/4092392203 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7faf54036b90 0x7faf54039050 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb07c04d290 tx=0x7fb07c046000 comp rx=0 tx=0).stop 2024-09-13T19:16:15.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.610+0000 7fb08fa10800 1 -- 172.21.15.102:0/4092392203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596f68a0e90 msgr2=0x5596f68a8390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.610+0000 7fb08a9c5640 1 -- 172.21.15.102:0/4092392203 reap_dead start 2024-09-13T19:16:15.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.610+0000 7fb08fa10800 1 --2- 172.21.15.102:0/4092392203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596f68a0e90 0x5596f68a8390 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb08400b010 tx=0x7fb08404cd30 comp rx=0 tx=0).stop 2024-09-13T19:16:15.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.610+0000 7fb08fa10800 1 -- 172.21.15.102:0/4092392203 shutdown_connections 2024-09-13T19:16:15.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.610+0000 7fb08fa10800 1 --2- 172.21.15.102:0/4092392203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596f68a0e90 0x5596f68a8390 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.610+0000 7fb08fa10800 1 -- 172.21.15.102:0/4092392203 >> 172.21.15.102:0/4092392203 conn(0x5596f689d240 msgr2=0x5596f689b310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:15.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.610+0000 7fb08fa10800 1 -- 172.21.15.102:0/4092392203 shutdown_connections 2024-09-13T19:16:15.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.610+0000 7fb08fa10800 1 -- 172.21.15.102:0/4092392203 wait complete. 2024-09-13T19:16:15.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.610+0000 7fb08fa10800 1 -- 172.21.15.102:0/3018906331 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7faf64036b90 msgr2=0x7faf64039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.610+0000 7fb08fa10800 1 --2- 172.21.15.102:0/3018906331 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7faf64036b90 0x7faf64039050 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x5596f6881c60 tx=0x7fb07c04b760 comp rx=0 tx=0).stop 2024-09-13T19:16:15.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.610+0000 7fb08fa10800 1 -- 172.21.15.102:0/3018906331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596f6894260 msgr2=0x5596f6894680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.610+0000 7fb08fa10800 1 --2- 172.21.15.102:0/3018906331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596f6894260 0x5596f6894680 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x5596f687a8b0 tx=0x7fb0840167b0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.610+0000 7fb08fa10800 1 -- 172.21.15.102:0/3018906331 shutdown_connections 2024-09-13T19:16:15.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.610+0000 7fb08fa10800 1 --2- 172.21.15.102:0/3018906331 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7faf64036b90 0x7faf64039050 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.610+0000 7fb08fa10800 1 --2- 172.21.15.102:0/3018906331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596f6894260 0x5596f6894680 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.610+0000 7fb08fa10800 1 -- 172.21.15.102:0/3018906331 >> 172.21.15.102:0/3018906331 conn(0x5596f68891f0 msgr2=0x5596f688bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:15.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.610+0000 7fb08fa10800 1 -- 172.21.15.102:0/3018906331 shutdown_connections 2024-09-13T19:16:15.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.610+0000 7fb08fa10800 1 -- 172.21.15.102:0/3018906331 wait complete. 2024-09-13T19:16:15.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.611+0000 7fb08fa10800 1 -- 172.21.15.102:0/3156989125 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5596f6786db0 msgr2=0x5596f6880520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.611+0000 7fb08fa10800 1 --2- 172.21.15.102:0/3156989125 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5596f6786db0 0x5596f6880520 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.611+0000 7fb08fa10800 1 -- 172.21.15.102:0/3156989125 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5596f6882df0 msgr2=0x5596f68851e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.611+0000 7fb08fa10800 1 --2- 172.21.15.102:0/3156989125 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5596f6882df0 0x5596f68851e0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.611+0000 7fb08fa10800 1 -- 172.21.15.102:0/3156989125 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7faf70036af0 msgr2=0x7faf70038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.611+0000 7fb08fa10800 1 --2- 172.21.15.102:0/3156989125 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7faf70036af0 0x7faf70038fb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb080057000 tx=0x7fb080052000 comp rx=0 tx=0).stop 2024-09-13T19:16:15.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.611+0000 7fb08fa10800 1 -- 172.21.15.102:0/3156989125 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596f66f45f0 msgr2=0x5596f68794b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.611+0000 7fb08fa10800 1 --2- 172.21.15.102:0/3156989125 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596f66f45f0 0x5596f68794b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb07c000f60 tx=0x7fb07c000bc0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.611+0000 7fb08fa10800 1 -- 172.21.15.102:0/3156989125 shutdown_connections 2024-09-13T19:16:15.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.611+0000 7fb08fa10800 1 --2- 172.21.15.102:0/3156989125 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5596f6882df0 0x5596f68851e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.611+0000 7fb08fa10800 1 --2- 172.21.15.102:0/3156989125 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5596f6786db0 0x5596f6880520 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.611+0000 7fb08fa10800 1 --2- 172.21.15.102:0/3156989125 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7faf70036af0 0x7faf70038fb0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.611+0000 7fb08fa10800 1 --2- 172.21.15.102:0/3156989125 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5596f66f45f0 0x5596f68794b0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.611+0000 7fb08fa10800 1 -- 172.21.15.102:0/3156989125 >> 172.21.15.102:0/3156989125 conn(0x5596f677ade0 msgr2=0x5596f686bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:15.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.611+0000 7fb08fa10800 1 -- 172.21.15.102:0/3156989125 shutdown_connections 2024-09-13T19:16:15.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.611+0000 7fb08fa10800 1 -- 172.21.15.102:0/3156989125 wait complete. 2024-09-13T19:16:15.633 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:16:14.779675Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:16:14.779665Z', 'tags': [], 'group_ids': []} 2024-09-13T19:16:15.633 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-13T19:16:15.633 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-13T19:16:15.634 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2024-09-13T19:16:15.682 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:15.682 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:15.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.678+0000 7f51ccc10800 1 Processor -- start 2024-09-13T19:16:15.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.678+0000 7f51ccc10800 1 -- start start 2024-09-13T19:16:15.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.678+0000 7f51ccc10800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56226f599570 0x56226f599970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.678+0000 7f51ccc10800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56226f459b30 con 0x56226f599eb0 2024-09-13T19:16:15.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.678+0000 7f51ccc10800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x56226f43b360 con 0x56226f599570 2024-09-13T19:16:15.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.679+0000 7f51c82c1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56226f599570 0x56226f599970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.679+0000 7f51c7ac0640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x56226f599eb0 0x56226f59ea30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:49834/0 (socket says 172.21.15.102:49834) 2024-09-13T19:16:15.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.679+0000 7f51c7ac0640 1 -- 172.21.15.102:0/858236819 learned_addr learned my addr 172.21.15.102:0/858236819 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:16:15.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.679+0000 7f51c82c1640 1 -- 172.21.15.102:0/858236819 >> v1:172.21.15.53:6789/0 conn(0x56226f599eb0 legacy=0x56226f59ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.679+0000 7f51c82c1640 1 -- 172.21.15.102:0/858236819 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56226f461e00 con 0x56226f599570 2024-09-13T19:16:15.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.681+0000 7f51c82c1640 1 --2- 172.21.15.102:0/858236819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56226f599570 0x56226f599970 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f51b8005fd0 tx=0x7f51b8045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69e569288121d413 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.681+0000 7f51c72bf640 1 -- 172.21.15.102:0/858236819 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51b8058530 con 0x56226f599570 2024-09-13T19:16:15.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.681+0000 7f51c72bf640 1 -- 172.21.15.102:0/858236819 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51b80586d0 con 0x56226f599570 2024-09-13T19:16:15.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.681+0000 7f51c72bf640 1 -- 172.21.15.102:0/858236819 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51b80589d0 con 0x56226f599570 2024-09-13T19:16:15.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.681+0000 7f51ccc10800 1 -- 172.21.15.102:0/858236819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56226f599570 msgr2=0x56226f599970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.681+0000 7f51ccc10800 1 --2- 172.21.15.102:0/858236819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56226f599570 0x56226f599970 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f51b8005fd0 tx=0x7f51b8045c30 comp rx=0 tx=0).stop 2024-09-13T19:16:15.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.681+0000 7f51ccc10800 1 -- 172.21.15.102:0/858236819 shutdown_connections 2024-09-13T19:16:15.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.681+0000 7f51ccc10800 1 --2- 172.21.15.102:0/858236819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56226f599570 0x56226f599970 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.681+0000 7f51ccc10800 1 -- 172.21.15.102:0/858236819 >> 172.21.15.102:0/858236819 conn(0x56226f594e00 msgr2=0x56226f597220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:15.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.681+0000 7f51ccc10800 1 -- 172.21.15.102:0/858236819 shutdown_connections 2024-09-13T19:16:15.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.681+0000 7f51ccc10800 1 -- 172.21.15.102:0/858236819 wait complete. 2024-09-13T19:16:15.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.695+0000 7f51ccc10800 1 Processor -- start 2024-09-13T19:16:15.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.695+0000 7f51ccc10800 1 -- start start 2024-09-13T19:16:15.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.695+0000 7f51ccc10800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56226f599570 0x56226f688880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.695+0000 7f51ccc10800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56226f4e6350 con 0x56226f599570 2024-09-13T19:16:15.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.696+0000 7f51c82c1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56226f599570 0x56226f688880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.696+0000 7f51c82c1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56226f599570 0x56226f688880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54200/0 (socket says 172.21.15.102:54200) 2024-09-13T19:16:15.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.696+0000 7f51c82c1640 1 -- 172.21.15.102:0/2230169138 learned_addr learned my addr 172.21.15.102:0/2230169138 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:15.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.696+0000 7f51c82c1640 1 -- 172.21.15.102:0/2230169138 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56226f433bc0 con 0x56226f599570 2024-09-13T19:16:15.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.696+0000 7f51c82c1640 1 --2- 172.21.15.102:0/2230169138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56226f599570 0x56226f688880 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f51b800a3f0 tx=0x7f51b8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18faa259f987574a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.696+0000 7f50b660c640 1 -- 172.21.15.102:0/2230169138 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51b8058a30 con 0x56226f599570 2024-09-13T19:16:15.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.696+0000 7f50b660c640 1 -- 172.21.15.102:0/2230169138 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51b8068070 con 0x56226f599570 2024-09-13T19:16:15.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.696+0000 7f50b660c640 1 -- 172.21.15.102:0/2230169138 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51b8058d60 con 0x56226f599570 2024-09-13T19:16:15.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.697+0000 7f51ccc10800 1 -- 172.21.15.102:0/2230169138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56226f599570 msgr2=0x56226f688880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.697+0000 7f51ccc10800 1 --2- 172.21.15.102:0/2230169138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56226f599570 0x56226f688880 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f51b800a3f0 tx=0x7f51b8051000 comp rx=0 tx=0).stop 2024-09-13T19:16:15.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.697+0000 7f51ccc10800 1 -- 172.21.15.102:0/2230169138 shutdown_connections 2024-09-13T19:16:15.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.697+0000 7f51ccc10800 1 --2- 172.21.15.102:0/2230169138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56226f599570 0x56226f688880 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.697+0000 7f51ccc10800 1 -- 172.21.15.102:0/2230169138 >> 172.21.15.102:0/2230169138 conn(0x56226f594e00 msgr2=0x56226f684240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:15.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.697+0000 7f51ccc10800 1 -- 172.21.15.102:0/2230169138 shutdown_connections 2024-09-13T19:16:15.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.697+0000 7f51ccc10800 1 -- 172.21.15.102:0/2230169138 wait complete. 2024-09-13T19:16:15.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.697+0000 7f51ccc10800 1 Processor -- start 2024-09-13T19:16:15.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.698+0000 7f51ccc10800 1 -- start start 2024-09-13T19:16:15.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.698+0000 7f51ccc10800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56226f599570 0x56226f50e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.698+0000 7f51ccc10800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56226f5a0590 con 0x56226f599570 2024-09-13T19:16:15.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.698+0000 7f51c82c1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56226f599570 0x56226f50e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.698+0000 7f51c82c1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56226f599570 0x56226f50e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54214/0 (socket says 172.21.15.102:54214) 2024-09-13T19:16:15.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.698+0000 7f51c82c1640 1 -- 172.21.15.102:0/3819669604 learned_addr learned my addr 172.21.15.102:0/3819669604 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:15.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.698+0000 7f51c82c1640 1 -- 172.21.15.102:0/3819669604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56226f447fe0 con 0x56226f599570 2024-09-13T19:16:15.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.698+0000 7f51c82c1640 1 --2- 172.21.15.102:0/3819669604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56226f599570 0x56226f50e600 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f51b8046130 tx=0x7f51b8003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.699+0000 7f50b4e09640 1 -- 172.21.15.102:0/3819669604 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51b80636b0 con 0x56226f599570 2024-09-13T19:16:15.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.699+0000 7f50b4e09640 1 -- 172.21.15.102:0/3819669604 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51b8063850 con 0x56226f599570 2024-09-13T19:16:15.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.699+0000 7f50b4e09640 1 -- 172.21.15.102:0/3819669604 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51b8063b70 con 0x56226f599570 2024-09-13T19:16:15.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.699+0000 7f51ccc10800 1 -- 172.21.15.102:0/3819669604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56226f693e50 con 0x56226f599570 2024-09-13T19:16:15.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.699+0000 7f51ccc10800 1 -- 172.21.15.102:0/3819669604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56226f694370 con 0x56226f599570 2024-09-13T19:16:15.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.699+0000 7f50b4e09640 1 -- 172.21.15.102:0/3819669604 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f51b8075020 con 0x56226f599570 2024-09-13T19:16:15.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.700+0000 7f50b4e09640 1 --2- 172.21.15.102:0/3819669604 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f50b0036b40 0x7f50b0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.700+0000 7f50b4e09640 1 -- 172.21.15.102:0/3819669604 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f51b8090cd0 con 0x56226f599570 2024-09-13T19:16:15.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.700+0000 7f51c7ac0640 1 --2- 172.21.15.102:0/3819669604 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f50b0036b40 0x7f50b0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.700+0000 7f51ccc10800 1 --2- 172.21.15.102:0/3819669604 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56226f599eb0 0x56226f698190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.700+0000 7f51ccc10800 1 -- 172.21.15.102:0/3819669604 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56226f698790 con 0x56226f599eb0 2024-09-13T19:16:15.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.700+0000 7f51c8ac2640 1 --2- 172.21.15.102:0/3819669604 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56226f599eb0 0x56226f698190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.700+0000 7f51c7ac0640 1 --2- 172.21.15.102:0/3819669604 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f50b0036b40 0x7f50b0039000 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f51bc000f60 tx=0x7f51bc0012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.700+0000 7f51c8ac2640 1 --2- 172.21.15.102:0/3819669604 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56226f599eb0 0x56226f698190 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.700+0000 7f51c8ac2640 1 -- 172.21.15.102:0/3819669604 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f51c00083e0 con 0x56226f599eb0 2024-09-13T19:16:15.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.700+0000 7f51ccc10800 1 -- 172.21.15.102:0/3819669604 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56226f695740 con 0x56226f599eb0 2024-09-13T19:16:15.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.701+0000 7f51c8ac2640 1 -- 172.21.15.102:0/3819669604 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f51c00083e0 con 0x56226f599eb0 2024-09-13T19:16:15.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.701+0000 7f51ccc10800 1 --2- 172.21.15.102:0/3819669604 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56226f69aaa0 0x56226f69ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.701+0000 7f51ccc10800 1 -- 172.21.15.102:0/3819669604 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56226f69d580 con 0x56226f69aaa0 2024-09-13T19:16:15.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.701+0000 7f51c82c1640 1 --2- 172.21.15.102:0/3819669604 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56226f69aaa0 0x56226f69ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.701+0000 7f51c82c1640 1 --2- 172.21.15.102:0/3819669604 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56226f69aaa0 0x56226f69ce90 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.701+0000 7f51c82c1640 1 -- 172.21.15.102:0/3819669604 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f51b8077c60 con 0x56226f69aaa0 2024-09-13T19:16:15.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.701+0000 7f51ccc10800 1 -- 172.21.15.102:0/3819669604 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56226f699940 con 0x56226f599eb0 2024-09-13T19:16:15.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.702+0000 7f51c8ac2640 1 -- 172.21.15.102:0/3819669604 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f51c00083e0 con 0x56226f599eb0 2024-09-13T19:16:15.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.702+0000 7f51ccc10800 1 -- 172.21.15.102:0/3819669604 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56226f699de0 con 0x56226f69aaa0 2024-09-13T19:16:15.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.702+0000 7f51c82c1640 1 -- 172.21.15.102:0/3819669604 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f51b8077c60 con 0x56226f69aaa0 2024-09-13T19:16:15.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.702+0000 7f51ccc10800 1 Processor -- start 2024-09-13T19:16:15.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.702+0000 7f51ccc10800 1 -- start start 2024-09-13T19:16:15.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.702+0000 7f51ccc10800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56226f6abef0 0x56226f6ac310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.702+0000 7f51ccc10800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56226f435580 con 0x56226f6abef0 2024-09-13T19:16:15.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.703+0000 7f51c8ac2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56226f6abef0 0x56226f6ac310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.703+0000 7f51c8ac2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56226f6abef0 0x56226f6ac310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54230/0 (socket says 172.21.15.102:54230) 2024-09-13T19:16:15.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.703+0000 7f51c8ac2640 1 -- 172.21.15.102:0/3618037324 learned_addr learned my addr 172.21.15.102:0/3618037324 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:15.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.703+0000 7f51c8ac2640 1 -- 172.21.15.102:0/3618037324 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56226f6ac850 con 0x56226f6abef0 2024-09-13T19:16:15.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.703+0000 7f51c8ac2640 1 --2- 172.21.15.102:0/3618037324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56226f6abef0 0x56226f6ac310 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x56226f50dff0 tx=0x7f51c000beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.703+0000 7f50adffb640 1 -- 172.21.15.102:0/3618037324 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51c001c020 con 0x56226f6abef0 2024-09-13T19:16:15.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.703+0000 7f50adffb640 1 -- 172.21.15.102:0/3618037324 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51c0007cf0 con 0x56226f6abef0 2024-09-13T19:16:15.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.703+0000 7f51ccc10800 1 -- 172.21.15.102:0/3618037324 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56226f6acae0 con 0x56226f6abef0 2024-09-13T19:16:15.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.703+0000 7f50adffb640 1 -- 172.21.15.102:0/3618037324 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51c0018440 con 0x56226f6abef0 2024-09-13T19:16:15.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.703+0000 7f51ccc10800 1 -- 172.21.15.102:0/3618037324 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56226f6af7c0 con 0x56226f6abef0 2024-09-13T19:16:15.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.704+0000 7f50adffb640 1 -- 172.21.15.102:0/3618037324 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f51c001f020 con 0x56226f6abef0 2024-09-13T19:16:15.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.704+0000 7f50adffb640 1 --2- 172.21.15.102:0/3618037324 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f50a0036b90 0x7f50a0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.704+0000 7f50adffb640 1 -- 172.21.15.102:0/3618037324 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f51c004e2a0 con 0x56226f6abef0 2024-09-13T19:16:15.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.704+0000 7f51c82c1640 1 --2- 172.21.15.102:0/3618037324 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f50a0036b90 0x7f50a0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.705+0000 7f51ccc10800 1 Processor -- start 2024-09-13T19:16:15.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.705+0000 7f51ccc10800 1 -- start start 2024-09-13T19:16:15.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.705+0000 7f51c82c1640 1 --2- 172.21.15.102:0/3618037324 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f50a0036b90 0x7f50a0039050 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x56226f699050 tx=0x7f51b8093040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.705+0000 7f51ccc10800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56226f6b8bc0 0x56226f6b8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.705+0000 7f51ccc10800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56226f688f70 con 0x56226f6b8bc0 2024-09-13T19:16:15.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.705+0000 7f51c8ac2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56226f6b8bc0 0x56226f6b8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.705+0000 7f51c8ac2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56226f6b8bc0 0x56226f6b8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54246/0 (socket says 172.21.15.102:54246) 2024-09-13T19:16:15.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.705+0000 7f51c8ac2640 1 -- 172.21.15.102:0/3931029953 learned_addr learned my addr 172.21.15.102:0/3931029953 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:15.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.705+0000 7f51c8ac2640 1 -- 172.21.15.102:0/3931029953 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56226f6b9590 con 0x56226f6b8bc0 2024-09-13T19:16:15.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.705+0000 7f51c8ac2640 1 --2- 172.21.15.102:0/3931029953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56226f6b8bc0 0x56226f6b8fc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f51c004c5f0 tx=0x7f51c0016640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=831c60f16bd1aab1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.705+0000 7f50a77fe640 1 -- 172.21.15.102:0/3931029953 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51c0045070 con 0x56226f6b8bc0 2024-09-13T19:16:15.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.705+0000 7f50a77fe640 1 -- 172.21.15.102:0/3931029953 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51c0021400 con 0x56226f6b8bc0 2024-09-13T19:16:15.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.705+0000 7f50a77fe640 1 -- 172.21.15.102:0/3931029953 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51c0018b40 con 0x56226f6b8bc0 2024-09-13T19:16:15.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.706+0000 7f51ccc10800 1 -- 172.21.15.102:0/3931029953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56226f6b8bc0 msgr2=0x56226f6b8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.706+0000 7f51ccc10800 1 --2- 172.21.15.102:0/3931029953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56226f6b8bc0 0x56226f6b8fc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f51c004c5f0 tx=0x7f51c0016640 comp rx=0 tx=0).stop 2024-09-13T19:16:15.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.706+0000 7f51ccc10800 1 -- 172.21.15.102:0/3931029953 shutdown_connections 2024-09-13T19:16:15.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.706+0000 7f51ccc10800 1 --2- 172.21.15.102:0/3931029953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56226f6b8bc0 0x56226f6b8fc0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.706+0000 7f51ccc10800 1 -- 172.21.15.102:0/3931029953 >> 172.21.15.102:0/3931029953 conn(0x56226f6b4f20 msgr2=0x56226f6b3020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:15.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.706+0000 7f51ccc10800 1 -- 172.21.15.102:0/3931029953 shutdown_connections 2024-09-13T19:16:15.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.706+0000 7f51ccc10800 1 -- 172.21.15.102:0/3931029953 wait complete. 2024-09-13T19:16:15.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.706+0000 7f51ccc10800 1 Processor -- start 2024-09-13T19:16:15.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.706+0000 7f51ccc10800 1 -- start start 2024-09-13T19:16:15.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.706+0000 7f51ccc10800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56226f6b8bc0 0x56226f6c0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.706+0000 7f51ccc10800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56226f6b9c00 con 0x56226f6b8bc0 2024-09-13T19:16:15.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.707+0000 7f51c8ac2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56226f6b8bc0 0x56226f6c0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.707+0000 7f51c8ac2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56226f6b8bc0 0x56226f6c0080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54250/0 (socket says 172.21.15.102:54250) 2024-09-13T19:16:15.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.707+0000 7f51c8ac2640 1 -- 172.21.15.102:0/1848578607 learned_addr learned my addr 172.21.15.102:0/1848578607 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:15.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.707+0000 7f51c8ac2640 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56226f6c05c0 con 0x56226f6b8bc0 2024-09-13T19:16:15.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.707+0000 7f51c8ac2640 1 --2- 172.21.15.102:0/1848578607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56226f6b8bc0 0x56226f6c0080 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f51c004b510 tx=0x7f51c004c580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.707+0000 7f50a5ffb640 1 -- 172.21.15.102:0/1848578607 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51c0045030 con 0x56226f6b8bc0 2024-09-13T19:16:15.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.707+0000 7f50a5ffb640 1 -- 172.21.15.102:0/1848578607 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51c004b210 con 0x56226f6b8bc0 2024-09-13T19:16:15.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.707+0000 7f50a5ffb640 1 -- 172.21.15.102:0/1848578607 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51c003f040 con 0x56226f6b8bc0 2024-09-13T19:16:15.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.707+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56226f6c0850 con 0x56226f6b8bc0 2024-09-13T19:16:15.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.707+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56226f6c3500 con 0x56226f6b8bc0 2024-09-13T19:16:15.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.708+0000 7f50a5ffb640 1 -- 172.21.15.102:0/1848578607 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f51c0016040 con 0x56226f6b8bc0 2024-09-13T19:16:15.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.708+0000 7f50a5ffb640 1 --2- 172.21.15.102:0/1848578607 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5098036b90 0x7f5098039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.708+0000 7f50a5ffb640 1 -- 172.21.15.102:0/1848578607 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f51c0046070 con 0x56226f6b8bc0 2024-09-13T19:16:15.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.708+0000 7f51c82c1640 1 --2- 172.21.15.102:0/1848578607 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5098036b90 0x7f5098039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.709+0000 7f51c82c1640 1 --2- 172.21.15.102:0/1848578607 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5098036b90 0x7f5098039050 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f51b8058ef0 tx=0x7f51b8098000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.709+0000 7f51ccc10800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.709+0000 7f51ccc10800 1 --2- 172.21.15.102:0/1848578607 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56226f6cbb70 0x56226f6ce030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.709+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56226f6ce780 con 0x56226f6cbb70 2024-09-13T19:16:15.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.709+0000 7f51c7ac0640 1 --2- 172.21.15.102:0/1848578607 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56226f6cbb70 0x56226f6ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.709+0000 7f51c7ac0640 1 --2- 172.21.15.102:0/1848578607 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56226f6cbb70 0x56226f6ce030 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.709+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f51bc009050 con 0x56226f6cbb70 2024-09-13T19:16:15.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.710+0000 7f51ccc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.710+0000 7f51ccc10800 20 realm 2024-09-13T19:16:15.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.710+0000 7f51ccc10800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.710+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56226f6cafc0 con 0x56226f6cbb70 2024-09-13T19:16:15.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.710+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f51bc009050 con 0x56226f6cbb70 2024-09-13T19:16:15.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.710+0000 7f51ccc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.710+0000 7f51ccc10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:15.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.710+0000 7f51ccc10800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.710+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56226f6cf270 con 0x56226f6cbb70 2024-09-13T19:16:15.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.710+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f51bc009050 con 0x56226f6cbb70 2024-09-13T19:16:15.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.710+0000 7f51ccc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.710+0000 7f51ccc10800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.710+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56226f6cfb40 con 0x56226f6cbb70 2024-09-13T19:16:15.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.710+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f51bc009050 con 0x56226f6cbb70 2024-09-13T19:16:15.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.710+0000 7f51ccc10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:15.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.710+0000 7f51ccc10800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.710+0000 7f51ccc10800 1 --2- 172.21.15.102:0/1848578607 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56226f6d0480 0x56226f6d2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.710+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56226f6d3000 con 0x56226f6d0480 2024-09-13T19:16:15.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.710+0000 7f51c8ac2640 1 --2- 172.21.15.102:0/1848578607 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56226f6d0480 0x56226f6d2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.711+0000 7f51c8ac2640 1 --2- 172.21.15.102:0/1848578607 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56226f6d0480 0x56226f6d2870 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.711+0000 7f51c8ac2640 1 -- 172.21.15.102:0/1848578607 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f51c0028070 con 0x56226f6d0480 2024-09-13T19:16:15.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.711+0000 7f51ccc10800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:15.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.711+0000 7f51ccc10800 20 searching for the correct realm 2024-09-13T19:16:15.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.711+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56226f6d4950 con 0x56226f6d0480 2024-09-13T19:16:15.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.711+0000 7f51c8ac2640 1 -- 172.21.15.102:0/1848578607 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51c0028070 con 0x56226f6d0480 2024-09-13T19:16:15.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.711+0000 7f51c8ac2640 1 --2- 172.21.15.102:0/1848578607 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f51c0021020 0x7f51c0029880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.711+0000 7f51c8ac2640 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56226f6d4950 con 0x7f51c0021020 2024-09-13T19:16:15.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.711+0000 7f51c82c1640 1 --2- 172.21.15.102:0/1848578607 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f51c0021020 0x7f51c0029880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.711+0000 7f51c82c1640 1 --2- 172.21.15.102:0/1848578607 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f51c0021020 0x7f51c0029880 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.712+0000 7f51c82c1640 1 -- 172.21.15.102:0/1848578607 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51b808d050 con 0x7f51c0021020 2024-09-13T19:16:15.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.712+0000 7f51c82c1640 1 --2- 172.21.15.102:0/1848578607 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f51b80ab040 0x7f51b808a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.712+0000 7f51c82c1640 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56226f6d4950 con 0x7f51b80ab040 2024-09-13T19:16:15.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.712+0000 7f51c7ac0640 1 --2- 172.21.15.102:0/1848578607 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f51b80ab040 0x7f51b808a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.712+0000 7f51c7ac0640 1 --2- 172.21.15.102:0/1848578607 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f51b80ab040 0x7f51b808a750 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.713+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51bc009050 con 0x7f51b80ab040 2024-09-13T19:16:15.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.713+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56226f6d4950 con 0x56226f6cbb70 2024-09-13T19:16:15.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.713+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51bc009050 con 0x56226f6cbb70 2024-09-13T19:16:15.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.713+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56226f6d4950 con 0x56226f6cbb70 2024-09-13T19:16:15.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.713+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51bc029040 con 0x56226f6cbb70 2024-09-13T19:16:15.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.713+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56226f6d4950 con 0x7f51b80ab040 2024-09-13T19:16:15.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.713+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51bc029040 con 0x7f51b80ab040 2024-09-13T19:16:15.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.713+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56226f6d4950 con 0x7f51b80ab040 2024-09-13T19:16:15.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.714+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51bc029040 con 0x7f51b80ab040 2024-09-13T19:16:15.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.714+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56226f6d4950 con 0x7f51c0021020 2024-09-13T19:16:15.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.714+0000 7f51c82c1640 1 -- 172.21.15.102:0/1848578607 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51b808d050 con 0x7f51c0021020 2024-09-13T19:16:15.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.714+0000 7f51c82c1640 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56226f6d4950 con 0x56226f6d0480 2024-09-13T19:16:15.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.714+0000 7f51c8ac2640 1 -- 172.21.15.102:0/1848578607 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51c0028070 con 0x56226f6d0480 2024-09-13T19:16:15.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.714+0000 7f51c8ac2640 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56226f6d4950 con 0x56226f6cbb70 2024-09-13T19:16:15.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.714+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51bc029040 con 0x56226f6cbb70 2024-09-13T19:16:15.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.714+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56226f6d4950 con 0x7f51b80ab040 2024-09-13T19:16:15.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.714+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51bc029040 con 0x7f51b80ab040 2024-09-13T19:16:15.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.715+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56226f6d4950 con 0x56226f6cbb70 2024-09-13T19:16:15.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.715+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51bc029040 con 0x56226f6cbb70 2024-09-13T19:16:15.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.715+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56226f6d4950 con 0x7f51c0021020 2024-09-13T19:16:15.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.715+0000 7f51c82c1640 1 -- 172.21.15.102:0/1848578607 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f51b808d050 con 0x7f51c0021020 2024-09-13T19:16:15.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.715+0000 7f51c82c1640 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56226f6d4950 con 0x56226f6d0480 2024-09-13T19:16:15.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.715+0000 7f51c8ac2640 1 -- 172.21.15.102:0/1848578607 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51c0028070 con 0x56226f6d0480 2024-09-13T19:16:15.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.715+0000 7f51c8ac2640 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56226f6d4950 con 0x56226f6d0480 2024-09-13T19:16:15.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.715+0000 7f51c8ac2640 1 -- 172.21.15.102:0/1848578607 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f51c0028070 con 0x56226f6d0480 2024-09-13T19:16:15.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.715+0000 7f51c8ac2640 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56226f6d4950 con 0x7f51b80ab040 2024-09-13T19:16:15.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.716+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51bc029040 con 0x7f51b80ab040 2024-09-13T19:16:15.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.716+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56226f6d4950 con 0x56226f6d0480 2024-09-13T19:16:15.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.716+0000 7f51c8ac2640 1 -- 172.21.15.102:0/1848578607 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f51c0028070 con 0x56226f6d0480 2024-09-13T19:16:15.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.716+0000 7f51c8ac2640 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56226f6d4950 con 0x56226f6d0480 2024-09-13T19:16:15.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.716+0000 7f51c8ac2640 1 -- 172.21.15.102:0/1848578607 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51c0028070 con 0x56226f6d0480 2024-09-13T19:16:15.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.716+0000 7f51c8ac2640 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56226f6d4950 con 0x56226f6cbb70 2024-09-13T19:16:15.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.716+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51bc029040 con 0x56226f6cbb70 2024-09-13T19:16:15.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.716+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56226f6d4950 con 0x56226f6cbb70 2024-09-13T19:16:15.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.716+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f51bc029040 con 0x56226f6cbb70 2024-09-13T19:16:15.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.716+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56226f6d4950 con 0x7f51b80ab040 2024-09-13T19:16:15.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.717+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51bc029040 con 0x7f51b80ab040 2024-09-13T19:16:15.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.717+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56226f6d4950 con 0x56226f6d0480 2024-09-13T19:16:15.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.717+0000 7f51c8ac2640 1 -- 172.21.15.102:0/1848578607 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51c0028070 con 0x56226f6d0480 2024-09-13T19:16:15.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.717+0000 7f51c8ac2640 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56226f6d4950 con 0x7f51c0021020 2024-09-13T19:16:15.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.717+0000 7f51c82c1640 1 -- 172.21.15.102:0/1848578607 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51b808d050 con 0x7f51c0021020 2024-09-13T19:16:15.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.717+0000 7f51c82c1640 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56226f6d4950 con 0x56226f6cbb70 2024-09-13T19:16:15.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.717+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51bc029040 con 0x56226f6cbb70 2024-09-13T19:16:15.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.717+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56226f6d4950 con 0x7f51b80ab040 2024-09-13T19:16:15.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.718+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51bc029040 con 0x7f51b80ab040 2024-09-13T19:16:15.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.718+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56226f6d4950 con 0x56226f6d0480 2024-09-13T19:16:15.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.718+0000 7f51c8ac2640 1 -- 172.21.15.102:0/1848578607 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51c0028070 con 0x56226f6d0480 2024-09-13T19:16:15.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.718+0000 7f51c8ac2640 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56226f6d4950 con 0x7f51b80ab040 2024-09-13T19:16:15.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.718+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51bc029040 con 0x7f51b80ab040 2024-09-13T19:16:15.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.718+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56226f6d4950 con 0x7f51c0021020 2024-09-13T19:16:15.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.718+0000 7f51c82c1640 1 -- 172.21.15.102:0/1848578607 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51b808d050 con 0x7f51c0021020 2024-09-13T19:16:15.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.718+0000 7f51c82c1640 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56226f6d4950 con 0x56226f6d0480 2024-09-13T19:16:15.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.719+0000 7f51c8ac2640 1 -- 172.21.15.102:0/1848578607 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51c0028070 con 0x56226f6d0480 2024-09-13T19:16:15.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.719+0000 7f51c8ac2640 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56226f6d4950 con 0x7f51b80ab040 2024-09-13T19:16:15.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.719+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51bc029040 con 0x7f51b80ab040 2024-09-13T19:16:15.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.719+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56226f6d4950 con 0x56226f6cbb70 2024-09-13T19:16:15.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.719+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f51bc029040 con 0x56226f6cbb70 2024-09-13T19:16:15.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.719+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56226f6d4950 con 0x7f51c0021020 2024-09-13T19:16:15.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.719+0000 7f51c82c1640 1 -- 172.21.15.102:0/1848578607 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51b808d050 con 0x7f51c0021020 2024-09-13T19:16:15.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.719+0000 7f51ccc10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:15.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.719+0000 7f51ccc10800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:15.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.719+0000 7f51ccc10800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:15.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.719+0000 7f51ccc10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:15.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.719+0000 7f51ccc10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:15.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.719+0000 7f51ccc10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:15.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.719+0000 7f51ccc10800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.719+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56226f6d39c0 con 0x56226f6cbb70 2024-09-13T19:16:15.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.720+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f51bc029040 con 0x56226f6cbb70 2024-09-13T19:16:15.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.720+0000 7f51ccc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.720+0000 7f51ccc10800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.720+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56226f6d4260 con 0x56226f6cbb70 2024-09-13T19:16:15.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.720+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f51bc029040 con 0x56226f6cbb70 2024-09-13T19:16:15.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.720+0000 7f51ccc10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:15.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.720+0000 7f51ccc10800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.720+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56226f6d4dd0 con 0x56226f6d0480 2024-09-13T19:16:15.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.720+0000 7f51c8ac2640 1 -- 172.21.15.102:0/1848578607 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f51c0028070 con 0x56226f6d0480 2024-09-13T19:16:15.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.720+0000 7f51ccc10800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:15.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.720+0000 7f51ccc10800 20 zone default found 2024-09-13T19:16:15.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.720+0000 7f51ccc10800 4 Realm: () 2024-09-13T19:16:15.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.720+0000 7f51ccc10800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:15.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.720+0000 7f51ccc10800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:15.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.720+0000 7f51ccc10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:15.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.720+0000 7f51ccc10800 20 zonegroup default 2024-09-13T19:16:15.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.720+0000 7f51ccc10800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.720+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56226f6d3e70 con 0x7f51b80ab040 2024-09-13T19:16:15.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.720+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f51bc029040 con 0x7f51b80ab040 2024-09-13T19:16:15.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.721+0000 7f51ccc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.721+0000 7f51ccc10800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.721+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56226f6d7500 con 0x56226f6d0480 2024-09-13T19:16:15.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.721+0000 7f51c8ac2640 1 -- 172.21.15.102:0/1848578607 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f51c0028070 con 0x56226f6d0480 2024-09-13T19:16:15.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.721+0000 7f51ccc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.721+0000 7f51ccc10800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.721+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56226f6d7500 con 0x56226f6d0480 2024-09-13T19:16:15.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.721+0000 7f51c8ac2640 1 -- 172.21.15.102:0/1848578607 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f51c0028070 con 0x56226f6d0480 2024-09-13T19:16:15.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.721+0000 7f51ccc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.721+0000 7f51ccc10800 20 started sync module instance, tier type = 2024-09-13T19:16:15.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.721+0000 7f51ccc10800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:15.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.721+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56226f6d6940 con 0x7f51c0021020 2024-09-13T19:16:15.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.722+0000 7f51c82c1640 1 -- 172.21.15.102:0/1848578607 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(44 notify.0 [create] v34'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51b808d050 con 0x7f51c0021020 2024-09-13T19:16:15.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.722+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94705898319072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56226f6d75b0 con 0x7f51c0021020 2024-09-13T19:16:15.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.722+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56226f6d7e60 con 0x56226f6cbb70 2024-09-13T19:16:15.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.723+0000 7f51c82c1640 1 -- 172.21.15.102:0/1848578607 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94705898319072] v34'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51b808d050 con 0x7f51c0021020 2024-09-13T19:16:15.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.723+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v34'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51bc029040 con 0x56226f6cbb70 2024-09-13T19:16:15.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.723+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94705898322256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56226f6d8250 con 0x56226f6cbb70 2024-09-13T19:16:15.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.723+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56226f6d8c90 con 0x56226f6d0480 2024-09-13T19:16:15.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.724+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94705898322256] v34'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51bc029040 con 0x56226f6cbb70 2024-09-13T19:16:15.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.725+0000 7f51c8ac2640 1 -- 172.21.15.102:0/1848578607 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v34'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51c0028070 con 0x56226f6d0480 2024-09-13T19:16:15.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.725+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94705898325856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56226f6d8c50 con 0x56226f6d0480 2024-09-13T19:16:15.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.725+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56226f6d9700 con 0x7f51c0021020 2024-09-13T19:16:15.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.725+0000 7f51c8ac2640 1 -- 172.21.15.102:0/1848578607 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94705898325856] v34'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51c0028070 con 0x56226f6d0480 2024-09-13T19:16:15.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.725+0000 7f51c82c1640 1 -- 172.21.15.102:0/1848578607 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(50 notify.3 [create] v34'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51b808d050 con 0x7f51c0021020 2024-09-13T19:16:15.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.726+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94705898328656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56226f6d9b20 con 0x7f51c0021020 2024-09-13T19:16:15.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.726+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56226f6da560 con 0x56226f6cbb70 2024-09-13T19:16:15.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.727+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v34'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51bc029040 con 0x56226f6cbb70 2024-09-13T19:16:15.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.727+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94705898332208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56226f6da560 con 0x56226f6cbb70 2024-09-13T19:16:15.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.727+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56226f6db540 con 0x7f51b80ab040 2024-09-13T19:16:15.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.727+0000 7f51c82c1640 1 -- 172.21.15.102:0/1848578607 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94705898328656] v34'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51b808d050 con 0x7f51c0021020 2024-09-13T19:16:15.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.728+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(54 notify.5 [create] v34'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51bc029040 con 0x7f51b80ab040 2024-09-13T19:16:15.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.728+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94705898320128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56226f6db500 con 0x7f51b80ab040 2024-09-13T19:16:15.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.728+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56226f6dbf80 con 0x7f51b80ab040 2024-09-13T19:16:15.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.728+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94705898332208] v34'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51bc029040 con 0x56226f6cbb70 2024-09-13T19:16:15.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.729+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94705898320128] v34'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51bc029040 con 0x7f51b80ab040 2024-09-13T19:16:15.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.729+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(56 notify.6 [create] v34'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51bc029040 con 0x7f51b80ab040 2024-09-13T19:16:15.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.729+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94705898336336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56226f6db470 con 0x7f51b80ab040 2024-09-13T19:16:15.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.729+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56226f6dc430 con 0x7f51b80ab040 2024-09-13T19:16:15.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.730+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94705898336336] v34'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51bc029040 con 0x7f51b80ab040 2024-09-13T19:16:15.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.730+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(58 notify.7 [create] v34'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51bc029040 con 0x7f51b80ab040 2024-09-13T19:16:15.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.730+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94705898339024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56226f6dc3a0 con 0x7f51b80ab040 2024-09-13T19:16:15.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.730+0000 7f51ccc10800 20 add_watcher() i=0 2024-09-13T19:16:15.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.730+0000 7f51ccc10800 20 add_watcher() i=1 2024-09-13T19:16:15.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.730+0000 7f51ccc10800 20 add_watcher() i=2 2024-09-13T19:16:15.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.730+0000 7f51ccc10800 20 add_watcher() i=3 2024-09-13T19:16:15.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.730+0000 7f51ccc10800 20 add_watcher() i=4 2024-09-13T19:16:15.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.730+0000 7f51ccc10800 20 add_watcher() i=5 2024-09-13T19:16:15.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.730+0000 7f51ccc10800 20 add_watcher() i=6 2024-09-13T19:16:15.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.731+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94705898339024] v34'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51bc029040 con 0x7f51b80ab040 2024-09-13T19:16:15.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.731+0000 7f51ccc10800 20 add_watcher() i=7 2024-09-13T19:16:15.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.731+0000 7f51ccc10800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:15.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.731+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56226f6df860 con 0x56226f6cbb70 2024-09-13T19:16:15.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.731+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f51bc029040 con 0x56226f6cbb70 2024-09-13T19:16:15.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.731+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94705898340544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56226f6dcd10 con 0x56226f6cbb70 2024-09-13T19:16:15.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.732+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94705898340544] v34'64 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f51bc029040 con 0x56226f6cbb70 2024-09-13T19:16:15.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.732+0000 7f507efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:15.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.732+0000 7f51ccc10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:15.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.732+0000 7f51ccc10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:15.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.732+0000 7f51ccc10800 5 note: GC not initialized 2024-09-13T19:16:15.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.732+0000 7f507dfe3640 20 reqs_thread_entry: start 2024-09-13T19:16:15.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.733+0000 7f51ccc10800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:15.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.733+0000 7f51ccc10800 20 Filter name: none 2024-09-13T19:16:15.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.733+0000 7f50777fe640 20 reqs_thread_entry: start 2024-09-13T19:16:15.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.733+0000 7f51ccc10800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:16:15.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.733+0000 7f51ccc10800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.733+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56226f712d90 con 0x56226f6cbb70 2024-09-13T19:16:15.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.733+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f51bc029040 con 0x56226f6cbb70 2024-09-13T19:16:15.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.733+0000 7f51ccc10800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:16:15.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.733+0000 7f51ccc10800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:16:15.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.733+0000 7f51ccc10800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:16:15.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.733+0000 7f51ccc10800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:16:15.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.733+0000 7f51ccc10800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-13T19:16:15.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.733+0000 7f51ccc10800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.733+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56226f713800 con 0x7f51b80ab040 2024-09-13T19:16:15.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.733+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f51bc029040 con 0x7f51b80ab040 2024-09-13T19:16:15.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.734+0000 7f51ccc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.734+0000 7f51ccc10800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-13T19:16:15.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.734+0000 7f51ccc10800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T19:16:15.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.734+0000 7f51ccc10800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T19:16:15.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.734+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~502 in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56226f7191e0 con 0x56226f6cbb70 2024-09-13T19:16:15.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.735+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~502] v34'4 uv4 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f51bc029040 con 0x56226f6cbb70 2024-09-13T19:16:15.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.735+0000 7f51ccc10800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:16:15.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.735+0000 7f51ccc10800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:16:15.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.735+0000 7f51ccc10800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T19:16:15.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.735+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94705898589088 in=690b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56226f714840 con 0x56226f6cbb70 2024-09-13T19:16:15.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.735+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== watch-notify(notify (1) cookie 94705898332208 notify 146028888067 ret 0) ==== 720+0+0 (crc 0 0 0) 0x56226f459b30 con 0x56226f6cbb70 2024-09-13T19:16:15.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.735+0000 7f50a77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888067 cookie 94705898332208 notifier 4349 bl.length()=678 2024-09-13T19:16:15.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.735+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(65 notify.4 [notify cookie 94705898589088 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f51bc029040 con 0x56226f6cbb70 2024-09-13T19:16:15.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.735+0000 7f50a77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:16:15.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.735+0000 7f50a77fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:16:15.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.735+0000 7f50a77fe640 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f508c003ea0 con 0x56226f6cbb70 2024-09-13T19:16:15.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.735+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51bc029040 con 0x56226f6cbb70 2024-09-13T19:16:15.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.735+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== watch-notify(notify_complete (2) cookie 94705898589088 notify 146028888067 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f51bc03b9f0 con 0x56226f6cbb70 2024-09-13T19:16:15.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.735+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56226f718ba0 con 0x7f51b80ab040 2024-09-13T19:16:15.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.736+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v34'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f51bc029040 con 0x7f51b80ab040 2024-09-13T19:16:15.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.737+0000 7f51ccc10800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T19:16:15.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.737+0000 7f51ccc10800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T19:16:15.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.737+0000 7f51ccc10800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T19:16:15.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.737+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94705898572912 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56226f718ba0 con 0x56226f6d0480 2024-09-13T19:16:15.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.737+0000 7f51c8ac2640 1 -- 172.21.15.102:0/1848578607 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== watch-notify(notify (1) cookie 94705898325856 notify 146028888064 ret 0) ==== 219+0+0 (crc 0 0 0) 0x56226f6c0850 con 0x56226f6d0480 2024-09-13T19:16:15.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.737+0000 7f50a77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888064 cookie 94705898325856 notifier 4349 bl.length()=177 2024-09-13T19:16:15.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.737+0000 7f50a77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T19:16:15.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.737+0000 7f50a77fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T19:16:15.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.737+0000 7f50a77fe640 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f508c003ea0 con 0x56226f6d0480 2024-09-13T19:16:15.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.737+0000 7f51c8ac2640 1 -- 172.21.15.102:0/1848578607 <== osd.3 v2:172.21.15.102:6800/3096737090 17 ==== osd_op_reply(68 notify.2 [notify cookie 94705898572912 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f51c0028070 con 0x56226f6d0480 2024-09-13T19:16:15.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.737+0000 7f51c8ac2640 1 -- 172.21.15.102:0/1848578607 <== osd.3 v2:172.21.15.102:6800/3096737090 18 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51c0028070 con 0x56226f6d0480 2024-09-13T19:16:15.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.737+0000 7f51c8ac2640 1 -- 172.21.15.102:0/1848578607 <== osd.3 v2:172.21.15.102:6800/3096737090 19 ==== watch-notify(notify_complete (2) cookie 94705898572912 notify 146028888064 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56226f6c05c0 con 0x56226f6d0480 2024-09-13T19:16:15.753 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:16:14.779675Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-13T19:16:15.735970Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:16:14.779665Z","tags":[],"group_ids":[]} 2024-09-13T19:16:15.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.738+0000 7f507efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:15.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.738+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94705898340544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56226f714390 con 0x56226f6cbb70 2024-09-13T19:16:15.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.739+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94705898340544] v34'65 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f51bc029040 con 0x56226f6cbb70 2024-09-13T19:16:15.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.739+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94705898319072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56226f710a50 con 0x7f51c0021020 2024-09-13T19:16:15.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.740+0000 7f51c82c1640 1 -- 172.21.15.102:0/1848578607 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94705898319072] v34'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51b808d050 con 0x7f51c0021020 2024-09-13T19:16:15.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.740+0000 7f51ccc10800 20 remove_watcher() i=0 2024-09-13T19:16:15.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.740+0000 7f51ccc10800 2 removed watcher, disabling cache 2024-09-13T19:16:15.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.740+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94705898322256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56226f710a50 con 0x56226f6cbb70 2024-09-13T19:16:15.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.741+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 <== osd.1 v2:172.21.15.102:6808/2204418452 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94705898322256] v34'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51bc029040 con 0x56226f6cbb70 2024-09-13T19:16:15.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.741+0000 7f51ccc10800 20 remove_watcher() i=1 2024-09-13T19:16:15.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.741+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94705898325856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56226f710a50 con 0x56226f6d0480 2024-09-13T19:16:15.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.742+0000 7f51c8ac2640 1 -- 172.21.15.102:0/1848578607 <== osd.3 v2:172.21.15.102:6800/3096737090 20 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94705898325856] v34'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51c0028070 con 0x56226f6d0480 2024-09-13T19:16:15.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.742+0000 7f51ccc10800 20 remove_watcher() i=2 2024-09-13T19:16:15.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.742+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94705898328656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56226f710a50 con 0x7f51c0021020 2024-09-13T19:16:15.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.743+0000 7f51c82c1640 1 -- 172.21.15.102:0/1848578607 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94705898328656] v34'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51b808d050 con 0x7f51c0021020 2024-09-13T19:16:15.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.743+0000 7f51ccc10800 20 remove_watcher() i=3 2024-09-13T19:16:15.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.743+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94705898332208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56226f710a50 con 0x56226f6cbb70 2024-09-13T19:16:15.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.744+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 <== osd.1 v2:172.21.15.102:6808/2204418452 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94705898332208] v34'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51bc029040 con 0x56226f6cbb70 2024-09-13T19:16:15.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.744+0000 7f51ccc10800 20 remove_watcher() i=4 2024-09-13T19:16:15.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.744+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94705898320128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56226f710a50 con 0x7f51b80ab040 2024-09-13T19:16:15.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.745+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94705898320128] v34'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51bc029040 con 0x7f51b80ab040 2024-09-13T19:16:15.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.745+0000 7f51ccc10800 20 remove_watcher() i=5 2024-09-13T19:16:15.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.745+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94705898336336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56226f710a50 con 0x7f51b80ab040 2024-09-13T19:16:15.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.746+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 <== osd.0 v2:172.21.15.53:6800/4021716951 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94705898336336] v34'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51bc029040 con 0x7f51b80ab040 2024-09-13T19:16:15.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.746+0000 7f51ccc10800 20 remove_watcher() i=6 2024-09-13T19:16:15.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.746+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94705898339024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56226f710a50 con 0x7f51b80ab040 2024-09-13T19:16:15.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.747+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 <== osd.0 v2:172.21.15.53:6800/4021716951 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94705898339024] v34'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51bc029040 con 0x7f51b80ab040 2024-09-13T19:16:15.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.747+0000 7f51ccc10800 20 remove_watcher() i=7 2024-09-13T19:16:15.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.747+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f51b80ab040 msgr2=0x7f51b808a750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.747+0000 7f51ccc10800 1 --2- 172.21.15.102:0/1848578607 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f51b80ab040 0x7f51b808a750 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.747+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56226f6cbb70 msgr2=0x56226f6ce030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.747+0000 7f51ccc10800 1 --2- 172.21.15.102:0/1848578607 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56226f6cbb70 0x56226f6ce030 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.747+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f51c0021020 msgr2=0x7f51c0029880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.747+0000 7f51ccc10800 1 --2- 172.21.15.102:0/1848578607 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f51c0021020 0x7f51c0029880 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.747+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56226f6d0480 msgr2=0x56226f6d2870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.747+0000 7f51ccc10800 1 --2- 172.21.15.102:0/1848578607 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56226f6d0480 0x56226f6d2870 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.747+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5098036b90 msgr2=0x7f5098039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.747+0000 7f51ccc10800 1 --2- 172.21.15.102:0/1848578607 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5098036b90 0x7f5098039050 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f51b8058ef0 tx=0x7f51b8098000 comp rx=0 tx=0).stop 2024-09-13T19:16:15.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.747+0000 7f51c7ac0640 1 -- 172.21.15.102:0/1848578607 reap_dead start 2024-09-13T19:16:15.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.747+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56226f6b8bc0 msgr2=0x56226f6c0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.747+0000 7f51ccc10800 1 --2- 172.21.15.102:0/1848578607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56226f6b8bc0 0x56226f6c0080 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f51c004b510 tx=0x7f51c004c580 comp rx=0 tx=0).stop 2024-09-13T19:16:15.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.747+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 shutdown_connections 2024-09-13T19:16:15.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.747+0000 7f51ccc10800 1 --2- 172.21.15.102:0/1848578607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56226f6b8bc0 0x56226f6c0080 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.747+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 >> 172.21.15.102:0/1848578607 conn(0x56226f6b4f20 msgr2=0x56226f6b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:15.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.747+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 shutdown_connections 2024-09-13T19:16:15.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.747+0000 7f51ccc10800 1 -- 172.21.15.102:0/1848578607 wait complete. 2024-09-13T19:16:15.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.747+0000 7f51ccc10800 1 -- 172.21.15.102:0/3618037324 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f50a0036b90 msgr2=0x7f50a0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.747+0000 7f51ccc10800 1 --2- 172.21.15.102:0/3618037324 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f50a0036b90 0x7f50a0039050 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x56226f699050 tx=0x7f51b8093040 comp rx=0 tx=0).stop 2024-09-13T19:16:15.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.747+0000 7f51ccc10800 1 -- 172.21.15.102:0/3618037324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56226f6abef0 msgr2=0x56226f6ac310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.747+0000 7f51ccc10800 1 --2- 172.21.15.102:0/3618037324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56226f6abef0 0x56226f6ac310 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x56226f50dff0 tx=0x7f51c000beb0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.747+0000 7f51ccc10800 1 -- 172.21.15.102:0/3618037324 shutdown_connections 2024-09-13T19:16:15.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.747+0000 7f51ccc10800 1 --2- 172.21.15.102:0/3618037324 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f50a0036b90 0x7f50a0039050 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.747+0000 7f51ccc10800 1 --2- 172.21.15.102:0/3618037324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56226f6abef0 0x56226f6ac310 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.747+0000 7f51ccc10800 1 -- 172.21.15.102:0/3618037324 >> 172.21.15.102:0/3618037324 conn(0x56226f6a0e80 msgr2=0x56226f6a3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:15.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.747+0000 7f51ccc10800 1 -- 172.21.15.102:0/3618037324 shutdown_connections 2024-09-13T19:16:15.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.748+0000 7f51ccc10800 1 -- 172.21.15.102:0/3618037324 wait complete. 2024-09-13T19:16:15.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.748+0000 7f51ccc10800 1 -- 172.21.15.102:0/3819669604 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56226f599eb0 msgr2=0x56226f698190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.748+0000 7f51ccc10800 1 --2- 172.21.15.102:0/3819669604 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56226f599eb0 0x56226f698190 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.748+0000 7f51ccc10800 1 -- 172.21.15.102:0/3819669604 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56226f69aaa0 msgr2=0x56226f69ce90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.748+0000 7f51ccc10800 1 --2- 172.21.15.102:0/3819669604 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56226f69aaa0 0x56226f69ce90 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.748+0000 7f51ccc10800 1 -- 172.21.15.102:0/3819669604 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f50b0036b40 msgr2=0x7f50b0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.748+0000 7f51ccc10800 1 --2- 172.21.15.102:0/3819669604 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f50b0036b40 0x7f50b0039000 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f51bc000f60 tx=0x7f51bc0012b0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.748+0000 7f51ccc10800 1 -- 172.21.15.102:0/3819669604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56226f599570 msgr2=0x56226f50e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.748+0000 7f51ccc10800 1 --2- 172.21.15.102:0/3819669604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56226f599570 0x56226f50e600 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f51b8046130 tx=0x7f51b8003330 comp rx=0 tx=0).stop 2024-09-13T19:16:15.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.748+0000 7f51ccc10800 1 -- 172.21.15.102:0/3819669604 shutdown_connections 2024-09-13T19:16:15.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.748+0000 7f51ccc10800 1 --2- 172.21.15.102:0/3819669604 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56226f69aaa0 0x56226f69ce90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.748+0000 7f51ccc10800 1 --2- 172.21.15.102:0/3819669604 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56226f599eb0 0x56226f698190 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.748+0000 7f51ccc10800 1 --2- 172.21.15.102:0/3819669604 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f50b0036b40 0x7f50b0039000 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.748+0000 7f51ccc10800 1 --2- 172.21.15.102:0/3819669604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56226f599570 0x56226f50e600 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.748+0000 7f51ccc10800 1 -- 172.21.15.102:0/3819669604 >> 172.21.15.102:0/3819669604 conn(0x56226f594e00 msgr2=0x56226f682ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:15.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.748+0000 7f51ccc10800 1 -- 172.21.15.102:0/3819669604 shutdown_connections 2024-09-13T19:16:15.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.748+0000 7f51ccc10800 1 -- 172.21.15.102:0/3819669604 wait complete. 2024-09-13T19:16:15.764 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:16:14.779675Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-13T19:16:15.735970Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:16:14.779665Z', 'tags': [], 'group_ids': []} 2024-09-13T19:16:15.764 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T19:16:15.764 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T19:16:15.764 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T19:16:15.810 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:15.810 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:15.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.805+0000 7f5cb70b9800 1 Processor -- start 2024-09-13T19:16:15.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.805+0000 7f5cb70b9800 1 -- start start 2024-09-13T19:16:15.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.805+0000 7f5cb70b9800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x563a94bfe900 0x563a94c00cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.805+0000 7f5cb70b9800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563a94abab30 con 0x563a94bfa4c0 2024-09-13T19:16:15.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.805+0000 7f5cb70b9800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x563a94a9c360 con 0x563a94bfe900 2024-09-13T19:16:15.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.805+0000 7f5caffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x563a94bfe900 0x563a94c00cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.805+0000 7f5cb4bad640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x563a94bfa4c0 0x563a94bfa8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:49846/0 (socket says 172.21.15.102:49846) 2024-09-13T19:16:15.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.805+0000 7f5caffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x563a94bfe900 0x563a94c00cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54252/0 (socket says 172.21.15.102:54252) 2024-09-13T19:16:15.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.805+0000 7f5cb4bad640 1 -- 172.21.15.102:0/1886949423 learned_addr learned my addr 172.21.15.102:0/1886949423 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:16:15.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.806+0000 7f5caffff640 1 -- 172.21.15.102:0/1886949423 >> v1:172.21.15.53:6789/0 conn(0x563a94bfa4c0 legacy=0x563a94bfa8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.806+0000 7f5caffff640 1 -- 172.21.15.102:0/1886949423 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a94ac2e00 con 0x563a94bfe900 2024-09-13T19:16:15.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.807+0000 7f5caffff640 1 --2- 172.21.15.102:0/1886949423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a94bfe900 0x563a94c00cf0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5ca000a470 tx=0x7f5ca0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=980d9d806b8ab028 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.808+0000 7f5caf7fe640 1 -- 172.21.15.102:0/1886949423 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ca0053570 con 0x563a94bfe900 2024-09-13T19:16:15.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.808+0000 7f5caf7fe640 1 -- 172.21.15.102:0/1886949423 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ca0058070 con 0x563a94bfe900 2024-09-13T19:16:15.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.808+0000 7f5caf7fe640 1 -- 172.21.15.102:0/1886949423 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ca0053880 con 0x563a94bfe900 2024-09-13T19:16:15.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.808+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1886949423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a94bfe900 msgr2=0x563a94c00cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.808+0000 7f5cb70b9800 1 --2- 172.21.15.102:0/1886949423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a94bfe900 0x563a94c00cf0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5ca000a470 tx=0x7f5ca0045a20 comp rx=0 tx=0).stop 2024-09-13T19:16:15.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.808+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1886949423 shutdown_connections 2024-09-13T19:16:15.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.808+0000 7f5cb70b9800 1 --2- 172.21.15.102:0/1886949423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a94bfe900 0x563a94c00cf0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.808+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1886949423 >> 172.21.15.102:0/1886949423 conn(0x563a94bf5df0 msgr2=0x563a94bf8210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:15.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.808+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1886949423 shutdown_connections 2024-09-13T19:16:15.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.808+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1886949423 wait complete. 2024-09-13T19:16:15.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.822+0000 7f5cb70b9800 1 Processor -- start 2024-09-13T19:16:15.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.822+0000 7f5cb70b9800 1 -- start start 2024-09-13T19:16:15.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.822+0000 7f5cb70b9800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a94bfa4c0 0x563a94b6ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.822+0000 7f5cb70b9800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563a94b47330 con 0x563a94bfa4c0 2024-09-13T19:16:15.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.823+0000 7f5cb4bad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a94bfa4c0 0x563a94b6ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.823+0000 7f5cb4bad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a94bfa4c0 0x563a94b6ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54262/0 (socket says 172.21.15.102:54262) 2024-09-13T19:16:15.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.823+0000 7f5cb4bad640 1 -- 172.21.15.102:0/901918439 learned_addr learned my addr 172.21.15.102:0/901918439 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:15.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.823+0000 7f5cb4bad640 1 -- 172.21.15.102:0/901918439 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a94a94bc0 con 0x563a94bfa4c0 2024-09-13T19:16:15.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.823+0000 7f5cb4bad640 1 --2- 172.21.15.102:0/901918439 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a94bfa4c0 0x563a94b6ed80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5ca8001d80 tx=0x7f5ca8001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c880820137af7571 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.823+0000 7f5ba2e05640 1 -- 172.21.15.102:0/901918439 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ca8013030 con 0x563a94bfa4c0 2024-09-13T19:16:15.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.823+0000 7f5ba2e05640 1 -- 172.21.15.102:0/901918439 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ca800e470 con 0x563a94bfa4c0 2024-09-13T19:16:15.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.823+0000 7f5ba2e05640 1 -- 172.21.15.102:0/901918439 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ca800e810 con 0x563a94bfa4c0 2024-09-13T19:16:15.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.824+0000 7f5cb70b9800 1 -- 172.21.15.102:0/901918439 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a94bfa4c0 msgr2=0x563a94b6ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.824+0000 7f5cb70b9800 1 --2- 172.21.15.102:0/901918439 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a94bfa4c0 0x563a94b6ed80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5ca8001d80 tx=0x7f5ca8001e70 comp rx=0 tx=0).stop 2024-09-13T19:16:15.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.824+0000 7f5cb70b9800 1 -- 172.21.15.102:0/901918439 shutdown_connections 2024-09-13T19:16:15.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.824+0000 7f5cb70b9800 1 --2- 172.21.15.102:0/901918439 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a94bfa4c0 0x563a94b6ed80 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.824+0000 7f5cb70b9800 1 -- 172.21.15.102:0/901918439 >> 172.21.15.102:0/901918439 conn(0x563a94bf5df0 msgr2=0x563a94ce5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:15.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.824+0000 7f5cb70b9800 1 -- 172.21.15.102:0/901918439 shutdown_connections 2024-09-13T19:16:15.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.824+0000 7f5cb70b9800 1 -- 172.21.15.102:0/901918439 wait complete. 2024-09-13T19:16:15.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.824+0000 7f5cb70b9800 1 Processor -- start 2024-09-13T19:16:15.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.825+0000 7f5cb70b9800 1 -- start start 2024-09-13T19:16:15.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.825+0000 7f5cb70b9800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a94bfa4c0 0x563a94cf2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.825+0000 7f5cb70b9800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563a94c01530 con 0x563a94bfa4c0 2024-09-13T19:16:15.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.825+0000 7f5cb4bad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a94bfa4c0 0x563a94cf2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.825+0000 7f5cb4bad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a94bfa4c0 0x563a94cf2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54266/0 (socket says 172.21.15.102:54266) 2024-09-13T19:16:15.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.825+0000 7f5cb4bad640 1 -- 172.21.15.102:0/2839447828 learned_addr learned my addr 172.21.15.102:0/2839447828 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:15.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.825+0000 7f5cb4bad640 1 -- 172.21.15.102:0/2839447828 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a94aa8fe0 con 0x563a94bfa4c0 2024-09-13T19:16:15.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.825+0000 7f5cb4bad640 1 --2- 172.21.15.102:0/2839447828 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a94bfa4c0 0x563a94cf2260 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5ca8004000 tx=0x7f5ca8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.826+0000 7f5ba1602640 1 -- 172.21.15.102:0/2839447828 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ca8027070 con 0x563a94bfa4c0 2024-09-13T19:16:15.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.826+0000 7f5cb70b9800 1 -- 172.21.15.102:0/2839447828 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563a94cf27a0 con 0x563a94bfa4c0 2024-09-13T19:16:15.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.826+0000 7f5cb70b9800 1 -- 172.21.15.102:0/2839447828 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a94cf2cc0 con 0x563a94bfa4c0 2024-09-13T19:16:15.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.826+0000 7f5ba1602640 1 -- 172.21.15.102:0/2839447828 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ca8019900 con 0x563a94bfa4c0 2024-09-13T19:16:15.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.826+0000 7f5ba1602640 1 -- 172.21.15.102:0/2839447828 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ca8019c60 con 0x563a94bfa4c0 2024-09-13T19:16:15.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.827+0000 7f5ba1602640 1 -- 172.21.15.102:0/2839447828 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5ca802a070 con 0x563a94bfa4c0 2024-09-13T19:16:15.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.827+0000 7f5ba1602640 1 --2- 172.21.15.102:0/2839447828 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5b9c036b40 0x7f5b9c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.827+0000 7f5ba1602640 1 -- 172.21.15.102:0/2839447828 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f5ca801f070 con 0x563a94bfa4c0 2024-09-13T19:16:15.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.827+0000 7f5caffff640 1 --2- 172.21.15.102:0/2839447828 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5b9c036b40 0x7f5b9c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.827+0000 7f5cb70b9800 1 --2- 172.21.15.102:0/2839447828 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563a94bfe900 0x563a94cf92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.827+0000 7f5cb70b9800 1 -- 172.21.15.102:0/2839447828 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563a94cf9850 con 0x563a94bfe900 2024-09-13T19:16:15.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.827+0000 7f5cb53ae640 1 --2- 172.21.15.102:0/2839447828 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563a94bfe900 0x563a94cf92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.827+0000 7f5caffff640 1 --2- 172.21.15.102:0/2839447828 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5b9c036b40 0x7f5b9c039000 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5ca0057000 tx=0x7f5ca0052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.827+0000 7f5cb53ae640 1 --2- 172.21.15.102:0/2839447828 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563a94bfe900 0x563a94cf92d0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.828+0000 7f5cb53ae640 1 -- 172.21.15.102:0/2839447828 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5cb000a4a0 con 0x563a94bfe900 2024-09-13T19:16:15.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.828+0000 7f5cb70b9800 1 -- 172.21.15.102:0/2839447828 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563a94cf68a0 con 0x563a94bfe900 2024-09-13T19:16:15.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.828+0000 7f5cb53ae640 1 -- 172.21.15.102:0/2839447828 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5cb000a4a0 con 0x563a94bfe900 2024-09-13T19:16:15.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.828+0000 7f5cb70b9800 1 --2- 172.21.15.102:0/2839447828 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563a94cfbba0 0x563a94cfdf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.828+0000 7f5cb70b9800 1 -- 172.21.15.102:0/2839447828 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563a94cfe680 con 0x563a94cfbba0 2024-09-13T19:16:15.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.828+0000 7f5cb4bad640 1 --2- 172.21.15.102:0/2839447828 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563a94cfbba0 0x563a94cfdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.828+0000 7f5cb4bad640 1 --2- 172.21.15.102:0/2839447828 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563a94cfbba0 0x563a94cfdf90 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.829+0000 7f5cb4bad640 1 -- 172.21.15.102:0/2839447828 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5ca8029030 con 0x563a94cfbba0 2024-09-13T19:16:15.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.829+0000 7f5cb70b9800 1 -- 172.21.15.102:0/2839447828 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563a94cfaa10 con 0x563a94bfe900 2024-09-13T19:16:15.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.829+0000 7f5cb53ae640 1 -- 172.21.15.102:0/2839447828 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5cb000a4a0 con 0x563a94bfe900 2024-09-13T19:16:15.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.829+0000 7f5cb70b9800 1 -- 172.21.15.102:0/2839447828 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563a94cfaef0 con 0x563a94cfbba0 2024-09-13T19:16:15.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.829+0000 7f5cb4bad640 1 -- 172.21.15.102:0/2839447828 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5ca8029030 con 0x563a94cfbba0 2024-09-13T19:16:15.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.830+0000 7f5cb70b9800 1 Processor -- start 2024-09-13T19:16:15.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.830+0000 7f5cb70b9800 1 -- start start 2024-09-13T19:16:15.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.830+0000 7f5cb70b9800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a94d0d000 0x563a94d0d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.830+0000 7f5cb70b9800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563a94a96580 con 0x563a94d0d000 2024-09-13T19:16:15.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.830+0000 7f5cb53ae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a94d0d000 0x563a94d0d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.830+0000 7f5cb53ae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a94d0d000 0x563a94d0d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54268/0 (socket says 172.21.15.102:54268) 2024-09-13T19:16:15.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.830+0000 7f5cb53ae640 1 -- 172.21.15.102:0/3479500645 learned_addr learned my addr 172.21.15.102:0/3479500645 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:15.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.831+0000 7f5cb53ae640 1 -- 172.21.15.102:0/3479500645 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a94d0d960 con 0x563a94d0d000 2024-09-13T19:16:15.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.831+0000 7f5cb53ae640 1 --2- 172.21.15.102:0/3479500645 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a94d0d000 0x563a94d0d420 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x563a94cf3660 tx=0x7f5cb00163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.831+0000 7f5b9a7fc640 1 -- 172.21.15.102:0/3479500645 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cb0013450 con 0x563a94d0d000 2024-09-13T19:16:15.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.831+0000 7f5b9a7fc640 1 -- 172.21.15.102:0/3479500645 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cb00135f0 con 0x563a94d0d000 2024-09-13T19:16:15.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.831+0000 7f5cb70b9800 1 -- 172.21.15.102:0/3479500645 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563a94d0dbf0 con 0x563a94d0d000 2024-09-13T19:16:15.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.831+0000 7f5b9a7fc640 1 -- 172.21.15.102:0/3479500645 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cb0013910 con 0x563a94d0d000 2024-09-13T19:16:15.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.831+0000 7f5cb70b9800 1 -- 172.21.15.102:0/3479500645 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a94d108d0 con 0x563a94d0d000 2024-09-13T19:16:15.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.832+0000 7f5b9a7fc640 1 -- 172.21.15.102:0/3479500645 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5cb0011040 con 0x563a94d0d000 2024-09-13T19:16:15.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.832+0000 7f5b9a7fc640 1 --2- 172.21.15.102:0/3479500645 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5b8c036c00 0x7f5b8c0390c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.832+0000 7f5b9a7fc640 1 -- 172.21.15.102:0/3479500645 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f5cb000e040 con 0x563a94d0d000 2024-09-13T19:16:15.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.832+0000 7f5cb4bad640 1 --2- 172.21.15.102:0/3479500645 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5b8c036c00 0x7f5b8c0390c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.832+0000 7f5cb70b9800 1 Processor -- start 2024-09-13T19:16:15.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.832+0000 7f5cb70b9800 1 -- start start 2024-09-13T19:16:15.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.832+0000 7f5cb4bad640 1 --2- 172.21.15.102:0/3479500645 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5b8c036c00 0x7f5b8c0390c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x563a94cfa150 tx=0x7f5ca804ad80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.832+0000 7f5cb70b9800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a94d19d20 0x563a94d1a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.832+0000 7f5cb70b9800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563a94ced730 con 0x563a94d19d20 2024-09-13T19:16:15.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.832+0000 7f5cb53ae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a94d19d20 0x563a94d1a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.833+0000 7f5cb53ae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a94d19d20 0x563a94d1a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54284/0 (socket says 172.21.15.102:54284) 2024-09-13T19:16:15.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.833+0000 7f5cb53ae640 1 -- 172.21.15.102:0/3503388473 learned_addr learned my addr 172.21.15.102:0/3503388473 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:15.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.833+0000 7f5cb53ae640 1 -- 172.21.15.102:0/3503388473 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a94d1a6f0 con 0x563a94d19d20 2024-09-13T19:16:15.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.833+0000 7f5cb53ae640 1 --2- 172.21.15.102:0/3503388473 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a94d19d20 0x563a94d1a120 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5cb004cdc0 tx=0x7f5cb004cfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa33d399b846baf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.833+0000 7f5b8bfff640 1 -- 172.21.15.102:0/3503388473 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cb002a440 con 0x563a94d19d20 2024-09-13T19:16:15.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.833+0000 7f5b8bfff640 1 -- 172.21.15.102:0/3503388473 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cb001f390 con 0x563a94d19d20 2024-09-13T19:16:15.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.833+0000 7f5b8bfff640 1 -- 172.21.15.102:0/3503388473 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cb002a5e0 con 0x563a94d19d20 2024-09-13T19:16:15.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.833+0000 7f5cb70b9800 1 -- 172.21.15.102:0/3503388473 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a94d19d20 msgr2=0x563a94d1a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.833+0000 7f5cb70b9800 1 --2- 172.21.15.102:0/3503388473 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a94d19d20 0x563a94d1a120 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5cb004cdc0 tx=0x7f5cb004cfc0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.833+0000 7f5cb70b9800 1 -- 172.21.15.102:0/3503388473 shutdown_connections 2024-09-13T19:16:15.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.833+0000 7f5cb70b9800 1 --2- 172.21.15.102:0/3503388473 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a94d19d20 0x563a94d1a120 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.833+0000 7f5cb70b9800 1 -- 172.21.15.102:0/3503388473 >> 172.21.15.102:0/3503388473 conn(0x563a94d160d0 msgr2=0x563a94d141d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:15.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.834+0000 7f5cb70b9800 1 -- 172.21.15.102:0/3503388473 shutdown_connections 2024-09-13T19:16:15.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.834+0000 7f5cb70b9800 1 -- 172.21.15.102:0/3503388473 wait complete. 2024-09-13T19:16:15.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.834+0000 7f5cb70b9800 1 Processor -- start 2024-09-13T19:16:15.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.834+0000 7f5cb70b9800 1 -- start start 2024-09-13T19:16:15.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.834+0000 7f5cb70b9800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a94d19d20 0x563a94d21170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.834+0000 7f5cb70b9800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563a94d1acc0 con 0x563a94d19d20 2024-09-13T19:16:15.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.834+0000 7f5cb53ae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a94d19d20 0x563a94d21170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.834+0000 7f5cb53ae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a94d19d20 0x563a94d21170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54294/0 (socket says 172.21.15.102:54294) 2024-09-13T19:16:15.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.834+0000 7f5cb53ae640 1 -- 172.21.15.102:0/1393103781 learned_addr learned my addr 172.21.15.102:0/1393103781 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:15.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.834+0000 7f5cb53ae640 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a94d216b0 con 0x563a94d19d20 2024-09-13T19:16:15.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.835+0000 7f5cb53ae640 1 --2- 172.21.15.102:0/1393103781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a94d19d20 0x563a94d21170 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5cb004cd20 tx=0x7f5cb004cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.835+0000 7f5b8a7fc640 1 -- 172.21.15.102:0/1393103781 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cb0039070 con 0x563a94d19d20 2024-09-13T19:16:15.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.835+0000 7f5b8a7fc640 1 -- 172.21.15.102:0/1393103781 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cb001f710 con 0x563a94d19d20 2024-09-13T19:16:15.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.835+0000 7f5b8a7fc640 1 -- 172.21.15.102:0/1393103781 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cb001f9f0 con 0x563a94d19d20 2024-09-13T19:16:15.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.835+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563a94d21940 con 0x563a94d19d20 2024-09-13T19:16:15.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.835+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a94d245f0 con 0x563a94d19d20 2024-09-13T19:16:15.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.836+0000 7f5b8a7fc640 1 -- 172.21.15.102:0/1393103781 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5cb003c070 con 0x563a94d19d20 2024-09-13T19:16:15.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.836+0000 7f5b8a7fc640 1 --2- 172.21.15.102:0/1393103781 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5b80036af0 0x7f5b80038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.836+0000 7f5b8a7fc640 1 -- 172.21.15.102:0/1393103781 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f5cb003fc90 con 0x563a94d19d20 2024-09-13T19:16:15.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.836+0000 7f5cb4bad640 1 --2- 172.21.15.102:0/1393103781 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5b80036af0 0x7f5b80038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.836+0000 7f5cb70b9800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.836+0000 7f5cb70b9800 1 --2- 172.21.15.102:0/1393103781 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563a94d2cc00 0x563a94d2f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.836+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563a94d2f810 con 0x563a94d2cc00 2024-09-13T19:16:15.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.836+0000 7f5caffff640 1 --2- 172.21.15.102:0/1393103781 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563a94d2cc00 0x563a94d2f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.836+0000 7f5cb4bad640 1 --2- 172.21.15.102:0/1393103781 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5b80036af0 0x7f5b80038fb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5ca8001550 tx=0x7f5ca803a000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.837+0000 7f5caffff640 1 --2- 172.21.15.102:0/1393103781 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563a94d2cc00 0x563a94d2f0c0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.837+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5ca0051070 con 0x563a94d2cc00 2024-09-13T19:16:15.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.837+0000 7f5cb70b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.837+0000 7f5cb70b9800 20 realm 2024-09-13T19:16:15.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.837+0000 7f5cb70b9800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.837+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563a94d2fc40 con 0x563a94d2cc00 2024-09-13T19:16:15.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.837+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5ca0051070 con 0x563a94d2cc00 2024-09-13T19:16:15.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.837+0000 7f5cb70b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.837+0000 7f5cb70b9800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:15.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.837+0000 7f5cb70b9800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.837+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563a94d30510 con 0x563a94d2cc00 2024-09-13T19:16:15.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.837+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5ca0051070 con 0x563a94d2cc00 2024-09-13T19:16:15.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.837+0000 7f5cb70b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.837+0000 7f5cb70b9800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.837+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563a94d308b0 con 0x563a94d2cc00 2024-09-13T19:16:15.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.838+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5ca0051070 con 0x563a94d2cc00 2024-09-13T19:16:15.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.838+0000 7f5cb70b9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:15.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.838+0000 7f5cb70b9800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.838+0000 7f5cb70b9800 1 --2- 172.21.15.102:0/1393103781 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563a94d31610 0x563a94d33a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.838+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563a94d33f40 con 0x563a94d31610 2024-09-13T19:16:15.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.838+0000 7f5cb53ae640 1 --2- 172.21.15.102:0/1393103781 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563a94d31610 0x563a94d33a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.838+0000 7f5cb53ae640 1 --2- 172.21.15.102:0/1393103781 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563a94d31610 0x563a94d33a00 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.838+0000 7f5cb53ae640 1 -- 172.21.15.102:0/1393103781 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5cb003b030 con 0x563a94d31610 2024-09-13T19:16:15.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.838+0000 7f5cb70b9800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:15.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.838+0000 7f5cb70b9800 20 searching for the correct realm 2024-09-13T19:16:15.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.838+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a94d35920 con 0x563a94d31610 2024-09-13T19:16:15.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.838+0000 7f5cb53ae640 1 -- 172.21.15.102:0/1393103781 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cb003b030 con 0x563a94d31610 2024-09-13T19:16:15.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.838+0000 7f5cb53ae640 1 --2- 172.21.15.102:0/1393103781 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f5cb003e070 0x7f5cb0048490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.838+0000 7f5cb53ae640 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a94d35920 con 0x7f5cb003e070 2024-09-13T19:16:15.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.839+0000 7f5cb4bad640 1 --2- 172.21.15.102:0/1393103781 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f5cb003e070 0x7f5cb0048490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.839+0000 7f5cb4bad640 1 --2- 172.21.15.102:0/1393103781 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f5cb003e070 0x7f5cb0048490 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.839+0000 7f5cb4bad640 1 -- 172.21.15.102:0/1393103781 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ca8037030 con 0x7f5cb003e070 2024-09-13T19:16:15.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.839+0000 7f5cb4bad640 1 --2- 172.21.15.102:0/1393103781 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f5ca8059040 0x7f5ca80491a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.839+0000 7f5cb4bad640 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a94d35920 con 0x7f5ca8059040 2024-09-13T19:16:15.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.839+0000 7f5caffff640 1 --2- 172.21.15.102:0/1393103781 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f5ca8059040 0x7f5ca80491a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.840+0000 7f5caffff640 1 --2- 172.21.15.102:0/1393103781 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f5ca8059040 0x7f5ca80491a0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.840+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ca0051070 con 0x7f5ca8059040 2024-09-13T19:16:15.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.840+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a94d35920 con 0x563a94d2cc00 2024-09-13T19:16:15.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.840+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ca0051070 con 0x563a94d2cc00 2024-09-13T19:16:15.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.840+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a94d35920 con 0x563a94d2cc00 2024-09-13T19:16:15.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.840+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ca0051070 con 0x563a94d2cc00 2024-09-13T19:16:15.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.840+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a94d35920 con 0x7f5ca8059040 2024-09-13T19:16:15.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.841+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ca0051070 con 0x7f5ca8059040 2024-09-13T19:16:15.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.841+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a94d35920 con 0x7f5ca8059040 2024-09-13T19:16:15.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.841+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ca0051070 con 0x7f5ca8059040 2024-09-13T19:16:15.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.841+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a94d35920 con 0x7f5cb003e070 2024-09-13T19:16:15.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.841+0000 7f5cb4bad640 1 -- 172.21.15.102:0/1393103781 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ca8037030 con 0x7f5cb003e070 2024-09-13T19:16:15.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.841+0000 7f5cb4bad640 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a94d35920 con 0x563a94d31610 2024-09-13T19:16:15.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.841+0000 7f5cb53ae640 1 -- 172.21.15.102:0/1393103781 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cb003b030 con 0x563a94d31610 2024-09-13T19:16:15.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.841+0000 7f5cb53ae640 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a94d35920 con 0x563a94d2cc00 2024-09-13T19:16:15.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.842+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ca0051070 con 0x563a94d2cc00 2024-09-13T19:16:15.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.842+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a94d35920 con 0x7f5ca8059040 2024-09-13T19:16:15.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.842+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ca0051070 con 0x7f5ca8059040 2024-09-13T19:16:15.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.842+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a94d35920 con 0x563a94d2cc00 2024-09-13T19:16:15.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.842+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ca0051070 con 0x563a94d2cc00 2024-09-13T19:16:15.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.842+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a94d35920 con 0x7f5cb003e070 2024-09-13T19:16:15.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.842+0000 7f5cb4bad640 1 -- 172.21.15.102:0/1393103781 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5ca8037030 con 0x7f5cb003e070 2024-09-13T19:16:15.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.842+0000 7f5cb4bad640 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a94d35920 con 0x563a94d31610 2024-09-13T19:16:15.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.843+0000 7f5cb53ae640 1 -- 172.21.15.102:0/1393103781 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cb003b030 con 0x563a94d31610 2024-09-13T19:16:15.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.843+0000 7f5cb53ae640 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a94d35920 con 0x563a94d31610 2024-09-13T19:16:15.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.843+0000 7f5cb53ae640 1 -- 172.21.15.102:0/1393103781 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5cb003b030 con 0x563a94d31610 2024-09-13T19:16:15.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.843+0000 7f5cb53ae640 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a94d35920 con 0x7f5ca8059040 2024-09-13T19:16:15.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.843+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ca0051070 con 0x7f5ca8059040 2024-09-13T19:16:15.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.843+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a94d35920 con 0x563a94d31610 2024-09-13T19:16:15.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.843+0000 7f5cb53ae640 1 -- 172.21.15.102:0/1393103781 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5cb003b030 con 0x563a94d31610 2024-09-13T19:16:15.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.843+0000 7f5cb53ae640 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a94d35920 con 0x563a94d31610 2024-09-13T19:16:15.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.843+0000 7f5cb53ae640 1 -- 172.21.15.102:0/1393103781 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cb003b030 con 0x563a94d31610 2024-09-13T19:16:15.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.844+0000 7f5cb53ae640 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a94d35920 con 0x563a94d2cc00 2024-09-13T19:16:15.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.844+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ca0051070 con 0x563a94d2cc00 2024-09-13T19:16:15.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.844+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a94d35920 con 0x563a94d2cc00 2024-09-13T19:16:15.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.844+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5ca0051070 con 0x563a94d2cc00 2024-09-13T19:16:15.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.844+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a94d35920 con 0x7f5ca8059040 2024-09-13T19:16:15.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.844+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ca0051070 con 0x7f5ca8059040 2024-09-13T19:16:15.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.844+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a94d35920 con 0x563a94d31610 2024-09-13T19:16:15.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.844+0000 7f5cb53ae640 1 -- 172.21.15.102:0/1393103781 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cb003b030 con 0x563a94d31610 2024-09-13T19:16:15.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.844+0000 7f5cb53ae640 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a94d35920 con 0x7f5cb003e070 2024-09-13T19:16:15.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.845+0000 7f5cb4bad640 1 -- 172.21.15.102:0/1393103781 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ca8037030 con 0x7f5cb003e070 2024-09-13T19:16:15.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.845+0000 7f5cb4bad640 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a94d35920 con 0x563a94d2cc00 2024-09-13T19:16:15.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.845+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ca0051070 con 0x563a94d2cc00 2024-09-13T19:16:15.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.845+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a94d35920 con 0x7f5ca8059040 2024-09-13T19:16:15.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.845+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ca0051070 con 0x7f5ca8059040 2024-09-13T19:16:15.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.845+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a94d35920 con 0x563a94d31610 2024-09-13T19:16:15.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.845+0000 7f5cb53ae640 1 -- 172.21.15.102:0/1393103781 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cb003b030 con 0x563a94d31610 2024-09-13T19:16:15.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.845+0000 7f5cb53ae640 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a94d35920 con 0x7f5ca8059040 2024-09-13T19:16:15.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.846+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ca0051070 con 0x7f5ca8059040 2024-09-13T19:16:15.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.846+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f5ca0087040 con 0x7f5cb003e070 2024-09-13T19:16:15.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.846+0000 7f5cb4bad640 1 -- 172.21.15.102:0/1393103781 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ca8037030 con 0x7f5cb003e070 2024-09-13T19:16:15.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.846+0000 7f5cb4bad640 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f5ca0087040 con 0x563a94d31610 2024-09-13T19:16:15.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.846+0000 7f5cb53ae640 1 -- 172.21.15.102:0/1393103781 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cb003b030 con 0x563a94d31610 2024-09-13T19:16:15.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.846+0000 7f5cb53ae640 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f5ca0087040 con 0x7f5ca8059040 2024-09-13T19:16:15.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.847+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ca0051070 con 0x7f5ca8059040 2024-09-13T19:16:15.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.847+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f5ca0087040 con 0x563a94d2cc00 2024-09-13T19:16:15.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.847+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5ca0051070 con 0x563a94d2cc00 2024-09-13T19:16:15.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.847+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f5ca0087040 con 0x7f5cb003e070 2024-09-13T19:16:15.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.847+0000 7f5cb4bad640 1 -- 172.21.15.102:0/1393103781 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ca8037030 con 0x7f5cb003e070 2024-09-13T19:16:15.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.847+0000 7f5cb70b9800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:15.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.847+0000 7f5cb70b9800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:15.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.847+0000 7f5cb70b9800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:15.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.847+0000 7f5cb70b9800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:15.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.847+0000 7f5cb70b9800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:15.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.847+0000 7f5cb70b9800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:15.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.847+0000 7f5cb70b9800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.847+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563a94d34a50 con 0x563a94d2cc00 2024-09-13T19:16:15.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.847+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5ca0051070 con 0x563a94d2cc00 2024-09-13T19:16:15.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.847+0000 7f5cb70b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.847+0000 7f5cb70b9800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.847+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563a94d34690 con 0x563a94d2cc00 2024-09-13T19:16:15.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.848+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5ca0051070 con 0x563a94d2cc00 2024-09-13T19:16:15.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.848+0000 7f5cb70b9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:15.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.848+0000 7f5cb70b9800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.848+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563a94d35370 con 0x563a94d31610 2024-09-13T19:16:15.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.848+0000 7f5cb53ae640 1 -- 172.21.15.102:0/1393103781 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5cb003b030 con 0x563a94d31610 2024-09-13T19:16:15.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.848+0000 7f5cb70b9800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:15.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.848+0000 7f5cb70b9800 20 zone default found 2024-09-13T19:16:15.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.848+0000 7f5cb70b9800 4 Realm: () 2024-09-13T19:16:15.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.848+0000 7f5cb70b9800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:15.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.848+0000 7f5cb70b9800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:15.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.848+0000 7f5cb70b9800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:15.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.848+0000 7f5cb70b9800 20 zonegroup default 2024-09-13T19:16:15.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.848+0000 7f5cb70b9800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.848+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563a94d362a0 con 0x7f5ca8059040 2024-09-13T19:16:15.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.848+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5ca0051070 con 0x7f5ca8059040 2024-09-13T19:16:15.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.848+0000 7f5cb70b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.848+0000 7f5cb70b9800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.848+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563a94d37d40 con 0x563a94d31610 2024-09-13T19:16:15.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.849+0000 7f5cb53ae640 1 -- 172.21.15.102:0/1393103781 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5cb003b030 con 0x563a94d31610 2024-09-13T19:16:15.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.849+0000 7f5cb70b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.849+0000 7f5cb70b9800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.849+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563a94d38270 con 0x563a94d31610 2024-09-13T19:16:15.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.849+0000 7f5cb53ae640 1 -- 172.21.15.102:0/1393103781 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5cb003b030 con 0x563a94d31610 2024-09-13T19:16:15.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.849+0000 7f5cb70b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.849+0000 7f5cb70b9800 20 started sync module instance, tier type = 2024-09-13T19:16:15.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.849+0000 7f5cb70b9800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:15.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.849+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a94d36c70 con 0x7f5cb003e070 2024-09-13T19:16:15.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.850+0000 7f5cb4bad640 1 -- 172.21.15.102:0/1393103781 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(44 notify.0 [create] v34'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ca8037030 con 0x7f5cb003e070 2024-09-13T19:16:15.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.850+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94809604976736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a94d368d0 con 0x7f5cb003e070 2024-09-13T19:16:15.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.850+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a94d391a0 con 0x563a94d2cc00 2024-09-13T19:16:15.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.851+0000 7f5cb4bad640 1 -- 172.21.15.102:0/1393103781 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94809604976736] v34'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ca8037030 con 0x7f5cb003e070 2024-09-13T19:16:15.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.851+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v34'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ca0051070 con 0x563a94d2cc00 2024-09-13T19:16:15.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.851+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94809604984048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a94d395c0 con 0x563a94d2cc00 2024-09-13T19:16:15.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.851+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a94d39f80 con 0x563a94d31610 2024-09-13T19:16:15.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.853+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94809604984048] v34'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ca0051070 con 0x563a94d2cc00 2024-09-13T19:16:15.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.853+0000 7f5cb53ae640 1 -- 172.21.15.102:0/1393103781 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v34'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cb003b030 con 0x563a94d31610 2024-09-13T19:16:15.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.853+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94809604985584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a94d39f80 con 0x563a94d31610 2024-09-13T19:16:15.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.853+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a94d3a9a0 con 0x7f5cb003e070 2024-09-13T19:16:15.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.854+0000 7f5cb53ae640 1 -- 172.21.15.102:0/1393103781 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94809604985584] v34'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cb003b030 con 0x563a94d31610 2024-09-13T19:16:15.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.854+0000 7f5cb4bad640 1 -- 172.21.15.102:0/1393103781 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(50 notify.3 [create] v34'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ca8037030 con 0x7f5cb003e070 2024-09-13T19:16:15.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.854+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94809604987600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a94d39ef0 con 0x7f5cb003e070 2024-09-13T19:16:15.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.854+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a94d3b860 con 0x563a94d2cc00 2024-09-13T19:16:15.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.856+0000 7f5cb4bad640 1 -- 172.21.15.102:0/1393103781 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94809604987600] v34'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ca8037030 con 0x7f5cb003e070 2024-09-13T19:16:15.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.856+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v34'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ca0051070 con 0x563a94d2cc00 2024-09-13T19:16:15.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.856+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94809604992400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a94d3b860 con 0x563a94d2cc00 2024-09-13T19:16:15.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.856+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a94d3c2b0 con 0x7f5ca8059040 2024-09-13T19:16:15.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.857+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94809604992400] v34'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ca0051070 con 0x563a94d2cc00 2024-09-13T19:16:15.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.858+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(54 notify.5 [create] v34'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ca0051070 con 0x7f5ca8059040 2024-09-13T19:16:15.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.858+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94809604996544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a94d3b860 con 0x7f5ca8059040 2024-09-13T19:16:15.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.858+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a94d3ccf0 con 0x7f5ca8059040 2024-09-13T19:16:15.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.858+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94809604996544] v34'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ca0051070 con 0x7f5ca8059040 2024-09-13T19:16:15.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.859+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(56 notify.6 [create] v34'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ca0051070 con 0x7f5ca8059040 2024-09-13T19:16:15.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.859+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94809604993968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a94d3ced0 con 0x7f5ca8059040 2024-09-13T19:16:15.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.859+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a94d3d720 con 0x7f5ca8059040 2024-09-13T19:16:15.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.860+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94809604993968] v34'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ca0051070 con 0x7f5ca8059040 2024-09-13T19:16:15.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.860+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(58 notify.7 [create] v34'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ca0051070 con 0x7f5ca8059040 2024-09-13T19:16:15.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.860+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94809605000192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a94d3d590 con 0x7f5ca8059040 2024-09-13T19:16:15.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.860+0000 7f5cb70b9800 20 add_watcher() i=0 2024-09-13T19:16:15.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.860+0000 7f5cb70b9800 20 add_watcher() i=1 2024-09-13T19:16:15.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.860+0000 7f5cb70b9800 20 add_watcher() i=2 2024-09-13T19:16:15.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.860+0000 7f5cb70b9800 20 add_watcher() i=3 2024-09-13T19:16:15.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.860+0000 7f5cb70b9800 20 add_watcher() i=4 2024-09-13T19:16:15.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.860+0000 7f5cb70b9800 20 add_watcher() i=5 2024-09-13T19:16:15.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.860+0000 7f5cb70b9800 20 add_watcher() i=6 2024-09-13T19:16:15.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.861+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94809605000192] v34'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ca0051070 con 0x7f5ca8059040 2024-09-13T19:16:15.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.861+0000 7f5cb70b9800 20 add_watcher() i=7 2024-09-13T19:16:15.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.861+0000 7f5cb70b9800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:15.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.861+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563a94d40ad0 con 0x563a94d2cc00 2024-09-13T19:16:15.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.861+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5ca0051070 con 0x563a94d2cc00 2024-09-13T19:16:15.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.861+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94809605001248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a94d3df90 con 0x563a94d2cc00 2024-09-13T19:16:15.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.862+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94809605001248] v34'66 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5ca0051070 con 0x563a94d2cc00 2024-09-13T19:16:15.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.862+0000 7f5b6afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:15.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.862+0000 7f5cb70b9800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:15.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.862+0000 7f5cb70b9800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:15.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.862+0000 7f5cb70b9800 5 note: GC not initialized 2024-09-13T19:16:15.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.862+0000 7f5b69fe3640 20 reqs_thread_entry: start 2024-09-13T19:16:15.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.862+0000 7f5cb70b9800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:15.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.863+0000 7f5cb70b9800 20 Filter name: none 2024-09-13T19:16:15.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.863+0000 7f5adb7fe640 20 reqs_thread_entry: start 2024-09-13T19:16:15.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.863+0000 7f5cb70b9800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.863+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563a94d73a40 con 0x563a94d2cc00 2024-09-13T19:16:15.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.863+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f5ca0051070 con 0x563a94d2cc00 2024-09-13T19:16:15.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.863+0000 7f5cb70b9800 20 rados_obj.operate() r=0 bl.length=502 2024-09-13T19:16:15.875 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:16:14.779675Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-13T19:16:15.735970Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:16:14.779665Z","tags":[],"group_ids":[]} 2024-09-13T19:16:15.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.864+0000 7f5b6afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:15.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.864+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94809605001248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a94d72490 con 0x563a94d2cc00 2024-09-13T19:16:15.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.865+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94809605001248] v34'67 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5ca0051070 con 0x563a94d2cc00 2024-09-13T19:16:15.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.865+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94809604976736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a94d71810 con 0x7f5cb003e070 2024-09-13T19:16:15.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.866+0000 7f5cb4bad640 1 -- 172.21.15.102:0/1393103781 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94809604976736] v34'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ca8037030 con 0x7f5cb003e070 2024-09-13T19:16:15.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.866+0000 7f5cb70b9800 20 remove_watcher() i=0 2024-09-13T19:16:15.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.866+0000 7f5cb70b9800 2 removed watcher, disabling cache 2024-09-13T19:16:15.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.866+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94809604984048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a94d71810 con 0x563a94d2cc00 2024-09-13T19:16:15.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.867+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94809604984048] v34'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ca0051070 con 0x563a94d2cc00 2024-09-13T19:16:15.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.867+0000 7f5cb70b9800 20 remove_watcher() i=1 2024-09-13T19:16:15.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.867+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94809604985584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a94d71810 con 0x563a94d31610 2024-09-13T19:16:15.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.868+0000 7f5cb53ae640 1 -- 172.21.15.102:0/1393103781 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94809604985584] v34'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cb003b030 con 0x563a94d31610 2024-09-13T19:16:15.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.868+0000 7f5cb70b9800 20 remove_watcher() i=2 2024-09-13T19:16:15.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.868+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94809604987600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a94d71810 con 0x7f5cb003e070 2024-09-13T19:16:15.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.869+0000 7f5cb4bad640 1 -- 172.21.15.102:0/1393103781 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94809604987600] v34'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ca8037030 con 0x7f5cb003e070 2024-09-13T19:16:15.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.869+0000 7f5cb70b9800 20 remove_watcher() i=3 2024-09-13T19:16:15.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.869+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94809604992400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a94d71810 con 0x563a94d2cc00 2024-09-13T19:16:15.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.870+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94809604992400] v34'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ca0051070 con 0x563a94d2cc00 2024-09-13T19:16:15.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.870+0000 7f5cb70b9800 20 remove_watcher() i=4 2024-09-13T19:16:15.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.870+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94809604996544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a94d71810 con 0x7f5ca8059040 2024-09-13T19:16:15.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.871+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94809604996544] v34'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ca0051070 con 0x7f5ca8059040 2024-09-13T19:16:15.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.871+0000 7f5cb70b9800 20 remove_watcher() i=5 2024-09-13T19:16:15.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.871+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94809604993968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a94d71810 con 0x7f5ca8059040 2024-09-13T19:16:15.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.872+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94809604993968] v34'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ca0051070 con 0x7f5ca8059040 2024-09-13T19:16:15.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.872+0000 7f5cb70b9800 20 remove_watcher() i=6 2024-09-13T19:16:15.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.872+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1393103781 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94809605000192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a94d71810 con 0x7f5ca8059040 2024-09-13T19:16:15.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.873+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94809605000192] v34'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ca0051070 con 0x7f5ca8059040 2024-09-13T19:16:15.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.873+0000 7f5cb70b9800 20 remove_watcher() i=7 2024-09-13T19:16:15.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.873+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1393103781 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f5ca8059040 msgr2=0x7f5ca80491a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.873+0000 7f5cb70b9800 1 --2- 172.21.15.102:0/1393103781 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f5ca8059040 0x7f5ca80491a0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.873+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1393103781 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563a94d2cc00 msgr2=0x563a94d2f0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.873+0000 7f5cb70b9800 1 --2- 172.21.15.102:0/1393103781 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563a94d2cc00 0x563a94d2f0c0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.873+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1393103781 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f5cb003e070 msgr2=0x7f5cb0048490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.873+0000 7f5cb70b9800 1 --2- 172.21.15.102:0/1393103781 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f5cb003e070 0x7f5cb0048490 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.873+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1393103781 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563a94d31610 msgr2=0x563a94d33a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.873+0000 7f5cb70b9800 1 --2- 172.21.15.102:0/1393103781 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563a94d31610 0x563a94d33a00 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.874+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1393103781 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5b80036af0 msgr2=0x7f5b80038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.874+0000 7f5cb70b9800 1 --2- 172.21.15.102:0/1393103781 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5b80036af0 0x7f5b80038fb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5ca8001550 tx=0x7f5ca803a000 comp rx=0 tx=0).stop 2024-09-13T19:16:15.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.874+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1393103781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a94d19d20 msgr2=0x563a94d21170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.874+0000 7f5cb70b9800 1 --2- 172.21.15.102:0/1393103781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a94d19d20 0x563a94d21170 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5cb004cd20 tx=0x7f5cb004cd50 comp rx=0 tx=0).stop 2024-09-13T19:16:15.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.874+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 reap_dead start 2024-09-13T19:16:15.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.874+0000 7f5caffff640 1 -- 172.21.15.102:0/1393103781 reap_dead start 2024-09-13T19:16:15.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.874+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1393103781 shutdown_connections 2024-09-13T19:16:15.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.874+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1393103781 >> 172.21.15.102:0/1393103781 conn(0x563a94d160d0 msgr2=0x563a94d1b430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:15.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.874+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1393103781 shutdown_connections 2024-09-13T19:16:15.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.874+0000 7f5cb70b9800 1 -- 172.21.15.102:0/1393103781 wait complete. 2024-09-13T19:16:15.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.874+0000 7f5cb70b9800 1 -- 172.21.15.102:0/3479500645 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5b8c036c00 msgr2=0x7f5b8c0390c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.874+0000 7f5cb70b9800 1 --2- 172.21.15.102:0/3479500645 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5b8c036c00 0x7f5b8c0390c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x563a94cfa150 tx=0x7f5ca804ad80 comp rx=0 tx=0).stop 2024-09-13T19:16:15.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.874+0000 7f5cb70b9800 1 -- 172.21.15.102:0/3479500645 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a94d0d000 msgr2=0x563a94d0d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.874+0000 7f5cb70b9800 1 --2- 172.21.15.102:0/3479500645 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a94d0d000 0x563a94d0d420 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x563a94cf3660 tx=0x7f5cb00163e0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.874+0000 7f5cb70b9800 1 -- 172.21.15.102:0/3479500645 shutdown_connections 2024-09-13T19:16:15.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.874+0000 7f5cb70b9800 1 --2- 172.21.15.102:0/3479500645 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5b8c036c00 0x7f5b8c0390c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.874+0000 7f5cb70b9800 1 --2- 172.21.15.102:0/3479500645 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a94d0d000 0x563a94d0d420 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.874+0000 7f5cb70b9800 1 -- 172.21.15.102:0/3479500645 >> 172.21.15.102:0/3479500645 conn(0x563a94d01f90 msgr2=0x563a94d04b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:15.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.874+0000 7f5cb70b9800 1 -- 172.21.15.102:0/3479500645 shutdown_connections 2024-09-13T19:16:15.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.874+0000 7f5cb70b9800 1 -- 172.21.15.102:0/3479500645 wait complete. 2024-09-13T19:16:15.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.874+0000 7f5cb70b9800 1 -- 172.21.15.102:0/2839447828 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563a94bfe900 msgr2=0x563a94cf92d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.874+0000 7f5cb70b9800 1 --2- 172.21.15.102:0/2839447828 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563a94bfe900 0x563a94cf92d0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.874+0000 7f5cb70b9800 1 -- 172.21.15.102:0/2839447828 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563a94cfbba0 msgr2=0x563a94cfdf90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.874+0000 7f5cb70b9800 1 --2- 172.21.15.102:0/2839447828 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563a94cfbba0 0x563a94cfdf90 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.874+0000 7f5cb70b9800 1 -- 172.21.15.102:0/2839447828 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5b9c036b40 msgr2=0x7f5b9c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.874+0000 7f5cb70b9800 1 --2- 172.21.15.102:0/2839447828 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5b9c036b40 0x7f5b9c039000 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5ca0057000 tx=0x7f5ca0052000 comp rx=0 tx=0).stop 2024-09-13T19:16:15.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.874+0000 7f5cb70b9800 1 -- 172.21.15.102:0/2839447828 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a94bfa4c0 msgr2=0x563a94cf2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.874+0000 7f5cb70b9800 1 --2- 172.21.15.102:0/2839447828 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a94bfa4c0 0x563a94cf2260 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5ca8004000 tx=0x7f5ca8000bc0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.875+0000 7f5cb70b9800 1 -- 172.21.15.102:0/2839447828 shutdown_connections 2024-09-13T19:16:15.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.875+0000 7f5cb70b9800 1 --2- 172.21.15.102:0/2839447828 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563a94cfbba0 0x563a94cfdf90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.875+0000 7f5cb70b9800 1 --2- 172.21.15.102:0/2839447828 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563a94bfe900 0x563a94cf92d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.875+0000 7f5cb70b9800 1 --2- 172.21.15.102:0/2839447828 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5b9c036b40 0x7f5b9c039000 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.875+0000 7f5cb70b9800 1 --2- 172.21.15.102:0/2839447828 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a94bfa4c0 0x563a94cf2260 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.875+0000 7f5cb70b9800 1 -- 172.21.15.102:0/2839447828 >> 172.21.15.102:0/2839447828 conn(0x563a94bf5df0 msgr2=0x563a94ce3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:15.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.875+0000 7f5cb70b9800 1 -- 172.21.15.102:0/2839447828 shutdown_connections 2024-09-13T19:16:15.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.875+0000 7f5cb70b9800 1 -- 172.21.15.102:0/2839447828 wait complete. 2024-09-13T19:16:15.887 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:16:14.779675Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-13T19:16:15.735970Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:16:14.779665Z', 'tags': [], 'group_ids': []} 2024-09-13T19:16:15.887 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-13T19:16:15.887 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-13T19:16:15.888 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2024-09-13T19:16:15.934 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:15.934 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:15.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.931+0000 7f83ab526800 1 Processor -- start 2024-09-13T19:16:15.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.931+0000 7f83ab526800 1 -- start start 2024-09-13T19:16:15.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.931+0000 7f83ab526800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56078f8cfeb0 0x56078f95f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.931+0000 7f83ab526800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56078f81bb30 con 0x56078f95f6a0 2024-09-13T19:16:15.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.931+0000 7f83ab526800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x56078f7fd360 con 0x56078f8cfeb0 2024-09-13T19:16:15.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.931+0000 7f83a71e3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56078f8cfeb0 0x56078f95f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.931+0000 7f839ffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x56078f95f6a0 0x56078f961ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:49854/0 (socket says 172.21.15.102:49854) 2024-09-13T19:16:15.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.931+0000 7f83a71e3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56078f8cfeb0 0x56078f95f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54310/0 (socket says 172.21.15.102:54310) 2024-09-13T19:16:15.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.931+0000 7f839ffff640 1 -- 172.21.15.102:0/439248402 learned_addr learned my addr 172.21.15.102:0/439248402 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:16:15.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.931+0000 7f83a71e3640 1 -- 172.21.15.102:0/439248402 >> v1:172.21.15.53:6789/0 conn(0x56078f95f6a0 legacy=0x56078f961ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.931+0000 7f83a71e3640 1 -- 172.21.15.102:0/439248402 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56078f823e00 con 0x56078f8cfeb0 2024-09-13T19:16:15.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.933+0000 7f83a71e3640 1 --2- 172.21.15.102:0/439248402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078f8cfeb0 0x56078f95f160 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f839800a470 tx=0x7f8398045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7428a0505df3d9d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.933+0000 7f83a69e2640 1 -- 172.21.15.102:0/439248402 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8398053570 con 0x56078f8cfeb0 2024-09-13T19:16:15.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.933+0000 7f83a69e2640 1 -- 172.21.15.102:0/439248402 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8398058070 con 0x56078f8cfeb0 2024-09-13T19:16:15.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.933+0000 7f83a69e2640 1 -- 172.21.15.102:0/439248402 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8398053880 con 0x56078f8cfeb0 2024-09-13T19:16:15.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.934+0000 7f83ab526800 1 -- 172.21.15.102:0/439248402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078f8cfeb0 msgr2=0x56078f95f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.934+0000 7f83ab526800 1 --2- 172.21.15.102:0/439248402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078f8cfeb0 0x56078f95f160 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f839800a470 tx=0x7f8398045a20 comp rx=0 tx=0).stop 2024-09-13T19:16:15.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.934+0000 7f83ab526800 1 -- 172.21.15.102:0/439248402 shutdown_connections 2024-09-13T19:16:15.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.934+0000 7f83ab526800 1 --2- 172.21.15.102:0/439248402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078f8cfeb0 0x56078f95f160 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.934+0000 7f83ab526800 1 -- 172.21.15.102:0/439248402 >> 172.21.15.102:0/439248402 conn(0x56078f956dd0 msgr2=0x56078f9591f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:15.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.934+0000 7f83ab526800 1 -- 172.21.15.102:0/439248402 shutdown_connections 2024-09-13T19:16:15.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.934+0000 7f83ab526800 1 -- 172.21.15.102:0/439248402 wait complete. 2024-09-13T19:16:15.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.948+0000 7f83ab526800 1 Processor -- start 2024-09-13T19:16:15.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.948+0000 7f83ab526800 1 -- start start 2024-09-13T19:16:15.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.948+0000 7f83ab526800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078f8cfeb0 0x56078f95ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.948+0000 7f83ab526800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56078f8a8360 con 0x56078f8cfeb0 2024-09-13T19:16:15.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.948+0000 7f83a71e3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078f8cfeb0 0x56078f95ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.948+0000 7f83a71e3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078f8cfeb0 0x56078f95ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54324/0 (socket says 172.21.15.102:54324) 2024-09-13T19:16:15.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.948+0000 7f83a71e3640 1 -- 172.21.15.102:0/2885310870 learned_addr learned my addr 172.21.15.102:0/2885310870 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:15.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.949+0000 7f83a71e3640 1 -- 172.21.15.102:0/2885310870 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56078f7f5bc0 con 0x56078f8cfeb0 2024-09-13T19:16:15.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.949+0000 7f83a71e3640 1 --2- 172.21.15.102:0/2885310870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078f8cfeb0 0x56078f95ca90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8398025c20 tx=0x7f8398051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75dddf911b8b940f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.949+0000 7f829560a640 1 -- 172.21.15.102:0/2885310870 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f839805c580 con 0x56078f8cfeb0 2024-09-13T19:16:15.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.949+0000 7f829560a640 1 -- 172.21.15.102:0/2885310870 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8398063030 con 0x56078f8cfeb0 2024-09-13T19:16:15.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.949+0000 7f829560a640 1 -- 172.21.15.102:0/2885310870 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f839805c850 con 0x56078f8cfeb0 2024-09-13T19:16:15.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.950+0000 7f83ab526800 1 -- 172.21.15.102:0/2885310870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078f8cfeb0 msgr2=0x56078f95ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.950+0000 7f83ab526800 1 --2- 172.21.15.102:0/2885310870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078f8cfeb0 0x56078f95ca90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8398025c20 tx=0x7f8398051000 comp rx=0 tx=0).stop 2024-09-13T19:16:15.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.950+0000 7f83ab526800 1 -- 172.21.15.102:0/2885310870 shutdown_connections 2024-09-13T19:16:15.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.950+0000 7f83ab526800 1 --2- 172.21.15.102:0/2885310870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078f8cfeb0 0x56078f95ca90 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.950+0000 7f83ab526800 1 -- 172.21.15.102:0/2885310870 >> 172.21.15.102:0/2885310870 conn(0x56078f956dd0 msgr2=0x56078fa472d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:15.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.950+0000 7f83ab526800 1 -- 172.21.15.102:0/2885310870 shutdown_connections 2024-09-13T19:16:15.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.950+0000 7f83ab526800 1 -- 172.21.15.102:0/2885310870 wait complete. 2024-09-13T19:16:15.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.950+0000 7f83ab526800 1 Processor -- start 2024-09-13T19:16:15.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.950+0000 7f83ab526800 1 -- start start 2024-09-13T19:16:15.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.950+0000 7f83ab526800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078f8cfeb0 0x56078fa553d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.950+0000 7f83ab526800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56078f963610 con 0x56078f8cfeb0 2024-09-13T19:16:15.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.950+0000 7f83a71e3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078f8cfeb0 0x56078fa553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.950+0000 7f83a71e3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078f8cfeb0 0x56078fa553d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54326/0 (socket says 172.21.15.102:54326) 2024-09-13T19:16:15.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.950+0000 7f83a71e3640 1 -- 172.21.15.102:0/579701137 learned_addr learned my addr 172.21.15.102:0/579701137 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:15.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.951+0000 7f83a71e3640 1 -- 172.21.15.102:0/579701137 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56078f809fe0 con 0x56078f8cfeb0 2024-09-13T19:16:15.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.951+0000 7f83a71e3640 1 --2- 172.21.15.102:0/579701137 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078f8cfeb0 0x56078fa553d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f839800a330 tx=0x7f8398002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.951+0000 7f8293e07640 1 -- 172.21.15.102:0/579701137 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f839806c030 con 0x56078f8cfeb0 2024-09-13T19:16:15.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.951+0000 7f8293e07640 1 -- 172.21.15.102:0/579701137 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f839805c580 con 0x56078f8cfeb0 2024-09-13T19:16:15.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.951+0000 7f83ab526800 1 -- 172.21.15.102:0/579701137 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56078fa55910 con 0x56078f8cfeb0 2024-09-13T19:16:15.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.951+0000 7f8293e07640 1 -- 172.21.15.102:0/579701137 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f839805c880 con 0x56078f8cfeb0 2024-09-13T19:16:15.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.951+0000 7f83ab526800 1 -- 172.21.15.102:0/579701137 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56078fa55e90 con 0x56078f8cfeb0 2024-09-13T19:16:15.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.952+0000 7f8293e07640 1 -- 172.21.15.102:0/579701137 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8398053440 con 0x56078f8cfeb0 2024-09-13T19:16:15.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.952+0000 7f8293e07640 1 --2- 172.21.15.102:0/579701137 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f828c036ce0 0x7f828c0391a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.952+0000 7f8293e07640 1 -- 172.21.15.102:0/579701137 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f8398070020 con 0x56078f8cfeb0 2024-09-13T19:16:15.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.952+0000 7f839ffff640 1 --2- 172.21.15.102:0/579701137 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f828c036ce0 0x7f828c0391a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.952+0000 7f83ab526800 1 --2- 172.21.15.102:0/579701137 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56078f95f6a0 0x56078fa5c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.952+0000 7f83ab526800 1 -- 172.21.15.102:0/579701137 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56078fa5c9c0 con 0x56078f95f6a0 2024-09-13T19:16:15.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.952+0000 7f83a79e4640 1 --2- 172.21.15.102:0/579701137 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56078f95f6a0 0x56078fa5c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.952+0000 7f839ffff640 1 --2- 172.21.15.102:0/579701137 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f828c036ce0 0x7f828c0391a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8390000f60 tx=0x7f83900012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.952+0000 7f83a79e4640 1 --2- 172.21.15.102:0/579701137 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56078f95f6a0 0x56078fa5c440 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.953+0000 7f83a79e4640 1 -- 172.21.15.102:0/579701137 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83a000a4a0 con 0x56078f95f6a0 2024-09-13T19:16:15.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.953+0000 7f83ab526800 1 -- 172.21.15.102:0/579701137 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56078fa59a10 con 0x56078f95f6a0 2024-09-13T19:16:15.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.953+0000 7f83a79e4640 1 -- 172.21.15.102:0/579701137 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f83a000a4a0 con 0x56078f95f6a0 2024-09-13T19:16:15.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.953+0000 7f83ab526800 1 --2- 172.21.15.102:0/579701137 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56078fa5ed40 0x56078fa61130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.953+0000 7f83ab526800 1 -- 172.21.15.102:0/579701137 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56078fa61820 con 0x56078fa5ed40 2024-09-13T19:16:15.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.953+0000 7f83a71e3640 1 --2- 172.21.15.102:0/579701137 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56078fa5ed40 0x56078fa61130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.953+0000 7f83a71e3640 1 --2- 172.21.15.102:0/579701137 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56078fa5ed40 0x56078fa61130 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.954+0000 7f83a71e3640 1 -- 172.21.15.102:0/579701137 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f839807b070 con 0x56078fa5ed40 2024-09-13T19:16:15.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.954+0000 7f83ab526800 1 -- 172.21.15.102:0/579701137 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56078fa5dbe0 con 0x56078f95f6a0 2024-09-13T19:16:15.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.954+0000 7f83a79e4640 1 -- 172.21.15.102:0/579701137 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f83a000a4a0 con 0x56078f95f6a0 2024-09-13T19:16:15.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.954+0000 7f83ab526800 1 -- 172.21.15.102:0/579701137 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56078fa5e0c0 con 0x56078fa5ed40 2024-09-13T19:16:15.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.954+0000 7f83a71e3640 1 -- 172.21.15.102:0/579701137 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f839807b070 con 0x56078fa5ed40 2024-09-13T19:16:15.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.955+0000 7f83ab526800 1 Processor -- start 2024-09-13T19:16:15.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.955+0000 7f83ab526800 1 -- start start 2024-09-13T19:16:15.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.955+0000 7f83ab526800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078fa701a0 0x56078fa705c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.955+0000 7f83ab526800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56078f7f7580 con 0x56078fa701a0 2024-09-13T19:16:15.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.955+0000 7f83a79e4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078fa701a0 0x56078fa705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.955+0000 7f83a79e4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078fa701a0 0x56078fa705c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54328/0 (socket says 172.21.15.102:54328) 2024-09-13T19:16:15.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.955+0000 7f83a79e4640 1 -- 172.21.15.102:0/1859893003 learned_addr learned my addr 172.21.15.102:0/1859893003 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:15.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.955+0000 7f83a79e4640 1 -- 172.21.15.102:0/1859893003 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56078fa70b00 con 0x56078fa701a0 2024-09-13T19:16:15.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.956+0000 7f83a79e4640 1 --2- 172.21.15.102:0/1859893003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078fa701a0 0x56078fa705c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x56078fa5cda0 tx=0x7f83a00163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.956+0000 7f8291602640 1 -- 172.21.15.102:0/1859893003 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83a0013450 con 0x56078fa701a0 2024-09-13T19:16:15.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.956+0000 7f8291602640 1 -- 172.21.15.102:0/1859893003 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83a00135f0 con 0x56078fa701a0 2024-09-13T19:16:15.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.956+0000 7f83ab526800 1 -- 172.21.15.102:0/1859893003 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56078fa70d90 con 0x56078fa701a0 2024-09-13T19:16:15.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.956+0000 7f8291602640 1 -- 172.21.15.102:0/1859893003 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83a00138d0 con 0x56078fa701a0 2024-09-13T19:16:15.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.956+0000 7f83ab526800 1 -- 172.21.15.102:0/1859893003 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56078fa73a70 con 0x56078fa701a0 2024-09-13T19:16:15.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.956+0000 7f8291602640 1 -- 172.21.15.102:0/1859893003 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f83a0011040 con 0x56078fa701a0 2024-09-13T19:16:15.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.957+0000 7f8291602640 1 --2- 172.21.15.102:0/1859893003 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8280036c00 0x7f82800390c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.957+0000 7f8291602640 1 -- 172.21.15.102:0/1859893003 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f83a000e040 con 0x56078fa701a0 2024-09-13T19:16:15.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.957+0000 7f83a71e3640 1 --2- 172.21.15.102:0/1859893003 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8280036c00 0x7f82800390c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.957+0000 7f83ab526800 1 Processor -- start 2024-09-13T19:16:15.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.957+0000 7f83a71e3640 1 --2- 172.21.15.102:0/1859893003 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8280036c00 0x7f82800390c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f839808ef80 tx=0x7f8398067a10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.957+0000 7f83ab526800 1 -- start start 2024-09-13T19:16:15.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.957+0000 7f83ab526800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078fa7ce80 0x56078fa7d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.957+0000 7f83ab526800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56078f95b100 con 0x56078fa7ce80 2024-09-13T19:16:15.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.957+0000 7f83a79e4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078fa7ce80 0x56078fa7d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.957+0000 7f83a79e4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078fa7ce80 0x56078fa7d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54338/0 (socket says 172.21.15.102:54338) 2024-09-13T19:16:15.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.957+0000 7f83a79e4640 1 -- 172.21.15.102:0/2055643745 learned_addr learned my addr 172.21.15.102:0/2055643745 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:15.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.958+0000 7f83a79e4640 1 -- 172.21.15.102:0/2055643745 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56078fa7d7c0 con 0x56078fa7ce80 2024-09-13T19:16:15.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.958+0000 7f83a79e4640 1 --2- 172.21.15.102:0/2055643745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078fa7ce80 0x56078fa7d280 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f83a002a020 tx=0x7f83a0014aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71d8300e0916cb11 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.958+0000 7f828affd640 1 -- 172.21.15.102:0/2055643745 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83a001f390 con 0x56078fa7ce80 2024-09-13T19:16:15.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.958+0000 7f828affd640 1 -- 172.21.15.102:0/2055643745 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83a0012cb0 con 0x56078fa7ce80 2024-09-13T19:16:15.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.958+0000 7f828affd640 1 -- 172.21.15.102:0/2055643745 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83a001f530 con 0x56078fa7ce80 2024-09-13T19:16:15.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.958+0000 7f83ab526800 1 -- 172.21.15.102:0/2055643745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078fa7ce80 msgr2=0x56078fa7d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:15.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.958+0000 7f83ab526800 1 --2- 172.21.15.102:0/2055643745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078fa7ce80 0x56078fa7d280 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f83a002a020 tx=0x7f83a0014aa0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.958+0000 7f83ab526800 1 -- 172.21.15.102:0/2055643745 shutdown_connections 2024-09-13T19:16:15.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.958+0000 7f83ab526800 1 --2- 172.21.15.102:0/2055643745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078fa7ce80 0x56078fa7d280 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:15.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.958+0000 7f83ab526800 1 -- 172.21.15.102:0/2055643745 >> 172.21.15.102:0/2055643745 conn(0x56078fa79230 msgr2=0x56078fa77330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:15.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.958+0000 7f83ab526800 1 -- 172.21.15.102:0/2055643745 shutdown_connections 2024-09-13T19:16:15.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.958+0000 7f83ab526800 1 -- 172.21.15.102:0/2055643745 wait complete. 2024-09-13T19:16:15.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.959+0000 7f83ab526800 1 Processor -- start 2024-09-13T19:16:15.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.959+0000 7f83ab526800 1 -- start start 2024-09-13T19:16:15.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.959+0000 7f83ab526800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078fa7ce80 0x56078fa84360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.959+0000 7f83ab526800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56078fa7de60 con 0x56078fa7ce80 2024-09-13T19:16:15.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.959+0000 7f83a79e4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078fa7ce80 0x56078fa84360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.959+0000 7f83a79e4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078fa7ce80 0x56078fa84360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54340/0 (socket says 172.21.15.102:54340) 2024-09-13T19:16:15.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.959+0000 7f83a79e4640 1 -- 172.21.15.102:0/2068337608 learned_addr learned my addr 172.21.15.102:0/2068337608 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:15.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.959+0000 7f83a79e4640 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56078fa848a0 con 0x56078fa7ce80 2024-09-13T19:16:15.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.959+0000 7f83a79e4640 1 --2- 172.21.15.102:0/2068337608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078fa7ce80 0x56078fa84360 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f83a004ccf0 tx=0x7f83a004cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.959+0000 7f82897fa640 1 -- 172.21.15.102:0/2068337608 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83a0012e60 con 0x56078fa7ce80 2024-09-13T19:16:15.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.959+0000 7f82897fa640 1 -- 172.21.15.102:0/2068337608 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83a001f920 con 0x56078fa7ce80 2024-09-13T19:16:15.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.959+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56078fa84b30 con 0x56078fa7ce80 2024-09-13T19:16:15.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.960+0000 7f82897fa640 1 -- 172.21.15.102:0/2068337608 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83a0013ba0 con 0x56078fa7ce80 2024-09-13T19:16:15.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.960+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56078fa877e0 con 0x56078fa7ce80 2024-09-13T19:16:15.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.960+0000 7f82897fa640 1 -- 172.21.15.102:0/2068337608 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f83a003b060 con 0x56078fa7ce80 2024-09-13T19:16:15.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.961+0000 7f82897fa640 1 --2- 172.21.15.102:0/2068337608 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8270036b90 0x7f8270039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.961+0000 7f82897fa640 1 -- 172.21.15.102:0/2068337608 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f83a0035c30 con 0x56078fa7ce80 2024-09-13T19:16:15.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.961+0000 7f83a71e3640 1 --2- 172.21.15.102:0/2068337608 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8270036b90 0x7f8270039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.961+0000 7f83a71e3640 1 --2- 172.21.15.102:0/2068337608 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8270036b90 0x7f8270039050 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f839805ceb0 tx=0x7f8398087000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.961+0000 7f83ab526800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.961+0000 7f83ab526800 1 --2- 172.21.15.102:0/2068337608 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56078fa90040 0x56078fa92500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.961+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56078fa92c50 con 0x56078fa90040 2024-09-13T19:16:15.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.961+0000 7f839ffff640 1 --2- 172.21.15.102:0/2068337608 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56078fa90040 0x56078fa92500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.962+0000 7f839ffff640 1 --2- 172.21.15.102:0/2068337608 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56078fa90040 0x56078fa92500 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.962+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8390009050 con 0x56078fa90040 2024-09-13T19:16:15.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.962+0000 7f83ab526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.962+0000 7f83ab526800 20 realm 2024-09-13T19:16:15.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.962+0000 7f83ab526800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.962+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56078fa8f490 con 0x56078fa90040 2024-09-13T19:16:15.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.962+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8390009050 con 0x56078fa90040 2024-09-13T19:16:15.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.962+0000 7f83ab526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.962+0000 7f83ab526800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:15.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.962+0000 7f83ab526800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.962+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56078fa93740 con 0x56078fa90040 2024-09-13T19:16:15.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.962+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8390009050 con 0x56078fa90040 2024-09-13T19:16:15.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.962+0000 7f83ab526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.962+0000 7f83ab526800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.962+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56078fa94010 con 0x56078fa90040 2024-09-13T19:16:15.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.962+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8390009050 con 0x56078fa90040 2024-09-13T19:16:15.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.962+0000 7f83ab526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:15.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.962+0000 7f83ab526800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.963+0000 7f83ab526800 1 --2- 172.21.15.102:0/2068337608 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56078fa94a30 0x56078fa96e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.963+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56078fa97510 con 0x56078fa94a30 2024-09-13T19:16:15.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.963+0000 7f83a79e4640 1 --2- 172.21.15.102:0/2068337608 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56078fa94a30 0x56078fa96e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.963+0000 7f83a79e4640 1 --2- 172.21.15.102:0/2068337608 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56078fa94a30 0x56078fa96e20 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.963+0000 7f83a79e4640 1 -- 172.21.15.102:0/2068337608 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f83a0027020 con 0x56078fa94a30 2024-09-13T19:16:15.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.963+0000 7f83ab526800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:15.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.963+0000 7f83ab526800 20 searching for the correct realm 2024-09-13T19:16:15.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.963+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56078fa98e60 con 0x56078fa94a30 2024-09-13T19:16:15.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.963+0000 7f83a79e4640 1 -- 172.21.15.102:0/2068337608 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83a0027020 con 0x56078fa94a30 2024-09-13T19:16:15.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.963+0000 7f83a79e4640 1 --2- 172.21.15.102:0/2068337608 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f83a0045040 0x7f83a00126f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.963+0000 7f83a79e4640 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56078fa98e60 con 0x7f83a0045040 2024-09-13T19:16:15.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.963+0000 7f83a71e3640 1 --2- 172.21.15.102:0/2068337608 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f83a0045040 0x7f83a00126f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.964+0000 7f83a71e3640 1 --2- 172.21.15.102:0/2068337608 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f83a0045040 0x7f83a00126f0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.964+0000 7f83a71e3640 1 -- 172.21.15.102:0/2068337608 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f839807b070 con 0x7f83a0045040 2024-09-13T19:16:15.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.964+0000 7f83a71e3640 1 --2- 172.21.15.102:0/2068337608 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f839805c070 0x7f8398053730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:15.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.964+0000 7f83a71e3640 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56078fa98e60 con 0x7f839805c070 2024-09-13T19:16:15.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.964+0000 7f839ffff640 1 --2- 172.21.15.102:0/2068337608 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f839805c070 0x7f8398053730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:15.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.965+0000 7f839ffff640 1 --2- 172.21.15.102:0/2068337608 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f839805c070 0x7f8398053730 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:15.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.965+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8390009050 con 0x7f839805c070 2024-09-13T19:16:15.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.965+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56078fa98e60 con 0x56078fa90040 2024-09-13T19:16:15.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.965+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8390009050 con 0x56078fa90040 2024-09-13T19:16:15.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.965+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56078fa98e60 con 0x56078fa90040 2024-09-13T19:16:15.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.965+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8390029040 con 0x56078fa90040 2024-09-13T19:16:15.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.965+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56078fa98e60 con 0x7f839805c070 2024-09-13T19:16:15.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.966+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8390029040 con 0x7f839805c070 2024-09-13T19:16:15.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.966+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56078fa98e60 con 0x7f839805c070 2024-09-13T19:16:15.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.966+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8390029040 con 0x7f839805c070 2024-09-13T19:16:15.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.966+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56078fa98e60 con 0x7f83a0045040 2024-09-13T19:16:15.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.966+0000 7f83a71e3640 1 -- 172.21.15.102:0/2068337608 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f839807b070 con 0x7f83a0045040 2024-09-13T19:16:15.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.966+0000 7f83a71e3640 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56078fa98e60 con 0x56078fa94a30 2024-09-13T19:16:15.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.966+0000 7f83a79e4640 1 -- 172.21.15.102:0/2068337608 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83a0027020 con 0x56078fa94a30 2024-09-13T19:16:15.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.966+0000 7f83a79e4640 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56078fa98e60 con 0x56078fa90040 2024-09-13T19:16:15.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.967+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8390029040 con 0x56078fa90040 2024-09-13T19:16:15.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.967+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56078fa98e60 con 0x7f839805c070 2024-09-13T19:16:15.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.967+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8390029040 con 0x7f839805c070 2024-09-13T19:16:15.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.967+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56078fa98e60 con 0x56078fa90040 2024-09-13T19:16:15.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.967+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8390029040 con 0x56078fa90040 2024-09-13T19:16:15.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.967+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56078fa98e60 con 0x7f83a0045040 2024-09-13T19:16:15.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.967+0000 7f83a71e3640 1 -- 172.21.15.102:0/2068337608 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f839807b070 con 0x7f83a0045040 2024-09-13T19:16:15.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.967+0000 7f83a71e3640 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56078fa98e60 con 0x56078fa94a30 2024-09-13T19:16:15.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.968+0000 7f83a79e4640 1 -- 172.21.15.102:0/2068337608 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83a0027020 con 0x56078fa94a30 2024-09-13T19:16:15.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.968+0000 7f83a79e4640 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56078fa98e60 con 0x56078fa94a30 2024-09-13T19:16:15.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.968+0000 7f83a79e4640 1 -- 172.21.15.102:0/2068337608 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f83a0027020 con 0x56078fa94a30 2024-09-13T19:16:15.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.968+0000 7f83a79e4640 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56078fa98e60 con 0x7f839805c070 2024-09-13T19:16:15.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.968+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8390029040 con 0x7f839805c070 2024-09-13T19:16:15.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.968+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56078fa98e60 con 0x56078fa94a30 2024-09-13T19:16:15.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.968+0000 7f83a79e4640 1 -- 172.21.15.102:0/2068337608 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f83a0027020 con 0x56078fa94a30 2024-09-13T19:16:15.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.968+0000 7f83a79e4640 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56078fa98e60 con 0x56078fa94a30 2024-09-13T19:16:15.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.968+0000 7f83a79e4640 1 -- 172.21.15.102:0/2068337608 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83a0027020 con 0x56078fa94a30 2024-09-13T19:16:15.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.969+0000 7f83a79e4640 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56078fa98e60 con 0x56078fa90040 2024-09-13T19:16:15.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.969+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8390029040 con 0x56078fa90040 2024-09-13T19:16:15.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.969+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56078fa98e60 con 0x56078fa90040 2024-09-13T19:16:15.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.969+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8390029040 con 0x56078fa90040 2024-09-13T19:16:15.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.969+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56078fa98e60 con 0x7f839805c070 2024-09-13T19:16:15.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.969+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8390029040 con 0x7f839805c070 2024-09-13T19:16:15.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.969+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56078fa98e60 con 0x56078fa94a30 2024-09-13T19:16:15.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.970+0000 7f83a79e4640 1 -- 172.21.15.102:0/2068337608 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83a0027020 con 0x56078fa94a30 2024-09-13T19:16:15.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.970+0000 7f83a79e4640 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56078fa98e60 con 0x7f83a0045040 2024-09-13T19:16:15.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.970+0000 7f83a71e3640 1 -- 172.21.15.102:0/2068337608 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f839807b070 con 0x7f83a0045040 2024-09-13T19:16:15.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.970+0000 7f83a71e3640 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56078fa98e60 con 0x56078fa90040 2024-09-13T19:16:15.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.970+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8390029040 con 0x56078fa90040 2024-09-13T19:16:15.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.970+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56078fa98e60 con 0x7f839805c070 2024-09-13T19:16:15.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.970+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8390039040 con 0x7f839805c070 2024-09-13T19:16:15.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.970+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56078fa98e60 con 0x56078fa94a30 2024-09-13T19:16:15.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.970+0000 7f83a79e4640 1 -- 172.21.15.102:0/2068337608 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83a0027020 con 0x56078fa94a30 2024-09-13T19:16:15.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.970+0000 7f83a79e4640 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56078fa98e60 con 0x7f839805c070 2024-09-13T19:16:15.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.971+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8390039040 con 0x7f839805c070 2024-09-13T19:16:15.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.971+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56078fa98e60 con 0x7f83a0045040 2024-09-13T19:16:15.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.971+0000 7f83a71e3640 1 -- 172.21.15.102:0/2068337608 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f839807b070 con 0x7f83a0045040 2024-09-13T19:16:15.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.971+0000 7f83a71e3640 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56078fa98e60 con 0x56078fa94a30 2024-09-13T19:16:15.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.971+0000 7f83a79e4640 1 -- 172.21.15.102:0/2068337608 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83a0027020 con 0x56078fa94a30 2024-09-13T19:16:15.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.971+0000 7f83a79e4640 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56078fa98e60 con 0x7f839805c070 2024-09-13T19:16:15.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.971+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8390039040 con 0x7f839805c070 2024-09-13T19:16:15.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.971+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56078fa98e60 con 0x56078fa90040 2024-09-13T19:16:15.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.972+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8390039040 con 0x56078fa90040 2024-09-13T19:16:15.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.972+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56078fa98e60 con 0x7f83a0045040 2024-09-13T19:16:15.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.972+0000 7f83a71e3640 1 -- 172.21.15.102:0/2068337608 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f839807b070 con 0x7f83a0045040 2024-09-13T19:16:15.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.972+0000 7f83ab526800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:15.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.972+0000 7f83ab526800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:15.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.972+0000 7f83ab526800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:15.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.972+0000 7f83ab526800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:15.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.972+0000 7f83ab526800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:15.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.972+0000 7f83ab526800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:15.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.972+0000 7f83ab526800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.972+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56078fa97ed0 con 0x56078fa90040 2024-09-13T19:16:15.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.972+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8390039040 con 0x56078fa90040 2024-09-13T19:16:15.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.972+0000 7f83ab526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.972+0000 7f83ab526800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.972+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56078fa98770 con 0x56078fa90040 2024-09-13T19:16:15.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.972+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8390039040 con 0x56078fa90040 2024-09-13T19:16:15.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.972+0000 7f83ab526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:15.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.972+0000 7f83ab526800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.972+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56078fa992e0 con 0x56078fa94a30 2024-09-13T19:16:15.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.973+0000 7f83a79e4640 1 -- 172.21.15.102:0/2068337608 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f83a0027020 con 0x56078fa94a30 2024-09-13T19:16:15.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.973+0000 7f83ab526800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:15.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.973+0000 7f83ab526800 20 zone default found 2024-09-13T19:16:15.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.973+0000 7f83ab526800 4 Realm: () 2024-09-13T19:16:15.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.973+0000 7f83ab526800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:15.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.973+0000 7f83ab526800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:15.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.973+0000 7f83ab526800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:15.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.973+0000 7f83ab526800 20 zonegroup default 2024-09-13T19:16:15.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.973+0000 7f83ab526800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.973+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56078fa99710 con 0x7f839805c070 2024-09-13T19:16:15.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.973+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8390039040 con 0x7f839805c070 2024-09-13T19:16:15.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.973+0000 7f83ab526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.973+0000 7f83ab526800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.973+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56078fa9b530 con 0x56078fa94a30 2024-09-13T19:16:15.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.973+0000 7f83a79e4640 1 -- 172.21.15.102:0/2068337608 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f83a0027020 con 0x56078fa94a30 2024-09-13T19:16:15.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.973+0000 7f83ab526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.973+0000 7f83ab526800 20 rados->read ofs=0 len=0 2024-09-13T19:16:15.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.973+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56078fa9b8d0 con 0x56078fa94a30 2024-09-13T19:16:15.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.974+0000 7f83a79e4640 1 -- 172.21.15.102:0/2068337608 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f83a0027020 con 0x56078fa94a30 2024-09-13T19:16:15.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.974+0000 7f83ab526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:15.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.974+0000 7f83ab526800 20 started sync module instance, tier type = 2024-09-13T19:16:15.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.974+0000 7f83ab526800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:15.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.974+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56078fa9a9d0 con 0x7f83a0045040 2024-09-13T19:16:15.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.975+0000 7f83a71e3640 1 -- 172.21.15.102:0/2068337608 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(44 notify.0 [create] v34'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f839807b070 con 0x7f83a0045040 2024-09-13T19:16:15.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.975+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94590475021808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56078fa9a630 con 0x7f83a0045040 2024-09-13T19:16:15.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.975+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56078fa9c7d0 con 0x56078fa90040 2024-09-13T19:16:15.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.976+0000 7f83a71e3640 1 -- 172.21.15.102:0/2068337608 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94590475021808] v34'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f839807b070 con 0x7f83a0045040 2024-09-13T19:16:15.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.976+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v34'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8390039040 con 0x56078fa90040 2024-09-13T19:16:15.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.976+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94590475027232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56078fa9cbf0 con 0x56078fa90040 2024-09-13T19:16:15.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.976+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56078fa9d5b0 con 0x56078fa94a30 2024-09-13T19:16:15.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.977+0000 7f83a79e4640 1 -- 172.21.15.102:0/2068337608 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v34'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83a0027020 con 0x56078fa94a30 2024-09-13T19:16:15.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.977+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94590475030784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56078fa9da70 con 0x56078fa94a30 2024-09-13T19:16:15.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.977+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56078fa9e570 con 0x7f83a0045040 2024-09-13T19:16:15.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.977+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94590475027232] v34'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8390039040 con 0x56078fa90040 2024-09-13T19:16:15.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.978+0000 7f83a71e3640 1 -- 172.21.15.102:0/2068337608 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(50 notify.3 [create] v34'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f839807b070 con 0x7f83a0045040 2024-09-13T19:16:15.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.978+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94590475034720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56078fa9e990 con 0x7f83a0045040 2024-09-13T19:16:15.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.978+0000 7f83a79e4640 1 -- 172.21.15.102:0/2068337608 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94590475030784] v34'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83a0027020 con 0x56078fa94a30 2024-09-13T19:16:15.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.978+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56078fa9d520 con 0x56078fa90040 2024-09-13T19:16:15.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.979+0000 7f83a71e3640 1 -- 172.21.15.102:0/2068337608 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94590475034720] v34'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f839807b070 con 0x7f83a0045040 2024-09-13T19:16:15.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.979+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v34'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8390039040 con 0x56078fa90040 2024-09-13T19:16:15.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.979+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94590475028288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56078fa9eea0 con 0x56078fa90040 2024-09-13T19:16:15.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.979+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56078fa9f8a0 con 0x7f839805c070 2024-09-13T19:16:15.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.980+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(54 notify.5 [create] v34'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8390039040 con 0x7f839805c070 2024-09-13T19:16:15.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.980+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94590475028288] v34'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8390039040 con 0x56078fa90040 2024-09-13T19:16:15.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.980+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94590475039664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56078fa9f810 con 0x7f839805c070 2024-09-13T19:16:15.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.980+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56078faa0360 con 0x7f839805c070 2024-09-13T19:16:15.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.981+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(56 notify.6 [create] v34'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8390039040 con 0x7f839805c070 2024-09-13T19:16:15.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.981+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94590475031840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56078faa0810 con 0x7f839805c070 2024-09-13T19:16:15.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.981+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56078faa1260 con 0x7f839805c070 2024-09-13T19:16:15.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.981+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94590475039664] v34'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8390039040 con 0x7f839805c070 2024-09-13T19:16:15.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.982+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(58 notify.7 [create] v34'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8390039040 con 0x7f839805c070 2024-09-13T19:16:15.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.982+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94590475031840] v34'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8390039040 con 0x7f839805c070 2024-09-13T19:16:15.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.982+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94590475046224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56078fa9fc90 con 0x7f839805c070 2024-09-13T19:16:15.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.982+0000 7f83ab526800 20 add_watcher() i=0 2024-09-13T19:16:15.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.982+0000 7f83ab526800 20 add_watcher() i=1 2024-09-13T19:16:15.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.982+0000 7f83ab526800 20 add_watcher() i=2 2024-09-13T19:16:15.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.982+0000 7f83ab526800 20 add_watcher() i=3 2024-09-13T19:16:15.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.982+0000 7f83ab526800 20 add_watcher() i=4 2024-09-13T19:16:15.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.982+0000 7f83ab526800 20 add_watcher() i=5 2024-09-13T19:16:15.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.982+0000 7f83ab526800 20 add_watcher() i=6 2024-09-13T19:16:15.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.983+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94590475046224] v34'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8390039040 con 0x7f839805c070 2024-09-13T19:16:15.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.983+0000 7f83ab526800 20 add_watcher() i=7 2024-09-13T19:16:15.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.983+0000 7f83ab526800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:15.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.983+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56078faa4250 con 0x56078fa90040 2024-09-13T19:16:15.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.983+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8390039040 con 0x56078fa90040 2024-09-13T19:16:15.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.983+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94590475043680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56078faa16d0 con 0x56078fa90040 2024-09-13T19:16:16.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.984+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94590475043680] v34'68 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8390039040 con 0x56078fa90040 2024-09-13T19:16:16.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.984+0000 7f825dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:16.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.984+0000 7f83ab526800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:16.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.984+0000 7f83ab526800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:16.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.985+0000 7f83ab526800 5 note: GC not initialized 2024-09-13T19:16:16.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.985+0000 7f825cfe1640 20 reqs_thread_entry: start 2024-09-13T19:16:16.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.985+0000 7f83ab526800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:16.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.985+0000 7f83ab526800 20 Filter name: none 2024-09-13T19:16:16.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.985+0000 7f81d67fc640 20 reqs_thread_entry: start 2024-09-13T19:16:16.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.985+0000 7f83ab526800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:16:16.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.985+0000 7f83ab526800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.985+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56078fad75b0 con 0x56078fa90040 2024-09-13T19:16:16.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.985+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f8390039040 con 0x56078fa90040 2024-09-13T19:16:16.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.985+0000 7f83ab526800 20 rados_obj.operate() r=0 bl.length=502 2024-09-13T19:16:16.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.985+0000 7f83ab526800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:16:16.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.985+0000 7f83ab526800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:16:16.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.985+0000 7f83ab526800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:16:16.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.986+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56078faddd10 con 0x56078fa90040 2024-09-13T19:16:16.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.987+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v34'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f8390039040 con 0x56078fa90040 2024-09-13T19:16:16.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.987+0000 7f83ab526800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:16:16.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.987+0000 7f83ab526800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:16:16.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.987+0000 7f83ab526800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T19:16:16.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.987+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94590475294416 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56078fad9350 con 0x56078fa90040 2024-09-13T19:16:16.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.987+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== watch-notify(notify (1) cookie 94590475028288 notify 146028888068 ret 0) ==== 609+0+0 (crc 0 0 0) 0x56078f81bb30 con 0x56078fa90040 2024-09-13T19:16:16.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.987+0000 7f828affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888068 cookie 94590475028288 notifier 4363 bl.length()=567 2024-09-13T19:16:16.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.987+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(64 notify.4 [notify cookie 94590475294416 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8390039040 con 0x56078fa90040 2024-09-13T19:16:16.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.987+0000 7f828affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:16:16.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.987+0000 7f828affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:16:16.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.987+0000 7f828affd640 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f826c003ea0 con 0x56078fa90040 2024-09-13T19:16:16.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.987+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8390039040 con 0x56078fa90040 2024-09-13T19:16:16.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.987+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== watch-notify(notify_complete (2) cookie 94590475294416 notify 146028888068 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f839002d8a0 con 0x56078fa90040 2024-09-13T19:16:16.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.988+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:66 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56078fadd6d0 con 0x7f839805c070 2024-09-13T19:16:16.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.989+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(66 p5YnriCv1nAtykxBrupQ [delete] v34'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f8390039040 con 0x7f839805c070 2024-09-13T19:16:16.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.989+0000 7f83ab526800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T19:16:16.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.989+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 94590475294416 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56078fad8ea0 con 0x56078fa94a30 2024-09-13T19:16:16.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.989+0000 7f83a79e4640 1 -- 172.21.15.102:0/2068337608 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== watch-notify(notify (1) cookie 94590475030784 notify 146028888065 ret 0) ==== 212+0+0 (crc 0 0 0) 0x56078fa877e0 con 0x56078fa94a30 2024-09-13T19:16:16.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.989+0000 7f828affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888065 cookie 94590475030784 notifier 4363 bl.length()=170 2024-09-13T19:16:16.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.989+0000 7f828affd640 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f826c003ea0 con 0x56078fa94a30 2024-09-13T19:16:16.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.989+0000 7f83a79e4640 1 -- 172.21.15.102:0/2068337608 <== osd.3 v2:172.21.15.102:6800/3096737090 17 ==== osd_op_reply(67 notify.2 [notify cookie 94590475294416 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f83a0027020 con 0x56078fa94a30 2024-09-13T19:16:16.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.989+0000 7f83a79e4640 1 -- 172.21.15.102:0/2068337608 <== osd.3 v2:172.21.15.102:6800/3096737090 18 ==== watch-notify(notify_complete (2) cookie 94590475294416 notify 146028888065 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f83a005f020 con 0x56078fa94a30 2024-09-13T19:16:16.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.989+0000 7f83a79e4640 1 -- 172.21.15.102:0/2068337608 <== osd.3 v2:172.21.15.102:6800/3096737090 19 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83a0027020 con 0x56078fa94a30 2024-09-13T19:16:16.004 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:16:14.779675Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:16:14.779665Z","tags":[],"group_ids":[]} 2024-09-13T19:16:16.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.990+0000 7f825dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:16.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.990+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94590475043680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56078fad52f0 con 0x56078fa90040 2024-09-13T19:16:16.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.991+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94590475043680] v34'69 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8390039040 con 0x56078fa90040 2024-09-13T19:16:16.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.991+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94590475021808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56078fad52f0 con 0x7f83a0045040 2024-09-13T19:16:16.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.992+0000 7f83a71e3640 1 -- 172.21.15.102:0/2068337608 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94590475021808] v34'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f839807b070 con 0x7f83a0045040 2024-09-13T19:16:16.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.992+0000 7f83ab526800 20 remove_watcher() i=0 2024-09-13T19:16:16.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.992+0000 7f83ab526800 2 removed watcher, disabling cache 2024-09-13T19:16:16.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.992+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94590475027232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56078fad52f0 con 0x56078fa90040 2024-09-13T19:16:16.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.993+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 <== osd.1 v2:172.21.15.102:6808/2204418452 28 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94590475027232] v34'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8390039040 con 0x56078fa90040 2024-09-13T19:16:16.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.993+0000 7f83ab526800 20 remove_watcher() i=1 2024-09-13T19:16:16.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.993+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94590475030784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56078fad52f0 con 0x56078fa94a30 2024-09-13T19:16:16.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.994+0000 7f83a79e4640 1 -- 172.21.15.102:0/2068337608 <== osd.3 v2:172.21.15.102:6800/3096737090 20 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94590475030784] v34'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83a0027020 con 0x56078fa94a30 2024-09-13T19:16:16.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.994+0000 7f83ab526800 20 remove_watcher() i=2 2024-09-13T19:16:16.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.994+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94590475034720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56078fad52f0 con 0x7f83a0045040 2024-09-13T19:16:16.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.995+0000 7f83a71e3640 1 -- 172.21.15.102:0/2068337608 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94590475034720] v34'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f839807b070 con 0x7f83a0045040 2024-09-13T19:16:16.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.995+0000 7f83ab526800 20 remove_watcher() i=3 2024-09-13T19:16:16.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.995+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94590475028288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56078fad52f0 con 0x56078fa90040 2024-09-13T19:16:16.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.996+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 <== osd.1 v2:172.21.15.102:6808/2204418452 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94590475028288] v34'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8390039040 con 0x56078fa90040 2024-09-13T19:16:16.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.996+0000 7f83ab526800 20 remove_watcher() i=4 2024-09-13T19:16:16.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.996+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94590475039664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56078fad52f0 con 0x7f839805c070 2024-09-13T19:16:16.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.997+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94590475039664] v34'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8390039040 con 0x7f839805c070 2024-09-13T19:16:16.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.997+0000 7f83ab526800 20 remove_watcher() i=5 2024-09-13T19:16:16.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.997+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94590475031840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56078fad52f0 con 0x7f839805c070 2024-09-13T19:16:16.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.998+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94590475031840] v34'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8390039040 con 0x7f839805c070 2024-09-13T19:16:16.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.998+0000 7f83ab526800 20 remove_watcher() i=6 2024-09-13T19:16:16.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.998+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94590475046224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56078fad52f0 con 0x7f839805c070 2024-09-13T19:16:16.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.999+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 <== osd.0 v2:172.21.15.53:6800/4021716951 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94590475046224] v34'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8390039040 con 0x7f839805c070 2024-09-13T19:16:16.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.999+0000 7f83ab526800 20 remove_watcher() i=7 2024-09-13T19:16:16.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.999+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f839805c070 msgr2=0x7f8398053730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.999+0000 7f83ab526800 1 --2- 172.21.15.102:0/2068337608 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f839805c070 0x7f8398053730 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.999+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56078fa90040 msgr2=0x56078fa92500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.999+0000 7f83ab526800 1 --2- 172.21.15.102:0/2068337608 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56078fa90040 0x56078fa92500 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.999+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f83a0045040 msgr2=0x7f83a00126f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.999+0000 7f83ab526800 1 --2- 172.21.15.102:0/2068337608 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f83a0045040 0x7f83a00126f0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.999+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56078fa94a30 msgr2=0x56078fa96e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.999+0000 7f83ab526800 1 --2- 172.21.15.102:0/2068337608 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56078fa94a30 0x56078fa96e20 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.999+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8270036b90 msgr2=0x7f8270039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.999+0000 7f83ab526800 1 --2- 172.21.15.102:0/2068337608 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8270036b90 0x7f8270039050 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f839805ceb0 tx=0x7f8398087000 comp rx=0 tx=0).stop 2024-09-13T19:16:16.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.999+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078fa7ce80 msgr2=0x56078fa84360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.999+0000 7f839ffff640 1 -- 172.21.15.102:0/2068337608 reap_dead start 2024-09-13T19:16:16.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.999+0000 7f83ab526800 1 --2- 172.21.15.102:0/2068337608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078fa7ce80 0x56078fa84360 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f83a004ccf0 tx=0x7f83a004cd20 comp rx=0 tx=0).stop 2024-09-13T19:16:16.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.999+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 shutdown_connections 2024-09-13T19:16:16.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.999+0000 7f83ab526800 1 --2- 172.21.15.102:0/2068337608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078fa7ce80 0x56078fa84360 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:15.999+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 >> 172.21.15.102:0/2068337608 conn(0x56078fa79230 msgr2=0x56078fa77300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:16.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.000+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 shutdown_connections 2024-09-13T19:16:16.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.000+0000 7f83ab526800 1 -- 172.21.15.102:0/2068337608 wait complete. 2024-09-13T19:16:16.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.000+0000 7f83ab526800 1 -- 172.21.15.102:0/1859893003 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8280036c00 msgr2=0x7f82800390c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.000+0000 7f83ab526800 1 --2- 172.21.15.102:0/1859893003 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8280036c00 0x7f82800390c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f839808ef80 tx=0x7f8398067a10 comp rx=0 tx=0).stop 2024-09-13T19:16:16.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.000+0000 7f83ab526800 1 -- 172.21.15.102:0/1859893003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078fa701a0 msgr2=0x56078fa705c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.000+0000 7f83ab526800 1 --2- 172.21.15.102:0/1859893003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078fa701a0 0x56078fa705c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x56078fa5cda0 tx=0x7f83a00163e0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.000+0000 7f83ab526800 1 -- 172.21.15.102:0/1859893003 shutdown_connections 2024-09-13T19:16:16.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.000+0000 7f83ab526800 1 --2- 172.21.15.102:0/1859893003 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8280036c00 0x7f82800390c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.000+0000 7f83ab526800 1 --2- 172.21.15.102:0/1859893003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078fa701a0 0x56078fa705c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.000+0000 7f83ab526800 1 -- 172.21.15.102:0/1859893003 >> 172.21.15.102:0/1859893003 conn(0x56078fa65130 msgr2=0x56078fa67cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:16.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.000+0000 7f83ab526800 1 -- 172.21.15.102:0/1859893003 shutdown_connections 2024-09-13T19:16:16.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.000+0000 7f83ab526800 1 -- 172.21.15.102:0/1859893003 wait complete. 2024-09-13T19:16:16.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.000+0000 7f83ab526800 1 -- 172.21.15.102:0/579701137 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56078f95f6a0 msgr2=0x56078fa5c440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.000+0000 7f83ab526800 1 --2- 172.21.15.102:0/579701137 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56078f95f6a0 0x56078fa5c440 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.000+0000 7f83ab526800 1 -- 172.21.15.102:0/579701137 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56078fa5ed40 msgr2=0x56078fa61130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.000+0000 7f83ab526800 1 --2- 172.21.15.102:0/579701137 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56078fa5ed40 0x56078fa61130 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.000+0000 7f83ab526800 1 -- 172.21.15.102:0/579701137 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f828c036ce0 msgr2=0x7f828c0391a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.000+0000 7f83ab526800 1 --2- 172.21.15.102:0/579701137 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f828c036ce0 0x7f828c0391a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8390000f60 tx=0x7f83900012b0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.000+0000 7f83ab526800 1 -- 172.21.15.102:0/579701137 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078f8cfeb0 msgr2=0x56078fa553d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.000+0000 7f83ab526800 1 --2- 172.21.15.102:0/579701137 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078f8cfeb0 0x56078fa553d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f839800a330 tx=0x7f8398002fb0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.000+0000 7f83ab526800 1 -- 172.21.15.102:0/579701137 shutdown_connections 2024-09-13T19:16:16.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.000+0000 7f83ab526800 1 --2- 172.21.15.102:0/579701137 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56078fa5ed40 0x56078fa61130 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.000+0000 7f83ab526800 1 --2- 172.21.15.102:0/579701137 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56078f95f6a0 0x56078fa5c440 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.000+0000 7f83ab526800 1 --2- 172.21.15.102:0/579701137 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f828c036ce0 0x7f828c0391a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.000+0000 7f83ab526800 1 --2- 172.21.15.102:0/579701137 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56078f8cfeb0 0x56078fa553d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.000+0000 7f83ab526800 1 -- 172.21.15.102:0/579701137 >> 172.21.15.102:0/579701137 conn(0x56078f956dd0 msgr2=0x56078fa46ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:16.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.000+0000 7f83ab526800 1 -- 172.21.15.102:0/579701137 shutdown_connections 2024-09-13T19:16:16.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.000+0000 7f83ab526800 1 -- 172.21.15.102:0/579701137 wait complete. 2024-09-13T19:16:16.014 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:16:14.779675Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:16:14.779665Z', 'tags': [], 'group_ids': []} 2024-09-13T19:16:16.015 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-13T19:16:16.015 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-13T19:16:16.015 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2024-09-13T19:16:16.061 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:16.061 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:16.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.057+0000 7f51bc542800 1 Processor -- start 2024-09-13T19:16:16.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.057+0000 7f51bc542800 1 -- start start 2024-09-13T19:16:16.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.057+0000 7f51bc542800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56405614e630 0x5640561df600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.057+0000 7f51bc542800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564056099b30 con 0x5640561dfb40 2024-09-13T19:16:16.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.057+0000 7f51bc542800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x56405607b360 con 0x56405614e630 2024-09-13T19:16:16.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.058+0000 7f51b8290640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56405614e630 0x5640561df600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.058+0000 7f51b7a8f640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5640561dfb40 0x5640561e1f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:49862/0 (socket says 172.21.15.102:49862) 2024-09-13T19:16:16.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.058+0000 7f51b7a8f640 1 -- 172.21.15.102:0/804251847 learned_addr learned my addr 172.21.15.102:0/804251847 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:16:16.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.058+0000 7f51b8290640 1 -- 172.21.15.102:0/804251847 >> v1:172.21.15.53:6789/0 conn(0x5640561dfb40 legacy=0x5640561e1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.058+0000 7f51b8290640 1 -- 172.21.15.102:0/804251847 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640560a1e00 con 0x56405614e630 2024-09-13T19:16:16.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.060+0000 7f51b8290640 1 --2- 172.21.15.102:0/804251847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56405614e630 0x5640561df600 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f51a800a470 tx=0x7f51a8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54e6d61daa4c5ab6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.060+0000 7f51b728e640 1 -- 172.21.15.102:0/804251847 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51a8053570 con 0x56405614e630 2024-09-13T19:16:16.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.060+0000 7f51b728e640 1 -- 172.21.15.102:0/804251847 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51a8058070 con 0x56405614e630 2024-09-13T19:16:16.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.060+0000 7f51b728e640 1 -- 172.21.15.102:0/804251847 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51a8053880 con 0x56405614e630 2024-09-13T19:16:16.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.061+0000 7f51bc542800 1 -- 172.21.15.102:0/804251847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56405614e630 msgr2=0x5640561df600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.061+0000 7f51bc542800 1 --2- 172.21.15.102:0/804251847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56405614e630 0x5640561df600 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f51a800a470 tx=0x7f51a8045a20 comp rx=0 tx=0).stop 2024-09-13T19:16:16.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.061+0000 7f51bc542800 1 -- 172.21.15.102:0/804251847 shutdown_connections 2024-09-13T19:16:16.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.061+0000 7f51bc542800 1 --2- 172.21.15.102:0/804251847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56405614e630 0x5640561df600 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.061+0000 7f51bc542800 1 -- 172.21.15.102:0/804251847 >> 172.21.15.102:0/804251847 conn(0x5640561d4db0 msgr2=0x5640561d71d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:16.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.061+0000 7f51bc542800 1 -- 172.21.15.102:0/804251847 shutdown_connections 2024-09-13T19:16:16.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.061+0000 7f51bc542800 1 -- 172.21.15.102:0/804251847 wait complete. 2024-09-13T19:16:16.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.074+0000 7f51bc542800 1 Processor -- start 2024-09-13T19:16:16.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.074+0000 7f51bc542800 1 -- start start 2024-09-13T19:16:16.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.075+0000 7f51bc542800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56405614e630 0x5640562cba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.075+0000 7f51bc542800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564056126360 con 0x56405614e630 2024-09-13T19:16:16.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.075+0000 7f51b8290640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56405614e630 0x5640562cba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.075+0000 7f51b8290640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56405614e630 0x5640562cba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54360/0 (socket says 172.21.15.102:54360) 2024-09-13T19:16:16.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.075+0000 7f51b8290640 1 -- 172.21.15.102:0/3579269029 learned_addr learned my addr 172.21.15.102:0/3579269029 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:16.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.075+0000 7f51b8290640 1 -- 172.21.15.102:0/3579269029 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564056073bc0 con 0x56405614e630 2024-09-13T19:16:16.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.075+0000 7f51b8290640 1 --2- 172.21.15.102:0/3579269029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56405614e630 0x5640562cba70 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f51a8025c20 tx=0x7f51a8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b360123503192781 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.075+0000 7f50a660c640 1 -- 172.21.15.102:0/3579269029 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51a805c580 con 0x56405614e630 2024-09-13T19:16:16.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.075+0000 7f50a660c640 1 -- 172.21.15.102:0/3579269029 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51a8063030 con 0x56405614e630 2024-09-13T19:16:16.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.075+0000 7f50a660c640 1 -- 172.21.15.102:0/3579269029 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51a805c850 con 0x56405614e630 2024-09-13T19:16:16.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.076+0000 7f51bc542800 1 -- 172.21.15.102:0/3579269029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56405614e630 msgr2=0x5640562cba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.076+0000 7f51bc542800 1 --2- 172.21.15.102:0/3579269029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56405614e630 0x5640562cba70 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f51a8025c20 tx=0x7f51a8051000 comp rx=0 tx=0).stop 2024-09-13T19:16:16.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.076+0000 7f51bc542800 1 -- 172.21.15.102:0/3579269029 shutdown_connections 2024-09-13T19:16:16.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.076+0000 7f51bc542800 1 --2- 172.21.15.102:0/3579269029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56405614e630 0x5640562cba70 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.076+0000 7f51bc542800 1 -- 172.21.15.102:0/3579269029 >> 172.21.15.102:0/3579269029 conn(0x5640561d4db0 msgr2=0x5640562c7430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:16.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.076+0000 7f51bc542800 1 -- 172.21.15.102:0/3579269029 shutdown_connections 2024-09-13T19:16:16.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.076+0000 7f51bc542800 1 -- 172.21.15.102:0/3579269029 wait complete. 2024-09-13T19:16:16.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.076+0000 7f51bc542800 1 Processor -- start 2024-09-13T19:16:16.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.077+0000 7f51bc542800 1 -- start start 2024-09-13T19:16:16.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.077+0000 7f51bc542800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56405614e630 0x5640562d33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.077+0000 7f51bc542800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5640561e3920 con 0x56405614e630 2024-09-13T19:16:16.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.077+0000 7f51b8290640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56405614e630 0x5640562d33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.077+0000 7f51b8290640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56405614e630 0x5640562d33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54368/0 (socket says 172.21.15.102:54368) 2024-09-13T19:16:16.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.077+0000 7f51b8290640 1 -- 172.21.15.102:0/3464820480 learned_addr learned my addr 172.21.15.102:0/3464820480 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:16.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.077+0000 7f51b8290640 1 -- 172.21.15.102:0/3464820480 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564056087fe0 con 0x56405614e630 2024-09-13T19:16:16.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.077+0000 7f51b8290640 1 --2- 172.21.15.102:0/3464820480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56405614e630 0x5640562d33b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f51a800a330 tx=0x7f51a8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.077+0000 7f50a4e09640 1 -- 172.21.15.102:0/3464820480 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51a806c030 con 0x56405614e630 2024-09-13T19:16:16.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.077+0000 7f50a4e09640 1 -- 172.21.15.102:0/3464820480 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51a805c580 con 0x56405614e630 2024-09-13T19:16:16.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.077+0000 7f50a4e09640 1 -- 172.21.15.102:0/3464820480 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51a805c860 con 0x56405614e630 2024-09-13T19:16:16.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.077+0000 7f51bc542800 1 -- 172.21.15.102:0/3464820480 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5640562d38f0 con 0x56405614e630 2024-09-13T19:16:16.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.078+0000 7f51bc542800 1 -- 172.21.15.102:0/3464820480 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640562d3e70 con 0x56405614e630 2024-09-13T19:16:16.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.078+0000 7f50a4e09640 1 -- 172.21.15.102:0/3464820480 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f51a8053440 con 0x56405614e630 2024-09-13T19:16:16.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.078+0000 7f50a4e09640 1 --2- 172.21.15.102:0/3464820480 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f50a0036b40 0x7f50a0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.078+0000 7f50a4e09640 1 -- 172.21.15.102:0/3464820480 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f51a8070020 con 0x56405614e630 2024-09-13T19:16:16.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.079+0000 7f51b7a8f640 1 --2- 172.21.15.102:0/3464820480 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f50a0036b40 0x7f50a0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.079+0000 7f51bc542800 1 --2- 172.21.15.102:0/3464820480 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5640561dfb40 0x5640562da420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.079+0000 7f51bc542800 1 -- 172.21.15.102:0/3464820480 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5640562da960 con 0x5640561dfb40 2024-09-13T19:16:16.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.079+0000 7f51b8a91640 1 --2- 172.21.15.102:0/3464820480 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5640561dfb40 0x5640562da420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.079+0000 7f51b7a8f640 1 --2- 172.21.15.102:0/3464820480 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f50a0036b40 0x7f50a0039000 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f51ac000f60 tx=0x7f51ac0012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.079+0000 7f51b8a91640 1 --2- 172.21.15.102:0/3464820480 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5640561dfb40 0x5640562da420 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.079+0000 7f51b8a91640 1 -- 172.21.15.102:0/3464820480 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f51b000a4a0 con 0x5640561dfb40 2024-09-13T19:16:16.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.079+0000 7f51bc542800 1 -- 172.21.15.102:0/3464820480 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5640562d79f0 con 0x5640561dfb40 2024-09-13T19:16:16.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.080+0000 7f51b8a91640 1 -- 172.21.15.102:0/3464820480 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f51b000a4a0 con 0x5640561dfb40 2024-09-13T19:16:16.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.080+0000 7f51bc542800 1 --2- 172.21.15.102:0/3464820480 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5640562dccb0 0x5640562df0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.080+0000 7f51bc542800 1 -- 172.21.15.102:0/3464820480 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5640562df740 con 0x5640562dccb0 2024-09-13T19:16:16.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.080+0000 7f51b8290640 1 --2- 172.21.15.102:0/3464820480 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5640562dccb0 0x5640562df0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.080+0000 7f51b8290640 1 --2- 172.21.15.102:0/3464820480 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5640562dccb0 0x5640562df0a0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.080+0000 7f51b8290640 1 -- 172.21.15.102:0/3464820480 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f51a807b070 con 0x5640562dccb0 2024-09-13T19:16:16.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.080+0000 7f51bc542800 1 -- 172.21.15.102:0/3464820480 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5640562dbb50 con 0x5640561dfb40 2024-09-13T19:16:16.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.081+0000 7f51b8a91640 1 -- 172.21.15.102:0/3464820480 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f51b000a4a0 con 0x5640561dfb40 2024-09-13T19:16:16.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.081+0000 7f51bc542800 1 -- 172.21.15.102:0/3464820480 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5640562dc030 con 0x5640562dccb0 2024-09-13T19:16:16.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.081+0000 7f51b8290640 1 -- 172.21.15.102:0/3464820480 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f51a807b070 con 0x5640562dccb0 2024-09-13T19:16:16.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.081+0000 7f51bc542800 1 Processor -- start 2024-09-13T19:16:16.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.081+0000 7f51bc542800 1 -- start start 2024-09-13T19:16:16.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.081+0000 7f51bc542800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640562ee060 0x5640562ee480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.081+0000 7f51bc542800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564056075580 con 0x5640562ee060 2024-09-13T19:16:16.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.082+0000 7f51b8a91640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640562ee060 0x5640562ee480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.082+0000 7f51b8a91640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640562ee060 0x5640562ee480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54372/0 (socket says 172.21.15.102:54372) 2024-09-13T19:16:16.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.082+0000 7f51b8a91640 1 -- 172.21.15.102:0/3397955775 learned_addr learned my addr 172.21.15.102:0/3397955775 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:16.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.082+0000 7f51b8a91640 1 -- 172.21.15.102:0/3397955775 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640562ee9c0 con 0x5640562ee060 2024-09-13T19:16:16.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.082+0000 7f51b8a91640 1 --2- 172.21.15.102:0/3397955775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640562ee060 0x5640562ee480 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x5640562dad60 tx=0x7f51b00167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.082+0000 7f509dffb640 1 -- 172.21.15.102:0/3397955775 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51b0013640 con 0x5640562ee060 2024-09-13T19:16:16.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.082+0000 7f509dffb640 1 -- 172.21.15.102:0/3397955775 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51b00137e0 con 0x5640562ee060 2024-09-13T19:16:16.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.082+0000 7f51bc542800 1 -- 172.21.15.102:0/3397955775 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5640562eec50 con 0x5640562ee060 2024-09-13T19:16:16.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.082+0000 7f509dffb640 1 -- 172.21.15.102:0/3397955775 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51b0013ae0 con 0x5640562ee060 2024-09-13T19:16:16.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.082+0000 7f51bc542800 1 -- 172.21.15.102:0/3397955775 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640562f1930 con 0x5640562ee060 2024-09-13T19:16:16.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.083+0000 7f509dffb640 1 -- 172.21.15.102:0/3397955775 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f51b0011040 con 0x5640562ee060 2024-09-13T19:16:16.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.083+0000 7f509dffb640 1 --2- 172.21.15.102:0/3397955775 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5090036b90 0x7f5090039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.083+0000 7f509dffb640 1 -- 172.21.15.102:0/3397955775 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f51b000e040 con 0x5640562ee060 2024-09-13T19:16:16.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.083+0000 7f51b8290640 1 --2- 172.21.15.102:0/3397955775 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5090036b90 0x7f5090039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.083+0000 7f51bc542800 1 Processor -- start 2024-09-13T19:16:16.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.084+0000 7f51b8290640 1 --2- 172.21.15.102:0/3397955775 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5090036b90 0x7f5090039050 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x5640562d7910 tx=0x7f51a808ee50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.084+0000 7f51bc542800 1 -- start start 2024-09-13T19:16:16.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.084+0000 7f51bc542800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640562fad60 0x5640562fb160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.084+0000 7f51bc542800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5640562cc1c0 con 0x5640562fad60 2024-09-13T19:16:16.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.084+0000 7f51b8a91640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640562fad60 0x5640562fb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.084+0000 7f51b8a91640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640562fad60 0x5640562fb160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54380/0 (socket says 172.21.15.102:54380) 2024-09-13T19:16:16.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.084+0000 7f51b8a91640 1 -- 172.21.15.102:0/4046098809 learned_addr learned my addr 172.21.15.102:0/4046098809 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:16.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.084+0000 7f51b8a91640 1 -- 172.21.15.102:0/4046098809 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640562fb730 con 0x5640562fad60 2024-09-13T19:16:16.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.084+0000 7f51b8a91640 1 --2- 172.21.15.102:0/4046098809 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640562fad60 0x5640562fb160 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f51b004cd70 tx=0x7f51b004cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=214db2ae62e555c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.084+0000 7f50977fe640 1 -- 172.21.15.102:0/4046098809 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51b0021a90 con 0x5640562fad60 2024-09-13T19:16:16.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.085+0000 7f50977fe640 1 -- 172.21.15.102:0/4046098809 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51b0021440 con 0x5640562fad60 2024-09-13T19:16:16.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.085+0000 7f50977fe640 1 -- 172.21.15.102:0/4046098809 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51b001f340 con 0x5640562fad60 2024-09-13T19:16:16.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.085+0000 7f51bc542800 1 -- 172.21.15.102:0/4046098809 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640562fad60 msgr2=0x5640562fb160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.085+0000 7f51bc542800 1 --2- 172.21.15.102:0/4046098809 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640562fad60 0x5640562fb160 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f51b004cd70 tx=0x7f51b004cf40 comp rx=0 tx=0).stop 2024-09-13T19:16:16.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.085+0000 7f51bc542800 1 -- 172.21.15.102:0/4046098809 shutdown_connections 2024-09-13T19:16:16.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.085+0000 7f51bc542800 1 --2- 172.21.15.102:0/4046098809 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640562fad60 0x5640562fb160 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.085+0000 7f51bc542800 1 -- 172.21.15.102:0/4046098809 >> 172.21.15.102:0/4046098809 conn(0x5640562f70c0 msgr2=0x5640562f51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:16.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.085+0000 7f51bc542800 1 -- 172.21.15.102:0/4046098809 shutdown_connections 2024-09-13T19:16:16.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.085+0000 7f51bc542800 1 -- 172.21.15.102:0/4046098809 wait complete. 2024-09-13T19:16:16.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.085+0000 7f51bc542800 1 Processor -- start 2024-09-13T19:16:16.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.085+0000 7f51bc542800 1 -- start start 2024-09-13T19:16:16.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.086+0000 7f51bc542800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640562fad60 0x5640563021a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.086+0000 7f51bc542800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5640562fbda0 con 0x5640562fad60 2024-09-13T19:16:16.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.086+0000 7f51b8a91640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640562fad60 0x5640563021a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.086+0000 7f51b8a91640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640562fad60 0x5640563021a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54392/0 (socket says 172.21.15.102:54392) 2024-09-13T19:16:16.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.086+0000 7f51b8a91640 1 -- 172.21.15.102:0/300908287 learned_addr learned my addr 172.21.15.102:0/300908287 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:16.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.086+0000 7f51b8a91640 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640563026e0 con 0x5640562fad60 2024-09-13T19:16:16.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.086+0000 7f51b8a91640 1 --2- 172.21.15.102:0/300908287 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640562fad60 0x5640563021a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f51b003d040 tx=0x7f51b004ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.086+0000 7f5095ffb640 1 -- 172.21.15.102:0/300908287 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51b0013c80 con 0x5640562fad60 2024-09-13T19:16:16.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.086+0000 7f5095ffb640 1 -- 172.21.15.102:0/300908287 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51b0013e20 con 0x5640562fad60 2024-09-13T19:16:16.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.086+0000 7f5095ffb640 1 -- 172.21.15.102:0/300908287 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51b001f810 con 0x5640562fad60 2024-09-13T19:16:16.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.086+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564056302970 con 0x5640562fad60 2024-09-13T19:16:16.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.086+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564056302970 con 0x5640562fad60 2024-09-13T19:16:16.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.087+0000 7f5095ffb640 1 -- 172.21.15.102:0/300908287 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f51b003b020 con 0x5640562fad60 2024-09-13T19:16:16.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.087+0000 7f5095ffb640 1 --2- 172.21.15.102:0/300908287 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5088036b40 0x7f5088039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.087+0000 7f5095ffb640 1 -- 172.21.15.102:0/300908287 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f51b0039020 con 0x5640562fad60 2024-09-13T19:16:16.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.087+0000 7f51b8290640 1 --2- 172.21.15.102:0/300908287 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5088036b40 0x7f5088039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.088+0000 7f51b8290640 1 --2- 172.21.15.102:0/300908287 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5088036b40 0x7f5088039000 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f51a8090010 tx=0x7f51a8091000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.088+0000 7f51bc542800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.088+0000 7f51bc542800 1 --2- 172.21.15.102:0/300908287 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56405630db60 0x564056310020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.088+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564056310770 con 0x56405630db60 2024-09-13T19:16:16.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.088+0000 7f51b7a8f640 1 --2- 172.21.15.102:0/300908287 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56405630db60 0x564056310020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.088+0000 7f51b7a8f640 1 --2- 172.21.15.102:0/300908287 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56405630db60 0x564056310020 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.089+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f51ac009050 con 0x56405630db60 2024-09-13T19:16:16.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.089+0000 7f51bc542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:16.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.089+0000 7f51bc542800 20 realm 2024-09-13T19:16:16.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.089+0000 7f51bc542800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.089+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56405630cfb0 con 0x56405630db60 2024-09-13T19:16:16.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.089+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f51ac009050 con 0x56405630db60 2024-09-13T19:16:16.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.089+0000 7f51bc542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:16.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.089+0000 7f51bc542800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:16.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.089+0000 7f51bc542800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.089+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564056311260 con 0x56405630db60 2024-09-13T19:16:16.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.089+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f51ac009050 con 0x56405630db60 2024-09-13T19:16:16.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.089+0000 7f51bc542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:16.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.089+0000 7f51bc542800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.089+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564056311b30 con 0x56405630db60 2024-09-13T19:16:16.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.089+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f51ac009050 con 0x56405630db60 2024-09-13T19:16:16.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.089+0000 7f51bc542800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:16.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.089+0000 7f51bc542800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.089+0000 7f51bc542800 1 --2- 172.21.15.102:0/300908287 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x564056312470 0x564056314860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.089+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564056314ff0 con 0x564056312470 2024-09-13T19:16:16.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.089+0000 7f51b8a91640 1 --2- 172.21.15.102:0/300908287 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x564056312470 0x564056314860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.090+0000 7f51b8a91640 1 --2- 172.21.15.102:0/300908287 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x564056312470 0x564056314860 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.090+0000 7f51b8a91640 1 -- 172.21.15.102:0/300908287 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f51b000a4a0 con 0x564056312470 2024-09-13T19:16:16.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.090+0000 7f51bc542800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:16.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.090+0000 7f51bc542800 20 searching for the correct realm 2024-09-13T19:16:16.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.090+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564056316940 con 0x564056312470 2024-09-13T19:16:16.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.090+0000 7f51b8a91640 1 -- 172.21.15.102:0/300908287 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51b000a4a0 con 0x564056312470 2024-09-13T19:16:16.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.090+0000 7f51b8a91640 1 --2- 172.21.15.102:0/300908287 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f51b0058040 0x7f51b004b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.090+0000 7f51b8a91640 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564056316940 con 0x7f51b0058040 2024-09-13T19:16:16.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.090+0000 7f51b8290640 1 --2- 172.21.15.102:0/300908287 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f51b0058040 0x7f51b004b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.090+0000 7f51b8290640 1 --2- 172.21.15.102:0/300908287 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f51b0058040 0x7f51b004b290 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.091+0000 7f51b8290640 1 -- 172.21.15.102:0/300908287 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51a807b070 con 0x7f51b0058040 2024-09-13T19:16:16.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.091+0000 7f51b8290640 1 --2- 172.21.15.102:0/300908287 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f51a805c070 0x7f51a805f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.091+0000 7f51b8290640 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564056316940 con 0x7f51a805c070 2024-09-13T19:16:16.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.091+0000 7f51b7a8f640 1 --2- 172.21.15.102:0/300908287 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f51a805c070 0x7f51a805f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.092+0000 7f51b7a8f640 1 --2- 172.21.15.102:0/300908287 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f51a805c070 0x7f51a805f760 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.092+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51ac009050 con 0x7f51a805c070 2024-09-13T19:16:16.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.092+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564056316940 con 0x56405630db60 2024-09-13T19:16:16.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.092+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51ac009050 con 0x56405630db60 2024-09-13T19:16:16.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.092+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564056316940 con 0x56405630db60 2024-09-13T19:16:16.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.092+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51ac029040 con 0x56405630db60 2024-09-13T19:16:16.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.092+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564056316940 con 0x7f51a805c070 2024-09-13T19:16:16.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.093+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51ac029040 con 0x7f51a805c070 2024-09-13T19:16:16.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.093+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564056316940 con 0x7f51a805c070 2024-09-13T19:16:16.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.093+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51ac029040 con 0x7f51a805c070 2024-09-13T19:16:16.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.093+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564056316940 con 0x7f51b0058040 2024-09-13T19:16:16.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.093+0000 7f51b8290640 1 -- 172.21.15.102:0/300908287 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51a807b070 con 0x7f51b0058040 2024-09-13T19:16:16.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.093+0000 7f51b8290640 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564056316940 con 0x564056312470 2024-09-13T19:16:16.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.093+0000 7f51b8a91640 1 -- 172.21.15.102:0/300908287 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51b000a4a0 con 0x564056312470 2024-09-13T19:16:16.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.093+0000 7f51b8a91640 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564056316940 con 0x56405630db60 2024-09-13T19:16:16.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.093+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51ac029040 con 0x56405630db60 2024-09-13T19:16:16.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.094+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564056316940 con 0x7f51a805c070 2024-09-13T19:16:16.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.094+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51ac029040 con 0x7f51a805c070 2024-09-13T19:16:16.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.094+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564056316940 con 0x56405630db60 2024-09-13T19:16:16.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.094+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51ac029040 con 0x56405630db60 2024-09-13T19:16:16.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.094+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564056316940 con 0x7f51b0058040 2024-09-13T19:16:16.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.094+0000 7f51b8290640 1 -- 172.21.15.102:0/300908287 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f51a807b070 con 0x7f51b0058040 2024-09-13T19:16:16.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.094+0000 7f51b8290640 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564056316940 con 0x564056312470 2024-09-13T19:16:16.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.094+0000 7f51b8a91640 1 -- 172.21.15.102:0/300908287 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51b000a4a0 con 0x564056312470 2024-09-13T19:16:16.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.094+0000 7f51b8a91640 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564056316940 con 0x564056312470 2024-09-13T19:16:16.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.095+0000 7f51b8a91640 1 -- 172.21.15.102:0/300908287 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f51b000a4a0 con 0x564056312470 2024-09-13T19:16:16.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.095+0000 7f51b8a91640 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564056316940 con 0x7f51a805c070 2024-09-13T19:16:16.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.095+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51ac029040 con 0x7f51a805c070 2024-09-13T19:16:16.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.095+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564056316940 con 0x564056312470 2024-09-13T19:16:16.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.095+0000 7f51b8a91640 1 -- 172.21.15.102:0/300908287 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f51b000a4a0 con 0x564056312470 2024-09-13T19:16:16.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.095+0000 7f51b8a91640 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564056316940 con 0x564056312470 2024-09-13T19:16:16.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.095+0000 7f51b8a91640 1 -- 172.21.15.102:0/300908287 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51b000a4a0 con 0x564056312470 2024-09-13T19:16:16.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.095+0000 7f51b8a91640 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564056316940 con 0x56405630db60 2024-09-13T19:16:16.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.096+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51ac029040 con 0x56405630db60 2024-09-13T19:16:16.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.096+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564056316940 con 0x56405630db60 2024-09-13T19:16:16.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.096+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f51ac029040 con 0x56405630db60 2024-09-13T19:16:16.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.096+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564056316940 con 0x7f51a805c070 2024-09-13T19:16:16.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.096+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51ac029040 con 0x7f51a805c070 2024-09-13T19:16:16.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.096+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564056316940 con 0x564056312470 2024-09-13T19:16:16.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.096+0000 7f51b8a91640 1 -- 172.21.15.102:0/300908287 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51b000a4a0 con 0x564056312470 2024-09-13T19:16:16.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.096+0000 7f51b8a91640 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564056316940 con 0x7f51b0058040 2024-09-13T19:16:16.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.097+0000 7f51b8290640 1 -- 172.21.15.102:0/300908287 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51a807b070 con 0x7f51b0058040 2024-09-13T19:16:16.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.097+0000 7f51b8290640 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564056316940 con 0x56405630db60 2024-09-13T19:16:16.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.097+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51ac029040 con 0x56405630db60 2024-09-13T19:16:16.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.097+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564056316940 con 0x7f51a805c070 2024-09-13T19:16:16.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.097+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51ac029040 con 0x7f51a805c070 2024-09-13T19:16:16.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.097+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564056316940 con 0x564056312470 2024-09-13T19:16:16.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.097+0000 7f51b8a91640 1 -- 172.21.15.102:0/300908287 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51b000a4a0 con 0x564056312470 2024-09-13T19:16:16.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.097+0000 7f51b8a91640 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564056316940 con 0x7f51a805c070 2024-09-13T19:16:16.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.098+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51ac029040 con 0x7f51a805c070 2024-09-13T19:16:16.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.098+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564056316940 con 0x7f51b0058040 2024-09-13T19:16:16.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.098+0000 7f51b8290640 1 -- 172.21.15.102:0/300908287 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51a807b070 con 0x7f51b0058040 2024-09-13T19:16:16.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.098+0000 7f51b8290640 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564056316940 con 0x564056312470 2024-09-13T19:16:16.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.098+0000 7f51b8a91640 1 -- 172.21.15.102:0/300908287 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51b000a4a0 con 0x564056312470 2024-09-13T19:16:16.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.098+0000 7f51b8a91640 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564056316940 con 0x7f51a805c070 2024-09-13T19:16:16.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.098+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51ac029040 con 0x7f51a805c070 2024-09-13T19:16:16.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.098+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564056316940 con 0x56405630db60 2024-09-13T19:16:16.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.099+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f51ac029040 con 0x56405630db60 2024-09-13T19:16:16.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.099+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564056316940 con 0x7f51b0058040 2024-09-13T19:16:16.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.099+0000 7f51b8290640 1 -- 172.21.15.102:0/300908287 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51a807b070 con 0x7f51b0058040 2024-09-13T19:16:16.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.099+0000 7f51bc542800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:16.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.099+0000 7f51bc542800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:16.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.099+0000 7f51bc542800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:16.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.099+0000 7f51bc542800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:16.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.099+0000 7f51bc542800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:16.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.099+0000 7f51bc542800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:16.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.099+0000 7f51bc542800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.099+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5640563159b0 con 0x56405630db60 2024-09-13T19:16:16.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.099+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f51ac029040 con 0x56405630db60 2024-09-13T19:16:16.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.099+0000 7f51bc542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:16.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.099+0000 7f51bc542800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.099+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564056316250 con 0x56405630db60 2024-09-13T19:16:16.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.099+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f51ac029040 con 0x56405630db60 2024-09-13T19:16:16.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.099+0000 7f51bc542800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:16.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.099+0000 7f51bc542800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.099+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564056316dc0 con 0x564056312470 2024-09-13T19:16:16.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.100+0000 7f51b8a91640 1 -- 172.21.15.102:0/300908287 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f51b000a4a0 con 0x564056312470 2024-09-13T19:16:16.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.100+0000 7f51bc542800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:16.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.100+0000 7f51bc542800 20 zone default found 2024-09-13T19:16:16.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.100+0000 7f51bc542800 4 Realm: () 2024-09-13T19:16:16.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.100+0000 7f51bc542800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:16.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.100+0000 7f51bc542800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:16.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.100+0000 7f51bc542800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:16.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.100+0000 7f51bc542800 20 zonegroup default 2024-09-13T19:16:16.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.100+0000 7f51bc542800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.100+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564056315e80 con 0x7f51a805c070 2024-09-13T19:16:16.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.100+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f51ac029040 con 0x7f51a805c070 2024-09-13T19:16:16.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.100+0000 7f51bc542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:16.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.100+0000 7f51bc542800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.100+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564056319520 con 0x564056312470 2024-09-13T19:16:16.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.100+0000 7f51b8a91640 1 -- 172.21.15.102:0/300908287 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f51b000a4a0 con 0x564056312470 2024-09-13T19:16:16.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.100+0000 7f51bc542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:16.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.100+0000 7f51bc542800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.101+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5640563198c0 con 0x564056312470 2024-09-13T19:16:16.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.101+0000 7f51b8a91640 1 -- 172.21.15.102:0/300908287 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f51b000a4a0 con 0x564056312470 2024-09-13T19:16:16.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.101+0000 7f51bc542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:16.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.101+0000 7f51bc542800 20 started sync module instance, tier type = 2024-09-13T19:16:16.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.101+0000 7f51bc542800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:16.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.101+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564056318960 con 0x7f51b0058040 2024-09-13T19:16:16.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.102+0000 7f51b8290640 1 -- 172.21.15.102:0/300908287 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(44 notify.0 [create] v34'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51a807b070 con 0x7f51b0058040 2024-09-13T19:16:16.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.102+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94834323983696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564056319170 con 0x7f51b0058040 2024-09-13T19:16:16.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.102+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56405631a5c0 con 0x56405630db60 2024-09-13T19:16:16.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.103+0000 7f51b8290640 1 -- 172.21.15.102:0/300908287 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94834323983696] v34'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51a807b070 con 0x7f51b0058040 2024-09-13T19:16:16.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.103+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v34'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51ac029040 con 0x56405630db60 2024-09-13T19:16:16.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.103+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94834323988032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56405631a9b0 con 0x56405630db60 2024-09-13T19:16:16.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.103+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56405631b3b0 con 0x564056312470 2024-09-13T19:16:16.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.104+0000 7f51b8a91640 1 -- 172.21.15.102:0/300908287 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v34'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51b000a4a0 con 0x564056312470 2024-09-13T19:16:16.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.104+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94834323992256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56405631b890 con 0x564056312470 2024-09-13T19:16:16.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.104+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56405631c3b0 con 0x7f51b0058040 2024-09-13T19:16:16.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.104+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94834323988032] v34'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51ac029040 con 0x56405630db60 2024-09-13T19:16:16.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.105+0000 7f51b8290640 1 -- 172.21.15.102:0/300908287 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(50 notify.3 [create] v34'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51a807b070 con 0x7f51b0058040 2024-09-13T19:16:16.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.105+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94834323996288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56405631c7a0 con 0x7f51b0058040 2024-09-13T19:16:16.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.105+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56405631d1f0 con 0x56405630db60 2024-09-13T19:16:16.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.105+0000 7f51b8a91640 1 -- 172.21.15.102:0/300908287 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94834323992256] v34'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51b000a4a0 con 0x564056312470 2024-09-13T19:16:16.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.106+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v34'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51ac029040 con 0x56405630db60 2024-09-13T19:16:16.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.106+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94834323999968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56405631c7a0 con 0x56405630db60 2024-09-13T19:16:16.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.106+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56405631dc70 con 0x7f51a805c070 2024-09-13T19:16:16.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.109+0000 7f51b8290640 1 -- 172.21.15.102:0/300908287 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94834323996288] v34'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51a807b070 con 0x7f51b0058040 2024-09-13T19:16:16.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.109+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(54 notify.5 [create] v34'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51ac029040 con 0x7f51a805c070 2024-09-13T19:16:16.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.109+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94834323989152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56405631dc70 con 0x7f51a805c070 2024-09-13T19:16:16.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.109+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56405631e6f0 con 0x7f51a805c070 2024-09-13T19:16:16.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.109+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94834323999968] v34'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51ac029040 con 0x56405630db60 2024-09-13T19:16:16.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.110+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94834323989152] v34'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51ac029040 con 0x7f51a805c070 2024-09-13T19:16:16.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.110+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(56 notify.6 [create] v34'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51ac029040 con 0x7f51a805c070 2024-09-13T19:16:16.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.110+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94834324002688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56405631e200 con 0x7f51a805c070 2024-09-13T19:16:16.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.110+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56405631ebc0 con 0x7f51a805c070 2024-09-13T19:16:16.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.111+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94834324002688] v34'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51ac029040 con 0x7f51a805c070 2024-09-13T19:16:16.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.111+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(58 notify.7 [create] v34'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51ac029040 con 0x7f51a805c070 2024-09-13T19:16:16.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.111+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94834323993312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56405631ebc0 con 0x7f51a805c070 2024-09-13T19:16:16.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.111+0000 7f51bc542800 20 add_watcher() i=0 2024-09-13T19:16:16.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.111+0000 7f51bc542800 20 add_watcher() i=1 2024-09-13T19:16:16.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.111+0000 7f51bc542800 20 add_watcher() i=2 2024-09-13T19:16:16.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.111+0000 7f51bc542800 20 add_watcher() i=3 2024-09-13T19:16:16.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.111+0000 7f51bc542800 20 add_watcher() i=4 2024-09-13T19:16:16.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.111+0000 7f51bc542800 20 add_watcher() i=5 2024-09-13T19:16:16.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.111+0000 7f51bc542800 20 add_watcher() i=6 2024-09-13T19:16:16.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.112+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94834323993312] v34'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51ac029040 con 0x7f51a805c070 2024-09-13T19:16:16.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.112+0000 7f51bc542800 20 add_watcher() i=7 2024-09-13T19:16:16.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.112+0000 7f51bc542800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:16.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.112+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564056321f00 con 0x56405630db60 2024-09-13T19:16:16.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.112+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f51ac029040 con 0x56405630db60 2024-09-13T19:16:16.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.112+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94834324019488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56405631ed30 con 0x56405630db60 2024-09-13T19:16:16.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.113+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94834324019488] v34'70 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f51ac029040 con 0x56405630db60 2024-09-13T19:16:16.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.113+0000 7f506e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:16.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.114+0000 7f51bc542800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:16.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.114+0000 7f51bc542800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:16.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.114+0000 7f51bc542800 5 note: GC not initialized 2024-09-13T19:16:16.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.114+0000 7f506d7e2640 20 reqs_thread_entry: start 2024-09-13T19:16:16.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.114+0000 7f51bc542800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:16.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.114+0000 7f51bc542800 20 Filter name: none 2024-09-13T19:16:16.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.114+0000 7f4fdeffd640 20 reqs_thread_entry: start 2024-09-13T19:16:16.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.114+0000 7f51bc542800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:16:16.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.114+0000 7f51bc542800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.114+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5640563553a0 con 0x56405630db60 2024-09-13T19:16:16.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.114+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f51ac029040 con 0x56405630db60 2024-09-13T19:16:16.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.115+0000 7f51bc542800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:16:16.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.115+0000 7f51bc542800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:16:16.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.115+0000 7f51bc542800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:16:16.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.115+0000 7f51bc542800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:16:16.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.115+0000 7f51bc542800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2024-09-13T19:16:16.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.115+0000 7f51bc542800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.115+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:63 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564056355e10 con 0x56405630db60 2024-09-13T19:16:16.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.115+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(63 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f51ac029040 con 0x56405630db60 2024-09-13T19:16:16.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.115+0000 7f51bc542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:16.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.115+0000 7f51bc542800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2024-09-13T19:16:16.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.115+0000 7f51bc542800 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-13T19:16:16.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.115+0000 7f51bc542800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2024-09-13T19:16:16.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.115+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56405635b8d0 con 0x56405630db60 2024-09-13T19:16:16.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.116+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~556] v34'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f51ac029040 con 0x56405630db60 2024-09-13T19:16:16.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.116+0000 7f51bc542800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:16:16.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.116+0000 7f51bc542800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:16:16.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.116+0000 7f51bc542800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T19:16:16.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.116+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94834324255376 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564056356e50 con 0x56405630db60 2024-09-13T19:16:16.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.116+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== watch-notify(notify (1) cookie 94834323999968 notify 146028888069 ret 0) ==== 774+0+0 (crc 0 0 0) 0x564056099b30 con 0x56405630db60 2024-09-13T19:16:16.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.116+0000 7f50977fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888069 cookie 94834323999968 notifier 4370 bl.length()=732 2024-09-13T19:16:16.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.116+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(65 notify.4 [notify cookie 94834324255376 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f51ac029040 con 0x56405630db60 2024-09-13T19:16:16.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.116+0000 7f50977fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:16:16.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.116+0000 7f50977fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:16:16.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.116+0000 7f50977fe640 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f507c003ea0 con 0x56405630db60 2024-09-13T19:16:16.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.116+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51ac029040 con 0x56405630db60 2024-09-13T19:16:16.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.116+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== watch-notify(notify_complete (2) cookie 94834324255376 notify 146028888069 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f51ac03b9f0 con 0x56405630db60 2024-09-13T19:16:16.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.117+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:67 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56405635b290 con 0x56405630db60 2024-09-13T19:16:16.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.117+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 <== osd.1 v2:172.21.15.102:6808/2204418452 28 ==== osd_op_reply(67 foo:foo1 [delete,create,writefull 0~7] v34'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f51ac029040 con 0x56405630db60 2024-09-13T19:16:16.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.117+0000 7f51bc542800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-13T19:16:16.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.117+0000 7f51bc542800 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-13T19:16:16.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.117+0000 7f51bc542800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-13T19:16:16.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.117+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94834324255376 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5640563569a0 con 0x7f51b0058040 2024-09-13T19:16:16.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.118+0000 7f51b8290640 1 -- 172.21.15.102:0/300908287 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== watch-notify(notify (1) cookie 94834323983696 notify 146028888066 ret 0) ==== 208+0+0 (crc 0 0 0) 0x5640562d3e70 con 0x7f51b0058040 2024-09-13T19:16:16.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.118+0000 7f50977fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888066 cookie 94834323983696 notifier 4370 bl.length()=166 2024-09-13T19:16:16.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.118+0000 7f50977fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-13T19:16:16.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.118+0000 7f50977fe640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-13T19:16:16.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.118+0000 7f51b8290640 1 -- 172.21.15.102:0/300908287 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(68 notify.0 [notify cookie 94834324255376 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f51a807b070 con 0x7f51b0058040 2024-09-13T19:16:16.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.118+0000 7f50977fe640 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f507c003ea0 con 0x7f51b0058040 2024-09-13T19:16:16.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.118+0000 7f51b8290640 1 -- 172.21.15.102:0/300908287 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== watch-notify(notify_complete (2) cookie 94834324255376 notify 146028888066 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5640562d38f0 con 0x7f51b0058040 2024-09-13T19:16:16.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.118+0000 7f51b8290640 1 -- 172.21.15.102:0/300908287 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51a807b070 con 0x7f51b0058040 2024-09-13T19:16:16.131 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:16:14.779675Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"WvUulW2FY90Ii1AQNJqso7stab3SiOPaW3K2irbj","active":true,"create_date":"2024-09-13T19:16:16.117214Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:16:14.779665Z","tags":[],"group_ids":[]} 2024-09-13T19:16:16.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.119+0000 7f506e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:16.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.119+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94834324019488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5640563530f0 con 0x56405630db60 2024-09-13T19:16:16.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.120+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 <== osd.1 v2:172.21.15.102:6808/2204418452 29 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94834324019488] v34'71 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f51ac029040 con 0x56405630db60 2024-09-13T19:16:16.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.120+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94834323983696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5640563530f0 con 0x7f51b0058040 2024-09-13T19:16:16.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.121+0000 7f51b8290640 1 -- 172.21.15.102:0/300908287 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94834323983696] v34'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51a807b070 con 0x7f51b0058040 2024-09-13T19:16:16.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.121+0000 7f51bc542800 20 remove_watcher() i=0 2024-09-13T19:16:16.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.121+0000 7f51bc542800 2 removed watcher, disabling cache 2024-09-13T19:16:16.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.121+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94834323988032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5640563530f0 con 0x56405630db60 2024-09-13T19:16:16.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.122+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 <== osd.1 v2:172.21.15.102:6808/2204418452 30 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94834323988032] v34'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51ac029040 con 0x56405630db60 2024-09-13T19:16:16.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.122+0000 7f51bc542800 20 remove_watcher() i=1 2024-09-13T19:16:16.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.122+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94834323992256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5640563530f0 con 0x564056312470 2024-09-13T19:16:16.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.123+0000 7f51b8a91640 1 -- 172.21.15.102:0/300908287 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94834323992256] v34'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51b000a4a0 con 0x564056312470 2024-09-13T19:16:16.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.123+0000 7f51bc542800 20 remove_watcher() i=2 2024-09-13T19:16:16.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.123+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94834323996288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5640563530f0 con 0x7f51b0058040 2024-09-13T19:16:16.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.124+0000 7f51b8290640 1 -- 172.21.15.102:0/300908287 <== osd.2 v2:172.21.15.102:6816/2238176080 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94834323996288] v34'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51a807b070 con 0x7f51b0058040 2024-09-13T19:16:16.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.124+0000 7f51bc542800 20 remove_watcher() i=3 2024-09-13T19:16:16.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.124+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94834323999968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5640563530f0 con 0x56405630db60 2024-09-13T19:16:16.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.125+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 <== osd.1 v2:172.21.15.102:6808/2204418452 31 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94834323999968] v34'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51ac029040 con 0x56405630db60 2024-09-13T19:16:16.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.125+0000 7f51bc542800 20 remove_watcher() i=4 2024-09-13T19:16:16.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.125+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94834323989152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5640563530f0 con 0x7f51a805c070 2024-09-13T19:16:16.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.126+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94834323989152] v34'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51ac029040 con 0x7f51a805c070 2024-09-13T19:16:16.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.126+0000 7f51bc542800 20 remove_watcher() i=5 2024-09-13T19:16:16.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.126+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94834324002688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5640563530f0 con 0x7f51a805c070 2024-09-13T19:16:16.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.127+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94834324002688] v34'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51ac029040 con 0x7f51a805c070 2024-09-13T19:16:16.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.127+0000 7f51bc542800 20 remove_watcher() i=6 2024-09-13T19:16:16.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.127+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94834323993312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5640563530f0 con 0x7f51a805c070 2024-09-13T19:16:16.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.128+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94834323993312] v34'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51ac029040 con 0x7f51a805c070 2024-09-13T19:16:16.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.128+0000 7f51bc542800 20 remove_watcher() i=7 2024-09-13T19:16:16.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.128+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f51a805c070 msgr2=0x7f51a805f760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.128+0000 7f51bc542800 1 --2- 172.21.15.102:0/300908287 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f51a805c070 0x7f51a805f760 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.128+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56405630db60 msgr2=0x564056310020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.128+0000 7f51bc542800 1 --2- 172.21.15.102:0/300908287 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56405630db60 0x564056310020 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.128+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f51b0058040 msgr2=0x7f51b004b290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.128+0000 7f51bc542800 1 --2- 172.21.15.102:0/300908287 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f51b0058040 0x7f51b004b290 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.128+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x564056312470 msgr2=0x564056314860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.128+0000 7f51bc542800 1 --2- 172.21.15.102:0/300908287 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x564056312470 0x564056314860 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.128+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5088036b40 msgr2=0x7f5088039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.128+0000 7f51bc542800 1 --2- 172.21.15.102:0/300908287 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5088036b40 0x7f5088039000 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f51a8090010 tx=0x7f51a8091000 comp rx=0 tx=0).stop 2024-09-13T19:16:16.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.128+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640562fad60 msgr2=0x5640563021a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.128+0000 7f51b7a8f640 1 -- 172.21.15.102:0/300908287 reap_dead start 2024-09-13T19:16:16.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.128+0000 7f51bc542800 1 --2- 172.21.15.102:0/300908287 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640562fad60 0x5640563021a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f51b003d040 tx=0x7f51b004ccd0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.128+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 shutdown_connections 2024-09-13T19:16:16.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.128+0000 7f51bc542800 1 --2- 172.21.15.102:0/300908287 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640562fad60 0x5640563021a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.128+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 >> 172.21.15.102:0/300908287 conn(0x5640562f70c0 msgr2=0x5640562f5190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:16.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.128+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 shutdown_connections 2024-09-13T19:16:16.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.128+0000 7f51bc542800 1 -- 172.21.15.102:0/300908287 wait complete. 2024-09-13T19:16:16.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.129+0000 7f51bc542800 1 -- 172.21.15.102:0/3397955775 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5090036b90 msgr2=0x7f5090039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.129+0000 7f51bc542800 1 --2- 172.21.15.102:0/3397955775 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5090036b90 0x7f5090039050 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x5640562d7910 tx=0x7f51a808ee50 comp rx=0 tx=0).stop 2024-09-13T19:16:16.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.129+0000 7f51bc542800 1 -- 172.21.15.102:0/3397955775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640562ee060 msgr2=0x5640562ee480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.129+0000 7f51bc542800 1 --2- 172.21.15.102:0/3397955775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640562ee060 0x5640562ee480 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x5640562dad60 tx=0x7f51b00167b0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.129+0000 7f51bc542800 1 -- 172.21.15.102:0/3397955775 shutdown_connections 2024-09-13T19:16:16.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.129+0000 7f51bc542800 1 --2- 172.21.15.102:0/3397955775 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5090036b90 0x7f5090039050 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.129+0000 7f51bc542800 1 --2- 172.21.15.102:0/3397955775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640562ee060 0x5640562ee480 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.129+0000 7f51bc542800 1 -- 172.21.15.102:0/3397955775 >> 172.21.15.102:0/3397955775 conn(0x5640562e2ff0 msgr2=0x5640562e5b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:16.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.129+0000 7f51bc542800 1 -- 172.21.15.102:0/3397955775 shutdown_connections 2024-09-13T19:16:16.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.129+0000 7f51bc542800 1 -- 172.21.15.102:0/3397955775 wait complete. 2024-09-13T19:16:16.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.129+0000 7f51bc542800 1 -- 172.21.15.102:0/3464820480 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5640561dfb40 msgr2=0x5640562da420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.129+0000 7f51bc542800 1 --2- 172.21.15.102:0/3464820480 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5640561dfb40 0x5640562da420 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.129+0000 7f51bc542800 1 -- 172.21.15.102:0/3464820480 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5640562dccb0 msgr2=0x5640562df0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.129+0000 7f51bc542800 1 --2- 172.21.15.102:0/3464820480 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5640562dccb0 0x5640562df0a0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.129+0000 7f51bc542800 1 -- 172.21.15.102:0/3464820480 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f50a0036b40 msgr2=0x7f50a0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.129+0000 7f51bc542800 1 --2- 172.21.15.102:0/3464820480 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f50a0036b40 0x7f50a0039000 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f51ac000f60 tx=0x7f51ac0012b0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.129+0000 7f51bc542800 1 -- 172.21.15.102:0/3464820480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56405614e630 msgr2=0x5640562d33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.129+0000 7f51bc542800 1 --2- 172.21.15.102:0/3464820480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56405614e630 0x5640562d33b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f51a800a330 tx=0x7f51a8002fb0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.129+0000 7f51bc542800 1 -- 172.21.15.102:0/3464820480 shutdown_connections 2024-09-13T19:16:16.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.129+0000 7f51bc542800 1 --2- 172.21.15.102:0/3464820480 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5640562dccb0 0x5640562df0a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.129+0000 7f51bc542800 1 --2- 172.21.15.102:0/3464820480 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5640561dfb40 0x5640562da420 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.129+0000 7f51bc542800 1 --2- 172.21.15.102:0/3464820480 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f50a0036b40 0x7f50a0039000 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.129+0000 7f51bc542800 1 --2- 172.21.15.102:0/3464820480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56405614e630 0x5640562d33b0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.129+0000 7f51bc542800 1 -- 172.21.15.102:0/3464820480 >> 172.21.15.102:0/3464820480 conn(0x5640561d4db0 msgr2=0x5640562c5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:16.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.129+0000 7f51bc542800 1 -- 172.21.15.102:0/3464820480 shutdown_connections 2024-09-13T19:16:16.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.129+0000 7f51bc542800 1 -- 172.21.15.102:0/3464820480 wait complete. 2024-09-13T19:16:16.143 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:16:14.779675Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'WvUulW2FY90Ii1AQNJqso7stab3SiOPaW3K2irbj', 'active': True, 'create_date': '2024-09-13T19:16:16.117214Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:16:14.779665Z', 'tags': [], 'group_ids': []} 2024-09-13T19:16:16.143 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-13T19:16:16.143 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-13T19:16:16.143 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2024-09-13T19:16:16.191 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:16.191 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:16.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.188+0000 7f53d9e63800 1 Processor -- start 2024-09-13T19:16:16.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.188+0000 7f53d9e63800 1 -- start start 2024-09-13T19:16:16.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.188+0000 7f53d9e63800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55d004f004e0 0x55d004f008e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.188+0000 7f53d9e63800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d004dc0b30 con 0x55d004f00e20 2024-09-13T19:16:16.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.188+0000 7f53d9e63800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55d004da2360 con 0x55d004f004e0 2024-09-13T19:16:16.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.188+0000 7f53d7957640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55d004f004e0 0x55d004f008e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.188+0000 7f53d7156640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55d004f00e20 0x55d004f059a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:49864/0 (socket says 172.21.15.102:49864) 2024-09-13T19:16:16.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.188+0000 7f53d7957640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55d004f004e0 0x55d004f008e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54404/0 (socket says 172.21.15.102:54404) 2024-09-13T19:16:16.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.188+0000 7f53d7156640 1 -- 172.21.15.102:0/4261260231 learned_addr learned my addr 172.21.15.102:0/4261260231 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:16:16.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.189+0000 7f53d7957640 1 -- 172.21.15.102:0/4261260231 >> v1:172.21.15.53:6789/0 conn(0x55d004f00e20 legacy=0x55d004f059a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.189+0000 7f53d7957640 1 -- 172.21.15.102:0/4261260231 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d004dc8e00 con 0x55d004f004e0 2024-09-13T19:16:16.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.191+0000 7f53d7957640 1 --2- 172.21.15.102:0/4261260231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d004f004e0 0x55d004f008e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f53c8005fd0 tx=0x7f53c8045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc53989d37468afd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.191+0000 7f53d6955640 1 -- 172.21.15.102:0/4261260231 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53c8058530 con 0x55d004f004e0 2024-09-13T19:16:16.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.191+0000 7f53d6955640 1 -- 172.21.15.102:0/4261260231 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53c80586d0 con 0x55d004f004e0 2024-09-13T19:16:16.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.191+0000 7f53d6955640 1 -- 172.21.15.102:0/4261260231 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53c80589d0 con 0x55d004f004e0 2024-09-13T19:16:16.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.191+0000 7f53d9e63800 1 -- 172.21.15.102:0/4261260231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d004f004e0 msgr2=0x55d004f008e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.191+0000 7f53d9e63800 1 --2- 172.21.15.102:0/4261260231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d004f004e0 0x55d004f008e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f53c8005fd0 tx=0x7f53c8045c30 comp rx=0 tx=0).stop 2024-09-13T19:16:16.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.191+0000 7f53d9e63800 1 -- 172.21.15.102:0/4261260231 shutdown_connections 2024-09-13T19:16:16.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.191+0000 7f53d9e63800 1 --2- 172.21.15.102:0/4261260231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d004f004e0 0x55d004f008e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.191+0000 7f53d9e63800 1 -- 172.21.15.102:0/4261260231 >> 172.21.15.102:0/4261260231 conn(0x55d004efbe10 msgr2=0x55d004efe230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:16.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.191+0000 7f53d9e63800 1 -- 172.21.15.102:0/4261260231 shutdown_connections 2024-09-13T19:16:16.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.191+0000 7f53d9e63800 1 -- 172.21.15.102:0/4261260231 wait complete. 2024-09-13T19:16:16.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.205+0000 7f53d9e63800 1 Processor -- start 2024-09-13T19:16:16.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.205+0000 7f53d9e63800 1 -- start start 2024-09-13T19:16:16.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.205+0000 7f53d9e63800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d004f004e0 0x55d004e74da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.205+0000 7f53d9e63800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d004e4d350 con 0x55d004f004e0 2024-09-13T19:16:16.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.206+0000 7f53d7957640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d004f004e0 0x55d004e74da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.206+0000 7f53d7957640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d004f004e0 0x55d004e74da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54410/0 (socket says 172.21.15.102:54410) 2024-09-13T19:16:16.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.206+0000 7f53d7957640 1 -- 172.21.15.102:0/1100369466 learned_addr learned my addr 172.21.15.102:0/1100369466 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:16.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.206+0000 7f53d7957640 1 -- 172.21.15.102:0/1100369466 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d004d9abc0 con 0x55d004f004e0 2024-09-13T19:16:16.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.206+0000 7f53d7957640 1 --2- 172.21.15.102:0/1100369466 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d004f004e0 0x55d004e74da0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f53c800a3f0 tx=0x7f53c8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f05bd9e87b12bf64 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.207+0000 7f52c5e0b640 1 -- 172.21.15.102:0/1100369466 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53c8058a30 con 0x55d004f004e0 2024-09-13T19:16:16.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.207+0000 7f52c5e0b640 1 -- 172.21.15.102:0/1100369466 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53c8068070 con 0x55d004f004e0 2024-09-13T19:16:16.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.207+0000 7f52c5e0b640 1 -- 172.21.15.102:0/1100369466 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53c8058d60 con 0x55d004f004e0 2024-09-13T19:16:16.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.207+0000 7f53d9e63800 1 -- 172.21.15.102:0/1100369466 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d004f004e0 msgr2=0x55d004e74da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.207+0000 7f53d9e63800 1 --2- 172.21.15.102:0/1100369466 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d004f004e0 0x55d004e74da0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f53c800a3f0 tx=0x7f53c8051000 comp rx=0 tx=0).stop 2024-09-13T19:16:16.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.207+0000 7f53d9e63800 1 -- 172.21.15.102:0/1100369466 shutdown_connections 2024-09-13T19:16:16.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.207+0000 7f53d9e63800 1 --2- 172.21.15.102:0/1100369466 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d004f004e0 0x55d004e74da0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.207+0000 7f53d9e63800 1 -- 172.21.15.102:0/1100369466 >> 172.21.15.102:0/1100369466 conn(0x55d004efbe10 msgr2=0x55d004feb1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:16.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.207+0000 7f53d9e63800 1 -- 172.21.15.102:0/1100369466 shutdown_connections 2024-09-13T19:16:16.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.207+0000 7f53d9e63800 1 -- 172.21.15.102:0/1100369466 wait complete. 2024-09-13T19:16:16.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.208+0000 7f53d9e63800 1 Processor -- start 2024-09-13T19:16:16.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.208+0000 7f53d9e63800 1 -- start start 2024-09-13T19:16:16.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.208+0000 7f53d9e63800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d004f004e0 0x55d004ff81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.208+0000 7f53d9e63800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d004f07500 con 0x55d004f004e0 2024-09-13T19:16:16.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.208+0000 7f53d7957640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d004f004e0 0x55d004ff81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.208+0000 7f53d7957640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d004f004e0 0x55d004ff81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54416/0 (socket says 172.21.15.102:54416) 2024-09-13T19:16:16.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.208+0000 7f53d7957640 1 -- 172.21.15.102:0/2962015654 learned_addr learned my addr 172.21.15.102:0/2962015654 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:16.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.208+0000 7f53d7957640 1 -- 172.21.15.102:0/2962015654 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d004daefe0 con 0x55d004f004e0 2024-09-13T19:16:16.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.208+0000 7f53d7957640 1 --2- 172.21.15.102:0/2962015654 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d004f004e0 0x55d004ff81b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f53c8046130 tx=0x7f53c8003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.209+0000 7f52bffff640 1 -- 172.21.15.102:0/2962015654 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53c80636b0 con 0x55d004f004e0 2024-09-13T19:16:16.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.209+0000 7f52bffff640 1 -- 172.21.15.102:0/2962015654 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53c8063850 con 0x55d004f004e0 2024-09-13T19:16:16.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.209+0000 7f53d9e63800 1 -- 172.21.15.102:0/2962015654 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d004ff86f0 con 0x55d004f004e0 2024-09-13T19:16:16.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.209+0000 7f52bffff640 1 -- 172.21.15.102:0/2962015654 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53c8063b70 con 0x55d004f004e0 2024-09-13T19:16:16.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.209+0000 7f53d9e63800 1 -- 172.21.15.102:0/2962015654 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d004ff8c10 con 0x55d004f004e0 2024-09-13T19:16:16.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.209+0000 7f52bffff640 1 -- 172.21.15.102:0/2962015654 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f53c8075020 con 0x55d004f004e0 2024-09-13T19:16:16.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.210+0000 7f52bffff640 1 --2- 172.21.15.102:0/2962015654 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f52c0036b40 0x7f52c0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.210+0000 7f52bffff640 1 -- 172.21.15.102:0/2962015654 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f53c8090d10 con 0x55d004f004e0 2024-09-13T19:16:16.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.210+0000 7f53d7156640 1 --2- 172.21.15.102:0/2962015654 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f52c0036b40 0x7f52c0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.210+0000 7f53d9e63800 1 --2- 172.21.15.102:0/2962015654 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55d004f00e20 0x55d004fff220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.210+0000 7f53d9e63800 1 -- 172.21.15.102:0/2962015654 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d004fff760 con 0x55d004f00e20 2024-09-13T19:16:16.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.210+0000 7f53d8158640 1 --2- 172.21.15.102:0/2962015654 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55d004f00e20 0x55d004fff220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.210+0000 7f53d7156640 1 --2- 172.21.15.102:0/2962015654 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f52c0036b40 0x7f52c0039000 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f53c0000f60 tx=0x7f53c00012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.210+0000 7f53d8158640 1 --2- 172.21.15.102:0/2962015654 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55d004f00e20 0x55d004fff220 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.210+0000 7f53d8158640 1 -- 172.21.15.102:0/2962015654 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f53d00083e0 con 0x55d004f00e20 2024-09-13T19:16:16.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.210+0000 7f53d9e63800 1 -- 172.21.15.102:0/2962015654 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d004ffc7d0 con 0x55d004f00e20 2024-09-13T19:16:16.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.211+0000 7f53d8158640 1 -- 172.21.15.102:0/2962015654 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f53d00083e0 con 0x55d004f00e20 2024-09-13T19:16:16.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.211+0000 7f53d9e63800 1 --2- 172.21.15.102:0/2962015654 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55d005001a50 0x55d005003e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.211+0000 7f53d9e63800 1 -- 172.21.15.102:0/2962015654 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d005004530 con 0x55d005001a50 2024-09-13T19:16:16.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.211+0000 7f53d7957640 1 --2- 172.21.15.102:0/2962015654 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55d005001a50 0x55d005003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.211+0000 7f53d7957640 1 --2- 172.21.15.102:0/2962015654 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55d005001a50 0x55d005003e40 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.211+0000 7f53d7957640 1 -- 172.21.15.102:0/2962015654 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f53c8077c60 con 0x55d005001a50 2024-09-13T19:16:16.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.211+0000 7f53d9e63800 1 -- 172.21.15.102:0/2962015654 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d0050008f0 con 0x55d004f00e20 2024-09-13T19:16:16.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.212+0000 7f53d8158640 1 -- 172.21.15.102:0/2962015654 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f53d00083e0 con 0x55d004f00e20 2024-09-13T19:16:16.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.212+0000 7f53d9e63800 1 -- 172.21.15.102:0/2962015654 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d005000d90 con 0x55d005001a50 2024-09-13T19:16:16.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.212+0000 7f53d7957640 1 -- 172.21.15.102:0/2962015654 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f53c8077c60 con 0x55d005001a50 2024-09-13T19:16:16.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.212+0000 7f53d9e63800 1 Processor -- start 2024-09-13T19:16:16.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.212+0000 7f53d9e63800 1 -- start start 2024-09-13T19:16:16.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.212+0000 7f53d9e63800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d005012ea0 0x55d0050132c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.212+0000 7f53d9e63800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d004d9c580 con 0x55d005012ea0 2024-09-13T19:16:16.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.213+0000 7f53d8158640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d005012ea0 0x55d0050132c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.213+0000 7f53d8158640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d005012ea0 0x55d0050132c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54418/0 (socket says 172.21.15.102:54418) 2024-09-13T19:16:16.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.213+0000 7f53d8158640 1 -- 172.21.15.102:0/3498044454 learned_addr learned my addr 172.21.15.102:0/3498044454 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:16.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.213+0000 7f53d8158640 1 -- 172.21.15.102:0/3498044454 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d005013800 con 0x55d005012ea0 2024-09-13T19:16:16.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.213+0000 7f53d8158640 1 --2- 172.21.15.102:0/3498044454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d005012ea0 0x55d0050132c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x55d004ff9260 tx=0x7f53d000beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.213+0000 7f52bd7fa640 1 -- 172.21.15.102:0/3498044454 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53d001c020 con 0x55d005012ea0 2024-09-13T19:16:16.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.213+0000 7f52bd7fa640 1 -- 172.21.15.102:0/3498044454 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53d0007cf0 con 0x55d005012ea0 2024-09-13T19:16:16.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.213+0000 7f53d9e63800 1 -- 172.21.15.102:0/3498044454 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d005013a90 con 0x55d005012ea0 2024-09-13T19:16:16.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.213+0000 7f52bd7fa640 1 -- 172.21.15.102:0/3498044454 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53d0018440 con 0x55d005012ea0 2024-09-13T19:16:16.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.214+0000 7f53d9e63800 1 -- 172.21.15.102:0/3498044454 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d005016770 con 0x55d005012ea0 2024-09-13T19:16:16.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.214+0000 7f52bd7fa640 1 -- 172.21.15.102:0/3498044454 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f53d001f020 con 0x55d005012ea0 2024-09-13T19:16:16.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.214+0000 7f52bd7fa640 1 --2- 172.21.15.102:0/3498044454 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f52b0036b90 0x7f52b0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.214+0000 7f52bd7fa640 1 -- 172.21.15.102:0/3498044454 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f53d004e2a0 con 0x55d005012ea0 2024-09-13T19:16:16.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.215+0000 7f53d7957640 1 --2- 172.21.15.102:0/3498044454 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f52b0036b90 0x7f52b0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.215+0000 7f53d9e63800 1 Processor -- start 2024-09-13T19:16:16.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.215+0000 7f53d9e63800 1 -- start start 2024-09-13T19:16:16.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.215+0000 7f53d7957640 1 --2- 172.21.15.102:0/3498044454 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f52b0036b90 0x7f52b0039050 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x55d005000000 tx=0x7f53c8000f40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.215+0000 7f53d9e63800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d00501fb70 0x55d00501ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.215+0000 7f53d9e63800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d004ff3740 con 0x55d00501fb70 2024-09-13T19:16:16.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.215+0000 7f53d8158640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d00501fb70 0x55d00501ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.215+0000 7f53d8158640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d00501fb70 0x55d00501ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54432/0 (socket says 172.21.15.102:54432) 2024-09-13T19:16:16.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.215+0000 7f53d8158640 1 -- 172.21.15.102:0/3114716989 learned_addr learned my addr 172.21.15.102:0/3114716989 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:16.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.216+0000 7f53d8158640 1 -- 172.21.15.102:0/3114716989 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d005020540 con 0x55d00501fb70 2024-09-13T19:16:16.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.216+0000 7f53d8158640 1 --2- 172.21.15.102:0/3114716989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d00501fb70 0x55d00501ff70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f53d004c5f0 tx=0x7f53d004c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef79e168179727d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.216+0000 7f52b6ffd640 1 -- 172.21.15.102:0/3114716989 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53d0045070 con 0x55d00501fb70 2024-09-13T19:16:16.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.216+0000 7f52b6ffd640 1 -- 172.21.15.102:0/3114716989 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53d004e070 con 0x55d00501fb70 2024-09-13T19:16:16.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.216+0000 7f52b6ffd640 1 -- 172.21.15.102:0/3114716989 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53d0021530 con 0x55d00501fb70 2024-09-13T19:16:16.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.216+0000 7f53d9e63800 1 -- 172.21.15.102:0/3114716989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d00501fb70 msgr2=0x55d00501ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.216+0000 7f53d9e63800 1 --2- 172.21.15.102:0/3114716989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d00501fb70 0x55d00501ff70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f53d004c5f0 tx=0x7f53d004c8a0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.216+0000 7f53d9e63800 1 -- 172.21.15.102:0/3114716989 shutdown_connections 2024-09-13T19:16:16.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.216+0000 7f53d9e63800 1 --2- 172.21.15.102:0/3114716989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d00501fb70 0x55d00501ff70 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.216+0000 7f53d9e63800 1 -- 172.21.15.102:0/3114716989 >> 172.21.15.102:0/3114716989 conn(0x55d00501bed0 msgr2=0x55d005019fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:16.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.216+0000 7f53d9e63800 1 -- 172.21.15.102:0/3114716989 shutdown_connections 2024-09-13T19:16:16.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.217+0000 7f53d9e63800 1 -- 172.21.15.102:0/3114716989 wait complete. 2024-09-13T19:16:16.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.217+0000 7f53d9e63800 1 Processor -- start 2024-09-13T19:16:16.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.217+0000 7f53d9e63800 1 -- start start 2024-09-13T19:16:16.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.217+0000 7f53d9e63800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d00501fb70 0x55d005027020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.217+0000 7f53d9e63800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d005020bb0 con 0x55d00501fb70 2024-09-13T19:16:16.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.217+0000 7f53d8158640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d00501fb70 0x55d005027020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.217+0000 7f53d8158640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d00501fb70 0x55d005027020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54434/0 (socket says 172.21.15.102:54434) 2024-09-13T19:16:16.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.217+0000 7f53d8158640 1 -- 172.21.15.102:0/3716116324 learned_addr learned my addr 172.21.15.102:0/3716116324 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:16.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.217+0000 7f53d8158640 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d005027560 con 0x55d00501fb70 2024-09-13T19:16:16.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.218+0000 7f53d8158640 1 --2- 172.21.15.102:0/3716116324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d00501fb70 0x55d005027020 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f53d004c5f0 tx=0x7f53d004c580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.218+0000 7f52b57fa640 1 -- 172.21.15.102:0/3716116324 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53d0045070 con 0x55d00501fb70 2024-09-13T19:16:16.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.218+0000 7f52b57fa640 1 -- 172.21.15.102:0/3716116324 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53d0029c70 con 0x55d00501fb70 2024-09-13T19:16:16.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.218+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d0050277f0 con 0x55d00501fb70 2024-09-13T19:16:16.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.218+0000 7f52b57fa640 1 -- 172.21.15.102:0/3716116324 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53d003f030 con 0x55d00501fb70 2024-09-13T19:16:16.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.218+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d00502a4a0 con 0x55d00501fb70 2024-09-13T19:16:16.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.218+0000 7f52b57fa640 1 -- 172.21.15.102:0/3716116324 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f53d0016040 con 0x55d00501fb70 2024-09-13T19:16:16.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.219+0000 7f52b57fa640 1 --2- 172.21.15.102:0/3716116324 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f52a0036b40 0x7f52a0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.219+0000 7f52b57fa640 1 -- 172.21.15.102:0/3716116324 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f53d004fd80 con 0x55d00501fb70 2024-09-13T19:16:16.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.219+0000 7f53d7957640 1 --2- 172.21.15.102:0/3716116324 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f52a0036b40 0x7f52a0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.219+0000 7f53d7957640 1 --2- 172.21.15.102:0/3716116324 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f52a0036b40 0x7f52a0039000 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f53c8077fd0 tx=0x7f53c8096000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.219+0000 7f53d9e63800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.220+0000 7f53d9e63800 1 --2- 172.21.15.102:0/3716116324 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55d005032b60 0x55d005035020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.220+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d005035770 con 0x55d005032b60 2024-09-13T19:16:16.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.220+0000 7f53d7156640 1 --2- 172.21.15.102:0/3716116324 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55d005032b60 0x55d005035020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.220+0000 7f53d7156640 1 --2- 172.21.15.102:0/3716116324 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55d005032b60 0x55d005035020 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.220+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f53c0009050 con 0x55d005032b60 2024-09-13T19:16:16.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.220+0000 7f53d9e63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:16.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.220+0000 7f53d9e63800 20 realm 2024-09-13T19:16:16.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.220+0000 7f53d9e63800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.220+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d005031fb0 con 0x55d005032b60 2024-09-13T19:16:16.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.220+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f53c0009050 con 0x55d005032b60 2024-09-13T19:16:16.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.220+0000 7f53d9e63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:16.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.220+0000 7f53d9e63800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:16.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.220+0000 7f53d9e63800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.220+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d005036260 con 0x55d005032b60 2024-09-13T19:16:16.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.221+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f53c0009050 con 0x55d005032b60 2024-09-13T19:16:16.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.221+0000 7f53d9e63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:16.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.221+0000 7f53d9e63800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.221+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d005036b30 con 0x55d005032b60 2024-09-13T19:16:16.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.221+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f53c0009050 con 0x55d005032b60 2024-09-13T19:16:16.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.221+0000 7f53d9e63800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:16.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.221+0000 7f53d9e63800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.221+0000 7f53d9e63800 1 --2- 172.21.15.102:0/3716116324 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55d005037470 0x55d005039860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.221+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d005039ff0 con 0x55d005037470 2024-09-13T19:16:16.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.221+0000 7f53d8158640 1 --2- 172.21.15.102:0/3716116324 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55d005037470 0x55d005039860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.221+0000 7f53d8158640 1 --2- 172.21.15.102:0/3716116324 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55d005037470 0x55d005039860 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.221+0000 7f53d8158640 1 -- 172.21.15.102:0/3716116324 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f53d0033020 con 0x55d005037470 2024-09-13T19:16:16.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.222+0000 7f53d9e63800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:16.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.222+0000 7f53d9e63800 20 searching for the correct realm 2024-09-13T19:16:16.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.222+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d00503b940 con 0x55d005037470 2024-09-13T19:16:16.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.222+0000 7f53d8158640 1 -- 172.21.15.102:0/3716116324 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53d0033020 con 0x55d005037470 2024-09-13T19:16:16.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.222+0000 7f53d8158640 1 --2- 172.21.15.102:0/3716116324 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f53d005b040 0x7f53d002a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.222+0000 7f53d8158640 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d00503b940 con 0x7f53d005b040 2024-09-13T19:16:16.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.222+0000 7f53d7957640 1 --2- 172.21.15.102:0/3716116324 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f53d005b040 0x7f53d002a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.222+0000 7f53d7957640 1 --2- 172.21.15.102:0/3716116324 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f53d005b040 0x7f53d002a7e0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.222+0000 7f53d7957640 1 -- 172.21.15.102:0/3716116324 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c808b050 con 0x7f53d005b040 2024-09-13T19:16:16.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.222+0000 7f53d7957640 1 --2- 172.21.15.102:0/3716116324 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f53c80aa040 0x7f53c8088670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.222+0000 7f53d7957640 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d00503b940 con 0x7f53c80aa040 2024-09-13T19:16:16.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.223+0000 7f53d7156640 1 --2- 172.21.15.102:0/3716116324 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f53c80aa040 0x7f53c8088670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.223+0000 7f53d7156640 1 --2- 172.21.15.102:0/3716116324 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f53c80aa040 0x7f53c8088670 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.223+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c0009050 con 0x7f53c80aa040 2024-09-13T19:16:16.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.223+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d00503b940 con 0x55d005032b60 2024-09-13T19:16:16.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.224+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c0009050 con 0x55d005032b60 2024-09-13T19:16:16.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.224+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d00503b940 con 0x55d005032b60 2024-09-13T19:16:16.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.224+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c0029040 con 0x55d005032b60 2024-09-13T19:16:16.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.224+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d00503b940 con 0x7f53c80aa040 2024-09-13T19:16:16.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.224+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c0029040 con 0x7f53c80aa040 2024-09-13T19:16:16.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.224+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d00503b940 con 0x7f53c80aa040 2024-09-13T19:16:16.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.224+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c0029040 con 0x7f53c80aa040 2024-09-13T19:16:16.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.224+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d00503b940 con 0x7f53d005b040 2024-09-13T19:16:16.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.225+0000 7f53d7957640 1 -- 172.21.15.102:0/3716116324 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c808b050 con 0x7f53d005b040 2024-09-13T19:16:16.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.225+0000 7f53d7957640 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d00503b940 con 0x55d005037470 2024-09-13T19:16:16.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.225+0000 7f53d8158640 1 -- 172.21.15.102:0/3716116324 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53d0033020 con 0x55d005037470 2024-09-13T19:16:16.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.225+0000 7f53d8158640 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d00503b940 con 0x55d005032b60 2024-09-13T19:16:16.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.225+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c0029040 con 0x55d005032b60 2024-09-13T19:16:16.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.225+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d00503b940 con 0x7f53c80aa040 2024-09-13T19:16:16.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.225+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c0029040 con 0x7f53c80aa040 2024-09-13T19:16:16.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.225+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d00503b940 con 0x55d005032b60 2024-09-13T19:16:16.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.225+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c0029040 con 0x55d005032b60 2024-09-13T19:16:16.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.225+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d00503b940 con 0x7f53d005b040 2024-09-13T19:16:16.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.226+0000 7f53d7957640 1 -- 172.21.15.102:0/3716116324 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f53c808b050 con 0x7f53d005b040 2024-09-13T19:16:16.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.226+0000 7f53d7957640 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d00503b940 con 0x55d005037470 2024-09-13T19:16:16.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.226+0000 7f53d8158640 1 -- 172.21.15.102:0/3716116324 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53d0033020 con 0x55d005037470 2024-09-13T19:16:16.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.226+0000 7f53d8158640 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d00503b940 con 0x55d005037470 2024-09-13T19:16:16.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.226+0000 7f53d8158640 1 -- 172.21.15.102:0/3716116324 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f53d0033020 con 0x55d005037470 2024-09-13T19:16:16.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.226+0000 7f53d8158640 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d00503b940 con 0x7f53c80aa040 2024-09-13T19:16:16.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.227+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c0029040 con 0x7f53c80aa040 2024-09-13T19:16:16.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.227+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d00503b940 con 0x55d005037470 2024-09-13T19:16:16.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.227+0000 7f53d8158640 1 -- 172.21.15.102:0/3716116324 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f53d0033020 con 0x55d005037470 2024-09-13T19:16:16.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.227+0000 7f53d8158640 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d00503b940 con 0x55d005037470 2024-09-13T19:16:16.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.227+0000 7f53d8158640 1 -- 172.21.15.102:0/3716116324 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53d0033020 con 0x55d005037470 2024-09-13T19:16:16.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.227+0000 7f53d8158640 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d00503b940 con 0x55d005032b60 2024-09-13T19:16:16.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.227+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c0029040 con 0x55d005032b60 2024-09-13T19:16:16.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.227+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d00503b940 con 0x55d005032b60 2024-09-13T19:16:16.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.227+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f53c0029040 con 0x55d005032b60 2024-09-13T19:16:16.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.227+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d00503b940 con 0x7f53c80aa040 2024-09-13T19:16:16.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.228+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c0029040 con 0x7f53c80aa040 2024-09-13T19:16:16.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.228+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d00503b940 con 0x55d005037470 2024-09-13T19:16:16.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.228+0000 7f53d8158640 1 -- 172.21.15.102:0/3716116324 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53d0033020 con 0x55d005037470 2024-09-13T19:16:16.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.228+0000 7f53d8158640 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d00503b940 con 0x7f53d005b040 2024-09-13T19:16:16.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.228+0000 7f53d7957640 1 -- 172.21.15.102:0/3716116324 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c808b050 con 0x7f53d005b040 2024-09-13T19:16:16.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.228+0000 7f53d7957640 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d00503b940 con 0x55d005032b60 2024-09-13T19:16:16.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.228+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c0029040 con 0x55d005032b60 2024-09-13T19:16:16.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.228+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d00503b940 con 0x7f53c80aa040 2024-09-13T19:16:16.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.229+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c0029040 con 0x7f53c80aa040 2024-09-13T19:16:16.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.229+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d00503b940 con 0x55d005037470 2024-09-13T19:16:16.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.229+0000 7f53d8158640 1 -- 172.21.15.102:0/3716116324 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53d006a040 con 0x55d005037470 2024-09-13T19:16:16.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.229+0000 7f53d8158640 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d00503b940 con 0x7f53c80aa040 2024-09-13T19:16:16.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.229+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c0029040 con 0x7f53c80aa040 2024-09-13T19:16:16.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.229+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d00503b940 con 0x7f53d005b040 2024-09-13T19:16:16.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.229+0000 7f53d7957640 1 -- 172.21.15.102:0/3716116324 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c808b050 con 0x7f53d005b040 2024-09-13T19:16:16.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.229+0000 7f53d7957640 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d00503b940 con 0x55d005037470 2024-09-13T19:16:16.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.230+0000 7f53d8158640 1 -- 172.21.15.102:0/3716116324 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53d006a040 con 0x55d005037470 2024-09-13T19:16:16.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.230+0000 7f53d8158640 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d00503b940 con 0x7f53c80aa040 2024-09-13T19:16:16.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.230+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c0029040 con 0x7f53c80aa040 2024-09-13T19:16:16.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.230+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d00503b940 con 0x55d005032b60 2024-09-13T19:16:16.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.230+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f53c0029040 con 0x55d005032b60 2024-09-13T19:16:16.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.230+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d00503b940 con 0x7f53d005b040 2024-09-13T19:16:16.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.230+0000 7f53d7957640 1 -- 172.21.15.102:0/3716116324 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c808b050 con 0x7f53d005b040 2024-09-13T19:16:16.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.230+0000 7f53d9e63800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:16.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.230+0000 7f53d9e63800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:16.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.230+0000 7f53d9e63800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:16.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.230+0000 7f53d9e63800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:16.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.230+0000 7f53d9e63800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:16.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.230+0000 7f53d9e63800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:16.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.230+0000 7f53d9e63800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.230+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d00503a9b0 con 0x55d005032b60 2024-09-13T19:16:16.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.231+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f53c0029040 con 0x55d005032b60 2024-09-13T19:16:16.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.231+0000 7f53d9e63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:16.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.231+0000 7f53d9e63800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.231+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d00503b250 con 0x55d005032b60 2024-09-13T19:16:16.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.231+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f53c0029040 con 0x55d005032b60 2024-09-13T19:16:16.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.231+0000 7f53d9e63800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:16.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.231+0000 7f53d9e63800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.231+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d00503bdc0 con 0x55d005037470 2024-09-13T19:16:16.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.231+0000 7f53d8158640 1 -- 172.21.15.102:0/3716116324 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f53d006a040 con 0x55d005037470 2024-09-13T19:16:16.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.231+0000 7f53d9e63800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:16.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.231+0000 7f53d9e63800 20 zone default found 2024-09-13T19:16:16.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.231+0000 7f53d9e63800 4 Realm: () 2024-09-13T19:16:16.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.231+0000 7f53d9e63800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:16.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.231+0000 7f53d9e63800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:16.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.231+0000 7f53d9e63800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:16.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.231+0000 7f53d9e63800 20 zonegroup default 2024-09-13T19:16:16.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.231+0000 7f53d9e63800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.231+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d00503aea0 con 0x7f53c80aa040 2024-09-13T19:16:16.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.232+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f53c0029040 con 0x7f53c80aa040 2024-09-13T19:16:16.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.232+0000 7f53d9e63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:16.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.232+0000 7f53d9e63800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.232+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d00503e540 con 0x55d005037470 2024-09-13T19:16:16.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.232+0000 7f53d8158640 1 -- 172.21.15.102:0/3716116324 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f53d006a040 con 0x55d005037470 2024-09-13T19:16:16.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.232+0000 7f53d9e63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:16.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.232+0000 7f53d9e63800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.232+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d00503e8e0 con 0x55d005037470 2024-09-13T19:16:16.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.232+0000 7f53d8158640 1 -- 172.21.15.102:0/3716116324 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f53d006a040 con 0x55d005037470 2024-09-13T19:16:16.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.232+0000 7f53d9e63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:16.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.232+0000 7f53d9e63800 20 started sync module instance, tier type = 2024-09-13T19:16:16.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.232+0000 7f53d9e63800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:16.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.232+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d00503d980 con 0x7f53d005b040 2024-09-13T19:16:16.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.233+0000 7f53d7957640 1 -- 172.21.15.102:0/3716116324 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(44 notify.0 [create] v34'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53c808b050 con 0x7f53d005b040 2024-09-13T19:16:16.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.233+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94351925697904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d00503e190 con 0x7f53d005b040 2024-09-13T19:16:16.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.233+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d00503f240 con 0x55d005032b60 2024-09-13T19:16:16.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.234+0000 7f53d7957640 1 -- 172.21.15.102:0/3716116324 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94351925697904] v34'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53c808b050 con 0x7f53d005b040 2024-09-13T19:16:16.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.234+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v34'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53c0029040 con 0x55d005032b60 2024-09-13T19:16:16.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.234+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94351925701312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d00503fae0 con 0x55d005032b60 2024-09-13T19:16:16.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.234+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d0050404a0 con 0x55d005037470 2024-09-13T19:16:16.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.235+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94351925701312] v34'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53c0029040 con 0x55d005032b60 2024-09-13T19:16:16.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.235+0000 7f53d8158640 1 -- 172.21.15.102:0/3716116324 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v34'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53d006a040 con 0x55d005037470 2024-09-13T19:16:16.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.235+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94351925707216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d00503fae0 con 0x55d005037470 2024-09-13T19:16:16.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.236+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d005040ef0 con 0x7f53d005b040 2024-09-13T19:16:16.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.236+0000 7f53d8158640 1 -- 172.21.15.102:0/3716116324 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94351925707216] v34'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53d006a040 con 0x55d005037470 2024-09-13T19:16:16.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.237+0000 7f53d7957640 1 -- 172.21.15.102:0/3716116324 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(50 notify.3 [create] v34'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53c808b050 con 0x7f53d005b040 2024-09-13T19:16:16.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.237+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94351925704240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d00503fa50 con 0x7f53d005b040 2024-09-13T19:16:16.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.237+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d005041db0 con 0x55d005032b60 2024-09-13T19:16:16.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.238+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v34'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53c0029040 con 0x55d005032b60 2024-09-13T19:16:16.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.238+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94351925713664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d005042650 con 0x55d005032b60 2024-09-13T19:16:16.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.238+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d0050430c0 con 0x7f53c80aa040 2024-09-13T19:16:16.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.238+0000 7f53d7957640 1 -- 172.21.15.102:0/3716116324 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94351925704240] v34'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53c808b050 con 0x7f53d005b040 2024-09-13T19:16:16.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.239+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94351925713664] v34'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53c0029040 con 0x55d005032b60 2024-09-13T19:16:16.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.239+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(54 notify.5 [create] v34'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53c0029040 con 0x7f53c80aa040 2024-09-13T19:16:16.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.239+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94351925717904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d005042120 con 0x7f53c80aa040 2024-09-13T19:16:16.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.239+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d005043960 con 0x7f53c80aa040 2024-09-13T19:16:16.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.240+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(56 notify.6 [create] v34'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53c0029040 con 0x7f53c80aa040 2024-09-13T19:16:16.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.240+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94351925715152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d005043960 con 0x7f53c80aa040 2024-09-13T19:16:16.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.240+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d005044480 con 0x7f53c80aa040 2024-09-13T19:16:16.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.240+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94351925717904] v34'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53c0029040 con 0x7f53c80aa040 2024-09-13T19:16:16.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.241+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94351925715152] v34'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53c0029040 con 0x7f53c80aa040 2024-09-13T19:16:16.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.241+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(58 notify.7 [create] v34'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53c0029040 con 0x7f53c80aa040 2024-09-13T19:16:16.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.241+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94351925722960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d0050434a0 con 0x7f53c80aa040 2024-09-13T19:16:16.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.241+0000 7f53d9e63800 20 add_watcher() i=0 2024-09-13T19:16:16.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.241+0000 7f53d9e63800 20 add_watcher() i=1 2024-09-13T19:16:16.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.241+0000 7f53d9e63800 20 add_watcher() i=2 2024-09-13T19:16:16.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.241+0000 7f53d9e63800 20 add_watcher() i=3 2024-09-13T19:16:16.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.241+0000 7f53d9e63800 20 add_watcher() i=4 2024-09-13T19:16:16.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.241+0000 7f53d9e63800 20 add_watcher() i=5 2024-09-13T19:16:16.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.241+0000 7f53d9e63800 20 add_watcher() i=6 2024-09-13T19:16:16.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.242+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94351925722960] v34'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53c0029040 con 0x7f53c80aa040 2024-09-13T19:16:16.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.242+0000 7f53d9e63800 20 add_watcher() i=7 2024-09-13T19:16:16.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.242+0000 7f53d9e63800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:16.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.242+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d005047580 con 0x55d005032b60 2024-09-13T19:16:16.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.242+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f53c0029040 con 0x55d005032b60 2024-09-13T19:16:16.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.242+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94351925711584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d005044a00 con 0x55d005032b60 2024-09-13T19:16:16.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.243+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94351925711584] v34'72 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f53c0029040 con 0x55d005032b60 2024-09-13T19:16:16.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.243+0000 7f528dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:16.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.243+0000 7f53d9e63800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:16.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.243+0000 7f53d9e63800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:16.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.243+0000 7f53d9e63800 5 note: GC not initialized 2024-09-13T19:16:16.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.243+0000 7f528cfe1640 20 reqs_thread_entry: start 2024-09-13T19:16:16.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.244+0000 7f53d9e63800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:16.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.244+0000 7f53d9e63800 20 Filter name: none 2024-09-13T19:16:16.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.244+0000 7f52067fc640 20 reqs_thread_entry: start 2024-09-13T19:16:16.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.244+0000 7f53d9e63800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:16:16.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.244+0000 7f53d9e63800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.244+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d00507a750 con 0x55d005032b60 2024-09-13T19:16:16.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.244+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f53c0029040 con 0x55d005032b60 2024-09-13T19:16:16.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.244+0000 7f53d9e63800 20 rados_obj.operate() r=0 bl.length=556 2024-09-13T19:16:16.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.244+0000 7f53d9e63800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:16:16.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.244+0000 7f53d9e63800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:16:16.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.244+0000 7f53d9e63800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:16:16.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.244+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d005080fa0 con 0x55d005032b60 2024-09-13T19:16:16.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.245+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v34'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f53c0029040 con 0x55d005032b60 2024-09-13T19:16:16.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.245+0000 7f53d9e63800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:16:16.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.245+0000 7f53d9e63800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:16:16.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.245+0000 7f53d9e63800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T19:16:16.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.245+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94351925971296 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d00507c620 con 0x55d005032b60 2024-09-13T19:16:16.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.246+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== watch-notify(notify (1) cookie 94351925713664 notify 146028888070 ret 0) ==== 774+0+0 (crc 0 0 0) 0x55d004dc0b30 con 0x55d005032b60 2024-09-13T19:16:16.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.246+0000 7f52b6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888070 cookie 94351925713664 notifier 4377 bl.length()=732 2024-09-13T19:16:16.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.246+0000 7f52b6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:16:16.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.246+0000 7f52b6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:16:16.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.246+0000 7f52b6ffd640 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f529c003ea0 con 0x55d005032b60 2024-09-13T19:16:16.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.246+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(64 notify.4 [notify cookie 94351925971296 out=8b] v0'0 uv57 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f53c0029040 con 0x55d005032b60 2024-09-13T19:16:16.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.246+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53c0029040 con 0x55d005032b60 2024-09-13T19:16:16.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.246+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== watch-notify(notify_complete (2) cookie 94351925971296 notify 146028888070 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f53c003b810 con 0x55d005032b60 2024-09-13T19:16:16.260 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:16:14.779675Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:16:14.779665Z","tags":[],"group_ids":[]} 2024-09-13T19:16:16.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.247+0000 7f528dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:16.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.247+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94351925711584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d00507c170 con 0x55d005032b60 2024-09-13T19:16:16.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.248+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94351925711584] v34'73 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f53c0029040 con 0x55d005032b60 2024-09-13T19:16:16.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.248+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94351925697904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d005078460 con 0x7f53d005b040 2024-09-13T19:16:16.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.249+0000 7f53d7957640 1 -- 172.21.15.102:0/3716116324 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94351925697904] v34'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53c808b050 con 0x7f53d005b040 2024-09-13T19:16:16.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.249+0000 7f53d9e63800 20 remove_watcher() i=0 2024-09-13T19:16:16.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.249+0000 7f53d9e63800 2 removed watcher, disabling cache 2024-09-13T19:16:16.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.249+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94351925701312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d005078460 con 0x55d005032b60 2024-09-13T19:16:16.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.250+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 <== osd.1 v2:172.21.15.102:6808/2204418452 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94351925701312] v34'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53c0029040 con 0x55d005032b60 2024-09-13T19:16:16.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.250+0000 7f53d9e63800 20 remove_watcher() i=1 2024-09-13T19:16:16.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.250+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94351925707216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d005078460 con 0x55d005037470 2024-09-13T19:16:16.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.251+0000 7f53d8158640 1 -- 172.21.15.102:0/3716116324 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94351925707216] v34'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53d006a040 con 0x55d005037470 2024-09-13T19:16:16.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.251+0000 7f53d9e63800 20 remove_watcher() i=2 2024-09-13T19:16:16.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.251+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94351925704240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d005078460 con 0x7f53d005b040 2024-09-13T19:16:16.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.252+0000 7f53d7957640 1 -- 172.21.15.102:0/3716116324 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94351925704240] v34'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53c808b050 con 0x7f53d005b040 2024-09-13T19:16:16.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.252+0000 7f53d9e63800 20 remove_watcher() i=3 2024-09-13T19:16:16.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.252+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94351925713664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d005078460 con 0x55d005032b60 2024-09-13T19:16:16.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.253+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 <== osd.1 v2:172.21.15.102:6808/2204418452 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94351925713664] v34'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53c0029040 con 0x55d005032b60 2024-09-13T19:16:16.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.253+0000 7f53d9e63800 20 remove_watcher() i=4 2024-09-13T19:16:16.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.253+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94351925717904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d005078460 con 0x7f53c80aa040 2024-09-13T19:16:16.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.254+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94351925717904] v34'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53c0029040 con 0x7f53c80aa040 2024-09-13T19:16:16.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.254+0000 7f53d9e63800 20 remove_watcher() i=5 2024-09-13T19:16:16.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.254+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94351925715152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d005078460 con 0x7f53c80aa040 2024-09-13T19:16:16.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.255+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94351925715152] v34'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53c0029040 con 0x7f53c80aa040 2024-09-13T19:16:16.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.255+0000 7f53d9e63800 20 remove_watcher() i=6 2024-09-13T19:16:16.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.255+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94351925722960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d005078460 con 0x7f53c80aa040 2024-09-13T19:16:16.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.256+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94351925722960] v34'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53c0029040 con 0x7f53c80aa040 2024-09-13T19:16:16.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.256+0000 7f53d9e63800 20 remove_watcher() i=7 2024-09-13T19:16:16.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.256+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f53c80aa040 msgr2=0x7f53c8088670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.256+0000 7f53d9e63800 1 --2- 172.21.15.102:0/3716116324 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f53c80aa040 0x7f53c8088670 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.256+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55d005032b60 msgr2=0x55d005035020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.256+0000 7f53d9e63800 1 --2- 172.21.15.102:0/3716116324 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55d005032b60 0x55d005035020 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.256+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f53d005b040 msgr2=0x7f53d002a7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.256+0000 7f53d9e63800 1 --2- 172.21.15.102:0/3716116324 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f53d005b040 0x7f53d002a7e0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.256+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55d005037470 msgr2=0x55d005039860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.256+0000 7f53d9e63800 1 --2- 172.21.15.102:0/3716116324 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55d005037470 0x55d005039860 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.256+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f52a0036b40 msgr2=0x7f52a0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.256+0000 7f53d9e63800 1 --2- 172.21.15.102:0/3716116324 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f52a0036b40 0x7f52a0039000 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f53c8077fd0 tx=0x7f53c8096000 comp rx=0 tx=0).stop 2024-09-13T19:16:16.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.256+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d00501fb70 msgr2=0x55d005027020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.256+0000 7f53d7156640 1 -- 172.21.15.102:0/3716116324 reap_dead start 2024-09-13T19:16:16.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.256+0000 7f53d9e63800 1 --2- 172.21.15.102:0/3716116324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d00501fb70 0x55d005027020 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f53d004c5f0 tx=0x7f53d004c580 comp rx=0 tx=0).stop 2024-09-13T19:16:16.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.256+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 shutdown_connections 2024-09-13T19:16:16.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.256+0000 7f53d9e63800 1 --2- 172.21.15.102:0/3716116324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d00501fb70 0x55d005027020 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.256+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 >> 172.21.15.102:0/3716116324 conn(0x55d00501bed0 msgr2=0x55d005019fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:16.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.256+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 shutdown_connections 2024-09-13T19:16:16.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.256+0000 7f53d9e63800 1 -- 172.21.15.102:0/3716116324 wait complete. 2024-09-13T19:16:16.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.256+0000 7f53d9e63800 1 -- 172.21.15.102:0/3498044454 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f52b0036b90 msgr2=0x7f52b0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.256+0000 7f53d9e63800 1 --2- 172.21.15.102:0/3498044454 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f52b0036b90 0x7f52b0039050 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x55d005000000 tx=0x7f53c8000f40 comp rx=0 tx=0).stop 2024-09-13T19:16:16.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.256+0000 7f53d9e63800 1 -- 172.21.15.102:0/3498044454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d005012ea0 msgr2=0x55d0050132c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.256+0000 7f53d9e63800 1 --2- 172.21.15.102:0/3498044454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d005012ea0 0x55d0050132c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x55d004ff9260 tx=0x7f53d000beb0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.256+0000 7f53d9e63800 1 -- 172.21.15.102:0/3498044454 shutdown_connections 2024-09-13T19:16:16.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.256+0000 7f53d9e63800 1 --2- 172.21.15.102:0/3498044454 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f52b0036b90 0x7f52b0039050 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.256+0000 7f53d9e63800 1 --2- 172.21.15.102:0/3498044454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d005012ea0 0x55d0050132c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.256+0000 7f53d9e63800 1 -- 172.21.15.102:0/3498044454 >> 172.21.15.102:0/3498044454 conn(0x55d005007e30 msgr2=0x55d00500a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:16.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.256+0000 7f53d9e63800 1 -- 172.21.15.102:0/3498044454 shutdown_connections 2024-09-13T19:16:16.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.256+0000 7f53d9e63800 1 -- 172.21.15.102:0/3498044454 wait complete. 2024-09-13T19:16:16.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.257+0000 7f53d9e63800 1 -- 172.21.15.102:0/2962015654 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55d004f00e20 msgr2=0x55d004fff220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.257+0000 7f53d9e63800 1 --2- 172.21.15.102:0/2962015654 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55d004f00e20 0x55d004fff220 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.257+0000 7f53d9e63800 1 -- 172.21.15.102:0/2962015654 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55d005001a50 msgr2=0x55d005003e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.257+0000 7f53d9e63800 1 --2- 172.21.15.102:0/2962015654 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55d005001a50 0x55d005003e40 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.257+0000 7f53d9e63800 1 -- 172.21.15.102:0/2962015654 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f52c0036b40 msgr2=0x7f52c0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.257+0000 7f53d9e63800 1 --2- 172.21.15.102:0/2962015654 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f52c0036b40 0x7f52c0039000 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f53c0000f60 tx=0x7f53c00012b0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.257+0000 7f53d9e63800 1 -- 172.21.15.102:0/2962015654 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d004f004e0 msgr2=0x55d004ff81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.257+0000 7f53d9e63800 1 --2- 172.21.15.102:0/2962015654 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d004f004e0 0x55d004ff81b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f53c8046130 tx=0x7f53c8003330 comp rx=0 tx=0).stop 2024-09-13T19:16:16.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.257+0000 7f53d9e63800 1 -- 172.21.15.102:0/2962015654 shutdown_connections 2024-09-13T19:16:16.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.257+0000 7f53d9e63800 1 --2- 172.21.15.102:0/2962015654 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55d005001a50 0x55d005003e40 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.257+0000 7f53d9e63800 1 --2- 172.21.15.102:0/2962015654 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55d004f00e20 0x55d004fff220 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.257+0000 7f53d9e63800 1 --2- 172.21.15.102:0/2962015654 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f52c0036b40 0x7f52c0039000 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.257+0000 7f53d9e63800 1 --2- 172.21.15.102:0/2962015654 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d004f004e0 0x55d004ff81b0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.257+0000 7f53d9e63800 1 -- 172.21.15.102:0/2962015654 >> 172.21.15.102:0/2962015654 conn(0x55d004efbe10 msgr2=0x55d004fe9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:16.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.257+0000 7f53d9e63800 1 -- 172.21.15.102:0/2962015654 shutdown_connections 2024-09-13T19:16:16.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.257+0000 7f53d9e63800 1 -- 172.21.15.102:0/2962015654 wait complete. 2024-09-13T19:16:16.271 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:16:14.779675Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:16:14.779665Z', 'tags': [], 'group_ids': []} 2024-09-13T19:16:16.271 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T19:16:16.271 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T19:16:16.271 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T19:16:16.315 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:16.315 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:16.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.313+0000 7fe995d2c800 1 Processor -- start 2024-09-13T19:16:16.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.313+0000 7fe995d2c800 1 -- start start 2024-09-13T19:16:16.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.313+0000 7fe995d2c800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55be5b43e900 0x55be5b440cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.313+0000 7fe995d2c800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55be5b2fab30 con 0x55be5b43a4c0 2024-09-13T19:16:16.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.313+0000 7fe995d2c800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55be5b2dc360 con 0x55be5b43e900 2024-09-13T19:16:16.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.313+0000 7fe9912b6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55be5b43e900 0x55be5b440cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.313+0000 7fe9912b6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55be5b43e900 0x55be5b440cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54446/0 (socket says 172.21.15.102:54446) 2024-09-13T19:16:16.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.313+0000 7fe9912b6640 1 -- 172.21.15.102:0/4181342558 learned_addr learned my addr 172.21.15.102:0/4181342558 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:16.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.313+0000 7fe991ab7640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55be5b43a4c0 0x55be5b43a8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:49878/0 (socket says 172.21.15.102:49878) 2024-09-13T19:16:16.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.314+0000 7fe9912b6640 1 -- 172.21.15.102:0/4181342558 >> v1:172.21.15.53:6789/0 conn(0x55be5b43a4c0 legacy=0x55be5b43a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.314+0000 7fe9912b6640 1 -- 172.21.15.102:0/4181342558 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be5b302e00 con 0x55be5b43e900 2024-09-13T19:16:16.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.315+0000 7fe9912b6640 1 --2- 172.21.15.102:0/4181342558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be5b43e900 0x55be5b440cf0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe97c00a6b0 tx=0x7fe97c047e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de08365ee235c8b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.315+0000 7fe990ab5640 1 -- 172.21.15.102:0/4181342558 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe97c00a200 con 0x55be5b43e900 2024-09-13T19:16:16.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.315+0000 7fe990ab5640 1 -- 172.21.15.102:0/4181342558 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe97c00a3a0 con 0x55be5b43e900 2024-09-13T19:16:16.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.315+0000 7fe990ab5640 1 -- 172.21.15.102:0/4181342558 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe97c008700 con 0x55be5b43e900 2024-09-13T19:16:16.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.315+0000 7fe995d2c800 1 -- 172.21.15.102:0/4181342558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be5b43e900 msgr2=0x55be5b440cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.315+0000 7fe995d2c800 1 --2- 172.21.15.102:0/4181342558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be5b43e900 0x55be5b440cf0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe97c00a6b0 tx=0x7fe97c047e30 comp rx=0 tx=0).stop 2024-09-13T19:16:16.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.315+0000 7fe995d2c800 1 -- 172.21.15.102:0/4181342558 shutdown_connections 2024-09-13T19:16:16.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.315+0000 7fe995d2c800 1 --2- 172.21.15.102:0/4181342558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be5b43e900 0x55be5b440cf0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.315+0000 7fe995d2c800 1 -- 172.21.15.102:0/4181342558 >> 172.21.15.102:0/4181342558 conn(0x55be5b435df0 msgr2=0x55be5b438210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:16.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.315+0000 7fe995d2c800 1 -- 172.21.15.102:0/4181342558 shutdown_connections 2024-09-13T19:16:16.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.315+0000 7fe995d2c800 1 -- 172.21.15.102:0/4181342558 wait complete. 2024-09-13T19:16:16.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.330+0000 7fe995d2c800 1 Processor -- start 2024-09-13T19:16:16.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.330+0000 7fe995d2c800 1 -- start start 2024-09-13T19:16:16.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.330+0000 7fe995d2c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be5b43a4c0 0x55be5b5285e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.330+0000 7fe995d2c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55be5b387330 con 0x55be5b43a4c0 2024-09-13T19:16:16.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.330+0000 7fe991ab7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be5b43a4c0 0x55be5b5285e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.330+0000 7fe991ab7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be5b43a4c0 0x55be5b5285e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54450/0 (socket says 172.21.15.102:54450) 2024-09-13T19:16:16.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.330+0000 7fe991ab7640 1 -- 172.21.15.102:0/3603757913 learned_addr learned my addr 172.21.15.102:0/3603757913 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:16.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.330+0000 7fe991ab7640 1 -- 172.21.15.102:0/3603757913 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be5b2d4bc0 con 0x55be5b43a4c0 2024-09-13T19:16:16.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.331+0000 7fe991ab7640 1 --2- 172.21.15.102:0/3603757913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be5b43a4c0 0x55be5b5285e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe98400b230 tx=0x7fe98400b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6edc4732441ce469 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.331+0000 7fe87fe07640 1 -- 172.21.15.102:0/3603757913 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe98400e5c0 con 0x55be5b43a4c0 2024-09-13T19:16:16.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.331+0000 7fe87fe07640 1 -- 172.21.15.102:0/3603757913 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe984006070 con 0x55be5b43a4c0 2024-09-13T19:16:16.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.331+0000 7fe87fe07640 1 -- 172.21.15.102:0/3603757913 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe98400e890 con 0x55be5b43a4c0 2024-09-13T19:16:16.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.331+0000 7fe995d2c800 1 -- 172.21.15.102:0/3603757913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be5b43a4c0 msgr2=0x55be5b5285e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.331+0000 7fe995d2c800 1 --2- 172.21.15.102:0/3603757913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be5b43a4c0 0x55be5b5285e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe98400b230 tx=0x7fe98400b6f0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.331+0000 7fe995d2c800 1 -- 172.21.15.102:0/3603757913 shutdown_connections 2024-09-13T19:16:16.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.331+0000 7fe995d2c800 1 --2- 172.21.15.102:0/3603757913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be5b43a4c0 0x55be5b5285e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.331+0000 7fe995d2c800 1 -- 172.21.15.102:0/3603757913 >> 172.21.15.102:0/3603757913 conn(0x55be5b435df0 msgr2=0x55be5b523fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:16.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.332+0000 7fe995d2c800 1 -- 172.21.15.102:0/3603757913 shutdown_connections 2024-09-13T19:16:16.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.332+0000 7fe995d2c800 1 -- 172.21.15.102:0/3603757913 wait complete. 2024-09-13T19:16:16.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.332+0000 7fe995d2c800 1 Processor -- start 2024-09-13T19:16:16.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.332+0000 7fe995d2c800 1 -- start start 2024-09-13T19:16:16.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.332+0000 7fe995d2c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be5b43a4c0 0x55be5b52fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.332+0000 7fe995d2c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55be5b4414d0 con 0x55be5b43a4c0 2024-09-13T19:16:16.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.332+0000 7fe991ab7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be5b43a4c0 0x55be5b52fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.332+0000 7fe991ab7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be5b43a4c0 0x55be5b52fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54456/0 (socket says 172.21.15.102:54456) 2024-09-13T19:16:16.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.332+0000 7fe991ab7640 1 -- 172.21.15.102:0/1355460956 learned_addr learned my addr 172.21.15.102:0/1355460956 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:16.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.332+0000 7fe991ab7640 1 -- 172.21.15.102:0/1355460956 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be5b2e8fe0 con 0x55be5b43a4c0 2024-09-13T19:16:16.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.333+0000 7fe991ab7640 1 --2- 172.21.15.102:0/1355460956 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be5b43a4c0 0x55be5b52fff0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe984000c00 tx=0x7fe984000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.333+0000 7fe87e604640 1 -- 172.21.15.102:0/1355460956 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe98400f8d0 con 0x55be5b43a4c0 2024-09-13T19:16:16.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.333+0000 7fe87e604640 1 -- 172.21.15.102:0/1355460956 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe98400fa90 con 0x55be5b43a4c0 2024-09-13T19:16:16.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.333+0000 7fe995d2c800 1 -- 172.21.15.102:0/1355460956 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55be5b530530 con 0x55be5b43a4c0 2024-09-13T19:16:16.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.333+0000 7fe87e604640 1 -- 172.21.15.102:0/1355460956 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe98400fdb0 con 0x55be5b43a4c0 2024-09-13T19:16:16.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.333+0000 7fe995d2c800 1 -- 172.21.15.102:0/1355460956 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be5b530a50 con 0x55be5b43a4c0 2024-09-13T19:16:16.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.334+0000 7fe87e604640 1 -- 172.21.15.102:0/1355460956 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe984017070 con 0x55be5b43a4c0 2024-09-13T19:16:16.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.334+0000 7fe87e604640 1 --2- 172.21.15.102:0/1355460956 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe878036b40 0x7fe878039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.334+0000 7fe87e604640 1 -- 172.21.15.102:0/1355460956 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fe984015020 con 0x55be5b43a4c0 2024-09-13T19:16:16.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.334+0000 7fe9912b6640 1 --2- 172.21.15.102:0/1355460956 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe878036b40 0x7fe878039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.334+0000 7fe995d2c800 1 --2- 172.21.15.102:0/1355460956 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55be5b43e900 0x55be5b537060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.334+0000 7fe995d2c800 1 -- 172.21.15.102:0/1355460956 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55be5b5375e0 con 0x55be5b43e900 2024-09-13T19:16:16.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.334+0000 7fe9922b8640 1 --2- 172.21.15.102:0/1355460956 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55be5b43e900 0x55be5b537060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.334+0000 7fe9912b6640 1 --2- 172.21.15.102:0/1355460956 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe878036b40 0x7fe878039000 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe97c058000 tx=0x7fe97c053000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.334+0000 7fe9922b8640 1 --2- 172.21.15.102:0/1355460956 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55be5b43e900 0x55be5b537060 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.335+0000 7fe9922b8640 1 -- 172.21.15.102:0/1355460956 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe98c00a4a0 con 0x55be5b43e900 2024-09-13T19:16:16.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.335+0000 7fe995d2c800 1 -- 172.21.15.102:0/1355460956 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55be5b534630 con 0x55be5b43e900 2024-09-13T19:16:16.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.335+0000 7fe9922b8640 1 -- 172.21.15.102:0/1355460956 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe98c00a4a0 con 0x55be5b43e900 2024-09-13T19:16:16.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.335+0000 7fe995d2c800 1 --2- 172.21.15.102:0/1355460956 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55be5b539930 0x55be5b53bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.335+0000 7fe995d2c800 1 -- 172.21.15.102:0/1355460956 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55be5b53c410 con 0x55be5b539930 2024-09-13T19:16:16.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.335+0000 7fe991ab7640 1 --2- 172.21.15.102:0/1355460956 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55be5b539930 0x55be5b53bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.335+0000 7fe991ab7640 1 --2- 172.21.15.102:0/1355460956 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55be5b539930 0x55be5b53bd20 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.336+0000 7fe991ab7640 1 -- 172.21.15.102:0/1355460956 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe98402e070 con 0x55be5b539930 2024-09-13T19:16:16.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.336+0000 7fe995d2c800 1 -- 172.21.15.102:0/1355460956 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55be5b5387a0 con 0x55be5b43e900 2024-09-13T19:16:16.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.336+0000 7fe9922b8640 1 -- 172.21.15.102:0/1355460956 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe98c00a4a0 con 0x55be5b43e900 2024-09-13T19:16:16.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.336+0000 7fe995d2c800 1 -- 172.21.15.102:0/1355460956 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55be5b538c80 con 0x55be5b539930 2024-09-13T19:16:16.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.336+0000 7fe991ab7640 1 -- 172.21.15.102:0/1355460956 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe98402e070 con 0x55be5b539930 2024-09-13T19:16:16.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.337+0000 7fe995d2c800 1 Processor -- start 2024-09-13T19:16:16.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.337+0000 7fe995d2c800 1 -- start start 2024-09-13T19:16:16.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.337+0000 7fe995d2c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be5b54ad90 0x55be5b54b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.337+0000 7fe995d2c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55be5b2d6580 con 0x55be5b54ad90 2024-09-13T19:16:16.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.337+0000 7fe9922b8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be5b54ad90 0x55be5b54b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.337+0000 7fe9922b8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be5b54ad90 0x55be5b54b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54462/0 (socket says 172.21.15.102:54462) 2024-09-13T19:16:16.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.337+0000 7fe9922b8640 1 -- 172.21.15.102:0/2296753550 learned_addr learned my addr 172.21.15.102:0/2296753550 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:16.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.338+0000 7fe9922b8640 1 -- 172.21.15.102:0/2296753550 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be5b54b6f0 con 0x55be5b54ad90 2024-09-13T19:16:16.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.338+0000 7fe9922b8640 1 --2- 172.21.15.102:0/2296753550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be5b54ad90 0x55be5b54b1b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x55be5b5313f0 tx=0x7fe98c0163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.338+0000 7fe8777fe640 1 -- 172.21.15.102:0/2296753550 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe98c013450 con 0x55be5b54ad90 2024-09-13T19:16:16.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.338+0000 7fe8777fe640 1 -- 172.21.15.102:0/2296753550 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe98c0135f0 con 0x55be5b54ad90 2024-09-13T19:16:16.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.338+0000 7fe995d2c800 1 -- 172.21.15.102:0/2296753550 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55be5b54b980 con 0x55be5b54ad90 2024-09-13T19:16:16.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.338+0000 7fe8777fe640 1 -- 172.21.15.102:0/2296753550 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe98c013910 con 0x55be5b54ad90 2024-09-13T19:16:16.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.338+0000 7fe995d2c800 1 -- 172.21.15.102:0/2296753550 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be5b54e660 con 0x55be5b54ad90 2024-09-13T19:16:16.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.339+0000 7fe8777fe640 1 -- 172.21.15.102:0/2296753550 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe98c011040 con 0x55be5b54ad90 2024-09-13T19:16:16.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.339+0000 7fe8777fe640 1 --2- 172.21.15.102:0/2296753550 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe86c036c00 0x7fe86c0390c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.339+0000 7fe8777fe640 1 -- 172.21.15.102:0/2296753550 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fe98c00e040 con 0x55be5b54ad90 2024-09-13T19:16:16.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.339+0000 7fe991ab7640 1 --2- 172.21.15.102:0/2296753550 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe86c036c00 0x7fe86c0390c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.339+0000 7fe995d2c800 1 Processor -- start 2024-09-13T19:16:16.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.340+0000 7fe991ab7640 1 --2- 172.21.15.102:0/2296753550 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe86c036c00 0x7fe86c0390c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x55be5b537ee0 tx=0x7fe98404b740 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.340+0000 7fe995d2c800 1 -- start start 2024-09-13T19:16:16.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.340+0000 7fe995d2c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be5b557ab0 0x55be5b557eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.340+0000 7fe995d2c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55be5b528d90 con 0x55be5b557ab0 2024-09-13T19:16:16.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.340+0000 7fe9922b8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be5b557ab0 0x55be5b557eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.340+0000 7fe9922b8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be5b557ab0 0x55be5b557eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54466/0 (socket says 172.21.15.102:54466) 2024-09-13T19:16:16.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.340+0000 7fe9922b8640 1 -- 172.21.15.102:0/1324362679 learned_addr learned my addr 172.21.15.102:0/1324362679 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:16.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.340+0000 7fe9922b8640 1 -- 172.21.15.102:0/1324362679 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be5b558480 con 0x55be5b557ab0 2024-09-13T19:16:16.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.340+0000 7fe9922b8640 1 --2- 172.21.15.102:0/1324362679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be5b557ab0 0x55be5b557eb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe98c04cde0 tx=0x7fe98c01fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71b79e4a55159ded server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.340+0000 7fe8757fa640 1 -- 172.21.15.102:0/1324362679 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe98c046250 con 0x55be5b557ab0 2024-09-13T19:16:16.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.340+0000 7fe8757fa640 1 -- 172.21.15.102:0/1324362679 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe98c02a440 con 0x55be5b557ab0 2024-09-13T19:16:16.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.340+0000 7fe8757fa640 1 -- 172.21.15.102:0/1324362679 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe98c01f390 con 0x55be5b557ab0 2024-09-13T19:16:16.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.341+0000 7fe995d2c800 1 -- 172.21.15.102:0/1324362679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be5b557ab0 msgr2=0x55be5b557eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.341+0000 7fe995d2c800 1 --2- 172.21.15.102:0/1324362679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be5b557ab0 0x55be5b557eb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe98c04cde0 tx=0x7fe98c01fd40 comp rx=0 tx=0).stop 2024-09-13T19:16:16.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.341+0000 7fe995d2c800 1 -- 172.21.15.102:0/1324362679 shutdown_connections 2024-09-13T19:16:16.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.341+0000 7fe995d2c800 1 --2- 172.21.15.102:0/1324362679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be5b557ab0 0x55be5b557eb0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.341+0000 7fe995d2c800 1 -- 172.21.15.102:0/1324362679 >> 172.21.15.102:0/1324362679 conn(0x55be5b553e60 msgr2=0x55be5b551f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:16.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.341+0000 7fe995d2c800 1 -- 172.21.15.102:0/1324362679 shutdown_connections 2024-09-13T19:16:16.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.341+0000 7fe995d2c800 1 -- 172.21.15.102:0/1324362679 wait complete. 2024-09-13T19:16:16.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.341+0000 7fe995d2c800 1 Processor -- start 2024-09-13T19:16:16.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.341+0000 7fe995d2c800 1 -- start start 2024-09-13T19:16:16.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.341+0000 7fe995d2c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be5b557ab0 0x55be5b55ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.341+0000 7fe995d2c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55be5b558a50 con 0x55be5b557ab0 2024-09-13T19:16:16.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.342+0000 7fe9922b8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be5b557ab0 0x55be5b55ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.342+0000 7fe9922b8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be5b557ab0 0x55be5b55ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54482/0 (socket says 172.21.15.102:54482) 2024-09-13T19:16:16.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.342+0000 7fe9922b8640 1 -- 172.21.15.102:0/2928884514 learned_addr learned my addr 172.21.15.102:0/2928884514 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:16.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.342+0000 7fe9922b8640 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be5b55f4c0 con 0x55be5b557ab0 2024-09-13T19:16:16.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.342+0000 7fe9922b8640 1 --2- 172.21.15.102:0/2928884514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be5b557ab0 0x55be5b55ef80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe98c02ac70 tx=0x7fe98c04cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.342+0000 7fe8637fe640 1 -- 172.21.15.102:0/2928884514 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe98c03a020 con 0x55be5b557ab0 2024-09-13T19:16:16.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.342+0000 7fe8637fe640 1 -- 172.21.15.102:0/2928884514 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe98c04e480 con 0x55be5b557ab0 2024-09-13T19:16:16.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.342+0000 7fe995d2c800 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55be5b55f750 con 0x55be5b557ab0 2024-09-13T19:16:16.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.342+0000 7fe8637fe640 1 -- 172.21.15.102:0/2928884514 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe98c04e7a0 con 0x55be5b557ab0 2024-09-13T19:16:16.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.342+0000 7fe995d2c800 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be5b562400 con 0x55be5b557ab0 2024-09-13T19:16:16.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.343+0000 7fe8637fe640 1 -- 172.21.15.102:0/2928884514 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe98c03d020 con 0x55be5b557ab0 2024-09-13T19:16:16.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.343+0000 7fe8637fe640 1 --2- 172.21.15.102:0/2928884514 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe85c036b90 0x7fe85c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.343+0000 7fe8637fe640 1 -- 172.21.15.102:0/2928884514 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fe98c002380 con 0x55be5b557ab0 2024-09-13T19:16:16.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.343+0000 7fe991ab7640 1 --2- 172.21.15.102:0/2928884514 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe85c036b90 0x7fe85c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.343+0000 7fe995d2c800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.343+0000 7fe995d2c800 1 --2- 172.21.15.102:0/2928884514 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55be5b56a9d0 0x55be5b56ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.343+0000 7fe995d2c800 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55be5b56d5e0 con 0x55be5b56a9d0 2024-09-13T19:16:16.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.344+0000 7fe991ab7640 1 --2- 172.21.15.102:0/2928884514 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe85c036b90 0x7fe85c039050 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe9840197f0 tx=0x7fe98404d2d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.344+0000 7fe9912b6640 1 --2- 172.21.15.102:0/2928884514 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55be5b56a9d0 0x55be5b56ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.344+0000 7fe9912b6640 1 --2- 172.21.15.102:0/2928884514 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55be5b56a9d0 0x55be5b56ce90 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.344+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe97c0087b0 con 0x55be5b56a9d0 2024-09-13T19:16:16.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.344+0000 7fe995d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:16.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.344+0000 7fe995d2c800 20 realm 2024-09-13T19:16:16.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.344+0000 7fe995d2c800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.344+0000 7fe995d2c800 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55be5b56da10 con 0x55be5b56a9d0 2024-09-13T19:16:16.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.344+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe97c0087b0 con 0x55be5b56a9d0 2024-09-13T19:16:16.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.344+0000 7fe995d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:16.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.344+0000 7fe995d2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:16.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.344+0000 7fe995d2c800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.344+0000 7fe995d2c800 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55be5b56e2e0 con 0x55be5b56a9d0 2024-09-13T19:16:16.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.345+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe97c0087b0 con 0x55be5b56a9d0 2024-09-13T19:16:16.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.345+0000 7fe995d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:16.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.345+0000 7fe995d2c800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.345+0000 7fe995d2c800 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55be5b56e680 con 0x55be5b56a9d0 2024-09-13T19:16:16.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.345+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe97c0087b0 con 0x55be5b56a9d0 2024-09-13T19:16:16.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.345+0000 7fe995d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:16.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.345+0000 7fe995d2c800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.345+0000 7fe995d2c800 1 --2- 172.21.15.102:0/2928884514 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55be5b56f3e0 0x55be5b5717d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.345+0000 7fe995d2c800 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55be5b571d10 con 0x55be5b56f3e0 2024-09-13T19:16:16.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.345+0000 7fe9922b8640 1 --2- 172.21.15.102:0/2928884514 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55be5b56f3e0 0x55be5b5717d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.345+0000 7fe9922b8640 1 --2- 172.21.15.102:0/2928884514 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55be5b56f3e0 0x55be5b5717d0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.346+0000 7fe9922b8640 1 -- 172.21.15.102:0/2928884514 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe98c032040 con 0x55be5b56f3e0 2024-09-13T19:16:16.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.346+0000 7fe995d2c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:16.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.346+0000 7fe995d2c800 20 searching for the correct realm 2024-09-13T19:16:16.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.346+0000 7fe995d2c800 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55be5b573680 con 0x55be5b56f3e0 2024-09-13T19:16:16.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.346+0000 7fe9922b8640 1 -- 172.21.15.102:0/2928884514 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe98c032040 con 0x55be5b56f3e0 2024-09-13T19:16:16.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.346+0000 7fe9922b8640 1 --2- 172.21.15.102:0/2928884514 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fe98c058040 0x7fe98c036460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.346+0000 7fe9922b8640 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55be5b573680 con 0x7fe98c058040 2024-09-13T19:16:16.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.346+0000 7fe991ab7640 1 --2- 172.21.15.102:0/2928884514 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fe98c058040 0x7fe98c036460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.346+0000 7fe991ab7640 1 --2- 172.21.15.102:0/2928884514 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fe98c058040 0x7fe98c036460 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.347+0000 7fe991ab7640 1 -- 172.21.15.102:0/2928884514 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe98402e070 con 0x7fe98c058040 2024-09-13T19:16:16.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.347+0000 7fe991ab7640 1 --2- 172.21.15.102:0/2928884514 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fe98403e040 0x7fe98403f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.347+0000 7fe991ab7640 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55be5b573680 con 0x7fe98403e040 2024-09-13T19:16:16.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.347+0000 7fe9912b6640 1 --2- 172.21.15.102:0/2928884514 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fe98403e040 0x7fe98403f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.347+0000 7fe9912b6640 1 --2- 172.21.15.102:0/2928884514 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fe98403e040 0x7fe98403f430 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.347+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97c0087b0 con 0x7fe98403e040 2024-09-13T19:16:16.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.347+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55be5b573680 con 0x55be5b56a9d0 2024-09-13T19:16:16.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.348+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97c0087b0 con 0x55be5b56a9d0 2024-09-13T19:16:16.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.348+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55be5b573680 con 0x55be5b56a9d0 2024-09-13T19:16:16.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.348+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97c0087b0 con 0x55be5b56a9d0 2024-09-13T19:16:16.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.348+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55be5b573680 con 0x7fe98403e040 2024-09-13T19:16:16.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.348+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97c0087b0 con 0x7fe98403e040 2024-09-13T19:16:16.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.348+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55be5b573680 con 0x7fe98403e040 2024-09-13T19:16:16.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.348+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97c0087b0 con 0x7fe98403e040 2024-09-13T19:16:16.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.348+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55be5b573680 con 0x7fe98c058040 2024-09-13T19:16:16.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.349+0000 7fe991ab7640 1 -- 172.21.15.102:0/2928884514 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe98402e070 con 0x7fe98c058040 2024-09-13T19:16:16.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.349+0000 7fe991ab7640 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55be5b573680 con 0x55be5b56f3e0 2024-09-13T19:16:16.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.349+0000 7fe9922b8640 1 -- 172.21.15.102:0/2928884514 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe98c032040 con 0x55be5b56f3e0 2024-09-13T19:16:16.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.349+0000 7fe9922b8640 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55be5b573680 con 0x55be5b56a9d0 2024-09-13T19:16:16.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.349+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97c0087b0 con 0x55be5b56a9d0 2024-09-13T19:16:16.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.349+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55be5b573680 con 0x7fe98403e040 2024-09-13T19:16:16.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.349+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97c0087b0 con 0x7fe98403e040 2024-09-13T19:16:16.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.349+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55be5b573680 con 0x55be5b56a9d0 2024-09-13T19:16:16.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.350+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97c0087b0 con 0x55be5b56a9d0 2024-09-13T19:16:16.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.350+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55be5b573680 con 0x7fe98c058040 2024-09-13T19:16:16.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.350+0000 7fe991ab7640 1 -- 172.21.15.102:0/2928884514 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe98402e070 con 0x7fe98c058040 2024-09-13T19:16:16.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.350+0000 7fe991ab7640 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55be5b573680 con 0x55be5b56f3e0 2024-09-13T19:16:16.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.350+0000 7fe9922b8640 1 -- 172.21.15.102:0/2928884514 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe98c032040 con 0x55be5b56f3e0 2024-09-13T19:16:16.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.350+0000 7fe9922b8640 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55be5b573680 con 0x55be5b56f3e0 2024-09-13T19:16:16.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.350+0000 7fe9922b8640 1 -- 172.21.15.102:0/2928884514 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe98c032040 con 0x55be5b56f3e0 2024-09-13T19:16:16.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.350+0000 7fe9922b8640 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55be5b573680 con 0x7fe98403e040 2024-09-13T19:16:16.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.351+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97c0087b0 con 0x7fe98403e040 2024-09-13T19:16:16.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.351+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55be5b573680 con 0x55be5b56f3e0 2024-09-13T19:16:16.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.351+0000 7fe9922b8640 1 -- 172.21.15.102:0/2928884514 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe98c032040 con 0x55be5b56f3e0 2024-09-13T19:16:16.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.351+0000 7fe9922b8640 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55be5b573680 con 0x55be5b56f3e0 2024-09-13T19:16:16.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.351+0000 7fe9922b8640 1 -- 172.21.15.102:0/2928884514 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe98c032040 con 0x55be5b56f3e0 2024-09-13T19:16:16.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.351+0000 7fe9922b8640 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55be5b573680 con 0x55be5b56a9d0 2024-09-13T19:16:16.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.351+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97c0087b0 con 0x55be5b56a9d0 2024-09-13T19:16:16.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.351+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55be5b573680 con 0x55be5b56a9d0 2024-09-13T19:16:16.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.351+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe97c0087b0 con 0x55be5b56a9d0 2024-09-13T19:16:16.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.351+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55be5b573680 con 0x7fe98403e040 2024-09-13T19:16:16.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.352+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97c0087b0 con 0x7fe98403e040 2024-09-13T19:16:16.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.352+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55be5b573680 con 0x55be5b56f3e0 2024-09-13T19:16:16.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.352+0000 7fe9922b8640 1 -- 172.21.15.102:0/2928884514 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe98c032040 con 0x55be5b56f3e0 2024-09-13T19:16:16.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.352+0000 7fe9922b8640 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55be5b573680 con 0x7fe98c058040 2024-09-13T19:16:16.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.352+0000 7fe991ab7640 1 -- 172.21.15.102:0/2928884514 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe98402e070 con 0x7fe98c058040 2024-09-13T19:16:16.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.352+0000 7fe991ab7640 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55be5b573680 con 0x55be5b56a9d0 2024-09-13T19:16:16.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.352+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97c0087b0 con 0x55be5b56a9d0 2024-09-13T19:16:16.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.352+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55be5b573680 con 0x7fe98403e040 2024-09-13T19:16:16.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.353+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97c0087b0 con 0x7fe98403e040 2024-09-13T19:16:16.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.353+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55be5b573680 con 0x55be5b56f3e0 2024-09-13T19:16:16.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.353+0000 7fe9922b8640 1 -- 172.21.15.102:0/2928884514 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe98c032040 con 0x55be5b56f3e0 2024-09-13T19:16:16.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.353+0000 7fe9922b8640 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55be5b573680 con 0x7fe98403e040 2024-09-13T19:16:16.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.353+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97c0087b0 con 0x7fe98403e040 2024-09-13T19:16:16.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.353+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55be5b573680 con 0x7fe98c058040 2024-09-13T19:16:16.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.353+0000 7fe991ab7640 1 -- 172.21.15.102:0/2928884514 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe98402e070 con 0x7fe98c058040 2024-09-13T19:16:16.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.353+0000 7fe991ab7640 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55be5b573680 con 0x55be5b56f3e0 2024-09-13T19:16:16.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.354+0000 7fe9922b8640 1 -- 172.21.15.102:0/2928884514 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe98c032040 con 0x55be5b56f3e0 2024-09-13T19:16:16.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.354+0000 7fe9922b8640 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55be5b573680 con 0x7fe98403e040 2024-09-13T19:16:16.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.354+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97c0087b0 con 0x7fe98403e040 2024-09-13T19:16:16.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.354+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55be5b573680 con 0x55be5b56a9d0 2024-09-13T19:16:16.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.354+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe97c0087b0 con 0x55be5b56a9d0 2024-09-13T19:16:16.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.354+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55be5b573680 con 0x7fe98c058040 2024-09-13T19:16:16.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.354+0000 7fe991ab7640 1 -- 172.21.15.102:0/2928884514 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe984065040 con 0x7fe98c058040 2024-09-13T19:16:16.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.355+0000 7fe995d2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:16.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.355+0000 7fe995d2c800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:16.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.355+0000 7fe995d2c800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:16.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.355+0000 7fe995d2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:16.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.355+0000 7fe995d2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:16.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.355+0000 7fe995d2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:16.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.355+0000 7fe995d2c800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.355+0000 7fe995d2c800 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55be5b572750 con 0x55be5b56a9d0 2024-09-13T19:16:16.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.355+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe97c0087b0 con 0x55be5b56a9d0 2024-09-13T19:16:16.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.355+0000 7fe995d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:16.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.355+0000 7fe995d2c800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.355+0000 7fe995d2c800 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55be5b572ff0 con 0x55be5b56a9d0 2024-09-13T19:16:16.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.355+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe97c0087b0 con 0x55be5b56a9d0 2024-09-13T19:16:16.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.355+0000 7fe995d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:16.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.355+0000 7fe995d2c800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.355+0000 7fe995d2c800 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55be5b572390 con 0x55be5b56f3e0 2024-09-13T19:16:16.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.355+0000 7fe9922b8640 1 -- 172.21.15.102:0/2928884514 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe98c032040 con 0x55be5b56f3e0 2024-09-13T19:16:16.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.355+0000 7fe995d2c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:16.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.355+0000 7fe995d2c800 20 zone default found 2024-09-13T19:16:16.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.355+0000 7fe995d2c800 4 Realm: () 2024-09-13T19:16:16.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.355+0000 7fe995d2c800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:16.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.355+0000 7fe995d2c800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:16.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.355+0000 7fe995d2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:16.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.355+0000 7fe995d2c800 20 zonegroup default 2024-09-13T19:16:16.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.355+0000 7fe995d2c800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.355+0000 7fe995d2c800 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55be5b574000 con 0x7fe98403e040 2024-09-13T19:16:16.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.356+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe97c0087b0 con 0x7fe98403e040 2024-09-13T19:16:16.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.356+0000 7fe995d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:16.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.356+0000 7fe995d2c800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.356+0000 7fe995d2c800 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55be5b573c10 con 0x55be5b56f3e0 2024-09-13T19:16:16.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.356+0000 7fe9922b8640 1 -- 172.21.15.102:0/2928884514 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe98c032040 con 0x55be5b56f3e0 2024-09-13T19:16:16.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.356+0000 7fe995d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:16.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.356+0000 7fe995d2c800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.356+0000 7fe995d2c800 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55be5b5762b0 con 0x55be5b56f3e0 2024-09-13T19:16:16.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.356+0000 7fe9922b8640 1 -- 172.21.15.102:0/2928884514 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe98c032040 con 0x55be5b56f3e0 2024-09-13T19:16:16.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.356+0000 7fe995d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:16.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.356+0000 7fe995d2c800 20 started sync module instance, tier type = 2024-09-13T19:16:16.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.356+0000 7fe995d2c800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:16.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.356+0000 7fe995d2c800 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55be5b5756c0 con 0x7fe98c058040 2024-09-13T19:16:16.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.357+0000 7fe991ab7640 1 -- 172.21.15.102:0/2928884514 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(44 notify.0 [create] v34'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe984065040 con 0x7fe98c058040 2024-09-13T19:16:16.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.357+0000 7fe995d2c800 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94276064598704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55be5b576bc0 con 0x7fe98c058040 2024-09-13T19:16:16.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.357+0000 7fe995d2c800 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55be5b577410 con 0x55be5b56a9d0 2024-09-13T19:16:16.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.358+0000 7fe991ab7640 1 -- 172.21.15.102:0/2928884514 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94276064598704] v34'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe984065040 con 0x7fe98c058040 2024-09-13T19:16:16.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.358+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v34'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97c0087b0 con 0x55be5b56a9d0 2024-09-13T19:16:16.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.358+0000 7fe995d2c800 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94276064604000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55be5b577830 con 0x55be5b56a9d0 2024-09-13T19:16:16.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.358+0000 7fe995d2c800 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55be5b578080 con 0x55be5b56f3e0 2024-09-13T19:16:16.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.359+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94276064604000] v34'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97c0087b0 con 0x55be5b56a9d0 2024-09-13T19:16:16.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.360+0000 7fe9922b8640 1 -- 172.21.15.102:0/2928884514 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v34'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe98c032040 con 0x55be5b56f3e0 2024-09-13T19:16:16.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.360+0000 7fe995d2c800 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94276064605536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55be5b577fb0 con 0x55be5b56f3e0 2024-09-13T19:16:16.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.360+0000 7fe995d2c800 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55be5b578a70 con 0x7fe98c058040 2024-09-13T19:16:16.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.361+0000 7fe9922b8640 1 -- 172.21.15.102:0/2928884514 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94276064605536] v34'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe98c032040 con 0x55be5b56f3e0 2024-09-13T19:16:16.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.361+0000 7fe991ab7640 1 -- 172.21.15.102:0/2928884514 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(50 notify.3 [create] v34'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe984065040 con 0x7fe98c058040 2024-09-13T19:16:16.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.361+0000 7fe995d2c800 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94276064609600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55be5b578e60 con 0x7fe98c058040 2024-09-13T19:16:16.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.361+0000 7fe995d2c800 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55be5b5798a0 con 0x55be5b56a9d0 2024-09-13T19:16:16.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.362+0000 7fe991ab7640 1 -- 172.21.15.102:0/2928884514 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94276064609600] v34'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe984065040 con 0x7fe98c058040 2024-09-13T19:16:16.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.362+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v34'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97c0087b0 con 0x55be5b56a9d0 2024-09-13T19:16:16.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.362+0000 7fe995d2c800 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94276064613232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55be5b579c90 con 0x55be5b56a9d0 2024-09-13T19:16:16.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.362+0000 7fe995d2c800 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55be5b57a6d0 con 0x7fe98403e040 2024-09-13T19:16:16.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.363+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(54 notify.5 [create] v34'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97c0087b0 con 0x7fe98403e040 2024-09-13T19:16:16.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.363+0000 7fe995d2c800 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94276064616864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55be5b57a690 con 0x7fe98403e040 2024-09-13T19:16:16.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.363+0000 7fe995d2c800 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55be5b57a690 con 0x7fe98403e040 2024-09-13T19:16:16.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.363+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94276064613232] v34'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97c0087b0 con 0x55be5b56a9d0 2024-09-13T19:16:16.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.364+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94276064616864] v34'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97c0087b0 con 0x7fe98403e040 2024-09-13T19:16:16.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.364+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(56 notify.6 [create] v34'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97c0087b0 con 0x7fe98403e040 2024-09-13T19:16:16.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.364+0000 7fe995d2c800 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94276064606720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55be5b57b190 con 0x7fe98403e040 2024-09-13T19:16:16.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.364+0000 7fe995d2c800 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55be5b57bb50 con 0x7fe98403e040 2024-09-13T19:16:16.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.365+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94276064606720] v34'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97c0087b0 con 0x7fe98403e040 2024-09-13T19:16:16.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.365+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(58 notify.7 [create] v34'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97c0087b0 con 0x7fe98403e040 2024-09-13T19:16:16.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.365+0000 7fe995d2c800 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94276064619120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55be5b57bb50 con 0x7fe98403e040 2024-09-13T19:16:16.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.365+0000 7fe995d2c800 20 add_watcher() i=0 2024-09-13T19:16:16.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.365+0000 7fe995d2c800 20 add_watcher() i=1 2024-09-13T19:16:16.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.365+0000 7fe995d2c800 20 add_watcher() i=2 2024-09-13T19:16:16.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.365+0000 7fe995d2c800 20 add_watcher() i=3 2024-09-13T19:16:16.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.365+0000 7fe995d2c800 20 add_watcher() i=4 2024-09-13T19:16:16.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.365+0000 7fe995d2c800 20 add_watcher() i=5 2024-09-13T19:16:16.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.365+0000 7fe995d2c800 20 add_watcher() i=6 2024-09-13T19:16:16.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.366+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94276064619120] v34'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97c0087b0 con 0x7fe98403e040 2024-09-13T19:16:16.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.366+0000 7fe995d2c800 20 add_watcher() i=7 2024-09-13T19:16:16.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.366+0000 7fe995d2c800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:16.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.366+0000 7fe995d2c800 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55be5b57ee60 con 0x55be5b56a9d0 2024-09-13T19:16:16.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.366+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe97c0087b0 con 0x55be5b56a9d0 2024-09-13T19:16:16.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.366+0000 7fe995d2c800 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94276064622608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55be5b57c0e0 con 0x55be5b56a9d0 2024-09-13T19:16:16.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.367+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94276064622608] v34'74 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe97c0087b0 con 0x55be5b56a9d0 2024-09-13T19:16:16.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.367+0000 7fe8437fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:16.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.367+0000 7fe995d2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:16.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.367+0000 7fe995d2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:16.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.367+0000 7fe995d2c800 5 note: GC not initialized 2024-09-13T19:16:16.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.367+0000 7fe8427fc640 20 reqs_thread_entry: start 2024-09-13T19:16:16.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.368+0000 7fe995d2c800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:16.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.368+0000 7fe995d2c800 20 Filter name: none 2024-09-13T19:16:16.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.368+0000 7fe7b3fff640 20 reqs_thread_entry: start 2024-09-13T19:16:16.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.368+0000 7fe995d2c800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.368+0000 7fe995d2c800 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55be5b5b1ea0 con 0x55be5b56a9d0 2024-09-13T19:16:16.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.368+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fe97c0087b0 con 0x55be5b56a9d0 2024-09-13T19:16:16.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.368+0000 7fe995d2c800 20 rados_obj.operate() r=0 bl.length=556 2024-09-13T19:16:16.381 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:16:14.779675Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:16:14.779665Z","tags":[],"group_ids":[]} 2024-09-13T19:16:16.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.369+0000 7fe8437fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:16.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.369+0000 7fe995d2c800 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94276064622608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55be5b5b0930 con 0x55be5b56a9d0 2024-09-13T19:16:16.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.370+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94276064622608] v34'75 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe97c0087b0 con 0x55be5b56a9d0 2024-09-13T19:16:16.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.370+0000 7fe995d2c800 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94276064598704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55be5b57b810 con 0x7fe98c058040 2024-09-13T19:16:16.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.371+0000 7fe991ab7640 1 -- 172.21.15.102:0/2928884514 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94276064598704] v34'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe984065040 con 0x7fe98c058040 2024-09-13T19:16:16.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.371+0000 7fe995d2c800 20 remove_watcher() i=0 2024-09-13T19:16:16.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.371+0000 7fe995d2c800 2 removed watcher, disabling cache 2024-09-13T19:16:16.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.371+0000 7fe995d2c800 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94276064604000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55be5b57b810 con 0x55be5b56a9d0 2024-09-13T19:16:16.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.372+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94276064604000] v34'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97c0087b0 con 0x55be5b56a9d0 2024-09-13T19:16:16.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.373+0000 7fe995d2c800 20 remove_watcher() i=1 2024-09-13T19:16:16.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.373+0000 7fe995d2c800 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94276064605536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55be5b576f60 con 0x55be5b56f3e0 2024-09-13T19:16:16.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.374+0000 7fe9922b8640 1 -- 172.21.15.102:0/2928884514 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94276064605536] v34'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe98c032040 con 0x55be5b56f3e0 2024-09-13T19:16:16.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.374+0000 7fe995d2c800 20 remove_watcher() i=2 2024-09-13T19:16:16.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.374+0000 7fe995d2c800 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94276064609600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55be5b57b810 con 0x7fe98c058040 2024-09-13T19:16:16.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.374+0000 7fe991ab7640 1 -- 172.21.15.102:0/2928884514 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94276064609600] v34'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe984065040 con 0x7fe98c058040 2024-09-13T19:16:16.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.375+0000 7fe995d2c800 20 remove_watcher() i=3 2024-09-13T19:16:16.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.375+0000 7fe995d2c800 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94276064613232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55be5b576f60 con 0x55be5b56a9d0 2024-09-13T19:16:16.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.376+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94276064613232] v34'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97c0087b0 con 0x55be5b56a9d0 2024-09-13T19:16:16.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.376+0000 7fe995d2c800 20 remove_watcher() i=4 2024-09-13T19:16:16.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.376+0000 7fe995d2c800 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94276064616864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55be5b578540 con 0x7fe98403e040 2024-09-13T19:16:16.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.377+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94276064616864] v34'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97c0087b0 con 0x7fe98403e040 2024-09-13T19:16:16.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.377+0000 7fe995d2c800 20 remove_watcher() i=5 2024-09-13T19:16:16.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.377+0000 7fe995d2c800 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94276064606720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55be5b57b810 con 0x7fe98403e040 2024-09-13T19:16:16.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.378+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94276064606720] v34'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97c0087b0 con 0x7fe98403e040 2024-09-13T19:16:16.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.378+0000 7fe995d2c800 20 remove_watcher() i=6 2024-09-13T19:16:16.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.378+0000 7fe995d2c800 1 -- 172.21.15.102:0/2928884514 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94276064619120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55be5b576f60 con 0x7fe98403e040 2024-09-13T19:16:16.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.379+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94276064619120] v34'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97c0087b0 con 0x7fe98403e040 2024-09-13T19:16:16.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.379+0000 7fe995d2c800 20 remove_watcher() i=7 2024-09-13T19:16:16.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.379+0000 7fe995d2c800 1 -- 172.21.15.102:0/2928884514 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fe98403e040 msgr2=0x7fe98403f430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.379+0000 7fe995d2c800 1 --2- 172.21.15.102:0/2928884514 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fe98403e040 0x7fe98403f430 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.379+0000 7fe995d2c800 1 -- 172.21.15.102:0/2928884514 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55be5b56a9d0 msgr2=0x55be5b56ce90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.379+0000 7fe995d2c800 1 --2- 172.21.15.102:0/2928884514 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55be5b56a9d0 0x55be5b56ce90 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.379+0000 7fe995d2c800 1 -- 172.21.15.102:0/2928884514 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fe98c058040 msgr2=0x7fe98c036460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.379+0000 7fe995d2c800 1 --2- 172.21.15.102:0/2928884514 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fe98c058040 0x7fe98c036460 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.379+0000 7fe995d2c800 1 -- 172.21.15.102:0/2928884514 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55be5b56f3e0 msgr2=0x55be5b5717d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.379+0000 7fe995d2c800 1 --2- 172.21.15.102:0/2928884514 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55be5b56f3e0 0x55be5b5717d0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.379+0000 7fe995d2c800 1 -- 172.21.15.102:0/2928884514 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe85c036b90 msgr2=0x7fe85c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.379+0000 7fe995d2c800 1 --2- 172.21.15.102:0/2928884514 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe85c036b90 0x7fe85c039050 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe9840197f0 tx=0x7fe98404d2d0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.379+0000 7fe995d2c800 1 -- 172.21.15.102:0/2928884514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be5b557ab0 msgr2=0x55be5b55ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.379+0000 7fe995d2c800 1 --2- 172.21.15.102:0/2928884514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be5b557ab0 0x55be5b55ef80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe98c02ac70 tx=0x7fe98c04cd70 comp rx=0 tx=0).stop 2024-09-13T19:16:16.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.379+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 reap_dead start 2024-09-13T19:16:16.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.379+0000 7fe9912b6640 1 -- 172.21.15.102:0/2928884514 reap_dead start 2024-09-13T19:16:16.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.379+0000 7fe995d2c800 1 -- 172.21.15.102:0/2928884514 shutdown_connections 2024-09-13T19:16:16.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.379+0000 7fe995d2c800 1 -- 172.21.15.102:0/2928884514 >> 172.21.15.102:0/2928884514 conn(0x55be5b553e60 msgr2=0x55be5b5591c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:16.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.380+0000 7fe995d2c800 1 -- 172.21.15.102:0/2928884514 shutdown_connections 2024-09-13T19:16:16.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.380+0000 7fe995d2c800 1 -- 172.21.15.102:0/2928884514 wait complete. 2024-09-13T19:16:16.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.380+0000 7fe995d2c800 1 -- 172.21.15.102:0/2296753550 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe86c036c00 msgr2=0x7fe86c0390c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.380+0000 7fe995d2c800 1 --2- 172.21.15.102:0/2296753550 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe86c036c00 0x7fe86c0390c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x55be5b537ee0 tx=0x7fe98404b740 comp rx=0 tx=0).stop 2024-09-13T19:16:16.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.380+0000 7fe995d2c800 1 -- 172.21.15.102:0/2296753550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be5b54ad90 msgr2=0x55be5b54b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.380+0000 7fe995d2c800 1 --2- 172.21.15.102:0/2296753550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be5b54ad90 0x55be5b54b1b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x55be5b5313f0 tx=0x7fe98c0163e0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.380+0000 7fe995d2c800 1 -- 172.21.15.102:0/2296753550 shutdown_connections 2024-09-13T19:16:16.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.380+0000 7fe995d2c800 1 --2- 172.21.15.102:0/2296753550 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe86c036c00 0x7fe86c0390c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.380+0000 7fe995d2c800 1 --2- 172.21.15.102:0/2296753550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be5b54ad90 0x55be5b54b1b0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.380+0000 7fe995d2c800 1 -- 172.21.15.102:0/2296753550 >> 172.21.15.102:0/2296753550 conn(0x55be5b53fd20 msgr2=0x55be5b5428a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:16.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.380+0000 7fe995d2c800 1 -- 172.21.15.102:0/2296753550 shutdown_connections 2024-09-13T19:16:16.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.380+0000 7fe995d2c800 1 -- 172.21.15.102:0/2296753550 wait complete. 2024-09-13T19:16:16.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.380+0000 7fe995d2c800 1 -- 172.21.15.102:0/1355460956 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55be5b43e900 msgr2=0x55be5b537060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.380+0000 7fe995d2c800 1 --2- 172.21.15.102:0/1355460956 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55be5b43e900 0x55be5b537060 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.380+0000 7fe995d2c800 1 -- 172.21.15.102:0/1355460956 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55be5b539930 msgr2=0x55be5b53bd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.380+0000 7fe995d2c800 1 --2- 172.21.15.102:0/1355460956 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55be5b539930 0x55be5b53bd20 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.380+0000 7fe995d2c800 1 -- 172.21.15.102:0/1355460956 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe878036b40 msgr2=0x7fe878039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.380+0000 7fe995d2c800 1 --2- 172.21.15.102:0/1355460956 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe878036b40 0x7fe878039000 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe97c058000 tx=0x7fe97c053000 comp rx=0 tx=0).stop 2024-09-13T19:16:16.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.380+0000 7fe995d2c800 1 -- 172.21.15.102:0/1355460956 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be5b43a4c0 msgr2=0x55be5b52fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.380+0000 7fe995d2c800 1 --2- 172.21.15.102:0/1355460956 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be5b43a4c0 0x55be5b52fff0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe984000c00 tx=0x7fe984000ed0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.380+0000 7fe995d2c800 1 -- 172.21.15.102:0/1355460956 shutdown_connections 2024-09-13T19:16:16.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.380+0000 7fe995d2c800 1 --2- 172.21.15.102:0/1355460956 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55be5b539930 0x55be5b53bd20 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.380+0000 7fe995d2c800 1 --2- 172.21.15.102:0/1355460956 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55be5b43e900 0x55be5b537060 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.380+0000 7fe995d2c800 1 --2- 172.21.15.102:0/1355460956 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe878036b40 0x7fe878039000 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.380+0000 7fe995d2c800 1 --2- 172.21.15.102:0/1355460956 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55be5b43a4c0 0x55be5b52fff0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.380+0000 7fe995d2c800 1 -- 172.21.15.102:0/1355460956 >> 172.21.15.102:0/1355460956 conn(0x55be5b435df0 msgr2=0x55be5b5228d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:16.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.380+0000 7fe995d2c800 1 -- 172.21.15.102:0/1355460956 shutdown_connections 2024-09-13T19:16:16.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.380+0000 7fe995d2c800 1 -- 172.21.15.102:0/1355460956 wait complete. 2024-09-13T19:16:16.393 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:16:14.779675Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:16:14.779665Z', 'tags': [], 'group_ids': []} 2024-09-13T19:16:16.393 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T19:16:16.393 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T19:16:16.393 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T19:16:16.437 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:16.437 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:16.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.435+0000 7f6adb730800 1 Processor -- start 2024-09-13T19:16:16.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.435+0000 7f6adb730800 1 -- start start 2024-09-13T19:16:16.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.435+0000 7f6adb730800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5573d011b900 0x5573d011dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.435+0000 7f6adb730800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5573cffd7b30 con 0x5573d01174c0 2024-09-13T19:16:16.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.435+0000 7f6adb730800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5573cffb9360 con 0x5573d011b900 2024-09-13T19:16:16.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.435+0000 7f6acffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5573d011b900 0x5573d011dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.435+0000 7f6ad745c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5573d01174c0 0x5573d01178c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:49886/0 (socket says 172.21.15.102:49886) 2024-09-13T19:16:16.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.435+0000 7f6ad745c640 1 -- 172.21.15.102:0/416488285 learned_addr learned my addr 172.21.15.102:0/416488285 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:16:16.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.436+0000 7f6acffff640 1 -- 172.21.15.102:0/416488285 >> v1:172.21.15.53:6789/0 conn(0x5573d01174c0 legacy=0x5573d01178c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.436+0000 7f6acffff640 1 -- 172.21.15.102:0/416488285 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573cffdfe00 con 0x5573d011b900 2024-09-13T19:16:16.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.437+0000 7f6acffff640 1 --2- 172.21.15.102:0/416488285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d011b900 0x5573d011dcf0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6ac000a470 tx=0x7f6ac0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ada3ee5f94608568 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.438+0000 7f6ad6c5b640 1 -- 172.21.15.102:0/416488285 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ac0053570 con 0x5573d011b900 2024-09-13T19:16:16.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.438+0000 7f6ad6c5b640 1 -- 172.21.15.102:0/416488285 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ac0058070 con 0x5573d011b900 2024-09-13T19:16:16.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.438+0000 7f6ad6c5b640 1 -- 172.21.15.102:0/416488285 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ac0053880 con 0x5573d011b900 2024-09-13T19:16:16.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.438+0000 7f6adb730800 1 -- 172.21.15.102:0/416488285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d011b900 msgr2=0x5573d011dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.438+0000 7f6adb730800 1 --2- 172.21.15.102:0/416488285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d011b900 0x5573d011dcf0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6ac000a470 tx=0x7f6ac0045a20 comp rx=0 tx=0).stop 2024-09-13T19:16:16.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.438+0000 7f6adb730800 1 -- 172.21.15.102:0/416488285 shutdown_connections 2024-09-13T19:16:16.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.438+0000 7f6adb730800 1 --2- 172.21.15.102:0/416488285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d011b900 0x5573d011dcf0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.438+0000 7f6adb730800 1 -- 172.21.15.102:0/416488285 >> 172.21.15.102:0/416488285 conn(0x5573d0112df0 msgr2=0x5573d0115210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:16.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.438+0000 7f6adb730800 1 -- 172.21.15.102:0/416488285 shutdown_connections 2024-09-13T19:16:16.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.438+0000 7f6adb730800 1 -- 172.21.15.102:0/416488285 wait complete. 2024-09-13T19:16:16.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.452+0000 7f6adb730800 1 Processor -- start 2024-09-13T19:16:16.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.452+0000 7f6adb730800 1 -- start start 2024-09-13T19:16:16.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.452+0000 7f6adb730800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d01174c0 0x5573d008bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.452+0000 7f6adb730800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5573d0064330 con 0x5573d01174c0 2024-09-13T19:16:16.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.452+0000 7f6ad745c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d01174c0 0x5573d008bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.452+0000 7f6ad745c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d01174c0 0x5573d008bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54502/0 (socket says 172.21.15.102:54502) 2024-09-13T19:16:16.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.452+0000 7f6ad745c640 1 -- 172.21.15.102:0/2672006309 learned_addr learned my addr 172.21.15.102:0/2672006309 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:16.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.453+0000 7f6ad745c640 1 -- 172.21.15.102:0/2672006309 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573cffb1bc0 con 0x5573d01174c0 2024-09-13T19:16:16.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.453+0000 7f6ad745c640 1 --2- 172.21.15.102:0/2672006309 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d01174c0 0x5573d008bd80 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8001e10 tx=0x7f6ac800b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e121340d113f6bd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.453+0000 7f69c560a640 1 -- 172.21.15.102:0/2672006309 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ac8012020 con 0x5573d01174c0 2024-09-13T19:16:16.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.453+0000 7f69c560a640 1 -- 172.21.15.102:0/2672006309 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ac800e5a0 con 0x5573d01174c0 2024-09-13T19:16:16.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.453+0000 7f69c560a640 1 -- 172.21.15.102:0/2672006309 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ac800e8e0 con 0x5573d01174c0 2024-09-13T19:16:16.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.454+0000 7f6adb730800 1 -- 172.21.15.102:0/2672006309 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d01174c0 msgr2=0x5573d008bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.454+0000 7f6adb730800 1 --2- 172.21.15.102:0/2672006309 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d01174c0 0x5573d008bd80 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8001e10 tx=0x7f6ac800b780 comp rx=0 tx=0).stop 2024-09-13T19:16:16.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.454+0000 7f6adb730800 1 -- 172.21.15.102:0/2672006309 shutdown_connections 2024-09-13T19:16:16.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.454+0000 7f6adb730800 1 --2- 172.21.15.102:0/2672006309 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d01174c0 0x5573d008bd80 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.454+0000 7f6adb730800 1 -- 172.21.15.102:0/2672006309 >> 172.21.15.102:0/2672006309 conn(0x5573d0112df0 msgr2=0x5573d0202110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:16.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.454+0000 7f6adb730800 1 -- 172.21.15.102:0/2672006309 shutdown_connections 2024-09-13T19:16:16.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.454+0000 7f6adb730800 1 -- 172.21.15.102:0/2672006309 wait complete. 2024-09-13T19:16:16.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.454+0000 7f6adb730800 1 Processor -- start 2024-09-13T19:16:16.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.454+0000 7f6adb730800 1 -- start start 2024-09-13T19:16:16.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.454+0000 7f6adb730800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d01174c0 0x5573d020f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.454+0000 7f6adb730800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5573d011e530 con 0x5573d01174c0 2024-09-13T19:16:16.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.455+0000 7f6ad745c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d01174c0 0x5573d020f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.455+0000 7f6ad745c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d01174c0 0x5573d020f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54504/0 (socket says 172.21.15.102:54504) 2024-09-13T19:16:16.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.455+0000 7f6ad745c640 1 -- 172.21.15.102:0/3618567252 learned_addr learned my addr 172.21.15.102:0/3618567252 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:16.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.455+0000 7f6ad745c640 1 -- 172.21.15.102:0/3618567252 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573cffc5fe0 con 0x5573d01174c0 2024-09-13T19:16:16.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.455+0000 7f6ad745c640 1 --2- 172.21.15.102:0/3618567252 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d01174c0 0x5573d020f230 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8001e10 tx=0x7f6ac8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.455+0000 7f69c3e07640 1 -- 172.21.15.102:0/3618567252 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ac8012030 con 0x5573d01174c0 2024-09-13T19:16:16.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.455+0000 7f69c3e07640 1 -- 172.21.15.102:0/3618567252 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ac801a7a0 con 0x5573d01174c0 2024-09-13T19:16:16.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.455+0000 7f6adb730800 1 -- 172.21.15.102:0/3618567252 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5573d020f770 con 0x5573d01174c0 2024-09-13T19:16:16.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.455+0000 7f69c3e07640 1 -- 172.21.15.102:0/3618567252 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ac801aac0 con 0x5573d01174c0 2024-09-13T19:16:16.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.455+0000 7f6adb730800 1 -- 172.21.15.102:0/3618567252 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573d020fc90 con 0x5573d01174c0 2024-09-13T19:16:16.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.456+0000 7f69c3e07640 1 -- 172.21.15.102:0/3618567252 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6ac8015020 con 0x5573d01174c0 2024-09-13T19:16:16.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.456+0000 7f69c3e07640 1 --2- 172.21.15.102:0/3618567252 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f69bc036b90 0x7f69bc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.456+0000 7f69c3e07640 1 -- 172.21.15.102:0/3618567252 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f6ac8020030 con 0x5573d01174c0 2024-09-13T19:16:16.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.456+0000 7f6acffff640 1 --2- 172.21.15.102:0/3618567252 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f69bc036b90 0x7f69bc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.456+0000 7f6adb730800 1 --2- 172.21.15.102:0/3618567252 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5573d011b900 0x5573d02162a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.456+0000 7f6adb730800 1 -- 172.21.15.102:0/3618567252 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5573d02167e0 con 0x5573d011b900 2024-09-13T19:16:16.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.457+0000 7f6ad7c5d640 1 --2- 172.21.15.102:0/3618567252 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5573d011b900 0x5573d02162a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.457+0000 7f6acffff640 1 --2- 172.21.15.102:0/3618567252 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f69bc036b90 0x7f69bc039050 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0057000 tx=0x7f6ac0052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.457+0000 7f6ad7c5d640 1 --2- 172.21.15.102:0/3618567252 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5573d011b900 0x5573d02162a0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.457+0000 7f6ad7c5d640 1 -- 172.21.15.102:0/3618567252 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ad000a4a0 con 0x5573d011b900 2024-09-13T19:16:16.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.457+0000 7f6adb730800 1 -- 172.21.15.102:0/3618567252 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5573d0213850 con 0x5573d011b900 2024-09-13T19:16:16.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.457+0000 7f6ad7c5d640 1 -- 172.21.15.102:0/3618567252 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6ad000a4a0 con 0x5573d011b900 2024-09-13T19:16:16.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.457+0000 7f6adb730800 1 --2- 172.21.15.102:0/3618567252 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5573d0218af0 0x5573d021aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.457+0000 7f6adb730800 1 -- 172.21.15.102:0/3618567252 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5573d021b580 con 0x5573d0218af0 2024-09-13T19:16:16.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.458+0000 7f6ad745c640 1 --2- 172.21.15.102:0/3618567252 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5573d0218af0 0x5573d021aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.458+0000 7f6ad745c640 1 --2- 172.21.15.102:0/3618567252 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5573d0218af0 0x5573d021aee0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.458+0000 7f6ad745c640 1 -- 172.21.15.102:0/3618567252 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6ac800dcd0 con 0x5573d0218af0 2024-09-13T19:16:16.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.458+0000 7f6adb730800 1 -- 172.21.15.102:0/3618567252 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5573d0217990 con 0x5573d011b900 2024-09-13T19:16:16.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.458+0000 7f6ad7c5d640 1 -- 172.21.15.102:0/3618567252 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6ad000a4a0 con 0x5573d011b900 2024-09-13T19:16:16.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.458+0000 7f6adb730800 1 -- 172.21.15.102:0/3618567252 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5573d0217e70 con 0x5573d0218af0 2024-09-13T19:16:16.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.459+0000 7f6ad745c640 1 -- 172.21.15.102:0/3618567252 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6ac800dcd0 con 0x5573d0218af0 2024-09-13T19:16:16.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.459+0000 7f6adb730800 1 Processor -- start 2024-09-13T19:16:16.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.459+0000 7f6adb730800 1 -- start start 2024-09-13T19:16:16.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.459+0000 7f6adb730800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0229f00 0x5573d022a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.459+0000 7f6adb730800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5573cffb3580 con 0x5573d0229f00 2024-09-13T19:16:16.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.460+0000 7f6ad7c5d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0229f00 0x5573d022a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.460+0000 7f6ad7c5d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0229f00 0x5573d022a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54514/0 (socket says 172.21.15.102:54514) 2024-09-13T19:16:16.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.460+0000 7f6ad7c5d640 1 -- 172.21.15.102:0/4290191646 learned_addr learned my addr 172.21.15.102:0/4290191646 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:16.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.460+0000 7f6ad7c5d640 1 -- 172.21.15.102:0/4290191646 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573d022a860 con 0x5573d0229f00 2024-09-13T19:16:16.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.461+0000 7f6ad7c5d640 1 --2- 172.21.15.102:0/4290191646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0229f00 0x5573d022a320 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x5573d02102e0 tx=0x7f6ad00167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.461+0000 7f69c1602640 1 -- 172.21.15.102:0/4290191646 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ad0013640 con 0x5573d0229f00 2024-09-13T19:16:16.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.461+0000 7f69c1602640 1 -- 172.21.15.102:0/4290191646 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ad00137e0 con 0x5573d0229f00 2024-09-13T19:16:16.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.461+0000 7f69c1602640 1 -- 172.21.15.102:0/4290191646 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ad0013ae0 con 0x5573d0229f00 2024-09-13T19:16:16.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.461+0000 7f6adb730800 1 -- 172.21.15.102:0/4290191646 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5573d022aaf0 con 0x5573d0229f00 2024-09-13T19:16:16.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.461+0000 7f6adb730800 1 -- 172.21.15.102:0/4290191646 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573d022d7d0 con 0x5573d0229f00 2024-09-13T19:16:16.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.462+0000 7f69c1602640 1 -- 172.21.15.102:0/4290191646 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6ad0011040 con 0x5573d0229f00 2024-09-13T19:16:16.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.462+0000 7f69c1602640 1 --2- 172.21.15.102:0/4290191646 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f69b0036c00 0x7f69b00390c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.462+0000 7f69c1602640 1 -- 172.21.15.102:0/4290191646 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f6ad000e040 con 0x5573d0229f00 2024-09-13T19:16:16.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.462+0000 7f6ad745c640 1 --2- 172.21.15.102:0/4290191646 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f69b0036c00 0x7f69b00390c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.462+0000 7f6adb730800 1 Processor -- start 2024-09-13T19:16:16.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.462+0000 7f6ad745c640 1 --2- 172.21.15.102:0/4290191646 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f69b0036c00 0x7f69b00390c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6ac804b040 tx=0x7f6ac804af10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.462+0000 7f6adb730800 1 -- start start 2024-09-13T19:16:16.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.462+0000 7f6adb730800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0236b30 0x5573d0236f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.462+0000 7f6adb730800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5573d020a730 con 0x5573d0236b30 2024-09-13T19:16:16.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.462+0000 7f6ad7c5d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0236b30 0x5573d0236f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.463+0000 7f6ad7c5d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0236b30 0x5573d0236f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54530/0 (socket says 172.21.15.102:54530) 2024-09-13T19:16:16.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.463+0000 7f6ad7c5d640 1 -- 172.21.15.102:0/4052314680 learned_addr learned my addr 172.21.15.102:0/4052314680 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:16.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.463+0000 7f6ad7c5d640 1 -- 172.21.15.102:0/4052314680 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573d0237500 con 0x5573d0236b30 2024-09-13T19:16:16.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.463+0000 7f6ad7c5d640 1 --2- 172.21.15.102:0/4052314680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0236b30 0x5573d0236f30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6ad000afb0 tx=0x7f6ad001fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee67a4997333e78d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.463+0000 7f69baffd640 1 -- 172.21.15.102:0/4052314680 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ad0021440 con 0x5573d0236b30 2024-09-13T19:16:16.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.463+0000 7f69baffd640 1 -- 172.21.15.102:0/4052314680 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ad001f340 con 0x5573d0236b30 2024-09-13T19:16:16.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.463+0000 7f69baffd640 1 -- 172.21.15.102:0/4052314680 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ad00215e0 con 0x5573d0236b30 2024-09-13T19:16:16.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.463+0000 7f6adb730800 1 -- 172.21.15.102:0/4052314680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0236b30 msgr2=0x5573d0236f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.463+0000 7f6adb730800 1 --2- 172.21.15.102:0/4052314680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0236b30 0x5573d0236f30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6ad000afb0 tx=0x7f6ad001fce0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.463+0000 7f6adb730800 1 -- 172.21.15.102:0/4052314680 shutdown_connections 2024-09-13T19:16:16.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.463+0000 7f6adb730800 1 --2- 172.21.15.102:0/4052314680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0236b30 0x5573d0236f30 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.463+0000 7f6adb730800 1 -- 172.21.15.102:0/4052314680 >> 172.21.15.102:0/4052314680 conn(0x5573d0232f20 msgr2=0x5573d0231020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:16.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.464+0000 7f6adb730800 1 -- 172.21.15.102:0/4052314680 shutdown_connections 2024-09-13T19:16:16.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.464+0000 7f6adb730800 1 -- 172.21.15.102:0/4052314680 wait complete. 2024-09-13T19:16:16.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.464+0000 7f6adb730800 1 Processor -- start 2024-09-13T19:16:16.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.464+0000 7f6adb730800 1 -- start start 2024-09-13T19:16:16.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.464+0000 7f6adb730800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0236b30 0x5573d023e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.464+0000 7f6adb730800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5573d0237b40 con 0x5573d0236b30 2024-09-13T19:16:16.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.464+0000 7f6ad7c5d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0236b30 0x5573d023e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.464+0000 7f6ad7c5d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0236b30 0x5573d023e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54546/0 (socket says 172.21.15.102:54546) 2024-09-13T19:16:16.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.464+0000 7f6ad7c5d640 1 -- 172.21.15.102:0/2946820856 learned_addr learned my addr 172.21.15.102:0/2946820856 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:16.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.464+0000 7f6ad7c5d640 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573d023e620 con 0x5573d0236b30 2024-09-13T19:16:16.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.465+0000 7f6ad7c5d640 1 --2- 172.21.15.102:0/2946820856 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0236b30 0x5573d023e0e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6ad004cd60 tx=0x7f6ad004cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.465+0000 7f69b97fa640 1 -- 172.21.15.102:0/2946820856 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ad0013e60 con 0x5573d0236b30 2024-09-13T19:16:16.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.465+0000 7f69b97fa640 1 -- 172.21.15.102:0/2946820856 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ad0040360 con 0x5573d0236b30 2024-09-13T19:16:16.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.465+0000 7f69b97fa640 1 -- 172.21.15.102:0/2946820856 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ad004e2b0 con 0x5573d0236b30 2024-09-13T19:16:16.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.465+0000 7f6adb730800 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5573d023e8b0 con 0x5573d0236b30 2024-09-13T19:16:16.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.465+0000 7f6adb730800 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573d0241560 con 0x5573d0236b30 2024-09-13T19:16:16.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.465+0000 7f69b97fa640 1 -- 172.21.15.102:0/2946820856 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6ad003b060 con 0x5573d0236b30 2024-09-13T19:16:16.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.466+0000 7f69b97fa640 1 --2- 172.21.15.102:0/2946820856 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f69a0036b40 0x7f69a0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.466+0000 7f69b97fa640 1 -- 172.21.15.102:0/2946820856 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f6ad0045c90 con 0x5573d0236b30 2024-09-13T19:16:16.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.466+0000 7f6ad745c640 1 --2- 172.21.15.102:0/2946820856 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f69a0036b40 0x7f69a0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.466+0000 7f6adb730800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.466+0000 7f6ad745c640 1 --2- 172.21.15.102:0/2946820856 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f69a0036b40 0x7f69a0039000 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6ac802c540 tx=0x7f6ac8037000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.466+0000 7f6adb730800 1 --2- 172.21.15.102:0/2946820856 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5573d0249b10 0x5573d024bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.466+0000 7f6adb730800 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5573d024c720 con 0x5573d0249b10 2024-09-13T19:16:16.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.466+0000 7f6acffff640 1 --2- 172.21.15.102:0/2946820856 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5573d0249b10 0x5573d024bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.467+0000 7f6acffff640 1 --2- 172.21.15.102:0/2946820856 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5573d0249b10 0x5573d024bfd0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.467+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ac0051070 con 0x5573d0249b10 2024-09-13T19:16:16.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.467+0000 7f6adb730800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:16.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.467+0000 7f6adb730800 20 realm 2024-09-13T19:16:16.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.467+0000 7f6adb730800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.467+0000 7f6adb730800 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5573d024cb50 con 0x5573d0249b10 2024-09-13T19:16:16.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.467+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ac0051070 con 0x5573d0249b10 2024-09-13T19:16:16.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.467+0000 7f6adb730800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:16.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.467+0000 7f6adb730800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:16.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.467+0000 7f6adb730800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.467+0000 7f6adb730800 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5573d024d420 con 0x5573d0249b10 2024-09-13T19:16:16.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.467+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ac0051070 con 0x5573d0249b10 2024-09-13T19:16:16.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.467+0000 7f6adb730800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:16.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.467+0000 7f6adb730800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.467+0000 7f6adb730800 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5573d024d7c0 con 0x5573d0249b10 2024-09-13T19:16:16.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.467+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6ac0051070 con 0x5573d0249b10 2024-09-13T19:16:16.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.467+0000 7f6adb730800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:16.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.467+0000 7f6adb730800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.467+0000 7f6adb730800 1 --2- 172.21.15.102:0/2946820856 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5573d024e520 0x5573d0250910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.467+0000 7f6adb730800 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5573d0250e50 con 0x5573d024e520 2024-09-13T19:16:16.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.468+0000 7f6ad7c5d640 1 --2- 172.21.15.102:0/2946820856 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5573d024e520 0x5573d0250910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.468+0000 7f6ad7c5d640 1 --2- 172.21.15.102:0/2946820856 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5573d024e520 0x5573d0250910 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.468+0000 7f6ad7c5d640 1 -- 172.21.15.102:0/2946820856 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6ad000a4a0 con 0x5573d024e520 2024-09-13T19:16:16.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.468+0000 7f6adb730800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:16.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.468+0000 7f6adb730800 20 searching for the correct realm 2024-09-13T19:16:16.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.468+0000 7f6adb730800 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d02527c0 con 0x5573d024e520 2024-09-13T19:16:16.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.468+0000 7f6ad7c5d640 1 -- 172.21.15.102:0/2946820856 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad000a4a0 con 0x5573d024e520 2024-09-13T19:16:16.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.468+0000 7f6ad7c5d640 1 --2- 172.21.15.102:0/2946820856 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f6ad0044070 0x7f6ad0031a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.468+0000 7f6ad7c5d640 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d02527c0 con 0x7f6ad0044070 2024-09-13T19:16:16.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.468+0000 7f6ad745c640 1 --2- 172.21.15.102:0/2946820856 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f6ad0044070 0x7f6ad0031a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.469+0000 7f6ad745c640 1 --2- 172.21.15.102:0/2946820856 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f6ad0044070 0x7f6ad0031a30 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.469+0000 7f6ad745c640 1 -- 172.21.15.102:0/2946820856 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ac800dcd0 con 0x7f6ad0044070 2024-09-13T19:16:16.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.469+0000 7f6ad745c640 1 --2- 172.21.15.102:0/2946820856 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f6ac8017050 0x7f6ac804c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.469+0000 7f6ad745c640 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d02527c0 con 0x7f6ac8017050 2024-09-13T19:16:16.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.469+0000 7f6acffff640 1 --2- 172.21.15.102:0/2946820856 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f6ac8017050 0x7f6ac804c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.470+0000 7f6acffff640 1 --2- 172.21.15.102:0/2946820856 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f6ac8017050 0x7f6ac804c130 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.470+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ac0051070 con 0x7f6ac8017050 2024-09-13T19:16:16.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.470+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d02527c0 con 0x5573d0249b10 2024-09-13T19:16:16.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.470+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ac0051070 con 0x5573d0249b10 2024-09-13T19:16:16.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.470+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d02527c0 con 0x5573d0249b10 2024-09-13T19:16:16.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.470+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ac0051070 con 0x5573d0249b10 2024-09-13T19:16:16.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.470+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d02527c0 con 0x7f6ac8017050 2024-09-13T19:16:16.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.471+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ac0051070 con 0x7f6ac8017050 2024-09-13T19:16:16.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.471+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d02527c0 con 0x7f6ac8017050 2024-09-13T19:16:16.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.471+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ac0051070 con 0x7f6ac8017050 2024-09-13T19:16:16.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.471+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d02527c0 con 0x7f6ad0044070 2024-09-13T19:16:16.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.471+0000 7f6ad745c640 1 -- 172.21.15.102:0/2946820856 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ac8059040 con 0x7f6ad0044070 2024-09-13T19:16:16.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.471+0000 7f6ad745c640 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d02527c0 con 0x5573d024e520 2024-09-13T19:16:16.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.471+0000 7f6ad7c5d640 1 -- 172.21.15.102:0/2946820856 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad000a4a0 con 0x5573d024e520 2024-09-13T19:16:16.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.471+0000 7f6ad7c5d640 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d02527c0 con 0x5573d0249b10 2024-09-13T19:16:16.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.472+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ac0051070 con 0x5573d0249b10 2024-09-13T19:16:16.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.472+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d02527c0 con 0x7f6ac8017050 2024-09-13T19:16:16.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.472+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ac0051070 con 0x7f6ac8017050 2024-09-13T19:16:16.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.472+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d02527c0 con 0x5573d0249b10 2024-09-13T19:16:16.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.472+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ac0051070 con 0x5573d0249b10 2024-09-13T19:16:16.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.472+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d02527c0 con 0x7f6ad0044070 2024-09-13T19:16:16.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.472+0000 7f6ad745c640 1 -- 172.21.15.102:0/2946820856 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6ac8059040 con 0x7f6ad0044070 2024-09-13T19:16:16.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.472+0000 7f6ad745c640 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d02527c0 con 0x5573d024e520 2024-09-13T19:16:16.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.473+0000 7f6ad7c5d640 1 -- 172.21.15.102:0/2946820856 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad000a4a0 con 0x5573d024e520 2024-09-13T19:16:16.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.473+0000 7f6ad7c5d640 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d02527c0 con 0x5573d024e520 2024-09-13T19:16:16.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.473+0000 7f6ad7c5d640 1 -- 172.21.15.102:0/2946820856 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6ad000a4a0 con 0x5573d024e520 2024-09-13T19:16:16.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.473+0000 7f6ad7c5d640 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d02527c0 con 0x7f6ac8017050 2024-09-13T19:16:16.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.473+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ac0051070 con 0x7f6ac8017050 2024-09-13T19:16:16.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.473+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d02527c0 con 0x5573d024e520 2024-09-13T19:16:16.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.473+0000 7f6ad7c5d640 1 -- 172.21.15.102:0/2946820856 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6ad000a4a0 con 0x5573d024e520 2024-09-13T19:16:16.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.473+0000 7f6ad7c5d640 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d02527c0 con 0x5573d024e520 2024-09-13T19:16:16.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.473+0000 7f6ad7c5d640 1 -- 172.21.15.102:0/2946820856 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad000a4a0 con 0x5573d024e520 2024-09-13T19:16:16.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.473+0000 7f6ad7c5d640 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d02527c0 con 0x5573d0249b10 2024-09-13T19:16:16.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.474+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ac0051070 con 0x5573d0249b10 2024-09-13T19:16:16.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.474+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d02527c0 con 0x5573d0249b10 2024-09-13T19:16:16.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.474+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6ac0051070 con 0x5573d0249b10 2024-09-13T19:16:16.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.474+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d02527c0 con 0x7f6ac8017050 2024-09-13T19:16:16.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.474+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ac0051070 con 0x7f6ac8017050 2024-09-13T19:16:16.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.474+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d02527c0 con 0x5573d024e520 2024-09-13T19:16:16.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.474+0000 7f6ad7c5d640 1 -- 172.21.15.102:0/2946820856 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad000a4a0 con 0x5573d024e520 2024-09-13T19:16:16.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.474+0000 7f6ad7c5d640 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d02527c0 con 0x7f6ad0044070 2024-09-13T19:16:16.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.475+0000 7f6ad745c640 1 -- 172.21.15.102:0/2946820856 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ac8059040 con 0x7f6ad0044070 2024-09-13T19:16:16.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.475+0000 7f6ad745c640 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d02527c0 con 0x5573d0249b10 2024-09-13T19:16:16.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.475+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ac0051070 con 0x5573d0249b10 2024-09-13T19:16:16.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.475+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d02527c0 con 0x7f6ac8017050 2024-09-13T19:16:16.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.475+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ac0051070 con 0x7f6ac8017050 2024-09-13T19:16:16.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.475+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d02527c0 con 0x5573d024e520 2024-09-13T19:16:16.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.475+0000 7f6ad7c5d640 1 -- 172.21.15.102:0/2946820856 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad000a4a0 con 0x5573d024e520 2024-09-13T19:16:16.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.475+0000 7f6ad7c5d640 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d02527c0 con 0x7f6ac8017050 2024-09-13T19:16:16.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.476+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ac0051070 con 0x7f6ac8017050 2024-09-13T19:16:16.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.476+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f6ac0087040 con 0x7f6ad0044070 2024-09-13T19:16:16.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.476+0000 7f6ad745c640 1 -- 172.21.15.102:0/2946820856 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ac8059040 con 0x7f6ad0044070 2024-09-13T19:16:16.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.476+0000 7f6ad745c640 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f6ac0087040 con 0x5573d024e520 2024-09-13T19:16:16.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.476+0000 7f6ad7c5d640 1 -- 172.21.15.102:0/2946820856 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad000a4a0 con 0x5573d024e520 2024-09-13T19:16:16.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.476+0000 7f6ad7c5d640 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f6ac0087040 con 0x7f6ac8017050 2024-09-13T19:16:16.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.476+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ac0051070 con 0x7f6ac8017050 2024-09-13T19:16:16.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.476+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f6ac0087040 con 0x5573d0249b10 2024-09-13T19:16:16.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.477+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6ac0051070 con 0x5573d0249b10 2024-09-13T19:16:16.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.477+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f6ac0087040 con 0x7f6ad0044070 2024-09-13T19:16:16.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.477+0000 7f6ad745c640 1 -- 172.21.15.102:0/2946820856 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ac8059040 con 0x7f6ad0044070 2024-09-13T19:16:16.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.477+0000 7f6adb730800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:16.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.477+0000 7f6adb730800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:16.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.477+0000 7f6adb730800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:16.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.477+0000 7f6adb730800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:16.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.477+0000 7f6adb730800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:16.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.477+0000 7f6adb730800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:16.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.477+0000 7f6adb730800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.477+0000 7f6adb730800 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5573d0251890 con 0x5573d0249b10 2024-09-13T19:16:16.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.477+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ac0051070 con 0x5573d0249b10 2024-09-13T19:16:16.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.477+0000 7f6adb730800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:16.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.477+0000 7f6adb730800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.477+0000 7f6adb730800 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5573d0252130 con 0x5573d0249b10 2024-09-13T19:16:16.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.477+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6ac0051070 con 0x5573d0249b10 2024-09-13T19:16:16.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.477+0000 7f6adb730800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:16.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.477+0000 7f6adb730800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.477+0000 7f6adb730800 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5573d02514d0 con 0x5573d024e520 2024-09-13T19:16:16.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.478+0000 7f6ad7c5d640 1 -- 172.21.15.102:0/2946820856 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6ad000a4a0 con 0x5573d024e520 2024-09-13T19:16:16.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.478+0000 7f6adb730800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:16.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.478+0000 7f6adb730800 20 zone default found 2024-09-13T19:16:16.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.478+0000 7f6adb730800 4 Realm: () 2024-09-13T19:16:16.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.478+0000 7f6adb730800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:16.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.478+0000 7f6adb730800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:16.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.478+0000 7f6adb730800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:16.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.478+0000 7f6adb730800 20 zonegroup default 2024-09-13T19:16:16.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.478+0000 7f6adb730800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.478+0000 7f6adb730800 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5573d0253140 con 0x7f6ac8017050 2024-09-13T19:16:16.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.478+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6ac0051070 con 0x7f6ac8017050 2024-09-13T19:16:16.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.478+0000 7f6adb730800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:16.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.478+0000 7f6adb730800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.478+0000 7f6adb730800 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5573d0254be0 con 0x5573d024e520 2024-09-13T19:16:16.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.478+0000 7f6ad7c5d640 1 -- 172.21.15.102:0/2946820856 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6ad000a4a0 con 0x5573d024e520 2024-09-13T19:16:16.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.478+0000 7f6adb730800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:16.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.478+0000 7f6adb730800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.478+0000 7f6adb730800 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5573d0255020 con 0x5573d024e520 2024-09-13T19:16:16.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.478+0000 7f6ad7c5d640 1 -- 172.21.15.102:0/2946820856 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6ad000a4a0 con 0x5573d024e520 2024-09-13T19:16:16.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.478+0000 7f6adb730800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:16.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.478+0000 7f6adb730800 20 started sync module instance, tier type = 2024-09-13T19:16:16.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.478+0000 7f6adb730800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:16.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.478+0000 7f6adb730800 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5573d0253fd0 con 0x7f6ad0044070 2024-09-13T19:16:16.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.479+0000 7f6ad745c640 1 -- 172.21.15.102:0/2946820856 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(44 notify.0 [create] v34'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ac8059040 con 0x7f6ad0044070 2024-09-13T19:16:16.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.479+0000 7f6adb730800 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93955901703104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5573d02547e0 con 0x7f6ad0044070 2024-09-13T19:16:16.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.479+0000 7f6adb730800 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5573d0255f30 con 0x5573d0249b10 2024-09-13T19:16:16.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.481+0000 7f6ad745c640 1 -- 172.21.15.102:0/2946820856 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93955901703104] v34'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ac8059040 con 0x7f6ad0044070 2024-09-13T19:16:16.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.481+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v34'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ac0051070 con 0x5573d0249b10 2024-09-13T19:16:16.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.481+0000 7f6adb730800 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93955901708928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5573d0255ea0 con 0x5573d0249b10 2024-09-13T19:16:16.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.481+0000 7f6adb730800 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5573d0256df0 con 0x5573d024e520 2024-09-13T19:16:16.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.482+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93955901708928] v34'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ac0051070 con 0x5573d0249b10 2024-09-13T19:16:16.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.482+0000 7f6ad7c5d640 1 -- 172.21.15.102:0/2946820856 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v34'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad000a4a0 con 0x5573d024e520 2024-09-13T19:16:16.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.482+0000 7f6adb730800 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93955901711136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5573d0256df0 con 0x5573d024e520 2024-09-13T19:16:16.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.482+0000 7f6adb730800 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5573d0257890 con 0x7f6ad0044070 2024-09-13T19:16:16.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.483+0000 7f6ad745c640 1 -- 172.21.15.102:0/2946820856 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(50 notify.3 [create] v34'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ac8059040 con 0x7f6ad0044070 2024-09-13T19:16:16.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.483+0000 7f6adb730800 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93955901715328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5573d0258130 con 0x7f6ad0044070 2024-09-13T19:16:16.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.483+0000 7f6adb730800 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5573d0258c30 con 0x5573d0249b10 2024-09-13T19:16:16.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.483+0000 7f6ad7c5d640 1 -- 172.21.15.102:0/2946820856 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93955901711136] v34'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad000a4a0 con 0x5573d024e520 2024-09-13T19:16:16.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.484+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v34'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ac0051070 con 0x5573d0249b10 2024-09-13T19:16:16.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.484+0000 7f6adb730800 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93955901720352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5573d0259020 con 0x5573d0249b10 2024-09-13T19:16:16.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.484+0000 7f6adb730800 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5573d0259a20 con 0x7f6ac8017050 2024-09-13T19:16:16.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.484+0000 7f6ad745c640 1 -- 172.21.15.102:0/2946820856 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93955901715328] v34'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ac8059040 con 0x7f6ad0044070 2024-09-13T19:16:16.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.485+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93955901720352] v34'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ac0051070 con 0x5573d0249b10 2024-09-13T19:16:16.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.485+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(54 notify.5 [create] v34'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ac0051070 con 0x7f6ac8017050 2024-09-13T19:16:16.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.485+0000 7f6adb730800 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93955901712704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5573d0259530 con 0x7f6ac8017050 2024-09-13T19:16:16.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.485+0000 7f6adb730800 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5573d025a2c0 con 0x7f6ac8017050 2024-09-13T19:16:16.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.486+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93955901712704] v34'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ac0051070 con 0x7f6ac8017050 2024-09-13T19:16:16.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.486+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(56 notify.6 [create] v34'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ac0051070 con 0x7f6ac8017050 2024-09-13T19:16:16.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.486+0000 7f6adb730800 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93955901717632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5573d0259530 con 0x7f6ac8017050 2024-09-13T19:16:16.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.486+0000 7f6adb730800 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5573d025a8e0 con 0x7f6ac8017050 2024-09-13T19:16:16.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.487+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93955901717632] v34'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ac0051070 con 0x7f6ac8017050 2024-09-13T19:16:16.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.487+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(58 notify.7 [create] v34'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ac0051070 con 0x7f6ac8017050 2024-09-13T19:16:16.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.487+0000 7f6adb730800 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93955901726144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5573d025a8e0 con 0x7f6ac8017050 2024-09-13T19:16:16.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.487+0000 7f6adb730800 20 add_watcher() i=0 2024-09-13T19:16:16.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.487+0000 7f6adb730800 20 add_watcher() i=1 2024-09-13T19:16:16.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.487+0000 7f6adb730800 20 add_watcher() i=2 2024-09-13T19:16:16.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.487+0000 7f6adb730800 20 add_watcher() i=3 2024-09-13T19:16:16.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.487+0000 7f6adb730800 20 add_watcher() i=4 2024-09-13T19:16:16.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.487+0000 7f6adb730800 20 add_watcher() i=5 2024-09-13T19:16:16.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.487+0000 7f6adb730800 20 add_watcher() i=6 2024-09-13T19:16:16.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.488+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93955901726144] v34'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ac0051070 con 0x7f6ac8017050 2024-09-13T19:16:16.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.488+0000 7f6adb730800 20 add_watcher() i=7 2024-09-13T19:16:16.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.488+0000 7f6adb730800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:16.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.488+0000 7f6adb730800 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5573d025dd00 con 0x5573d0249b10 2024-09-13T19:16:16.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.488+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6ac0051070 con 0x5573d0249b10 2024-09-13T19:16:16.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.488+0000 7f6adb730800 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93955901728256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5573d025b200 con 0x5573d0249b10 2024-09-13T19:16:16.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.489+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93955901728256] v34'76 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6ac0051070 con 0x5573d0249b10 2024-09-13T19:16:16.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.489+0000 7f698dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:16.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.489+0000 7f6adb730800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:16.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.489+0000 7f6adb730800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:16.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.489+0000 7f6adb730800 5 note: GC not initialized 2024-09-13T19:16:16.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.490+0000 7f698cfe1640 20 reqs_thread_entry: start 2024-09-13T19:16:16.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.490+0000 7f6adb730800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:16.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.490+0000 7f6adb730800 20 Filter name: none 2024-09-13T19:16:16.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.490+0000 7f69067fc640 20 reqs_thread_entry: start 2024-09-13T19:16:16.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.490+0000 7f6adb730800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.490+0000 7f6adb730800 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5573d0290c10 con 0x5573d0249b10 2024-09-13T19:16:16.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.490+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f6ac0051070 con 0x5573d0249b10 2024-09-13T19:16:16.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.490+0000 7f6adb730800 20 rados_obj.operate() r=0 bl.length=556 2024-09-13T19:16:16.503 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:16:14.779675Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:16:14.779665Z","tags":[],"group_ids":[]} 2024-09-13T19:16:16.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.491+0000 7f698dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:16.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.491+0000 7f6adb730800 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93955901728256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5573d028f6a0 con 0x5573d0249b10 2024-09-13T19:16:16.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.492+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93955901728256] v34'77 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6ac0051070 con 0x5573d0249b10 2024-09-13T19:16:16.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.492+0000 7f6adb730800 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93955901703104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5573d025a5d0 con 0x7f6ad0044070 2024-09-13T19:16:16.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.493+0000 7f6ad745c640 1 -- 172.21.15.102:0/2946820856 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93955901703104] v34'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ac8059040 con 0x7f6ad0044070 2024-09-13T19:16:16.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.493+0000 7f6adb730800 20 remove_watcher() i=0 2024-09-13T19:16:16.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.493+0000 7f6adb730800 2 removed watcher, disabling cache 2024-09-13T19:16:16.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.493+0000 7f6adb730800 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93955901708928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5573d02543c0 con 0x5573d0249b10 2024-09-13T19:16:16.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.494+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93955901708928] v34'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ac0051070 con 0x5573d0249b10 2024-09-13T19:16:16.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.494+0000 7f6adb730800 20 remove_watcher() i=1 2024-09-13T19:16:16.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.494+0000 7f6adb730800 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93955901711136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5573d02543c0 con 0x5573d024e520 2024-09-13T19:16:16.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.495+0000 7f6ad7c5d640 1 -- 172.21.15.102:0/2946820856 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93955901711136] v34'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad000a4a0 con 0x5573d024e520 2024-09-13T19:16:16.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.495+0000 7f6adb730800 20 remove_watcher() i=2 2024-09-13T19:16:16.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.495+0000 7f6adb730800 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93955901715328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5573d0256320 con 0x7f6ad0044070 2024-09-13T19:16:16.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.496+0000 7f6ad745c640 1 -- 172.21.15.102:0/2946820856 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93955901715328] v34'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ac8059040 con 0x7f6ad0044070 2024-09-13T19:16:16.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.496+0000 7f6adb730800 20 remove_watcher() i=3 2024-09-13T19:16:16.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.496+0000 7f6adb730800 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93955901720352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5573d02543c0 con 0x5573d0249b10 2024-09-13T19:16:16.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.497+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93955901720352] v34'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ac0051070 con 0x5573d0249b10 2024-09-13T19:16:16.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.497+0000 7f6adb730800 20 remove_watcher() i=4 2024-09-13T19:16:16.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.497+0000 7f6adb730800 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93955901712704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5573d0256320 con 0x7f6ac8017050 2024-09-13T19:16:16.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.498+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93955901712704] v34'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ac0051070 con 0x7f6ac8017050 2024-09-13T19:16:16.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.498+0000 7f6adb730800 20 remove_watcher() i=5 2024-09-13T19:16:16.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.498+0000 7f6adb730800 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93955901717632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5573d02543c0 con 0x7f6ac8017050 2024-09-13T19:16:16.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.499+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93955901717632] v34'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ac0051070 con 0x7f6ac8017050 2024-09-13T19:16:16.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.499+0000 7f6adb730800 20 remove_watcher() i=6 2024-09-13T19:16:16.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.499+0000 7f6adb730800 1 -- 172.21.15.102:0/2946820856 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93955901726144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5573d0256320 con 0x7f6ac8017050 2024-09-13T19:16:16.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.500+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93955901726144] v34'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ac0051070 con 0x7f6ac8017050 2024-09-13T19:16:16.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.500+0000 7f6adb730800 20 remove_watcher() i=7 2024-09-13T19:16:16.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.500+0000 7f6adb730800 1 -- 172.21.15.102:0/2946820856 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f6ac8017050 msgr2=0x7f6ac804c130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.500+0000 7f6adb730800 1 --2- 172.21.15.102:0/2946820856 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f6ac8017050 0x7f6ac804c130 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.500+0000 7f6adb730800 1 -- 172.21.15.102:0/2946820856 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5573d0249b10 msgr2=0x5573d024bfd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.500+0000 7f6adb730800 1 --2- 172.21.15.102:0/2946820856 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5573d0249b10 0x5573d024bfd0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.500+0000 7f6adb730800 1 -- 172.21.15.102:0/2946820856 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f6ad0044070 msgr2=0x7f6ad0031a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.500+0000 7f6adb730800 1 --2- 172.21.15.102:0/2946820856 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f6ad0044070 0x7f6ad0031a30 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.500+0000 7f6adb730800 1 -- 172.21.15.102:0/2946820856 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5573d024e520 msgr2=0x5573d0250910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.500+0000 7f6adb730800 1 --2- 172.21.15.102:0/2946820856 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5573d024e520 0x5573d0250910 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.500+0000 7f6adb730800 1 -- 172.21.15.102:0/2946820856 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f69a0036b40 msgr2=0x7f69a0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.500+0000 7f6adb730800 1 --2- 172.21.15.102:0/2946820856 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f69a0036b40 0x7f69a0039000 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6ac802c540 tx=0x7f6ac8037000 comp rx=0 tx=0).stop 2024-09-13T19:16:16.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.500+0000 7f6adb730800 1 -- 172.21.15.102:0/2946820856 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0236b30 msgr2=0x5573d023e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.500+0000 7f6adb730800 1 --2- 172.21.15.102:0/2946820856 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0236b30 0x5573d023e0e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6ad004cd60 tx=0x7f6ad004cd90 comp rx=0 tx=0).stop 2024-09-13T19:16:16.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.500+0000 7f6acffff640 1 -- 172.21.15.102:0/2946820856 reap_dead start 2024-09-13T19:16:16.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.500+0000 7f6adb730800 1 -- 172.21.15.102:0/2946820856 shutdown_connections 2024-09-13T19:16:16.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.500+0000 7f6adb730800 1 --2- 172.21.15.102:0/2946820856 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0236b30 0x5573d023e0e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.500+0000 7f6adb730800 1 -- 172.21.15.102:0/2946820856 >> 172.21.15.102:0/2946820856 conn(0x5573d0232f20 msgr2=0x5573d0230ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:16.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.500+0000 7f6adb730800 1 -- 172.21.15.102:0/2946820856 shutdown_connections 2024-09-13T19:16:16.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.500+0000 7f6adb730800 1 -- 172.21.15.102:0/2946820856 wait complete. 2024-09-13T19:16:16.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.501+0000 7f6adb730800 1 -- 172.21.15.102:0/4290191646 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f69b0036c00 msgr2=0x7f69b00390c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.501+0000 7f6adb730800 1 --2- 172.21.15.102:0/4290191646 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f69b0036c00 0x7f69b00390c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6ac804b040 tx=0x7f6ac804af10 comp rx=0 tx=0).stop 2024-09-13T19:16:16.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.501+0000 7f6adb730800 1 -- 172.21.15.102:0/4290191646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0229f00 msgr2=0x5573d022a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.501+0000 7f6adb730800 1 --2- 172.21.15.102:0/4290191646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0229f00 0x5573d022a320 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x5573d02102e0 tx=0x7f6ad00167b0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.501+0000 7f6adb730800 1 -- 172.21.15.102:0/4290191646 shutdown_connections 2024-09-13T19:16:16.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.501+0000 7f6adb730800 1 --2- 172.21.15.102:0/4290191646 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f69b0036c00 0x7f69b00390c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.501+0000 7f6adb730800 1 --2- 172.21.15.102:0/4290191646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0229f00 0x5573d022a320 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.501+0000 7f6adb730800 1 -- 172.21.15.102:0/4290191646 >> 172.21.15.102:0/4290191646 conn(0x5573d021ee90 msgr2=0x5573d0221a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:16.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.501+0000 7f6adb730800 1 -- 172.21.15.102:0/4290191646 shutdown_connections 2024-09-13T19:16:16.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.501+0000 7f6adb730800 1 -- 172.21.15.102:0/4290191646 wait complete. 2024-09-13T19:16:16.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.501+0000 7f6adb730800 1 -- 172.21.15.102:0/3618567252 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5573d011b900 msgr2=0x5573d02162a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.501+0000 7f6adb730800 1 --2- 172.21.15.102:0/3618567252 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5573d011b900 0x5573d02162a0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.501+0000 7f6adb730800 1 -- 172.21.15.102:0/3618567252 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5573d0218af0 msgr2=0x5573d021aee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.501+0000 7f6adb730800 1 --2- 172.21.15.102:0/3618567252 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5573d0218af0 0x5573d021aee0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.501+0000 7f6adb730800 1 -- 172.21.15.102:0/3618567252 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f69bc036b90 msgr2=0x7f69bc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.501+0000 7f6adb730800 1 --2- 172.21.15.102:0/3618567252 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f69bc036b90 0x7f69bc039050 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0057000 tx=0x7f6ac0052000 comp rx=0 tx=0).stop 2024-09-13T19:16:16.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.501+0000 7f6adb730800 1 -- 172.21.15.102:0/3618567252 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d01174c0 msgr2=0x5573d020f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.501+0000 7f6adb730800 1 --2- 172.21.15.102:0/3618567252 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d01174c0 0x5573d020f230 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8001e10 tx=0x7f6ac8000ed0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.501+0000 7f6adb730800 1 -- 172.21.15.102:0/3618567252 shutdown_connections 2024-09-13T19:16:16.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.501+0000 7f6adb730800 1 --2- 172.21.15.102:0/3618567252 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5573d0218af0 0x5573d021aee0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.501+0000 7f6adb730800 1 --2- 172.21.15.102:0/3618567252 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5573d011b900 0x5573d02162a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.501+0000 7f6adb730800 1 --2- 172.21.15.102:0/3618567252 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f69bc036b90 0x7f69bc039050 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.501+0000 7f6adb730800 1 --2- 172.21.15.102:0/3618567252 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d01174c0 0x5573d020f230 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.501+0000 7f6adb730800 1 -- 172.21.15.102:0/3618567252 >> 172.21.15.102:0/3618567252 conn(0x5573d0112df0 msgr2=0x5573d0200a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:16.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.501+0000 7f6adb730800 1 -- 172.21.15.102:0/3618567252 shutdown_connections 2024-09-13T19:16:16.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.501+0000 7f6adb730800 1 -- 172.21.15.102:0/3618567252 wait complete. 2024-09-13T19:16:16.514 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:16:14.779675Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:16:14.779665Z', 'tags': [], 'group_ids': []} 2024-09-13T19:16:16.514 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-13T19:16:16.514 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-13T19:16:16.515 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2024-09-13T19:16:16.563 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:16.563 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:16.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.560+0000 7fdca090c800 1 Processor -- start 2024-09-13T19:16:16.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.560+0000 7fdca090c800 1 -- start start 2024-09-13T19:16:16.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.560+0000 7fdca090c800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55d286c84610 0x55d286d156b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.560+0000 7fdca090c800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d286bcfb30 con 0x55d286d15bf0 2024-09-13T19:16:16.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.560+0000 7fdca090c800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55d286bb1360 con 0x55d286c84610 2024-09-13T19:16:16.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.561+0000 7fdc9e400640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55d286c84610 0x55d286d156b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.561+0000 7fdc9dbff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55d286d15bf0 0x55d286d17fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:49894/0 (socket says 172.21.15.102:49894) 2024-09-13T19:16:16.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.561+0000 7fdc9dbff640 1 -- 172.21.15.102:0/1052861199 learned_addr learned my addr 172.21.15.102:0/1052861199 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:16:16.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.561+0000 7fdc9e400640 1 -- 172.21.15.102:0/1052861199 >> v1:172.21.15.53:6789/0 conn(0x55d286d15bf0 legacy=0x55d286d17fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.561+0000 7fdc9e400640 1 -- 172.21.15.102:0/1052861199 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d286bd7e00 con 0x55d286c84610 2024-09-13T19:16:16.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.563+0000 7fdc9e400640 1 --2- 172.21.15.102:0/1052861199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d286c84610 0x55d286d156b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fdc90005fd0 tx=0x7fdc90045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5fdd8b46147777c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.563+0000 7fdc9d3fe640 1 -- 172.21.15.102:0/1052861199 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc90058530 con 0x55d286c84610 2024-09-13T19:16:16.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.563+0000 7fdc9d3fe640 1 -- 172.21.15.102:0/1052861199 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc900586d0 con 0x55d286c84610 2024-09-13T19:16:16.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.563+0000 7fdc9d3fe640 1 -- 172.21.15.102:0/1052861199 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc900589d0 con 0x55d286c84610 2024-09-13T19:16:16.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.563+0000 7fdca090c800 1 -- 172.21.15.102:0/1052861199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d286c84610 msgr2=0x55d286d156b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.563+0000 7fdca090c800 1 --2- 172.21.15.102:0/1052861199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d286c84610 0x55d286d156b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fdc90005fd0 tx=0x7fdc90045c30 comp rx=0 tx=0).stop 2024-09-13T19:16:16.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.563+0000 7fdca090c800 1 -- 172.21.15.102:0/1052861199 shutdown_connections 2024-09-13T19:16:16.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.563+0000 7fdca090c800 1 --2- 172.21.15.102:0/1052861199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d286c84610 0x55d286d156b0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.563+0000 7fdca090c800 1 -- 172.21.15.102:0/1052861199 >> 172.21.15.102:0/1052861199 conn(0x55d286d0ae00 msgr2=0x55d286d0d220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:16.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.563+0000 7fdca090c800 1 -- 172.21.15.102:0/1052861199 shutdown_connections 2024-09-13T19:16:16.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.563+0000 7fdca090c800 1 -- 172.21.15.102:0/1052861199 wait complete. 2024-09-13T19:16:16.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.577+0000 7fdca090c800 1 Processor -- start 2024-09-13T19:16:16.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.578+0000 7fdca090c800 1 -- start start 2024-09-13T19:16:16.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.578+0000 7fdca090c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d286c84610 0x55d286e01b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.578+0000 7fdca090c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d286c5c350 con 0x55d286c84610 2024-09-13T19:16:16.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.578+0000 7fdc9e400640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d286c84610 0x55d286e01b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.578+0000 7fdc9e400640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d286c84610 0x55d286e01b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54566/0 (socket says 172.21.15.102:54566) 2024-09-13T19:16:16.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.578+0000 7fdc9e400640 1 -- 172.21.15.102:0/4120096598 learned_addr learned my addr 172.21.15.102:0/4120096598 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:16.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.578+0000 7fdc9e400640 1 -- 172.21.15.102:0/4120096598 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d286ba9bc0 con 0x55d286c84610 2024-09-13T19:16:16.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.578+0000 7fdc9e400640 1 --2- 172.21.15.102:0/4120096598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d286c84610 0x55d286e01b10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fdc9000a3f0 tx=0x7fdc90051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbc3113f983a90e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.579+0000 7fdb8c608640 1 -- 172.21.15.102:0/4120096598 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc90058a30 con 0x55d286c84610 2024-09-13T19:16:16.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.579+0000 7fdb8c608640 1 -- 172.21.15.102:0/4120096598 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc90068070 con 0x55d286c84610 2024-09-13T19:16:16.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.579+0000 7fdb8c608640 1 -- 172.21.15.102:0/4120096598 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc90058d60 con 0x55d286c84610 2024-09-13T19:16:16.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.579+0000 7fdca090c800 1 -- 172.21.15.102:0/4120096598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d286c84610 msgr2=0x55d286e01b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.579+0000 7fdca090c800 1 --2- 172.21.15.102:0/4120096598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d286c84610 0x55d286e01b10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fdc9000a3f0 tx=0x7fdc90051000 comp rx=0 tx=0).stop 2024-09-13T19:16:16.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.579+0000 7fdca090c800 1 -- 172.21.15.102:0/4120096598 shutdown_connections 2024-09-13T19:16:16.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.579+0000 7fdca090c800 1 --2- 172.21.15.102:0/4120096598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d286c84610 0x55d286e01b10 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.579+0000 7fdca090c800 1 -- 172.21.15.102:0/4120096598 >> 172.21.15.102:0/4120096598 conn(0x55d286d0ae00 msgr2=0x55d286dfd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:16.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.579+0000 7fdca090c800 1 -- 172.21.15.102:0/4120096598 shutdown_connections 2024-09-13T19:16:16.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.579+0000 7fdca090c800 1 -- 172.21.15.102:0/4120096598 wait complete. 2024-09-13T19:16:16.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.580+0000 7fdca090c800 1 Processor -- start 2024-09-13T19:16:16.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.580+0000 7fdca090c800 1 -- start start 2024-09-13T19:16:16.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.580+0000 7fdca090c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d286c84610 0x55d286e094a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.580+0000 7fdca090c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d286d199a0 con 0x55d286c84610 2024-09-13T19:16:16.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.580+0000 7fdc9e400640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d286c84610 0x55d286e094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.580+0000 7fdc9e400640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d286c84610 0x55d286e094a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54582/0 (socket says 172.21.15.102:54582) 2024-09-13T19:16:16.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.580+0000 7fdc9e400640 1 -- 172.21.15.102:0/2972179665 learned_addr learned my addr 172.21.15.102:0/2972179665 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:16.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.580+0000 7fdc9e400640 1 -- 172.21.15.102:0/2972179665 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d286bbdfe0 con 0x55d286c84610 2024-09-13T19:16:16.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.580+0000 7fdc9e400640 1 --2- 172.21.15.102:0/2972179665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d286c84610 0x55d286e094a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdc90046130 tx=0x7fdc90003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.581+0000 7fdb8ae05640 1 -- 172.21.15.102:0/2972179665 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc90063630 con 0x55d286c84610 2024-09-13T19:16:16.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.581+0000 7fdb8ae05640 1 -- 172.21.15.102:0/2972179665 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc900637d0 con 0x55d286c84610 2024-09-13T19:16:16.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.581+0000 7fdca090c800 1 -- 172.21.15.102:0/2972179665 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d286e099e0 con 0x55d286c84610 2024-09-13T19:16:16.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.581+0000 7fdb8ae05640 1 -- 172.21.15.102:0/2972179665 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc90063af0 con 0x55d286c84610 2024-09-13T19:16:16.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.581+0000 7fdca090c800 1 -- 172.21.15.102:0/2972179665 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d286e09f60 con 0x55d286c84610 2024-09-13T19:16:16.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.581+0000 7fdb8ae05640 1 -- 172.21.15.102:0/2972179665 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fdc90063c90 con 0x55d286c84610 2024-09-13T19:16:16.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.582+0000 7fdb8ae05640 1 --2- 172.21.15.102:0/2972179665 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdb84036b40 0x7fdb84039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.582+0000 7fdb8ae05640 1 -- 172.21.15.102:0/2972179665 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fdc90090d70 con 0x55d286c84610 2024-09-13T19:16:16.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.582+0000 7fdc9dbff640 1 --2- 172.21.15.102:0/2972179665 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdb84036b40 0x7fdb84039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.582+0000 7fdca090c800 1 --2- 172.21.15.102:0/2972179665 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55d286d15bf0 0x55d286e10510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.582+0000 7fdca090c800 1 -- 172.21.15.102:0/2972179665 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d286e10a50 con 0x55d286d15bf0 2024-09-13T19:16:16.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.582+0000 7fdc9ec01640 1 --2- 172.21.15.102:0/2972179665 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55d286d15bf0 0x55d286e10510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.582+0000 7fdc9dbff640 1 --2- 172.21.15.102:0/2972179665 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdb84036b40 0x7fdb84039000 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdc94000f60 tx=0x7fdc940012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.582+0000 7fdc9ec01640 1 --2- 172.21.15.102:0/2972179665 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55d286d15bf0 0x55d286e10510 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.582+0000 7fdc9ec01640 1 -- 172.21.15.102:0/2972179665 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdc980083e0 con 0x55d286d15bf0 2024-09-13T19:16:16.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.583+0000 7fdca090c800 1 -- 172.21.15.102:0/2972179665 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d286e0dac0 con 0x55d286d15bf0 2024-09-13T19:16:16.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.583+0000 7fdc9ec01640 1 -- 172.21.15.102:0/2972179665 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdc980083e0 con 0x55d286d15bf0 2024-09-13T19:16:16.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.583+0000 7fdca090c800 1 --2- 172.21.15.102:0/2972179665 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55d286e12d40 0x55d286e15130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.583+0000 7fdca090c800 1 -- 172.21.15.102:0/2972179665 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d286e15820 con 0x55d286e12d40 2024-09-13T19:16:16.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.583+0000 7fdc9e400640 1 --2- 172.21.15.102:0/2972179665 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55d286e12d40 0x55d286e15130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.583+0000 7fdc9e400640 1 --2- 172.21.15.102:0/2972179665 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55d286e12d40 0x55d286e15130 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.583+0000 7fdc9e400640 1 -- 172.21.15.102:0/2972179665 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdc9007fc90 con 0x55d286e12d40 2024-09-13T19:16:16.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.583+0000 7fdca090c800 1 -- 172.21.15.102:0/2972179665 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d286e11be0 con 0x55d286d15bf0 2024-09-13T19:16:16.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.584+0000 7fdc9ec01640 1 -- 172.21.15.102:0/2972179665 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdc980083e0 con 0x55d286d15bf0 2024-09-13T19:16:16.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.584+0000 7fdca090c800 1 -- 172.21.15.102:0/2972179665 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d286e12080 con 0x55d286e12d40 2024-09-13T19:16:16.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.584+0000 7fdc9e400640 1 -- 172.21.15.102:0/2972179665 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdc9007fc90 con 0x55d286e12d40 2024-09-13T19:16:16.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.584+0000 7fdca090c800 1 Processor -- start 2024-09-13T19:16:16.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.584+0000 7fdca090c800 1 -- start start 2024-09-13T19:16:16.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.584+0000 7fdca090c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d286e241a0 0x55d286e245c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.584+0000 7fdca090c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d286bab580 con 0x55d286e241a0 2024-09-13T19:16:16.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.585+0000 7fdc9ec01640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d286e241a0 0x55d286e245c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.585+0000 7fdc9ec01640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d286e241a0 0x55d286e245c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54596/0 (socket says 172.21.15.102:54596) 2024-09-13T19:16:16.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.585+0000 7fdc9ec01640 1 -- 172.21.15.102:0/3770842257 learned_addr learned my addr 172.21.15.102:0/3770842257 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:16.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.585+0000 7fdc9ec01640 1 -- 172.21.15.102:0/3770842257 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d286e24b00 con 0x55d286e241a0 2024-09-13T19:16:16.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.585+0000 7fdc9ec01640 1 --2- 172.21.15.102:0/3770842257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d286e241a0 0x55d286e245c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x55d286e0a550 tx=0x7fdc9800beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.585+0000 7fdb83fff640 1 -- 172.21.15.102:0/3770842257 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc9801c020 con 0x55d286e241a0 2024-09-13T19:16:16.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.585+0000 7fdb83fff640 1 -- 172.21.15.102:0/3770842257 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc98007c30 con 0x55d286e241a0 2024-09-13T19:16:16.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.585+0000 7fdca090c800 1 -- 172.21.15.102:0/3770842257 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d286e24d90 con 0x55d286e241a0 2024-09-13T19:16:16.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.585+0000 7fdb83fff640 1 -- 172.21.15.102:0/3770842257 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc98018440 con 0x55d286e241a0 2024-09-13T19:16:16.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.585+0000 7fdca090c800 1 -- 172.21.15.102:0/3770842257 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d286e27a70 con 0x55d286e241a0 2024-09-13T19:16:16.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.586+0000 7fdb83fff640 1 -- 172.21.15.102:0/3770842257 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fdc9801f020 con 0x55d286e241a0 2024-09-13T19:16:16.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.586+0000 7fdb83fff640 1 --2- 172.21.15.102:0/3770842257 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdb78036c00 0x7fdb780390c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.586+0000 7fdb83fff640 1 -- 172.21.15.102:0/3770842257 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fdc9804e280 con 0x55d286e241a0 2024-09-13T19:16:16.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.586+0000 7fdc9e400640 1 --2- 172.21.15.102:0/3770842257 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdb78036c00 0x7fdb780390c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.587+0000 7fdca090c800 1 Processor -- start 2024-09-13T19:16:16.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.587+0000 7fdca090c800 1 -- start start 2024-09-13T19:16:16.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.587+0000 7fdc9e400640 1 --2- 172.21.15.102:0/3770842257 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdb78036c00 0x7fdb780390c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdc9008f1c0 tx=0x7fdc90077fc0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.587+0000 7fdca090c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d286e30e70 0x55d286e31270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.587+0000 7fdca090c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d286e02200 con 0x55d286e30e70 2024-09-13T19:16:16.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.587+0000 7fdc9ec01640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d286e30e70 0x55d286e31270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.587+0000 7fdc9ec01640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d286e30e70 0x55d286e31270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54602/0 (socket says 172.21.15.102:54602) 2024-09-13T19:16:16.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.587+0000 7fdc9ec01640 1 -- 172.21.15.102:0/2701306873 learned_addr learned my addr 172.21.15.102:0/2701306873 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:16.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.587+0000 7fdc9ec01640 1 -- 172.21.15.102:0/2701306873 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d286e31840 con 0x55d286e30e70 2024-09-13T19:16:16.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.588+0000 7fdc9ec01640 1 --2- 172.21.15.102:0/2701306873 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d286e30e70 0x55d286e31270 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fdc9804c600 tx=0x7fdc98016630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cca4aa996b05b64 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.588+0000 7fdb81ffb640 1 -- 172.21.15.102:0/2701306873 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc98045070 con 0x55d286e30e70 2024-09-13T19:16:16.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.588+0000 7fdb81ffb640 1 -- 172.21.15.102:0/2701306873 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc980187c0 con 0x55d286e30e70 2024-09-13T19:16:16.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.588+0000 7fdb81ffb640 1 -- 172.21.15.102:0/2701306873 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc98021400 con 0x55d286e30e70 2024-09-13T19:16:16.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.588+0000 7fdca090c800 1 -- 172.21.15.102:0/2701306873 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d286e30e70 msgr2=0x55d286e31270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.588+0000 7fdca090c800 1 --2- 172.21.15.102:0/2701306873 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d286e30e70 0x55d286e31270 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fdc9804c600 tx=0x7fdc98016630 comp rx=0 tx=0).stop 2024-09-13T19:16:16.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.588+0000 7fdca090c800 1 -- 172.21.15.102:0/2701306873 shutdown_connections 2024-09-13T19:16:16.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.588+0000 7fdca090c800 1 --2- 172.21.15.102:0/2701306873 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d286e30e70 0x55d286e31270 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.588+0000 7fdca090c800 1 -- 172.21.15.102:0/2701306873 >> 172.21.15.102:0/2701306873 conn(0x55d286e2d1d0 msgr2=0x55d286e2b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:16.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.588+0000 7fdca090c800 1 -- 172.21.15.102:0/2701306873 shutdown_connections 2024-09-13T19:16:16.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.588+0000 7fdca090c800 1 -- 172.21.15.102:0/2701306873 wait complete. 2024-09-13T19:16:16.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.588+0000 7fdca090c800 1 Processor -- start 2024-09-13T19:16:16.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.589+0000 7fdca090c800 1 -- start start 2024-09-13T19:16:16.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.589+0000 7fdca090c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d286e30e70 0x55d286e382e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.589+0000 7fdca090c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d286e31eb0 con 0x55d286e30e70 2024-09-13T19:16:16.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.589+0000 7fdc9ec01640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d286e30e70 0x55d286e382e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.589+0000 7fdc9ec01640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d286e30e70 0x55d286e382e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54606/0 (socket says 172.21.15.102:54606) 2024-09-13T19:16:16.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.589+0000 7fdc9ec01640 1 -- 172.21.15.102:0/3933299801 learned_addr learned my addr 172.21.15.102:0/3933299801 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:16.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.589+0000 7fdc9ec01640 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d286e38820 con 0x55d286e30e70 2024-09-13T19:16:16.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.589+0000 7fdc9ec01640 1 --2- 172.21.15.102:0/3933299801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d286e30e70 0x55d286e382e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fdc98043040 tx=0x7fdc9804c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.589+0000 7fdb6ffff640 1 -- 172.21.15.102:0/3933299801 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc98045030 con 0x55d286e30e70 2024-09-13T19:16:16.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.589+0000 7fdb6ffff640 1 -- 172.21.15.102:0/3933299801 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc9804e070 con 0x55d286e30e70 2024-09-13T19:16:16.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.589+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d286e38ab0 con 0x55d286e30e70 2024-09-13T19:16:16.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.589+0000 7fdb6ffff640 1 -- 172.21.15.102:0/3933299801 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc9803fe60 con 0x55d286e30e70 2024-09-13T19:16:16.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.589+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d286e3b760 con 0x55d286e30e70 2024-09-13T19:16:16.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.590+0000 7fdb6ffff640 1 -- 172.21.15.102:0/3933299801 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fdc98016040 con 0x55d286e30e70 2024-09-13T19:16:16.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.590+0000 7fdb6ffff640 1 --2- 172.21.15.102:0/3933299801 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdb68036af0 0x7fdb68038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.590+0000 7fdb6ffff640 1 -- 172.21.15.102:0/3933299801 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fdc98046070 con 0x55d286e30e70 2024-09-13T19:16:16.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.591+0000 7fdc9e400640 1 --2- 172.21.15.102:0/3933299801 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdb68036af0 0x7fdb68038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.591+0000 7fdc9e400640 1 --2- 172.21.15.102:0/3933299801 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdb68036af0 0x7fdb68038fb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdc90059f90 tx=0x7fdc90094000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.591+0000 7fdca090c800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.591+0000 7fdca090c800 1 --2- 172.21.15.102:0/3933299801 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55d286e43ce0 0x55d286e461a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.591+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d286e468f0 con 0x55d286e43ce0 2024-09-13T19:16:16.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.591+0000 7fdc9dbff640 1 --2- 172.21.15.102:0/3933299801 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55d286e43ce0 0x55d286e461a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.592+0000 7fdc9dbff640 1 --2- 172.21.15.102:0/3933299801 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55d286e43ce0 0x55d286e461a0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.592+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdc94009050 con 0x55d286e43ce0 2024-09-13T19:16:16.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.592+0000 7fdca090c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:16.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.592+0000 7fdca090c800 20 realm 2024-09-13T19:16:16.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.592+0000 7fdca090c800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.592+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d286e43130 con 0x55d286e43ce0 2024-09-13T19:16:16.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.592+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdc94009050 con 0x55d286e43ce0 2024-09-13T19:16:16.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.592+0000 7fdca090c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:16.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.592+0000 7fdca090c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:16.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.592+0000 7fdca090c800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.592+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d286e473e0 con 0x55d286e43ce0 2024-09-13T19:16:16.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.592+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdc94009050 con 0x55d286e43ce0 2024-09-13T19:16:16.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.592+0000 7fdca090c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:16.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.592+0000 7fdca090c800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.592+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d286e47cb0 con 0x55d286e43ce0 2024-09-13T19:16:16.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.592+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdc94009050 con 0x55d286e43ce0 2024-09-13T19:16:16.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.592+0000 7fdca090c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:16.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.593+0000 7fdca090c800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.593+0000 7fdca090c800 1 --2- 172.21.15.102:0/3933299801 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55d286e485f0 0x55d286e4a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.593+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d286e4b170 con 0x55d286e485f0 2024-09-13T19:16:16.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.593+0000 7fdc9ec01640 1 --2- 172.21.15.102:0/3933299801 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55d286e485f0 0x55d286e4a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.593+0000 7fdc9ec01640 1 --2- 172.21.15.102:0/3933299801 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55d286e485f0 0x55d286e4a9e0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.593+0000 7fdc9ec01640 1 -- 172.21.15.102:0/3933299801 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdc98028070 con 0x55d286e485f0 2024-09-13T19:16:16.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.593+0000 7fdca090c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:16.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.593+0000 7fdca090c800 20 searching for the correct realm 2024-09-13T19:16:16.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.593+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d286e4cac0 con 0x55d286e485f0 2024-09-13T19:16:16.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.593+0000 7fdc9ec01640 1 -- 172.21.15.102:0/3933299801 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc98028070 con 0x55d286e485f0 2024-09-13T19:16:16.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.593+0000 7fdc9ec01640 1 --2- 172.21.15.102:0/3933299801 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fdc98021020 0x7fdc98028780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.593+0000 7fdc9ec01640 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d286e4cac0 con 0x7fdc98021020 2024-09-13T19:16:16.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.593+0000 7fdc9e400640 1 --2- 172.21.15.102:0/3933299801 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fdc98021020 0x7fdc98028780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.594+0000 7fdc9e400640 1 --2- 172.21.15.102:0/3933299801 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fdc98021020 0x7fdc98028780 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.594+0000 7fdc9e400640 1 -- 172.21.15.102:0/3933299801 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc900a2040 con 0x7fdc98021020 2024-09-13T19:16:16.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.594+0000 7fdc9e400640 1 --2- 172.21.15.102:0/3933299801 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fdc900a5040 0x7fdc9004e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.594+0000 7fdc9e400640 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d286e4cac0 con 0x7fdc900a5040 2024-09-13T19:16:16.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.594+0000 7fdc9dbff640 1 --2- 172.21.15.102:0/3933299801 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fdc900a5040 0x7fdc9004e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.595+0000 7fdc9dbff640 1 --2- 172.21.15.102:0/3933299801 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fdc900a5040 0x7fdc9004e7d0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.595+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc94009050 con 0x7fdc900a5040 2024-09-13T19:16:16.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.595+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d286e4cac0 con 0x55d286e43ce0 2024-09-13T19:16:16.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.595+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc94009050 con 0x55d286e43ce0 2024-09-13T19:16:16.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.595+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d286e4cac0 con 0x55d286e43ce0 2024-09-13T19:16:16.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.595+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc94029040 con 0x55d286e43ce0 2024-09-13T19:16:16.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.595+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d286e4cac0 con 0x7fdc900a5040 2024-09-13T19:16:16.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.595+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc94029040 con 0x7fdc900a5040 2024-09-13T19:16:16.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.596+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d286e4cac0 con 0x7fdc900a5040 2024-09-13T19:16:16.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.596+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc94029040 con 0x7fdc900a5040 2024-09-13T19:16:16.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.596+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d286e4cac0 con 0x7fdc98021020 2024-09-13T19:16:16.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.596+0000 7fdc9e400640 1 -- 172.21.15.102:0/3933299801 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc900a2040 con 0x7fdc98021020 2024-09-13T19:16:16.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.596+0000 7fdc9e400640 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d286e4cac0 con 0x55d286e485f0 2024-09-13T19:16:16.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.596+0000 7fdc9ec01640 1 -- 172.21.15.102:0/3933299801 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc98028070 con 0x55d286e485f0 2024-09-13T19:16:16.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.596+0000 7fdc9ec01640 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d286e4cac0 con 0x55d286e43ce0 2024-09-13T19:16:16.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.596+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc94029040 con 0x55d286e43ce0 2024-09-13T19:16:16.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.596+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d286e4cac0 con 0x7fdc900a5040 2024-09-13T19:16:16.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.597+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc94029040 con 0x7fdc900a5040 2024-09-13T19:16:16.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.597+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d286e4cac0 con 0x55d286e43ce0 2024-09-13T19:16:16.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.597+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc94029040 con 0x55d286e43ce0 2024-09-13T19:16:16.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.597+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d286e4cac0 con 0x7fdc98021020 2024-09-13T19:16:16.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.597+0000 7fdc9e400640 1 -- 172.21.15.102:0/3933299801 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdc900a2040 con 0x7fdc98021020 2024-09-13T19:16:16.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.597+0000 7fdc9e400640 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d286e4cac0 con 0x55d286e485f0 2024-09-13T19:16:16.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.597+0000 7fdc9ec01640 1 -- 172.21.15.102:0/3933299801 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc98028070 con 0x55d286e485f0 2024-09-13T19:16:16.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.597+0000 7fdc9ec01640 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d286e4cac0 con 0x55d286e485f0 2024-09-13T19:16:16.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.598+0000 7fdc9ec01640 1 -- 172.21.15.102:0/3933299801 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdc98028070 con 0x55d286e485f0 2024-09-13T19:16:16.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.598+0000 7fdc9ec01640 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d286e4cac0 con 0x7fdc900a5040 2024-09-13T19:16:16.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.598+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc94029040 con 0x7fdc900a5040 2024-09-13T19:16:16.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.598+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d286e4cac0 con 0x55d286e485f0 2024-09-13T19:16:16.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.598+0000 7fdc9ec01640 1 -- 172.21.15.102:0/3933299801 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdc98028070 con 0x55d286e485f0 2024-09-13T19:16:16.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.598+0000 7fdc9ec01640 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d286e4cac0 con 0x55d286e485f0 2024-09-13T19:16:16.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.598+0000 7fdc9ec01640 1 -- 172.21.15.102:0/3933299801 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc98028070 con 0x55d286e485f0 2024-09-13T19:16:16.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.598+0000 7fdc9ec01640 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d286e4cac0 con 0x55d286e43ce0 2024-09-13T19:16:16.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.599+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc94029040 con 0x55d286e43ce0 2024-09-13T19:16:16.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.599+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d286e4cac0 con 0x55d286e43ce0 2024-09-13T19:16:16.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.599+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdc94029040 con 0x55d286e43ce0 2024-09-13T19:16:16.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.599+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d286e4cac0 con 0x7fdc900a5040 2024-09-13T19:16:16.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.599+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc94029040 con 0x7fdc900a5040 2024-09-13T19:16:16.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.599+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d286e4cac0 con 0x55d286e485f0 2024-09-13T19:16:16.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.599+0000 7fdc9ec01640 1 -- 172.21.15.102:0/3933299801 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc98028070 con 0x55d286e485f0 2024-09-13T19:16:16.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.599+0000 7fdc9ec01640 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d286e4cac0 con 0x7fdc98021020 2024-09-13T19:16:16.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.600+0000 7fdc9e400640 1 -- 172.21.15.102:0/3933299801 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc900a2040 con 0x7fdc98021020 2024-09-13T19:16:16.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.600+0000 7fdc9e400640 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d286e4cac0 con 0x55d286e43ce0 2024-09-13T19:16:16.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.600+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc94029040 con 0x55d286e43ce0 2024-09-13T19:16:16.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.600+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d286e4cac0 con 0x7fdc900a5040 2024-09-13T19:16:16.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.600+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc94029040 con 0x7fdc900a5040 2024-09-13T19:16:16.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.600+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d286e4cac0 con 0x55d286e485f0 2024-09-13T19:16:16.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.600+0000 7fdc9ec01640 1 -- 172.21.15.102:0/3933299801 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc98028070 con 0x55d286e485f0 2024-09-13T19:16:16.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.600+0000 7fdc9ec01640 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d286e4cac0 con 0x7fdc900a5040 2024-09-13T19:16:16.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.601+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc94029040 con 0x7fdc900a5040 2024-09-13T19:16:16.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.601+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d286e4cac0 con 0x7fdc98021020 2024-09-13T19:16:16.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.601+0000 7fdc9e400640 1 -- 172.21.15.102:0/3933299801 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc900a2040 con 0x7fdc98021020 2024-09-13T19:16:16.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.601+0000 7fdc9e400640 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d286e4cac0 con 0x55d286e485f0 2024-09-13T19:16:16.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.601+0000 7fdc9ec01640 1 -- 172.21.15.102:0/3933299801 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc98028070 con 0x55d286e485f0 2024-09-13T19:16:16.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.601+0000 7fdc9ec01640 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d286e4cac0 con 0x7fdc900a5040 2024-09-13T19:16:16.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.601+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc94029040 con 0x7fdc900a5040 2024-09-13T19:16:16.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.601+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d286e4cac0 con 0x55d286e43ce0 2024-09-13T19:16:16.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.601+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdc94029040 con 0x55d286e43ce0 2024-09-13T19:16:16.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.602+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d286e4cac0 con 0x7fdc98021020 2024-09-13T19:16:16.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.602+0000 7fdc9e400640 1 -- 172.21.15.102:0/3933299801 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc900a2040 con 0x7fdc98021020 2024-09-13T19:16:16.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.602+0000 7fdca090c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:16.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.602+0000 7fdca090c800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:16.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.602+0000 7fdca090c800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:16.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.602+0000 7fdca090c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:16.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.602+0000 7fdca090c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:16.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.602+0000 7fdca090c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:16.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.602+0000 7fdca090c800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.602+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d286e4bb30 con 0x55d286e43ce0 2024-09-13T19:16:16.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.602+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdc94029040 con 0x55d286e43ce0 2024-09-13T19:16:16.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.602+0000 7fdca090c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:16.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.602+0000 7fdca090c800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.602+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d286e4c3d0 con 0x55d286e43ce0 2024-09-13T19:16:16.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.602+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdc94029040 con 0x55d286e43ce0 2024-09-13T19:16:16.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.602+0000 7fdca090c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:16.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.602+0000 7fdca090c800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.602+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d286e4cf40 con 0x55d286e485f0 2024-09-13T19:16:16.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.603+0000 7fdc9ec01640 1 -- 172.21.15.102:0/3933299801 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdc98028070 con 0x55d286e485f0 2024-09-13T19:16:16.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.603+0000 7fdca090c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:16.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.603+0000 7fdca090c800 20 zone default found 2024-09-13T19:16:16.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.603+0000 7fdca090c800 4 Realm: () 2024-09-13T19:16:16.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.603+0000 7fdca090c800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:16.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.603+0000 7fdca090c800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:16.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.603+0000 7fdca090c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:16.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.603+0000 7fdca090c800 20 zonegroup default 2024-09-13T19:16:16.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.603+0000 7fdca090c800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.603+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d286e4d790 con 0x7fdc900a5040 2024-09-13T19:16:16.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.603+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdc94029040 con 0x7fdc900a5040 2024-09-13T19:16:16.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.603+0000 7fdca090c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:16.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.603+0000 7fdca090c800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.603+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d286e4f510 con 0x55d286e485f0 2024-09-13T19:16:16.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.603+0000 7fdc9ec01640 1 -- 172.21.15.102:0/3933299801 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdc98028070 con 0x55d286e485f0 2024-09-13T19:16:16.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.603+0000 7fdca090c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:16.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.603+0000 7fdca090c800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.603+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d286e4f920 con 0x55d286e485f0 2024-09-13T19:16:16.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.603+0000 7fdc9ec01640 1 -- 172.21.15.102:0/3933299801 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdc98028070 con 0x55d286e485f0 2024-09-13T19:16:16.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.603+0000 7fdca090c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:16.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.603+0000 7fdca090c800 20 started sync module instance, tier type = 2024-09-13T19:16:16.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.603+0000 7fdca090c800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:16.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.603+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d286e4e9b0 con 0x7fdc98021020 2024-09-13T19:16:16.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.604+0000 7fdc9e400640 1 -- 172.21.15.102:0/3933299801 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(44 notify.0 [create] v34'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc900a2040 con 0x7fdc98021020 2024-09-13T19:16:16.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.604+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94362694640896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d286e4f920 con 0x7fdc98021020 2024-09-13T19:16:16.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.604+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d286e50170 con 0x55d286e43ce0 2024-09-13T19:16:16.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.605+0000 7fdc9e400640 1 -- 172.21.15.102:0/3933299801 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94362694640896] v34'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc900a2040 con 0x7fdc98021020 2024-09-13T19:16:16.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.605+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v34'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc94029040 con 0x55d286e43ce0 2024-09-13T19:16:16.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.606+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94362694646976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d286e50590 con 0x55d286e43ce0 2024-09-13T19:16:16.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.606+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d286e50f50 con 0x55d286e485f0 2024-09-13T19:16:16.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.607+0000 7fdc9ec01640 1 -- 172.21.15.102:0/3933299801 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v34'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc98028070 con 0x55d286e485f0 2024-09-13T19:16:16.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.607+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94362694650528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d286e51370 con 0x55d286e485f0 2024-09-13T19:16:16.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.607+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d286e51e50 con 0x7fdc98021020 2024-09-13T19:16:16.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.607+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94362694646976] v34'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc94029040 con 0x55d286e43ce0 2024-09-13T19:16:16.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.608+0000 7fdc9e400640 1 -- 172.21.15.102:0/3933299801 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(50 notify.3 [create] v34'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc900a2040 con 0x7fdc98021020 2024-09-13T19:16:16.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.608+0000 7fdc9ec01640 1 -- 172.21.15.102:0/3933299801 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94362694650528] v34'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc98028070 con 0x55d286e485f0 2024-09-13T19:16:16.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.608+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94362694648032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d286e51960 con 0x7fdc98021020 2024-09-13T19:16:16.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.608+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d286e52890 con 0x55d286e43ce0 2024-09-13T19:16:16.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.609+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v34'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc94029040 con 0x55d286e43ce0 2024-09-13T19:16:16.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.609+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94362694657472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d286e52fd0 con 0x55d286e43ce0 2024-09-13T19:16:16.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.609+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d286e53ad0 con 0x7fdc900a5040 2024-09-13T19:16:16.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.609+0000 7fdc9e400640 1 -- 172.21.15.102:0/3933299801 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94362694648032] v34'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc900a2040 con 0x7fdc98021020 2024-09-13T19:16:16.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.610+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94362694657472] v34'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc94029040 con 0x55d286e43ce0 2024-09-13T19:16:16.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.610+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(54 notify.5 [create] v34'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc94029040 con 0x7fdc900a5040 2024-09-13T19:16:16.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.610+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94362694661568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d286e53a90 con 0x7fdc900a5040 2024-09-13T19:16:16.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.610+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d286e543a0 con 0x7fdc900a5040 2024-09-13T19:16:16.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.611+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94362694661568] v34'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc94029040 con 0x7fdc900a5040 2024-09-13T19:16:16.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.611+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(56 notify.6 [create] v34'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc94029040 con 0x7fdc900a5040 2024-09-13T19:16:16.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.611+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94362694651584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d286e53a90 con 0x7fdc900a5040 2024-09-13T19:16:16.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.611+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d286e549d0 con 0x7fdc900a5040 2024-09-13T19:16:16.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.612+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94362694651584] v34'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc94029040 con 0x7fdc900a5040 2024-09-13T19:16:16.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.612+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(58 notify.7 [create] v34'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc94029040 con 0x7fdc900a5040 2024-09-13T19:16:16.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.612+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94362694665408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d286e54990 con 0x7fdc900a5040 2024-09-13T19:16:16.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.612+0000 7fdca090c800 20 add_watcher() i=0 2024-09-13T19:16:16.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.612+0000 7fdca090c800 20 add_watcher() i=1 2024-09-13T19:16:16.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.612+0000 7fdca090c800 20 add_watcher() i=2 2024-09-13T19:16:16.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.612+0000 7fdca090c800 20 add_watcher() i=3 2024-09-13T19:16:16.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.612+0000 7fdca090c800 20 add_watcher() i=4 2024-09-13T19:16:16.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.612+0000 7fdca090c800 20 add_watcher() i=5 2024-09-13T19:16:16.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.612+0000 7fdca090c800 20 add_watcher() i=6 2024-09-13T19:16:16.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.613+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94362694665408] v34'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc94029040 con 0x7fdc900a5040 2024-09-13T19:16:16.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.613+0000 7fdca090c800 20 add_watcher() i=7 2024-09-13T19:16:16.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.613+0000 7fdca090c800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:16.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.613+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d286e57df0 con 0x55d286e43ce0 2024-09-13T19:16:16.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.613+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdc94029040 con 0x55d286e43ce0 2024-09-13T19:16:16.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.613+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94362694663840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d286e55310 con 0x55d286e43ce0 2024-09-13T19:16:16.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.614+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94362694663840] v34'78 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdc94029040 con 0x55d286e43ce0 2024-09-13T19:16:16.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.614+0000 7fdb54fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:16.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.614+0000 7fdca090c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:16.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.614+0000 7fdca090c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:16.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.614+0000 7fdca090c800 5 note: GC not initialized 2024-09-13T19:16:16.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.615+0000 7fdacf7fe640 20 reqs_thread_entry: start 2024-09-13T19:16:16.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.615+0000 7fdca090c800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:16.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.615+0000 7fdca090c800 20 Filter name: none 2024-09-13T19:16:16.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.615+0000 7fdacd7fa640 20 reqs_thread_entry: start 2024-09-13T19:16:16.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.615+0000 7fdca090c800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:16:16.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.615+0000 7fdca090c800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.615+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d286e8b260 con 0x55d286e43ce0 2024-09-13T19:16:16.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.615+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fdc94029040 con 0x55d286e43ce0 2024-09-13T19:16:16.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.615+0000 7fdca090c800 20 rados_obj.operate() r=0 bl.length=556 2024-09-13T19:16:16.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.615+0000 7fdca090c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:16:16.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.615+0000 7fdca090c800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:16:16.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.615+0000 7fdca090c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:16:16.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.615+0000 7fdca090c800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2024-09-13T19:16:16.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.615+0000 7fdca090c800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.615+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:63 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d286e8bfa0 con 0x7fdc98021020 2024-09-13T19:16:16.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.616+0000 7fdc9e400640 1 -- 172.21.15.102:0/3933299801 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(63 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7fdc900a2040 con 0x7fdc98021020 2024-09-13T19:16:16.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.616+0000 7fdca090c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:16.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.616+0000 7fdca090c800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2024-09-13T19:16:16.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.616+0000 7fdca090c800 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-13T19:16:16.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.616+0000 7fdca090c800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2024-09-13T19:16:16.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.616+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~673 in=673b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d286e91e50 con 0x55d286e43ce0 2024-09-13T19:16:16.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.617+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~673] v34'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fdc94029040 con 0x55d286e43ce0 2024-09-13T19:16:16.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.617+0000 7fdca090c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:16:16.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.617+0000 7fdca090c800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:16:16.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.617+0000 7fdca090c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T19:16:16.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.617+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94362694916128 in=861b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d286e8d880 con 0x55d286e43ce0 2024-09-13T19:16:16.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.617+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== watch-notify(notify (1) cookie 94362694657472 notify 146028888071 ret 0) ==== 891+0+0 (crc 0 0 0) 0x55d286bcfb30 con 0x55d286e43ce0 2024-09-13T19:16:16.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.617+0000 7fdb81ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888071 cookie 94362694657472 notifier 4398 bl.length()=849 2024-09-13T19:16:16.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.617+0000 7fdb81ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:16:16.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.617+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(65 notify.4 [notify cookie 94362694916128 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdc94029040 con 0x55d286e43ce0 2024-09-13T19:16:16.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.617+0000 7fdb81ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:16:16.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.617+0000 7fdb81ffb640 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fdb64003ea0 con 0x55d286e43ce0 2024-09-13T19:16:16.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.617+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc94029040 con 0x55d286e43ce0 2024-09-13T19:16:16.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.617+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== watch-notify(notify_complete (2) cookie 94362694916128 notify 146028888071 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fdc9403bbf0 con 0x55d286e43ce0 2024-09-13T19:16:16.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.617+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:67 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d286e91820 con 0x7fdc98021020 2024-09-13T19:16:16.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.619+0000 7fdc9e400640 1 -- 172.21.15.102:0/3933299801 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(67 foo:foo2 [delete,create,writefull 0~7] v34'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7fdc900a2040 con 0x7fdc98021020 2024-09-13T19:16:16.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.619+0000 7fdca090c800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-13T19:16:16.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.619+0000 7fdca090c800 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-13T19:16:16.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.619+0000 7fdca090c800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-13T19:16:16.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.619+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94362694916128 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d286e8d880 con 0x7fdc98021020 2024-09-13T19:16:16.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.619+0000 7fdc9e400640 1 -- 172.21.15.102:0/3933299801 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== watch-notify(notify (1) cookie 94362694640896 notify 146028888067 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7fdc90084040 con 0x7fdc98021020 2024-09-13T19:16:16.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.619+0000 7fdb81ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888067 cookie 94362694640896 notifier 4398 bl.length()=166 2024-09-13T19:16:16.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.619+0000 7fdb81ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-13T19:16:16.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.619+0000 7fdb81ffb640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-13T19:16:16.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.619+0000 7fdb81ffb640 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fdb64003ea0 con 0x7fdc98021020 2024-09-13T19:16:16.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.619+0000 7fdc9e400640 1 -- 172.21.15.102:0/3933299801 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(68 notify.0 [notify cookie 94362694916128 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdc900a2040 con 0x7fdc98021020 2024-09-13T19:16:16.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.619+0000 7fdc9e400640 1 -- 172.21.15.102:0/3933299801 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc900a2040 con 0x7fdc98021020 2024-09-13T19:16:16.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.619+0000 7fdc9e400640 1 -- 172.21.15.102:0/3933299801 <== osd.2 v2:172.21.15.102:6816/2238176080 16 ==== watch-notify(notify_complete (2) cookie 94362694916128 notify 146028888067 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d286e09f60 con 0x7fdc98021020 2024-09-13T19:16:16.638 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:16:14.779675Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-13T19:16:16.617088Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:16:14.779665Z","tags":[],"group_ids":[]} 2024-09-13T19:16:16.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.620+0000 7fdb54fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:16.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.620+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94362694663840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d286e88f70 con 0x55d286e43ce0 2024-09-13T19:16:16.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.621+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94362694663840] v34'79 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdc94029040 con 0x55d286e43ce0 2024-09-13T19:16:16.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.621+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94362694640896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d286e88f70 con 0x7fdc98021020 2024-09-13T19:16:16.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.622+0000 7fdc9e400640 1 -- 172.21.15.102:0/3933299801 <== osd.2 v2:172.21.15.102:6816/2238176080 17 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94362694640896] v34'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc900a2040 con 0x7fdc98021020 2024-09-13T19:16:16.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.622+0000 7fdca090c800 20 remove_watcher() i=0 2024-09-13T19:16:16.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.622+0000 7fdca090c800 2 removed watcher, disabling cache 2024-09-13T19:16:16.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.622+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94362694646976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d286e88f70 con 0x55d286e43ce0 2024-09-13T19:16:16.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.623+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 <== osd.1 v2:172.21.15.102:6808/2204418452 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94362694646976] v34'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc94029040 con 0x55d286e43ce0 2024-09-13T19:16:16.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.623+0000 7fdca090c800 20 remove_watcher() i=1 2024-09-13T19:16:16.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.623+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94362694650528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d286e88f70 con 0x55d286e485f0 2024-09-13T19:16:16.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.624+0000 7fdc9ec01640 1 -- 172.21.15.102:0/3933299801 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94362694650528] v34'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc98028070 con 0x55d286e485f0 2024-09-13T19:16:16.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.624+0000 7fdca090c800 20 remove_watcher() i=2 2024-09-13T19:16:16.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.624+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94362694648032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d286e88f70 con 0x7fdc98021020 2024-09-13T19:16:16.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.625+0000 7fdc9e400640 1 -- 172.21.15.102:0/3933299801 <== osd.2 v2:172.21.15.102:6816/2238176080 18 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94362694648032] v34'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc900a2040 con 0x7fdc98021020 2024-09-13T19:16:16.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.625+0000 7fdca090c800 20 remove_watcher() i=3 2024-09-13T19:16:16.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.625+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94362694657472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d286e88f70 con 0x55d286e43ce0 2024-09-13T19:16:16.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.626+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 <== osd.1 v2:172.21.15.102:6808/2204418452 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94362694657472] v34'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc94029040 con 0x55d286e43ce0 2024-09-13T19:16:16.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.626+0000 7fdca090c800 20 remove_watcher() i=4 2024-09-13T19:16:16.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.626+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94362694661568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d286e88f70 con 0x7fdc900a5040 2024-09-13T19:16:16.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.627+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94362694661568] v34'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc94029040 con 0x7fdc900a5040 2024-09-13T19:16:16.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.627+0000 7fdca090c800 20 remove_watcher() i=5 2024-09-13T19:16:16.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.627+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94362694651584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d286e88f70 con 0x7fdc900a5040 2024-09-13T19:16:16.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.628+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94362694651584] v34'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc94029040 con 0x7fdc900a5040 2024-09-13T19:16:16.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.628+0000 7fdca090c800 20 remove_watcher() i=6 2024-09-13T19:16:16.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.628+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94362694665408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d286e88f70 con 0x7fdc900a5040 2024-09-13T19:16:16.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.629+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94362694665408] v34'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc94029040 con 0x7fdc900a5040 2024-09-13T19:16:16.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.629+0000 7fdca090c800 20 remove_watcher() i=7 2024-09-13T19:16:16.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.629+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fdc900a5040 msgr2=0x7fdc9004e7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.629+0000 7fdca090c800 1 --2- 172.21.15.102:0/3933299801 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fdc900a5040 0x7fdc9004e7d0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.629+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55d286e43ce0 msgr2=0x55d286e461a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.629+0000 7fdca090c800 1 --2- 172.21.15.102:0/3933299801 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55d286e43ce0 0x55d286e461a0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.629+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fdc98021020 msgr2=0x7fdc98028780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.629+0000 7fdca090c800 1 --2- 172.21.15.102:0/3933299801 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fdc98021020 0x7fdc98028780 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.629+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55d286e485f0 msgr2=0x55d286e4a9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.629+0000 7fdca090c800 1 --2- 172.21.15.102:0/3933299801 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55d286e485f0 0x55d286e4a9e0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.629+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdb68036af0 msgr2=0x7fdb68038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.629+0000 7fdca090c800 1 --2- 172.21.15.102:0/3933299801 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdb68036af0 0x7fdb68038fb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdc90059f90 tx=0x7fdc90094000 comp rx=0 tx=0).stop 2024-09-13T19:16:16.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.629+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d286e30e70 msgr2=0x55d286e382e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.629+0000 7fdc9dbff640 1 -- 172.21.15.102:0/3933299801 reap_dead start 2024-09-13T19:16:16.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.629+0000 7fdca090c800 1 --2- 172.21.15.102:0/3933299801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d286e30e70 0x55d286e382e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fdc98043040 tx=0x7fdc9804c560 comp rx=0 tx=0).stop 2024-09-13T19:16:16.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.629+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 shutdown_connections 2024-09-13T19:16:16.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.629+0000 7fdca090c800 1 --2- 172.21.15.102:0/3933299801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d286e30e70 0x55d286e382e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.629+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 >> 172.21.15.102:0/3933299801 conn(0x55d286e2d1d0 msgr2=0x55d286e2b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:16.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.629+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 shutdown_connections 2024-09-13T19:16:16.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.629+0000 7fdca090c800 1 -- 172.21.15.102:0/3933299801 wait complete. 2024-09-13T19:16:16.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.630+0000 7fdca090c800 1 -- 172.21.15.102:0/3770842257 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdb78036c00 msgr2=0x7fdb780390c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.630+0000 7fdca090c800 1 --2- 172.21.15.102:0/3770842257 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdb78036c00 0x7fdb780390c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdc9008f1c0 tx=0x7fdc90077fc0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.630+0000 7fdca090c800 1 -- 172.21.15.102:0/3770842257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d286e241a0 msgr2=0x55d286e245c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.630+0000 7fdca090c800 1 --2- 172.21.15.102:0/3770842257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d286e241a0 0x55d286e245c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x55d286e0a550 tx=0x7fdc9800beb0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.630+0000 7fdca090c800 1 -- 172.21.15.102:0/3770842257 shutdown_connections 2024-09-13T19:16:16.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.630+0000 7fdca090c800 1 --2- 172.21.15.102:0/3770842257 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdb78036c00 0x7fdb780390c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.630+0000 7fdca090c800 1 --2- 172.21.15.102:0/3770842257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d286e241a0 0x55d286e245c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.630+0000 7fdca090c800 1 -- 172.21.15.102:0/3770842257 >> 172.21.15.102:0/3770842257 conn(0x55d286e19130 msgr2=0x55d286e1bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:16.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.630+0000 7fdca090c800 1 -- 172.21.15.102:0/3770842257 shutdown_connections 2024-09-13T19:16:16.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.630+0000 7fdca090c800 1 -- 172.21.15.102:0/3770842257 wait complete. 2024-09-13T19:16:16.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.630+0000 7fdca090c800 1 -- 172.21.15.102:0/2972179665 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55d286d15bf0 msgr2=0x55d286e10510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.630+0000 7fdca090c800 1 --2- 172.21.15.102:0/2972179665 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55d286d15bf0 0x55d286e10510 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.630+0000 7fdca090c800 1 -- 172.21.15.102:0/2972179665 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55d286e12d40 msgr2=0x55d286e15130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.630+0000 7fdca090c800 1 --2- 172.21.15.102:0/2972179665 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55d286e12d40 0x55d286e15130 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.630+0000 7fdca090c800 1 -- 172.21.15.102:0/2972179665 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdb84036b40 msgr2=0x7fdb84039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.630+0000 7fdca090c800 1 --2- 172.21.15.102:0/2972179665 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdb84036b40 0x7fdb84039000 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdc94000f60 tx=0x7fdc940012b0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.630+0000 7fdca090c800 1 -- 172.21.15.102:0/2972179665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d286c84610 msgr2=0x55d286e094a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.630+0000 7fdca090c800 1 --2- 172.21.15.102:0/2972179665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d286c84610 0x55d286e094a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdc90046130 tx=0x7fdc90003330 comp rx=0 tx=0).stop 2024-09-13T19:16:16.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.630+0000 7fdca090c800 1 -- 172.21.15.102:0/2972179665 shutdown_connections 2024-09-13T19:16:16.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.630+0000 7fdca090c800 1 --2- 172.21.15.102:0/2972179665 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55d286e12d40 0x55d286e15130 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.630+0000 7fdca090c800 1 --2- 172.21.15.102:0/2972179665 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55d286d15bf0 0x55d286e10510 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.630+0000 7fdca090c800 1 --2- 172.21.15.102:0/2972179665 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdb84036b40 0x7fdb84039000 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.630+0000 7fdca090c800 1 --2- 172.21.15.102:0/2972179665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d286c84610 0x55d286e094a0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.630+0000 7fdca090c800 1 -- 172.21.15.102:0/2972179665 >> 172.21.15.102:0/2972179665 conn(0x55d286d0ae00 msgr2=0x55d286dfbd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:16.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.630+0000 7fdca090c800 1 -- 172.21.15.102:0/2972179665 shutdown_connections 2024-09-13T19:16:16.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.630+0000 7fdca090c800 1 -- 172.21.15.102:0/2972179665 wait complete. 2024-09-13T19:16:16.649 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:16:14.779675Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-13T19:16:16.617088Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:16:14.779665Z', 'tags': [], 'group_ids': []} 2024-09-13T19:16:16.649 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T19:16:16.650 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T19:16:16.650 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T19:16:16.693 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:16.694 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:16.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.691+0000 7f3d6f542800 1 Processor -- start 2024-09-13T19:16:16.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.691+0000 7f3d6f542800 1 -- start start 2024-09-13T19:16:16.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.691+0000 7f3d6f542800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5654a7baa900 0x5654a7baccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.691+0000 7f3d6f542800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5654a7a66b30 con 0x5654a7ba64c0 2024-09-13T19:16:16.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.691+0000 7f3d6f542800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5654a7a48360 con 0x5654a7baa900 2024-09-13T19:16:16.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.692+0000 7f3d62a96640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5654a7baa900 0x5654a7baccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.692+0000 7f3d62a96640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5654a7baa900 0x5654a7baccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54616/0 (socket says 172.21.15.102:54616) 2024-09-13T19:16:16.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.692+0000 7f3d6b297640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5654a7ba64c0 0x5654a7ba68c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:49910/0 (socket says 172.21.15.102:49910) 2024-09-13T19:16:16.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.692+0000 7f3d62a96640 1 -- 172.21.15.102:0/1016495887 learned_addr learned my addr 172.21.15.102:0/1016495887 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:16.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.692+0000 7f3d62a96640 1 -- 172.21.15.102:0/1016495887 >> v1:172.21.15.53:6789/0 conn(0x5654a7ba64c0 legacy=0x5654a7ba68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.692+0000 7f3d62a96640 1 -- 172.21.15.102:0/1016495887 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654a7a6ee00 con 0x5654a7baa900 2024-09-13T19:16:16.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.694+0000 7f3d62a96640 1 --2- 172.21.15.102:0/1016495887 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654a7baa900 0x5654a7baccf0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3d5400a520 tx=0x7f3d54045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58c4b59dd1cdbb53 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.694+0000 7f3d6aa96640 1 -- 172.21.15.102:0/1016495887 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d54055070 con 0x5654a7baa900 2024-09-13T19:16:16.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.694+0000 7f3d6aa96640 1 -- 172.21.15.102:0/1016495887 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d540515b0 con 0x5654a7baa900 2024-09-13T19:16:16.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.694+0000 7f3d6aa96640 1 -- 172.21.15.102:0/1016495887 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d540518d0 con 0x5654a7baa900 2024-09-13T19:16:16.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.694+0000 7f3d6f542800 1 -- 172.21.15.102:0/1016495887 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654a7baa900 msgr2=0x5654a7baccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.694+0000 7f3d6f542800 1 --2- 172.21.15.102:0/1016495887 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654a7baa900 0x5654a7baccf0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3d5400a520 tx=0x7f3d54045ba0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.694+0000 7f3d6f542800 1 -- 172.21.15.102:0/1016495887 shutdown_connections 2024-09-13T19:16:16.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.694+0000 7f3d6f542800 1 --2- 172.21.15.102:0/1016495887 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654a7baa900 0x5654a7baccf0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.694+0000 7f3d6f542800 1 -- 172.21.15.102:0/1016495887 >> 172.21.15.102:0/1016495887 conn(0x5654a7ba1df0 msgr2=0x5654a7ba4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:16.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.694+0000 7f3d6f542800 1 -- 172.21.15.102:0/1016495887 shutdown_connections 2024-09-13T19:16:16.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.694+0000 7f3d6f542800 1 -- 172.21.15.102:0/1016495887 wait complete. 2024-09-13T19:16:16.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.708+0000 7f3d6f542800 1 Processor -- start 2024-09-13T19:16:16.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.708+0000 7f3d6f542800 1 -- start start 2024-09-13T19:16:16.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.708+0000 7f3d6f542800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654a7ba64c0 0x5654a7c95750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.708+0000 7f3d6f542800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5654a7af3330 con 0x5654a7ba64c0 2024-09-13T19:16:16.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.708+0000 7f3d6b297640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654a7ba64c0 0x5654a7c95750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.708+0000 7f3d6b297640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654a7ba64c0 0x5654a7c95750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54624/0 (socket says 172.21.15.102:54624) 2024-09-13T19:16:16.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.708+0000 7f3d6b297640 1 -- 172.21.15.102:0/3640737355 learned_addr learned my addr 172.21.15.102:0/3640737355 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:16.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.709+0000 7f3d6b297640 1 -- 172.21.15.102:0/3640737355 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654a7a40bc0 con 0x5654a7ba64c0 2024-09-13T19:16:16.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.709+0000 7f3d6b297640 1 --2- 172.21.15.102:0/3640737355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654a7ba64c0 0x5654a7c95750 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c001e40 tx=0x7f3d5c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=617dad80fe1ed689 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.709+0000 7f3c5960a640 1 -- 172.21.15.102:0/3640737355 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d5c00b690 con 0x5654a7ba64c0 2024-09-13T19:16:16.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.709+0000 7f3c5960a640 1 -- 172.21.15.102:0/3640737355 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d5c006070 con 0x5654a7ba64c0 2024-09-13T19:16:16.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.709+0000 7f3c5960a640 1 -- 172.21.15.102:0/3640737355 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d5c00b9e0 con 0x5654a7ba64c0 2024-09-13T19:16:16.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.710+0000 7f3d6f542800 1 -- 172.21.15.102:0/3640737355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654a7ba64c0 msgr2=0x5654a7c95750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.710+0000 7f3d6f542800 1 --2- 172.21.15.102:0/3640737355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654a7ba64c0 0x5654a7c95750 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c001e40 tx=0x7f3d5c001e70 comp rx=0 tx=0).stop 2024-09-13T19:16:16.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.710+0000 7f3d6f542800 1 -- 172.21.15.102:0/3640737355 shutdown_connections 2024-09-13T19:16:16.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.710+0000 7f3d6f542800 1 --2- 172.21.15.102:0/3640737355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654a7ba64c0 0x5654a7c95750 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.710+0000 7f3d6f542800 1 -- 172.21.15.102:0/3640737355 >> 172.21.15.102:0/3640737355 conn(0x5654a7ba1df0 msgr2=0x5654a7c91110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:16.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.710+0000 7f3d6f542800 1 -- 172.21.15.102:0/3640737355 shutdown_connections 2024-09-13T19:16:16.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.710+0000 7f3d6f542800 1 -- 172.21.15.102:0/3640737355 wait complete. 2024-09-13T19:16:16.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.710+0000 7f3d6f542800 1 Processor -- start 2024-09-13T19:16:16.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.710+0000 7f3d6f542800 1 -- start start 2024-09-13T19:16:16.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.710+0000 7f3d6f542800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654a7ba64c0 0x5654a7ca0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.710+0000 7f3d6f542800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5654a7bad530 con 0x5654a7ba64c0 2024-09-13T19:16:16.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.710+0000 7f3d6b297640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654a7ba64c0 0x5654a7ca0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.710+0000 7f3d6b297640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654a7ba64c0 0x5654a7ca0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54636/0 (socket says 172.21.15.102:54636) 2024-09-13T19:16:16.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.710+0000 7f3d6b297640 1 -- 172.21.15.102:0/4048977561 learned_addr learned my addr 172.21.15.102:0/4048977561 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:16.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.711+0000 7f3d6b297640 1 -- 172.21.15.102:0/4048977561 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654a7a54fe0 con 0x5654a7ba64c0 2024-09-13T19:16:16.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.711+0000 7f3d6b297640 1 --2- 172.21.15.102:0/4048977561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654a7ba64c0 0x5654a7ca0480 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c000f60 tx=0x7f3d5c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.711+0000 7f3c57e07640 1 -- 172.21.15.102:0/4048977561 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d5c016730 con 0x5654a7ba64c0 2024-09-13T19:16:16.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.711+0000 7f3c57e07640 1 -- 172.21.15.102:0/4048977561 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d5c024070 con 0x5654a7ba64c0 2024-09-13T19:16:16.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.711+0000 7f3c57e07640 1 -- 172.21.15.102:0/4048977561 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d5c016a40 con 0x5654a7ba64c0 2024-09-13T19:16:16.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.711+0000 7f3d6f542800 1 -- 172.21.15.102:0/4048977561 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5654a7ca09c0 con 0x5654a7ba64c0 2024-09-13T19:16:16.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.711+0000 7f3d6f542800 1 -- 172.21.15.102:0/4048977561 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654a7ca0ee0 con 0x5654a7ba64c0 2024-09-13T19:16:16.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.712+0000 7f3c57e07640 1 -- 172.21.15.102:0/4048977561 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3d5c01e070 con 0x5654a7ba64c0 2024-09-13T19:16:16.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.712+0000 7f3c57e07640 1 --2- 172.21.15.102:0/4048977561 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3c50036b40 0x7f3c50039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.712+0000 7f3c57e07640 1 -- 172.21.15.102:0/4048977561 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f3d5c01b070 con 0x5654a7ba64c0 2024-09-13T19:16:16.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.712+0000 7f3d62a96640 1 --2- 172.21.15.102:0/4048977561 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3c50036b40 0x7f3c50039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.712+0000 7f3d6f542800 1 --2- 172.21.15.102:0/4048977561 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5654a7baa900 0x5654a7ca74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.712+0000 7f3d6f542800 1 -- 172.21.15.102:0/4048977561 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ca7a70 con 0x5654a7baa900 2024-09-13T19:16:16.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.713+0000 7f3d6ba98640 1 --2- 172.21.15.102:0/4048977561 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5654a7baa900 0x5654a7ca74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.713+0000 7f3d62a96640 1 --2- 172.21.15.102:0/4048977561 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3c50036b40 0x7f3c50039000 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3d54057000 tx=0x7f3d54052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.713+0000 7f3d6ba98640 1 --2- 172.21.15.102:0/4048977561 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5654a7baa900 0x5654a7ca74f0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.713+0000 7f3d6ba98640 1 -- 172.21.15.102:0/4048977561 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3d6400a4a0 con 0x5654a7baa900 2024-09-13T19:16:16.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.713+0000 7f3d6f542800 1 -- 172.21.15.102:0/4048977561 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ca4ac0 con 0x5654a7baa900 2024-09-13T19:16:16.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.713+0000 7f3d6ba98640 1 -- 172.21.15.102:0/4048977561 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3d6400a4a0 con 0x5654a7baa900 2024-09-13T19:16:16.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.713+0000 7f3d6f542800 1 --2- 172.21.15.102:0/4048977561 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5654a7ca9da0 0x5654a7cac190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.713+0000 7f3d6f542800 1 -- 172.21.15.102:0/4048977561 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5654a7cac880 con 0x5654a7ca9da0 2024-09-13T19:16:16.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.713+0000 7f3d6b297640 1 --2- 172.21.15.102:0/4048977561 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5654a7ca9da0 0x5654a7cac190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.714+0000 7f3d6b297640 1 --2- 172.21.15.102:0/4048977561 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5654a7ca9da0 0x5654a7cac190 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.714+0000 7f3d6b297640 1 -- 172.21.15.102:0/4048977561 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3d5c01fca0 con 0x5654a7ca9da0 2024-09-13T19:16:16.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.714+0000 7f3d6f542800 1 -- 172.21.15.102:0/4048977561 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ca8c40 con 0x5654a7baa900 2024-09-13T19:16:16.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.714+0000 7f3d6ba98640 1 -- 172.21.15.102:0/4048977561 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3d6400a4a0 con 0x5654a7baa900 2024-09-13T19:16:16.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.714+0000 7f3d6f542800 1 -- 172.21.15.102:0/4048977561 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ca90e0 con 0x5654a7ca9da0 2024-09-13T19:16:16.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.715+0000 7f3d6b297640 1 -- 172.21.15.102:0/4048977561 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3d5c01fca0 con 0x5654a7ca9da0 2024-09-13T19:16:16.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.715+0000 7f3d6f542800 1 Processor -- start 2024-09-13T19:16:16.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.715+0000 7f3d6f542800 1 -- start start 2024-09-13T19:16:16.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.715+0000 7f3d6f542800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654a7cbb220 0x5654a7cbb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.715+0000 7f3d6f542800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5654a7a42580 con 0x5654a7cbb220 2024-09-13T19:16:16.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.715+0000 7f3d6ba98640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654a7cbb220 0x5654a7cbb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.715+0000 7f3d6ba98640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654a7cbb220 0x5654a7cbb640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54638/0 (socket says 172.21.15.102:54638) 2024-09-13T19:16:16.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.715+0000 7f3d6ba98640 1 -- 172.21.15.102:0/490069222 learned_addr learned my addr 172.21.15.102:0/490069222 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:16.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.716+0000 7f3d6ba98640 1 -- 172.21.15.102:0/490069222 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654a7cbbb80 con 0x5654a7cbb220 2024-09-13T19:16:16.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.716+0000 7f3d6ba98640 1 --2- 172.21.15.102:0/490069222 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654a7cbb220 0x5654a7cbb640 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x5654a7ca1880 tx=0x7f3d640167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.716+0000 7f3c55602640 1 -- 172.21.15.102:0/490069222 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d64013640 con 0x5654a7cbb220 2024-09-13T19:16:16.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.716+0000 7f3c55602640 1 -- 172.21.15.102:0/490069222 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d640137e0 con 0x5654a7cbb220 2024-09-13T19:16:16.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.716+0000 7f3d6f542800 1 -- 172.21.15.102:0/490069222 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5654a7cbbe10 con 0x5654a7cbb220 2024-09-13T19:16:16.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.716+0000 7f3c55602640 1 -- 172.21.15.102:0/490069222 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d64013ae0 con 0x5654a7cbb220 2024-09-13T19:16:16.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.716+0000 7f3d6f542800 1 -- 172.21.15.102:0/490069222 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654a7cbeaf0 con 0x5654a7cbb220 2024-09-13T19:16:16.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.717+0000 7f3c55602640 1 -- 172.21.15.102:0/490069222 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3d64011040 con 0x5654a7cbb220 2024-09-13T19:16:16.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.717+0000 7f3c55602640 1 --2- 172.21.15.102:0/490069222 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3c44036b90 0x7f3c44039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.717+0000 7f3c55602640 1 -- 172.21.15.102:0/490069222 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f3d6400e040 con 0x5654a7cbb220 2024-09-13T19:16:16.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.717+0000 7f3d6b297640 1 --2- 172.21.15.102:0/490069222 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3c44036b90 0x7f3c44039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.717+0000 7f3d6f542800 1 Processor -- start 2024-09-13T19:16:16.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.717+0000 7f3d6f542800 1 -- start start 2024-09-13T19:16:16.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.717+0000 7f3d6b297640 1 --2- 172.21.15.102:0/490069222 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3c44036b90 0x7f3c44039050 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x5654a7ca8c10 tx=0x7f3d5c01ff30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.718+0000 7f3d6f542800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654a7cc7ec0 0x5654a7cc82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.718+0000 7f3d6f542800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5654a7c95f00 con 0x5654a7cc7ec0 2024-09-13T19:16:16.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.718+0000 7f3d6ba98640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654a7cc7ec0 0x5654a7cc82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.718+0000 7f3d6ba98640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654a7cc7ec0 0x5654a7cc82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54652/0 (socket says 172.21.15.102:54652) 2024-09-13T19:16:16.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.718+0000 7f3d6ba98640 1 -- 172.21.15.102:0/1736680243 learned_addr learned my addr 172.21.15.102:0/1736680243 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:16.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.718+0000 7f3d6ba98640 1 -- 172.21.15.102:0/1736680243 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654a7cc8890 con 0x5654a7cc7ec0 2024-09-13T19:16:16.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.718+0000 7f3d6ba98640 1 --2- 172.21.15.102:0/1736680243 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654a7cc7ec0 0x5654a7cc82c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3d6400b010 tx=0x7f3d64020460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=930f7b366e88e3a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.718+0000 7f3c4effd640 1 -- 172.21.15.102:0/1736680243 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d64014c10 con 0x5654a7cc7ec0 2024-09-13T19:16:16.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.718+0000 7f3c4effd640 1 -- 172.21.15.102:0/1736680243 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d6402a910 con 0x5654a7cc7ec0 2024-09-13T19:16:16.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.718+0000 7f3c4effd640 1 -- 172.21.15.102:0/1736680243 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d6402a3f0 con 0x5654a7cc7ec0 2024-09-13T19:16:16.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.719+0000 7f3d6f542800 1 -- 172.21.15.102:0/1736680243 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654a7cc7ec0 msgr2=0x5654a7cc82c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.719+0000 7f3d6f542800 1 --2- 172.21.15.102:0/1736680243 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654a7cc7ec0 0x5654a7cc82c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3d6400b010 tx=0x7f3d64020460 comp rx=0 tx=0).stop 2024-09-13T19:16:16.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.719+0000 7f3d6f542800 1 -- 172.21.15.102:0/1736680243 shutdown_connections 2024-09-13T19:16:16.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.719+0000 7f3d6f542800 1 --2- 172.21.15.102:0/1736680243 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654a7cc7ec0 0x5654a7cc82c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.719+0000 7f3d6f542800 1 -- 172.21.15.102:0/1736680243 >> 172.21.15.102:0/1736680243 conn(0x5654a7cc4220 msgr2=0x5654a7cc2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:16.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.719+0000 7f3d6f542800 1 -- 172.21.15.102:0/1736680243 shutdown_connections 2024-09-13T19:16:16.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.719+0000 7f3d6f542800 1 -- 172.21.15.102:0/1736680243 wait complete. 2024-09-13T19:16:16.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.719+0000 7f3d6f542800 1 Processor -- start 2024-09-13T19:16:16.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.719+0000 7f3d6f542800 1 -- start start 2024-09-13T19:16:16.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.719+0000 7f3d6f542800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654a7cc7ec0 0x5654a7ccf390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.719+0000 7f3d6f542800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5654a7cc8f00 con 0x5654a7cc7ec0 2024-09-13T19:16:16.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.720+0000 7f3d6ba98640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654a7cc7ec0 0x5654a7ccf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.720+0000 7f3d6ba98640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654a7cc7ec0 0x5654a7ccf390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54656/0 (socket says 172.21.15.102:54656) 2024-09-13T19:16:16.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.720+0000 7f3d6ba98640 1 -- 172.21.15.102:0/2207895940 learned_addr learned my addr 172.21.15.102:0/2207895940 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:16.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.720+0000 7f3d6ba98640 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654a7ccf8d0 con 0x5654a7cc7ec0 2024-09-13T19:16:16.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.720+0000 7f3d6ba98640 1 --2- 172.21.15.102:0/2207895940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654a7cc7ec0 0x5654a7ccf390 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3d6404bcc0 tx=0x7f3d6404cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.720+0000 7f3c4d7fa640 1 -- 172.21.15.102:0/2207895940 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d6402e070 con 0x5654a7cc7ec0 2024-09-13T19:16:16.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.720+0000 7f3c4d7fa640 1 -- 172.21.15.102:0/2207895940 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d64029ca0 con 0x5654a7cc7ec0 2024-09-13T19:16:16.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.720+0000 7f3c4d7fa640 1 -- 172.21.15.102:0/2207895940 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d64040140 con 0x5654a7cc7ec0 2024-09-13T19:16:16.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.720+0000 7f3d6f542800 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5654a7ccfb60 con 0x5654a7cc7ec0 2024-09-13T19:16:16.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.720+0000 7f3d6f542800 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654a7cd2810 con 0x5654a7cc7ec0 2024-09-13T19:16:16.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.721+0000 7f3c4d7fa640 1 -- 172.21.15.102:0/2207895940 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3d64039060 con 0x5654a7cc7ec0 2024-09-13T19:16:16.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.721+0000 7f3c4d7fa640 1 --2- 172.21.15.102:0/2207895940 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3c34036b90 0x7f3c34039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.721+0000 7f3c4d7fa640 1 -- 172.21.15.102:0/2207895940 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f3d6403f870 con 0x5654a7cc7ec0 2024-09-13T19:16:16.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.721+0000 7f3d6b297640 1 --2- 172.21.15.102:0/2207895940 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3c34036b90 0x7f3c34039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.721+0000 7f3d6f542800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.722+0000 7f3d6f542800 1 --2- 172.21.15.102:0/2207895940 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5654a7cdae20 0x5654a7cdd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.722+0000 7f3d6f542800 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5654a7cdda30 con 0x5654a7cdae20 2024-09-13T19:16:16.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.722+0000 7f3d6b297640 1 --2- 172.21.15.102:0/2207895940 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3c34036b90 0x7f3c34039050 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c00baa0 tx=0x7f3d5c041000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.722+0000 7f3d62a96640 1 --2- 172.21.15.102:0/2207895940 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5654a7cdae20 0x5654a7cdd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.722+0000 7f3d62a96640 1 --2- 172.21.15.102:0/2207895940 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5654a7cdae20 0x5654a7cdd2e0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.722+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3d54057030 con 0x5654a7cdae20 2024-09-13T19:16:16.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.722+0000 7f3d6f542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:16.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.722+0000 7f3d6f542800 20 realm 2024-09-13T19:16:16.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.722+0000 7f3d6f542800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.722+0000 7f3d6f542800 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5654a7cdde00 con 0x5654a7cdae20 2024-09-13T19:16:16.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.722+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3d54057030 con 0x5654a7cdae20 2024-09-13T19:16:16.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.722+0000 7f3d6f542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:16.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.722+0000 7f3d6f542800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:16.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.722+0000 7f3d6f542800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.722+0000 7f3d6f542800 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5654a7cde6a0 con 0x5654a7cdae20 2024-09-13T19:16:16.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.723+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3d54057030 con 0x5654a7cdae20 2024-09-13T19:16:16.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.723+0000 7f3d6f542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:16.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.723+0000 7f3d6f542800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.723+0000 7f3d6f542800 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5654a7cdea40 con 0x5654a7cdae20 2024-09-13T19:16:16.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.723+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3d54057030 con 0x5654a7cdae20 2024-09-13T19:16:16.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.723+0000 7f3d6f542800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:16.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.723+0000 7f3d6f542800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.723+0000 7f3d6f542800 1 --2- 172.21.15.102:0/2207895940 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5654a7cdf4f0 0x5654a7ce1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.723+0000 7f3d6f542800 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce2060 con 0x5654a7cdf4f0 2024-09-13T19:16:16.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.723+0000 7f3d6ba98640 1 --2- 172.21.15.102:0/2207895940 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5654a7cdf4f0 0x5654a7ce1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.723+0000 7f3d6ba98640 1 --2- 172.21.15.102:0/2207895940 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5654a7cdf4f0 0x5654a7ce1900 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.724+0000 7f3d6ba98640 1 -- 172.21.15.102:0/2207895940 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3d64057040 con 0x5654a7cdf4f0 2024-09-13T19:16:16.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.724+0000 7f3d6f542800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:16.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.724+0000 7f3d6f542800 20 searching for the correct realm 2024-09-13T19:16:16.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.724+0000 7f3d6f542800 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce3a40 con 0x5654a7cdf4f0 2024-09-13T19:16:16.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.724+0000 7f3d6ba98640 1 -- 172.21.15.102:0/2207895940 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d64057040 con 0x5654a7cdf4f0 2024-09-13T19:16:16.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.724+0000 7f3d6ba98640 1 --2- 172.21.15.102:0/2207895940 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f3d64032020 0x7f3d64011910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.724+0000 7f3d6ba98640 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce3a40 con 0x7f3d64032020 2024-09-13T19:16:16.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.724+0000 7f3d6b297640 1 --2- 172.21.15.102:0/2207895940 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f3d64032020 0x7f3d64011910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.724+0000 7f3d6b297640 1 --2- 172.21.15.102:0/2207895940 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f3d64032020 0x7f3d64011910 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.724+0000 7f3d6b297640 1 -- 172.21.15.102:0/2207895940 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d5c01fca0 con 0x7f3d64032020 2024-09-13T19:16:16.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.724+0000 7f3d6b297640 1 --2- 172.21.15.102:0/2207895940 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f3d5c01f400 0x7f3d5c044200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.724+0000 7f3d6b297640 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce3a40 con 0x7f3d5c01f400 2024-09-13T19:16:16.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.725+0000 7f3d62a96640 1 --2- 172.21.15.102:0/2207895940 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f3d5c01f400 0x7f3d5c044200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.725+0000 7f3d62a96640 1 --2- 172.21.15.102:0/2207895940 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f3d5c01f400 0x7f3d5c044200 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.725+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d54057030 con 0x7f3d5c01f400 2024-09-13T19:16:16.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.725+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce3a40 con 0x5654a7cdae20 2024-09-13T19:16:16.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.725+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d54057030 con 0x5654a7cdae20 2024-09-13T19:16:16.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.726+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce3a40 con 0x5654a7cdae20 2024-09-13T19:16:16.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.726+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d54057030 con 0x5654a7cdae20 2024-09-13T19:16:16.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.726+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce3a40 con 0x7f3d5c01f400 2024-09-13T19:16:16.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.726+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d54057030 con 0x7f3d5c01f400 2024-09-13T19:16:16.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.726+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce3a40 con 0x7f3d5c01f400 2024-09-13T19:16:16.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.726+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d54057030 con 0x7f3d5c01f400 2024-09-13T19:16:16.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.726+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce3a40 con 0x7f3d64032020 2024-09-13T19:16:16.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.726+0000 7f3d6b297640 1 -- 172.21.15.102:0/2207895940 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d5c01fca0 con 0x7f3d64032020 2024-09-13T19:16:16.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.726+0000 7f3d6b297640 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce3a40 con 0x5654a7cdf4f0 2024-09-13T19:16:16.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.727+0000 7f3d6ba98640 1 -- 172.21.15.102:0/2207895940 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d64057040 con 0x5654a7cdf4f0 2024-09-13T19:16:16.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.727+0000 7f3d6ba98640 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce3a40 con 0x5654a7cdae20 2024-09-13T19:16:16.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.727+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d54057030 con 0x5654a7cdae20 2024-09-13T19:16:16.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.727+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce3a40 con 0x7f3d5c01f400 2024-09-13T19:16:16.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.727+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d54057030 con 0x7f3d5c01f400 2024-09-13T19:16:16.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.727+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce3a40 con 0x5654a7cdae20 2024-09-13T19:16:16.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.727+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d54057030 con 0x5654a7cdae20 2024-09-13T19:16:16.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.727+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce3a40 con 0x7f3d64032020 2024-09-13T19:16:16.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.728+0000 7f3d6b297640 1 -- 172.21.15.102:0/2207895940 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3d5c01fca0 con 0x7f3d64032020 2024-09-13T19:16:16.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.728+0000 7f3d6b297640 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce3a40 con 0x5654a7cdf4f0 2024-09-13T19:16:16.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.728+0000 7f3d6ba98640 1 -- 172.21.15.102:0/2207895940 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d64057040 con 0x5654a7cdf4f0 2024-09-13T19:16:16.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.728+0000 7f3d6ba98640 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce3a40 con 0x5654a7cdf4f0 2024-09-13T19:16:16.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.728+0000 7f3d6ba98640 1 -- 172.21.15.102:0/2207895940 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3d64057040 con 0x5654a7cdf4f0 2024-09-13T19:16:16.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.728+0000 7f3d6ba98640 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce3a40 con 0x7f3d5c01f400 2024-09-13T19:16:16.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.728+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d54057030 con 0x7f3d5c01f400 2024-09-13T19:16:16.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.728+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce3a40 con 0x5654a7cdf4f0 2024-09-13T19:16:16.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.728+0000 7f3d6ba98640 1 -- 172.21.15.102:0/2207895940 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3d64057040 con 0x5654a7cdf4f0 2024-09-13T19:16:16.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.729+0000 7f3d6ba98640 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce3a40 con 0x5654a7cdf4f0 2024-09-13T19:16:16.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.729+0000 7f3d6ba98640 1 -- 172.21.15.102:0/2207895940 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d64057040 con 0x5654a7cdf4f0 2024-09-13T19:16:16.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.729+0000 7f3d6ba98640 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce3a40 con 0x5654a7cdae20 2024-09-13T19:16:16.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.729+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d54057030 con 0x5654a7cdae20 2024-09-13T19:16:16.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.729+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce3a40 con 0x5654a7cdae20 2024-09-13T19:16:16.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.729+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3d54057030 con 0x5654a7cdae20 2024-09-13T19:16:16.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.729+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce3a40 con 0x7f3d5c01f400 2024-09-13T19:16:16.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.729+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d54057030 con 0x7f3d5c01f400 2024-09-13T19:16:16.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.729+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce3a40 con 0x5654a7cdf4f0 2024-09-13T19:16:16.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.730+0000 7f3d6ba98640 1 -- 172.21.15.102:0/2207895940 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d64057040 con 0x5654a7cdf4f0 2024-09-13T19:16:16.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.730+0000 7f3d6ba98640 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce3a40 con 0x7f3d64032020 2024-09-13T19:16:16.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.730+0000 7f3d6b297640 1 -- 172.21.15.102:0/2207895940 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d5c01fca0 con 0x7f3d64032020 2024-09-13T19:16:16.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.730+0000 7f3d6b297640 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce3a40 con 0x5654a7cdae20 2024-09-13T19:16:16.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.730+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d54057030 con 0x5654a7cdae20 2024-09-13T19:16:16.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.730+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce3a40 con 0x7f3d5c01f400 2024-09-13T19:16:16.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.730+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d54057030 con 0x7f3d5c01f400 2024-09-13T19:16:16.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.730+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce3a40 con 0x5654a7cdf4f0 2024-09-13T19:16:16.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.731+0000 7f3d6ba98640 1 -- 172.21.15.102:0/2207895940 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d64057040 con 0x5654a7cdf4f0 2024-09-13T19:16:16.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.731+0000 7f3d6ba98640 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce3a40 con 0x7f3d5c01f400 2024-09-13T19:16:16.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.731+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d54057030 con 0x7f3d5c01f400 2024-09-13T19:16:16.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.731+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce3a40 con 0x7f3d64032020 2024-09-13T19:16:16.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.731+0000 7f3d6b297640 1 -- 172.21.15.102:0/2207895940 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d5c01fca0 con 0x7f3d64032020 2024-09-13T19:16:16.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.731+0000 7f3d6b297640 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce3a40 con 0x5654a7cdf4f0 2024-09-13T19:16:16.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.731+0000 7f3d6ba98640 1 -- 172.21.15.102:0/2207895940 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d64057040 con 0x5654a7cdf4f0 2024-09-13T19:16:16.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.731+0000 7f3d6ba98640 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce3a40 con 0x7f3d5c01f400 2024-09-13T19:16:16.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.732+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d54057030 con 0x7f3d5c01f400 2024-09-13T19:16:16.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.732+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce3a40 con 0x5654a7cdae20 2024-09-13T19:16:16.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.732+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3d54057030 con 0x5654a7cdae20 2024-09-13T19:16:16.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.732+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f3d5408a080 con 0x7f3d64032020 2024-09-13T19:16:16.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.732+0000 7f3d6b297640 1 -- 172.21.15.102:0/2207895940 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d5c01fca0 con 0x7f3d64032020 2024-09-13T19:16:16.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.732+0000 7f3d6f542800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:16.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.732+0000 7f3d6f542800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:16.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.732+0000 7f3d6f542800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:16.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.732+0000 7f3d6f542800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:16.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.732+0000 7f3d6f542800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:16.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.732+0000 7f3d6f542800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:16.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.732+0000 7f3d6f542800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.732+0000 7f3d6f542800 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce2b10 con 0x5654a7cdae20 2024-09-13T19:16:16.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.732+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3d54057030 con 0x5654a7cdae20 2024-09-13T19:16:16.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.732+0000 7f3d6f542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:16.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.732+0000 7f3d6f542800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.732+0000 7f3d6f542800 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce33b0 con 0x5654a7cdae20 2024-09-13T19:16:16.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.733+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3d54057030 con 0x5654a7cdae20 2024-09-13T19:16:16.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.733+0000 7f3d6f542800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:16.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.733+0000 7f3d6f542800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.733+0000 7f3d6f542800 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce2750 con 0x5654a7cdf4f0 2024-09-13T19:16:16.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.733+0000 7f3d6ba98640 1 -- 172.21.15.102:0/2207895940 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3d64057040 con 0x5654a7cdf4f0 2024-09-13T19:16:16.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.733+0000 7f3d6f542800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:16.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.733+0000 7f3d6f542800 20 zone default found 2024-09-13T19:16:16.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.733+0000 7f3d6f542800 4 Realm: () 2024-09-13T19:16:16.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.733+0000 7f3d6f542800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:16.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.733+0000 7f3d6f542800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:16.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.733+0000 7f3d6f542800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:16.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.733+0000 7f3d6f542800 20 zonegroup default 2024-09-13T19:16:16.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.733+0000 7f3d6f542800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.733+0000 7f3d6f542800 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce43c0 con 0x7f3d5c01f400 2024-09-13T19:16:16.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.733+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3d54057030 con 0x7f3d5c01f400 2024-09-13T19:16:16.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.733+0000 7f3d6f542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:16.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.733+0000 7f3d6f542800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.733+0000 7f3d6f542800 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce5e60 con 0x5654a7cdf4f0 2024-09-13T19:16:16.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.733+0000 7f3d6ba98640 1 -- 172.21.15.102:0/2207895940 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3d64057040 con 0x5654a7cdf4f0 2024-09-13T19:16:16.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.733+0000 7f3d6f542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:16.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.733+0000 7f3d6f542800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.733+0000 7f3d6f542800 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce62a0 con 0x5654a7cdf4f0 2024-09-13T19:16:16.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.734+0000 7f3d6ba98640 1 -- 172.21.15.102:0/2207895940 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3d64057040 con 0x5654a7cdf4f0 2024-09-13T19:16:16.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.734+0000 7f3d6f542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:16.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.734+0000 7f3d6f542800 20 started sync module instance, tier type = 2024-09-13T19:16:16.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.734+0000 7f3d6f542800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:16.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.734+0000 7f3d6f542800 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce5230 con 0x7f3d64032020 2024-09-13T19:16:16.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.735+0000 7f3d6b297640 1 -- 172.21.15.102:0/2207895940 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(44 notify.0 [create] v34'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d5c01fca0 con 0x7f3d64032020 2024-09-13T19:16:16.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.735+0000 7f3d6f542800 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94921592559136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce6be0 con 0x7f3d64032020 2024-09-13T19:16:16.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.735+0000 7f3d6f542800 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce7430 con 0x5654a7cdae20 2024-09-13T19:16:16.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.736+0000 7f3d6b297640 1 -- 172.21.15.102:0/2207895940 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94921592559136] v34'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d5c01fca0 con 0x7f3d64032020 2024-09-13T19:16:16.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.736+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v34'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d54057030 con 0x5654a7cdae20 2024-09-13T19:16:16.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.736+0000 7f3d6f542800 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94921592565632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce7850 con 0x5654a7cdae20 2024-09-13T19:16:16.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.736+0000 7f3d6f542800 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce80a0 con 0x5654a7cdf4f0 2024-09-13T19:16:16.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.737+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94921592565632] v34'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d54057030 con 0x5654a7cdae20 2024-09-13T19:16:16.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.737+0000 7f3d6ba98640 1 -- 172.21.15.102:0/2207895940 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v34'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d64057040 con 0x5654a7cdf4f0 2024-09-13T19:16:16.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.737+0000 7f3d6f542800 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94921592567168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce7f90 con 0x5654a7cdf4f0 2024-09-13T19:16:16.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.737+0000 7f3d6f542800 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce8ab0 con 0x7f3d64032020 2024-09-13T19:16:16.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.738+0000 7f3d6ba98640 1 -- 172.21.15.102:0/2207895940 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94921592567168] v34'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d64057040 con 0x5654a7cdf4f0 2024-09-13T19:16:16.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.738+0000 7f3d6b297640 1 -- 172.21.15.102:0/2207895940 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(50 notify.3 [create] v34'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d5c01fca0 con 0x7f3d64032020 2024-09-13T19:16:16.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.738+0000 7f3d6f542800 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94921592571264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce8ea0 con 0x7f3d64032020 2024-09-13T19:16:16.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.738+0000 7f3d6f542800 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce98e0 con 0x5654a7cdae20 2024-09-13T19:16:16.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.739+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v34'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d54057030 con 0x5654a7cdae20 2024-09-13T19:16:16.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.739+0000 7f3d6b297640 1 -- 172.21.15.102:0/2207895940 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94921592571264] v34'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d5c01fca0 con 0x7f3d64032020 2024-09-13T19:16:16.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.739+0000 7f3d6f542800 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94921592574896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5654a7cea180 con 0x5654a7cdae20 2024-09-13T19:16:16.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.739+0000 7f3d6f542800 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce7a00 con 0x7f3d5c01f400 2024-09-13T19:16:16.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.740+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(54 notify.5 [create] v34'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d54057030 con 0x7f3d5c01f400 2024-09-13T19:16:16.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.740+0000 7f3d6f542800 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94921592579952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce7a00 con 0x7f3d5c01f400 2024-09-13T19:16:16.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.740+0000 7f3d6f542800 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ceb6c0 con 0x7f3d5c01f400 2024-09-13T19:16:16.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.741+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94921592574896] v34'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d54057030 con 0x5654a7cdae20 2024-09-13T19:16:16.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.741+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(56 notify.6 [create] v34'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d54057030 con 0x7f3d5c01f400 2024-09-13T19:16:16.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.741+0000 7f3d6f542800 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94921592582576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ceb680 con 0x7f3d5c01f400 2024-09-13T19:16:16.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.741+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94921592579952] v34'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d54057030 con 0x7f3d5c01f400 2024-09-13T19:16:16.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.741+0000 7f3d6f542800 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ceab90 con 0x7f3d5c01f400 2024-09-13T19:16:16.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.742+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(58 notify.7 [create] v34'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d54057030 con 0x7f3d5c01f400 2024-09-13T19:16:16.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.742+0000 7f3d6f542800 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94921592581008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5654a7cec040 con 0x7f3d5c01f400 2024-09-13T19:16:16.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.742+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94921592582576] v34'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d54057030 con 0x7f3d5c01f400 2024-09-13T19:16:16.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.742+0000 7f3d6f542800 20 add_watcher() i=0 2024-09-13T19:16:16.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.742+0000 7f3d6f542800 20 add_watcher() i=1 2024-09-13T19:16:16.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.742+0000 7f3d6f542800 20 add_watcher() i=2 2024-09-13T19:16:16.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.742+0000 7f3d6f542800 20 add_watcher() i=3 2024-09-13T19:16:16.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.742+0000 7f3d6f542800 20 add_watcher() i=4 2024-09-13T19:16:16.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.742+0000 7f3d6f542800 20 add_watcher() i=5 2024-09-13T19:16:16.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.742+0000 7f3d6f542800 20 add_watcher() i=6 2024-09-13T19:16:16.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.743+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94921592581008] v34'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d54057030 con 0x7f3d5c01f400 2024-09-13T19:16:16.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.743+0000 7f3d6f542800 20 add_watcher() i=7 2024-09-13T19:16:16.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.743+0000 7f3d6f542800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:16.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.743+0000 7f3d6f542800 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5654a7cef070 con 0x5654a7cdae20 2024-09-13T19:16:16.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.744+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3d54057030 con 0x5654a7cdae20 2024-09-13T19:16:16.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.744+0000 7f3d6f542800 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94921592585104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5654a7cec4a0 con 0x5654a7cdae20 2024-09-13T19:16:16.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.745+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94921592585104] v34'80 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3d54057030 con 0x5654a7cdae20 2024-09-13T19:16:16.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.745+0000 7f3c21fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:16.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.745+0000 7f3d6f542800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:16.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.745+0000 7f3d6f542800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:16.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.745+0000 7f3d6f542800 5 note: GC not initialized 2024-09-13T19:16:16.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.745+0000 7f3c20fe1640 20 reqs_thread_entry: start 2024-09-13T19:16:16.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.745+0000 7f3d6f542800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:16.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.745+0000 7f3d6f542800 20 Filter name: none 2024-09-13T19:16:16.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.745+0000 7f3b9a7fc640 20 reqs_thread_entry: start 2024-09-13T19:16:16.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.745+0000 7f3d6f542800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.746+0000 7f3d6f542800 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5654a7d21eb0 con 0x5654a7cdae20 2024-09-13T19:16:16.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.746+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f3d54057030 con 0x5654a7cdae20 2024-09-13T19:16:16.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.746+0000 7f3d6f542800 20 rados_obj.operate() r=0 bl.length=673 2024-09-13T19:16:16.759 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:16:14.779675Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-13T19:16:16.617088Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:16:14.779665Z","tags":[],"group_ids":[]} 2024-09-13T19:16:16.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.747+0000 7f3c21fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:16.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.747+0000 7f3d6f542800 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94921592585104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5654a7d223f0 con 0x5654a7cdae20 2024-09-13T19:16:16.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.748+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94921592585104] v34'81 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3d54057030 con 0x5654a7cdae20 2024-09-13T19:16:16.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.748+0000 7f3d6f542800 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94921592559136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5654a7d223f0 con 0x7f3d64032020 2024-09-13T19:16:16.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.749+0000 7f3d6b297640 1 -- 172.21.15.102:0/2207895940 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94921592559136] v34'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d5c01fca0 con 0x7f3d64032020 2024-09-13T19:16:16.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.749+0000 7f3d6f542800 20 remove_watcher() i=0 2024-09-13T19:16:16.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.749+0000 7f3d6f542800 2 removed watcher, disabling cache 2024-09-13T19:16:16.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.749+0000 7f3d6f542800 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94921592565632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce5620 con 0x5654a7cdae20 2024-09-13T19:16:16.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.750+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94921592565632] v34'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d54057030 con 0x5654a7cdae20 2024-09-13T19:16:16.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.750+0000 7f3d6f542800 20 remove_watcher() i=1 2024-09-13T19:16:16.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.750+0000 7f3d6f542800 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94921592567168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce5620 con 0x5654a7cdf4f0 2024-09-13T19:16:16.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.751+0000 7f3d6ba98640 1 -- 172.21.15.102:0/2207895940 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94921592567168] v34'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d64057040 con 0x5654a7cdf4f0 2024-09-13T19:16:16.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.751+0000 7f3d6f542800 20 remove_watcher() i=2 2024-09-13T19:16:16.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.751+0000 7f3d6f542800 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94921592571264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce7580 con 0x7f3d64032020 2024-09-13T19:16:16.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.752+0000 7f3d6b297640 1 -- 172.21.15.102:0/2207895940 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94921592571264] v34'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d5c01fca0 con 0x7f3d64032020 2024-09-13T19:16:16.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.752+0000 7f3d6f542800 20 remove_watcher() i=3 2024-09-13T19:16:16.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.752+0000 7f3d6f542800 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94921592574896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce5620 con 0x5654a7cdae20 2024-09-13T19:16:16.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.753+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94921592574896] v34'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d54057030 con 0x5654a7cdae20 2024-09-13T19:16:16.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.753+0000 7f3d6f542800 20 remove_watcher() i=4 2024-09-13T19:16:16.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.753+0000 7f3d6f542800 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94921592579952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce8580 con 0x7f3d5c01f400 2024-09-13T19:16:16.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.755+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94921592579952] v34'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d54057030 con 0x7f3d5c01f400 2024-09-13T19:16:16.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.755+0000 7f3d6f542800 20 remove_watcher() i=5 2024-09-13T19:16:16.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.755+0000 7f3d6f542800 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94921592582576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce8580 con 0x7f3d5c01f400 2024-09-13T19:16:16.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.756+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94921592582576] v34'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d54057030 con 0x7f3d5c01f400 2024-09-13T19:16:16.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.756+0000 7f3d6f542800 20 remove_watcher() i=6 2024-09-13T19:16:16.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.756+0000 7f3d6f542800 1 -- 172.21.15.102:0/2207895940 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94921592581008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5654a7ce8580 con 0x7f3d5c01f400 2024-09-13T19:16:16.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.757+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94921592581008] v34'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d54057030 con 0x7f3d5c01f400 2024-09-13T19:16:16.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.757+0000 7f3d6f542800 20 remove_watcher() i=7 2024-09-13T19:16:16.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.757+0000 7f3d6f542800 1 -- 172.21.15.102:0/2207895940 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f3d5c01f400 msgr2=0x7f3d5c044200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.757+0000 7f3d6f542800 1 --2- 172.21.15.102:0/2207895940 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f3d5c01f400 0x7f3d5c044200 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.757+0000 7f3d6f542800 1 -- 172.21.15.102:0/2207895940 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5654a7cdae20 msgr2=0x5654a7cdd2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.757+0000 7f3d6f542800 1 --2- 172.21.15.102:0/2207895940 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5654a7cdae20 0x5654a7cdd2e0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.757+0000 7f3d6f542800 1 -- 172.21.15.102:0/2207895940 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f3d64032020 msgr2=0x7f3d64011910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.757+0000 7f3d6f542800 1 --2- 172.21.15.102:0/2207895940 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f3d64032020 0x7f3d64011910 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.757+0000 7f3d6f542800 1 -- 172.21.15.102:0/2207895940 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5654a7cdf4f0 msgr2=0x5654a7ce1900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.757+0000 7f3d6f542800 1 --2- 172.21.15.102:0/2207895940 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5654a7cdf4f0 0x5654a7ce1900 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.757+0000 7f3d6f542800 1 -- 172.21.15.102:0/2207895940 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3c34036b90 msgr2=0x7f3c34039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.757+0000 7f3d6f542800 1 --2- 172.21.15.102:0/2207895940 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3c34036b90 0x7f3c34039050 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c00baa0 tx=0x7f3d5c041000 comp rx=0 tx=0).stop 2024-09-13T19:16:16.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.757+0000 7f3d6f542800 1 -- 172.21.15.102:0/2207895940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654a7cc7ec0 msgr2=0x5654a7ccf390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.757+0000 7f3d6f542800 1 --2- 172.21.15.102:0/2207895940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654a7cc7ec0 0x5654a7ccf390 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3d6404bcc0 tx=0x7f3d6404cd30 comp rx=0 tx=0).stop 2024-09-13T19:16:16.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.757+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 reap_dead start 2024-09-13T19:16:16.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.757+0000 7f3d62a96640 1 -- 172.21.15.102:0/2207895940 reap_dead start 2024-09-13T19:16:16.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.757+0000 7f3d6f542800 1 -- 172.21.15.102:0/2207895940 shutdown_connections 2024-09-13T19:16:16.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.757+0000 7f3d6f542800 1 -- 172.21.15.102:0/2207895940 >> 172.21.15.102:0/2207895940 conn(0x5654a7cc4220 msgr2=0x5654a7cc22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:16.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.757+0000 7f3d6f542800 1 -- 172.21.15.102:0/2207895940 shutdown_connections 2024-09-13T19:16:16.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.757+0000 7f3d6f542800 1 -- 172.21.15.102:0/2207895940 wait complete. 2024-09-13T19:16:16.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.758+0000 7f3d6f542800 1 -- 172.21.15.102:0/490069222 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3c44036b90 msgr2=0x7f3c44039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.758+0000 7f3d6f542800 1 --2- 172.21.15.102:0/490069222 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3c44036b90 0x7f3c44039050 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x5654a7ca8c10 tx=0x7f3d5c01ff30 comp rx=0 tx=0).stop 2024-09-13T19:16:16.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.758+0000 7f3d6f542800 1 -- 172.21.15.102:0/490069222 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654a7cbb220 msgr2=0x5654a7cbb640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.758+0000 7f3d6f542800 1 --2- 172.21.15.102:0/490069222 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654a7cbb220 0x5654a7cbb640 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x5654a7ca1880 tx=0x7f3d640167b0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.758+0000 7f3d6f542800 1 -- 172.21.15.102:0/490069222 shutdown_connections 2024-09-13T19:16:16.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.758+0000 7f3d6f542800 1 --2- 172.21.15.102:0/490069222 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3c44036b90 0x7f3c44039050 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.758+0000 7f3d6f542800 1 --2- 172.21.15.102:0/490069222 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654a7cbb220 0x5654a7cbb640 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.758+0000 7f3d6f542800 1 -- 172.21.15.102:0/490069222 >> 172.21.15.102:0/490069222 conn(0x5654a7cb01b0 msgr2=0x5654a7cb2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:16.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.758+0000 7f3d6f542800 1 -- 172.21.15.102:0/490069222 shutdown_connections 2024-09-13T19:16:16.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.758+0000 7f3d6f542800 1 -- 172.21.15.102:0/490069222 wait complete. 2024-09-13T19:16:16.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.758+0000 7f3d6f542800 1 -- 172.21.15.102:0/4048977561 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5654a7baa900 msgr2=0x5654a7ca74f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.758+0000 7f3d6f542800 1 --2- 172.21.15.102:0/4048977561 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5654a7baa900 0x5654a7ca74f0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.758+0000 7f3d6f542800 1 -- 172.21.15.102:0/4048977561 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5654a7ca9da0 msgr2=0x5654a7cac190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.758+0000 7f3d6f542800 1 --2- 172.21.15.102:0/4048977561 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5654a7ca9da0 0x5654a7cac190 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.758+0000 7f3d6f542800 1 -- 172.21.15.102:0/4048977561 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3c50036b40 msgr2=0x7f3c50039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.758+0000 7f3d6f542800 1 --2- 172.21.15.102:0/4048977561 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3c50036b40 0x7f3c50039000 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3d54057000 tx=0x7f3d54052000 comp rx=0 tx=0).stop 2024-09-13T19:16:16.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.758+0000 7f3d6f542800 1 -- 172.21.15.102:0/4048977561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654a7ba64c0 msgr2=0x5654a7ca0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.758+0000 7f3d6f542800 1 --2- 172.21.15.102:0/4048977561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654a7ba64c0 0x5654a7ca0480 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c000f60 tx=0x7f3d5c000bc0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.758+0000 7f3d6f542800 1 -- 172.21.15.102:0/4048977561 shutdown_connections 2024-09-13T19:16:16.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.758+0000 7f3d6f542800 1 --2- 172.21.15.102:0/4048977561 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5654a7ca9da0 0x5654a7cac190 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.758+0000 7f3d6f542800 1 --2- 172.21.15.102:0/4048977561 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5654a7baa900 0x5654a7ca74f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.758+0000 7f3d6f542800 1 --2- 172.21.15.102:0/4048977561 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3c50036b40 0x7f3c50039000 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.758+0000 7f3d6f542800 1 --2- 172.21.15.102:0/4048977561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654a7ba64c0 0x5654a7ca0480 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.758+0000 7f3d6f542800 1 -- 172.21.15.102:0/4048977561 >> 172.21.15.102:0/4048977561 conn(0x5654a7ba1df0 msgr2=0x5654a7c8fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:16.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.758+0000 7f3d6f542800 1 -- 172.21.15.102:0/4048977561 shutdown_connections 2024-09-13T19:16:16.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.758+0000 7f3d6f542800 1 -- 172.21.15.102:0/4048977561 wait complete. 2024-09-13T19:16:16.770 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:16:14.779675Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-13T19:16:16.617088Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:16:14.779665Z', 'tags': [], 'group_ids': []} 2024-09-13T19:16:16.770 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-13T19:16:16.771 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-13T19:16:16.771 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2024-09-13T19:16:16.816 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:16.817 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:16.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.814+0000 7f0fb2339800 1 Processor -- start 2024-09-13T19:16:16.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.814+0000 7f0fb2339800 1 -- start start 2024-09-13T19:16:16.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.814+0000 7f0fb2339800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55dca0b11c80 0x55dca0b14070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.814+0000 7f0fb2339800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55dca09cab30 con 0x55dca0a7eeb0 2024-09-13T19:16:16.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.814+0000 7f0fb2339800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55dca09ac360 con 0x55dca0b11c80 2024-09-13T19:16:16.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.815+0000 7f0fad7f4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55dca0b11c80 0x55dca0b14070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.815+0000 7f0fadff5640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55dca0a7eeb0 0x55dca0b10560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:49916/0 (socket says 172.21.15.102:49916) 2024-09-13T19:16:16.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.815+0000 7f0fadff5640 1 -- 172.21.15.102:0/780380860 learned_addr learned my addr 172.21.15.102:0/780380860 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:16:16.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.815+0000 7f0fad7f4640 1 --2- 172.21.15.102:0/780380860 >> v2:172.21.15.53:3300/0 conn(0x55dca0b11c80 0x55dca0b14070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54666/0 (socket says 172.21.15.102:54666) 2024-09-13T19:16:16.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.815+0000 7f0fad7f4640 1 -- 172.21.15.102:0/780380860 >> v1:172.21.15.53:6789/0 conn(0x55dca0a7eeb0 legacy=0x55dca0b10560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.815+0000 7f0fad7f4640 1 -- 172.21.15.102:0/780380860 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dca09d2e00 con 0x55dca0b11c80 2024-09-13T19:16:16.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.817+0000 7f0fad7f4640 1 --2- 172.21.15.102:0/780380860 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dca0b11c80 0x55dca0b14070 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f0fa400a470 tx=0x7f0fa4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1be0b6cc0c8164d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.817+0000 7f0facff3640 1 -- 172.21.15.102:0/780380860 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fa4053570 con 0x55dca0b11c80 2024-09-13T19:16:16.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.817+0000 7f0facff3640 1 -- 172.21.15.102:0/780380860 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fa4058070 con 0x55dca0b11c80 2024-09-13T19:16:16.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.817+0000 7f0facff3640 1 -- 172.21.15.102:0/780380860 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fa4053880 con 0x55dca0b11c80 2024-09-13T19:16:16.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.817+0000 7f0fb2339800 1 -- 172.21.15.102:0/780380860 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dca0b11c80 msgr2=0x55dca0b14070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.817+0000 7f0fb2339800 1 --2- 172.21.15.102:0/780380860 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dca0b11c80 0x55dca0b14070 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f0fa400a470 tx=0x7f0fa4045a20 comp rx=0 tx=0).stop 2024-09-13T19:16:16.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.818+0000 7f0fb2339800 1 -- 172.21.15.102:0/780380860 shutdown_connections 2024-09-13T19:16:16.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.818+0000 7f0fb2339800 1 --2- 172.21.15.102:0/780380860 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dca0b11c80 0x55dca0b14070 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.818+0000 7f0fb2339800 1 -- 172.21.15.102:0/780380860 >> 172.21.15.102:0/780380860 conn(0x55dca0b05dd0 msgr2=0x55dca0b081f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:16.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.818+0000 7f0fb2339800 1 -- 172.21.15.102:0/780380860 shutdown_connections 2024-09-13T19:16:16.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.818+0000 7f0fb2339800 1 -- 172.21.15.102:0/780380860 wait complete. 2024-09-13T19:16:16.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.831+0000 7f0fb2339800 1 Processor -- start 2024-09-13T19:16:16.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.831+0000 7f0fb2339800 1 -- start start 2024-09-13T19:16:16.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.832+0000 7f0fb2339800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dca0a7eeb0 0x55dca0bfcac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.832+0000 7f0fb2339800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55dca0a57360 con 0x55dca0a7eeb0 2024-09-13T19:16:16.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.832+0000 7f0fadff5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dca0a7eeb0 0x55dca0bfcac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.832+0000 7f0fadff5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dca0a7eeb0 0x55dca0bfcac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54676/0 (socket says 172.21.15.102:54676) 2024-09-13T19:16:16.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.832+0000 7f0fadff5640 1 -- 172.21.15.102:0/3530305220 learned_addr learned my addr 172.21.15.102:0/3530305220 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:16.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.832+0000 7f0fadff5640 1 -- 172.21.15.102:0/3530305220 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dca09a4bc0 con 0x55dca0a7eeb0 2024-09-13T19:16:16.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.833+0000 7f0fadff5640 1 --2- 172.21.15.102:0/3530305220 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dca0a7eeb0 0x55dca0bfcac0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0fa00017a0 tx=0x7f0fa0001c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6ccc0af9dcc49ed server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.833+0000 7f0e9be07640 1 -- 172.21.15.102:0/3530305220 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fa0016070 con 0x55dca0a7eeb0 2024-09-13T19:16:16.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.833+0000 7f0e9be07640 1 -- 172.21.15.102:0/3530305220 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fa0004520 con 0x55dca0a7eeb0 2024-09-13T19:16:16.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.833+0000 7f0e9be07640 1 -- 172.21.15.102:0/3530305220 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fa0004820 con 0x55dca0a7eeb0 2024-09-13T19:16:16.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.833+0000 7f0fb2339800 1 -- 172.21.15.102:0/3530305220 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dca0a7eeb0 msgr2=0x55dca0bfcac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.833+0000 7f0fb2339800 1 --2- 172.21.15.102:0/3530305220 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dca0a7eeb0 0x55dca0bfcac0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0fa00017a0 tx=0x7f0fa0001c60 comp rx=0 tx=0).stop 2024-09-13T19:16:16.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.833+0000 7f0fb2339800 1 -- 172.21.15.102:0/3530305220 shutdown_connections 2024-09-13T19:16:16.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.833+0000 7f0fb2339800 1 --2- 172.21.15.102:0/3530305220 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dca0a7eeb0 0x55dca0bfcac0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.833+0000 7f0fb2339800 1 -- 172.21.15.102:0/3530305220 >> 172.21.15.102:0/3530305220 conn(0x55dca0b05dd0 msgr2=0x55dca0bf8480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:16.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.834+0000 7f0fb2339800 1 -- 172.21.15.102:0/3530305220 shutdown_connections 2024-09-13T19:16:16.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.834+0000 7f0fb2339800 1 -- 172.21.15.102:0/3530305220 wait complete. 2024-09-13T19:16:16.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.834+0000 7f0fb2339800 1 Processor -- start 2024-09-13T19:16:16.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.834+0000 7f0fb2339800 1 -- start start 2024-09-13T19:16:16.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.834+0000 7f0fb2339800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dca0a7eeb0 0x55dca0c044a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.834+0000 7f0fb2339800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55dca0b148b0 con 0x55dca0a7eeb0 2024-09-13T19:16:16.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.834+0000 7f0fadff5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dca0a7eeb0 0x55dca0c044a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.834+0000 7f0fadff5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dca0a7eeb0 0x55dca0c044a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54684/0 (socket says 172.21.15.102:54684) 2024-09-13T19:16:16.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.834+0000 7f0fadff5640 1 -- 172.21.15.102:0/1489702999 learned_addr learned my addr 172.21.15.102:0/1489702999 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:16.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.834+0000 7f0fadff5640 1 -- 172.21.15.102:0/1489702999 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dca09b8fe0 con 0x55dca0a7eeb0 2024-09-13T19:16:16.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.835+0000 7f0fadff5640 1 --2- 172.21.15.102:0/1489702999 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dca0a7eeb0 0x55dca0c044a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0fa0014040 tx=0x7f0fa0001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.835+0000 7f0e9a604640 1 -- 172.21.15.102:0/1489702999 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fa0020070 con 0x55dca0a7eeb0 2024-09-13T19:16:16.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.835+0000 7f0e9a604640 1 -- 172.21.15.102:0/1489702999 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fa0011550 con 0x55dca0a7eeb0 2024-09-13T19:16:16.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.835+0000 7f0e9a604640 1 -- 172.21.15.102:0/1489702999 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fa0016040 con 0x55dca0a7eeb0 2024-09-13T19:16:16.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.835+0000 7f0fb2339800 1 -- 172.21.15.102:0/1489702999 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dca0c049e0 con 0x55dca0a7eeb0 2024-09-13T19:16:16.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.835+0000 7f0fb2339800 1 -- 172.21.15.102:0/1489702999 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dca0c04f60 con 0x55dca0a7eeb0 2024-09-13T19:16:16.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.836+0000 7f0e9a604640 1 -- 172.21.15.102:0/1489702999 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0fa0023070 con 0x55dca0a7eeb0 2024-09-13T19:16:16.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.836+0000 7f0e9a604640 1 --2- 172.21.15.102:0/1489702999 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0e94036b40 0x7f0e94039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.836+0000 7f0e9a604640 1 -- 172.21.15.102:0/1489702999 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f0fa004bee0 con 0x55dca0a7eeb0 2024-09-13T19:16:16.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.836+0000 7f0fad7f4640 1 --2- 172.21.15.102:0/1489702999 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0e94036b40 0x7f0e94039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.836+0000 7f0fb2339800 1 --2- 172.21.15.102:0/1489702999 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55dca0b11c80 0x55dca0c0b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.836+0000 7f0fb2339800 1 -- 172.21.15.102:0/1489702999 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c0bae0 con 0x55dca0b11c80 2024-09-13T19:16:16.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.836+0000 7f0fae7f6640 1 --2- 172.21.15.102:0/1489702999 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55dca0b11c80 0x55dca0c0b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.836+0000 7f0fad7f4640 1 --2- 172.21.15.102:0/1489702999 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0e94036b40 0x7f0e94039000 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4057000 tx=0x7f0fa4052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.836+0000 7f0fae7f6640 1 --2- 172.21.15.102:0/1489702999 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55dca0b11c80 0x55dca0c0b510 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.837+0000 7f0fae7f6640 1 -- 172.21.15.102:0/1489702999 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0fa80083e0 con 0x55dca0b11c80 2024-09-13T19:16:16.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.837+0000 7f0fb2339800 1 -- 172.21.15.102:0/1489702999 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c08ac0 con 0x55dca0b11c80 2024-09-13T19:16:16.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.837+0000 7f0fae7f6640 1 -- 172.21.15.102:0/1489702999 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0fa80083e0 con 0x55dca0b11c80 2024-09-13T19:16:16.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.837+0000 7f0fb2339800 1 --2- 172.21.15.102:0/1489702999 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55dca0c0ddf0 0x55dca0c101e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.837+0000 7f0fb2339800 1 -- 172.21.15.102:0/1489702999 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c108d0 con 0x55dca0c0ddf0 2024-09-13T19:16:16.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.837+0000 7f0fadff5640 1 --2- 172.21.15.102:0/1489702999 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55dca0c0ddf0 0x55dca0c101e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.837+0000 7f0fadff5640 1 --2- 172.21.15.102:0/1489702999 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55dca0c0ddf0 0x55dca0c101e0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.838+0000 7f0fadff5640 1 -- 172.21.15.102:0/1489702999 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0fa002c070 con 0x55dca0c0ddf0 2024-09-13T19:16:16.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.838+0000 7f0fb2339800 1 -- 172.21.15.102:0/1489702999 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c0cc90 con 0x55dca0b11c80 2024-09-13T19:16:16.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.838+0000 7f0fae7f6640 1 -- 172.21.15.102:0/1489702999 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0fa80083e0 con 0x55dca0b11c80 2024-09-13T19:16:16.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.838+0000 7f0fb2339800 1 -- 172.21.15.102:0/1489702999 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c0d130 con 0x55dca0c0ddf0 2024-09-13T19:16:16.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.838+0000 7f0fadff5640 1 -- 172.21.15.102:0/1489702999 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0fa002c070 con 0x55dca0c0ddf0 2024-09-13T19:16:16.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.839+0000 7f0fb2339800 1 Processor -- start 2024-09-13T19:16:16.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.839+0000 7f0fb2339800 1 -- start start 2024-09-13T19:16:16.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.839+0000 7f0fb2339800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dca0c1f230 0x55dca0c1f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.839+0000 7f0fb2339800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55dca09a6580 con 0x55dca0c1f230 2024-09-13T19:16:16.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.839+0000 7f0fae7f6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dca0c1f230 0x55dca0c1f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.839+0000 7f0fae7f6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dca0c1f230 0x55dca0c1f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54698/0 (socket says 172.21.15.102:54698) 2024-09-13T19:16:16.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.839+0000 7f0fae7f6640 1 -- 172.21.15.102:0/49588876 learned_addr learned my addr 172.21.15.102:0/49588876 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:16.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.840+0000 7f0fae7f6640 1 -- 172.21.15.102:0/49588876 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dca0c1fb90 con 0x55dca0c1f230 2024-09-13T19:16:16.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.840+0000 7f0fae7f6640 1 --2- 172.21.15.102:0/49588876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dca0c1f230 0x55dca0c1f650 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x55dca0c05550 tx=0x7f0fa800beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.840+0000 7f0e937fe640 1 -- 172.21.15.102:0/49588876 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fa801c020 con 0x55dca0c1f230 2024-09-13T19:16:16.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.840+0000 7f0e937fe640 1 -- 172.21.15.102:0/49588876 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fa8007cf0 con 0x55dca0c1f230 2024-09-13T19:16:16.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.840+0000 7f0fb2339800 1 -- 172.21.15.102:0/49588876 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dca0c1fe20 con 0x55dca0c1f230 2024-09-13T19:16:16.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.840+0000 7f0e937fe640 1 -- 172.21.15.102:0/49588876 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fa8018440 con 0x55dca0c1f230 2024-09-13T19:16:16.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.840+0000 7f0fb2339800 1 -- 172.21.15.102:0/49588876 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dca0c22b00 con 0x55dca0c1f230 2024-09-13T19:16:16.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.841+0000 7f0e937fe640 1 -- 172.21.15.102:0/49588876 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0fa801f020 con 0x55dca0c1f230 2024-09-13T19:16:16.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.841+0000 7f0e937fe640 1 --2- 172.21.15.102:0/49588876 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0e88036b90 0x7f0e88039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.841+0000 7f0e937fe640 1 -- 172.21.15.102:0/49588876 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f0fa804e260 con 0x55dca0c1f230 2024-09-13T19:16:16.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.841+0000 7f0fadff5640 1 --2- 172.21.15.102:0/49588876 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0e88036b90 0x7f0e88039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.841+0000 7f0fb2339800 1 Processor -- start 2024-09-13T19:16:16.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.841+0000 7f0fadff5640 1 --2- 172.21.15.102:0/49588876 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0e88036b90 0x7f0e88039050 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x55dca0c0c3a0 tx=0x7f0fa001cf50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.841+0000 7f0fb2339800 1 -- start start 2024-09-13T19:16:16.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.841+0000 7f0fb2339800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dca0c2bf00 0x55dca0c2c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.841+0000 7f0fb2339800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55dca0bfd270 con 0x55dca0c2bf00 2024-09-13T19:16:16.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.842+0000 7f0fae7f6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dca0c2bf00 0x55dca0c2c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.842+0000 7f0fae7f6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dca0c2bf00 0x55dca0c2c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54714/0 (socket says 172.21.15.102:54714) 2024-09-13T19:16:16.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.842+0000 7f0fae7f6640 1 -- 172.21.15.102:0/201085257 learned_addr learned my addr 172.21.15.102:0/201085257 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:16.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.842+0000 7f0fae7f6640 1 -- 172.21.15.102:0/201085257 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dca0c2c8d0 con 0x55dca0c2bf00 2024-09-13T19:16:16.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.842+0000 7f0fae7f6640 1 --2- 172.21.15.102:0/201085257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dca0c2bf00 0x55dca0c2c300 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0fa804c5f0 tx=0x7f0fa8016640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcd7744216e611 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.842+0000 7f0e917fa640 1 -- 172.21.15.102:0/201085257 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fa8045070 con 0x55dca0c2bf00 2024-09-13T19:16:16.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.842+0000 7f0e917fa640 1 -- 172.21.15.102:0/201085257 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fa8021400 con 0x55dca0c2bf00 2024-09-13T19:16:16.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.842+0000 7f0e917fa640 1 -- 172.21.15.102:0/201085257 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fa8018b40 con 0x55dca0c2bf00 2024-09-13T19:16:16.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.843+0000 7f0fb2339800 1 -- 172.21.15.102:0/201085257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dca0c2bf00 msgr2=0x55dca0c2c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.843+0000 7f0fb2339800 1 --2- 172.21.15.102:0/201085257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dca0c2bf00 0x55dca0c2c300 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0fa804c5f0 tx=0x7f0fa8016640 comp rx=0 tx=0).stop 2024-09-13T19:16:16.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.843+0000 7f0fb2339800 1 -- 172.21.15.102:0/201085257 shutdown_connections 2024-09-13T19:16:16.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.843+0000 7f0fb2339800 1 --2- 172.21.15.102:0/201085257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dca0c2bf00 0x55dca0c2c300 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.843+0000 7f0fb2339800 1 -- 172.21.15.102:0/201085257 >> 172.21.15.102:0/201085257 conn(0x55dca0c28260 msgr2=0x55dca0c26360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:16.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.843+0000 7f0fb2339800 1 -- 172.21.15.102:0/201085257 shutdown_connections 2024-09-13T19:16:16.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.843+0000 7f0fb2339800 1 -- 172.21.15.102:0/201085257 wait complete. 2024-09-13T19:16:16.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.843+0000 7f0fb2339800 1 Processor -- start 2024-09-13T19:16:16.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.843+0000 7f0fb2339800 1 -- start start 2024-09-13T19:16:16.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.843+0000 7f0fb2339800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dca0c2bf00 0x55dca0c333b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.843+0000 7f0fb2339800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55dca0c2cf40 con 0x55dca0c2bf00 2024-09-13T19:16:16.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.843+0000 7f0fae7f6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dca0c2bf00 0x55dca0c333b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.843+0000 7f0fae7f6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dca0c2bf00 0x55dca0c333b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54722/0 (socket says 172.21.15.102:54722) 2024-09-13T19:16:16.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.843+0000 7f0fae7f6640 1 -- 172.21.15.102:0/1344602761 learned_addr learned my addr 172.21.15.102:0/1344602761 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:16.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.844+0000 7f0fae7f6640 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dca0c338f0 con 0x55dca0c2bf00 2024-09-13T19:16:16.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.844+0000 7f0fae7f6640 1 --2- 172.21.15.102:0/1344602761 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dca0c2bf00 0x55dca0c333b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0fa804b510 tx=0x7f0fa804c580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.844+0000 7f0e7f7fe640 1 -- 172.21.15.102:0/1344602761 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fa8045030 con 0x55dca0c2bf00 2024-09-13T19:16:16.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.844+0000 7f0e7f7fe640 1 -- 172.21.15.102:0/1344602761 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fa804b210 con 0x55dca0c2bf00 2024-09-13T19:16:16.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.844+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dca0c33b80 con 0x55dca0c2bf00 2024-09-13T19:16:16.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.844+0000 7f0e7f7fe640 1 -- 172.21.15.102:0/1344602761 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fa803f040 con 0x55dca0c2bf00 2024-09-13T19:16:16.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.844+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dca0c36830 con 0x55dca0c2bf00 2024-09-13T19:16:16.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.845+0000 7f0e7f7fe640 1 -- 172.21.15.102:0/1344602761 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0fa8016040 con 0x55dca0c2bf00 2024-09-13T19:16:16.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.845+0000 7f0e7f7fe640 1 --2- 172.21.15.102:0/1344602761 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0e78036b90 0x7f0e78039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.845+0000 7f0e7f7fe640 1 -- 172.21.15.102:0/1344602761 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f0fa8046070 con 0x55dca0c2bf00 2024-09-13T19:16:16.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.845+0000 7f0fadff5640 1 --2- 172.21.15.102:0/1344602761 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0e78036b90 0x7f0e78039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.845+0000 7f0fadff5640 1 --2- 172.21.15.102:0/1344602761 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0e78036b90 0x7f0e78039050 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0fa0000f80 tx=0x7f0fa0034000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.846+0000 7f0fb2339800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.846+0000 7f0fb2339800 1 --2- 172.21.15.102:0/1344602761 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55dca0c3ede0 0x55dca0c412a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.846+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c419f0 con 0x55dca0c3ede0 2024-09-13T19:16:16.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.846+0000 7f0fad7f4640 1 --2- 172.21.15.102:0/1344602761 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55dca0c3ede0 0x55dca0c412a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.846+0000 7f0fad7f4640 1 --2- 172.21.15.102:0/1344602761 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55dca0c3ede0 0x55dca0c412a0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.846+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0fa4051070 con 0x55dca0c3ede0 2024-09-13T19:16:16.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.846+0000 7f0fb2339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:16.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.846+0000 7f0fb2339800 20 realm 2024-09-13T19:16:16.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.846+0000 7f0fb2339800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.846+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c41e20 con 0x55dca0c3ede0 2024-09-13T19:16:16.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.847+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0fa4051070 con 0x55dca0c3ede0 2024-09-13T19:16:16.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.847+0000 7f0fb2339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:16.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.847+0000 7f0fb2339800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:16.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.847+0000 7f0fb2339800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.847+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c426f0 con 0x55dca0c3ede0 2024-09-13T19:16:16.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.847+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0fa4051070 con 0x55dca0c3ede0 2024-09-13T19:16:16.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.847+0000 7f0fb2339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:16.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.847+0000 7f0fb2339800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.847+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c42a90 con 0x55dca0c3ede0 2024-09-13T19:16:16.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.847+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0fa4051070 con 0x55dca0c3ede0 2024-09-13T19:16:16.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.847+0000 7f0fb2339800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:16.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.847+0000 7f0fb2339800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.847+0000 7f0fb2339800 1 --2- 172.21.15.102:0/1344602761 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55dca0c437f0 0x55dca0c45be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.847+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c461f0 con 0x55dca0c437f0 2024-09-13T19:16:16.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.847+0000 7f0fae7f6640 1 --2- 172.21.15.102:0/1344602761 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55dca0c437f0 0x55dca0c45be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.847+0000 7f0fae7f6640 1 --2- 172.21.15.102:0/1344602761 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55dca0c437f0 0x55dca0c45be0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.848+0000 7f0fae7f6640 1 -- 172.21.15.102:0/1344602761 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0fa8028070 con 0x55dca0c437f0 2024-09-13T19:16:16.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.848+0000 7f0fb2339800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:16.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.848+0000 7f0fb2339800 20 searching for the correct realm 2024-09-13T19:16:16.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.848+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c47b00 con 0x55dca0c437f0 2024-09-13T19:16:16.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.848+0000 7f0fae7f6640 1 -- 172.21.15.102:0/1344602761 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fa8028070 con 0x55dca0c437f0 2024-09-13T19:16:16.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.848+0000 7f0fae7f6640 1 --2- 172.21.15.102:0/1344602761 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f0fa8021020 0x7f0fa802b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.848+0000 7f0fae7f6640 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c47b00 con 0x7f0fa8021020 2024-09-13T19:16:16.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.848+0000 7f0fadff5640 1 --2- 172.21.15.102:0/1344602761 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f0fa8021020 0x7f0fa802b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.848+0000 7f0fadff5640 1 --2- 172.21.15.102:0/1344602761 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f0fa8021020 0x7f0fa802b450 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.848+0000 7f0fadff5640 1 -- 172.21.15.102:0/1344602761 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fa002c070 con 0x7f0fa8021020 2024-09-13T19:16:16.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.849+0000 7f0fadff5640 1 --2- 172.21.15.102:0/1344602761 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f0fa0025070 0x7f0fa003e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.849+0000 7f0fadff5640 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c47b00 con 0x7f0fa0025070 2024-09-13T19:16:16.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.849+0000 7f0fad7f4640 1 --2- 172.21.15.102:0/1344602761 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f0fa0025070 0x7f0fa003e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.849+0000 7f0fad7f4640 1 --2- 172.21.15.102:0/1344602761 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f0fa0025070 0x7f0fa003e040 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.849+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fa4051070 con 0x7f0fa0025070 2024-09-13T19:16:16.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.849+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c47b00 con 0x55dca0c3ede0 2024-09-13T19:16:16.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.850+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fa4051070 con 0x55dca0c3ede0 2024-09-13T19:16:16.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.850+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c47b00 con 0x55dca0c3ede0 2024-09-13T19:16:16.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.850+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fa4051070 con 0x55dca0c3ede0 2024-09-13T19:16:16.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.850+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c47b00 con 0x7f0fa0025070 2024-09-13T19:16:16.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.850+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fa4051070 con 0x7f0fa0025070 2024-09-13T19:16:16.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.850+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c47b00 con 0x7f0fa0025070 2024-09-13T19:16:16.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.850+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fa4051070 con 0x7f0fa0025070 2024-09-13T19:16:16.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.850+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c47b00 con 0x7f0fa8021020 2024-09-13T19:16:16.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.851+0000 7f0fadff5640 1 -- 172.21.15.102:0/1344602761 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fa002c070 con 0x7f0fa8021020 2024-09-13T19:16:16.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.851+0000 7f0fadff5640 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c47b00 con 0x55dca0c437f0 2024-09-13T19:16:16.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.851+0000 7f0fae7f6640 1 -- 172.21.15.102:0/1344602761 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fa8028070 con 0x55dca0c437f0 2024-09-13T19:16:16.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.851+0000 7f0fae7f6640 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c47b00 con 0x55dca0c3ede0 2024-09-13T19:16:16.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.851+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fa4051070 con 0x55dca0c3ede0 2024-09-13T19:16:16.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.851+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c47b00 con 0x7f0fa0025070 2024-09-13T19:16:16.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.851+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fa4051070 con 0x7f0fa0025070 2024-09-13T19:16:16.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.851+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c47b00 con 0x55dca0c3ede0 2024-09-13T19:16:16.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.851+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fa4051070 con 0x55dca0c3ede0 2024-09-13T19:16:16.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.851+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c47b00 con 0x7f0fa8021020 2024-09-13T19:16:16.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.852+0000 7f0fadff5640 1 -- 172.21.15.102:0/1344602761 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0fa002c070 con 0x7f0fa8021020 2024-09-13T19:16:16.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.852+0000 7f0fadff5640 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c47b00 con 0x55dca0c437f0 2024-09-13T19:16:16.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.852+0000 7f0fae7f6640 1 -- 172.21.15.102:0/1344602761 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fa8028070 con 0x55dca0c437f0 2024-09-13T19:16:16.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.852+0000 7f0fae7f6640 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c47b00 con 0x55dca0c437f0 2024-09-13T19:16:16.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.852+0000 7f0fae7f6640 1 -- 172.21.15.102:0/1344602761 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0fa8028070 con 0x55dca0c437f0 2024-09-13T19:16:16.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.852+0000 7f0fae7f6640 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c47b00 con 0x7f0fa0025070 2024-09-13T19:16:16.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.852+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fa4051070 con 0x7f0fa0025070 2024-09-13T19:16:16.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.852+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c47b00 con 0x55dca0c437f0 2024-09-13T19:16:16.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.853+0000 7f0fae7f6640 1 -- 172.21.15.102:0/1344602761 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0fa8028070 con 0x55dca0c437f0 2024-09-13T19:16:16.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.853+0000 7f0fae7f6640 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c47b00 con 0x55dca0c437f0 2024-09-13T19:16:16.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.853+0000 7f0fae7f6640 1 -- 172.21.15.102:0/1344602761 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fa8028070 con 0x55dca0c437f0 2024-09-13T19:16:16.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.853+0000 7f0fae7f6640 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c47b00 con 0x55dca0c3ede0 2024-09-13T19:16:16.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.853+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fa4051070 con 0x55dca0c3ede0 2024-09-13T19:16:16.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.853+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c47b00 con 0x55dca0c3ede0 2024-09-13T19:16:16.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.853+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0fa4051070 con 0x55dca0c3ede0 2024-09-13T19:16:16.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.853+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c47b00 con 0x7f0fa0025070 2024-09-13T19:16:16.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.854+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fa4051070 con 0x7f0fa0025070 2024-09-13T19:16:16.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.854+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c47b00 con 0x55dca0c437f0 2024-09-13T19:16:16.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.854+0000 7f0fae7f6640 1 -- 172.21.15.102:0/1344602761 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fa8028070 con 0x55dca0c437f0 2024-09-13T19:16:16.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.854+0000 7f0fae7f6640 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c47b00 con 0x7f0fa8021020 2024-09-13T19:16:16.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.854+0000 7f0fadff5640 1 -- 172.21.15.102:0/1344602761 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fa002c070 con 0x7f0fa8021020 2024-09-13T19:16:16.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.854+0000 7f0fadff5640 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c47b00 con 0x55dca0c3ede0 2024-09-13T19:16:16.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.854+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fa4051070 con 0x55dca0c3ede0 2024-09-13T19:16:16.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.854+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c47b00 con 0x7f0fa0025070 2024-09-13T19:16:16.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.854+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fa4051070 con 0x7f0fa0025070 2024-09-13T19:16:16.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.855+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c47b00 con 0x55dca0c437f0 2024-09-13T19:16:16.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.855+0000 7f0fae7f6640 1 -- 172.21.15.102:0/1344602761 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fa8028070 con 0x55dca0c437f0 2024-09-13T19:16:16.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.855+0000 7f0fae7f6640 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c47b00 con 0x7f0fa0025070 2024-09-13T19:16:16.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.855+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fa4051070 con 0x7f0fa0025070 2024-09-13T19:16:16.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.855+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0fa4087040 con 0x7f0fa8021020 2024-09-13T19:16:16.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.855+0000 7f0fadff5640 1 -- 172.21.15.102:0/1344602761 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fa002c070 con 0x7f0fa8021020 2024-09-13T19:16:16.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.855+0000 7f0fadff5640 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0fa4087040 con 0x55dca0c437f0 2024-09-13T19:16:16.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.855+0000 7f0fae7f6640 1 -- 172.21.15.102:0/1344602761 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fa8028070 con 0x55dca0c437f0 2024-09-13T19:16:16.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.855+0000 7f0fae7f6640 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0fa4087040 con 0x7f0fa0025070 2024-09-13T19:16:16.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.856+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fa4051070 con 0x7f0fa0025070 2024-09-13T19:16:16.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.856+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0fa4087040 con 0x55dca0c3ede0 2024-09-13T19:16:16.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.856+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0fa4051070 con 0x55dca0c3ede0 2024-09-13T19:16:16.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.856+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0fa4087040 con 0x7f0fa8021020 2024-09-13T19:16:16.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.856+0000 7f0fadff5640 1 -- 172.21.15.102:0/1344602761 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fa002c070 con 0x7f0fa8021020 2024-09-13T19:16:16.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.856+0000 7f0fb2339800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:16.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.856+0000 7f0fb2339800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:16.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.856+0000 7f0fb2339800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:16.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.856+0000 7f0fb2339800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:16.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.856+0000 7f0fb2339800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:16.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.856+0000 7f0fb2339800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:16.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.856+0000 7f0fb2339800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.856+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c476d0 con 0x55dca0c3ede0 2024-09-13T19:16:16.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.856+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0fa4051070 con 0x55dca0c3ede0 2024-09-13T19:16:16.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.856+0000 7f0fb2339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:16.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.856+0000 7f0fb2339800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.857+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c46f40 con 0x55dca0c3ede0 2024-09-13T19:16:16.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.857+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0fa4051070 con 0x55dca0c3ede0 2024-09-13T19:16:16.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.857+0000 7f0fb2339800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:16.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.857+0000 7f0fb2339800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.857+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c47f80 con 0x55dca0c437f0 2024-09-13T19:16:16.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.857+0000 7f0fae7f6640 1 -- 172.21.15.102:0/1344602761 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0fa8028070 con 0x55dca0c437f0 2024-09-13T19:16:16.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.857+0000 7f0fb2339800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:16.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.857+0000 7f0fb2339800 20 zone default found 2024-09-13T19:16:16.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.857+0000 7f0fb2339800 4 Realm: () 2024-09-13T19:16:16.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.857+0000 7f0fb2339800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:16.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.857+0000 7f0fb2339800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:16.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.857+0000 7f0fb2339800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:16.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.857+0000 7f0fb2339800 20 zonegroup default 2024-09-13T19:16:16.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.857+0000 7f0fb2339800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.857+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c487d0 con 0x7f0fa0025070 2024-09-13T19:16:16.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.857+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0fa4051070 con 0x7f0fa0025070 2024-09-13T19:16:16.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.857+0000 7f0fb2339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:16.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.857+0000 7f0fb2339800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.857+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c4a550 con 0x55dca0c437f0 2024-09-13T19:16:16.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.858+0000 7f0fae7f6640 1 -- 172.21.15.102:0/1344602761 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0fa8028070 con 0x55dca0c437f0 2024-09-13T19:16:16.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.858+0000 7f0fb2339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:16.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.858+0000 7f0fb2339800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.858+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c4a960 con 0x55dca0c437f0 2024-09-13T19:16:16.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.858+0000 7f0fae7f6640 1 -- 172.21.15.102:0/1344602761 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0fa8028070 con 0x55dca0c437f0 2024-09-13T19:16:16.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.858+0000 7f0fb2339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:16.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.858+0000 7f0fb2339800 20 started sync module instance, tier type = 2024-09-13T19:16:16.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.858+0000 7f0fb2339800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:16.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.858+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c499f0 con 0x7f0fa8021020 2024-09-13T19:16:16.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.859+0000 7f0fadff5640 1 -- 172.21.15.102:0/1344602761 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(44 notify.0 [create] v34'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fa002c070 con 0x7f0fa8021020 2024-09-13T19:16:16.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.859+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94406078403904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c4adf0 con 0x7f0fa8021020 2024-09-13T19:16:16.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.859+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c4b640 con 0x55dca0c3ede0 2024-09-13T19:16:16.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.860+0000 7f0fadff5640 1 -- 172.21.15.102:0/1344602761 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94406078403904] v34'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fa002c070 con 0x7f0fa8021020 2024-09-13T19:16:16.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.860+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v34'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fa4051070 con 0x55dca0c3ede0 2024-09-13T19:16:16.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.860+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94406078406112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c4b740 con 0x55dca0c3ede0 2024-09-13T19:16:16.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.860+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c4c260 con 0x55dca0c437f0 2024-09-13T19:16:16.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.861+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94406078406112] v34'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fa4051070 con 0x55dca0c3ede0 2024-09-13T19:16:16.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.861+0000 7f0fae7f6640 1 -- 172.21.15.102:0/1344602761 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v34'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fa8028070 con 0x55dca0c437f0 2024-09-13T19:16:16.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.861+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94406078414128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c4c220 con 0x55dca0c437f0 2024-09-13T19:16:16.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.861+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c4cd10 con 0x7f0fa8021020 2024-09-13T19:16:16.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.862+0000 7f0fadff5640 1 -- 172.21.15.102:0/1344602761 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(50 notify.3 [create] v34'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fa002c070 con 0x7f0fa8021020 2024-09-13T19:16:16.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.862+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94406078416928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c4d5e0 con 0x7f0fa8021020 2024-09-13T19:16:16.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.862+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c4e0a0 con 0x55dca0c3ede0 2024-09-13T19:16:16.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.863+0000 7f0fae7f6640 1 -- 172.21.15.102:0/1344602761 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94406078414128] v34'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fa8028070 con 0x55dca0c437f0 2024-09-13T19:16:16.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.863+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v34'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fa4051070 con 0x55dca0c3ede0 2024-09-13T19:16:16.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.863+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94406078421872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c4e060 con 0x55dca0c3ede0 2024-09-13T19:16:16.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.863+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c4eb50 con 0x7f0fa0025070 2024-09-13T19:16:16.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.863+0000 7f0fadff5640 1 -- 172.21.15.102:0/1344602761 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94406078416928] v34'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fa002c070 con 0x7f0fa8021020 2024-09-13T19:16:16.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.864+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(54 notify.5 [create] v34'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fa4051070 con 0x7f0fa0025070 2024-09-13T19:16:16.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.864+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94406078419248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c4eb50 con 0x7f0fa0025070 2024-09-13T19:16:16.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.864+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c4f560 con 0x7f0fa0025070 2024-09-13T19:16:16.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.864+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94406078421872] v34'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fa4051070 con 0x55dca0c3ede0 2024-09-13T19:16:16.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.865+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94406078419248] v34'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fa4051070 con 0x7f0fa0025070 2024-09-13T19:16:16.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.866+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(56 notify.6 [create] v34'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fa4051070 con 0x7f0fa0025070 2024-09-13T19:16:16.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.866+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94406078411152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c4f0b0 con 0x7f0fa0025070 2024-09-13T19:16:16.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.866+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c4fa70 con 0x7f0fa0025070 2024-09-13T19:16:16.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.866+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(58 notify.7 [create] v34'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fa4051070 con 0x7f0fa0025070 2024-09-13T19:16:16.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.866+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94406078428608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c4fe90 con 0x7f0fa0025070 2024-09-13T19:16:16.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.866+0000 7f0fb2339800 20 add_watcher() i=0 2024-09-13T19:16:16.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.866+0000 7f0fb2339800 20 add_watcher() i=1 2024-09-13T19:16:16.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.866+0000 7f0fb2339800 20 add_watcher() i=2 2024-09-13T19:16:16.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.866+0000 7f0fb2339800 20 add_watcher() i=3 2024-09-13T19:16:16.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.866+0000 7f0fb2339800 20 add_watcher() i=4 2024-09-13T19:16:16.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.866+0000 7f0fb2339800 20 add_watcher() i=5 2024-09-13T19:16:16.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.867+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94406078411152] v34'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fa4051070 con 0x7f0fa0025070 2024-09-13T19:16:16.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.867+0000 7f0fb2339800 20 add_watcher() i=6 2024-09-13T19:16:16.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.867+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94406078428608] v34'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fa4051070 con 0x7f0fa0025070 2024-09-13T19:16:16.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.867+0000 7f0fb2339800 20 add_watcher() i=7 2024-09-13T19:16:16.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.867+0000 7f0fb2339800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:16.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.867+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c4fe90 con 0x55dca0c3ede0 2024-09-13T19:16:16.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.868+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0fa4051070 con 0x55dca0c3ede0 2024-09-13T19:16:16.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.868+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94406078429664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c50820 con 0x55dca0c3ede0 2024-09-13T19:16:16.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.869+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94406078429664] v34'82 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0fa4051070 con 0x55dca0c3ede0 2024-09-13T19:16:16.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.869+0000 7f0e5f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:16.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.869+0000 7f0fb2339800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:16.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.869+0000 7f0fb2339800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:16.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.869+0000 7f0fb2339800 5 note: GC not initialized 2024-09-13T19:16:16.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.869+0000 7f0e5e7fc640 20 reqs_thread_entry: start 2024-09-13T19:16:16.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.869+0000 7f0fb2339800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:16.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.869+0000 7f0fb2339800 20 Filter name: none 2024-09-13T19:16:16.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.869+0000 7f0dcffff640 20 reqs_thread_entry: start 2024-09-13T19:16:16.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.869+0000 7f0fb2339800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:16:16.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.869+0000 7f0fb2339800 20 rados->read ofs=0 len=0 2024-09-13T19:16:16.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.869+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c861d0 con 0x55dca0c3ede0 2024-09-13T19:16:16.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.870+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f0fa4051070 con 0x55dca0c3ede0 2024-09-13T19:16:16.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.870+0000 7f0fb2339800 20 rados_obj.operate() r=0 bl.length=673 2024-09-13T19:16:16.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.870+0000 7f0fb2339800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:16:16.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.870+0000 7f0fb2339800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:16:16.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.870+0000 7f0fb2339800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:16:16.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.870+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c8ce30 con 0x55dca0c3ede0 2024-09-13T19:16:16.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.871+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~582] v34'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f0fa4051070 con 0x55dca0c3ede0 2024-09-13T19:16:16.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.871+0000 7f0fb2339800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:16:16.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.871+0000 7f0fb2339800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:16:16.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.871+0000 7f0fb2339800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T19:16:16.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.871+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94406078679024 in=770b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c884d0 con 0x55dca0c3ede0 2024-09-13T19:16:16.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.871+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== watch-notify(notify (1) cookie 94406078421872 notify 146028888072 ret 0) ==== 800+0+0 (crc 0 0 0) 0x7f0fa408e040 con 0x55dca0c3ede0 2024-09-13T19:16:16.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.871+0000 7f0e917fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888072 cookie 94406078421872 notifier 4412 bl.length()=758 2024-09-13T19:16:16.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.871+0000 7f0e917fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:16:16.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.871+0000 7f0e917fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:16:16.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.871+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(64 notify.4 [notify cookie 94406078679024 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0fa4051070 con 0x55dca0c3ede0 2024-09-13T19:16:16.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.871+0000 7f0e917fa640 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f0e70003ea0 con 0x55dca0c3ede0 2024-09-13T19:16:16.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.871+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== watch-notify(notify_complete (2) cookie 94406078679024 notify 146028888072 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f0fa4082040 con 0x55dca0c3ede0 2024-09-13T19:16:16.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.871+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fa4051070 con 0x55dca0c3ede0 2024-09-13T19:16:16.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.871+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:66 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c8c7f0 con 0x55dca0c3ede0 2024-09-13T19:16:16.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.872+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(66 foo:foo1 [delete] v34'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fa4051070 con 0x55dca0c3ede0 2024-09-13T19:16:16.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.872+0000 7f0fb2339800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-13T19:16:16.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.872+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94406078679024 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c88020 con 0x7f0fa8021020 2024-09-13T19:16:16.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.873+0000 7f0fadff5640 1 -- 172.21.15.102:0/1344602761 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== watch-notify(notify (1) cookie 94406078403904 notify 146028888068 ret 0) ==== 201+0+0 (crc 0 0 0) 0x55dca0c04f60 con 0x7f0fa8021020 2024-09-13T19:16:16.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.873+0000 7f0e90ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888068 cookie 94406078403904 notifier 4412 bl.length()=159 2024-09-13T19:16:16.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.873+0000 7f0fadff5640 1 -- 172.21.15.102:0/1344602761 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(67 notify.0 [notify cookie 94406078679024 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0fa002c070 con 0x7f0fa8021020 2024-09-13T19:16:16.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.873+0000 7f0e90ff9640 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f0dd80032c0 con 0x7f0fa8021020 2024-09-13T19:16:16.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.873+0000 7f0fadff5640 1 -- 172.21.15.102:0/1344602761 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fa002c070 con 0x7f0fa8021020 2024-09-13T19:16:16.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.873+0000 7f0fadff5640 1 -- 172.21.15.102:0/1344602761 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== watch-notify(notify_complete (2) cookie 94406078679024 notify 146028888068 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55dca0c049e0 con 0x7f0fa8021020 2024-09-13T19:16:16.895 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:16:14.779675Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-13T19:16:16.617088Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:16:14.779665Z","tags":[],"group_ids":[]} 2024-09-13T19:16:16.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.874+0000 7f0e5f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:16.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.874+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94406078429664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c83f20 con 0x55dca0c3ede0 2024-09-13T19:16:16.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.875+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 <== osd.1 v2:172.21.15.102:6808/2204418452 28 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94406078429664] v34'83 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0fa4051070 con 0x55dca0c3ede0 2024-09-13T19:16:16.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.875+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94406078403904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c83f20 con 0x7f0fa8021020 2024-09-13T19:16:16.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.876+0000 7f0fadff5640 1 -- 172.21.15.102:0/1344602761 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94406078403904] v34'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fa002c070 con 0x7f0fa8021020 2024-09-13T19:16:16.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.876+0000 7f0fb2339800 20 remove_watcher() i=0 2024-09-13T19:16:16.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.876+0000 7f0fb2339800 2 removed watcher, disabling cache 2024-09-13T19:16:16.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.876+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94406078406112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c83f20 con 0x55dca0c3ede0 2024-09-13T19:16:16.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.877+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 <== osd.1 v2:172.21.15.102:6808/2204418452 29 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94406078406112] v34'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fa4051070 con 0x55dca0c3ede0 2024-09-13T19:16:16.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.877+0000 7f0fb2339800 20 remove_watcher() i=1 2024-09-13T19:16:16.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.877+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94406078414128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c83f20 con 0x55dca0c437f0 2024-09-13T19:16:16.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.878+0000 7f0fae7f6640 1 -- 172.21.15.102:0/1344602761 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94406078414128] v34'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fa8028070 con 0x55dca0c437f0 2024-09-13T19:16:16.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.878+0000 7f0fb2339800 20 remove_watcher() i=2 2024-09-13T19:16:16.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.878+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94406078416928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c83f20 con 0x7f0fa8021020 2024-09-13T19:16:16.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.879+0000 7f0fadff5640 1 -- 172.21.15.102:0/1344602761 <== osd.2 v2:172.21.15.102:6816/2238176080 16 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94406078416928] v34'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fa002c070 con 0x7f0fa8021020 2024-09-13T19:16:16.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.879+0000 7f0fb2339800 20 remove_watcher() i=3 2024-09-13T19:16:16.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.879+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94406078421872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c83f20 con 0x55dca0c3ede0 2024-09-13T19:16:16.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.880+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 <== osd.1 v2:172.21.15.102:6808/2204418452 30 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94406078421872] v34'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fa4051070 con 0x55dca0c3ede0 2024-09-13T19:16:16.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.880+0000 7f0fb2339800 20 remove_watcher() i=4 2024-09-13T19:16:16.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.880+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94406078419248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c83f20 con 0x7f0fa0025070 2024-09-13T19:16:16.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.881+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94406078419248] v34'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fa4051070 con 0x7f0fa0025070 2024-09-13T19:16:16.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.881+0000 7f0fb2339800 20 remove_watcher() i=5 2024-09-13T19:16:16.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.881+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94406078411152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c83f20 con 0x7f0fa0025070 2024-09-13T19:16:16.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.882+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94406078411152] v34'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fa4051070 con 0x7f0fa0025070 2024-09-13T19:16:16.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.882+0000 7f0fb2339800 20 remove_watcher() i=6 2024-09-13T19:16:16.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.882+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94406078428608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dca0c83f20 con 0x7f0fa0025070 2024-09-13T19:16:16.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.883+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94406078428608] v34'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fa4051070 con 0x7f0fa0025070 2024-09-13T19:16:16.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.883+0000 7f0fb2339800 20 remove_watcher() i=7 2024-09-13T19:16:16.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.883+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f0fa0025070 msgr2=0x7f0fa003e040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.883+0000 7f0fb2339800 1 --2- 172.21.15.102:0/1344602761 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f0fa0025070 0x7f0fa003e040 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.883+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55dca0c3ede0 msgr2=0x55dca0c412a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.883+0000 7f0fb2339800 1 --2- 172.21.15.102:0/1344602761 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55dca0c3ede0 0x55dca0c412a0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.883+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f0fa8021020 msgr2=0x7f0fa802b450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.883+0000 7f0fb2339800 1 --2- 172.21.15.102:0/1344602761 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f0fa8021020 0x7f0fa802b450 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.883+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55dca0c437f0 msgr2=0x55dca0c45be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.883+0000 7f0fb2339800 1 --2- 172.21.15.102:0/1344602761 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55dca0c437f0 0x55dca0c45be0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.883+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0e78036b90 msgr2=0x7f0e78039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.883+0000 7f0fb2339800 1 --2- 172.21.15.102:0/1344602761 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0e78036b90 0x7f0e78039050 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0fa0000f80 tx=0x7f0fa0034000 comp rx=0 tx=0).stop 2024-09-13T19:16:16.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.883+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dca0c2bf00 msgr2=0x55dca0c333b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.883+0000 7f0fad7f4640 1 -- 172.21.15.102:0/1344602761 reap_dead start 2024-09-13T19:16:16.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.883+0000 7f0fb2339800 1 --2- 172.21.15.102:0/1344602761 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dca0c2bf00 0x55dca0c333b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0fa804b510 tx=0x7f0fa804c580 comp rx=0 tx=0).stop 2024-09-13T19:16:16.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.883+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 shutdown_connections 2024-09-13T19:16:16.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.883+0000 7f0fb2339800 1 --2- 172.21.15.102:0/1344602761 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dca0c2bf00 0x55dca0c333b0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.883+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 >> 172.21.15.102:0/1344602761 conn(0x55dca0c28260 msgr2=0x55dca0c26330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:16.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.883+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 shutdown_connections 2024-09-13T19:16:16.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.883+0000 7f0fb2339800 1 -- 172.21.15.102:0/1344602761 wait complete. 2024-09-13T19:16:16.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.883+0000 7f0fb2339800 1 -- 172.21.15.102:0/49588876 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0e88036b90 msgr2=0x7f0e88039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.883+0000 7f0fb2339800 1 --2- 172.21.15.102:0/49588876 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0e88036b90 0x7f0e88039050 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x55dca0c0c3a0 tx=0x7f0fa001cf50 comp rx=0 tx=0).stop 2024-09-13T19:16:16.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.883+0000 7f0fb2339800 1 -- 172.21.15.102:0/49588876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dca0c1f230 msgr2=0x55dca0c1f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.883+0000 7f0fb2339800 1 --2- 172.21.15.102:0/49588876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dca0c1f230 0x55dca0c1f650 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x55dca0c05550 tx=0x7f0fa800beb0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.883+0000 7f0fb2339800 1 -- 172.21.15.102:0/49588876 shutdown_connections 2024-09-13T19:16:16.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.883+0000 7f0fb2339800 1 --2- 172.21.15.102:0/49588876 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0e88036b90 0x7f0e88039050 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.883+0000 7f0fb2339800 1 --2- 172.21.15.102:0/49588876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dca0c1f230 0x55dca0c1f650 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.883+0000 7f0fb2339800 1 -- 172.21.15.102:0/49588876 >> 172.21.15.102:0/49588876 conn(0x55dca0c141c0 msgr2=0x55dca0c16d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:16.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.884+0000 7f0fb2339800 1 -- 172.21.15.102:0/49588876 shutdown_connections 2024-09-13T19:16:16.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.884+0000 7f0fb2339800 1 -- 172.21.15.102:0/49588876 wait complete. 2024-09-13T19:16:16.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.884+0000 7f0fb2339800 1 -- 172.21.15.102:0/1489702999 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55dca0b11c80 msgr2=0x55dca0c0b510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.884+0000 7f0fb2339800 1 --2- 172.21.15.102:0/1489702999 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55dca0b11c80 0x55dca0c0b510 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.884+0000 7f0fb2339800 1 -- 172.21.15.102:0/1489702999 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55dca0c0ddf0 msgr2=0x55dca0c101e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.884+0000 7f0fb2339800 1 --2- 172.21.15.102:0/1489702999 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55dca0c0ddf0 0x55dca0c101e0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.884+0000 7f0fb2339800 1 -- 172.21.15.102:0/1489702999 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0e94036b40 msgr2=0x7f0e94039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.884+0000 7f0fb2339800 1 --2- 172.21.15.102:0/1489702999 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0e94036b40 0x7f0e94039000 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4057000 tx=0x7f0fa4052000 comp rx=0 tx=0).stop 2024-09-13T19:16:16.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.884+0000 7f0fb2339800 1 -- 172.21.15.102:0/1489702999 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dca0a7eeb0 msgr2=0x55dca0c044a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.884+0000 7f0fb2339800 1 --2- 172.21.15.102:0/1489702999 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dca0a7eeb0 0x55dca0c044a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0fa0014040 tx=0x7f0fa0001250 comp rx=0 tx=0).stop 2024-09-13T19:16:16.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.884+0000 7f0fb2339800 1 -- 172.21.15.102:0/1489702999 shutdown_connections 2024-09-13T19:16:16.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.884+0000 7f0fb2339800 1 --2- 172.21.15.102:0/1489702999 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55dca0c0ddf0 0x55dca0c101e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.884+0000 7f0fb2339800 1 --2- 172.21.15.102:0/1489702999 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55dca0b11c80 0x55dca0c0b510 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.884+0000 7f0fb2339800 1 --2- 172.21.15.102:0/1489702999 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0e94036b40 0x7f0e94039000 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.884+0000 7f0fb2339800 1 --2- 172.21.15.102:0/1489702999 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dca0a7eeb0 0x55dca0c044a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.884+0000 7f0fb2339800 1 -- 172.21.15.102:0/1489702999 >> 172.21.15.102:0/1489702999 conn(0x55dca0b05dd0 msgr2=0x55dca0bf6d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:16.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.884+0000 7f0fb2339800 1 -- 172.21.15.102:0/1489702999 shutdown_connections 2024-09-13T19:16:16.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.884+0000 7f0fb2339800 1 -- 172.21.15.102:0/1489702999 wait complete. 2024-09-13T19:16:16.908 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:16:14.779675Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-13T19:16:16.617088Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:16:14.779665Z', 'tags': [], 'group_ids': []} 2024-09-13T19:16:16.908 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-13T19:16:16.908 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-13T19:16:16.909 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2024-09-13T19:16:16.953 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:16.953 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:16.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.950+0000 7fceaf531800 1 Processor -- start 2024-09-13T19:16:16.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.951+0000 7fceaf531800 1 -- start start 2024-09-13T19:16:16.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.951+0000 7fceaf531800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f7fd4aa550 0x55f7fd4aa950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.951+0000 7fceaf531800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f7fd36ab30 con 0x55f7fd4aae90 2024-09-13T19:16:16.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.951+0000 7fceaf531800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55f7fd34c360 con 0x55f7fd4aa550 2024-09-13T19:16:16.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.951+0000 7fceab224640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f7fd4aa550 0x55f7fd4aa950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.951+0000 7fceab224640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f7fd4aa550 0x55f7fd4aa950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54728/0 (socket says 172.21.15.102:54728) 2024-09-13T19:16:16.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.951+0000 7fceab224640 1 -- 172.21.15.102:0/127857963 learned_addr learned my addr 172.21.15.102:0/127857963 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:16.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.951+0000 7fceab224640 1 -- 172.21.15.102:0/127857963 >> v1:172.21.15.53:6789/0 conn(0x55f7fd4aae90 legacy=0x55f7fd4afa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.951+0000 7fceab224640 1 -- 172.21.15.102:0/127857963 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7fd372e00 con 0x55f7fd4aa550 2024-09-13T19:16:16.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.953+0000 7fceab224640 1 --2- 172.21.15.102:0/127857963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fd4aa550 0x55f7fd4aa950 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fce9c00a520 tx=0x7fce9c045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90897ba2a2044446 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.953+0000 7fceaa222640 1 -- 172.21.15.102:0/127857963 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce9c055070 con 0x55f7fd4aa550 2024-09-13T19:16:16.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.953+0000 7fceaa222640 1 -- 172.21.15.102:0/127857963 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce9c0515b0 con 0x55f7fd4aa550 2024-09-13T19:16:16.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.953+0000 7fceaa222640 1 -- 172.21.15.102:0/127857963 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce9c0518d0 con 0x55f7fd4aa550 2024-09-13T19:16:16.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.954+0000 7fceaf531800 1 -- 172.21.15.102:0/127857963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fd4aa550 msgr2=0x55f7fd4aa950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.954+0000 7fceaf531800 1 --2- 172.21.15.102:0/127857963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fd4aa550 0x55f7fd4aa950 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fce9c00a520 tx=0x7fce9c045ba0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.954+0000 7fceaf531800 1 -- 172.21.15.102:0/127857963 shutdown_connections 2024-09-13T19:16:16.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.954+0000 7fceaf531800 1 --2- 172.21.15.102:0/127857963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fd4aa550 0x55f7fd4aa950 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.954+0000 7fceaf531800 1 -- 172.21.15.102:0/127857963 >> 172.21.15.102:0/127857963 conn(0x55f7fd4a5de0 msgr2=0x55f7fd4a8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:16.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.954+0000 7fceaf531800 1 -- 172.21.15.102:0/127857963 shutdown_connections 2024-09-13T19:16:16.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.954+0000 7fceaf531800 1 -- 172.21.15.102:0/127857963 wait complete. 2024-09-13T19:16:16.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.968+0000 7fceaf531800 1 Processor -- start 2024-09-13T19:16:16.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.968+0000 7fceaf531800 1 -- start start 2024-09-13T19:16:16.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.968+0000 7fceaf531800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fd4aa550 0x55f7fd41f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.968+0000 7fceaf531800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f7fd3f7330 con 0x55f7fd4aa550 2024-09-13T19:16:16.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.968+0000 7fceab224640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fd4aa550 0x55f7fd41f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.968+0000 7fceab224640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fd4aa550 0x55f7fd41f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54738/0 (socket says 172.21.15.102:54738) 2024-09-13T19:16:16.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.968+0000 7fceab224640 1 -- 172.21.15.102:0/1657347169 learned_addr learned my addr 172.21.15.102:0/1657347169 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:16.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.969+0000 7fceab224640 1 -- 172.21.15.102:0/1657347169 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7fd344bc0 con 0x55f7fd4aa550 2024-09-13T19:16:16.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.969+0000 7fceab224640 1 --2- 172.21.15.102:0/1657347169 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fd4aa550 0x55f7fd41f5a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fce9c025da0 tx=0x7fce9c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f5e85062f658bae server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.969+0000 7fcd9960a640 1 -- 172.21.15.102:0/1657347169 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce9c051950 con 0x55f7fd4aa550 2024-09-13T19:16:16.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.969+0000 7fcd9960a640 1 -- 172.21.15.102:0/1657347169 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce9c051af0 con 0x55f7fd4aa550 2024-09-13T19:16:16.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.969+0000 7fcd9960a640 1 -- 172.21.15.102:0/1657347169 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce9c051dd0 con 0x55f7fd4aa550 2024-09-13T19:16:16.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.970+0000 7fceaf531800 1 -- 172.21.15.102:0/1657347169 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fd4aa550 msgr2=0x55f7fd41f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:16.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.970+0000 7fceaf531800 1 --2- 172.21.15.102:0/1657347169 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fd4aa550 0x55f7fd41f5a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fce9c025da0 tx=0x7fce9c051000 comp rx=0 tx=0).stop 2024-09-13T19:16:16.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.970+0000 7fceaf531800 1 -- 172.21.15.102:0/1657347169 shutdown_connections 2024-09-13T19:16:16.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.970+0000 7fceaf531800 1 --2- 172.21.15.102:0/1657347169 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fd4aa550 0x55f7fd41f5a0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:16.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.970+0000 7fceaf531800 1 -- 172.21.15.102:0/1657347169 >> 172.21.15.102:0/1657347169 conn(0x55f7fd4a5de0 msgr2=0x55f7fd595150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:16.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.970+0000 7fceaf531800 1 -- 172.21.15.102:0/1657347169 shutdown_connections 2024-09-13T19:16:16.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.970+0000 7fceaf531800 1 -- 172.21.15.102:0/1657347169 wait complete. 2024-09-13T19:16:16.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.970+0000 7fceaf531800 1 Processor -- start 2024-09-13T19:16:16.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.970+0000 7fceaf531800 1 -- start start 2024-09-13T19:16:16.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.970+0000 7fceaf531800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fd4aa550 0x55f7fd5a2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.970+0000 7fceaf531800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f7fd4b1570 con 0x55f7fd4aa550 2024-09-13T19:16:16.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.971+0000 7fceab224640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fd4aa550 0x55f7fd5a2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.971+0000 7fceab224640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fd4aa550 0x55f7fd5a2150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54744/0 (socket says 172.21.15.102:54744) 2024-09-13T19:16:16.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.971+0000 7fceab224640 1 -- 172.21.15.102:0/761186787 learned_addr learned my addr 172.21.15.102:0/761186787 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:16.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.971+0000 7fceab224640 1 -- 172.21.15.102:0/761186787 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7fd358fe0 con 0x55f7fd4aa550 2024-09-13T19:16:16.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.971+0000 7fceab224640 1 --2- 172.21.15.102:0/761186787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fd4aa550 0x55f7fd5a2150 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fce9c067040 tx=0x7fce9c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.971+0000 7fcd97e07640 1 -- 172.21.15.102:0/761186787 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce9c073070 con 0x55f7fd4aa550 2024-09-13T19:16:16.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.971+0000 7fcd97e07640 1 -- 172.21.15.102:0/761186787 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce9c05a450 con 0x55f7fd4aa550 2024-09-13T19:16:16.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.971+0000 7fcd97e07640 1 -- 172.21.15.102:0/761186787 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce9c05a730 con 0x55f7fd4aa550 2024-09-13T19:16:16.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.971+0000 7fceaf531800 1 -- 172.21.15.102:0/761186787 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f7fd5a2690 con 0x55f7fd4aa550 2024-09-13T19:16:16.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.971+0000 7fceaf531800 1 -- 172.21.15.102:0/761186787 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7fd5a2c10 con 0x55f7fd4aa550 2024-09-13T19:16:16.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.972+0000 7fcd97e07640 1 -- 172.21.15.102:0/761186787 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fce9c076070 con 0x55f7fd4aa550 2024-09-13T19:16:16.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.972+0000 7fcd97e07640 1 --2- 172.21.15.102:0/761186787 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fcd90036b40 0x7fcd90039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.972+0000 7fcd97e07640 1 -- 172.21.15.102:0/761186787 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fce9c062070 con 0x55f7fd4aa550 2024-09-13T19:16:16.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.972+0000 7fceaaa23640 1 --2- 172.21.15.102:0/761186787 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fcd90036b40 0x7fcd90039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.972+0000 7fceaf531800 1 --2- 172.21.15.102:0/761186787 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55f7fd4aae90 0x55f7fd5a91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.972+0000 7fceaf531800 1 -- 172.21.15.102:0/761186787 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5a9740 con 0x55f7fd4aae90 2024-09-13T19:16:16.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.972+0000 7fceaba25640 1 --2- 172.21.15.102:0/761186787 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55f7fd4aae90 0x55f7fd5a91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.973+0000 7fceaaa23640 1 --2- 172.21.15.102:0/761186787 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fcd90036b40 0x7fcd90039000 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcea0001e10 tx=0x7fcea0001390 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.973+0000 7fceaba25640 1 --2- 172.21.15.102:0/761186787 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55f7fd4aae90 0x55f7fd5a91c0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.973+0000 7fceaba25640 1 -- 172.21.15.102:0/761186787 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcea400a4a0 con 0x55f7fd4aae90 2024-09-13T19:16:16.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.973+0000 7fceaf531800 1 -- 172.21.15.102:0/761186787 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5aa000 con 0x55f7fd4aae90 2024-09-13T19:16:16.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.973+0000 7fceaba25640 1 -- 172.21.15.102:0/761186787 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcea400a4a0 con 0x55f7fd4aae90 2024-09-13T19:16:16.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.973+0000 7fceaf531800 1 --2- 172.21.15.102:0/761186787 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55f7fd5ab910 0x55f7fd5adda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:16.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.973+0000 7fceaf531800 1 -- 172.21.15.102:0/761186787 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5ae530 con 0x55f7fd5ab910 2024-09-13T19:16:16.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.973+0000 7fceab224640 1 --2- 172.21.15.102:0/761186787 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55f7fd5ab910 0x55f7fd5adda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:16.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.974+0000 7fceab224640 1 --2- 172.21.15.102:0/761186787 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55f7fd5ab910 0x55f7fd5adda0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:16.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.974+0000 7fceab224640 1 -- 172.21.15.102:0/761186787 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fce9c075030 con 0x55f7fd5ab910 2024-09-13T19:16:16.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.974+0000 7fceaf531800 1 -- 172.21.15.102:0/761186787 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5aa850 con 0x55f7fd4aae90 2024-09-13T19:16:16.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.974+0000 7fceaba25640 1 -- 172.21.15.102:0/761186787 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcea400a4a0 con 0x55f7fd4aae90 2024-09-13T19:16:16.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.974+0000 7fceaf531800 1 -- 172.21.15.102:0/761186787 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5aac30 con 0x55f7fd5ab910 2024-09-13T19:16:16.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.975+0000 7fceab224640 1 -- 172.21.15.102:0/761186787 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fce9c075030 con 0x55f7fd5ab910 2024-09-13T19:16:17.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.975+0000 7fceaf531800 1 Processor -- start 2024-09-13T19:16:17.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.975+0000 7fceaf531800 1 -- start start 2024-09-13T19:16:17.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.975+0000 7fceaf531800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fd59af70 0x55f7fd5995c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.975+0000 7fceaf531800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f7fd346580 con 0x55f7fd59af70 2024-09-13T19:16:17.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.976+0000 7fceaba25640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fd59af70 0x55f7fd5995c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.976+0000 7fceaba25640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fd59af70 0x55f7fd5995c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54760/0 (socket says 172.21.15.102:54760) 2024-09-13T19:16:17.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.976+0000 7fceaba25640 1 -- 172.21.15.102:0/4145774060 learned_addr learned my addr 172.21.15.102:0/4145774060 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:17.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.976+0000 7fceaba25640 1 -- 172.21.15.102:0/4145774060 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7fd59b390 con 0x55f7fd59af70 2024-09-13T19:16:17.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.976+0000 7fceaba25640 1 --2- 172.21.15.102:0/4145774060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fd59af70 0x55f7fd5995c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x55f7fd5a3200 tx=0x7fcea40167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.976+0000 7fcd95602640 1 -- 172.21.15.102:0/4145774060 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcea4013640 con 0x55f7fd59af70 2024-09-13T19:16:17.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.976+0000 7fcd95602640 1 -- 172.21.15.102:0/4145774060 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcea40137e0 con 0x55f7fd59af70 2024-09-13T19:16:17.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.976+0000 7fcd95602640 1 -- 172.21.15.102:0/4145774060 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcea4013ae0 con 0x55f7fd59af70 2024-09-13T19:16:17.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.976+0000 7fceaf531800 1 -- 172.21.15.102:0/4145774060 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f7fd599bc0 con 0x55f7fd59af70 2024-09-13T19:16:17.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.976+0000 7fceaf531800 1 -- 172.21.15.102:0/4145774060 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7fd59a0c0 con 0x55f7fd59af70 2024-09-13T19:16:17.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.977+0000 7fcd95602640 1 -- 172.21.15.102:0/4145774060 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fcea4011040 con 0x55f7fd59af70 2024-09-13T19:16:17.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.977+0000 7fcd95602640 1 --2- 172.21.15.102:0/4145774060 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fcd84036b90 0x7fcd84039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.977+0000 7fcd95602640 1 -- 172.21.15.102:0/4145774060 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fcea400e040 con 0x55f7fd59af70 2024-09-13T19:16:17.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.977+0000 7fceab224640 1 --2- 172.21.15.102:0/4145774060 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fcd84036b90 0x7fcd84039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.978+0000 7fceaf531800 1 Processor -- start 2024-09-13T19:16:17.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.978+0000 7fceaf531800 1 -- start start 2024-09-13T19:16:17.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.978+0000 7fceab224640 1 --2- 172.21.15.102:0/4145774060 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fcd84036b90 0x7fcd84039050 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fce9c08f870 tx=0x7fce9c06e9f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.978+0000 7fceaf531800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fd5cbce0 0x55f7fd5cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.978+0000 7fceaf531800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f7fd59d6b0 con 0x55f7fd5cbce0 2024-09-13T19:16:17.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.978+0000 7fceaba25640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fd5cbce0 0x55f7fd5cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.978+0000 7fceaba25640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fd5cbce0 0x55f7fd5cc0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54764/0 (socket says 172.21.15.102:54764) 2024-09-13T19:16:17.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.978+0000 7fceaba25640 1 -- 172.21.15.102:0/3057024867 learned_addr learned my addr 172.21.15.102:0/3057024867 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:17.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.978+0000 7fceaba25640 1 -- 172.21.15.102:0/3057024867 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7fd5cc6b0 con 0x55f7fd5cbce0 2024-09-13T19:16:17.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.978+0000 7fceaba25640 1 --2- 172.21.15.102:0/3057024867 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fd5cbce0 0x55f7fd5cc0e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fcea400afb0 tx=0x7fcea401fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3d4722691d567de server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.979+0000 7fcd8effd640 1 -- 172.21.15.102:0/3057024867 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcea4021440 con 0x55f7fd5cbce0 2024-09-13T19:16:17.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.979+0000 7fcd8effd640 1 -- 172.21.15.102:0/3057024867 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcea401f340 con 0x55f7fd5cbce0 2024-09-13T19:16:17.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.979+0000 7fcd8effd640 1 -- 172.21.15.102:0/3057024867 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcea40215e0 con 0x55f7fd5cbce0 2024-09-13T19:16:17.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.979+0000 7fceaf531800 1 -- 172.21.15.102:0/3057024867 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fd5cbce0 msgr2=0x55f7fd5cc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.979+0000 7fceaf531800 1 --2- 172.21.15.102:0/3057024867 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fd5cbce0 0x55f7fd5cc0e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fcea400afb0 tx=0x7fcea401fce0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.979+0000 7fceaf531800 1 -- 172.21.15.102:0/3057024867 shutdown_connections 2024-09-13T19:16:17.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.979+0000 7fceaf531800 1 --2- 172.21.15.102:0/3057024867 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fd5cbce0 0x55f7fd5cc0e0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.979+0000 7fceaf531800 1 -- 172.21.15.102:0/3057024867 >> 172.21.15.102:0/3057024867 conn(0x55f7fd5c80d0 msgr2=0x55f7fd5c61d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:17.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.979+0000 7fceaf531800 1 -- 172.21.15.102:0/3057024867 shutdown_connections 2024-09-13T19:16:17.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.979+0000 7fceaf531800 1 -- 172.21.15.102:0/3057024867 wait complete. 2024-09-13T19:16:17.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.979+0000 7fceaf531800 1 Processor -- start 2024-09-13T19:16:17.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.979+0000 7fceaf531800 1 -- start start 2024-09-13T19:16:17.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.980+0000 7fceaf531800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fd5cbce0 0x55f7fd5d3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.980+0000 7fceaf531800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f7fd5cccf0 con 0x55f7fd5cbce0 2024-09-13T19:16:17.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.980+0000 7fceaba25640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fd5cbce0 0x55f7fd5d3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.980+0000 7fceaba25640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fd5cbce0 0x55f7fd5d3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54778/0 (socket says 172.21.15.102:54778) 2024-09-13T19:16:17.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.980+0000 7fceaba25640 1 -- 172.21.15.102:0/544781741 learned_addr learned my addr 172.21.15.102:0/544781741 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:17.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.980+0000 7fceaba25640 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7fd5d3770 con 0x55f7fd5cbce0 2024-09-13T19:16:17.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.980+0000 7fceaba25640 1 --2- 172.21.15.102:0/544781741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fd5cbce0 0x55f7fd5d3230 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fcea404cd60 tx=0x7fcea404cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.980+0000 7fcd8d7fa640 1 -- 172.21.15.102:0/544781741 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcea4013e60 con 0x55f7fd5cbce0 2024-09-13T19:16:17.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.980+0000 7fcd8d7fa640 1 -- 172.21.15.102:0/544781741 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcea4040360 con 0x55f7fd5cbce0 2024-09-13T19:16:17.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.980+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f7fd5d3a00 con 0x55f7fd5cbce0 2024-09-13T19:16:17.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.980+0000 7fcd8d7fa640 1 -- 172.21.15.102:0/544781741 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcea404e2b0 con 0x55f7fd5cbce0 2024-09-13T19:16:17.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.980+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7fd5d66b0 con 0x55f7fd5cbce0 2024-09-13T19:16:17.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.981+0000 7fcd8d7fa640 1 -- 172.21.15.102:0/544781741 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fcea403b060 con 0x55f7fd5cbce0 2024-09-13T19:16:17.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.981+0000 7fcd8d7fa640 1 --2- 172.21.15.102:0/544781741 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fcd74036b90 0x7fcd74039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.981+0000 7fcd8d7fa640 1 -- 172.21.15.102:0/544781741 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fcea4045c90 con 0x55f7fd5cbce0 2024-09-13T19:16:17.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.981+0000 7fceab224640 1 --2- 172.21.15.102:0/544781741 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fcd74036b90 0x7fcd74039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.982+0000 7fceab224640 1 --2- 172.21.15.102:0/544781741 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fcd74036b90 0x7fcd74039050 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fce9c01bb60 tx=0x7fce9c097000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.982+0000 7fceaf531800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.982+0000 7fceaf531800 1 --2- 172.21.15.102:0/544781741 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55f7fd5ded30 0x55f7fd5e11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.982+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5e1940 con 0x55f7fd5ded30 2024-09-13T19:16:17.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.982+0000 7fceaaa23640 1 --2- 172.21.15.102:0/544781741 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55f7fd5ded30 0x55f7fd5e11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.982+0000 7fceaaa23640 1 --2- 172.21.15.102:0/544781741 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55f7fd5ded30 0x55f7fd5e11f0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.983+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcea000bdb0 con 0x55f7fd5ded30 2024-09-13T19:16:17.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.983+0000 7fceaf531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:17.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.983+0000 7fceaf531800 20 realm 2024-09-13T19:16:17.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.983+0000 7fceaf531800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.983+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5de180 con 0x55f7fd5ded30 2024-09-13T19:16:17.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.983+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcea000bdb0 con 0x55f7fd5ded30 2024-09-13T19:16:17.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.983+0000 7fceaf531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:17.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.983+0000 7fceaf531800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:17.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.983+0000 7fceaf531800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.983+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5e2430 con 0x55f7fd5ded30 2024-09-13T19:16:17.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.983+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcea000bdb0 con 0x55f7fd5ded30 2024-09-13T19:16:17.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.983+0000 7fceaf531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:17.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.983+0000 7fceaf531800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.983+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5e2d00 con 0x55f7fd5ded30 2024-09-13T19:16:17.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.983+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcea000bdb0 con 0x55f7fd5ded30 2024-09-13T19:16:17.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.983+0000 7fceaf531800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:17.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.983+0000 7fceaf531800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.983+0000 7fceaf531800 1 --2- 172.21.15.102:0/544781741 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55f7fd5e3640 0x55f7fd5e5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.983+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5e6200 con 0x55f7fd5e3640 2024-09-13T19:16:17.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.983+0000 7fceaba25640 1 --2- 172.21.15.102:0/544781741 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55f7fd5e3640 0x55f7fd5e5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.984+0000 7fceaba25640 1 --2- 172.21.15.102:0/544781741 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55f7fd5e3640 0x55f7fd5e5a70 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.984+0000 7fceaba25640 1 -- 172.21.15.102:0/544781741 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcea400a4a0 con 0x55f7fd5e3640 2024-09-13T19:16:17.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.984+0000 7fceaf531800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:17.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.984+0000 7fceaf531800 20 searching for the correct realm 2024-09-13T19:16:17.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.984+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5e7b50 con 0x55f7fd5e3640 2024-09-13T19:16:17.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.984+0000 7fceaba25640 1 -- 172.21.15.102:0/544781741 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcea400a4a0 con 0x55f7fd5e3640 2024-09-13T19:16:17.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.984+0000 7fceaba25640 1 --2- 172.21.15.102:0/544781741 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fcea4044070 0x7fcea4040a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.984+0000 7fceaba25640 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5e7b50 con 0x7fcea4044070 2024-09-13T19:16:17.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.984+0000 7fceab224640 1 --2- 172.21.15.102:0/544781741 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fcea4044070 0x7fcea4040a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.984+0000 7fceab224640 1 --2- 172.21.15.102:0/544781741 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fcea4044070 0x7fcea4040a00 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.985+0000 7fceab224640 1 -- 172.21.15.102:0/544781741 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce9c075030 con 0x7fcea4044070 2024-09-13T19:16:17.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.985+0000 7fceab224640 1 --2- 172.21.15.102:0/544781741 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fce9c0a1070 0x7fce9c08f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.985+0000 7fceab224640 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5e7b50 con 0x7fce9c0a1070 2024-09-13T19:16:17.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.985+0000 7fceaaa23640 1 --2- 172.21.15.102:0/544781741 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fce9c0a1070 0x7fce9c08f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.985+0000 7fceaaa23640 1 --2- 172.21.15.102:0/544781741 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fce9c0a1070 0x7fce9c08f920 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.986+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcea000bdb0 con 0x7fce9c0a1070 2024-09-13T19:16:17.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.986+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5e7b50 con 0x55f7fd5ded30 2024-09-13T19:16:17.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.986+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcea000bdb0 con 0x55f7fd5ded30 2024-09-13T19:16:17.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.986+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5e7b50 con 0x55f7fd5ded30 2024-09-13T19:16:17.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.986+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcea002a040 con 0x55f7fd5ded30 2024-09-13T19:16:17.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.986+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5e7b50 con 0x7fce9c0a1070 2024-09-13T19:16:17.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.986+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcea002a040 con 0x7fce9c0a1070 2024-09-13T19:16:17.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.986+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5e7b50 con 0x7fce9c0a1070 2024-09-13T19:16:17.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.986+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcea002a040 con 0x7fce9c0a1070 2024-09-13T19:16:17.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.986+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5e7b50 con 0x7fcea4044070 2024-09-13T19:16:17.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.987+0000 7fceab224640 1 -- 172.21.15.102:0/544781741 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce9c075030 con 0x7fcea4044070 2024-09-13T19:16:17.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.987+0000 7fceab224640 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5e7b50 con 0x55f7fd5e3640 2024-09-13T19:16:17.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.987+0000 7fceaba25640 1 -- 172.21.15.102:0/544781741 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcea400a4a0 con 0x55f7fd5e3640 2024-09-13T19:16:17.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.987+0000 7fceaba25640 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5e7b50 con 0x55f7fd5ded30 2024-09-13T19:16:17.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.987+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcea002a040 con 0x55f7fd5ded30 2024-09-13T19:16:17.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.987+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5e7b50 con 0x7fce9c0a1070 2024-09-13T19:16:17.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.987+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcea002a040 con 0x7fce9c0a1070 2024-09-13T19:16:17.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.988+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5e7b50 con 0x55f7fd5ded30 2024-09-13T19:16:17.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.988+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcea002a040 con 0x55f7fd5ded30 2024-09-13T19:16:17.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.988+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5e7b50 con 0x7fcea4044070 2024-09-13T19:16:17.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.988+0000 7fceab224640 1 -- 172.21.15.102:0/544781741 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fce9c075030 con 0x7fcea4044070 2024-09-13T19:16:17.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.988+0000 7fceab224640 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5e7b50 con 0x55f7fd5e3640 2024-09-13T19:16:17.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.988+0000 7fceaba25640 1 -- 172.21.15.102:0/544781741 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcea400a4a0 con 0x55f7fd5e3640 2024-09-13T19:16:17.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.988+0000 7fceaba25640 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5e7b50 con 0x55f7fd5e3640 2024-09-13T19:16:17.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.988+0000 7fceaba25640 1 -- 172.21.15.102:0/544781741 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcea400a4a0 con 0x55f7fd5e3640 2024-09-13T19:16:17.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.988+0000 7fceaba25640 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5e7b50 con 0x7fce9c0a1070 2024-09-13T19:16:17.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.989+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcea002a040 con 0x7fce9c0a1070 2024-09-13T19:16:17.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.989+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5e7b50 con 0x55f7fd5e3640 2024-09-13T19:16:17.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.989+0000 7fceaba25640 1 -- 172.21.15.102:0/544781741 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fcea400a4a0 con 0x55f7fd5e3640 2024-09-13T19:16:17.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.989+0000 7fceaba25640 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5e7b50 con 0x55f7fd5e3640 2024-09-13T19:16:17.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.989+0000 7fceaba25640 1 -- 172.21.15.102:0/544781741 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcea400a4a0 con 0x55f7fd5e3640 2024-09-13T19:16:17.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.989+0000 7fceaba25640 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5e7b50 con 0x55f7fd5ded30 2024-09-13T19:16:17.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.989+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcea002a040 con 0x55f7fd5ded30 2024-09-13T19:16:17.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.989+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5e7b50 con 0x55f7fd5ded30 2024-09-13T19:16:17.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.990+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fcea002a040 con 0x55f7fd5ded30 2024-09-13T19:16:17.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.990+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5e7b50 con 0x7fce9c0a1070 2024-09-13T19:16:17.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.990+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcea002a040 con 0x7fce9c0a1070 2024-09-13T19:16:17.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.990+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5e7b50 con 0x55f7fd5e3640 2024-09-13T19:16:17.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.990+0000 7fceaba25640 1 -- 172.21.15.102:0/544781741 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcea400a4a0 con 0x55f7fd5e3640 2024-09-13T19:16:17.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.990+0000 7fceaba25640 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5e7b50 con 0x7fcea4044070 2024-09-13T19:16:17.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.990+0000 7fceab224640 1 -- 172.21.15.102:0/544781741 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce9c075030 con 0x7fcea4044070 2024-09-13T19:16:17.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.991+0000 7fceab224640 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5e7b50 con 0x55f7fd5ded30 2024-09-13T19:16:17.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.991+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcea002a040 con 0x55f7fd5ded30 2024-09-13T19:16:17.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.991+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5e7b50 con 0x7fce9c0a1070 2024-09-13T19:16:17.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.991+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcea002a040 con 0x7fce9c0a1070 2024-09-13T19:16:17.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.991+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5e7b50 con 0x55f7fd5e3640 2024-09-13T19:16:17.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.991+0000 7fceaba25640 1 -- 172.21.15.102:0/544781741 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcea400a4a0 con 0x55f7fd5e3640 2024-09-13T19:16:17.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.991+0000 7fceaba25640 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5e7b50 con 0x7fce9c0a1070 2024-09-13T19:16:17.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.992+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcea002a040 con 0x7fce9c0a1070 2024-09-13T19:16:17.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.992+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5e7b50 con 0x7fcea4044070 2024-09-13T19:16:17.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.992+0000 7fceab224640 1 -- 172.21.15.102:0/544781741 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce9c075030 con 0x7fcea4044070 2024-09-13T19:16:17.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.992+0000 7fceab224640 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5e7b50 con 0x55f7fd5e3640 2024-09-13T19:16:17.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.992+0000 7fceaba25640 1 -- 172.21.15.102:0/544781741 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcea400a4a0 con 0x55f7fd5e3640 2024-09-13T19:16:17.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.992+0000 7fceaba25640 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5e7b50 con 0x7fce9c0a1070 2024-09-13T19:16:17.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.992+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcea002a040 con 0x7fce9c0a1070 2024-09-13T19:16:17.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.992+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5e7b50 con 0x55f7fd5ded30 2024-09-13T19:16:17.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.993+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcea002a040 con 0x55f7fd5ded30 2024-09-13T19:16:17.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.993+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5e7b50 con 0x7fcea4044070 2024-09-13T19:16:17.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.993+0000 7fceab224640 1 -- 172.21.15.102:0/544781741 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce9c075030 con 0x7fcea4044070 2024-09-13T19:16:17.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.993+0000 7fceaf531800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:17.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.993+0000 7fceaf531800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:17.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.993+0000 7fceaf531800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:17.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.993+0000 7fceaf531800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:17.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.993+0000 7fceaf531800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:17.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.993+0000 7fceaf531800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:17.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.993+0000 7fceaf531800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.993+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5e6bf0 con 0x55f7fd5ded30 2024-09-13T19:16:17.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.993+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcea002a040 con 0x55f7fd5ded30 2024-09-13T19:16:17.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.993+0000 7fceaf531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:17.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.993+0000 7fceaf531800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.993+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5e7490 con 0x55f7fd5ded30 2024-09-13T19:16:17.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.993+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcea002a040 con 0x55f7fd5ded30 2024-09-13T19:16:17.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.993+0000 7fceaf531800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:17.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.993+0000 7fceaf531800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.993+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5e7fd0 con 0x55f7fd5e3640 2024-09-13T19:16:17.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.994+0000 7fceaba25640 1 -- 172.21.15.102:0/544781741 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcea400a4a0 con 0x55f7fd5e3640 2024-09-13T19:16:17.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.994+0000 7fceaf531800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:17.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.994+0000 7fceaf531800 20 zone default found 2024-09-13T19:16:17.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.994+0000 7fceaf531800 4 Realm: () 2024-09-13T19:16:17.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.994+0000 7fceaf531800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:17.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.994+0000 7fceaf531800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:17.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.994+0000 7fceaf531800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:17.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.994+0000 7fceaf531800 20 zonegroup default 2024-09-13T19:16:17.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.994+0000 7fceaf531800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.994+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5e8820 con 0x7fce9c0a1070 2024-09-13T19:16:17.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.994+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcea002a040 con 0x7fce9c0a1070 2024-09-13T19:16:17.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.994+0000 7fceaf531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:17.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.994+0000 7fceaf531800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.994+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5ea200 con 0x55f7fd5e3640 2024-09-13T19:16:17.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.994+0000 7fceaba25640 1 -- 172.21.15.102:0/544781741 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcea400a4a0 con 0x55f7fd5e3640 2024-09-13T19:16:17.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.994+0000 7fceaf531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:17.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.994+0000 7fceaf531800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.994+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5ea630 con 0x55f7fd5e3640 2024-09-13T19:16:17.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.994+0000 7fceaba25640 1 -- 172.21.15.102:0/544781741 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcea400a4a0 con 0x55f7fd5e3640 2024-09-13T19:16:17.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.994+0000 7fceaf531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:17.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.994+0000 7fceaf531800 20 started sync module instance, tier type = 2024-09-13T19:16:17.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.994+0000 7fceaf531800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:17.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.994+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5e9690 con 0x7fcea4044070 2024-09-13T19:16:17.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.996+0000 7fceab224640 1 -- 172.21.15.102:0/544781741 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(44 notify.0 [create] v34'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce9c075030 con 0x7fcea4044070 2024-09-13T19:16:17.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.996+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94523596118656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5e92f0 con 0x7fcea4044070 2024-09-13T19:16:17.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.996+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5eb540 con 0x55f7fd5ded30 2024-09-13T19:16:17.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.997+0000 7fceab224640 1 -- 172.21.15.102:0/544781741 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94523596118656] v34'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce9c075030 con 0x7fcea4044070 2024-09-13T19:16:17.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.997+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v34'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcea002a040 con 0x55f7fd5ded30 2024-09-13T19:16:17.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.997+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94523596124304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5eb960 con 0x55f7fd5ded30 2024-09-13T19:16:17.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.997+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5ec320 con 0x55f7fd5e3640 2024-09-13T19:16:17.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.998+0000 7fceaba25640 1 -- 172.21.15.102:0/544781741 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v34'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcea400a4a0 con 0x55f7fd5e3640 2024-09-13T19:16:17.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.998+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94523596127856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5ec2d0 con 0x55f7fd5e3640 2024-09-13T19:16:17.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.998+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5ed2d0 con 0x7fcea4044070 2024-09-13T19:16:17.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.998+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94523596124304] v34'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcea002a040 con 0x55f7fd5ded30 2024-09-13T19:16:17.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.999+0000 7fceab224640 1 -- 172.21.15.102:0/544781741 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(50 notify.3 [create] v34'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce9c075030 con 0x7fcea4044070 2024-09-13T19:16:17.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.999+0000 7fceaba25640 1 -- 172.21.15.102:0/544781741 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94523596127856] v34'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcea400a4a0 con 0x55f7fd5e3640 2024-09-13T19:16:17.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.999+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94523596125360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5ecde0 con 0x7fcea4044070 2024-09-13T19:16:17.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:16.999+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5edce0 con 0x55f7fd5ded30 2024-09-13T19:16:17.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.002+0000 7fceab224640 1 -- 172.21.15.102:0/544781741 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94523596125360] v34'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce9c075030 con 0x7fcea4044070 2024-09-13T19:16:17.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.002+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v34'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcea002a040 con 0x55f7fd5ded30 2024-09-13T19:16:17.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.002+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94523596130064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5edce0 con 0x55f7fd5ded30 2024-09-13T19:16:17.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.002+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5ee6a0 con 0x7fce9c0a1070 2024-09-13T19:16:17.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.003+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(54 notify.5 [create] v34'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcea002a040 con 0x7fce9c0a1070 2024-09-13T19:16:17.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.003+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94523596136944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5ee610 con 0x7fce9c0a1070 2024-09-13T19:16:17.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.003+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5ef650 con 0x7fce9c0a1070 2024-09-13T19:16:17.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.003+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94523596130064] v34'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcea002a040 con 0x55f7fd5ded30 2024-09-13T19:16:17.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.004+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94523596136944] v34'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcea002a040 con 0x7fce9c0a1070 2024-09-13T19:16:17.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.004+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(56 notify.6 [create] v34'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcea002a040 con 0x7fce9c0a1070 2024-09-13T19:16:17.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.004+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94523596139152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5ef130 con 0x7fce9c0a1070 2024-09-13T19:16:17.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.004+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5efb00 con 0x7fce9c0a1070 2024-09-13T19:16:17.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.005+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94523596139152] v34'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcea002a040 con 0x7fce9c0a1070 2024-09-13T19:16:17.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.005+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(58 notify.7 [create] v34'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcea002a040 con 0x7fce9c0a1070 2024-09-13T19:16:17.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.005+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94523596134448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5efb00 con 0x7fce9c0a1070 2024-09-13T19:16:17.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.005+0000 7fceaf531800 20 add_watcher() i=0 2024-09-13T19:16:17.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.005+0000 7fceaf531800 20 add_watcher() i=1 2024-09-13T19:16:17.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.005+0000 7fceaf531800 20 add_watcher() i=2 2024-09-13T19:16:17.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.005+0000 7fceaf531800 20 add_watcher() i=3 2024-09-13T19:16:17.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.005+0000 7fceaf531800 20 add_watcher() i=4 2024-09-13T19:16:17.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.005+0000 7fceaf531800 20 add_watcher() i=5 2024-09-13T19:16:17.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.005+0000 7fceaf531800 20 add_watcher() i=6 2024-09-13T19:16:17.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.006+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94523596134448] v34'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcea002a040 con 0x7fce9c0a1070 2024-09-13T19:16:17.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.006+0000 7fceaf531800 20 add_watcher() i=7 2024-09-13T19:16:17.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.006+0000 7fceaf531800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:17.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.006+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5f2e60 con 0x55f7fd5ded30 2024-09-13T19:16:17.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.006+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcea002a040 con 0x55f7fd5ded30 2024-09-13T19:16:17.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.006+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94523596142528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd5f0090 con 0x55f7fd5ded30 2024-09-13T19:16:17.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.007+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94523596142528] v34'84 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcea002a040 con 0x55f7fd5ded30 2024-09-13T19:16:17.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.007+0000 7fcd61fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:17.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.007+0000 7fceaf531800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:17.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.007+0000 7fceaf531800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:17.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.008+0000 7fceaf531800 5 note: GC not initialized 2024-09-13T19:16:17.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.008+0000 7fcd60fe1640 20 reqs_thread_entry: start 2024-09-13T19:16:17.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.008+0000 7fceaf531800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:17.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.008+0000 7fceaf531800 20 Filter name: none 2024-09-13T19:16:17.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.008+0000 7fccda7fc640 20 reqs_thread_entry: start 2024-09-13T19:16:17.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.008+0000 7fceaf531800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:16:17.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.008+0000 7fceaf531800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.008+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd626310 con 0x55f7fd5ded30 2024-09-13T19:16:17.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.009+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 foo [call out=48b,read 0~582 out=582b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+705 (crc 0 0 0) 0x7fcea002a040 con 0x55f7fd5ded30 2024-09-13T19:16:17.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.009+0000 7fceaf531800 20 rados_obj.operate() r=0 bl.length=582 2024-09-13T19:16:17.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.009+0000 7fceaf531800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:16:17.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.009+0000 7fceaf531800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:16:17.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.009+0000 7fceaf531800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:16:17.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.009+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd62ca20 con 0x55f7fd5ded30 2024-09-13T19:16:17.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.010+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v34'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fcea002a040 con 0x55f7fd5ded30 2024-09-13T19:16:17.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.010+0000 7fceaf531800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:16:17.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.010+0000 7fceaf531800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:16:17.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.010+0000 7fceaf531800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T19:16:17.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.010+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94523596391392 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd628310 con 0x55f7fd5ded30 2024-09-13T19:16:17.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.010+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== watch-notify(notify (1) cookie 94523596130064 notify 146028888073 ret 0) ==== 774+0+0 (crc 0 0 0) 0x55f7fd36ab30 con 0x55f7fd5ded30 2024-09-13T19:16:17.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.010+0000 7fcd8effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888073 cookie 94523596130064 notifier 4419 bl.length()=732 2024-09-13T19:16:17.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.010+0000 7fcd8effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:16:17.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.010+0000 7fcd8effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:16:17.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.010+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(64 notify.4 [notify cookie 94523596391392 out=8b] v0'0 uv75 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcea002a040 con 0x55f7fd5ded30 2024-09-13T19:16:17.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.010+0000 7fcd8effd640 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fcd70003ea0 con 0x55f7fd5ded30 2024-09-13T19:16:17.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.010+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcea002a040 con 0x55f7fd5ded30 2024-09-13T19:16:17.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.010+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== watch-notify(notify_complete (2) cookie 94523596391392 notify 146028888073 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fcea000f850 con 0x55f7fd5ded30 2024-09-13T19:16:17.033 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:16:14.779675Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-13T19:16:16.617088Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:16:14.779665Z","tags":[],"group_ids":[]} 2024-09-13T19:16:17.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.011+0000 7fcd61fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:17.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.011+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94523596142528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd624060 con 0x55f7fd5ded30 2024-09-13T19:16:17.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.012+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94523596142528] v34'85 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcea002a040 con 0x55f7fd5ded30 2024-09-13T19:16:17.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.012+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94523596118656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd624060 con 0x7fcea4044070 2024-09-13T19:16:17.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.013+0000 7fceab224640 1 -- 172.21.15.102:0/544781741 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94523596118656] v34'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce9c075030 con 0x7fcea4044070 2024-09-13T19:16:17.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.013+0000 7fceaf531800 20 remove_watcher() i=0 2024-09-13T19:16:17.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.013+0000 7fceaf531800 2 removed watcher, disabling cache 2024-09-13T19:16:17.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.013+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94523596124304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd624060 con 0x55f7fd5ded30 2024-09-13T19:16:17.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.015+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 <== osd.1 v2:172.21.15.102:6808/2204418452 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94523596124304] v34'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcea002a040 con 0x55f7fd5ded30 2024-09-13T19:16:17.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.015+0000 7fceaf531800 20 remove_watcher() i=1 2024-09-13T19:16:17.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.015+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94523596127856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd624060 con 0x55f7fd5e3640 2024-09-13T19:16:17.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.016+0000 7fceaba25640 1 -- 172.21.15.102:0/544781741 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94523596127856] v34'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcea400a4a0 con 0x55f7fd5e3640 2024-09-13T19:16:17.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.016+0000 7fceaf531800 20 remove_watcher() i=2 2024-09-13T19:16:17.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.016+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94523596125360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd624060 con 0x7fcea4044070 2024-09-13T19:16:17.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.017+0000 7fceab224640 1 -- 172.21.15.102:0/544781741 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94523596125360] v34'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce9c075030 con 0x7fcea4044070 2024-09-13T19:16:17.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.017+0000 7fceaf531800 20 remove_watcher() i=3 2024-09-13T19:16:17.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.017+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94523596130064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd624060 con 0x55f7fd5ded30 2024-09-13T19:16:17.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.018+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 <== osd.1 v2:172.21.15.102:6808/2204418452 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94523596130064] v34'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcea002a040 con 0x55f7fd5ded30 2024-09-13T19:16:17.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.018+0000 7fceaf531800 20 remove_watcher() i=4 2024-09-13T19:16:17.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.018+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94523596136944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd624060 con 0x7fce9c0a1070 2024-09-13T19:16:17.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.019+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94523596136944] v34'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcea002a040 con 0x7fce9c0a1070 2024-09-13T19:16:17.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.019+0000 7fceaf531800 20 remove_watcher() i=5 2024-09-13T19:16:17.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.019+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94523596139152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd624060 con 0x7fce9c0a1070 2024-09-13T19:16:17.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.020+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94523596139152] v34'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcea002a040 con 0x7fce9c0a1070 2024-09-13T19:16:17.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.020+0000 7fceaf531800 20 remove_watcher() i=6 2024-09-13T19:16:17.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.020+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94523596134448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7fd624060 con 0x7fce9c0a1070 2024-09-13T19:16:17.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.020+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94523596134448] v34'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcea002a040 con 0x7fce9c0a1070 2024-09-13T19:16:17.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.020+0000 7fceaf531800 20 remove_watcher() i=7 2024-09-13T19:16:17.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.021+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fce9c0a1070 msgr2=0x7fce9c08f920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.021+0000 7fceaf531800 1 --2- 172.21.15.102:0/544781741 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fce9c0a1070 0x7fce9c08f920 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.021+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55f7fd5ded30 msgr2=0x55f7fd5e11f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.021+0000 7fceaf531800 1 --2- 172.21.15.102:0/544781741 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55f7fd5ded30 0x55f7fd5e11f0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.021+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fcea4044070 msgr2=0x7fcea4040a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.021+0000 7fceaf531800 1 --2- 172.21.15.102:0/544781741 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fcea4044070 0x7fcea4040a00 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.021+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55f7fd5e3640 msgr2=0x55f7fd5e5a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.021+0000 7fceaf531800 1 --2- 172.21.15.102:0/544781741 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55f7fd5e3640 0x55f7fd5e5a70 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.021+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fcd74036b90 msgr2=0x7fcd74039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.021+0000 7fceaf531800 1 --2- 172.21.15.102:0/544781741 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fcd74036b90 0x7fcd74039050 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fce9c01bb60 tx=0x7fce9c097000 comp rx=0 tx=0).stop 2024-09-13T19:16:17.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.021+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fd5cbce0 msgr2=0x55f7fd5d3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.021+0000 7fceaf531800 1 --2- 172.21.15.102:0/544781741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fd5cbce0 0x55f7fd5d3230 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fcea404cd60 tx=0x7fcea404cd90 comp rx=0 tx=0).stop 2024-09-13T19:16:17.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.021+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 reap_dead start 2024-09-13T19:16:17.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.021+0000 7fceaaa23640 1 -- 172.21.15.102:0/544781741 reap_dead start 2024-09-13T19:16:17.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.021+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 shutdown_connections 2024-09-13T19:16:17.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.021+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 >> 172.21.15.102:0/544781741 conn(0x55f7fd5c80d0 msgr2=0x55f7fd5c61a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:17.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.021+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 shutdown_connections 2024-09-13T19:16:17.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.021+0000 7fceaf531800 1 -- 172.21.15.102:0/544781741 wait complete. 2024-09-13T19:16:17.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.021+0000 7fceaf531800 1 -- 172.21.15.102:0/4145774060 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fcd84036b90 msgr2=0x7fcd84039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.021+0000 7fceaf531800 1 --2- 172.21.15.102:0/4145774060 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fcd84036b90 0x7fcd84039050 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fce9c08f870 tx=0x7fce9c06e9f0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.021+0000 7fceaf531800 1 -- 172.21.15.102:0/4145774060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fd59af70 msgr2=0x55f7fd5995c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.021+0000 7fceaf531800 1 --2- 172.21.15.102:0/4145774060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fd59af70 0x55f7fd5995c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x55f7fd5a3200 tx=0x7fcea40167b0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.021+0000 7fceaf531800 1 -- 172.21.15.102:0/4145774060 shutdown_connections 2024-09-13T19:16:17.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.021+0000 7fceaf531800 1 --2- 172.21.15.102:0/4145774060 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fcd84036b90 0x7fcd84039050 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.021+0000 7fceaf531800 1 --2- 172.21.15.102:0/4145774060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fd59af70 0x55f7fd5995c0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.021+0000 7fceaf531800 1 -- 172.21.15.102:0/4145774060 >> 172.21.15.102:0/4145774060 conn(0x55f7fd5b1e40 msgr2=0x55f7fd5b49c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:17.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.021+0000 7fceaf531800 1 -- 172.21.15.102:0/4145774060 shutdown_connections 2024-09-13T19:16:17.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.021+0000 7fceaf531800 1 -- 172.21.15.102:0/4145774060 wait complete. 2024-09-13T19:16:17.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.022+0000 7fceaf531800 1 -- 172.21.15.102:0/761186787 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55f7fd4aae90 msgr2=0x55f7fd5a91c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.022+0000 7fceaf531800 1 --2- 172.21.15.102:0/761186787 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55f7fd4aae90 0x55f7fd5a91c0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.022+0000 7fceaf531800 1 -- 172.21.15.102:0/761186787 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55f7fd5ab910 msgr2=0x55f7fd5adda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.022+0000 7fceaf531800 1 --2- 172.21.15.102:0/761186787 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55f7fd5ab910 0x55f7fd5adda0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.022+0000 7fceaf531800 1 -- 172.21.15.102:0/761186787 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fcd90036b40 msgr2=0x7fcd90039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.022+0000 7fceaf531800 1 --2- 172.21.15.102:0/761186787 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fcd90036b40 0x7fcd90039000 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcea0001e10 tx=0x7fcea0001390 comp rx=0 tx=0).stop 2024-09-13T19:16:17.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.022+0000 7fceaf531800 1 -- 172.21.15.102:0/761186787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fd4aa550 msgr2=0x55f7fd5a2150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.022+0000 7fceaf531800 1 --2- 172.21.15.102:0/761186787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fd4aa550 0x55f7fd5a2150 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fce9c067040 tx=0x7fce9c002fb0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.022+0000 7fceaf531800 1 -- 172.21.15.102:0/761186787 shutdown_connections 2024-09-13T19:16:17.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.022+0000 7fceaf531800 1 --2- 172.21.15.102:0/761186787 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55f7fd5ab910 0x55f7fd5adda0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.022+0000 7fceaf531800 1 --2- 172.21.15.102:0/761186787 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55f7fd4aae90 0x55f7fd5a91c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.022+0000 7fceaf531800 1 --2- 172.21.15.102:0/761186787 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fcd90036b40 0x7fcd90039000 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.022+0000 7fceaf531800 1 --2- 172.21.15.102:0/761186787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7fd4aa550 0x55f7fd5a2150 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.022+0000 7fceaf531800 1 -- 172.21.15.102:0/761186787 >> 172.21.15.102:0/761186787 conn(0x55f7fd4a5de0 msgr2=0x55f7fd5939c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:17.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.022+0000 7fceaf531800 1 -- 172.21.15.102:0/761186787 shutdown_connections 2024-09-13T19:16:17.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.022+0000 7fceaf531800 1 -- 172.21.15.102:0/761186787 wait complete. 2024-09-13T19:16:17.050 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:16:14.779675Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-13T19:16:16.617088Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:16:14.779665Z', 'tags': [], 'group_ids': []} 2024-09-13T19:16:17.050 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-13T19:16:17.050 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-13T19:16:17.050 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2024-09-13T19:16:17.098 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:17.098 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:17.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.095+0000 7fdb8d230800 1 Processor -- start 2024-09-13T19:16:17.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.095+0000 7fdb8d230800 1 -- start start 2024-09-13T19:16:17.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.096+0000 7fdb8d230800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55a89a7699b0 0x55a89a76bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.096+0000 7fdb8d230800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a89a625b30 con 0x55a89a765570 2024-09-13T19:16:17.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.096+0000 7fdb8d230800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55a89a607360 con 0x55a89a7699b0 2024-09-13T19:16:17.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.096+0000 7fdb7fd66640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55a89a7699b0 0x55a89a76bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.096+0000 7fdb7fd66640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55a89a7699b0 0x55a89a76bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54790/0 (socket says 172.21.15.102:54790) 2024-09-13T19:16:17.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.096+0000 7fdb88567640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55a89a765570 0x55a89a765970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:49922/0 (socket says 172.21.15.102:49922) 2024-09-13T19:16:17.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.096+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3854482419 learned_addr learned my addr 172.21.15.102:0/3854482419 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:17.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.096+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3854482419 >> v1:172.21.15.53:6789/0 conn(0x55a89a765570 legacy=0x55a89a765970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.096+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3854482419 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a89a62de00 con 0x55a89a7699b0 2024-09-13T19:16:17.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.098+0000 7fdb7fd66640 1 --2- 172.21.15.102:0/3854482419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a89a7699b0 0x55a89a76bda0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fdb7000a520 tx=0x7fdb70045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=713598a5269c4b10 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.098+0000 7fdb87d66640 1 -- 172.21.15.102:0/3854482419 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb70055070 con 0x55a89a7699b0 2024-09-13T19:16:17.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.098+0000 7fdb87d66640 1 -- 172.21.15.102:0/3854482419 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb700515b0 con 0x55a89a7699b0 2024-09-13T19:16:17.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.098+0000 7fdb87d66640 1 -- 172.21.15.102:0/3854482419 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb700518d0 con 0x55a89a7699b0 2024-09-13T19:16:17.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.098+0000 7fdb8d230800 1 -- 172.21.15.102:0/3854482419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a89a7699b0 msgr2=0x55a89a76bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.098+0000 7fdb8d230800 1 --2- 172.21.15.102:0/3854482419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a89a7699b0 0x55a89a76bda0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fdb7000a520 tx=0x7fdb70045ba0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.098+0000 7fdb8d230800 1 -- 172.21.15.102:0/3854482419 shutdown_connections 2024-09-13T19:16:17.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.098+0000 7fdb8d230800 1 --2- 172.21.15.102:0/3854482419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a89a7699b0 0x55a89a76bda0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.098+0000 7fdb8d230800 1 -- 172.21.15.102:0/3854482419 >> 172.21.15.102:0/3854482419 conn(0x55a89a760e00 msgr2=0x55a89a763220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:17.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.098+0000 7fdb8d230800 1 -- 172.21.15.102:0/3854482419 shutdown_connections 2024-09-13T19:16:17.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.098+0000 7fdb8d230800 1 -- 172.21.15.102:0/3854482419 wait complete. 2024-09-13T19:16:17.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.112+0000 7fdb8d230800 1 Processor -- start 2024-09-13T19:16:17.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.112+0000 7fdb8d230800 1 -- start start 2024-09-13T19:16:17.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.112+0000 7fdb8d230800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a89a765570 0x55a89a8547a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.112+0000 7fdb8d230800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a89a6b2350 con 0x55a89a765570 2024-09-13T19:16:17.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.112+0000 7fdb88567640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a89a765570 0x55a89a8547a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.113+0000 7fdb88567640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a89a765570 0x55a89a8547a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54794/0 (socket says 172.21.15.102:54794) 2024-09-13T19:16:17.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.113+0000 7fdb88567640 1 -- 172.21.15.102:0/633582103 learned_addr learned my addr 172.21.15.102:0/633582103 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:17.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.113+0000 7fdb88567640 1 -- 172.21.15.102:0/633582103 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a89a5ffbc0 con 0x55a89a765570 2024-09-13T19:16:17.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.113+0000 7fdb88567640 1 --2- 172.21.15.102:0/633582103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a89a765570 0x55a89a8547a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fdb7800b230 tx=0x7fdb7800b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c5c6dab7ed8e21 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.113+0000 7fda7660c640 1 -- 172.21.15.102:0/633582103 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb7800e5c0 con 0x55a89a765570 2024-09-13T19:16:17.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.113+0000 7fda7660c640 1 -- 172.21.15.102:0/633582103 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb78006070 con 0x55a89a765570 2024-09-13T19:16:17.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.113+0000 7fda7660c640 1 -- 172.21.15.102:0/633582103 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb7800e890 con 0x55a89a765570 2024-09-13T19:16:17.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.114+0000 7fdb8d230800 1 -- 172.21.15.102:0/633582103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a89a765570 msgr2=0x55a89a8547a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.114+0000 7fdb8d230800 1 --2- 172.21.15.102:0/633582103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a89a765570 0x55a89a8547a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fdb7800b230 tx=0x7fdb7800b6f0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.114+0000 7fdb8d230800 1 -- 172.21.15.102:0/633582103 shutdown_connections 2024-09-13T19:16:17.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.114+0000 7fdb8d230800 1 --2- 172.21.15.102:0/633582103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a89a765570 0x55a89a8547a0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.114+0000 7fdb8d230800 1 -- 172.21.15.102:0/633582103 >> 172.21.15.102:0/633582103 conn(0x55a89a760e00 msgr2=0x55a89a850160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:17.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.114+0000 7fdb8d230800 1 -- 172.21.15.102:0/633582103 shutdown_connections 2024-09-13T19:16:17.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.114+0000 7fdb8d230800 1 -- 172.21.15.102:0/633582103 wait complete. 2024-09-13T19:16:17.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.114+0000 7fdb8d230800 1 Processor -- start 2024-09-13T19:16:17.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.114+0000 7fdb8d230800 1 -- start start 2024-09-13T19:16:17.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.114+0000 7fdb8d230800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a89a765570 0x55a89a6da600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.114+0000 7fdb8d230800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a89a76c5e0 con 0x55a89a765570 2024-09-13T19:16:17.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.115+0000 7fdb88567640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a89a765570 0x55a89a6da600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.115+0000 7fdb88567640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a89a765570 0x55a89a6da600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54808/0 (socket says 172.21.15.102:54808) 2024-09-13T19:16:17.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.115+0000 7fdb88567640 1 -- 172.21.15.102:0/636288925 learned_addr learned my addr 172.21.15.102:0/636288925 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:17.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.115+0000 7fdb88567640 1 -- 172.21.15.102:0/636288925 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a89a613fe0 con 0x55a89a765570 2024-09-13T19:16:17.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.115+0000 7fdb88567640 1 --2- 172.21.15.102:0/636288925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a89a765570 0x55a89a6da600 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fdb78000c00 tx=0x7fdb78000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.115+0000 7fda74e09640 1 -- 172.21.15.102:0/636288925 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb7800f8d0 con 0x55a89a765570 2024-09-13T19:16:17.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.115+0000 7fda74e09640 1 -- 172.21.15.102:0/636288925 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb7800fa90 con 0x55a89a765570 2024-09-13T19:16:17.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.115+0000 7fdb8d230800 1 -- 172.21.15.102:0/636288925 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a89a85ff00 con 0x55a89a765570 2024-09-13T19:16:17.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.115+0000 7fda74e09640 1 -- 172.21.15.102:0/636288925 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb7800fdb0 con 0x55a89a765570 2024-09-13T19:16:17.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.115+0000 7fdb8d230800 1 -- 172.21.15.102:0/636288925 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a89a860420 con 0x55a89a765570 2024-09-13T19:16:17.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.116+0000 7fda74e09640 1 -- 172.21.15.102:0/636288925 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fdb78017070 con 0x55a89a765570 2024-09-13T19:16:17.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.116+0000 7fda74e09640 1 --2- 172.21.15.102:0/636288925 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fda70036b90 0x7fda70039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.116+0000 7fda74e09640 1 -- 172.21.15.102:0/636288925 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fdb78015020 con 0x55a89a765570 2024-09-13T19:16:17.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.116+0000 7fdb7fd66640 1 --2- 172.21.15.102:0/636288925 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fda70036b90 0x7fda70039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.116+0000 7fdb8d230800 1 --2- 172.21.15.102:0/636288925 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55a89a7699b0 0x55a89a8642c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.116+0000 7fdb8d230800 1 -- 172.21.15.102:0/636288925 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a89a864900 con 0x55a89a7699b0 2024-09-13T19:16:17.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.117+0000 7fdb88d68640 1 --2- 172.21.15.102:0/636288925 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55a89a7699b0 0x55a89a8642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.117+0000 7fdb7fd66640 1 --2- 172.21.15.102:0/636288925 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fda70036b90 0x7fda70039050 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdb70057000 tx=0x7fdb70052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.117+0000 7fdb88d68640 1 --2- 172.21.15.102:0/636288925 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55a89a7699b0 0x55a89a8642c0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.117+0000 7fdb88d68640 1 -- 172.21.15.102:0/636288925 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb8000a4a0 con 0x55a89a7699b0 2024-09-13T19:16:17.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.117+0000 7fdb8d230800 1 -- 172.21.15.102:0/636288925 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8617f0 con 0x55a89a7699b0 2024-09-13T19:16:17.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.117+0000 7fdb88d68640 1 -- 172.21.15.102:0/636288925 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdb8000a4a0 con 0x55a89a7699b0 2024-09-13T19:16:17.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.117+0000 7fdb8d230800 1 --2- 172.21.15.102:0/636288925 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55a89a866c50 0x55a89a869040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.117+0000 7fdb8d230800 1 -- 172.21.15.102:0/636288925 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a89a869730 con 0x55a89a866c50 2024-09-13T19:16:17.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.118+0000 7fdb88567640 1 --2- 172.21.15.102:0/636288925 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55a89a866c50 0x55a89a869040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.118+0000 7fdb88567640 1 --2- 172.21.15.102:0/636288925 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55a89a866c50 0x55a89a869040 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.118+0000 7fdb88567640 1 -- 172.21.15.102:0/636288925 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdb7802e070 con 0x55a89a866c50 2024-09-13T19:16:17.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.118+0000 7fdb8d230800 1 -- 172.21.15.102:0/636288925 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a89a865af0 con 0x55a89a7699b0 2024-09-13T19:16:17.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.118+0000 7fdb88d68640 1 -- 172.21.15.102:0/636288925 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdb8000a4a0 con 0x55a89a7699b0 2024-09-13T19:16:17.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.118+0000 7fdb8d230800 1 -- 172.21.15.102:0/636288925 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a89a865fd0 con 0x55a89a866c50 2024-09-13T19:16:17.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.119+0000 7fdb88567640 1 -- 172.21.15.102:0/636288925 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdb7802e070 con 0x55a89a866c50 2024-09-13T19:16:17.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.119+0000 7fdb8d230800 1 Processor -- start 2024-09-13T19:16:17.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.119+0000 7fdb8d230800 1 -- start start 2024-09-13T19:16:17.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.119+0000 7fdb8d230800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a89a85d8b0 0x55a89a85bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.119+0000 7fdb8d230800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a89a601580 con 0x55a89a85d8b0 2024-09-13T19:16:17.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.119+0000 7fdb88d68640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a89a85d8b0 0x55a89a85bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.119+0000 7fdb88d68640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a89a85d8b0 0x55a89a85bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54812/0 (socket says 172.21.15.102:54812) 2024-09-13T19:16:17.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.119+0000 7fdb88d68640 1 -- 172.21.15.102:0/3543615165 learned_addr learned my addr 172.21.15.102:0/3543615165 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:17.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.120+0000 7fdb88d68640 1 -- 172.21.15.102:0/3543615165 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a89a85dcd0 con 0x55a89a85d8b0 2024-09-13T19:16:17.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.120+0000 7fdb88d68640 1 --2- 172.21.15.102:0/3543615165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a89a85d8b0 0x55a89a85bf00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x55a89a6dab60 tx=0x7fdb800163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.120+0000 7fda6dffb640 1 -- 172.21.15.102:0/3543615165 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb80013450 con 0x55a89a85d8b0 2024-09-13T19:16:17.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.120+0000 7fda6dffb640 1 -- 172.21.15.102:0/3543615165 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb800135f0 con 0x55a89a85d8b0 2024-09-13T19:16:17.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.120+0000 7fdb8d230800 1 -- 172.21.15.102:0/3543615165 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a89a85c500 con 0x55a89a85d8b0 2024-09-13T19:16:17.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.120+0000 7fda6dffb640 1 -- 172.21.15.102:0/3543615165 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb80013910 con 0x55a89a85d8b0 2024-09-13T19:16:17.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.120+0000 7fdb8d230800 1 -- 172.21.15.102:0/3543615165 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a89a85ca00 con 0x55a89a85d8b0 2024-09-13T19:16:17.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.121+0000 7fda6dffb640 1 -- 172.21.15.102:0/3543615165 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fdb80011040 con 0x55a89a85d8b0 2024-09-13T19:16:17.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.121+0000 7fda6dffb640 1 --2- 172.21.15.102:0/3543615165 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fda60036b90 0x7fda60039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.121+0000 7fda6dffb640 1 -- 172.21.15.102:0/3543615165 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fdb8000e040 con 0x55a89a85d8b0 2024-09-13T19:16:17.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.121+0000 7fdb88567640 1 --2- 172.21.15.102:0/3543615165 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fda60036b90 0x7fda60039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.121+0000 7fdb8d230800 1 Processor -- start 2024-09-13T19:16:17.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.121+0000 7fdb88567640 1 --2- 172.21.15.102:0/3543615165 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fda60036b90 0x7fda60039050 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x55a89a865200 tx=0x7fdb7800ff90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.121+0000 7fdb8d230800 1 -- start start 2024-09-13T19:16:17.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.121+0000 7fdb8d230800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a89a887010 0x55a89a887410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.121+0000 7fdb8d230800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a89a854f50 con 0x55a89a887010 2024-09-13T19:16:17.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.122+0000 7fdb88d68640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a89a887010 0x55a89a887410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.122+0000 7fdb88d68640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a89a887010 0x55a89a887410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54828/0 (socket says 172.21.15.102:54828) 2024-09-13T19:16:17.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.122+0000 7fdb88d68640 1 -- 172.21.15.102:0/2091262933 learned_addr learned my addr 172.21.15.102:0/2091262933 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:17.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.122+0000 7fdb88d68640 1 -- 172.21.15.102:0/2091262933 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a89a8879e0 con 0x55a89a887010 2024-09-13T19:16:17.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.122+0000 7fdb88d68640 1 --2- 172.21.15.102:0/2091262933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a89a887010 0x55a89a887410 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fdb8004ce00 tx=0x7fdb8004d0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94f0fcdadf0f8ca0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.122+0000 7fda677fe640 1 -- 172.21.15.102:0/2091262933 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb80046250 con 0x55a89a887010 2024-09-13T19:16:17.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.122+0000 7fda677fe640 1 -- 172.21.15.102:0/2091262933 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb8002a440 con 0x55a89a887010 2024-09-13T19:16:17.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.122+0000 7fda677fe640 1 -- 172.21.15.102:0/2091262933 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb8001f390 con 0x55a89a887010 2024-09-13T19:16:17.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.123+0000 7fdb8d230800 1 -- 172.21.15.102:0/2091262933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a89a887010 msgr2=0x55a89a887410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.123+0000 7fdb8d230800 1 --2- 172.21.15.102:0/2091262933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a89a887010 0x55a89a887410 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fdb8004ce00 tx=0x7fdb8004d0b0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.123+0000 7fdb8d230800 1 -- 172.21.15.102:0/2091262933 shutdown_connections 2024-09-13T19:16:17.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.123+0000 7fdb8d230800 1 --2- 172.21.15.102:0/2091262933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a89a887010 0x55a89a887410 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.123+0000 7fdb8d230800 1 -- 172.21.15.102:0/2091262933 >> 172.21.15.102:0/2091262933 conn(0x55a89a883370 msgr2=0x55a89a881470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:17.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.123+0000 7fdb8d230800 1 -- 172.21.15.102:0/2091262933 shutdown_connections 2024-09-13T19:16:17.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.123+0000 7fdb8d230800 1 -- 172.21.15.102:0/2091262933 wait complete. 2024-09-13T19:16:17.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.123+0000 7fdb8d230800 1 Processor -- start 2024-09-13T19:16:17.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.123+0000 7fdb8d230800 1 -- start start 2024-09-13T19:16:17.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.123+0000 7fdb8d230800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a89a887010 0x55a89a88e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.123+0000 7fdb8d230800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a89a888050 con 0x55a89a887010 2024-09-13T19:16:17.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.123+0000 7fdb88d68640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a89a887010 0x55a89a88e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.123+0000 7fdb88d68640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a89a887010 0x55a89a88e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54830/0 (socket says 172.21.15.102:54830) 2024-09-13T19:16:17.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.123+0000 7fdb88d68640 1 -- 172.21.15.102:0/3758876466 learned_addr learned my addr 172.21.15.102:0/3758876466 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:17.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.124+0000 7fdb88d68640 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a89a88e9b0 con 0x55a89a887010 2024-09-13T19:16:17.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.124+0000 7fdb88d68640 1 --2- 172.21.15.102:0/3758876466 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a89a887010 0x55a89a88e470 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fdb8004cd60 tx=0x7fdb8004cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.124+0000 7fda65ffb640 1 -- 172.21.15.102:0/3758876466 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb80039070 con 0x55a89a887010 2024-09-13T19:16:17.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.124+0000 7fda65ffb640 1 -- 172.21.15.102:0/3758876466 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb8004e290 con 0x55a89a887010 2024-09-13T19:16:17.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.124+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a89a88ec40 con 0x55a89a887010 2024-09-13T19:16:17.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.124+0000 7fda65ffb640 1 -- 172.21.15.102:0/3758876466 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb8004e5b0 con 0x55a89a887010 2024-09-13T19:16:17.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.124+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a89a8918f0 con 0x55a89a887010 2024-09-13T19:16:17.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.125+0000 7fda65ffb640 1 -- 172.21.15.102:0/3758876466 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fdb8003c070 con 0x55a89a887010 2024-09-13T19:16:17.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.125+0000 7fda65ffb640 1 --2- 172.21.15.102:0/3758876466 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fda58036b90 0x7fda58039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.125+0000 7fda65ffb640 1 -- 172.21.15.102:0/3758876466 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fdb8003fc90 con 0x55a89a887010 2024-09-13T19:16:17.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.125+0000 7fdb88567640 1 --2- 172.21.15.102:0/3758876466 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fda58036b90 0x7fda58039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.125+0000 7fdb88567640 1 --2- 172.21.15.102:0/3758876466 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fda58036b90 0x7fda58039050 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdb7801dfd0 tx=0x7fdb78037000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.126+0000 7fdb8d230800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.126+0000 7fdb8d230800 1 --2- 172.21.15.102:0/3758876466 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55a89a899f80 0x55a89a89c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.126+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a89a89cb90 con 0x55a89a899f80 2024-09-13T19:16:17.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.126+0000 7fdb7fd66640 1 --2- 172.21.15.102:0/3758876466 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55a89a899f80 0x55a89a89c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.126+0000 7fdb7fd66640 1 --2- 172.21.15.102:0/3758876466 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55a89a899f80 0x55a89a89c440 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.126+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb70057030 con 0x55a89a899f80 2024-09-13T19:16:17.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.126+0000 7fdb8d230800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:17.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.126+0000 7fdb8d230800 20 realm 2024-09-13T19:16:17.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.126+0000 7fdb8d230800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.126+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a89a89cfc0 con 0x55a89a899f80 2024-09-13T19:16:17.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.127+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb70057030 con 0x55a89a899f80 2024-09-13T19:16:17.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.127+0000 7fdb8d230800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:17.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.127+0000 7fdb8d230800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:17.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.127+0000 7fdb8d230800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.127+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a89a89d890 con 0x55a89a899f80 2024-09-13T19:16:17.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.127+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb70057030 con 0x55a89a899f80 2024-09-13T19:16:17.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.127+0000 7fdb8d230800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:17.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.127+0000 7fdb8d230800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.127+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a89a89dc30 con 0x55a89a899f80 2024-09-13T19:16:17.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.127+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdb70057030 con 0x55a89a899f80 2024-09-13T19:16:17.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.127+0000 7fdb8d230800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:17.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.127+0000 7fdb8d230800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.127+0000 7fdb8d230800 1 --2- 172.21.15.102:0/3758876466 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55a89a89e990 0x55a89a8a0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.127+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8a13d0 con 0x55a89a89e990 2024-09-13T19:16:17.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.127+0000 7fdb88d68640 1 --2- 172.21.15.102:0/3758876466 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55a89a89e990 0x55a89a8a0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.127+0000 7fdb88d68640 1 --2- 172.21.15.102:0/3758876466 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55a89a89e990 0x55a89a8a0d80 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.128+0000 7fdb88d68640 1 -- 172.21.15.102:0/3758876466 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdb8003b030 con 0x55a89a89e990 2024-09-13T19:16:17.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.128+0000 7fdb8d230800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:17.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.128+0000 7fdb8d230800 20 searching for the correct realm 2024-09-13T19:16:17.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.128+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8a2d30 con 0x55a89a89e990 2024-09-13T19:16:17.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.128+0000 7fdb88d68640 1 -- 172.21.15.102:0/3758876466 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb8003b030 con 0x55a89a89e990 2024-09-13T19:16:17.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.128+0000 7fdb88d68640 1 --2- 172.21.15.102:0/3758876466 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fdb8003e070 0x7fdb8004b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.128+0000 7fdb88d68640 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8a2d30 con 0x7fdb8003e070 2024-09-13T19:16:17.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.128+0000 7fdb88567640 1 --2- 172.21.15.102:0/3758876466 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fdb8003e070 0x7fdb8004b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.128+0000 7fdb88567640 1 --2- 172.21.15.102:0/3758876466 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fdb8003e070 0x7fdb8004b5d0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.129+0000 7fdb88567640 1 -- 172.21.15.102:0/3758876466 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb7802e070 con 0x7fdb8003e070 2024-09-13T19:16:17.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.129+0000 7fdb88567640 1 --2- 172.21.15.102:0/3758876466 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fdb7804bc20 0x7fdb7804d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.129+0000 7fdb88567640 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8a2d30 con 0x7fdb7804bc20 2024-09-13T19:16:17.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.129+0000 7fdb7fd66640 1 --2- 172.21.15.102:0/3758876466 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fdb7804bc20 0x7fdb7804d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.129+0000 7fdb7fd66640 1 --2- 172.21.15.102:0/3758876466 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fdb7804bc20 0x7fdb7804d5a0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.130+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb70057030 con 0x7fdb7804bc20 2024-09-13T19:16:17.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.130+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8a2d30 con 0x55a89a899f80 2024-09-13T19:16:17.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.130+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb70057030 con 0x55a89a899f80 2024-09-13T19:16:17.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.130+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8a2d30 con 0x55a89a899f80 2024-09-13T19:16:17.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.130+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb70057030 con 0x55a89a899f80 2024-09-13T19:16:17.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.130+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8a2d30 con 0x7fdb7804bc20 2024-09-13T19:16:17.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.130+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb70057030 con 0x7fdb7804bc20 2024-09-13T19:16:17.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.130+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8a2d30 con 0x7fdb7804bc20 2024-09-13T19:16:17.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.131+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb70057030 con 0x7fdb7804bc20 2024-09-13T19:16:17.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.131+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8a2d30 con 0x7fdb8003e070 2024-09-13T19:16:17.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.131+0000 7fdb88567640 1 -- 172.21.15.102:0/3758876466 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb7802e070 con 0x7fdb8003e070 2024-09-13T19:16:17.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.131+0000 7fdb88567640 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8a2d30 con 0x55a89a89e990 2024-09-13T19:16:17.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.131+0000 7fdb88d68640 1 -- 172.21.15.102:0/3758876466 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb8003b030 con 0x55a89a89e990 2024-09-13T19:16:17.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.131+0000 7fdb88d68640 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8a2d30 con 0x55a89a899f80 2024-09-13T19:16:17.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.131+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb70057030 con 0x55a89a899f80 2024-09-13T19:16:17.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.131+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8a2d30 con 0x7fdb7804bc20 2024-09-13T19:16:17.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.132+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb70057030 con 0x7fdb7804bc20 2024-09-13T19:16:17.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.132+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8a2d30 con 0x55a89a899f80 2024-09-13T19:16:17.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.132+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb70057030 con 0x55a89a899f80 2024-09-13T19:16:17.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.132+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8a2d30 con 0x7fdb8003e070 2024-09-13T19:16:17.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.132+0000 7fdb88567640 1 -- 172.21.15.102:0/3758876466 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdb7802e070 con 0x7fdb8003e070 2024-09-13T19:16:17.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.132+0000 7fdb88567640 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8a2d30 con 0x55a89a89e990 2024-09-13T19:16:17.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.132+0000 7fdb88d68640 1 -- 172.21.15.102:0/3758876466 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb8003b030 con 0x55a89a89e990 2024-09-13T19:16:17.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.132+0000 7fdb88d68640 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8a2d30 con 0x55a89a89e990 2024-09-13T19:16:17.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.133+0000 7fdb88d68640 1 -- 172.21.15.102:0/3758876466 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdb8003b030 con 0x55a89a89e990 2024-09-13T19:16:17.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.133+0000 7fdb88d68640 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8a2d30 con 0x7fdb7804bc20 2024-09-13T19:16:17.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.133+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb70057030 con 0x7fdb7804bc20 2024-09-13T19:16:17.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.133+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8a2d30 con 0x55a89a89e990 2024-09-13T19:16:17.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.133+0000 7fdb88d68640 1 -- 172.21.15.102:0/3758876466 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdb8003b030 con 0x55a89a89e990 2024-09-13T19:16:17.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.133+0000 7fdb88d68640 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8a2d30 con 0x55a89a89e990 2024-09-13T19:16:17.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.133+0000 7fdb88d68640 1 -- 172.21.15.102:0/3758876466 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb8003b030 con 0x55a89a89e990 2024-09-13T19:16:17.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.133+0000 7fdb88d68640 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8a2d30 con 0x55a89a899f80 2024-09-13T19:16:17.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.134+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb70057030 con 0x55a89a899f80 2024-09-13T19:16:17.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.134+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8a2d30 con 0x55a89a899f80 2024-09-13T19:16:17.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.134+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdb70057030 con 0x55a89a899f80 2024-09-13T19:16:17.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.134+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8a2d30 con 0x7fdb7804bc20 2024-09-13T19:16:17.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.134+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb70057030 con 0x7fdb7804bc20 2024-09-13T19:16:17.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.134+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8a2d30 con 0x55a89a89e990 2024-09-13T19:16:17.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.134+0000 7fdb88d68640 1 -- 172.21.15.102:0/3758876466 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb8003b030 con 0x55a89a89e990 2024-09-13T19:16:17.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.134+0000 7fdb88d68640 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8a2d30 con 0x7fdb8003e070 2024-09-13T19:16:17.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.134+0000 7fdb88567640 1 -- 172.21.15.102:0/3758876466 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb7802e070 con 0x7fdb8003e070 2024-09-13T19:16:17.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.134+0000 7fdb88567640 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8a2d30 con 0x55a89a899f80 2024-09-13T19:16:17.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.135+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb70057030 con 0x55a89a899f80 2024-09-13T19:16:17.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.135+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8a2d30 con 0x7fdb7804bc20 2024-09-13T19:16:17.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.135+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb70057030 con 0x7fdb7804bc20 2024-09-13T19:16:17.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.135+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8a2d30 con 0x55a89a89e990 2024-09-13T19:16:17.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.135+0000 7fdb88d68640 1 -- 172.21.15.102:0/3758876466 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb8003b030 con 0x55a89a89e990 2024-09-13T19:16:17.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.135+0000 7fdb88d68640 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8a2d30 con 0x7fdb7804bc20 2024-09-13T19:16:17.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.135+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb70057030 con 0x7fdb7804bc20 2024-09-13T19:16:17.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.135+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8a2d30 con 0x7fdb8003e070 2024-09-13T19:16:17.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.136+0000 7fdb88567640 1 -- 172.21.15.102:0/3758876466 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb7802e070 con 0x7fdb8003e070 2024-09-13T19:16:17.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.136+0000 7fdb88567640 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8a2d30 con 0x55a89a89e990 2024-09-13T19:16:17.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.136+0000 7fdb88d68640 1 -- 172.21.15.102:0/3758876466 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb8003b030 con 0x55a89a89e990 2024-09-13T19:16:17.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.136+0000 7fdb88d68640 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8a2d30 con 0x7fdb7804bc20 2024-09-13T19:16:17.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.136+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb70057030 con 0x7fdb7804bc20 2024-09-13T19:16:17.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.136+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8a2d30 con 0x55a89a899f80 2024-09-13T19:16:17.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.136+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdb70057030 con 0x55a89a899f80 2024-09-13T19:16:17.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.137+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fdb7008a080 con 0x7fdb8003e070 2024-09-13T19:16:17.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.137+0000 7fdb88567640 1 -- 172.21.15.102:0/3758876466 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb7802e070 con 0x7fdb8003e070 2024-09-13T19:16:17.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.137+0000 7fdb8d230800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:17.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.137+0000 7fdb8d230800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:17.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.137+0000 7fdb8d230800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:17.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.137+0000 7fdb8d230800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:17.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.137+0000 7fdb8d230800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:17.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.137+0000 7fdb8d230800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:17.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.137+0000 7fdb8d230800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.137+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8a2950 con 0x55a89a899f80 2024-09-13T19:16:17.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.137+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb70057030 con 0x55a89a899f80 2024-09-13T19:16:17.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.137+0000 7fdb8d230800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:17.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.137+0000 7fdb8d230800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.137+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8a2190 con 0x55a89a899f80 2024-09-13T19:16:17.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.137+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdb70057030 con 0x55a89a899f80 2024-09-13T19:16:17.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.137+0000 7fdb8d230800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:17.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.137+0000 7fdb8d230800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.137+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8a31b0 con 0x55a89a89e990 2024-09-13T19:16:17.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.138+0000 7fdb88d68640 1 -- 172.21.15.102:0/3758876466 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdb8003b030 con 0x55a89a89e990 2024-09-13T19:16:17.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.138+0000 7fdb8d230800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:17.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.138+0000 7fdb8d230800 20 zone default found 2024-09-13T19:16:17.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.138+0000 7fdb8d230800 4 Realm: () 2024-09-13T19:16:17.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.138+0000 7fdb8d230800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:17.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.138+0000 7fdb8d230800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:17.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.138+0000 7fdb8d230800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:17.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.138+0000 7fdb8d230800 20 zonegroup default 2024-09-13T19:16:17.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.138+0000 7fdb8d230800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.138+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8a3a00 con 0x7fdb7804bc20 2024-09-13T19:16:17.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.138+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdb70057030 con 0x7fdb7804bc20 2024-09-13T19:16:17.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.138+0000 7fdb8d230800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:17.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.138+0000 7fdb8d230800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.138+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8a53e0 con 0x55a89a89e990 2024-09-13T19:16:17.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.138+0000 7fdb88d68640 1 -- 172.21.15.102:0/3758876466 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdb8003b030 con 0x55a89a89e990 2024-09-13T19:16:17.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.138+0000 7fdb8d230800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:17.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.138+0000 7fdb8d230800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.138+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8a5850 con 0x55a89a89e990 2024-09-13T19:16:17.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.138+0000 7fdb88d68640 1 -- 172.21.15.102:0/3758876466 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdb8003b030 con 0x55a89a89e990 2024-09-13T19:16:17.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.138+0000 7fdb8d230800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:17.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.138+0000 7fdb8d230800 20 started sync module instance, tier type = 2024-09-13T19:16:17.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.138+0000 7fdb8d230800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:17.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.138+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8a4820 con 0x7fdb8003e070 2024-09-13T19:16:17.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.139+0000 7fdb88567640 1 -- 172.21.15.102:0/3758876466 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(44 notify.0 [create] v34'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb7802e070 con 0x7fdb8003e070 2024-09-13T19:16:17.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.139+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94182635619184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8a5cb0 con 0x7fdb8003e070 2024-09-13T19:16:17.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.139+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8a6500 con 0x55a89a899f80 2024-09-13T19:16:17.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.140+0000 7fdb88567640 1 -- 172.21.15.102:0/3758876466 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94182635619184] v34'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb7802e070 con 0x7fdb8003e070 2024-09-13T19:16:17.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.141+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v34'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb70057030 con 0x55a89a899f80 2024-09-13T19:16:17.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.141+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94182635626576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8a6920 con 0x55a89a899f80 2024-09-13T19:16:17.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.141+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8a72e0 con 0x55a89a89e990 2024-09-13T19:16:17.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.142+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94182635626576] v34'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb70057030 con 0x55a89a899f80 2024-09-13T19:16:17.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.142+0000 7fdb88d68640 1 -- 172.21.15.102:0/3758876466 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v34'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb8003b030 con 0x55a89a89e990 2024-09-13T19:16:17.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.142+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94182635628112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8a72e0 con 0x55a89a89e990 2024-09-13T19:16:17.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.142+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8a7ca0 con 0x7fdb8003e070 2024-09-13T19:16:17.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.143+0000 7fdb88d68640 1 -- 172.21.15.102:0/3758876466 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94182635628112] v34'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb8003b030 con 0x55a89a89e990 2024-09-13T19:16:17.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.143+0000 7fdb88567640 1 -- 172.21.15.102:0/3758876466 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(50 notify.3 [create] v34'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb7802e070 con 0x7fdb8003e070 2024-09-13T19:16:17.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.143+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94182635630128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8a7250 con 0x7fdb8003e070 2024-09-13T19:16:17.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.143+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8a8b60 con 0x55a89a899f80 2024-09-13T19:16:17.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.144+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v34'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb70057030 con 0x55a89a899f80 2024-09-13T19:16:17.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.144+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94182635636400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8a8b10 con 0x55a89a899f80 2024-09-13T19:16:17.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.144+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8a9b20 con 0x7fdb7804bc20 2024-09-13T19:16:17.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.144+0000 7fdb88567640 1 -- 172.21.15.102:0/3758876466 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94182635630128] v34'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb7802e070 con 0x7fdb8003e070 2024-09-13T19:16:17.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.145+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(54 notify.5 [create] v34'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb70057030 con 0x7fdb7804bc20 2024-09-13T19:16:17.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.145+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94182635640272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8a9ae0 con 0x7fdb7804bc20 2024-09-13T19:16:17.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.145+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8aa530 con 0x7fdb7804bc20 2024-09-13T19:16:17.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.145+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94182635636400] v34'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb70057030 con 0x55a89a899f80 2024-09-13T19:16:17.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.146+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94182635640272] v34'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb70057030 con 0x7fdb7804bc20 2024-09-13T19:16:17.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.146+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(56 notify.6 [create] v34'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb70057030 con 0x7fdb7804bc20 2024-09-13T19:16:17.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.146+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94182635634832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8aa080 con 0x7fdb7804bc20 2024-09-13T19:16:17.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.146+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8aaa40 con 0x7fdb7804bc20 2024-09-13T19:16:17.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.147+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94182635634832] v34'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb70057030 con 0x7fdb7804bc20 2024-09-13T19:16:17.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.147+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(58 notify.7 [create] v34'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb70057030 con 0x7fdb7804bc20 2024-09-13T19:16:17.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.147+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94182635638608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8aaa40 con 0x7fdb7804bc20 2024-09-13T19:16:17.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.147+0000 7fdb8d230800 20 add_watcher() i=0 2024-09-13T19:16:17.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.147+0000 7fdb8d230800 20 add_watcher() i=1 2024-09-13T19:16:17.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.147+0000 7fdb8d230800 20 add_watcher() i=2 2024-09-13T19:16:17.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.147+0000 7fdb8d230800 20 add_watcher() i=3 2024-09-13T19:16:17.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.147+0000 7fdb8d230800 20 add_watcher() i=4 2024-09-13T19:16:17.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.147+0000 7fdb8d230800 20 add_watcher() i=5 2024-09-13T19:16:17.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.147+0000 7fdb8d230800 20 add_watcher() i=6 2024-09-13T19:16:17.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.148+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94182635638608] v34'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb70057030 con 0x7fdb7804bc20 2024-09-13T19:16:17.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.148+0000 7fdb8d230800 20 add_watcher() i=7 2024-09-13T19:16:17.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.148+0000 7fdb8d230800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:17.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.148+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8add30 con 0x55a89a899f80 2024-09-13T19:16:17.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.148+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdb70057030 con 0x55a89a899f80 2024-09-13T19:16:17.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.148+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94182635644672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8aafd0 con 0x55a89a899f80 2024-09-13T19:16:17.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.149+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94182635644672] v34'86 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdb70057030 con 0x55a89a899f80 2024-09-13T19:16:17.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.149+0000 7fda3e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:17.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.150+0000 7fdb8d230800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:17.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.150+0000 7fdb8d230800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:17.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.150+0000 7fdb8d230800 5 note: GC not initialized 2024-09-13T19:16:17.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.150+0000 7fda3d7e2640 20 reqs_thread_entry: start 2024-09-13T19:16:17.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.150+0000 7fdb8d230800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:17.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.150+0000 7fdb8d230800 20 Filter name: none 2024-09-13T19:16:17.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.150+0000 7fd9aeffd640 20 reqs_thread_entry: start 2024-09-13T19:16:17.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.150+0000 7fdb8d230800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:16:17.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.150+0000 7fdb8d230800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.150+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8e1170 con 0x55a89a899f80 2024-09-13T19:16:17.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.151+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fdb70057030 con 0x55a89a899f80 2024-09-13T19:16:17.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.151+0000 7fdb8d230800 20 rados_obj.operate() r=0 bl.length=556 2024-09-13T19:16:17.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.151+0000 7fdb8d230800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:16:17.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.151+0000 7fdb8d230800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:16:17.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.151+0000 7fdb8d230800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:16:17.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.151+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8e7960 con 0x55a89a899f80 2024-09-13T19:16:17.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.152+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v34'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fdb70057030 con 0x55a89a899f80 2024-09-13T19:16:17.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.152+0000 7fdb8d230800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:16:17.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.152+0000 7fdb8d230800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:16:17.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.152+0000 7fdb8d230800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T19:16:17.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.152+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94182635893568 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8e3040 con 0x55a89a899f80 2024-09-13T19:16:17.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.152+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== watch-notify(notify (1) cookie 94182635636400 notify 146028888074 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55a89a62de00 con 0x55a89a899f80 2024-09-13T19:16:17.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.152+0000 7fda677fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888074 cookie 94182635636400 notifier 4426 bl.length()=567 2024-09-13T19:16:17.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.152+0000 7fda677fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:16:17.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.152+0000 7fda677fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:16:17.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.152+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(64 notify.4 [notify cookie 94182635893568 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdb70057030 con 0x55a89a899f80 2024-09-13T19:16:17.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.152+0000 7fda677fe640 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fda4c003ea0 con 0x55a89a899f80 2024-09-13T19:16:17.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.152+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb70057030 con 0x55a89a899f80 2024-09-13T19:16:17.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.152+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== watch-notify(notify_complete (2) cookie 94182635893568 notify 146028888074 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fdb7005bd60 con 0x55a89a899f80 2024-09-13T19:16:17.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.152+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:66 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8e7340 con 0x7fdb8003e070 2024-09-13T19:16:17.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.154+0000 7fdb88567640 1 -- 172.21.15.102:0/3758876466 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(66 foo:foo2 [delete] v34'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb7802e070 con 0x7fdb8003e070 2024-09-13T19:16:17.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.154+0000 7fdb8d230800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-13T19:16:17.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.154+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94182635893568 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8e2b90 con 0x7fdb8003e070 2024-09-13T19:16:17.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.154+0000 7fdb88567640 1 -- 172.21.15.102:0/3758876466 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== watch-notify(notify (1) cookie 94182635619184 notify 146028888069 ret 0) ==== 201+0+0 (crc 0 0 0) 0x55a89a860420 con 0x7fdb8003e070 2024-09-13T19:16:17.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.154+0000 7fdb88567640 1 -- 172.21.15.102:0/3758876466 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(67 notify.0 [notify cookie 94182635893568 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdb7802e070 con 0x7fdb8003e070 2024-09-13T19:16:17.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.154+0000 7fda66ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888069 cookie 94182635619184 notifier 4426 bl.length()=159 2024-09-13T19:16:17.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.154+0000 7fda66ffd640 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fd9bc0032c0 con 0x7fdb8003e070 2024-09-13T19:16:17.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.154+0000 7fdb88567640 1 -- 172.21.15.102:0/3758876466 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== watch-notify(notify_complete (2) cookie 94182635893568 notify 146028888069 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a89a85ff00 con 0x7fdb8003e070 2024-09-13T19:16:17.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.154+0000 7fdb88567640 1 -- 172.21.15.102:0/3758876466 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb7802e070 con 0x7fdb8003e070 2024-09-13T19:16:17.178 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:16:14.779675Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:16:14.779665Z","tags":[],"group_ids":[]} 2024-09-13T19:16:17.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.155+0000 7fda3e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:17.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.155+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94182635644672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8deec0 con 0x55a89a899f80 2024-09-13T19:16:17.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.156+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94182635644672] v34'87 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdb70057030 con 0x55a89a899f80 2024-09-13T19:16:17.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.156+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94182635619184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8deec0 con 0x7fdb8003e070 2024-09-13T19:16:17.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.157+0000 7fdb88567640 1 -- 172.21.15.102:0/3758876466 <== osd.2 v2:172.21.15.102:6816/2238176080 16 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94182635619184] v34'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb7802e070 con 0x7fdb8003e070 2024-09-13T19:16:17.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.157+0000 7fdb8d230800 20 remove_watcher() i=0 2024-09-13T19:16:17.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.157+0000 7fdb8d230800 2 removed watcher, disabling cache 2024-09-13T19:16:17.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.157+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94182635626576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8deec0 con 0x55a89a899f80 2024-09-13T19:16:17.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.158+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 <== osd.1 v2:172.21.15.102:6808/2204418452 28 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94182635626576] v34'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb70057030 con 0x55a89a899f80 2024-09-13T19:16:17.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.158+0000 7fdb8d230800 20 remove_watcher() i=1 2024-09-13T19:16:17.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.158+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94182635628112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8deec0 con 0x55a89a89e990 2024-09-13T19:16:17.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.159+0000 7fdb88d68640 1 -- 172.21.15.102:0/3758876466 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94182635628112] v34'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb8003b030 con 0x55a89a89e990 2024-09-13T19:16:17.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.159+0000 7fdb8d230800 20 remove_watcher() i=2 2024-09-13T19:16:17.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.159+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94182635630128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8deec0 con 0x7fdb8003e070 2024-09-13T19:16:17.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.160+0000 7fdb88567640 1 -- 172.21.15.102:0/3758876466 <== osd.2 v2:172.21.15.102:6816/2238176080 17 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94182635630128] v34'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb7802e070 con 0x7fdb8003e070 2024-09-13T19:16:17.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.160+0000 7fdb8d230800 20 remove_watcher() i=3 2024-09-13T19:16:17.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.160+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94182635636400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8deec0 con 0x55a89a899f80 2024-09-13T19:16:17.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.162+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 <== osd.1 v2:172.21.15.102:6808/2204418452 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94182635636400] v34'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb70057030 con 0x55a89a899f80 2024-09-13T19:16:17.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.162+0000 7fdb8d230800 20 remove_watcher() i=4 2024-09-13T19:16:17.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.162+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94182635640272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8deec0 con 0x7fdb7804bc20 2024-09-13T19:16:17.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.163+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94182635640272] v34'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb70057030 con 0x7fdb7804bc20 2024-09-13T19:16:17.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.163+0000 7fdb8d230800 20 remove_watcher() i=5 2024-09-13T19:16:17.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.163+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94182635634832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8deec0 con 0x7fdb7804bc20 2024-09-13T19:16:17.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.164+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94182635634832] v34'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb70057030 con 0x7fdb7804bc20 2024-09-13T19:16:17.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.164+0000 7fdb8d230800 20 remove_watcher() i=6 2024-09-13T19:16:17.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.164+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94182635638608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a89a8deec0 con 0x7fdb7804bc20 2024-09-13T19:16:17.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.165+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94182635638608] v34'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb70057030 con 0x7fdb7804bc20 2024-09-13T19:16:17.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.165+0000 7fdb8d230800 20 remove_watcher() i=7 2024-09-13T19:16:17.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.165+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fdb7804bc20 msgr2=0x7fdb7804d5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.165+0000 7fdb8d230800 1 --2- 172.21.15.102:0/3758876466 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fdb7804bc20 0x7fdb7804d5a0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.165+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55a89a899f80 msgr2=0x55a89a89c440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.165+0000 7fdb8d230800 1 --2- 172.21.15.102:0/3758876466 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55a89a899f80 0x55a89a89c440 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.165+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fdb8003e070 msgr2=0x7fdb8004b5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.165+0000 7fdb8d230800 1 --2- 172.21.15.102:0/3758876466 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fdb8003e070 0x7fdb8004b5d0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.165+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55a89a89e990 msgr2=0x55a89a8a0d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.165+0000 7fdb8d230800 1 --2- 172.21.15.102:0/3758876466 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55a89a89e990 0x55a89a8a0d80 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.165+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fda58036b90 msgr2=0x7fda58039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.165+0000 7fdb8d230800 1 --2- 172.21.15.102:0/3758876466 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fda58036b90 0x7fda58039050 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdb7801dfd0 tx=0x7fdb78037000 comp rx=0 tx=0).stop 2024-09-13T19:16:17.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.165+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a89a887010 msgr2=0x55a89a88e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.165+0000 7fdb8d230800 1 --2- 172.21.15.102:0/3758876466 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a89a887010 0x55a89a88e470 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fdb8004cd60 tx=0x7fdb8004cd90 comp rx=0 tx=0).stop 2024-09-13T19:16:17.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.165+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 reap_dead start 2024-09-13T19:16:17.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.165+0000 7fdb7fd66640 1 -- 172.21.15.102:0/3758876466 reap_dead start 2024-09-13T19:16:17.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.165+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 shutdown_connections 2024-09-13T19:16:17.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.165+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 >> 172.21.15.102:0/3758876466 conn(0x55a89a883370 msgr2=0x55a89a881440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:17.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.165+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 shutdown_connections 2024-09-13T19:16:17.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.165+0000 7fdb8d230800 1 -- 172.21.15.102:0/3758876466 wait complete. 2024-09-13T19:16:17.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.165+0000 7fdb8d230800 1 -- 172.21.15.102:0/3543615165 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fda60036b90 msgr2=0x7fda60039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.165+0000 7fdb8d230800 1 --2- 172.21.15.102:0/3543615165 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fda60036b90 0x7fda60039050 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x55a89a865200 tx=0x7fdb7800ff90 comp rx=0 tx=0).stop 2024-09-13T19:16:17.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.165+0000 7fdb8d230800 1 -- 172.21.15.102:0/3543615165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a89a85d8b0 msgr2=0x55a89a85bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.165+0000 7fdb8d230800 1 --2- 172.21.15.102:0/3543615165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a89a85d8b0 0x55a89a85bf00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x55a89a6dab60 tx=0x7fdb800163e0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.165+0000 7fdb8d230800 1 -- 172.21.15.102:0/3543615165 shutdown_connections 2024-09-13T19:16:17.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.165+0000 7fdb8d230800 1 --2- 172.21.15.102:0/3543615165 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fda60036b90 0x7fda60039050 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.165+0000 7fdb8d230800 1 --2- 172.21.15.102:0/3543615165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a89a85d8b0 0x55a89a85bf00 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.165+0000 7fdb8d230800 1 -- 172.21.15.102:0/3543615165 >> 172.21.15.102:0/3543615165 conn(0x55a89a86d050 msgr2=0x55a89a86fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:17.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.165+0000 7fdb8d230800 1 -- 172.21.15.102:0/3543615165 shutdown_connections 2024-09-13T19:16:17.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.165+0000 7fdb8d230800 1 -- 172.21.15.102:0/3543615165 wait complete. 2024-09-13T19:16:17.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.166+0000 7fdb8d230800 1 -- 172.21.15.102:0/636288925 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55a89a7699b0 msgr2=0x55a89a8642c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.166+0000 7fdb8d230800 1 --2- 172.21.15.102:0/636288925 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55a89a7699b0 0x55a89a8642c0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.166+0000 7fdb8d230800 1 -- 172.21.15.102:0/636288925 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55a89a866c50 msgr2=0x55a89a869040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.166+0000 7fdb8d230800 1 --2- 172.21.15.102:0/636288925 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55a89a866c50 0x55a89a869040 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.166+0000 7fdb8d230800 1 -- 172.21.15.102:0/636288925 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fda70036b90 msgr2=0x7fda70039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.166+0000 7fdb8d230800 1 --2- 172.21.15.102:0/636288925 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fda70036b90 0x7fda70039050 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdb70057000 tx=0x7fdb70052000 comp rx=0 tx=0).stop 2024-09-13T19:16:17.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.166+0000 7fdb8d230800 1 -- 172.21.15.102:0/636288925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a89a765570 msgr2=0x55a89a6da600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.166+0000 7fdb8d230800 1 --2- 172.21.15.102:0/636288925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a89a765570 0x55a89a6da600 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fdb78000c00 tx=0x7fdb78000ed0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.166+0000 7fdb8d230800 1 -- 172.21.15.102:0/636288925 shutdown_connections 2024-09-13T19:16:17.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.166+0000 7fdb8d230800 1 --2- 172.21.15.102:0/636288925 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55a89a866c50 0x55a89a869040 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.166+0000 7fdb8d230800 1 --2- 172.21.15.102:0/636288925 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55a89a7699b0 0x55a89a8642c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.166+0000 7fdb8d230800 1 --2- 172.21.15.102:0/636288925 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fda70036b90 0x7fda70039050 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.166+0000 7fdb8d230800 1 --2- 172.21.15.102:0/636288925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a89a765570 0x55a89a6da600 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.166+0000 7fdb8d230800 1 -- 172.21.15.102:0/636288925 >> 172.21.15.102:0/636288925 conn(0x55a89a760e00 msgr2=0x55a89a84e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:17.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.166+0000 7fdb8d230800 1 -- 172.21.15.102:0/636288925 shutdown_connections 2024-09-13T19:16:17.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.166+0000 7fdb8d230800 1 -- 172.21.15.102:0/636288925 wait complete. 2024-09-13T19:16:17.191 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:16:14.779675Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:16:14.779665Z', 'tags': [], 'group_ids': []} 2024-09-13T19:16:17.192 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-13T19:16:17.192 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-13T19:16:17.192 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-13T19:16:17.236 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:17.237 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:17.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.234+0000 7f6905287800 1 Processor -- start 2024-09-13T19:16:17.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.234+0000 7f6905287800 1 -- start start 2024-09-13T19:16:17.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.234+0000 7f6905287800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5573d0d3f4c0 0x5573d0d3f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.234+0000 7f6905287800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5573d0bffb30 con 0x5573d0d3fe00 2024-09-13T19:16:17.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.234+0000 7f6905287800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5573d0be1360 con 0x5573d0d3f4c0 2024-09-13T19:16:17.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.235+0000 7f6902d7b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5573d0d3f4c0 0x5573d0d3f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.235+0000 7f690257a640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5573d0d3fe00 0x5573d0d44980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:49934/0 (socket says 172.21.15.102:49934) 2024-09-13T19:16:17.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.235+0000 7f6902d7b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5573d0d3f4c0 0x5573d0d3f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54838/0 (socket says 172.21.15.102:54838) 2024-09-13T19:16:17.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.235+0000 7f690257a640 1 -- 172.21.15.102:0/514493898 learned_addr learned my addr 172.21.15.102:0/514493898 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:16:17.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.235+0000 7f6902d7b640 1 -- 172.21.15.102:0/514493898 >> v1:172.21.15.53:6789/0 conn(0x5573d0d3fe00 legacy=0x5573d0d44980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.235+0000 7f6902d7b640 1 -- 172.21.15.102:0/514493898 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573d0c07e00 con 0x5573d0d3f4c0 2024-09-13T19:16:17.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.237+0000 7f6902d7b640 1 --2- 172.21.15.102:0/514493898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0d3f4c0 0x5573d0d3f8c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f68f400a600 tx=0x7f68f4047cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd06d54ba3229cc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.237+0000 7f6901d79640 1 -- 172.21.15.102:0/514493898 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68f4056070 con 0x5573d0d3f4c0 2024-09-13T19:16:17.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.237+0000 7f6901d79640 1 -- 172.21.15.102:0/514493898 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68f400a200 con 0x5573d0d3f4c0 2024-09-13T19:16:17.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.237+0000 7f6901d79640 1 -- 172.21.15.102:0/514493898 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68f4008590 con 0x5573d0d3f4c0 2024-09-13T19:16:17.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.237+0000 7f6905287800 1 -- 172.21.15.102:0/514493898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0d3f4c0 msgr2=0x5573d0d3f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.237+0000 7f6905287800 1 --2- 172.21.15.102:0/514493898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0d3f4c0 0x5573d0d3f8c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f68f400a600 tx=0x7f68f4047cb0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.237+0000 7f6905287800 1 -- 172.21.15.102:0/514493898 shutdown_connections 2024-09-13T19:16:17.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.237+0000 7f6905287800 1 --2- 172.21.15.102:0/514493898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0d3f4c0 0x5573d0d3f8c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.237+0000 7f6905287800 1 -- 172.21.15.102:0/514493898 >> 172.21.15.102:0/514493898 conn(0x5573d0d3adf0 msgr2=0x5573d0d3d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:17.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.237+0000 7f6905287800 1 -- 172.21.15.102:0/514493898 shutdown_connections 2024-09-13T19:16:17.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.237+0000 7f6905287800 1 -- 172.21.15.102:0/514493898 wait complete. 2024-09-13T19:16:17.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.251+0000 7f6905287800 1 Processor -- start 2024-09-13T19:16:17.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.251+0000 7f6905287800 1 -- start start 2024-09-13T19:16:17.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.251+0000 7f6905287800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0d3f4c0 0x5573d0e2d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.251+0000 7f6905287800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5573d0c8c330 con 0x5573d0d3f4c0 2024-09-13T19:16:17.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.252+0000 7f6902d7b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0d3f4c0 0x5573d0e2d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.252+0000 7f6902d7b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0d3f4c0 0x5573d0e2d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54850/0 (socket says 172.21.15.102:54850) 2024-09-13T19:16:17.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.252+0000 7f6902d7b640 1 -- 172.21.15.102:0/3790782514 learned_addr learned my addr 172.21.15.102:0/3790782514 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:17.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.252+0000 7f6902d7b640 1 -- 172.21.15.102:0/3790782514 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573d0bd9bc0 con 0x5573d0d3f4c0 2024-09-13T19:16:17.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.252+0000 7f6902d7b640 1 --2- 172.21.15.102:0/3790782514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0d3f4c0 0x5573d0e2d670 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f68f4027ae0 tx=0x7f68f4053000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77643d1bce40c0ce server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.252+0000 7f67f0e09640 1 -- 172.21.15.102:0/3790782514 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68f4008780 con 0x5573d0d3f4c0 2024-09-13T19:16:17.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.252+0000 7f67f0e09640 1 -- 172.21.15.102:0/3790782514 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68f4008920 con 0x5573d0d3f4c0 2024-09-13T19:16:17.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.252+0000 7f67f0e09640 1 -- 172.21.15.102:0/3790782514 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68f4008c00 con 0x5573d0d3f4c0 2024-09-13T19:16:17.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.253+0000 7f6905287800 1 -- 172.21.15.102:0/3790782514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0d3f4c0 msgr2=0x5573d0e2d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.253+0000 7f6905287800 1 --2- 172.21.15.102:0/3790782514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0d3f4c0 0x5573d0e2d670 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f68f4027ae0 tx=0x7f68f4053000 comp rx=0 tx=0).stop 2024-09-13T19:16:17.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.253+0000 7f6905287800 1 -- 172.21.15.102:0/3790782514 shutdown_connections 2024-09-13T19:16:17.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.253+0000 7f6905287800 1 --2- 172.21.15.102:0/3790782514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0d3f4c0 0x5573d0e2d670 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.253+0000 7f6905287800 1 -- 172.21.15.102:0/3790782514 >> 172.21.15.102:0/3790782514 conn(0x5573d0d3adf0 msgr2=0x5573d0e29030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:17.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.253+0000 7f6905287800 1 -- 172.21.15.102:0/3790782514 shutdown_connections 2024-09-13T19:16:17.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.253+0000 7f6905287800 1 -- 172.21.15.102:0/3790782514 wait complete. 2024-09-13T19:16:17.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.253+0000 7f6905287800 1 Processor -- start 2024-09-13T19:16:17.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.253+0000 7f6905287800 1 -- start start 2024-09-13T19:16:17.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.254+0000 7f6905287800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0d3f4c0 0x5573d0e35050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.254+0000 7f6905287800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5573d0d464e0 con 0x5573d0d3f4c0 2024-09-13T19:16:17.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.254+0000 7f6902d7b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0d3f4c0 0x5573d0e35050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.254+0000 7f6902d7b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0d3f4c0 0x5573d0e35050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54864/0 (socket says 172.21.15.102:54864) 2024-09-13T19:16:17.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.254+0000 7f6902d7b640 1 -- 172.21.15.102:0/615179596 learned_addr learned my addr 172.21.15.102:0/615179596 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:17.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.254+0000 7f6902d7b640 1 -- 172.21.15.102:0/615179596 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573d0bedfe0 con 0x5573d0d3f4c0 2024-09-13T19:16:17.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.254+0000 7f6902d7b640 1 --2- 172.21.15.102:0/615179596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0d3f4c0 0x5573d0e35050 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f68f400a1d0 tx=0x7f68f4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.254+0000 7f67ef606640 1 -- 172.21.15.102:0/615179596 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68f4051470 con 0x5573d0d3f4c0 2024-09-13T19:16:17.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.254+0000 7f67ef606640 1 -- 172.21.15.102:0/615179596 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68f4051610 con 0x5573d0d3f4c0 2024-09-13T19:16:17.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.254+0000 7f67ef606640 1 -- 172.21.15.102:0/615179596 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68f40518f0 con 0x5573d0d3f4c0 2024-09-13T19:16:17.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.254+0000 7f6905287800 1 -- 172.21.15.102:0/615179596 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5573d0e35590 con 0x5573d0d3f4c0 2024-09-13T19:16:17.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.255+0000 7f6905287800 1 -- 172.21.15.102:0/615179596 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573d0e35ab0 con 0x5573d0d3f4c0 2024-09-13T19:16:17.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.255+0000 7f67ef606640 1 -- 172.21.15.102:0/615179596 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f68f4075060 con 0x5573d0d3f4c0 2024-09-13T19:16:17.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.255+0000 7f67ef606640 1 --2- 172.21.15.102:0/615179596 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f67e8036b90 0x7f67e8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.255+0000 7f67ef606640 1 -- 172.21.15.102:0/615179596 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f68f4062070 con 0x5573d0d3f4c0 2024-09-13T19:16:17.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.256+0000 7f690257a640 1 --2- 172.21.15.102:0/615179596 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f67e8036b90 0x7f67e8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.256+0000 7f6905287800 1 --2- 172.21.15.102:0/615179596 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5573d0d3fe00 0x5573d0e3c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.256+0000 7f6905287800 1 -- 172.21.15.102:0/615179596 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e3c600 con 0x5573d0d3fe00 2024-09-13T19:16:17.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.256+0000 7f690357c640 1 --2- 172.21.15.102:0/615179596 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5573d0d3fe00 0x5573d0e3c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.256+0000 7f690257a640 1 --2- 172.21.15.102:0/615179596 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f67e8036b90 0x7f67e8039050 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f68f8000f60 tx=0x7f68f80012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.256+0000 7f690357c640 1 --2- 172.21.15.102:0/615179596 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5573d0d3fe00 0x5573d0e3c0c0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.256+0000 7f690357c640 1 -- 172.21.15.102:0/615179596 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68fc00a4a0 con 0x5573d0d3fe00 2024-09-13T19:16:17.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.256+0000 7f6905287800 1 -- 172.21.15.102:0/615179596 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e39690 con 0x5573d0d3fe00 2024-09-13T19:16:17.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.257+0000 7f690357c640 1 -- 172.21.15.102:0/615179596 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f68fc00a4a0 con 0x5573d0d3fe00 2024-09-13T19:16:17.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.257+0000 7f6905287800 1 --2- 172.21.15.102:0/615179596 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5573d0e3e910 0x5573d0e40d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.257+0000 7f6905287800 1 -- 172.21.15.102:0/615179596 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e413a0 con 0x5573d0e3e910 2024-09-13T19:16:17.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.257+0000 7f6902d7b640 1 --2- 172.21.15.102:0/615179596 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5573d0e3e910 0x5573d0e40d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.257+0000 7f6902d7b640 1 --2- 172.21.15.102:0/615179596 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5573d0e3e910 0x5573d0e40d00 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.257+0000 7f6902d7b640 1 -- 172.21.15.102:0/615179596 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f68f4058030 con 0x5573d0e3e910 2024-09-13T19:16:17.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.257+0000 7f6905287800 1 -- 172.21.15.102:0/615179596 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e3d6c0 con 0x5573d0d3fe00 2024-09-13T19:16:17.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.258+0000 7f690357c640 1 -- 172.21.15.102:0/615179596 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f68fc00a4a0 con 0x5573d0d3fe00 2024-09-13T19:16:17.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.258+0000 7f6905287800 1 -- 172.21.15.102:0/615179596 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e3db50 con 0x5573d0e3e910 2024-09-13T19:16:17.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.258+0000 7f6902d7b640 1 -- 172.21.15.102:0/615179596 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f68f4058030 con 0x5573d0e3e910 2024-09-13T19:16:17.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.258+0000 7f6905287800 1 Processor -- start 2024-09-13T19:16:17.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.258+0000 7f6905287800 1 -- start start 2024-09-13T19:16:17.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.258+0000 7f6905287800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0e4fc80 0x5573d0e500a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.258+0000 7f6905287800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5573d0bdb580 con 0x5573d0e4fc80 2024-09-13T19:16:17.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.259+0000 7f690357c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0e4fc80 0x5573d0e500a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.259+0000 7f690357c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0e4fc80 0x5573d0e500a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54866/0 (socket says 172.21.15.102:54866) 2024-09-13T19:16:17.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.259+0000 7f690357c640 1 -- 172.21.15.102:0/617051841 learned_addr learned my addr 172.21.15.102:0/617051841 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:17.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.259+0000 7f690357c640 1 -- 172.21.15.102:0/617051841 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573d0e505e0 con 0x5573d0e4fc80 2024-09-13T19:16:17.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.259+0000 7f690357c640 1 --2- 172.21.15.102:0/617051841 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0e4fc80 0x5573d0e500a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x5573d0e36100 tx=0x7f68fc0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.259+0000 7f67ece01640 1 -- 172.21.15.102:0/617051841 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68fc013640 con 0x5573d0e4fc80 2024-09-13T19:16:17.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.259+0000 7f67ece01640 1 -- 172.21.15.102:0/617051841 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68fc0137e0 con 0x5573d0e4fc80 2024-09-13T19:16:17.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.259+0000 7f67ece01640 1 -- 172.21.15.102:0/617051841 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68fc013ac0 con 0x5573d0e4fc80 2024-09-13T19:16:17.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.259+0000 7f6905287800 1 -- 172.21.15.102:0/617051841 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5573d0e50870 con 0x5573d0e4fc80 2024-09-13T19:16:17.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.259+0000 7f6905287800 1 -- 172.21.15.102:0/617051841 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573d0e53550 con 0x5573d0e4fc80 2024-09-13T19:16:17.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.260+0000 7f67ece01640 1 -- 172.21.15.102:0/617051841 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f68fc011040 con 0x5573d0e4fc80 2024-09-13T19:16:17.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.260+0000 7f67ece01640 1 --2- 172.21.15.102:0/617051841 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f67dc036b90 0x7f67dc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.260+0000 7f67ece01640 1 -- 172.21.15.102:0/617051841 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f68fc00e040 con 0x5573d0e4fc80 2024-09-13T19:16:17.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.260+0000 7f6902d7b640 1 --2- 172.21.15.102:0/617051841 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f67dc036b90 0x7f67dc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.261+0000 7f6905287800 1 Processor -- start 2024-09-13T19:16:17.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.261+0000 7f6905287800 1 -- start start 2024-09-13T19:16:17.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.261+0000 7f6902d7b640 1 --2- 172.21.15.102:0/617051841 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f67dc036b90 0x7f67dc039050 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x5573d0e395b0 tx=0x7f68f4065ee0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.261+0000 7f6905287800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0e5c920 0x5573d0e5cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.261+0000 7f6905287800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5573d0e2ddc0 con 0x5573d0e5c920 2024-09-13T19:16:17.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.261+0000 7f690357c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0e5c920 0x5573d0e5cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.261+0000 7f690357c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0e5c920 0x5573d0e5cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54880/0 (socket says 172.21.15.102:54880) 2024-09-13T19:16:17.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.261+0000 7f690357c640 1 -- 172.21.15.102:0/3427838056 learned_addr learned my addr 172.21.15.102:0/3427838056 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:17.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.261+0000 7f690357c640 1 -- 172.21.15.102:0/3427838056 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573d0e5d2f0 con 0x5573d0e5c920 2024-09-13T19:16:17.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.261+0000 7f690357c640 1 --2- 172.21.15.102:0/3427838056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0e5c920 0x5573d0e5cd20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f68fc005a10 tx=0x7f68fc020f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e88f781ea417fbd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.261+0000 7f67e67fc640 1 -- 172.21.15.102:0/3427838056 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68fc02a910 con 0x5573d0e5c920 2024-09-13T19:16:17.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.261+0000 7f67e67fc640 1 -- 172.21.15.102:0/3427838056 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68fc04a020 con 0x5573d0e5c920 2024-09-13T19:16:17.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.261+0000 7f67e67fc640 1 -- 172.21.15.102:0/3427838056 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68fc02a3f0 con 0x5573d0e5c920 2024-09-13T19:16:17.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.262+0000 7f6905287800 1 -- 172.21.15.102:0/3427838056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0e5c920 msgr2=0x5573d0e5cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.262+0000 7f6905287800 1 --2- 172.21.15.102:0/3427838056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0e5c920 0x5573d0e5cd20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f68fc005a10 tx=0x7f68fc020f60 comp rx=0 tx=0).stop 2024-09-13T19:16:17.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.262+0000 7f6905287800 1 -- 172.21.15.102:0/3427838056 shutdown_connections 2024-09-13T19:16:17.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.262+0000 7f6905287800 1 --2- 172.21.15.102:0/3427838056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0e5c920 0x5573d0e5cd20 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.262+0000 7f6905287800 1 -- 172.21.15.102:0/3427838056 >> 172.21.15.102:0/3427838056 conn(0x5573d0e58c80 msgr2=0x5573d0e56d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:17.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.262+0000 7f6905287800 1 -- 172.21.15.102:0/3427838056 shutdown_connections 2024-09-13T19:16:17.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.262+0000 7f6905287800 1 -- 172.21.15.102:0/3427838056 wait complete. 2024-09-13T19:16:17.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.262+0000 7f6905287800 1 Processor -- start 2024-09-13T19:16:17.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.262+0000 7f6905287800 1 -- start start 2024-09-13T19:16:17.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.263+0000 7f6905287800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0e5c920 0x5573d0e63de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.263+0000 7f6905287800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5573d0e5d960 con 0x5573d0e5c920 2024-09-13T19:16:17.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.263+0000 7f690357c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0e5c920 0x5573d0e63de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.263+0000 7f690357c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0e5c920 0x5573d0e63de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54896/0 (socket says 172.21.15.102:54896) 2024-09-13T19:16:17.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.263+0000 7f690357c640 1 -- 172.21.15.102:0/1532992081 learned_addr learned my addr 172.21.15.102:0/1532992081 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:17.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.263+0000 7f690357c640 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573d0e64320 con 0x5573d0e5c920 2024-09-13T19:16:17.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.263+0000 7f690357c640 1 --2- 172.21.15.102:0/1532992081 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0e5c920 0x5573d0e63de0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f68fc04bc10 tx=0x7f68fc04ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.263+0000 7f67e4ff9640 1 -- 172.21.15.102:0/1532992081 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68fc038070 con 0x5573d0e5c920 2024-09-13T19:16:17.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.263+0000 7f67e4ff9640 1 -- 172.21.15.102:0/1532992081 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68fc020580 con 0x5573d0e5c920 2024-09-13T19:16:17.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.263+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5573d0e645b0 con 0x5573d0e5c920 2024-09-13T19:16:17.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.263+0000 7f67e4ff9640 1 -- 172.21.15.102:0/1532992081 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68fc020880 con 0x5573d0e5c920 2024-09-13T19:16:17.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.263+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573d0e67260 con 0x5573d0e5c920 2024-09-13T19:16:17.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.264+0000 7f67e4ff9640 1 -- 172.21.15.102:0/1532992081 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f68fc03b070 con 0x5573d0e5c920 2024-09-13T19:16:17.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.264+0000 7f67e4ff9640 1 --2- 172.21.15.102:0/1532992081 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f67cc036aa0 0x7f67cc038f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.264+0000 7f67e4ff9640 1 -- 172.21.15.102:0/1532992081 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f68fc04b030 con 0x5573d0e5c920 2024-09-13T19:16:17.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.264+0000 7f6902d7b640 1 --2- 172.21.15.102:0/1532992081 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f67cc036aa0 0x7f67cc038f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.264+0000 7f6905287800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.265+0000 7f6905287800 1 --2- 172.21.15.102:0/1532992081 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5573d0e6f830 0x5573d0e71cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.265+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e72440 con 0x5573d0e6f830 2024-09-13T19:16:17.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.265+0000 7f690257a640 1 --2- 172.21.15.102:0/1532992081 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5573d0e6f830 0x5573d0e71cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.265+0000 7f6902d7b640 1 --2- 172.21.15.102:0/1532992081 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f67cc036aa0 0x7f67cc038f60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f68f400a1a0 tx=0x7f68f408b000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.265+0000 7f690257a640 1 --2- 172.21.15.102:0/1532992081 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5573d0e6f830 0x5573d0e71cf0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.265+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68f8009050 con 0x5573d0e6f830 2024-09-13T19:16:17.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.265+0000 7f6905287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:17.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.265+0000 7f6905287800 20 realm 2024-09-13T19:16:17.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.265+0000 7f6905287800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.265+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e6ecd0 con 0x5573d0e6f830 2024-09-13T19:16:17.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.265+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68f8009050 con 0x5573d0e6f830 2024-09-13T19:16:17.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.265+0000 7f6905287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:17.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.265+0000 7f6905287800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:17.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.265+0000 7f6905287800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.265+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e72f20 con 0x5573d0e6f830 2024-09-13T19:16:17.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.266+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68f8009050 con 0x5573d0e6f830 2024-09-13T19:16:17.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.266+0000 7f6905287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:17.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.266+0000 7f6905287800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.266+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e737f0 con 0x5573d0e6f830 2024-09-13T19:16:17.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.266+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f68f8009050 con 0x5573d0e6f830 2024-09-13T19:16:17.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.266+0000 7f6905287800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:17.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.266+0000 7f6905287800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.266+0000 7f6905287800 1 --2- 172.21.15.102:0/1532992081 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5573d0e740a0 0x5573d0e76490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.266+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e76bd0 con 0x5573d0e740a0 2024-09-13T19:16:17.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.266+0000 7f690357c640 1 --2- 172.21.15.102:0/1532992081 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5573d0e740a0 0x5573d0e76490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.266+0000 7f690357c640 1 --2- 172.21.15.102:0/1532992081 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5573d0e740a0 0x5573d0e76490 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.266+0000 7f690357c640 1 -- 172.21.15.102:0/1532992081 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f68fc03a030 con 0x5573d0e740a0 2024-09-13T19:16:17.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.266+0000 7f6905287800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:17.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.267+0000 7f6905287800 20 searching for the correct realm 2024-09-13T19:16:17.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.267+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e785b0 con 0x5573d0e740a0 2024-09-13T19:16:17.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.267+0000 7f690357c640 1 -- 172.21.15.102:0/1532992081 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68fc03a030 con 0x5573d0e740a0 2024-09-13T19:16:17.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.267+0000 7f690357c640 1 --2- 172.21.15.102:0/1532992081 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f68fc024bb0 0x7f68fc040960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.267+0000 7f690357c640 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e785b0 con 0x7f68fc024bb0 2024-09-13T19:16:17.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.267+0000 7f6902d7b640 1 --2- 172.21.15.102:0/1532992081 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f68fc024bb0 0x7f68fc040960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.267+0000 7f6902d7b640 1 --2- 172.21.15.102:0/1532992081 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f68fc024bb0 0x7f68fc040960 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.267+0000 7f6902d7b640 1 -- 172.21.15.102:0/1532992081 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68f4058030 con 0x7f68fc024bb0 2024-09-13T19:16:17.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.267+0000 7f6902d7b640 1 --2- 172.21.15.102:0/1532992081 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f68f409f040 0x7f68f4065410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.267+0000 7f6902d7b640 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e785b0 con 0x7f68f409f040 2024-09-13T19:16:17.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.268+0000 7f690257a640 1 --2- 172.21.15.102:0/1532992081 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f68f409f040 0x7f68f4065410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.268+0000 7f690257a640 1 --2- 172.21.15.102:0/1532992081 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f68f409f040 0x7f68f4065410 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.269+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68f8009050 con 0x7f68f409f040 2024-09-13T19:16:17.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.269+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e785b0 con 0x5573d0e6f830 2024-09-13T19:16:17.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.269+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68f8009050 con 0x5573d0e6f830 2024-09-13T19:16:17.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.269+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e785b0 con 0x5573d0e6f830 2024-09-13T19:16:17.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.269+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68f8029040 con 0x5573d0e6f830 2024-09-13T19:16:17.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.269+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e785b0 con 0x7f68f409f040 2024-09-13T19:16:17.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.269+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68f8029040 con 0x7f68f409f040 2024-09-13T19:16:17.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.269+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e785b0 con 0x7f68f409f040 2024-09-13T19:16:17.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.269+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68f8029040 con 0x7f68f409f040 2024-09-13T19:16:17.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.269+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e785b0 con 0x7f68fc024bb0 2024-09-13T19:16:17.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.270+0000 7f6902d7b640 1 -- 172.21.15.102:0/1532992081 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68f4058030 con 0x7f68fc024bb0 2024-09-13T19:16:17.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.270+0000 7f6902d7b640 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e785b0 con 0x5573d0e740a0 2024-09-13T19:16:17.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.270+0000 7f690357c640 1 -- 172.21.15.102:0/1532992081 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68fc03a030 con 0x5573d0e740a0 2024-09-13T19:16:17.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.270+0000 7f690357c640 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e785b0 con 0x5573d0e6f830 2024-09-13T19:16:17.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.270+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68f8029040 con 0x5573d0e6f830 2024-09-13T19:16:17.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.270+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e785b0 con 0x7f68f409f040 2024-09-13T19:16:17.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.270+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68f8029040 con 0x7f68f409f040 2024-09-13T19:16:17.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.270+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e785b0 con 0x5573d0e6f830 2024-09-13T19:16:17.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.271+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68f8029040 con 0x5573d0e6f830 2024-09-13T19:16:17.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.271+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e785b0 con 0x7f68fc024bb0 2024-09-13T19:16:17.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.271+0000 7f6902d7b640 1 -- 172.21.15.102:0/1532992081 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f68f4058030 con 0x7f68fc024bb0 2024-09-13T19:16:17.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.271+0000 7f6902d7b640 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e785b0 con 0x5573d0e740a0 2024-09-13T19:16:17.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.271+0000 7f690357c640 1 -- 172.21.15.102:0/1532992081 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68fc03a030 con 0x5573d0e740a0 2024-09-13T19:16:17.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.271+0000 7f690357c640 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e785b0 con 0x5573d0e740a0 2024-09-13T19:16:17.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.271+0000 7f690357c640 1 -- 172.21.15.102:0/1532992081 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f68fc03a030 con 0x5573d0e740a0 2024-09-13T19:16:17.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.271+0000 7f690357c640 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e785b0 con 0x7f68f409f040 2024-09-13T19:16:17.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.272+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68f8029040 con 0x7f68f409f040 2024-09-13T19:16:17.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.272+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e785b0 con 0x5573d0e740a0 2024-09-13T19:16:17.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.272+0000 7f690357c640 1 -- 172.21.15.102:0/1532992081 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f68fc03a030 con 0x5573d0e740a0 2024-09-13T19:16:17.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.272+0000 7f690357c640 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e785b0 con 0x5573d0e740a0 2024-09-13T19:16:17.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.272+0000 7f690357c640 1 -- 172.21.15.102:0/1532992081 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68fc03a030 con 0x5573d0e740a0 2024-09-13T19:16:17.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.272+0000 7f690357c640 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e785b0 con 0x5573d0e6f830 2024-09-13T19:16:17.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.272+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68f8029040 con 0x5573d0e6f830 2024-09-13T19:16:17.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.272+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e785b0 con 0x5573d0e6f830 2024-09-13T19:16:17.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.272+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f68f8029040 con 0x5573d0e6f830 2024-09-13T19:16:17.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.272+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e785b0 con 0x7f68f409f040 2024-09-13T19:16:17.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.273+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68f8029040 con 0x7f68f409f040 2024-09-13T19:16:17.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.273+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e785b0 con 0x5573d0e740a0 2024-09-13T19:16:17.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.273+0000 7f690357c640 1 -- 172.21.15.102:0/1532992081 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68fc03a030 con 0x5573d0e740a0 2024-09-13T19:16:17.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.273+0000 7f690357c640 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e785b0 con 0x7f68fc024bb0 2024-09-13T19:16:17.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.273+0000 7f6902d7b640 1 -- 172.21.15.102:0/1532992081 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68f4058030 con 0x7f68fc024bb0 2024-09-13T19:16:17.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.273+0000 7f6902d7b640 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e785b0 con 0x5573d0e6f830 2024-09-13T19:16:17.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.273+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68f8029040 con 0x5573d0e6f830 2024-09-13T19:16:17.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.273+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e785b0 con 0x7f68f409f040 2024-09-13T19:16:17.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.274+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68f8029040 con 0x7f68f409f040 2024-09-13T19:16:17.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.274+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e785b0 con 0x5573d0e740a0 2024-09-13T19:16:17.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.274+0000 7f690357c640 1 -- 172.21.15.102:0/1532992081 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68fc03a030 con 0x5573d0e740a0 2024-09-13T19:16:17.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.274+0000 7f690357c640 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e785b0 con 0x7f68f409f040 2024-09-13T19:16:17.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.274+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68f8029040 con 0x7f68f409f040 2024-09-13T19:16:17.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.274+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e785b0 con 0x7f68fc024bb0 2024-09-13T19:16:17.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.274+0000 7f6902d7b640 1 -- 172.21.15.102:0/1532992081 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68f4058030 con 0x7f68fc024bb0 2024-09-13T19:16:17.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.274+0000 7f6902d7b640 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e785b0 con 0x5573d0e740a0 2024-09-13T19:16:17.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.274+0000 7f690357c640 1 -- 172.21.15.102:0/1532992081 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68fc03a030 con 0x5573d0e740a0 2024-09-13T19:16:17.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.275+0000 7f690357c640 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e785b0 con 0x7f68f409f040 2024-09-13T19:16:17.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.275+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68f8029040 con 0x7f68f409f040 2024-09-13T19:16:17.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.275+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e785b0 con 0x5573d0e6f830 2024-09-13T19:16:17.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.275+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f68f8029040 con 0x5573d0e6f830 2024-09-13T19:16:17.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.275+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e785b0 con 0x7f68fc024bb0 2024-09-13T19:16:17.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.275+0000 7f6902d7b640 1 -- 172.21.15.102:0/1532992081 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68f4058030 con 0x7f68fc024bb0 2024-09-13T19:16:17.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.275+0000 7f6905287800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:17.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.275+0000 7f6905287800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:17.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.275+0000 7f6905287800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:17.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.275+0000 7f6905287800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:17.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.275+0000 7f6905287800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:17.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.275+0000 7f6905287800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:17.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.275+0000 7f6905287800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.275+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e77680 con 0x5573d0e6f830 2024-09-13T19:16:17.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.275+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68f8029040 con 0x5573d0e6f830 2024-09-13T19:16:17.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.275+0000 7f6905287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:17.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.275+0000 7f6905287800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.275+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e77f20 con 0x5573d0e6f830 2024-09-13T19:16:17.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.276+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f68f8029040 con 0x5573d0e6f830 2024-09-13T19:16:17.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.276+0000 7f6905287800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:17.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.276+0000 7f6905287800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.276+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e772c0 con 0x5573d0e740a0 2024-09-13T19:16:17.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.276+0000 7f690357c640 1 -- 172.21.15.102:0/1532992081 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f68fc03a030 con 0x5573d0e740a0 2024-09-13T19:16:17.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.276+0000 7f6905287800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:17.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.276+0000 7f6905287800 20 zone default found 2024-09-13T19:16:17.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.276+0000 7f6905287800 4 Realm: () 2024-09-13T19:16:17.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.276+0000 7f6905287800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:17.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.276+0000 7f6905287800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:17.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.276+0000 7f6905287800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:17.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.276+0000 7f6905287800 20 zonegroup default 2024-09-13T19:16:17.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.276+0000 7f6905287800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.276+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e78f30 con 0x7f68f409f040 2024-09-13T19:16:17.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.276+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f68f8029040 con 0x7f68f409f040 2024-09-13T19:16:17.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.276+0000 7f6905287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:17.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.276+0000 7f6905287800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.276+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e78b40 con 0x5573d0e740a0 2024-09-13T19:16:17.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.277+0000 7f690357c640 1 -- 172.21.15.102:0/1532992081 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f68fc03a030 con 0x5573d0e740a0 2024-09-13T19:16:17.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.277+0000 7f6905287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:17.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.277+0000 7f6905287800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.277+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e78b80 con 0x5573d0e740a0 2024-09-13T19:16:17.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.277+0000 7f690357c640 1 -- 172.21.15.102:0/1532992081 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f68fc03a030 con 0x5573d0e740a0 2024-09-13T19:16:17.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.277+0000 7f6905287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:17.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.277+0000 7f6905287800 20 started sync module instance, tier type = 2024-09-13T19:16:17.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.277+0000 7f6905287800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:17.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.277+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e7a5f0 con 0x7f68fc024bb0 2024-09-13T19:16:17.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.278+0000 7f6902d7b640 1 -- 172.21.15.102:0/1532992081 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(44 notify.0 [create] v34'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68f4058030 con 0x7f68fc024bb0 2024-09-13T19:16:17.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.278+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93955914443232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e7a250 con 0x7f68fc024bb0 2024-09-13T19:16:17.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.278+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e7bd40 con 0x5573d0e6f830 2024-09-13T19:16:17.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.279+0000 7f6902d7b640 1 -- 172.21.15.102:0/1532992081 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93955914443232] v34'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68f4058030 con 0x7f68fc024bb0 2024-09-13T19:16:17.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.279+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v34'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68f8029040 con 0x5573d0e6f830 2024-09-13T19:16:17.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.279+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93955914446992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e7c160 con 0x5573d0e6f830 2024-09-13T19:16:17.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.279+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e7cb60 con 0x5573d0e740a0 2024-09-13T19:16:17.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.280+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93955914446992] v34'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68f8029040 con 0x5573d0e6f830 2024-09-13T19:16:17.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.280+0000 7f690357c640 1 -- 172.21.15.102:0/1532992081 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v34'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68fc03a030 con 0x5573d0e740a0 2024-09-13T19:16:17.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.280+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93955914450544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e7c160 con 0x5573d0e740a0 2024-09-13T19:16:17.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.280+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e7d5d0 con 0x7f68fc024bb0 2024-09-13T19:16:17.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.281+0000 7f690357c640 1 -- 172.21.15.102:0/1532992081 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93955914450544] v34'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68fc03a030 con 0x5573d0e740a0 2024-09-13T19:16:17.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.281+0000 7f6902d7b640 1 -- 172.21.15.102:0/1532992081 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(50 notify.3 [create] v34'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68f4058030 con 0x7f68fc024bb0 2024-09-13T19:16:17.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.281+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93955914453184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e7c160 con 0x7f68fc024bb0 2024-09-13T19:16:17.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.281+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e7e070 con 0x5573d0e6f830 2024-09-13T19:16:17.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.282+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v34'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68f8029040 con 0x5573d0e6f830 2024-09-13T19:16:17.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.282+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93955914455904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e7e030 con 0x5573d0e6f830 2024-09-13T19:16:17.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.282+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e7f010 con 0x7f68f409f040 2024-09-13T19:16:17.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.282+0000 7f6902d7b640 1 -- 172.21.15.102:0/1532992081 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93955914453184] v34'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68f4058030 con 0x7f68fc024bb0 2024-09-13T19:16:17.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.283+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(54 notify.5 [create] v34'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68f8029040 con 0x7f68f409f040 2024-09-13T19:16:17.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.283+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93955914459904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e7f010 con 0x7f68f409f040 2024-09-13T19:16:17.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.283+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e7fa50 con 0x7f68f409f040 2024-09-13T19:16:17.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.283+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93955914455904] v34'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68f8029040 con 0x5573d0e6f830 2024-09-13T19:16:17.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.284+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93955914459904] v34'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68f8029040 con 0x7f68f409f040 2024-09-13T19:16:17.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.284+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(56 notify.6 [create] v34'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68f8029040 con 0x7f68f409f040 2024-09-13T19:16:17.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.284+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93955914448048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e7f5a0 con 0x7f68f409f040 2024-09-13T19:16:17.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.284+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e7f5a0 con 0x7f68f409f040 2024-09-13T19:16:17.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.285+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(58 notify.7 [create] v34'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68f8029040 con 0x7f68f409f040 2024-09-13T19:16:17.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.285+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93955914464048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e80400 con 0x7f68f409f040 2024-09-13T19:16:17.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.285+0000 7f6905287800 20 add_watcher() i=0 2024-09-13T19:16:17.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.285+0000 7f6905287800 20 add_watcher() i=1 2024-09-13T19:16:17.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.285+0000 7f6905287800 20 add_watcher() i=2 2024-09-13T19:16:17.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.285+0000 7f6905287800 20 add_watcher() i=3 2024-09-13T19:16:17.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.285+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93955914448048] v34'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68f8029040 con 0x7f68f409f040 2024-09-13T19:16:17.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.285+0000 7f6905287800 20 add_watcher() i=4 2024-09-13T19:16:17.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.285+0000 7f6905287800 20 add_watcher() i=5 2024-09-13T19:16:17.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.285+0000 7f6905287800 20 add_watcher() i=6 2024-09-13T19:16:17.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.286+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93955914464048] v34'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68f8029040 con 0x7f68f409f040 2024-09-13T19:16:17.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.286+0000 7f6905287800 20 add_watcher() i=7 2024-09-13T19:16:17.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.286+0000 7f6905287800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:17.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.286+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e83430 con 0x5573d0e6f830 2024-09-13T19:16:17.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.287+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f68f8029040 con 0x5573d0e6f830 2024-09-13T19:16:17.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.287+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93955914465104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e80820 con 0x5573d0e6f830 2024-09-13T19:16:17.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.288+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93955914465104] v34'88 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f68f8029040 con 0x5573d0e6f830 2024-09-13T19:16:17.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.288+0000 7f67b97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:17.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.288+0000 7f6905287800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:17.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.288+0000 7f6905287800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:17.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.288+0000 7f6905287800 5 note: GC not initialized 2024-09-13T19:16:17.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.288+0000 7f6733fff640 20 reqs_thread_entry: start 2024-09-13T19:16:17.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.288+0000 7f6905287800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:17.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.288+0000 7f6905287800 20 Filter name: none 2024-09-13T19:16:17.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.288+0000 7f6731ffb640 20 reqs_thread_entry: start 2024-09-13T19:16:17.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.289+0000 7f6905287800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.289+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5573d0eb62e0 con 0x5573d0e6f830 2024-09-13T19:16:17.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.289+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f68f8029040 con 0x5573d0e6f830 2024-09-13T19:16:17.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.289+0000 7f6905287800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:16:17.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.289+0000 7f6905287800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.289+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5573d0eb6cd0 con 0x5573d0e6f830 2024-09-13T19:16:17.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.289+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f68f8029040 con 0x5573d0e6f830 2024-09-13T19:16:17.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.289+0000 7f6905287800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:16:17.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.289+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5573d0eb7ce0 con 0x7f68fc024bb0 2024-09-13T19:16:17.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.290+0000 7f6902d7b640 1 -- 172.21.15.102:0/1532992081 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f68f4058030 con 0x7f68fc024bb0 2024-09-13T19:16:17.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.290+0000 7f67b97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:17.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.290+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93955914465104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5573d0eb40d0 con 0x5573d0e6f830 2024-09-13T19:16:17.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.291+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 93955914465104] v34'89 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f68f8029040 con 0x5573d0e6f830 2024-09-13T19:16:17.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.291+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93955914443232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5573d0eb40d0 con 0x7f68fc024bb0 2024-09-13T19:16:17.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.292+0000 7f6902d7b640 1 -- 172.21.15.102:0/1532992081 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 93955914443232] v34'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68f4058030 con 0x7f68fc024bb0 2024-09-13T19:16:17.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.292+0000 7f6905287800 20 remove_watcher() i=0 2024-09-13T19:16:17.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.292+0000 7f6905287800 2 removed watcher, disabling cache 2024-09-13T19:16:17.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.292+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93955914446992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e9ef00 con 0x5573d0e6f830 2024-09-13T19:16:17.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.293+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 93955914446992] v34'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68f8029040 con 0x5573d0e6f830 2024-09-13T19:16:17.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.293+0000 7f6905287800 20 remove_watcher() i=1 2024-09-13T19:16:17.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.293+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93955914450544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5573d0eb40d0 con 0x5573d0e740a0 2024-09-13T19:16:17.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.295+0000 7f690357c640 1 -- 172.21.15.102:0/1532992081 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 93955914450544] v34'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68fc03a030 con 0x5573d0e740a0 2024-09-13T19:16:17.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.295+0000 7f6905287800 20 remove_watcher() i=2 2024-09-13T19:16:17.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.295+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93955914453184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e9ef00 con 0x7f68fc024bb0 2024-09-13T19:16:17.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.295+0000 7f6902d7b640 1 -- 172.21.15.102:0/1532992081 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 93955914453184] v34'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68f4058030 con 0x7f68fc024bb0 2024-09-13T19:16:17.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.295+0000 7f6905287800 20 remove_watcher() i=3 2024-09-13T19:16:17.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.295+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93955914455904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5573d0eb40d0 con 0x5573d0e6f830 2024-09-13T19:16:17.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.296+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 93955914455904] v34'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68f8029040 con 0x5573d0e6f830 2024-09-13T19:16:17.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.296+0000 7f6905287800 20 remove_watcher() i=4 2024-09-13T19:16:17.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.296+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93955914459904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e9ef00 con 0x7f68f409f040 2024-09-13T19:16:17.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.298+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 93955914459904] v34'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68f8029040 con 0x7f68f409f040 2024-09-13T19:16:17.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.298+0000 7f6905287800 20 remove_watcher() i=5 2024-09-13T19:16:17.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.298+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93955914448048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5573d0eb40d0 con 0x7f68f409f040 2024-09-13T19:16:17.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.298+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 93955914448048] v34'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68f8029040 con 0x7f68f409f040 2024-09-13T19:16:17.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.299+0000 7f6905287800 20 remove_watcher() i=6 2024-09-13T19:16:17.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.299+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93955914464048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5573d0e7bd40 con 0x7f68f409f040 2024-09-13T19:16:17.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.300+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 93955914464048] v34'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68f8029040 con 0x7f68f409f040 2024-09-13T19:16:17.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.300+0000 7f6905287800 20 remove_watcher() i=7 2024-09-13T19:16:17.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.300+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f68f409f040 msgr2=0x7f68f4065410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.300+0000 7f6905287800 1 --2- 172.21.15.102:0/1532992081 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f68f409f040 0x7f68f4065410 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.300+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5573d0e6f830 msgr2=0x5573d0e71cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.300+0000 7f6905287800 1 --2- 172.21.15.102:0/1532992081 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5573d0e6f830 0x5573d0e71cf0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.300+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f68fc024bb0 msgr2=0x7f68fc040960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.300+0000 7f6905287800 1 --2- 172.21.15.102:0/1532992081 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f68fc024bb0 0x7f68fc040960 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.300+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5573d0e740a0 msgr2=0x5573d0e76490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.300+0000 7f6905287800 1 --2- 172.21.15.102:0/1532992081 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5573d0e740a0 0x5573d0e76490 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.300+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f67cc036aa0 msgr2=0x7f67cc038f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.300+0000 7f6905287800 1 --2- 172.21.15.102:0/1532992081 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f67cc036aa0 0x7f67cc038f60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f68f400a1a0 tx=0x7f68f408b000 comp rx=0 tx=0).stop 2024-09-13T19:16:17.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.300+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0e5c920 msgr2=0x5573d0e63de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.300+0000 7f6905287800 1 --2- 172.21.15.102:0/1532992081 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0e5c920 0x5573d0e63de0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f68fc04bc10 tx=0x7f68fc04ccd0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.300+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 reap_dead start 2024-09-13T19:16:17.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.300+0000 7f690257a640 1 -- 172.21.15.102:0/1532992081 reap_dead start 2024-09-13T19:16:17.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.300+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 shutdown_connections 2024-09-13T19:16:17.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.300+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 >> 172.21.15.102:0/1532992081 conn(0x5573d0e58c80 msgr2=0x5573d0e56d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:17.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.300+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 shutdown_connections 2024-09-13T19:16:17.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.300+0000 7f6905287800 1 -- 172.21.15.102:0/1532992081 wait complete. 2024-09-13T19:16:17.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.300+0000 7f6905287800 1 -- 172.21.15.102:0/617051841 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f67dc036b90 msgr2=0x7f67dc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.300+0000 7f6905287800 1 --2- 172.21.15.102:0/617051841 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f67dc036b90 0x7f67dc039050 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x5573d0e395b0 tx=0x7f68f4065ee0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.300+0000 7f6905287800 1 -- 172.21.15.102:0/617051841 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0e4fc80 msgr2=0x5573d0e500a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.300+0000 7f6905287800 1 --2- 172.21.15.102:0/617051841 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0e4fc80 0x5573d0e500a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x5573d0e36100 tx=0x7f68fc0167b0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.300+0000 7f6905287800 1 -- 172.21.15.102:0/617051841 shutdown_connections 2024-09-13T19:16:17.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.300+0000 7f6905287800 1 --2- 172.21.15.102:0/617051841 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f67dc036b90 0x7f67dc039050 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.300+0000 7f6905287800 1 --2- 172.21.15.102:0/617051841 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0e4fc80 0x5573d0e500a0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.300+0000 7f6905287800 1 -- 172.21.15.102:0/617051841 >> 172.21.15.102:0/617051841 conn(0x5573d0e44c10 msgr2=0x5573d0e47790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:17.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.300+0000 7f6905287800 1 -- 172.21.15.102:0/617051841 shutdown_connections 2024-09-13T19:16:17.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.300+0000 7f6905287800 1 -- 172.21.15.102:0/617051841 wait complete. 2024-09-13T19:16:17.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.301+0000 7f6905287800 1 -- 172.21.15.102:0/615179596 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5573d0d3fe00 msgr2=0x5573d0e3c0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.301+0000 7f6905287800 1 --2- 172.21.15.102:0/615179596 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5573d0d3fe00 0x5573d0e3c0c0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.301+0000 7f6905287800 1 -- 172.21.15.102:0/615179596 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5573d0e3e910 msgr2=0x5573d0e40d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.301+0000 7f6905287800 1 --2- 172.21.15.102:0/615179596 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5573d0e3e910 0x5573d0e40d00 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.301+0000 7f6905287800 1 -- 172.21.15.102:0/615179596 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f67e8036b90 msgr2=0x7f67e8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.301+0000 7f6905287800 1 --2- 172.21.15.102:0/615179596 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f67e8036b90 0x7f67e8039050 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f68f8000f60 tx=0x7f68f80012b0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.301+0000 7f6905287800 1 -- 172.21.15.102:0/615179596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0d3f4c0 msgr2=0x5573d0e35050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.301+0000 7f6905287800 1 --2- 172.21.15.102:0/615179596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0d3f4c0 0x5573d0e35050 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f68f400a1d0 tx=0x7f68f4002fb0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.301+0000 7f6905287800 1 -- 172.21.15.102:0/615179596 shutdown_connections 2024-09-13T19:16:17.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.301+0000 7f6905287800 1 --2- 172.21.15.102:0/615179596 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5573d0e3e910 0x5573d0e40d00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.301+0000 7f6905287800 1 --2- 172.21.15.102:0/615179596 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5573d0d3fe00 0x5573d0e3c0c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.301+0000 7f6905287800 1 --2- 172.21.15.102:0/615179596 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f67e8036b90 0x7f67e8039050 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.301+0000 7f6905287800 1 --2- 172.21.15.102:0/615179596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573d0d3f4c0 0x5573d0e35050 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.301+0000 7f6905287800 1 -- 172.21.15.102:0/615179596 >> 172.21.15.102:0/615179596 conn(0x5573d0d3adf0 msgr2=0x5573d0e278e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:17.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.301+0000 7f6905287800 1 -- 172.21.15.102:0/615179596 shutdown_connections 2024-09-13T19:16:17.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.301+0000 7f6905287800 1 -- 172.21.15.102:0/615179596 wait complete. 2024-09-13T19:16:17.322 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-13T19:16:17.323 DEBUG:tasks.util.rgw: json result: [] 2024-09-13T19:16:17.323 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-13T19:16:17.323 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-13T19:16:17.323 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-13T19:16:17.367 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:17.368 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:17.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.365+0000 7f2ee172e800 1 Processor -- start 2024-09-13T19:16:17.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.365+0000 7f2ee172e800 1 -- start start 2024-09-13T19:16:17.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.365+0000 7f2ee172e800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x559702bad900 0x559702bafcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.365+0000 7f2ee172e800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559702a69b30 con 0x559702ba94c0 2024-09-13T19:16:17.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.365+0000 7f2ee172e800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x559702a4b360 con 0x559702bad900 2024-09-13T19:16:17.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.366+0000 7f2ed4b6d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x559702bad900 0x559702bafcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.366+0000 7f2ed4b6d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x559702bad900 0x559702bafcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54898/0 (socket says 172.21.15.102:54898) 2024-09-13T19:16:17.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.366+0000 7f2edd36e640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x559702ba94c0 0x559702ba98c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:49936/0 (socket says 172.21.15.102:49936) 2024-09-13T19:16:17.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.366+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/3116957854 learned_addr learned my addr 172.21.15.102:0/3116957854 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:17.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.366+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/3116957854 >> v1:172.21.15.53:6789/0 conn(0x559702ba94c0 legacy=0x559702ba98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.366+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/3116957854 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559702a71e00 con 0x559702bad900 2024-09-13T19:16:17.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.368+0000 7f2ed4b6d640 1 --2- 172.21.15.102:0/3116957854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559702bad900 0x559702bafcf0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2ec800a6b0 tx=0x7f2ec8047e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=218e11e26638770b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.368+0000 7f2edcb6d640 1 -- 172.21.15.102:0/3116957854 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ec800a200 con 0x559702bad900 2024-09-13T19:16:17.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.368+0000 7f2edcb6d640 1 -- 172.21.15.102:0/3116957854 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ec800a3a0 con 0x559702bad900 2024-09-13T19:16:17.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.368+0000 7f2edcb6d640 1 -- 172.21.15.102:0/3116957854 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ec8008700 con 0x559702bad900 2024-09-13T19:16:17.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.368+0000 7f2ee172e800 1 -- 172.21.15.102:0/3116957854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559702bad900 msgr2=0x559702bafcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.368+0000 7f2ee172e800 1 --2- 172.21.15.102:0/3116957854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559702bad900 0x559702bafcf0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2ec800a6b0 tx=0x7f2ec8047e30 comp rx=0 tx=0).stop 2024-09-13T19:16:17.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.368+0000 7f2ee172e800 1 -- 172.21.15.102:0/3116957854 shutdown_connections 2024-09-13T19:16:17.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.368+0000 7f2ee172e800 1 --2- 172.21.15.102:0/3116957854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559702bad900 0x559702bafcf0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.368+0000 7f2ee172e800 1 -- 172.21.15.102:0/3116957854 >> 172.21.15.102:0/3116957854 conn(0x559702ba4df0 msgr2=0x559702ba7210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:17.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.368+0000 7f2ee172e800 1 -- 172.21.15.102:0/3116957854 shutdown_connections 2024-09-13T19:16:17.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.368+0000 7f2ee172e800 1 -- 172.21.15.102:0/3116957854 wait complete. 2024-09-13T19:16:17.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.382+0000 7f2ee172e800 1 Processor -- start 2024-09-13T19:16:17.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.382+0000 7f2ee172e800 1 -- start start 2024-09-13T19:16:17.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.382+0000 7f2ee172e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559702ba94c0 0x559702c975e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.382+0000 7f2ee172e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559702af6330 con 0x559702ba94c0 2024-09-13T19:16:17.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.383+0000 7f2edd36e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559702ba94c0 0x559702c975e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.383+0000 7f2edd36e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559702ba94c0 0x559702c975e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54902/0 (socket says 172.21.15.102:54902) 2024-09-13T19:16:17.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.383+0000 7f2edd36e640 1 -- 172.21.15.102:0/2589713897 learned_addr learned my addr 172.21.15.102:0/2589713897 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:17.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.383+0000 7f2edd36e640 1 -- 172.21.15.102:0/2589713897 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559702a43bc0 con 0x559702ba94c0 2024-09-13T19:16:17.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.383+0000 7f2edd36e640 1 --2- 172.21.15.102:0/2589713897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559702ba94c0 0x559702c975e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2ed000b230 tx=0x7f2ed000b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39df831e1ab582b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.383+0000 7f2dcb606640 1 -- 172.21.15.102:0/2589713897 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ed000e5c0 con 0x559702ba94c0 2024-09-13T19:16:17.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.383+0000 7f2dcb606640 1 -- 172.21.15.102:0/2589713897 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ed0006070 con 0x559702ba94c0 2024-09-13T19:16:17.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.383+0000 7f2dcb606640 1 -- 172.21.15.102:0/2589713897 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ed000e890 con 0x559702ba94c0 2024-09-13T19:16:17.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.384+0000 7f2ee172e800 1 -- 172.21.15.102:0/2589713897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559702ba94c0 msgr2=0x559702c975e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.384+0000 7f2ee172e800 1 --2- 172.21.15.102:0/2589713897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559702ba94c0 0x559702c975e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2ed000b230 tx=0x7f2ed000b6f0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.384+0000 7f2ee172e800 1 -- 172.21.15.102:0/2589713897 shutdown_connections 2024-09-13T19:16:17.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.384+0000 7f2ee172e800 1 --2- 172.21.15.102:0/2589713897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559702ba94c0 0x559702c975e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.384+0000 7f2ee172e800 1 -- 172.21.15.102:0/2589713897 >> 172.21.15.102:0/2589713897 conn(0x559702ba4df0 msgr2=0x559702c92fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:17.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.384+0000 7f2ee172e800 1 -- 172.21.15.102:0/2589713897 shutdown_connections 2024-09-13T19:16:17.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.384+0000 7f2ee172e800 1 -- 172.21.15.102:0/2589713897 wait complete. 2024-09-13T19:16:17.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.384+0000 7f2ee172e800 1 Processor -- start 2024-09-13T19:16:17.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.384+0000 7f2ee172e800 1 -- start start 2024-09-13T19:16:17.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.385+0000 7f2ee172e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559702ba94c0 0x559702c9eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.385+0000 7f2ee172e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559702bb04d0 con 0x559702ba94c0 2024-09-13T19:16:17.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.385+0000 7f2edd36e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559702ba94c0 0x559702c9eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.385+0000 7f2edd36e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559702ba94c0 0x559702c9eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54910/0 (socket says 172.21.15.102:54910) 2024-09-13T19:16:17.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.385+0000 7f2edd36e640 1 -- 172.21.15.102:0/2676629721 learned_addr learned my addr 172.21.15.102:0/2676629721 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:17.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.385+0000 7f2edd36e640 1 -- 172.21.15.102:0/2676629721 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559702a57fe0 con 0x559702ba94c0 2024-09-13T19:16:17.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.385+0000 7f2edd36e640 1 --2- 172.21.15.102:0/2676629721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559702ba94c0 0x559702c9eff0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0000fd0 tx=0x7f2ed0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.385+0000 7f2dc9e03640 1 -- 172.21.15.102:0/2676629721 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ed000f8d0 con 0x559702ba94c0 2024-09-13T19:16:17.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.385+0000 7f2dc9e03640 1 -- 172.21.15.102:0/2676629721 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ed000fa90 con 0x559702ba94c0 2024-09-13T19:16:17.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.385+0000 7f2ee172e800 1 -- 172.21.15.102:0/2676629721 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559702c9f530 con 0x559702ba94c0 2024-09-13T19:16:17.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.385+0000 7f2dc9e03640 1 -- 172.21.15.102:0/2676629721 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ed000fdb0 con 0x559702ba94c0 2024-09-13T19:16:17.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.385+0000 7f2ee172e800 1 -- 172.21.15.102:0/2676629721 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559702c9fa50 con 0x559702ba94c0 2024-09-13T19:16:17.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.386+0000 7f2dc9e03640 1 -- 172.21.15.102:0/2676629721 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2ed0017070 con 0x559702ba94c0 2024-09-13T19:16:17.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.386+0000 7f2dc9e03640 1 --2- 172.21.15.102:0/2676629721 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2dc4036b40 0x7f2dc4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.386+0000 7f2dc9e03640 1 -- 172.21.15.102:0/2676629721 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f2ed0015020 con 0x559702ba94c0 2024-09-13T19:16:17.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.386+0000 7f2ed4b6d640 1 --2- 172.21.15.102:0/2676629721 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2dc4036b40 0x7f2dc4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.386+0000 7f2ee172e800 1 --2- 172.21.15.102:0/2676629721 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x559702bad900 0x559702ca6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.387+0000 7f2ee172e800 1 -- 172.21.15.102:0/2676629721 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559702ca65e0 con 0x559702bad900 2024-09-13T19:16:17.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.387+0000 7f2eddb6f640 1 --2- 172.21.15.102:0/2676629721 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x559702bad900 0x559702ca6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.387+0000 7f2ed4b6d640 1 --2- 172.21.15.102:0/2676629721 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2dc4036b40 0x7f2dc4039000 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2ec8058000 tx=0x7f2ec8053000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.387+0000 7f2eddb6f640 1 --2- 172.21.15.102:0/2676629721 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x559702bad900 0x559702ca6060 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.387+0000 7f2eddb6f640 1 -- 172.21.15.102:0/2676629721 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2ed800a4a0 con 0x559702bad900 2024-09-13T19:16:17.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.387+0000 7f2ee172e800 1 -- 172.21.15.102:0/2676629721 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559702ca3630 con 0x559702bad900 2024-09-13T19:16:17.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.387+0000 7f2eddb6f640 1 -- 172.21.15.102:0/2676629721 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2ed800a4a0 con 0x559702bad900 2024-09-13T19:16:17.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.388+0000 7f2ee172e800 1 --2- 172.21.15.102:0/2676629721 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x559702ca8910 0x559702caad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.388+0000 7f2ee172e800 1 -- 172.21.15.102:0/2676629721 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559702cab3f0 con 0x559702ca8910 2024-09-13T19:16:17.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.388+0000 7f2edd36e640 1 --2- 172.21.15.102:0/2676629721 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x559702ca8910 0x559702caad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.388+0000 7f2edd36e640 1 --2- 172.21.15.102:0/2676629721 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x559702ca8910 0x559702caad00 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.388+0000 7f2edd36e640 1 -- 172.21.15.102:0/2676629721 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2ed002e070 con 0x559702ca8910 2024-09-13T19:16:17.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.388+0000 7f2ee172e800 1 -- 172.21.15.102:0/2676629721 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559702ca77b0 con 0x559702bad900 2024-09-13T19:16:17.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.388+0000 7f2eddb6f640 1 -- 172.21.15.102:0/2676629721 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2ed800a4a0 con 0x559702bad900 2024-09-13T19:16:17.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.388+0000 7f2ee172e800 1 -- 172.21.15.102:0/2676629721 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559702ca7c90 con 0x559702ca8910 2024-09-13T19:16:17.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.389+0000 7f2edd36e640 1 -- 172.21.15.102:0/2676629721 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2ed002e070 con 0x559702ca8910 2024-09-13T19:16:17.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.389+0000 7f2ee172e800 1 Processor -- start 2024-09-13T19:16:17.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.389+0000 7f2ee172e800 1 -- start start 2024-09-13T19:16:17.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.389+0000 7f2ee172e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559702cb9d90 0x559702cba1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.389+0000 7f2ee172e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559702a45580 con 0x559702cb9d90 2024-09-13T19:16:17.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.389+0000 7f2eddb6f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559702cb9d90 0x559702cba1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.389+0000 7f2eddb6f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559702cb9d90 0x559702cba1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54922/0 (socket says 172.21.15.102:54922) 2024-09-13T19:16:17.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.389+0000 7f2eddb6f640 1 -- 172.21.15.102:0/3661036333 learned_addr learned my addr 172.21.15.102:0/3661036333 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:17.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.390+0000 7f2eddb6f640 1 -- 172.21.15.102:0/3661036333 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559702cba6f0 con 0x559702cb9d90 2024-09-13T19:16:17.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.390+0000 7f2eddb6f640 1 --2- 172.21.15.102:0/3661036333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559702cb9d90 0x559702cba1b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x559702ca03f0 tx=0x7f2ed80163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.390+0000 7f2dc2ffd640 1 -- 172.21.15.102:0/3661036333 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ed8013450 con 0x559702cb9d90 2024-09-13T19:16:17.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.390+0000 7f2dc2ffd640 1 -- 172.21.15.102:0/3661036333 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ed80135f0 con 0x559702cb9d90 2024-09-13T19:16:17.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.390+0000 7f2dc2ffd640 1 -- 172.21.15.102:0/3661036333 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ed8013910 con 0x559702cb9d90 2024-09-13T19:16:17.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.390+0000 7f2ee172e800 1 -- 172.21.15.102:0/3661036333 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559702cba980 con 0x559702cb9d90 2024-09-13T19:16:17.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.390+0000 7f2ee172e800 1 -- 172.21.15.102:0/3661036333 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559702cbd660 con 0x559702cb9d90 2024-09-13T19:16:17.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.391+0000 7f2dc2ffd640 1 -- 172.21.15.102:0/3661036333 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2ed8011040 con 0x559702cb9d90 2024-09-13T19:16:17.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.391+0000 7f2dc2ffd640 1 --2- 172.21.15.102:0/3661036333 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2db4036b90 0x7f2db4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.391+0000 7f2dc2ffd640 1 -- 172.21.15.102:0/3661036333 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f2ed800e040 con 0x559702cb9d90 2024-09-13T19:16:17.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.391+0000 7f2edd36e640 1 --2- 172.21.15.102:0/3661036333 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2db4036b90 0x7f2db4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.391+0000 7f2ee172e800 1 Processor -- start 2024-09-13T19:16:17.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.392+0000 7f2ee172e800 1 -- start start 2024-09-13T19:16:17.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.392+0000 7f2edd36e640 1 --2- 172.21.15.102:0/3661036333 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2db4036b90 0x7f2db4039050 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x559702ca6ec0 tx=0x7f2ed004b690 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.392+0000 7f2ee172e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559702ccaef0 0x559702ccb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.392+0000 7f2ee172e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559702c97d90 con 0x559702ccaef0 2024-09-13T19:16:17.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.392+0000 7f2eddb6f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559702ccaef0 0x559702ccb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.392+0000 7f2eddb6f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559702ccaef0 0x559702ccb2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54930/0 (socket says 172.21.15.102:54930) 2024-09-13T19:16:17.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.392+0000 7f2eddb6f640 1 -- 172.21.15.102:0/4121762831 learned_addr learned my addr 172.21.15.102:0/4121762831 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:17.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.392+0000 7f2eddb6f640 1 -- 172.21.15.102:0/4121762831 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559702ccb8c0 con 0x559702ccaef0 2024-09-13T19:16:17.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.392+0000 7f2eddb6f640 1 --2- 172.21.15.102:0/4121762831 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559702ccaef0 0x559702ccb2f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2ed804ce00 tx=0x7f2ed804d0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dea84551f8207495 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.392+0000 7f2dc0ff9640 1 -- 172.21.15.102:0/4121762831 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ed8046250 con 0x559702ccaef0 2024-09-13T19:16:17.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.392+0000 7f2dc0ff9640 1 -- 172.21.15.102:0/4121762831 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ed802a440 con 0x559702ccaef0 2024-09-13T19:16:17.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.392+0000 7f2dc0ff9640 1 -- 172.21.15.102:0/4121762831 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ed801f390 con 0x559702ccaef0 2024-09-13T19:16:17.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.393+0000 7f2ee172e800 1 -- 172.21.15.102:0/4121762831 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559702ccaef0 msgr2=0x559702ccb2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.393+0000 7f2ee172e800 1 --2- 172.21.15.102:0/4121762831 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559702ccaef0 0x559702ccb2f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2ed804ce00 tx=0x7f2ed804d0b0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.393+0000 7f2ee172e800 1 -- 172.21.15.102:0/4121762831 shutdown_connections 2024-09-13T19:16:17.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.393+0000 7f2ee172e800 1 --2- 172.21.15.102:0/4121762831 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559702ccaef0 0x559702ccb2f0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.393+0000 7f2ee172e800 1 -- 172.21.15.102:0/4121762831 >> 172.21.15.102:0/4121762831 conn(0x559702cc2e40 msgr2=0x559702cc0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:17.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.393+0000 7f2ee172e800 1 -- 172.21.15.102:0/4121762831 shutdown_connections 2024-09-13T19:16:17.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.393+0000 7f2ee172e800 1 -- 172.21.15.102:0/4121762831 wait complete. 2024-09-13T19:16:17.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.393+0000 7f2ee172e800 1 Processor -- start 2024-09-13T19:16:17.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.393+0000 7f2ee172e800 1 -- start start 2024-09-13T19:16:17.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.393+0000 7f2ee172e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559702ccaef0 0x559702cd2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.393+0000 7f2ee172e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559702ccbf30 con 0x559702ccaef0 2024-09-13T19:16:17.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.394+0000 7f2eddb6f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559702ccaef0 0x559702cd2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.394+0000 7f2eddb6f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559702ccaef0 0x559702cd2390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54934/0 (socket says 172.21.15.102:54934) 2024-09-13T19:16:17.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.394+0000 7f2eddb6f640 1 -- 172.21.15.102:0/1802988916 learned_addr learned my addr 172.21.15.102:0/1802988916 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:17.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.394+0000 7f2eddb6f640 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559702cd28d0 con 0x559702ccaef0 2024-09-13T19:16:17.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.394+0000 7f2eddb6f640 1 --2- 172.21.15.102:0/1802988916 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559702ccaef0 0x559702cd2390 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2ed804cd60 tx=0x7f2ed804cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.394+0000 7f2db2ffd640 1 -- 172.21.15.102:0/1802988916 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ed8039070 con 0x559702ccaef0 2024-09-13T19:16:17.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.394+0000 7f2db2ffd640 1 -- 172.21.15.102:0/1802988916 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ed804e290 con 0x559702ccaef0 2024-09-13T19:16:17.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.394+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559702cd2b60 con 0x559702ccaef0 2024-09-13T19:16:17.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.394+0000 7f2db2ffd640 1 -- 172.21.15.102:0/1802988916 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ed804e5b0 con 0x559702ccaef0 2024-09-13T19:16:17.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.394+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559702cd5810 con 0x559702ccaef0 2024-09-13T19:16:17.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.395+0000 7f2db2ffd640 1 -- 172.21.15.102:0/1802988916 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2ed803c070 con 0x559702ccaef0 2024-09-13T19:16:17.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.395+0000 7f2db2ffd640 1 --2- 172.21.15.102:0/1802988916 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2da8036b90 0x7f2da8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.395+0000 7f2db2ffd640 1 -- 172.21.15.102:0/1802988916 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f2ed803fc90 con 0x559702ccaef0 2024-09-13T19:16:17.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.395+0000 7f2edd36e640 1 --2- 172.21.15.102:0/1802988916 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2da8036b90 0x7f2da8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.396+0000 7f2ee172e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.396+0000 7f2ee172e800 1 --2- 172.21.15.102:0/1802988916 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x559702cdddd0 0x559702ce0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.396+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559702ce09e0 con 0x559702cdddd0 2024-09-13T19:16:17.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.396+0000 7f2edd36e640 1 --2- 172.21.15.102:0/1802988916 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2da8036b90 0x7f2da8039050 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2ed001dfd0 tx=0x7f2ed0038000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.396+0000 7f2ed4b6d640 1 --2- 172.21.15.102:0/1802988916 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x559702cdddd0 0x559702ce0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.396+0000 7f2ed4b6d640 1 --2- 172.21.15.102:0/1802988916 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x559702cdddd0 0x559702ce0290 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.396+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2ec804f760 con 0x559702cdddd0 2024-09-13T19:16:17.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.396+0000 7f2ee172e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:17.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.396+0000 7f2ee172e800 20 realm 2024-09-13T19:16:17.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.396+0000 7f2ee172e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.396+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559702ce0e10 con 0x559702cdddd0 2024-09-13T19:16:17.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.397+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2ec804f760 con 0x559702cdddd0 2024-09-13T19:16:17.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.397+0000 7f2ee172e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:17.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.397+0000 7f2ee172e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:17.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.397+0000 7f2ee172e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.397+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559702ce16e0 con 0x559702cdddd0 2024-09-13T19:16:17.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.397+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2ec804f760 con 0x559702cdddd0 2024-09-13T19:16:17.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.397+0000 7f2ee172e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:17.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.397+0000 7f2ee172e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.397+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559702ce1a80 con 0x559702cdddd0 2024-09-13T19:16:17.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.397+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2ec804f760 con 0x559702cdddd0 2024-09-13T19:16:17.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.397+0000 7f2ee172e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:17.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.397+0000 7f2ee172e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.397+0000 7f2ee172e800 1 --2- 172.21.15.102:0/1802988916 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x559702ce27e0 0x559702ce4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.397+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559702ce5110 con 0x559702ce27e0 2024-09-13T19:16:17.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.397+0000 7f2eddb6f640 1 --2- 172.21.15.102:0/1802988916 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x559702ce27e0 0x559702ce4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.397+0000 7f2eddb6f640 1 --2- 172.21.15.102:0/1802988916 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x559702ce27e0 0x559702ce4bd0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.398+0000 7f2eddb6f640 1 -- 172.21.15.102:0/1802988916 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2ed803b030 con 0x559702ce27e0 2024-09-13T19:16:17.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.398+0000 7f2ee172e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:17.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.398+0000 7f2ee172e800 20 searching for the correct realm 2024-09-13T19:16:17.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.398+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559702ce6ab0 con 0x559702ce27e0 2024-09-13T19:16:17.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.398+0000 7f2eddb6f640 1 -- 172.21.15.102:0/1802988916 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ed803b030 con 0x559702ce27e0 2024-09-13T19:16:17.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.398+0000 7f2eddb6f640 1 --2- 172.21.15.102:0/1802988916 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f2ed803e070 0x7f2ed804b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.398+0000 7f2eddb6f640 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559702ce6ab0 con 0x7f2ed803e070 2024-09-13T19:16:17.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.398+0000 7f2edd36e640 1 --2- 172.21.15.102:0/1802988916 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f2ed803e070 0x7f2ed804b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.398+0000 7f2edd36e640 1 --2- 172.21.15.102:0/1802988916 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f2ed803e070 0x7f2ed804b5d0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.399+0000 7f2edd36e640 1 -- 172.21.15.102:0/1802988916 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ed002e070 con 0x7f2ed803e070 2024-09-13T19:16:17.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.399+0000 7f2edd36e640 1 --2- 172.21.15.102:0/1802988916 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f2ed003e040 0x7f2ed003f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.399+0000 7f2edd36e640 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559702ce6ab0 con 0x7f2ed003e040 2024-09-13T19:16:17.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.399+0000 7f2ed4b6d640 1 --2- 172.21.15.102:0/1802988916 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f2ed003e040 0x7f2ed003f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.399+0000 7f2ed4b6d640 1 --2- 172.21.15.102:0/1802988916 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f2ed003e040 0x7f2ed003f430 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.400+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ec804f760 con 0x7f2ed003e040 2024-09-13T19:16:17.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.400+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559702ce6ab0 con 0x559702cdddd0 2024-09-13T19:16:17.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.400+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ec804f760 con 0x559702cdddd0 2024-09-13T19:16:17.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.400+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559702ce6ab0 con 0x559702cdddd0 2024-09-13T19:16:17.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.400+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ec804f760 con 0x559702cdddd0 2024-09-13T19:16:17.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.400+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559702ce6ab0 con 0x7f2ed003e040 2024-09-13T19:16:17.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.401+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ec804f760 con 0x7f2ed003e040 2024-09-13T19:16:17.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.401+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559702ce6ab0 con 0x7f2ed003e040 2024-09-13T19:16:17.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.401+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ec804f760 con 0x7f2ed003e040 2024-09-13T19:16:17.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.401+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559702ce6ab0 con 0x7f2ed803e070 2024-09-13T19:16:17.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.401+0000 7f2edd36e640 1 -- 172.21.15.102:0/1802988916 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ed002e070 con 0x7f2ed803e070 2024-09-13T19:16:17.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.401+0000 7f2edd36e640 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559702ce6ab0 con 0x559702ce27e0 2024-09-13T19:16:17.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.401+0000 7f2eddb6f640 1 -- 172.21.15.102:0/1802988916 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ed803b030 con 0x559702ce27e0 2024-09-13T19:16:17.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.401+0000 7f2eddb6f640 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559702ce6ab0 con 0x559702cdddd0 2024-09-13T19:16:17.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.402+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ec804f760 con 0x559702cdddd0 2024-09-13T19:16:17.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.402+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559702ce6ab0 con 0x7f2ed003e040 2024-09-13T19:16:17.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.402+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ec804f760 con 0x7f2ed003e040 2024-09-13T19:16:17.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.402+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559702ce6ab0 con 0x559702cdddd0 2024-09-13T19:16:17.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.402+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ec804f760 con 0x559702cdddd0 2024-09-13T19:16:17.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.402+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559702ce6ab0 con 0x7f2ed803e070 2024-09-13T19:16:17.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.402+0000 7f2edd36e640 1 -- 172.21.15.102:0/1802988916 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2ed002e070 con 0x7f2ed803e070 2024-09-13T19:16:17.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.402+0000 7f2edd36e640 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559702ce6ab0 con 0x559702ce27e0 2024-09-13T19:16:17.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.403+0000 7f2eddb6f640 1 -- 172.21.15.102:0/1802988916 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ed803b030 con 0x559702ce27e0 2024-09-13T19:16:17.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.403+0000 7f2eddb6f640 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559702ce6ab0 con 0x559702ce27e0 2024-09-13T19:16:17.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.403+0000 7f2eddb6f640 1 -- 172.21.15.102:0/1802988916 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2ed803b030 con 0x559702ce27e0 2024-09-13T19:16:17.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.403+0000 7f2eddb6f640 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559702ce6ab0 con 0x7f2ed003e040 2024-09-13T19:16:17.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.403+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ec804f760 con 0x7f2ed003e040 2024-09-13T19:16:17.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.403+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559702ce6ab0 con 0x559702ce27e0 2024-09-13T19:16:17.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.403+0000 7f2eddb6f640 1 -- 172.21.15.102:0/1802988916 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2ed803b030 con 0x559702ce27e0 2024-09-13T19:16:17.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.403+0000 7f2eddb6f640 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559702ce6ab0 con 0x559702ce27e0 2024-09-13T19:16:17.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.403+0000 7f2eddb6f640 1 -- 172.21.15.102:0/1802988916 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ed803b030 con 0x559702ce27e0 2024-09-13T19:16:17.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.403+0000 7f2eddb6f640 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559702ce6ab0 con 0x559702cdddd0 2024-09-13T19:16:17.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.404+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ec804f760 con 0x559702cdddd0 2024-09-13T19:16:17.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.404+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559702ce6ab0 con 0x559702cdddd0 2024-09-13T19:16:17.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.404+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2ec804f760 con 0x559702cdddd0 2024-09-13T19:16:17.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.404+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559702ce6ab0 con 0x7f2ed003e040 2024-09-13T19:16:17.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.404+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ec804f760 con 0x7f2ed003e040 2024-09-13T19:16:17.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.404+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559702ce6ab0 con 0x559702ce27e0 2024-09-13T19:16:17.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.404+0000 7f2eddb6f640 1 -- 172.21.15.102:0/1802988916 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ed803b030 con 0x559702ce27e0 2024-09-13T19:16:17.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.404+0000 7f2eddb6f640 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559702ce6ab0 con 0x7f2ed803e070 2024-09-13T19:16:17.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.405+0000 7f2edd36e640 1 -- 172.21.15.102:0/1802988916 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ed002e070 con 0x7f2ed803e070 2024-09-13T19:16:17.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.405+0000 7f2edd36e640 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559702ce6ab0 con 0x559702cdddd0 2024-09-13T19:16:17.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.405+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ec804f760 con 0x559702cdddd0 2024-09-13T19:16:17.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.405+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559702ce6ab0 con 0x7f2ed003e040 2024-09-13T19:16:17.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.405+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ec804f760 con 0x7f2ed003e040 2024-09-13T19:16:17.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.405+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559702ce6ab0 con 0x559702ce27e0 2024-09-13T19:16:17.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.405+0000 7f2eddb6f640 1 -- 172.21.15.102:0/1802988916 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ed803b030 con 0x559702ce27e0 2024-09-13T19:16:17.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.405+0000 7f2eddb6f640 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559702ce6ab0 con 0x7f2ed003e040 2024-09-13T19:16:17.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.406+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ec804f760 con 0x7f2ed003e040 2024-09-13T19:16:17.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.406+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559702ce6ab0 con 0x7f2ed803e070 2024-09-13T19:16:17.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.406+0000 7f2edd36e640 1 -- 172.21.15.102:0/1802988916 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ed002e070 con 0x7f2ed803e070 2024-09-13T19:16:17.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.406+0000 7f2edd36e640 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559702ce6ab0 con 0x559702ce27e0 2024-09-13T19:16:17.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.406+0000 7f2eddb6f640 1 -- 172.21.15.102:0/1802988916 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ed803b030 con 0x559702ce27e0 2024-09-13T19:16:17.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.406+0000 7f2eddb6f640 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559702ce6ab0 con 0x7f2ed003e040 2024-09-13T19:16:17.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.406+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ec804f760 con 0x7f2ed003e040 2024-09-13T19:16:17.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.406+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559702ce6ab0 con 0x559702cdddd0 2024-09-13T19:16:17.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.407+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2ec804f760 con 0x559702cdddd0 2024-09-13T19:16:17.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.407+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559702ce6ab0 con 0x7f2ed803e070 2024-09-13T19:16:17.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.407+0000 7f2edd36e640 1 -- 172.21.15.102:0/1802988916 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ed0065040 con 0x7f2ed803e070 2024-09-13T19:16:17.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.407+0000 7f2ee172e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:17.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.407+0000 7f2ee172e800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:17.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.407+0000 7f2ee172e800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:17.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.407+0000 7f2ee172e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:17.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.407+0000 7f2ee172e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:17.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.407+0000 7f2ee172e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:17.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.407+0000 7f2ee172e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.407+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559702ce5be0 con 0x559702cdddd0 2024-09-13T19:16:17.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.407+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2ec804f760 con 0x559702cdddd0 2024-09-13T19:16:17.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.407+0000 7f2ee172e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:17.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.407+0000 7f2ee172e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.407+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559702ce6480 con 0x559702cdddd0 2024-09-13T19:16:17.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.407+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2ec804f760 con 0x559702cdddd0 2024-09-13T19:16:17.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.407+0000 7f2ee172e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:17.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.407+0000 7f2ee172e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.407+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559702ce5820 con 0x559702ce27e0 2024-09-13T19:16:17.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.408+0000 7f2eddb6f640 1 -- 172.21.15.102:0/1802988916 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2ed803b030 con 0x559702ce27e0 2024-09-13T19:16:17.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.408+0000 7f2ee172e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:17.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.408+0000 7f2ee172e800 20 zone default found 2024-09-13T19:16:17.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.408+0000 7f2ee172e800 4 Realm: () 2024-09-13T19:16:17.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.408+0000 7f2ee172e800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:17.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.408+0000 7f2ee172e800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:17.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.408+0000 7f2ee172e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:17.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.408+0000 7f2ee172e800 20 zonegroup default 2024-09-13T19:16:17.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.408+0000 7f2ee172e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.408+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559702ce7430 con 0x7f2ed003e040 2024-09-13T19:16:17.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.408+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2ec804f760 con 0x7f2ed003e040 2024-09-13T19:16:17.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.408+0000 7f2ee172e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:17.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.408+0000 7f2ee172e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.408+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559702ce7090 con 0x559702ce27e0 2024-09-13T19:16:17.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.408+0000 7f2eddb6f640 1 -- 172.21.15.102:0/1802988916 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2ed803b030 con 0x559702ce27e0 2024-09-13T19:16:17.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.408+0000 7f2ee172e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:17.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.408+0000 7f2ee172e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.408+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559702ce97e0 con 0x559702ce27e0 2024-09-13T19:16:17.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.409+0000 7f2eddb6f640 1 -- 172.21.15.102:0/1802988916 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2ed803b030 con 0x559702ce27e0 2024-09-13T19:16:17.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.409+0000 7f2ee172e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:17.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.409+0000 7f2ee172e800 20 started sync module instance, tier type = 2024-09-13T19:16:17.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.409+0000 7f2ee172e800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:17.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.409+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559702ce8aa0 con 0x7f2ed803e070 2024-09-13T19:16:17.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.410+0000 7f2edd36e640 1 -- 172.21.15.102:0/1802988916 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(44 notify.0 [create] v34'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ed0065040 con 0x7f2ed803e070 2024-09-13T19:16:17.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.410+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94107075511792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559702ce9c40 con 0x7f2ed803e070 2024-09-13T19:16:17.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.410+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559702cea490 con 0x559702cdddd0 2024-09-13T19:16:17.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.411+0000 7f2edd36e640 1 -- 172.21.15.102:0/1802988916 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94107075511792] v34'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ed0065040 con 0x7f2ed803e070 2024-09-13T19:16:17.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.411+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v34'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ec804f760 con 0x559702cdddd0 2024-09-13T19:16:17.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.411+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94107075518432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559702cea8b0 con 0x559702cdddd0 2024-09-13T19:16:17.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.411+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559702ceb160 con 0x559702ce27e0 2024-09-13T19:16:17.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.412+0000 7f2eddb6f640 1 -- 172.21.15.102:0/1802988916 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v34'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ed803b030 con 0x559702ce27e0 2024-09-13T19:16:17.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.412+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94107075520688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559702cead10 con 0x559702ce27e0 2024-09-13T19:16:17.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.412+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559702cec100 con 0x7f2ed803e070 2024-09-13T19:16:17.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.412+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94107075518432] v34'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ec804f760 con 0x559702cdddd0 2024-09-13T19:16:17.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.413+0000 7f2eddb6f640 1 -- 172.21.15.102:0/1802988916 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94107075520688] v34'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ed803b030 con 0x559702ce27e0 2024-09-13T19:16:17.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.413+0000 7f2edd36e640 1 -- 172.21.15.102:0/1802988916 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(50 notify.3 [create] v34'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ed0065040 con 0x7f2ed803e070 2024-09-13T19:16:17.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.413+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94107075523920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559702cea400 con 0x7f2ed803e070 2024-09-13T19:16:17.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.413+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559702ceca30 con 0x559702cdddd0 2024-09-13T19:16:17.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.414+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v34'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ec804f760 con 0x559702cdddd0 2024-09-13T19:16:17.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.414+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94107075527968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559702ced2d0 con 0x559702cdddd0 2024-09-13T19:16:17.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.414+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559702ceddb0 con 0x7f2ed003e040 2024-09-13T19:16:17.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.414+0000 7f2edd36e640 1 -- 172.21.15.102:0/1802988916 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94107075523920] v34'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ed0065040 con 0x7f2ed803e070 2024-09-13T19:16:17.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.415+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94107075527968] v34'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ec804f760 con 0x559702cdddd0 2024-09-13T19:16:17.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.415+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(54 notify.5 [create] v34'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ec804f760 con 0x7f2ed003e040 2024-09-13T19:16:17.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.415+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94107075532992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559702cecd50 con 0x7f2ed003e040 2024-09-13T19:16:17.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.415+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559702cee650 con 0x7f2ed003e040 2024-09-13T19:16:17.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.416+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94107075532992] v34'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ec804f760 con 0x7f2ed003e040 2024-09-13T19:16:17.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.417+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(56 notify.6 [create] v34'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ec804f760 con 0x7f2ed003e040 2024-09-13T19:16:17.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.417+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94107075525616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559702cecd50 con 0x7f2ed003e040 2024-09-13T19:16:17.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.417+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559702ceec50 con 0x7f2ed003e040 2024-09-13T19:16:17.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.418+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(58 notify.7 [create] v34'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ec804f760 con 0x7f2ed003e040 2024-09-13T19:16:17.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.418+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94107075536672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559702ceec10 con 0x7f2ed003e040 2024-09-13T19:16:17.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.418+0000 7f2ee172e800 20 add_watcher() i=0 2024-09-13T19:16:17.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.418+0000 7f2ee172e800 20 add_watcher() i=1 2024-09-13T19:16:17.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.418+0000 7f2ee172e800 20 add_watcher() i=2 2024-09-13T19:16:17.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.418+0000 7f2ee172e800 20 add_watcher() i=3 2024-09-13T19:16:17.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.418+0000 7f2ee172e800 20 add_watcher() i=4 2024-09-13T19:16:17.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.418+0000 7f2ee172e800 20 add_watcher() i=5 2024-09-13T19:16:17.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.418+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94107075525616] v34'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ec804f760 con 0x7f2ed003e040 2024-09-13T19:16:17.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.418+0000 7f2ee172e800 20 add_watcher() i=6 2024-09-13T19:16:17.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.419+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94107075536672] v34'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ec804f760 con 0x7f2ed003e040 2024-09-13T19:16:17.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.419+0000 7f2ee172e800 20 add_watcher() i=7 2024-09-13T19:16:17.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.419+0000 7f2ee172e800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:17.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.419+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559702cee050 con 0x559702cdddd0 2024-09-13T19:16:17.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.419+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2ec804f760 con 0x559702cdddd0 2024-09-13T19:16:17.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.419+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94107075538928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559702cee050 con 0x559702cdddd0 2024-09-13T19:16:17.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.420+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94107075538928] v34'90 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2ec804f760 con 0x559702cdddd0 2024-09-13T19:16:17.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.420+0000 7f2d937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:17.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.420+0000 7f2ee172e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:17.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.420+0000 7f2ee172e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:17.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.420+0000 7f2ee172e800 5 note: GC not initialized 2024-09-13T19:16:17.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.420+0000 7f2d927e4640 20 reqs_thread_entry: start 2024-09-13T19:16:17.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.420+0000 7f2ee172e800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:17.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.420+0000 7f2ee172e800 20 Filter name: none 2024-09-13T19:16:17.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.421+0000 7f2d03fff640 20 reqs_thread_entry: start 2024-09-13T19:16:17.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.421+0000 7f2ee172e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.421+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559702d24ff0 con 0x559702cdddd0 2024-09-13T19:16:17.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.421+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f2ec804f760 con 0x559702cdddd0 2024-09-13T19:16:17.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.421+0000 7f2ee172e800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:16:17.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.421+0000 7f2ee172e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.421+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559702d259e0 con 0x559702cdddd0 2024-09-13T19:16:17.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.421+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f2ec804f760 con 0x559702cdddd0 2024-09-13T19:16:17.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.421+0000 7f2ee172e800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:16:17.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.421+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559702d269f0 con 0x7f2ed803e070 2024-09-13T19:16:17.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.422+0000 7f2edd36e640 1 -- 172.21.15.102:0/1802988916 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f2ed0065040 con 0x7f2ed803e070 2024-09-13T19:16:17.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.422+0000 7f2d937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:17.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.422+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94107075538928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559702d22dc0 con 0x559702cdddd0 2024-09-13T19:16:17.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.423+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94107075538928] v34'91 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2ec804f760 con 0x559702cdddd0 2024-09-13T19:16:17.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.423+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94107075511792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559702d22dc0 con 0x7f2ed803e070 2024-09-13T19:16:17.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.424+0000 7f2edd36e640 1 -- 172.21.15.102:0/1802988916 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94107075511792] v34'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ed0065040 con 0x7f2ed803e070 2024-09-13T19:16:17.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.424+0000 7f2ee172e800 20 remove_watcher() i=0 2024-09-13T19:16:17.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.424+0000 7f2ee172e800 2 removed watcher, disabling cache 2024-09-13T19:16:17.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.424+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94107075518432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559702d22dc0 con 0x559702cdddd0 2024-09-13T19:16:17.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.425+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94107075518432] v34'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ec804f760 con 0x559702cdddd0 2024-09-13T19:16:17.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.425+0000 7f2ee172e800 20 remove_watcher() i=1 2024-09-13T19:16:17.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.425+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94107075520688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559702d22dc0 con 0x559702ce27e0 2024-09-13T19:16:17.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.426+0000 7f2eddb6f640 1 -- 172.21.15.102:0/1802988916 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94107075520688] v34'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ed803b030 con 0x559702ce27e0 2024-09-13T19:16:17.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.426+0000 7f2ee172e800 20 remove_watcher() i=2 2024-09-13T19:16:17.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.426+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94107075523920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559702d22dc0 con 0x7f2ed803e070 2024-09-13T19:16:17.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.427+0000 7f2edd36e640 1 -- 172.21.15.102:0/1802988916 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94107075523920] v34'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ed0065040 con 0x7f2ed803e070 2024-09-13T19:16:17.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.427+0000 7f2ee172e800 20 remove_watcher() i=3 2024-09-13T19:16:17.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.427+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94107075527968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559702d22dc0 con 0x559702cdddd0 2024-09-13T19:16:17.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.429+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94107075527968] v34'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ec804f760 con 0x559702cdddd0 2024-09-13T19:16:17.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.429+0000 7f2ee172e800 20 remove_watcher() i=4 2024-09-13T19:16:17.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.429+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94107075532992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559702d22dc0 con 0x7f2ed003e040 2024-09-13T19:16:17.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.430+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94107075532992] v34'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ec804f760 con 0x7f2ed003e040 2024-09-13T19:16:17.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.430+0000 7f2ee172e800 20 remove_watcher() i=5 2024-09-13T19:16:17.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.430+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94107075525616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559702d22dc0 con 0x7f2ed003e040 2024-09-13T19:16:17.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.431+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94107075525616] v34'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ec804f760 con 0x7f2ed003e040 2024-09-13T19:16:17.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.431+0000 7f2ee172e800 20 remove_watcher() i=6 2024-09-13T19:16:17.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.431+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94107075536672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559702d22dc0 con 0x7f2ed003e040 2024-09-13T19:16:17.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.432+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94107075536672] v34'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ec804f760 con 0x7f2ed003e040 2024-09-13T19:16:17.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.432+0000 7f2ee172e800 20 remove_watcher() i=7 2024-09-13T19:16:17.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.432+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f2ed003e040 msgr2=0x7f2ed003f430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.432+0000 7f2ee172e800 1 --2- 172.21.15.102:0/1802988916 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f2ed003e040 0x7f2ed003f430 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.432+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x559702cdddd0 msgr2=0x559702ce0290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.432+0000 7f2ee172e800 1 --2- 172.21.15.102:0/1802988916 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x559702cdddd0 0x559702ce0290 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.432+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f2ed803e070 msgr2=0x7f2ed804b5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.432+0000 7f2ee172e800 1 --2- 172.21.15.102:0/1802988916 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f2ed803e070 0x7f2ed804b5d0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.432+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x559702ce27e0 msgr2=0x559702ce4bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.432+0000 7f2ee172e800 1 --2- 172.21.15.102:0/1802988916 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x559702ce27e0 0x559702ce4bd0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.432+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2da8036b90 msgr2=0x7f2da8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.432+0000 7f2ee172e800 1 --2- 172.21.15.102:0/1802988916 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2da8036b90 0x7f2da8039050 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2ed001dfd0 tx=0x7f2ed0038000 comp rx=0 tx=0).stop 2024-09-13T19:16:17.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.432+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559702ccaef0 msgr2=0x559702cd2390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.432+0000 7f2ee172e800 1 --2- 172.21.15.102:0/1802988916 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559702ccaef0 0x559702cd2390 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2ed804cd60 tx=0x7f2ed804cd90 comp rx=0 tx=0).stop 2024-09-13T19:16:17.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.432+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 reap_dead start 2024-09-13T19:16:17.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.432+0000 7f2ed4b6d640 1 -- 172.21.15.102:0/1802988916 reap_dead start 2024-09-13T19:16:17.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.432+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 shutdown_connections 2024-09-13T19:16:17.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.432+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 >> 172.21.15.102:0/1802988916 conn(0x559702cc2e40 msgr2=0x559702cc0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:17.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.432+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 shutdown_connections 2024-09-13T19:16:17.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.432+0000 7f2ee172e800 1 -- 172.21.15.102:0/1802988916 wait complete. 2024-09-13T19:16:17.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.433+0000 7f2ee172e800 1 -- 172.21.15.102:0/3661036333 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2db4036b90 msgr2=0x7f2db4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.433+0000 7f2ee172e800 1 --2- 172.21.15.102:0/3661036333 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2db4036b90 0x7f2db4039050 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x559702ca6ec0 tx=0x7f2ed004b690 comp rx=0 tx=0).stop 2024-09-13T19:16:17.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.433+0000 7f2ee172e800 1 -- 172.21.15.102:0/3661036333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559702cb9d90 msgr2=0x559702cba1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.433+0000 7f2ee172e800 1 --2- 172.21.15.102:0/3661036333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559702cb9d90 0x559702cba1b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x559702ca03f0 tx=0x7f2ed80163e0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.433+0000 7f2ee172e800 1 -- 172.21.15.102:0/3661036333 shutdown_connections 2024-09-13T19:16:17.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.433+0000 7f2ee172e800 1 --2- 172.21.15.102:0/3661036333 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2db4036b90 0x7f2db4039050 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.433+0000 7f2ee172e800 1 --2- 172.21.15.102:0/3661036333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559702cb9d90 0x559702cba1b0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.433+0000 7f2ee172e800 1 -- 172.21.15.102:0/3661036333 >> 172.21.15.102:0/3661036333 conn(0x559702caed20 msgr2=0x559702cb18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:17.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.433+0000 7f2ee172e800 1 -- 172.21.15.102:0/3661036333 shutdown_connections 2024-09-13T19:16:17.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.433+0000 7f2ee172e800 1 -- 172.21.15.102:0/3661036333 wait complete. 2024-09-13T19:16:17.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.433+0000 7f2ee172e800 1 -- 172.21.15.102:0/2676629721 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x559702bad900 msgr2=0x559702ca6060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.433+0000 7f2ee172e800 1 --2- 172.21.15.102:0/2676629721 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x559702bad900 0x559702ca6060 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.433+0000 7f2ee172e800 1 -- 172.21.15.102:0/2676629721 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x559702ca8910 msgr2=0x559702caad00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.433+0000 7f2ee172e800 1 --2- 172.21.15.102:0/2676629721 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x559702ca8910 0x559702caad00 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.433+0000 7f2ee172e800 1 -- 172.21.15.102:0/2676629721 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2dc4036b40 msgr2=0x7f2dc4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.433+0000 7f2ee172e800 1 --2- 172.21.15.102:0/2676629721 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2dc4036b40 0x7f2dc4039000 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2ec8058000 tx=0x7f2ec8053000 comp rx=0 tx=0).stop 2024-09-13T19:16:17.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.433+0000 7f2ee172e800 1 -- 172.21.15.102:0/2676629721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559702ba94c0 msgr2=0x559702c9eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.433+0000 7f2ee172e800 1 --2- 172.21.15.102:0/2676629721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559702ba94c0 0x559702c9eff0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0000fd0 tx=0x7f2ed0000ed0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.433+0000 7f2ee172e800 1 -- 172.21.15.102:0/2676629721 shutdown_connections 2024-09-13T19:16:17.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.433+0000 7f2ee172e800 1 --2- 172.21.15.102:0/2676629721 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x559702ca8910 0x559702caad00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.433+0000 7f2ee172e800 1 --2- 172.21.15.102:0/2676629721 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x559702bad900 0x559702ca6060 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.433+0000 7f2ee172e800 1 --2- 172.21.15.102:0/2676629721 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2dc4036b40 0x7f2dc4039000 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.433+0000 7f2ee172e800 1 --2- 172.21.15.102:0/2676629721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559702ba94c0 0x559702c9eff0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.433+0000 7f2ee172e800 1 -- 172.21.15.102:0/2676629721 >> 172.21.15.102:0/2676629721 conn(0x559702ba4df0 msgr2=0x559702c918d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:17.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.433+0000 7f2ee172e800 1 -- 172.21.15.102:0/2676629721 shutdown_connections 2024-09-13T19:16:17.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.433+0000 7f2ee172e800 1 -- 172.21.15.102:0/2676629721 wait complete. 2024-09-13T19:16:17.456 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-13T19:16:17.456 DEBUG:tasks.util.rgw: json result: [] 2024-09-13T19:16:17.504 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:16:17.505 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-13T19:16:17.505 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-13T19:16:17.505 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-13T19:16:17.549 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:17.550 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:17.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.547+0000 7f939f726800 1 Processor -- start 2024-09-13T19:16:17.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.547+0000 7f939f726800 1 -- start start 2024-09-13T19:16:17.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.547+0000 7f939f726800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x563e90e01900 0x563e90e03cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.547+0000 7f939f726800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563e90cbdb30 con 0x563e90dfd4c0 2024-09-13T19:16:17.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.547+0000 7f939f726800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x563e90c9f360 con 0x563e90e01900 2024-09-13T19:16:17.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.548+0000 7f939abe2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x563e90e01900 0x563e90e03cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.548+0000 7f939abe2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x563e90e01900 0x563e90e03cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54948/0 (socket says 172.21.15.102:54948) 2024-09-13T19:16:17.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.548+0000 7f939abe2640 1 -- 172.21.15.102:0/822742448 learned_addr learned my addr 172.21.15.102:0/822742448 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:17.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.548+0000 7f939b3e3640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x563e90dfd4c0 0x563e90dfd8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:49948/0 (socket says 172.21.15.102:49948) 2024-09-13T19:16:17.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.548+0000 7f939abe2640 1 -- 172.21.15.102:0/822742448 >> v1:172.21.15.53:6789/0 conn(0x563e90dfd4c0 legacy=0x563e90dfd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.548+0000 7f939abe2640 1 -- 172.21.15.102:0/822742448 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e90cc5e00 con 0x563e90e01900 2024-09-13T19:16:17.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.550+0000 7f939abe2640 1 --2- 172.21.15.102:0/822742448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e90e01900 0x563e90e03cf0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f938400a520 tx=0x7f9384045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35b0a9556bb86d96 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.550+0000 7f939a3e1640 1 -- 172.21.15.102:0/822742448 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9384055070 con 0x563e90e01900 2024-09-13T19:16:17.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.550+0000 7f939a3e1640 1 -- 172.21.15.102:0/822742448 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93840515b0 con 0x563e90e01900 2024-09-13T19:16:17.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.550+0000 7f939a3e1640 1 -- 172.21.15.102:0/822742448 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93840518d0 con 0x563e90e01900 2024-09-13T19:16:17.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.550+0000 7f939f726800 1 -- 172.21.15.102:0/822742448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e90e01900 msgr2=0x563e90e03cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.550+0000 7f939f726800 1 --2- 172.21.15.102:0/822742448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e90e01900 0x563e90e03cf0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f938400a520 tx=0x7f9384045ba0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.550+0000 7f939f726800 1 -- 172.21.15.102:0/822742448 shutdown_connections 2024-09-13T19:16:17.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.550+0000 7f939f726800 1 --2- 172.21.15.102:0/822742448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e90e01900 0x563e90e03cf0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.550+0000 7f939f726800 1 -- 172.21.15.102:0/822742448 >> 172.21.15.102:0/822742448 conn(0x563e90df8df0 msgr2=0x563e90dfb210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:17.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.550+0000 7f939f726800 1 -- 172.21.15.102:0/822742448 shutdown_connections 2024-09-13T19:16:17.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.550+0000 7f939f726800 1 -- 172.21.15.102:0/822742448 wait complete. 2024-09-13T19:16:17.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.564+0000 7f939f726800 1 Processor -- start 2024-09-13T19:16:17.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.564+0000 7f939f726800 1 -- start start 2024-09-13T19:16:17.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.564+0000 7f939f726800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e90dfd4c0 0x563e90eec750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.564+0000 7f939f726800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563e90d4a330 con 0x563e90dfd4c0 2024-09-13T19:16:17.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.565+0000 7f939b3e3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e90dfd4c0 0x563e90eec750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.565+0000 7f939b3e3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e90dfd4c0 0x563e90eec750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54952/0 (socket says 172.21.15.102:54952) 2024-09-13T19:16:17.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.565+0000 7f939b3e3640 1 -- 172.21.15.102:0/3755873845 learned_addr learned my addr 172.21.15.102:0/3755873845 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:17.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.565+0000 7f939b3e3640 1 -- 172.21.15.102:0/3755873845 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e90c97bc0 con 0x563e90dfd4c0 2024-09-13T19:16:17.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.565+0000 7f939b3e3640 1 --2- 172.21.15.102:0/3755873845 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e90dfd4c0 0x563e90eec750 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f938c001650 tx=0x7f938c001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9071e5c209ae739 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.565+0000 7f928960a640 1 -- 172.21.15.102:0/3755873845 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f938c013420 con 0x563e90dfd4c0 2024-09-13T19:16:17.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.565+0000 7f928960a640 1 -- 172.21.15.102:0/3755873845 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f938c0135c0 con 0x563e90dfd4c0 2024-09-13T19:16:17.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.565+0000 7f928960a640 1 -- 172.21.15.102:0/3755873845 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f938c0138c0 con 0x563e90dfd4c0 2024-09-13T19:16:17.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.566+0000 7f939f726800 1 -- 172.21.15.102:0/3755873845 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e90dfd4c0 msgr2=0x563e90eec750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.566+0000 7f939f726800 1 --2- 172.21.15.102:0/3755873845 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e90dfd4c0 0x563e90eec750 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f938c001650 tx=0x7f938c001b10 comp rx=0 tx=0).stop 2024-09-13T19:16:17.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.566+0000 7f939f726800 1 -- 172.21.15.102:0/3755873845 shutdown_connections 2024-09-13T19:16:17.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.566+0000 7f939f726800 1 --2- 172.21.15.102:0/3755873845 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e90dfd4c0 0x563e90eec750 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.566+0000 7f939f726800 1 -- 172.21.15.102:0/3755873845 >> 172.21.15.102:0/3755873845 conn(0x563e90df8df0 msgr2=0x563e90ee8110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:17.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.566+0000 7f939f726800 1 -- 172.21.15.102:0/3755873845 shutdown_connections 2024-09-13T19:16:17.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.566+0000 7f939f726800 1 -- 172.21.15.102:0/3755873845 wait complete. 2024-09-13T19:16:17.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.566+0000 7f939f726800 1 Processor -- start 2024-09-13T19:16:17.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.566+0000 7f939f726800 1 -- start start 2024-09-13T19:16:17.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.567+0000 7f939f726800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e90dfd4c0 0x563e90d71dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.567+0000 7f939f726800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563e90e04530 con 0x563e90dfd4c0 2024-09-13T19:16:17.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.567+0000 7f939b3e3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e90dfd4c0 0x563e90d71dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.567+0000 7f939b3e3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e90dfd4c0 0x563e90d71dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54958/0 (socket says 172.21.15.102:54958) 2024-09-13T19:16:17.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.567+0000 7f939b3e3640 1 -- 172.21.15.102:0/726285225 learned_addr learned my addr 172.21.15.102:0/726285225 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:17.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.567+0000 7f939b3e3640 1 -- 172.21.15.102:0/726285225 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e90cabfe0 con 0x563e90dfd4c0 2024-09-13T19:16:17.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.567+0000 7f939b3e3640 1 --2- 172.21.15.102:0/726285225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e90dfd4c0 0x563e90d71dc0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f938c000f80 tx=0x7f938c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.567+0000 7f9287e07640 1 -- 172.21.15.102:0/726285225 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f938c022020 con 0x563e90dfd4c0 2024-09-13T19:16:17.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.567+0000 7f9287e07640 1 -- 172.21.15.102:0/726285225 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f938c006830 con 0x563e90dfd4c0 2024-09-13T19:16:17.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.567+0000 7f939f726800 1 -- 172.21.15.102:0/726285225 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563e90ef7e80 con 0x563e90dfd4c0 2024-09-13T19:16:17.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.567+0000 7f9287e07640 1 -- 172.21.15.102:0/726285225 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f938c004b60 con 0x563e90dfd4c0 2024-09-13T19:16:17.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.567+0000 7f939f726800 1 -- 172.21.15.102:0/726285225 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e90ef83a0 con 0x563e90dfd4c0 2024-09-13T19:16:17.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.568+0000 7f9287e07640 1 -- 172.21.15.102:0/726285225 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f938c025020 con 0x563e90dfd4c0 2024-09-13T19:16:17.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.568+0000 7f9287e07640 1 --2- 172.21.15.102:0/726285225 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9280036b90 0x7f9280039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.568+0000 7f9287e07640 1 -- 172.21.15.102:0/726285225 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f938c018030 con 0x563e90dfd4c0 2024-09-13T19:16:17.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.568+0000 7f939abe2640 1 --2- 172.21.15.102:0/726285225 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9280036b90 0x7f9280039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.568+0000 7f939f726800 1 --2- 172.21.15.102:0/726285225 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563e90e01900 0x563e90efc240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.568+0000 7f939f726800 1 -- 172.21.15.102:0/726285225 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e90efc860 con 0x563e90e01900 2024-09-13T19:16:17.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.569+0000 7f939bbe4640 1 --2- 172.21.15.102:0/726285225 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563e90e01900 0x563e90efc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.569+0000 7f939abe2640 1 --2- 172.21.15.102:0/726285225 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9280036b90 0x7f9280039050 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9384057000 tx=0x7f9384052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.569+0000 7f939bbe4640 1 --2- 172.21.15.102:0/726285225 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563e90e01900 0x563e90efc240 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.569+0000 7f939bbe4640 1 -- 172.21.15.102:0/726285225 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f93940083e0 con 0x563e90e01900 2024-09-13T19:16:17.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.569+0000 7f939f726800 1 -- 172.21.15.102:0/726285225 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e90ef9770 con 0x563e90e01900 2024-09-13T19:16:17.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.569+0000 7f939bbe4640 1 -- 172.21.15.102:0/726285225 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f93940083e0 con 0x563e90e01900 2024-09-13T19:16:17.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.569+0000 7f939f726800 1 --2- 172.21.15.102:0/726285225 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563e90efeb70 0x563e90f00f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.569+0000 7f939f726800 1 -- 172.21.15.102:0/726285225 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e90f01650 con 0x563e90efeb70 2024-09-13T19:16:17.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.570+0000 7f939b3e3640 1 --2- 172.21.15.102:0/726285225 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563e90efeb70 0x563e90f00f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.570+0000 7f939b3e3640 1 --2- 172.21.15.102:0/726285225 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563e90efeb70 0x563e90f00f60 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.570+0000 7f939b3e3640 1 -- 172.21.15.102:0/726285225 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f938c01b070 con 0x563e90efeb70 2024-09-13T19:16:17.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.570+0000 7f939f726800 1 -- 172.21.15.102:0/726285225 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e90efd9e0 con 0x563e90e01900 2024-09-13T19:16:17.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.570+0000 7f939bbe4640 1 -- 172.21.15.102:0/726285225 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f93940083e0 con 0x563e90e01900 2024-09-13T19:16:17.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.570+0000 7f939f726800 1 -- 172.21.15.102:0/726285225 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e90efde80 con 0x563e90efeb70 2024-09-13T19:16:17.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.571+0000 7f939b3e3640 1 -- 172.21.15.102:0/726285225 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f938c01b070 con 0x563e90efeb70 2024-09-13T19:16:17.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.571+0000 7f939f726800 1 Processor -- start 2024-09-13T19:16:17.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.571+0000 7f939f726800 1 -- start start 2024-09-13T19:16:17.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.571+0000 7f939f726800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e90f0ffd0 0x563e90f103f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.571+0000 7f939f726800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563e90c99580 con 0x563e90f0ffd0 2024-09-13T19:16:17.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.571+0000 7f939bbe4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e90f0ffd0 0x563e90f103f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.572+0000 7f939bbe4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e90f0ffd0 0x563e90f103f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54966/0 (socket says 172.21.15.102:54966) 2024-09-13T19:16:17.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.572+0000 7f939bbe4640 1 -- 172.21.15.102:0/3572533591 learned_addr learned my addr 172.21.15.102:0/3572533591 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:17.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.572+0000 7f939bbe4640 1 -- 172.21.15.102:0/3572533591 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e90f10930 con 0x563e90f0ffd0 2024-09-13T19:16:17.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.572+0000 7f939bbe4640 1 --2- 172.21.15.102:0/3572533591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e90f0ffd0 0x563e90f103f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x563e90d717b0 tx=0x7f939400beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.572+0000 7f9285602640 1 -- 172.21.15.102:0/3572533591 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f939401c020 con 0x563e90f0ffd0 2024-09-13T19:16:17.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.572+0000 7f9285602640 1 -- 172.21.15.102:0/3572533591 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9394007cf0 con 0x563e90f0ffd0 2024-09-13T19:16:17.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.572+0000 7f9285602640 1 -- 172.21.15.102:0/3572533591 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9394018440 con 0x563e90f0ffd0 2024-09-13T19:16:17.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.572+0000 7f939f726800 1 -- 172.21.15.102:0/3572533591 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563e90f10bc0 con 0x563e90f0ffd0 2024-09-13T19:16:17.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.572+0000 7f939f726800 1 -- 172.21.15.102:0/3572533591 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e90f138a0 con 0x563e90f0ffd0 2024-09-13T19:16:17.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.573+0000 7f9285602640 1 -- 172.21.15.102:0/3572533591 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f939401f020 con 0x563e90f0ffd0 2024-09-13T19:16:17.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.573+0000 7f9285602640 1 --2- 172.21.15.102:0/3572533591 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9274036c00 0x7f92740390c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.573+0000 7f9285602640 1 -- 172.21.15.102:0/3572533591 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f939404e290 con 0x563e90f0ffd0 2024-09-13T19:16:17.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.573+0000 7f939b3e3640 1 --2- 172.21.15.102:0/3572533591 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9274036c00 0x7f92740390c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.573+0000 7f939f726800 1 Processor -- start 2024-09-13T19:16:17.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.574+0000 7f939b3e3640 1 --2- 172.21.15.102:0/3572533591 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9274036c00 0x7f92740390c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x563e90efd120 tx=0x7f938c04aed0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.574+0000 7f939f726800 1 -- start start 2024-09-13T19:16:17.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.574+0000 7f939f726800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e90f1cc80 0x563e90f1d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.574+0000 7f939f726800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563e90eecf00 con 0x563e90f1cc80 2024-09-13T19:16:17.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.574+0000 7f939bbe4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e90f1cc80 0x563e90f1d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.574+0000 7f939bbe4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e90f1cc80 0x563e90f1d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54974/0 (socket says 172.21.15.102:54974) 2024-09-13T19:16:17.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.574+0000 7f939bbe4640 1 -- 172.21.15.102:0/2274134163 learned_addr learned my addr 172.21.15.102:0/2274134163 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:17.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.574+0000 7f939bbe4640 1 -- 172.21.15.102:0/2274134163 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e90f1d650 con 0x563e90f1cc80 2024-09-13T19:16:17.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.575+0000 7f939bbe4640 1 --2- 172.21.15.102:0/2274134163 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e90f1cc80 0x563e90f1d080 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f939404c5e0 tx=0x7f939404c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1495adc48b6e2e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.575+0000 7f927effd640 1 -- 172.21.15.102:0/2274134163 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9394045070 con 0x563e90f1cc80 2024-09-13T19:16:17.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.575+0000 7f927effd640 1 -- 172.21.15.102:0/2274134163 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f939404e070 con 0x563e90f1cc80 2024-09-13T19:16:17.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.575+0000 7f927effd640 1 -- 172.21.15.102:0/2274134163 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9394021570 con 0x563e90f1cc80 2024-09-13T19:16:17.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.575+0000 7f939f726800 1 -- 172.21.15.102:0/2274134163 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e90f1cc80 msgr2=0x563e90f1d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.575+0000 7f939f726800 1 --2- 172.21.15.102:0/2274134163 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e90f1cc80 0x563e90f1d080 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f939404c5e0 tx=0x7f939404c890 comp rx=0 tx=0).stop 2024-09-13T19:16:17.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.575+0000 7f939f726800 1 -- 172.21.15.102:0/2274134163 shutdown_connections 2024-09-13T19:16:17.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.575+0000 7f939f726800 1 --2- 172.21.15.102:0/2274134163 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e90f1cc80 0x563e90f1d080 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.575+0000 7f939f726800 1 -- 172.21.15.102:0/2274134163 >> 172.21.15.102:0/2274134163 conn(0x563e90f18fe0 msgr2=0x563e90f170e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:17.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.575+0000 7f939f726800 1 -- 172.21.15.102:0/2274134163 shutdown_connections 2024-09-13T19:16:17.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.575+0000 7f939f726800 1 -- 172.21.15.102:0/2274134163 wait complete. 2024-09-13T19:16:17.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.575+0000 7f939f726800 1 Processor -- start 2024-09-13T19:16:17.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.576+0000 7f939f726800 1 -- start start 2024-09-13T19:16:17.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.576+0000 7f939f726800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e90f1cc80 0x563e90f24130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.576+0000 7f939f726800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563e90f1dcc0 con 0x563e90f1cc80 2024-09-13T19:16:17.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.576+0000 7f939bbe4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e90f1cc80 0x563e90f24130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.576+0000 7f939bbe4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e90f1cc80 0x563e90f24130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:54982/0 (socket says 172.21.15.102:54982) 2024-09-13T19:16:17.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.576+0000 7f939bbe4640 1 -- 172.21.15.102:0/794295586 learned_addr learned my addr 172.21.15.102:0/794295586 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:17.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.576+0000 7f939bbe4640 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e90f24670 con 0x563e90f1cc80 2024-09-13T19:16:17.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.576+0000 7f939bbe4640 1 --2- 172.21.15.102:0/794295586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e90f1cc80 0x563e90f24130 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f939404c8d0 tx=0x7f939404c570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.576+0000 7f927d7fa640 1 -- 172.21.15.102:0/794295586 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9394045070 con 0x563e90f1cc80 2024-09-13T19:16:17.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.576+0000 7f927d7fa640 1 -- 172.21.15.102:0/794295586 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9394029c70 con 0x563e90f1cc80 2024-09-13T19:16:17.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.576+0000 7f927d7fa640 1 -- 172.21.15.102:0/794295586 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f939403f030 con 0x563e90f1cc80 2024-09-13T19:16:17.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.576+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563e90f24900 con 0x563e90f1cc80 2024-09-13T19:16:17.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.577+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e90f275b0 con 0x563e90f1cc80 2024-09-13T19:16:17.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.577+0000 7f927d7fa640 1 -- 172.21.15.102:0/794295586 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9394016040 con 0x563e90f1cc80 2024-09-13T19:16:17.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.577+0000 7f927d7fa640 1 --2- 172.21.15.102:0/794295586 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9264036b90 0x7f9264039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.577+0000 7f927d7fa640 1 -- 172.21.15.102:0/794295586 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f939404fd90 con 0x563e90f1cc80 2024-09-13T19:16:17.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.577+0000 7f939b3e3640 1 --2- 172.21.15.102:0/794295586 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9264036b90 0x7f9264039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.578+0000 7f939f726800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.578+0000 7f939f726800 1 --2- 172.21.15.102:0/794295586 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563e90f2fc20 0x563e90f320e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.578+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e90f32830 con 0x563e90f2fc20 2024-09-13T19:16:17.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.578+0000 7f939b3e3640 1 --2- 172.21.15.102:0/794295586 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9264036b90 0x7f9264039050 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f938c044560 tx=0x7f938c038000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.578+0000 7f939abe2640 1 --2- 172.21.15.102:0/794295586 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563e90f2fc20 0x563e90f320e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.578+0000 7f939abe2640 1 --2- 172.21.15.102:0/794295586 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563e90f2fc20 0x563e90f320e0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.579+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9384057030 con 0x563e90f2fc20 2024-09-13T19:16:17.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.579+0000 7f939f726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:17.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.579+0000 7f939f726800 20 realm 2024-09-13T19:16:17.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.579+0000 7f939f726800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.579+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e90f32c60 con 0x563e90f2fc20 2024-09-13T19:16:17.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.579+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9384057030 con 0x563e90f2fc20 2024-09-13T19:16:17.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.579+0000 7f939f726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:17.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.579+0000 7f939f726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:17.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.579+0000 7f939f726800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.579+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e90f33530 con 0x563e90f2fc20 2024-09-13T19:16:17.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.579+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9384057030 con 0x563e90f2fc20 2024-09-13T19:16:17.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.579+0000 7f939f726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:17.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.579+0000 7f939f726800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.579+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e90f338d0 con 0x563e90f2fc20 2024-09-13T19:16:17.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.579+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9384057030 con 0x563e90f2fc20 2024-09-13T19:16:17.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.579+0000 7f939f726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:17.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.579+0000 7f939f726800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.579+0000 7f939f726800 1 --2- 172.21.15.102:0/794295586 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563e90f34630 0x563e90f36a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.579+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e90f36f60 con 0x563e90f34630 2024-09-13T19:16:17.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.579+0000 7f939bbe4640 1 --2- 172.21.15.102:0/794295586 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563e90f34630 0x563e90f36a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.580+0000 7f939bbe4640 1 --2- 172.21.15.102:0/794295586 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563e90f34630 0x563e90f36a20 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.580+0000 7f939bbe4640 1 -- 172.21.15.102:0/794295586 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9394033020 con 0x563e90f34630 2024-09-13T19:16:17.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.580+0000 7f939f726800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:17.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.580+0000 7f939f726800 20 searching for the correct realm 2024-09-13T19:16:17.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.580+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e90f388d0 con 0x563e90f34630 2024-09-13T19:16:17.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.580+0000 7f939bbe4640 1 -- 172.21.15.102:0/794295586 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9394033020 con 0x563e90f34630 2024-09-13T19:16:17.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.580+0000 7f939bbe4640 1 --2- 172.21.15.102:0/794295586 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f9394036020 0x7f939402b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.580+0000 7f939bbe4640 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e90f388d0 con 0x7f9394036020 2024-09-13T19:16:17.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.580+0000 7f939b3e3640 1 --2- 172.21.15.102:0/794295586 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f9394036020 0x7f939402b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.581+0000 7f939b3e3640 1 --2- 172.21.15.102:0/794295586 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f9394036020 0x7f939402b450 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.581+0000 7f939b3e3640 1 -- 172.21.15.102:0/794295586 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f938c01b070 con 0x7f9394036020 2024-09-13T19:16:17.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.581+0000 7f939b3e3640 1 --2- 172.21.15.102:0/794295586 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f938c03b070 0x7f938c026830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.581+0000 7f939b3e3640 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e90f388d0 con 0x7f938c03b070 2024-09-13T19:16:17.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.581+0000 7f939abe2640 1 --2- 172.21.15.102:0/794295586 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f938c03b070 0x7f938c026830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.581+0000 7f939abe2640 1 --2- 172.21.15.102:0/794295586 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f938c03b070 0x7f938c026830 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.582+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9384057030 con 0x7f938c03b070 2024-09-13T19:16:17.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.582+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e90f388d0 con 0x563e90f2fc20 2024-09-13T19:16:17.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.582+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9384057030 con 0x563e90f2fc20 2024-09-13T19:16:17.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.582+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e90f388d0 con 0x563e90f2fc20 2024-09-13T19:16:17.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.582+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9384057030 con 0x563e90f2fc20 2024-09-13T19:16:17.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.582+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e90f388d0 con 0x7f938c03b070 2024-09-13T19:16:17.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.582+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9384057030 con 0x7f938c03b070 2024-09-13T19:16:17.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.582+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e90f388d0 con 0x7f938c03b070 2024-09-13T19:16:17.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.583+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9384057030 con 0x7f938c03b070 2024-09-13T19:16:17.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.583+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e90f388d0 con 0x7f9394036020 2024-09-13T19:16:17.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.583+0000 7f939b3e3640 1 -- 172.21.15.102:0/794295586 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f938c01b070 con 0x7f9394036020 2024-09-13T19:16:17.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.583+0000 7f939b3e3640 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e90f388d0 con 0x563e90f34630 2024-09-13T19:16:17.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.583+0000 7f939bbe4640 1 -- 172.21.15.102:0/794295586 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9394033020 con 0x563e90f34630 2024-09-13T19:16:17.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.583+0000 7f939bbe4640 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e90f388d0 con 0x563e90f2fc20 2024-09-13T19:16:17.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.583+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9384057030 con 0x563e90f2fc20 2024-09-13T19:16:17.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.583+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e90f388d0 con 0x7f938c03b070 2024-09-13T19:16:17.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.584+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9384057030 con 0x7f938c03b070 2024-09-13T19:16:17.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.584+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e90f388d0 con 0x563e90f2fc20 2024-09-13T19:16:17.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.584+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9384057030 con 0x563e90f2fc20 2024-09-13T19:16:17.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.584+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e90f388d0 con 0x7f9394036020 2024-09-13T19:16:17.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.584+0000 7f939b3e3640 1 -- 172.21.15.102:0/794295586 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f938c01b070 con 0x7f9394036020 2024-09-13T19:16:17.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.584+0000 7f939b3e3640 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e90f388d0 con 0x563e90f34630 2024-09-13T19:16:17.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.584+0000 7f939bbe4640 1 -- 172.21.15.102:0/794295586 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9394033020 con 0x563e90f34630 2024-09-13T19:16:17.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.584+0000 7f939bbe4640 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e90f388d0 con 0x563e90f34630 2024-09-13T19:16:17.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.584+0000 7f939bbe4640 1 -- 172.21.15.102:0/794295586 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9394033020 con 0x563e90f34630 2024-09-13T19:16:17.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.584+0000 7f939bbe4640 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e90f388d0 con 0x7f938c03b070 2024-09-13T19:16:17.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.585+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9384057030 con 0x7f938c03b070 2024-09-13T19:16:17.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.585+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e90f388d0 con 0x563e90f34630 2024-09-13T19:16:17.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.585+0000 7f939bbe4640 1 -- 172.21.15.102:0/794295586 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9394033020 con 0x563e90f34630 2024-09-13T19:16:17.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.585+0000 7f939bbe4640 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e90f388d0 con 0x563e90f34630 2024-09-13T19:16:17.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.585+0000 7f939bbe4640 1 -- 172.21.15.102:0/794295586 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9394033020 con 0x563e90f34630 2024-09-13T19:16:17.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.585+0000 7f939bbe4640 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e90f388d0 con 0x563e90f2fc20 2024-09-13T19:16:17.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.585+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9384057030 con 0x563e90f2fc20 2024-09-13T19:16:17.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.585+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e90f388d0 con 0x563e90f2fc20 2024-09-13T19:16:17.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.586+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9384057030 con 0x563e90f2fc20 2024-09-13T19:16:17.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.586+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e90f388d0 con 0x7f938c03b070 2024-09-13T19:16:17.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.586+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9384057030 con 0x7f938c03b070 2024-09-13T19:16:17.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.586+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e90f388d0 con 0x563e90f34630 2024-09-13T19:16:17.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.586+0000 7f939bbe4640 1 -- 172.21.15.102:0/794295586 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9394033020 con 0x563e90f34630 2024-09-13T19:16:17.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.586+0000 7f939bbe4640 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e90f388d0 con 0x7f9394036020 2024-09-13T19:16:17.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.586+0000 7f939b3e3640 1 -- 172.21.15.102:0/794295586 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f938c01b070 con 0x7f9394036020 2024-09-13T19:16:17.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.586+0000 7f939b3e3640 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e90f388d0 con 0x563e90f2fc20 2024-09-13T19:16:17.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.587+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9384057030 con 0x563e90f2fc20 2024-09-13T19:16:17.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.587+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e90f388d0 con 0x7f938c03b070 2024-09-13T19:16:17.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.587+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9384057030 con 0x7f938c03b070 2024-09-13T19:16:17.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.587+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e90f388d0 con 0x563e90f34630 2024-09-13T19:16:17.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.587+0000 7f939bbe4640 1 -- 172.21.15.102:0/794295586 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9394067040 con 0x563e90f34630 2024-09-13T19:16:17.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.587+0000 7f939bbe4640 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e90f388d0 con 0x7f938c03b070 2024-09-13T19:16:17.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.587+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9384057030 con 0x7f938c03b070 2024-09-13T19:16:17.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.587+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e90f388d0 con 0x7f9394036020 2024-09-13T19:16:17.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.588+0000 7f939b3e3640 1 -- 172.21.15.102:0/794295586 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f938c01b070 con 0x7f9394036020 2024-09-13T19:16:17.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.588+0000 7f939b3e3640 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e90f388d0 con 0x563e90f34630 2024-09-13T19:16:17.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.588+0000 7f939bbe4640 1 -- 172.21.15.102:0/794295586 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9394067040 con 0x563e90f34630 2024-09-13T19:16:17.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.588+0000 7f939bbe4640 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e90f388d0 con 0x7f938c03b070 2024-09-13T19:16:17.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.588+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9384057030 con 0x7f938c03b070 2024-09-13T19:16:17.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.588+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e90f388d0 con 0x563e90f2fc20 2024-09-13T19:16:17.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.588+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9384057030 con 0x563e90f2fc20 2024-09-13T19:16:17.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.588+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f938408a080 con 0x7f9394036020 2024-09-13T19:16:17.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.589+0000 7f939b3e3640 1 -- 172.21.15.102:0/794295586 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f938c01b070 con 0x7f9394036020 2024-09-13T19:16:17.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.589+0000 7f939f726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:17.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.589+0000 7f939f726800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:17.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.589+0000 7f939f726800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:17.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.589+0000 7f939f726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:17.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.589+0000 7f939f726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:17.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.589+0000 7f939f726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:17.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.589+0000 7f939f726800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.589+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e90f379a0 con 0x563e90f2fc20 2024-09-13T19:16:17.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.589+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9384057030 con 0x563e90f2fc20 2024-09-13T19:16:17.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.589+0000 7f939f726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:17.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.589+0000 7f939f726800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.589+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e90f38240 con 0x563e90f2fc20 2024-09-13T19:16:17.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.589+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9384057030 con 0x563e90f2fc20 2024-09-13T19:16:17.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.589+0000 7f939f726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:17.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.589+0000 7f939f726800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.589+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e90f375e0 con 0x563e90f34630 2024-09-13T19:16:17.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.589+0000 7f939bbe4640 1 -- 172.21.15.102:0/794295586 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9394067040 con 0x563e90f34630 2024-09-13T19:16:17.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.589+0000 7f939f726800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:17.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.589+0000 7f939f726800 20 zone default found 2024-09-13T19:16:17.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.589+0000 7f939f726800 4 Realm: () 2024-09-13T19:16:17.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.589+0000 7f939f726800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:17.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.589+0000 7f939f726800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:17.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.589+0000 7f939f726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:17.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.589+0000 7f939f726800 20 zonegroup default 2024-09-13T19:16:17.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.589+0000 7f939f726800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.589+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e90f39250 con 0x7f938c03b070 2024-09-13T19:16:17.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.590+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9384057030 con 0x7f938c03b070 2024-09-13T19:16:17.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.590+0000 7f939f726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:17.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.590+0000 7f939f726800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.590+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e90f3acf0 con 0x563e90f34630 2024-09-13T19:16:17.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.590+0000 7f939bbe4640 1 -- 172.21.15.102:0/794295586 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9394067040 con 0x563e90f34630 2024-09-13T19:16:17.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.590+0000 7f939f726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:17.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.590+0000 7f939f726800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.590+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e90f3b130 con 0x563e90f34630 2024-09-13T19:16:17.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.590+0000 7f939bbe4640 1 -- 172.21.15.102:0/794295586 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9394067040 con 0x563e90f34630 2024-09-13T19:16:17.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.590+0000 7f939f726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:17.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.590+0000 7f939f726800 20 started sync module instance, tier type = 2024-09-13T19:16:17.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.590+0000 7f939f726800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:17.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.590+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e90f3a070 con 0x7f9394036020 2024-09-13T19:16:17.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.591+0000 7f939b3e3640 1 -- 172.21.15.102:0/794295586 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(44 notify.0 [create] v34'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f938c01b070 con 0x7f9394036020 2024-09-13T19:16:17.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.591+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94826719845312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e90f3a940 con 0x7f9394036020 2024-09-13T19:16:17.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.591+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e90f3bc80 con 0x563e90f2fc20 2024-09-13T19:16:17.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.592+0000 7f939b3e3640 1 -- 172.21.15.102:0/794295586 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94826719845312] v34'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f938c01b070 con 0x7f9394036020 2024-09-13T19:16:17.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.592+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v34'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9384057030 con 0x563e90f2fc20 2024-09-13T19:16:17.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.593+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94826719847568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e90f3c0a0 con 0x563e90f2fc20 2024-09-13T19:16:17.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.593+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e90f3cad0 con 0x563e90f34630 2024-09-13T19:16:17.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.593+0000 7f939bbe4640 1 -- 172.21.15.102:0/794295586 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v34'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9394067040 con 0x563e90f34630 2024-09-13T19:16:17.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.594+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94826719856096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e90f3caa0 con 0x563e90f34630 2024-09-13T19:16:17.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.594+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e90f3dac0 con 0x7f9394036020 2024-09-13T19:16:17.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.594+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94826719847568] v34'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9384057030 con 0x563e90f2fc20 2024-09-13T19:16:17.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.595+0000 7f939bbe4640 1 -- 172.21.15.102:0/794295586 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94826719856096] v34'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9394067040 con 0x563e90f34630 2024-09-13T19:16:17.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.595+0000 7f939b3e3640 1 -- 172.21.15.102:0/794295586 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(50 notify.3 [create] v34'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f938c01b070 con 0x7f9394036020 2024-09-13T19:16:17.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.595+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94826719858416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e90f3b790 con 0x7f9394036020 2024-09-13T19:16:17.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.595+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e90f3e3a0 con 0x563e90f2fc20 2024-09-13T19:16:17.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.596+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v34'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9384057030 con 0x563e90f2fc20 2024-09-13T19:16:17.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.596+0000 7f939b3e3640 1 -- 172.21.15.102:0/794295586 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94826719858416] v34'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f938c01b070 con 0x7f9394036020 2024-09-13T19:16:17.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.596+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94826719862448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e90f3ec40 con 0x563e90f2fc20 2024-09-13T19:16:17.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.596+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e90f3d590 con 0x7f938c03b070 2024-09-13T19:16:17.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.597+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(54 notify.5 [create] v34'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9384057030 con 0x7f938c03b070 2024-09-13T19:16:17.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.597+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94826719867344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e90f3d590 con 0x7f938c03b070 2024-09-13T19:16:17.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.597+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e90f401e0 con 0x7f938c03b070 2024-09-13T19:16:17.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.597+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94826719862448] v34'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9384057030 con 0x563e90f2fc20 2024-09-13T19:16:17.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.597+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94826719867344] v34'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9384057030 con 0x7f938c03b070 2024-09-13T19:16:17.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.598+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(56 notify.6 [create] v34'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9384057030 con 0x7f938c03b070 2024-09-13T19:16:17.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.598+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94826719868688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e90f3fd30 con 0x7f938c03b070 2024-09-13T19:16:17.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.598+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e90f40580 con 0x7f938c03b070 2024-09-13T19:16:17.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.599+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94826719868688] v34'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9384057030 con 0x7f938c03b070 2024-09-13T19:16:17.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.599+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(58 notify.7 [create] v34'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9384057030 con 0x7f938c03b070 2024-09-13T19:16:17.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.599+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94826719870256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e90f40600 con 0x7f938c03b070 2024-09-13T19:16:17.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.599+0000 7f939f726800 20 add_watcher() i=0 2024-09-13T19:16:17.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.599+0000 7f939f726800 20 add_watcher() i=1 2024-09-13T19:16:17.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.599+0000 7f939f726800 20 add_watcher() i=2 2024-09-13T19:16:17.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.599+0000 7f939f726800 20 add_watcher() i=3 2024-09-13T19:16:17.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.599+0000 7f939f726800 20 add_watcher() i=4 2024-09-13T19:16:17.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.599+0000 7f939f726800 20 add_watcher() i=5 2024-09-13T19:16:17.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.599+0000 7f939f726800 20 add_watcher() i=6 2024-09-13T19:16:17.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.600+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94826719870256] v34'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9384057030 con 0x7f938c03b070 2024-09-13T19:16:17.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.600+0000 7f939f726800 20 add_watcher() i=7 2024-09-13T19:16:17.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.600+0000 7f939f726800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:17.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.600+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e90f43910 con 0x563e90f2fc20 2024-09-13T19:16:17.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.601+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9384057030 con 0x563e90f2fc20 2024-09-13T19:16:17.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.601+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94826719871680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e90f40b90 con 0x563e90f2fc20 2024-09-13T19:16:17.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.602+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94826719871680] v34'92 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9384057030 con 0x563e90f2fc20 2024-09-13T19:16:17.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.602+0000 7f9251fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:17.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.602+0000 7f939f726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:17.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.602+0000 7f939f726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:17.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.602+0000 7f939f726800 5 note: GC not initialized 2024-09-13T19:16:17.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.602+0000 7f9250fe1640 20 reqs_thread_entry: start 2024-09-13T19:16:17.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.602+0000 7f939f726800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:17.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.602+0000 7f939f726800 20 Filter name: none 2024-09-13T19:16:17.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.602+0000 7f91ca7fc640 20 reqs_thread_entry: start 2024-09-13T19:16:17.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.602+0000 7f939f726800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.602+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e90f768f0 con 0x563e90f2fc20 2024-09-13T19:16:17.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.603+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f9384057030 con 0x563e90f2fc20 2024-09-13T19:16:17.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.603+0000 7f939f726800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:16:17.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.603+0000 7f939f726800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.603+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e90f772e0 con 0x563e90f2fc20 2024-09-13T19:16:17.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.603+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f9384057030 con 0x563e90f2fc20 2024-09-13T19:16:17.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.603+0000 7f939f726800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:16:17.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.603+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e90f782f0 con 0x7f9394036020 2024-09-13T19:16:17.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.603+0000 7f939b3e3640 1 -- 172.21.15.102:0/794295586 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv3 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f938c01b070 con 0x7f9394036020 2024-09-13T19:16:17.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.604+0000 7f9251fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:17.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.604+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94826719871680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e90f746a0 con 0x563e90f2fc20 2024-09-13T19:16:17.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.605+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94826719871680] v34'93 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9384057030 con 0x563e90f2fc20 2024-09-13T19:16:17.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.605+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94826719845312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e90f746a0 con 0x7f9394036020 2024-09-13T19:16:17.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.606+0000 7f939b3e3640 1 -- 172.21.15.102:0/794295586 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94826719845312] v34'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f938c01b070 con 0x7f9394036020 2024-09-13T19:16:17.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.606+0000 7f939f726800 20 remove_watcher() i=0 2024-09-13T19:16:17.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.606+0000 7f939f726800 2 removed watcher, disabling cache 2024-09-13T19:16:17.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.606+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94826719847568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e90f746a0 con 0x563e90f2fc20 2024-09-13T19:16:17.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.608+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94826719847568] v34'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9384057030 con 0x563e90f2fc20 2024-09-13T19:16:17.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.608+0000 7f939f726800 20 remove_watcher() i=1 2024-09-13T19:16:17.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.608+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94826719856096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e90f746a0 con 0x563e90f34630 2024-09-13T19:16:17.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.608+0000 7f939bbe4640 1 -- 172.21.15.102:0/794295586 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94826719856096] v34'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9394067040 con 0x563e90f34630 2024-09-13T19:16:17.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.609+0000 7f939f726800 20 remove_watcher() i=2 2024-09-13T19:16:17.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.609+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94826719858416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e90f746a0 con 0x7f9394036020 2024-09-13T19:16:17.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.610+0000 7f939b3e3640 1 -- 172.21.15.102:0/794295586 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94826719858416] v34'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f938c01b070 con 0x7f9394036020 2024-09-13T19:16:17.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.610+0000 7f939f726800 20 remove_watcher() i=3 2024-09-13T19:16:17.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.610+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94826719862448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e90f746a0 con 0x563e90f2fc20 2024-09-13T19:16:17.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.611+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94826719862448] v34'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9384057030 con 0x563e90f2fc20 2024-09-13T19:16:17.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.611+0000 7f939f726800 20 remove_watcher() i=4 2024-09-13T19:16:17.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.611+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94826719867344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e90f746a0 con 0x7f938c03b070 2024-09-13T19:16:17.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.612+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94826719867344] v34'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9384057030 con 0x7f938c03b070 2024-09-13T19:16:17.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.612+0000 7f939f726800 20 remove_watcher() i=5 2024-09-13T19:16:17.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.612+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94826719868688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e90f746a0 con 0x7f938c03b070 2024-09-13T19:16:17.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.612+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94826719868688] v34'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9384057030 con 0x7f938c03b070 2024-09-13T19:16:17.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.612+0000 7f939f726800 20 remove_watcher() i=6 2024-09-13T19:16:17.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.612+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94826719870256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e90f746a0 con 0x7f938c03b070 2024-09-13T19:16:17.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.613+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94826719870256] v34'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9384057030 con 0x7f938c03b070 2024-09-13T19:16:17.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.613+0000 7f939f726800 20 remove_watcher() i=7 2024-09-13T19:16:17.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.613+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f938c03b070 msgr2=0x7f938c026830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.613+0000 7f939f726800 1 --2- 172.21.15.102:0/794295586 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f938c03b070 0x7f938c026830 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.613+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563e90f2fc20 msgr2=0x563e90f320e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.613+0000 7f939f726800 1 --2- 172.21.15.102:0/794295586 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563e90f2fc20 0x563e90f320e0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.613+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f9394036020 msgr2=0x7f939402b450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.614+0000 7f939f726800 1 --2- 172.21.15.102:0/794295586 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f9394036020 0x7f939402b450 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.614+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563e90f34630 msgr2=0x563e90f36a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.614+0000 7f939f726800 1 --2- 172.21.15.102:0/794295586 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563e90f34630 0x563e90f36a20 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.614+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9264036b90 msgr2=0x7f9264039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.614+0000 7f939f726800 1 --2- 172.21.15.102:0/794295586 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9264036b90 0x7f9264039050 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f938c044560 tx=0x7f938c038000 comp rx=0 tx=0).stop 2024-09-13T19:16:17.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.614+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e90f1cc80 msgr2=0x563e90f24130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.614+0000 7f939abe2640 1 -- 172.21.15.102:0/794295586 reap_dead start 2024-09-13T19:16:17.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.614+0000 7f939f726800 1 --2- 172.21.15.102:0/794295586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e90f1cc80 0x563e90f24130 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f939404c8d0 tx=0x7f939404c570 comp rx=0 tx=0).stop 2024-09-13T19:16:17.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.614+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 shutdown_connections 2024-09-13T19:16:17.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.614+0000 7f939f726800 1 --2- 172.21.15.102:0/794295586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e90f1cc80 0x563e90f24130 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.614+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 >> 172.21.15.102:0/794295586 conn(0x563e90f18fe0 msgr2=0x563e90f170b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:17.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.614+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 shutdown_connections 2024-09-13T19:16:17.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.614+0000 7f939f726800 1 -- 172.21.15.102:0/794295586 wait complete. 2024-09-13T19:16:17.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.614+0000 7f939f726800 1 -- 172.21.15.102:0/3572533591 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9274036c00 msgr2=0x7f92740390c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.614+0000 7f939f726800 1 --2- 172.21.15.102:0/3572533591 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9274036c00 0x7f92740390c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x563e90efd120 tx=0x7f938c04aed0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.614+0000 7f939f726800 1 -- 172.21.15.102:0/3572533591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e90f0ffd0 msgr2=0x563e90f103f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.614+0000 7f939f726800 1 --2- 172.21.15.102:0/3572533591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e90f0ffd0 0x563e90f103f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x563e90d717b0 tx=0x7f939400beb0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.614+0000 7f939f726800 1 -- 172.21.15.102:0/3572533591 shutdown_connections 2024-09-13T19:16:17.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.614+0000 7f939f726800 1 --2- 172.21.15.102:0/3572533591 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9274036c00 0x7f92740390c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.614+0000 7f939f726800 1 --2- 172.21.15.102:0/3572533591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e90f0ffd0 0x563e90f103f0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.614+0000 7f939f726800 1 -- 172.21.15.102:0/3572533591 >> 172.21.15.102:0/3572533591 conn(0x563e90f04f60 msgr2=0x563e90f07ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:17.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.614+0000 7f939f726800 1 -- 172.21.15.102:0/3572533591 shutdown_connections 2024-09-13T19:16:17.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.614+0000 7f939f726800 1 -- 172.21.15.102:0/3572533591 wait complete. 2024-09-13T19:16:17.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.615+0000 7f939f726800 1 -- 172.21.15.102:0/726285225 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563e90e01900 msgr2=0x563e90efc240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.615+0000 7f939f726800 1 --2- 172.21.15.102:0/726285225 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563e90e01900 0x563e90efc240 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.615+0000 7f939f726800 1 -- 172.21.15.102:0/726285225 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563e90efeb70 msgr2=0x563e90f00f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.615+0000 7f939f726800 1 --2- 172.21.15.102:0/726285225 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563e90efeb70 0x563e90f00f60 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.615+0000 7f939f726800 1 -- 172.21.15.102:0/726285225 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9280036b90 msgr2=0x7f9280039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.615+0000 7f939f726800 1 --2- 172.21.15.102:0/726285225 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9280036b90 0x7f9280039050 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9384057000 tx=0x7f9384052000 comp rx=0 tx=0).stop 2024-09-13T19:16:17.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.615+0000 7f939f726800 1 -- 172.21.15.102:0/726285225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e90dfd4c0 msgr2=0x563e90d71dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.615+0000 7f939f726800 1 --2- 172.21.15.102:0/726285225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e90dfd4c0 0x563e90d71dc0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f938c000f80 tx=0x7f938c001250 comp rx=0 tx=0).stop 2024-09-13T19:16:17.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.615+0000 7f939f726800 1 -- 172.21.15.102:0/726285225 shutdown_connections 2024-09-13T19:16:17.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.615+0000 7f939f726800 1 --2- 172.21.15.102:0/726285225 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563e90efeb70 0x563e90f00f60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.615+0000 7f939f726800 1 --2- 172.21.15.102:0/726285225 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563e90e01900 0x563e90efc240 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.615+0000 7f939f726800 1 --2- 172.21.15.102:0/726285225 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9280036b90 0x7f9280039050 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.615+0000 7f939f726800 1 --2- 172.21.15.102:0/726285225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e90dfd4c0 0x563e90d71dc0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.615+0000 7f939f726800 1 -- 172.21.15.102:0/726285225 >> 172.21.15.102:0/726285225 conn(0x563e90df8df0 msgr2=0x563e90ee6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:17.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.615+0000 7f939f726800 1 -- 172.21.15.102:0/726285225 shutdown_connections 2024-09-13T19:16:17.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.615+0000 7f939f726800 1 -- 172.21.15.102:0/726285225 wait complete. 2024-09-13T19:16:17.627 INFO:teuthology.orchestra.run.smithi102.stdout:["myfoo"] 2024-09-13T19:16:17.627 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-13T19:16:17.634 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:16:17.634 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-13T19:16:17.634 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-13T19:16:17.634 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-13T19:16:17.678 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:17.678 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:17.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.674+0000 7ff143119800 1 Processor -- start 2024-09-13T19:16:17.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.674+0000 7ff143119800 1 -- start start 2024-09-13T19:16:17.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.674+0000 7ff143119800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55e054423d80 0x55e054426170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.674+0000 7ff143119800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e0542dcb30 con 0x55e054391600 2024-09-13T19:16:17.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.674+0000 7ff143119800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55e0542be360 con 0x55e054423d80 2024-09-13T19:16:17.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.674+0000 7ff13bfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55e054423d80 0x55e054426170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.674+0000 7ff140c0d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55e054391600 0x55e054422660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:49962/0 (socket says 172.21.15.102:49962) 2024-09-13T19:16:17.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.674+0000 7ff140c0d640 1 -- 172.21.15.102:0/781514601 learned_addr learned my addr 172.21.15.102:0/781514601 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:16:17.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.674+0000 7ff13bfff640 1 -- 172.21.15.102:0/781514601 >> v1:172.21.15.53:6789/0 conn(0x55e054391600 legacy=0x55e054422660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.674+0000 7ff13bfff640 1 -- 172.21.15.102:0/781514601 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0542e4e00 con 0x55e054423d80 2024-09-13T19:16:17.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.676+0000 7ff13bfff640 1 --2- 172.21.15.102:0/781514601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e054423d80 0x55e054426170 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff12c00a470 tx=0x7ff12c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ac07305d67f077b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.676+0000 7ff13b7fe640 1 -- 172.21.15.102:0/781514601 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff12c053570 con 0x55e054423d80 2024-09-13T19:16:17.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.676+0000 7ff13b7fe640 1 -- 172.21.15.102:0/781514601 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff12c058070 con 0x55e054423d80 2024-09-13T19:16:17.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.676+0000 7ff13b7fe640 1 -- 172.21.15.102:0/781514601 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff12c053880 con 0x55e054423d80 2024-09-13T19:16:17.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.677+0000 7ff143119800 1 -- 172.21.15.102:0/781514601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e054423d80 msgr2=0x55e054426170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.677+0000 7ff143119800 1 --2- 172.21.15.102:0/781514601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e054423d80 0x55e054426170 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff12c00a470 tx=0x7ff12c045a20 comp rx=0 tx=0).stop 2024-09-13T19:16:17.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.677+0000 7ff143119800 1 -- 172.21.15.102:0/781514601 shutdown_connections 2024-09-13T19:16:17.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.677+0000 7ff143119800 1 --2- 172.21.15.102:0/781514601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e054423d80 0x55e054426170 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.677+0000 7ff143119800 1 -- 172.21.15.102:0/781514601 >> 172.21.15.102:0/781514601 conn(0x55e054417dd0 msgr2=0x55e05441a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:17.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.677+0000 7ff143119800 1 -- 172.21.15.102:0/781514601 shutdown_connections 2024-09-13T19:16:17.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.677+0000 7ff143119800 1 -- 172.21.15.102:0/781514601 wait complete. 2024-09-13T19:16:17.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.691+0000 7ff143119800 1 Processor -- start 2024-09-13T19:16:17.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.691+0000 7ff143119800 1 -- start start 2024-09-13T19:16:17.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.691+0000 7ff143119800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e054391600 0x55e05450ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.691+0000 7ff143119800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e054369320 con 0x55e054391600 2024-09-13T19:16:17.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.691+0000 7ff140c0d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e054391600 0x55e05450ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.692+0000 7ff140c0d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e054391600 0x55e05450ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55002/0 (socket says 172.21.15.102:55002) 2024-09-13T19:16:17.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.692+0000 7ff140c0d640 1 -- 172.21.15.102:0/762562655 learned_addr learned my addr 172.21.15.102:0/762562655 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:17.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.692+0000 7ff140c0d640 1 -- 172.21.15.102:0/762562655 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0542b6bc0 con 0x55e054391600 2024-09-13T19:16:17.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.692+0000 7ff140c0d640 1 --2- 172.21.15.102:0/762562655 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e054391600 0x55e05450ea80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff134001e10 tx=0x7ff13400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=625df42b031c4293 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.692+0000 7ff02ee05640 1 -- 172.21.15.102:0/762562655 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff134012020 con 0x55e054391600 2024-09-13T19:16:17.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.692+0000 7ff02ee05640 1 -- 172.21.15.102:0/762562655 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff13400e5a0 con 0x55e054391600 2024-09-13T19:16:17.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.692+0000 7ff02ee05640 1 -- 172.21.15.102:0/762562655 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff13400e8e0 con 0x55e054391600 2024-09-13T19:16:17.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.693+0000 7ff143119800 1 -- 172.21.15.102:0/762562655 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e054391600 msgr2=0x55e05450ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.693+0000 7ff143119800 1 --2- 172.21.15.102:0/762562655 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e054391600 0x55e05450ea80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff134001e10 tx=0x7ff13400b780 comp rx=0 tx=0).stop 2024-09-13T19:16:17.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.693+0000 7ff143119800 1 -- 172.21.15.102:0/762562655 shutdown_connections 2024-09-13T19:16:17.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.693+0000 7ff143119800 1 --2- 172.21.15.102:0/762562655 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e054391600 0x55e05450ea80 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.693+0000 7ff143119800 1 -- 172.21.15.102:0/762562655 >> 172.21.15.102:0/762562655 conn(0x55e054417dd0 msgr2=0x55e05450a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:17.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.693+0000 7ff143119800 1 -- 172.21.15.102:0/762562655 shutdown_connections 2024-09-13T19:16:17.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.693+0000 7ff143119800 1 -- 172.21.15.102:0/762562655 wait complete. 2024-09-13T19:16:17.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.693+0000 7ff143119800 1 Processor -- start 2024-09-13T19:16:17.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.693+0000 7ff143119800 1 -- start start 2024-09-13T19:16:17.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.693+0000 7ff143119800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e054391600 0x55e054516490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.693+0000 7ff143119800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e054426980 con 0x55e054391600 2024-09-13T19:16:17.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.693+0000 7ff140c0d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e054391600 0x55e054516490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.693+0000 7ff140c0d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e054391600 0x55e054516490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55018/0 (socket says 172.21.15.102:55018) 2024-09-13T19:16:17.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.693+0000 7ff140c0d640 1 -- 172.21.15.102:0/3918571549 learned_addr learned my addr 172.21.15.102:0/3918571549 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:17.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.694+0000 7ff140c0d640 1 -- 172.21.15.102:0/3918571549 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0542cafe0 con 0x55e054391600 2024-09-13T19:16:17.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.694+0000 7ff140c0d640 1 --2- 172.21.15.102:0/3918571549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e054391600 0x55e054516490 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff13400b7c0 tx=0x7ff134000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.694+0000 7ff02d602640 1 -- 172.21.15.102:0/3918571549 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff134012030 con 0x55e054391600 2024-09-13T19:16:17.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.694+0000 7ff02d602640 1 -- 172.21.15.102:0/3918571549 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff134001470 con 0x55e054391600 2024-09-13T19:16:17.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.694+0000 7ff02d602640 1 -- 172.21.15.102:0/3918571549 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff13401a8d0 con 0x55e054391600 2024-09-13T19:16:17.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.694+0000 7ff143119800 1 -- 172.21.15.102:0/3918571549 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e0545169d0 con 0x55e054391600 2024-09-13T19:16:17.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.694+0000 7ff143119800 1 -- 172.21.15.102:0/3918571549 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e054516ef0 con 0x55e054391600 2024-09-13T19:16:17.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.695+0000 7ff02d602640 1 -- 172.21.15.102:0/3918571549 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff134015020 con 0x55e054391600 2024-09-13T19:16:17.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.695+0000 7ff02d602640 1 --2- 172.21.15.102:0/3918571549 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff028036b90 0x7ff028039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.695+0000 7ff02d602640 1 -- 172.21.15.102:0/3918571549 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7ff134020030 con 0x55e054391600 2024-09-13T19:16:17.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.695+0000 7ff13bfff640 1 --2- 172.21.15.102:0/3918571549 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff028036b90 0x7ff028039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.695+0000 7ff143119800 1 --2- 172.21.15.102:0/3918571549 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e054423d80 0x55e05451d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.695+0000 7ff143119800 1 -- 172.21.15.102:0/3918571549 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e05451da40 con 0x55e054423d80 2024-09-13T19:16:17.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.695+0000 7ff14140e640 1 --2- 172.21.15.102:0/3918571549 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e054423d80 0x55e05451d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.696+0000 7ff13bfff640 1 --2- 172.21.15.102:0/3918571549 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff028036b90 0x7ff028039050 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff12c057000 tx=0x7ff12c052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.696+0000 7ff14140e640 1 --2- 172.21.15.102:0/3918571549 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e054423d80 0x55e05451d500 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.696+0000 7ff14140e640 1 -- 172.21.15.102:0/3918571549 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff13c00a4a0 con 0x55e054423d80 2024-09-13T19:16:17.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.696+0000 7ff143119800 1 -- 172.21.15.102:0/3918571549 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e05451aad0 con 0x55e054423d80 2024-09-13T19:16:17.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.696+0000 7ff14140e640 1 -- 172.21.15.102:0/3918571549 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff13c00a4a0 con 0x55e054423d80 2024-09-13T19:16:17.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.696+0000 7ff143119800 1 --2- 172.21.15.102:0/3918571549 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e05451fd90 0x55e054522180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.696+0000 7ff143119800 1 -- 172.21.15.102:0/3918571549 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e054522870 con 0x55e05451fd90 2024-09-13T19:16:17.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.696+0000 7ff140c0d640 1 --2- 172.21.15.102:0/3918571549 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e05451fd90 0x55e054522180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.697+0000 7ff140c0d640 1 --2- 172.21.15.102:0/3918571549 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e05451fd90 0x55e054522180 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.697+0000 7ff140c0d640 1 -- 172.21.15.102:0/3918571549 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff134018950 con 0x55e05451fd90 2024-09-13T19:16:17.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.697+0000 7ff143119800 1 -- 172.21.15.102:0/3918571549 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e05451ec30 con 0x55e054423d80 2024-09-13T19:16:17.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.697+0000 7ff14140e640 1 -- 172.21.15.102:0/3918571549 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff13c00a4a0 con 0x55e054423d80 2024-09-13T19:16:17.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.697+0000 7ff143119800 1 -- 172.21.15.102:0/3918571549 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e05451f110 con 0x55e05451fd90 2024-09-13T19:16:17.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.698+0000 7ff140c0d640 1 -- 172.21.15.102:0/3918571549 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff134018950 con 0x55e05451fd90 2024-09-13T19:16:17.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.698+0000 7ff143119800 1 Processor -- start 2024-09-13T19:16:17.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.698+0000 7ff143119800 1 -- start start 2024-09-13T19:16:17.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.698+0000 7ff143119800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e054531220 0x55e054531640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.698+0000 7ff143119800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e0542b8580 con 0x55e054531220 2024-09-13T19:16:17.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.698+0000 7ff14140e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e054531220 0x55e054531640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.698+0000 7ff14140e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e054531220 0x55e054531640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55028/0 (socket says 172.21.15.102:55028) 2024-09-13T19:16:17.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.698+0000 7ff14140e640 1 -- 172.21.15.102:0/1057325602 learned_addr learned my addr 172.21.15.102:0/1057325602 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:17.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.699+0000 7ff14140e640 1 -- 172.21.15.102:0/1057325602 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e054531b80 con 0x55e054531220 2024-09-13T19:16:17.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.699+0000 7ff14140e640 1 --2- 172.21.15.102:0/1057325602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e054531220 0x55e054531640 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x55e05451de40 tx=0x7ff13c0163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.699+0000 7ff0267fc640 1 -- 172.21.15.102:0/1057325602 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff13c013450 con 0x55e054531220 2024-09-13T19:16:17.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.699+0000 7ff0267fc640 1 -- 172.21.15.102:0/1057325602 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff13c0135f0 con 0x55e054531220 2024-09-13T19:16:17.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.699+0000 7ff143119800 1 -- 172.21.15.102:0/1057325602 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e054531e10 con 0x55e054531220 2024-09-13T19:16:17.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.699+0000 7ff0267fc640 1 -- 172.21.15.102:0/1057325602 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff13c0138d0 con 0x55e054531220 2024-09-13T19:16:17.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.699+0000 7ff143119800 1 -- 172.21.15.102:0/1057325602 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e054534af0 con 0x55e054531220 2024-09-13T19:16:17.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.700+0000 7ff0267fc640 1 -- 172.21.15.102:0/1057325602 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff13c011040 con 0x55e054531220 2024-09-13T19:16:17.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.700+0000 7ff0267fc640 1 --2- 172.21.15.102:0/1057325602 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff018036b90 0x7ff018039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.700+0000 7ff0267fc640 1 -- 172.21.15.102:0/1057325602 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7ff13c00e040 con 0x55e054531220 2024-09-13T19:16:17.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.700+0000 7ff140c0d640 1 --2- 172.21.15.102:0/1057325602 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff018036b90 0x7ff018039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.700+0000 7ff143119800 1 Processor -- start 2024-09-13T19:16:17.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.700+0000 7ff140c0d640 1 --2- 172.21.15.102:0/1057325602 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff018036b90 0x7ff018039050 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x55e05451e340 tx=0x7ff134024ec0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.700+0000 7ff143119800 1 -- start start 2024-09-13T19:16:17.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.700+0000 7ff143119800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e05453df30 0x55e05453e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.700+0000 7ff143119800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e05450f230 con 0x55e05453df30 2024-09-13T19:16:17.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.701+0000 7ff14140e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e05453df30 0x55e05453e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.701+0000 7ff14140e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e05453df30 0x55e05453e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55030/0 (socket says 172.21.15.102:55030) 2024-09-13T19:16:17.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.701+0000 7ff14140e640 1 -- 172.21.15.102:0/1402428861 learned_addr learned my addr 172.21.15.102:0/1402428861 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:17.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.701+0000 7ff14140e640 1 -- 172.21.15.102:0/1402428861 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e05453e900 con 0x55e05453df30 2024-09-13T19:16:17.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.701+0000 7ff14140e640 1 --2- 172.21.15.102:0/1402428861 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e05453df30 0x55e05453e330 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff13c04cda0 tx=0x7ff13c014f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10be13ff1b2d9789 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.701+0000 7ff017fff640 1 -- 172.21.15.102:0/1402428861 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff13c04a070 con 0x55e05453df30 2024-09-13T19:16:17.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.701+0000 7ff017fff640 1 -- 172.21.15.102:0/1402428861 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff13c014c00 con 0x55e05453df30 2024-09-13T19:16:17.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.701+0000 7ff017fff640 1 -- 172.21.15.102:0/1402428861 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff13c02a980 con 0x55e05453df30 2024-09-13T19:16:17.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.702+0000 7ff143119800 1 -- 172.21.15.102:0/1402428861 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e05453df30 msgr2=0x55e05453e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.702+0000 7ff143119800 1 --2- 172.21.15.102:0/1402428861 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e05453df30 0x55e05453e330 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff13c04cda0 tx=0x7ff13c014f20 comp rx=0 tx=0).stop 2024-09-13T19:16:17.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.702+0000 7ff143119800 1 -- 172.21.15.102:0/1402428861 shutdown_connections 2024-09-13T19:16:17.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.702+0000 7ff143119800 1 --2- 172.21.15.102:0/1402428861 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e05453df30 0x55e05453e330 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.702+0000 7ff143119800 1 -- 172.21.15.102:0/1402428861 >> 172.21.15.102:0/1402428861 conn(0x55e05453a240 msgr2=0x55e054538390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:17.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.702+0000 7ff143119800 1 -- 172.21.15.102:0/1402428861 shutdown_connections 2024-09-13T19:16:17.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.702+0000 7ff143119800 1 -- 172.21.15.102:0/1402428861 wait complete. 2024-09-13T19:16:17.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.702+0000 7ff143119800 1 Processor -- start 2024-09-13T19:16:17.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.702+0000 7ff143119800 1 -- start start 2024-09-13T19:16:17.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.702+0000 7ff143119800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e05453df30 0x55e054545330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.702+0000 7ff143119800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e05453ef10 con 0x55e05453df30 2024-09-13T19:16:17.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.702+0000 7ff14140e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e05453df30 0x55e054545330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.702+0000 7ff14140e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e05453df30 0x55e054545330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55042/0 (socket says 172.21.15.102:55042) 2024-09-13T19:16:17.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.702+0000 7ff14140e640 1 -- 172.21.15.102:0/128548214 learned_addr learned my addr 172.21.15.102:0/128548214 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:17.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.702+0000 7ff14140e640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e054545870 con 0x55e05453df30 2024-09-13T19:16:17.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.703+0000 7ff14140e640 1 --2- 172.21.15.102:0/128548214 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e05453df30 0x55e054545330 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff13c04cd00 tx=0x7ff13c04cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.703+0000 7ff0167fc640 1 -- 172.21.15.102:0/128548214 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff13c02a980 con 0x55e05453df30 2024-09-13T19:16:17.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.703+0000 7ff0167fc640 1 -- 172.21.15.102:0/128548214 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff13c013a70 con 0x55e05453df30 2024-09-13T19:16:17.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.703+0000 7ff143119800 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e054545b00 con 0x55e05453df30 2024-09-13T19:16:17.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.703+0000 7ff0167fc640 1 -- 172.21.15.102:0/128548214 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff13c02ab20 con 0x55e05453df30 2024-09-13T19:16:17.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.703+0000 7ff143119800 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0545487b0 con 0x55e05453df30 2024-09-13T19:16:17.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.704+0000 7ff0167fc640 1 -- 172.21.15.102:0/128548214 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff13c04eaf0 con 0x55e05453df30 2024-09-13T19:16:17.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.704+0000 7ff0167fc640 1 --2- 172.21.15.102:0/128548214 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff00c036b90 0x7ff00c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.704+0000 7ff0167fc640 1 -- 172.21.15.102:0/128548214 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7ff13c0539e0 con 0x55e05453df30 2024-09-13T19:16:17.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.704+0000 7ff140c0d640 1 --2- 172.21.15.102:0/128548214 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff00c036b90 0x7ff00c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.704+0000 7ff143119800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.704+0000 7ff143119800 1 --2- 172.21.15.102:0/128548214 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e054550e50 0x55e054553310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.704+0000 7ff143119800 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e054553a60 con 0x55e054550e50 2024-09-13T19:16:17.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.704+0000 7ff13bfff640 1 --2- 172.21.15.102:0/128548214 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e054550e50 0x55e054553310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.704+0000 7ff140c0d640 1 --2- 172.21.15.102:0/128548214 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff00c036b90 0x7ff00c039050 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff134044480 tx=0x7ff134039000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.705+0000 7ff13bfff640 1 --2- 172.21.15.102:0/128548214 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e054550e50 0x55e054553310 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.705+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff12c051070 con 0x55e054550e50 2024-09-13T19:16:17.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.705+0000 7ff143119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:17.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.705+0000 7ff143119800 20 realm 2024-09-13T19:16:17.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.705+0000 7ff143119800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.705+0000 7ff143119800 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e054553e90 con 0x55e054550e50 2024-09-13T19:16:17.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.705+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff12c051070 con 0x55e054550e50 2024-09-13T19:16:17.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.705+0000 7ff143119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:17.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.705+0000 7ff143119800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:17.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.705+0000 7ff143119800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.705+0000 7ff143119800 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e054554760 con 0x55e054550e50 2024-09-13T19:16:17.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.705+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff12c051070 con 0x55e054550e50 2024-09-13T19:16:17.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.705+0000 7ff143119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:17.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.705+0000 7ff143119800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.705+0000 7ff143119800 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e054554b00 con 0x55e054550e50 2024-09-13T19:16:17.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.705+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff12c051070 con 0x55e054550e50 2024-09-13T19:16:17.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.705+0000 7ff143119800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:17.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.705+0000 7ff143119800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.705+0000 7ff143119800 1 --2- 172.21.15.102:0/128548214 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e054555860 0x55e054557c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.706+0000 7ff143119800 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e054558190 con 0x55e054555860 2024-09-13T19:16:17.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.706+0000 7ff14140e640 1 --2- 172.21.15.102:0/128548214 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e054555860 0x55e054557c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.706+0000 7ff14140e640 1 --2- 172.21.15.102:0/128548214 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e054555860 0x55e054557c50 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.706+0000 7ff14140e640 1 -- 172.21.15.102:0/128548214 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff13c027020 con 0x55e054555860 2024-09-13T19:16:17.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.706+0000 7ff143119800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:17.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.706+0000 7ff143119800 20 searching for the correct realm 2024-09-13T19:16:17.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.706+0000 7ff143119800 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e054559b00 con 0x55e054555860 2024-09-13T19:16:17.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.706+0000 7ff14140e640 1 -- 172.21.15.102:0/128548214 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff13c027020 con 0x55e054555860 2024-09-13T19:16:17.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.706+0000 7ff14140e640 1 --2- 172.21.15.102:0/128548214 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7ff13c013070 0x7ff13c04b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.706+0000 7ff14140e640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e054559b00 con 0x7ff13c013070 2024-09-13T19:16:17.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.707+0000 7ff140c0d640 1 --2- 172.21.15.102:0/128548214 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7ff13c013070 0x7ff13c04b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.707+0000 7ff140c0d640 1 --2- 172.21.15.102:0/128548214 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7ff13c013070 0x7ff13c04b480 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.707+0000 7ff140c0d640 1 -- 172.21.15.102:0/128548214 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff134018950 con 0x7ff13c013070 2024-09-13T19:16:17.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.707+0000 7ff140c0d640 1 --2- 172.21.15.102:0/128548214 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7ff134059040 0x7ff134024420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:17.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.707+0000 7ff140c0d640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e054559b00 con 0x7ff134059040 2024-09-13T19:16:17.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.707+0000 7ff13bfff640 1 --2- 172.21.15.102:0/128548214 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7ff134059040 0x7ff134024420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:17.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.708+0000 7ff13bfff640 1 --2- 172.21.15.102:0/128548214 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7ff134059040 0x7ff134024420 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:17.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.708+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff12c051070 con 0x7ff134059040 2024-09-13T19:16:17.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.708+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e054559b00 con 0x55e054550e50 2024-09-13T19:16:17.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.708+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff12c051070 con 0x55e054550e50 2024-09-13T19:16:17.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.708+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e054559b00 con 0x55e054550e50 2024-09-13T19:16:17.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.709+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff12c051070 con 0x55e054550e50 2024-09-13T19:16:17.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.709+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e054559b00 con 0x7ff134059040 2024-09-13T19:16:17.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.709+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff12c051070 con 0x7ff134059040 2024-09-13T19:16:17.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.709+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e054559b00 con 0x7ff134059040 2024-09-13T19:16:17.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.709+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff12c051070 con 0x7ff134059040 2024-09-13T19:16:17.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.709+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e054559b00 con 0x7ff13c013070 2024-09-13T19:16:17.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.709+0000 7ff140c0d640 1 -- 172.21.15.102:0/128548214 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff134018950 con 0x7ff13c013070 2024-09-13T19:16:17.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.709+0000 7ff140c0d640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e054559b00 con 0x55e054555860 2024-09-13T19:16:17.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.710+0000 7ff14140e640 1 -- 172.21.15.102:0/128548214 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff13c027020 con 0x55e054555860 2024-09-13T19:16:17.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.710+0000 7ff14140e640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e054559b00 con 0x55e054550e50 2024-09-13T19:16:17.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.710+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff12c051070 con 0x55e054550e50 2024-09-13T19:16:17.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.710+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e054559b00 con 0x7ff134059040 2024-09-13T19:16:17.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.710+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff12c051070 con 0x7ff134059040 2024-09-13T19:16:17.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.710+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e054559b00 con 0x55e054550e50 2024-09-13T19:16:17.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.710+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff12c051070 con 0x55e054550e50 2024-09-13T19:16:17.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.710+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e054559b00 con 0x7ff13c013070 2024-09-13T19:16:17.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.710+0000 7ff140c0d640 1 -- 172.21.15.102:0/128548214 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff134018950 con 0x7ff13c013070 2024-09-13T19:16:17.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.710+0000 7ff140c0d640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e054559b00 con 0x55e054555860 2024-09-13T19:16:17.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.711+0000 7ff14140e640 1 -- 172.21.15.102:0/128548214 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff13c027020 con 0x55e054555860 2024-09-13T19:16:17.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.711+0000 7ff14140e640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e054559b00 con 0x55e054555860 2024-09-13T19:16:17.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.711+0000 7ff14140e640 1 -- 172.21.15.102:0/128548214 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff13c027020 con 0x55e054555860 2024-09-13T19:16:17.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.711+0000 7ff14140e640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e054559b00 con 0x7ff134059040 2024-09-13T19:16:17.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.711+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff12c051070 con 0x7ff134059040 2024-09-13T19:16:17.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.711+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e054559b00 con 0x55e054555860 2024-09-13T19:16:17.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.712+0000 7ff14140e640 1 -- 172.21.15.102:0/128548214 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff13c027020 con 0x55e054555860 2024-09-13T19:16:17.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.712+0000 7ff14140e640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e054559b00 con 0x55e054555860 2024-09-13T19:16:17.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.712+0000 7ff14140e640 1 -- 172.21.15.102:0/128548214 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff13c027020 con 0x55e054555860 2024-09-13T19:16:17.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.712+0000 7ff14140e640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e054559b00 con 0x55e054550e50 2024-09-13T19:16:17.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.712+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff12c051070 con 0x55e054550e50 2024-09-13T19:16:17.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.712+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e054559b00 con 0x55e054550e50 2024-09-13T19:16:17.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.712+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff12c051070 con 0x55e054550e50 2024-09-13T19:16:17.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.712+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e054559b00 con 0x7ff134059040 2024-09-13T19:16:17.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.713+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff12c051070 con 0x7ff134059040 2024-09-13T19:16:17.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.713+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e054559b00 con 0x55e054555860 2024-09-13T19:16:17.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.713+0000 7ff14140e640 1 -- 172.21.15.102:0/128548214 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff13c027020 con 0x55e054555860 2024-09-13T19:16:17.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.713+0000 7ff14140e640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e054559b00 con 0x7ff13c013070 2024-09-13T19:16:17.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.713+0000 7ff140c0d640 1 -- 172.21.15.102:0/128548214 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff134018950 con 0x7ff13c013070 2024-09-13T19:16:17.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.713+0000 7ff140c0d640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e054559b00 con 0x55e054550e50 2024-09-13T19:16:17.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.713+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff12c051070 con 0x55e054550e50 2024-09-13T19:16:17.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.713+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e054559b00 con 0x7ff134059040 2024-09-13T19:16:17.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.714+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff12c051070 con 0x7ff134059040 2024-09-13T19:16:17.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.714+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e054559b00 con 0x55e054555860 2024-09-13T19:16:17.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.714+0000 7ff14140e640 1 -- 172.21.15.102:0/128548214 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff13c027020 con 0x55e054555860 2024-09-13T19:16:17.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.714+0000 7ff14140e640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e054559b00 con 0x7ff134059040 2024-09-13T19:16:17.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.714+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff12c051070 con 0x7ff134059040 2024-09-13T19:16:17.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.714+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff12c086040 con 0x7ff13c013070 2024-09-13T19:16:17.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.714+0000 7ff140c0d640 1 -- 172.21.15.102:0/128548214 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff134018950 con 0x7ff13c013070 2024-09-13T19:16:17.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.714+0000 7ff140c0d640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff12c086040 con 0x55e054555860 2024-09-13T19:16:17.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.714+0000 7ff14140e640 1 -- 172.21.15.102:0/128548214 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff13c027020 con 0x55e054555860 2024-09-13T19:16:17.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.715+0000 7ff14140e640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff12c086040 con 0x7ff134059040 2024-09-13T19:16:17.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.715+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff12c051070 con 0x7ff134059040 2024-09-13T19:16:17.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.715+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff12c086040 con 0x55e054550e50 2024-09-13T19:16:17.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.715+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff12c051070 con 0x55e054550e50 2024-09-13T19:16:17.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.715+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff12c086040 con 0x7ff13c013070 2024-09-13T19:16:17.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.715+0000 7ff140c0d640 1 -- 172.21.15.102:0/128548214 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff134018950 con 0x7ff13c013070 2024-09-13T19:16:17.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.715+0000 7ff143119800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:17.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.715+0000 7ff143119800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:17.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.715+0000 7ff143119800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:17.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.715+0000 7ff143119800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:17.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.715+0000 7ff143119800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:17.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.715+0000 7ff143119800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:17.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.715+0000 7ff143119800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.715+0000 7ff143119800 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e054558bd0 con 0x55e054550e50 2024-09-13T19:16:17.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.716+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff12c051070 con 0x55e054550e50 2024-09-13T19:16:17.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.716+0000 7ff143119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:17.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.716+0000 7ff143119800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.716+0000 7ff143119800 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e054559470 con 0x55e054550e50 2024-09-13T19:16:17.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.716+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff12c051070 con 0x55e054550e50 2024-09-13T19:16:17.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.716+0000 7ff143119800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:17.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.716+0000 7ff143119800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.716+0000 7ff143119800 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e054558810 con 0x55e054555860 2024-09-13T19:16:17.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.716+0000 7ff14140e640 1 -- 172.21.15.102:0/128548214 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff13c027020 con 0x55e054555860 2024-09-13T19:16:17.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.716+0000 7ff143119800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:17.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.716+0000 7ff143119800 20 zone default found 2024-09-13T19:16:17.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.716+0000 7ff143119800 4 Realm: () 2024-09-13T19:16:17.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.716+0000 7ff143119800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:17.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.716+0000 7ff143119800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:17.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.716+0000 7ff143119800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:17.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.716+0000 7ff143119800 20 zonegroup default 2024-09-13T19:16:17.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.716+0000 7ff143119800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.716+0000 7ff143119800 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e05455a480 con 0x7ff134059040 2024-09-13T19:16:17.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.716+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff12c051070 con 0x7ff134059040 2024-09-13T19:16:17.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.716+0000 7ff143119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:17.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.716+0000 7ff143119800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.716+0000 7ff143119800 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e05455bf20 con 0x55e054555860 2024-09-13T19:16:17.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.717+0000 7ff14140e640 1 -- 172.21.15.102:0/128548214 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff13c027020 con 0x55e054555860 2024-09-13T19:16:17.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.717+0000 7ff143119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:17.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.717+0000 7ff143119800 20 rados->read ofs=0 len=0 2024-09-13T19:16:17.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.717+0000 7ff143119800 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e05455c340 con 0x55e054555860 2024-09-13T19:16:17.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.717+0000 7ff14140e640 1 -- 172.21.15.102:0/128548214 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff13c027020 con 0x55e054555860 2024-09-13T19:16:17.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.717+0000 7ff143119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:17.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.717+0000 7ff143119800 20 started sync module instance, tier type = 2024-09-13T19:16:17.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.717+0000 7ff143119800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:17.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.717+0000 7ff143119800 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e05455b2f0 con 0x7ff13c013070 2024-09-13T19:16:17.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.718+0000 7ff140c0d640 1 -- 172.21.15.102:0/128548214 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(44 notify.0 [create] v34'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff134018950 con 0x7ff13c013070 2024-09-13T19:16:17.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.718+0000 7ff143119800 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94421975938832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e05455bb30 con 0x7ff13c013070 2024-09-13T19:16:17.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.718+0000 7ff143119800 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e05455d240 con 0x55e054550e50 2024-09-13T19:16:17.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.719+0000 7ff140c0d640 1 -- 172.21.15.102:0/128548214 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94421975938832] v34'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff134018950 con 0x7ff13c013070 2024-09-13T19:16:17.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.719+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v34'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff12c051070 con 0x55e054550e50 2024-09-13T19:16:17.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.719+0000 7ff143119800 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94421975944592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e05455d1b0 con 0x55e054550e50 2024-09-13T19:16:17.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.719+0000 7ff143119800 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e05455e100 con 0x55e054555860 2024-09-13T19:16:17.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.720+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94421975944592] v34'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff12c051070 con 0x55e054550e50 2024-09-13T19:16:17.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.721+0000 7ff14140e640 1 -- 172.21.15.102:0/128548214 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v34'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff13c027020 con 0x55e054555860 2024-09-13T19:16:17.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.721+0000 7ff143119800 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94421975946800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e05455e100 con 0x55e054555860 2024-09-13T19:16:17.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.721+0000 7ff143119800 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e05455eb70 con 0x7ff13c013070 2024-09-13T19:16:17.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.722+0000 7ff14140e640 1 -- 172.21.15.102:0/128548214 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94421975946800] v34'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff13c027020 con 0x55e054555860 2024-09-13T19:16:17.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.722+0000 7ff140c0d640 1 -- 172.21.15.102:0/128548214 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(50 notify.3 [create] v34'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff134018950 con 0x7ff13c013070 2024-09-13T19:16:17.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.722+0000 7ff143119800 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94421975948368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e05455e070 con 0x7ff13c013070 2024-09-13T19:16:17.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.722+0000 7ff143119800 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e05455fa30 con 0x55e054550e50 2024-09-13T19:16:17.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.723+0000 7ff140c0d640 1 -- 172.21.15.102:0/128548214 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94421975948368] v34'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff134018950 con 0x7ff13c013070 2024-09-13T19:16:17.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.723+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v34'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff12c051070 con 0x55e054550e50 2024-09-13T19:16:17.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.723+0000 7ff143119800 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94421975954816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e05455f9a0 con 0x55e054550e50 2024-09-13T19:16:17.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.723+0000 7ff143119800 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e0545608f0 con 0x7ff134059040 2024-09-13T19:16:17.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.724+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(54 notify.5 [create] v34'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff12c051070 con 0x7ff134059040 2024-09-13T19:16:17.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.724+0000 7ff143119800 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94421975958592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e054560d10 con 0x7ff134059040 2024-09-13T19:16:17.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.724+0000 7ff143119800 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e0545617c0 con 0x7ff134059040 2024-09-13T19:16:17.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.724+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94421975954816] v34'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff12c051070 con 0x55e054550e50 2024-09-13T19:16:17.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.725+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94421975958592] v34'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff12c051070 con 0x7ff134059040 2024-09-13T19:16:17.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.725+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(56 notify.6 [create] v34'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff12c051070 con 0x7ff134059040 2024-09-13T19:16:17.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.725+0000 7ff143119800 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94421975957024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e054560860 con 0x7ff134059040 2024-09-13T19:16:17.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.725+0000 7ff143119800 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e054561e50 con 0x7ff134059040 2024-09-13T19:16:17.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.726+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94421975957024] v34'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff12c051070 con 0x7ff134059040 2024-09-13T19:16:17.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.726+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(58 notify.7 [create] v34'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff12c051070 con 0x7ff134059040 2024-09-13T19:16:17.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.726+0000 7ff143119800 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94421975962320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e054561e50 con 0x7ff134059040 2024-09-13T19:16:17.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.726+0000 7ff143119800 20 add_watcher() i=0 2024-09-13T19:16:17.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.726+0000 7ff143119800 20 add_watcher() i=1 2024-09-13T19:16:17.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.726+0000 7ff143119800 20 add_watcher() i=2 2024-09-13T19:16:17.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.726+0000 7ff143119800 20 add_watcher() i=3 2024-09-13T19:16:17.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.726+0000 7ff143119800 20 add_watcher() i=4 2024-09-13T19:16:17.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.726+0000 7ff143119800 20 add_watcher() i=5 2024-09-13T19:16:17.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.726+0000 7ff143119800 20 add_watcher() i=6 2024-09-13T19:16:17.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.727+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94421975962320] v34'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff12c051070 con 0x7ff134059040 2024-09-13T19:16:17.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.727+0000 7ff143119800 20 add_watcher() i=7 2024-09-13T19:16:17.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.727+0000 7ff143119800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:17.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.727+0000 7ff143119800 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e054564fe0 con 0x55e054550e50 2024-09-13T19:16:17.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.727+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff12c051070 con 0x55e054550e50 2024-09-13T19:16:17.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.727+0000 7ff143119800 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94421975964064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e054562270 con 0x55e054550e50 2024-09-13T19:16:17.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.729+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94421975964064] v34'94 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff12c051070 con 0x55e054550e50 2024-09-13T19:16:17.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.729+0000 7feff77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:17.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.729+0000 7ff143119800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:17.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.729+0000 7ff143119800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:17.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.729+0000 7ff143119800 5 note: GC not initialized 2024-09-13T19:16:17.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.729+0000 7feff67e4640 20 reqs_thread_entry: start 2024-09-13T19:16:17.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.729+0000 7ff143119800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:17.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.729+0000 7ff143119800 20 Filter name: none 2024-09-13T19:16:17.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.729+0000 7fefeffff640 20 reqs_thread_entry: start 2024-09-13T19:16:17.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.729+0000 7ff143119800 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e054597a70 con 0x55e054555860 2024-09-13T19:16:17.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.730+0000 7ff14140e640 1 -- 172.21.15.102:0/128548214 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(62 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff13c027020 con 0x55e054555860 2024-09-13T19:16:17.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.730+0000 7ff14140e640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e05455c340 con 0x55e054555860 2024-09-13T19:16:17.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.730+0000 7ff14140e640 1 -- 172.21.15.102:0/128548214 <== osd.3 v2:172.21.15.102:6800/3096737090 17 ==== osd_op_reply(63 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff13c027020 con 0x55e054555860 2024-09-13T19:16:17.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.730+0000 7ff14140e640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e05455c340 con 0x55e054550e50 2024-09-13T19:16:17.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.730+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(64 [pgnls start_epoch 34 out=49b] v34'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff12c051070 con 0x55e054550e50 2024-09-13T19:16:17.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.730+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e054559470 con 0x55e054550e50 2024-09-13T19:16:17.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.730+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(65 [pgnls start_epoch 34 out=49b] v34'11 uv11 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff12c051070 con 0x55e054550e50 2024-09-13T19:16:17.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.730+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e054559470 con 0x7ff13c013070 2024-09-13T19:16:17.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.730+0000 7ff140c0d640 1 -- 172.21.15.102:0/128548214 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(66 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff134018950 con 0x7ff13c013070 2024-09-13T19:16:17.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.730+0000 7ff140c0d640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e05455e070 con 0x55e054555860 2024-09-13T19:16:17.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.731+0000 7ff14140e640 1 -- 172.21.15.102:0/128548214 <== osd.3 v2:172.21.15.102:6800/3096737090 18 ==== osd_op_reply(67 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff13c027020 con 0x55e054555860 2024-09-13T19:16:17.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.731+0000 7ff14140e640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e05455e070 con 0x55e054550e50 2024-09-13T19:16:17.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.731+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(68 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff12c051070 con 0x55e054550e50 2024-09-13T19:16:17.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.731+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e05455e070 con 0x55e054555860 2024-09-13T19:16:17.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.731+0000 7ff14140e640 1 -- 172.21.15.102:0/128548214 <== osd.3 v2:172.21.15.102:6800/3096737090 19 ==== osd_op_reply(69 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff13c027020 con 0x55e054555860 2024-09-13T19:16:17.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.731+0000 7ff14140e640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e05455e070 con 0x7ff13c013070 2024-09-13T19:16:17.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.731+0000 7ff140c0d640 1 -- 172.21.15.102:0/128548214 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(70 [pgnls start_epoch 34 out=49b] v34'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff134018950 con 0x7ff13c013070 2024-09-13T19:16:17.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.731+0000 7ff140c0d640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e05455e070 con 0x55e054555860 2024-09-13T19:16:17.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.731+0000 7ff14140e640 1 -- 172.21.15.102:0/128548214 <== osd.3 v2:172.21.15.102:6800/3096737090 20 ==== osd_op_reply(71 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff13c027020 con 0x55e054555860 2024-09-13T19:16:17.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.731+0000 7ff14140e640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e05455e070 con 0x55e054550e50 2024-09-13T19:16:17.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.732+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(72 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff12c051070 con 0x55e054550e50 2024-09-13T19:16:17.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.732+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e05455e070 con 0x7ff134059040 2024-09-13T19:16:17.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.732+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(73 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff12c051070 con 0x7ff134059040 2024-09-13T19:16:17.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.732+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e05455e070 con 0x7ff134059040 2024-09-13T19:16:17.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.732+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(74 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff12c051070 con 0x7ff134059040 2024-09-13T19:16:17.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.732+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e05455e070 con 0x55e054555860 2024-09-13T19:16:17.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.732+0000 7ff14140e640 1 -- 172.21.15.102:0/128548214 <== osd.3 v2:172.21.15.102:6800/3096737090 21 ==== osd_op_reply(75 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff13c027020 con 0x55e054555860 2024-09-13T19:16:17.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.732+0000 7ff14140e640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e05455e070 con 0x7ff134059040 2024-09-13T19:16:17.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.733+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(76 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff12c051070 con 0x7ff134059040 2024-09-13T19:16:17.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.733+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e05455e070 con 0x7ff134059040 2024-09-13T19:16:17.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.733+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.0 v2:172.21.15.53:6800/4021716951 20 ==== osd_op_reply(77 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff12c051070 con 0x7ff134059040 2024-09-13T19:16:17.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.733+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e05455e070 con 0x7ff134059040 2024-09-13T19:16:17.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.733+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.0 v2:172.21.15.53:6800/4021716951 21 ==== osd_op_reply(78 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff12c051070 con 0x7ff134059040 2024-09-13T19:16:17.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.733+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e05455e070 con 0x55e054555860 2024-09-13T19:16:17.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.733+0000 7ff14140e640 1 -- 172.21.15.102:0/128548214 <== osd.3 v2:172.21.15.102:6800/3096737090 22 ==== osd_op_reply(79 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff13c027020 con 0x55e054555860 2024-09-13T19:16:17.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.733+0000 7ff14140e640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e05455e070 con 0x7ff13c013070 2024-09-13T19:16:17.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.734+0000 7ff140c0d640 1 -- 172.21.15.102:0/128548214 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(80 [pgnls start_epoch 34 out=148b] v34'3 uv3 ondisk = 1) ==== 144+0+148 (crc 0 0 0) 0x7ff134018950 con 0x7ff13c013070 2024-09-13T19:16:17.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.734+0000 7ff140c0d640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e05455e070 con 0x55e054550e50 2024-09-13T19:16:17.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.734+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(81 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff12c051070 con 0x55e054550e50 2024-09-13T19:16:17.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.734+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e05455e070 con 0x55e054550e50 2024-09-13T19:16:17.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.734+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== osd_op_reply(82 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff12c051070 con 0x55e054550e50 2024-09-13T19:16:17.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.734+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e05455e070 con 0x55e054555860 2024-09-13T19:16:17.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.734+0000 7ff14140e640 1 -- 172.21.15.102:0/128548214 <== osd.3 v2:172.21.15.102:6800/3096737090 23 ==== osd_op_reply(83 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff13c027020 con 0x55e054555860 2024-09-13T19:16:17.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.734+0000 7ff14140e640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e05455e070 con 0x7ff13c013070 2024-09-13T19:16:17.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.734+0000 7ff140c0d640 1 -- 172.21.15.102:0/128548214 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(84 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff134018950 con 0x7ff13c013070 2024-09-13T19:16:17.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.734+0000 7ff140c0d640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e05455e070 con 0x7ff134059040 2024-09-13T19:16:17.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.735+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.0 v2:172.21.15.53:6800/4021716951 22 ==== osd_op_reply(85 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff12c051070 con 0x7ff134059040 2024-09-13T19:16:17.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.735+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e05455e070 con 0x55e054550e50 2024-09-13T19:16:17.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.735+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(86 [pgnls start_epoch 34 out=49b] v34'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff12c051070 con 0x55e054550e50 2024-09-13T19:16:17.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.735+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e05455e070 con 0x7ff134059040 2024-09-13T19:16:17.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.736+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.0 v2:172.21.15.53:6800/4021716951 23 ==== osd_op_reply(87 [pgnls start_epoch 34 out=49b] v34'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff12c051070 con 0x7ff134059040 2024-09-13T19:16:17.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.736+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e05455e070 con 0x55e054555860 2024-09-13T19:16:17.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.736+0000 7ff14140e640 1 -- 172.21.15.102:0/128548214 <== osd.3 v2:172.21.15.102:6800/3096737090 24 ==== osd_op_reply(88 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff13c027020 con 0x55e054555860 2024-09-13T19:16:17.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.736+0000 7ff14140e640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e05455e070 con 0x7ff13c013070 2024-09-13T19:16:17.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.736+0000 7ff140c0d640 1 -- 172.21.15.102:0/128548214 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(89 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff134018950 con 0x7ff13c013070 2024-09-13T19:16:17.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.736+0000 7ff140c0d640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e05455e070 con 0x7ff134059040 2024-09-13T19:16:17.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.737+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.0 v2:172.21.15.53:6800/4021716951 24 ==== osd_op_reply(90 [pgnls start_epoch 34 out=49b] v34'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff12c051070 con 0x7ff134059040 2024-09-13T19:16:17.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.737+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e05455e070 con 0x55e054550e50 2024-09-13T19:16:17.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.737+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.1 v2:172.21.15.102:6808/2204418452 28 ==== osd_op_reply(91 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff12c051070 con 0x55e054550e50 2024-09-13T19:16:17.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.737+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e05455e070 con 0x55e054555860 2024-09-13T19:16:17.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.737+0000 7ff14140e640 1 -- 172.21.15.102:0/128548214 <== osd.3 v2:172.21.15.102:6800/3096737090 25 ==== osd_op_reply(92 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff13c027020 con 0x55e054555860 2024-09-13T19:16:17.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.737+0000 7ff14140e640 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e05455e070 con 0x7ff13c013070 2024-09-13T19:16:17.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.737+0000 7ff140c0d640 1 -- 172.21.15.102:0/128548214 <== osd.2 v2:172.21.15.102:6816/2238176080 16 ==== osd_op_reply(93 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff134018950 con 0x7ff13c013070 2024-09-13T19:16:17.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.737+0000 7ff143119800 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 2024-09-13T19:16:17.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.737+0000 7ff143119800 20 RGWRados::pool_iterate: got myfoo 2024-09-13T19:16:17.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.738+0000 7feff77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:17.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.738+0000 7ff143119800 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94421975964064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e05455c340 con 0x55e054550e50 2024-09-13T19:16:17.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.739+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.1 v2:172.21.15.102:6808/2204418452 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94421975964064] v34'95 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff12c051070 con 0x55e054550e50 2024-09-13T19:16:17.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.739+0000 7ff143119800 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94421975938832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e054559470 con 0x7ff13c013070 2024-09-13T19:16:17.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.742+0000 7ff140c0d640 1 -- 172.21.15.102:0/128548214 <== osd.2 v2:172.21.15.102:6816/2238176080 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94421975938832] v34'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff134018950 con 0x7ff13c013070 2024-09-13T19:16:17.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.742+0000 7ff143119800 20 remove_watcher() i=0 2024-09-13T19:16:17.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.742+0000 7ff143119800 2 removed watcher, disabling cache 2024-09-13T19:16:17.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.742+0000 7ff143119800 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94421975944592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e054559470 con 0x55e054550e50 2024-09-13T19:16:17.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.743+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.1 v2:172.21.15.102:6808/2204418452 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94421975944592] v34'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff12c051070 con 0x55e054550e50 2024-09-13T19:16:17.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.743+0000 7ff143119800 20 remove_watcher() i=1 2024-09-13T19:16:17.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.743+0000 7ff143119800 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94421975946800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e054559470 con 0x55e054555860 2024-09-13T19:16:17.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.744+0000 7ff14140e640 1 -- 172.21.15.102:0/128548214 <== osd.3 v2:172.21.15.102:6800/3096737090 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94421975946800] v34'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff13c027020 con 0x55e054555860 2024-09-13T19:16:17.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.744+0000 7ff143119800 20 remove_watcher() i=2 2024-09-13T19:16:17.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.744+0000 7ff143119800 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94421975948368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e054595d30 con 0x7ff13c013070 2024-09-13T19:16:17.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.745+0000 7ff140c0d640 1 -- 172.21.15.102:0/128548214 <== osd.2 v2:172.21.15.102:6816/2238176080 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94421975948368] v34'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff13406b040 con 0x7ff13c013070 2024-09-13T19:16:17.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.745+0000 7ff143119800 20 remove_watcher() i=3 2024-09-13T19:16:17.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.745+0000 7ff143119800 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94421975954816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e054595d30 con 0x55e054550e50 2024-09-13T19:16:17.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.746+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.1 v2:172.21.15.102:6808/2204418452 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94421975954816] v34'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff12c051070 con 0x55e054550e50 2024-09-13T19:16:17.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.746+0000 7ff143119800 20 remove_watcher() i=4 2024-09-13T19:16:17.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.746+0000 7ff143119800 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94421975958592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e054595d30 con 0x7ff134059040 2024-09-13T19:16:17.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.747+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.0 v2:172.21.15.53:6800/4021716951 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94421975958592] v34'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff12c051070 con 0x7ff134059040 2024-09-13T19:16:17.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.747+0000 7ff143119800 20 remove_watcher() i=5 2024-09-13T19:16:17.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.747+0000 7ff143119800 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94421975957024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e054595d30 con 0x7ff134059040 2024-09-13T19:16:17.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.748+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.0 v2:172.21.15.53:6800/4021716951 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94421975957024] v34'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff12c051070 con 0x7ff134059040 2024-09-13T19:16:17.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.748+0000 7ff143119800 20 remove_watcher() i=6 2024-09-13T19:16:17.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.748+0000 7ff143119800 1 -- 172.21.15.102:0/128548214 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94421975962320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e054595d30 con 0x7ff134059040 2024-09-13T19:16:17.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.749+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 <== osd.0 v2:172.21.15.53:6800/4021716951 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94421975962320] v34'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff12c051070 con 0x7ff134059040 2024-09-13T19:16:17.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.749+0000 7ff143119800 20 remove_watcher() i=7 2024-09-13T19:16:17.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.749+0000 7ff143119800 1 -- 172.21.15.102:0/128548214 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7ff134059040 msgr2=0x7ff134024420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.749+0000 7ff143119800 1 --2- 172.21.15.102:0/128548214 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7ff134059040 0x7ff134024420 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.749+0000 7ff143119800 1 -- 172.21.15.102:0/128548214 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e054550e50 msgr2=0x55e054553310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.749+0000 7ff143119800 1 --2- 172.21.15.102:0/128548214 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e054550e50 0x55e054553310 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.749+0000 7ff143119800 1 -- 172.21.15.102:0/128548214 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7ff13c013070 msgr2=0x7ff13c04b480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.749+0000 7ff143119800 1 --2- 172.21.15.102:0/128548214 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7ff13c013070 0x7ff13c04b480 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.749+0000 7ff143119800 1 -- 172.21.15.102:0/128548214 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e054555860 msgr2=0x55e054557c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.749+0000 7ff143119800 1 --2- 172.21.15.102:0/128548214 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e054555860 0x55e054557c50 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.749+0000 7ff143119800 1 -- 172.21.15.102:0/128548214 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff00c036b90 msgr2=0x7ff00c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.749+0000 7ff143119800 1 --2- 172.21.15.102:0/128548214 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff00c036b90 0x7ff00c039050 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff134044480 tx=0x7ff134039000 comp rx=0 tx=0).stop 2024-09-13T19:16:17.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.749+0000 7ff143119800 1 -- 172.21.15.102:0/128548214 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e05453df30 msgr2=0x55e054545330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.749+0000 7ff143119800 1 --2- 172.21.15.102:0/128548214 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e05453df30 0x55e054545330 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff13c04cd00 tx=0x7ff13c04cd30 comp rx=0 tx=0).stop 2024-09-13T19:16:17.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.749+0000 7ff13bfff640 1 -- 172.21.15.102:0/128548214 reap_dead start 2024-09-13T19:16:17.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.749+0000 7ff143119800 1 -- 172.21.15.102:0/128548214 shutdown_connections 2024-09-13T19:16:17.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.749+0000 7ff143119800 1 --2- 172.21.15.102:0/128548214 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e05453df30 0x55e054545330 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.749+0000 7ff143119800 1 -- 172.21.15.102:0/128548214 >> 172.21.15.102:0/128548214 conn(0x55e05453a240 msgr2=0x55e054538300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:17.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.749+0000 7ff143119800 1 -- 172.21.15.102:0/128548214 shutdown_connections 2024-09-13T19:16:17.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.750+0000 7ff143119800 1 -- 172.21.15.102:0/128548214 wait complete. 2024-09-13T19:16:17.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.750+0000 7ff143119800 1 -- 172.21.15.102:0/1057325602 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff018036b90 msgr2=0x7ff018039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.750+0000 7ff143119800 1 --2- 172.21.15.102:0/1057325602 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff018036b90 0x7ff018039050 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x55e05451e340 tx=0x7ff134024ec0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.750+0000 7ff143119800 1 -- 172.21.15.102:0/1057325602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e054531220 msgr2=0x55e054531640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.750+0000 7ff143119800 1 --2- 172.21.15.102:0/1057325602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e054531220 0x55e054531640 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x55e05451de40 tx=0x7ff13c0163e0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.750+0000 7ff143119800 1 -- 172.21.15.102:0/1057325602 shutdown_connections 2024-09-13T19:16:17.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.750+0000 7ff143119800 1 --2- 172.21.15.102:0/1057325602 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff018036b90 0x7ff018039050 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.750+0000 7ff143119800 1 --2- 172.21.15.102:0/1057325602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e054531220 0x55e054531640 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.750+0000 7ff143119800 1 -- 172.21.15.102:0/1057325602 >> 172.21.15.102:0/1057325602 conn(0x55e0545261b0 msgr2=0x55e054528d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:17.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.750+0000 7ff143119800 1 -- 172.21.15.102:0/1057325602 shutdown_connections 2024-09-13T19:16:17.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.750+0000 7ff143119800 1 -- 172.21.15.102:0/1057325602 wait complete. 2024-09-13T19:16:17.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.750+0000 7ff143119800 1 -- 172.21.15.102:0/3918571549 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e054423d80 msgr2=0x55e05451d500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.750+0000 7ff143119800 1 --2- 172.21.15.102:0/3918571549 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e054423d80 0x55e05451d500 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.750+0000 7ff143119800 1 -- 172.21.15.102:0/3918571549 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e05451fd90 msgr2=0x55e054522180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.750+0000 7ff143119800 1 --2- 172.21.15.102:0/3918571549 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e05451fd90 0x55e054522180 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.750+0000 7ff143119800 1 -- 172.21.15.102:0/3918571549 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff028036b90 msgr2=0x7ff028039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.750+0000 7ff143119800 1 --2- 172.21.15.102:0/3918571549 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff028036b90 0x7ff028039050 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff12c057000 tx=0x7ff12c052000 comp rx=0 tx=0).stop 2024-09-13T19:16:17.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.750+0000 7ff143119800 1 -- 172.21.15.102:0/3918571549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e054391600 msgr2=0x55e054516490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:17.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.750+0000 7ff143119800 1 --2- 172.21.15.102:0/3918571549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e054391600 0x55e054516490 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff13400b7c0 tx=0x7ff134000ed0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.750+0000 7ff143119800 1 -- 172.21.15.102:0/3918571549 shutdown_connections 2024-09-13T19:16:17.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.750+0000 7ff143119800 1 --2- 172.21.15.102:0/3918571549 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e05451fd90 0x55e054522180 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.750+0000 7ff143119800 1 --2- 172.21.15.102:0/3918571549 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e054423d80 0x55e05451d500 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.750+0000 7ff143119800 1 --2- 172.21.15.102:0/3918571549 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff028036b90 0x7ff028039050 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.750+0000 7ff143119800 1 --2- 172.21.15.102:0/3918571549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e054391600 0x55e054516490 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:17.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.750+0000 7ff143119800 1 -- 172.21.15.102:0/3918571549 >> 172.21.15.102:0/3918571549 conn(0x55e054417dd0 msgr2=0x55e054508cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:17.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.750+0000 7ff143119800 1 -- 172.21.15.102:0/3918571549 shutdown_connections 2024-09-13T19:16:17.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.750+0000 7ff143119800 1 -- 172.21.15.102:0/3918571549 wait complete. 2024-09-13T19:16:17.774 INFO:teuthology.orchestra.run.smithi102.stdout:["myfoo"] 2024-09-13T19:16:17.775 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-13T19:16:17.785 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:16:17.796 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:16:17.808 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:16:17.875 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2024-09-13T19:16:17.903 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:16:17.929 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:16:17.957 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:16:17.957 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-13T19:16:17.957 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-13T19:16:17.957 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-13T19:16:18.002 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:18.002 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:18.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.999+0000 7fddff8b7800 1 Processor -- start 2024-09-13T19:16:18.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.999+0000 7fddff8b7800 1 -- start start 2024-09-13T19:16:18.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.999+0000 7fddff8b7800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x557d4ca18d00 0x557d4ca1b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.999+0000 7fddff8b7800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557d4c8d1b30 con 0x557d4c985df0 2024-09-13T19:16:18.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:17.999+0000 7fddff8b7800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x557d4c8b3360 con 0x557d4ca18d00 2024-09-13T19:16:18.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.000+0000 7fddf7fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x557d4ca18d00 0x557d4ca1b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.000+0000 7fddfd3ab640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x557d4c985df0 0x557d4ca175e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:49976/0 (socket says 172.21.15.102:49976) 2024-09-13T19:16:18.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.000+0000 7fddfd3ab640 1 -- 172.21.15.102:0/3774020026 learned_addr learned my addr 172.21.15.102:0/3774020026 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:16:18.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.000+0000 7fddf7fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x557d4ca18d00 0x557d4ca1b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55046/0 (socket says 172.21.15.102:55046) 2024-09-13T19:16:18.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.000+0000 7fddf7fff640 1 -- 172.21.15.102:0/3774020026 >> v1:172.21.15.53:6789/0 conn(0x557d4c985df0 legacy=0x557d4ca175e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.000+0000 7fddf7fff640 1 -- 172.21.15.102:0/3774020026 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d4c8d9e00 con 0x557d4ca18d00 2024-09-13T19:16:18.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.002+0000 7fddf7fff640 1 --2- 172.21.15.102:0/3774020026 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d4ca18d00 0x557d4ca1b0f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fdde800a470 tx=0x7fdde8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf916d1b6ae201da server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.002+0000 7fddfcbaa640 1 -- 172.21.15.102:0/3774020026 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdde8053570 con 0x557d4ca18d00 2024-09-13T19:16:18.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.002+0000 7fddfcbaa640 1 -- 172.21.15.102:0/3774020026 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdde8058070 con 0x557d4ca18d00 2024-09-13T19:16:18.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.002+0000 7fddfcbaa640 1 -- 172.21.15.102:0/3774020026 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdde8053880 con 0x557d4ca18d00 2024-09-13T19:16:18.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.002+0000 7fddff8b7800 1 -- 172.21.15.102:0/3774020026 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d4ca18d00 msgr2=0x557d4ca1b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.002+0000 7fddff8b7800 1 --2- 172.21.15.102:0/3774020026 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d4ca18d00 0x557d4ca1b0f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fdde800a470 tx=0x7fdde8045a20 comp rx=0 tx=0).stop 2024-09-13T19:16:18.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.002+0000 7fddff8b7800 1 -- 172.21.15.102:0/3774020026 shutdown_connections 2024-09-13T19:16:18.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.002+0000 7fddff8b7800 1 --2- 172.21.15.102:0/3774020026 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d4ca18d00 0x557d4ca1b0f0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.002+0000 7fddff8b7800 1 -- 172.21.15.102:0/3774020026 >> 172.21.15.102:0/3774020026 conn(0x557d4ca0cdf0 msgr2=0x557d4ca0f210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:18.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.003+0000 7fddff8b7800 1 -- 172.21.15.102:0/3774020026 shutdown_connections 2024-09-13T19:16:18.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.003+0000 7fddff8b7800 1 -- 172.21.15.102:0/3774020026 wait complete. 2024-09-13T19:16:18.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.016+0000 7fddff8b7800 1 Processor -- start 2024-09-13T19:16:18.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.016+0000 7fddff8b7800 1 -- start start 2024-09-13T19:16:18.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.016+0000 7fddff8b7800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d4c985df0 0x557d4cb03a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.016+0000 7fddff8b7800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557d4c95e330 con 0x557d4c985df0 2024-09-13T19:16:18.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.017+0000 7fddfd3ab640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d4c985df0 0x557d4cb03a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.017+0000 7fddfd3ab640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d4c985df0 0x557d4cb03a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55048/0 (socket says 172.21.15.102:55048) 2024-09-13T19:16:18.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.017+0000 7fddfd3ab640 1 -- 172.21.15.102:0/916976424 learned_addr learned my addr 172.21.15.102:0/916976424 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:18.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.017+0000 7fddfd3ab640 1 -- 172.21.15.102:0/916976424 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d4c8abbc0 con 0x557d4c985df0 2024-09-13T19:16:18.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.017+0000 7fddfd3ab640 1 --2- 172.21.15.102:0/916976424 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d4c985df0 0x557d4cb03a60 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fddf0001e10 tx=0x7fddf000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63d2d4e13de25aad server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.018+0000 7fdceb606640 1 -- 172.21.15.102:0/916976424 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddf0012020 con 0x557d4c985df0 2024-09-13T19:16:18.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.018+0000 7fdceb606640 1 -- 172.21.15.102:0/916976424 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddf000e5a0 con 0x557d4c985df0 2024-09-13T19:16:18.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.018+0000 7fdceb606640 1 -- 172.21.15.102:0/916976424 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddf000e8e0 con 0x557d4c985df0 2024-09-13T19:16:18.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.018+0000 7fddff8b7800 1 -- 172.21.15.102:0/916976424 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d4c985df0 msgr2=0x557d4cb03a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.018+0000 7fddff8b7800 1 --2- 172.21.15.102:0/916976424 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d4c985df0 0x557d4cb03a60 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fddf0001e10 tx=0x7fddf000b780 comp rx=0 tx=0).stop 2024-09-13T19:16:18.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.018+0000 7fddff8b7800 1 -- 172.21.15.102:0/916976424 shutdown_connections 2024-09-13T19:16:18.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.018+0000 7fddff8b7800 1 --2- 172.21.15.102:0/916976424 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d4c985df0 0x557d4cb03a60 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.018+0000 7fddff8b7800 1 -- 172.21.15.102:0/916976424 >> 172.21.15.102:0/916976424 conn(0x557d4ca0cdf0 msgr2=0x557d4caff420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:18.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.018+0000 7fddff8b7800 1 -- 172.21.15.102:0/916976424 shutdown_connections 2024-09-13T19:16:18.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.018+0000 7fddff8b7800 1 -- 172.21.15.102:0/916976424 wait complete. 2024-09-13T19:16:18.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.019+0000 7fddff8b7800 1 Processor -- start 2024-09-13T19:16:18.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.019+0000 7fddff8b7800 1 -- start start 2024-09-13T19:16:18.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.019+0000 7fddff8b7800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d4c985df0 0x557d4cb0b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.019+0000 7fddff8b7800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557d4ca1b900 con 0x557d4c985df0 2024-09-13T19:16:18.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.019+0000 7fddfd3ab640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d4c985df0 0x557d4cb0b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.019+0000 7fddfd3ab640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d4c985df0 0x557d4cb0b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55050/0 (socket says 172.21.15.102:55050) 2024-09-13T19:16:18.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.019+0000 7fddfd3ab640 1 -- 172.21.15.102:0/3320362087 learned_addr learned my addr 172.21.15.102:0/3320362087 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:18.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.019+0000 7fddfd3ab640 1 -- 172.21.15.102:0/3320362087 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d4c8bffe0 con 0x557d4c985df0 2024-09-13T19:16:18.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.019+0000 7fddfd3ab640 1 --2- 172.21.15.102:0/3320362087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d4c985df0 0x557d4cb0b440 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fddf000b7c0 tx=0x7fddf0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.020+0000 7fdce9e03640 1 -- 172.21.15.102:0/3320362087 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddf0012030 con 0x557d4c985df0 2024-09-13T19:16:18.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.020+0000 7fdce9e03640 1 -- 172.21.15.102:0/3320362087 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddf0001470 con 0x557d4c985df0 2024-09-13T19:16:18.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.020+0000 7fddff8b7800 1 -- 172.21.15.102:0/3320362087 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d4cb0b980 con 0x557d4c985df0 2024-09-13T19:16:18.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.020+0000 7fdce9e03640 1 -- 172.21.15.102:0/3320362087 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddf001a8d0 con 0x557d4c985df0 2024-09-13T19:16:18.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.020+0000 7fddff8b7800 1 -- 172.21.15.102:0/3320362087 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d4cb0bea0 con 0x557d4c985df0 2024-09-13T19:16:18.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.021+0000 7fdce9e03640 1 -- 172.21.15.102:0/3320362087 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fddf0015020 con 0x557d4c985df0 2024-09-13T19:16:18.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.021+0000 7fdce9e03640 1 --2- 172.21.15.102:0/3320362087 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdce4036b90 0x7fdce4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.021+0000 7fdce9e03640 1 -- 172.21.15.102:0/3320362087 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fddf0020030 con 0x557d4c985df0 2024-09-13T19:16:18.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.021+0000 7fddf7fff640 1 --2- 172.21.15.102:0/3320362087 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdce4036b90 0x7fdce4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.021+0000 7fddff8b7800 1 --2- 172.21.15.102:0/3320362087 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557d4ca18d00 0x557d4cb124b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.021+0000 7fddff8b7800 1 -- 172.21.15.102:0/3320362087 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb12a40 con 0x557d4ca18d00 2024-09-13T19:16:18.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.021+0000 7fddfdbac640 1 --2- 172.21.15.102:0/3320362087 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557d4ca18d00 0x557d4cb124b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.021+0000 7fddf7fff640 1 --2- 172.21.15.102:0/3320362087 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdce4036b90 0x7fdce4039050 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdde8057000 tx=0x7fdde8052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.021+0000 7fddfdbac640 1 --2- 172.21.15.102:0/3320362087 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557d4ca18d00 0x557d4cb124b0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.022+0000 7fddfdbac640 1 -- 172.21.15.102:0/3320362087 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fddf800a4a0 con 0x557d4ca18d00 2024-09-13T19:16:18.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.022+0000 7fddff8b7800 1 -- 172.21.15.102:0/3320362087 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb0fa80 con 0x557d4ca18d00 2024-09-13T19:16:18.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.022+0000 7fddfdbac640 1 -- 172.21.15.102:0/3320362087 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fddf800a4a0 con 0x557d4ca18d00 2024-09-13T19:16:18.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.022+0000 7fddff8b7800 1 --2- 172.21.15.102:0/3320362087 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x557d4cb14d90 0x557d4cb17180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.022+0000 7fddff8b7800 1 -- 172.21.15.102:0/3320362087 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb17870 con 0x557d4cb14d90 2024-09-13T19:16:18.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.022+0000 7fddfd3ab640 1 --2- 172.21.15.102:0/3320362087 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x557d4cb14d90 0x557d4cb17180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.022+0000 7fddfd3ab640 1 --2- 172.21.15.102:0/3320362087 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x557d4cb14d90 0x557d4cb17180 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.023+0000 7fddfd3ab640 1 -- 172.21.15.102:0/3320362087 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fddf0018950 con 0x557d4cb14d90 2024-09-13T19:16:18.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.023+0000 7fddff8b7800 1 -- 172.21.15.102:0/3320362087 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb13c30 con 0x557d4ca18d00 2024-09-13T19:16:18.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.023+0000 7fddfdbac640 1 -- 172.21.15.102:0/3320362087 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fddf800a4a0 con 0x557d4ca18d00 2024-09-13T19:16:18.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.023+0000 7fddff8b7800 1 -- 172.21.15.102:0/3320362087 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb14110 con 0x557d4cb14d90 2024-09-13T19:16:18.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.023+0000 7fddfd3ab640 1 -- 172.21.15.102:0/3320362087 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fddf0018950 con 0x557d4cb14d90 2024-09-13T19:16:18.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.023+0000 7fddff8b7800 1 Processor -- start 2024-09-13T19:16:18.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.024+0000 7fddff8b7800 1 -- start start 2024-09-13T19:16:18.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.024+0000 7fddff8b7800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d4cb261f0 0x557d4cb26610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.024+0000 7fddff8b7800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557d4c8ad580 con 0x557d4cb261f0 2024-09-13T19:16:18.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.024+0000 7fddfdbac640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d4cb261f0 0x557d4cb26610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.024+0000 7fddfdbac640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d4cb261f0 0x557d4cb26610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55058/0 (socket says 172.21.15.102:55058) 2024-09-13T19:16:18.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.024+0000 7fddfdbac640 1 -- 172.21.15.102:0/1663910863 learned_addr learned my addr 172.21.15.102:0/1663910863 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:18.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.024+0000 7fddfdbac640 1 -- 172.21.15.102:0/1663910863 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d4cb26b50 con 0x557d4cb261f0 2024-09-13T19:16:18.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.025+0000 7fddfdbac640 1 --2- 172.21.15.102:0/1663910863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d4cb261f0 0x557d4cb26610 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x557d4cb12e40 tx=0x7fddf80163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.025+0000 7fdce2ffd640 1 -- 172.21.15.102:0/1663910863 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddf8013450 con 0x557d4cb261f0 2024-09-13T19:16:18.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.025+0000 7fdce2ffd640 1 -- 172.21.15.102:0/1663910863 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddf80135f0 con 0x557d4cb261f0 2024-09-13T19:16:18.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.025+0000 7fddff8b7800 1 -- 172.21.15.102:0/1663910863 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d4cb26de0 con 0x557d4cb261f0 2024-09-13T19:16:18.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.025+0000 7fdce2ffd640 1 -- 172.21.15.102:0/1663910863 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddf80138d0 con 0x557d4cb261f0 2024-09-13T19:16:18.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.025+0000 7fddff8b7800 1 -- 172.21.15.102:0/1663910863 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d4cb29ac0 con 0x557d4cb261f0 2024-09-13T19:16:18.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.026+0000 7fdce2ffd640 1 -- 172.21.15.102:0/1663910863 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fddf8011040 con 0x557d4cb261f0 2024-09-13T19:16:18.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.026+0000 7fdce2ffd640 1 --2- 172.21.15.102:0/1663910863 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdcd4036c00 0x7fdcd40390c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.026+0000 7fdce2ffd640 1 -- 172.21.15.102:0/1663910863 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fddf800e040 con 0x557d4cb261f0 2024-09-13T19:16:18.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.026+0000 7fddfd3ab640 1 --2- 172.21.15.102:0/1663910863 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdcd4036c00 0x7fdcd40390c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.026+0000 7fddff8b7800 1 Processor -- start 2024-09-13T19:16:18.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.026+0000 7fddff8b7800 1 -- start start 2024-09-13T19:16:18.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.026+0000 7fddfd3ab640 1 --2- 172.21.15.102:0/1663910863 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdcd4036c00 0x7fdcd40390c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fddf0016fd0 tx=0x7fddf0024ec0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.026+0000 7fddff8b7800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d4cb32ef0 0x557d4cb332f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.026+0000 7fddff8b7800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557d4cb04210 con 0x557d4cb32ef0 2024-09-13T19:16:18.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.027+0000 7fddfdbac640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d4cb32ef0 0x557d4cb332f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.027+0000 7fddfdbac640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d4cb32ef0 0x557d4cb332f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55074/0 (socket says 172.21.15.102:55074) 2024-09-13T19:16:18.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.027+0000 7fddfdbac640 1 -- 172.21.15.102:0/1535609515 learned_addr learned my addr 172.21.15.102:0/1535609515 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:18.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.027+0000 7fddfdbac640 1 -- 172.21.15.102:0/1535609515 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d4cb338c0 con 0x557d4cb32ef0 2024-09-13T19:16:18.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.027+0000 7fddfdbac640 1 --2- 172.21.15.102:0/1535609515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d4cb32ef0 0x557d4cb332f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fddf802a020 tx=0x7fddf804cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29cc88573ee49c52 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.027+0000 7fdce0ff9640 1 -- 172.21.15.102:0/1535609515 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddf804a070 con 0x557d4cb32ef0 2024-09-13T19:16:18.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.027+0000 7fdce0ff9640 1 -- 172.21.15.102:0/1535609515 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddf802a570 con 0x557d4cb32ef0 2024-09-13T19:16:18.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.027+0000 7fdce0ff9640 1 -- 172.21.15.102:0/1535609515 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddf801f4c0 con 0x557d4cb32ef0 2024-09-13T19:16:18.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.028+0000 7fddff8b7800 1 -- 172.21.15.102:0/1535609515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d4cb32ef0 msgr2=0x557d4cb332f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.028+0000 7fddff8b7800 1 --2- 172.21.15.102:0/1535609515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d4cb32ef0 0x557d4cb332f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fddf802a020 tx=0x7fddf804cf90 comp rx=0 tx=0).stop 2024-09-13T19:16:18.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.028+0000 7fddff8b7800 1 -- 172.21.15.102:0/1535609515 shutdown_connections 2024-09-13T19:16:18.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.028+0000 7fddff8b7800 1 --2- 172.21.15.102:0/1535609515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d4cb32ef0 0x557d4cb332f0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.028+0000 7fddff8b7800 1 -- 172.21.15.102:0/1535609515 >> 172.21.15.102:0/1535609515 conn(0x557d4cb2f250 msgr2=0x557d4cb2d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:18.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.028+0000 7fddff8b7800 1 -- 172.21.15.102:0/1535609515 shutdown_connections 2024-09-13T19:16:18.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.028+0000 7fddff8b7800 1 -- 172.21.15.102:0/1535609515 wait complete. 2024-09-13T19:16:18.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.028+0000 7fddff8b7800 1 Processor -- start 2024-09-13T19:16:18.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.028+0000 7fddff8b7800 1 -- start start 2024-09-13T19:16:18.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.028+0000 7fddff8b7800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d4cb32ef0 0x557d4cb3a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.028+0000 7fddff8b7800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557d4cb33e90 con 0x557d4cb32ef0 2024-09-13T19:16:18.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.028+0000 7fddfdbac640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d4cb32ef0 0x557d4cb3a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.028+0000 7fddfdbac640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d4cb32ef0 0x557d4cb3a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55082/0 (socket says 172.21.15.102:55082) 2024-09-13T19:16:18.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.028+0000 7fddfdbac640 1 -- 172.21.15.102:0/1174428336 learned_addr learned my addr 172.21.15.102:0/1174428336 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:18.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.028+0000 7fddfdbac640 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d4cb3a8a0 con 0x557d4cb32ef0 2024-09-13T19:16:18.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.029+0000 7fddfdbac640 1 --2- 172.21.15.102:0/1174428336 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d4cb32ef0 0x557d4cb3a360 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fddf802ac70 tx=0x7fddf804cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.029+0000 7fdcd2ffd640 1 -- 172.21.15.102:0/1174428336 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddf801f710 con 0x557d4cb32ef0 2024-09-13T19:16:18.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.029+0000 7fdcd2ffd640 1 -- 172.21.15.102:0/1174428336 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddf8039070 con 0x557d4cb32ef0 2024-09-13T19:16:18.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.029+0000 7fdcd2ffd640 1 -- 172.21.15.102:0/1174428336 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddf801f9e0 con 0x557d4cb32ef0 2024-09-13T19:16:18.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.029+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d4cb3ab30 con 0x557d4cb32ef0 2024-09-13T19:16:18.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.029+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d4cb3d7e0 con 0x557d4cb32ef0 2024-09-13T19:16:18.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.029+0000 7fdcd2ffd640 1 -- 172.21.15.102:0/1174428336 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fddf8033070 con 0x557d4cb32ef0 2024-09-13T19:16:18.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.030+0000 7fdcd2ffd640 1 --2- 172.21.15.102:0/1174428336 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdcc8036b90 0x7fdcc8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.030+0000 7fdcd2ffd640 1 -- 172.21.15.102:0/1174428336 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fddf8015420 con 0x557d4cb32ef0 2024-09-13T19:16:18.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.030+0000 7fddfd3ab640 1 --2- 172.21.15.102:0/1174428336 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdcc8036b90 0x7fdcc8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.030+0000 7fddff8b7800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.030+0000 7fddff8b7800 1 --2- 172.21.15.102:0/1174428336 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557d4cb45e20 0x557d4cb482e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.030+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb48a30 con 0x557d4cb45e20 2024-09-13T19:16:18.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.030+0000 7fddf7fff640 1 --2- 172.21.15.102:0/1174428336 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557d4cb45e20 0x557d4cb482e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.030+0000 7fddfd3ab640 1 --2- 172.21.15.102:0/1174428336 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdcc8036b90 0x7fdcc8039050 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fddf001a6f0 tx=0x7fddf0039000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.031+0000 7fddf7fff640 1 --2- 172.21.15.102:0/1174428336 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557d4cb45e20 0x557d4cb482e0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.031+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdde8051070 con 0x557d4cb45e20 2024-09-13T19:16:18.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.031+0000 7fddff8b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:18.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.031+0000 7fddff8b7800 20 realm 2024-09-13T19:16:18.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.031+0000 7fddff8b7800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.031+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb48e60 con 0x557d4cb45e20 2024-09-13T19:16:18.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.031+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdde8051070 con 0x557d4cb45e20 2024-09-13T19:16:18.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.031+0000 7fddff8b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:18.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.031+0000 7fddff8b7800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:18.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.031+0000 7fddff8b7800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.031+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb49730 con 0x557d4cb45e20 2024-09-13T19:16:18.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.031+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdde8051070 con 0x557d4cb45e20 2024-09-13T19:16:18.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.031+0000 7fddff8b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:18.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.031+0000 7fddff8b7800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.031+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb49ad0 con 0x557d4cb45e20 2024-09-13T19:16:18.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.031+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdde8051070 con 0x557d4cb45e20 2024-09-13T19:16:18.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.031+0000 7fddff8b7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:18.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.031+0000 7fddff8b7800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.031+0000 7fddff8b7800 1 --2- 172.21.15.102:0/1174428336 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x557d4cb4a830 0x557d4cb4cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.031+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb4d160 con 0x557d4cb4a830 2024-09-13T19:16:18.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.032+0000 7fddfdbac640 1 --2- 172.21.15.102:0/1174428336 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x557d4cb4a830 0x557d4cb4cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.032+0000 7fddfdbac640 1 --2- 172.21.15.102:0/1174428336 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x557d4cb4a830 0x557d4cb4cc20 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.032+0000 7fddfdbac640 1 -- 172.21.15.102:0/1174428336 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fddf8027020 con 0x557d4cb4a830 2024-09-13T19:16:18.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.032+0000 7fddff8b7800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:18.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.032+0000 7fddff8b7800 20 searching for the correct realm 2024-09-13T19:16:18.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.032+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb4ead0 con 0x557d4cb4a830 2024-09-13T19:16:18.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.032+0000 7fddfdbac640 1 -- 172.21.15.102:0/1174428336 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddf8027020 con 0x557d4cb4a830 2024-09-13T19:16:18.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.032+0000 7fddfdbac640 1 --2- 172.21.15.102:0/1174428336 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fddf8059040 0x7fddf8012550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.032+0000 7fddfdbac640 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb4ead0 con 0x7fddf8059040 2024-09-13T19:16:18.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.032+0000 7fddfd3ab640 1 --2- 172.21.15.102:0/1174428336 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fddf8059040 0x7fddf8012550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.033+0000 7fddfd3ab640 1 --2- 172.21.15.102:0/1174428336 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fddf8059040 0x7fddf8012550 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.033+0000 7fddfd3ab640 1 -- 172.21.15.102:0/1174428336 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddf0018950 con 0x7fddf8059040 2024-09-13T19:16:18.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.033+0000 7fddfd3ab640 1 --2- 172.21.15.102:0/1174428336 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fddf0059040 0x7fddf004c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.033+0000 7fddfd3ab640 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb4ead0 con 0x7fddf0059040 2024-09-13T19:16:18.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.033+0000 7fddf7fff640 1 --2- 172.21.15.102:0/1174428336 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fddf0059040 0x7fddf004c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.034+0000 7fddf7fff640 1 --2- 172.21.15.102:0/1174428336 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fddf0059040 0x7fddf004c050 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.034+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdde8051070 con 0x7fddf0059040 2024-09-13T19:16:18.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.034+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb4ead0 con 0x557d4cb45e20 2024-09-13T19:16:18.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.034+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdde8051070 con 0x557d4cb45e20 2024-09-13T19:16:18.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.034+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb4ead0 con 0x557d4cb45e20 2024-09-13T19:16:18.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.034+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdde8051070 con 0x557d4cb45e20 2024-09-13T19:16:18.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.034+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb4ead0 con 0x7fddf0059040 2024-09-13T19:16:18.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.034+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdde8051070 con 0x7fddf0059040 2024-09-13T19:16:18.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.034+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb4ead0 con 0x7fddf0059040 2024-09-13T19:16:18.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.035+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdde8051070 con 0x7fddf0059040 2024-09-13T19:16:18.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.035+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb4ead0 con 0x7fddf8059040 2024-09-13T19:16:18.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.035+0000 7fddfd3ab640 1 -- 172.21.15.102:0/1174428336 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddf0018950 con 0x7fddf8059040 2024-09-13T19:16:18.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.035+0000 7fddfd3ab640 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb4ead0 con 0x557d4cb4a830 2024-09-13T19:16:18.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.035+0000 7fddfdbac640 1 -- 172.21.15.102:0/1174428336 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddf8027020 con 0x557d4cb4a830 2024-09-13T19:16:18.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.035+0000 7fddfdbac640 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb4ead0 con 0x557d4cb45e20 2024-09-13T19:16:18.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.035+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdde8051070 con 0x557d4cb45e20 2024-09-13T19:16:18.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.035+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb4ead0 con 0x7fddf0059040 2024-09-13T19:16:18.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.036+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdde8051070 con 0x7fddf0059040 2024-09-13T19:16:18.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.036+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb4ead0 con 0x557d4cb45e20 2024-09-13T19:16:18.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.036+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdde8051070 con 0x557d4cb45e20 2024-09-13T19:16:18.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.036+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb4ead0 con 0x7fddf8059040 2024-09-13T19:16:18.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.036+0000 7fddfd3ab640 1 -- 172.21.15.102:0/1174428336 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fddf0018950 con 0x7fddf8059040 2024-09-13T19:16:18.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.036+0000 7fddfd3ab640 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb4ead0 con 0x557d4cb4a830 2024-09-13T19:16:18.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.036+0000 7fddfdbac640 1 -- 172.21.15.102:0/1174428336 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddf8027020 con 0x557d4cb4a830 2024-09-13T19:16:18.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.036+0000 7fddfdbac640 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb4ead0 con 0x557d4cb4a830 2024-09-13T19:16:18.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.036+0000 7fddfdbac640 1 -- 172.21.15.102:0/1174428336 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fddf8027020 con 0x557d4cb4a830 2024-09-13T19:16:18.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.036+0000 7fddfdbac640 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb4ead0 con 0x7fddf0059040 2024-09-13T19:16:18.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.037+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdde8051070 con 0x7fddf0059040 2024-09-13T19:16:18.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.037+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb4ead0 con 0x557d4cb4a830 2024-09-13T19:16:18.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.037+0000 7fddfdbac640 1 -- 172.21.15.102:0/1174428336 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fddf8027020 con 0x557d4cb4a830 2024-09-13T19:16:18.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.037+0000 7fddfdbac640 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb4ead0 con 0x557d4cb4a830 2024-09-13T19:16:18.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.037+0000 7fddfdbac640 1 -- 172.21.15.102:0/1174428336 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddf8027020 con 0x557d4cb4a830 2024-09-13T19:16:18.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.037+0000 7fddfdbac640 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb4ead0 con 0x557d4cb45e20 2024-09-13T19:16:18.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.037+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdde8051070 con 0x557d4cb45e20 2024-09-13T19:16:18.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.037+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb4ead0 con 0x557d4cb45e20 2024-09-13T19:16:18.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.037+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdde8051070 con 0x557d4cb45e20 2024-09-13T19:16:18.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.037+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb4ead0 con 0x7fddf0059040 2024-09-13T19:16:18.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.038+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdde8051070 con 0x7fddf0059040 2024-09-13T19:16:18.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.038+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb4ead0 con 0x557d4cb4a830 2024-09-13T19:16:18.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.038+0000 7fddfdbac640 1 -- 172.21.15.102:0/1174428336 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddf8027020 con 0x557d4cb4a830 2024-09-13T19:16:18.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.038+0000 7fddfdbac640 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb4ead0 con 0x7fddf8059040 2024-09-13T19:16:18.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.038+0000 7fddfd3ab640 1 -- 172.21.15.102:0/1174428336 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddf0018950 con 0x7fddf8059040 2024-09-13T19:16:18.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.038+0000 7fddfd3ab640 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb4ead0 con 0x557d4cb45e20 2024-09-13T19:16:18.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.038+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdde8051070 con 0x557d4cb45e20 2024-09-13T19:16:18.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.038+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb4ead0 con 0x7fddf0059040 2024-09-13T19:16:18.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.039+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdde8051070 con 0x7fddf0059040 2024-09-13T19:16:18.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.039+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb4ead0 con 0x557d4cb4a830 2024-09-13T19:16:18.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.039+0000 7fddfdbac640 1 -- 172.21.15.102:0/1174428336 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddf8027020 con 0x557d4cb4a830 2024-09-13T19:16:18.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.039+0000 7fddfdbac640 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb4ead0 con 0x7fddf0059040 2024-09-13T19:16:18.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.039+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdde8051070 con 0x7fddf0059040 2024-09-13T19:16:18.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.039+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fdde8086040 con 0x7fddf8059040 2024-09-13T19:16:18.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.039+0000 7fddfd3ab640 1 -- 172.21.15.102:0/1174428336 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddf0018950 con 0x7fddf8059040 2024-09-13T19:16:18.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.039+0000 7fddfd3ab640 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fdde8086040 con 0x557d4cb4a830 2024-09-13T19:16:18.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.040+0000 7fddfdbac640 1 -- 172.21.15.102:0/1174428336 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddf8027020 con 0x557d4cb4a830 2024-09-13T19:16:18.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.040+0000 7fddfdbac640 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fdde8086040 con 0x7fddf0059040 2024-09-13T19:16:18.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.040+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdde8051070 con 0x7fddf0059040 2024-09-13T19:16:18.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.040+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fdde8086040 con 0x557d4cb45e20 2024-09-13T19:16:18.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.040+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdde8051070 con 0x557d4cb45e20 2024-09-13T19:16:18.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.040+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fdde8086040 con 0x7fddf8059040 2024-09-13T19:16:18.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.040+0000 7fddfd3ab640 1 -- 172.21.15.102:0/1174428336 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddf0018950 con 0x7fddf8059040 2024-09-13T19:16:18.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.040+0000 7fddff8b7800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:18.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.040+0000 7fddff8b7800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:18.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.040+0000 7fddff8b7800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:18.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.040+0000 7fddff8b7800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:18.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.040+0000 7fddff8b7800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:18.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.040+0000 7fddff8b7800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:18.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.040+0000 7fddff8b7800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.040+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb4dbd0 con 0x557d4cb45e20 2024-09-13T19:16:18.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.041+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdde8051070 con 0x557d4cb45e20 2024-09-13T19:16:18.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.041+0000 7fddff8b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:18.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.041+0000 7fddff8b7800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.041+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb4e470 con 0x557d4cb45e20 2024-09-13T19:16:18.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.041+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdde8051070 con 0x557d4cb45e20 2024-09-13T19:16:18.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.041+0000 7fddff8b7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:18.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.041+0000 7fddff8b7800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.041+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb4d810 con 0x557d4cb4a830 2024-09-13T19:16:18.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.041+0000 7fddfdbac640 1 -- 172.21.15.102:0/1174428336 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fddf8027020 con 0x557d4cb4a830 2024-09-13T19:16:18.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.041+0000 7fddff8b7800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:18.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.041+0000 7fddff8b7800 20 zone default found 2024-09-13T19:16:18.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.041+0000 7fddff8b7800 4 Realm: () 2024-09-13T19:16:18.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.041+0000 7fddff8b7800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:18.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.041+0000 7fddff8b7800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:18.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.041+0000 7fddff8b7800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:18.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.041+0000 7fddff8b7800 20 zonegroup default 2024-09-13T19:16:18.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.041+0000 7fddff8b7800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.041+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb4f450 con 0x7fddf0059040 2024-09-13T19:16:18.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.042+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdde8051070 con 0x7fddf0059040 2024-09-13T19:16:18.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.042+0000 7fddff8b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:18.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.042+0000 7fddff8b7800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.042+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb50f20 con 0x557d4cb4a830 2024-09-13T19:16:18.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.042+0000 7fddfdbac640 1 -- 172.21.15.102:0/1174428336 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fddf8027020 con 0x557d4cb4a830 2024-09-13T19:16:18.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.042+0000 7fddff8b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:18.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.042+0000 7fddff8b7800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.042+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb513c0 con 0x557d4cb4a830 2024-09-13T19:16:18.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.042+0000 7fddfdbac640 1 -- 172.21.15.102:0/1174428336 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fddf8027020 con 0x557d4cb4a830 2024-09-13T19:16:18.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.042+0000 7fddff8b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:18.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.042+0000 7fddff8b7800 20 started sync module instance, tier type = 2024-09-13T19:16:18.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.042+0000 7fddff8b7800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:18.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.042+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb4fe20 con 0x7fddf8059040 2024-09-13T19:16:18.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.043+0000 7fddfd3ab640 1 -- 172.21.15.102:0/1174428336 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(44 notify.0 [create] v34'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddf0018950 con 0x7fddf8059040 2024-09-13T19:16:18.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.043+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93996646203968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb51cd0 con 0x7fddf8059040 2024-09-13T19:16:18.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.043+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb52520 con 0x557d4cb45e20 2024-09-13T19:16:18.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.044+0000 7fddfd3ab640 1 -- 172.21.15.102:0/1174428336 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93996646203968] v34'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddf0018950 con 0x7fddf8059040 2024-09-13T19:16:18.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.045+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v34'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdde8051070 con 0x557d4cb45e20 2024-09-13T19:16:18.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.045+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93996646209568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb525c0 con 0x557d4cb45e20 2024-09-13T19:16:18.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.045+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb530e0 con 0x557d4cb4a830 2024-09-13T19:16:18.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.046+0000 7fddfdbac640 1 -- 172.21.15.102:0/1174428336 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v34'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddf8027020 con 0x557d4cb4a830 2024-09-13T19:16:18.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.046+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93996646214576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb530a0 con 0x557d4cb4a830 2024-09-13T19:16:18.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.046+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb540c0 con 0x7fddf8059040 2024-09-13T19:16:18.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.046+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93996646209568] v34'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdde8051070 con 0x557d4cb45e20 2024-09-13T19:16:18.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.047+0000 7fddfdbac640 1 -- 172.21.15.102:0/1174428336 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93996646214576] v34'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddf8027020 con 0x557d4cb4a830 2024-09-13T19:16:18.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.047+0000 7fddfd3ab640 1 -- 172.21.15.102:0/1174428336 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(50 notify.3 [create] v34'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddf0018950 con 0x7fddf8059040 2024-09-13T19:16:18.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.047+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93996646216912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb540c0 con 0x7fddf8059040 2024-09-13T19:16:18.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.047+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb54960 con 0x557d4cb45e20 2024-09-13T19:16:18.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.048+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v34'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdde8051070 con 0x557d4cb45e20 2024-09-13T19:16:18.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.048+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93996646220976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb54d80 con 0x557d4cb45e20 2024-09-13T19:16:18.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.048+0000 7fddfd3ab640 1 -- 172.21.15.102:0/1174428336 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93996646216912] v34'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddf0018950 con 0x7fddf8059040 2024-09-13T19:16:18.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.048+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb55120 con 0x7fddf0059040 2024-09-13T19:16:18.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.049+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(54 notify.5 [create] v34'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdde8051070 con 0x7fddf0059040 2024-09-13T19:16:18.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.049+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93996646223232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb55650 con 0x7fddf0059040 2024-09-13T19:16:18.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.049+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb56010 con 0x7fddf0059040 2024-09-13T19:16:18.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.049+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93996646220976] v34'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdde8051070 con 0x557d4cb45e20 2024-09-13T19:16:18.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.050+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93996646223232] v34'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdde8051070 con 0x7fddf0059040 2024-09-13T19:16:18.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.050+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(56 notify.6 [create] v34'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdde8051070 con 0x7fddf0059040 2024-09-13T19:16:18.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.050+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93996646224288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb555c0 con 0x7fddf0059040 2024-09-13T19:16:18.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.050+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb564c0 con 0x7fddf0059040 2024-09-13T19:16:18.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.051+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93996646224288] v34'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdde8051070 con 0x7fddf0059040 2024-09-13T19:16:18.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.051+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(58 notify.7 [create] v34'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdde8051070 con 0x7fddf0059040 2024-09-13T19:16:18.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.051+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93996646226784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb56430 con 0x7fddf0059040 2024-09-13T19:16:18.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.051+0000 7fddff8b7800 20 add_watcher() i=0 2024-09-13T19:16:18.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.051+0000 7fddff8b7800 20 add_watcher() i=1 2024-09-13T19:16:18.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.051+0000 7fddff8b7800 20 add_watcher() i=2 2024-09-13T19:16:18.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.051+0000 7fddff8b7800 20 add_watcher() i=3 2024-09-13T19:16:18.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.051+0000 7fddff8b7800 20 add_watcher() i=4 2024-09-13T19:16:18.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.051+0000 7fddff8b7800 20 add_watcher() i=5 2024-09-13T19:16:18.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.051+0000 7fddff8b7800 20 add_watcher() i=6 2024-09-13T19:16:18.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.052+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93996646226784] v34'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdde8051070 con 0x7fddf0059040 2024-09-13T19:16:18.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.052+0000 7fddff8b7800 20 add_watcher() i=7 2024-09-13T19:16:18.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.052+0000 7fddff8b7800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:18.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.052+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb59890 con 0x557d4cb45e20 2024-09-13T19:16:18.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.052+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdde8051070 con 0x557d4cb45e20 2024-09-13T19:16:18.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.052+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93996646228304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb56db0 con 0x557d4cb45e20 2024-09-13T19:16:18.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.053+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93996646228304] v34'96 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdde8051070 con 0x557d4cb45e20 2024-09-13T19:16:18.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.053+0000 7fdcb37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:18.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.053+0000 7fddff8b7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:18.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.053+0000 7fddff8b7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:18.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.053+0000 7fddff8b7800 5 note: GC not initialized 2024-09-13T19:16:18.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.054+0000 7fdcb27e4640 20 reqs_thread_entry: start 2024-09-13T19:16:18.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.054+0000 7fddff8b7800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:18.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.054+0000 7fddff8b7800 20 Filter name: none 2024-09-13T19:16:18.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.054+0000 7fdc23fff640 20 reqs_thread_entry: start 2024-09-13T19:16:18.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.054+0000 7fddff8b7800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.054+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb8cb60 con 0x7fddf8059040 2024-09-13T19:16:18.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.054+0000 7fddfd3ab640 1 -- 172.21.15.102:0/1174428336 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv2 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fddf0018950 con 0x7fddf8059040 2024-09-13T19:16:18.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.054+0000 7fddff8b7800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:16:18.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.054+0000 7fddff8b7800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.055+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:63 8.9 8:917ee2d5:root::.bucket.meta.myfoo%3a509740b4-c081-4f37-bd6d-df9ca851489b.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb8d4d0 con 0x7fddf8059040 2024-09-13T19:16:18.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.055+0000 7fddfd3ab640 1 -- 172.21.15.102:0/1174428336 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(63 .bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fddf0018950 con 0x7fddf8059040 2024-09-13T19:16:18.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.055+0000 7fddff8b7800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:16:18.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.055+0000 7fddff8b7800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T19:16:18.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.055+0000 7fddff8b7800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.055+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb8d480 con 0x7fddf8059040 2024-09-13T19:16:18.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.055+0000 7fddfd3ab640 1 -- 172.21.15.102:0/1174428336 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv2 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fddf0018950 con 0x7fddf8059040 2024-09-13T19:16:18.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.055+0000 7fddff8b7800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:16:18.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.055+0000 7fddff8b7800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.055+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:65 8.9 8:917ee2d5:root::.bucket.meta.myfoo%3a509740b4-c081-4f37-bd6d-df9ca851489b.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb8d4d0 con 0x7fddf8059040 2024-09-13T19:16:18.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.056+0000 7fddfd3ab640 1 -- 172.21.15.102:0/1174428336 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(65 .bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fddf0018950 con 0x7fddf8059040 2024-09-13T19:16:18.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.056+0000 7fddff8b7800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:16:18.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.056+0000 7fddff8b7800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T19:16:18.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.056+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:66 4.3e 4:7eb89d75:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb90280 con 0x7fddf8059040 2024-09-13T19:16:18.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.056+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:67 4.28 4:16845d32:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb92cb0 con 0x557d4cb45e20 2024-09-13T19:16:18.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.056+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:68 4.e 4:7015f333:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb95610 con 0x7fddf8059040 2024-09-13T19:16:18.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.056+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:69 4.31 4:8e14c63f:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb92cb0 con 0x557d4cb45e20 2024-09-13T19:16:18.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.056+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:70 4.1f 4:fb695182:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb9a6f0 con 0x557d4cb4a830 2024-09-13T19:16:18.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.056+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:71 4.22 4:475c4288:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb9d580 con 0x557d4cb45e20 2024-09-13T19:16:18.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.056+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:72 4.8 4:102eb403:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d4cba0410 con 0x557d4cb4a830 2024-09-13T19:16:18.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.056+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:73 4.3d 4:be2d5322:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d4cba0410 con 0x557d4cb4a830 2024-09-13T19:16:18.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.056+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:74 4.8 4:130dc037:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d4cba51d0 con 0x557d4cb4a830 2024-09-13T19:16:18.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.056+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:75 4.32 4:4c01988a:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d4cba7a40 con 0x557d4cb45e20 2024-09-13T19:16:18.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.056+0000 7fddfd3ab640 1 -- 172.21.15.102:0/1174428336 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(66 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fddf0018950 con 0x7fddf8059040 2024-09-13T19:16:18.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.056+0000 7fddfd3ab640 1 -- 172.21.15.102:0/1174428336 <== osd.2 v2:172.21.15.102:6816/2238176080 16 ==== osd_op_reply(68 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fddf0018950 con 0x7fddf8059040 2024-09-13T19:16:18.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.056+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:76 4.1c 4:3b6ce2a2:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb8ee40 con 0x7fddf0059040 2024-09-13T19:16:18.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.056+0000 7fddfdbac640 1 -- 172.21.15.102:0/1174428336 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(70 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fddf8027020 con 0x557d4cb4a830 2024-09-13T19:16:18.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.056+0000 7fddfdbac640 1 -- 172.21.15.102:0/1174428336 <== osd.3 v2:172.21.15.102:6800/3096737090 17 ==== osd_op_reply(73 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fddf8027020 con 0x557d4cb4a830 2024-09-13T19:16:18.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.057+0000 7fddfdbac640 1 -- 172.21.15.102:0/1174428336 <== osd.3 v2:172.21.15.102:6800/3096737090 18 ==== osd_op_reply(72 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fddf8027020 con 0x557d4cb4a830 2024-09-13T19:16:18.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.057+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(67 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdde8051070 con 0x557d4cb45e20 2024-09-13T19:16:18.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.057+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(69 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdde8051070 con 0x557d4cb45e20 2024-09-13T19:16:18.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.057+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(71 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdde8051070 con 0x557d4cb45e20 2024-09-13T19:16:18.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.057+0000 7fddfdbac640 1 -- 172.21.15.102:0/1174428336 <== osd.3 v2:172.21.15.102:6800/3096737090 19 ==== osd_op_reply(74 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.8 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fddf8027020 con 0x557d4cb4a830 2024-09-13T19:16:18.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.057+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(75 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdde8051070 con 0x557d4cb45e20 2024-09-13T19:16:18.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.057+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(76 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fdde8051070 con 0x7fddf0059040 2024-09-13T19:16:18.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.058+0000 7fdcb37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:18.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.058+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93996646228304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb8ee40 con 0x557d4cb45e20 2024-09-13T19:16:18.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.059+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 93996646228304] v34'97 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdde8051070 con 0x557d4cb45e20 2024-09-13T19:16:18.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.059+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93996646203968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb8a5c0 con 0x7fddf8059040 2024-09-13T19:16:18.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.060+0000 7fddfd3ab640 1 -- 172.21.15.102:0/1174428336 <== osd.2 v2:172.21.15.102:6816/2238176080 17 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 93996646203968] v34'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddf0018950 con 0x7fddf8059040 2024-09-13T19:16:18.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.060+0000 7fddff8b7800 20 remove_watcher() i=0 2024-09-13T19:16:18.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.060+0000 7fddff8b7800 2 removed watcher, disabling cache 2024-09-13T19:16:18.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.060+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93996646209568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb8a5c0 con 0x557d4cb45e20 2024-09-13T19:16:18.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.061+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 93996646209568] v34'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdde8051070 con 0x557d4cb45e20 2024-09-13T19:16:18.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.061+0000 7fddff8b7800 20 remove_watcher() i=1 2024-09-13T19:16:18.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.061+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93996646214576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb8a5c0 con 0x557d4cb4a830 2024-09-13T19:16:18.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.062+0000 7fddfdbac640 1 -- 172.21.15.102:0/1174428336 <== osd.3 v2:172.21.15.102:6800/3096737090 20 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 93996646214576] v34'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddf8027020 con 0x557d4cb4a830 2024-09-13T19:16:18.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.062+0000 7fddff8b7800 20 remove_watcher() i=2 2024-09-13T19:16:18.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.062+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93996646216912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb8a5c0 con 0x7fddf8059040 2024-09-13T19:16:18.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.063+0000 7fddfd3ab640 1 -- 172.21.15.102:0/1174428336 <== osd.2 v2:172.21.15.102:6816/2238176080 18 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 93996646216912] v34'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddf0018950 con 0x7fddf8059040 2024-09-13T19:16:18.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.063+0000 7fddff8b7800 20 remove_watcher() i=3 2024-09-13T19:16:18.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.063+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93996646220976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb8a5c0 con 0x557d4cb45e20 2024-09-13T19:16:18.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.064+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 93996646220976] v34'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdde8051070 con 0x557d4cb45e20 2024-09-13T19:16:18.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.064+0000 7fddff8b7800 20 remove_watcher() i=4 2024-09-13T19:16:18.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.064+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93996646223232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb8a5c0 con 0x7fddf0059040 2024-09-13T19:16:18.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.065+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 93996646223232] v34'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdde8051070 con 0x7fddf0059040 2024-09-13T19:16:18.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.065+0000 7fddff8b7800 20 remove_watcher() i=5 2024-09-13T19:16:18.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.065+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93996646224288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb8a5c0 con 0x7fddf0059040 2024-09-13T19:16:18.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.066+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 93996646224288] v34'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdde8051070 con 0x7fddf0059040 2024-09-13T19:16:18.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.066+0000 7fddff8b7800 20 remove_watcher() i=6 2024-09-13T19:16:18.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.066+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93996646226784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d4cb8a5c0 con 0x7fddf0059040 2024-09-13T19:16:18.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.067+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 <== osd.0 v2:172.21.15.53:6800/4021716951 20 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 93996646226784] v34'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdde8051070 con 0x7fddf0059040 2024-09-13T19:16:18.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.067+0000 7fddff8b7800 20 remove_watcher() i=7 2024-09-13T19:16:18.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.067+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fddf0059040 msgr2=0x7fddf004c050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.067+0000 7fddff8b7800 1 --2- 172.21.15.102:0/1174428336 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fddf0059040 0x7fddf004c050 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.067+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557d4cb45e20 msgr2=0x557d4cb482e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.067+0000 7fddff8b7800 1 --2- 172.21.15.102:0/1174428336 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557d4cb45e20 0x557d4cb482e0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.067+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fddf8059040 msgr2=0x7fddf8012550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.067+0000 7fddff8b7800 1 --2- 172.21.15.102:0/1174428336 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fddf8059040 0x7fddf8012550 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.067+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x557d4cb4a830 msgr2=0x557d4cb4cc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.067+0000 7fddff8b7800 1 --2- 172.21.15.102:0/1174428336 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x557d4cb4a830 0x557d4cb4cc20 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.067+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdcc8036b90 msgr2=0x7fdcc8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.067+0000 7fddff8b7800 1 --2- 172.21.15.102:0/1174428336 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdcc8036b90 0x7fdcc8039050 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fddf001a6f0 tx=0x7fddf0039000 comp rx=0 tx=0).stop 2024-09-13T19:16:18.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.067+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d4cb32ef0 msgr2=0x557d4cb3a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.067+0000 7fddf7fff640 1 -- 172.21.15.102:0/1174428336 reap_dead start 2024-09-13T19:16:18.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.067+0000 7fddff8b7800 1 --2- 172.21.15.102:0/1174428336 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d4cb32ef0 0x557d4cb3a360 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fddf802ac70 tx=0x7fddf804cd20 comp rx=0 tx=0).stop 2024-09-13T19:16:18.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.067+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 shutdown_connections 2024-09-13T19:16:18.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.067+0000 7fddff8b7800 1 --2- 172.21.15.102:0/1174428336 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d4cb32ef0 0x557d4cb3a360 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.067+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 >> 172.21.15.102:0/1174428336 conn(0x557d4cb2f250 msgr2=0x557d4cb2d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:18.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.067+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 shutdown_connections 2024-09-13T19:16:18.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.067+0000 7fddff8b7800 1 -- 172.21.15.102:0/1174428336 wait complete. 2024-09-13T19:16:18.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.068+0000 7fddff8b7800 1 -- 172.21.15.102:0/1663910863 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdcd4036c00 msgr2=0x7fdcd40390c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.068+0000 7fddff8b7800 1 --2- 172.21.15.102:0/1663910863 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdcd4036c00 0x7fdcd40390c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fddf0016fd0 tx=0x7fddf0024ec0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.068+0000 7fddff8b7800 1 -- 172.21.15.102:0/1663910863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d4cb261f0 msgr2=0x557d4cb26610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.068+0000 7fddff8b7800 1 --2- 172.21.15.102:0/1663910863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d4cb261f0 0x557d4cb26610 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x557d4cb12e40 tx=0x7fddf80163e0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.068+0000 7fddff8b7800 1 -- 172.21.15.102:0/1663910863 shutdown_connections 2024-09-13T19:16:18.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.068+0000 7fddff8b7800 1 --2- 172.21.15.102:0/1663910863 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdcd4036c00 0x7fdcd40390c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.068+0000 7fddff8b7800 1 --2- 172.21.15.102:0/1663910863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d4cb261f0 0x557d4cb26610 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.068+0000 7fddff8b7800 1 -- 172.21.15.102:0/1663910863 >> 172.21.15.102:0/1663910863 conn(0x557d4cb1b180 msgr2=0x557d4cb1dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:18.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.068+0000 7fddff8b7800 1 -- 172.21.15.102:0/1663910863 shutdown_connections 2024-09-13T19:16:18.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.068+0000 7fddff8b7800 1 -- 172.21.15.102:0/1663910863 wait complete. 2024-09-13T19:16:18.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.068+0000 7fddff8b7800 1 -- 172.21.15.102:0/3320362087 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557d4ca18d00 msgr2=0x557d4cb124b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.068+0000 7fddff8b7800 1 --2- 172.21.15.102:0/3320362087 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557d4ca18d00 0x557d4cb124b0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.068+0000 7fddff8b7800 1 -- 172.21.15.102:0/3320362087 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x557d4cb14d90 msgr2=0x557d4cb17180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.068+0000 7fddff8b7800 1 --2- 172.21.15.102:0/3320362087 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x557d4cb14d90 0x557d4cb17180 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.068+0000 7fddff8b7800 1 -- 172.21.15.102:0/3320362087 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdce4036b90 msgr2=0x7fdce4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.068+0000 7fddff8b7800 1 --2- 172.21.15.102:0/3320362087 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdce4036b90 0x7fdce4039050 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdde8057000 tx=0x7fdde8052000 comp rx=0 tx=0).stop 2024-09-13T19:16:18.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.068+0000 7fddff8b7800 1 -- 172.21.15.102:0/3320362087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d4c985df0 msgr2=0x557d4cb0b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.068+0000 7fddff8b7800 1 --2- 172.21.15.102:0/3320362087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d4c985df0 0x557d4cb0b440 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fddf000b7c0 tx=0x7fddf0000ed0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.068+0000 7fddff8b7800 1 -- 172.21.15.102:0/3320362087 shutdown_connections 2024-09-13T19:16:18.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.068+0000 7fddff8b7800 1 --2- 172.21.15.102:0/3320362087 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x557d4cb14d90 0x557d4cb17180 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.068+0000 7fddff8b7800 1 --2- 172.21.15.102:0/3320362087 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557d4ca18d00 0x557d4cb124b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.068+0000 7fddff8b7800 1 --2- 172.21.15.102:0/3320362087 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdce4036b90 0x7fdce4039050 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.068+0000 7fddff8b7800 1 --2- 172.21.15.102:0/3320362087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d4c985df0 0x557d4cb0b440 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.068+0000 7fddff8b7800 1 -- 172.21.15.102:0/3320362087 >> 172.21.15.102:0/3320362087 conn(0x557d4ca0cdf0 msgr2=0x557d4cafdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:18.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.068+0000 7fddff8b7800 1 -- 172.21.15.102:0/3320362087 shutdown_connections 2024-09-13T19:16:18.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.068+0000 7fddff8b7800 1 -- 172.21.15.102:0/3320362087 wait complete. 2024-09-13T19:16:18.128 INFO:teuthology.orchestra.run.smithi102.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"f767d22e-a5e7-4349-a797-2de84f67e90b","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"509740b4-c081-4f37-bd6d-df9ca851489b.4237.1","marker":"509740b4-c081-4f37-bd6d-df9ca851489b.4237.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-13T19:16:17.496135Z","creation_time":"2024-09-13T19:16:17.492008Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-09-13T19:16:18.128 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'f767d22e-a5e7-4349-a797-2de84f67e90b', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '509740b4-c081-4f37-bd6d-df9ca851489b.4237.1', 'marker': '509740b4-c081-4f37-bd6d-df9ca851489b.4237.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T19:16:17.496135Z', 'creation_time': '2024-09-13T19:16:17.492008Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-13T19:16:18.129 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-13T19:16:18.129 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-13T19:16:18.129 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-13T19:16:18.174 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:18.174 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:18.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.171+0000 7f4da0e87800 1 Processor -- start 2024-09-13T19:16:18.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.171+0000 7f4da0e87800 1 -- start start 2024-09-13T19:16:18.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.171+0000 7f4da0e87800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x562963bd2550 0x562963bd2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.171+0000 7f4da0e87800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562963a92b30 con 0x562963bd2e90 2024-09-13T19:16:18.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.171+0000 7f4da0e87800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x562963a74360 con 0x562963bd2550 2024-09-13T19:16:18.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.172+0000 7f4d9e97b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x562963bd2550 0x562963bd2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.172+0000 7f4d9e97b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x562963bd2550 0x562963bd2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55086/0 (socket says 172.21.15.102:55086) 2024-09-13T19:16:18.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.172+0000 7f4d9617a640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x562963bd2e90 0x562963bd7a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:49980/0 (socket says 172.21.15.102:49980) 2024-09-13T19:16:18.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.172+0000 7f4d9e97b640 1 -- 172.21.15.102:0/4105703012 learned_addr learned my addr 172.21.15.102:0/4105703012 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:18.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.172+0000 7f4d9e97b640 1 -- 172.21.15.102:0/4105703012 >> v1:172.21.15.53:6789/0 conn(0x562963bd2e90 legacy=0x562963bd7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.172+0000 7f4d9e97b640 1 -- 172.21.15.102:0/4105703012 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562963a9ae00 con 0x562963bd2550 2024-09-13T19:16:18.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.174+0000 7f4d9e97b640 1 --2- 172.21.15.102:0/4105703012 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562963bd2550 0x562963bd2950 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4d9000a520 tx=0x7f4d90045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19f3ef89d417382a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.174+0000 7f4d9e17a640 1 -- 172.21.15.102:0/4105703012 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d90055070 con 0x562963bd2550 2024-09-13T19:16:18.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.174+0000 7f4d9e17a640 1 -- 172.21.15.102:0/4105703012 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d900515b0 con 0x562963bd2550 2024-09-13T19:16:18.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.174+0000 7f4d9e17a640 1 -- 172.21.15.102:0/4105703012 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d900518d0 con 0x562963bd2550 2024-09-13T19:16:18.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.174+0000 7f4da0e87800 1 -- 172.21.15.102:0/4105703012 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562963bd2550 msgr2=0x562963bd2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.174+0000 7f4da0e87800 1 --2- 172.21.15.102:0/4105703012 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562963bd2550 0x562963bd2950 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4d9000a520 tx=0x7f4d90045ba0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.174+0000 7f4da0e87800 1 -- 172.21.15.102:0/4105703012 shutdown_connections 2024-09-13T19:16:18.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.174+0000 7f4da0e87800 1 --2- 172.21.15.102:0/4105703012 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562963bd2550 0x562963bd2950 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.174+0000 7f4da0e87800 1 -- 172.21.15.102:0/4105703012 >> 172.21.15.102:0/4105703012 conn(0x562963bcdde0 msgr2=0x562963bd0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:18.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.174+0000 7f4da0e87800 1 -- 172.21.15.102:0/4105703012 shutdown_connections 2024-09-13T19:16:18.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.175+0000 7f4da0e87800 1 -- 172.21.15.102:0/4105703012 wait complete. 2024-09-13T19:16:18.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.188+0000 7f4da0e87800 1 Processor -- start 2024-09-13T19:16:18.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.188+0000 7f4da0e87800 1 -- start start 2024-09-13T19:16:18.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.189+0000 7f4da0e87800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562963bd2550 0x562963b475a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.189+0000 7f4da0e87800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562963b1f330 con 0x562963bd2550 2024-09-13T19:16:18.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.189+0000 7f4d9e97b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562963bd2550 0x562963b475a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.189+0000 7f4d9e97b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562963bd2550 0x562963b475a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55100/0 (socket says 172.21.15.102:55100) 2024-09-13T19:16:18.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.189+0000 7f4d9e97b640 1 -- 172.21.15.102:0/2474147077 learned_addr learned my addr 172.21.15.102:0/2474147077 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:18.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.189+0000 7f4d9e97b640 1 -- 172.21.15.102:0/2474147077 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562963a6cbc0 con 0x562963bd2550 2024-09-13T19:16:18.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.189+0000 7f4d9e97b640 1 --2- 172.21.15.102:0/2474147077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562963bd2550 0x562963b475a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4d90025da0 tx=0x7f4d90051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2f65f47cdfc2793 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.189+0000 7f4c8ce09640 1 -- 172.21.15.102:0/2474147077 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d90051950 con 0x562963bd2550 2024-09-13T19:16:18.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.190+0000 7f4c8ce09640 1 -- 172.21.15.102:0/2474147077 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d90051af0 con 0x562963bd2550 2024-09-13T19:16:18.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.190+0000 7f4c8ce09640 1 -- 172.21.15.102:0/2474147077 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d90051dd0 con 0x562963bd2550 2024-09-13T19:16:18.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.190+0000 7f4da0e87800 1 -- 172.21.15.102:0/2474147077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562963bd2550 msgr2=0x562963b475a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.190+0000 7f4da0e87800 1 --2- 172.21.15.102:0/2474147077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562963bd2550 0x562963b475a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4d90025da0 tx=0x7f4d90051000 comp rx=0 tx=0).stop 2024-09-13T19:16:18.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.190+0000 7f4da0e87800 1 -- 172.21.15.102:0/2474147077 shutdown_connections 2024-09-13T19:16:18.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.190+0000 7f4da0e87800 1 --2- 172.21.15.102:0/2474147077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562963bd2550 0x562963b475a0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.190+0000 7f4da0e87800 1 -- 172.21.15.102:0/2474147077 >> 172.21.15.102:0/2474147077 conn(0x562963bcdde0 msgr2=0x562963cbd150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:18.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.190+0000 7f4da0e87800 1 -- 172.21.15.102:0/2474147077 shutdown_connections 2024-09-13T19:16:18.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.190+0000 7f4da0e87800 1 -- 172.21.15.102:0/2474147077 wait complete. 2024-09-13T19:16:18.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.191+0000 7f4da0e87800 1 Processor -- start 2024-09-13T19:16:18.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.191+0000 7f4da0e87800 1 -- start start 2024-09-13T19:16:18.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.191+0000 7f4da0e87800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562963bd2550 0x562963cca150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.191+0000 7f4da0e87800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562963bd9570 con 0x562963bd2550 2024-09-13T19:16:18.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.191+0000 7f4d9e97b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562963bd2550 0x562963cca150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.191+0000 7f4d9e97b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562963bd2550 0x562963cca150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55108/0 (socket says 172.21.15.102:55108) 2024-09-13T19:16:18.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.191+0000 7f4d9e97b640 1 -- 172.21.15.102:0/1375265118 learned_addr learned my addr 172.21.15.102:0/1375265118 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:18.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.191+0000 7f4d9e97b640 1 -- 172.21.15.102:0/1375265118 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562963a80fe0 con 0x562963bd2550 2024-09-13T19:16:18.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.192+0000 7f4d9e97b640 1 --2- 172.21.15.102:0/1375265118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562963bd2550 0x562963cca150 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4d90067040 tx=0x7f4d90002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.192+0000 7f4c8b606640 1 -- 172.21.15.102:0/1375265118 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d90073070 con 0x562963bd2550 2024-09-13T19:16:18.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.192+0000 7f4c8b606640 1 -- 172.21.15.102:0/1375265118 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d9005a450 con 0x562963bd2550 2024-09-13T19:16:18.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.192+0000 7f4da0e87800 1 -- 172.21.15.102:0/1375265118 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562963cca690 con 0x562963bd2550 2024-09-13T19:16:18.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.192+0000 7f4c8b606640 1 -- 172.21.15.102:0/1375265118 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d9005a730 con 0x562963bd2550 2024-09-13T19:16:18.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.192+0000 7f4da0e87800 1 -- 172.21.15.102:0/1375265118 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562963ccac10 con 0x562963bd2550 2024-09-13T19:16:18.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.193+0000 7f4c8b606640 1 -- 172.21.15.102:0/1375265118 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4d90076070 con 0x562963bd2550 2024-09-13T19:16:18.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.193+0000 7f4c8b606640 1 --2- 172.21.15.102:0/1375265118 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4c84036b40 0x7f4c84039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.193+0000 7f4c8b606640 1 -- 172.21.15.102:0/1375265118 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f4d90062070 con 0x562963bd2550 2024-09-13T19:16:18.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.193+0000 7f4d9617a640 1 --2- 172.21.15.102:0/1375265118 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4c84036b40 0x7f4c84039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.193+0000 7f4da0e87800 1 --2- 172.21.15.102:0/1375265118 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x562963bd2e90 0x562963cd11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.193+0000 7f4da0e87800 1 -- 172.21.15.102:0/1375265118 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562963cd1740 con 0x562963bd2e90 2024-09-13T19:16:18.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.193+0000 7f4d9f17c640 1 --2- 172.21.15.102:0/1375265118 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x562963bd2e90 0x562963cd11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.193+0000 7f4d9617a640 1 --2- 172.21.15.102:0/1375265118 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4c84036b40 0x7f4c84039000 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4d88000f60 tx=0x7f4d88001370 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.193+0000 7f4d9f17c640 1 --2- 172.21.15.102:0/1375265118 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x562963bd2e90 0x562963cd11c0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.194+0000 7f4d9f17c640 1 -- 172.21.15.102:0/1375265118 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4d9800a4a0 con 0x562963bd2e90 2024-09-13T19:16:18.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.194+0000 7f4da0e87800 1 -- 172.21.15.102:0/1375265118 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562963cce790 con 0x562963bd2e90 2024-09-13T19:16:18.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.194+0000 7f4d9f17c640 1 -- 172.21.15.102:0/1375265118 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4d9800a4a0 con 0x562963bd2e90 2024-09-13T19:16:18.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.194+0000 7f4da0e87800 1 --2- 172.21.15.102:0/1375265118 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x562963cd3a70 0x562963cd5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.194+0000 7f4da0e87800 1 -- 172.21.15.102:0/1375265118 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562963cd6500 con 0x562963cd3a70 2024-09-13T19:16:18.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.194+0000 7f4d9e97b640 1 --2- 172.21.15.102:0/1375265118 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x562963cd3a70 0x562963cd5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.194+0000 7f4d9e97b640 1 --2- 172.21.15.102:0/1375265118 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x562963cd3a70 0x562963cd5e60 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.194+0000 7f4d9e97b640 1 -- 172.21.15.102:0/1375265118 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4d90075030 con 0x562963cd3a70 2024-09-13T19:16:18.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.195+0000 7f4da0e87800 1 -- 172.21.15.102:0/1375265118 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562963cd2910 con 0x562963bd2e90 2024-09-13T19:16:18.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.195+0000 7f4d9f17c640 1 -- 172.21.15.102:0/1375265118 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4d9800a4a0 con 0x562963bd2e90 2024-09-13T19:16:18.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.195+0000 7f4da0e87800 1 -- 172.21.15.102:0/1375265118 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562963cd2df0 con 0x562963cd3a70 2024-09-13T19:16:18.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.195+0000 7f4d9e97b640 1 -- 172.21.15.102:0/1375265118 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4d90075030 con 0x562963cd3a70 2024-09-13T19:16:18.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.195+0000 7f4da0e87800 1 Processor -- start 2024-09-13T19:16:18.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.196+0000 7f4da0e87800 1 -- start start 2024-09-13T19:16:18.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.196+0000 7f4da0e87800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562963cc2f70 0x562963cc15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.196+0000 7f4da0e87800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562963a6e580 con 0x562963cc2f70 2024-09-13T19:16:18.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.196+0000 7f4d9f17c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562963cc2f70 0x562963cc15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.196+0000 7f4d9f17c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562963cc2f70 0x562963cc15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55112/0 (socket says 172.21.15.102:55112) 2024-09-13T19:16:18.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.196+0000 7f4d9f17c640 1 -- 172.21.15.102:0/121007395 learned_addr learned my addr 172.21.15.102:0/121007395 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:18.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.196+0000 7f4d9f17c640 1 -- 172.21.15.102:0/121007395 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562963cc3390 con 0x562963cc2f70 2024-09-13T19:16:18.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.197+0000 7f4d9f17c640 1 --2- 172.21.15.102:0/121007395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562963cc2f70 0x562963cc15c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x562963ccb200 tx=0x7f4d980167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.197+0000 7f4c88e01640 1 -- 172.21.15.102:0/121007395 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d98013640 con 0x562963cc2f70 2024-09-13T19:16:18.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.197+0000 7f4da0e87800 1 -- 172.21.15.102:0/121007395 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562963cc1bc0 con 0x562963cc2f70 2024-09-13T19:16:18.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.197+0000 7f4c88e01640 1 -- 172.21.15.102:0/121007395 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d980137e0 con 0x562963cc2f70 2024-09-13T19:16:18.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.197+0000 7f4c88e01640 1 -- 172.21.15.102:0/121007395 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d98013ae0 con 0x562963cc2f70 2024-09-13T19:16:18.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.197+0000 7f4da0e87800 1 -- 172.21.15.102:0/121007395 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562963cc20c0 con 0x562963cc2f70 2024-09-13T19:16:18.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.198+0000 7f4c88e01640 1 -- 172.21.15.102:0/121007395 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4d98011040 con 0x562963cc2f70 2024-09-13T19:16:18.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.198+0000 7f4c88e01640 1 --2- 172.21.15.102:0/121007395 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4c78036bb0 0x7f4c78039070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.198+0000 7f4c88e01640 1 -- 172.21.15.102:0/121007395 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f4d9800e040 con 0x562963cc2f70 2024-09-13T19:16:18.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.198+0000 7f4d9e97b640 1 --2- 172.21.15.102:0/121007395 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4c78036bb0 0x7f4c78039070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.198+0000 7f4da0e87800 1 Processor -- start 2024-09-13T19:16:18.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.198+0000 7f4da0e87800 1 -- start start 2024-09-13T19:16:18.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.198+0000 7f4d9e97b640 1 --2- 172.21.15.102:0/121007395 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4c78036bb0 0x7f4c78039070 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4d900910b0 tx=0x7f4d9006f4a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.198+0000 7f4da0e87800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562963cf3d00 0x562963cf4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.199+0000 7f4da0e87800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562963cc56b0 con 0x562963cf3d00 2024-09-13T19:16:18.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.199+0000 7f4d9f17c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562963cf3d00 0x562963cf4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.199+0000 7f4d9f17c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562963cf3d00 0x562963cf4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55116/0 (socket says 172.21.15.102:55116) 2024-09-13T19:16:18.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.199+0000 7f4d9f17c640 1 -- 172.21.15.102:0/1951912416 learned_addr learned my addr 172.21.15.102:0/1951912416 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:18.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.199+0000 7f4d9f17c640 1 -- 172.21.15.102:0/1951912416 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562963cf46d0 con 0x562963cf3d00 2024-09-13T19:16:18.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.199+0000 7f4d9f17c640 1 --2- 172.21.15.102:0/1951912416 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562963cf3d00 0x562963cf4100 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4d9800afb0 tx=0x7f4d9801fd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d80809e98f68c814 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.199+0000 7f4c827fc640 1 -- 172.21.15.102:0/1951912416 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d9804a070 con 0x562963cf3d00 2024-09-13T19:16:18.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.199+0000 7f4c827fc640 1 -- 172.21.15.102:0/1951912416 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d9801f340 con 0x562963cf3d00 2024-09-13T19:16:18.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.199+0000 7f4c827fc640 1 -- 172.21.15.102:0/1951912416 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d98014cc0 con 0x562963cf3d00 2024-09-13T19:16:18.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.200+0000 7f4da0e87800 1 -- 172.21.15.102:0/1951912416 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562963cf3d00 msgr2=0x562963cf4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.200+0000 7f4da0e87800 1 --2- 172.21.15.102:0/1951912416 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562963cf3d00 0x562963cf4100 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4d9800afb0 tx=0x7f4d9801fd00 comp rx=0 tx=0).stop 2024-09-13T19:16:18.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.200+0000 7f4da0e87800 1 -- 172.21.15.102:0/1951912416 shutdown_connections 2024-09-13T19:16:18.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.200+0000 7f4da0e87800 1 --2- 172.21.15.102:0/1951912416 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562963cf3d00 0x562963cf4100 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.200+0000 7f4da0e87800 1 -- 172.21.15.102:0/1951912416 >> 172.21.15.102:0/1951912416 conn(0x562963cf00f0 msgr2=0x562963cee1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:18.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.200+0000 7f4da0e87800 1 -- 172.21.15.102:0/1951912416 shutdown_connections 2024-09-13T19:16:18.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.200+0000 7f4da0e87800 1 -- 172.21.15.102:0/1951912416 wait complete. 2024-09-13T19:16:18.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.200+0000 7f4da0e87800 1 Processor -- start 2024-09-13T19:16:18.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.200+0000 7f4da0e87800 1 -- start start 2024-09-13T19:16:18.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.200+0000 7f4da0e87800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562963cf3d00 0x562963cfb290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.200+0000 7f4da0e87800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562963cf4d10 con 0x562963cf3d00 2024-09-13T19:16:18.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.200+0000 7f4d9f17c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562963cf3d00 0x562963cfb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.200+0000 7f4d9f17c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562963cf3d00 0x562963cfb290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55126/0 (socket says 172.21.15.102:55126) 2024-09-13T19:16:18.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.200+0000 7f4d9f17c640 1 -- 172.21.15.102:0/3552122421 learned_addr learned my addr 172.21.15.102:0/3552122421 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:18.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.201+0000 7f4d9f17c640 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562963cfb7d0 con 0x562963cf3d00 2024-09-13T19:16:18.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.201+0000 7f4d9f17c640 1 --2- 172.21.15.102:0/3552122421 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562963cf3d00 0x562963cfb290 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4d9800a120 tx=0x7f4d9804cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.201+0000 7f4c80ff9640 1 -- 172.21.15.102:0/3552122421 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d9801f9f0 con 0x562963cf3d00 2024-09-13T19:16:18.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.201+0000 7f4c80ff9640 1 -- 172.21.15.102:0/3552122421 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d98040340 con 0x562963cf3d00 2024-09-13T19:16:18.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.201+0000 7f4c80ff9640 1 -- 172.21.15.102:0/3552122421 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d980205b0 con 0x562963cf3d00 2024-09-13T19:16:18.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.201+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562963cfba60 con 0x562963cf3d00 2024-09-13T19:16:18.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.201+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562963cfe710 con 0x562963cf3d00 2024-09-13T19:16:18.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.202+0000 7f4c80ff9640 1 -- 172.21.15.102:0/3552122421 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4d9804ebb0 con 0x562963cf3d00 2024-09-13T19:16:18.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.202+0000 7f4c80ff9640 1 --2- 172.21.15.102:0/3552122421 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4c68036b90 0x7f4c68039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.202+0000 7f4c80ff9640 1 -- 172.21.15.102:0/3552122421 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f4d9802f070 con 0x562963cf3d00 2024-09-13T19:16:18.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.202+0000 7f4d9e97b640 1 --2- 172.21.15.102:0/3552122421 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4c68036b90 0x7f4c68039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.202+0000 7f4da0e87800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.202+0000 7f4da0e87800 1 --2- 172.21.15.102:0/3552122421 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x562963d06cb0 0x562963d09170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.202+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562963d098c0 con 0x562963d06cb0 2024-09-13T19:16:18.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.202+0000 7f4d9617a640 1 --2- 172.21.15.102:0/3552122421 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x562963d06cb0 0x562963d09170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.202+0000 7f4d9e97b640 1 --2- 172.21.15.102:0/3552122421 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4c68036b90 0x7f4c68039050 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x562963cd1b90 tx=0x7f4d9008d000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.203+0000 7f4d9617a640 1 --2- 172.21.15.102:0/3552122421 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x562963d06cb0 0x562963d09170 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.203+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4d8800f610 con 0x562963d06cb0 2024-09-13T19:16:18.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.203+0000 7f4da0e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:18.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.203+0000 7f4da0e87800 20 realm 2024-09-13T19:16:18.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.203+0000 7f4da0e87800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.203+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562963d06100 con 0x562963d06cb0 2024-09-13T19:16:18.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.203+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4d8800f610 con 0x562963d06cb0 2024-09-13T19:16:18.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.203+0000 7f4da0e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:18.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.203+0000 7f4da0e87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:18.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.203+0000 7f4da0e87800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.203+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562963d0a3a0 con 0x562963d06cb0 2024-09-13T19:16:18.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.203+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4d8800f610 con 0x562963d06cb0 2024-09-13T19:16:18.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.203+0000 7f4da0e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:18.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.203+0000 7f4da0e87800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.203+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562963d0ac70 con 0x562963d06cb0 2024-09-13T19:16:18.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.203+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4d8800f610 con 0x562963d06cb0 2024-09-13T19:16:18.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.203+0000 7f4da0e87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:18.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.203+0000 7f4da0e87800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.203+0000 7f4da0e87800 1 --2- 172.21.15.102:0/3552122421 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x562963d0b520 0x562963d0d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.203+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562963d0e090 con 0x562963d0b520 2024-09-13T19:16:18.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.204+0000 7f4d9f17c640 1 --2- 172.21.15.102:0/3552122421 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x562963d0b520 0x562963d0d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.204+0000 7f4d9f17c640 1 --2- 172.21.15.102:0/3552122421 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x562963d0b520 0x562963d0d930 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.204+0000 7f4d9f17c640 1 -- 172.21.15.102:0/3552122421 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4d98038020 con 0x562963d0b520 2024-09-13T19:16:18.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.204+0000 7f4da0e87800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:18.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.204+0000 7f4da0e87800 20 searching for the correct realm 2024-09-13T19:16:18.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.204+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562963d0fac0 con 0x562963d0b520 2024-09-13T19:16:18.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.204+0000 7f4d9f17c640 1 -- 172.21.15.102:0/3552122421 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d98038020 con 0x562963d0b520 2024-09-13T19:16:18.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.204+0000 7f4d9f17c640 1 --2- 172.21.15.102:0/3552122421 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f4d98032030 0x7f4d980409f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.204+0000 7f4d9f17c640 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562963d0fac0 con 0x7f4d98032030 2024-09-13T19:16:18.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.204+0000 7f4d9e97b640 1 --2- 172.21.15.102:0/3552122421 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f4d98032030 0x7f4d980409f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.205+0000 7f4d9e97b640 1 --2- 172.21.15.102:0/3552122421 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f4d98032030 0x7f4d980409f0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.205+0000 7f4d9e97b640 1 -- 172.21.15.102:0/3552122421 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d90075030 con 0x7f4d98032030 2024-09-13T19:16:18.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.205+0000 7f4d9e97b640 1 --2- 172.21.15.102:0/3552122421 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f4d900a0070 0x7f4d9005a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.205+0000 7f4d9e97b640 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562963d0fac0 con 0x7f4d900a0070 2024-09-13T19:16:18.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.205+0000 7f4d9617a640 1 --2- 172.21.15.102:0/3552122421 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f4d900a0070 0x7f4d9005a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.205+0000 7f4d9617a640 1 --2- 172.21.15.102:0/3552122421 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f4d900a0070 0x7f4d9005a960 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.206+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d8800f610 con 0x7f4d900a0070 2024-09-13T19:16:18.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.206+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562963d0fac0 con 0x562963d06cb0 2024-09-13T19:16:18.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.206+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d8800f610 con 0x562963d06cb0 2024-09-13T19:16:18.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.206+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562963d0fac0 con 0x562963d06cb0 2024-09-13T19:16:18.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.206+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d8802b040 con 0x562963d06cb0 2024-09-13T19:16:18.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.206+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562963d0fac0 con 0x7f4d900a0070 2024-09-13T19:16:18.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.207+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d8802b040 con 0x7f4d900a0070 2024-09-13T19:16:18.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.207+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562963d0fac0 con 0x7f4d900a0070 2024-09-13T19:16:18.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.207+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d8802b040 con 0x7f4d900a0070 2024-09-13T19:16:18.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.207+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562963d0fac0 con 0x7f4d98032030 2024-09-13T19:16:18.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.207+0000 7f4d9e97b640 1 -- 172.21.15.102:0/3552122421 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d90075030 con 0x7f4d98032030 2024-09-13T19:16:18.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.207+0000 7f4d9e97b640 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562963d0fac0 con 0x562963d0b520 2024-09-13T19:16:18.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.207+0000 7f4d9f17c640 1 -- 172.21.15.102:0/3552122421 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d98038020 con 0x562963d0b520 2024-09-13T19:16:18.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.207+0000 7f4d9f17c640 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562963d0fac0 con 0x562963d06cb0 2024-09-13T19:16:18.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.207+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d8802b040 con 0x562963d06cb0 2024-09-13T19:16:18.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.207+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562963d0fac0 con 0x7f4d900a0070 2024-09-13T19:16:18.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.208+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d8802b040 con 0x7f4d900a0070 2024-09-13T19:16:18.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.208+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562963d0fac0 con 0x562963d06cb0 2024-09-13T19:16:18.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.208+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d8802b040 con 0x562963d06cb0 2024-09-13T19:16:18.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.208+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562963d0fac0 con 0x7f4d98032030 2024-09-13T19:16:18.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.208+0000 7f4d9e97b640 1 -- 172.21.15.102:0/3552122421 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4d900af040 con 0x7f4d98032030 2024-09-13T19:16:18.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.208+0000 7f4d9e97b640 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562963d0fac0 con 0x562963d0b520 2024-09-13T19:16:18.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.208+0000 7f4d9f17c640 1 -- 172.21.15.102:0/3552122421 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d98038020 con 0x562963d0b520 2024-09-13T19:16:18.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.208+0000 7f4d9f17c640 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562963d0fac0 con 0x562963d0b520 2024-09-13T19:16:18.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.209+0000 7f4d9f17c640 1 -- 172.21.15.102:0/3552122421 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4d98038020 con 0x562963d0b520 2024-09-13T19:16:18.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.209+0000 7f4d9f17c640 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562963d0fac0 con 0x7f4d900a0070 2024-09-13T19:16:18.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.209+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d8802b040 con 0x7f4d900a0070 2024-09-13T19:16:18.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.209+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562963d0fac0 con 0x562963d0b520 2024-09-13T19:16:18.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.209+0000 7f4d9f17c640 1 -- 172.21.15.102:0/3552122421 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4d98038020 con 0x562963d0b520 2024-09-13T19:16:18.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.209+0000 7f4d9f17c640 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562963d0fac0 con 0x562963d0b520 2024-09-13T19:16:18.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.209+0000 7f4d9f17c640 1 -- 172.21.15.102:0/3552122421 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d98038020 con 0x562963d0b520 2024-09-13T19:16:18.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.209+0000 7f4d9f17c640 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562963d0fac0 con 0x562963d06cb0 2024-09-13T19:16:18.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.210+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d8802b040 con 0x562963d06cb0 2024-09-13T19:16:18.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.210+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562963d0fac0 con 0x562963d06cb0 2024-09-13T19:16:18.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.210+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4d8802b040 con 0x562963d06cb0 2024-09-13T19:16:18.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.210+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562963d0fac0 con 0x7f4d900a0070 2024-09-13T19:16:18.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.210+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d8802b040 con 0x7f4d900a0070 2024-09-13T19:16:18.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.210+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562963d0fac0 con 0x562963d0b520 2024-09-13T19:16:18.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.211+0000 7f4d9f17c640 1 -- 172.21.15.102:0/3552122421 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d98038020 con 0x562963d0b520 2024-09-13T19:16:18.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.211+0000 7f4d9f17c640 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562963d0fac0 con 0x7f4d98032030 2024-09-13T19:16:18.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.211+0000 7f4d9e97b640 1 -- 172.21.15.102:0/3552122421 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d900af040 con 0x7f4d98032030 2024-09-13T19:16:18.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.211+0000 7f4d9e97b640 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562963d0fac0 con 0x562963d06cb0 2024-09-13T19:16:18.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.211+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d8802b040 con 0x562963d06cb0 2024-09-13T19:16:18.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.211+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562963d0fac0 con 0x7f4d900a0070 2024-09-13T19:16:18.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.211+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d8803b040 con 0x7f4d900a0070 2024-09-13T19:16:18.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.211+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562963d0fac0 con 0x562963d0b520 2024-09-13T19:16:18.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.211+0000 7f4d9f17c640 1 -- 172.21.15.102:0/3552122421 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d98038020 con 0x562963d0b520 2024-09-13T19:16:18.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.212+0000 7f4d9f17c640 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562963d0fac0 con 0x7f4d900a0070 2024-09-13T19:16:18.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.212+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d8803b040 con 0x7f4d900a0070 2024-09-13T19:16:18.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.212+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562963d0fac0 con 0x7f4d98032030 2024-09-13T19:16:18.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.212+0000 7f4d9e97b640 1 -- 172.21.15.102:0/3552122421 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d900af040 con 0x7f4d98032030 2024-09-13T19:16:18.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.212+0000 7f4d9e97b640 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562963d0fac0 con 0x562963d0b520 2024-09-13T19:16:18.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.212+0000 7f4d9f17c640 1 -- 172.21.15.102:0/3552122421 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d98038020 con 0x562963d0b520 2024-09-13T19:16:18.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.212+0000 7f4d9f17c640 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562963d0fac0 con 0x7f4d900a0070 2024-09-13T19:16:18.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.212+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d8803b040 con 0x7f4d900a0070 2024-09-13T19:16:18.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.213+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562963d0fac0 con 0x562963d06cb0 2024-09-13T19:16:18.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.213+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4d8803b040 con 0x562963d06cb0 2024-09-13T19:16:18.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.213+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562963d0fac0 con 0x7f4d98032030 2024-09-13T19:16:18.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.213+0000 7f4d9e97b640 1 -- 172.21.15.102:0/3552122421 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d900af040 con 0x7f4d98032030 2024-09-13T19:16:18.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.213+0000 7f4da0e87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:18.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.213+0000 7f4da0e87800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:18.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.213+0000 7f4da0e87800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:18.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.213+0000 7f4da0e87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:18.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.213+0000 7f4da0e87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:18.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.213+0000 7f4da0e87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:18.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.213+0000 7f4da0e87800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.213+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562963d0ebc0 con 0x562963d06cb0 2024-09-13T19:16:18.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.213+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4d8803b040 con 0x562963d06cb0 2024-09-13T19:16:18.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.213+0000 7f4da0e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:18.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.213+0000 7f4da0e87800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.213+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562963d0f460 con 0x562963d06cb0 2024-09-13T19:16:18.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.213+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4d8803b040 con 0x562963d06cb0 2024-09-13T19:16:18.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.213+0000 7f4da0e87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:18.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.213+0000 7f4da0e87800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.213+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562963d0e800 con 0x562963d0b520 2024-09-13T19:16:18.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.214+0000 7f4d9f17c640 1 -- 172.21.15.102:0/3552122421 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4d98038020 con 0x562963d0b520 2024-09-13T19:16:18.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.214+0000 7f4da0e87800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:18.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.214+0000 7f4da0e87800 20 zone default found 2024-09-13T19:16:18.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.214+0000 7f4da0e87800 4 Realm: () 2024-09-13T19:16:18.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.214+0000 7f4da0e87800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:18.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.214+0000 7f4da0e87800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:18.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.214+0000 7f4da0e87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:18.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.214+0000 7f4da0e87800 20 zonegroup default 2024-09-13T19:16:18.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.214+0000 7f4da0e87800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.214+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562963d10440 con 0x7f4d900a0070 2024-09-13T19:16:18.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.214+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4d8803b040 con 0x7f4d900a0070 2024-09-13T19:16:18.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.214+0000 7f4da0e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:18.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.214+0000 7f4da0e87800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.214+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562963d11ee0 con 0x562963d0b520 2024-09-13T19:16:18.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.214+0000 7f4d9f17c640 1 -- 172.21.15.102:0/3552122421 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4d98038020 con 0x562963d0b520 2024-09-13T19:16:18.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.214+0000 7f4da0e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:18.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.214+0000 7f4da0e87800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.214+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562963d12370 con 0x562963d0b520 2024-09-13T19:16:18.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.214+0000 7f4d9f17c640 1 -- 172.21.15.102:0/3552122421 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4d98038020 con 0x562963d0b520 2024-09-13T19:16:18.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.214+0000 7f4da0e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:18.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.215+0000 7f4da0e87800 20 started sync module instance, tier type = 2024-09-13T19:16:18.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.215+0000 7f4da0e87800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:18.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.215+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562963d112b0 con 0x7f4d98032030 2024-09-13T19:16:18.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.215+0000 7f4d9e97b640 1 -- 172.21.15.102:0/3552122421 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(44 notify.0 [create] v34'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d900af040 con 0x7f4d98032030 2024-09-13T19:16:18.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.216+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94735768295072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562963d11ac0 con 0x7f4d98032030 2024-09-13T19:16:18.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.216+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562963d132a0 con 0x562963d06cb0 2024-09-13T19:16:18.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.217+0000 7f4d9e97b640 1 -- 172.21.15.102:0/3552122421 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94735768295072] v34'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d900af040 con 0x7f4d98032030 2024-09-13T19:16:18.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.217+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v34'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d8803b040 con 0x562963d06cb0 2024-09-13T19:16:18.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.217+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94735768301040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562963d13210 con 0x562963d06cb0 2024-09-13T19:16:18.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.217+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562963d14160 con 0x562963d0b520 2024-09-13T19:16:18.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.218+0000 7f4d9f17c640 1 -- 172.21.15.102:0/3552122421 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v34'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d98038020 con 0x562963d0b520 2024-09-13T19:16:18.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.218+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94735768304816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562963d145c0 con 0x562963d0b520 2024-09-13T19:16:18.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.218+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562963d15090 con 0x7f4d98032030 2024-09-13T19:16:18.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.218+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94735768301040] v34'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d8803b040 con 0x562963d06cb0 2024-09-13T19:16:18.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.219+0000 7f4d9e97b640 1 -- 172.21.15.102:0/3552122421 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(50 notify.3 [create] v34'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d900af040 con 0x7f4d98032030 2024-09-13T19:16:18.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.219+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94735768308608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562963d15430 con 0x7f4d98032030 2024-09-13T19:16:18.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.219+0000 7f4d9f17c640 1 -- 172.21.15.102:0/3552122421 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94735768304816] v34'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d98038020 con 0x562963d0b520 2024-09-13T19:16:18.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.219+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562963d15ed0 con 0x562963d06cb0 2024-09-13T19:16:18.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.220+0000 7f4d9e97b640 1 -- 172.21.15.102:0/3552122421 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94735768308608] v34'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d900af040 con 0x7f4d98032030 2024-09-13T19:16:18.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.220+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v34'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d8803b040 con 0x562963d06cb0 2024-09-13T19:16:18.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.220+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94735768312224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562963d15e90 con 0x562963d06cb0 2024-09-13T19:16:18.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.220+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562963d16850 con 0x7f4d900a0070 2024-09-13T19:16:18.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.221+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(54 notify.5 [create] v34'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d8803b040 con 0x7f4d900a0070 2024-09-13T19:16:18.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.221+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94735768314784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562963d16c70 con 0x7f4d900a0070 2024-09-13T19:16:18.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.221+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94735768312224] v34'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d8803b040 con 0x562963d06cb0 2024-09-13T19:16:18.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.221+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562963d136d0 con 0x7f4d900a0070 2024-09-13T19:16:18.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.222+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94735768314784] v34'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d8803b040 con 0x7f4d900a0070 2024-09-13T19:16:18.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.222+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(56 notify.6 [create] v34'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d8803b040 con 0x7f4d900a0070 2024-09-13T19:16:18.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.222+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94735768315840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562963d16be0 con 0x7f4d900a0070 2024-09-13T19:16:18.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.222+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562963d17bc0 con 0x7f4d900a0070 2024-09-13T19:16:18.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.223+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(58 notify.7 [create] v34'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d8803b040 con 0x7f4d900a0070 2024-09-13T19:16:18.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.223+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94735768319760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562963d18020 con 0x7f4d900a0070 2024-09-13T19:16:18.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.223+0000 7f4da0e87800 20 add_watcher() i=0 2024-09-13T19:16:18.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.223+0000 7f4da0e87800 20 add_watcher() i=1 2024-09-13T19:16:18.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.223+0000 7f4da0e87800 20 add_watcher() i=2 2024-09-13T19:16:18.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.223+0000 7f4da0e87800 20 add_watcher() i=3 2024-09-13T19:16:18.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.223+0000 7f4da0e87800 20 add_watcher() i=4 2024-09-13T19:16:18.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.223+0000 7f4da0e87800 20 add_watcher() i=5 2024-09-13T19:16:18.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.223+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94735768315840] v34'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d8803b040 con 0x7f4d900a0070 2024-09-13T19:16:18.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.223+0000 7f4da0e87800 20 add_watcher() i=6 2024-09-13T19:16:18.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.224+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94735768319760] v34'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d8803b040 con 0x7f4d900a0070 2024-09-13T19:16:18.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.224+0000 7f4da0e87800 20 add_watcher() i=7 2024-09-13T19:16:18.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.224+0000 7f4da0e87800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:18.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.224+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562963d17260 con 0x562963d06cb0 2024-09-13T19:16:18.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.224+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4d8803b040 con 0x562963d06cb0 2024-09-13T19:16:18.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.224+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94735768320816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562963d17260 con 0x562963d06cb0 2024-09-13T19:16:18.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.225+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94735768320816] v34'98 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4d8803b040 con 0x562963d06cb0 2024-09-13T19:16:18.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.225+0000 7f4c557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:18.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.225+0000 7f4da0e87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:18.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.225+0000 7f4da0e87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:18.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.226+0000 7f4da0e87800 5 note: GC not initialized 2024-09-13T19:16:18.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.226+0000 7f4bcffff640 20 reqs_thread_entry: start 2024-09-13T19:16:18.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.226+0000 7f4da0e87800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:18.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.226+0000 7f4da0e87800 20 Filter name: none 2024-09-13T19:16:18.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.226+0000 7f4bcdffb640 20 reqs_thread_entry: start 2024-09-13T19:16:18.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.226+0000 7f4da0e87800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.226+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562963d4dff0 con 0x562963d06cb0 2024-09-13T19:16:18.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.226+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f4d8803b040 con 0x562963d06cb0 2024-09-13T19:16:18.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.226+0000 7f4da0e87800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:16:18.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.226+0000 7f4da0e87800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.226+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562963d4e9e0 con 0x562963d06cb0 2024-09-13T19:16:18.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.227+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f4d8803b040 con 0x562963d06cb0 2024-09-13T19:16:18.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.227+0000 7f4da0e87800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:16:18.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.227+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562963d4f9f0 con 0x7f4d98032030 2024-09-13T19:16:18.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.227+0000 7f4d9e97b640 1 -- 172.21.15.102:0/3552122421 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv15 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f4d900af040 con 0x7f4d98032030 2024-09-13T19:16:18.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.227+0000 7f4da0e87800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.227+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:65 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562963d4d140 con 0x7f4d98032030 2024-09-13T19:16:18.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.227+0000 7f4d9e97b640 1 -- 172.21.15.102:0/3552122421 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(65 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv2 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f4d900af040 con 0x7f4d98032030 2024-09-13T19:16:18.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.227+0000 7f4da0e87800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:16:18.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.227+0000 7f4da0e87800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.227+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:66 8.9 8:917ee2d5:root::.bucket.meta.myfoo%3a509740b4-c081-4f37-bd6d-df9ca851489b.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562963d4f9f0 con 0x7f4d98032030 2024-09-13T19:16:18.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.228+0000 7f4d9e97b640 1 -- 172.21.15.102:0/3552122421 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(66 .bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f4d900af040 con 0x7f4d98032030 2024-09-13T19:16:18.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.228+0000 7f4da0e87800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:16:18.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.228+0000 7f4da0e87800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T19:16:18.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.228+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:67 4.3e 4:7eb89d75:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562963d512b0 con 0x7f4d98032030 2024-09-13T19:16:18.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.228+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 4.28 4:16845d32:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562963d53e70 con 0x562963d06cb0 2024-09-13T19:16:18.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.228+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:69 4.e 4:7015f333:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562963d56870 con 0x7f4d98032030 2024-09-13T19:16:18.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.228+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:70 4.31 4:8e14c63f:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562963d53e70 con 0x562963d06cb0 2024-09-13T19:16:18.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.228+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:71 4.1f 4:fb695182:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562963d5b7b0 con 0x562963d0b520 2024-09-13T19:16:18.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.228+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:72 4.22 4:475c4288:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562963d5e640 con 0x562963d06cb0 2024-09-13T19:16:18.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.228+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:73 4.8 4:102eb403:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562963d61500 con 0x562963d0b520 2024-09-13T19:16:18.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.228+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:74 4.3d 4:be2d5322:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562963d64230 con 0x562963d0b520 2024-09-13T19:16:18.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.228+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:75 4.8 4:130dc037:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562963d66d10 con 0x562963d0b520 2024-09-13T19:16:18.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.228+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:76 4.32 4:4c01988a:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562963d69740 con 0x562963d06cb0 2024-09-13T19:16:18.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.228+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:77 4.1c 4:3b6ce2a2:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562963d66d10 con 0x7f4d900a0070 2024-09-13T19:16:18.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.228+0000 7f4d9e97b640 1 -- 172.21.15.102:0/3552122421 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(67 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4d900af040 con 0x7f4d98032030 2024-09-13T19:16:18.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.228+0000 7f4d9e97b640 1 -- 172.21.15.102:0/3552122421 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(69 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4d900af040 con 0x7f4d98032030 2024-09-13T19:16:18.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.228+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(68 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4d8803b040 con 0x562963d06cb0 2024-09-13T19:16:18.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.229+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(72 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4d8803b040 con 0x562963d06cb0 2024-09-13T19:16:18.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.229+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(76 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4d8803b040 con 0x562963d06cb0 2024-09-13T19:16:18.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.229+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== osd_op_reply(70 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4d8803b040 con 0x562963d06cb0 2024-09-13T19:16:18.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.229+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(77 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f4d8803b040 con 0x7f4d900a0070 2024-09-13T19:16:18.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.229+0000 7f4d9f17c640 1 -- 172.21.15.102:0/3552122421 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(71 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4d98038020 con 0x562963d0b520 2024-09-13T19:16:18.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.229+0000 7f4d9f17c640 1 -- 172.21.15.102:0/3552122421 <== osd.3 v2:172.21.15.102:6800/3096737090 17 ==== osd_op_reply(73 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4d98038020 con 0x562963d0b520 2024-09-13T19:16:18.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.229+0000 7f4d9f17c640 1 -- 172.21.15.102:0/3552122421 <== osd.3 v2:172.21.15.102:6800/3096737090 18 ==== osd_op_reply(74 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4d98038020 con 0x562963d0b520 2024-09-13T19:16:18.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.229+0000 7f4d9f17c640 1 -- 172.21.15.102:0/3552122421 <== osd.3 v2:172.21.15.102:6800/3096737090 19 ==== osd_op_reply(75 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.8 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4d98038020 con 0x562963d0b520 2024-09-13T19:16:18.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.230+0000 7f4c557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:18.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.230+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94735768320816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562963d5e640 con 0x562963d06cb0 2024-09-13T19:16:18.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.231+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94735768320816] v34'99 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4d8803b040 con 0x562963d06cb0 2024-09-13T19:16:18.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.231+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94735768295072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562963d4bdc0 con 0x7f4d98032030 2024-09-13T19:16:18.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.232+0000 7f4d9e97b640 1 -- 172.21.15.102:0/3552122421 <== osd.2 v2:172.21.15.102:6816/2238176080 16 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94735768295072] v34'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d900af040 con 0x7f4d98032030 2024-09-13T19:16:18.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.232+0000 7f4da0e87800 20 remove_watcher() i=0 2024-09-13T19:16:18.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.232+0000 7f4da0e87800 2 removed watcher, disabling cache 2024-09-13T19:16:18.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.232+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94735768301040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562963d4bdc0 con 0x562963d06cb0 2024-09-13T19:16:18.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.233+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 <== osd.1 v2:172.21.15.102:6808/2204418452 28 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94735768301040] v34'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d8803b040 con 0x562963d06cb0 2024-09-13T19:16:18.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.233+0000 7f4da0e87800 20 remove_watcher() i=1 2024-09-13T19:16:18.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.233+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94735768304816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562963d4bdc0 con 0x562963d0b520 2024-09-13T19:16:18.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.234+0000 7f4d9f17c640 1 -- 172.21.15.102:0/3552122421 <== osd.3 v2:172.21.15.102:6800/3096737090 20 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94735768304816] v34'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d98038020 con 0x562963d0b520 2024-09-13T19:16:18.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.234+0000 7f4da0e87800 20 remove_watcher() i=2 2024-09-13T19:16:18.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.234+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94735768308608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562963d4bdc0 con 0x7f4d98032030 2024-09-13T19:16:18.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.235+0000 7f4d9e97b640 1 -- 172.21.15.102:0/3552122421 <== osd.2 v2:172.21.15.102:6816/2238176080 17 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94735768308608] v34'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d900af040 con 0x7f4d98032030 2024-09-13T19:16:18.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.235+0000 7f4da0e87800 20 remove_watcher() i=3 2024-09-13T19:16:18.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.235+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94735768312224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562963d4bdc0 con 0x562963d06cb0 2024-09-13T19:16:18.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.236+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 <== osd.1 v2:172.21.15.102:6808/2204418452 29 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94735768312224] v34'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d8803b040 con 0x562963d06cb0 2024-09-13T19:16:18.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.236+0000 7f4da0e87800 20 remove_watcher() i=4 2024-09-13T19:16:18.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.236+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94735768314784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562963d4bdc0 con 0x7f4d900a0070 2024-09-13T19:16:18.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.237+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94735768314784] v34'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d8803b040 con 0x7f4d900a0070 2024-09-13T19:16:18.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.237+0000 7f4da0e87800 20 remove_watcher() i=5 2024-09-13T19:16:18.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.237+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94735768315840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562963d4bdc0 con 0x7f4d900a0070 2024-09-13T19:16:18.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.238+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94735768315840] v34'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d8803b040 con 0x7f4d900a0070 2024-09-13T19:16:18.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.238+0000 7f4da0e87800 20 remove_watcher() i=6 2024-09-13T19:16:18.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.238+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94735768319760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562963d4bdc0 con 0x7f4d900a0070 2024-09-13T19:16:18.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.239+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 <== osd.0 v2:172.21.15.53:6800/4021716951 20 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94735768319760] v34'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d8803b040 con 0x7f4d900a0070 2024-09-13T19:16:18.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.239+0000 7f4da0e87800 20 remove_watcher() i=7 2024-09-13T19:16:18.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.239+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f4d900a0070 msgr2=0x7f4d9005a960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.239+0000 7f4da0e87800 1 --2- 172.21.15.102:0/3552122421 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f4d900a0070 0x7f4d9005a960 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.239+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x562963d06cb0 msgr2=0x562963d09170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.239+0000 7f4da0e87800 1 --2- 172.21.15.102:0/3552122421 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x562963d06cb0 0x562963d09170 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.239+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f4d98032030 msgr2=0x7f4d980409f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.239+0000 7f4da0e87800 1 --2- 172.21.15.102:0/3552122421 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f4d98032030 0x7f4d980409f0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.239+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x562963d0b520 msgr2=0x562963d0d930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.239+0000 7f4da0e87800 1 --2- 172.21.15.102:0/3552122421 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x562963d0b520 0x562963d0d930 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.239+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4c68036b90 msgr2=0x7f4c68039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.239+0000 7f4da0e87800 1 --2- 172.21.15.102:0/3552122421 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4c68036b90 0x7f4c68039050 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x562963cd1b90 tx=0x7f4d9008d000 comp rx=0 tx=0).stop 2024-09-13T19:16:18.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.239+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562963cf3d00 msgr2=0x562963cfb290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.239+0000 7f4d9617a640 1 -- 172.21.15.102:0/3552122421 reap_dead start 2024-09-13T19:16:18.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.239+0000 7f4da0e87800 1 --2- 172.21.15.102:0/3552122421 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562963cf3d00 0x562963cfb290 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4d9800a120 tx=0x7f4d9804cdb0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.239+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 shutdown_connections 2024-09-13T19:16:18.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.239+0000 7f4da0e87800 1 --2- 172.21.15.102:0/3552122421 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562963cf3d00 0x562963cfb290 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.239+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 >> 172.21.15.102:0/3552122421 conn(0x562963cf00f0 msgr2=0x562963cee1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:18.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.239+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 shutdown_connections 2024-09-13T19:16:18.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.239+0000 7f4da0e87800 1 -- 172.21.15.102:0/3552122421 wait complete. 2024-09-13T19:16:18.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.240+0000 7f4da0e87800 1 -- 172.21.15.102:0/121007395 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4c78036bb0 msgr2=0x7f4c78039070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.240+0000 7f4da0e87800 1 --2- 172.21.15.102:0/121007395 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4c78036bb0 0x7f4c78039070 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4d900910b0 tx=0x7f4d9006f4a0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.240+0000 7f4da0e87800 1 -- 172.21.15.102:0/121007395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562963cc2f70 msgr2=0x562963cc15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.240+0000 7f4da0e87800 1 --2- 172.21.15.102:0/121007395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562963cc2f70 0x562963cc15c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x562963ccb200 tx=0x7f4d980167b0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.240+0000 7f4da0e87800 1 -- 172.21.15.102:0/121007395 shutdown_connections 2024-09-13T19:16:18.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.240+0000 7f4da0e87800 1 --2- 172.21.15.102:0/121007395 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4c78036bb0 0x7f4c78039070 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.240+0000 7f4da0e87800 1 --2- 172.21.15.102:0/121007395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562963cc2f70 0x562963cc15c0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.240+0000 7f4da0e87800 1 -- 172.21.15.102:0/121007395 >> 172.21.15.102:0/121007395 conn(0x562963cd9e10 msgr2=0x562963cdc990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:18.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.240+0000 7f4da0e87800 1 -- 172.21.15.102:0/121007395 shutdown_connections 2024-09-13T19:16:18.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.240+0000 7f4da0e87800 1 -- 172.21.15.102:0/121007395 wait complete. 2024-09-13T19:16:18.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.240+0000 7f4da0e87800 1 -- 172.21.15.102:0/1375265118 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x562963bd2e90 msgr2=0x562963cd11c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.240+0000 7f4da0e87800 1 --2- 172.21.15.102:0/1375265118 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x562963bd2e90 0x562963cd11c0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.240+0000 7f4da0e87800 1 -- 172.21.15.102:0/1375265118 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x562963cd3a70 msgr2=0x562963cd5e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.240+0000 7f4da0e87800 1 --2- 172.21.15.102:0/1375265118 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x562963cd3a70 0x562963cd5e60 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.240+0000 7f4da0e87800 1 -- 172.21.15.102:0/1375265118 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4c84036b40 msgr2=0x7f4c84039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.240+0000 7f4da0e87800 1 --2- 172.21.15.102:0/1375265118 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4c84036b40 0x7f4c84039000 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4d88000f60 tx=0x7f4d88001370 comp rx=0 tx=0).stop 2024-09-13T19:16:18.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.240+0000 7f4da0e87800 1 -- 172.21.15.102:0/1375265118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562963bd2550 msgr2=0x562963cca150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.240+0000 7f4da0e87800 1 --2- 172.21.15.102:0/1375265118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562963bd2550 0x562963cca150 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4d90067040 tx=0x7f4d90002fb0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.240+0000 7f4da0e87800 1 -- 172.21.15.102:0/1375265118 shutdown_connections 2024-09-13T19:16:18.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.240+0000 7f4da0e87800 1 --2- 172.21.15.102:0/1375265118 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x562963cd3a70 0x562963cd5e60 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.240+0000 7f4da0e87800 1 --2- 172.21.15.102:0/1375265118 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x562963bd2e90 0x562963cd11c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.240+0000 7f4da0e87800 1 --2- 172.21.15.102:0/1375265118 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4c84036b40 0x7f4c84039000 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.240+0000 7f4da0e87800 1 --2- 172.21.15.102:0/1375265118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562963bd2550 0x562963cca150 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.240+0000 7f4da0e87800 1 -- 172.21.15.102:0/1375265118 >> 172.21.15.102:0/1375265118 conn(0x562963bcdde0 msgr2=0x562963cbb9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:18.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.240+0000 7f4da0e87800 1 -- 172.21.15.102:0/1375265118 shutdown_connections 2024-09-13T19:16:18.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.240+0000 7f4da0e87800 1 -- 172.21.15.102:0/1375265118 wait complete. 2024-09-13T19:16:18.314 INFO:teuthology.orchestra.run.smithi102.stdout:[{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"f767d22e-a5e7-4349-a797-2de84f67e90b","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"509740b4-c081-4f37-bd6d-df9ca851489b.4237.1","marker":"509740b4-c081-4f37-bd6d-df9ca851489b.4237.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-13T19:16:17.496135Z","creation_time":"2024-09-13T19:16:17.492008Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}}] 2024-09-13T19:16:18.314 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'f767d22e-a5e7-4349-a797-2de84f67e90b', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '509740b4-c081-4f37-bd6d-df9ca851489b.4237.1', 'marker': '509740b4-c081-4f37-bd6d-df9ca851489b.4237.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T19:16:17.496135Z', 'creation_time': '2024-09-13T19:16:17.492008Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-09-13T19:16:18.322 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-13T19:16:18.322 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-13T19:16:18.322 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-13T19:16:18.323 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-13T19:16:18.367 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:18.368 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:18.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.365+0000 7f4c00920800 1 Processor -- start 2024-09-13T19:16:18.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.365+0000 7f4c00920800 1 -- start start 2024-09-13T19:16:18.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.365+0000 7f4c00920800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b4a4684550 0x55b4a4684950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.365+0000 7f4c00920800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b4a4544b30 con 0x55b4a4684e90 2024-09-13T19:16:18.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.365+0000 7f4c00920800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55b4a4526360 con 0x55b4a4684550 2024-09-13T19:16:18.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.366+0000 7f4bfc616640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b4a4684550 0x55b4a4684950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.366+0000 7f4bfc616640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b4a4684550 0x55b4a4684950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55134/0 (socket says 172.21.15.102:55134) 2024-09-13T19:16:18.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.366+0000 7f4bfc616640 1 -- 172.21.15.102:0/3462572382 learned_addr learned my addr 172.21.15.102:0/3462572382 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:18.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.366+0000 7f4bfbe15640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55b4a4684e90 0x55b4a4689a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:49984/0 (socket says 172.21.15.102:49984) 2024-09-13T19:16:18.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.366+0000 7f4bfc616640 1 -- 172.21.15.102:0/3462572382 >> v1:172.21.15.53:6789/0 conn(0x55b4a4684e90 legacy=0x55b4a4689a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.366+0000 7f4bfc616640 1 -- 172.21.15.102:0/3462572382 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4a454ce00 con 0x55b4a4684550 2024-09-13T19:16:18.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.368+0000 7f4bfc616640 1 --2- 172.21.15.102:0/3462572382 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4a4684550 0x55b4a4684950 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4bf400a520 tx=0x7f4bf4045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4e1d1b9d79c9b17 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.368+0000 7f4bfb614640 1 -- 172.21.15.102:0/3462572382 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bf4055070 con 0x55b4a4684550 2024-09-13T19:16:18.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.368+0000 7f4bfb614640 1 -- 172.21.15.102:0/3462572382 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bf40515b0 con 0x55b4a4684550 2024-09-13T19:16:18.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.368+0000 7f4bfb614640 1 -- 172.21.15.102:0/3462572382 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bf40518d0 con 0x55b4a4684550 2024-09-13T19:16:18.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.368+0000 7f4c00920800 1 -- 172.21.15.102:0/3462572382 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4a4684550 msgr2=0x55b4a4684950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.368+0000 7f4c00920800 1 --2- 172.21.15.102:0/3462572382 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4a4684550 0x55b4a4684950 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4bf400a520 tx=0x7f4bf4045ba0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.368+0000 7f4c00920800 1 -- 172.21.15.102:0/3462572382 shutdown_connections 2024-09-13T19:16:18.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.368+0000 7f4c00920800 1 --2- 172.21.15.102:0/3462572382 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4a4684550 0x55b4a4684950 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.368+0000 7f4c00920800 1 -- 172.21.15.102:0/3462572382 >> 172.21.15.102:0/3462572382 conn(0x55b4a467fde0 msgr2=0x55b4a4682200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:18.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.368+0000 7f4c00920800 1 -- 172.21.15.102:0/3462572382 shutdown_connections 2024-09-13T19:16:18.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.368+0000 7f4c00920800 1 -- 172.21.15.102:0/3462572382 wait complete. 2024-09-13T19:16:18.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.382+0000 7f4c00920800 1 Processor -- start 2024-09-13T19:16:18.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.382+0000 7f4c00920800 1 -- start start 2024-09-13T19:16:18.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.382+0000 7f4c00920800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4a4684550 0x55b4a45f95a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.382+0000 7f4c00920800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b4a45d1330 con 0x55b4a4684550 2024-09-13T19:16:18.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.383+0000 7f4bfc616640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4a4684550 0x55b4a45f95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.383+0000 7f4bfc616640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4a4684550 0x55b4a45f95a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55144/0 (socket says 172.21.15.102:55144) 2024-09-13T19:16:18.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.383+0000 7f4bfc616640 1 -- 172.21.15.102:0/2709122905 learned_addr learned my addr 172.21.15.102:0/2709122905 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:18.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.383+0000 7f4bfc616640 1 -- 172.21.15.102:0/2709122905 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4a451ebc0 con 0x55b4a4684550 2024-09-13T19:16:18.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.383+0000 7f4bfc616640 1 --2- 172.21.15.102:0/2709122905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4a4684550 0x55b4a45f95a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f4bf4025da0 tx=0x7f4bf4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f24739fc7b60680 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.383+0000 7f4aea60c640 1 -- 172.21.15.102:0/2709122905 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bf4051890 con 0x55b4a4684550 2024-09-13T19:16:18.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.383+0000 7f4aea60c640 1 -- 172.21.15.102:0/2709122905 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bf4051ac0 con 0x55b4a4684550 2024-09-13T19:16:18.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.383+0000 7f4aea60c640 1 -- 172.21.15.102:0/2709122905 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bf4051da0 con 0x55b4a4684550 2024-09-13T19:16:18.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.384+0000 7f4c00920800 1 -- 172.21.15.102:0/2709122905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4a4684550 msgr2=0x55b4a45f95a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.384+0000 7f4c00920800 1 --2- 172.21.15.102:0/2709122905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4a4684550 0x55b4a45f95a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f4bf4025da0 tx=0x7f4bf4051000 comp rx=0 tx=0).stop 2024-09-13T19:16:18.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.384+0000 7f4c00920800 1 -- 172.21.15.102:0/2709122905 shutdown_connections 2024-09-13T19:16:18.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.384+0000 7f4c00920800 1 --2- 172.21.15.102:0/2709122905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4a4684550 0x55b4a45f95a0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.384+0000 7f4c00920800 1 -- 172.21.15.102:0/2709122905 >> 172.21.15.102:0/2709122905 conn(0x55b4a467fde0 msgr2=0x55b4a476f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:18.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.384+0000 7f4c00920800 1 -- 172.21.15.102:0/2709122905 shutdown_connections 2024-09-13T19:16:18.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.384+0000 7f4c00920800 1 -- 172.21.15.102:0/2709122905 wait complete. 2024-09-13T19:16:18.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.385+0000 7f4c00920800 1 Processor -- start 2024-09-13T19:16:18.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.385+0000 7f4c00920800 1 -- start start 2024-09-13T19:16:18.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.385+0000 7f4c00920800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4a4684550 0x55b4a477e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.385+0000 7f4c00920800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b4a468b570 con 0x55b4a4684550 2024-09-13T19:16:18.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.385+0000 7f4bfc616640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4a4684550 0x55b4a477e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.385+0000 7f4bfc616640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4a4684550 0x55b4a477e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55156/0 (socket says 172.21.15.102:55156) 2024-09-13T19:16:18.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.385+0000 7f4bfc616640 1 -- 172.21.15.102:0/3109855341 learned_addr learned my addr 172.21.15.102:0/3109855341 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:18.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.385+0000 7f4bfc616640 1 -- 172.21.15.102:0/3109855341 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4a4532fe0 con 0x55b4a4684550 2024-09-13T19:16:18.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.385+0000 7f4bfc616640 1 --2- 172.21.15.102:0/3109855341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4a4684550 0x55b4a477e340 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f4bf4025da0 tx=0x7f4bf4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.386+0000 7f4ae8e09640 1 -- 172.21.15.102:0/3109855341 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bf4073070 con 0x55b4a4684550 2024-09-13T19:16:18.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.386+0000 7f4ae8e09640 1 -- 172.21.15.102:0/3109855341 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bf405a580 con 0x55b4a4684550 2024-09-13T19:16:18.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.386+0000 7f4c00920800 1 -- 172.21.15.102:0/3109855341 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b4a477e880 con 0x55b4a4684550 2024-09-13T19:16:18.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.386+0000 7f4ae8e09640 1 -- 172.21.15.102:0/3109855341 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bf405a860 con 0x55b4a4684550 2024-09-13T19:16:18.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.386+0000 7f4c00920800 1 -- 172.21.15.102:0/3109855341 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4a477ee00 con 0x55b4a4684550 2024-09-13T19:16:18.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.386+0000 7f4ae8e09640 1 -- 172.21.15.102:0/3109855341 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4bf4076070 con 0x55b4a4684550 2024-09-13T19:16:18.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.386+0000 7f4ae8e09640 1 --2- 172.21.15.102:0/3109855341 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4ae4036b40 0x7f4ae4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.387+0000 7f4ae8e09640 1 -- 172.21.15.102:0/3109855341 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f4bf4062070 con 0x55b4a4684550 2024-09-13T19:16:18.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.387+0000 7f4bfbe15640 1 --2- 172.21.15.102:0/3109855341 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4ae4036b40 0x7f4ae4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.387+0000 7f4c00920800 1 --2- 172.21.15.102:0/3109855341 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55b4a4684e90 0x55b4a47853b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.387+0000 7f4c00920800 1 -- 172.21.15.102:0/3109855341 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4a4785a20 con 0x55b4a4684e90 2024-09-13T19:16:18.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.387+0000 7f4bfce17640 1 --2- 172.21.15.102:0/3109855341 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55b4a4684e90 0x55b4a47853b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.387+0000 7f4bfbe15640 1 --2- 172.21.15.102:0/3109855341 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4ae4036b40 0x7f4ae4039000 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4be4000f60 tx=0x7f4be4001370 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.387+0000 7f4bfce17640 1 --2- 172.21.15.102:0/3109855341 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55b4a4684e90 0x55b4a47853b0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.387+0000 7f4bfce17640 1 -- 172.21.15.102:0/3109855341 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4bec00a4a0 con 0x55b4a4684e90 2024-09-13T19:16:18.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.387+0000 7f4c00920800 1 -- 172.21.15.102:0/3109855341 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4a4782960 con 0x55b4a4684e90 2024-09-13T19:16:18.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.388+0000 7f4bfce17640 1 -- 172.21.15.102:0/3109855341 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4bec00a4a0 con 0x55b4a4684e90 2024-09-13T19:16:18.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.388+0000 7f4c00920800 1 --2- 172.21.15.102:0/3109855341 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55b4a4787d50 0x55b4a478a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.388+0000 7f4c00920800 1 -- 172.21.15.102:0/3109855341 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4a478a830 con 0x55b4a4787d50 2024-09-13T19:16:18.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.388+0000 7f4bfc616640 1 --2- 172.21.15.102:0/3109855341 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55b4a4787d50 0x55b4a478a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.388+0000 7f4bfc616640 1 --2- 172.21.15.102:0/3109855341 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55b4a4787d50 0x55b4a478a140 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.388+0000 7f4bfc616640 1 -- 172.21.15.102:0/3109855341 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4bf407f070 con 0x55b4a4787d50 2024-09-13T19:16:18.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.388+0000 7f4c00920800 1 -- 172.21.15.102:0/3109855341 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4a4786bf0 con 0x55b4a4684e90 2024-09-13T19:16:18.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.389+0000 7f4bfce17640 1 -- 172.21.15.102:0/3109855341 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4bec00a4a0 con 0x55b4a4684e90 2024-09-13T19:16:18.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.389+0000 7f4c00920800 1 -- 172.21.15.102:0/3109855341 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47870d0 con 0x55b4a4787d50 2024-09-13T19:16:18.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.389+0000 7f4bfc616640 1 -- 172.21.15.102:0/3109855341 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4bf407f070 con 0x55b4a4787d50 2024-09-13T19:16:18.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.389+0000 7f4c00920800 1 Processor -- start 2024-09-13T19:16:18.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.389+0000 7f4c00920800 1 -- start start 2024-09-13T19:16:18.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.389+0000 7f4c00920800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4a47991e0 0x55b4a4799600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.389+0000 7f4c00920800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b4a4520580 con 0x55b4a47991e0 2024-09-13T19:16:18.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.390+0000 7f4bfce17640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4a47991e0 0x55b4a4799600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.390+0000 7f4bfce17640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4a47991e0 0x55b4a4799600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55172/0 (socket says 172.21.15.102:55172) 2024-09-13T19:16:18.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.390+0000 7f4bfce17640 1 -- 172.21.15.102:0/2921000188 learned_addr learned my addr 172.21.15.102:0/2921000188 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:18.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.390+0000 7f4bfce17640 1 -- 172.21.15.102:0/2921000188 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4a4799b40 con 0x55b4a47991e0 2024-09-13T19:16:18.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.390+0000 7f4bfce17640 1 --2- 172.21.15.102:0/2921000188 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4a47991e0 0x55b4a4799600 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x55b4a4785e20 tx=0x7f4bec0163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.391+0000 7f4ae1ffb640 1 -- 172.21.15.102:0/2921000188 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bec013450 con 0x55b4a47991e0 2024-09-13T19:16:18.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.391+0000 7f4ae1ffb640 1 -- 172.21.15.102:0/2921000188 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bec0135f0 con 0x55b4a47991e0 2024-09-13T19:16:18.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.391+0000 7f4c00920800 1 -- 172.21.15.102:0/2921000188 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b4a4799dd0 con 0x55b4a47991e0 2024-09-13T19:16:18.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.391+0000 7f4ae1ffb640 1 -- 172.21.15.102:0/2921000188 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bec0138d0 con 0x55b4a47991e0 2024-09-13T19:16:18.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.391+0000 7f4c00920800 1 -- 172.21.15.102:0/2921000188 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4a479cab0 con 0x55b4a47991e0 2024-09-13T19:16:18.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.392+0000 7f4ae1ffb640 1 -- 172.21.15.102:0/2921000188 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4bec011040 con 0x55b4a47991e0 2024-09-13T19:16:18.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.392+0000 7f4ae1ffb640 1 --2- 172.21.15.102:0/2921000188 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4ad4036b90 0x7f4ad4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.392+0000 7f4ae1ffb640 1 -- 172.21.15.102:0/2921000188 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f4bec00e040 con 0x55b4a47991e0 2024-09-13T19:16:18.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.392+0000 7f4bfc616640 1 --2- 172.21.15.102:0/2921000188 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4ad4036b90 0x7f4ad4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.392+0000 7f4c00920800 1 Processor -- start 2024-09-13T19:16:18.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.392+0000 7f4bfc616640 1 --2- 172.21.15.102:0/2921000188 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4ad4036b90 0x7f4ad4039050 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x55b4a4786300 tx=0x7f4bf408f3b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.392+0000 7f4c00920800 1 -- start start 2024-09-13T19:16:18.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.392+0000 7f4c00920800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4a47a5f00 0x55b4a47a6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.392+0000 7f4c00920800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b4a47799c0 con 0x55b4a47a5f00 2024-09-13T19:16:18.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.392+0000 7f4bfce17640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4a47a5f00 0x55b4a47a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.393+0000 7f4bfce17640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4a47a5f00 0x55b4a47a6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55188/0 (socket says 172.21.15.102:55188) 2024-09-13T19:16:18.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.393+0000 7f4bfce17640 1 -- 172.21.15.102:0/2768989146 learned_addr learned my addr 172.21.15.102:0/2768989146 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:18.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.393+0000 7f4bfce17640 1 -- 172.21.15.102:0/2768989146 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4a47a68d0 con 0x55b4a47a5f00 2024-09-13T19:16:18.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.393+0000 7f4bfce17640 1 --2- 172.21.15.102:0/2768989146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4a47a5f00 0x55b4a47a6300 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4bec04cd90 tx=0x7f4bec014aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd6c70933ef7db39 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.393+0000 7f4adb7fe640 1 -- 172.21.15.102:0/2768989146 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bec01f390 con 0x55b4a47a5f00 2024-09-13T19:16:18.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.393+0000 7f4adb7fe640 1 -- 172.21.15.102:0/2768989146 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bec012cb0 con 0x55b4a47a5f00 2024-09-13T19:16:18.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.393+0000 7f4adb7fe640 1 -- 172.21.15.102:0/2768989146 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bec01f530 con 0x55b4a47a5f00 2024-09-13T19:16:18.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.393+0000 7f4c00920800 1 -- 172.21.15.102:0/2768989146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4a47a5f00 msgr2=0x55b4a47a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.393+0000 7f4c00920800 1 --2- 172.21.15.102:0/2768989146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4a47a5f00 0x55b4a47a6300 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4bec04cd90 tx=0x7f4bec014aa0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.394+0000 7f4c00920800 1 -- 172.21.15.102:0/2768989146 shutdown_connections 2024-09-13T19:16:18.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.394+0000 7f4c00920800 1 --2- 172.21.15.102:0/2768989146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4a47a5f00 0x55b4a47a6300 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.394+0000 7f4c00920800 1 -- 172.21.15.102:0/2768989146 >> 172.21.15.102:0/2768989146 conn(0x55b4a47a22b0 msgr2=0x55b4a47a03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:18.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.394+0000 7f4c00920800 1 -- 172.21.15.102:0/2768989146 shutdown_connections 2024-09-13T19:16:18.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.394+0000 7f4c00920800 1 -- 172.21.15.102:0/2768989146 wait complete. 2024-09-13T19:16:18.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.394+0000 7f4c00920800 1 Processor -- start 2024-09-13T19:16:18.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.394+0000 7f4c00920800 1 -- start start 2024-09-13T19:16:18.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.394+0000 7f4c00920800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4a47a5f00 0x55b4a47ad390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.394+0000 7f4c00920800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b4a47a6ea0 con 0x55b4a47a5f00 2024-09-13T19:16:18.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.394+0000 7f4bfce17640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4a47a5f00 0x55b4a47ad390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.394+0000 7f4bfce17640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4a47a5f00 0x55b4a47ad390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55202/0 (socket says 172.21.15.102:55202) 2024-09-13T19:16:18.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.394+0000 7f4bfce17640 1 -- 172.21.15.102:0/3186436386 learned_addr learned my addr 172.21.15.102:0/3186436386 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:18.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.394+0000 7f4bfce17640 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4a47ad8d0 con 0x55b4a47a5f00 2024-09-13T19:16:18.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.395+0000 7f4bfce17640 1 --2- 172.21.15.102:0/3186436386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4a47a5f00 0x55b4a47ad390 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f4bec02a040 tx=0x7f4bec04cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.395+0000 7f4ad9ffb640 1 -- 172.21.15.102:0/3186436386 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bec038070 con 0x55b4a47a5f00 2024-09-13T19:16:18.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.395+0000 7f4ad9ffb640 1 -- 172.21.15.102:0/3186436386 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bec01f920 con 0x55b4a47a5f00 2024-09-13T19:16:18.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.395+0000 7f4ad9ffb640 1 -- 172.21.15.102:0/3186436386 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bec013bc0 con 0x55b4a47a5f00 2024-09-13T19:16:18.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.395+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b4a47adb60 con 0x55b4a47a5f00 2024-09-13T19:16:18.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.395+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4a47b0810 con 0x55b4a47a5f00 2024-09-13T19:16:18.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.395+0000 7f4ad9ffb640 1 -- 172.21.15.102:0/3186436386 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4bec03b070 con 0x55b4a47a5f00 2024-09-13T19:16:18.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.396+0000 7f4ad9ffb640 1 --2- 172.21.15.102:0/3186436386 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4acc036b40 0x7f4acc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.396+0000 7f4ad9ffb640 1 -- 172.21.15.102:0/3186436386 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f4bec034ca0 con 0x55b4a47a5f00 2024-09-13T19:16:18.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.396+0000 7f4bfc616640 1 --2- 172.21.15.102:0/3186436386 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4acc036b40 0x7f4acc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.396+0000 7f4c00920800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.396+0000 7f4c00920800 1 --2- 172.21.15.102:0/3186436386 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55b4a47b8fd0 0x55b4a47bb490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.396+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47bbbe0 con 0x55b4a47b8fd0 2024-09-13T19:16:18.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.396+0000 7f4bfbe15640 1 --2- 172.21.15.102:0/3186436386 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55b4a47b8fd0 0x55b4a47bb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.396+0000 7f4bfc616640 1 --2- 172.21.15.102:0/3186436386 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4acc036b40 0x7f4acc039000 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4bf405cfd0 tx=0x7f4bf408a000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.397+0000 7f4bfbe15640 1 --2- 172.21.15.102:0/3186436386 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55b4a47b8fd0 0x55b4a47bb490 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.397+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4be400f610 con 0x55b4a47b8fd0 2024-09-13T19:16:18.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.397+0000 7f4c00920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:18.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.397+0000 7f4c00920800 20 realm 2024-09-13T19:16:18.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.397+0000 7f4c00920800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.397+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47b8420 con 0x55b4a47b8fd0 2024-09-13T19:16:18.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.397+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4be400f610 con 0x55b4a47b8fd0 2024-09-13T19:16:18.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.397+0000 7f4c00920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:18.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.397+0000 7f4c00920800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:18.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.397+0000 7f4c00920800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.397+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47bc6c0 con 0x55b4a47b8fd0 2024-09-13T19:16:18.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.397+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4be400f610 con 0x55b4a47b8fd0 2024-09-13T19:16:18.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.397+0000 7f4c00920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:18.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.397+0000 7f4c00920800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.397+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47bcf90 con 0x55b4a47b8fd0 2024-09-13T19:16:18.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.398+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4be400f610 con 0x55b4a47b8fd0 2024-09-13T19:16:18.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.398+0000 7f4c00920800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:18.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.398+0000 7f4c00920800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.398+0000 7f4c00920800 1 --2- 172.21.15.102:0/3186436386 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55b4a47bd840 0x55b4a47bfc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.398+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c03b0 con 0x55b4a47bd840 2024-09-13T19:16:18.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.398+0000 7f4bfce17640 1 --2- 172.21.15.102:0/3186436386 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55b4a47bd840 0x55b4a47bfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.398+0000 7f4bfce17640 1 --2- 172.21.15.102:0/3186436386 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55b4a47bd840 0x55b4a47bfc50 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.398+0000 7f4bfce17640 1 -- 172.21.15.102:0/3186436386 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4bec03a030 con 0x55b4a47bd840 2024-09-13T19:16:18.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.398+0000 7f4c00920800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:18.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.398+0000 7f4c00920800 20 searching for the correct realm 2024-09-13T19:16:18.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.398+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c1dd0 con 0x55b4a47bd840 2024-09-13T19:16:18.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.398+0000 7f4bfce17640 1 -- 172.21.15.102:0/3186436386 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bec03a030 con 0x55b4a47bd840 2024-09-13T19:16:18.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.399+0000 7f4bfce17640 1 --2- 172.21.15.102:0/3186436386 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f4bec045050 0x7f4bec04eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.399+0000 7f4bfce17640 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c1dd0 con 0x7f4bec045050 2024-09-13T19:16:18.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.399+0000 7f4bfc616640 1 --2- 172.21.15.102:0/3186436386 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f4bec045050 0x7f4bec04eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.399+0000 7f4bfc616640 1 --2- 172.21.15.102:0/3186436386 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f4bec045050 0x7f4bec04eaa0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.399+0000 7f4bfc616640 1 -- 172.21.15.102:0/3186436386 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bf407f070 con 0x7f4bec045050 2024-09-13T19:16:18.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.399+0000 7f4bfc616640 1 --2- 172.21.15.102:0/3186436386 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f4bf4078070 0x7f4bf40643b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.399+0000 7f4bfc616640 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c1dd0 con 0x7f4bf4078070 2024-09-13T19:16:18.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.399+0000 7f4bfbe15640 1 --2- 172.21.15.102:0/3186436386 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f4bf4078070 0x7f4bf40643b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.400+0000 7f4bfbe15640 1 --2- 172.21.15.102:0/3186436386 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f4bf4078070 0x7f4bf40643b0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.400+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4be400f610 con 0x7f4bf4078070 2024-09-13T19:16:18.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.400+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c1dd0 con 0x55b4a47b8fd0 2024-09-13T19:16:18.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.400+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4be400f610 con 0x55b4a47b8fd0 2024-09-13T19:16:18.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.400+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c1dd0 con 0x55b4a47b8fd0 2024-09-13T19:16:18.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.400+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4be402b040 con 0x55b4a47b8fd0 2024-09-13T19:16:18.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.401+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c1dd0 con 0x7f4bf4078070 2024-09-13T19:16:18.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.401+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4be402b040 con 0x7f4bf4078070 2024-09-13T19:16:18.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.401+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c1dd0 con 0x7f4bf4078070 2024-09-13T19:16:18.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.401+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4be402b040 con 0x7f4bf4078070 2024-09-13T19:16:18.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.401+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c1dd0 con 0x7f4bec045050 2024-09-13T19:16:18.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.401+0000 7f4bfc616640 1 -- 172.21.15.102:0/3186436386 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bf407f070 con 0x7f4bec045050 2024-09-13T19:16:18.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.401+0000 7f4bfc616640 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c1dd0 con 0x55b4a47bd840 2024-09-13T19:16:18.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.402+0000 7f4bfce17640 1 -- 172.21.15.102:0/3186436386 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bec03a030 con 0x55b4a47bd840 2024-09-13T19:16:18.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.402+0000 7f4bfce17640 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c1dd0 con 0x55b4a47b8fd0 2024-09-13T19:16:18.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.402+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4be402b040 con 0x55b4a47b8fd0 2024-09-13T19:16:18.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.402+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c1dd0 con 0x7f4bf4078070 2024-09-13T19:16:18.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.402+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4be402b040 con 0x7f4bf4078070 2024-09-13T19:16:18.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.402+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c1dd0 con 0x55b4a47b8fd0 2024-09-13T19:16:18.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.402+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4be402b040 con 0x55b4a47b8fd0 2024-09-13T19:16:18.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.402+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c1dd0 con 0x7f4bec045050 2024-09-13T19:16:18.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.403+0000 7f4bfc616640 1 -- 172.21.15.102:0/3186436386 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4bf407f070 con 0x7f4bec045050 2024-09-13T19:16:18.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.403+0000 7f4bfc616640 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c1dd0 con 0x55b4a47bd840 2024-09-13T19:16:18.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.403+0000 7f4bfce17640 1 -- 172.21.15.102:0/3186436386 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bec03a030 con 0x55b4a47bd840 2024-09-13T19:16:18.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.403+0000 7f4bfce17640 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c1dd0 con 0x55b4a47bd840 2024-09-13T19:16:18.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.403+0000 7f4bfce17640 1 -- 172.21.15.102:0/3186436386 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4bec03a030 con 0x55b4a47bd840 2024-09-13T19:16:18.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.403+0000 7f4bfce17640 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c1dd0 con 0x7f4bf4078070 2024-09-13T19:16:18.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.403+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4be402b040 con 0x7f4bf4078070 2024-09-13T19:16:18.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.403+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c1dd0 con 0x55b4a47bd840 2024-09-13T19:16:18.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.403+0000 7f4bfce17640 1 -- 172.21.15.102:0/3186436386 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4bec03a030 con 0x55b4a47bd840 2024-09-13T19:16:18.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.404+0000 7f4bfce17640 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c1dd0 con 0x55b4a47bd840 2024-09-13T19:16:18.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.404+0000 7f4bfce17640 1 -- 172.21.15.102:0/3186436386 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bec03a030 con 0x55b4a47bd840 2024-09-13T19:16:18.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.404+0000 7f4bfce17640 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c1dd0 con 0x55b4a47b8fd0 2024-09-13T19:16:18.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.404+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4be402b040 con 0x55b4a47b8fd0 2024-09-13T19:16:18.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.404+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c1dd0 con 0x55b4a47b8fd0 2024-09-13T19:16:18.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.404+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4be402b040 con 0x55b4a47b8fd0 2024-09-13T19:16:18.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.404+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c1dd0 con 0x7f4bf4078070 2024-09-13T19:16:18.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.405+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4be402b040 con 0x7f4bf4078070 2024-09-13T19:16:18.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.405+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c1dd0 con 0x55b4a47bd840 2024-09-13T19:16:18.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.405+0000 7f4bfce17640 1 -- 172.21.15.102:0/3186436386 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bec03a030 con 0x55b4a47bd840 2024-09-13T19:16:18.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.405+0000 7f4bfce17640 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c1dd0 con 0x7f4bec045050 2024-09-13T19:16:18.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.405+0000 7f4bfc616640 1 -- 172.21.15.102:0/3186436386 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bf407f070 con 0x7f4bec045050 2024-09-13T19:16:18.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.405+0000 7f4bfc616640 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c1dd0 con 0x55b4a47b8fd0 2024-09-13T19:16:18.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.405+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4be402b040 con 0x55b4a47b8fd0 2024-09-13T19:16:18.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.405+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c1dd0 con 0x7f4bf4078070 2024-09-13T19:16:18.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.406+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4be403b040 con 0x7f4bf4078070 2024-09-13T19:16:18.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.406+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c1dd0 con 0x55b4a47bd840 2024-09-13T19:16:18.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.406+0000 7f4bfce17640 1 -- 172.21.15.102:0/3186436386 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bec03a030 con 0x55b4a47bd840 2024-09-13T19:16:18.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.406+0000 7f4bfce17640 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c1dd0 con 0x7f4bf4078070 2024-09-13T19:16:18.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.406+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4be403b040 con 0x7f4bf4078070 2024-09-13T19:16:18.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.406+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c1dd0 con 0x7f4bec045050 2024-09-13T19:16:18.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.406+0000 7f4bfc616640 1 -- 172.21.15.102:0/3186436386 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bf407f070 con 0x7f4bec045050 2024-09-13T19:16:18.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.406+0000 7f4bfc616640 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c1dd0 con 0x55b4a47bd840 2024-09-13T19:16:18.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.406+0000 7f4bfce17640 1 -- 172.21.15.102:0/3186436386 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bec03a030 con 0x55b4a47bd840 2024-09-13T19:16:18.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.407+0000 7f4bfce17640 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c1dd0 con 0x7f4bf4078070 2024-09-13T19:16:18.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.407+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4be403b040 con 0x7f4bf4078070 2024-09-13T19:16:18.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.407+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c1dd0 con 0x55b4a47b8fd0 2024-09-13T19:16:18.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.407+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4be403b040 con 0x55b4a47b8fd0 2024-09-13T19:16:18.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.407+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c1dd0 con 0x7f4bec045050 2024-09-13T19:16:18.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.407+0000 7f4bfc616640 1 -- 172.21.15.102:0/3186436386 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bf407f070 con 0x7f4bec045050 2024-09-13T19:16:18.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.407+0000 7f4c00920800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:18.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.407+0000 7f4c00920800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:18.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.407+0000 7f4c00920800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:18.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.407+0000 7f4c00920800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:18.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.407+0000 7f4c00920800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:18.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.407+0000 7f4c00920800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:18.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.407+0000 7f4c00920800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.407+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c0ed0 con 0x55b4a47b8fd0 2024-09-13T19:16:18.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.408+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4be403b040 con 0x55b4a47b8fd0 2024-09-13T19:16:18.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.408+0000 7f4c00920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:18.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.408+0000 7f4c00920800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.408+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c1770 con 0x55b4a47b8fd0 2024-09-13T19:16:18.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.408+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4be403b040 con 0x55b4a47b8fd0 2024-09-13T19:16:18.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.408+0000 7f4c00920800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:18.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.408+0000 7f4c00920800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.408+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c0b10 con 0x55b4a47bd840 2024-09-13T19:16:18.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.408+0000 7f4bfce17640 1 -- 172.21.15.102:0/3186436386 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4bec03a030 con 0x55b4a47bd840 2024-09-13T19:16:18.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.408+0000 7f4c00920800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:18.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.408+0000 7f4c00920800 20 zone default found 2024-09-13T19:16:18.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.408+0000 7f4c00920800 4 Realm: () 2024-09-13T19:16:18.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.408+0000 7f4c00920800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:18.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.408+0000 7f4c00920800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:18.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.408+0000 7f4c00920800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:18.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.408+0000 7f4c00920800 20 zonegroup default 2024-09-13T19:16:18.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.408+0000 7f4c00920800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.408+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c2750 con 0x7f4bf4078070 2024-09-13T19:16:18.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.408+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4be403b040 con 0x7f4bf4078070 2024-09-13T19:16:18.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.408+0000 7f4c00920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:18.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.408+0000 7f4c00920800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.408+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c4250 con 0x55b4a47bd840 2024-09-13T19:16:18.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.409+0000 7f4bfce17640 1 -- 172.21.15.102:0/3186436386 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4bec03a030 con 0x55b4a47bd840 2024-09-13T19:16:18.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.409+0000 7f4c00920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:18.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.409+0000 7f4c00920800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.409+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c4790 con 0x55b4a47bd840 2024-09-13T19:16:18.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.409+0000 7f4bfce17640 1 -- 172.21.15.102:0/3186436386 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4bec03a030 con 0x55b4a47bd840 2024-09-13T19:16:18.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.409+0000 7f4c00920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:18.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.409+0000 7f4c00920800 20 started sync module instance, tier type = 2024-09-13T19:16:18.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.409+0000 7f4c00920800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:18.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.409+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c3db0 con 0x7f4bec045050 2024-09-13T19:16:18.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.410+0000 7f4bfc616640 1 -- 172.21.15.102:0/3186436386 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(44 notify.0 [create] v34'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bf407f070 con 0x7f4bec045050 2024-09-13T19:16:18.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.410+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94234342076960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c4bf0 con 0x7f4bec045050 2024-09-13T19:16:18.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.410+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c5630 con 0x55b4a47b8fd0 2024-09-13T19:16:18.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.411+0000 7f4bfc616640 1 -- 172.21.15.102:0/3186436386 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94234342076960] v34'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bf407f070 con 0x7f4bec045050 2024-09-13T19:16:18.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.411+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v34'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4be403b040 con 0x55b4a47b8fd0 2024-09-13T19:16:18.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.411+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94234342084992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c55a0 con 0x55b4a47b8fd0 2024-09-13T19:16:18.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.411+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c6520 con 0x55b4a47bd840 2024-09-13T19:16:18.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.412+0000 7f4bfce17640 1 -- 172.21.15.102:0/3186436386 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v34'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bec03a030 con 0x55b4a47bd840 2024-09-13T19:16:18.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.412+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94234342084992] v34'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4be403b040 con 0x55b4a47b8fd0 2024-09-13T19:16:18.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.412+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94234342088816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c6940 con 0x55b4a47bd840 2024-09-13T19:16:18.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.412+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c5a70 con 0x7f4bec045050 2024-09-13T19:16:18.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.413+0000 7f4bfce17640 1 -- 172.21.15.102:0/3186436386 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94234342088816] v34'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bec03a030 con 0x55b4a47bd840 2024-09-13T19:16:18.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.413+0000 7f4bfc616640 1 -- 172.21.15.102:0/3186436386 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(50 notify.3 [create] v34'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bf407f070 con 0x7f4bec045050 2024-09-13T19:16:18.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.413+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94234342090352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c73b0 con 0x7f4bec045050 2024-09-13T19:16:18.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.413+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c7c80 con 0x55b4a47b8fd0 2024-09-13T19:16:18.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.414+0000 7f4bfc616640 1 -- 172.21.15.102:0/3186436386 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94234342090352] v34'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bf407f070 con 0x7f4bec045050 2024-09-13T19:16:18.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.415+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v34'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4be403b040 con 0x55b4a47b8fd0 2024-09-13T19:16:18.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.415+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94234342094672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c80a0 con 0x55b4a47b8fd0 2024-09-13T19:16:18.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.415+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c8ac0 con 0x7f4bf4078070 2024-09-13T19:16:18.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.416+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(54 notify.5 [create] v34'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4be403b040 con 0x7f4bf4078070 2024-09-13T19:16:18.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.416+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94234342098352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c8a80 con 0x7f4bf4078070 2024-09-13T19:16:18.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.416+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c9a60 con 0x7f4bf4078070 2024-09-13T19:16:18.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.416+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94234342094672] v34'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4be403b040 con 0x55b4a47b8fd0 2024-09-13T19:16:18.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.417+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94234342098352] v34'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4be403b040 con 0x7f4bf4078070 2024-09-13T19:16:18.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.417+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(56 notify.6 [create] v34'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4be403b040 con 0x7f4bf4078070 2024-09-13T19:16:18.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.417+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94234342100656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c95b0 con 0x7f4bf4078070 2024-09-13T19:16:18.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.417+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c9f70 con 0x7f4bf4078070 2024-09-13T19:16:18.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.418+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(58 notify.7 [create] v34'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4be403b040 con 0x7f4bf4078070 2024-09-13T19:16:18.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.418+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94234342103744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47ca390 con 0x7f4bf4078070 2024-09-13T19:16:18.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.418+0000 7f4c00920800 20 add_watcher() i=0 2024-09-13T19:16:18.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.418+0000 7f4c00920800 20 add_watcher() i=1 2024-09-13T19:16:18.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.418+0000 7f4c00920800 20 add_watcher() i=2 2024-09-13T19:16:18.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.418+0000 7f4c00920800 20 add_watcher() i=3 2024-09-13T19:16:18.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.418+0000 7f4c00920800 20 add_watcher() i=4 2024-09-13T19:16:18.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.418+0000 7f4c00920800 20 add_watcher() i=5 2024-09-13T19:16:18.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.418+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94234342100656] v34'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4be403b040 con 0x7f4bf4078070 2024-09-13T19:16:18.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.418+0000 7f4c00920800 20 add_watcher() i=6 2024-09-13T19:16:18.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.419+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94234342103744] v34'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4be403b040 con 0x7f4bf4078070 2024-09-13T19:16:18.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.419+0000 7f4c00920800 20 add_watcher() i=7 2024-09-13T19:16:18.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.419+0000 7f4c00920800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:18.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.419+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c6f00 con 0x55b4a47b8fd0 2024-09-13T19:16:18.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.419+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4be403b040 con 0x55b4a47b8fd0 2024-09-13T19:16:18.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.419+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94234342104800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47c6f00 con 0x55b4a47b8fd0 2024-09-13T19:16:18.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.420+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94234342104800] v34'100 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4be403b040 con 0x55b4a47b8fd0 2024-09-13T19:16:18.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.420+0000 7f4ab27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:18.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.420+0000 7f4c00920800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:18.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.420+0000 7f4c00920800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:18.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.420+0000 7f4c00920800 5 note: GC not initialized 2024-09-13T19:16:18.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.420+0000 7f4ab17e2640 20 reqs_thread_entry: start 2024-09-13T19:16:18.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.420+0000 7f4c00920800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:18.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.420+0000 7f4c00920800 20 Filter name: none 2024-09-13T19:16:18.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.421+0000 7f4a22ffd640 20 reqs_thread_entry: start 2024-09-13T19:16:18.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.421+0000 7f4c00920800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.421+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4a4800610 con 0x7f4bec045050 2024-09-13T19:16:18.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.421+0000 7f4bfc616640 1 -- 172.21.15.102:0/3186436386 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv2 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f4bf407f070 con 0x7f4bec045050 2024-09-13T19:16:18.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.421+0000 7f4c00920800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:16:18.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.421+0000 7f4c00920800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.421+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:63 8.9 8:917ee2d5:root::.bucket.meta.myfoo%3a509740b4-c081-4f37-bd6d-df9ca851489b.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4a4800f80 con 0x7f4bec045050 2024-09-13T19:16:18.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.421+0000 7f4bfc616640 1 -- 172.21.15.102:0/3186436386 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(63 .bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f4bf407f070 con 0x7f4bec045050 2024-09-13T19:16:18.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.421+0000 7f4c00920800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:16:18.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.421+0000 7f4c00920800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T19:16:18.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.421+0000 7f4c00920800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.421+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4a4800f30 con 0x7f4bec045050 2024-09-13T19:16:18.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.422+0000 7f4bfc616640 1 -- 172.21.15.102:0/3186436386 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv2 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f4bf407f070 con 0x7f4bec045050 2024-09-13T19:16:18.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.422+0000 7f4c00920800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:16:18.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.422+0000 7f4c00920800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.422+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:65 8.9 8:917ee2d5:root::.bucket.meta.myfoo%3a509740b4-c081-4f37-bd6d-df9ca851489b.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4a4800f30 con 0x7f4bec045050 2024-09-13T19:16:18.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.422+0000 7f4bfc616640 1 -- 172.21.15.102:0/3186436386 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(65 .bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f4bf407f070 con 0x7f4bec045050 2024-09-13T19:16:18.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.422+0000 7f4c00920800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:16:18.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.422+0000 7f4c00920800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T19:16:18.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.422+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:66 4.3e 4:7eb89d75:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4a4803dd0 con 0x7f4bec045050 2024-09-13T19:16:18.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.422+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:67 4.28 4:16845d32:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4a4806740 con 0x55b4a47b8fd0 2024-09-13T19:16:18.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.422+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:68 4.e 4:7015f333:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4a4809380 con 0x7f4bec045050 2024-09-13T19:16:18.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.422+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:69 4.31 4:8e14c63f:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4a480bcc0 con 0x55b4a47b8fd0 2024-09-13T19:16:18.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.422+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:70 4.1f 4:fb695182:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4a4809380 con 0x55b4a47bd840 2024-09-13T19:16:18.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.422+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:71 4.22 4:475c4288:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4a4810b40 con 0x55b4a47b8fd0 2024-09-13T19:16:18.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.422+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:72 4.8 4:102eb403:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4a4813570 con 0x55b4a47bd840 2024-09-13T19:16:18.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.422+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:73 4.3d 4:be2d5322:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4a48163f0 con 0x55b4a47bd840 2024-09-13T19:16:18.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.422+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:74 4.8 4:130dc037:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4a4818ec0 con 0x55b4a47bd840 2024-09-13T19:16:18.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.422+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:75 4.32 4:4c01988a:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4a481b750 con 0x55b4a47b8fd0 2024-09-13T19:16:18.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.422+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:76 4.1c 4:3b6ce2a2:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4a481e230 con 0x7f4bf4078070 2024-09-13T19:16:18.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.422+0000 7f4bfc616640 1 -- 172.21.15.102:0/3186436386 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(66 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4bf407f070 con 0x7f4bec045050 2024-09-13T19:16:18.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.422+0000 7f4bfc616640 1 -- 172.21.15.102:0/3186436386 <== osd.2 v2:172.21.15.102:6816/2238176080 16 ==== osd_op_reply(68 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4bf407f070 con 0x7f4bec045050 2024-09-13T19:16:18.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.423+0000 7f4bfce17640 1 -- 172.21.15.102:0/3186436386 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(70 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4bec03a030 con 0x55b4a47bd840 2024-09-13T19:16:18.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.423+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(76 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f4be403b040 con 0x7f4bf4078070 2024-09-13T19:16:18.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.423+0000 7f4bfce17640 1 -- 172.21.15.102:0/3186436386 <== osd.3 v2:172.21.15.102:6800/3096737090 17 ==== osd_op_reply(73 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4bec03a030 con 0x55b4a47bd840 2024-09-13T19:16:18.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.423+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(67 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4be403b040 con 0x55b4a47b8fd0 2024-09-13T19:16:18.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.423+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(69 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4be403b040 con 0x55b4a47b8fd0 2024-09-13T19:16:18.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.423+0000 7f4bfce17640 1 -- 172.21.15.102:0/3186436386 <== osd.3 v2:172.21.15.102:6800/3096737090 18 ==== osd_op_reply(72 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4bec03a030 con 0x55b4a47bd840 2024-09-13T19:16:18.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.423+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(71 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.5 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f4be403b040 con 0x55b4a47b8fd0 2024-09-13T19:16:18.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.423+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(75 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4be403b040 con 0x55b4a47b8fd0 2024-09-13T19:16:18.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.423+0000 7f4bfce17640 1 -- 172.21.15.102:0/3186436386 <== osd.3 v2:172.21.15.102:6800/3096737090 19 ==== osd_op_reply(74 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.8 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4bec03a030 con 0x55b4a47bd840 2024-09-13T19:16:18.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.424+0000 7f4ab27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:18.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.424+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94234342104800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4a481e230 con 0x55b4a47b8fd0 2024-09-13T19:16:18.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.425+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94234342104800] v34'101 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4be403b040 con 0x55b4a47b8fd0 2024-09-13T19:16:18.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.425+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94234342076960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47fe050 con 0x7f4bec045050 2024-09-13T19:16:18.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.426+0000 7f4bfc616640 1 -- 172.21.15.102:0/3186436386 <== osd.2 v2:172.21.15.102:6816/2238176080 17 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94234342076960] v34'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bf407f070 con 0x7f4bec045050 2024-09-13T19:16:18.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.426+0000 7f4c00920800 20 remove_watcher() i=0 2024-09-13T19:16:18.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.426+0000 7f4c00920800 2 removed watcher, disabling cache 2024-09-13T19:16:18.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.426+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94234342084992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47fe050 con 0x55b4a47b8fd0 2024-09-13T19:16:18.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.427+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94234342084992] v34'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4be403b040 con 0x55b4a47b8fd0 2024-09-13T19:16:18.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.427+0000 7f4c00920800 20 remove_watcher() i=1 2024-09-13T19:16:18.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.427+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94234342088816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47fe050 con 0x55b4a47bd840 2024-09-13T19:16:18.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.428+0000 7f4bfce17640 1 -- 172.21.15.102:0/3186436386 <== osd.3 v2:172.21.15.102:6800/3096737090 20 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94234342088816] v34'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bec03a030 con 0x55b4a47bd840 2024-09-13T19:16:18.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.428+0000 7f4c00920800 20 remove_watcher() i=2 2024-09-13T19:16:18.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.428+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94234342090352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47fe050 con 0x7f4bec045050 2024-09-13T19:16:18.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.429+0000 7f4bfc616640 1 -- 172.21.15.102:0/3186436386 <== osd.2 v2:172.21.15.102:6816/2238176080 18 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94234342090352] v34'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bf407f070 con 0x7f4bec045050 2024-09-13T19:16:18.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.429+0000 7f4c00920800 20 remove_watcher() i=3 2024-09-13T19:16:18.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.429+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94234342094672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47fe050 con 0x55b4a47b8fd0 2024-09-13T19:16:18.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.430+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94234342094672] v34'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4be403b040 con 0x55b4a47b8fd0 2024-09-13T19:16:18.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.430+0000 7f4c00920800 20 remove_watcher() i=4 2024-09-13T19:16:18.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.430+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94234342098352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47fe050 con 0x7f4bf4078070 2024-09-13T19:16:18.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.431+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94234342098352] v34'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4be403b040 con 0x7f4bf4078070 2024-09-13T19:16:18.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.431+0000 7f4c00920800 20 remove_watcher() i=5 2024-09-13T19:16:18.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.431+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94234342100656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47fe050 con 0x7f4bf4078070 2024-09-13T19:16:18.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.432+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94234342100656] v34'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4be403b040 con 0x7f4bf4078070 2024-09-13T19:16:18.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.432+0000 7f4c00920800 20 remove_watcher() i=6 2024-09-13T19:16:18.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.432+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94234342103744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4a47fe050 con 0x7f4bf4078070 2024-09-13T19:16:18.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.433+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 <== osd.0 v2:172.21.15.53:6800/4021716951 20 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94234342103744] v34'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4be403b040 con 0x7f4bf4078070 2024-09-13T19:16:18.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.433+0000 7f4c00920800 20 remove_watcher() i=7 2024-09-13T19:16:18.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.433+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f4bf4078070 msgr2=0x7f4bf40643b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.433+0000 7f4c00920800 1 --2- 172.21.15.102:0/3186436386 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f4bf4078070 0x7f4bf40643b0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.433+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55b4a47b8fd0 msgr2=0x55b4a47bb490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.433+0000 7f4c00920800 1 --2- 172.21.15.102:0/3186436386 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55b4a47b8fd0 0x55b4a47bb490 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.433+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f4bec045050 msgr2=0x7f4bec04eaa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.433+0000 7f4c00920800 1 --2- 172.21.15.102:0/3186436386 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f4bec045050 0x7f4bec04eaa0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.433+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55b4a47bd840 msgr2=0x55b4a47bfc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.433+0000 7f4c00920800 1 --2- 172.21.15.102:0/3186436386 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55b4a47bd840 0x55b4a47bfc50 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.433+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4acc036b40 msgr2=0x7f4acc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.433+0000 7f4c00920800 1 --2- 172.21.15.102:0/3186436386 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4acc036b40 0x7f4acc039000 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4bf405cfd0 tx=0x7f4bf408a000 comp rx=0 tx=0).stop 2024-09-13T19:16:18.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.434+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4a47a5f00 msgr2=0x55b4a47ad390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.434+0000 7f4c00920800 1 --2- 172.21.15.102:0/3186436386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4a47a5f00 0x55b4a47ad390 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f4bec02a040 tx=0x7f4bec04cd20 comp rx=0 tx=0).stop 2024-09-13T19:16:18.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.434+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 reap_dead start 2024-09-13T19:16:18.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.434+0000 7f4bfbe15640 1 -- 172.21.15.102:0/3186436386 reap_dead start 2024-09-13T19:16:18.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.434+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 shutdown_connections 2024-09-13T19:16:18.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.434+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 >> 172.21.15.102:0/3186436386 conn(0x55b4a47a22b0 msgr2=0x55b4a47a7610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:18.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.434+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 shutdown_connections 2024-09-13T19:16:18.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.434+0000 7f4c00920800 1 -- 172.21.15.102:0/3186436386 wait complete. 2024-09-13T19:16:18.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.434+0000 7f4c00920800 1 -- 172.21.15.102:0/2921000188 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4ad4036b90 msgr2=0x7f4ad4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.434+0000 7f4c00920800 1 --2- 172.21.15.102:0/2921000188 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4ad4036b90 0x7f4ad4039050 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x55b4a4786300 tx=0x7f4bf408f3b0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.434+0000 7f4c00920800 1 -- 172.21.15.102:0/2921000188 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4a47991e0 msgr2=0x55b4a4799600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.434+0000 7f4c00920800 1 --2- 172.21.15.102:0/2921000188 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4a47991e0 0x55b4a4799600 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x55b4a4785e20 tx=0x7f4bec0163e0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.434+0000 7f4c00920800 1 -- 172.21.15.102:0/2921000188 shutdown_connections 2024-09-13T19:16:18.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.434+0000 7f4c00920800 1 --2- 172.21.15.102:0/2921000188 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4ad4036b90 0x7f4ad4039050 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.434+0000 7f4c00920800 1 --2- 172.21.15.102:0/2921000188 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4a47991e0 0x55b4a4799600 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.434+0000 7f4c00920800 1 -- 172.21.15.102:0/2921000188 >> 172.21.15.102:0/2921000188 conn(0x55b4a478e170 msgr2=0x55b4a4790cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:18.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.434+0000 7f4c00920800 1 -- 172.21.15.102:0/2921000188 shutdown_connections 2024-09-13T19:16:18.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.434+0000 7f4c00920800 1 -- 172.21.15.102:0/2921000188 wait complete. 2024-09-13T19:16:18.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.434+0000 7f4c00920800 1 -- 172.21.15.102:0/3109855341 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55b4a4684e90 msgr2=0x55b4a47853b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.434+0000 7f4c00920800 1 --2- 172.21.15.102:0/3109855341 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55b4a4684e90 0x55b4a47853b0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.434+0000 7f4c00920800 1 -- 172.21.15.102:0/3109855341 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55b4a4787d50 msgr2=0x55b4a478a140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.434+0000 7f4c00920800 1 --2- 172.21.15.102:0/3109855341 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55b4a4787d50 0x55b4a478a140 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.434+0000 7f4c00920800 1 -- 172.21.15.102:0/3109855341 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4ae4036b40 msgr2=0x7f4ae4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.434+0000 7f4c00920800 1 --2- 172.21.15.102:0/3109855341 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4ae4036b40 0x7f4ae4039000 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4be4000f60 tx=0x7f4be4001370 comp rx=0 tx=0).stop 2024-09-13T19:16:18.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.434+0000 7f4c00920800 1 -- 172.21.15.102:0/3109855341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4a4684550 msgr2=0x55b4a477e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.434+0000 7f4c00920800 1 --2- 172.21.15.102:0/3109855341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4a4684550 0x55b4a477e340 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f4bf4025da0 tx=0x7f4bf4002fb0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.434+0000 7f4c00920800 1 -- 172.21.15.102:0/3109855341 shutdown_connections 2024-09-13T19:16:18.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.434+0000 7f4c00920800 1 --2- 172.21.15.102:0/3109855341 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55b4a4787d50 0x55b4a478a140 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.434+0000 7f4c00920800 1 --2- 172.21.15.102:0/3109855341 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55b4a4684e90 0x55b4a47853b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.434+0000 7f4c00920800 1 --2- 172.21.15.102:0/3109855341 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4ae4036b40 0x7f4ae4039000 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.434+0000 7f4c00920800 1 --2- 172.21.15.102:0/3109855341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b4a4684550 0x55b4a477e340 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.435+0000 7f4c00920800 1 -- 172.21.15.102:0/3109855341 >> 172.21.15.102:0/3109855341 conn(0x55b4a467fde0 msgr2=0x55b4a476d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:18.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.435+0000 7f4c00920800 1 -- 172.21.15.102:0/3109855341 shutdown_connections 2024-09-13T19:16:18.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.435+0000 7f4c00920800 1 -- 172.21.15.102:0/3109855341 wait complete. 2024-09-13T19:16:18.471 INFO:teuthology.orchestra.run.smithi102.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"f767d22e-a5e7-4349-a797-2de84f67e90b","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"509740b4-c081-4f37-bd6d-df9ca851489b.4237.1","marker":"509740b4-c081-4f37-bd6d-df9ca851489b.4237.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-13T19:16:17.496135Z","creation_time":"2024-09-13T19:16:17.492008Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":3,"size_actual":4096,"size_utilized":3,"size_kb":1,"size_kb_actual":4,"size_kb_utilized":1,"num_objects":1}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-09-13T19:16:18.472 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'f767d22e-a5e7-4349-a797-2de84f67e90b', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '509740b4-c081-4f37-bd6d-df9ca851489b.4237.1', 'marker': '509740b4-c081-4f37-bd6d-df9ca851489b.4237.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T19:16:17.496135Z', 'creation_time': '2024-09-13T19:16:17.492008Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-13T19:16:18.472 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-13T19:16:18.472 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-13T19:16:18.472 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2024-09-13T19:16:18.561 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:18.561 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:18.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.556+0000 7f9b91530800 1 Processor -- start 2024-09-13T19:16:18.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.556+0000 7f9b91530800 1 -- start start 2024-09-13T19:16:18.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.557+0000 7f9b91530800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55679b1c84e0 0x55679b1c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.557+0000 7f9b91530800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55679b088b30 con 0x55679b1c8e20 2024-09-13T19:16:18.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.557+0000 7f9b91530800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55679b06a360 con 0x55679b1c84e0 2024-09-13T19:16:18.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.557+0000 7f9b8d25c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55679b1c84e0 0x55679b1c88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.557+0000 7f9b8d25c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55679b1c84e0 0x55679b1c88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55204/0 (socket says 172.21.15.102:55204) 2024-09-13T19:16:18.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.557+0000 7f9b8d25c640 1 -- 172.21.15.102:0/2067824603 learned_addr learned my addr 172.21.15.102:0/2067824603 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:18.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.557+0000 7f9b84a5b640 1 --1- 172.21.15.102:0/2067824603 >> v1:172.21.15.53:6789/0 conn(0x55679b1c8e20 0x55679b1cd9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:49986/0 (socket says 172.21.15.102:49986) 2024-09-13T19:16:18.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.557+0000 7f9b8d25c640 1 -- 172.21.15.102:0/2067824603 >> v1:172.21.15.53:6789/0 conn(0x55679b1c8e20 legacy=0x55679b1cd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.557+0000 7f9b8d25c640 1 -- 172.21.15.102:0/2067824603 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55679b090e00 con 0x55679b1c84e0 2024-09-13T19:16:18.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.559+0000 7f9b8d25c640 1 --2- 172.21.15.102:0/2067824603 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55679b1c84e0 0x55679b1c88e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9b8000a520 tx=0x7f9b80045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d745269c1cc26a65 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.559+0000 7f9b8ca5b640 1 -- 172.21.15.102:0/2067824603 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b80055070 con 0x55679b1c84e0 2024-09-13T19:16:18.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.559+0000 7f9b8ca5b640 1 -- 172.21.15.102:0/2067824603 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b800515b0 con 0x55679b1c84e0 2024-09-13T19:16:18.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.559+0000 7f9b8ca5b640 1 -- 172.21.15.102:0/2067824603 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b800518d0 con 0x55679b1c84e0 2024-09-13T19:16:18.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.560+0000 7f9b91530800 1 -- 172.21.15.102:0/2067824603 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55679b1c84e0 msgr2=0x55679b1c88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.560+0000 7f9b91530800 1 --2- 172.21.15.102:0/2067824603 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55679b1c84e0 0x55679b1c88e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9b8000a520 tx=0x7f9b80045ba0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.560+0000 7f9b91530800 1 -- 172.21.15.102:0/2067824603 shutdown_connections 2024-09-13T19:16:18.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.560+0000 7f9b91530800 1 --2- 172.21.15.102:0/2067824603 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55679b1c84e0 0x55679b1c88e0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.560+0000 7f9b91530800 1 -- 172.21.15.102:0/2067824603 >> 172.21.15.102:0/2067824603 conn(0x55679b1c3dd0 msgr2=0x55679b1c61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:18.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.560+0000 7f9b91530800 1 -- 172.21.15.102:0/2067824603 shutdown_connections 2024-09-13T19:16:18.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.560+0000 7f9b91530800 1 -- 172.21.15.102:0/2067824603 wait complete. 2024-09-13T19:16:18.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.574+0000 7f9b91530800 1 Processor -- start 2024-09-13T19:16:18.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.574+0000 7f9b91530800 1 -- start start 2024-09-13T19:16:18.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.574+0000 7f9b91530800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55679b1c84e0 0x55679b13cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.574+0000 7f9b91530800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55679b115360 con 0x55679b1c84e0 2024-09-13T19:16:18.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.574+0000 7f9b8d25c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55679b1c84e0 0x55679b13cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.574+0000 7f9b8d25c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55679b1c84e0 0x55679b13cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55210/0 (socket says 172.21.15.102:55210) 2024-09-13T19:16:18.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.574+0000 7f9b8d25c640 1 -- 172.21.15.102:0/3895872852 learned_addr learned my addr 172.21.15.102:0/3895872852 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:18.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.574+0000 7f9b8d25c640 1 -- 172.21.15.102:0/3895872852 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55679b062bc0 con 0x55679b1c84e0 2024-09-13T19:16:18.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.575+0000 7f9b8d25c640 1 --2- 172.21.15.102:0/3895872852 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55679b1c84e0 0x55679b13cd80 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9b80025da0 tx=0x7f9b80051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83d3ef670ec73b8a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.575+0000 7f9a7b606640 1 -- 172.21.15.102:0/3895872852 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b80051950 con 0x55679b1c84e0 2024-09-13T19:16:18.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.575+0000 7f9a7b606640 1 -- 172.21.15.102:0/3895872852 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b80051af0 con 0x55679b1c84e0 2024-09-13T19:16:18.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.575+0000 7f9a7b606640 1 -- 172.21.15.102:0/3895872852 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b80051dd0 con 0x55679b1c84e0 2024-09-13T19:16:18.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.576+0000 7f9b91530800 1 -- 172.21.15.102:0/3895872852 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55679b1c84e0 msgr2=0x55679b13cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.576+0000 7f9b91530800 1 --2- 172.21.15.102:0/3895872852 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55679b1c84e0 0x55679b13cd80 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9b80025da0 tx=0x7f9b80051000 comp rx=0 tx=0).stop 2024-09-13T19:16:18.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.576+0000 7f9b91530800 1 -- 172.21.15.102:0/3895872852 shutdown_connections 2024-09-13T19:16:18.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.576+0000 7f9b91530800 1 --2- 172.21.15.102:0/3895872852 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55679b1c84e0 0x55679b13cd80 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.576+0000 7f9b91530800 1 -- 172.21.15.102:0/3895872852 >> 172.21.15.102:0/3895872852 conn(0x55679b1c3dd0 msgr2=0x55679b2b3170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:18.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.576+0000 7f9b91530800 1 -- 172.21.15.102:0/3895872852 shutdown_connections 2024-09-13T19:16:18.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.576+0000 7f9b91530800 1 -- 172.21.15.102:0/3895872852 wait complete. 2024-09-13T19:16:18.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.576+0000 7f9b91530800 1 Processor -- start 2024-09-13T19:16:18.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.576+0000 7f9b91530800 1 -- start start 2024-09-13T19:16:18.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.576+0000 7f9b91530800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55679b1c84e0 0x55679b2c0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.576+0000 7f9b91530800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55679b1cf500 con 0x55679b1c84e0 2024-09-13T19:16:18.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.576+0000 7f9b8d25c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55679b1c84e0 0x55679b2c0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.576+0000 7f9b8d25c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55679b1c84e0 0x55679b2c0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55224/0 (socket says 172.21.15.102:55224) 2024-09-13T19:16:18.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.576+0000 7f9b8d25c640 1 -- 172.21.15.102:0/311026517 learned_addr learned my addr 172.21.15.102:0/311026517 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:18.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.577+0000 7f9b8d25c640 1 -- 172.21.15.102:0/311026517 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55679b076fe0 con 0x55679b1c84e0 2024-09-13T19:16:18.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.577+0000 7f9b8d25c640 1 --2- 172.21.15.102:0/311026517 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55679b1c84e0 0x55679b2c0190 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9b80067040 tx=0x7f9b80002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.577+0000 7f9a79e03640 1 -- 172.21.15.102:0/311026517 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b80073070 con 0x55679b1c84e0 2024-09-13T19:16:18.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.577+0000 7f9a79e03640 1 -- 172.21.15.102:0/311026517 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b8005a450 con 0x55679b1c84e0 2024-09-13T19:16:18.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.577+0000 7f9b91530800 1 -- 172.21.15.102:0/311026517 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55679b2c06d0 con 0x55679b1c84e0 2024-09-13T19:16:18.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.577+0000 7f9a79e03640 1 -- 172.21.15.102:0/311026517 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b8005a730 con 0x55679b1c84e0 2024-09-13T19:16:18.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.577+0000 7f9b91530800 1 -- 172.21.15.102:0/311026517 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55679b2c0c50 con 0x55679b1c84e0 2024-09-13T19:16:18.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.578+0000 7f9a79e03640 1 -- 172.21.15.102:0/311026517 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9b80076070 con 0x55679b1c84e0 2024-09-13T19:16:18.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.578+0000 7f9a79e03640 1 --2- 172.21.15.102:0/311026517 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9a74036b40 0x7f9a74039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.578+0000 7f9a79e03640 1 -- 172.21.15.102:0/311026517 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f9b80062070 con 0x55679b1c84e0 2024-09-13T19:16:18.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.578+0000 7f9b84a5b640 1 --2- 172.21.15.102:0/311026517 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9a74036b40 0x7f9a74039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.578+0000 7f9b91530800 1 --2- 172.21.15.102:0/311026517 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55679b1c8e20 0x55679b2c7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.578+0000 7f9b91530800 1 -- 172.21.15.102:0/311026517 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55679b2c77a0 con 0x55679b1c8e20 2024-09-13T19:16:18.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.578+0000 7f9b8da5d640 1 --2- 172.21.15.102:0/311026517 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55679b1c8e20 0x55679b2c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.578+0000 7f9b84a5b640 1 --2- 172.21.15.102:0/311026517 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9a74036b40 0x7f9a74039000 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9b78000f60 tx=0x7f9b78001370 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.579+0000 7f9b8da5d640 1 --2- 172.21.15.102:0/311026517 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55679b1c8e20 0x55679b2c7260 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.579+0000 7f9b8da5d640 1 -- 172.21.15.102:0/311026517 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9b8800a4a0 con 0x55679b1c8e20 2024-09-13T19:16:18.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.579+0000 7f9b91530800 1 -- 172.21.15.102:0/311026517 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55679b2c4830 con 0x55679b1c8e20 2024-09-13T19:16:18.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.579+0000 7f9b8da5d640 1 -- 172.21.15.102:0/311026517 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9b8800a4a0 con 0x55679b1c8e20 2024-09-13T19:16:18.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.579+0000 7f9b91530800 1 --2- 172.21.15.102:0/311026517 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55679b2c9ab0 0x55679b2cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.579+0000 7f9b91530800 1 -- 172.21.15.102:0/311026517 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55679b2cc590 con 0x55679b2c9ab0 2024-09-13T19:16:18.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.579+0000 7f9b8d25c640 1 --2- 172.21.15.102:0/311026517 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55679b2c9ab0 0x55679b2cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.579+0000 7f9b8d25c640 1 --2- 172.21.15.102:0/311026517 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55679b2c9ab0 0x55679b2cbea0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.580+0000 7f9b8d25c640 1 -- 172.21.15.102:0/311026517 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9b80075030 con 0x55679b2c9ab0 2024-09-13T19:16:18.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.580+0000 7f9b91530800 1 -- 172.21.15.102:0/311026517 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55679b2c8950 con 0x55679b1c8e20 2024-09-13T19:16:18.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.580+0000 7f9b8da5d640 1 -- 172.21.15.102:0/311026517 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9b8800a4a0 con 0x55679b1c8e20 2024-09-13T19:16:18.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.580+0000 7f9b91530800 1 -- 172.21.15.102:0/311026517 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55679b2c8e30 con 0x55679b2c9ab0 2024-09-13T19:16:18.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.580+0000 7f9b8d25c640 1 -- 172.21.15.102:0/311026517 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9b80075030 con 0x55679b2c9ab0 2024-09-13T19:16:18.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.581+0000 7f9b91530800 1 Processor -- start 2024-09-13T19:16:18.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.581+0000 7f9b91530800 1 -- start start 2024-09-13T19:16:18.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.581+0000 7f9b91530800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55679b2daf20 0x55679b2db340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.581+0000 7f9b91530800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55679b064580 con 0x55679b2daf20 2024-09-13T19:16:18.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.581+0000 7f9b8da5d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55679b2daf20 0x55679b2db340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.581+0000 7f9b8da5d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55679b2daf20 0x55679b2db340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55230/0 (socket says 172.21.15.102:55230) 2024-09-13T19:16:18.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.581+0000 7f9b8da5d640 1 -- 172.21.15.102:0/3792702636 learned_addr learned my addr 172.21.15.102:0/3792702636 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:18.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.581+0000 7f9b8da5d640 1 -- 172.21.15.102:0/3792702636 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55679b2db880 con 0x55679b2daf20 2024-09-13T19:16:18.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.581+0000 7f9b8da5d640 1 --2- 172.21.15.102:0/3792702636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55679b2daf20 0x55679b2db340 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x55679b2c7b60 tx=0x7f9b880163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.582+0000 7f9a72ffd640 1 -- 172.21.15.102:0/3792702636 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b88013450 con 0x55679b2daf20 2024-09-13T19:16:18.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.582+0000 7f9a72ffd640 1 -- 172.21.15.102:0/3792702636 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b880135f0 con 0x55679b2daf20 2024-09-13T19:16:18.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.582+0000 7f9b91530800 1 -- 172.21.15.102:0/3792702636 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55679b2dbb10 con 0x55679b2daf20 2024-09-13T19:16:18.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.582+0000 7f9a72ffd640 1 -- 172.21.15.102:0/3792702636 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b880138d0 con 0x55679b2daf20 2024-09-13T19:16:18.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.582+0000 7f9b91530800 1 -- 172.21.15.102:0/3792702636 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55679b2de7f0 con 0x55679b2daf20 2024-09-13T19:16:18.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.582+0000 7f9a72ffd640 1 -- 172.21.15.102:0/3792702636 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9b88011040 con 0x55679b2daf20 2024-09-13T19:16:18.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.583+0000 7f9a72ffd640 1 --2- 172.21.15.102:0/3792702636 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9a64036b90 0x7f9a64039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.583+0000 7f9a72ffd640 1 -- 172.21.15.102:0/3792702636 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f9b8800e040 con 0x55679b2daf20 2024-09-13T19:16:18.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.583+0000 7f9b8d25c640 1 --2- 172.21.15.102:0/3792702636 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9a64036b90 0x7f9a64039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.583+0000 7f9b91530800 1 Processor -- start 2024-09-13T19:16:18.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.583+0000 7f9b91530800 1 -- start start 2024-09-13T19:16:18.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.583+0000 7f9b8d25c640 1 --2- 172.21.15.102:0/3792702636 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9a64036b90 0x7f9a64039050 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x55679b2c8060 tx=0x7f9b8005df40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.583+0000 7f9b91530800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55679b2e7c70 0x55679b2e8070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.583+0000 7f9b91530800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55679b2bb6f0 con 0x55679b2e7c70 2024-09-13T19:16:18.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.583+0000 7f9b8da5d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55679b2e7c70 0x55679b2e8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.583+0000 7f9b8da5d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55679b2e7c70 0x55679b2e8070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55240/0 (socket says 172.21.15.102:55240) 2024-09-13T19:16:18.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.583+0000 7f9b8da5d640 1 -- 172.21.15.102:0/520357928 learned_addr learned my addr 172.21.15.102:0/520357928 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:18.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.584+0000 7f9b8da5d640 1 -- 172.21.15.102:0/520357928 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55679b2e8640 con 0x55679b2e7c70 2024-09-13T19:16:18.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.584+0000 7f9b8da5d640 1 --2- 172.21.15.102:0/520357928 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55679b2e7c70 0x55679b2e8070 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9b8804cd90 tx=0x7f9b8804cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79656db97e7968e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.584+0000 7f9a70ff9640 1 -- 172.21.15.102:0/520357928 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b8804a070 con 0x55679b2e7c70 2024-09-13T19:16:18.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.584+0000 7f9a70ff9640 1 -- 172.21.15.102:0/520357928 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b8802a570 con 0x55679b2e7c70 2024-09-13T19:16:18.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.584+0000 7f9a70ff9640 1 -- 172.21.15.102:0/520357928 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b8801f4c0 con 0x55679b2e7c70 2024-09-13T19:16:18.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.584+0000 7f9b91530800 1 -- 172.21.15.102:0/520357928 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55679b2e7c70 msgr2=0x55679b2e8070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.584+0000 7f9b91530800 1 --2- 172.21.15.102:0/520357928 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55679b2e7c70 0x55679b2e8070 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9b8804cd90 tx=0x7f9b8804cf90 comp rx=0 tx=0).stop 2024-09-13T19:16:18.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.584+0000 7f9b91530800 1 -- 172.21.15.102:0/520357928 shutdown_connections 2024-09-13T19:16:18.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.584+0000 7f9b91530800 1 --2- 172.21.15.102:0/520357928 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55679b2e7c70 0x55679b2e8070 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.584+0000 7f9b91530800 1 -- 172.21.15.102:0/520357928 >> 172.21.15.102:0/520357928 conn(0x55679b2e3fd0 msgr2=0x55679b2e20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:18.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.584+0000 7f9b91530800 1 -- 172.21.15.102:0/520357928 shutdown_connections 2024-09-13T19:16:18.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.584+0000 7f9b91530800 1 -- 172.21.15.102:0/520357928 wait complete. 2024-09-13T19:16:18.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.585+0000 7f9b91530800 1 Processor -- start 2024-09-13T19:16:18.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.585+0000 7f9b91530800 1 -- start start 2024-09-13T19:16:18.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.585+0000 7f9b91530800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55679b2e7c70 0x55679b2ef0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.585+0000 7f9b91530800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55679b2e8cb0 con 0x55679b2e7c70 2024-09-13T19:16:18.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.585+0000 7f9b8da5d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55679b2e7c70 0x55679b2ef0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.585+0000 7f9b8da5d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55679b2e7c70 0x55679b2ef0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55252/0 (socket says 172.21.15.102:55252) 2024-09-13T19:16:18.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.585+0000 7f9b8da5d640 1 -- 172.21.15.102:0/941474196 learned_addr learned my addr 172.21.15.102:0/941474196 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:18.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.585+0000 7f9b8da5d640 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55679b2ef620 con 0x55679b2e7c70 2024-09-13T19:16:18.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.585+0000 7f9b8da5d640 1 --2- 172.21.15.102:0/941474196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55679b2e7c70 0x55679b2ef0e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f9b8802ac70 tx=0x7f9b8804cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.585+0000 7f9a62ffd640 1 -- 172.21.15.102:0/941474196 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b8801f710 con 0x55679b2e7c70 2024-09-13T19:16:18.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.586+0000 7f9a62ffd640 1 -- 172.21.15.102:0/941474196 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b88039070 con 0x55679b2e7c70 2024-09-13T19:16:18.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.586+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55679b2ef8b0 con 0x55679b2e7c70 2024-09-13T19:16:18.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.586+0000 7f9a62ffd640 1 -- 172.21.15.102:0/941474196 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b8801f9e0 con 0x55679b2e7c70 2024-09-13T19:16:18.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.586+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55679b2f2560 con 0x55679b2e7c70 2024-09-13T19:16:18.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.586+0000 7f9a62ffd640 1 -- 172.21.15.102:0/941474196 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9b88033070 con 0x55679b2e7c70 2024-09-13T19:16:18.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.587+0000 7f9a62ffd640 1 --2- 172.21.15.102:0/941474196 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9a58036b90 0x7f9a58039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.587+0000 7f9a62ffd640 1 -- 172.21.15.102:0/941474196 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f9b88041040 con 0x55679b2e7c70 2024-09-13T19:16:18.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.587+0000 7f9b8d25c640 1 --2- 172.21.15.102:0/941474196 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9a58036b90 0x7f9a58039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.587+0000 7f9b91530800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.587+0000 7f9b91530800 1 --2- 172.21.15.102:0/941474196 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55679b2fab00 0x55679b2fcfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.587+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55679b2fd710 con 0x55679b2fab00 2024-09-13T19:16:18.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.587+0000 7f9b84a5b640 1 --2- 172.21.15.102:0/941474196 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55679b2fab00 0x55679b2fcfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.587+0000 7f9b8d25c640 1 --2- 172.21.15.102:0/941474196 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9a58036b90 0x7f9a58039050 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x55679b2c7c00 tx=0x7f9b8008a000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.587+0000 7f9b84a5b640 1 --2- 172.21.15.102:0/941474196 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55679b2fab00 0x55679b2fcfc0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.588+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9b7800f610 con 0x55679b2fab00 2024-09-13T19:16:18.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.588+0000 7f9b91530800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:18.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.588+0000 7f9b91530800 20 realm 2024-09-13T19:16:18.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.588+0000 7f9b91530800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.588+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55679b2f9f50 con 0x55679b2fab00 2024-09-13T19:16:18.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.588+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9b7800f610 con 0x55679b2fab00 2024-09-13T19:16:18.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.588+0000 7f9b91530800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:18.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.588+0000 7f9b91530800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:18.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.588+0000 7f9b91530800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.588+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55679b2fe1f0 con 0x55679b2fab00 2024-09-13T19:16:18.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.588+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9b7800f610 con 0x55679b2fab00 2024-09-13T19:16:18.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.588+0000 7f9b91530800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:18.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.588+0000 7f9b91530800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.588+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55679b2feac0 con 0x55679b2fab00 2024-09-13T19:16:18.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.588+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9b7800f610 con 0x55679b2fab00 2024-09-13T19:16:18.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.588+0000 7f9b91530800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:18.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.588+0000 7f9b91530800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.588+0000 7f9b91530800 1 --2- 172.21.15.102:0/941474196 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55679b2ff370 0x55679b301780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.588+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55679b301ee0 con 0x55679b2ff370 2024-09-13T19:16:18.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.588+0000 7f9b8da5d640 1 --2- 172.21.15.102:0/941474196 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55679b2ff370 0x55679b301780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.589+0000 7f9b8da5d640 1 --2- 172.21.15.102:0/941474196 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55679b2ff370 0x55679b301780 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.589+0000 7f9b8da5d640 1 -- 172.21.15.102:0/941474196 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9b88027020 con 0x55679b2ff370 2024-09-13T19:16:18.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.589+0000 7f9b91530800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:18.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.589+0000 7f9b91530800 20 searching for the correct realm 2024-09-13T19:16:18.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.589+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55679b303910 con 0x55679b2ff370 2024-09-13T19:16:18.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.589+0000 7f9b8da5d640 1 -- 172.21.15.102:0/941474196 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b88027020 con 0x55679b2ff370 2024-09-13T19:16:18.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.589+0000 7f9b8da5d640 1 --2- 172.21.15.102:0/941474196 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f9b88059040 0x7f9b88012550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.589+0000 7f9b8da5d640 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55679b303910 con 0x7f9b88059040 2024-09-13T19:16:18.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.589+0000 7f9b8d25c640 1 --2- 172.21.15.102:0/941474196 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f9b88059040 0x7f9b88012550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.590+0000 7f9b8d25c640 1 --2- 172.21.15.102:0/941474196 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f9b88059040 0x7f9b88012550 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.590+0000 7f9b8d25c640 1 -- 172.21.15.102:0/941474196 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b8008e040 con 0x7f9b88059040 2024-09-13T19:16:18.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.590+0000 7f9b8d25c640 1 --2- 172.21.15.102:0/941474196 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f9b80078070 0x7f9b80065400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.590+0000 7f9b8d25c640 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55679b303910 con 0x7f9b80078070 2024-09-13T19:16:18.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.590+0000 7f9b84a5b640 1 --2- 172.21.15.102:0/941474196 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f9b80078070 0x7f9b80065400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.590+0000 7f9b84a5b640 1 --2- 172.21.15.102:0/941474196 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f9b80078070 0x7f9b80065400 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.591+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b7800f610 con 0x7f9b80078070 2024-09-13T19:16:18.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.591+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55679b303910 con 0x55679b2fab00 2024-09-13T19:16:18.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.591+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b7800f610 con 0x55679b2fab00 2024-09-13T19:16:18.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.591+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55679b303910 con 0x55679b2fab00 2024-09-13T19:16:18.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.591+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b7802b040 con 0x55679b2fab00 2024-09-13T19:16:18.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.591+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55679b303910 con 0x7f9b80078070 2024-09-13T19:16:18.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.591+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b7802b040 con 0x7f9b80078070 2024-09-13T19:16:18.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.592+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55679b303910 con 0x7f9b80078070 2024-09-13T19:16:18.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.592+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b7802b040 con 0x7f9b80078070 2024-09-13T19:16:18.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.592+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55679b303910 con 0x7f9b88059040 2024-09-13T19:16:18.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.592+0000 7f9b8d25c640 1 -- 172.21.15.102:0/941474196 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b8008e040 con 0x7f9b88059040 2024-09-13T19:16:18.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.592+0000 7f9b8d25c640 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55679b303910 con 0x55679b2ff370 2024-09-13T19:16:18.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.592+0000 7f9b8da5d640 1 -- 172.21.15.102:0/941474196 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b88027020 con 0x55679b2ff370 2024-09-13T19:16:18.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.592+0000 7f9b8da5d640 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55679b303910 con 0x55679b2fab00 2024-09-13T19:16:18.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.592+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b7802b040 con 0x55679b2fab00 2024-09-13T19:16:18.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.592+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55679b303910 con 0x7f9b80078070 2024-09-13T19:16:18.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.593+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b7802b040 con 0x7f9b80078070 2024-09-13T19:16:18.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.593+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55679b303910 con 0x55679b2fab00 2024-09-13T19:16:18.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.593+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b7802b040 con 0x55679b2fab00 2024-09-13T19:16:18.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.593+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55679b303910 con 0x7f9b88059040 2024-09-13T19:16:18.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.593+0000 7f9b8d25c640 1 -- 172.21.15.102:0/941474196 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9b8008e040 con 0x7f9b88059040 2024-09-13T19:16:18.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.593+0000 7f9b8d25c640 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55679b303910 con 0x55679b2ff370 2024-09-13T19:16:18.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.593+0000 7f9b8da5d640 1 -- 172.21.15.102:0/941474196 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b88027020 con 0x55679b2ff370 2024-09-13T19:16:18.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.593+0000 7f9b8da5d640 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55679b303910 con 0x55679b2ff370 2024-09-13T19:16:18.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.594+0000 7f9b8da5d640 1 -- 172.21.15.102:0/941474196 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9b88027020 con 0x55679b2ff370 2024-09-13T19:16:18.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.594+0000 7f9b8da5d640 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55679b303910 con 0x7f9b80078070 2024-09-13T19:16:18.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.594+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b7802b040 con 0x7f9b80078070 2024-09-13T19:16:18.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.594+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55679b303910 con 0x55679b2ff370 2024-09-13T19:16:18.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.594+0000 7f9b8da5d640 1 -- 172.21.15.102:0/941474196 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9b88027020 con 0x55679b2ff370 2024-09-13T19:16:18.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.594+0000 7f9b8da5d640 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55679b303910 con 0x55679b2ff370 2024-09-13T19:16:18.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.594+0000 7f9b8da5d640 1 -- 172.21.15.102:0/941474196 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b88027020 con 0x55679b2ff370 2024-09-13T19:16:18.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.594+0000 7f9b8da5d640 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55679b303910 con 0x55679b2fab00 2024-09-13T19:16:18.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.595+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b7802b040 con 0x55679b2fab00 2024-09-13T19:16:18.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.595+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55679b303910 con 0x55679b2fab00 2024-09-13T19:16:18.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.595+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9b7802b040 con 0x55679b2fab00 2024-09-13T19:16:18.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.595+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55679b303910 con 0x7f9b80078070 2024-09-13T19:16:18.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.595+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b7802b040 con 0x7f9b80078070 2024-09-13T19:16:18.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.595+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55679b303910 con 0x55679b2ff370 2024-09-13T19:16:18.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.595+0000 7f9b8da5d640 1 -- 172.21.15.102:0/941474196 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b88027020 con 0x55679b2ff370 2024-09-13T19:16:18.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.595+0000 7f9b8da5d640 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55679b303910 con 0x7f9b88059040 2024-09-13T19:16:18.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.596+0000 7f9b8d25c640 1 -- 172.21.15.102:0/941474196 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b8008e040 con 0x7f9b88059040 2024-09-13T19:16:18.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.596+0000 7f9b8d25c640 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55679b303910 con 0x55679b2fab00 2024-09-13T19:16:18.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.596+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b7802b040 con 0x55679b2fab00 2024-09-13T19:16:18.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.596+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55679b303910 con 0x7f9b80078070 2024-09-13T19:16:18.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.596+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b7803b040 con 0x7f9b80078070 2024-09-13T19:16:18.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.596+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55679b303910 con 0x55679b2ff370 2024-09-13T19:16:18.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.596+0000 7f9b8da5d640 1 -- 172.21.15.102:0/941474196 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b88027020 con 0x55679b2ff370 2024-09-13T19:16:18.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.596+0000 7f9b8da5d640 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55679b303910 con 0x7f9b80078070 2024-09-13T19:16:18.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.597+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b7803b040 con 0x7f9b80078070 2024-09-13T19:16:18.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.597+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55679b303910 con 0x7f9b88059040 2024-09-13T19:16:18.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.597+0000 7f9b8d25c640 1 -- 172.21.15.102:0/941474196 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b8008e040 con 0x7f9b88059040 2024-09-13T19:16:18.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.597+0000 7f9b8d25c640 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55679b303910 con 0x55679b2ff370 2024-09-13T19:16:18.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.597+0000 7f9b8da5d640 1 -- 172.21.15.102:0/941474196 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b88027020 con 0x55679b2ff370 2024-09-13T19:16:18.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.597+0000 7f9b8da5d640 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55679b303910 con 0x7f9b80078070 2024-09-13T19:16:18.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.597+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b7803b040 con 0x7f9b80078070 2024-09-13T19:16:18.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.597+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55679b303910 con 0x55679b2fab00 2024-09-13T19:16:18.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.598+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9b7803b040 con 0x55679b2fab00 2024-09-13T19:16:18.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.598+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55679b303910 con 0x7f9b88059040 2024-09-13T19:16:18.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.598+0000 7f9b8d25c640 1 -- 172.21.15.102:0/941474196 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b8008e040 con 0x7f9b88059040 2024-09-13T19:16:18.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.598+0000 7f9b91530800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:18.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.598+0000 7f9b91530800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:18.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.598+0000 7f9b91530800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:18.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.598+0000 7f9b91530800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:18.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.598+0000 7f9b91530800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:18.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.598+0000 7f9b91530800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:18.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.598+0000 7f9b91530800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.598+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55679b302a10 con 0x55679b2fab00 2024-09-13T19:16:18.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.598+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9b7803b040 con 0x55679b2fab00 2024-09-13T19:16:18.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.598+0000 7f9b91530800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:18.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.598+0000 7f9b91530800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.598+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55679b3032b0 con 0x55679b2fab00 2024-09-13T19:16:18.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.598+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9b7803b040 con 0x55679b2fab00 2024-09-13T19:16:18.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.598+0000 7f9b91530800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:18.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.598+0000 7f9b91530800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.598+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55679b302650 con 0x55679b2ff370 2024-09-13T19:16:18.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.599+0000 7f9b8da5d640 1 -- 172.21.15.102:0/941474196 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9b88027020 con 0x55679b2ff370 2024-09-13T19:16:18.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.599+0000 7f9b91530800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:18.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.599+0000 7f9b91530800 20 zone default found 2024-09-13T19:16:18.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.599+0000 7f9b91530800 4 Realm: () 2024-09-13T19:16:18.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.599+0000 7f9b91530800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:18.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.599+0000 7f9b91530800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:18.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.599+0000 7f9b91530800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:18.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.599+0000 7f9b91530800 20 zonegroup default 2024-09-13T19:16:18.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.599+0000 7f9b91530800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.599+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55679b304290 con 0x7f9b80078070 2024-09-13T19:16:18.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.599+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9b7803b040 con 0x7f9b80078070 2024-09-13T19:16:18.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.599+0000 7f9b91530800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:18.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.599+0000 7f9b91530800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.599+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55679b305d60 con 0x55679b2ff370 2024-09-13T19:16:18.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.599+0000 7f9b8da5d640 1 -- 172.21.15.102:0/941474196 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9b88027020 con 0x55679b2ff370 2024-09-13T19:16:18.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.599+0000 7f9b91530800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:18.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.599+0000 7f9b91530800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.599+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55679b306210 con 0x55679b2ff370 2024-09-13T19:16:18.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.599+0000 7f9b8da5d640 1 -- 172.21.15.102:0/941474196 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9b88027020 con 0x55679b2ff370 2024-09-13T19:16:18.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.599+0000 7f9b91530800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:18.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.599+0000 7f9b91530800 20 started sync module instance, tier type = 2024-09-13T19:16:18.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.599+0000 7f9b91530800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:18.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.599+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55679b304c60 con 0x7f9b88059040 2024-09-13T19:16:18.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.600+0000 7f9b8d25c640 1 -- 172.21.15.102:0/941474196 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(44 notify.0 [create] v34'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b8008e040 con 0x7f9b88059040 2024-09-13T19:16:18.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.600+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93903473627216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55679b3048c0 con 0x7f9b88059040 2024-09-13T19:16:18.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.600+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55679b307140 con 0x55679b2fab00 2024-09-13T19:16:18.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.601+0000 7f9b8d25c640 1 -- 172.21.15.102:0/941474196 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93903473627216] v34'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b8008e040 con 0x7f9b88059040 2024-09-13T19:16:18.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.602+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v34'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b7803b040 con 0x55679b2fab00 2024-09-13T19:16:18.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.602+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93903473634448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55679b3070b0 con 0x55679b2fab00 2024-09-13T19:16:18.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.602+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55679b308000 con 0x55679b2ff370 2024-09-13T19:16:18.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.603+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93903473634448] v34'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b7803b040 con 0x55679b2fab00 2024-09-13T19:16:18.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.603+0000 7f9b8da5d640 1 -- 172.21.15.102:0/941474196 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v34'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b88027020 con 0x55679b2ff370 2024-09-13T19:16:18.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.603+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93903473636656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55679b308000 con 0x55679b2ff370 2024-09-13T19:16:18.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.603+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55679b308a20 con 0x7f9b88059040 2024-09-13T19:16:18.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.604+0000 7f9b8da5d640 1 -- 172.21.15.102:0/941474196 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93903473636656] v34'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b88027020 con 0x55679b2ff370 2024-09-13T19:16:18.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.604+0000 7f9b8d25c640 1 -- 172.21.15.102:0/941474196 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(50 notify.3 [create] v34'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b8008e040 con 0x7f9b88059040 2024-09-13T19:16:18.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.604+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93903473638224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55679b307f70 con 0x7f9b88059040 2024-09-13T19:16:18.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.604+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55679b309910 con 0x55679b2fab00 2024-09-13T19:16:18.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.605+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v34'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b7803b040 con 0x55679b2fab00 2024-09-13T19:16:18.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.605+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93903473644640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55679b309d70 con 0x55679b2fab00 2024-09-13T19:16:18.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.605+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55679b30a870 con 0x7f9b80078070 2024-09-13T19:16:18.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.605+0000 7f9b8d25c640 1 -- 172.21.15.102:0/941474196 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93903473638224] v34'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b8008e040 con 0x7f9b88059040 2024-09-13T19:16:18.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.606+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(54 notify.5 [create] v34'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b7803b040 con 0x7f9b80078070 2024-09-13T19:16:18.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.606+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93903473648480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55679b30a830 con 0x7f9b80078070 2024-09-13T19:16:18.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.606+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55679b30b2f0 con 0x7f9b80078070 2024-09-13T19:16:18.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.606+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93903473644640] v34'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b7803b040 con 0x55679b2fab00 2024-09-13T19:16:18.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.607+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93903473648480] v34'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b7803b040 con 0x7f9b80078070 2024-09-13T19:16:18.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.607+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(56 notify.6 [create] v34'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b7803b040 con 0x7f9b80078070 2024-09-13T19:16:18.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.607+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93903473643072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55679b30ae00 con 0x7f9b80078070 2024-09-13T19:16:18.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.607+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55679b30b7c0 con 0x7f9b80078070 2024-09-13T19:16:18.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.608+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(58 notify.7 [create] v34'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b7803b040 con 0x7f9b80078070 2024-09-13T19:16:18.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.608+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93903473643072] v34'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b7803b040 con 0x7f9b80078070 2024-09-13T19:16:18.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.608+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93903473652496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55679b30bbe0 con 0x7f9b80078070 2024-09-13T19:16:18.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.608+0000 7f9b91530800 20 add_watcher() i=0 2024-09-13T19:16:18.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.608+0000 7f9b91530800 20 add_watcher() i=1 2024-09-13T19:16:18.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.608+0000 7f9b91530800 20 add_watcher() i=2 2024-09-13T19:16:18.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.608+0000 7f9b91530800 20 add_watcher() i=3 2024-09-13T19:16:18.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.608+0000 7f9b91530800 20 add_watcher() i=4 2024-09-13T19:16:18.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.608+0000 7f9b91530800 20 add_watcher() i=5 2024-09-13T19:16:18.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.608+0000 7f9b91530800 20 add_watcher() i=6 2024-09-13T19:16:18.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.609+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93903473652496] v34'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b7803b040 con 0x7f9b80078070 2024-09-13T19:16:18.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.609+0000 7f9b91530800 20 add_watcher() i=7 2024-09-13T19:16:18.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.609+0000 7f9b91530800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:18.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.609+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55679b30bbe0 con 0x55679b2fab00 2024-09-13T19:16:18.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.609+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9b7803b040 con 0x55679b2fab00 2024-09-13T19:16:18.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.609+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93903473653552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55679b30bb50 con 0x55679b2fab00 2024-09-13T19:16:18.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.611+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93903473653552] v34'102 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9b7803b040 con 0x55679b2fab00 2024-09-13T19:16:18.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.611+0000 7f9a437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:18.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.611+0000 7f9b91530800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:18.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.611+0000 7f9b91530800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:18.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.611+0000 7f9b91530800 5 note: GC not initialized 2024-09-13T19:16:18.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.611+0000 7f9a427e4640 20 reqs_thread_entry: start 2024-09-13T19:16:18.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.612+0000 7f9b91530800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:18.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.612+0000 7f9b91530800 20 Filter name: none 2024-09-13T19:16:18.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.612+0000 7f99b3fff640 20 reqs_thread_entry: start 2024-09-13T19:16:18.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.612+0000 7f9b91530800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.612+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55679b341a70 con 0x55679b2fab00 2024-09-13T19:16:18.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.612+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f9b7803b040 con 0x55679b2fab00 2024-09-13T19:16:18.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.612+0000 7f9b91530800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:16:18.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.612+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55679b342fc0 con 0x7f9b88059040 2024-09-13T19:16:18.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.613+0000 7f9b8d25c640 1 -- 172.21.15.102:0/941474196 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv15 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f9b8008e040 con 0x7f9b88059040 2024-09-13T19:16:18.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.613+0000 7f9b91530800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.613+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:64 8.9 8:917ee2d5:root::.bucket.meta.myfoo%3a509740b4-c081-4f37-bd6d-df9ca851489b.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55679b342fc0 con 0x7f9b88059040 2024-09-13T19:16:18.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.613+0000 7f9b8d25c640 1 -- 172.21.15.102:0/941474196 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(64 .bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f9b8008e040 con 0x7f9b88059040 2024-09-13T19:16:18.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.613+0000 7f9b91530800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:16:18.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.613+0000 7f9b91530800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T19:16:18.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.613+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:65 4.3e 4:7eb89d75:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55679b344a80 con 0x7f9b88059040 2024-09-13T19:16:18.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.613+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:66 4.28 4:16845d32:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55679b347640 con 0x55679b2fab00 2024-09-13T19:16:18.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.613+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:67 4.e 4:7015f333:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55679b34a390 con 0x7f9b88059040 2024-09-13T19:16:18.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.613+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 4.31 4:8e14c63f:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55679b344a80 con 0x55679b2fab00 2024-09-13T19:16:18.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.613+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:69 4.1f 4:fb695182:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55679b34f3b0 con 0x55679b2ff370 2024-09-13T19:16:18.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.613+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:70 4.22 4:475c4288:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55679b351ce0 con 0x55679b2fab00 2024-09-13T19:16:18.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.613+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:71 4.8 4:102eb403:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55679b354230 con 0x55679b2ff370 2024-09-13T19:16:18.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.613+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:72 4.3d 4:be2d5322:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55679b356fc0 con 0x55679b2ff370 2024-09-13T19:16:18.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.613+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:73 4.8 4:130dc037:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55679b359d30 con 0x55679b2ff370 2024-09-13T19:16:18.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.613+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:74 4.32 4:4c01988a:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55679b35ca90 con 0x55679b2fab00 2024-09-13T19:16:18.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.613+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:75 4.1c 4:3b6ce2a2:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55679b35f3d0 con 0x7f9b80078070 2024-09-13T19:16:18.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.614+0000 7f9b8da5d640 1 -- 172.21.15.102:0/941474196 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(69 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9b88027020 con 0x55679b2ff370 2024-09-13T19:16:18.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.614+0000 7f9b8d25c640 1 -- 172.21.15.102:0/941474196 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(65 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9b8008e040 con 0x7f9b88059040 2024-09-13T19:16:18.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.614+0000 7f9b8d25c640 1 -- 172.21.15.102:0/941474196 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(67 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9b8008e040 con 0x7f9b88059040 2024-09-13T19:16:18.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.614+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(66 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9b7803b040 con 0x55679b2fab00 2024-09-13T19:16:18.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.614+0000 7f9b8da5d640 1 -- 172.21.15.102:0/941474196 <== osd.3 v2:172.21.15.102:6800/3096737090 17 ==== osd_op_reply(71 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9b88027020 con 0x55679b2ff370 2024-09-13T19:16:18.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.614+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(68 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9b7803b040 con 0x55679b2fab00 2024-09-13T19:16:18.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.614+0000 7f9b8da5d640 1 -- 172.21.15.102:0/941474196 <== osd.3 v2:172.21.15.102:6800/3096737090 18 ==== osd_op_reply(72 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9b88027020 con 0x55679b2ff370 2024-09-13T19:16:18.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.614+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(70 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.5 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f9b7803b040 con 0x55679b2fab00 2024-09-13T19:16:18.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.614+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(74 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9b7803b040 con 0x55679b2fab00 2024-09-13T19:16:18.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.614+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(75 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9b7803b040 con 0x7f9b80078070 2024-09-13T19:16:18.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.614+0000 7f9b8da5d640 1 -- 172.21.15.102:0/941474196 <== osd.3 v2:172.21.15.102:6800/3096737090 19 ==== osd_op_reply(73 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.8 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9b88027020 con 0x55679b2ff370 2024-09-13T19:16:18.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.614+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:76 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55679b359d30 con 0x7f9b88059040 2024-09-13T19:16:18.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.615+0000 7f9b8d25c640 1 -- 172.21.15.102:0/941474196 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(76 foo.buckets [call] v34'16 uv16 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f9b8008e040 con 0x7f9b88059040 2024-09-13T19:16:18.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.615+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:77 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55679b359d30 con 0x7f9b88059040 2024-09-13T19:16:18.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.616+0000 7f9b8d25c640 1 -- 172.21.15.102:0/941474196 <== osd.2 v2:172.21.15.102:6816/2238176080 16 ==== osd_op_reply(77 foo.buckets [call] v34'17 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f9b8008e040 con 0x7f9b88059040 2024-09-13T19:16:18.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.616+0000 7f9b91530800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.616+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:78 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55679b359d30 con 0x55679b2fab00 2024-09-13T19:16:18.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.616+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== osd_op_reply(78 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f9b7803b040 con 0x55679b2fab00 2024-09-13T19:16:18.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.616+0000 7f9b91530800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:16:18.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.616+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:79 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55679b359d30 con 0x7f9b88059040 2024-09-13T19:16:18.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.617+0000 7f9b8d25c640 1 -- 172.21.15.102:0/941474196 <== osd.2 v2:172.21.15.102:6816/2238176080 17 ==== osd_op_reply(79 foo.buckets [call out=58b] v0'0 uv17 ondisk = 0) ==== 155+0+58 (crc 0 0 0) 0x7f9b8008e040 con 0x7f9b88059040 2024-09-13T19:16:18.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.617+0000 7f9a437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:18.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.617+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:80 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93903473653552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55679b32a5e0 con 0x55679b2fab00 2024-09-13T19:16:18.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.618+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(80 data_loggenerations_metadata [watch unwatch cookie 93903473653552] v34'103 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9b7803b040 con 0x55679b2fab00 2024-09-13T19:16:18.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.618+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:81 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93903473627216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55679b33f840 con 0x7f9b88059040 2024-09-13T19:16:18.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.619+0000 7f9b8d25c640 1 -- 172.21.15.102:0/941474196 <== osd.2 v2:172.21.15.102:6816/2238176080 18 ==== osd_op_reply(81 notify.0 [watch unwatch cookie 93903473627216] v34'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b8008e040 con 0x7f9b88059040 2024-09-13T19:16:18.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.619+0000 7f9b91530800 20 remove_watcher() i=0 2024-09-13T19:16:18.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.619+0000 7f9b91530800 2 removed watcher, disabling cache 2024-09-13T19:16:18.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.619+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:82 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93903473634448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55679b33f840 con 0x55679b2fab00 2024-09-13T19:16:18.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.620+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 <== osd.1 v2:172.21.15.102:6808/2204418452 28 ==== osd_op_reply(82 notify.1 [watch unwatch cookie 93903473634448] v34'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b7803b040 con 0x55679b2fab00 2024-09-13T19:16:18.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.620+0000 7f9b91530800 20 remove_watcher() i=1 2024-09-13T19:16:18.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.620+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:83 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93903473636656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55679b33f840 con 0x55679b2ff370 2024-09-13T19:16:18.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.621+0000 7f9b8da5d640 1 -- 172.21.15.102:0/941474196 <== osd.3 v2:172.21.15.102:6800/3096737090 20 ==== osd_op_reply(83 notify.2 [watch unwatch cookie 93903473636656] v34'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b88027020 con 0x55679b2ff370 2024-09-13T19:16:18.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.621+0000 7f9b91530800 20 remove_watcher() i=2 2024-09-13T19:16:18.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.621+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:84 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93903473638224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55679b33f840 con 0x7f9b88059040 2024-09-13T19:16:18.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.622+0000 7f9b8d25c640 1 -- 172.21.15.102:0/941474196 <== osd.2 v2:172.21.15.102:6816/2238176080 19 ==== osd_op_reply(84 notify.3 [watch unwatch cookie 93903473638224] v34'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b8008e040 con 0x7f9b88059040 2024-09-13T19:16:18.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.622+0000 7f9b91530800 20 remove_watcher() i=3 2024-09-13T19:16:18.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.622+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:85 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93903473644640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55679b33f840 con 0x55679b2fab00 2024-09-13T19:16:18.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.623+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 <== osd.1 v2:172.21.15.102:6808/2204418452 29 ==== osd_op_reply(85 notify.4 [watch unwatch cookie 93903473644640] v34'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b7803b040 con 0x55679b2fab00 2024-09-13T19:16:18.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.623+0000 7f9b91530800 20 remove_watcher() i=4 2024-09-13T19:16:18.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.623+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:86 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93903473648480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55679b33f840 con 0x7f9b80078070 2024-09-13T19:16:18.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.624+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(86 notify.5 [watch unwatch cookie 93903473648480] v34'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b7803b040 con 0x7f9b80078070 2024-09-13T19:16:18.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.624+0000 7f9b91530800 20 remove_watcher() i=5 2024-09-13T19:16:18.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.624+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:87 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93903473643072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55679b33f840 con 0x7f9b80078070 2024-09-13T19:16:18.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.625+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(87 notify.6 [watch unwatch cookie 93903473643072] v34'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b7803b040 con 0x7f9b80078070 2024-09-13T19:16:18.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.625+0000 7f9b91530800 20 remove_watcher() i=6 2024-09-13T19:16:18.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.625+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:88 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93903473652496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55679b33f840 con 0x7f9b80078070 2024-09-13T19:16:18.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.626+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 <== osd.0 v2:172.21.15.53:6800/4021716951 20 ==== osd_op_reply(88 notify.7 [watch unwatch cookie 93903473652496] v34'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b7803b040 con 0x7f9b80078070 2024-09-13T19:16:18.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.626+0000 7f9b91530800 20 remove_watcher() i=7 2024-09-13T19:16:18.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.626+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f9b80078070 msgr2=0x7f9b80065400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.626+0000 7f9b91530800 1 --2- 172.21.15.102:0/941474196 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f9b80078070 0x7f9b80065400 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.626+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55679b2fab00 msgr2=0x55679b2fcfc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.626+0000 7f9b91530800 1 --2- 172.21.15.102:0/941474196 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55679b2fab00 0x55679b2fcfc0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.626+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f9b88059040 msgr2=0x7f9b88012550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.626+0000 7f9b91530800 1 --2- 172.21.15.102:0/941474196 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f9b88059040 0x7f9b88012550 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.626+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55679b2ff370 msgr2=0x55679b301780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.626+0000 7f9b91530800 1 --2- 172.21.15.102:0/941474196 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55679b2ff370 0x55679b301780 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.626+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9a58036b90 msgr2=0x7f9a58039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.626+0000 7f9b91530800 1 --2- 172.21.15.102:0/941474196 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9a58036b90 0x7f9a58039050 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x55679b2c7c00 tx=0x7f9b8008a000 comp rx=0 tx=0).stop 2024-09-13T19:16:18.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.626+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55679b2e7c70 msgr2=0x55679b2ef0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.626+0000 7f9b91530800 1 --2- 172.21.15.102:0/941474196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55679b2e7c70 0x55679b2ef0e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f9b8802ac70 tx=0x7f9b8804cd20 comp rx=0 tx=0).stop 2024-09-13T19:16:18.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.626+0000 7f9b84a5b640 1 -- 172.21.15.102:0/941474196 reap_dead start 2024-09-13T19:16:18.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.626+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 shutdown_connections 2024-09-13T19:16:18.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.626+0000 7f9b91530800 1 --2- 172.21.15.102:0/941474196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55679b2e7c70 0x55679b2ef0e0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.626+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 >> 172.21.15.102:0/941474196 conn(0x55679b2e3fd0 msgr2=0x55679b2e20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:18.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.627+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 shutdown_connections 2024-09-13T19:16:18.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.627+0000 7f9b91530800 1 -- 172.21.15.102:0/941474196 wait complete. 2024-09-13T19:16:18.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.627+0000 7f9b91530800 1 -- 172.21.15.102:0/3792702636 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9a64036b90 msgr2=0x7f9a64039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.627+0000 7f9b91530800 1 --2- 172.21.15.102:0/3792702636 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9a64036b90 0x7f9a64039050 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x55679b2c8060 tx=0x7f9b8005df40 comp rx=0 tx=0).stop 2024-09-13T19:16:18.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.627+0000 7f9b91530800 1 -- 172.21.15.102:0/3792702636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55679b2daf20 msgr2=0x55679b2db340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.627+0000 7f9b91530800 1 --2- 172.21.15.102:0/3792702636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55679b2daf20 0x55679b2db340 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x55679b2c7b60 tx=0x7f9b880163e0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.627+0000 7f9b91530800 1 -- 172.21.15.102:0/3792702636 shutdown_connections 2024-09-13T19:16:18.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.627+0000 7f9b91530800 1 --2- 172.21.15.102:0/3792702636 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9a64036b90 0x7f9a64039050 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.627+0000 7f9b91530800 1 --2- 172.21.15.102:0/3792702636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55679b2daf20 0x55679b2db340 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.627+0000 7f9b91530800 1 -- 172.21.15.102:0/3792702636 >> 172.21.15.102:0/3792702636 conn(0x55679b2cfeb0 msgr2=0x55679b2d2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:18.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.627+0000 7f9b91530800 1 -- 172.21.15.102:0/3792702636 shutdown_connections 2024-09-13T19:16:18.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.627+0000 7f9b91530800 1 -- 172.21.15.102:0/3792702636 wait complete. 2024-09-13T19:16:18.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.627+0000 7f9b91530800 1 -- 172.21.15.102:0/311026517 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55679b1c8e20 msgr2=0x55679b2c7260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.627+0000 7f9b91530800 1 --2- 172.21.15.102:0/311026517 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55679b1c8e20 0x55679b2c7260 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.627+0000 7f9b91530800 1 -- 172.21.15.102:0/311026517 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55679b2c9ab0 msgr2=0x55679b2cbea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.627+0000 7f9b91530800 1 --2- 172.21.15.102:0/311026517 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55679b2c9ab0 0x55679b2cbea0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.627+0000 7f9b91530800 1 -- 172.21.15.102:0/311026517 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9a74036b40 msgr2=0x7f9a74039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.627+0000 7f9b91530800 1 --2- 172.21.15.102:0/311026517 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9a74036b40 0x7f9a74039000 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9b78000f60 tx=0x7f9b78001370 comp rx=0 tx=0).stop 2024-09-13T19:16:18.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.627+0000 7f9b91530800 1 -- 172.21.15.102:0/311026517 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55679b1c84e0 msgr2=0x55679b2c0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.627+0000 7f9b91530800 1 --2- 172.21.15.102:0/311026517 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55679b1c84e0 0x55679b2c0190 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9b80067040 tx=0x7f9b80002fb0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.627+0000 7f9b91530800 1 -- 172.21.15.102:0/311026517 shutdown_connections 2024-09-13T19:16:18.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.627+0000 7f9b91530800 1 --2- 172.21.15.102:0/311026517 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55679b2c9ab0 0x55679b2cbea0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.627+0000 7f9b91530800 1 --2- 172.21.15.102:0/311026517 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55679b1c8e20 0x55679b2c7260 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.627+0000 7f9b91530800 1 --2- 172.21.15.102:0/311026517 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9a74036b40 0x7f9a74039000 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.627+0000 7f9b91530800 1 --2- 172.21.15.102:0/311026517 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55679b1c84e0 0x55679b2c0190 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.627+0000 7f9b91530800 1 -- 172.21.15.102:0/311026517 >> 172.21.15.102:0/311026517 conn(0x55679b1c3dd0 msgr2=0x55679b2b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:18.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.627+0000 7f9b91530800 1 -- 172.21.15.102:0/311026517 shutdown_connections 2024-09-13T19:16:18.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.627+0000 7f9b91530800 1 -- 172.21.15.102:0/311026517 wait complete. 2024-09-13T19:16:18.674 INFO:teuthology.orchestra.run.smithi102.stdout:{"stats":{"size":3,"size_actual":4096,"size_kb":1,"size_kb_actual":4,"num_objects":1},"last_stats_sync":"2024-09-13T19:16:18.616565Z","last_stats_update":"2024-09-13T19:16:18.615475Z"} 2024-09-13T19:16:18.674 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2024-09-13T19:16:18.616565Z', 'last_stats_update': '2024-09-13T19:16:18.615475Z'} 2024-09-13T19:16:18.681 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:16:18.681 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-13T19:16:18.682 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-13T19:16:18.682 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2024-09-13T19:16:18.729 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:18.729 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:18.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.726+0000 7f94b6e30800 1 Processor -- start 2024-09-13T19:16:18.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.727+0000 7f94b6e30800 1 -- start start 2024-09-13T19:16:18.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.727+0000 7f94b6e30800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x564d2aa6d940 0x564d2aa6dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.727+0000 7f94b6e30800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564d2a92eb30 con 0x564d2aa6e280 2024-09-13T19:16:18.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.727+0000 7f94b6e30800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x564d2a910360 con 0x564d2aa6d940 2024-09-13T19:16:18.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.727+0000 7f94b2073640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x564d2aa6d940 0x564d2aa6dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.727+0000 7f94b2073640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x564d2aa6d940 0x564d2aa6dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55268/0 (socket says 172.21.15.102:55268) 2024-09-13T19:16:18.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.727+0000 7f94b2073640 1 -- 172.21.15.102:0/1164417278 learned_addr learned my addr 172.21.15.102:0/1164417278 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:18.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.727+0000 7f94a9872640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x564d2aa6e280 0x564d2aa74aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:49992/0 (socket says 172.21.15.102:49992) 2024-09-13T19:16:18.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.727+0000 7f94b2073640 1 -- 172.21.15.102:0/1164417278 >> v1:172.21.15.53:6789/0 conn(0x564d2aa6e280 legacy=0x564d2aa74aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.727+0000 7f94b2073640 1 -- 172.21.15.102:0/1164417278 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d2a936e00 con 0x564d2aa6d940 2024-09-13T19:16:18.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.727+0000 7f94b1872640 1 -- 172.21.15.102:0/1164417278 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 207496502 0 0) 0x564d2a92eb30 con 0x564d2aa6e280 2024-09-13T19:16:18.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.729+0000 7f94b2073640 1 --2- 172.21.15.102:0/1164417278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d2aa6d940 0x564d2aa6dd40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f94a400a520 tx=0x7f94a4045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e23848d431ad519 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.729+0000 7f94b1872640 1 -- 172.21.15.102:0/1164417278 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94a4055070 con 0x564d2aa6d940 2024-09-13T19:16:18.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.729+0000 7f94b1872640 1 -- 172.21.15.102:0/1164417278 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94a40515b0 con 0x564d2aa6d940 2024-09-13T19:16:18.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.729+0000 7f94b1872640 1 -- 172.21.15.102:0/1164417278 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94a40518d0 con 0x564d2aa6d940 2024-09-13T19:16:18.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.730+0000 7f94b6e30800 1 -- 172.21.15.102:0/1164417278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d2aa6d940 msgr2=0x564d2aa6dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.730+0000 7f94b6e30800 1 --2- 172.21.15.102:0/1164417278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d2aa6d940 0x564d2aa6dd40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f94a400a520 tx=0x7f94a4045ba0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.730+0000 7f94b6e30800 1 -- 172.21.15.102:0/1164417278 shutdown_connections 2024-09-13T19:16:18.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.730+0000 7f94b6e30800 1 --2- 172.21.15.102:0/1164417278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d2aa6d940 0x564d2aa6dd40 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.730+0000 7f94b6e30800 1 -- 172.21.15.102:0/1164417278 >> 172.21.15.102:0/1164417278 conn(0x564d2aa69550 msgr2=0x564d2aa6b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:18.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.730+0000 7f94b6e30800 1 -- 172.21.15.102:0/1164417278 shutdown_connections 2024-09-13T19:16:18.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.730+0000 7f94b6e30800 1 -- 172.21.15.102:0/1164417278 wait complete. 2024-09-13T19:16:18.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.743+0000 7f94b6e30800 1 Processor -- start 2024-09-13T19:16:18.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.744+0000 7f94b6e30800 1 -- start start 2024-09-13T19:16:18.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.744+0000 7f94b6e30800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d2aa6d940 0x564d2ab5e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.744+0000 7f94b6e30800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564d2a9bb360 con 0x564d2aa6d940 2024-09-13T19:16:18.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.744+0000 7f94b2073640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d2aa6d940 0x564d2ab5e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.744+0000 7f94b2073640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d2aa6d940 0x564d2ab5e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55276/0 (socket says 172.21.15.102:55276) 2024-09-13T19:16:18.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.744+0000 7f94b2073640 1 -- 172.21.15.102:0/4153617915 learned_addr learned my addr 172.21.15.102:0/4153617915 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:18.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.744+0000 7f94b2073640 1 -- 172.21.15.102:0/4153617915 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d2a908bc0 con 0x564d2aa6d940 2024-09-13T19:16:18.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.745+0000 7f94b2073640 1 --2- 172.21.15.102:0/4153617915 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d2aa6d940 0x564d2ab5e6b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f94a4000c00 tx=0x7f94a4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9324ff7bf770b052 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.745+0000 7f93a0608640 1 -- 172.21.15.102:0/4153617915 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94a40519d0 con 0x564d2aa6d940 2024-09-13T19:16:18.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.745+0000 7f93a0608640 1 -- 172.21.15.102:0/4153617915 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94a4051b70 con 0x564d2aa6d940 2024-09-13T19:16:18.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.745+0000 7f93a0608640 1 -- 172.21.15.102:0/4153617915 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94a4051e50 con 0x564d2aa6d940 2024-09-13T19:16:18.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.745+0000 7f94b6e30800 1 -- 172.21.15.102:0/4153617915 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d2aa6d940 msgr2=0x564d2ab5e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.745+0000 7f94b6e30800 1 --2- 172.21.15.102:0/4153617915 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d2aa6d940 0x564d2ab5e6b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f94a4000c00 tx=0x7f94a4051000 comp rx=0 tx=0).stop 2024-09-13T19:16:18.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.745+0000 7f94b6e30800 1 -- 172.21.15.102:0/4153617915 shutdown_connections 2024-09-13T19:16:18.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.745+0000 7f94b6e30800 1 --2- 172.21.15.102:0/4153617915 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d2aa6d940 0x564d2ab5e6b0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.745+0000 7f94b6e30800 1 -- 172.21.15.102:0/4153617915 >> 172.21.15.102:0/4153617915 conn(0x564d2aa69550 msgr2=0x564d2ab5a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:18.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.746+0000 7f94b6e30800 1 -- 172.21.15.102:0/4153617915 shutdown_connections 2024-09-13T19:16:18.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.746+0000 7f94b6e30800 1 -- 172.21.15.102:0/4153617915 wait complete. 2024-09-13T19:16:18.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.746+0000 7f94b6e30800 1 Processor -- start 2024-09-13T19:16:18.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.746+0000 7f94b6e30800 1 -- start start 2024-09-13T19:16:18.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.746+0000 7f94b6e30800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d2aa6d940 0x564d2aa70300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.746+0000 7f94b6e30800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564d2aa76600 con 0x564d2aa6d940 2024-09-13T19:16:18.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.746+0000 7f94b2073640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d2aa6d940 0x564d2aa70300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.746+0000 7f94b2073640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d2aa6d940 0x564d2aa70300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55288/0 (socket says 172.21.15.102:55288) 2024-09-13T19:16:18.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.746+0000 7f94b2073640 1 -- 172.21.15.102:0/1442724983 learned_addr learned my addr 172.21.15.102:0/1442724983 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:18.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.747+0000 7f94b2073640 1 -- 172.21.15.102:0/1442724983 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d2a91cfe0 con 0x564d2aa6d940 2024-09-13T19:16:18.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.747+0000 7f94b2073640 1 --2- 172.21.15.102:0/1442724983 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d2aa6d940 0x564d2aa70300 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f94a4005570 tx=0x7f94a4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.747+0000 7f939ee05640 1 -- 172.21.15.102:0/1442724983 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94a4073070 con 0x564d2aa6d940 2024-09-13T19:16:18.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.747+0000 7f939ee05640 1 -- 172.21.15.102:0/1442724983 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94a405a580 con 0x564d2aa6d940 2024-09-13T19:16:18.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.747+0000 7f94b6e30800 1 -- 172.21.15.102:0/1442724983 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564d2aa6e9f0 con 0x564d2aa6d940 2024-09-13T19:16:18.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.747+0000 7f939ee05640 1 -- 172.21.15.102:0/1442724983 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94a405a8a0 con 0x564d2aa6d940 2024-09-13T19:16:18.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.747+0000 7f94b6e30800 1 -- 172.21.15.102:0/1442724983 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d2aa6ef70 con 0x564d2aa6d940 2024-09-13T19:16:18.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.748+0000 7f939ee05640 1 -- 172.21.15.102:0/1442724983 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f94a4076070 con 0x564d2aa6d940 2024-09-13T19:16:18.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.748+0000 7f939ee05640 1 --2- 172.21.15.102:0/1442724983 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9398036b40 0x7f9398039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.748+0000 7f939ee05640 1 -- 172.21.15.102:0/1442724983 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f94a4062070 con 0x564d2aa6d940 2024-09-13T19:16:18.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.748+0000 7f94a9872640 1 --2- 172.21.15.102:0/1442724983 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9398036b40 0x7f9398039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.748+0000 7f94b6e30800 1 --2- 172.21.15.102:0/1442724983 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x564d2aa6e280 0x564d2ab6f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.748+0000 7f94b6e30800 1 -- 172.21.15.102:0/1442724983 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d2ab6f850 con 0x564d2aa6e280 2024-09-13T19:16:18.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.748+0000 7f94b2874640 1 --2- 172.21.15.102:0/1442724983 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x564d2aa6e280 0x564d2ab6f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.748+0000 7f94a9872640 1 --2- 172.21.15.102:0/1442724983 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9398036b40 0x7f9398039000 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f949c000c00 tx=0x7f949c0013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.748+0000 7f94b2874640 1 --2- 172.21.15.102:0/1442724983 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x564d2aa6e280 0x564d2ab6f310 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.749+0000 7f94b2874640 1 -- 172.21.15.102:0/1442724983 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94ac00a4a0 con 0x564d2aa6e280 2024-09-13T19:16:18.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.749+0000 7f94b6e30800 1 -- 172.21.15.102:0/1442724983 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d2ab700a0 con 0x564d2aa6e280 2024-09-13T19:16:18.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.749+0000 7f94b2874640 1 -- 172.21.15.102:0/1442724983 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f94ac00a4a0 con 0x564d2aa6e280 2024-09-13T19:16:18.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.749+0000 7f94b6e30800 1 --2- 172.21.15.102:0/1442724983 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x564d2ab71ad0 0x564d2ab73f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.749+0000 7f94b6e30800 1 -- 172.21.15.102:0/1442724983 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d2ab746b0 con 0x564d2ab71ad0 2024-09-13T19:16:18.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.749+0000 7f94b2073640 1 --2- 172.21.15.102:0/1442724983 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x564d2ab71ad0 0x564d2ab73f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.749+0000 7f94b2073640 1 --2- 172.21.15.102:0/1442724983 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x564d2ab71ad0 0x564d2ab73f20 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.750+0000 7f94b2073640 1 -- 172.21.15.102:0/1442724983 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f94a407f070 con 0x564d2ab71ad0 2024-09-13T19:16:18.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.750+0000 7f94b6e30800 1 -- 172.21.15.102:0/1442724983 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d2ab708f0 con 0x564d2aa6e280 2024-09-13T19:16:18.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.750+0000 7f94b2874640 1 -- 172.21.15.102:0/1442724983 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f94ac00a4a0 con 0x564d2aa6e280 2024-09-13T19:16:18.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.750+0000 7f94b6e30800 1 -- 172.21.15.102:0/1442724983 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d2ab70cd0 con 0x564d2ab71ad0 2024-09-13T19:16:18.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.750+0000 7f94b2073640 1 -- 172.21.15.102:0/1442724983 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f94a407f070 con 0x564d2ab71ad0 2024-09-13T19:16:18.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.751+0000 7f94b6e30800 1 Processor -- start 2024-09-13T19:16:18.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.751+0000 7f94b6e30800 1 -- start start 2024-09-13T19:16:18.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.751+0000 7f94b6e30800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d2ab83010 0x564d2ab83430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.751+0000 7f94b6e30800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564d2aa70840 con 0x564d2ab83010 2024-09-13T19:16:18.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.751+0000 7f94b2874640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d2ab83010 0x564d2ab83430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.751+0000 7f94b2874640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d2ab83010 0x564d2ab83430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55298/0 (socket says 172.21.15.102:55298) 2024-09-13T19:16:18.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.751+0000 7f94b2874640 1 -- 172.21.15.102:0/707169767 learned_addr learned my addr 172.21.15.102:0/707169767 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:18.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.751+0000 7f94b2874640 1 -- 172.21.15.102:0/707169767 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d2ab83970 con 0x564d2ab83010 2024-09-13T19:16:18.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.752+0000 7f94b2874640 1 --2- 172.21.15.102:0/707169767 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d2ab83010 0x564d2ab83430 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x564d2aa6fcf0 tx=0x7f94ac0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.752+0000 7f9397fff640 1 -- 172.21.15.102:0/707169767 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94ac013640 con 0x564d2ab83010 2024-09-13T19:16:18.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.752+0000 7f9397fff640 1 -- 172.21.15.102:0/707169767 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94ac0137e0 con 0x564d2ab83010 2024-09-13T19:16:18.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.752+0000 7f94b6e30800 1 -- 172.21.15.102:0/707169767 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564d2ab83c00 con 0x564d2ab83010 2024-09-13T19:16:18.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.752+0000 7f9397fff640 1 -- 172.21.15.102:0/707169767 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94ac013ae0 con 0x564d2ab83010 2024-09-13T19:16:18.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.752+0000 7f94b6e30800 1 -- 172.21.15.102:0/707169767 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d2ab868e0 con 0x564d2ab83010 2024-09-13T19:16:18.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.753+0000 7f9397fff640 1 -- 172.21.15.102:0/707169767 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f94ac011040 con 0x564d2ab83010 2024-09-13T19:16:18.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.753+0000 7f9397fff640 1 --2- 172.21.15.102:0/707169767 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f938c036b40 0x7f938c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.753+0000 7f9397fff640 1 -- 172.21.15.102:0/707169767 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f94ac00e040 con 0x564d2ab83010 2024-09-13T19:16:18.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.753+0000 7f94b2073640 1 --2- 172.21.15.102:0/707169767 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f938c036b40 0x7f938c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.753+0000 7f94b6e30800 1 Processor -- start 2024-09-13T19:16:18.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.753+0000 7f94b6e30800 1 -- start start 2024-09-13T19:16:18.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.753+0000 7f94b2073640 1 --2- 172.21.15.102:0/707169767 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f938c036b40 0x7f938c039000 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f94a4050e80 tx=0x7f94a406f750 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.754+0000 7f94b6e30800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d2ab8fcd0 0x564d2ab900d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.754+0000 7f94b6e30800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564d2a90a580 con 0x564d2ab8fcd0 2024-09-13T19:16:18.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.754+0000 7f94b2874640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d2ab8fcd0 0x564d2ab900d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.754+0000 7f94b2874640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d2ab8fcd0 0x564d2ab900d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55302/0 (socket says 172.21.15.102:55302) 2024-09-13T19:16:18.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.754+0000 7f94b2874640 1 -- 172.21.15.102:0/1804259236 learned_addr learned my addr 172.21.15.102:0/1804259236 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:18.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.754+0000 7f94b2874640 1 -- 172.21.15.102:0/1804259236 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d2ab906a0 con 0x564d2ab8fcd0 2024-09-13T19:16:18.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.754+0000 7f94b2874640 1 --2- 172.21.15.102:0/1804259236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d2ab8fcd0 0x564d2ab900d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f94ac00afb0 tx=0x7f94ac01fd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb80a84f29547511 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.754+0000 7f9395ffb640 1 -- 172.21.15.102:0/1804259236 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94ac021570 con 0x564d2ab8fcd0 2024-09-13T19:16:18.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.754+0000 7f9395ffb640 1 -- 172.21.15.102:0/1804259236 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94ac04a030 con 0x564d2ab8fcd0 2024-09-13T19:16:18.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.754+0000 7f9395ffb640 1 -- 172.21.15.102:0/1804259236 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94ac01f4b0 con 0x564d2ab8fcd0 2024-09-13T19:16:18.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.755+0000 7f94b6e30800 1 -- 172.21.15.102:0/1804259236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d2ab8fcd0 msgr2=0x564d2ab900d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.755+0000 7f94b6e30800 1 --2- 172.21.15.102:0/1804259236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d2ab8fcd0 0x564d2ab900d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f94ac00afb0 tx=0x7f94ac01fd00 comp rx=0 tx=0).stop 2024-09-13T19:16:18.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.755+0000 7f94b6e30800 1 -- 172.21.15.102:0/1804259236 shutdown_connections 2024-09-13T19:16:18.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.755+0000 7f94b6e30800 1 --2- 172.21.15.102:0/1804259236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d2ab8fcd0 0x564d2ab900d0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.755+0000 7f94b6e30800 1 -- 172.21.15.102:0/1804259236 >> 172.21.15.102:0/1804259236 conn(0x564d2ab8c030 msgr2=0x564d2ab8a180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:18.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.755+0000 7f94b6e30800 1 -- 172.21.15.102:0/1804259236 shutdown_connections 2024-09-13T19:16:18.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.755+0000 7f94b6e30800 1 -- 172.21.15.102:0/1804259236 wait complete. 2024-09-13T19:16:18.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.755+0000 7f94b6e30800 1 Processor -- start 2024-09-13T19:16:18.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.755+0000 7f94b6e30800 1 -- start start 2024-09-13T19:16:18.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.755+0000 7f94b6e30800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d2ab8fcd0 0x564d2ab97020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.755+0000 7f94b6e30800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564d2ab90af0 con 0x564d2ab8fcd0 2024-09-13T19:16:18.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.756+0000 7f94b2874640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d2ab8fcd0 0x564d2ab97020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.756+0000 7f94b2874640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d2ab8fcd0 0x564d2ab97020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55318/0 (socket says 172.21.15.102:55318) 2024-09-13T19:16:18.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.756+0000 7f94b2874640 1 -- 172.21.15.102:0/1734120033 learned_addr learned my addr 172.21.15.102:0/1734120033 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:18.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.756+0000 7f94b2874640 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d2ab97560 con 0x564d2ab8fcd0 2024-09-13T19:16:18.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.756+0000 7f94b2874640 1 --2- 172.21.15.102:0/1734120033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d2ab8fcd0 0x564d2ab97020 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f94ac00afb0 tx=0x7f94ac04cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.756+0000 7f9383fff640 1 -- 172.21.15.102:0/1734120033 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94ac03a070 con 0x564d2ab8fcd0 2024-09-13T19:16:18.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.756+0000 7f9383fff640 1 -- 172.21.15.102:0/1734120033 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94ac03de50 con 0x564d2ab8fcd0 2024-09-13T19:16:18.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.756+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564d2ab977f0 con 0x564d2ab8fcd0 2024-09-13T19:16:18.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.756+0000 7f9383fff640 1 -- 172.21.15.102:0/1734120033 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94ac0400e0 con 0x564d2ab8fcd0 2024-09-13T19:16:18.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.756+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d2ab977f0 con 0x564d2ab8fcd0 2024-09-13T19:16:18.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.757+0000 7f9383fff640 1 -- 172.21.15.102:0/1734120033 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f94ac0402a0 con 0x564d2ab8fcd0 2024-09-13T19:16:18.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.757+0000 7f9383fff640 1 --2- 172.21.15.102:0/1734120033 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f937c036b90 0x7f937c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.757+0000 7f9383fff640 1 -- 172.21.15.102:0/1734120033 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f94ac036cc0 con 0x564d2ab8fcd0 2024-09-13T19:16:18.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.757+0000 7f94b2073640 1 --2- 172.21.15.102:0/1734120033 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f937c036b90 0x7f937c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.758+0000 7f94b2073640 1 --2- 172.21.15.102:0/1734120033 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f937c036b90 0x7f937c039050 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f94a405af80 tx=0x7f94a4088000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.758+0000 7f94b6e30800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.758+0000 7f94b6e30800 1 --2- 172.21.15.102:0/1734120033 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x564d2aba28e0 0x564d2aba4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.758+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d2aba54f0 con 0x564d2aba28e0 2024-09-13T19:16:18.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.758+0000 7f94a9872640 1 --2- 172.21.15.102:0/1734120033 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x564d2aba28e0 0x564d2aba4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.758+0000 7f94a9872640 1 --2- 172.21.15.102:0/1734120033 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x564d2aba28e0 0x564d2aba4da0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.758+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f949c00f5f0 con 0x564d2aba28e0 2024-09-13T19:16:18.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.758+0000 7f94b6e30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:18.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.758+0000 7f94b6e30800 20 realm 2024-09-13T19:16:18.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.758+0000 7f94b6e30800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.758+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d2aba1d30 con 0x564d2aba28e0 2024-09-13T19:16:18.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.759+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f949c00f5f0 con 0x564d2aba28e0 2024-09-13T19:16:18.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.759+0000 7f94b6e30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:18.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.759+0000 7f94b6e30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:18.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.759+0000 7f94b6e30800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.759+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d2aba5fe0 con 0x564d2aba28e0 2024-09-13T19:16:18.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.759+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f949c00f5f0 con 0x564d2aba28e0 2024-09-13T19:16:18.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.759+0000 7f94b6e30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:18.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.759+0000 7f94b6e30800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.759+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d2aba68b0 con 0x564d2aba28e0 2024-09-13T19:16:18.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.759+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f949c00f5f0 con 0x564d2aba28e0 2024-09-13T19:16:18.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.759+0000 7f94b6e30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:18.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.759+0000 7f94b6e30800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.759+0000 7f94b6e30800 1 --2- 172.21.15.102:0/1734120033 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x564d2aba72d0 0x564d2aba96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.759+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d2aba9e30 con 0x564d2aba72d0 2024-09-13T19:16:18.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.759+0000 7f94b2874640 1 --2- 172.21.15.102:0/1734120033 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x564d2aba72d0 0x564d2aba96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.760+0000 7f94b2874640 1 --2- 172.21.15.102:0/1734120033 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x564d2aba72d0 0x564d2aba96c0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.760+0000 7f94b2874640 1 -- 172.21.15.102:0/1734120033 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f94ac00a4a0 con 0x564d2aba72d0 2024-09-13T19:16:18.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.760+0000 7f94b6e30800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:18.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.760+0000 7f94b6e30800 20 searching for the correct realm 2024-09-13T19:16:18.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.760+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d2abab780 con 0x564d2aba72d0 2024-09-13T19:16:18.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.760+0000 7f94b2874640 1 -- 172.21.15.102:0/1734120033 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94ac00a4a0 con 0x564d2aba72d0 2024-09-13T19:16:18.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.760+0000 7f94b2874640 1 --2- 172.21.15.102:0/1734120033 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f94ac04ebb0 0x7f94ac046500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.760+0000 7f94b2874640 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d2abab780 con 0x7f94ac04ebb0 2024-09-13T19:16:18.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.760+0000 7f94b2073640 1 --2- 172.21.15.102:0/1734120033 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f94ac04ebb0 0x7f94ac046500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.761+0000 7f94b2073640 1 --2- 172.21.15.102:0/1734120033 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f94ac04ebb0 0x7f94ac046500 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.761+0000 7f94b2073640 1 -- 172.21.15.102:0/1734120033 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94a407f070 con 0x7f94ac04ebb0 2024-09-13T19:16:18.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.761+0000 7f94b2073640 1 --2- 172.21.15.102:0/1734120033 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f94a4078070 0x7f94a4068120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.761+0000 7f94b2073640 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d2abab780 con 0x7f94a4078070 2024-09-13T19:16:18.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.761+0000 7f94a9872640 1 --2- 172.21.15.102:0/1734120033 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f94a4078070 0x7f94a4068120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.761+0000 7f94a9872640 1 --2- 172.21.15.102:0/1734120033 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f94a4078070 0x7f94a4068120 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.762+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f949c00f5f0 con 0x7f94a4078070 2024-09-13T19:16:18.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.762+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d2abab780 con 0x564d2aba28e0 2024-09-13T19:16:18.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.762+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f949c00f5f0 con 0x564d2aba28e0 2024-09-13T19:16:18.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.762+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d2abab780 con 0x564d2aba28e0 2024-09-13T19:16:18.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.762+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f949c02b040 con 0x564d2aba28e0 2024-09-13T19:16:18.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.762+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d2abab780 con 0x7f94a4078070 2024-09-13T19:16:18.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.762+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f949c02b040 con 0x7f94a4078070 2024-09-13T19:16:18.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.762+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d2abab780 con 0x7f94a4078070 2024-09-13T19:16:18.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.763+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f949c02b040 con 0x7f94a4078070 2024-09-13T19:16:18.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.763+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d2abab780 con 0x7f94ac04ebb0 2024-09-13T19:16:18.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.763+0000 7f94b2073640 1 -- 172.21.15.102:0/1734120033 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94a407f070 con 0x7f94ac04ebb0 2024-09-13T19:16:18.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.763+0000 7f94b2073640 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d2abab780 con 0x564d2aba72d0 2024-09-13T19:16:18.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.763+0000 7f94b2874640 1 -- 172.21.15.102:0/1734120033 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94ac00a4a0 con 0x564d2aba72d0 2024-09-13T19:16:18.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.763+0000 7f94b2874640 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d2abab780 con 0x564d2aba28e0 2024-09-13T19:16:18.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.763+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f949c02b040 con 0x564d2aba28e0 2024-09-13T19:16:18.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.763+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d2abab780 con 0x7f94a4078070 2024-09-13T19:16:18.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.764+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f949c02b040 con 0x7f94a4078070 2024-09-13T19:16:18.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.764+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d2abab780 con 0x564d2aba28e0 2024-09-13T19:16:18.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.764+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f949c02b040 con 0x564d2aba28e0 2024-09-13T19:16:18.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.764+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d2abab780 con 0x7f94ac04ebb0 2024-09-13T19:16:18.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.764+0000 7f94b2073640 1 -- 172.21.15.102:0/1734120033 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f94a407f070 con 0x7f94ac04ebb0 2024-09-13T19:16:18.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.764+0000 7f94b2073640 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d2abab780 con 0x564d2aba72d0 2024-09-13T19:16:18.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.764+0000 7f94b2874640 1 -- 172.21.15.102:0/1734120033 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94ac00a4a0 con 0x564d2aba72d0 2024-09-13T19:16:18.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.764+0000 7f94b2874640 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d2abab780 con 0x564d2aba72d0 2024-09-13T19:16:18.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.764+0000 7f94b2874640 1 -- 172.21.15.102:0/1734120033 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f94ac00a4a0 con 0x564d2aba72d0 2024-09-13T19:16:18.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.764+0000 7f94b2874640 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d2abab780 con 0x7f94a4078070 2024-09-13T19:16:18.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.765+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f949c02b040 con 0x7f94a4078070 2024-09-13T19:16:18.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.765+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d2abab780 con 0x564d2aba72d0 2024-09-13T19:16:18.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.765+0000 7f94b2874640 1 -- 172.21.15.102:0/1734120033 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f94ac00a4a0 con 0x564d2aba72d0 2024-09-13T19:16:18.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.765+0000 7f94b2874640 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d2abab780 con 0x564d2aba72d0 2024-09-13T19:16:18.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.765+0000 7f94b2874640 1 -- 172.21.15.102:0/1734120033 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94ac00a4a0 con 0x564d2aba72d0 2024-09-13T19:16:18.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.765+0000 7f94b2874640 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d2abab780 con 0x564d2aba28e0 2024-09-13T19:16:18.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.765+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f949c02b040 con 0x564d2aba28e0 2024-09-13T19:16:18.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.765+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d2abab780 con 0x564d2aba28e0 2024-09-13T19:16:18.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.766+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f949c02b040 con 0x564d2aba28e0 2024-09-13T19:16:18.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.766+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d2abab780 con 0x7f94a4078070 2024-09-13T19:16:18.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.766+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f949c02b040 con 0x7f94a4078070 2024-09-13T19:16:18.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.766+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d2abab780 con 0x564d2aba72d0 2024-09-13T19:16:18.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.766+0000 7f94b2874640 1 -- 172.21.15.102:0/1734120033 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94ac00a4a0 con 0x564d2aba72d0 2024-09-13T19:16:18.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.766+0000 7f94b2874640 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d2abab780 con 0x7f94ac04ebb0 2024-09-13T19:16:18.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.766+0000 7f94b2073640 1 -- 172.21.15.102:0/1734120033 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94a407f070 con 0x7f94ac04ebb0 2024-09-13T19:16:18.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.766+0000 7f94b2073640 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d2abab780 con 0x564d2aba28e0 2024-09-13T19:16:18.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.767+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f949c02b040 con 0x564d2aba28e0 2024-09-13T19:16:18.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.767+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d2abab780 con 0x7f94a4078070 2024-09-13T19:16:18.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.767+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f949c03b040 con 0x7f94a4078070 2024-09-13T19:16:18.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.767+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d2abab780 con 0x564d2aba72d0 2024-09-13T19:16:18.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.767+0000 7f94b2874640 1 -- 172.21.15.102:0/1734120033 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94ac00a4a0 con 0x564d2aba72d0 2024-09-13T19:16:18.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.767+0000 7f94b2874640 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d2abab780 con 0x7f94a4078070 2024-09-13T19:16:18.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.768+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f949c03b040 con 0x7f94a4078070 2024-09-13T19:16:18.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.768+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d2abab780 con 0x7f94ac04ebb0 2024-09-13T19:16:18.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.768+0000 7f94b2073640 1 -- 172.21.15.102:0/1734120033 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94a407f070 con 0x7f94ac04ebb0 2024-09-13T19:16:18.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.768+0000 7f94b2073640 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d2abab780 con 0x564d2aba72d0 2024-09-13T19:16:18.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.768+0000 7f94b2874640 1 -- 172.21.15.102:0/1734120033 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94ac00a4a0 con 0x564d2aba72d0 2024-09-13T19:16:18.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.768+0000 7f94b2874640 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d2abab780 con 0x7f94a4078070 2024-09-13T19:16:18.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.768+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f949c03b040 con 0x7f94a4078070 2024-09-13T19:16:18.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.768+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d2abab780 con 0x564d2aba28e0 2024-09-13T19:16:18.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.769+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f949c03b040 con 0x564d2aba28e0 2024-09-13T19:16:18.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.769+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564d2abab780 con 0x7f94ac04ebb0 2024-09-13T19:16:18.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.769+0000 7f94b2073640 1 -- 172.21.15.102:0/1734120033 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94a407f070 con 0x7f94ac04ebb0 2024-09-13T19:16:18.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.769+0000 7f94b6e30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:18.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.769+0000 7f94b6e30800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:18.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.769+0000 7f94b6e30800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:18.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.769+0000 7f94b6e30800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:18.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.769+0000 7f94b6e30800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:18.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.769+0000 7f94b6e30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:18.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.769+0000 7f94b6e30800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.769+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d2abaa820 con 0x564d2aba28e0 2024-09-13T19:16:18.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.769+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f949c03b040 con 0x564d2aba28e0 2024-09-13T19:16:18.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.769+0000 7f94b6e30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:18.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.769+0000 7f94b6e30800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.769+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d2abab0c0 con 0x564d2aba28e0 2024-09-13T19:16:18.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.769+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f949c03b040 con 0x564d2aba28e0 2024-09-13T19:16:18.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.769+0000 7f94b6e30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:18.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.769+0000 7f94b6e30800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.769+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d2abaa460 con 0x564d2aba72d0 2024-09-13T19:16:18.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.770+0000 7f94b2874640 1 -- 172.21.15.102:0/1734120033 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f94ac00a4a0 con 0x564d2aba72d0 2024-09-13T19:16:18.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.770+0000 7f94b6e30800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:18.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.770+0000 7f94b6e30800 20 zone default found 2024-09-13T19:16:18.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.770+0000 7f94b6e30800 4 Realm: () 2024-09-13T19:16:18.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.770+0000 7f94b6e30800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:18.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.770+0000 7f94b6e30800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:18.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.770+0000 7f94b6e30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:18.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.770+0000 7f94b6e30800 20 zonegroup default 2024-09-13T19:16:18.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.770+0000 7f94b6e30800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.770+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d2abac120 con 0x7f94a4078070 2024-09-13T19:16:18.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.770+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f949c03b040 con 0x7f94a4078070 2024-09-13T19:16:18.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.770+0000 7f94b6e30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:18.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.770+0000 7f94b6e30800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.770+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d2abadf40 con 0x564d2aba72d0 2024-09-13T19:16:18.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.770+0000 7f94b2874640 1 -- 172.21.15.102:0/1734120033 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f94ac00a4a0 con 0x564d2aba72d0 2024-09-13T19:16:18.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.770+0000 7f94b6e30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:18.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.770+0000 7f94b6e30800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.770+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d2abae2e0 con 0x564d2aba72d0 2024-09-13T19:16:18.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.770+0000 7f94b2874640 1 -- 172.21.15.102:0/1734120033 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f94ac00a4a0 con 0x564d2aba72d0 2024-09-13T19:16:18.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.770+0000 7f94b6e30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:18.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.770+0000 7f94b6e30800 20 started sync module instance, tier type = 2024-09-13T19:16:18.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.770+0000 7f94b6e30800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:18.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.771+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d2abad3e0 con 0x7f94ac04ebb0 2024-09-13T19:16:18.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.771+0000 7f94b2073640 1 -- 172.21.15.102:0/1734120033 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(44 notify.0 [create] v34'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94a407f070 con 0x7f94ac04ebb0 2024-09-13T19:16:18.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.771+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94889429356336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d2abae6f0 con 0x7f94ac04ebb0 2024-09-13T19:16:18.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.772+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d2abaef40 con 0x564d2aba28e0 2024-09-13T19:16:18.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.773+0000 7f94b2073640 1 -- 172.21.15.102:0/1734120033 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94889429356336] v34'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94a407f070 con 0x7f94ac04ebb0 2024-09-13T19:16:18.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.773+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v34'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f949c03b040 con 0x564d2aba28e0 2024-09-13T19:16:18.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.773+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94889429363344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d2abaf360 con 0x564d2aba28e0 2024-09-13T19:16:18.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.773+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d2abafbb0 con 0x564d2aba72d0 2024-09-13T19:16:18.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.774+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94889429363344] v34'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f949c03b040 con 0x564d2aba28e0 2024-09-13T19:16:18.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.774+0000 7f94b2874640 1 -- 172.21.15.102:0/1734120033 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v34'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94ac00a4a0 con 0x564d2aba72d0 2024-09-13T19:16:18.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.774+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94889429364880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d2abafae0 con 0x564d2aba72d0 2024-09-13T19:16:18.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.774+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d2abb0580 con 0x7f94ac04ebb0 2024-09-13T19:16:18.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.775+0000 7f94b2073640 1 -- 172.21.15.102:0/1734120033 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(50 notify.3 [create] v34'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94a407f070 con 0x7f94ac04ebb0 2024-09-13T19:16:18.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.775+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94889429368944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d2abb0e50 con 0x7f94ac04ebb0 2024-09-13T19:16:18.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.775+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d2abb1930 con 0x564d2aba28e0 2024-09-13T19:16:18.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.775+0000 7f94b2874640 1 -- 172.21.15.102:0/1734120033 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94889429364880] v34'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94ac00a4a0 con 0x564d2aba72d0 2024-09-13T19:16:18.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.776+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v34'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f949c03b040 con 0x564d2aba28e0 2024-09-13T19:16:18.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.776+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94889429374016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d2abb1d20 con 0x564d2aba28e0 2024-09-13T19:16:18.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.776+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d2abb2740 con 0x7f94a4078070 2024-09-13T19:16:18.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.776+0000 7f94b2073640 1 -- 172.21.15.102:0/1734120033 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94889429368944] v34'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94a407f070 con 0x7f94ac04ebb0 2024-09-13T19:16:18.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.777+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(54 notify.5 [create] v34'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f949c03b040 con 0x7f94a4078070 2024-09-13T19:16:18.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.777+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94889429377584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d2abb2700 con 0x7f94a4078070 2024-09-13T19:16:18.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.777+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d2abb3190 con 0x7f94a4078070 2024-09-13T19:16:18.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.777+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94889429374016] v34'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f949c03b040 con 0x564d2aba28e0 2024-09-13T19:16:18.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.778+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94889429377584] v34'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f949c03b040 con 0x7f94a4078070 2024-09-13T19:16:18.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.778+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(56 notify.6 [create] v34'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f949c03b040 con 0x7f94a4078070 2024-09-13T19:16:18.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.778+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94889429371296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d2abb2ca0 con 0x7f94a4078070 2024-09-13T19:16:18.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.778+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d2abb3660 con 0x7f94a4078070 2024-09-13T19:16:18.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.779+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94889429371296] v34'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f949c03b040 con 0x7f94a4078070 2024-09-13T19:16:18.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.779+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(58 notify.7 [create] v34'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f949c03b040 con 0x7f94a4078070 2024-09-13T19:16:18.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.779+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94889429366064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d2abb3660 con 0x7f94a4078070 2024-09-13T19:16:18.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.779+0000 7f94b6e30800 20 add_watcher() i=0 2024-09-13T19:16:18.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.779+0000 7f94b6e30800 20 add_watcher() i=1 2024-09-13T19:16:18.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.779+0000 7f94b6e30800 20 add_watcher() i=2 2024-09-13T19:16:18.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.779+0000 7f94b6e30800 20 add_watcher() i=3 2024-09-13T19:16:18.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.779+0000 7f94b6e30800 20 add_watcher() i=4 2024-09-13T19:16:18.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.779+0000 7f94b6e30800 20 add_watcher() i=5 2024-09-13T19:16:18.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.779+0000 7f94b6e30800 20 add_watcher() i=6 2024-09-13T19:16:18.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.780+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94889429366064] v34'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f949c03b040 con 0x7f94a4078070 2024-09-13T19:16:18.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.780+0000 7f94b6e30800 20 add_watcher() i=7 2024-09-13T19:16:18.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.780+0000 7f94b6e30800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:18.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.781+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d2abb6980 con 0x564d2aba28e0 2024-09-13T19:16:18.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.781+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f949c03b040 con 0x564d2aba28e0 2024-09-13T19:16:18.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.781+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94889429381920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d2abb3bf0 con 0x564d2aba28e0 2024-09-13T19:16:18.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.782+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94889429381920] v34'104 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f949c03b040 con 0x564d2aba28e0 2024-09-13T19:16:18.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.782+0000 7f9368fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:18.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.782+0000 7f94b6e30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:18.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.782+0000 7f94b6e30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:18.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.782+0000 7f94b6e30800 5 note: GC not initialized 2024-09-13T19:16:18.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.782+0000 7f92e37fe640 20 reqs_thread_entry: start 2024-09-13T19:16:18.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.782+0000 7f94b6e30800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:18.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.783+0000 7f94b6e30800 20 Filter name: none 2024-09-13T19:16:18.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.783+0000 7f92e17fa640 20 reqs_thread_entry: start 2024-09-13T19:16:18.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.783+0000 7f94b6e30800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:16:18.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.783+0000 7f94b6e30800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.783+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d2abe9e20 con 0x564d2aba28e0 2024-09-13T19:16:18.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.783+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f949c03b040 con 0x564d2aba28e0 2024-09-13T19:16:18.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.783+0000 7f94b6e30800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:16:18.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.783+0000 7f94b6e30800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:16:18.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.783+0000 7f94b6e30800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:16:18.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.783+0000 7f94b6e30800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:16:18.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.783+0000 7f94b6e30800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T19:16:18.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.783+0000 7f94b6e30800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.783+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d2abebf00 con 0x7f94ac04ebb0 2024-09-13T19:16:18.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.783+0000 7f94b2073640 1 -- 172.21.15.102:0/1734120033 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv2 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f94a407f070 con 0x7f94ac04ebb0 2024-09-13T19:16:18.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.783+0000 7f94b6e30800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:16:18.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.783+0000 7f94b6e30800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T19:16:18.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.783+0000 7f94b6e30800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:16:18.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.783+0000 7f94b6e30800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 : miss 2024-09-13T19:16:18.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.783+0000 7f94b6e30800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.783+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:64 8.9 8:917ee2d5:root::.bucket.meta.myfoo%3a509740b4-c081-4f37-bd6d-df9ca851489b.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d2abed780 con 0x7f94ac04ebb0 2024-09-13T19:16:18.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.784+0000 7f94b2073640 1 -- 172.21.15.102:0/1734120033 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(64 .bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f94a407f070 con 0x7f94ac04ebb0 2024-09-13T19:16:18.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.784+0000 7f94b6e30800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:16:18.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.784+0000 7f94b6e30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 info.flags=0x17 2024-09-13T19:16:18.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.784+0000 7f94b6e30800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 to cache LRU end 2024-09-13T19:16:18.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.784+0000 7f94b6e30800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:16:18.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.784+0000 7f94b6e30800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:16:18.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.784+0000 7f94b6e30800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 2024-09-13T19:16:18.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.784+0000 7f94b6e30800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-13T19:16:18.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.784+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d2abeecc0 con 0x7f94ac04ebb0 2024-09-13T19:16:18.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.785+0000 7f94b2073640 1 -- 172.21.15.102:0/1734120033 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(65 foo.buckets [call] v34'18 uv18 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f94a407f070 con 0x7f94ac04ebb0 2024-09-13T19:16:18.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.785+0000 7f94b6e30800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-13T19:16:18.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.785+0000 7f94b6e30800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.785+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d2abee810 con 0x7f94ac04ebb0 2024-09-13T19:16:18.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.786+0000 7f94b2073640 1 -- 172.21.15.102:0/1734120033 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f94a407f070 con 0x7f94ac04ebb0 2024-09-13T19:16:18.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.786+0000 7f94b6e30800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:16:18.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.786+0000 7f94b6e30800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-13T19:16:18.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.786+0000 7f94b6e30800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:16:18.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.786+0000 7f94b6e30800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:16:18.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.786+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d2abf4cf0 con 0x7f94ac04ebb0 2024-09-13T19:16:18.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.787+0000 7f94b2073640 1 -- 172.21.15.102:0/1734120033 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v34'19 uv19 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f94a407f070 con 0x7f94ac04ebb0 2024-09-13T19:16:18.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.787+0000 7f94b6e30800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-13T19:16:18.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.787+0000 7f94b6e30800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:16:18.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.787+0000 7f94b6e30800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T19:16:18.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.787+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94889429633024 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564d2abf2280 con 0x7f94a4078070 2024-09-13T19:16:18.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.787+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== watch-notify(notify (1) cookie 94889429371296 notify 146028888071 ret 0) ==== 380+0+0 (crc 0 0 0) 0x7f949c018040 con 0x7f94a4078070 2024-09-13T19:16:18.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.787+0000 7f9395ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888071 cookie 94889429371296 notifier 4489 bl.length()=338 2024-09-13T19:16:18.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.787+0000 7f9395ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-13T19:16:18.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.787+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(68 notify.6 [notify cookie 94889429633024 out=8b] v0'0 uv105 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f949c03b040 con 0x7f94a4078070 2024-09-13T19:16:18.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.787+0000 7f9395ffb640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:16:18.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.787+0000 7f9395ffb640 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f9378003ea0 con 0x7f94a4078070 2024-09-13T19:16:18.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.787+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f949c03b040 con 0x7f94a4078070 2024-09-13T19:16:18.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.787+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 <== osd.0 v2:172.21.15.53:6800/4021716951 20 ==== watch-notify(notify_complete (2) cookie 94889429633024 notify 146028888071 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f949c01d960 con 0x7f94a4078070 2024-09-13T19:16:18.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.788+0000 7f9368fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:18.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.788+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94889429381920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d2abe7b90 con 0x564d2aba28e0 2024-09-13T19:16:18.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.789+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94889429381920] v34'105 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f949c03b040 con 0x564d2aba28e0 2024-09-13T19:16:18.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.789+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94889429356336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d2abe7b90 con 0x7f94ac04ebb0 2024-09-13T19:16:18.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.790+0000 7f94b2073640 1 -- 172.21.15.102:0/1734120033 <== osd.2 v2:172.21.15.102:6816/2238176080 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94889429356336] v34'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94a407f070 con 0x7f94ac04ebb0 2024-09-13T19:16:18.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.790+0000 7f94b6e30800 20 remove_watcher() i=0 2024-09-13T19:16:18.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.790+0000 7f94b6e30800 2 removed watcher, disabling cache 2024-09-13T19:16:18.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.790+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94889429363344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d2abe7b90 con 0x564d2aba28e0 2024-09-13T19:16:18.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.791+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94889429363344] v34'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f949c03b040 con 0x564d2aba28e0 2024-09-13T19:16:18.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.791+0000 7f94b6e30800 20 remove_watcher() i=1 2024-09-13T19:16:18.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.791+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94889429364880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d2abe7b90 con 0x564d2aba72d0 2024-09-13T19:16:18.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.793+0000 7f94b2874640 1 -- 172.21.15.102:0/1734120033 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94889429364880] v34'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94ac00a4a0 con 0x564d2aba72d0 2024-09-13T19:16:18.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.793+0000 7f94b6e30800 20 remove_watcher() i=2 2024-09-13T19:16:18.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.793+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94889429368944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d2abe7b90 con 0x7f94ac04ebb0 2024-09-13T19:16:18.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.794+0000 7f94b2073640 1 -- 172.21.15.102:0/1734120033 <== osd.2 v2:172.21.15.102:6816/2238176080 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94889429368944] v34'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94a407f070 con 0x7f94ac04ebb0 2024-09-13T19:16:18.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.794+0000 7f94b6e30800 20 remove_watcher() i=3 2024-09-13T19:16:18.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.794+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94889429374016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d2abe7b90 con 0x564d2aba28e0 2024-09-13T19:16:18.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.794+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94889429374016] v34'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f949c03b040 con 0x564d2aba28e0 2024-09-13T19:16:18.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.795+0000 7f94b6e30800 20 remove_watcher() i=4 2024-09-13T19:16:18.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.795+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94889429377584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d2abe7b90 con 0x7f94a4078070 2024-09-13T19:16:18.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.796+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 <== osd.0 v2:172.21.15.53:6800/4021716951 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94889429377584] v34'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f949c03b040 con 0x7f94a4078070 2024-09-13T19:16:18.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.796+0000 7f94b6e30800 20 remove_watcher() i=5 2024-09-13T19:16:18.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.796+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94889429371296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d2abe7b90 con 0x7f94a4078070 2024-09-13T19:16:18.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.797+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 <== osd.0 v2:172.21.15.53:6800/4021716951 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94889429371296] v34'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f949c03b040 con 0x7f94a4078070 2024-09-13T19:16:18.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.797+0000 7f94b6e30800 20 remove_watcher() i=6 2024-09-13T19:16:18.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.797+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94889429366064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564d2abe7b90 con 0x7f94a4078070 2024-09-13T19:16:18.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.798+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 <== osd.0 v2:172.21.15.53:6800/4021716951 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94889429366064] v34'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f949c03b040 con 0x7f94a4078070 2024-09-13T19:16:18.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.798+0000 7f94b6e30800 20 remove_watcher() i=7 2024-09-13T19:16:18.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.798+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f94a4078070 msgr2=0x7f94a4068120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.798+0000 7f94b6e30800 1 --2- 172.21.15.102:0/1734120033 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f94a4078070 0x7f94a4068120 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.798+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x564d2aba28e0 msgr2=0x564d2aba4da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.798+0000 7f94b6e30800 1 --2- 172.21.15.102:0/1734120033 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x564d2aba28e0 0x564d2aba4da0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.798+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f94ac04ebb0 msgr2=0x7f94ac046500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.798+0000 7f94b6e30800 1 --2- 172.21.15.102:0/1734120033 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f94ac04ebb0 0x7f94ac046500 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.798+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x564d2aba72d0 msgr2=0x564d2aba96c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.798+0000 7f94b6e30800 1 --2- 172.21.15.102:0/1734120033 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x564d2aba72d0 0x564d2aba96c0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.798+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f937c036b90 msgr2=0x7f937c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.798+0000 7f94b6e30800 1 --2- 172.21.15.102:0/1734120033 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f937c036b90 0x7f937c039050 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f94a405af80 tx=0x7f94a4088000 comp rx=0 tx=0).stop 2024-09-13T19:16:18.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.798+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d2ab8fcd0 msgr2=0x564d2ab97020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.798+0000 7f94a9872640 1 -- 172.21.15.102:0/1734120033 reap_dead start 2024-09-13T19:16:18.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.798+0000 7f94b6e30800 1 --2- 172.21.15.102:0/1734120033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d2ab8fcd0 0x564d2ab97020 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f94ac00afb0 tx=0x7f94ac04cdb0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.798+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 shutdown_connections 2024-09-13T19:16:18.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.798+0000 7f94b6e30800 1 --2- 172.21.15.102:0/1734120033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d2ab8fcd0 0x564d2ab97020 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.798+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 >> 172.21.15.102:0/1734120033 conn(0x564d2ab8c030 msgr2=0x564d2ab8a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:18.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.798+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 shutdown_connections 2024-09-13T19:16:18.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.798+0000 7f94b6e30800 1 -- 172.21.15.102:0/1734120033 wait complete. 2024-09-13T19:16:18.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.798+0000 7f94b6e30800 1 -- 172.21.15.102:0/707169767 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f938c036b40 msgr2=0x7f938c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.798+0000 7f94b6e30800 1 --2- 172.21.15.102:0/707169767 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f938c036b40 0x7f938c039000 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f94a4050e80 tx=0x7f94a406f750 comp rx=0 tx=0).stop 2024-09-13T19:16:18.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.798+0000 7f94b6e30800 1 -- 172.21.15.102:0/707169767 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d2ab83010 msgr2=0x564d2ab83430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.798+0000 7f94b6e30800 1 --2- 172.21.15.102:0/707169767 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d2ab83010 0x564d2ab83430 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x564d2aa6fcf0 tx=0x7f94ac0167b0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.798+0000 7f94b6e30800 1 -- 172.21.15.102:0/707169767 shutdown_connections 2024-09-13T19:16:18.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.798+0000 7f94b6e30800 1 --2- 172.21.15.102:0/707169767 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f938c036b40 0x7f938c039000 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.798+0000 7f94b6e30800 1 --2- 172.21.15.102:0/707169767 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d2ab83010 0x564d2ab83430 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.798+0000 7f94b6e30800 1 -- 172.21.15.102:0/707169767 >> 172.21.15.102:0/707169767 conn(0x564d2ab77fa0 msgr2=0x564d2ab7ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:18.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.799+0000 7f94b6e30800 1 -- 172.21.15.102:0/707169767 shutdown_connections 2024-09-13T19:16:18.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.799+0000 7f94b6e30800 1 -- 172.21.15.102:0/707169767 wait complete. 2024-09-13T19:16:18.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.799+0000 7f94b6e30800 1 -- 172.21.15.102:0/1442724983 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x564d2aa6e280 msgr2=0x564d2ab6f310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.799+0000 7f94b6e30800 1 --2- 172.21.15.102:0/1442724983 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x564d2aa6e280 0x564d2ab6f310 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.799+0000 7f94b6e30800 1 -- 172.21.15.102:0/1442724983 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x564d2ab71ad0 msgr2=0x564d2ab73f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.799+0000 7f94b6e30800 1 --2- 172.21.15.102:0/1442724983 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x564d2ab71ad0 0x564d2ab73f20 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.799+0000 7f94b6e30800 1 -- 172.21.15.102:0/1442724983 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9398036b40 msgr2=0x7f9398039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.799+0000 7f94b6e30800 1 --2- 172.21.15.102:0/1442724983 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9398036b40 0x7f9398039000 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f949c000c00 tx=0x7f949c0013b0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.799+0000 7f94b6e30800 1 -- 172.21.15.102:0/1442724983 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d2aa6d940 msgr2=0x564d2aa70300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.799+0000 7f94b6e30800 1 --2- 172.21.15.102:0/1442724983 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d2aa6d940 0x564d2aa70300 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f94a4005570 tx=0x7f94a4002fb0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.799+0000 7f94b6e30800 1 -- 172.21.15.102:0/1442724983 shutdown_connections 2024-09-13T19:16:18.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.799+0000 7f94b6e30800 1 --2- 172.21.15.102:0/1442724983 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x564d2ab71ad0 0x564d2ab73f20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.799+0000 7f94b6e30800 1 --2- 172.21.15.102:0/1442724983 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x564d2aa6e280 0x564d2ab6f310 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.799+0000 7f94b6e30800 1 --2- 172.21.15.102:0/1442724983 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9398036b40 0x7f9398039000 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.799+0000 7f94b6e30800 1 --2- 172.21.15.102:0/1442724983 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564d2aa6d940 0x564d2aa70300 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.799+0000 7f94b6e30800 1 -- 172.21.15.102:0/1442724983 >> 172.21.15.102:0/1442724983 conn(0x564d2aa69550 msgr2=0x564d2ab589a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:18.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.799+0000 7f94b6e30800 1 -- 172.21.15.102:0/1442724983 shutdown_connections 2024-09-13T19:16:18.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.799+0000 7f94b6e30800 1 -- 172.21.15.102:0/1442724983 wait complete. 2024-09-13T19:16:18.829 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-13T19:16:18.830 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-13T19:16:18.830 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-13T19:16:18.886 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:18.886 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:18.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.880+0000 7f2f37610800 1 Processor -- start 2024-09-13T19:16:18.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.880+0000 7f2f37610800 1 -- start start 2024-09-13T19:16:18.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.880+0000 7f2f37610800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5613acf2c4e0 0x5613acfc0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.880+0000 7f2f37610800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5613ace76b30 con 0x5613acf2d5f0 2024-09-13T19:16:18.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.880+0000 7f2f37610800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5613ace58360 con 0x5613acf2c4e0 2024-09-13T19:16:18.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.880+0000 7f2f32583640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5613acf2c4e0 0x5613acfc0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.880+0000 7f2f32d84640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5613acf2d5f0 0x5613acf2bdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:49996/0 (socket says 172.21.15.102:49996) 2024-09-13T19:16:18.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.880+0000 7f2f32d84640 1 -- 172.21.15.102:0/1689827917 learned_addr learned my addr 172.21.15.102:0/1689827917 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:16:18.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.880+0000 7f2f32583640 1 --2- 172.21.15.102:0/1689827917 >> v2:172.21.15.53:3300/0 conn(0x5613acf2c4e0 0x5613acfc0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55330/0 (socket says 172.21.15.102:55330) 2024-09-13T19:16:18.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.881+0000 7f2f32583640 1 -- 172.21.15.102:0/1689827917 >> v1:172.21.15.53:6789/0 conn(0x5613acf2d5f0 legacy=0x5613acf2bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.881+0000 7f2f31d82640 1 -- 172.21.15.102:0/1689827917 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 876417021 0 0) 0x5613ace76b30 con 0x5613acf2d5f0 2024-09-13T19:16:18.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.881+0000 7f2f32583640 1 -- 172.21.15.102:0/1689827917 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613ace7ee00 con 0x5613acf2c4e0 2024-09-13T19:16:18.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.883+0000 7f2f32583640 1 --2- 172.21.15.102:0/1689827917 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613acf2c4e0 0x5613acfc0720 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2f2800a470 tx=0x7f2f28045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bb56335d435badf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.883+0000 7f2f31d82640 1 -- 172.21.15.102:0/1689827917 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f28053570 con 0x5613acf2c4e0 2024-09-13T19:16:18.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.883+0000 7f2f31d82640 1 -- 172.21.15.102:0/1689827917 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f28058070 con 0x5613acf2c4e0 2024-09-13T19:16:18.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.883+0000 7f2f31d82640 1 -- 172.21.15.102:0/1689827917 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f28053880 con 0x5613acf2c4e0 2024-09-13T19:16:18.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.883+0000 7f2f37610800 1 -- 172.21.15.102:0/1689827917 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613acf2c4e0 msgr2=0x5613acfc0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.883+0000 7f2f37610800 1 --2- 172.21.15.102:0/1689827917 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613acf2c4e0 0x5613acfc0720 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2f2800a470 tx=0x7f2f28045a20 comp rx=0 tx=0).stop 2024-09-13T19:16:18.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.883+0000 7f2f37610800 1 -- 172.21.15.102:0/1689827917 shutdown_connections 2024-09-13T19:16:18.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.883+0000 7f2f37610800 1 --2- 172.21.15.102:0/1689827917 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613acf2c4e0 0x5613acfc0720 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.883+0000 7f2f37610800 1 -- 172.21.15.102:0/1689827917 >> 172.21.15.102:0/1689827917 conn(0x5613acfb3030 msgr2=0x5613acfb5450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:18.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.883+0000 7f2f37610800 1 -- 172.21.15.102:0/1689827917 shutdown_connections 2024-09-13T19:16:18.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.883+0000 7f2f37610800 1 -- 172.21.15.102:0/1689827917 wait complete. 2024-09-13T19:16:18.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.897+0000 7f2f37610800 1 Processor -- start 2024-09-13T19:16:18.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.897+0000 7f2f37610800 1 -- start start 2024-09-13T19:16:18.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.897+0000 7f2f37610800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613acf2c4e0 0x5613ad0a8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.897+0000 7f2f37610800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5613acf03370 con 0x5613acf2c4e0 2024-09-13T19:16:18.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.897+0000 7f2f32d84640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613acf2c4e0 0x5613ad0a8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.897+0000 7f2f32d84640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613acf2c4e0 0x5613ad0a8990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55344/0 (socket says 172.21.15.102:55344) 2024-09-13T19:16:18.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.897+0000 7f2f32d84640 1 -- 172.21.15.102:0/836895026 learned_addr learned my addr 172.21.15.102:0/836895026 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:18.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.898+0000 7f2f32d84640 1 -- 172.21.15.102:0/836895026 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613ace50bc0 con 0x5613acf2c4e0 2024-09-13T19:16:18.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.898+0000 7f2f32d84640 1 --2- 172.21.15.102:0/836895026 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613acf2c4e0 0x5613ad0a8990 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2f24001e10 tx=0x7f2f2400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d216a14e4f3c561 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.898+0000 7f2e20e09640 1 -- 172.21.15.102:0/836895026 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f24012020 con 0x5613acf2c4e0 2024-09-13T19:16:18.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.898+0000 7f2e20e09640 1 -- 172.21.15.102:0/836895026 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f2400e5c0 con 0x5613acf2c4e0 2024-09-13T19:16:18.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.898+0000 7f2e20e09640 1 -- 172.21.15.102:0/836895026 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f2400e8e0 con 0x5613acf2c4e0 2024-09-13T19:16:18.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.899+0000 7f2f37610800 1 -- 172.21.15.102:0/836895026 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613acf2c4e0 msgr2=0x5613ad0a8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.899+0000 7f2f37610800 1 --2- 172.21.15.102:0/836895026 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613acf2c4e0 0x5613ad0a8990 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2f24001e10 tx=0x7f2f2400b780 comp rx=0 tx=0).stop 2024-09-13T19:16:18.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.899+0000 7f2f37610800 1 -- 172.21.15.102:0/836895026 shutdown_connections 2024-09-13T19:16:18.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.899+0000 7f2f37610800 1 --2- 172.21.15.102:0/836895026 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613acf2c4e0 0x5613ad0a8990 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.899+0000 7f2f37610800 1 -- 172.21.15.102:0/836895026 >> 172.21.15.102:0/836895026 conn(0x5613acfb3030 msgr2=0x5613ad0a4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:18.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.899+0000 7f2f37610800 1 -- 172.21.15.102:0/836895026 shutdown_connections 2024-09-13T19:16:18.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.899+0000 7f2f37610800 1 -- 172.21.15.102:0/836895026 wait complete. 2024-09-13T19:16:18.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.899+0000 7f2f37610800 1 Processor -- start 2024-09-13T19:16:18.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.899+0000 7f2f37610800 1 -- start start 2024-09-13T19:16:18.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.899+0000 7f2f37610800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613acf2c4e0 0x5613ad0b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.899+0000 7f2f37610800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5613acf2cbd0 con 0x5613acf2c4e0 2024-09-13T19:16:18.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.899+0000 7f2f32d84640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613acf2c4e0 0x5613ad0b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.899+0000 7f2f32d84640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613acf2c4e0 0x5613ad0b03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55360/0 (socket says 172.21.15.102:55360) 2024-09-13T19:16:18.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.899+0000 7f2f32d84640 1 -- 172.21.15.102:0/446885966 learned_addr learned my addr 172.21.15.102:0/446885966 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:18.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.900+0000 7f2f32d84640 1 -- 172.21.15.102:0/446885966 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613ace64fe0 con 0x5613acf2c4e0 2024-09-13T19:16:18.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.900+0000 7f2f32d84640 1 --2- 172.21.15.102:0/446885966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613acf2c4e0 0x5613ad0b03d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f2f24000fb0 tx=0x7f2f24000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.900+0000 7f2e1f606640 1 -- 172.21.15.102:0/446885966 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f24012030 con 0x5613acf2c4e0 2024-09-13T19:16:18.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.900+0000 7f2e1f606640 1 -- 172.21.15.102:0/446885966 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f2401a7a0 con 0x5613acf2c4e0 2024-09-13T19:16:18.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.900+0000 7f2f37610800 1 -- 172.21.15.102:0/446885966 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5613ad0b0910 con 0x5613acf2c4e0 2024-09-13T19:16:18.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.900+0000 7f2e1f606640 1 -- 172.21.15.102:0/446885966 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f2401aa80 con 0x5613acf2c4e0 2024-09-13T19:16:18.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.900+0000 7f2f37610800 1 -- 172.21.15.102:0/446885966 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613ad0b0e30 con 0x5613acf2c4e0 2024-09-13T19:16:18.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.901+0000 7f2e1f606640 1 -- 172.21.15.102:0/446885966 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2f24015020 con 0x5613acf2c4e0 2024-09-13T19:16:18.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.901+0000 7f2e1f606640 1 --2- 172.21.15.102:0/446885966 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2e18036b40 0x7f2e18039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.901+0000 7f2e1f606640 1 -- 172.21.15.102:0/446885966 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f2f24020030 con 0x5613acf2c4e0 2024-09-13T19:16:18.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.901+0000 7f2f32583640 1 --2- 172.21.15.102:0/446885966 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2e18036b40 0x7f2e18039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.901+0000 7f2f37610800 1 --2- 172.21.15.102:0/446885966 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5613acf2d5f0 0x5613ad0b7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.901+0000 7f2f37610800 1 -- 172.21.15.102:0/446885966 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0b79c0 con 0x5613acf2d5f0 2024-09-13T19:16:18.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.901+0000 7f2f33585640 1 --2- 172.21.15.102:0/446885966 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5613acf2d5f0 0x5613ad0b7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.902+0000 7f2f32583640 1 --2- 172.21.15.102:0/446885966 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2e18036b40 0x7f2e18039000 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2f28057000 tx=0x7f2f28052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.902+0000 7f2f33585640 1 --2- 172.21.15.102:0/446885966 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5613acf2d5f0 0x5613ad0b7440 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.902+0000 7f2f33585640 1 -- 172.21.15.102:0/446885966 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f2c00a4a0 con 0x5613acf2d5f0 2024-09-13T19:16:18.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.902+0000 7f2f37610800 1 -- 172.21.15.102:0/446885966 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0b49f0 con 0x5613acf2d5f0 2024-09-13T19:16:18.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.902+0000 7f2f33585640 1 -- 172.21.15.102:0/446885966 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2f2c00a4a0 con 0x5613acf2d5f0 2024-09-13T19:16:18.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.902+0000 7f2f37610800 1 --2- 172.21.15.102:0/446885966 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5613ad0b9cd0 0x5613ad0bc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.902+0000 7f2f37610800 1 -- 172.21.15.102:0/446885966 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0bc760 con 0x5613ad0b9cd0 2024-09-13T19:16:18.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.902+0000 7f2f32d84640 1 --2- 172.21.15.102:0/446885966 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5613ad0b9cd0 0x5613ad0bc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.903+0000 7f2f32d84640 1 --2- 172.21.15.102:0/446885966 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5613ad0b9cd0 0x5613ad0bc0c0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.903+0000 7f2f32d84640 1 -- 172.21.15.102:0/446885966 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2f24018950 con 0x5613ad0b9cd0 2024-09-13T19:16:18.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.903+0000 7f2f37610800 1 -- 172.21.15.102:0/446885966 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0b8b70 con 0x5613acf2d5f0 2024-09-13T19:16:18.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.903+0000 7f2f33585640 1 -- 172.21.15.102:0/446885966 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2f2c00a4a0 con 0x5613acf2d5f0 2024-09-13T19:16:18.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.903+0000 7f2f37610800 1 -- 172.21.15.102:0/446885966 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0b9050 con 0x5613ad0b9cd0 2024-09-13T19:16:18.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.903+0000 7f2f32d84640 1 -- 172.21.15.102:0/446885966 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2f24018950 con 0x5613ad0b9cd0 2024-09-13T19:16:18.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.904+0000 7f2f37610800 1 Processor -- start 2024-09-13T19:16:18.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.904+0000 7f2f37610800 1 -- start start 2024-09-13T19:16:18.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.904+0000 7f2f37610800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613ad0cb0f0 0x5613ad0cb510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.904+0000 7f2f37610800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5613ace52580 con 0x5613ad0cb0f0 2024-09-13T19:16:18.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.904+0000 7f2f33585640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613ad0cb0f0 0x5613ad0cb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.904+0000 7f2f33585640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613ad0cb0f0 0x5613ad0cb510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55362/0 (socket says 172.21.15.102:55362) 2024-09-13T19:16:18.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.904+0000 7f2f33585640 1 -- 172.21.15.102:0/3748205414 learned_addr learned my addr 172.21.15.102:0/3748205414 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:18.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.905+0000 7f2f33585640 1 -- 172.21.15.102:0/3748205414 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613ad0cba50 con 0x5613ad0cb0f0 2024-09-13T19:16:18.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.905+0000 7f2f33585640 1 --2- 172.21.15.102:0/3748205414 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613ad0cb0f0 0x5613ad0cb510 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x5613ad0b1480 tx=0x7f2f2c0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.905+0000 7f2e1ce01640 1 -- 172.21.15.102:0/3748205414 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f2c021440 con 0x5613ad0cb0f0 2024-09-13T19:16:18.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.905+0000 7f2e1ce01640 1 -- 172.21.15.102:0/3748205414 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f2c0215e0 con 0x5613ad0cb0f0 2024-09-13T19:16:18.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.905+0000 7f2f37610800 1 -- 172.21.15.102:0/3748205414 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5613ad0cbce0 con 0x5613ad0cb0f0 2024-09-13T19:16:18.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.905+0000 7f2e1ce01640 1 -- 172.21.15.102:0/3748205414 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f2c0218e0 con 0x5613ad0cb0f0 2024-09-13T19:16:18.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.905+0000 7f2f37610800 1 -- 172.21.15.102:0/3748205414 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613ad0ce9c0 con 0x5613ad0cb0f0 2024-09-13T19:16:18.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.906+0000 7f2e1ce01640 1 -- 172.21.15.102:0/3748205414 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2f2c011040 con 0x5613ad0cb0f0 2024-09-13T19:16:18.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.906+0000 7f2e1ce01640 1 --2- 172.21.15.102:0/3748205414 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2e0c036b90 0x7f2e0c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.906+0000 7f2e1ce01640 1 -- 172.21.15.102:0/3748205414 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f2f2c00e040 con 0x5613ad0cb0f0 2024-09-13T19:16:18.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.906+0000 7f2f32d84640 1 --2- 172.21.15.102:0/3748205414 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2e0c036b90 0x7f2e0c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.906+0000 7f2f37610800 1 Processor -- start 2024-09-13T19:16:18.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.906+0000 7f2f32d84640 1 --2- 172.21.15.102:0/3748205414 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2e0c036b90 0x7f2e0c039050 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x5613ad0b4930 tx=0x7f2f24041040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.906+0000 7f2f37610800 1 -- start start 2024-09-13T19:16:18.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.907+0000 7f2f37610800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613ad0d7e10 0x5613ad0d8210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.907+0000 7f2f37610800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5613ad0a9140 con 0x5613ad0d7e10 2024-09-13T19:16:18.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.907+0000 7f2f33585640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613ad0d7e10 0x5613ad0d8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.907+0000 7f2f33585640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613ad0d7e10 0x5613ad0d8210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55370/0 (socket says 172.21.15.102:55370) 2024-09-13T19:16:18.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.907+0000 7f2f33585640 1 -- 172.21.15.102:0/594657930 learned_addr learned my addr 172.21.15.102:0/594657930 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:18.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.907+0000 7f2f33585640 1 -- 172.21.15.102:0/594657930 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613ad0d87e0 con 0x5613ad0d7e10 2024-09-13T19:16:18.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.907+0000 7f2f33585640 1 --2- 172.21.15.102:0/594657930 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613ad0d7e10 0x5613ad0d8210 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c00b010 tx=0x7f2f2c04cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92ffc1ab5e0b2067 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.907+0000 7f2e167fc640 1 -- 172.21.15.102:0/594657930 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f2c013af0 con 0x5613ad0d7e10 2024-09-13T19:16:18.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.907+0000 7f2e167fc640 1 -- 172.21.15.102:0/594657930 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f2c01f340 con 0x5613ad0d7e10 2024-09-13T19:16:18.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.907+0000 7f2e167fc640 1 -- 172.21.15.102:0/594657930 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f2c014cc0 con 0x5613ad0d7e10 2024-09-13T19:16:18.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.908+0000 7f2f37610800 1 -- 172.21.15.102:0/594657930 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613ad0d7e10 msgr2=0x5613ad0d8210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.908+0000 7f2f37610800 1 --2- 172.21.15.102:0/594657930 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613ad0d7e10 0x5613ad0d8210 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c00b010 tx=0x7f2f2c04cca0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.908+0000 7f2f37610800 1 -- 172.21.15.102:0/594657930 shutdown_connections 2024-09-13T19:16:18.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.908+0000 7f2f37610800 1 --2- 172.21.15.102:0/594657930 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613ad0d7e10 0x5613ad0d8210 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.908+0000 7f2f37610800 1 -- 172.21.15.102:0/594657930 >> 172.21.15.102:0/594657930 conn(0x5613ad0d4170 msgr2=0x5613ad0d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:18.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.908+0000 7f2f37610800 1 -- 172.21.15.102:0/594657930 shutdown_connections 2024-09-13T19:16:18.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.908+0000 7f2f37610800 1 -- 172.21.15.102:0/594657930 wait complete. 2024-09-13T19:16:18.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.908+0000 7f2f37610800 1 Processor -- start 2024-09-13T19:16:18.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.908+0000 7f2f37610800 1 -- start start 2024-09-13T19:16:18.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.908+0000 7f2f37610800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613ad0d7e10 0x5613ad0df2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.908+0000 7f2f37610800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5613ad0d8e50 con 0x5613ad0d7e10 2024-09-13T19:16:18.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.908+0000 7f2f33585640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613ad0d7e10 0x5613ad0df2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.908+0000 7f2f33585640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613ad0d7e10 0x5613ad0df2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55386/0 (socket says 172.21.15.102:55386) 2024-09-13T19:16:18.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.908+0000 7f2f33585640 1 -- 172.21.15.102:0/2132523464 learned_addr learned my addr 172.21.15.102:0/2132523464 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:18.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.909+0000 7f2f33585640 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613ad0df810 con 0x5613ad0d7e10 2024-09-13T19:16:18.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.909+0000 7f2f33585640 1 --2- 172.21.15.102:0/2132523464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613ad0d7e10 0x5613ad0df2d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c042010 tx=0x7f2f2c04ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.909+0000 7f2e14ff9640 1 -- 172.21.15.102:0/2132523464 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f2c03a070 con 0x5613ad0d7e10 2024-09-13T19:16:18.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.909+0000 7f2e14ff9640 1 -- 172.21.15.102:0/2132523464 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f2c04b150 con 0x5613ad0d7e10 2024-09-13T19:16:18.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.909+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5613ad0dfaa0 con 0x5613ad0d7e10 2024-09-13T19:16:18.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.909+0000 7f2e14ff9640 1 -- 172.21.15.102:0/2132523464 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f2c013af0 con 0x5613ad0d7e10 2024-09-13T19:16:18.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.909+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613ad0e2750 con 0x5613ad0d7e10 2024-09-13T19:16:18.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.910+0000 7f2e14ff9640 1 -- 172.21.15.102:0/2132523464 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2f2c03d070 con 0x5613ad0d7e10 2024-09-13T19:16:18.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.910+0000 7f2e14ff9640 1 --2- 172.21.15.102:0/2132523464 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2dfc036b40 0x7f2dfc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.910+0000 7f2e14ff9640 1 -- 172.21.15.102:0/2132523464 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f2f2c04d070 con 0x5613ad0d7e10 2024-09-13T19:16:18.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.910+0000 7f2f32d84640 1 --2- 172.21.15.102:0/2132523464 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2dfc036b40 0x7f2dfc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.910+0000 7f2f32d84640 1 --2- 172.21.15.102:0/2132523464 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2dfc036b40 0x7f2dfc039000 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2f24018c60 tx=0x7f2f24035000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.911+0000 7f2f37610800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.911+0000 7f2f37610800 1 --2- 172.21.15.102:0/2132523464 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5613ad0eaf10 0x5613ad0ed3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.911+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0edb20 con 0x5613ad0eaf10 2024-09-13T19:16:18.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.911+0000 7f2f32583640 1 --2- 172.21.15.102:0/2132523464 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5613ad0eaf10 0x5613ad0ed3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.911+0000 7f2f32583640 1 --2- 172.21.15.102:0/2132523464 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5613ad0eaf10 0x5613ad0ed3d0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.911+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f28051070 con 0x5613ad0eaf10 2024-09-13T19:16:18.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.911+0000 7f2f37610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:18.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.911+0000 7f2f37610800 20 realm 2024-09-13T19:16:18.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.911+0000 7f2f37610800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.911+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0edf50 con 0x5613ad0eaf10 2024-09-13T19:16:18.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.911+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f28051070 con 0x5613ad0eaf10 2024-09-13T19:16:18.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.911+0000 7f2f37610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:18.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.911+0000 7f2f37610800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:18.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.911+0000 7f2f37610800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.911+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0ee820 con 0x5613ad0eaf10 2024-09-13T19:16:18.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.912+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f28051070 con 0x5613ad0eaf10 2024-09-13T19:16:18.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.912+0000 7f2f37610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:18.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.912+0000 7f2f37610800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.912+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0eebc0 con 0x5613ad0eaf10 2024-09-13T19:16:18.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.912+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2f28051070 con 0x5613ad0eaf10 2024-09-13T19:16:18.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.912+0000 7f2f37610800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:18.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.912+0000 7f2f37610800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.912+0000 7f2f37610800 1 --2- 172.21.15.102:0/2132523464 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5613ad0ef920 0x5613ad0f1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.912+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0f2320 con 0x5613ad0ef920 2024-09-13T19:16:18.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.912+0000 7f2f33585640 1 --2- 172.21.15.102:0/2132523464 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5613ad0ef920 0x5613ad0f1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.912+0000 7f2f33585640 1 --2- 172.21.15.102:0/2132523464 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5613ad0ef920 0x5613ad0f1d10 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.913+0000 7f2f33585640 1 -- 172.21.15.102:0/2132523464 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2f2c055070 con 0x5613ad0ef920 2024-09-13T19:16:18.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.913+0000 7f2f37610800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:18.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.913+0000 7f2f37610800 20 searching for the correct realm 2024-09-13T19:16:18.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.913+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0f3c10 con 0x5613ad0ef920 2024-09-13T19:16:18.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.913+0000 7f2f33585640 1 -- 172.21.15.102:0/2132523464 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f2c055070 con 0x5613ad0ef920 2024-09-13T19:16:18.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.913+0000 7f2f33585640 1 --2- 172.21.15.102:0/2132523464 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f2f2c03f070 0x7f2f2c02d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.913+0000 7f2f33585640 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0f3c10 con 0x7f2f2c03f070 2024-09-13T19:16:18.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.913+0000 7f2f32d84640 1 --2- 172.21.15.102:0/2132523464 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f2f2c03f070 0x7f2f2c02d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.913+0000 7f2f32d84640 1 --2- 172.21.15.102:0/2132523464 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f2f2c03f070 0x7f2f2c02d110 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.913+0000 7f2f32d84640 1 -- 172.21.15.102:0/2132523464 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f24018950 con 0x7f2f2c03f070 2024-09-13T19:16:18.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.913+0000 7f2f32d84640 1 --2- 172.21.15.102:0/2132523464 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f2f24017050 0x7f2f2400d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:18.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.913+0000 7f2f32d84640 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0f3c10 con 0x7f2f24017050 2024-09-13T19:16:18.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.914+0000 7f2f32583640 1 --2- 172.21.15.102:0/2132523464 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f2f24017050 0x7f2f2400d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:18.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.914+0000 7f2f32583640 1 --2- 172.21.15.102:0/2132523464 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f2f24017050 0x7f2f2400d3d0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:18.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.914+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f28051070 con 0x7f2f24017050 2024-09-13T19:16:18.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.914+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0f3c10 con 0x5613ad0eaf10 2024-09-13T19:16:18.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.914+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f28051070 con 0x5613ad0eaf10 2024-09-13T19:16:18.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.914+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0f3c10 con 0x5613ad0eaf10 2024-09-13T19:16:18.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.915+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f28051070 con 0x5613ad0eaf10 2024-09-13T19:16:18.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.915+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0f3c10 con 0x7f2f24017050 2024-09-13T19:16:18.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.915+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f28051070 con 0x7f2f24017050 2024-09-13T19:16:18.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.915+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0f3c10 con 0x7f2f24017050 2024-09-13T19:16:18.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.915+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f28051070 con 0x7f2f24017050 2024-09-13T19:16:18.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.915+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0f3c10 con 0x7f2f2c03f070 2024-09-13T19:16:18.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.915+0000 7f2f32d84640 1 -- 172.21.15.102:0/2132523464 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f24018950 con 0x7f2f2c03f070 2024-09-13T19:16:18.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.915+0000 7f2f32d84640 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0f3c10 con 0x5613ad0ef920 2024-09-13T19:16:18.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.916+0000 7f2f33585640 1 -- 172.21.15.102:0/2132523464 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f2c055070 con 0x5613ad0ef920 2024-09-13T19:16:18.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.916+0000 7f2f33585640 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0f3c10 con 0x5613ad0eaf10 2024-09-13T19:16:18.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.916+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f28051070 con 0x5613ad0eaf10 2024-09-13T19:16:18.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.916+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0f3c10 con 0x7f2f24017050 2024-09-13T19:16:18.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.916+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f28051070 con 0x7f2f24017050 2024-09-13T19:16:18.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.916+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0f3c10 con 0x5613ad0eaf10 2024-09-13T19:16:18.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.916+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f28051070 con 0x5613ad0eaf10 2024-09-13T19:16:18.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.916+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0f3c10 con 0x7f2f2c03f070 2024-09-13T19:16:18.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.916+0000 7f2f32d84640 1 -- 172.21.15.102:0/2132523464 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2f24018950 con 0x7f2f2c03f070 2024-09-13T19:16:18.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.916+0000 7f2f32d84640 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0f3c10 con 0x5613ad0ef920 2024-09-13T19:16:18.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.917+0000 7f2f33585640 1 -- 172.21.15.102:0/2132523464 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f2c055070 con 0x5613ad0ef920 2024-09-13T19:16:18.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.917+0000 7f2f33585640 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0f3c10 con 0x5613ad0ef920 2024-09-13T19:16:18.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.917+0000 7f2f33585640 1 -- 172.21.15.102:0/2132523464 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2f2c055070 con 0x5613ad0ef920 2024-09-13T19:16:18.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.917+0000 7f2f33585640 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0f3c10 con 0x7f2f24017050 2024-09-13T19:16:18.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.917+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f28051070 con 0x7f2f24017050 2024-09-13T19:16:18.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.917+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0f3c10 con 0x5613ad0ef920 2024-09-13T19:16:18.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.917+0000 7f2f33585640 1 -- 172.21.15.102:0/2132523464 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2f2c055070 con 0x5613ad0ef920 2024-09-13T19:16:18.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.917+0000 7f2f33585640 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0f3c10 con 0x5613ad0ef920 2024-09-13T19:16:18.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.918+0000 7f2f33585640 1 -- 172.21.15.102:0/2132523464 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f2c055070 con 0x5613ad0ef920 2024-09-13T19:16:18.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.918+0000 7f2f33585640 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0f3c10 con 0x5613ad0eaf10 2024-09-13T19:16:18.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.918+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f28051070 con 0x5613ad0eaf10 2024-09-13T19:16:18.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.918+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0f3c10 con 0x5613ad0eaf10 2024-09-13T19:16:18.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.918+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2f28051070 con 0x5613ad0eaf10 2024-09-13T19:16:18.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.918+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0f3c10 con 0x7f2f24017050 2024-09-13T19:16:18.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.918+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f28051070 con 0x7f2f24017050 2024-09-13T19:16:18.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.918+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0f3c10 con 0x5613ad0ef920 2024-09-13T19:16:18.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.919+0000 7f2f33585640 1 -- 172.21.15.102:0/2132523464 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f2c055070 con 0x5613ad0ef920 2024-09-13T19:16:18.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.919+0000 7f2f33585640 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0f3c10 con 0x7f2f2c03f070 2024-09-13T19:16:18.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.919+0000 7f2f32d84640 1 -- 172.21.15.102:0/2132523464 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f24018950 con 0x7f2f2c03f070 2024-09-13T19:16:18.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.919+0000 7f2f32d84640 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0f3c10 con 0x5613ad0eaf10 2024-09-13T19:16:18.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.919+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f28051070 con 0x5613ad0eaf10 2024-09-13T19:16:18.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.919+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0f3c10 con 0x7f2f24017050 2024-09-13T19:16:18.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.919+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f28051070 con 0x7f2f24017050 2024-09-13T19:16:18.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.919+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0f3c10 con 0x5613ad0ef920 2024-09-13T19:16:18.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.920+0000 7f2f33585640 1 -- 172.21.15.102:0/2132523464 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f2c055070 con 0x5613ad0ef920 2024-09-13T19:16:18.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.920+0000 7f2f33585640 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0f3c10 con 0x7f2f24017050 2024-09-13T19:16:18.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.920+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f28051070 con 0x7f2f24017050 2024-09-13T19:16:18.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.920+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2f28086040 con 0x7f2f2c03f070 2024-09-13T19:16:18.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.920+0000 7f2f32d84640 1 -- 172.21.15.102:0/2132523464 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f24018950 con 0x7f2f2c03f070 2024-09-13T19:16:18.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.920+0000 7f2f32d84640 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2f28086040 con 0x5613ad0ef920 2024-09-13T19:16:18.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.920+0000 7f2f33585640 1 -- 172.21.15.102:0/2132523464 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f2c055070 con 0x5613ad0ef920 2024-09-13T19:16:18.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.920+0000 7f2f33585640 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2f28086040 con 0x7f2f24017050 2024-09-13T19:16:18.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.921+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f28051070 con 0x7f2f24017050 2024-09-13T19:16:18.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.921+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2f28086040 con 0x5613ad0eaf10 2024-09-13T19:16:18.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.921+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2f28051070 con 0x5613ad0eaf10 2024-09-13T19:16:18.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.921+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2f28086040 con 0x7f2f2c03f070 2024-09-13T19:16:18.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.921+0000 7f2f32d84640 1 -- 172.21.15.102:0/2132523464 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f24018950 con 0x7f2f2c03f070 2024-09-13T19:16:18.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.921+0000 7f2f37610800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:18.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.921+0000 7f2f37610800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:18.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.921+0000 7f2f37610800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:18.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.921+0000 7f2f37610800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:18.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.921+0000 7f2f37610800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:18.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.921+0000 7f2f37610800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:18.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.921+0000 7f2f37610800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.921+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0f2b70 con 0x5613ad0eaf10 2024-09-13T19:16:18.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.921+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f28051070 con 0x5613ad0eaf10 2024-09-13T19:16:18.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.921+0000 7f2f37610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:18.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.921+0000 7f2f37610800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.921+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0f2f60 con 0x5613ad0eaf10 2024-09-13T19:16:18.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.922+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2f28051070 con 0x5613ad0eaf10 2024-09-13T19:16:18.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.922+0000 7f2f37610800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:18.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.922+0000 7f2f37610800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.922+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0f4090 con 0x5613ad0ef920 2024-09-13T19:16:18.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.922+0000 7f2f33585640 1 -- 172.21.15.102:0/2132523464 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2f2c055070 con 0x5613ad0ef920 2024-09-13T19:16:18.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.922+0000 7f2f37610800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:18.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.922+0000 7f2f37610800 20 zone default found 2024-09-13T19:16:18.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.922+0000 7f2f37610800 4 Realm: () 2024-09-13T19:16:18.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.922+0000 7f2f37610800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:18.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.922+0000 7f2f37610800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:18.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.922+0000 7f2f37610800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:18.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.922+0000 7f2f37610800 20 zonegroup default 2024-09-13T19:16:18.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.922+0000 7f2f37610800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.922+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0f48e0 con 0x7f2f24017050 2024-09-13T19:16:18.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.922+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2f28051070 con 0x7f2f24017050 2024-09-13T19:16:18.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.922+0000 7f2f37610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:18.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.922+0000 7f2f37610800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.922+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0f62c0 con 0x5613ad0ef920 2024-09-13T19:16:18.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.922+0000 7f2f33585640 1 -- 172.21.15.102:0/2132523464 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2f2c055070 con 0x5613ad0ef920 2024-09-13T19:16:18.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.922+0000 7f2f37610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:18.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.922+0000 7f2f37610800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.922+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0f6750 con 0x5613ad0ef920 2024-09-13T19:16:18.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.923+0000 7f2f33585640 1 -- 172.21.15.102:0/2132523464 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2f2c055070 con 0x5613ad0ef920 2024-09-13T19:16:18.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.923+0000 7f2f37610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:18.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.923+0000 7f2f37610800 20 started sync module instance, tier type = 2024-09-13T19:16:18.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.923+0000 7f2f37610800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:18.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.923+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0f5700 con 0x7f2f2c03f070 2024-09-13T19:16:18.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.924+0000 7f2f32d84640 1 -- 172.21.15.102:0/2132523464 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(44 notify.0 [create] v34'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f24018950 con 0x7f2f2c03f070 2024-09-13T19:16:18.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.924+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94642507829840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0f6b90 con 0x7f2f2c03f070 2024-09-13T19:16:18.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.924+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0f73e0 con 0x5613ad0eaf10 2024-09-13T19:16:18.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.925+0000 7f2f32d84640 1 -- 172.21.15.102:0/2132523464 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94642507829840] v34'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f24018950 con 0x7f2f2c03f070 2024-09-13T19:16:18.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.925+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v34'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f28051070 con 0x5613ad0eaf10 2024-09-13T19:16:18.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.925+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94642507837232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0f7800 con 0x5613ad0eaf10 2024-09-13T19:16:18.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.925+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0f8050 con 0x5613ad0ef920 2024-09-13T19:16:18.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.926+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94642507837232] v34'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f28051070 con 0x5613ad0eaf10 2024-09-13T19:16:18.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.926+0000 7f2f33585640 1 -- 172.21.15.102:0/2132523464 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v34'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f2c055070 con 0x5613ad0ef920 2024-09-13T19:16:18.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.926+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94642507838768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0f7f60 con 0x5613ad0ef920 2024-09-13T19:16:18.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.926+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0f8ae0 con 0x7f2f2c03f070 2024-09-13T19:16:18.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.927+0000 7f2f33585640 1 -- 172.21.15.102:0/2132523464 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94642507838768] v34'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f2c055070 con 0x5613ad0ef920 2024-09-13T19:16:18.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.928+0000 7f2f32d84640 1 -- 172.21.15.102:0/2132523464 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(50 notify.3 [create] v34'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f24018950 con 0x7f2f2c03f070 2024-09-13T19:16:18.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.928+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94642507842992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0f8ed0 con 0x7f2f2c03f070 2024-09-13T19:16:18.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.928+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0f9910 con 0x5613ad0eaf10 2024-09-13T19:16:18.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.929+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v34'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f28051070 con 0x5613ad0eaf10 2024-09-13T19:16:18.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.929+0000 7f2f32d84640 1 -- 172.21.15.102:0/2132523464 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94642507842992] v34'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f24018950 con 0x7f2f2c03f070 2024-09-13T19:16:18.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.929+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94642507846624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0f98d0 con 0x5613ad0eaf10 2024-09-13T19:16:18.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.929+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0fa420 con 0x7f2f24017050 2024-09-13T19:16:18.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.930+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(54 notify.5 [create] v34'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f28051070 con 0x7f2f24017050 2024-09-13T19:16:18.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.930+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94642507849552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0fa420 con 0x7f2f24017050 2024-09-13T19:16:18.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.930+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0fb390 con 0x7f2f24017050 2024-09-13T19:16:18.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.930+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94642507846624] v34'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f28051070 con 0x5613ad0eaf10 2024-09-13T19:16:18.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.931+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94642507849552] v34'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f28051070 con 0x7f2f24017050 2024-09-13T19:16:18.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.931+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(56 notify.6 [create] v34'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f28051070 con 0x7f2f24017050 2024-09-13T19:16:18.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.931+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94642507851792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0f79b0 con 0x7f2f24017050 2024-09-13T19:16:18.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.931+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0fb840 con 0x7f2f24017050 2024-09-13T19:16:18.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.932+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94642507851792] v34'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f28051070 con 0x7f2f24017050 2024-09-13T19:16:18.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.932+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(58 notify.7 [create] v34'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f28051070 con 0x7f2f24017050 2024-09-13T19:16:18.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.932+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94642507853408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0fb800 con 0x7f2f24017050 2024-09-13T19:16:18.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.932+0000 7f2f37610800 20 add_watcher() i=0 2024-09-13T19:16:18.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.932+0000 7f2f37610800 20 add_watcher() i=1 2024-09-13T19:16:18.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.932+0000 7f2f37610800 20 add_watcher() i=2 2024-09-13T19:16:18.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.932+0000 7f2f37610800 20 add_watcher() i=3 2024-09-13T19:16:18.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.932+0000 7f2f37610800 20 add_watcher() i=4 2024-09-13T19:16:18.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.932+0000 7f2f37610800 20 add_watcher() i=5 2024-09-13T19:16:18.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.932+0000 7f2f37610800 20 add_watcher() i=6 2024-09-13T19:16:18.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.933+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94642507853408] v34'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f28051070 con 0x7f2f24017050 2024-09-13T19:16:18.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.933+0000 7f2f37610800 20 add_watcher() i=7 2024-09-13T19:16:18.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.933+0000 7f2f37610800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:18.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.933+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0fec30 con 0x5613ad0eaf10 2024-09-13T19:16:18.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.933+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2f28051070 con 0x5613ad0eaf10 2024-09-13T19:16:18.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.933+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94642507855136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613ad0fc180 con 0x5613ad0eaf10 2024-09-13T19:16:18.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.934+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94642507855136] v34'106 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2f28051070 con 0x5613ad0eaf10 2024-09-13T19:16:18.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.934+0000 7f2de97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:18.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.934+0000 7f2f37610800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:18.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.934+0000 7f2f37610800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:18.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.934+0000 7f2f37610800 5 note: GC not initialized 2024-09-13T19:16:18.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.935+0000 7f2d63fff640 20 reqs_thread_entry: start 2024-09-13T19:16:18.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.935+0000 7f2f37610800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:18.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.935+0000 7f2f37610800 20 Filter name: none 2024-09-13T19:16:18.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.935+0000 7f2d61ffb640 20 reqs_thread_entry: start 2024-09-13T19:16:18.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.935+0000 7f2f37610800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T19:16:18.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.935+0000 7f2f37610800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.935+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613ad132080 con 0x7f2f24017050 2024-09-13T19:16:18.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.935+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f2f28051070 con 0x7f2f24017050 2024-09-13T19:16:18.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.935+0000 7f2f37610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:18.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.935+0000 7f2f37610800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-13T19:16:18.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.935+0000 7f2f37610800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T19:16:18.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.935+0000 7f2f37610800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-13T19:16:18.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.935+0000 7f2f37610800 20 rados->read ofs=0 len=0 2024-09-13T19:16:18.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.935+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613ad1306c0 con 0x7f2f24017050 2024-09-13T19:16:18.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.935+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f2f28051070 con 0x7f2f24017050 2024-09-13T19:16:18.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.935+0000 7f2f37610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:18.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.935+0000 7f2f37610800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-13T19:16:18.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.935+0000 7f2f37610800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T19:16:18.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.935+0000 7f2f37610800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T19:16:18.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.935+0000 7f2f37610800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T19:16:18.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.935+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613ad130f60 con 0x7f2f24017050 2024-09-13T19:16:18.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.937+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v34'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f2f28051070 con 0x7f2f24017050 2024-09-13T19:16:18.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.937+0000 7f2f37610800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-13T19:16:18.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.937+0000 7f2f37610800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T19:16:18.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.937+0000 7f2f37610800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-13T19:16:18.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.937+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94642508073648 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613ad135b20 con 0x7f2f24017050 2024-09-13T19:16:18.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.937+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 <== osd.0 v2:172.21.15.53:6800/4021716951 20 ==== watch-notify(notify (1) cookie 94642507849552 notify 146028888072 ret 0) ==== 598+0+0 (crc 0 0 0) 0x5613ad131300 con 0x7f2f24017050 2024-09-13T19:16:18.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.937+0000 7f2e167fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888072 cookie 94642507849552 notifier 4496 bl.length()=556 2024-09-13T19:16:18.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.937+0000 7f2e167fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-13T19:16:18.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.937+0000 7f2e167fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T19:16:18.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.937+0000 7f2e167fc640 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f2df8003ea0 con 0x7f2f24017050 2024-09-13T19:16:18.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.937+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 <== osd.0 v2:172.21.15.53:6800/4021716951 21 ==== osd_op_reply(65 notify.5 [notify cookie 94642508073648 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2f28051070 con 0x7f2f24017050 2024-09-13T19:16:18.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.937+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 <== osd.0 v2:172.21.15.53:6800/4021716951 22 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f28051070 con 0x7f2f24017050 2024-09-13T19:16:18.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.937+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 <== osd.0 v2:172.21.15.53:6800/4021716951 23 ==== watch-notify(notify_complete (2) cookie 94642508073648 notify 146028888072 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5613ad131ad0 con 0x7f2f24017050 2024-09-13T19:16:18.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.937+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613ad133650 con 0x7f2f24017050 2024-09-13T19:16:18.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.938+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 <== osd.0 v2:172.21.15.53:6800/4021716951 24 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v34'3 uv3 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f2f28051070 con 0x7f2f24017050 2024-09-13T19:16:18.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.938+0000 7f2f37610800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T19:16:18.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.938+0000 7f2f37610800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T19:16:18.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.938+0000 7f2f37610800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T19:16:18.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.938+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94642508073536 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613ad135b20 con 0x5613ad0ef920 2024-09-13T19:16:18.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.938+0000 7f2f33585640 1 -- 172.21.15.102:0/2132523464 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== watch-notify(notify (1) cookie 94642507838768 notify 146028888066 ret 0) ==== 219+0+0 (crc 0 0 0) 0x5613ad0e2750 con 0x5613ad0ef920 2024-09-13T19:16:18.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.939+0000 7f2e15ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888066 cookie 94642507838768 notifier 4496 bl.length()=177 2024-09-13T19:16:18.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.939+0000 7f2e15ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T19:16:18.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.939+0000 7f2e15ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T19:16:18.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.939+0000 7f2f33585640 1 -- 172.21.15.102:0/2132523464 <== osd.3 v2:172.21.15.102:6800/3096737090 17 ==== osd_op_reply(68 notify.2 [notify cookie 94642508073536 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2f2c055070 con 0x5613ad0ef920 2024-09-13T19:16:18.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.939+0000 7f2e15ffb640 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f2d68003400 con 0x5613ad0ef920 2024-09-13T19:16:18.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.939+0000 7f2f33585640 1 -- 172.21.15.102:0/2132523464 <== osd.3 v2:172.21.15.102:6800/3096737090 18 ==== watch-notify(notify_complete (2) cookie 94642508073536 notify 146028888066 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f2f2c060020 con 0x5613ad0ef920 2024-09-13T19:16:18.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.939+0000 7f2f33585640 1 -- 172.21.15.102:0/2132523464 <== osd.3 v2:172.21.15.102:6800/3096737090 19 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f2c055070 con 0x5613ad0ef920 2024-09-13T19:16:18.955 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-13T19:16:18.936884Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:16:18.936873Z","tags":[],"group_ids":[]} 2024-09-13T19:16:18.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.940+0000 7f2de97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:18.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.940+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94642507855136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613ad12fd40 con 0x5613ad0eaf10 2024-09-13T19:16:18.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.941+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94642507855136] v34'107 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2f28051070 con 0x5613ad0eaf10 2024-09-13T19:16:18.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.941+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94642507829840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613ad12fd40 con 0x7f2f2c03f070 2024-09-13T19:16:18.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.942+0000 7f2f32d84640 1 -- 172.21.15.102:0/2132523464 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94642507829840] v34'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f24018950 con 0x7f2f2c03f070 2024-09-13T19:16:18.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.942+0000 7f2f37610800 20 remove_watcher() i=0 2024-09-13T19:16:18.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.942+0000 7f2f37610800 2 removed watcher, disabling cache 2024-09-13T19:16:18.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.942+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94642507837232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613ad12fd40 con 0x5613ad0eaf10 2024-09-13T19:16:18.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.943+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94642507837232] v34'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f28051070 con 0x5613ad0eaf10 2024-09-13T19:16:18.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.943+0000 7f2f37610800 20 remove_watcher() i=1 2024-09-13T19:16:18.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.943+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94642507838768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613ad12fd40 con 0x5613ad0ef920 2024-09-13T19:16:18.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.944+0000 7f2f33585640 1 -- 172.21.15.102:0/2132523464 <== osd.3 v2:172.21.15.102:6800/3096737090 20 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94642507838768] v34'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f2c055070 con 0x5613ad0ef920 2024-09-13T19:16:18.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.944+0000 7f2f37610800 20 remove_watcher() i=2 2024-09-13T19:16:18.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.944+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94642507842992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613ad12fd40 con 0x7f2f2c03f070 2024-09-13T19:16:18.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.945+0000 7f2f32d84640 1 -- 172.21.15.102:0/2132523464 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94642507842992] v34'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f24018950 con 0x7f2f2c03f070 2024-09-13T19:16:18.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.945+0000 7f2f37610800 20 remove_watcher() i=3 2024-09-13T19:16:18.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.945+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94642507846624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613ad12fd40 con 0x5613ad0eaf10 2024-09-13T19:16:18.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.946+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94642507846624] v34'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f28051070 con 0x5613ad0eaf10 2024-09-13T19:16:18.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.946+0000 7f2f37610800 20 remove_watcher() i=4 2024-09-13T19:16:18.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.946+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94642507849552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613ad12fd40 con 0x7f2f24017050 2024-09-13T19:16:18.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.947+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 <== osd.0 v2:172.21.15.53:6800/4021716951 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94642507849552] v34'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f28051070 con 0x7f2f24017050 2024-09-13T19:16:18.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.947+0000 7f2f37610800 20 remove_watcher() i=5 2024-09-13T19:16:18.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.947+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94642507851792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613ad12fd40 con 0x7f2f24017050 2024-09-13T19:16:18.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.948+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 <== osd.0 v2:172.21.15.53:6800/4021716951 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94642507851792] v34'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f28051070 con 0x7f2f24017050 2024-09-13T19:16:18.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.948+0000 7f2f37610800 20 remove_watcher() i=6 2024-09-13T19:16:18.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.948+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94642507853408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613ad12fd40 con 0x7f2f24017050 2024-09-13T19:16:18.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.949+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 <== osd.0 v2:172.21.15.53:6800/4021716951 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94642507853408] v34'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f28051070 con 0x7f2f24017050 2024-09-13T19:16:18.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.949+0000 7f2f37610800 20 remove_watcher() i=7 2024-09-13T19:16:18.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.949+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f2f24017050 msgr2=0x7f2f2400d3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.949+0000 7f2f37610800 1 --2- 172.21.15.102:0/2132523464 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f2f24017050 0x7f2f2400d3d0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.949+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5613ad0eaf10 msgr2=0x5613ad0ed3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.949+0000 7f2f37610800 1 --2- 172.21.15.102:0/2132523464 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5613ad0eaf10 0x5613ad0ed3d0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.949+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f2f2c03f070 msgr2=0x7f2f2c02d110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.949+0000 7f2f37610800 1 --2- 172.21.15.102:0/2132523464 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f2f2c03f070 0x7f2f2c02d110 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.949+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5613ad0ef920 msgr2=0x5613ad0f1d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.949+0000 7f2f37610800 1 --2- 172.21.15.102:0/2132523464 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5613ad0ef920 0x5613ad0f1d10 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.949+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2dfc036b40 msgr2=0x7f2dfc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.949+0000 7f2f37610800 1 --2- 172.21.15.102:0/2132523464 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2dfc036b40 0x7f2dfc039000 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2f24018c60 tx=0x7f2f24035000 comp rx=0 tx=0).stop 2024-09-13T19:16:18.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.949+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613ad0d7e10 msgr2=0x5613ad0df2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.949+0000 7f2f32583640 1 -- 172.21.15.102:0/2132523464 reap_dead start 2024-09-13T19:16:18.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.949+0000 7f2f37610800 1 --2- 172.21.15.102:0/2132523464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613ad0d7e10 0x5613ad0df2d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c042010 tx=0x7f2f2c04ca30 comp rx=0 tx=0).stop 2024-09-13T19:16:18.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.949+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 shutdown_connections 2024-09-13T19:16:18.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.949+0000 7f2f37610800 1 --2- 172.21.15.102:0/2132523464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613ad0d7e10 0x5613ad0df2d0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.949+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 >> 172.21.15.102:0/2132523464 conn(0x5613ad0d4170 msgr2=0x5613ad0d2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:18.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.949+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 shutdown_connections 2024-09-13T19:16:18.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.949+0000 7f2f37610800 1 -- 172.21.15.102:0/2132523464 wait complete. 2024-09-13T19:16:18.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.949+0000 7f2f37610800 1 -- 172.21.15.102:0/3748205414 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2e0c036b90 msgr2=0x7f2e0c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.949+0000 7f2f37610800 1 --2- 172.21.15.102:0/3748205414 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2e0c036b90 0x7f2e0c039050 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x5613ad0b4930 tx=0x7f2f24041040 comp rx=0 tx=0).stop 2024-09-13T19:16:18.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.949+0000 7f2f37610800 1 -- 172.21.15.102:0/3748205414 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613ad0cb0f0 msgr2=0x5613ad0cb510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.949+0000 7f2f37610800 1 --2- 172.21.15.102:0/3748205414 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613ad0cb0f0 0x5613ad0cb510 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x5613ad0b1480 tx=0x7f2f2c0167b0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.949+0000 7f2f37610800 1 -- 172.21.15.102:0/3748205414 shutdown_connections 2024-09-13T19:16:18.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.949+0000 7f2f37610800 1 --2- 172.21.15.102:0/3748205414 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2e0c036b90 0x7f2e0c039050 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.949+0000 7f2f37610800 1 --2- 172.21.15.102:0/3748205414 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613ad0cb0f0 0x5613ad0cb510 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.949+0000 7f2f37610800 1 -- 172.21.15.102:0/3748205414 >> 172.21.15.102:0/3748205414 conn(0x5613ad0c0080 msgr2=0x5613ad0c2c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:18.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.949+0000 7f2f37610800 1 -- 172.21.15.102:0/3748205414 shutdown_connections 2024-09-13T19:16:18.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.949+0000 7f2f37610800 1 -- 172.21.15.102:0/3748205414 wait complete. 2024-09-13T19:16:18.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.950+0000 7f2f37610800 1 -- 172.21.15.102:0/446885966 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5613acf2d5f0 msgr2=0x5613ad0b7440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.950+0000 7f2f37610800 1 --2- 172.21.15.102:0/446885966 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5613acf2d5f0 0x5613ad0b7440 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.950+0000 7f2f37610800 1 -- 172.21.15.102:0/446885966 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5613ad0b9cd0 msgr2=0x5613ad0bc0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.950+0000 7f2f37610800 1 --2- 172.21.15.102:0/446885966 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5613ad0b9cd0 0x5613ad0bc0c0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.950+0000 7f2f37610800 1 -- 172.21.15.102:0/446885966 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2e18036b40 msgr2=0x7f2e18039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.950+0000 7f2f37610800 1 --2- 172.21.15.102:0/446885966 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2e18036b40 0x7f2e18039000 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2f28057000 tx=0x7f2f28052000 comp rx=0 tx=0).stop 2024-09-13T19:16:18.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.950+0000 7f2f37610800 1 -- 172.21.15.102:0/446885966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613acf2c4e0 msgr2=0x5613ad0b03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:18.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.950+0000 7f2f37610800 1 --2- 172.21.15.102:0/446885966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613acf2c4e0 0x5613ad0b03d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f2f24000fb0 tx=0x7f2f24000ed0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.950+0000 7f2f37610800 1 -- 172.21.15.102:0/446885966 shutdown_connections 2024-09-13T19:16:18.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.950+0000 7f2f37610800 1 --2- 172.21.15.102:0/446885966 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5613ad0b9cd0 0x5613ad0bc0c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.950+0000 7f2f37610800 1 --2- 172.21.15.102:0/446885966 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5613acf2d5f0 0x5613ad0b7440 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.950+0000 7f2f37610800 1 --2- 172.21.15.102:0/446885966 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2e18036b40 0x7f2e18039000 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.950+0000 7f2f37610800 1 --2- 172.21.15.102:0/446885966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613acf2c4e0 0x5613ad0b03d0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:18.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.950+0000 7f2f37610800 1 -- 172.21.15.102:0/446885966 >> 172.21.15.102:0/446885966 conn(0x5613acfb3030 msgr2=0x5613ad0a2c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:18.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.950+0000 7f2f37610800 1 -- 172.21.15.102:0/446885966 shutdown_connections 2024-09-13T19:16:18.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:18.950+0000 7f2f37610800 1 -- 172.21.15.102:0/446885966 wait complete. 2024-09-13T19:16:18.966 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-13T19:16:18.936884Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:16:18.936873Z', 'tags': [], 'group_ids': []} 2024-09-13T19:16:18.972 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-13T19:16:18.976 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:16:18.976 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2024-09-13T19:16:18.976 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2024-09-13T19:16:18.976 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2024-09-13T19:16:19.019 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:19.020 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:19.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.017+0000 7fa869810800 1 Processor -- start 2024-09-13T19:16:19.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.017+0000 7fa869810800 1 -- start start 2024-09-13T19:16:19.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.017+0000 7fa869810800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b889171a60 0x55b889173e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.017+0000 7fa869810800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b88902cb30 con 0x55b88916d760 2024-09-13T19:16:19.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.017+0000 7fa869810800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55b88900e360 con 0x55b889171a60 2024-09-13T19:16:19.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.018+0000 7fa85c783640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b889171a60 0x55b889173e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.018+0000 7fa864f84640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55b88916d760 0x55b88916db60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:50002/0 (socket says 172.21.15.102:50002) 2024-09-13T19:16:19.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.018+0000 7fa864f84640 1 -- 172.21.15.102:0/2381723316 learned_addr learned my addr 172.21.15.102:0/2381723316 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:16:19.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.018+0000 7fa85c783640 1 -- 172.21.15.102:0/2381723316 >> v1:172.21.15.53:6789/0 conn(0x55b88916d760 legacy=0x55b88916db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.018+0000 7fa85c783640 1 -- 172.21.15.102:0/2381723316 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b889034e00 con 0x55b889171a60 2024-09-13T19:16:19.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.020+0000 7fa85c783640 1 --2- 172.21.15.102:0/2381723316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b889171a60 0x55b889173e50 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa84c00a470 tx=0x7fa84c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb791cec0ad2e3e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.020+0000 7fa85ffff640 1 -- 172.21.15.102:0/2381723316 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa84c053570 con 0x55b889171a60 2024-09-13T19:16:19.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.020+0000 7fa85ffff640 1 -- 172.21.15.102:0/2381723316 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa84c058070 con 0x55b889171a60 2024-09-13T19:16:19.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.020+0000 7fa85ffff640 1 -- 172.21.15.102:0/2381723316 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa84c053880 con 0x55b889171a60 2024-09-13T19:16:19.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.020+0000 7fa869810800 1 -- 172.21.15.102:0/2381723316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b889171a60 msgr2=0x55b889173e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.020+0000 7fa869810800 1 --2- 172.21.15.102:0/2381723316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b889171a60 0x55b889173e50 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa84c00a470 tx=0x7fa84c045a20 comp rx=0 tx=0).stop 2024-09-13T19:16:19.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.020+0000 7fa869810800 1 -- 172.21.15.102:0/2381723316 shutdown_connections 2024-09-13T19:16:19.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.020+0000 7fa869810800 1 --2- 172.21.15.102:0/2381723316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b889171a60 0x55b889173e50 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.020+0000 7fa869810800 1 -- 172.21.15.102:0/2381723316 >> 172.21.15.102:0/2381723316 conn(0x55b889168ff0 msgr2=0x55b88916b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:19.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.020+0000 7fa869810800 1 -- 172.21.15.102:0/2381723316 shutdown_connections 2024-09-13T19:16:19.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.020+0000 7fa869810800 1 -- 172.21.15.102:0/2381723316 wait complete. 2024-09-13T19:16:19.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.034+0000 7fa869810800 1 Processor -- start 2024-09-13T19:16:19.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.034+0000 7fa869810800 1 -- start start 2024-09-13T19:16:19.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.034+0000 7fa869810800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b88916d760 0x55b88925c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.034+0000 7fa869810800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b8890b9330 con 0x55b88916d760 2024-09-13T19:16:19.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.035+0000 7fa864f84640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b88916d760 0x55b88925c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.035+0000 7fa864f84640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b88916d760 0x55b88925c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55408/0 (socket says 172.21.15.102:55408) 2024-09-13T19:16:19.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.035+0000 7fa864f84640 1 -- 172.21.15.102:0/2740974435 learned_addr learned my addr 172.21.15.102:0/2740974435 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:19.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.035+0000 7fa864f84640 1 -- 172.21.15.102:0/2740974435 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b889006bc0 con 0x55b88916d760 2024-09-13T19:16:19.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.035+0000 7fa864f84640 1 --2- 172.21.15.102:0/2740974435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b88916d760 0x55b88925c890 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa854001e10 tx=0x7fa85400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c24c02218f1319f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.035+0000 7fa752e0d640 1 -- 172.21.15.102:0/2740974435 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa854012020 con 0x55b88916d760 2024-09-13T19:16:19.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.035+0000 7fa752e0d640 1 -- 172.21.15.102:0/2740974435 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa85400e5a0 con 0x55b88916d760 2024-09-13T19:16:19.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.035+0000 7fa752e0d640 1 -- 172.21.15.102:0/2740974435 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa85400e8e0 con 0x55b88916d760 2024-09-13T19:16:19.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.036+0000 7fa869810800 1 -- 172.21.15.102:0/2740974435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b88916d760 msgr2=0x55b88925c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.036+0000 7fa869810800 1 --2- 172.21.15.102:0/2740974435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b88916d760 0x55b88925c890 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa854001e10 tx=0x7fa85400b780 comp rx=0 tx=0).stop 2024-09-13T19:16:19.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.036+0000 7fa869810800 1 -- 172.21.15.102:0/2740974435 shutdown_connections 2024-09-13T19:16:19.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.036+0000 7fa869810800 1 --2- 172.21.15.102:0/2740974435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b88916d760 0x55b88925c890 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.036+0000 7fa869810800 1 -- 172.21.15.102:0/2740974435 >> 172.21.15.102:0/2740974435 conn(0x55b889168ff0 msgr2=0x55b889258250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:19.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.036+0000 7fa869810800 1 -- 172.21.15.102:0/2740974435 shutdown_connections 2024-09-13T19:16:19.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.036+0000 7fa869810800 1 -- 172.21.15.102:0/2740974435 wait complete. 2024-09-13T19:16:19.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.036+0000 7fa869810800 1 Processor -- start 2024-09-13T19:16:19.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.036+0000 7fa869810800 1 -- start start 2024-09-13T19:16:19.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.037+0000 7fa869810800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b88916d760 0x55b889264290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.037+0000 7fa869810800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b889174690 con 0x55b88916d760 2024-09-13T19:16:19.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.037+0000 7fa864f84640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b88916d760 0x55b889264290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.037+0000 7fa864f84640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b88916d760 0x55b889264290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55410/0 (socket says 172.21.15.102:55410) 2024-09-13T19:16:19.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.037+0000 7fa864f84640 1 -- 172.21.15.102:0/3859644248 learned_addr learned my addr 172.21.15.102:0/3859644248 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:19.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.037+0000 7fa864f84640 1 -- 172.21.15.102:0/3859644248 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b88901afe0 con 0x55b88916d760 2024-09-13T19:16:19.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.037+0000 7fa864f84640 1 --2- 172.21.15.102:0/3859644248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b88916d760 0x55b889264290 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa85400b7c0 tx=0x7fa854000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.037+0000 7fa75160a640 1 -- 172.21.15.102:0/3859644248 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa854012030 con 0x55b88916d760 2024-09-13T19:16:19.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.037+0000 7fa75160a640 1 -- 172.21.15.102:0/3859644248 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa854001470 con 0x55b88916d760 2024-09-13T19:16:19.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.037+0000 7fa869810800 1 -- 172.21.15.102:0/3859644248 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b8892647d0 con 0x55b88916d760 2024-09-13T19:16:19.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.037+0000 7fa75160a640 1 -- 172.21.15.102:0/3859644248 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa85401a8d0 con 0x55b88916d760 2024-09-13T19:16:19.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.037+0000 7fa869810800 1 -- 172.21.15.102:0/3859644248 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b889264cf0 con 0x55b88916d760 2024-09-13T19:16:19.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.038+0000 7fa75160a640 1 -- 172.21.15.102:0/3859644248 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa854015020 con 0x55b88916d760 2024-09-13T19:16:19.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.038+0000 7fa75160a640 1 --2- 172.21.15.102:0/3859644248 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa74c036be0 0x7fa74c0390a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.038+0000 7fa75160a640 1 -- 172.21.15.102:0/3859644248 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fa854020030 con 0x55b88916d760 2024-09-13T19:16:19.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.038+0000 7fa85c783640 1 --2- 172.21.15.102:0/3859644248 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa74c036be0 0x7fa74c0390a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.038+0000 7fa869810800 1 --2- 172.21.15.102:0/3859644248 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55b889171a60 0x55b88926b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.039+0000 7fa869810800 1 -- 172.21.15.102:0/3859644248 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b88926b880 con 0x55b889171a60 2024-09-13T19:16:19.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.039+0000 7fa865785640 1 --2- 172.21.15.102:0/3859644248 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55b889171a60 0x55b88926b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.039+0000 7fa85c783640 1 --2- 172.21.15.102:0/3859644248 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa74c036be0 0x7fa74c0390a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa84c057000 tx=0x7fa84c052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.039+0000 7fa865785640 1 --2- 172.21.15.102:0/3859644248 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55b889171a60 0x55b88926b300 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.039+0000 7fa865785640 1 -- 172.21.15.102:0/3859644248 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa86000a4a0 con 0x55b889171a60 2024-09-13T19:16:19.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.039+0000 7fa869810800 1 -- 172.21.15.102:0/3859644248 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b8892688b0 con 0x55b889171a60 2024-09-13T19:16:19.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.040+0000 7fa865785640 1 -- 172.21.15.102:0/3859644248 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa86000a4a0 con 0x55b889171a60 2024-09-13T19:16:19.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.040+0000 7fa869810800 1 --2- 172.21.15.102:0/3859644248 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55b88926db90 0x55b88926ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.040+0000 7fa869810800 1 -- 172.21.15.102:0/3859644248 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b889270620 con 0x55b88926db90 2024-09-13T19:16:19.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.040+0000 7fa864f84640 1 --2- 172.21.15.102:0/3859644248 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55b88926db90 0x55b88926ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.040+0000 7fa864f84640 1 --2- 172.21.15.102:0/3859644248 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55b88926db90 0x55b88926ff80 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.040+0000 7fa864f84640 1 -- 172.21.15.102:0/3859644248 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa854018950 con 0x55b88926db90 2024-09-13T19:16:19.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.040+0000 7fa869810800 1 -- 172.21.15.102:0/3859644248 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b88926ca30 con 0x55b889171a60 2024-09-13T19:16:19.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.040+0000 7fa865785640 1 -- 172.21.15.102:0/3859644248 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa86000a4a0 con 0x55b889171a60 2024-09-13T19:16:19.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.040+0000 7fa869810800 1 -- 172.21.15.102:0/3859644248 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b88926ced0 con 0x55b88926db90 2024-09-13T19:16:19.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.041+0000 7fa864f84640 1 -- 172.21.15.102:0/3859644248 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa854018950 con 0x55b88926db90 2024-09-13T19:16:19.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.041+0000 7fa869810800 1 Processor -- start 2024-09-13T19:16:19.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.041+0000 7fa869810800 1 -- start start 2024-09-13T19:16:19.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.041+0000 7fa869810800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b88927efd0 0x55b88927f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.041+0000 7fa869810800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b889008580 con 0x55b88927efd0 2024-09-13T19:16:19.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.041+0000 7fa865785640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b88927efd0 0x55b88927f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.041+0000 7fa865785640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b88927efd0 0x55b88927f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55418/0 (socket says 172.21.15.102:55418) 2024-09-13T19:16:19.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.041+0000 7fa865785640 1 -- 172.21.15.102:0/1075852509 learned_addr learned my addr 172.21.15.102:0/1075852509 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:19.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.042+0000 7fa865785640 1 -- 172.21.15.102:0/1075852509 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b88927f930 con 0x55b88927efd0 2024-09-13T19:16:19.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.042+0000 7fa865785640 1 --2- 172.21.15.102:0/1075852509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b88927efd0 0x55b88927f3f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x55b889265340 tx=0x7fa8600167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.042+0000 7fa74a7fc640 1 -- 172.21.15.102:0/1075852509 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa860013640 con 0x55b88927efd0 2024-09-13T19:16:19.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.042+0000 7fa74a7fc640 1 -- 172.21.15.102:0/1075852509 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8600137e0 con 0x55b88927efd0 2024-09-13T19:16:19.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.042+0000 7fa74a7fc640 1 -- 172.21.15.102:0/1075852509 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa860013ac0 con 0x55b88927efd0 2024-09-13T19:16:19.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.042+0000 7fa869810800 1 -- 172.21.15.102:0/1075852509 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b88927fbc0 con 0x55b88927efd0 2024-09-13T19:16:19.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.042+0000 7fa869810800 1 -- 172.21.15.102:0/1075852509 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8892828a0 con 0x55b88927efd0 2024-09-13T19:16:19.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.043+0000 7fa74a7fc640 1 -- 172.21.15.102:0/1075852509 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa860011040 con 0x55b88927efd0 2024-09-13T19:16:19.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.043+0000 7fa74a7fc640 1 --2- 172.21.15.102:0/1075852509 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa73c036b40 0x7fa73c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.043+0000 7fa74a7fc640 1 -- 172.21.15.102:0/1075852509 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fa86000e040 con 0x55b88927efd0 2024-09-13T19:16:19.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.043+0000 7fa864f84640 1 --2- 172.21.15.102:0/1075852509 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa73c036b40 0x7fa73c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.043+0000 7fa869810800 1 Processor -- start 2024-09-13T19:16:19.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.043+0000 7fa869810800 1 -- start start 2024-09-13T19:16:19.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.043+0000 7fa864f84640 1 --2- 172.21.15.102:0/1075852509 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa73c036b40 0x7fa73c039000 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x55b88926ca00 tx=0x7fa85404b030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.044+0000 7fa869810800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8890e2fc0 0x55b8890e33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.044+0000 7fa869810800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b88925d040 con 0x55b8890e2fc0 2024-09-13T19:16:19.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.044+0000 7fa865785640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8890e2fc0 0x55b8890e33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.044+0000 7fa865785640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8890e2fc0 0x55b8890e33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55432/0 (socket says 172.21.15.102:55432) 2024-09-13T19:16:19.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.044+0000 7fa865785640 1 -- 172.21.15.102:0/3071897886 learned_addr learned my addr 172.21.15.102:0/3071897886 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:19.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.044+0000 7fa865785640 1 -- 172.21.15.102:0/3071897886 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8890e3990 con 0x55b8890e2fc0 2024-09-13T19:16:19.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.044+0000 7fa865785640 1 --2- 172.21.15.102:0/3071897886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8890e2fc0 0x55b8890e33c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa860005a10 tx=0x7fa860020e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c065dc213d19da61 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.044+0000 7fa73bfff640 1 -- 172.21.15.102:0/3071897886 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa860021440 con 0x55b8890e2fc0 2024-09-13T19:16:19.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.044+0000 7fa73bfff640 1 -- 172.21.15.102:0/3071897886 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa86001f340 con 0x55b8890e2fc0 2024-09-13T19:16:19.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.044+0000 7fa73bfff640 1 -- 172.21.15.102:0/3071897886 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8600215e0 con 0x55b8890e2fc0 2024-09-13T19:16:19.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.045+0000 7fa869810800 1 -- 172.21.15.102:0/3071897886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8890e2fc0 msgr2=0x55b8890e33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.045+0000 7fa869810800 1 --2- 172.21.15.102:0/3071897886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8890e2fc0 0x55b8890e33c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa860005a10 tx=0x7fa860020e60 comp rx=0 tx=0).stop 2024-09-13T19:16:19.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.045+0000 7fa869810800 1 -- 172.21.15.102:0/3071897886 shutdown_connections 2024-09-13T19:16:19.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.045+0000 7fa869810800 1 --2- 172.21.15.102:0/3071897886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8890e2fc0 0x55b8890e33c0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.045+0000 7fa869810800 1 -- 172.21.15.102:0/3071897886 >> 172.21.15.102:0/3071897886 conn(0x55b8892880a0 msgr2=0x55b8892861a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:19.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.045+0000 7fa869810800 1 -- 172.21.15.102:0/3071897886 shutdown_connections 2024-09-13T19:16:19.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.045+0000 7fa869810800 1 -- 172.21.15.102:0/3071897886 wait complete. 2024-09-13T19:16:19.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.045+0000 7fa869810800 1 Processor -- start 2024-09-13T19:16:19.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.045+0000 7fa869810800 1 -- start start 2024-09-13T19:16:19.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.045+0000 7fa869810800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8890e2fc0 0x55b8892953e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.045+0000 7fa869810800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b8890e1cf0 con 0x55b8890e2fc0 2024-09-13T19:16:19.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.046+0000 7fa865785640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8890e2fc0 0x55b8892953e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.046+0000 7fa865785640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8890e2fc0 0x55b8892953e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55448/0 (socket says 172.21.15.102:55448) 2024-09-13T19:16:19.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.046+0000 7fa865785640 1 -- 172.21.15.102:0/693201159 learned_addr learned my addr 172.21.15.102:0/693201159 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:19.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.046+0000 7fa865785640 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b889295920 con 0x55b8890e2fc0 2024-09-13T19:16:19.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.046+0000 7fa865785640 1 --2- 172.21.15.102:0/693201159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8890e2fc0 0x55b8892953e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa860012fd0 tx=0x7fa86004cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.046+0000 7fa73a7fc640 1 -- 172.21.15.102:0/693201159 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8600400d0 con 0x55b8890e2fc0 2024-09-13T19:16:19.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.046+0000 7fa73a7fc640 1 -- 172.21.15.102:0/693201159 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa860040270 con 0x55b8890e2fc0 2024-09-13T19:16:19.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.046+0000 7fa73a7fc640 1 -- 172.21.15.102:0/693201159 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa86004e1c0 con 0x55b8890e2fc0 2024-09-13T19:16:19.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.046+0000 7fa869810800 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b889295bb0 con 0x55b8890e2fc0 2024-09-13T19:16:19.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.046+0000 7fa869810800 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b889295bb0 con 0x55b8890e2fc0 2024-09-13T19:16:19.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.047+0000 7fa73a7fc640 1 -- 172.21.15.102:0/693201159 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa86004e360 con 0x55b8890e2fc0 2024-09-13T19:16:19.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.047+0000 7fa73a7fc640 1 --2- 172.21.15.102:0/693201159 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa730036b40 0x7fa730039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.047+0000 7fa73a7fc640 1 -- 172.21.15.102:0/693201159 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fa860035070 con 0x55b8890e2fc0 2024-09-13T19:16:19.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.047+0000 7fa864f84640 1 --2- 172.21.15.102:0/693201159 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa730036b40 0x7fa730039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.048+0000 7fa864f84640 1 --2- 172.21.15.102:0/693201159 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa730036b40 0x7fa730039000 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa8540446c0 tx=0x7fa854031000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.048+0000 7fa869810800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.048+0000 7fa869810800 1 --2- 172.21.15.102:0/693201159 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55b8892a0be0 0x55b8892a30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.048+0000 7fa869810800 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b8892a37f0 con 0x55b8892a0be0 2024-09-13T19:16:19.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.048+0000 7fa85c783640 1 --2- 172.21.15.102:0/693201159 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55b8892a0be0 0x55b8892a30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.048+0000 7fa85c783640 1 --2- 172.21.15.102:0/693201159 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55b8892a0be0 0x55b8892a30a0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.048+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa84c051070 con 0x55b8892a0be0 2024-09-13T19:16:19.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.048+0000 7fa869810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:19.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.048+0000 7fa869810800 20 realm 2024-09-13T19:16:19.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.048+0000 7fa869810800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.048+0000 7fa869810800 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b8892a3c20 con 0x55b8892a0be0 2024-09-13T19:16:19.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.049+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa84c051070 con 0x55b8892a0be0 2024-09-13T19:16:19.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.049+0000 7fa869810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:19.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.049+0000 7fa869810800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:19.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.049+0000 7fa869810800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.049+0000 7fa869810800 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b8892a44f0 con 0x55b8892a0be0 2024-09-13T19:16:19.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.049+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa84c051070 con 0x55b8892a0be0 2024-09-13T19:16:19.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.049+0000 7fa869810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:19.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.049+0000 7fa869810800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.049+0000 7fa869810800 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b8892a4890 con 0x55b8892a0be0 2024-09-13T19:16:19.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.049+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa84c051070 con 0x55b8892a0be0 2024-09-13T19:16:19.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.049+0000 7fa869810800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:19.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.049+0000 7fa869810800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.049+0000 7fa869810800 1 --2- 172.21.15.102:0/693201159 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55b8892a55f0 0x55b8892a79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.049+0000 7fa869810800 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b8892a7f20 con 0x55b8892a55f0 2024-09-13T19:16:19.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.049+0000 7fa865785640 1 --2- 172.21.15.102:0/693201159 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55b8892a55f0 0x55b8892a79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.050+0000 7fa865785640 1 --2- 172.21.15.102:0/693201159 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55b8892a55f0 0x55b8892a79e0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.050+0000 7fa865785640 1 -- 172.21.15.102:0/693201159 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa86000a4a0 con 0x55b8892a55f0 2024-09-13T19:16:19.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.050+0000 7fa869810800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:19.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.050+0000 7fa869810800 20 searching for the correct realm 2024-09-13T19:16:19.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.050+0000 7fa869810800 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b8892a9890 con 0x55b8892a55f0 2024-09-13T19:16:19.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.050+0000 7fa865785640 1 -- 172.21.15.102:0/693201159 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa86000a4a0 con 0x55b8892a55f0 2024-09-13T19:16:19.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.050+0000 7fa865785640 1 --2- 172.21.15.102:0/693201159 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fa8600123d0 0x7fa8600230c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.050+0000 7fa865785640 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b8892a9890 con 0x7fa8600123d0 2024-09-13T19:16:19.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.050+0000 7fa864f84640 1 --2- 172.21.15.102:0/693201159 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fa8600123d0 0x7fa8600230c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.050+0000 7fa864f84640 1 --2- 172.21.15.102:0/693201159 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fa8600123d0 0x7fa8600230c0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.051+0000 7fa864f84640 1 -- 172.21.15.102:0/693201159 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa854018950 con 0x7fa8600123d0 2024-09-13T19:16:19.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.051+0000 7fa864f84640 1 --2- 172.21.15.102:0/693201159 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fa854017050 0x7fa854044730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.051+0000 7fa864f84640 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b8892a9890 con 0x7fa854017050 2024-09-13T19:16:19.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.051+0000 7fa85c783640 1 --2- 172.21.15.102:0/693201159 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fa854017050 0x7fa854044730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.051+0000 7fa85c783640 1 --2- 172.21.15.102:0/693201159 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fa854017050 0x7fa854044730 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.052+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa84c051070 con 0x7fa854017050 2024-09-13T19:16:19.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.052+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b8892a9890 con 0x55b8892a0be0 2024-09-13T19:16:19.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.052+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa84c051070 con 0x55b8892a0be0 2024-09-13T19:16:19.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.052+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b8892a9890 con 0x55b8892a0be0 2024-09-13T19:16:19.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.052+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa84c051070 con 0x55b8892a0be0 2024-09-13T19:16:19.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.052+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b8892a9890 con 0x7fa854017050 2024-09-13T19:16:19.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.052+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa84c051070 con 0x7fa854017050 2024-09-13T19:16:19.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.052+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b8892a9890 con 0x7fa854017050 2024-09-13T19:16:19.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.053+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa84c051070 con 0x7fa854017050 2024-09-13T19:16:19.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.053+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b8892a9890 con 0x7fa8600123d0 2024-09-13T19:16:19.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.053+0000 7fa864f84640 1 -- 172.21.15.102:0/693201159 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa854018950 con 0x7fa8600123d0 2024-09-13T19:16:19.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.053+0000 7fa864f84640 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b8892a9890 con 0x55b8892a55f0 2024-09-13T19:16:19.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.053+0000 7fa865785640 1 -- 172.21.15.102:0/693201159 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa86000a4a0 con 0x55b8892a55f0 2024-09-13T19:16:19.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.053+0000 7fa865785640 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b8892a9890 con 0x55b8892a0be0 2024-09-13T19:16:19.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.053+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa84c051070 con 0x55b8892a0be0 2024-09-13T19:16:19.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.053+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b8892a9890 con 0x7fa854017050 2024-09-13T19:16:19.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.054+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa84c051070 con 0x7fa854017050 2024-09-13T19:16:19.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.054+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b8892a9890 con 0x55b8892a0be0 2024-09-13T19:16:19.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.054+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa84c051070 con 0x55b8892a0be0 2024-09-13T19:16:19.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.054+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b8892a9890 con 0x7fa8600123d0 2024-09-13T19:16:19.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.054+0000 7fa864f84640 1 -- 172.21.15.102:0/693201159 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa854018950 con 0x7fa8600123d0 2024-09-13T19:16:19.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.054+0000 7fa864f84640 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b8892a9890 con 0x55b8892a55f0 2024-09-13T19:16:19.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.054+0000 7fa865785640 1 -- 172.21.15.102:0/693201159 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa86000a4a0 con 0x55b8892a55f0 2024-09-13T19:16:19.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.054+0000 7fa865785640 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b8892a9890 con 0x55b8892a55f0 2024-09-13T19:16:19.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.054+0000 7fa865785640 1 -- 172.21.15.102:0/693201159 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa86000a4a0 con 0x55b8892a55f0 2024-09-13T19:16:19.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.054+0000 7fa865785640 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b8892a9890 con 0x7fa854017050 2024-09-13T19:16:19.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.055+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa84c051070 con 0x7fa854017050 2024-09-13T19:16:19.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.055+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b8892a9890 con 0x55b8892a55f0 2024-09-13T19:16:19.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.055+0000 7fa865785640 1 -- 172.21.15.102:0/693201159 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa86000a4a0 con 0x55b8892a55f0 2024-09-13T19:16:19.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.055+0000 7fa865785640 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b8892a9890 con 0x55b8892a55f0 2024-09-13T19:16:19.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.055+0000 7fa865785640 1 -- 172.21.15.102:0/693201159 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa86000a4a0 con 0x55b8892a55f0 2024-09-13T19:16:19.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.055+0000 7fa865785640 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b8892a9890 con 0x55b8892a0be0 2024-09-13T19:16:19.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.055+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa84c051070 con 0x55b8892a0be0 2024-09-13T19:16:19.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.055+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b8892a9890 con 0x55b8892a0be0 2024-09-13T19:16:19.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.055+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa84c051070 con 0x55b8892a0be0 2024-09-13T19:16:19.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.055+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b8892a9890 con 0x7fa854017050 2024-09-13T19:16:19.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.056+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa84c051070 con 0x7fa854017050 2024-09-13T19:16:19.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.056+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b8892a9890 con 0x55b8892a55f0 2024-09-13T19:16:19.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.056+0000 7fa865785640 1 -- 172.21.15.102:0/693201159 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa86000a4a0 con 0x55b8892a55f0 2024-09-13T19:16:19.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.056+0000 7fa865785640 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b8892a9890 con 0x7fa8600123d0 2024-09-13T19:16:19.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.056+0000 7fa864f84640 1 -- 172.21.15.102:0/693201159 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa854018950 con 0x7fa8600123d0 2024-09-13T19:16:19.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.056+0000 7fa864f84640 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b8892a9890 con 0x55b8892a0be0 2024-09-13T19:16:19.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.056+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa84c051070 con 0x55b8892a0be0 2024-09-13T19:16:19.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.056+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b8892a9890 con 0x7fa854017050 2024-09-13T19:16:19.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.057+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa84c051070 con 0x7fa854017050 2024-09-13T19:16:19.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.057+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b8892a9890 con 0x55b8892a55f0 2024-09-13T19:16:19.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.057+0000 7fa865785640 1 -- 172.21.15.102:0/693201159 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa86000a4a0 con 0x55b8892a55f0 2024-09-13T19:16:19.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.057+0000 7fa865785640 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b8892a9890 con 0x7fa854017050 2024-09-13T19:16:19.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.057+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa84c051070 con 0x7fa854017050 2024-09-13T19:16:19.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.057+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa84c086040 con 0x7fa8600123d0 2024-09-13T19:16:19.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.057+0000 7fa864f84640 1 -- 172.21.15.102:0/693201159 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa854018950 con 0x7fa8600123d0 2024-09-13T19:16:19.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.057+0000 7fa864f84640 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa84c086040 con 0x55b8892a55f0 2024-09-13T19:16:19.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.058+0000 7fa865785640 1 -- 172.21.15.102:0/693201159 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa86000a4a0 con 0x55b8892a55f0 2024-09-13T19:16:19.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.058+0000 7fa865785640 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa84c086040 con 0x7fa854017050 2024-09-13T19:16:19.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.058+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa84c051070 con 0x7fa854017050 2024-09-13T19:16:19.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.058+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa84c086040 con 0x55b8892a0be0 2024-09-13T19:16:19.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.058+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa84c051070 con 0x55b8892a0be0 2024-09-13T19:16:19.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.058+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa84c086040 con 0x7fa8600123d0 2024-09-13T19:16:19.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.058+0000 7fa864f84640 1 -- 172.21.15.102:0/693201159 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa854018950 con 0x7fa8600123d0 2024-09-13T19:16:19.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.058+0000 7fa869810800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:19.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.058+0000 7fa869810800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:19.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.058+0000 7fa869810800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:19.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.058+0000 7fa869810800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:19.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.058+0000 7fa869810800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:19.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.058+0000 7fa869810800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:19.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.058+0000 7fa869810800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.058+0000 7fa869810800 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b8892a8990 con 0x55b8892a0be0 2024-09-13T19:16:19.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.059+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa84c051070 con 0x55b8892a0be0 2024-09-13T19:16:19.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.059+0000 7fa869810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:19.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.059+0000 7fa869810800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.059+0000 7fa869810800 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b8892a9230 con 0x55b8892a0be0 2024-09-13T19:16:19.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.059+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa84c051070 con 0x55b8892a0be0 2024-09-13T19:16:19.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.059+0000 7fa869810800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:19.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.059+0000 7fa869810800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.059+0000 7fa869810800 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b8892a85d0 con 0x55b8892a55f0 2024-09-13T19:16:19.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.059+0000 7fa865785640 1 -- 172.21.15.102:0/693201159 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa86000a4a0 con 0x55b8892a55f0 2024-09-13T19:16:19.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.059+0000 7fa869810800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:19.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.059+0000 7fa869810800 20 zone default found 2024-09-13T19:16:19.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.059+0000 7fa869810800 4 Realm: () 2024-09-13T19:16:19.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.059+0000 7fa869810800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:19.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.059+0000 7fa869810800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:19.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.059+0000 7fa869810800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:19.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.059+0000 7fa869810800 20 zonegroup default 2024-09-13T19:16:19.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.059+0000 7fa869810800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.059+0000 7fa869810800 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b8892aa210 con 0x7fa854017050 2024-09-13T19:16:19.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.059+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa84c051070 con 0x7fa854017050 2024-09-13T19:16:19.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.059+0000 7fa869810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:19.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.059+0000 7fa869810800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.059+0000 7fa869810800 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b8892abce0 con 0x55b8892a55f0 2024-09-13T19:16:19.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.060+0000 7fa865785640 1 -- 172.21.15.102:0/693201159 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa86000a4a0 con 0x55b8892a55f0 2024-09-13T19:16:19.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.060+0000 7fa869810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:19.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.060+0000 7fa869810800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.060+0000 7fa869810800 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b8892ac130 con 0x55b8892a55f0 2024-09-13T19:16:19.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.060+0000 7fa865785640 1 -- 172.21.15.102:0/693201159 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa86000a4a0 con 0x55b8892a55f0 2024-09-13T19:16:19.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.060+0000 7fa869810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:19.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.060+0000 7fa869810800 20 started sync module instance, tier type = 2024-09-13T19:16:19.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.060+0000 7fa869810800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:19.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.060+0000 7fa869810800 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b8892aabe0 con 0x7fa8600123d0 2024-09-13T19:16:19.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.061+0000 7fa864f84640 1 -- 172.21.15.102:0/693201159 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(44 notify.0 [create] v34'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa854018950 con 0x7fa8600123d0 2024-09-13T19:16:19.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.061+0000 7fa869810800 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94251063619536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b8892aa840 con 0x7fa8600123d0 2024-09-13T19:16:19.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.061+0000 7fa869810800 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b8892ad0a0 con 0x55b8892a0be0 2024-09-13T19:16:19.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.062+0000 7fa864f84640 1 -- 172.21.15.102:0/693201159 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94251063619536] v34'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa854018950 con 0x7fa8600123d0 2024-09-13T19:16:19.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.062+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v34'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa84c051070 con 0x55b8892a0be0 2024-09-13T19:16:19.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.062+0000 7fa869810800 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94251063625104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b8892ad490 con 0x55b8892a0be0 2024-09-13T19:16:19.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.062+0000 7fa869810800 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b8892adeb0 con 0x55b8892a55f0 2024-09-13T19:16:19.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.063+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94251063625104] v34'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa84c051070 con 0x55b8892a0be0 2024-09-13T19:16:19.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.064+0000 7fa865785640 1 -- 172.21.15.102:0/693201159 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v34'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa86000a4a0 con 0x55b8892a55f0 2024-09-13T19:16:19.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.064+0000 7fa869810800 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94251063630240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b8892ade70 con 0x55b8892a55f0 2024-09-13T19:16:19.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.064+0000 7fa869810800 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b8892ae940 con 0x7fa8600123d0 2024-09-13T19:16:19.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.065+0000 7fa864f84640 1 -- 172.21.15.102:0/693201159 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(50 notify.3 [create] v34'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa854018950 con 0x7fa8600123d0 2024-09-13T19:16:19.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.065+0000 7fa865785640 1 -- 172.21.15.102:0/693201159 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94251063630240] v34'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa86000a4a0 con 0x55b8892a55f0 2024-09-13T19:16:19.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.065+0000 7fa869810800 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94251063632960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b8892af1e0 con 0x7fa8600123d0 2024-09-13T19:16:19.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.065+0000 7fa869810800 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b8892acbd0 con 0x55b8892a0be0 2024-09-13T19:16:19.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.066+0000 7fa864f84640 1 -- 172.21.15.102:0/693201159 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94251063632960] v34'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa854018950 con 0x7fa8600123d0 2024-09-13T19:16:19.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.066+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v34'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa84c051070 con 0x55b8892a0be0 2024-09-13T19:16:19.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.066+0000 7fa869810800 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94251063635248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b8892afc50 con 0x55b8892a0be0 2024-09-13T19:16:19.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.066+0000 7fa869810800 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b8892b0610 con 0x7fa854017050 2024-09-13T19:16:19.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.067+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(54 notify.5 [create] v34'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa84c051070 con 0x7fa854017050 2024-09-13T19:16:19.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.067+0000 7fa869810800 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94251063640416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b8892b0a30 con 0x7fa854017050 2024-09-13T19:16:19.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.067+0000 7fa869810800 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b8892b1510 con 0x7fa854017050 2024-09-13T19:16:19.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.067+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94251063635248] v34'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa84c051070 con 0x55b8892a0be0 2024-09-13T19:16:19.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.068+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(56 notify.6 [create] v34'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa84c051070 con 0x7fa854017050 2024-09-13T19:16:19.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.068+0000 7fa869810800 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94251063637920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b8892b14d0 con 0x7fa854017050 2024-09-13T19:16:19.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.068+0000 7fa869810800 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b8892b1f30 con 0x7fa854017050 2024-09-13T19:16:19.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.068+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94251063640416] v34'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa84c051070 con 0x7fa854017050 2024-09-13T19:16:19.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.069+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(58 notify.7 [create] v34'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa84c051070 con 0x7fa854017050 2024-09-13T19:16:19.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.069+0000 7fa869810800 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94251063641472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b8892b1f30 con 0x7fa854017050 2024-09-13T19:16:19.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.069+0000 7fa869810800 20 add_watcher() i=0 2024-09-13T19:16:19.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.069+0000 7fa869810800 20 add_watcher() i=1 2024-09-13T19:16:19.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.069+0000 7fa869810800 20 add_watcher() i=2 2024-09-13T19:16:19.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.069+0000 7fa869810800 20 add_watcher() i=3 2024-09-13T19:16:19.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.069+0000 7fa869810800 20 add_watcher() i=4 2024-09-13T19:16:19.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.069+0000 7fa869810800 20 add_watcher() i=5 2024-09-13T19:16:19.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.069+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94251063637920] v34'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa84c051070 con 0x7fa854017050 2024-09-13T19:16:19.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.069+0000 7fa869810800 20 add_watcher() i=6 2024-09-13T19:16:19.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.070+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94251063641472] v34'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa84c051070 con 0x7fa854017050 2024-09-13T19:16:19.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.070+0000 7fa869810800 20 add_watcher() i=7 2024-09-13T19:16:19.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.070+0000 7fa869810800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:19.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.070+0000 7fa869810800 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b8892b1020 con 0x55b8892a0be0 2024-09-13T19:16:19.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.070+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa84c051070 con 0x55b8892a0be0 2024-09-13T19:16:19.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.070+0000 7fa869810800 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94251063646736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b8892b1020 con 0x55b8892a0be0 2024-09-13T19:16:19.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.071+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94251063646736] v34'108 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa84c051070 con 0x55b8892a0be0 2024-09-13T19:16:19.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.071+0000 7fa71afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:19.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.071+0000 7fa869810800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:19.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.071+0000 7fa869810800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:19.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.071+0000 7fa869810800 5 note: GC not initialized 2024-09-13T19:16:19.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.071+0000 7fa719fe3640 20 reqs_thread_entry: start 2024-09-13T19:16:19.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.071+0000 7fa869810800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:19.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.072+0000 7fa869810800 20 Filter name: none 2024-09-13T19:16:19.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.072+0000 7fa68b7fe640 20 reqs_thread_entry: start 2024-09-13T19:16:19.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.072+0000 7fa869810800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.072+0000 7fa869810800 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b8892e7d10 con 0x7fa8600123d0 2024-09-13T19:16:19.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.072+0000 7fa864f84640 1 -- 172.21.15.102:0/693201159 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(62 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv19 ondisk = 0) ==== 275+0+304 (crc 0 0 0) 0x7fa854018950 con 0x7fa8600123d0 2024-09-13T19:16:19.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.072+0000 7fa869810800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:16:19.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.073+0000 7fa71afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:19.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.073+0000 7fa869810800 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94251063646736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b8892e5b90 con 0x55b8892a0be0 2024-09-13T19:16:19.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.074+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94251063646736] v34'109 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa84c051070 con 0x55b8892a0be0 2024-09-13T19:16:19.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.074+0000 7fa869810800 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94251063619536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b8892e5b90 con 0x7fa8600123d0 2024-09-13T19:16:19.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.075+0000 7fa864f84640 1 -- 172.21.15.102:0/693201159 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94251063619536] v34'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa854018950 con 0x7fa8600123d0 2024-09-13T19:16:19.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.075+0000 7fa869810800 20 remove_watcher() i=0 2024-09-13T19:16:19.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.075+0000 7fa869810800 2 removed watcher, disabling cache 2024-09-13T19:16:19.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.075+0000 7fa869810800 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94251063625104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b8892e5b90 con 0x55b8892a0be0 2024-09-13T19:16:19.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.076+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94251063625104] v34'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa84c051070 con 0x55b8892a0be0 2024-09-13T19:16:19.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.076+0000 7fa869810800 20 remove_watcher() i=1 2024-09-13T19:16:19.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.076+0000 7fa869810800 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94251063630240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b8892e5b90 con 0x55b8892a55f0 2024-09-13T19:16:19.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.077+0000 7fa865785640 1 -- 172.21.15.102:0/693201159 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94251063630240] v34'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa86000a4a0 con 0x55b8892a55f0 2024-09-13T19:16:19.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.077+0000 7fa869810800 20 remove_watcher() i=2 2024-09-13T19:16:19.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.077+0000 7fa869810800 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94251063632960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b8892e5b90 con 0x7fa8600123d0 2024-09-13T19:16:19.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.078+0000 7fa864f84640 1 -- 172.21.15.102:0/693201159 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94251063632960] v34'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa854018950 con 0x7fa8600123d0 2024-09-13T19:16:19.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.078+0000 7fa869810800 20 remove_watcher() i=3 2024-09-13T19:16:19.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.078+0000 7fa869810800 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94251063635248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b8892e5b90 con 0x55b8892a0be0 2024-09-13T19:16:19.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.079+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94251063635248] v34'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa84c051070 con 0x55b8892a0be0 2024-09-13T19:16:19.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.079+0000 7fa869810800 20 remove_watcher() i=4 2024-09-13T19:16:19.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.079+0000 7fa869810800 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94251063640416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b8892e5b90 con 0x7fa854017050 2024-09-13T19:16:19.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.080+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94251063640416] v34'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa84c051070 con 0x7fa854017050 2024-09-13T19:16:19.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.080+0000 7fa869810800 20 remove_watcher() i=5 2024-09-13T19:16:19.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.080+0000 7fa869810800 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94251063637920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b8892e5b90 con 0x7fa854017050 2024-09-13T19:16:19.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.081+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94251063637920] v34'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa84c051070 con 0x7fa854017050 2024-09-13T19:16:19.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.081+0000 7fa869810800 20 remove_watcher() i=6 2024-09-13T19:16:19.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.081+0000 7fa869810800 1 -- 172.21.15.102:0/693201159 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94251063641472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b8892e5b90 con 0x7fa854017050 2024-09-13T19:16:19.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.082+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94251063641472] v34'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa84c051070 con 0x7fa854017050 2024-09-13T19:16:19.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.082+0000 7fa869810800 20 remove_watcher() i=7 2024-09-13T19:16:19.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.082+0000 7fa869810800 1 -- 172.21.15.102:0/693201159 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fa854017050 msgr2=0x7fa854044730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.082+0000 7fa869810800 1 --2- 172.21.15.102:0/693201159 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fa854017050 0x7fa854044730 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.082+0000 7fa869810800 1 -- 172.21.15.102:0/693201159 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55b8892a0be0 msgr2=0x55b8892a30a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.082+0000 7fa869810800 1 --2- 172.21.15.102:0/693201159 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55b8892a0be0 0x55b8892a30a0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.082+0000 7fa869810800 1 -- 172.21.15.102:0/693201159 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fa8600123d0 msgr2=0x7fa8600230c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.082+0000 7fa869810800 1 --2- 172.21.15.102:0/693201159 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fa8600123d0 0x7fa8600230c0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.082+0000 7fa869810800 1 -- 172.21.15.102:0/693201159 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55b8892a55f0 msgr2=0x55b8892a79e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.082+0000 7fa869810800 1 --2- 172.21.15.102:0/693201159 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55b8892a55f0 0x55b8892a79e0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.082+0000 7fa869810800 1 -- 172.21.15.102:0/693201159 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa730036b40 msgr2=0x7fa730039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.082+0000 7fa869810800 1 --2- 172.21.15.102:0/693201159 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa730036b40 0x7fa730039000 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa8540446c0 tx=0x7fa854031000 comp rx=0 tx=0).stop 2024-09-13T19:16:19.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.082+0000 7fa869810800 1 -- 172.21.15.102:0/693201159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8890e2fc0 msgr2=0x55b8892953e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.082+0000 7fa85c783640 1 -- 172.21.15.102:0/693201159 reap_dead start 2024-09-13T19:16:19.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.082+0000 7fa869810800 1 --2- 172.21.15.102:0/693201159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8890e2fc0 0x55b8892953e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa860012fd0 tx=0x7fa86004cd10 comp rx=0 tx=0).stop 2024-09-13T19:16:19.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.082+0000 7fa869810800 1 -- 172.21.15.102:0/693201159 shutdown_connections 2024-09-13T19:16:19.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.082+0000 7fa869810800 1 --2- 172.21.15.102:0/693201159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8890e2fc0 0x55b8892953e0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.082+0000 7fa869810800 1 -- 172.21.15.102:0/693201159 >> 172.21.15.102:0/693201159 conn(0x55b8892880a0 msgr2=0x55b889286170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:19.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.082+0000 7fa869810800 1 -- 172.21.15.102:0/693201159 shutdown_connections 2024-09-13T19:16:19.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.082+0000 7fa869810800 1 -- 172.21.15.102:0/693201159 wait complete. 2024-09-13T19:16:19.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.083+0000 7fa869810800 1 -- 172.21.15.102:0/1075852509 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa73c036b40 msgr2=0x7fa73c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.083+0000 7fa869810800 1 --2- 172.21.15.102:0/1075852509 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa73c036b40 0x7fa73c039000 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x55b88926ca00 tx=0x7fa85404b030 comp rx=0 tx=0).stop 2024-09-13T19:16:19.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.083+0000 7fa869810800 1 -- 172.21.15.102:0/1075852509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b88927efd0 msgr2=0x55b88927f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.083+0000 7fa869810800 1 --2- 172.21.15.102:0/1075852509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b88927efd0 0x55b88927f3f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x55b889265340 tx=0x7fa8600167b0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.083+0000 7fa869810800 1 -- 172.21.15.102:0/1075852509 shutdown_connections 2024-09-13T19:16:19.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.083+0000 7fa869810800 1 --2- 172.21.15.102:0/1075852509 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa73c036b40 0x7fa73c039000 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.083+0000 7fa869810800 1 --2- 172.21.15.102:0/1075852509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b88927efd0 0x55b88927f3f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.083+0000 7fa869810800 1 -- 172.21.15.102:0/1075852509 >> 172.21.15.102:0/1075852509 conn(0x55b889273f60 msgr2=0x55b889276ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:19.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.083+0000 7fa869810800 1 -- 172.21.15.102:0/1075852509 shutdown_connections 2024-09-13T19:16:19.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.083+0000 7fa869810800 1 -- 172.21.15.102:0/1075852509 wait complete. 2024-09-13T19:16:19.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.083+0000 7fa869810800 1 -- 172.21.15.102:0/3859644248 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55b889171a60 msgr2=0x55b88926b300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.083+0000 7fa869810800 1 --2- 172.21.15.102:0/3859644248 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55b889171a60 0x55b88926b300 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.083+0000 7fa869810800 1 -- 172.21.15.102:0/3859644248 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55b88926db90 msgr2=0x55b88926ff80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.083+0000 7fa869810800 1 --2- 172.21.15.102:0/3859644248 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55b88926db90 0x55b88926ff80 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.083+0000 7fa869810800 1 -- 172.21.15.102:0/3859644248 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa74c036be0 msgr2=0x7fa74c0390a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.083+0000 7fa869810800 1 --2- 172.21.15.102:0/3859644248 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa74c036be0 0x7fa74c0390a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa84c057000 tx=0x7fa84c052000 comp rx=0 tx=0).stop 2024-09-13T19:16:19.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.083+0000 7fa869810800 1 -- 172.21.15.102:0/3859644248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b88916d760 msgr2=0x55b889264290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.083+0000 7fa869810800 1 --2- 172.21.15.102:0/3859644248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b88916d760 0x55b889264290 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa85400b7c0 tx=0x7fa854000ed0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.083+0000 7fa869810800 1 -- 172.21.15.102:0/3859644248 shutdown_connections 2024-09-13T19:16:19.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.083+0000 7fa869810800 1 --2- 172.21.15.102:0/3859644248 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55b88926db90 0x55b88926ff80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.083+0000 7fa869810800 1 --2- 172.21.15.102:0/3859644248 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55b889171a60 0x55b88926b300 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.083+0000 7fa869810800 1 --2- 172.21.15.102:0/3859644248 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa74c036be0 0x7fa74c0390a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.083+0000 7fa869810800 1 --2- 172.21.15.102:0/3859644248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b88916d760 0x55b889264290 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.083+0000 7fa869810800 1 -- 172.21.15.102:0/3859644248 >> 172.21.15.102:0/3859644248 conn(0x55b889168ff0 msgr2=0x55b889256ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:19.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.083+0000 7fa869810800 1 -- 172.21.15.102:0/3859644248 shutdown_connections 2024-09-13T19:16:19.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.083+0000 7fa869810800 1 -- 172.21.15.102:0/3859644248 wait complete. 2024-09-13T19:16:19.098 INFO:teuthology.orchestra.run.smithi102.stdout:{"key":"bucket:myfoo","ver":{"tag":"_63r5Uerf2wJvIqszRU92rkg","ver":2},"mtime":"2024-09-13T19:16:18.787129Z","data":{"bucket":{"name":"myfoo","marker":"509740b4-c081-4f37-bd6d-df9ca851489b.4237.1","bucket_id":"509740b4-c081-4f37-bd6d-df9ca851489b.4237.1","tenant":"","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"foo","creation_time":"2024-09-13T19:16:17.492008Z","linked":false,"has_bucket_info":false}} 2024-09-13T19:16:19.099 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_63r5Uerf2wJvIqszRU92rkg', 'ver': 2}, 'mtime': '2024-09-13T19:16:18.787129Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '509740b4-c081-4f37-bd6d-df9ca851489b.4237.1', 'bucket_id': '509740b4-c081-4f37-bd6d-df9ca851489b.4237.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2024-09-13T19:16:17.492008Z', 'linked': False, 'has_bucket_info': False}} 2024-09-13T19:16:19.099 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '509740b4-c081-4f37-bd6d-df9ca851489b.4237.1'] 2024-09-13T19:16:19.099 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '509740b4-c081-4f37-bd6d-df9ca851489b.4237.1'] 2024-09-13T19:16:19.099 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id 509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 2024-09-13T19:16:19.188 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:19.188 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:19.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.185+0000 7fc514087800 1 Processor -- start 2024-09-13T19:16:19.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.185+0000 7fc514087800 1 -- start start 2024-09-13T19:16:19.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.186+0000 7fc514087800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55a28289d880 0x55a28289fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.186+0000 7fc514087800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a282758b30 con 0x55a28280ceb0 2024-09-13T19:16:19.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.186+0000 7fc514087800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55a28273a360 con 0x55a28289d880 2024-09-13T19:16:19.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.186+0000 7fc51137a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55a28289d880 0x55a28289fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.186+0000 7fc51137a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55a28289d880 0x55a28289fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55464/0 (socket says 172.21.15.102:55464) 2024-09-13T19:16:19.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.186+0000 7fc51137a640 1 -- 172.21.15.102:0/2258074134 learned_addr learned my addr 172.21.15.102:0/2258074134 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:19.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.186+0000 7fc511b7b640 1 --1- 172.21.15.102:0/2258074134 >> v1:172.21.15.53:6789/0 conn(0x55a28280ceb0 0x55a28289c160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:50010/0 (socket says 172.21.15.102:50010) 2024-09-13T19:16:19.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.186+0000 7fc51137a640 1 -- 172.21.15.102:0/2258074134 >> v1:172.21.15.53:6789/0 conn(0x55a28280ceb0 legacy=0x55a28289c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.186+0000 7fc51137a640 1 -- 172.21.15.102:0/2258074134 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a282760e00 con 0x55a28289d880 2024-09-13T19:16:19.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.188+0000 7fc51137a640 1 --2- 172.21.15.102:0/2258074134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a28289d880 0x55a28289fc90 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc50800a520 tx=0x7fc508045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89f17ea0739d14ef server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.188+0000 7fc510b79640 1 -- 172.21.15.102:0/2258074134 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc508055070 con 0x55a28289d880 2024-09-13T19:16:19.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.188+0000 7fc510b79640 1 -- 172.21.15.102:0/2258074134 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5080515b0 con 0x55a28289d880 2024-09-13T19:16:19.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.188+0000 7fc510b79640 1 -- 172.21.15.102:0/2258074134 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5080518d0 con 0x55a28289d880 2024-09-13T19:16:19.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.188+0000 7fc514087800 1 -- 172.21.15.102:0/2258074134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a28289d880 msgr2=0x55a28289fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.188+0000 7fc514087800 1 --2- 172.21.15.102:0/2258074134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a28289d880 0x55a28289fc90 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc50800a520 tx=0x7fc508045ba0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.189+0000 7fc514087800 1 -- 172.21.15.102:0/2258074134 shutdown_connections 2024-09-13T19:16:19.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.189+0000 7fc514087800 1 --2- 172.21.15.102:0/2258074134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a28289d880 0x55a28289fc90 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.189+0000 7fc514087800 1 -- 172.21.15.102:0/2258074134 >> 172.21.15.102:0/2258074134 conn(0x55a282893e10 msgr2=0x55a282896230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:19.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.189+0000 7fc514087800 1 -- 172.21.15.102:0/2258074134 shutdown_connections 2024-09-13T19:16:19.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.189+0000 7fc514087800 1 -- 172.21.15.102:0/2258074134 wait complete. 2024-09-13T19:16:19.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.202+0000 7fc514087800 1 Processor -- start 2024-09-13T19:16:19.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.202+0000 7fc514087800 1 -- start start 2024-09-13T19:16:19.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.203+0000 7fc514087800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a28280ceb0 0x55a282988950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.203+0000 7fc514087800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a2827e5350 con 0x55a28280ceb0 2024-09-13T19:16:19.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.203+0000 7fc511b7b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a28280ceb0 0x55a282988950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.203+0000 7fc511b7b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a28280ceb0 0x55a282988950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55472/0 (socket says 172.21.15.102:55472) 2024-09-13T19:16:19.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.203+0000 7fc511b7b640 1 -- 172.21.15.102:0/59503990 learned_addr learned my addr 172.21.15.102:0/59503990 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:19.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.203+0000 7fc511b7b640 1 -- 172.21.15.102:0/59503990 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a282732bc0 con 0x55a28280ceb0 2024-09-13T19:16:19.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.204+0000 7fc511b7b640 1 --2- 172.21.15.102:0/59503990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a28280ceb0 0x55a282988950 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc50400b230 tx=0x7fc50400b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81a72d2f06746d1f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.204+0000 7fc3ffe07640 1 -- 172.21.15.102:0/59503990 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc50400e5c0 con 0x55a28280ceb0 2024-09-13T19:16:19.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.204+0000 7fc3ffe07640 1 -- 172.21.15.102:0/59503990 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc504006070 con 0x55a28280ceb0 2024-09-13T19:16:19.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.204+0000 7fc3ffe07640 1 -- 172.21.15.102:0/59503990 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc50400e890 con 0x55a28280ceb0 2024-09-13T19:16:19.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.204+0000 7fc514087800 1 -- 172.21.15.102:0/59503990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a28280ceb0 msgr2=0x55a282988950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.204+0000 7fc514087800 1 --2- 172.21.15.102:0/59503990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a28280ceb0 0x55a282988950 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc50400b230 tx=0x7fc50400b6f0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.204+0000 7fc514087800 1 -- 172.21.15.102:0/59503990 shutdown_connections 2024-09-13T19:16:19.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.204+0000 7fc514087800 1 --2- 172.21.15.102:0/59503990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a28280ceb0 0x55a282988950 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.204+0000 7fc514087800 1 -- 172.21.15.102:0/59503990 >> 172.21.15.102:0/59503990 conn(0x55a282893e10 msgr2=0x55a282984310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:19.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.204+0000 7fc514087800 1 -- 172.21.15.102:0/59503990 shutdown_connections 2024-09-13T19:16:19.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.204+0000 7fc514087800 1 -- 172.21.15.102:0/59503990 wait complete. 2024-09-13T19:16:19.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.205+0000 7fc514087800 1 Processor -- start 2024-09-13T19:16:19.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.205+0000 7fc514087800 1 -- start start 2024-09-13T19:16:19.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.205+0000 7fc514087800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a28280ceb0 0x55a282990360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.205+0000 7fc514087800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a2828a0610 con 0x55a28280ceb0 2024-09-13T19:16:19.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.205+0000 7fc511b7b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a28280ceb0 0x55a282990360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.205+0000 7fc511b7b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a28280ceb0 0x55a282990360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55476/0 (socket says 172.21.15.102:55476) 2024-09-13T19:16:19.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.205+0000 7fc511b7b640 1 -- 172.21.15.102:0/3726726239 learned_addr learned my addr 172.21.15.102:0/3726726239 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:19.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.205+0000 7fc511b7b640 1 -- 172.21.15.102:0/3726726239 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a282746fe0 con 0x55a28280ceb0 2024-09-13T19:16:19.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.206+0000 7fc511b7b640 1 --2- 172.21.15.102:0/3726726239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a28280ceb0 0x55a282990360 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc504000fd0 tx=0x7fc504000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.206+0000 7fc3fe604640 1 -- 172.21.15.102:0/3726726239 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc50400f8d0 con 0x55a28280ceb0 2024-09-13T19:16:19.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.206+0000 7fc3fe604640 1 -- 172.21.15.102:0/3726726239 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc50400fa90 con 0x55a28280ceb0 2024-09-13T19:16:19.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.206+0000 7fc514087800 1 -- 172.21.15.102:0/3726726239 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a2829908a0 con 0x55a28280ceb0 2024-09-13T19:16:19.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.206+0000 7fc3fe604640 1 -- 172.21.15.102:0/3726726239 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc50400fdb0 con 0x55a28280ceb0 2024-09-13T19:16:19.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.206+0000 7fc514087800 1 -- 172.21.15.102:0/3726726239 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a282990dc0 con 0x55a28280ceb0 2024-09-13T19:16:19.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.206+0000 7fc3fe604640 1 -- 172.21.15.102:0/3726726239 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc504017070 con 0x55a28280ceb0 2024-09-13T19:16:19.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.207+0000 7fc3fe604640 1 --2- 172.21.15.102:0/3726726239 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc3f8036b90 0x7fc3f8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.207+0000 7fc3fe604640 1 -- 172.21.15.102:0/3726726239 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fc504015020 con 0x55a28280ceb0 2024-09-13T19:16:19.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.207+0000 7fc51137a640 1 --2- 172.21.15.102:0/3726726239 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc3f8036b90 0x7fc3f8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.207+0000 7fc514087800 1 --2- 172.21.15.102:0/3726726239 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55a28289d880 0x55a2829973d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.207+0000 7fc514087800 1 -- 172.21.15.102:0/3726726239 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a282997910 con 0x55a28289d880 2024-09-13T19:16:19.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.207+0000 7fc51237c640 1 --2- 172.21.15.102:0/3726726239 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55a28289d880 0x55a2829973d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.207+0000 7fc51137a640 1 --2- 172.21.15.102:0/3726726239 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc3f8036b90 0x7fc3f8039050 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc508057000 tx=0x7fc508052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.207+0000 7fc51237c640 1 --2- 172.21.15.102:0/3726726239 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55a28289d880 0x55a2829973d0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.208+0000 7fc51237c640 1 -- 172.21.15.102:0/3726726239 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc50c00a4a0 con 0x55a28289d880 2024-09-13T19:16:19.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.208+0000 7fc514087800 1 -- 172.21.15.102:0/3726726239 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2829949a0 con 0x55a28289d880 2024-09-13T19:16:19.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.208+0000 7fc51237c640 1 -- 172.21.15.102:0/3726726239 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc50c00a4a0 con 0x55a28289d880 2024-09-13T19:16:19.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.208+0000 7fc514087800 1 --2- 172.21.15.102:0/3726726239 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55a282999c20 0x55a28299c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.208+0000 7fc514087800 1 -- 172.21.15.102:0/3726726239 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a28299c700 con 0x55a282999c20 2024-09-13T19:16:19.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.208+0000 7fc511b7b640 1 --2- 172.21.15.102:0/3726726239 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55a282999c20 0x55a28299c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.208+0000 7fc511b7b640 1 --2- 172.21.15.102:0/3726726239 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55a282999c20 0x55a28299c010 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.209+0000 7fc511b7b640 1 -- 172.21.15.102:0/3726726239 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc50402e070 con 0x55a282999c20 2024-09-13T19:16:19.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.209+0000 7fc514087800 1 -- 172.21.15.102:0/3726726239 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a282998ac0 con 0x55a28289d880 2024-09-13T19:16:19.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.209+0000 7fc51237c640 1 -- 172.21.15.102:0/3726726239 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc50c00a4a0 con 0x55a28289d880 2024-09-13T19:16:19.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.209+0000 7fc514087800 1 -- 172.21.15.102:0/3726726239 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a282998fa0 con 0x55a282999c20 2024-09-13T19:16:19.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.209+0000 7fc511b7b640 1 -- 172.21.15.102:0/3726726239 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc50402e070 con 0x55a282999c20 2024-09-13T19:16:19.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.209+0000 7fc514087800 1 Processor -- start 2024-09-13T19:16:19.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.210+0000 7fc514087800 1 -- start start 2024-09-13T19:16:19.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.210+0000 7fc514087800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2829ab0a0 0x55a2829ab4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.210+0000 7fc514087800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a282734580 con 0x55a2829ab0a0 2024-09-13T19:16:19.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.210+0000 7fc51237c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2829ab0a0 0x55a2829ab4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.210+0000 7fc51237c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2829ab0a0 0x55a2829ab4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55490/0 (socket says 172.21.15.102:55490) 2024-09-13T19:16:19.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.210+0000 7fc51237c640 1 -- 172.21.15.102:0/564878721 learned_addr learned my addr 172.21.15.102:0/564878721 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:19.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.210+0000 7fc51237c640 1 -- 172.21.15.102:0/564878721 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2829aba00 con 0x55a2829ab0a0 2024-09-13T19:16:19.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.210+0000 7fc51237c640 1 --2- 172.21.15.102:0/564878721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2829ab0a0 0x55a2829ab4c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x55a282997cd0 tx=0x7fc50c0163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.211+0000 7fc3f77fe640 1 -- 172.21.15.102:0/564878721 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc50c013450 con 0x55a2829ab0a0 2024-09-13T19:16:19.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.211+0000 7fc3f77fe640 1 -- 172.21.15.102:0/564878721 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc50c0135f0 con 0x55a2829ab0a0 2024-09-13T19:16:19.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.211+0000 7fc514087800 1 -- 172.21.15.102:0/564878721 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a2829abc90 con 0x55a2829ab0a0 2024-09-13T19:16:19.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.211+0000 7fc3f77fe640 1 -- 172.21.15.102:0/564878721 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc50c0138d0 con 0x55a2829ab0a0 2024-09-13T19:16:19.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.211+0000 7fc514087800 1 -- 172.21.15.102:0/564878721 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2829ae970 con 0x55a2829ab0a0 2024-09-13T19:16:19.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.211+0000 7fc3f77fe640 1 -- 172.21.15.102:0/564878721 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc50c011040 con 0x55a2829ab0a0 2024-09-13T19:16:19.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.212+0000 7fc3f77fe640 1 --2- 172.21.15.102:0/564878721 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc3ec036b90 0x7fc3ec039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.212+0000 7fc3f77fe640 1 -- 172.21.15.102:0/564878721 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fc50c00e040 con 0x55a2829ab0a0 2024-09-13T19:16:19.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.212+0000 7fc511b7b640 1 --2- 172.21.15.102:0/564878721 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc3ec036b90 0x7fc3ec039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.212+0000 7fc514087800 1 Processor -- start 2024-09-13T19:16:19.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.212+0000 7fc511b7b640 1 --2- 172.21.15.102:0/564878721 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc3ec036b90 0x7fc3ec039050 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc50404b760 tx=0x7fc50404b630 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.212+0000 7fc514087800 1 -- start start 2024-09-13T19:16:19.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.212+0000 7fc514087800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2829b7d40 0x55a2829b8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.212+0000 7fc514087800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a282989100 con 0x55a2829b7d40 2024-09-13T19:16:19.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.212+0000 7fc51237c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2829b7d40 0x55a2829b8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.212+0000 7fc51237c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2829b7d40 0x55a2829b8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55504/0 (socket says 172.21.15.102:55504) 2024-09-13T19:16:19.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.212+0000 7fc51237c640 1 -- 172.21.15.102:0/915407997 learned_addr learned my addr 172.21.15.102:0/915407997 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:19.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.212+0000 7fc51237c640 1 -- 172.21.15.102:0/915407997 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2829b8710 con 0x55a2829b7d40 2024-09-13T19:16:19.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.213+0000 7fc51237c640 1 --2- 172.21.15.102:0/915407997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2829b7d40 0x55a2829b8140 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc50c014e60 tx=0x7fc50c014f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9ffab9398b8275b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.213+0000 7fc3f57fa640 1 -- 172.21.15.102:0/915407997 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc50c02a980 con 0x55a2829b7d40 2024-09-13T19:16:19.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.213+0000 7fc3f57fa640 1 -- 172.21.15.102:0/915407997 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc50c02a440 con 0x55a2829b7d40 2024-09-13T19:16:19.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.213+0000 7fc3f57fa640 1 -- 172.21.15.102:0/915407997 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc50c02ab20 con 0x55a2829b7d40 2024-09-13T19:16:19.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.213+0000 7fc514087800 1 -- 172.21.15.102:0/915407997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2829b7d40 msgr2=0x55a2829b8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.213+0000 7fc514087800 1 --2- 172.21.15.102:0/915407997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2829b7d40 0x55a2829b8140 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc50c014e60 tx=0x7fc50c014f50 comp rx=0 tx=0).stop 2024-09-13T19:16:19.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.213+0000 7fc514087800 1 -- 172.21.15.102:0/915407997 shutdown_connections 2024-09-13T19:16:19.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.213+0000 7fc514087800 1 --2- 172.21.15.102:0/915407997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2829b7d40 0x55a2829b8140 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.213+0000 7fc514087800 1 -- 172.21.15.102:0/915407997 >> 172.21.15.102:0/915407997 conn(0x55a2829b40a0 msgr2=0x55a2829b21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:19.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.213+0000 7fc514087800 1 -- 172.21.15.102:0/915407997 shutdown_connections 2024-09-13T19:16:19.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.213+0000 7fc514087800 1 -- 172.21.15.102:0/915407997 wait complete. 2024-09-13T19:16:19.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.214+0000 7fc514087800 1 Processor -- start 2024-09-13T19:16:19.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.214+0000 7fc514087800 1 -- start start 2024-09-13T19:16:19.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.214+0000 7fc514087800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2829b7d40 0x55a2829bf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.214+0000 7fc514087800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a2829b8ce0 con 0x55a2829b7d40 2024-09-13T19:16:19.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.214+0000 7fc51237c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2829b7d40 0x55a2829bf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.214+0000 7fc51237c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2829b7d40 0x55a2829bf1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55514/0 (socket says 172.21.15.102:55514) 2024-09-13T19:16:19.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.214+0000 7fc51237c640 1 -- 172.21.15.102:0/446582042 learned_addr learned my addr 172.21.15.102:0/446582042 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:19.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.214+0000 7fc51237c640 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2829bf730 con 0x55a2829b7d40 2024-09-13T19:16:19.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.214+0000 7fc51237c640 1 --2- 172.21.15.102:0/446582042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2829b7d40 0x55a2829bf1f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc50c014e60 tx=0x7fc50c04cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.214+0000 7fc3e37fe640 1 -- 172.21.15.102:0/446582042 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc50c013a70 con 0x55a2829b7d40 2024-09-13T19:16:19.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.214+0000 7fc3e37fe640 1 -- 172.21.15.102:0/446582042 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc50c013c10 con 0x55a2829b7d40 2024-09-13T19:16:19.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.214+0000 7fc3e37fe640 1 -- 172.21.15.102:0/446582042 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc50c0143c0 con 0x55a2829b7d40 2024-09-13T19:16:19.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.214+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a2829bf9c0 con 0x55a2829b7d40 2024-09-13T19:16:19.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.215+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2829c2670 con 0x55a2829b7d40 2024-09-13T19:16:19.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.215+0000 7fc3e37fe640 1 -- 172.21.15.102:0/446582042 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc50c03b060 con 0x55a2829b7d40 2024-09-13T19:16:19.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.215+0000 7fc3e37fe640 1 --2- 172.21.15.102:0/446582042 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc3dc036b90 0x7fc3dc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.215+0000 7fc3e37fe640 1 -- 172.21.15.102:0/446582042 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fc50c035c30 con 0x55a2829b7d40 2024-09-13T19:16:19.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.216+0000 7fc511b7b640 1 --2- 172.21.15.102:0/446582042 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc3dc036b90 0x7fc3dc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.216+0000 7fc511b7b640 1 --2- 172.21.15.102:0/446582042 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc3dc036b90 0x7fc3dc039050 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc50400ff70 tx=0x7fc50404d000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.216+0000 7fc514087800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.216+0000 7fc514087800 1 --2- 172.21.15.102:0/446582042 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55a2829caeb0 0x55a2829cd370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.216+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2829cdac0 con 0x55a2829caeb0 2024-09-13T19:16:19.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.216+0000 7fc51137a640 1 --2- 172.21.15.102:0/446582042 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55a2829caeb0 0x55a2829cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.217+0000 7fc51137a640 1 --2- 172.21.15.102:0/446582042 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55a2829caeb0 0x55a2829cd370 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.217+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc508057030 con 0x55a2829caeb0 2024-09-13T19:16:19.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.217+0000 7fc514087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:19.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.217+0000 7fc514087800 20 realm 2024-09-13T19:16:19.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.217+0000 7fc514087800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.217+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2829cdef0 con 0x55a2829caeb0 2024-09-13T19:16:19.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.217+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc508057030 con 0x55a2829caeb0 2024-09-13T19:16:19.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.217+0000 7fc514087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:19.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.217+0000 7fc514087800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:19.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.217+0000 7fc514087800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.217+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2829ce7c0 con 0x55a2829caeb0 2024-09-13T19:16:19.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.217+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc508057030 con 0x55a2829caeb0 2024-09-13T19:16:19.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.217+0000 7fc514087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:19.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.217+0000 7fc514087800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.217+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2829ceb60 con 0x55a2829caeb0 2024-09-13T19:16:19.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.217+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc508057030 con 0x55a2829caeb0 2024-09-13T19:16:19.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.217+0000 7fc514087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:19.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.218+0000 7fc514087800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.218+0000 7fc514087800 1 --2- 172.21.15.102:0/446582042 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55a2829cf8c0 0x55a2829d1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.218+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2829d22c0 con 0x55a2829cf8c0 2024-09-13T19:16:19.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.218+0000 7fc51237c640 1 --2- 172.21.15.102:0/446582042 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55a2829cf8c0 0x55a2829d1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.218+0000 7fc51237c640 1 --2- 172.21.15.102:0/446582042 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55a2829cf8c0 0x55a2829d1cb0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.218+0000 7fc51237c640 1 -- 172.21.15.102:0/446582042 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc50c027020 con 0x55a2829cf8c0 2024-09-13T19:16:19.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.218+0000 7fc514087800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:19.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.218+0000 7fc514087800 20 searching for the correct realm 2024-09-13T19:16:19.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.218+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2829d3c10 con 0x55a2829cf8c0 2024-09-13T19:16:19.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.218+0000 7fc51237c640 1 -- 172.21.15.102:0/446582042 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc50c027020 con 0x55a2829cf8c0 2024-09-13T19:16:19.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.218+0000 7fc51237c640 1 --2- 172.21.15.102:0/446582042 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fc50c044050 0x7fc50c04eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.218+0000 7fc51237c640 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2829d3c10 con 0x7fc50c044050 2024-09-13T19:16:19.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.219+0000 7fc511b7b640 1 --2- 172.21.15.102:0/446582042 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fc50c044050 0x7fc50c04eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.219+0000 7fc511b7b640 1 --2- 172.21.15.102:0/446582042 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fc50c044050 0x7fc50c04eab0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.219+0000 7fc511b7b640 1 -- 172.21.15.102:0/446582042 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc50402e070 con 0x7fc50c044050 2024-09-13T19:16:19.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.219+0000 7fc511b7b640 1 --2- 172.21.15.102:0/446582042 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fc50400f070 0x7fc504019860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.219+0000 7fc511b7b640 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2829d3c10 con 0x7fc50400f070 2024-09-13T19:16:19.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.219+0000 7fc51137a640 1 --2- 172.21.15.102:0/446582042 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fc50400f070 0x7fc504019860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.220+0000 7fc51137a640 1 --2- 172.21.15.102:0/446582042 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fc50400f070 0x7fc504019860 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.220+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc508057030 con 0x7fc50400f070 2024-09-13T19:16:19.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.220+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2829d3c10 con 0x55a2829caeb0 2024-09-13T19:16:19.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.220+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc508057030 con 0x55a2829caeb0 2024-09-13T19:16:19.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.220+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2829d3c10 con 0x55a2829caeb0 2024-09-13T19:16:19.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.220+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc508057030 con 0x55a2829caeb0 2024-09-13T19:16:19.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.220+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2829d3c10 con 0x7fc50400f070 2024-09-13T19:16:19.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.221+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc508057030 con 0x7fc50400f070 2024-09-13T19:16:19.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.221+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2829d3c10 con 0x7fc50400f070 2024-09-13T19:16:19.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.221+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc508057030 con 0x7fc50400f070 2024-09-13T19:16:19.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.221+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2829d3c10 con 0x7fc50c044050 2024-09-13T19:16:19.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.221+0000 7fc511b7b640 1 -- 172.21.15.102:0/446582042 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc50402e070 con 0x7fc50c044050 2024-09-13T19:16:19.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.221+0000 7fc511b7b640 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2829d3c10 con 0x55a2829cf8c0 2024-09-13T19:16:19.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.221+0000 7fc51237c640 1 -- 172.21.15.102:0/446582042 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc50c027020 con 0x55a2829cf8c0 2024-09-13T19:16:19.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.221+0000 7fc51237c640 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2829d3c10 con 0x55a2829caeb0 2024-09-13T19:16:19.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.222+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc508057030 con 0x55a2829caeb0 2024-09-13T19:16:19.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.222+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2829d3c10 con 0x7fc50400f070 2024-09-13T19:16:19.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.222+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc508057030 con 0x7fc50400f070 2024-09-13T19:16:19.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.222+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2829d3c10 con 0x55a2829caeb0 2024-09-13T19:16:19.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.222+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc508057030 con 0x55a2829caeb0 2024-09-13T19:16:19.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.222+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2829d3c10 con 0x7fc50c044050 2024-09-13T19:16:19.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.222+0000 7fc511b7b640 1 -- 172.21.15.102:0/446582042 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc50402e070 con 0x7fc50c044050 2024-09-13T19:16:19.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.222+0000 7fc511b7b640 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2829d3c10 con 0x55a2829cf8c0 2024-09-13T19:16:19.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.223+0000 7fc51237c640 1 -- 172.21.15.102:0/446582042 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc50c027020 con 0x55a2829cf8c0 2024-09-13T19:16:19.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.223+0000 7fc51237c640 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2829d3c10 con 0x55a2829cf8c0 2024-09-13T19:16:19.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.223+0000 7fc51237c640 1 -- 172.21.15.102:0/446582042 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc50c027020 con 0x55a2829cf8c0 2024-09-13T19:16:19.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.223+0000 7fc51237c640 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2829d3c10 con 0x7fc50400f070 2024-09-13T19:16:19.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.223+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc508057030 con 0x7fc50400f070 2024-09-13T19:16:19.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.223+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2829d3c10 con 0x55a2829cf8c0 2024-09-13T19:16:19.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.223+0000 7fc51237c640 1 -- 172.21.15.102:0/446582042 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc50c027020 con 0x55a2829cf8c0 2024-09-13T19:16:19.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.223+0000 7fc51237c640 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2829d3c10 con 0x55a2829cf8c0 2024-09-13T19:16:19.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.224+0000 7fc51237c640 1 -- 172.21.15.102:0/446582042 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc50c027020 con 0x55a2829cf8c0 2024-09-13T19:16:19.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.224+0000 7fc51237c640 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2829d3c10 con 0x55a2829caeb0 2024-09-13T19:16:19.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.224+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc508057030 con 0x55a2829caeb0 2024-09-13T19:16:19.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.224+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2829d3c10 con 0x55a2829caeb0 2024-09-13T19:16:19.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.224+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc508057030 con 0x55a2829caeb0 2024-09-13T19:16:19.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.224+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2829d3c10 con 0x7fc50400f070 2024-09-13T19:16:19.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.224+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc508057030 con 0x7fc50400f070 2024-09-13T19:16:19.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.224+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2829d3c10 con 0x55a2829cf8c0 2024-09-13T19:16:19.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.225+0000 7fc51237c640 1 -- 172.21.15.102:0/446582042 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc50c027020 con 0x55a2829cf8c0 2024-09-13T19:16:19.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.225+0000 7fc51237c640 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2829d3c10 con 0x7fc50c044050 2024-09-13T19:16:19.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.225+0000 7fc511b7b640 1 -- 172.21.15.102:0/446582042 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc50402e070 con 0x7fc50c044050 2024-09-13T19:16:19.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.225+0000 7fc511b7b640 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2829d3c10 con 0x55a2829caeb0 2024-09-13T19:16:19.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.225+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc508057030 con 0x55a2829caeb0 2024-09-13T19:16:19.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.225+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2829d3c10 con 0x7fc50400f070 2024-09-13T19:16:19.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.225+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc508057030 con 0x7fc50400f070 2024-09-13T19:16:19.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.225+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2829d3c10 con 0x55a2829cf8c0 2024-09-13T19:16:19.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.226+0000 7fc51237c640 1 -- 172.21.15.102:0/446582042 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc50c027020 con 0x55a2829cf8c0 2024-09-13T19:16:19.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.226+0000 7fc51237c640 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2829d3c10 con 0x7fc50400f070 2024-09-13T19:16:19.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.226+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc508057030 con 0x7fc50400f070 2024-09-13T19:16:19.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.226+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2829d3c10 con 0x7fc50c044050 2024-09-13T19:16:19.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.226+0000 7fc511b7b640 1 -- 172.21.15.102:0/446582042 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc50402e070 con 0x7fc50c044050 2024-09-13T19:16:19.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.226+0000 7fc511b7b640 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2829d3c10 con 0x55a2829cf8c0 2024-09-13T19:16:19.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.226+0000 7fc51237c640 1 -- 172.21.15.102:0/446582042 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc50c027020 con 0x55a2829cf8c0 2024-09-13T19:16:19.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.226+0000 7fc51237c640 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2829d3c10 con 0x7fc50400f070 2024-09-13T19:16:19.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.227+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc508057030 con 0x7fc50400f070 2024-09-13T19:16:19.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.227+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2829d3c10 con 0x55a2829caeb0 2024-09-13T19:16:19.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.227+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc508057030 con 0x55a2829caeb0 2024-09-13T19:16:19.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.227+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc50808a080 con 0x7fc50c044050 2024-09-13T19:16:19.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.227+0000 7fc511b7b640 1 -- 172.21.15.102:0/446582042 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc50402e070 con 0x7fc50c044050 2024-09-13T19:16:19.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.227+0000 7fc514087800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:19.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.227+0000 7fc514087800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:19.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.227+0000 7fc514087800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:19.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.227+0000 7fc514087800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:19.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.227+0000 7fc514087800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:19.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.227+0000 7fc514087800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:19.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.227+0000 7fc514087800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.227+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2829d2cb0 con 0x55a2829caeb0 2024-09-13T19:16:19.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.227+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc508057030 con 0x55a2829caeb0 2024-09-13T19:16:19.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.227+0000 7fc514087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:19.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.227+0000 7fc514087800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.227+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2829d3550 con 0x55a2829caeb0 2024-09-13T19:16:19.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.228+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc508057030 con 0x55a2829caeb0 2024-09-13T19:16:19.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.228+0000 7fc514087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:19.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.228+0000 7fc514087800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.228+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2829d4090 con 0x55a2829cf8c0 2024-09-13T19:16:19.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.228+0000 7fc51237c640 1 -- 172.21.15.102:0/446582042 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc50c027020 con 0x55a2829cf8c0 2024-09-13T19:16:19.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.228+0000 7fc514087800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:19.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.228+0000 7fc514087800 20 zone default found 2024-09-13T19:16:19.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.228+0000 7fc514087800 4 Realm: () 2024-09-13T19:16:19.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.228+0000 7fc514087800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:19.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.228+0000 7fc514087800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:19.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.228+0000 7fc514087800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:19.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.228+0000 7fc514087800 20 zonegroup default 2024-09-13T19:16:19.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.228+0000 7fc514087800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.228+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2829d48e0 con 0x7fc50400f070 2024-09-13T19:16:19.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.228+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc508057030 con 0x7fc50400f070 2024-09-13T19:16:19.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.229+0000 7fc514087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:19.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.229+0000 7fc514087800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.229+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2829d62c0 con 0x55a2829cf8c0 2024-09-13T19:16:19.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.229+0000 7fc51237c640 1 -- 172.21.15.102:0/446582042 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc50c027020 con 0x55a2829cf8c0 2024-09-13T19:16:19.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.229+0000 7fc514087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:19.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.229+0000 7fc514087800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.229+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2829d66f0 con 0x55a2829cf8c0 2024-09-13T19:16:19.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.229+0000 7fc51237c640 1 -- 172.21.15.102:0/446582042 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc50c027020 con 0x55a2829cf8c0 2024-09-13T19:16:19.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.229+0000 7fc514087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:19.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.229+0000 7fc514087800 20 started sync module instance, tier type = 2024-09-13T19:16:19.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.229+0000 7fc514087800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:19.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.229+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2829d5750 con 0x7fc50c044050 2024-09-13T19:16:19.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.230+0000 7fc511b7b640 1 -- 172.21.15.102:0/446582042 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(44 notify.0 [create] v34'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc50402e070 con 0x7fc50c044050 2024-09-13T19:16:19.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.230+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94156464413504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2829d53b0 con 0x7fc50c044050 2024-09-13T19:16:19.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.230+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2829d7620 con 0x55a2829caeb0 2024-09-13T19:16:19.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.231+0000 7fc511b7b640 1 -- 172.21.15.102:0/446582042 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94156464413504] v34'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc50402e070 con 0x7fc50c044050 2024-09-13T19:16:19.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.232+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v34'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc508057030 con 0x55a2829caeb0 2024-09-13T19:16:19.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.232+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94156464419184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2829d7a40 con 0x55a2829caeb0 2024-09-13T19:16:19.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.232+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2829d8400 con 0x55a2829cf8c0 2024-09-13T19:16:19.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.233+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94156464419184] v34'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc508057030 con 0x55a2829caeb0 2024-09-13T19:16:19.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.233+0000 7fc51237c640 1 -- 172.21.15.102:0/446582042 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v34'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc50c027020 con 0x55a2829cf8c0 2024-09-13T19:16:19.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.233+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94156464420720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2829d8400 con 0x55a2829cf8c0 2024-09-13T19:16:19.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.233+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2829d8e00 con 0x7fc50c044050 2024-09-13T19:16:19.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.234+0000 7fc511b7b640 1 -- 172.21.15.102:0/446582042 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(50 notify.3 [create] v34'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc50402e070 con 0x7fc50c044050 2024-09-13T19:16:19.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.234+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94156464425232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2829d96b0 con 0x7fc50c044050 2024-09-13T19:16:19.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.234+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2829da1c0 con 0x55a2829caeb0 2024-09-13T19:16:19.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.234+0000 7fc51237c640 1 -- 172.21.15.102:0/446582042 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94156464420720] v34'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc50c027020 con 0x55a2829cf8c0 2024-09-13T19:16:19.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.235+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v34'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc508057030 con 0x55a2829caeb0 2024-09-13T19:16:19.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.235+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94156464430192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2829da5b0 con 0x55a2829caeb0 2024-09-13T19:16:19.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.235+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2829db030 con 0x7fc50400f070 2024-09-13T19:16:19.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.235+0000 7fc511b7b640 1 -- 172.21.15.102:0/446582042 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94156464425232] v34'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc50402e070 con 0x7fc50c044050 2024-09-13T19:16:19.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.236+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(54 notify.5 [create] v34'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc508057030 con 0x7fc50400f070 2024-09-13T19:16:19.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.236+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94156464433952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2829daff0 con 0x7fc50400f070 2024-09-13T19:16:19.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.236+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2829dba40 con 0x7fc50400f070 2024-09-13T19:16:19.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.236+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94156464430192] v34'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc508057030 con 0x55a2829caeb0 2024-09-13T19:16:19.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.237+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94156464433952] v34'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc508057030 con 0x7fc50400f070 2024-09-13T19:16:19.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.237+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(56 notify.6 [create] v34'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc508057030 con 0x7fc50400f070 2024-09-13T19:16:19.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.237+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94156464427424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2829d7f50 con 0x7fc50400f070 2024-09-13T19:16:19.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.237+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2829dbeb0 con 0x7fc50400f070 2024-09-13T19:16:19.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.238+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(58 notify.7 [create] v34'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc508057030 con 0x7fc50400f070 2024-09-13T19:16:19.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.238+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94156464437760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2829dc2d0 con 0x7fc50400f070 2024-09-13T19:16:19.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.238+0000 7fc514087800 20 add_watcher() i=0 2024-09-13T19:16:19.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.238+0000 7fc514087800 20 add_watcher() i=1 2024-09-13T19:16:19.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.238+0000 7fc514087800 20 add_watcher() i=2 2024-09-13T19:16:19.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.238+0000 7fc514087800 20 add_watcher() i=3 2024-09-13T19:16:19.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.238+0000 7fc514087800 20 add_watcher() i=4 2024-09-13T19:16:19.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.238+0000 7fc514087800 20 add_watcher() i=5 2024-09-13T19:16:19.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.238+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94156464427424] v34'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc508057030 con 0x7fc50400f070 2024-09-13T19:16:19.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.238+0000 7fc514087800 20 add_watcher() i=6 2024-09-13T19:16:19.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.239+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94156464437760] v34'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc508057030 con 0x7fc50400f070 2024-09-13T19:16:19.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.239+0000 7fc514087800 20 add_watcher() i=7 2024-09-13T19:16:19.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.239+0000 7fc514087800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:19.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.239+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2829dc2d0 con 0x55a2829caeb0 2024-09-13T19:16:19.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.239+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc508057030 con 0x55a2829caeb0 2024-09-13T19:16:19.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.239+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94156464438816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2829dc240 con 0x55a2829caeb0 2024-09-13T19:16:19.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.240+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94156464438816] v34'110 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc508057030 con 0x55a2829caeb0 2024-09-13T19:16:19.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.240+0000 7fc3c37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:19.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.241+0000 7fc514087800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:19.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.241+0000 7fc514087800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:19.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.241+0000 7fc514087800 5 note: GC not initialized 2024-09-13T19:16:19.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.241+0000 7fc3c27fc640 20 reqs_thread_entry: start 2024-09-13T19:16:19.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.241+0000 7fc514087800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:19.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.241+0000 7fc514087800 20 Filter name: none 2024-09-13T19:16:19.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.241+0000 7fc333fff640 20 reqs_thread_entry: start 2024-09-13T19:16:19.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.241+0000 7fc514087800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T19:16:19.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.241+0000 7fc514087800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.241+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a282a12760 con 0x7fc50400f070 2024-09-13T19:16:19.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.242+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fc508057030 con 0x7fc50400f070 2024-09-13T19:16:19.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.242+0000 7fc514087800 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T19:16:19.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.242+0000 7fc514087800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-13T19:16:19.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.242+0000 7fc514087800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T19:16:19.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.242+0000 7fc514087800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:16:19.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.242+0000 7fc514087800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T19:16:19.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.242+0000 7fc514087800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.242+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a282a14840 con 0x7fc50c044050 2024-09-13T19:16:19.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.242+0000 7fc511b7b640 1 -- 172.21.15.102:0/446582042 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv19 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fc50402e070 con 0x7fc50c044050 2024-09-13T19:16:19.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.242+0000 7fc514087800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:16:19.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.242+0000 7fc514087800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T19:16:19.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.242+0000 7fc514087800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:16:19.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.242+0000 7fc514087800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 : miss 2024-09-13T19:16:19.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.242+0000 7fc514087800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.242+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:64 8.9 8:917ee2d5:root::.bucket.meta.myfoo%3a509740b4-c081-4f37-bd6d-df9ca851489b.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a282a16290 con 0x7fc50c044050 2024-09-13T19:16:19.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.242+0000 7fc511b7b640 1 -- 172.21.15.102:0/446582042 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(64 .bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fc50402e070 con 0x7fc50c044050 2024-09-13T19:16:19.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.242+0000 7fc514087800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:16:19.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.242+0000 7fc514087800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 info.flags=0x17 2024-09-13T19:16:19.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.242+0000 7fc514087800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 to cache LRU end 2024-09-13T19:16:19.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.242+0000 7fc514087800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:16:19.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.242+0000 7fc514087800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:16:19.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.242+0000 7fc514087800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 2024-09-13T19:16:19.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.242+0000 7fc514087800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-13T19:16:19.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.242+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a282a1a700 con 0x7fc50c044050 2024-09-13T19:16:19.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.243+0000 7fc511b7b640 1 -- 172.21.15.102:0/446582042 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(65 foo.buckets [call] v34'20 uv18 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fc50402e070 con 0x7fc50c044050 2024-09-13T19:16:19.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.243+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:66 8.9 8:917ee2d5:root::.bucket.meta.myfoo%3a509740b4-c081-4f37-bd6d-df9ca851489b.4237.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a282a20690 con 0x7fc50c044050 2024-09-13T19:16:19.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.245+0000 7fc511b7b640 1 -- 172.21.15.102:0/446582042 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(66 .bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v34'21 uv21 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7fc50402e070 con 0x7fc50c044050 2024-09-13T19:16:19.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.245+0000 7fc514087800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 info.flags=0x17 2024-09-13T19:16:19.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.245+0000 7fc514087800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 to cache LRU end 2024-09-13T19:16:19.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.245+0000 7fc514087800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:16:19.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.245+0000 7fc514087800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1, ofs0, ns] 2024-09-13T19:16:19.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.245+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify cookie 94156464677296 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a282a1ab30 con 0x55a2829caeb0 2024-09-13T19:16:19.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.245+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== watch-notify(notify (1) cookie 94156464430192 notify 146028888076 ret 0) ==== 794+0+0 (crc 0 0 0) 0x55a282760e00 con 0x55a2829caeb0 2024-09-13T19:16:19.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.245+0000 7fc3f57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888076 cookie 94156464430192 notifier 4510 bl.length()=752 2024-09-13T19:16:19.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.245+0000 7fc3f57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 info.flags=0x17 2024-09-13T19:16:19.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.245+0000 7fc3f57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 to cache LRU end 2024-09-13T19:16:19.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.245+0000 7fc3f57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:16:19.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.245+0000 7fc3f57fa640 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fc3d4003ea0 con 0x55a2829caeb0 2024-09-13T19:16:19.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.245+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(67 notify.4 [notify cookie 94156464677296 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc508057030 con 0x55a2829caeb0 2024-09-13T19:16:19.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.245+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(68 notify.4 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc508057030 con 0x55a2829caeb0 2024-09-13T19:16:19.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.245+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== watch-notify(notify_complete (2) cookie 94156464677296 notify 146028888076 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc50805ba10 con 0x55a2829caeb0 2024-09-13T19:16:19.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.245+0000 7fc514087800 20 handle_bi_update(): bucket=:myfoo[509740b4-c081-4f37-bd6d-df9ca851489b.4237.1]): orig_sources= new_sources= 2024-09-13T19:16:19.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.245+0000 7fc514087800 20 handle_bi_update(): bucket=:myfoo[509740b4-c081-4f37-bd6d-df9ca851489b.4237.1]): potential sources added=[] removed=[] 2024-09-13T19:16:19.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.245+0000 7fc514087800 20 handle_bi_update(): bucket=:myfoo[509740b4-c081-4f37-bd6d-df9ca851489b.4237.1]): orig_dests= new_dests= 2024-09-13T19:16:19.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.245+0000 7fc514087800 20 handle_bi_update(): bucket=:myfoo[509740b4-c081-4f37-bd6d-df9ca851489b.4237.1]): potential dests added=[] removed=[] 2024-09-13T19:16:19.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.245+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:69 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a282a161b0 con 0x7fc50400f070 2024-09-13T19:16:19.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.246+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(69 fud.buckets [call] v34'1 uv1 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fc508057030 con 0x7fc50400f070 2024-09-13T19:16:19.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.246+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a282a1ff00 con 0x7fc50c044050 2024-09-13T19:16:19.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.247+0000 7fc511b7b640 1 -- 172.21.15.102:0/446582042 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v34'22 uv22 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7fc50402e070 con 0x7fc50c044050 2024-09-13T19:16:19.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.247+0000 7fc514087800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-13T19:16:19.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.247+0000 7fc514087800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:16:19.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.248+0000 7fc514087800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T19:16:19.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.248+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94156464695968 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a282a1f3a0 con 0x7fc50400f070 2024-09-13T19:16:19.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.248+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== watch-notify(notify (1) cookie 94156464427424 notify 146028888073 ret 0) ==== 356+0+0 (crc 0 0 0) 0x7fc50805bcd0 con 0x7fc50400f070 2024-09-13T19:16:19.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.248+0000 7fc3f4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888073 cookie 94156464427424 notifier 4510 bl.length()=314 2024-09-13T19:16:19.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.248+0000 7fc3f4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-13T19:16:19.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.248+0000 7fc3f4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:16:19.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.248+0000 7fc3f4ff9640 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fc33c003400 con 0x7fc50400f070 2024-09-13T19:16:19.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.248+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 <== osd.0 v2:172.21.15.53:6800/4021716951 20 ==== osd_op_reply(71 notify.6 [notify cookie 94156464695968 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc508057030 con 0x7fc50400f070 2024-09-13T19:16:19.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.248+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 <== osd.0 v2:172.21.15.53:6800/4021716951 21 ==== watch-notify(notify_complete (2) cookie 94156464695968 notify 146028888073 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc508081430 con 0x7fc50400f070 2024-09-13T19:16:19.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.248+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 <== osd.0 v2:172.21.15.53:6800/4021716951 22 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc508057030 con 0x7fc50400f070 2024-09-13T19:16:19.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.249+0000 7fc3c37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:19.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.249+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94156464438816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a282a104b0 con 0x55a2829caeb0 2024-09-13T19:16:19.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.250+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94156464438816] v34'111 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc508057030 con 0x55a2829caeb0 2024-09-13T19:16:19.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.250+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94156464413504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a282a104b0 con 0x7fc50c044050 2024-09-13T19:16:19.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.253+0000 7fc511b7b640 1 -- 172.21.15.102:0/446582042 <== osd.2 v2:172.21.15.102:6816/2238176080 16 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94156464413504] v34'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc50402e070 con 0x7fc50c044050 2024-09-13T19:16:19.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.253+0000 7fc514087800 20 remove_watcher() i=0 2024-09-13T19:16:19.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.253+0000 7fc514087800 2 removed watcher, disabling cache 2024-09-13T19:16:19.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.253+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94156464419184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a282a104b0 con 0x55a2829caeb0 2024-09-13T19:16:19.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.254+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94156464419184] v34'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc508057030 con 0x55a2829caeb0 2024-09-13T19:16:19.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.254+0000 7fc514087800 20 remove_watcher() i=1 2024-09-13T19:16:19.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.254+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94156464420720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a282a104b0 con 0x55a2829cf8c0 2024-09-13T19:16:19.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.255+0000 7fc51237c640 1 -- 172.21.15.102:0/446582042 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94156464420720] v34'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc50c027020 con 0x55a2829cf8c0 2024-09-13T19:16:19.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.255+0000 7fc514087800 20 remove_watcher() i=2 2024-09-13T19:16:19.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.255+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94156464425232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a282a104b0 con 0x7fc50c044050 2024-09-13T19:16:19.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.256+0000 7fc511b7b640 1 -- 172.21.15.102:0/446582042 <== osd.2 v2:172.21.15.102:6816/2238176080 17 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94156464425232] v34'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc50402e070 con 0x7fc50c044050 2024-09-13T19:16:19.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.256+0000 7fc514087800 20 remove_watcher() i=3 2024-09-13T19:16:19.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.256+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94156464430192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a282a104b0 con 0x55a2829caeb0 2024-09-13T19:16:19.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.257+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94156464430192] v34'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc508057030 con 0x55a2829caeb0 2024-09-13T19:16:19.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.257+0000 7fc514087800 20 remove_watcher() i=4 2024-09-13T19:16:19.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.257+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94156464433952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a282a104b0 con 0x7fc50400f070 2024-09-13T19:16:19.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.258+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 <== osd.0 v2:172.21.15.53:6800/4021716951 23 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94156464433952] v34'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc508057030 con 0x7fc50400f070 2024-09-13T19:16:19.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.258+0000 7fc514087800 20 remove_watcher() i=5 2024-09-13T19:16:19.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.258+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94156464427424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a282a104b0 con 0x7fc50400f070 2024-09-13T19:16:19.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.259+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 <== osd.0 v2:172.21.15.53:6800/4021716951 24 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94156464427424] v34'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc508057030 con 0x7fc50400f070 2024-09-13T19:16:19.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.259+0000 7fc514087800 20 remove_watcher() i=6 2024-09-13T19:16:19.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.259+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94156464437760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a282a104b0 con 0x7fc50400f070 2024-09-13T19:16:19.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.260+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 <== osd.0 v2:172.21.15.53:6800/4021716951 25 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94156464437760] v34'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc508057030 con 0x7fc50400f070 2024-09-13T19:16:19.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.260+0000 7fc514087800 20 remove_watcher() i=7 2024-09-13T19:16:19.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.260+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fc50400f070 msgr2=0x7fc504019860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.260+0000 7fc514087800 1 --2- 172.21.15.102:0/446582042 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fc50400f070 0x7fc504019860 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.260+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55a2829caeb0 msgr2=0x55a2829cd370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.260+0000 7fc514087800 1 --2- 172.21.15.102:0/446582042 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55a2829caeb0 0x55a2829cd370 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.260+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fc50c044050 msgr2=0x7fc50c04eab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.260+0000 7fc514087800 1 --2- 172.21.15.102:0/446582042 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fc50c044050 0x7fc50c04eab0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.260+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55a2829cf8c0 msgr2=0x55a2829d1cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.260+0000 7fc514087800 1 --2- 172.21.15.102:0/446582042 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55a2829cf8c0 0x55a2829d1cb0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.260+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc3dc036b90 msgr2=0x7fc3dc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.261+0000 7fc514087800 1 --2- 172.21.15.102:0/446582042 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc3dc036b90 0x7fc3dc039050 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc50400ff70 tx=0x7fc50404d000 comp rx=0 tx=0).stop 2024-09-13T19:16:19.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.261+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2829b7d40 msgr2=0x55a2829bf1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.261+0000 7fc514087800 1 --2- 172.21.15.102:0/446582042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2829b7d40 0x55a2829bf1f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc50c014e60 tx=0x7fc50c04cd30 comp rx=0 tx=0).stop 2024-09-13T19:16:19.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.261+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 reap_dead start 2024-09-13T19:16:19.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.261+0000 7fc51137a640 1 -- 172.21.15.102:0/446582042 reap_dead start 2024-09-13T19:16:19.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.261+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 shutdown_connections 2024-09-13T19:16:19.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.261+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 >> 172.21.15.102:0/446582042 conn(0x55a2829b40a0 msgr2=0x55a2829b2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:19.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.261+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 shutdown_connections 2024-09-13T19:16:19.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.261+0000 7fc514087800 1 -- 172.21.15.102:0/446582042 wait complete. 2024-09-13T19:16:19.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.261+0000 7fc514087800 1 -- 172.21.15.102:0/564878721 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc3ec036b90 msgr2=0x7fc3ec039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.261+0000 7fc514087800 1 --2- 172.21.15.102:0/564878721 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc3ec036b90 0x7fc3ec039050 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc50404b760 tx=0x7fc50404b630 comp rx=0 tx=0).stop 2024-09-13T19:16:19.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.261+0000 7fc514087800 1 -- 172.21.15.102:0/564878721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2829ab0a0 msgr2=0x55a2829ab4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.261+0000 7fc514087800 1 --2- 172.21.15.102:0/564878721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2829ab0a0 0x55a2829ab4c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x55a282997cd0 tx=0x7fc50c0163e0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.261+0000 7fc514087800 1 -- 172.21.15.102:0/564878721 shutdown_connections 2024-09-13T19:16:19.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.261+0000 7fc514087800 1 --2- 172.21.15.102:0/564878721 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc3ec036b90 0x7fc3ec039050 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.261+0000 7fc514087800 1 --2- 172.21.15.102:0/564878721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2829ab0a0 0x55a2829ab4c0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.261+0000 7fc514087800 1 -- 172.21.15.102:0/564878721 >> 172.21.15.102:0/564878721 conn(0x55a2829a0030 msgr2=0x55a2829a2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:19.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.261+0000 7fc514087800 1 -- 172.21.15.102:0/564878721 shutdown_connections 2024-09-13T19:16:19.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.261+0000 7fc514087800 1 -- 172.21.15.102:0/564878721 wait complete. 2024-09-13T19:16:19.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.261+0000 7fc514087800 1 -- 172.21.15.102:0/3726726239 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55a28289d880 msgr2=0x55a2829973d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.261+0000 7fc514087800 1 --2- 172.21.15.102:0/3726726239 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55a28289d880 0x55a2829973d0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.261+0000 7fc514087800 1 -- 172.21.15.102:0/3726726239 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55a282999c20 msgr2=0x55a28299c010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.261+0000 7fc514087800 1 --2- 172.21.15.102:0/3726726239 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55a282999c20 0x55a28299c010 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.261+0000 7fc514087800 1 -- 172.21.15.102:0/3726726239 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc3f8036b90 msgr2=0x7fc3f8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.261+0000 7fc514087800 1 --2- 172.21.15.102:0/3726726239 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc3f8036b90 0x7fc3f8039050 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc508057000 tx=0x7fc508052000 comp rx=0 tx=0).stop 2024-09-13T19:16:19.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.261+0000 7fc514087800 1 -- 172.21.15.102:0/3726726239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a28280ceb0 msgr2=0x55a282990360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.261+0000 7fc514087800 1 --2- 172.21.15.102:0/3726726239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a28280ceb0 0x55a282990360 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc504000fd0 tx=0x7fc504000ed0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.262+0000 7fc514087800 1 -- 172.21.15.102:0/3726726239 shutdown_connections 2024-09-13T19:16:19.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.262+0000 7fc514087800 1 --2- 172.21.15.102:0/3726726239 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55a282999c20 0x55a28299c010 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.262+0000 7fc514087800 1 --2- 172.21.15.102:0/3726726239 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55a28289d880 0x55a2829973d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.262+0000 7fc514087800 1 --2- 172.21.15.102:0/3726726239 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc3f8036b90 0x7fc3f8039050 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.262+0000 7fc514087800 1 --2- 172.21.15.102:0/3726726239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a28280ceb0 0x55a282990360 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.262+0000 7fc514087800 1 -- 172.21.15.102:0/3726726239 >> 172.21.15.102:0/3726726239 conn(0x55a282893e10 msgr2=0x55a282982bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:19.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.262+0000 7fc514087800 1 -- 172.21.15.102:0/3726726239 shutdown_connections 2024-09-13T19:16:19.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.262+0000 7fc514087800 1 -- 172.21.15.102:0/3726726239 wait complete. 2024-09-13T19:16:19.274 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-13T19:16:19.274 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-13T19:16:19.274 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-13T19:16:19.318 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:19.318 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:19.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.315+0000 7fdbe8b3e800 1 Processor -- start 2024-09-13T19:16:19.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.315+0000 7fdbe8b3e800 1 -- start start 2024-09-13T19:16:19.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.315+0000 7fdbe8b3e800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55e4ae6e2900 0x55e4ae6e4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.315+0000 7fdbe8b3e800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e4ae59eb30 con 0x55e4ae6de4c0 2024-09-13T19:16:19.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.315+0000 7fdbe8b3e800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55e4ae580360 con 0x55e4ae6e2900 2024-09-13T19:16:19.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.316+0000 7fdbdc033640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55e4ae6e2900 0x55e4ae6e4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.316+0000 7fdbdc033640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55e4ae6e2900 0x55e4ae6e4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55516/0 (socket says 172.21.15.102:55516) 2024-09-13T19:16:19.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.316+0000 7fdbdc033640 1 -- 172.21.15.102:0/2240713569 learned_addr learned my addr 172.21.15.102:0/2240713569 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:19.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.316+0000 7fdbe4834640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55e4ae6de4c0 0x55e4ae6de8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:50014/0 (socket says 172.21.15.102:50014) 2024-09-13T19:16:19.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.316+0000 7fdbdc033640 1 -- 172.21.15.102:0/2240713569 >> v1:172.21.15.53:6789/0 conn(0x55e4ae6de4c0 legacy=0x55e4ae6de8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.316+0000 7fdbdc033640 1 -- 172.21.15.102:0/2240713569 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4ae5a6e00 con 0x55e4ae6e2900 2024-09-13T19:16:19.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.318+0000 7fdbdc033640 1 --2- 172.21.15.102:0/2240713569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ae6e2900 0x55e4ae6e4cf0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc00a520 tx=0x7fdbcc045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3348704ee49ff94 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.318+0000 7fdbdffff640 1 -- 172.21.15.102:0/2240713569 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbcc055070 con 0x55e4ae6e2900 2024-09-13T19:16:19.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.318+0000 7fdbdffff640 1 -- 172.21.15.102:0/2240713569 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbcc0515b0 con 0x55e4ae6e2900 2024-09-13T19:16:19.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.318+0000 7fdbdffff640 1 -- 172.21.15.102:0/2240713569 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbcc0518d0 con 0x55e4ae6e2900 2024-09-13T19:16:19.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.318+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/2240713569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ae6e2900 msgr2=0x55e4ae6e4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.318+0000 7fdbe8b3e800 1 --2- 172.21.15.102:0/2240713569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ae6e2900 0x55e4ae6e4cf0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc00a520 tx=0x7fdbcc045ba0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.318+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/2240713569 shutdown_connections 2024-09-13T19:16:19.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.318+0000 7fdbe8b3e800 1 --2- 172.21.15.102:0/2240713569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ae6e2900 0x55e4ae6e4cf0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.318+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/2240713569 >> 172.21.15.102:0/2240713569 conn(0x55e4ae6d9df0 msgr2=0x55e4ae6dc210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:19.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.318+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/2240713569 shutdown_connections 2024-09-13T19:16:19.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.318+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/2240713569 wait complete. 2024-09-13T19:16:19.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.332+0000 7fdbe8b3e800 1 Processor -- start 2024-09-13T19:16:19.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.332+0000 7fdbe8b3e800 1 -- start start 2024-09-13T19:16:19.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.332+0000 7fdbe8b3e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ae6de4c0 0x55e4ae652d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.332+0000 7fdbe8b3e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e4ae62b330 con 0x55e4ae6de4c0 2024-09-13T19:16:19.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.333+0000 7fdbe4834640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ae6de4c0 0x55e4ae652d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.333+0000 7fdbe4834640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ae6de4c0 0x55e4ae652d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55530/0 (socket says 172.21.15.102:55530) 2024-09-13T19:16:19.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.333+0000 7fdbe4834640 1 -- 172.21.15.102:0/1492446592 learned_addr learned my addr 172.21.15.102:0/1492446592 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:19.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.333+0000 7fdbe4834640 1 -- 172.21.15.102:0/1492446592 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4ae578bc0 con 0x55e4ae6de4c0 2024-09-13T19:16:19.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.333+0000 7fdbe4834640 1 --2- 172.21.15.102:0/1492446592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ae6de4c0 0x55e4ae652d80 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fdbd400b230 tx=0x7fdbd400b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3d7a8ed77cbb687 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.333+0000 7fdad2e0d640 1 -- 172.21.15.102:0/1492446592 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbd400e5c0 con 0x55e4ae6de4c0 2024-09-13T19:16:19.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.333+0000 7fdad2e0d640 1 -- 172.21.15.102:0/1492446592 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbd4006070 con 0x55e4ae6de4c0 2024-09-13T19:16:19.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.333+0000 7fdad2e0d640 1 -- 172.21.15.102:0/1492446592 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbd400e890 con 0x55e4ae6de4c0 2024-09-13T19:16:19.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.334+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1492446592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ae6de4c0 msgr2=0x55e4ae652d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.334+0000 7fdbe8b3e800 1 --2- 172.21.15.102:0/1492446592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ae6de4c0 0x55e4ae652d80 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fdbd400b230 tx=0x7fdbd400b6f0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.334+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1492446592 shutdown_connections 2024-09-13T19:16:19.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.334+0000 7fdbe8b3e800 1 --2- 172.21.15.102:0/1492446592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ae6de4c0 0x55e4ae652d80 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.334+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1492446592 >> 172.21.15.102:0/1492446592 conn(0x55e4ae6d9df0 msgr2=0x55e4ae7c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:19.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.334+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1492446592 shutdown_connections 2024-09-13T19:16:19.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.334+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1492446592 wait complete. 2024-09-13T19:16:19.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.334+0000 7fdbe8b3e800 1 Processor -- start 2024-09-13T19:16:19.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.334+0000 7fdbe8b3e800 1 -- start start 2024-09-13T19:16:19.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.335+0000 7fdbe8b3e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ae6de4c0 0x55e4ae7ceeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.335+0000 7fdbe8b3e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e4ae6e5530 con 0x55e4ae6de4c0 2024-09-13T19:16:19.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.335+0000 7fdbe4834640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ae6de4c0 0x55e4ae7ceeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.335+0000 7fdbe4834640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ae6de4c0 0x55e4ae7ceeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55534/0 (socket says 172.21.15.102:55534) 2024-09-13T19:16:19.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.335+0000 7fdbe4834640 1 -- 172.21.15.102:0/1445169454 learned_addr learned my addr 172.21.15.102:0/1445169454 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:19.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.335+0000 7fdbe4834640 1 -- 172.21.15.102:0/1445169454 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4ae58cfe0 con 0x55e4ae6de4c0 2024-09-13T19:16:19.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.335+0000 7fdbe4834640 1 --2- 172.21.15.102:0/1445169454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ae6de4c0 0x55e4ae7ceeb0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4000fd0 tx=0x7fdbd4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.335+0000 7fdad160a640 1 -- 172.21.15.102:0/1445169454 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbd400f8d0 con 0x55e4ae6de4c0 2024-09-13T19:16:19.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.335+0000 7fdad160a640 1 -- 172.21.15.102:0/1445169454 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbd400fa90 con 0x55e4ae6de4c0 2024-09-13T19:16:19.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.335+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1445169454 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e4ae7cd5a0 con 0x55e4ae6de4c0 2024-09-13T19:16:19.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.335+0000 7fdad160a640 1 -- 172.21.15.102:0/1445169454 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbd400fdb0 con 0x55e4ae6de4c0 2024-09-13T19:16:19.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.335+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1445169454 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4ae7cdac0 con 0x55e4ae6de4c0 2024-09-13T19:16:19.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.336+0000 7fdad160a640 1 -- 172.21.15.102:0/1445169454 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fdbd4017070 con 0x55e4ae6de4c0 2024-09-13T19:16:19.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.336+0000 7fdad160a640 1 --2- 172.21.15.102:0/1445169454 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdacc036b40 0x7fdacc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.336+0000 7fdad160a640 1 -- 172.21.15.102:0/1445169454 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fdbd4015020 con 0x55e4ae6de4c0 2024-09-13T19:16:19.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.336+0000 7fdbdc033640 1 --2- 172.21.15.102:0/1445169454 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdacc036b40 0x7fdacc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.336+0000 7fdbe8b3e800 1 --2- 172.21.15.102:0/1445169454 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e4ae6e2900 0x55e4ae7df650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.336+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1445169454 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae7dfb90 con 0x55e4ae6e2900 2024-09-13T19:16:19.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.337+0000 7fdbe5035640 1 --2- 172.21.15.102:0/1445169454 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e4ae6e2900 0x55e4ae7df650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.337+0000 7fdbdc033640 1 --2- 172.21.15.102:0/1445169454 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdacc036b40 0x7fdacc039000 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc057000 tx=0x7fdbcc052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.337+0000 7fdbe5035640 1 --2- 172.21.15.102:0/1445169454 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e4ae6e2900 0x55e4ae7df650 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.337+0000 7fdbe5035640 1 -- 172.21.15.102:0/1445169454 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdbe000a4a0 con 0x55e4ae6e2900 2024-09-13T19:16:19.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.337+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1445169454 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae7e03e0 con 0x55e4ae6e2900 2024-09-13T19:16:19.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.337+0000 7fdbe5035640 1 -- 172.21.15.102:0/1445169454 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdbe000a4a0 con 0x55e4ae6e2900 2024-09-13T19:16:19.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.338+0000 7fdbe8b3e800 1 --2- 172.21.15.102:0/1445169454 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e4ae7e1e10 0x55e4ae7e4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.338+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1445169454 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae7e4990 con 0x55e4ae7e1e10 2024-09-13T19:16:19.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.338+0000 7fdbe4834640 1 --2- 172.21.15.102:0/1445169454 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e4ae7e1e10 0x55e4ae7e4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.338+0000 7fdbe4834640 1 --2- 172.21.15.102:0/1445169454 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e4ae7e1e10 0x55e4ae7e4200 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.338+0000 7fdbe4834640 1 -- 172.21.15.102:0/1445169454 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdbd402e070 con 0x55e4ae7e1e10 2024-09-13T19:16:19.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.338+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1445169454 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae7e0c30 con 0x55e4ae6e2900 2024-09-13T19:16:19.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.338+0000 7fdbe5035640 1 -- 172.21.15.102:0/1445169454 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdbe000a4a0 con 0x55e4ae6e2900 2024-09-13T19:16:19.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.338+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1445169454 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae7e1010 con 0x55e4ae7e1e10 2024-09-13T19:16:19.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.339+0000 7fdbe4834640 1 -- 172.21.15.102:0/1445169454 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdbd402e070 con 0x55e4ae7e1e10 2024-09-13T19:16:19.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.339+0000 7fdbe8b3e800 1 Processor -- start 2024-09-13T19:16:19.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.339+0000 7fdbe8b3e800 1 -- start start 2024-09-13T19:16:19.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.339+0000 7fdbe8b3e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ae7f3340 0x55e4ae7f3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.339+0000 7fdbe8b3e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e4ae7cf3f0 con 0x55e4ae7f3340 2024-09-13T19:16:19.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.340+0000 7fdbe5035640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ae7f3340 0x55e4ae7f3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.340+0000 7fdbe5035640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ae7f3340 0x55e4ae7f3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55542/0 (socket says 172.21.15.102:55542) 2024-09-13T19:16:19.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.340+0000 7fdbe5035640 1 -- 172.21.15.102:0/2443973058 learned_addr learned my addr 172.21.15.102:0/2443973058 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:19.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.340+0000 7fdbe5035640 1 -- 172.21.15.102:0/2443973058 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4ae7f3ca0 con 0x55e4ae7f3340 2024-09-13T19:16:19.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.340+0000 7fdbe5035640 1 --2- 172.21.15.102:0/2443973058 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ae7f3340 0x55e4ae7f3760 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x55e4ae7ce8a0 tx=0x7fdbe00167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.340+0000 7fdaca7fc640 1 -- 172.21.15.102:0/2443973058 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbe0013640 con 0x55e4ae7f3340 2024-09-13T19:16:19.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.340+0000 7fdaca7fc640 1 -- 172.21.15.102:0/2443973058 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbe00137e0 con 0x55e4ae7f3340 2024-09-13T19:16:19.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.340+0000 7fdaca7fc640 1 -- 172.21.15.102:0/2443973058 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbe0013ae0 con 0x55e4ae7f3340 2024-09-13T19:16:19.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.340+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/2443973058 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e4ae7f3f30 con 0x55e4ae7f3340 2024-09-13T19:16:19.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.340+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/2443973058 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4ae7f6c10 con 0x55e4ae7f3340 2024-09-13T19:16:19.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.341+0000 7fdaca7fc640 1 -- 172.21.15.102:0/2443973058 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fdbe0011040 con 0x55e4ae7f3340 2024-09-13T19:16:19.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.341+0000 7fdaca7fc640 1 --2- 172.21.15.102:0/2443973058 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdabc036b90 0x7fdabc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.341+0000 7fdaca7fc640 1 -- 172.21.15.102:0/2443973058 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fdbe000e040 con 0x55e4ae7f3340 2024-09-13T19:16:19.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.341+0000 7fdbe4834640 1 --2- 172.21.15.102:0/2443973058 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdabc036b90 0x7fdabc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.341+0000 7fdbe8b3e800 1 Processor -- start 2024-09-13T19:16:19.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.342+0000 7fdbe4834640 1 --2- 172.21.15.102:0/2443973058 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdabc036b90 0x7fdabc039050 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x55e4ae7cdeb0 tx=0x7fdbd404b690 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.342+0000 7fdbe8b3e800 1 -- start start 2024-09-13T19:16:19.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.342+0000 7fdbe8b3e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ae800000 0x55e4ae800400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.342+0000 7fdbe8b3e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e4ae57a580 con 0x55e4ae800000 2024-09-13T19:16:19.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.342+0000 7fdbe5035640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ae800000 0x55e4ae800400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.342+0000 7fdbe5035640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ae800000 0x55e4ae800400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55544/0 (socket says 172.21.15.102:55544) 2024-09-13T19:16:19.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.342+0000 7fdbe5035640 1 -- 172.21.15.102:0/1415738613 learned_addr learned my addr 172.21.15.102:0/1415738613 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:19.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.342+0000 7fdbe5035640 1 -- 172.21.15.102:0/1415738613 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4ae8009d0 con 0x55e4ae800000 2024-09-13T19:16:19.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.342+0000 7fdbe5035640 1 --2- 172.21.15.102:0/1415738613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ae800000 0x55e4ae800400 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fdbe000afb0 tx=0x7fdbe001fcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6993a58492625a57 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.342+0000 7fdabbfff640 1 -- 172.21.15.102:0/1415738613 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbe0021570 con 0x55e4ae800000 2024-09-13T19:16:19.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.342+0000 7fdabbfff640 1 -- 172.21.15.102:0/1415738613 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbe001f340 con 0x55e4ae800000 2024-09-13T19:16:19.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.342+0000 7fdabbfff640 1 -- 172.21.15.102:0/1415738613 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbe0014cc0 con 0x55e4ae800000 2024-09-13T19:16:19.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.343+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1415738613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ae800000 msgr2=0x55e4ae800400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.343+0000 7fdbe8b3e800 1 --2- 172.21.15.102:0/1415738613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ae800000 0x55e4ae800400 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fdbe000afb0 tx=0x7fdbe001fcc0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.343+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1415738613 shutdown_connections 2024-09-13T19:16:19.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.343+0000 7fdbe8b3e800 1 --2- 172.21.15.102:0/1415738613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ae800000 0x55e4ae800400 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.343+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1415738613 >> 172.21.15.102:0/1415738613 conn(0x55e4ae7fc360 msgr2=0x55e4ae7fa460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:19.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.343+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1415738613 shutdown_connections 2024-09-13T19:16:19.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.343+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1415738613 wait complete. 2024-09-13T19:16:19.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.343+0000 7fdbe8b3e800 1 Processor -- start 2024-09-13T19:16:19.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.344+0000 7fdbe8b3e800 1 -- start start 2024-09-13T19:16:19.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.344+0000 7fdbe8b3e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ae800000 0x55e4ae807330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.344+0000 7fdbe8b3e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e4ae800ec0 con 0x55e4ae800000 2024-09-13T19:16:19.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.344+0000 7fdbe5035640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ae800000 0x55e4ae807330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.344+0000 7fdbe5035640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ae800000 0x55e4ae807330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55560/0 (socket says 172.21.15.102:55560) 2024-09-13T19:16:19.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.344+0000 7fdbe5035640 1 -- 172.21.15.102:0/1139405864 learned_addr learned my addr 172.21.15.102:0/1139405864 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:19.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.344+0000 7fdbe5035640 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4ae807870 con 0x55e4ae800000 2024-09-13T19:16:19.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.344+0000 7fdbe5035640 1 --2- 172.21.15.102:0/1139405864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ae800000 0x55e4ae807330 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fdbe004cd60 tx=0x7fdbe004cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.345+0000 7fdaba7fc640 1 -- 172.21.15.102:0/1139405864 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbe0040360 con 0x55e4ae800000 2024-09-13T19:16:19.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.345+0000 7fdaba7fc640 1 -- 172.21.15.102:0/1139405864 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbe004e2b0 con 0x55e4ae800000 2024-09-13T19:16:19.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.345+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e4ae807b00 con 0x55e4ae800000 2024-09-13T19:16:19.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.345+0000 7fdaba7fc640 1 -- 172.21.15.102:0/1139405864 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbe004e590 con 0x55e4ae800000 2024-09-13T19:16:19.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.345+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4ae80a7b0 con 0x55e4ae800000 2024-09-13T19:16:19.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.345+0000 7fdaba7fc640 1 -- 172.21.15.102:0/1139405864 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fdbe003b020 con 0x55e4ae800000 2024-09-13T19:16:19.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.346+0000 7fdaba7fc640 1 --2- 172.21.15.102:0/1139405864 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdab0036b90 0x7fdab0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.346+0000 7fdaba7fc640 1 -- 172.21.15.102:0/1139405864 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fdbe0039020 con 0x55e4ae800000 2024-09-13T19:16:19.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.346+0000 7fdbe4834640 1 --2- 172.21.15.102:0/1139405864 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdab0036b90 0x7fdab0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.346+0000 7fdbe4834640 1 --2- 172.21.15.102:0/1139405864 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdab0036b90 0x7fdab0039050 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdbd401dfd0 tx=0x7fdbd4038000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.346+0000 7fdbe8b3e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.346+0000 7fdbe8b3e800 1 --2- 172.21.15.102:0/1139405864 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e4ae812e80 0x55e4ae815340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.346+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae815a90 con 0x55e4ae812e80 2024-09-13T19:16:19.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.346+0000 7fdbdc033640 1 --2- 172.21.15.102:0/1139405864 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e4ae812e80 0x55e4ae815340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.347+0000 7fdbdc033640 1 --2- 172.21.15.102:0/1139405864 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e4ae812e80 0x55e4ae815340 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.347+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdbcc057030 con 0x55e4ae812e80 2024-09-13T19:16:19.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.347+0000 7fdbe8b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:19.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.347+0000 7fdbe8b3e800 20 realm 2024-09-13T19:16:19.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.347+0000 7fdbe8b3e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.347+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae815ec0 con 0x55e4ae812e80 2024-09-13T19:16:19.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.347+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdbcc057030 con 0x55e4ae812e80 2024-09-13T19:16:19.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.347+0000 7fdbe8b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:19.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.347+0000 7fdbe8b3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:19.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.347+0000 7fdbe8b3e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.347+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae816790 con 0x55e4ae812e80 2024-09-13T19:16:19.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.347+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdbcc057030 con 0x55e4ae812e80 2024-09-13T19:16:19.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.347+0000 7fdbe8b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:19.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.347+0000 7fdbe8b3e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.347+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae816b30 con 0x55e4ae812e80 2024-09-13T19:16:19.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.348+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdbcc057030 con 0x55e4ae812e80 2024-09-13T19:16:19.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.348+0000 7fdbe8b3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:19.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.348+0000 7fdbe8b3e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.348+0000 7fdbe8b3e800 1 --2- 172.21.15.102:0/1139405864 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e4ae817890 0x55e4ae819c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.348+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae81a290 con 0x55e4ae817890 2024-09-13T19:16:19.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.348+0000 7fdbe5035640 1 --2- 172.21.15.102:0/1139405864 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e4ae817890 0x55e4ae819c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.348+0000 7fdbe5035640 1 --2- 172.21.15.102:0/1139405864 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e4ae817890 0x55e4ae819c80 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.348+0000 7fdbe5035640 1 -- 172.21.15.102:0/1139405864 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdbe000a4a0 con 0x55e4ae817890 2024-09-13T19:16:19.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.348+0000 7fdbe8b3e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:19.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.348+0000 7fdbe8b3e800 20 searching for the correct realm 2024-09-13T19:16:19.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.348+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae81bba0 con 0x55e4ae817890 2024-09-13T19:16:19.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.349+0000 7fdbe5035640 1 -- 172.21.15.102:0/1139405864 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbe000a4a0 con 0x55e4ae817890 2024-09-13T19:16:19.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.349+0000 7fdbe5035640 1 --2- 172.21.15.102:0/1139405864 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fdbe0044070 0x7fdbe003b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.349+0000 7fdbe5035640 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae81bba0 con 0x7fdbe0044070 2024-09-13T19:16:19.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.349+0000 7fdbe4834640 1 --2- 172.21.15.102:0/1139405864 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fdbe0044070 0x7fdbe003b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.349+0000 7fdbe4834640 1 --2- 172.21.15.102:0/1139405864 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fdbe0044070 0x7fdbe003b6a0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.349+0000 7fdbe4834640 1 -- 172.21.15.102:0/1139405864 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbd402e070 con 0x7fdbe0044070 2024-09-13T19:16:19.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.349+0000 7fdbe4834640 1 --2- 172.21.15.102:0/1139405864 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fdbd403e040 0x7fdbd403f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.349+0000 7fdbe4834640 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae81bba0 con 0x7fdbd403e040 2024-09-13T19:16:19.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.350+0000 7fdbdc033640 1 --2- 172.21.15.102:0/1139405864 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fdbd403e040 0x7fdbd403f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.350+0000 7fdbdc033640 1 --2- 172.21.15.102:0/1139405864 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fdbd403e040 0x7fdbd403f430 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.350+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbcc057030 con 0x7fdbd403e040 2024-09-13T19:16:19.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.350+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae81bba0 con 0x55e4ae812e80 2024-09-13T19:16:19.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.351+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbcc057030 con 0x55e4ae812e80 2024-09-13T19:16:19.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.351+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae81bba0 con 0x55e4ae812e80 2024-09-13T19:16:19.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.351+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbcc057030 con 0x55e4ae812e80 2024-09-13T19:16:19.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.351+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae81bba0 con 0x7fdbd403e040 2024-09-13T19:16:19.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.351+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbcc057030 con 0x7fdbd403e040 2024-09-13T19:16:19.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.351+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae81bba0 con 0x7fdbd403e040 2024-09-13T19:16:19.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.351+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbcc057030 con 0x7fdbd403e040 2024-09-13T19:16:19.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.351+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae81bba0 con 0x7fdbe0044070 2024-09-13T19:16:19.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.351+0000 7fdbe4834640 1 -- 172.21.15.102:0/1139405864 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbd402e070 con 0x7fdbe0044070 2024-09-13T19:16:19.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.352+0000 7fdbe4834640 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae81bba0 con 0x55e4ae817890 2024-09-13T19:16:19.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.352+0000 7fdbe5035640 1 -- 172.21.15.102:0/1139405864 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbe000a4a0 con 0x55e4ae817890 2024-09-13T19:16:19.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.352+0000 7fdbe5035640 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae81bba0 con 0x55e4ae812e80 2024-09-13T19:16:19.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.352+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbcc057030 con 0x55e4ae812e80 2024-09-13T19:16:19.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.352+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae81bba0 con 0x7fdbd403e040 2024-09-13T19:16:19.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.352+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbcc057030 con 0x7fdbd403e040 2024-09-13T19:16:19.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.352+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae81bba0 con 0x55e4ae812e80 2024-09-13T19:16:19.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.352+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbcc057030 con 0x55e4ae812e80 2024-09-13T19:16:19.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.352+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae81bba0 con 0x7fdbe0044070 2024-09-13T19:16:19.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.353+0000 7fdbe4834640 1 -- 172.21.15.102:0/1139405864 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdbd402e070 con 0x7fdbe0044070 2024-09-13T19:16:19.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.353+0000 7fdbe4834640 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae81bba0 con 0x55e4ae817890 2024-09-13T19:16:19.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.353+0000 7fdbe5035640 1 -- 172.21.15.102:0/1139405864 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbe000a4a0 con 0x55e4ae817890 2024-09-13T19:16:19.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.353+0000 7fdbe5035640 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae81bba0 con 0x55e4ae817890 2024-09-13T19:16:19.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.353+0000 7fdbe5035640 1 -- 172.21.15.102:0/1139405864 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdbe000a4a0 con 0x55e4ae817890 2024-09-13T19:16:19.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.353+0000 7fdbe5035640 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae81bba0 con 0x7fdbd403e040 2024-09-13T19:16:19.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.353+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbcc057030 con 0x7fdbd403e040 2024-09-13T19:16:19.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.353+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae81bba0 con 0x55e4ae817890 2024-09-13T19:16:19.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.354+0000 7fdbe5035640 1 -- 172.21.15.102:0/1139405864 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdbe000a4a0 con 0x55e4ae817890 2024-09-13T19:16:19.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.354+0000 7fdbe5035640 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae81bba0 con 0x55e4ae817890 2024-09-13T19:16:19.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.354+0000 7fdbe5035640 1 -- 172.21.15.102:0/1139405864 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbe000a4a0 con 0x55e4ae817890 2024-09-13T19:16:19.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.354+0000 7fdbe5035640 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae81bba0 con 0x55e4ae812e80 2024-09-13T19:16:19.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.354+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbcc057030 con 0x55e4ae812e80 2024-09-13T19:16:19.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.354+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae81bba0 con 0x55e4ae812e80 2024-09-13T19:16:19.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.354+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdbcc057030 con 0x55e4ae812e80 2024-09-13T19:16:19.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.354+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae81bba0 con 0x7fdbd403e040 2024-09-13T19:16:19.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.354+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbcc057030 con 0x7fdbd403e040 2024-09-13T19:16:19.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.355+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae81bba0 con 0x55e4ae817890 2024-09-13T19:16:19.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.355+0000 7fdbe5035640 1 -- 172.21.15.102:0/1139405864 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbe000a4a0 con 0x55e4ae817890 2024-09-13T19:16:19.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.355+0000 7fdbe5035640 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae81bba0 con 0x7fdbe0044070 2024-09-13T19:16:19.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.355+0000 7fdbe4834640 1 -- 172.21.15.102:0/1139405864 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbd402e070 con 0x7fdbe0044070 2024-09-13T19:16:19.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.355+0000 7fdbe4834640 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae81bba0 con 0x55e4ae812e80 2024-09-13T19:16:19.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.355+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbcc057030 con 0x55e4ae812e80 2024-09-13T19:16:19.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.355+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae81bba0 con 0x7fdbd403e040 2024-09-13T19:16:19.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.356+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbcc057030 con 0x7fdbd403e040 2024-09-13T19:16:19.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.356+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae81bba0 con 0x55e4ae817890 2024-09-13T19:16:19.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.356+0000 7fdbe5035640 1 -- 172.21.15.102:0/1139405864 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbe000a4a0 con 0x55e4ae817890 2024-09-13T19:16:19.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.356+0000 7fdbe5035640 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae81bba0 con 0x7fdbd403e040 2024-09-13T19:16:19.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.356+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbcc057030 con 0x7fdbd403e040 2024-09-13T19:16:19.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.356+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae81bba0 con 0x7fdbe0044070 2024-09-13T19:16:19.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.356+0000 7fdbe4834640 1 -- 172.21.15.102:0/1139405864 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbd402e070 con 0x7fdbe0044070 2024-09-13T19:16:19.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.356+0000 7fdbe4834640 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae81bba0 con 0x55e4ae817890 2024-09-13T19:16:19.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.357+0000 7fdbe5035640 1 -- 172.21.15.102:0/1139405864 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbe000a4a0 con 0x55e4ae817890 2024-09-13T19:16:19.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.357+0000 7fdbe5035640 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae81bba0 con 0x7fdbd403e040 2024-09-13T19:16:19.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.357+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbcc057030 con 0x7fdbd403e040 2024-09-13T19:16:19.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.357+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae81bba0 con 0x55e4ae812e80 2024-09-13T19:16:19.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.357+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdbcc057030 con 0x55e4ae812e80 2024-09-13T19:16:19.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.357+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fdbcc08a080 con 0x7fdbe0044070 2024-09-13T19:16:19.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.357+0000 7fdbe4834640 1 -- 172.21.15.102:0/1139405864 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbd4065040 con 0x7fdbe0044070 2024-09-13T19:16:19.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.357+0000 7fdbe8b3e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:19.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.357+0000 7fdbe8b3e800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:19.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.357+0000 7fdbe8b3e800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:19.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.357+0000 7fdbe8b3e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:19.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.357+0000 7fdbe8b3e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:19.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.357+0000 7fdbe8b3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:19.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.357+0000 7fdbe8b3e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.357+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae81aae0 con 0x55e4ae812e80 2024-09-13T19:16:19.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.358+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdbcc057030 con 0x55e4ae812e80 2024-09-13T19:16:19.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.358+0000 7fdbe8b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:19.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.358+0000 7fdbe8b3e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.358+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae81aed0 con 0x55e4ae812e80 2024-09-13T19:16:19.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.358+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdbcc057030 con 0x55e4ae812e80 2024-09-13T19:16:19.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.358+0000 7fdbe8b3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:19.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.358+0000 7fdbe8b3e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.358+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae81c020 con 0x55e4ae817890 2024-09-13T19:16:19.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.358+0000 7fdbe5035640 1 -- 172.21.15.102:0/1139405864 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdbe000a4a0 con 0x55e4ae817890 2024-09-13T19:16:19.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.358+0000 7fdbe8b3e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:19.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.358+0000 7fdbe8b3e800 20 zone default found 2024-09-13T19:16:19.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.358+0000 7fdbe8b3e800 4 Realm: () 2024-09-13T19:16:19.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.358+0000 7fdbe8b3e800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:19.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.358+0000 7fdbe8b3e800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:19.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.358+0000 7fdbe8b3e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:19.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.358+0000 7fdbe8b3e800 20 zonegroup default 2024-09-13T19:16:19.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.358+0000 7fdbe8b3e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.358+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae81c870 con 0x7fdbd403e040 2024-09-13T19:16:19.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.358+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdbcc057030 con 0x7fdbd403e040 2024-09-13T19:16:19.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.358+0000 7fdbe8b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:19.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.358+0000 7fdbe8b3e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.358+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae81e250 con 0x55e4ae817890 2024-09-13T19:16:19.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.359+0000 7fdbe5035640 1 -- 172.21.15.102:0/1139405864 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdbe000a4a0 con 0x55e4ae817890 2024-09-13T19:16:19.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.359+0000 7fdbe8b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:19.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.359+0000 7fdbe8b3e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.359+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae81e690 con 0x55e4ae817890 2024-09-13T19:16:19.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.359+0000 7fdbe5035640 1 -- 172.21.15.102:0/1139405864 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdbe000a4a0 con 0x55e4ae817890 2024-09-13T19:16:19.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.359+0000 7fdbe8b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:19.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.359+0000 7fdbe8b3e800 20 started sync module instance, tier type = 2024-09-13T19:16:19.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.359+0000 7fdbe8b3e800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:19.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.359+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae81d6e0 con 0x7fdbe0044070 2024-09-13T19:16:19.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.360+0000 7fdbe4834640 1 -- 172.21.15.102:0/1139405864 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(44 notify.0 [create] v34'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbd4065040 con 0x7fdbe0044070 2024-09-13T19:16:19.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.360+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94440668650192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae81efa0 con 0x7fdbe0044070 2024-09-13T19:16:19.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.360+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae81f7f0 con 0x55e4ae812e80 2024-09-13T19:16:19.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.361+0000 7fdbe4834640 1 -- 172.21.15.102:0/1139405864 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94440668650192] v34'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbd4065040 con 0x7fdbe0044070 2024-09-13T19:16:19.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.361+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v34'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbcc057030 con 0x55e4ae812e80 2024-09-13T19:16:19.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.361+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94440668654320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae81f7f0 con 0x55e4ae812e80 2024-09-13T19:16:19.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.361+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae820310 con 0x55e4ae817890 2024-09-13T19:16:19.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.362+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94440668654320] v34'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbcc057030 con 0x55e4ae812e80 2024-09-13T19:16:19.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.362+0000 7fdbe5035640 1 -- 172.21.15.102:0/1139405864 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v34'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbe000a4a0 con 0x55e4ae817890 2024-09-13T19:16:19.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.362+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94440668659168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae81f7f0 con 0x55e4ae817890 2024-09-13T19:16:19.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.362+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae820d60 con 0x7fdbe0044070 2024-09-13T19:16:19.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.363+0000 7fdbe5035640 1 -- 172.21.15.102:0/1139405864 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94440668659168] v34'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbe000a4a0 con 0x55e4ae817890 2024-09-13T19:16:19.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.363+0000 7fdbe4834640 1 -- 172.21.15.102:0/1139405864 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(50 notify.3 [create] v34'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbd4065040 con 0x7fdbe0044070 2024-09-13T19:16:19.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.363+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94440668656448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae81f760 con 0x7fdbe0044070 2024-09-13T19:16:19.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.363+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae821c20 con 0x55e4ae812e80 2024-09-13T19:16:19.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.364+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v34'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbcc057030 con 0x55e4ae812e80 2024-09-13T19:16:19.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.364+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94440668666192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae8223e0 con 0x55e4ae812e80 2024-09-13T19:16:19.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.364+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae822f00 con 0x7fdbd403e040 2024-09-13T19:16:19.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.364+0000 7fdbe4834640 1 -- 172.21.15.102:0/1139405864 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94440668656448] v34'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbd4065040 con 0x7fdbe0044070 2024-09-13T19:16:19.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.365+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(54 notify.5 [create] v34'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbcc057030 con 0x7fdbd403e040 2024-09-13T19:16:19.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.365+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94440668670416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae822ec0 con 0x7fdbd403e040 2024-09-13T19:16:19.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.365+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae823930 con 0x7fdbd403e040 2024-09-13T19:16:19.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.365+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94440668666192] v34'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbcc057030 con 0x55e4ae812e80 2024-09-13T19:16:19.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.366+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(56 notify.6 [create] v34'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbcc057030 con 0x7fdbd403e040 2024-09-13T19:16:19.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.366+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94440668673120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae823930 con 0x7fdbd403e040 2024-09-13T19:16:19.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.366+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae8242f0 con 0x7fdbd403e040 2024-09-13T19:16:19.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.367+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94440668670416] v34'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbcc057030 con 0x7fdbd403e040 2024-09-13T19:16:19.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.367+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(58 notify.7 [create] v34'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbcc057030 con 0x7fdbd403e040 2024-09-13T19:16:19.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.367+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94440668673120] v34'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbcc057030 con 0x7fdbd403e040 2024-09-13T19:16:19.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.367+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94440668664144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae8242f0 con 0x7fdbd403e040 2024-09-13T19:16:19.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.367+0000 7fdbe8b3e800 20 add_watcher() i=0 2024-09-13T19:16:19.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.367+0000 7fdbe8b3e800 20 add_watcher() i=1 2024-09-13T19:16:19.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.367+0000 7fdbe8b3e800 20 add_watcher() i=2 2024-09-13T19:16:19.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.367+0000 7fdbe8b3e800 20 add_watcher() i=3 2024-09-13T19:16:19.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.367+0000 7fdbe8b3e800 20 add_watcher() i=4 2024-09-13T19:16:19.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.367+0000 7fdbe8b3e800 20 add_watcher() i=5 2024-09-13T19:16:19.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.367+0000 7fdbe8b3e800 20 add_watcher() i=6 2024-09-13T19:16:19.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.368+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94440668664144] v34'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbcc057030 con 0x7fdbd403e040 2024-09-13T19:16:19.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.368+0000 7fdbe8b3e800 20 add_watcher() i=7 2024-09-13T19:16:19.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.368+0000 7fdbe8b3e800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:19.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.368+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae827320 con 0x55e4ae812e80 2024-09-13T19:16:19.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.369+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdbcc057030 con 0x55e4ae812e80 2024-09-13T19:16:19.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.369+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94440668675648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae824780 con 0x55e4ae812e80 2024-09-13T19:16:19.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.369+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94440668675648] v34'112 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdbcc057030 con 0x55e4ae812e80 2024-09-13T19:16:19.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.370+0000 7fda9afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:19.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.370+0000 7fdbe8b3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:19.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.370+0000 7fdbe8b3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:19.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.370+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae82fc50 con 0x55e4ae812e80 2024-09-13T19:16:19.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.371+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdbcc057030 con 0x55e4ae812e80 2024-09-13T19:16:19.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.371+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae830320 con 0x7fdbd403e040 2024-09-13T19:16:19.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.372+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'14 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdbcc057030 con 0x7fdbd403e040 2024-09-13T19:16:19.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.372+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae830740 con 0x55e4ae817890 2024-09-13T19:16:19.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.373+0000 7fdbe5035640 1 -- 172.21.15.102:0/1139405864 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdbe000a4a0 con 0x55e4ae817890 2024-09-13T19:16:19.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.373+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae8306c0 con 0x55e4ae812e80 2024-09-13T19:16:19.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.374+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'113 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdbcc057030 con 0x55e4ae812e80 2024-09-13T19:16:19.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.374+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae830c30 con 0x7fdbe0044070 2024-09-13T19:16:19.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.376+0000 7fdbe4834640 1 -- 172.21.15.102:0/1139405864 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'32 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdbd4065040 con 0x7fdbe0044070 2024-09-13T19:16:19.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.376+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae8311a0 con 0x55e4ae817890 2024-09-13T19:16:19.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.377+0000 7fdbe5035640 1 -- 172.21.15.102:0/1139405864 <== osd.3 v2:172.21.15.102:6800/3096737090 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'22 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdbe000a4a0 con 0x55e4ae817890 2024-09-13T19:16:19.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.377+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae8311a0 con 0x55e4ae812e80 2024-09-13T19:16:19.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.378+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdbcc057030 con 0x55e4ae812e80 2024-09-13T19:16:19.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.378+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae831230 con 0x7fdbd403e040 2024-09-13T19:16:19.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.379+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'21 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdbcc057030 con 0x7fdbd403e040 2024-09-13T19:16:19.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.379+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae8312c0 con 0x7fdbe0044070 2024-09-13T19:16:19.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.380+0000 7fdbe4834640 1 -- 172.21.15.102:0/1139405864 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdbd4065040 con 0x7fdbe0044070 2024-09-13T19:16:19.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.380+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae831770 con 0x55e4ae817890 2024-09-13T19:16:19.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.381+0000 7fdbe5035640 1 -- 172.21.15.102:0/1139405864 <== osd.3 v2:172.21.15.102:6800/3096737090 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdbe000a4a0 con 0x55e4ae817890 2024-09-13T19:16:19.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.381+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae831770 con 0x7fdbe0044070 2024-09-13T19:16:19.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.382+0000 7fdbe4834640 1 -- 172.21.15.102:0/1139405864 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'33 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdbd4065040 con 0x7fdbe0044070 2024-09-13T19:16:19.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.382+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae831770 con 0x7fdbd403e040 2024-09-13T19:16:19.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.383+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdbcc057030 con 0x7fdbd403e040 2024-09-13T19:16:19.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.383+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae831770 con 0x7fdbe0044070 2024-09-13T19:16:19.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.384+0000 7fdbe4834640 1 -- 172.21.15.102:0/1139405864 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdbd4065040 con 0x7fdbe0044070 2024-09-13T19:16:19.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.384+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae831770 con 0x7fdbd403e040 2024-09-13T19:16:19.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.385+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.0 v2:172.21.15.53:6800/4021716951 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'27 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdbcc057030 con 0x7fdbd403e040 2024-09-13T19:16:19.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.385+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae831770 con 0x55e4ae812e80 2024-09-13T19:16:19.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.386+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'114 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdbcc057030 con 0x55e4ae812e80 2024-09-13T19:16:19.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.386+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae831770 con 0x55e4ae817890 2024-09-13T19:16:19.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.387+0000 7fdbe5035640 1 -- 172.21.15.102:0/1139405864 <== osd.3 v2:172.21.15.102:6800/3096737090 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdbe000a4a0 con 0x55e4ae817890 2024-09-13T19:16:19.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.387+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae831770 con 0x7fdbe0044070 2024-09-13T19:16:19.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.389+0000 7fdbe4834640 1 -- 172.21.15.102:0/1139405864 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'34 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdbd4065040 con 0x7fdbe0044070 2024-09-13T19:16:19.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.389+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae831850 con 0x55e4ae817890 2024-09-13T19:16:19.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.389+0000 7fdbe5035640 1 -- 172.21.15.102:0/1139405864 <== osd.3 v2:172.21.15.102:6800/3096737090 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdbe000a4a0 con 0x55e4ae817890 2024-09-13T19:16:19.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.390+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae8312c0 con 0x55e4ae812e80 2024-09-13T19:16:19.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.391+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdbcc057030 con 0x55e4ae812e80 2024-09-13T19:16:19.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.391+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae831850 con 0x55e4ae812e80 2024-09-13T19:16:19.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.392+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'115 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdbcc057030 con 0x55e4ae812e80 2024-09-13T19:16:19.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.392+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae8313b0 con 0x55e4ae817890 2024-09-13T19:16:19.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.393+0000 7fdbe5035640 1 -- 172.21.15.102:0/1139405864 <== osd.3 v2:172.21.15.102:6800/3096737090 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'27 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdbe000a4a0 con 0x55e4ae817890 2024-09-13T19:16:19.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.393+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae8313b0 con 0x7fdbe0044070 2024-09-13T19:16:19.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.394+0000 7fdbe4834640 1 -- 172.21.15.102:0/1139405864 <== osd.2 v2:172.21.15.102:6816/2238176080 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'24 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdbd4065040 con 0x7fdbe0044070 2024-09-13T19:16:19.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.394+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae831350 con 0x55e4ae817890 2024-09-13T19:16:19.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.395+0000 7fdbe5035640 1 -- 172.21.15.102:0/1139405864 <== osd.3 v2:172.21.15.102:6800/3096737090 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdbe000a4a0 con 0x55e4ae817890 2024-09-13T19:16:19.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.395+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae831350 con 0x55e4ae817890 2024-09-13T19:16:19.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.396+0000 7fdbe5035640 1 -- 172.21.15.102:0/1139405864 <== osd.3 v2:172.21.15.102:6800/3096737090 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdbe000a4a0 con 0x55e4ae817890 2024-09-13T19:16:19.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.396+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae831350 con 0x55e4ae817890 2024-09-13T19:16:19.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.397+0000 7fdbe5035640 1 -- 172.21.15.102:0/1139405864 <== osd.3 v2:172.21.15.102:6800/3096737090 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdbe000a4a0 con 0x55e4ae817890 2024-09-13T19:16:19.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.397+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae831350 con 0x55e4ae817890 2024-09-13T19:16:19.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.398+0000 7fdbe5035640 1 -- 172.21.15.102:0/1139405864 <== osd.3 v2:172.21.15.102:6800/3096737090 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'23 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdbe000a4a0 con 0x55e4ae817890 2024-09-13T19:16:19.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.398+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae831350 con 0x7fdbd403e040 2024-09-13T19:16:19.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.399+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.0 v2:172.21.15.53:6800/4021716951 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdbcc057030 con 0x7fdbd403e040 2024-09-13T19:16:19.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.399+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae831350 con 0x55e4ae817890 2024-09-13T19:16:19.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.400+0000 7fdbe5035640 1 -- 172.21.15.102:0/1139405864 <== osd.3 v2:172.21.15.102:6800/3096737090 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdbe000a4a0 con 0x55e4ae817890 2024-09-13T19:16:19.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.400+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae831350 con 0x7fdbd403e040 2024-09-13T19:16:19.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.401+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.0 v2:172.21.15.53:6800/4021716951 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'22 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdbcc057030 con 0x7fdbd403e040 2024-09-13T19:16:19.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.401+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae831350 con 0x55e4ae817890 2024-09-13T19:16:19.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.402+0000 7fdbe5035640 1 -- 172.21.15.102:0/1139405864 <== osd.3 v2:172.21.15.102:6800/3096737090 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'28 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdbe000a4a0 con 0x55e4ae817890 2024-09-13T19:16:19.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.402+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae831350 con 0x7fdbd403e040 2024-09-13T19:16:19.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.403+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.0 v2:172.21.15.53:6800/4021716951 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'28 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdbcc057030 con 0x7fdbd403e040 2024-09-13T19:16:19.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.403+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae831350 con 0x7fdbe0044070 2024-09-13T19:16:19.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.404+0000 7fdbe4834640 1 -- 172.21.15.102:0/1139405864 <== osd.2 v2:172.21.15.102:6816/2238176080 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdbd4065040 con 0x7fdbe0044070 2024-09-13T19:16:19.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.404+0000 7fda99fe3640 20 reqs_thread_entry: start 2024-09-13T19:16:19.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.404+0000 7fdbe8b3e800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:19.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.404+0000 7fdbe8b3e800 20 Filter name: none 2024-09-13T19:16:19.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.404+0000 7fda0b7fe640 20 reqs_thread_entry: start 2024-09-13T19:16:19.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.404+0000 7fdbe8b3e800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T19:16:19.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.404+0000 7fdbe8b3e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.404+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae85c860 con 0x7fdbd403e040 2024-09-13T19:16:19.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.405+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.0 v2:172.21.15.53:6800/4021716951 24 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fdbcc057030 con 0x7fdbd403e040 2024-09-13T19:16:19.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.405+0000 7fdbe8b3e800 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T19:16:19.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.405+0000 7fdbe8b3e800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-13T19:16:19.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.405+0000 7fdbe8b3e800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T19:16:19.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.405+0000 7fdbe8b3e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:16:19.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.405+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae85f170 con 0x7fdbd403e040 2024-09-13T19:16:19.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.405+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.0 v2:172.21.15.53:6800/4021716951 25 ==== osd_op_reply(95 fud.buckets [call out=183b] v0'0 uv1 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fdbcc057030 con 0x7fdbd403e040 2024-09-13T19:16:19.410 INFO:teuthology.orchestra.run.smithi102.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-13T19:16:19.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.406+0000 7fda9afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:19.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.406+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94440668675648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae82eae0 con 0x55e4ae812e80 2024-09-13T19:16:19.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.407+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94440668675648] v34'116 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdbcc057030 con 0x55e4ae812e80 2024-09-13T19:16:19.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.407+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94440668650192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae82eae0 con 0x7fdbe0044070 2024-09-13T19:16:19.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.408+0000 7fdbe4834640 1 -- 172.21.15.102:0/1139405864 <== osd.2 v2:172.21.15.102:6816/2238176080 18 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94440668650192] v34'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbd4065040 con 0x7fdbe0044070 2024-09-13T19:16:19.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.408+0000 7fdbe8b3e800 20 remove_watcher() i=0 2024-09-13T19:16:19.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.408+0000 7fdbe8b3e800 2 removed watcher, disabling cache 2024-09-13T19:16:19.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.408+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94440668654320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae81dad0 con 0x55e4ae812e80 2024-09-13T19:16:19.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.409+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.1 v2:172.21.15.102:6808/2204418452 28 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94440668654320] v34'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbcc057030 con 0x55e4ae812e80 2024-09-13T19:16:19.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.409+0000 7fdbe8b3e800 20 remove_watcher() i=1 2024-09-13T19:16:19.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.409+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94440668659168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae81dad0 con 0x55e4ae817890 2024-09-13T19:16:19.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.410+0000 7fdbe5035640 1 -- 172.21.15.102:0/1139405864 <== osd.3 v2:172.21.15.102:6800/3096737090 28 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94440668659168] v34'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbe000a4a0 con 0x55e4ae817890 2024-09-13T19:16:19.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.410+0000 7fdbe8b3e800 20 remove_watcher() i=2 2024-09-13T19:16:19.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.410+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94440668656448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae81dad0 con 0x7fdbe0044070 2024-09-13T19:16:19.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.411+0000 7fdbe4834640 1 -- 172.21.15.102:0/1139405864 <== osd.2 v2:172.21.15.102:6816/2238176080 19 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94440668656448] v34'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbd4065040 con 0x7fdbe0044070 2024-09-13T19:16:19.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.411+0000 7fdbe8b3e800 20 remove_watcher() i=3 2024-09-13T19:16:19.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.411+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94440668666192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae81f340 con 0x55e4ae812e80 2024-09-13T19:16:19.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.412+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.1 v2:172.21.15.102:6808/2204418452 29 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94440668666192] v34'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbcc057030 con 0x55e4ae812e80 2024-09-13T19:16:19.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.412+0000 7fdbe8b3e800 20 remove_watcher() i=4 2024-09-13T19:16:19.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.412+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94440668670416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae81dad0 con 0x7fdbd403e040 2024-09-13T19:16:19.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.413+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.0 v2:172.21.15.53:6800/4021716951 26 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94440668670416] v34'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbcc057030 con 0x7fdbd403e040 2024-09-13T19:16:19.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.413+0000 7fdbe8b3e800 20 remove_watcher() i=5 2024-09-13T19:16:19.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.413+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94440668673120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae821950 con 0x7fdbd403e040 2024-09-13T19:16:19.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.414+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.0 v2:172.21.15.53:6800/4021716951 27 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94440668673120] v34'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbcc057030 con 0x7fdbd403e040 2024-09-13T19:16:19.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.414+0000 7fdbe8b3e800 20 remove_watcher() i=6 2024-09-13T19:16:19.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.414+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94440668664144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4ae81f340 con 0x7fdbd403e040 2024-09-13T19:16:19.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.415+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 <== osd.0 v2:172.21.15.53:6800/4021716951 28 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94440668664144] v34'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbcc057030 con 0x7fdbd403e040 2024-09-13T19:16:19.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.415+0000 7fdbe8b3e800 20 remove_watcher() i=7 2024-09-13T19:16:19.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.415+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fdbd403e040 msgr2=0x7fdbd403f430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.415+0000 7fdbe8b3e800 1 --2- 172.21.15.102:0/1139405864 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fdbd403e040 0x7fdbd403f430 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.415+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e4ae812e80 msgr2=0x55e4ae815340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.415+0000 7fdbe8b3e800 1 --2- 172.21.15.102:0/1139405864 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e4ae812e80 0x55e4ae815340 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.415+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fdbe0044070 msgr2=0x7fdbe003b6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.415+0000 7fdbe8b3e800 1 --2- 172.21.15.102:0/1139405864 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fdbe0044070 0x7fdbe003b6a0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.415+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e4ae817890 msgr2=0x55e4ae819c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.415+0000 7fdbe8b3e800 1 --2- 172.21.15.102:0/1139405864 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e4ae817890 0x55e4ae819c80 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.415+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdab0036b90 msgr2=0x7fdab0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.415+0000 7fdbe8b3e800 1 --2- 172.21.15.102:0/1139405864 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdab0036b90 0x7fdab0039050 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdbd401dfd0 tx=0x7fdbd4038000 comp rx=0 tx=0).stop 2024-09-13T19:16:19.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.415+0000 7fdbdc033640 1 -- 172.21.15.102:0/1139405864 reap_dead start 2024-09-13T19:16:19.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.415+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ae800000 msgr2=0x55e4ae807330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.415+0000 7fdbe8b3e800 1 --2- 172.21.15.102:0/1139405864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ae800000 0x55e4ae807330 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fdbe004cd60 tx=0x7fdbe004cd90 comp rx=0 tx=0).stop 2024-09-13T19:16:19.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.415+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 shutdown_connections 2024-09-13T19:16:19.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.415+0000 7fdbe8b3e800 1 --2- 172.21.15.102:0/1139405864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ae800000 0x55e4ae807330 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.415+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 >> 172.21.15.102:0/1139405864 conn(0x55e4ae7fc360 msgr2=0x55e4ae7fa430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:19.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.415+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 shutdown_connections 2024-09-13T19:16:19.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.415+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1139405864 wait complete. 2024-09-13T19:16:19.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.416+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/2443973058 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdabc036b90 msgr2=0x7fdabc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.416+0000 7fdbe8b3e800 1 --2- 172.21.15.102:0/2443973058 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdabc036b90 0x7fdabc039050 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x55e4ae7cdeb0 tx=0x7fdbd404b690 comp rx=0 tx=0).stop 2024-09-13T19:16:19.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.416+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/2443973058 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ae7f3340 msgr2=0x55e4ae7f3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.416+0000 7fdbe8b3e800 1 --2- 172.21.15.102:0/2443973058 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ae7f3340 0x55e4ae7f3760 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x55e4ae7ce8a0 tx=0x7fdbe00167b0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.416+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/2443973058 shutdown_connections 2024-09-13T19:16:19.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.416+0000 7fdbe8b3e800 1 --2- 172.21.15.102:0/2443973058 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdabc036b90 0x7fdabc039050 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.416+0000 7fdbe8b3e800 1 --2- 172.21.15.102:0/2443973058 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ae7f3340 0x55e4ae7f3760 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.416+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/2443973058 >> 172.21.15.102:0/2443973058 conn(0x55e4ae7e82d0 msgr2=0x55e4ae7eae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:19.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.416+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/2443973058 shutdown_connections 2024-09-13T19:16:19.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.416+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/2443973058 wait complete. 2024-09-13T19:16:19.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.416+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1445169454 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e4ae6e2900 msgr2=0x55e4ae7df650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.416+0000 7fdbe8b3e800 1 --2- 172.21.15.102:0/1445169454 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e4ae6e2900 0x55e4ae7df650 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.416+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1445169454 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e4ae7e1e10 msgr2=0x55e4ae7e4200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.416+0000 7fdbe8b3e800 1 --2- 172.21.15.102:0/1445169454 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e4ae7e1e10 0x55e4ae7e4200 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.416+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1445169454 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdacc036b40 msgr2=0x7fdacc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.416+0000 7fdbe8b3e800 1 --2- 172.21.15.102:0/1445169454 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdacc036b40 0x7fdacc039000 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc057000 tx=0x7fdbcc052000 comp rx=0 tx=0).stop 2024-09-13T19:16:19.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.416+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1445169454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ae6de4c0 msgr2=0x55e4ae7ceeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.416+0000 7fdbe8b3e800 1 --2- 172.21.15.102:0/1445169454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ae6de4c0 0x55e4ae7ceeb0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4000fd0 tx=0x7fdbd4000ed0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.416+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1445169454 shutdown_connections 2024-09-13T19:16:19.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.416+0000 7fdbe8b3e800 1 --2- 172.21.15.102:0/1445169454 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e4ae7e1e10 0x55e4ae7e4200 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.416+0000 7fdbe8b3e800 1 --2- 172.21.15.102:0/1445169454 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e4ae6e2900 0x55e4ae7df650 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.416+0000 7fdbe8b3e800 1 --2- 172.21.15.102:0/1445169454 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdacc036b40 0x7fdacc039000 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.416+0000 7fdbe8b3e800 1 --2- 172.21.15.102:0/1445169454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ae6de4c0 0x55e4ae7ceeb0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.416+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1445169454 >> 172.21.15.102:0/1445169454 conn(0x55e4ae6d9df0 msgr2=0x55e4ae7c7a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:19.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.416+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1445169454 shutdown_connections 2024-09-13T19:16:19.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.416+0000 7fdbe8b3e800 1 -- 172.21.15.102:0/1445169454 wait complete. 2024-09-13T19:16:19.428 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-13T19:16:19.428 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-13T19:16:19.428 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-13T19:16:19.429 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2024-09-13T19:16:19.515 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:19.516 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:19.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.513+0000 7f832e5af800 1 Processor -- start 2024-09-13T19:16:19.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.513+0000 7f832e5af800 1 -- start start 2024-09-13T19:16:19.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.513+0000 7f832e5af800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x563c29993630 0x563c29a24600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.513+0000 7f832e5af800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563c298deb30 con 0x563c29a24b40 2024-09-13T19:16:19.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.513+0000 7f832e5af800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x563c298c0360 con 0x563c29993630 2024-09-13T19:16:19.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.513+0000 7f832c0a3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x563c29993630 0x563c29a24600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.513+0000 7f832b8a2640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x563c29a24b40 0x563c29a26f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:50020/0 (socket says 172.21.15.102:50020) 2024-09-13T19:16:19.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.514+0000 7f832b8a2640 1 -- 172.21.15.102:0/295341132 learned_addr learned my addr 172.21.15.102:0/295341132 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:16:19.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.514+0000 7f832c0a3640 1 -- 172.21.15.102:0/295341132 >> v1:172.21.15.53:6789/0 conn(0x563c29a24b40 legacy=0x563c29a26f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.514+0000 7f832c0a3640 1 -- 172.21.15.102:0/295341132 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c298e6e00 con 0x563c29993630 2024-09-13T19:16:19.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.516+0000 7f832c0a3640 1 --2- 172.21.15.102:0/295341132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c29993630 0x563c29a24600 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f831c005fd0 tx=0x7f831c045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a586a9d5c1dc6b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.516+0000 7f832b0a1640 1 -- 172.21.15.102:0/295341132 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f831c058530 con 0x563c29993630 2024-09-13T19:16:19.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.516+0000 7f832b0a1640 1 -- 172.21.15.102:0/295341132 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f831c0586d0 con 0x563c29993630 2024-09-13T19:16:19.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.516+0000 7f832b0a1640 1 -- 172.21.15.102:0/295341132 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f831c0589d0 con 0x563c29993630 2024-09-13T19:16:19.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.516+0000 7f832e5af800 1 -- 172.21.15.102:0/295341132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c29993630 msgr2=0x563c29a24600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.516+0000 7f832e5af800 1 --2- 172.21.15.102:0/295341132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c29993630 0x563c29a24600 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f831c005fd0 tx=0x7f831c045c30 comp rx=0 tx=0).stop 2024-09-13T19:16:19.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.516+0000 7f832e5af800 1 -- 172.21.15.102:0/295341132 shutdown_connections 2024-09-13T19:16:19.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.516+0000 7f832e5af800 1 --2- 172.21.15.102:0/295341132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c29993630 0x563c29a24600 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.516+0000 7f832e5af800 1 -- 172.21.15.102:0/295341132 >> 172.21.15.102:0/295341132 conn(0x563c29a19db0 msgr2=0x563c29a1c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:19.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.516+0000 7f832e5af800 1 -- 172.21.15.102:0/295341132 shutdown_connections 2024-09-13T19:16:19.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.516+0000 7f832e5af800 1 -- 172.21.15.102:0/295341132 wait complete. 2024-09-13T19:16:19.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.530+0000 7f832e5af800 1 Processor -- start 2024-09-13T19:16:19.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.530+0000 7f832e5af800 1 -- start start 2024-09-13T19:16:19.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.530+0000 7f832e5af800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c29993630 0x563c29b10ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.530+0000 7f832e5af800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563c2996b360 con 0x563c29993630 2024-09-13T19:16:19.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.530+0000 7f832c0a3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c29993630 0x563c29b10ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.531+0000 7f832c0a3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c29993630 0x563c29b10ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55570/0 (socket says 172.21.15.102:55570) 2024-09-13T19:16:19.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.531+0000 7f832c0a3640 1 -- 172.21.15.102:0/3010467005 learned_addr learned my addr 172.21.15.102:0/3010467005 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:19.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.531+0000 7f832c0a3640 1 -- 172.21.15.102:0/3010467005 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c298b8bc0 con 0x563c29993630 2024-09-13T19:16:19.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.531+0000 7f832c0a3640 1 --2- 172.21.15.102:0/3010467005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c29993630 0x563c29b10ac0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f831c00a3f0 tx=0x7f831c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d5697edeac7669a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.531+0000 7f821a60c640 1 -- 172.21.15.102:0/3010467005 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f831c0589b0 con 0x563c29993630 2024-09-13T19:16:19.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.531+0000 7f821a60c640 1 -- 172.21.15.102:0/3010467005 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f831c068070 con 0x563c29993630 2024-09-13T19:16:19.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.531+0000 7f821a60c640 1 -- 172.21.15.102:0/3010467005 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f831c058c80 con 0x563c29993630 2024-09-13T19:16:19.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.532+0000 7f832e5af800 1 -- 172.21.15.102:0/3010467005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c29993630 msgr2=0x563c29b10ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.532+0000 7f832e5af800 1 --2- 172.21.15.102:0/3010467005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c29993630 0x563c29b10ac0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f831c00a3f0 tx=0x7f831c051000 comp rx=0 tx=0).stop 2024-09-13T19:16:19.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.532+0000 7f832e5af800 1 -- 172.21.15.102:0/3010467005 shutdown_connections 2024-09-13T19:16:19.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.532+0000 7f832e5af800 1 --2- 172.21.15.102:0/3010467005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c29993630 0x563c29b10ac0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.532+0000 7f832e5af800 1 -- 172.21.15.102:0/3010467005 >> 172.21.15.102:0/3010467005 conn(0x563c29a19db0 msgr2=0x563c29b0c480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:19.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.532+0000 7f832e5af800 1 -- 172.21.15.102:0/3010467005 shutdown_connections 2024-09-13T19:16:19.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.532+0000 7f832e5af800 1 -- 172.21.15.102:0/3010467005 wait complete. 2024-09-13T19:16:19.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.532+0000 7f832e5af800 1 Processor -- start 2024-09-13T19:16:19.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.532+0000 7f832e5af800 1 -- start start 2024-09-13T19:16:19.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.532+0000 7f832e5af800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c29993630 0x563c29b183f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.532+0000 7f832e5af800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563c29a28920 con 0x563c29993630 2024-09-13T19:16:19.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.533+0000 7f832c0a3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c29993630 0x563c29b183f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.533+0000 7f832c0a3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c29993630 0x563c29b183f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55578/0 (socket says 172.21.15.102:55578) 2024-09-13T19:16:19.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.533+0000 7f832c0a3640 1 -- 172.21.15.102:0/2107335274 learned_addr learned my addr 172.21.15.102:0/2107335274 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:19.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.533+0000 7f832c0a3640 1 -- 172.21.15.102:0/2107335274 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c298ccfe0 con 0x563c29993630 2024-09-13T19:16:19.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.533+0000 7f832c0a3640 1 --2- 172.21.15.102:0/2107335274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c29993630 0x563c29b183f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f831c065040 tx=0x7f831c003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.533+0000 7f8218e09640 1 -- 172.21.15.102:0/2107335274 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f831c063650 con 0x563c29993630 2024-09-13T19:16:19.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.533+0000 7f8218e09640 1 -- 172.21.15.102:0/2107335274 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f831c0637f0 con 0x563c29993630 2024-09-13T19:16:19.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.533+0000 7f832e5af800 1 -- 172.21.15.102:0/2107335274 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563c29b18930 con 0x563c29993630 2024-09-13T19:16:19.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.533+0000 7f8218e09640 1 -- 172.21.15.102:0/2107335274 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f831c063af0 con 0x563c29993630 2024-09-13T19:16:19.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.533+0000 7f832e5af800 1 -- 172.21.15.102:0/2107335274 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c29b18e50 con 0x563c29993630 2024-09-13T19:16:19.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.534+0000 7f8218e09640 1 -- 172.21.15.102:0/2107335274 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f831c074020 con 0x563c29993630 2024-09-13T19:16:19.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.534+0000 7f8218e09640 1 --2- 172.21.15.102:0/2107335274 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8214036be0 0x7f82140390a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.534+0000 7f8218e09640 1 -- 172.21.15.102:0/2107335274 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f831c090960 con 0x563c29993630 2024-09-13T19:16:19.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.534+0000 7f832b8a2640 1 --2- 172.21.15.102:0/2107335274 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8214036be0 0x7f82140390a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.535+0000 7f832e5af800 1 --2- 172.21.15.102:0/2107335274 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563c29a24b40 0x563c29b1f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.535+0000 7f832e5af800 1 -- 172.21.15.102:0/2107335274 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563c29b1f9a0 con 0x563c29a24b40 2024-09-13T19:16:19.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.535+0000 7f832c8a4640 1 --2- 172.21.15.102:0/2107335274 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563c29a24b40 0x563c29b1f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.535+0000 7f832b8a2640 1 --2- 172.21.15.102:0/2107335274 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8214036be0 0x7f82140390a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8320000f60 tx=0x7f83200012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.535+0000 7f832c8a4640 1 --2- 172.21.15.102:0/2107335274 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563c29a24b40 0x563c29b1f460 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.535+0000 7f832c8a4640 1 -- 172.21.15.102:0/2107335274 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83240083e0 con 0x563c29a24b40 2024-09-13T19:16:19.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.535+0000 7f832e5af800 1 -- 172.21.15.102:0/2107335274 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563c29b1ca10 con 0x563c29a24b40 2024-09-13T19:16:19.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.535+0000 7f832c8a4640 1 -- 172.21.15.102:0/2107335274 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f83240083e0 con 0x563c29a24b40 2024-09-13T19:16:19.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.535+0000 7f832e5af800 1 --2- 172.21.15.102:0/2107335274 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563c29b21c60 0x563c29b24050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.535+0000 7f832e5af800 1 -- 172.21.15.102:0/2107335274 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563c29b24720 con 0x563c29b21c60 2024-09-13T19:16:19.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.536+0000 7f832c0a3640 1 --2- 172.21.15.102:0/2107335274 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563c29b21c60 0x563c29b24050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.536+0000 7f832c0a3640 1 --2- 172.21.15.102:0/2107335274 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563c29b21c60 0x563c29b24050 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.536+0000 7f832c0a3640 1 -- 172.21.15.102:0/2107335274 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f831c06c3f0 con 0x563c29b21c60 2024-09-13T19:16:19.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.536+0000 7f832e5af800 1 -- 172.21.15.102:0/2107335274 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563c29b20b00 con 0x563c29a24b40 2024-09-13T19:16:19.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.536+0000 7f832c8a4640 1 -- 172.21.15.102:0/2107335274 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f83240083e0 con 0x563c29a24b40 2024-09-13T19:16:19.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.536+0000 7f832e5af800 1 -- 172.21.15.102:0/2107335274 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563c29b20fe0 con 0x563c29b21c60 2024-09-13T19:16:19.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.537+0000 7f832c0a3640 1 -- 172.21.15.102:0/2107335274 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f831c06c3f0 con 0x563c29b21c60 2024-09-13T19:16:19.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.537+0000 7f832e5af800 1 Processor -- start 2024-09-13T19:16:19.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.537+0000 7f832e5af800 1 -- start start 2024-09-13T19:16:19.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.537+0000 7f832e5af800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c29b33100 0x563c29b33520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.537+0000 7f832e5af800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563c298ba580 con 0x563c29b33100 2024-09-13T19:16:19.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.537+0000 7f832c8a4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c29b33100 0x563c29b33520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.537+0000 7f832c8a4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c29b33100 0x563c29b33520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55582/0 (socket says 172.21.15.102:55582) 2024-09-13T19:16:19.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.537+0000 7f832c8a4640 1 -- 172.21.15.102:0/750865081 learned_addr learned my addr 172.21.15.102:0/750865081 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:19.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.538+0000 7f832c8a4640 1 -- 172.21.15.102:0/750865081 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c29b33a60 con 0x563c29b33100 2024-09-13T19:16:19.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.538+0000 7f832c8a4640 1 --2- 172.21.15.102:0/750865081 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c29b33100 0x563c29b33520 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x563c29b197f0 tx=0x7f832400beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.538+0000 7f8211ffb640 1 -- 172.21.15.102:0/750865081 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f832401c020 con 0x563c29b33100 2024-09-13T19:16:19.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.538+0000 7f8211ffb640 1 -- 172.21.15.102:0/750865081 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8324007c30 con 0x563c29b33100 2024-09-13T19:16:19.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.538+0000 7f832e5af800 1 -- 172.21.15.102:0/750865081 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563c29b33cf0 con 0x563c29b33100 2024-09-13T19:16:19.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.538+0000 7f8211ffb640 1 -- 172.21.15.102:0/750865081 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8324018440 con 0x563c29b33100 2024-09-13T19:16:19.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.538+0000 7f832e5af800 1 -- 172.21.15.102:0/750865081 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c29b369d0 con 0x563c29b33100 2024-09-13T19:16:19.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.539+0000 7f8211ffb640 1 -- 172.21.15.102:0/750865081 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f832401f020 con 0x563c29b33100 2024-09-13T19:16:19.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.539+0000 7f8211ffb640 1 --2- 172.21.15.102:0/750865081 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8204036b40 0x7f8204039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.539+0000 7f8211ffb640 1 -- 172.21.15.102:0/750865081 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f832404e2e0 con 0x563c29b33100 2024-09-13T19:16:19.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.539+0000 7f832c0a3640 1 --2- 172.21.15.102:0/750865081 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8204036b40 0x7f8204039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.540+0000 7f832e5af800 1 Processor -- start 2024-09-13T19:16:19.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.540+0000 7f832e5af800 1 -- start start 2024-09-13T19:16:19.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.540+0000 7f832c0a3640 1 --2- 172.21.15.102:0/750865081 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8204036b40 0x7f8204039000 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f831c00a3f0 tx=0x7f831c06c8c0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.540+0000 7f832e5af800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c29b3fdd0 0x563c29b401d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.540+0000 7f832e5af800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563c29b111b0 con 0x563c29b3fdd0 2024-09-13T19:16:19.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.540+0000 7f832c8a4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c29b3fdd0 0x563c29b401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.540+0000 7f832c8a4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c29b3fdd0 0x563c29b401d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55596/0 (socket says 172.21.15.102:55596) 2024-09-13T19:16:19.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.540+0000 7f832c8a4640 1 -- 172.21.15.102:0/3502836899 learned_addr learned my addr 172.21.15.102:0/3502836899 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:19.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.540+0000 7f832c8a4640 1 -- 172.21.15.102:0/3502836899 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c29b407a0 con 0x563c29b3fdd0 2024-09-13T19:16:19.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.541+0000 7f832c8a4640 1 --2- 172.21.15.102:0/3502836899 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c29b3fdd0 0x563c29b401d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f832404c660 tx=0x7f832404c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eb944bc6fbb17a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.541+0000 7f820b7fe640 1 -- 172.21.15.102:0/3502836899 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83240207d0 con 0x563c29b3fdd0 2024-09-13T19:16:19.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.541+0000 7f820b7fe640 1 -- 172.21.15.102:0/3502836899 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8324021400 con 0x563c29b3fdd0 2024-09-13T19:16:19.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.541+0000 7f820b7fe640 1 -- 172.21.15.102:0/3502836899 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8324018b50 con 0x563c29b3fdd0 2024-09-13T19:16:19.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.541+0000 7f832e5af800 1 -- 172.21.15.102:0/3502836899 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c29b3fdd0 msgr2=0x563c29b401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.541+0000 7f832e5af800 1 --2- 172.21.15.102:0/3502836899 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c29b3fdd0 0x563c29b401d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f832404c660 tx=0x7f832404c8e0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.541+0000 7f832e5af800 1 -- 172.21.15.102:0/3502836899 shutdown_connections 2024-09-13T19:16:19.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.541+0000 7f832e5af800 1 --2- 172.21.15.102:0/3502836899 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c29b3fdd0 0x563c29b401d0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.541+0000 7f832e5af800 1 -- 172.21.15.102:0/3502836899 >> 172.21.15.102:0/3502836899 conn(0x563c29b3c130 msgr2=0x563c29b3a230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:19.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.541+0000 7f832e5af800 1 -- 172.21.15.102:0/3502836899 shutdown_connections 2024-09-13T19:16:19.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.541+0000 7f832e5af800 1 -- 172.21.15.102:0/3502836899 wait complete. 2024-09-13T19:16:19.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.542+0000 7f832e5af800 1 Processor -- start 2024-09-13T19:16:19.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.542+0000 7f832e5af800 1 -- start start 2024-09-13T19:16:19.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.542+0000 7f832e5af800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c29b3fdd0 0x563c29b471e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.542+0000 7f832e5af800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563c29b40d20 con 0x563c29b3fdd0 2024-09-13T19:16:19.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.542+0000 7f832c8a4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c29b3fdd0 0x563c29b471e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.542+0000 7f832c8a4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c29b3fdd0 0x563c29b471e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55598/0 (socket says 172.21.15.102:55598) 2024-09-13T19:16:19.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.542+0000 7f832c8a4640 1 -- 172.21.15.102:0/711818314 learned_addr learned my addr 172.21.15.102:0/711818314 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:19.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.542+0000 7f832c8a4640 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c29b47720 con 0x563c29b3fdd0 2024-09-13T19:16:19.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.542+0000 7f832c8a4640 1 --2- 172.21.15.102:0/711818314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c29b3fdd0 0x563c29b471e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f83240168b0 tx=0x7f832404b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.543+0000 7f8209ffb640 1 -- 172.21.15.102:0/711818314 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8324018630 con 0x563c29b3fdd0 2024-09-13T19:16:19.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.543+0000 7f8209ffb640 1 -- 172.21.15.102:0/711818314 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83240187d0 con 0x563c29b3fdd0 2024-09-13T19:16:19.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.543+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563c29b479b0 con 0x563c29b3fdd0 2024-09-13T19:16:19.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.543+0000 7f8209ffb640 1 -- 172.21.15.102:0/711818314 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8324020a90 con 0x563c29b3fdd0 2024-09-13T19:16:19.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.543+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c29b479b0 con 0x563c29b3fdd0 2024-09-13T19:16:19.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.543+0000 7f8209ffb640 1 -- 172.21.15.102:0/711818314 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8324016040 con 0x563c29b3fdd0 2024-09-13T19:16:19.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.544+0000 7f8209ffb640 1 --2- 172.21.15.102:0/711818314 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f81fc036b90 0x7f81fc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.544+0000 7f8209ffb640 1 -- 172.21.15.102:0/711818314 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f832402cb30 con 0x563c29b3fdd0 2024-09-13T19:16:19.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.544+0000 7f832c0a3640 1 --2- 172.21.15.102:0/711818314 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f81fc036b90 0x7f81fc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.544+0000 7f832c0a3640 1 --2- 172.21.15.102:0/711818314 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f81fc036b90 0x7f81fc039050 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f831c06c700 tx=0x7f831c094000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.544+0000 7f832e5af800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.544+0000 7f832e5af800 1 --2- 172.21.15.102:0/711818314 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563c29b52b20 0x563c29b54fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.544+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563c29b55730 con 0x563c29b52b20 2024-09-13T19:16:19.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.544+0000 7f832b8a2640 1 --2- 172.21.15.102:0/711818314 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563c29b52b20 0x563c29b54fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.545+0000 7f832b8a2640 1 --2- 172.21.15.102:0/711818314 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563c29b52b20 0x563c29b54fe0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.545+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8320009050 con 0x563c29b52b20 2024-09-13T19:16:19.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.545+0000 7f832e5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:19.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.545+0000 7f832e5af800 20 realm 2024-09-13T19:16:19.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.545+0000 7f832e5af800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.545+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563c29b51f70 con 0x563c29b52b20 2024-09-13T19:16:19.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.545+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8320009050 con 0x563c29b52b20 2024-09-13T19:16:19.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.545+0000 7f832e5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:19.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.545+0000 7f832e5af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:19.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.545+0000 7f832e5af800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.545+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563c29b56220 con 0x563c29b52b20 2024-09-13T19:16:19.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.545+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8320009050 con 0x563c29b52b20 2024-09-13T19:16:19.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.545+0000 7f832e5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:19.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.545+0000 7f832e5af800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.545+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563c29b56af0 con 0x563c29b52b20 2024-09-13T19:16:19.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.546+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8320009050 con 0x563c29b52b20 2024-09-13T19:16:19.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.546+0000 7f832e5af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:19.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.546+0000 7f832e5af800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.546+0000 7f832e5af800 1 --2- 172.21.15.102:0/711818314 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563c29b57430 0x563c29b59820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.546+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563c29b59fb0 con 0x563c29b57430 2024-09-13T19:16:19.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.546+0000 7f832c8a4640 1 --2- 172.21.15.102:0/711818314 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563c29b57430 0x563c29b59820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.546+0000 7f832c8a4640 1 --2- 172.21.15.102:0/711818314 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563c29b57430 0x563c29b59820 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.546+0000 7f832c8a4640 1 -- 172.21.15.102:0/711818314 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f832403d020 con 0x563c29b57430 2024-09-13T19:16:19.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.546+0000 7f832e5af800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:19.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.546+0000 7f832e5af800 20 searching for the correct realm 2024-09-13T19:16:19.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.546+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563c29b5b900 con 0x563c29b57430 2024-09-13T19:16:19.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.547+0000 7f832c8a4640 1 -- 172.21.15.102:0/711818314 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f832403d020 con 0x563c29b57430 2024-09-13T19:16:19.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.547+0000 7f832c8a4640 1 --2- 172.21.15.102:0/711818314 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f8324021020 0x7f832402c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.547+0000 7f832c8a4640 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563c29b5b900 con 0x7f8324021020 2024-09-13T19:16:19.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.547+0000 7f832c0a3640 1 --2- 172.21.15.102:0/711818314 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f8324021020 0x7f832402c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.547+0000 7f832c0a3640 1 --2- 172.21.15.102:0/711818314 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f8324021020 0x7f832402c030 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.547+0000 7f832c0a3640 1 -- 172.21.15.102:0/711818314 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f831c09a040 con 0x7f8324021020 2024-09-13T19:16:19.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.547+0000 7f832c0a3640 1 --2- 172.21.15.102:0/711818314 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f831c090050 0x7f831c086680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.547+0000 7f832c0a3640 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563c29b5b900 con 0x7f831c090050 2024-09-13T19:16:19.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.547+0000 7f832b8a2640 1 --2- 172.21.15.102:0/711818314 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f831c090050 0x7f831c086680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.548+0000 7f832b8a2640 1 --2- 172.21.15.102:0/711818314 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f831c090050 0x7f831c086680 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.548+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8320009050 con 0x7f831c090050 2024-09-13T19:16:19.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.548+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563c29b5b900 con 0x563c29b52b20 2024-09-13T19:16:19.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.548+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8320009050 con 0x563c29b52b20 2024-09-13T19:16:19.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.548+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563c29b5b900 con 0x563c29b52b20 2024-09-13T19:16:19.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.549+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8320029040 con 0x563c29b52b20 2024-09-13T19:16:19.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.549+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563c29b5b900 con 0x7f831c090050 2024-09-13T19:16:19.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.549+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8320029040 con 0x7f831c090050 2024-09-13T19:16:19.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.549+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563c29b5b900 con 0x7f831c090050 2024-09-13T19:16:19.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.549+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8320029040 con 0x7f831c090050 2024-09-13T19:16:19.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.549+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563c29b5b900 con 0x7f8324021020 2024-09-13T19:16:19.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.549+0000 7f832c0a3640 1 -- 172.21.15.102:0/711818314 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f831c09a040 con 0x7f8324021020 2024-09-13T19:16:19.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.549+0000 7f832c0a3640 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563c29b5b900 con 0x563c29b57430 2024-09-13T19:16:19.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.550+0000 7f832c8a4640 1 -- 172.21.15.102:0/711818314 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f832403d020 con 0x563c29b57430 2024-09-13T19:16:19.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.550+0000 7f832c8a4640 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563c29b5b900 con 0x563c29b52b20 2024-09-13T19:16:19.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.550+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8320029040 con 0x563c29b52b20 2024-09-13T19:16:19.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.550+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563c29b5b900 con 0x7f831c090050 2024-09-13T19:16:19.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.550+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8320029040 con 0x7f831c090050 2024-09-13T19:16:19.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.550+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563c29b5b900 con 0x563c29b52b20 2024-09-13T19:16:19.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.550+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8320029040 con 0x563c29b52b20 2024-09-13T19:16:19.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.550+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563c29b5b900 con 0x7f8324021020 2024-09-13T19:16:19.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.550+0000 7f832c0a3640 1 -- 172.21.15.102:0/711818314 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f831c09a040 con 0x7f8324021020 2024-09-13T19:16:19.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.551+0000 7f832c0a3640 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563c29b5b900 con 0x563c29b57430 2024-09-13T19:16:19.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.551+0000 7f832c8a4640 1 -- 172.21.15.102:0/711818314 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f832403d020 con 0x563c29b57430 2024-09-13T19:16:19.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.551+0000 7f832c8a4640 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563c29b5b900 con 0x563c29b57430 2024-09-13T19:16:19.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.551+0000 7f832c8a4640 1 -- 172.21.15.102:0/711818314 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f832403d020 con 0x563c29b57430 2024-09-13T19:16:19.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.551+0000 7f832c8a4640 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563c29b5b900 con 0x7f831c090050 2024-09-13T19:16:19.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.551+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8320029040 con 0x7f831c090050 2024-09-13T19:16:19.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.551+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563c29b5b900 con 0x563c29b57430 2024-09-13T19:16:19.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.551+0000 7f832c8a4640 1 -- 172.21.15.102:0/711818314 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f832403d020 con 0x563c29b57430 2024-09-13T19:16:19.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.551+0000 7f832c8a4640 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563c29b5b900 con 0x563c29b57430 2024-09-13T19:16:19.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.552+0000 7f832c8a4640 1 -- 172.21.15.102:0/711818314 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f832403d020 con 0x563c29b57430 2024-09-13T19:16:19.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.552+0000 7f832c8a4640 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563c29b5b900 con 0x563c29b52b20 2024-09-13T19:16:19.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.552+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8320029040 con 0x563c29b52b20 2024-09-13T19:16:19.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.552+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563c29b5b900 con 0x563c29b52b20 2024-09-13T19:16:19.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.552+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8320029040 con 0x563c29b52b20 2024-09-13T19:16:19.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.552+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563c29b5b900 con 0x7f831c090050 2024-09-13T19:16:19.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.552+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8320029040 con 0x7f831c090050 2024-09-13T19:16:19.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.552+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563c29b5b900 con 0x563c29b57430 2024-09-13T19:16:19.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.553+0000 7f832c8a4640 1 -- 172.21.15.102:0/711818314 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f832403d020 con 0x563c29b57430 2024-09-13T19:16:19.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.553+0000 7f832c8a4640 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563c29b5b900 con 0x7f8324021020 2024-09-13T19:16:19.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.553+0000 7f832c0a3640 1 -- 172.21.15.102:0/711818314 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f831c09a040 con 0x7f8324021020 2024-09-13T19:16:19.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.553+0000 7f832c0a3640 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563c29b5b900 con 0x563c29b52b20 2024-09-13T19:16:19.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.553+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8320029040 con 0x563c29b52b20 2024-09-13T19:16:19.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.553+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563c29b5b900 con 0x7f831c090050 2024-09-13T19:16:19.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.553+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8320029040 con 0x7f831c090050 2024-09-13T19:16:19.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.553+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563c29b5b900 con 0x563c29b57430 2024-09-13T19:16:19.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.554+0000 7f832c8a4640 1 -- 172.21.15.102:0/711818314 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f832403d020 con 0x563c29b57430 2024-09-13T19:16:19.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.554+0000 7f832c8a4640 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563c29b5b900 con 0x7f831c090050 2024-09-13T19:16:19.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.554+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8320029040 con 0x7f831c090050 2024-09-13T19:16:19.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.554+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563c29b5b900 con 0x7f8324021020 2024-09-13T19:16:19.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.554+0000 7f832c0a3640 1 -- 172.21.15.102:0/711818314 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f831c09a040 con 0x7f8324021020 2024-09-13T19:16:19.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.554+0000 7f832c0a3640 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563c29b5b900 con 0x563c29b57430 2024-09-13T19:16:19.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.554+0000 7f832c8a4640 1 -- 172.21.15.102:0/711818314 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f832403d020 con 0x563c29b57430 2024-09-13T19:16:19.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.554+0000 7f832c8a4640 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563c29b5b900 con 0x7f831c090050 2024-09-13T19:16:19.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.555+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8320029040 con 0x7f831c090050 2024-09-13T19:16:19.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.555+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563c29b5b900 con 0x563c29b52b20 2024-09-13T19:16:19.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.555+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8320029040 con 0x563c29b52b20 2024-09-13T19:16:19.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.555+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563c29b5b900 con 0x7f8324021020 2024-09-13T19:16:19.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.555+0000 7f832c0a3640 1 -- 172.21.15.102:0/711818314 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f831c09a040 con 0x7f8324021020 2024-09-13T19:16:19.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.555+0000 7f832e5af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:19.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.555+0000 7f832e5af800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:19.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.555+0000 7f832e5af800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:19.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.555+0000 7f832e5af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:19.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.555+0000 7f832e5af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:19.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.555+0000 7f832e5af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:19.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.555+0000 7f832e5af800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.555+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563c29b5a9a0 con 0x563c29b52b20 2024-09-13T19:16:19.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.555+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8320029040 con 0x563c29b52b20 2024-09-13T19:16:19.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.555+0000 7f832e5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:19.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.555+0000 7f832e5af800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.555+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563c29b5b240 con 0x563c29b52b20 2024-09-13T19:16:19.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.556+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8320029040 con 0x563c29b52b20 2024-09-13T19:16:19.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.556+0000 7f832e5af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:19.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.556+0000 7f832e5af800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.556+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563c29b5bd80 con 0x563c29b57430 2024-09-13T19:16:19.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.556+0000 7f832c8a4640 1 -- 172.21.15.102:0/711818314 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f832403d020 con 0x563c29b57430 2024-09-13T19:16:19.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.556+0000 7f832e5af800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:19.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.556+0000 7f832e5af800 20 zone default found 2024-09-13T19:16:19.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.556+0000 7f832e5af800 4 Realm: () 2024-09-13T19:16:19.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.556+0000 7f832e5af800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:19.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.556+0000 7f832e5af800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:19.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.556+0000 7f832e5af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:19.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.556+0000 7f832e5af800 20 zonegroup default 2024-09-13T19:16:19.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.556+0000 7f832e5af800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.556+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563c29b5c5d0 con 0x7f831c090050 2024-09-13T19:16:19.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.556+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8320029040 con 0x7f831c090050 2024-09-13T19:16:19.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.556+0000 7f832e5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:19.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.556+0000 7f832e5af800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.556+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563c29b5e350 con 0x563c29b57430 2024-09-13T19:16:19.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.556+0000 7f832c8a4640 1 -- 172.21.15.102:0/711818314 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f832403d020 con 0x563c29b57430 2024-09-13T19:16:19.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.557+0000 7f832e5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:19.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.557+0000 7f832e5af800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.557+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563c29b5e7b0 con 0x563c29b57430 2024-09-13T19:16:19.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.557+0000 7f832c8a4640 1 -- 172.21.15.102:0/711818314 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f832403d020 con 0x563c29b57430 2024-09-13T19:16:19.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.557+0000 7f832e5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:19.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.557+0000 7f832e5af800 20 started sync module instance, tier type = 2024-09-13T19:16:19.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.557+0000 7f832e5af800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:19.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.557+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563c29b5d7f0 con 0x7f8324021020 2024-09-13T19:16:19.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.558+0000 7f832c0a3640 1 -- 172.21.15.102:0/711818314 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(44 notify.0 [create] v34'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f831c09a040 con 0x7f8324021020 2024-09-13T19:16:19.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.558+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94816397808448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563c29b5ec10 con 0x7f8324021020 2024-09-13T19:16:19.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.558+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563c29b5f460 con 0x563c29b52b20 2024-09-13T19:16:19.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.559+0000 7f832c0a3640 1 -- 172.21.15.102:0/711818314 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94816397808448] v34'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f831c09a040 con 0x7f8324021020 2024-09-13T19:16:19.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.559+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v34'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8320029040 con 0x563c29b52b20 2024-09-13T19:16:19.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.559+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94816397810704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563c29b5f200 con 0x563c29b52b20 2024-09-13T19:16:19.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.559+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563c29b5fd20 con 0x563c29b57430 2024-09-13T19:16:19.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.560+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94816397810704] v34'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8320029040 con 0x563c29b52b20 2024-09-13T19:16:19.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.560+0000 7f832c8a4640 1 -- 172.21.15.102:0/711818314 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v34'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f832403d020 con 0x563c29b57430 2024-09-13T19:16:19.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.560+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94816397817840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563c29b5fce0 con 0x563c29b57430 2024-09-13T19:16:19.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.560+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563c29b60790 con 0x7f8324021020 2024-09-13T19:16:19.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.561+0000 7f832c8a4640 1 -- 172.21.15.102:0/711818314 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94816397817840] v34'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f832403d020 con 0x563c29b57430 2024-09-13T19:16:19.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.561+0000 7f832c0a3640 1 -- 172.21.15.102:0/711818314 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(50 notify.3 [create] v34'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f831c09a040 con 0x7f8324021020 2024-09-13T19:16:19.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.562+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94816397814864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563c29b60790 con 0x7f8324021020 2024-09-13T19:16:19.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.562+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563c29b61250 con 0x563c29b52b20 2024-09-13T19:16:19.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.563+0000 7f832c0a3640 1 -- 172.21.15.102:0/711818314 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94816397814864] v34'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f831c09a040 con 0x7f8324021020 2024-09-13T19:16:19.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.563+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v34'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8320029040 con 0x563c29b52b20 2024-09-13T19:16:19.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.563+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94816397823264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563c29b60790 con 0x563c29b52b20 2024-09-13T19:16:19.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.563+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563c29b61cc0 con 0x7f831c090050 2024-09-13T19:16:19.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.564+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(54 notify.5 [create] v34'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8320029040 con 0x7f831c090050 2024-09-13T19:16:19.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.564+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94816397823264] v34'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8320029040 con 0x563c29b52b20 2024-09-13T19:16:19.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.564+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94816397825968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563c29b62170 con 0x7f831c090050 2024-09-13T19:16:19.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.564+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563c29b602e0 con 0x7f831c090050 2024-09-13T19:16:19.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.565+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94816397825968] v34'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8320029040 con 0x7f831c090050 2024-09-13T19:16:19.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.565+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(56 notify.6 [create] v34'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8320029040 con 0x7f831c090050 2024-09-13T19:16:19.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.565+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94816397827200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563c29b620a0 con 0x7f831c090050 2024-09-13T19:16:19.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.565+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563c29b630d0 con 0x7f831c090050 2024-09-13T19:16:19.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.566+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94816397827200] v34'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8320029040 con 0x7f831c090050 2024-09-13T19:16:19.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.566+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(58 notify.7 [create] v34'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8320029040 con 0x7f831c090050 2024-09-13T19:16:19.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.566+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94816397829936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563c29b63000 con 0x7f831c090050 2024-09-13T19:16:19.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.566+0000 7f832e5af800 20 add_watcher() i=0 2024-09-13T19:16:19.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.566+0000 7f832e5af800 20 add_watcher() i=1 2024-09-13T19:16:19.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.566+0000 7f832e5af800 20 add_watcher() i=2 2024-09-13T19:16:19.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.566+0000 7f832e5af800 20 add_watcher() i=3 2024-09-13T19:16:19.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.566+0000 7f832e5af800 20 add_watcher() i=4 2024-09-13T19:16:19.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.566+0000 7f832e5af800 20 add_watcher() i=5 2024-09-13T19:16:19.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.566+0000 7f832e5af800 20 add_watcher() i=6 2024-09-13T19:16:19.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.567+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94816397829936] v34'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8320029040 con 0x7f831c090050 2024-09-13T19:16:19.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.567+0000 7f832e5af800 20 add_watcher() i=7 2024-09-13T19:16:19.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.567+0000 7f832e5af800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:19.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.567+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563c29b664f0 con 0x563c29b52b20 2024-09-13T19:16:19.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.567+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8320029040 con 0x563c29b52b20 2024-09-13T19:16:19.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.567+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94816397831456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563c29b639f0 con 0x563c29b52b20 2024-09-13T19:16:19.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.568+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94816397831456] v34'117 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8320029040 con 0x563c29b52b20 2024-09-13T19:16:19.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.568+0000 7f81e27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:19.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.568+0000 7f832e5af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:19.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.568+0000 7f832e5af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:19.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.568+0000 7f832e5af800 5 note: GC not initialized 2024-09-13T19:16:19.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.568+0000 7f81e17e2640 20 reqs_thread_entry: start 2024-09-13T19:16:19.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.569+0000 7f832e5af800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:19.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.569+0000 7f832e5af800 20 Filter name: none 2024-09-13T19:16:19.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.569+0000 7f8152ffd640 20 reqs_thread_entry: start 2024-09-13T19:16:19.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.569+0000 7f832e5af800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T19:16:19.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.569+0000 7f832e5af800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.569+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563c29b998f0 con 0x7f831c090050 2024-09-13T19:16:19.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.569+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f8320029040 con 0x7f831c090050 2024-09-13T19:16:19.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.569+0000 7f832e5af800 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T19:16:19.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.569+0000 7f832e5af800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-13T19:16:19.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.569+0000 7f832e5af800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T19:16:19.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.569+0000 7f832e5af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:16:19.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.569+0000 7f832e5af800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T19:16:19.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.569+0000 7f832e5af800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.569+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563c29b9b9d0 con 0x7f8324021020 2024-09-13T19:16:19.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.570+0000 7f832c0a3640 1 -- 172.21.15.102:0/711818314 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv22 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f831c09a040 con 0x7f8324021020 2024-09-13T19:16:19.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.570+0000 7f832e5af800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:16:19.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.570+0000 7f832e5af800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T19:16:19.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.570+0000 7f832e5af800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:16:19.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.570+0000 7f832e5af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 : miss 2024-09-13T19:16:19.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.570+0000 7f832e5af800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.570+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:64 8.9 8:917ee2d5:root::.bucket.meta.myfoo%3a509740b4-c081-4f37-bd6d-df9ca851489b.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563c29b9d450 con 0x7f8324021020 2024-09-13T19:16:19.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.570+0000 7f832c0a3640 1 -- 172.21.15.102:0/711818314 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(64 .bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv21 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f831c09a040 con 0x7f8324021020 2024-09-13T19:16:19.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.570+0000 7f832e5af800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:16:19.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.570+0000 7f832e5af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 info.flags=0x17 2024-09-13T19:16:19.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.570+0000 7f832e5af800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 to cache LRU end 2024-09-13T19:16:19.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.570+0000 7f832e5af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:16:19.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.570+0000 7f832e5af800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:16:19.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.570+0000 7f832e5af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 2024-09-13T19:16:19.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.570+0000 7f832e5af800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-13T19:16:19.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.570+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563c29b9e990 con 0x7f831c090050 2024-09-13T19:16:19.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.571+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(65 fud.buckets [call] v34'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f8320029040 con 0x7f831c090050 2024-09-13T19:16:19.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.571+0000 7f832e5af800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-13T19:16:19.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.571+0000 7f832e5af800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.571+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563c29b9ed90 con 0x7f8324021020 2024-09-13T19:16:19.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.572+0000 7f832c0a3640 1 -- 172.21.15.102:0/711818314 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv22 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f831c09a040 con 0x7f8324021020 2024-09-13T19:16:19.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.572+0000 7f832e5af800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:16:19.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.572+0000 7f832e5af800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-13T19:16:19.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.572+0000 7f832e5af800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:16:19.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.572+0000 7f832e5af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:16:19.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.572+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563c29ba4940 con 0x7f8324021020 2024-09-13T19:16:19.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.573+0000 7f832c0a3640 1 -- 172.21.15.102:0/711818314 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v34'23 uv23 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f831c09a040 con 0x7f8324021020 2024-09-13T19:16:19.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.573+0000 7f832e5af800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-13T19:16:19.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.573+0000 7f832e5af800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:16:19.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.573+0000 7f832e5af800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T19:16:19.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.573+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94816398083152 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563c29ba1ed0 con 0x7f831c090050 2024-09-13T19:16:19.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.573+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== watch-notify(notify (1) cookie 94816397827200 notify 146028888074 ret 0) ==== 380+0+0 (crc 0 0 0) 0x563c298deb30 con 0x7f831c090050 2024-09-13T19:16:19.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.573+0000 7f820b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888074 cookie 94816397827200 notifier 4524 bl.length()=338 2024-09-13T19:16:19.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.573+0000 7f820b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-13T19:16:19.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.573+0000 7f820b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:16:19.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.573+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 <== osd.0 v2:172.21.15.53:6800/4021716951 20 ==== osd_op_reply(68 notify.6 [notify cookie 94816398083152 out=8b] v0'0 uv120 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8320029040 con 0x7f831c090050 2024-09-13T19:16:19.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.573+0000 7f820b7fe640 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f81f0003ea0 con 0x7f831c090050 2024-09-13T19:16:19.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.574+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 <== osd.0 v2:172.21.15.53:6800/4021716951 21 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8320029040 con 0x7f831c090050 2024-09-13T19:16:19.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.574+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 <== osd.0 v2:172.21.15.53:6800/4021716951 22 ==== watch-notify(notify_complete (2) cookie 94816398083152 notify 146028888074 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f832003b740 con 0x7f831c090050 2024-09-13T19:16:19.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.574+0000 7f81e27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:19.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.575+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94816397831456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563c29b97660 con 0x563c29b52b20 2024-09-13T19:16:19.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.575+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94816397831456] v34'118 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8320029040 con 0x563c29b52b20 2024-09-13T19:16:19.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.575+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94816397808448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563c29b97660 con 0x7f8324021020 2024-09-13T19:16:19.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.576+0000 7f832c0a3640 1 -- 172.21.15.102:0/711818314 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94816397808448] v34'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f831c09a040 con 0x7f8324021020 2024-09-13T19:16:19.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.576+0000 7f832e5af800 20 remove_watcher() i=0 2024-09-13T19:16:19.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.576+0000 7f832e5af800 2 removed watcher, disabling cache 2024-09-13T19:16:19.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.576+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94816397810704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563c29b97660 con 0x563c29b52b20 2024-09-13T19:16:19.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.578+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94816397810704] v34'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8320029040 con 0x563c29b52b20 2024-09-13T19:16:19.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.578+0000 7f832e5af800 20 remove_watcher() i=1 2024-09-13T19:16:19.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.578+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94816397817840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563c29b97660 con 0x563c29b57430 2024-09-13T19:16:19.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.579+0000 7f832c8a4640 1 -- 172.21.15.102:0/711818314 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94816397817840] v34'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f832403d020 con 0x563c29b57430 2024-09-13T19:16:19.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.579+0000 7f832e5af800 20 remove_watcher() i=2 2024-09-13T19:16:19.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.579+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94816397814864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563c29b97660 con 0x7f8324021020 2024-09-13T19:16:19.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.580+0000 7f832c0a3640 1 -- 172.21.15.102:0/711818314 <== osd.2 v2:172.21.15.102:6816/2238176080 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94816397814864] v34'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f831c09a040 con 0x7f8324021020 2024-09-13T19:16:19.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.580+0000 7f832e5af800 20 remove_watcher() i=3 2024-09-13T19:16:19.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.580+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94816397823264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563c29b97660 con 0x563c29b52b20 2024-09-13T19:16:19.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.581+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94816397823264] v34'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8320029040 con 0x563c29b52b20 2024-09-13T19:16:19.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.581+0000 7f832e5af800 20 remove_watcher() i=4 2024-09-13T19:16:19.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.581+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94816397825968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563c29b97660 con 0x7f831c090050 2024-09-13T19:16:19.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.582+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 <== osd.0 v2:172.21.15.53:6800/4021716951 23 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94816397825968] v34'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8320029040 con 0x7f831c090050 2024-09-13T19:16:19.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.582+0000 7f832e5af800 20 remove_watcher() i=5 2024-09-13T19:16:19.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.582+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94816397827200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563c29b97660 con 0x7f831c090050 2024-09-13T19:16:19.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.583+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 <== osd.0 v2:172.21.15.53:6800/4021716951 24 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94816397827200] v34'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8320029040 con 0x7f831c090050 2024-09-13T19:16:19.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.583+0000 7f832e5af800 20 remove_watcher() i=6 2024-09-13T19:16:19.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.583+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94816397829936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563c29b97660 con 0x7f831c090050 2024-09-13T19:16:19.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.584+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 <== osd.0 v2:172.21.15.53:6800/4021716951 25 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94816397829936] v34'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8320029040 con 0x7f831c090050 2024-09-13T19:16:19.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.584+0000 7f832e5af800 20 remove_watcher() i=7 2024-09-13T19:16:19.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.584+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f831c090050 msgr2=0x7f831c086680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.584+0000 7f832e5af800 1 --2- 172.21.15.102:0/711818314 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f831c090050 0x7f831c086680 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.584+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563c29b52b20 msgr2=0x563c29b54fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.584+0000 7f832e5af800 1 --2- 172.21.15.102:0/711818314 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563c29b52b20 0x563c29b54fe0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.584+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f8324021020 msgr2=0x7f832402c030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.584+0000 7f832e5af800 1 --2- 172.21.15.102:0/711818314 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f8324021020 0x7f832402c030 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.584+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563c29b57430 msgr2=0x563c29b59820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.584+0000 7f832e5af800 1 --2- 172.21.15.102:0/711818314 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563c29b57430 0x563c29b59820 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.584+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f81fc036b90 msgr2=0x7f81fc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.584+0000 7f832e5af800 1 --2- 172.21.15.102:0/711818314 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f81fc036b90 0x7f81fc039050 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f831c06c700 tx=0x7f831c094000 comp rx=0 tx=0).stop 2024-09-13T19:16:19.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.584+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c29b3fdd0 msgr2=0x563c29b471e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.584+0000 7f832e5af800 1 --2- 172.21.15.102:0/711818314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c29b3fdd0 0x563c29b471e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f83240168b0 tx=0x7f832404b000 comp rx=0 tx=0).stop 2024-09-13T19:16:19.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.584+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 reap_dead start 2024-09-13T19:16:19.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.584+0000 7f832b8a2640 1 -- 172.21.15.102:0/711818314 reap_dead start 2024-09-13T19:16:19.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.585+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 shutdown_connections 2024-09-13T19:16:19.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.585+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 >> 172.21.15.102:0/711818314 conn(0x563c29b3c130 msgr2=0x563c29b3a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:19.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.585+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 shutdown_connections 2024-09-13T19:16:19.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.585+0000 7f832e5af800 1 -- 172.21.15.102:0/711818314 wait complete. 2024-09-13T19:16:19.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.585+0000 7f832e5af800 1 -- 172.21.15.102:0/750865081 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8204036b40 msgr2=0x7f8204039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.585+0000 7f832e5af800 1 --2- 172.21.15.102:0/750865081 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8204036b40 0x7f8204039000 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f831c00a3f0 tx=0x7f831c06c8c0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.585+0000 7f832e5af800 1 -- 172.21.15.102:0/750865081 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c29b33100 msgr2=0x563c29b33520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.585+0000 7f832e5af800 1 --2- 172.21.15.102:0/750865081 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c29b33100 0x563c29b33520 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x563c29b197f0 tx=0x7f832400beb0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.585+0000 7f832e5af800 1 -- 172.21.15.102:0/750865081 shutdown_connections 2024-09-13T19:16:19.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.585+0000 7f832e5af800 1 --2- 172.21.15.102:0/750865081 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8204036b40 0x7f8204039000 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.585+0000 7f832e5af800 1 --2- 172.21.15.102:0/750865081 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c29b33100 0x563c29b33520 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.585+0000 7f832e5af800 1 -- 172.21.15.102:0/750865081 >> 172.21.15.102:0/750865081 conn(0x563c29b28090 msgr2=0x563c29b2ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:19.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.585+0000 7f832e5af800 1 -- 172.21.15.102:0/750865081 shutdown_connections 2024-09-13T19:16:19.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.585+0000 7f832e5af800 1 -- 172.21.15.102:0/750865081 wait complete. 2024-09-13T19:16:19.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.585+0000 7f832e5af800 1 -- 172.21.15.102:0/2107335274 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563c29a24b40 msgr2=0x563c29b1f460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.585+0000 7f832e5af800 1 --2- 172.21.15.102:0/2107335274 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563c29a24b40 0x563c29b1f460 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.585+0000 7f832e5af800 1 -- 172.21.15.102:0/2107335274 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563c29b21c60 msgr2=0x563c29b24050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.585+0000 7f832e5af800 1 --2- 172.21.15.102:0/2107335274 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563c29b21c60 0x563c29b24050 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.585+0000 7f832e5af800 1 -- 172.21.15.102:0/2107335274 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8214036be0 msgr2=0x7f82140390a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.585+0000 7f832e5af800 1 --2- 172.21.15.102:0/2107335274 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8214036be0 0x7f82140390a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8320000f60 tx=0x7f83200012b0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.585+0000 7f832e5af800 1 -- 172.21.15.102:0/2107335274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c29993630 msgr2=0x563c29b183f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.585+0000 7f832e5af800 1 --2- 172.21.15.102:0/2107335274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c29993630 0x563c29b183f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f831c065040 tx=0x7f831c003330 comp rx=0 tx=0).stop 2024-09-13T19:16:19.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.585+0000 7f832e5af800 1 -- 172.21.15.102:0/2107335274 shutdown_connections 2024-09-13T19:16:19.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.585+0000 7f832e5af800 1 --2- 172.21.15.102:0/2107335274 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563c29b21c60 0x563c29b24050 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.585+0000 7f832e5af800 1 --2- 172.21.15.102:0/2107335274 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563c29a24b40 0x563c29b1f460 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.585+0000 7f832e5af800 1 --2- 172.21.15.102:0/2107335274 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8214036be0 0x7f82140390a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.585+0000 7f832e5af800 1 --2- 172.21.15.102:0/2107335274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563c29993630 0x563c29b183f0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.585+0000 7f832e5af800 1 -- 172.21.15.102:0/2107335274 >> 172.21.15.102:0/2107335274 conn(0x563c29a19db0 msgr2=0x563c29b0ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:19.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.586+0000 7f832e5af800 1 -- 172.21.15.102:0/2107335274 shutdown_connections 2024-09-13T19:16:19.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.586+0000 7f832e5af800 1 -- 172.21.15.102:0/2107335274 wait complete. 2024-09-13T19:16:19.613 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '509740b4-c081-4f37-bd6d-df9ca851489b.4237.1'] 2024-09-13T19:16:19.613 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '509740b4-c081-4f37-bd6d-df9ca851489b.4237.1'] 2024-09-13T19:16:19.613 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id 509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 2024-09-13T19:16:19.662 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:19.662 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:19.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.659+0000 7f81b2432800 1 Processor -- start 2024-09-13T19:16:19.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.659+0000 7f81b2432800 1 -- start start 2024-09-13T19:16:19.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.659+0000 7f81b2432800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5620f7264eb0 0x5620f72f4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.659+0000 7f81b2432800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5620f71b0b30 con 0x5620f72f46a0 2024-09-13T19:16:19.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.659+0000 7f81b2432800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5620f7192360 con 0x5620f7264eb0 2024-09-13T19:16:19.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.660+0000 7f81ad673640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5620f7264eb0 0x5620f72f4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.660+0000 7f81ad673640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5620f7264eb0 0x5620f72f4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55602/0 (socket says 172.21.15.102:55602) 2024-09-13T19:16:19.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.660+0000 7f81ad673640 1 -- 172.21.15.102:0/3321501073 learned_addr learned my addr 172.21.15.102:0/3321501073 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:19.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.660+0000 7f81a4e72640 1 --1- 172.21.15.102:0/3321501073 >> v1:172.21.15.53:6789/0 conn(0x5620f72f46a0 0x5620f72f6ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:50032/0 (socket says 172.21.15.102:50032) 2024-09-13T19:16:19.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.660+0000 7f81ad673640 1 -- 172.21.15.102:0/3321501073 >> v1:172.21.15.53:6789/0 conn(0x5620f72f46a0 legacy=0x5620f72f6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.660+0000 7f81ad673640 1 -- 172.21.15.102:0/3321501073 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620f71b8e00 con 0x5620f7264eb0 2024-09-13T19:16:19.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.662+0000 7f81ad673640 1 --2- 172.21.15.102:0/3321501073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620f7264eb0 0x5620f72f4160 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f81a000a520 tx=0x7f81a0045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25b6fbf989d62c9b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.662+0000 7f81ace72640 1 -- 172.21.15.102:0/3321501073 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81a0055070 con 0x5620f7264eb0 2024-09-13T19:16:19.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.662+0000 7f81ace72640 1 -- 172.21.15.102:0/3321501073 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81a00515b0 con 0x5620f7264eb0 2024-09-13T19:16:19.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.662+0000 7f81ace72640 1 -- 172.21.15.102:0/3321501073 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81a00518d0 con 0x5620f7264eb0 2024-09-13T19:16:19.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.662+0000 7f81b2432800 1 -- 172.21.15.102:0/3321501073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620f7264eb0 msgr2=0x5620f72f4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.662+0000 7f81b2432800 1 --2- 172.21.15.102:0/3321501073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620f7264eb0 0x5620f72f4160 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f81a000a520 tx=0x7f81a0045ba0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.662+0000 7f81b2432800 1 -- 172.21.15.102:0/3321501073 shutdown_connections 2024-09-13T19:16:19.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.662+0000 7f81b2432800 1 --2- 172.21.15.102:0/3321501073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620f7264eb0 0x5620f72f4160 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.662+0000 7f81b2432800 1 -- 172.21.15.102:0/3321501073 >> 172.21.15.102:0/3321501073 conn(0x5620f72ebe10 msgr2=0x5620f72ee230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:19.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.662+0000 7f81b2432800 1 -- 172.21.15.102:0/3321501073 shutdown_connections 2024-09-13T19:16:19.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.662+0000 7f81b2432800 1 -- 172.21.15.102:0/3321501073 wait complete. 2024-09-13T19:16:19.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.676+0000 7f81b2432800 1 Processor -- start 2024-09-13T19:16:19.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.676+0000 7f81b2432800 1 -- start start 2024-09-13T19:16:19.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.676+0000 7f81b2432800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620f7264eb0 0x5620f73e0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.676+0000 7f81b2432800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5620f723d350 con 0x5620f7264eb0 2024-09-13T19:16:19.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.677+0000 7f81ad673640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620f7264eb0 0x5620f73e0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.677+0000 7f81ad673640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620f7264eb0 0x5620f73e0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55614/0 (socket says 172.21.15.102:55614) 2024-09-13T19:16:19.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.677+0000 7f81ad673640 1 -- 172.21.15.102:0/2889715042 learned_addr learned my addr 172.21.15.102:0/2889715042 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:19.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.677+0000 7f81ad673640 1 -- 172.21.15.102:0/2889715042 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620f718abc0 con 0x5620f7264eb0 2024-09-13T19:16:19.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.677+0000 7f81ad673640 1 --2- 172.21.15.102:0/2889715042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620f7264eb0 0x5620f73e0960 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f81a0025da0 tx=0x7f81a0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fa938da3f03a762 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.677+0000 7f809b606640 1 -- 172.21.15.102:0/2889715042 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81a0051950 con 0x5620f7264eb0 2024-09-13T19:16:19.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.677+0000 7f809b606640 1 -- 172.21.15.102:0/2889715042 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81a0051af0 con 0x5620f7264eb0 2024-09-13T19:16:19.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.677+0000 7f809b606640 1 -- 172.21.15.102:0/2889715042 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81a0051dd0 con 0x5620f7264eb0 2024-09-13T19:16:19.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.678+0000 7f81b2432800 1 -- 172.21.15.102:0/2889715042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620f7264eb0 msgr2=0x5620f73e0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.678+0000 7f81b2432800 1 --2- 172.21.15.102:0/2889715042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620f7264eb0 0x5620f73e0960 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f81a0025da0 tx=0x7f81a0051000 comp rx=0 tx=0).stop 2024-09-13T19:16:19.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.678+0000 7f81b2432800 1 -- 172.21.15.102:0/2889715042 shutdown_connections 2024-09-13T19:16:19.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.678+0000 7f81b2432800 1 --2- 172.21.15.102:0/2889715042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620f7264eb0 0x5620f73e0960 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.678+0000 7f81b2432800 1 -- 172.21.15.102:0/2889715042 >> 172.21.15.102:0/2889715042 conn(0x5620f72ebe10 msgr2=0x5620f73dc320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:19.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.678+0000 7f81b2432800 1 -- 172.21.15.102:0/2889715042 shutdown_connections 2024-09-13T19:16:19.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.678+0000 7f81b2432800 1 -- 172.21.15.102:0/2889715042 wait complete. 2024-09-13T19:16:19.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.678+0000 7f81b2432800 1 Processor -- start 2024-09-13T19:16:19.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.678+0000 7f81b2432800 1 -- start start 2024-09-13T19:16:19.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.678+0000 7f81b2432800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620f72f46a0 0x5620f73e8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.678+0000 7f81b2432800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5620f72f8610 con 0x5620f72f46a0 2024-09-13T19:16:19.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.679+0000 7f81ad673640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620f72f46a0 0x5620f73e8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.679+0000 7f81ad673640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620f72f46a0 0x5620f73e8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55628/0 (socket says 172.21.15.102:55628) 2024-09-13T19:16:19.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.679+0000 7f81ad673640 1 -- 172.21.15.102:0/1779430823 learned_addr learned my addr 172.21.15.102:0/1779430823 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:19.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.679+0000 7f81ad673640 1 -- 172.21.15.102:0/1779430823 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620f719efe0 con 0x5620f72f46a0 2024-09-13T19:16:19.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.679+0000 7f81ad673640 1 --2- 172.21.15.102:0/1779430823 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620f72f46a0 0x5620f73e8440 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f81a0067040 tx=0x7f81a0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.679+0000 7f8099e03640 1 -- 172.21.15.102:0/1779430823 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81a0073020 con 0x5620f72f46a0 2024-09-13T19:16:19.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.679+0000 7f8099e03640 1 -- 172.21.15.102:0/1779430823 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81a006f450 con 0x5620f72f46a0 2024-09-13T19:16:19.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.679+0000 7f81b2432800 1 -- 172.21.15.102:0/1779430823 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5620f73e8980 con 0x5620f72f46a0 2024-09-13T19:16:19.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.679+0000 7f8099e03640 1 -- 172.21.15.102:0/1779430823 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81a006f750 con 0x5620f72f46a0 2024-09-13T19:16:19.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.679+0000 7f81b2432800 1 -- 172.21.15.102:0/1779430823 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620f73e8f00 con 0x5620f72f46a0 2024-09-13T19:16:19.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.680+0000 7f8099e03640 1 -- 172.21.15.102:0/1779430823 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f81a0076020 con 0x5620f72f46a0 2024-09-13T19:16:19.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.680+0000 7f8099e03640 1 --2- 172.21.15.102:0/1779430823 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8094036be0 0x7f80940390a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.680+0000 7f8099e03640 1 -- 172.21.15.102:0/1779430823 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f81a006b040 con 0x5620f72f46a0 2024-09-13T19:16:19.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.680+0000 7f81a4e72640 1 --2- 172.21.15.102:0/1779430823 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8094036be0 0x7f80940390a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.681+0000 7f81b2432800 1 --2- 172.21.15.102:0/1779430823 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5620f73ed4a0 0x5620f73ef890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.681+0000 7f81b2432800 1 -- 172.21.15.102:0/1779430823 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620f73efe10 con 0x5620f73ed4a0 2024-09-13T19:16:19.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.681+0000 7f81ade74640 1 --2- 172.21.15.102:0/1779430823 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5620f73ed4a0 0x5620f73ef890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.681+0000 7f81a4e72640 1 --2- 172.21.15.102:0/1779430823 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8094036be0 0x7f80940390a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8198000f60 tx=0x7f8198001370 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.681+0000 7f81ade74640 1 --2- 172.21.15.102:0/1779430823 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5620f73ed4a0 0x5620f73ef890 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.681+0000 7f81ade74640 1 -- 172.21.15.102:0/1779430823 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f81a800a4a0 con 0x5620f73ed4a0 2024-09-13T19:16:19.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.681+0000 7f81b2432800 1 -- 172.21.15.102:0/1779430823 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620f73eca80 con 0x5620f73ed4a0 2024-09-13T19:16:19.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.682+0000 7f81ade74640 1 -- 172.21.15.102:0/1779430823 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f81a800a4a0 con 0x5620f73ed4a0 2024-09-13T19:16:19.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.682+0000 7f81b2432800 1 --2- 172.21.15.102:0/1779430823 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5620f73f2140 0x5620f73f4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.682+0000 7f81b2432800 1 -- 172.21.15.102:0/1779430823 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620f73f4c20 con 0x5620f73f2140 2024-09-13T19:16:19.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.682+0000 7f81ad673640 1 --2- 172.21.15.102:0/1779430823 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5620f73f2140 0x5620f73f4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.682+0000 7f81ad673640 1 --2- 172.21.15.102:0/1779430823 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5620f73f2140 0x5620f73f4530 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.682+0000 7f81ad673640 1 -- 172.21.15.102:0/1779430823 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f81a0057030 con 0x5620f73f2140 2024-09-13T19:16:19.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.682+0000 7f81b2432800 1 -- 172.21.15.102:0/1779430823 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620f73f0fe0 con 0x5620f73ed4a0 2024-09-13T19:16:19.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.682+0000 7f81ade74640 1 -- 172.21.15.102:0/1779430823 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f81a800a4a0 con 0x5620f73ed4a0 2024-09-13T19:16:19.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.682+0000 7f81b2432800 1 -- 172.21.15.102:0/1779430823 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620f73f14c0 con 0x5620f73f2140 2024-09-13T19:16:19.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.683+0000 7f81ad673640 1 -- 172.21.15.102:0/1779430823 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f81a0057030 con 0x5620f73f2140 2024-09-13T19:16:19.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.683+0000 7f81b2432800 1 Processor -- start 2024-09-13T19:16:19.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.683+0000 7f81b2432800 1 -- start start 2024-09-13T19:16:19.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.683+0000 7f81b2432800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620f72f1b10 0x5620f72f0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.683+0000 7f81b2432800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5620f718c580 con 0x5620f72f1b10 2024-09-13T19:16:19.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.684+0000 7f81ade74640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620f72f1b10 0x5620f72f0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.684+0000 7f81ade74640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620f72f1b10 0x5620f72f0160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55638/0 (socket says 172.21.15.102:55638) 2024-09-13T19:16:19.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.684+0000 7f81ade74640 1 -- 172.21.15.102:0/2153084962 learned_addr learned my addr 172.21.15.102:0/2153084962 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:19.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.684+0000 7f81ade74640 1 -- 172.21.15.102:0/2153084962 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620f72f1f30 con 0x5620f72f1b10 2024-09-13T19:16:19.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.684+0000 7f81ade74640 1 --2- 172.21.15.102:0/2153084962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620f72f1b10 0x5620f72f0160 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x5620f73f01f0 tx=0x7f81a80163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.684+0000 7f8092ffd640 1 -- 172.21.15.102:0/2153084962 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81a8013450 con 0x5620f72f1b10 2024-09-13T19:16:19.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.684+0000 7f8092ffd640 1 -- 172.21.15.102:0/2153084962 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81a80135f0 con 0x5620f72f1b10 2024-09-13T19:16:19.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.684+0000 7f8092ffd640 1 -- 172.21.15.102:0/2153084962 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81a80138d0 con 0x5620f72f1b10 2024-09-13T19:16:19.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.684+0000 7f81b2432800 1 -- 172.21.15.102:0/2153084962 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5620f72f0760 con 0x5620f72f1b10 2024-09-13T19:16:19.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.684+0000 7f81b2432800 1 -- 172.21.15.102:0/2153084962 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620f72f0c60 con 0x5620f72f1b10 2024-09-13T19:16:19.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.685+0000 7f8092ffd640 1 -- 172.21.15.102:0/2153084962 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f81a8011040 con 0x5620f72f1b10 2024-09-13T19:16:19.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.685+0000 7f8092ffd640 1 --2- 172.21.15.102:0/2153084962 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8084036b90 0x7f8084039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.685+0000 7f8092ffd640 1 -- 172.21.15.102:0/2153084962 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f81a800e040 con 0x5620f72f1b10 2024-09-13T19:16:19.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.685+0000 7f81ad673640 1 --2- 172.21.15.102:0/2153084962 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8084036b90 0x7f8084039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.686+0000 7f81b2432800 1 Processor -- start 2024-09-13T19:16:19.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.686+0000 7f81b2432800 1 -- start start 2024-09-13T19:16:19.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.686+0000 7f81ad673640 1 --2- 172.21.15.102:0/2153084962 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8084036b90 0x7f8084039050 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f81a0064e50 tx=0x7f81a0064ee0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.686+0000 7f81b2432800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620f7412440 0x5620f7412840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.686+0000 7f81b2432800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5620f73e1050 con 0x5620f7412440 2024-09-13T19:16:19.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.686+0000 7f81ade74640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620f7412440 0x5620f7412840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.686+0000 7f81ade74640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620f7412440 0x5620f7412840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55644/0 (socket says 172.21.15.102:55644) 2024-09-13T19:16:19.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.686+0000 7f81ade74640 1 -- 172.21.15.102:0/3966007951 learned_addr learned my addr 172.21.15.102:0/3966007951 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:19.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.686+0000 7f81ade74640 1 -- 172.21.15.102:0/3966007951 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620f7412e10 con 0x5620f7412440 2024-09-13T19:16:19.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.687+0000 7f81ade74640 1 --2- 172.21.15.102:0/3966007951 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620f7412440 0x5620f7412840 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f81a802a020 tx=0x7f81a8014aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27dabf04f4fb72a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.687+0000 7f8090ff9640 1 -- 172.21.15.102:0/3966007951 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81a801f390 con 0x5620f7412440 2024-09-13T19:16:19.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.687+0000 7f8090ff9640 1 -- 172.21.15.102:0/3966007951 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81a8012cb0 con 0x5620f7412440 2024-09-13T19:16:19.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.687+0000 7f8090ff9640 1 -- 172.21.15.102:0/3966007951 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81a801f530 con 0x5620f7412440 2024-09-13T19:16:19.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.687+0000 7f81b2432800 1 -- 172.21.15.102:0/3966007951 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620f7412440 msgr2=0x5620f7412840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.687+0000 7f81b2432800 1 --2- 172.21.15.102:0/3966007951 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620f7412440 0x5620f7412840 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f81a802a020 tx=0x7f81a8014aa0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.687+0000 7f81b2432800 1 -- 172.21.15.102:0/3966007951 shutdown_connections 2024-09-13T19:16:19.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.687+0000 7f81b2432800 1 --2- 172.21.15.102:0/3966007951 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620f7412440 0x5620f7412840 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.687+0000 7f81b2432800 1 -- 172.21.15.102:0/3966007951 >> 172.21.15.102:0/3966007951 conn(0x5620f740e830 msgr2=0x5620f740c930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:19.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.687+0000 7f81b2432800 1 -- 172.21.15.102:0/3966007951 shutdown_connections 2024-09-13T19:16:19.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.687+0000 7f81b2432800 1 -- 172.21.15.102:0/3966007951 wait complete. 2024-09-13T19:16:19.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.687+0000 7f81b2432800 1 Processor -- start 2024-09-13T19:16:19.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.688+0000 7f81b2432800 1 -- start start 2024-09-13T19:16:19.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.688+0000 7f81b2432800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620f7412440 0x5620f7419950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.688+0000 7f81b2432800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5620f7413450 con 0x5620f7412440 2024-09-13T19:16:19.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.688+0000 7f81ade74640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620f7412440 0x5620f7419950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.688+0000 7f81ade74640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620f7412440 0x5620f7419950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55654/0 (socket says 172.21.15.102:55654) 2024-09-13T19:16:19.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.688+0000 7f81ade74640 1 -- 172.21.15.102:0/664299850 learned_addr learned my addr 172.21.15.102:0/664299850 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:19.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.688+0000 7f81ade74640 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620f7419e90 con 0x5620f7412440 2024-09-13T19:16:19.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.688+0000 7f81ade74640 1 --2- 172.21.15.102:0/664299850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620f7412440 0x5620f7419950 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f81a804ccf0 tx=0x7f81a804cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.688+0000 7f8082ffd640 1 -- 172.21.15.102:0/664299850 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81a8012e60 con 0x5620f7412440 2024-09-13T19:16:19.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.688+0000 7f8082ffd640 1 -- 172.21.15.102:0/664299850 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81a801f920 con 0x5620f7412440 2024-09-13T19:16:19.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.688+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5620f741a120 con 0x5620f7412440 2024-09-13T19:16:19.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.688+0000 7f8082ffd640 1 -- 172.21.15.102:0/664299850 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81a8013ba0 con 0x5620f7412440 2024-09-13T19:16:19.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.688+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620f741cdd0 con 0x5620f7412440 2024-09-13T19:16:19.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.689+0000 7f8082ffd640 1 -- 172.21.15.102:0/664299850 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f81a803b060 con 0x5620f7412440 2024-09-13T19:16:19.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.689+0000 7f8082ffd640 1 --2- 172.21.15.102:0/664299850 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8078036b90 0x7f8078039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.690+0000 7f8082ffd640 1 -- 172.21.15.102:0/664299850 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f81a8035c30 con 0x5620f7412440 2024-09-13T19:16:19.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.690+0000 7f81ad673640 1 --2- 172.21.15.102:0/664299850 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8078036b90 0x7f8078039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.690+0000 7f81ad673640 1 --2- 172.21.15.102:0/664299850 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8078036b90 0x7f8078039050 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f81a0065fb0 tx=0x7f81a0089000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.690+0000 7f81b2432800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.690+0000 7f81b2432800 1 --2- 172.21.15.102:0/664299850 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5620f74255d0 0x5620f7427a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.690+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620f74281e0 con 0x5620f74255d0 2024-09-13T19:16:19.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.690+0000 7f81a4e72640 1 --2- 172.21.15.102:0/664299850 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5620f74255d0 0x5620f7427a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.691+0000 7f81a4e72640 1 --2- 172.21.15.102:0/664299850 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5620f74255d0 0x5620f7427a90 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.691+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f819800f5c0 con 0x5620f74255d0 2024-09-13T19:16:19.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.691+0000 7f81b2432800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:19.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.691+0000 7f81b2432800 20 realm 2024-09-13T19:16:19.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.691+0000 7f81b2432800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.691+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620f7424a20 con 0x5620f74255d0 2024-09-13T19:16:19.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.691+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f819800f5c0 con 0x5620f74255d0 2024-09-13T19:16:19.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.691+0000 7f81b2432800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:19.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.691+0000 7f81b2432800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:19.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.691+0000 7f81b2432800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.691+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620f7428cd0 con 0x5620f74255d0 2024-09-13T19:16:19.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.691+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f819800f5c0 con 0x5620f74255d0 2024-09-13T19:16:19.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.691+0000 7f81b2432800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:19.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.691+0000 7f81b2432800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.691+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620f74295a0 con 0x5620f74255d0 2024-09-13T19:16:19.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.692+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f819800f5c0 con 0x5620f74255d0 2024-09-13T19:16:19.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.692+0000 7f81b2432800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:19.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.692+0000 7f81b2432800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.692+0000 7f81b2432800 1 --2- 172.21.15.102:0/664299850 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5620f7429fc0 0x5620f742c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.692+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620f742caa0 con 0x5620f7429fc0 2024-09-13T19:16:19.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.692+0000 7f81ade74640 1 --2- 172.21.15.102:0/664299850 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5620f7429fc0 0x5620f742c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.692+0000 7f81ade74640 1 --2- 172.21.15.102:0/664299850 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5620f7429fc0 0x5620f742c3b0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.692+0000 7f81ade74640 1 -- 172.21.15.102:0/664299850 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f81a8027020 con 0x5620f7429fc0 2024-09-13T19:16:19.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.692+0000 7f81b2432800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:19.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.692+0000 7f81b2432800 20 searching for the correct realm 2024-09-13T19:16:19.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.692+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620f742e3f0 con 0x5620f7429fc0 2024-09-13T19:16:19.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.693+0000 7f81ade74640 1 -- 172.21.15.102:0/664299850 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a8027020 con 0x5620f7429fc0 2024-09-13T19:16:19.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.693+0000 7f81ade74640 1 --2- 172.21.15.102:0/664299850 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f81a8045040 0x7f81a80126f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.693+0000 7f81ade74640 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620f742e3f0 con 0x7f81a8045040 2024-09-13T19:16:19.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.693+0000 7f81ad673640 1 --2- 172.21.15.102:0/664299850 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f81a8045040 0x7f81a80126f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.693+0000 7f81ad673640 1 --2- 172.21.15.102:0/664299850 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f81a8045040 0x7f81a80126f0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.693+0000 7f81ad673640 1 -- 172.21.15.102:0/664299850 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a0057030 con 0x7f81a8045040 2024-09-13T19:16:19.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.693+0000 7f81ad673640 1 --2- 172.21.15.102:0/664299850 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f81a0083040 0x7f81a00773b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.693+0000 7f81ad673640 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620f742e3f0 con 0x7f81a0083040 2024-09-13T19:16:19.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.693+0000 7f81a4e72640 1 --2- 172.21.15.102:0/664299850 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f81a0083040 0x7f81a00773b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.694+0000 7f81a4e72640 1 --2- 172.21.15.102:0/664299850 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f81a0083040 0x7f81a00773b0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.694+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819800f5c0 con 0x7f81a0083040 2024-09-13T19:16:19.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.694+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620f742e3f0 con 0x5620f74255d0 2024-09-13T19:16:19.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.694+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819800f5c0 con 0x5620f74255d0 2024-09-13T19:16:19.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.694+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620f742e3f0 con 0x5620f74255d0 2024-09-13T19:16:19.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.694+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819802b040 con 0x5620f74255d0 2024-09-13T19:16:19.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.694+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620f742e3f0 con 0x7f81a0083040 2024-09-13T19:16:19.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.695+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819802b040 con 0x7f81a0083040 2024-09-13T19:16:19.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.695+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620f742e3f0 con 0x7f81a0083040 2024-09-13T19:16:19.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.695+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819802b040 con 0x7f81a0083040 2024-09-13T19:16:19.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.695+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620f742e3f0 con 0x7f81a8045040 2024-09-13T19:16:19.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.695+0000 7f81ad673640 1 -- 172.21.15.102:0/664299850 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a0057030 con 0x7f81a8045040 2024-09-13T19:16:19.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.695+0000 7f81ad673640 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620f742e3f0 con 0x5620f7429fc0 2024-09-13T19:16:19.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.695+0000 7f81ade74640 1 -- 172.21.15.102:0/664299850 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a8027020 con 0x5620f7429fc0 2024-09-13T19:16:19.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.695+0000 7f81ade74640 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620f742e3f0 con 0x5620f74255d0 2024-09-13T19:16:19.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.696+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819802b040 con 0x5620f74255d0 2024-09-13T19:16:19.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.696+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620f742e3f0 con 0x7f81a0083040 2024-09-13T19:16:19.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.696+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819802b040 con 0x7f81a0083040 2024-09-13T19:16:19.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.696+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620f742e3f0 con 0x5620f74255d0 2024-09-13T19:16:19.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.696+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819802b040 con 0x5620f74255d0 2024-09-13T19:16:19.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.696+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620f742e3f0 con 0x7f81a8045040 2024-09-13T19:16:19.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.696+0000 7f81ad673640 1 -- 172.21.15.102:0/664299850 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f81a0057030 con 0x7f81a8045040 2024-09-13T19:16:19.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.696+0000 7f81ad673640 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620f742e3f0 con 0x5620f7429fc0 2024-09-13T19:16:19.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.697+0000 7f81ade74640 1 -- 172.21.15.102:0/664299850 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a8027020 con 0x5620f7429fc0 2024-09-13T19:16:19.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.697+0000 7f81ade74640 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620f742e3f0 con 0x5620f7429fc0 2024-09-13T19:16:19.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.697+0000 7f81ade74640 1 -- 172.21.15.102:0/664299850 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f81a8027020 con 0x5620f7429fc0 2024-09-13T19:16:19.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.697+0000 7f81ade74640 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620f742e3f0 con 0x7f81a0083040 2024-09-13T19:16:19.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.697+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819802b040 con 0x7f81a0083040 2024-09-13T19:16:19.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.697+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620f742e3f0 con 0x5620f7429fc0 2024-09-13T19:16:19.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.697+0000 7f81ade74640 1 -- 172.21.15.102:0/664299850 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f81a8027020 con 0x5620f7429fc0 2024-09-13T19:16:19.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.697+0000 7f81ade74640 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620f742e3f0 con 0x5620f7429fc0 2024-09-13T19:16:19.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.698+0000 7f81ade74640 1 -- 172.21.15.102:0/664299850 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a8027020 con 0x5620f7429fc0 2024-09-13T19:16:19.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.698+0000 7f81ade74640 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620f742e3f0 con 0x5620f74255d0 2024-09-13T19:16:19.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.698+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819802b040 con 0x5620f74255d0 2024-09-13T19:16:19.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.698+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620f742e3f0 con 0x5620f74255d0 2024-09-13T19:16:19.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.698+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f819802b040 con 0x5620f74255d0 2024-09-13T19:16:19.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.698+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620f742e3f0 con 0x7f81a0083040 2024-09-13T19:16:19.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.698+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819802b040 con 0x7f81a0083040 2024-09-13T19:16:19.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.698+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620f742e3f0 con 0x5620f7429fc0 2024-09-13T19:16:19.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.698+0000 7f81ade74640 1 -- 172.21.15.102:0/664299850 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a8027020 con 0x5620f7429fc0 2024-09-13T19:16:19.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.699+0000 7f81ade74640 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620f742e3f0 con 0x7f81a8045040 2024-09-13T19:16:19.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.699+0000 7f81ad673640 1 -- 172.21.15.102:0/664299850 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a0057030 con 0x7f81a8045040 2024-09-13T19:16:19.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.699+0000 7f81ad673640 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620f742e3f0 con 0x5620f74255d0 2024-09-13T19:16:19.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.699+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819802b040 con 0x5620f74255d0 2024-09-13T19:16:19.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.699+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620f742e3f0 con 0x7f81a0083040 2024-09-13T19:16:19.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.699+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819803b040 con 0x7f81a0083040 2024-09-13T19:16:19.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.699+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620f742e3f0 con 0x5620f7429fc0 2024-09-13T19:16:19.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.699+0000 7f81ade74640 1 -- 172.21.15.102:0/664299850 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a8027020 con 0x5620f7429fc0 2024-09-13T19:16:19.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.699+0000 7f81ade74640 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620f742e3f0 con 0x7f81a0083040 2024-09-13T19:16:19.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.700+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819803b040 con 0x7f81a0083040 2024-09-13T19:16:19.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.700+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620f742e3f0 con 0x7f81a8045040 2024-09-13T19:16:19.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.700+0000 7f81ad673640 1 -- 172.21.15.102:0/664299850 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a0057030 con 0x7f81a8045040 2024-09-13T19:16:19.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.700+0000 7f81ad673640 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620f742e3f0 con 0x5620f7429fc0 2024-09-13T19:16:19.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.700+0000 7f81ade74640 1 -- 172.21.15.102:0/664299850 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a8027020 con 0x5620f7429fc0 2024-09-13T19:16:19.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.700+0000 7f81ade74640 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620f742e3f0 con 0x7f81a0083040 2024-09-13T19:16:19.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.700+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819803b040 con 0x7f81a0083040 2024-09-13T19:16:19.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.700+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620f742e3f0 con 0x5620f74255d0 2024-09-13T19:16:19.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.701+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f819803b040 con 0x5620f74255d0 2024-09-13T19:16:19.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.701+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620f742e3f0 con 0x7f81a8045040 2024-09-13T19:16:19.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.701+0000 7f81ad673640 1 -- 172.21.15.102:0/664299850 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a0057030 con 0x7f81a8045040 2024-09-13T19:16:19.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.701+0000 7f81b2432800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:19.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.701+0000 7f81b2432800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:19.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.701+0000 7f81b2432800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:19.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.701+0000 7f81b2432800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:19.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.701+0000 7f81b2432800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:19.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.701+0000 7f81b2432800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:19.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.701+0000 7f81b2432800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.701+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620f742d490 con 0x5620f74255d0 2024-09-13T19:16:19.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.701+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f819803b040 con 0x5620f74255d0 2024-09-13T19:16:19.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.701+0000 7f81b2432800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:19.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.701+0000 7f81b2432800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.701+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620f742dd30 con 0x5620f74255d0 2024-09-13T19:16:19.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.701+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f819803b040 con 0x5620f74255d0 2024-09-13T19:16:19.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.701+0000 7f81b2432800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:19.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.701+0000 7f81b2432800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.701+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620f742e870 con 0x5620f7429fc0 2024-09-13T19:16:19.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.702+0000 7f81ade74640 1 -- 172.21.15.102:0/664299850 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f81a8027020 con 0x5620f7429fc0 2024-09-13T19:16:19.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.702+0000 7f81b2432800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:19.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.702+0000 7f81b2432800 20 zone default found 2024-09-13T19:16:19.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.702+0000 7f81b2432800 4 Realm: () 2024-09-13T19:16:19.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.702+0000 7f81b2432800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:19.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.702+0000 7f81b2432800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:19.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.702+0000 7f81b2432800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:19.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.702+0000 7f81b2432800 20 zonegroup default 2024-09-13T19:16:19.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.702+0000 7f81b2432800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.702+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620f742f0c0 con 0x7f81a0083040 2024-09-13T19:16:19.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.702+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f819803b040 con 0x7f81a0083040 2024-09-13T19:16:19.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.702+0000 7f81b2432800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:19.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.702+0000 7f81b2432800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.702+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620f7430aa0 con 0x5620f7429fc0 2024-09-13T19:16:19.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.702+0000 7f81ade74640 1 -- 172.21.15.102:0/664299850 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f81a8027020 con 0x5620f7429fc0 2024-09-13T19:16:19.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.702+0000 7f81b2432800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:19.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.702+0000 7f81b2432800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.702+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620f7430eb0 con 0x5620f7429fc0 2024-09-13T19:16:19.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.702+0000 7f81ade74640 1 -- 172.21.15.102:0/664299850 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f81a8027020 con 0x5620f7429fc0 2024-09-13T19:16:19.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.702+0000 7f81b2432800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:19.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.702+0000 7f81b2432800 20 started sync module instance, tier type = 2024-09-13T19:16:19.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.702+0000 7f81b2432800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:19.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.702+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620f742ff30 con 0x7f81a8045040 2024-09-13T19:16:19.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.703+0000 7f81ad673640 1 -- 172.21.15.102:0/664299850 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(44 notify.0 [create] v34'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81a0057030 con 0x7f81a8045040 2024-09-13T19:16:19.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.703+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94699587306320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620f7431790 con 0x7f81a8045040 2024-09-13T19:16:19.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.703+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620f7431fe0 con 0x5620f74255d0 2024-09-13T19:16:19.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.704+0000 7f81ad673640 1 -- 172.21.15.102:0/664299850 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94699587306320] v34'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81a0057030 con 0x7f81a8045040 2024-09-13T19:16:19.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.705+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v34'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819803b040 con 0x5620f74255d0 2024-09-13T19:16:19.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.705+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94699587310304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620f7431fe0 con 0x5620f74255d0 2024-09-13T19:16:19.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.705+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620f7432b00 con 0x5620f7429fc0 2024-09-13T19:16:19.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.706+0000 7f81ade74640 1 -- 172.21.15.102:0/664299850 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v34'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81a8027020 con 0x5620f7429fc0 2024-09-13T19:16:19.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.706+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94699587310304] v34'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819803b040 con 0x5620f74255d0 2024-09-13T19:16:19.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.706+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94699587315152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620f7432ac0 con 0x5620f7429fc0 2024-09-13T19:16:19.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.706+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620f7431b70 con 0x7f81a8045040 2024-09-13T19:16:19.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.707+0000 7f81ade74640 1 -- 172.21.15.102:0/664299850 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94699587315152] v34'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81a8027020 con 0x5620f7429fc0 2024-09-13T19:16:19.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.707+0000 7f81ad673640 1 -- 172.21.15.102:0/664299850 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(50 notify.3 [create] v34'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81a0057030 con 0x7f81a8045040 2024-09-13T19:16:19.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.707+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94699587317488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620f7433aa0 con 0x7f81a8045040 2024-09-13T19:16:19.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.707+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620f7434460 con 0x5620f74255d0 2024-09-13T19:16:19.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.708+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v34'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819803b040 con 0x5620f74255d0 2024-09-13T19:16:19.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.708+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94699587322256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620f7434be0 con 0x5620f74255d0 2024-09-13T19:16:19.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.708+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620f74356d0 con 0x7f81a0083040 2024-09-13T19:16:19.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.709+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94699587322256] v34'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819803b040 con 0x5620f74255d0 2024-09-13T19:16:19.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.709+0000 7f81ad673640 1 -- 172.21.15.102:0/664299850 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94699587317488] v34'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81a0057030 con 0x7f81a8045040 2024-09-13T19:16:19.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.709+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(54 notify.5 [create] v34'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819803b040 con 0x7f81a0083040 2024-09-13T19:16:19.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.709+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94699587319280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620f7435690 con 0x7f81a0083040 2024-09-13T19:16:19.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.709+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620f7435fa0 con 0x7f81a0083040 2024-09-13T19:16:19.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.710+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94699587319280] v34'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819803b040 con 0x7f81a0083040 2024-09-13T19:16:19.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.711+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(56 notify.6 [create] v34'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819803b040 con 0x7f81a0083040 2024-09-13T19:16:19.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.711+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94699587326368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620f7435690 con 0x7f81a0083040 2024-09-13T19:16:19.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.711+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620f74365f0 con 0x7f81a0083040 2024-09-13T19:16:19.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.712+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(58 notify.7 [create] v34'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819803b040 con 0x7f81a0083040 2024-09-13T19:16:19.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.712+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94699587330240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620f7436a60 con 0x7f81a0083040 2024-09-13T19:16:19.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.712+0000 7f81b2432800 20 add_watcher() i=0 2024-09-13T19:16:19.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.712+0000 7f81b2432800 20 add_watcher() i=1 2024-09-13T19:16:19.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.712+0000 7f81b2432800 20 add_watcher() i=2 2024-09-13T19:16:19.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.712+0000 7f81b2432800 20 add_watcher() i=3 2024-09-13T19:16:19.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.712+0000 7f81b2432800 20 add_watcher() i=4 2024-09-13T19:16:19.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.712+0000 7f81b2432800 20 add_watcher() i=5 2024-09-13T19:16:19.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.712+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94699587326368] v34'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819803b040 con 0x7f81a0083040 2024-09-13T19:16:19.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.712+0000 7f81b2432800 20 add_watcher() i=6 2024-09-13T19:16:19.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.712+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94699587330240] v34'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819803b040 con 0x7f81a0083040 2024-09-13T19:16:19.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.712+0000 7f81b2432800 20 add_watcher() i=7 2024-09-13T19:16:19.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.712+0000 7f81b2432800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:19.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.713+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620f7436a60 con 0x5620f74255d0 2024-09-13T19:16:19.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.713+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f819803b040 con 0x5620f74255d0 2024-09-13T19:16:19.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.713+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94699587331504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620f74369d0 con 0x5620f74255d0 2024-09-13T19:16:19.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.714+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94699587331504] v34'119 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f819803b040 con 0x5620f74255d0 2024-09-13T19:16:19.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.714+0000 7f80637e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:19.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.714+0000 7f81b2432800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:19.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.714+0000 7f81b2432800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:19.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.714+0000 7f81b2432800 5 note: GC not initialized 2024-09-13T19:16:19.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.714+0000 7f80627e4640 20 reqs_thread_entry: start 2024-09-13T19:16:19.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.714+0000 7f81b2432800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:19.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.715+0000 7f81b2432800 20 Filter name: none 2024-09-13T19:16:19.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.715+0000 7f7fd3fff640 20 reqs_thread_entry: start 2024-09-13T19:16:19.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.715+0000 7f81b2432800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:16:19.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.715+0000 7f81b2432800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.715+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620f746ce50 con 0x5620f74255d0 2024-09-13T19:16:19.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.715+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f819803b040 con 0x5620f74255d0 2024-09-13T19:16:19.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.715+0000 7f81b2432800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:16:19.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.715+0000 7f81b2432800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:16:19.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.715+0000 7f81b2432800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:16:19.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.715+0000 7f81b2432800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:16:19.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.715+0000 7f81b2432800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T19:16:19.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.715+0000 7f81b2432800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.715+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620f746ef30 con 0x7f81a8045040 2024-09-13T19:16:19.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.716+0000 7f81ad673640 1 -- 172.21.15.102:0/664299850 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f81a0057030 con 0x7f81a8045040 2024-09-13T19:16:19.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.716+0000 7f81b2432800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:16:19.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.716+0000 7f81b2432800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T19:16:19.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.716+0000 7f81b2432800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:16:19.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.716+0000 7f81b2432800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 : miss 2024-09-13T19:16:19.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.716+0000 7f81b2432800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.716+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:64 8.9 8:917ee2d5:root::.bucket.meta.myfoo%3a509740b4-c081-4f37-bd6d-df9ca851489b.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620f74707e0 con 0x7f81a8045040 2024-09-13T19:16:19.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.716+0000 7f81ad673640 1 -- 172.21.15.102:0/664299850 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(64 .bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv21 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f81a0057030 con 0x7f81a8045040 2024-09-13T19:16:19.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.716+0000 7f81b2432800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:16:19.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.716+0000 7f81b2432800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 info.flags=0x17 2024-09-13T19:16:19.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.716+0000 7f81b2432800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 to cache LRU end 2024-09-13T19:16:19.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.716+0000 7f81b2432800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:16:19.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.716+0000 7f81b2432800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:16:19.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.716+0000 7f81b2432800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 2024-09-13T19:16:19.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.716+0000 7f81b2432800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-13T19:16:19.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.716+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620f7474e70 con 0x7f81a0083040 2024-09-13T19:16:19.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.717+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(65 fud.buckets [call] v34'3 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f819803b040 con 0x7f81a0083040 2024-09-13T19:16:19.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.717+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:66 8.9 8:917ee2d5:root::.bucket.meta.myfoo%3a509740b4-c081-4f37-bd6d-df9ca851489b.4237.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620f747ace0 con 0x7f81a8045040 2024-09-13T19:16:19.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.718+0000 7f81ad673640 1 -- 172.21.15.102:0/664299850 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(66 .bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v34'24 uv24 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f81a0057030 con 0x7f81a8045040 2024-09-13T19:16:19.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.718+0000 7f81b2432800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 info.flags=0x17 2024-09-13T19:16:19.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.718+0000 7f81b2432800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 to cache LRU end 2024-09-13T19:16:19.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.718+0000 7f81b2432800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:16:19.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.718+0000 7f81b2432800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1, ofs0, ns] 2024-09-13T19:16:19.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.718+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify cookie 94699587567792 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620f74752a0 con 0x5620f74255d0 2024-09-13T19:16:19.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.718+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== watch-notify(notify (1) cookie 94699587322256 notify 146028888077 ret 0) ==== 794+0+0 (crc 0 0 0) 0x7f8198018040 con 0x5620f74255d0 2024-09-13T19:16:19.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.719+0000 7f8090ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888077 cookie 94699587322256 notifier 4531 bl.length()=752 2024-09-13T19:16:19.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.719+0000 7f8090ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 info.flags=0x17 2024-09-13T19:16:19.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.719+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(67 notify.4 [notify cookie 94699587567792 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f819803b040 con 0x5620f74255d0 2024-09-13T19:16:19.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.719+0000 7f8090ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 to cache LRU end 2024-09-13T19:16:19.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.719+0000 7f8090ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:16:19.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.719+0000 7f8090ff9640 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f8070003ea0 con 0x5620f74255d0 2024-09-13T19:16:19.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.719+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== watch-notify(notify_complete (2) cookie 94699587567792 notify 146028888077 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f8198009050 con 0x5620f74255d0 2024-09-13T19:16:19.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.719+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(68 notify.4 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819803b040 con 0x5620f74255d0 2024-09-13T19:16:19.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.719+0000 7f81b2432800 20 handle_bi_update(): bucket=:myfoo[509740b4-c081-4f37-bd6d-df9ca851489b.4237.1]): orig_sources= new_sources= 2024-09-13T19:16:19.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.719+0000 7f81b2432800 20 handle_bi_update(): bucket=:myfoo[509740b4-c081-4f37-bd6d-df9ca851489b.4237.1]): potential sources added=[] removed=[] 2024-09-13T19:16:19.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.719+0000 7f81b2432800 20 handle_bi_update(): bucket=:myfoo[509740b4-c081-4f37-bd6d-df9ca851489b.4237.1]): orig_dests= new_dests= 2024-09-13T19:16:19.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.719+0000 7f81b2432800 20 handle_bi_update(): bucket=:myfoo[509740b4-c081-4f37-bd6d-df9ca851489b.4237.1]): potential dests added=[] removed=[] 2024-09-13T19:16:19.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.719+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620f7479590 con 0x7f81a8045040 2024-09-13T19:16:19.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.720+0000 7f81ad673640 1 -- 172.21.15.102:0/664299850 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(69 foo.buckets [call] v34'25 uv25 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f81a0057030 con 0x7f81a8045040 2024-09-13T19:16:19.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.720+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620f74700b0 con 0x7f81a8045040 2024-09-13T19:16:19.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.721+0000 7f81ad673640 1 -- 172.21.15.102:0/664299850 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v34'26 uv26 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f81a0057030 con 0x7f81a8045040 2024-09-13T19:16:19.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.721+0000 7f81b2432800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-13T19:16:19.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.721+0000 7f81b2432800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:16:19.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.721+0000 7f81b2432800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T19:16:19.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.721+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94699587567792 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620f7479a40 con 0x7f81a0083040 2024-09-13T19:16:19.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.722+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== watch-notify(notify (1) cookie 94699587326368 notify 146028888075 ret 0) ==== 356+0+0 (crc 0 0 0) 0x5620f71b0b30 con 0x7f81a0083040 2024-09-13T19:16:19.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.722+0000 7f8090ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888075 cookie 94699587326368 notifier 4531 bl.length()=314 2024-09-13T19:16:19.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.722+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(71 notify.6 [notify cookie 94699587567792 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f819803b040 con 0x7f81a0083040 2024-09-13T19:16:19.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.722+0000 7f8090ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-13T19:16:19.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.722+0000 7f8090ff9640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:16:19.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.722+0000 7f8090ff9640 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f8070003ea0 con 0x7f81a0083040 2024-09-13T19:16:19.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.722+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 <== osd.0 v2:172.21.15.53:6800/4021716951 20 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819803b040 con 0x7f81a0083040 2024-09-13T19:16:19.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.722+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 <== osd.0 v2:172.21.15.53:6800/4021716951 21 ==== watch-notify(notify_complete (2) cookie 94699587567792 notify 146028888075 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f8198041860 con 0x7f81a0083040 2024-09-13T19:16:19.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.723+0000 7f80637e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:19.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.723+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94699587331504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620f746aba0 con 0x5620f74255d0 2024-09-13T19:16:19.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.724+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94699587331504] v34'120 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f819803b040 con 0x5620f74255d0 2024-09-13T19:16:19.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.724+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94699587306320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620f746aba0 con 0x7f81a8045040 2024-09-13T19:16:19.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.725+0000 7f81ad673640 1 -- 172.21.15.102:0/664299850 <== osd.2 v2:172.21.15.102:6816/2238176080 16 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94699587306320] v34'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81a0057030 con 0x7f81a8045040 2024-09-13T19:16:19.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.725+0000 7f81b2432800 20 remove_watcher() i=0 2024-09-13T19:16:19.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.725+0000 7f81b2432800 2 removed watcher, disabling cache 2024-09-13T19:16:19.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.725+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94699587310304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620f746aba0 con 0x5620f74255d0 2024-09-13T19:16:19.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.726+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94699587310304] v34'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819803b040 con 0x5620f74255d0 2024-09-13T19:16:19.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.726+0000 7f81b2432800 20 remove_watcher() i=1 2024-09-13T19:16:19.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.726+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94699587315152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620f746aba0 con 0x5620f7429fc0 2024-09-13T19:16:19.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.727+0000 7f81ade74640 1 -- 172.21.15.102:0/664299850 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94699587315152] v34'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81a8027020 con 0x5620f7429fc0 2024-09-13T19:16:19.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.727+0000 7f81b2432800 20 remove_watcher() i=2 2024-09-13T19:16:19.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.727+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94699587317488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620f746aba0 con 0x7f81a8045040 2024-09-13T19:16:19.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.728+0000 7f81ad673640 1 -- 172.21.15.102:0/664299850 <== osd.2 v2:172.21.15.102:6816/2238176080 17 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94699587317488] v34'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81a0057030 con 0x7f81a8045040 2024-09-13T19:16:19.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.728+0000 7f81b2432800 20 remove_watcher() i=3 2024-09-13T19:16:19.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.728+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94699587322256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620f746aba0 con 0x5620f74255d0 2024-09-13T19:16:19.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.729+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 <== osd.1 v2:172.21.15.102:6808/2204418452 28 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94699587322256] v34'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819803b040 con 0x5620f74255d0 2024-09-13T19:16:19.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.729+0000 7f81b2432800 20 remove_watcher() i=4 2024-09-13T19:16:19.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.729+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94699587319280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620f746aba0 con 0x7f81a0083040 2024-09-13T19:16:19.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.730+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 <== osd.0 v2:172.21.15.53:6800/4021716951 22 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94699587319280] v34'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819803b040 con 0x7f81a0083040 2024-09-13T19:16:19.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.730+0000 7f81b2432800 20 remove_watcher() i=5 2024-09-13T19:16:19.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.730+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94699587326368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620f746aba0 con 0x7f81a0083040 2024-09-13T19:16:19.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.731+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 <== osd.0 v2:172.21.15.53:6800/4021716951 23 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94699587326368] v34'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819803b040 con 0x7f81a0083040 2024-09-13T19:16:19.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.731+0000 7f81b2432800 20 remove_watcher() i=6 2024-09-13T19:16:19.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.731+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94699587330240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620f746aba0 con 0x7f81a0083040 2024-09-13T19:16:19.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.732+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 <== osd.0 v2:172.21.15.53:6800/4021716951 24 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94699587330240] v34'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819803b040 con 0x7f81a0083040 2024-09-13T19:16:19.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.732+0000 7f81b2432800 20 remove_watcher() i=7 2024-09-13T19:16:19.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.732+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f81a0083040 msgr2=0x7f81a00773b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.732+0000 7f81b2432800 1 --2- 172.21.15.102:0/664299850 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f81a0083040 0x7f81a00773b0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.732+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5620f74255d0 msgr2=0x5620f7427a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.732+0000 7f81b2432800 1 --2- 172.21.15.102:0/664299850 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5620f74255d0 0x5620f7427a90 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.732+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f81a8045040 msgr2=0x7f81a80126f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.732+0000 7f81b2432800 1 --2- 172.21.15.102:0/664299850 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f81a8045040 0x7f81a80126f0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.732+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5620f7429fc0 msgr2=0x5620f742c3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.732+0000 7f81b2432800 1 --2- 172.21.15.102:0/664299850 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5620f7429fc0 0x5620f742c3b0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.732+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8078036b90 msgr2=0x7f8078039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.732+0000 7f81b2432800 1 --2- 172.21.15.102:0/664299850 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8078036b90 0x7f8078039050 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f81a0065fb0 tx=0x7f81a0089000 comp rx=0 tx=0).stop 2024-09-13T19:16:19.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.732+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620f7412440 msgr2=0x5620f7419950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.732+0000 7f81a4e72640 1 -- 172.21.15.102:0/664299850 reap_dead start 2024-09-13T19:16:19.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.732+0000 7f81b2432800 1 --2- 172.21.15.102:0/664299850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620f7412440 0x5620f7419950 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f81a804ccf0 tx=0x7f81a804cd20 comp rx=0 tx=0).stop 2024-09-13T19:16:19.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.732+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 shutdown_connections 2024-09-13T19:16:19.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.732+0000 7f81b2432800 1 --2- 172.21.15.102:0/664299850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620f7412440 0x5620f7419950 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.732+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 >> 172.21.15.102:0/664299850 conn(0x5620f740e830 msgr2=0x5620f740c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:19.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.732+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 shutdown_connections 2024-09-13T19:16:19.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.732+0000 7f81b2432800 1 -- 172.21.15.102:0/664299850 wait complete. 2024-09-13T19:16:19.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.732+0000 7f81b2432800 1 -- 172.21.15.102:0/2153084962 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8084036b90 msgr2=0x7f8084039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.732+0000 7f81b2432800 1 --2- 172.21.15.102:0/2153084962 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8084036b90 0x7f8084039050 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f81a0064e50 tx=0x7f81a0064ee0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.732+0000 7f81b2432800 1 -- 172.21.15.102:0/2153084962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620f72f1b10 msgr2=0x5620f72f0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.732+0000 7f81b2432800 1 --2- 172.21.15.102:0/2153084962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620f72f1b10 0x5620f72f0160 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x5620f73f01f0 tx=0x7f81a80163e0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.732+0000 7f81b2432800 1 -- 172.21.15.102:0/2153084962 shutdown_connections 2024-09-13T19:16:19.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.732+0000 7f81b2432800 1 --2- 172.21.15.102:0/2153084962 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8084036b90 0x7f8084039050 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.732+0000 7f81b2432800 1 --2- 172.21.15.102:0/2153084962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620f72f1b10 0x5620f72f0160 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.732+0000 7f81b2432800 1 -- 172.21.15.102:0/2153084962 >> 172.21.15.102:0/2153084962 conn(0x5620f73f8510 msgr2=0x5620f73fb090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:19.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.732+0000 7f81b2432800 1 -- 172.21.15.102:0/2153084962 shutdown_connections 2024-09-13T19:16:19.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.732+0000 7f81b2432800 1 -- 172.21.15.102:0/2153084962 wait complete. 2024-09-13T19:16:19.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.733+0000 7f81b2432800 1 -- 172.21.15.102:0/1779430823 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5620f73ed4a0 msgr2=0x5620f73ef890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.733+0000 7f81b2432800 1 --2- 172.21.15.102:0/1779430823 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5620f73ed4a0 0x5620f73ef890 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.733+0000 7f81b2432800 1 -- 172.21.15.102:0/1779430823 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5620f73f2140 msgr2=0x5620f73f4530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.733+0000 7f81b2432800 1 --2- 172.21.15.102:0/1779430823 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5620f73f2140 0x5620f73f4530 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.733+0000 7f81b2432800 1 -- 172.21.15.102:0/1779430823 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8094036be0 msgr2=0x7f80940390a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.733+0000 7f81b2432800 1 --2- 172.21.15.102:0/1779430823 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8094036be0 0x7f80940390a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8198000f60 tx=0x7f8198001370 comp rx=0 tx=0).stop 2024-09-13T19:16:19.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.733+0000 7f81b2432800 1 -- 172.21.15.102:0/1779430823 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620f72f46a0 msgr2=0x5620f73e8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.733+0000 7f81b2432800 1 --2- 172.21.15.102:0/1779430823 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620f72f46a0 0x5620f73e8440 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f81a0067040 tx=0x7f81a0002fb0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.733+0000 7f81b2432800 1 -- 172.21.15.102:0/1779430823 shutdown_connections 2024-09-13T19:16:19.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.733+0000 7f81b2432800 1 --2- 172.21.15.102:0/1779430823 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5620f73f2140 0x5620f73f4530 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.733+0000 7f81b2432800 1 --2- 172.21.15.102:0/1779430823 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5620f73ed4a0 0x5620f73ef890 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.733+0000 7f81b2432800 1 --2- 172.21.15.102:0/1779430823 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8094036be0 0x7f80940390a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.733+0000 7f81b2432800 1 --2- 172.21.15.102:0/1779430823 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5620f72f46a0 0x5620f73e8440 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.733+0000 7f81b2432800 1 -- 172.21.15.102:0/1779430823 >> 172.21.15.102:0/1779430823 conn(0x5620f72ebe10 msgr2=0x5620f73dabd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:19.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.733+0000 7f81b2432800 1 -- 172.21.15.102:0/1779430823 shutdown_connections 2024-09-13T19:16:19.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.733+0000 7f81b2432800 1 -- 172.21.15.102:0/1779430823 wait complete. 2024-09-13T19:16:19.773 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-13T19:16:19.773 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-13T19:16:19.773 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-13T19:16:19.817 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:19.818 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:19.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.815+0000 7f73414b5800 1 Processor -- start 2024-09-13T19:16:19.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.815+0000 7f73414b5800 1 -- start start 2024-09-13T19:16:19.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.815+0000 7f73414b5800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x563a93a64d20 0x563a93a67110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.815+0000 7f73414b5800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563a9391db30 con 0x563a939d1dd0 2024-09-13T19:16:19.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.815+0000 7f73414b5800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x563a938ff360 con 0x563a93a64d20 2024-09-13T19:16:19.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.816+0000 7f7337fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x563a93a64d20 0x563a93a67110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.816+0000 7f733efa9640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x563a939d1dd0 0x563a93a63600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:50044/0 (socket says 172.21.15.102:50044) 2024-09-13T19:16:19.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.816+0000 7f733efa9640 1 -- 172.21.15.102:0/1359374358 learned_addr learned my addr 172.21.15.102:0/1359374358 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:16:19.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.816+0000 7f7337fff640 1 -- 172.21.15.102:0/1359374358 >> v1:172.21.15.53:6789/0 conn(0x563a939d1dd0 legacy=0x563a93a63600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.816+0000 7f7337fff640 1 -- 172.21.15.102:0/1359374358 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a93925e00 con 0x563a93a64d20 2024-09-13T19:16:19.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.818+0000 7f7337fff640 1 --2- 172.21.15.102:0/1359374358 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a93a64d20 0x563a93a67110 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f732800a470 tx=0x7f7328045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5983a5e0bdf17875 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.818+0000 7f733e7a8640 1 -- 172.21.15.102:0/1359374358 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7328053570 con 0x563a93a64d20 2024-09-13T19:16:19.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.818+0000 7f733e7a8640 1 -- 172.21.15.102:0/1359374358 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7328058070 con 0x563a93a64d20 2024-09-13T19:16:19.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.818+0000 7f733e7a8640 1 -- 172.21.15.102:0/1359374358 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7328053880 con 0x563a93a64d20 2024-09-13T19:16:19.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.818+0000 7f73414b5800 1 -- 172.21.15.102:0/1359374358 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a93a64d20 msgr2=0x563a93a67110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.818+0000 7f73414b5800 1 --2- 172.21.15.102:0/1359374358 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a93a64d20 0x563a93a67110 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f732800a470 tx=0x7f7328045a20 comp rx=0 tx=0).stop 2024-09-13T19:16:19.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.818+0000 7f73414b5800 1 -- 172.21.15.102:0/1359374358 shutdown_connections 2024-09-13T19:16:19.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.818+0000 7f73414b5800 1 --2- 172.21.15.102:0/1359374358 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a93a64d20 0x563a93a67110 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.818+0000 7f73414b5800 1 -- 172.21.15.102:0/1359374358 >> 172.21.15.102:0/1359374358 conn(0x563a93a58df0 msgr2=0x563a93a5b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:19.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.818+0000 7f73414b5800 1 -- 172.21.15.102:0/1359374358 shutdown_connections 2024-09-13T19:16:19.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.818+0000 7f73414b5800 1 -- 172.21.15.102:0/1359374358 wait complete. 2024-09-13T19:16:19.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.832+0000 7f73414b5800 1 Processor -- start 2024-09-13T19:16:19.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.832+0000 7f73414b5800 1 -- start start 2024-09-13T19:16:19.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.832+0000 7f73414b5800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a939d1dd0 0x563a93b4fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.832+0000 7f73414b5800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563a939aa330 con 0x563a939d1dd0 2024-09-13T19:16:19.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.832+0000 7f733efa9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a939d1dd0 0x563a93b4fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.832+0000 7f733efa9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a939d1dd0 0x563a93b4fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55676/0 (socket says 172.21.15.102:55676) 2024-09-13T19:16:19.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.832+0000 7f733efa9640 1 -- 172.21.15.102:0/2682305444 learned_addr learned my addr 172.21.15.102:0/2682305444 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:19.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.833+0000 7f733efa9640 1 -- 172.21.15.102:0/2682305444 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a938f7bc0 con 0x563a939d1dd0 2024-09-13T19:16:19.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.833+0000 7f733efa9640 1 --2- 172.21.15.102:0/2682305444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a939d1dd0 0x563a93b4fa50 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f7330001e10 tx=0x7f733000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dde2df7f3c0eaa1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.833+0000 7f722ce09640 1 -- 172.21.15.102:0/2682305444 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7330012020 con 0x563a939d1dd0 2024-09-13T19:16:19.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.833+0000 7f722ce09640 1 -- 172.21.15.102:0/2682305444 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f733000e5a0 con 0x563a939d1dd0 2024-09-13T19:16:19.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.833+0000 7f722ce09640 1 -- 172.21.15.102:0/2682305444 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f733000e8e0 con 0x563a939d1dd0 2024-09-13T19:16:19.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.834+0000 7f73414b5800 1 -- 172.21.15.102:0/2682305444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a939d1dd0 msgr2=0x563a93b4fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.834+0000 7f73414b5800 1 --2- 172.21.15.102:0/2682305444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a939d1dd0 0x563a93b4fa50 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f7330001e10 tx=0x7f733000b780 comp rx=0 tx=0).stop 2024-09-13T19:16:19.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.834+0000 7f73414b5800 1 -- 172.21.15.102:0/2682305444 shutdown_connections 2024-09-13T19:16:19.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.834+0000 7f73414b5800 1 --2- 172.21.15.102:0/2682305444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a939d1dd0 0x563a93b4fa50 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.834+0000 7f73414b5800 1 -- 172.21.15.102:0/2682305444 >> 172.21.15.102:0/2682305444 conn(0x563a93a58df0 msgr2=0x563a93b4b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:19.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.834+0000 7f73414b5800 1 -- 172.21.15.102:0/2682305444 shutdown_connections 2024-09-13T19:16:19.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.834+0000 7f73414b5800 1 -- 172.21.15.102:0/2682305444 wait complete. 2024-09-13T19:16:19.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.834+0000 7f73414b5800 1 Processor -- start 2024-09-13T19:16:19.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.834+0000 7f73414b5800 1 -- start start 2024-09-13T19:16:19.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.834+0000 7f73414b5800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a939d1dd0 0x563a93b57430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.834+0000 7f73414b5800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563a93a678f0 con 0x563a939d1dd0 2024-09-13T19:16:19.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.835+0000 7f733efa9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a939d1dd0 0x563a93b57430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.835+0000 7f733efa9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a939d1dd0 0x563a93b57430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55680/0 (socket says 172.21.15.102:55680) 2024-09-13T19:16:19.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.835+0000 7f733efa9640 1 -- 172.21.15.102:0/1943541040 learned_addr learned my addr 172.21.15.102:0/1943541040 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:19.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.835+0000 7f733efa9640 1 -- 172.21.15.102:0/1943541040 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a9390bfe0 con 0x563a939d1dd0 2024-09-13T19:16:19.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.835+0000 7f733efa9640 1 --2- 172.21.15.102:0/1943541040 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a939d1dd0 0x563a93b57430 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f733000b7c0 tx=0x7f7330000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.835+0000 7f722b606640 1 -- 172.21.15.102:0/1943541040 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7330012030 con 0x563a939d1dd0 2024-09-13T19:16:19.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.835+0000 7f722b606640 1 -- 172.21.15.102:0/1943541040 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7330001470 con 0x563a939d1dd0 2024-09-13T19:16:19.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.835+0000 7f73414b5800 1 -- 172.21.15.102:0/1943541040 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563a93b57970 con 0x563a939d1dd0 2024-09-13T19:16:19.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.835+0000 7f722b606640 1 -- 172.21.15.102:0/1943541040 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f733001a8d0 con 0x563a939d1dd0 2024-09-13T19:16:19.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.835+0000 7f73414b5800 1 -- 172.21.15.102:0/1943541040 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a93b57e90 con 0x563a939d1dd0 2024-09-13T19:16:19.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.836+0000 7f722b606640 1 -- 172.21.15.102:0/1943541040 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7330015020 con 0x563a939d1dd0 2024-09-13T19:16:19.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.836+0000 7f722b606640 1 --2- 172.21.15.102:0/1943541040 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7224036b40 0x7f7224039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.836+0000 7f722b606640 1 -- 172.21.15.102:0/1943541040 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f7330020030 con 0x563a939d1dd0 2024-09-13T19:16:19.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.836+0000 7f7337fff640 1 --2- 172.21.15.102:0/1943541040 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7224036b40 0x7f7224039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.836+0000 7f73414b5800 1 --2- 172.21.15.102:0/1943541040 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563a93a64d20 0x563a93b5e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.836+0000 7f73414b5800 1 -- 172.21.15.102:0/1943541040 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563a93b5ea70 con 0x563a93a64d20 2024-09-13T19:16:19.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.837+0000 7f733f7aa640 1 --2- 172.21.15.102:0/1943541040 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563a93a64d20 0x563a93b5e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.837+0000 7f7337fff640 1 --2- 172.21.15.102:0/1943541040 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7224036b40 0x7f7224039000 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7328057000 tx=0x7f7328052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.837+0000 7f733f7aa640 1 --2- 172.21.15.102:0/1943541040 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563a93a64d20 0x563a93b5e4a0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.837+0000 7f733f7aa640 1 -- 172.21.15.102:0/1943541040 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f733800a4a0 con 0x563a93a64d20 2024-09-13T19:16:19.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.837+0000 7f73414b5800 1 -- 172.21.15.102:0/1943541040 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563a93b5ba70 con 0x563a93a64d20 2024-09-13T19:16:19.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.837+0000 7f733f7aa640 1 -- 172.21.15.102:0/1943541040 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f733800a4a0 con 0x563a93a64d20 2024-09-13T19:16:19.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.837+0000 7f73414b5800 1 --2- 172.21.15.102:0/1943541040 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563a93b60d80 0x563a93b63170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.837+0000 7f73414b5800 1 -- 172.21.15.102:0/1943541040 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563a93b63810 con 0x563a93b60d80 2024-09-13T19:16:19.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.838+0000 7f733efa9640 1 --2- 172.21.15.102:0/1943541040 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563a93b60d80 0x563a93b63170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.838+0000 7f733efa9640 1 --2- 172.21.15.102:0/1943541040 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563a93b60d80 0x563a93b63170 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.838+0000 7f733efa9640 1 -- 172.21.15.102:0/1943541040 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f733002dcf0 con 0x563a93b60d80 2024-09-13T19:16:19.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.838+0000 7f73414b5800 1 -- 172.21.15.102:0/1943541040 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563a93b5fc20 con 0x563a93a64d20 2024-09-13T19:16:19.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.838+0000 7f733f7aa640 1 -- 172.21.15.102:0/1943541040 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f733800a4a0 con 0x563a93a64d20 2024-09-13T19:16:19.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.838+0000 7f73414b5800 1 -- 172.21.15.102:0/1943541040 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563a93b60100 con 0x563a93b60d80 2024-09-13T19:16:19.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.839+0000 7f733efa9640 1 -- 172.21.15.102:0/1943541040 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f733002dcf0 con 0x563a93b60d80 2024-09-13T19:16:19.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.839+0000 7f73414b5800 1 Processor -- start 2024-09-13T19:16:19.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.839+0000 7f73414b5800 1 -- start start 2024-09-13T19:16:19.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.839+0000 7f73414b5800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a93b721a0 0x563a93b725c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.839+0000 7f73414b5800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563a938f9580 con 0x563a93b721a0 2024-09-13T19:16:19.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.839+0000 7f733f7aa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a93b721a0 0x563a93b725c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.839+0000 7f733f7aa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a93b721a0 0x563a93b725c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55682/0 (socket says 172.21.15.102:55682) 2024-09-13T19:16:19.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.839+0000 7f733f7aa640 1 -- 172.21.15.102:0/466560844 learned_addr learned my addr 172.21.15.102:0/466560844 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:19.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.840+0000 7f733f7aa640 1 -- 172.21.15.102:0/466560844 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a93b72b00 con 0x563a93b721a0 2024-09-13T19:16:19.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.840+0000 7f733f7aa640 1 --2- 172.21.15.102:0/466560844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a93b721a0 0x563a93b725c0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x563a93b584e0 tx=0x7f73380167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.840+0000 7f7228e01640 1 -- 172.21.15.102:0/466560844 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7338013640 con 0x563a93b721a0 2024-09-13T19:16:19.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.840+0000 7f7228e01640 1 -- 172.21.15.102:0/466560844 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73380137e0 con 0x563a93b721a0 2024-09-13T19:16:19.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.840+0000 7f73414b5800 1 -- 172.21.15.102:0/466560844 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563a93b72d90 con 0x563a93b721a0 2024-09-13T19:16:19.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.840+0000 7f7228e01640 1 -- 172.21.15.102:0/466560844 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7338013ae0 con 0x563a93b721a0 2024-09-13T19:16:19.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.840+0000 7f73414b5800 1 -- 172.21.15.102:0/466560844 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a93b75a70 con 0x563a93b721a0 2024-09-13T19:16:19.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.841+0000 7f7228e01640 1 -- 172.21.15.102:0/466560844 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7338011040 con 0x563a93b721a0 2024-09-13T19:16:19.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.841+0000 7f7228e01640 1 --2- 172.21.15.102:0/466560844 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7218036b90 0x7f7218039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.841+0000 7f7228e01640 1 -- 172.21.15.102:0/466560844 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f733800e040 con 0x563a93b721a0 2024-09-13T19:16:19.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.841+0000 7f733efa9640 1 --2- 172.21.15.102:0/466560844 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7218036b90 0x7f7218039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.841+0000 7f73414b5800 1 Processor -- start 2024-09-13T19:16:19.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.841+0000 7f73414b5800 1 -- start start 2024-09-13T19:16:19.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.841+0000 7f733efa9640 1 --2- 172.21.15.102:0/466560844 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7218036b90 0x7f7218039050 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x563a93b5b990 tx=0x7f733000e530 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.841+0000 7f73414b5800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a93b7ee60 0x563a93b7f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.841+0000 7f73414b5800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563a93b50200 con 0x563a93b7ee60 2024-09-13T19:16:19.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.842+0000 7f733f7aa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a93b7ee60 0x563a93b7f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.842+0000 7f733f7aa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a93b7ee60 0x563a93b7f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55688/0 (socket says 172.21.15.102:55688) 2024-09-13T19:16:19.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.842+0000 7f733f7aa640 1 -- 172.21.15.102:0/592130238 learned_addr learned my addr 172.21.15.102:0/592130238 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:19.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.842+0000 7f733f7aa640 1 -- 172.21.15.102:0/592130238 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a93b7f830 con 0x563a93b7ee60 2024-09-13T19:16:19.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.842+0000 7f733f7aa640 1 --2- 172.21.15.102:0/592130238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a93b7ee60 0x563a93b7f260 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f733800afb0 tx=0x7f733801fcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95fa8cec908c273f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.842+0000 7f72227fc640 1 -- 172.21.15.102:0/592130238 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7338021570 con 0x563a93b7ee60 2024-09-13T19:16:19.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.842+0000 7f72227fc640 1 -- 172.21.15.102:0/592130238 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f733801f340 con 0x563a93b7ee60 2024-09-13T19:16:19.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.842+0000 7f72227fc640 1 -- 172.21.15.102:0/592130238 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7338014cc0 con 0x563a93b7ee60 2024-09-13T19:16:19.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.843+0000 7f73414b5800 1 -- 172.21.15.102:0/592130238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a93b7ee60 msgr2=0x563a93b7f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.843+0000 7f73414b5800 1 --2- 172.21.15.102:0/592130238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a93b7ee60 0x563a93b7f260 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f733800afb0 tx=0x7f733801fcc0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.843+0000 7f73414b5800 1 -- 172.21.15.102:0/592130238 shutdown_connections 2024-09-13T19:16:19.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.843+0000 7f73414b5800 1 --2- 172.21.15.102:0/592130238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a93b7ee60 0x563a93b7f260 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.843+0000 7f73414b5800 1 -- 172.21.15.102:0/592130238 >> 172.21.15.102:0/592130238 conn(0x563a93b7b1c0 msgr2=0x563a93b792c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:19.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.843+0000 7f73414b5800 1 -- 172.21.15.102:0/592130238 shutdown_connections 2024-09-13T19:16:19.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.843+0000 7f73414b5800 1 -- 172.21.15.102:0/592130238 wait complete. 2024-09-13T19:16:19.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.843+0000 7f73414b5800 1 Processor -- start 2024-09-13T19:16:19.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.843+0000 7f73414b5800 1 -- start start 2024-09-13T19:16:19.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.843+0000 7f73414b5800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a93b7ee60 0x563a93b862d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.843+0000 7f73414b5800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563a93b7fea0 con 0x563a93b7ee60 2024-09-13T19:16:19.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.843+0000 7f733f7aa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a93b7ee60 0x563a93b862d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.843+0000 7f733f7aa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a93b7ee60 0x563a93b862d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55698/0 (socket says 172.21.15.102:55698) 2024-09-13T19:16:19.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.843+0000 7f733f7aa640 1 -- 172.21.15.102:0/3779137195 learned_addr learned my addr 172.21.15.102:0/3779137195 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:19.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.844+0000 7f733f7aa640 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a93b86810 con 0x563a93b7ee60 2024-09-13T19:16:19.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.844+0000 7f733f7aa640 1 --2- 172.21.15.102:0/3779137195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a93b7ee60 0x563a93b862d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f7338048010 tx=0x7f733804cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.844+0000 7f7220ff9640 1 -- 172.21.15.102:0/3779137195 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7338013e60 con 0x563a93b7ee60 2024-09-13T19:16:19.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.844+0000 7f7220ff9640 1 -- 172.21.15.102:0/3779137195 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7338040360 con 0x563a93b7ee60 2024-09-13T19:16:19.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.844+0000 7f7220ff9640 1 -- 172.21.15.102:0/3779137195 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f733804e2b0 con 0x563a93b7ee60 2024-09-13T19:16:19.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.844+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563a93b86aa0 con 0x563a93b7ee60 2024-09-13T19:16:19.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.844+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a93b86aa0 con 0x563a93b7ee60 2024-09-13T19:16:19.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.845+0000 7f7220ff9640 1 -- 172.21.15.102:0/3779137195 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f733804e470 con 0x563a93b7ee60 2024-09-13T19:16:19.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.845+0000 7f7220ff9640 1 --2- 172.21.15.102:0/3779137195 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7208036b40 0x7f7208039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.845+0000 7f7220ff9640 1 -- 172.21.15.102:0/3779137195 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f7338041040 con 0x563a93b7ee60 2024-09-13T19:16:19.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.845+0000 7f733efa9640 1 --2- 172.21.15.102:0/3779137195 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7208036b40 0x7f7208039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.845+0000 7f733efa9640 1 --2- 172.21.15.102:0/3779137195 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7208036b40 0x7f7208039000 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7330000fd0 tx=0x7f7330036000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.845+0000 7f73414b5800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.846+0000 7f73414b5800 1 --2- 172.21.15.102:0/3779137195 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563a93b91b90 0x563a93b94050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.846+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563a93b947a0 con 0x563a93b91b90 2024-09-13T19:16:19.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.846+0000 7f7337fff640 1 --2- 172.21.15.102:0/3779137195 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563a93b91b90 0x563a93b94050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.846+0000 7f7337fff640 1 --2- 172.21.15.102:0/3779137195 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563a93b91b90 0x563a93b94050 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.846+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7328051070 con 0x563a93b91b90 2024-09-13T19:16:19.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.846+0000 7f73414b5800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:19.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.846+0000 7f73414b5800 20 realm 2024-09-13T19:16:19.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.846+0000 7f73414b5800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.846+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563a93b94bd0 con 0x563a93b91b90 2024-09-13T19:16:19.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.846+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7328051070 con 0x563a93b91b90 2024-09-13T19:16:19.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.846+0000 7f73414b5800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:19.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.846+0000 7f73414b5800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:19.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.846+0000 7f73414b5800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.846+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563a93b954a0 con 0x563a93b91b90 2024-09-13T19:16:19.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.847+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7328051070 con 0x563a93b91b90 2024-09-13T19:16:19.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.847+0000 7f73414b5800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:19.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.847+0000 7f73414b5800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.847+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563a93b95840 con 0x563a93b91b90 2024-09-13T19:16:19.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.847+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7328051070 con 0x563a93b91b90 2024-09-13T19:16:19.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.847+0000 7f73414b5800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:19.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.847+0000 7f73414b5800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.847+0000 7f73414b5800 1 --2- 172.21.15.102:0/3779137195 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563a93b965a0 0x563a93b98990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.847+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563a93b98fa0 con 0x563a93b965a0 2024-09-13T19:16:19.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.847+0000 7f733f7aa640 1 --2- 172.21.15.102:0/3779137195 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563a93b965a0 0x563a93b98990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.847+0000 7f733f7aa640 1 --2- 172.21.15.102:0/3779137195 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563a93b965a0 0x563a93b98990 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.848+0000 7f733f7aa640 1 -- 172.21.15.102:0/3779137195 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7338055070 con 0x563a93b965a0 2024-09-13T19:16:19.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.848+0000 7f73414b5800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:19.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.848+0000 7f73414b5800 20 searching for the correct realm 2024-09-13T19:16:19.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.848+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a93b9a8b0 con 0x563a93b965a0 2024-09-13T19:16:19.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.848+0000 7f733f7aa640 1 -- 172.21.15.102:0/3779137195 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7338055070 con 0x563a93b965a0 2024-09-13T19:16:19.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.848+0000 7f733f7aa640 1 --2- 172.21.15.102:0/3779137195 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f7338044070 0x7f733804b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.848+0000 7f733f7aa640 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a93b9a8b0 con 0x7f7338044070 2024-09-13T19:16:19.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.848+0000 7f733efa9640 1 --2- 172.21.15.102:0/3779137195 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f7338044070 0x7f733804b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.848+0000 7f733efa9640 1 --2- 172.21.15.102:0/3779137195 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f7338044070 0x7f733804b250 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.849+0000 7f733efa9640 1 -- 172.21.15.102:0/3779137195 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f733002dcf0 con 0x7f7338044070 2024-09-13T19:16:19.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.849+0000 7f733efa9640 1 --2- 172.21.15.102:0/3779137195 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f7330059040 0x7f733002d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.849+0000 7f733efa9640 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a93b9a8b0 con 0x7f7330059040 2024-09-13T19:16:19.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.849+0000 7f7337fff640 1 --2- 172.21.15.102:0/3779137195 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f7330059040 0x7f733002d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.849+0000 7f7337fff640 1 --2- 172.21.15.102:0/3779137195 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f7330059040 0x7f733002d3f0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.849+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7328051070 con 0x7f7330059040 2024-09-13T19:16:19.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.849+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a93b9a8b0 con 0x563a93b91b90 2024-09-13T19:16:19.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.850+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7328051070 con 0x563a93b91b90 2024-09-13T19:16:19.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.850+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a93b9a8b0 con 0x563a93b91b90 2024-09-13T19:16:19.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.850+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7328051070 con 0x563a93b91b90 2024-09-13T19:16:19.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.850+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a93b9a8b0 con 0x7f7330059040 2024-09-13T19:16:19.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.850+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7328051070 con 0x7f7330059040 2024-09-13T19:16:19.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.850+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a93b9a8b0 con 0x7f7330059040 2024-09-13T19:16:19.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.850+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7328051070 con 0x7f7330059040 2024-09-13T19:16:19.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.850+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a93b9a8b0 con 0x7f7338044070 2024-09-13T19:16:19.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.851+0000 7f733efa9640 1 -- 172.21.15.102:0/3779137195 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f733002dcf0 con 0x7f7338044070 2024-09-13T19:16:19.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.851+0000 7f733efa9640 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a93b9a8b0 con 0x563a93b965a0 2024-09-13T19:16:19.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.851+0000 7f733f7aa640 1 -- 172.21.15.102:0/3779137195 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7338055070 con 0x563a93b965a0 2024-09-13T19:16:19.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.851+0000 7f733f7aa640 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a93b9a8b0 con 0x563a93b91b90 2024-09-13T19:16:19.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.851+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7328051070 con 0x563a93b91b90 2024-09-13T19:16:19.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.851+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a93b9a8b0 con 0x7f7330059040 2024-09-13T19:16:19.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.851+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7328051070 con 0x7f7330059040 2024-09-13T19:16:19.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.851+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a93b9a8b0 con 0x563a93b91b90 2024-09-13T19:16:19.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.852+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7328051070 con 0x563a93b91b90 2024-09-13T19:16:19.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.852+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a93b9a8b0 con 0x7f7338044070 2024-09-13T19:16:19.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.852+0000 7f733efa9640 1 -- 172.21.15.102:0/3779137195 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f733002dcf0 con 0x7f7338044070 2024-09-13T19:16:19.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.852+0000 7f733efa9640 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a93b9a8b0 con 0x563a93b965a0 2024-09-13T19:16:19.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.852+0000 7f733f7aa640 1 -- 172.21.15.102:0/3779137195 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7338055070 con 0x563a93b965a0 2024-09-13T19:16:19.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.852+0000 7f733f7aa640 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a93b9a8b0 con 0x563a93b965a0 2024-09-13T19:16:19.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.852+0000 7f733f7aa640 1 -- 172.21.15.102:0/3779137195 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7338055070 con 0x563a93b965a0 2024-09-13T19:16:19.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.852+0000 7f733f7aa640 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a93b9a8b0 con 0x7f7330059040 2024-09-13T19:16:19.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.853+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7328051070 con 0x7f7330059040 2024-09-13T19:16:19.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.853+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a93b9a8b0 con 0x563a93b965a0 2024-09-13T19:16:19.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.853+0000 7f733f7aa640 1 -- 172.21.15.102:0/3779137195 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7338055070 con 0x563a93b965a0 2024-09-13T19:16:19.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.853+0000 7f733f7aa640 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a93b9a8b0 con 0x563a93b965a0 2024-09-13T19:16:19.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.853+0000 7f733f7aa640 1 -- 172.21.15.102:0/3779137195 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7338055070 con 0x563a93b965a0 2024-09-13T19:16:19.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.853+0000 7f733f7aa640 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a93b9a8b0 con 0x563a93b91b90 2024-09-13T19:16:19.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.853+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7328051070 con 0x563a93b91b90 2024-09-13T19:16:19.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.853+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a93b9a8b0 con 0x563a93b91b90 2024-09-13T19:16:19.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.853+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7328051070 con 0x563a93b91b90 2024-09-13T19:16:19.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.853+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a93b9a8b0 con 0x7f7330059040 2024-09-13T19:16:19.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.854+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7328051070 con 0x7f7330059040 2024-09-13T19:16:19.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.854+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a93b9a8b0 con 0x563a93b965a0 2024-09-13T19:16:19.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.854+0000 7f733f7aa640 1 -- 172.21.15.102:0/3779137195 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7338055070 con 0x563a93b965a0 2024-09-13T19:16:19.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.854+0000 7f733f7aa640 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a93b9a8b0 con 0x7f7338044070 2024-09-13T19:16:19.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.854+0000 7f733efa9640 1 -- 172.21.15.102:0/3779137195 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f733002dcf0 con 0x7f7338044070 2024-09-13T19:16:19.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.854+0000 7f733efa9640 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a93b9a8b0 con 0x563a93b91b90 2024-09-13T19:16:19.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.854+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7328051070 con 0x563a93b91b90 2024-09-13T19:16:19.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.854+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a93b9a8b0 con 0x7f7330059040 2024-09-13T19:16:19.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.855+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7328051070 con 0x7f7330059040 2024-09-13T19:16:19.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.855+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a93b9a8b0 con 0x563a93b965a0 2024-09-13T19:16:19.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.855+0000 7f733f7aa640 1 -- 172.21.15.102:0/3779137195 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7338055070 con 0x563a93b965a0 2024-09-13T19:16:19.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.855+0000 7f733f7aa640 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563a93b9a8b0 con 0x7f7330059040 2024-09-13T19:16:19.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.855+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7328051070 con 0x7f7330059040 2024-09-13T19:16:19.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.855+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7328086040 con 0x7f7338044070 2024-09-13T19:16:19.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.855+0000 7f733efa9640 1 -- 172.21.15.102:0/3779137195 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f733002dcf0 con 0x7f7338044070 2024-09-13T19:16:19.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.855+0000 7f733efa9640 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7328086040 con 0x563a93b965a0 2024-09-13T19:16:19.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.856+0000 7f733f7aa640 1 -- 172.21.15.102:0/3779137195 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7338055070 con 0x563a93b965a0 2024-09-13T19:16:19.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.856+0000 7f733f7aa640 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7328086040 con 0x7f7330059040 2024-09-13T19:16:19.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.856+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7328051070 con 0x7f7330059040 2024-09-13T19:16:19.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.856+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7328086040 con 0x563a93b91b90 2024-09-13T19:16:19.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.856+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7328051070 con 0x563a93b91b90 2024-09-13T19:16:19.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.856+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7328086040 con 0x7f7338044070 2024-09-13T19:16:19.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.856+0000 7f733efa9640 1 -- 172.21.15.102:0/3779137195 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f733002dcf0 con 0x7f7338044070 2024-09-13T19:16:19.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.856+0000 7f73414b5800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:19.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.856+0000 7f73414b5800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:19.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.856+0000 7f73414b5800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:19.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.856+0000 7f73414b5800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:19.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.856+0000 7f73414b5800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:19.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.856+0000 7f73414b5800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:19.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.856+0000 7f73414b5800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.856+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563a93b997f0 con 0x563a93b91b90 2024-09-13T19:16:19.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.857+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7328051070 con 0x563a93b91b90 2024-09-13T19:16:19.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.857+0000 7f73414b5800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:19.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.857+0000 7f73414b5800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.857+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563a93b99be0 con 0x563a93b91b90 2024-09-13T19:16:19.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.857+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7328051070 con 0x563a93b91b90 2024-09-13T19:16:19.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.857+0000 7f73414b5800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:19.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.857+0000 7f73414b5800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.857+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563a93b9ad30 con 0x563a93b965a0 2024-09-13T19:16:19.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.857+0000 7f733f7aa640 1 -- 172.21.15.102:0/3779137195 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7338055070 con 0x563a93b965a0 2024-09-13T19:16:19.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.857+0000 7f73414b5800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:19.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.857+0000 7f73414b5800 20 zone default found 2024-09-13T19:16:19.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.857+0000 7f73414b5800 4 Realm: () 2024-09-13T19:16:19.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.857+0000 7f73414b5800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:19.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.857+0000 7f73414b5800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:19.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.857+0000 7f73414b5800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:19.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.857+0000 7f73414b5800 20 zonegroup default 2024-09-13T19:16:19.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.857+0000 7f73414b5800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.857+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563a93b9b580 con 0x7f7330059040 2024-09-13T19:16:19.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.857+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7328051070 con 0x7f7330059040 2024-09-13T19:16:19.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.857+0000 7f73414b5800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:19.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.858+0000 7f73414b5800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.858+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563a93b9cf60 con 0x563a93b965a0 2024-09-13T19:16:19.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.858+0000 7f733f7aa640 1 -- 172.21.15.102:0/3779137195 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7338055070 con 0x563a93b965a0 2024-09-13T19:16:19.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.858+0000 7f73414b5800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:19.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.858+0000 7f73414b5800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.858+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563a93b9d3c0 con 0x563a93b965a0 2024-09-13T19:16:19.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.858+0000 7f733f7aa640 1 -- 172.21.15.102:0/3779137195 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7338055070 con 0x563a93b965a0 2024-09-13T19:16:19.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.858+0000 7f73414b5800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:19.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.858+0000 7f73414b5800 20 started sync module instance, tier type = 2024-09-13T19:16:19.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.858+0000 7f73414b5800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:19.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.858+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93b9c3f0 con 0x7f7338044070 2024-09-13T19:16:19.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.859+0000 7f733efa9640 1 -- 172.21.15.102:0/3779137195 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(44 notify.0 [create] v34'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f733002dcf0 con 0x7f7338044070 2024-09-13T19:16:19.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.859+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94809586517984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93b9c050 con 0x7f7338044070 2024-09-13T19:16:19.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.859+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93b9e1c0 con 0x563a93b91b90 2024-09-13T19:16:19.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.860+0000 7f733efa9640 1 -- 172.21.15.102:0/3779137195 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94809586517984] v34'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f733002dcf0 con 0x7f7338044070 2024-09-13T19:16:19.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.860+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v34'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7328051070 con 0x563a93b91b90 2024-09-13T19:16:19.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.860+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94809586522112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93b9e5b0 con 0x563a93b91b90 2024-09-13T19:16:19.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.860+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93b9eff0 con 0x563a93b965a0 2024-09-13T19:16:19.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.862+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94809586522112] v34'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7328051070 con 0x563a93b91b90 2024-09-13T19:16:19.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.862+0000 7f733f7aa640 1 -- 172.21.15.102:0/3779137195 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v34'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7338055070 con 0x563a93b965a0 2024-09-13T19:16:19.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.862+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94809586526912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93b9efb0 con 0x563a93b965a0 2024-09-13T19:16:19.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.862+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93b9faa0 con 0x7f7338044070 2024-09-13T19:16:19.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.863+0000 7f733f7aa640 1 -- 172.21.15.102:0/3779137195 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94809586526912] v34'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7338055070 con 0x563a93b965a0 2024-09-13T19:16:19.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.863+0000 7f733efa9640 1 -- 172.21.15.102:0/3779137195 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(50 notify.3 [create] v34'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f733002dcf0 con 0x7f7338044070 2024-09-13T19:16:19.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.863+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94809586529712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93b9fe90 con 0x7f7338044070 2024-09-13T19:16:19.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.863+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93ba08f0 con 0x563a93b91b90 2024-09-13T19:16:19.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.864+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v34'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7328051070 con 0x563a93b91b90 2024-09-13T19:16:19.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.864+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94809586533328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93ba1190 con 0x563a93b91b90 2024-09-13T19:16:19.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.864+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93ba1c50 con 0x7f7330059040 2024-09-13T19:16:19.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.864+0000 7f733efa9640 1 -- 172.21.15.102:0/3779137195 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94809586529712] v34'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f733002dcf0 con 0x7f7338044070 2024-09-13T19:16:19.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.865+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94809586533328] v34'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7328051070 con 0x563a93b91b90 2024-09-13T19:16:19.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.865+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(54 notify.5 [create] v34'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7328051070 con 0x7f7330059040 2024-09-13T19:16:19.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.865+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94809586538272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93ba0bf0 con 0x7f7330059040 2024-09-13T19:16:19.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.865+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93ba24f0 con 0x7f7330059040 2024-09-13T19:16:19.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.866+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94809586538272] v34'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7328051070 con 0x7f7330059040 2024-09-13T19:16:19.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.866+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(56 notify.6 [create] v34'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7328051070 con 0x7f7330059040 2024-09-13T19:16:19.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.866+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94809586523168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93ba0bf0 con 0x7f7330059040 2024-09-13T19:16:19.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.866+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93ba2b10 con 0x7f7330059040 2024-09-13T19:16:19.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.867+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94809586523168] v34'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7328051070 con 0x7f7330059040 2024-09-13T19:16:19.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.867+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(58 notify.7 [create] v34'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7328051070 con 0x7f7330059040 2024-09-13T19:16:19.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.867+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94809586540528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93ba2b10 con 0x7f7330059040 2024-09-13T19:16:19.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.867+0000 7f73414b5800 20 add_watcher() i=0 2024-09-13T19:16:19.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.867+0000 7f73414b5800 20 add_watcher() i=1 2024-09-13T19:16:19.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.867+0000 7f73414b5800 20 add_watcher() i=2 2024-09-13T19:16:19.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.867+0000 7f73414b5800 20 add_watcher() i=3 2024-09-13T19:16:19.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.867+0000 7f73414b5800 20 add_watcher() i=4 2024-09-13T19:16:19.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.867+0000 7f73414b5800 20 add_watcher() i=5 2024-09-13T19:16:19.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.867+0000 7f73414b5800 20 add_watcher() i=6 2024-09-13T19:16:19.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.868+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94809586540528] v34'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7328051070 con 0x7f7330059040 2024-09-13T19:16:19.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.868+0000 7f73414b5800 20 add_watcher() i=7 2024-09-13T19:16:19.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.868+0000 7f73414b5800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:19.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.868+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563a93ba5e50 con 0x563a93b91b90 2024-09-13T19:16:19.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.868+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7328051070 con 0x563a93b91b90 2024-09-13T19:16:19.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.868+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94809586554992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93ba2c80 con 0x563a93b91b90 2024-09-13T19:16:19.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.870+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94809586554992] v34'121 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7328051070 con 0x563a93b91b90 2024-09-13T19:16:19.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.870+0000 7f71f57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:19.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.870+0000 7f73414b5800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:19.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.870+0000 7f73414b5800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:19.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.870+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93ba5250 con 0x563a93b91b90 2024-09-13T19:16:19.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.871+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7328051070 con 0x563a93b91b90 2024-09-13T19:16:19.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.871+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93baf030 con 0x7f7330059040 2024-09-13T19:16:19.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.872+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'15 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7328051070 con 0x7f7330059040 2024-09-13T19:16:19.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.872+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93baf5a0 con 0x563a93b965a0 2024-09-13T19:16:19.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.873+0000 7f733f7aa640 1 -- 172.21.15.102:0/3779137195 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7338055070 con 0x563a93b965a0 2024-09-13T19:16:19.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.873+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93baf630 con 0x563a93b91b90 2024-09-13T19:16:19.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.874+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'122 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7328051070 con 0x563a93b91b90 2024-09-13T19:16:19.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.874+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93baf6c0 con 0x7f7338044070 2024-09-13T19:16:19.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.875+0000 7f733efa9640 1 -- 172.21.15.102:0/3779137195 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'35 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f733002dcf0 con 0x7f7338044070 2024-09-13T19:16:19.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.875+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93bafac0 con 0x563a93b965a0 2024-09-13T19:16:19.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.876+0000 7f733f7aa640 1 -- 172.21.15.102:0/3779137195 <== osd.3 v2:172.21.15.102:6800/3096737090 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'24 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7338055070 con 0x563a93b965a0 2024-09-13T19:16:19.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.876+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93bafac0 con 0x563a93b91b90 2024-09-13T19:16:19.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.877+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7328051070 con 0x563a93b91b90 2024-09-13T19:16:19.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.877+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93bafac0 con 0x7f7330059040 2024-09-13T19:16:19.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.878+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'23 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7328051070 con 0x7f7330059040 2024-09-13T19:16:19.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.878+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93bafb50 con 0x7f7338044070 2024-09-13T19:16:19.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.879+0000 7f733efa9640 1 -- 172.21.15.102:0/3779137195 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f733002dcf0 con 0x7f7338044070 2024-09-13T19:16:19.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.879+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93bb0000 con 0x563a93b965a0 2024-09-13T19:16:19.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.880+0000 7f733f7aa640 1 -- 172.21.15.102:0/3779137195 <== osd.3 v2:172.21.15.102:6800/3096737090 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7338055070 con 0x563a93b965a0 2024-09-13T19:16:19.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.880+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93bb0000 con 0x7f7338044070 2024-09-13T19:16:19.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.881+0000 7f733efa9640 1 -- 172.21.15.102:0/3779137195 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'36 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f733002dcf0 con 0x7f7338044070 2024-09-13T19:16:19.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.881+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93bb0000 con 0x7f7330059040 2024-09-13T19:16:19.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.882+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7328051070 con 0x7f7330059040 2024-09-13T19:16:19.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.882+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93bb0000 con 0x7f7338044070 2024-09-13T19:16:19.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.883+0000 7f733efa9640 1 -- 172.21.15.102:0/3779137195 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f733002dcf0 con 0x7f7338044070 2024-09-13T19:16:19.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.883+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93bb0000 con 0x7f7330059040 2024-09-13T19:16:19.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.884+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.0 v2:172.21.15.53:6800/4021716951 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'29 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7328051070 con 0x7f7330059040 2024-09-13T19:16:19.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.884+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93bb0000 con 0x563a93b91b90 2024-09-13T19:16:19.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.885+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'123 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7328051070 con 0x563a93b91b90 2024-09-13T19:16:19.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.885+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93bb0000 con 0x563a93b965a0 2024-09-13T19:16:19.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.886+0000 7f733f7aa640 1 -- 172.21.15.102:0/3779137195 <== osd.3 v2:172.21.15.102:6800/3096737090 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'29 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7338055070 con 0x563a93b965a0 2024-09-13T19:16:19.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.886+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93baff70 con 0x7f7338044070 2024-09-13T19:16:19.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.887+0000 7f733efa9640 1 -- 172.21.15.102:0/3779137195 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'37 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f733002dcf0 con 0x7f7338044070 2024-09-13T19:16:19.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.887+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93baff70 con 0x563a93b965a0 2024-09-13T19:16:19.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.888+0000 7f733f7aa640 1 -- 172.21.15.102:0/3779137195 <== osd.3 v2:172.21.15.102:6800/3096737090 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7338055070 con 0x563a93b965a0 2024-09-13T19:16:19.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.888+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93baff70 con 0x563a93b91b90 2024-09-13T19:16:19.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.889+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7328051070 con 0x563a93b91b90 2024-09-13T19:16:19.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.889+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93baff70 con 0x563a93b91b90 2024-09-13T19:16:19.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.890+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'124 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7328051070 con 0x563a93b91b90 2024-09-13T19:16:19.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.890+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93baff70 con 0x563a93b965a0 2024-09-13T19:16:19.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.892+0000 7f733f7aa640 1 -- 172.21.15.102:0/3779137195 <== osd.3 v2:172.21.15.102:6800/3096737090 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'30 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7338055070 con 0x563a93b965a0 2024-09-13T19:16:19.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.892+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93baff70 con 0x7f7338044070 2024-09-13T19:16:19.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.894+0000 7f733efa9640 1 -- 172.21.15.102:0/3779137195 <== osd.2 v2:172.21.15.102:6816/2238176080 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f733002dcf0 con 0x7f7338044070 2024-09-13T19:16:19.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.894+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93baff70 con 0x563a93b965a0 2024-09-13T19:16:19.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.895+0000 7f733f7aa640 1 -- 172.21.15.102:0/3779137195 <== osd.3 v2:172.21.15.102:6800/3096737090 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7338055070 con 0x563a93b965a0 2024-09-13T19:16:19.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.895+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93baff70 con 0x563a93b965a0 2024-09-13T19:16:19.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.896+0000 7f733f7aa640 1 -- 172.21.15.102:0/3779137195 <== osd.3 v2:172.21.15.102:6800/3096737090 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7338055070 con 0x563a93b965a0 2024-09-13T19:16:19.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.896+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93baff70 con 0x563a93b965a0 2024-09-13T19:16:19.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.897+0000 7f733f7aa640 1 -- 172.21.15.102:0/3779137195 <== osd.3 v2:172.21.15.102:6800/3096737090 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7338055070 con 0x563a93b965a0 2024-09-13T19:16:19.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.897+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93baff70 con 0x563a93b965a0 2024-09-13T19:16:19.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.898+0000 7f733f7aa640 1 -- 172.21.15.102:0/3779137195 <== osd.3 v2:172.21.15.102:6800/3096737090 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'25 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7338055070 con 0x563a93b965a0 2024-09-13T19:16:19.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.898+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93baff70 con 0x7f7330059040 2024-09-13T19:16:19.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.899+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.0 v2:172.21.15.53:6800/4021716951 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7328051070 con 0x7f7330059040 2024-09-13T19:16:19.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.899+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93baff70 con 0x563a93b965a0 2024-09-13T19:16:19.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.900+0000 7f733f7aa640 1 -- 172.21.15.102:0/3779137195 <== osd.3 v2:172.21.15.102:6800/3096737090 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7338055070 con 0x563a93b965a0 2024-09-13T19:16:19.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.900+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93baff70 con 0x7f7330059040 2024-09-13T19:16:19.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.901+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.0 v2:172.21.15.53:6800/4021716951 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'24 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7328051070 con 0x7f7330059040 2024-09-13T19:16:19.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.901+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93baff70 con 0x563a93b965a0 2024-09-13T19:16:19.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.902+0000 7f733f7aa640 1 -- 172.21.15.102:0/3779137195 <== osd.3 v2:172.21.15.102:6800/3096737090 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'31 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7338055070 con 0x563a93b965a0 2024-09-13T19:16:19.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.902+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93baff70 con 0x7f7330059040 2024-09-13T19:16:19.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.903+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.0 v2:172.21.15.53:6800/4021716951 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'30 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7328051070 con 0x7f7330059040 2024-09-13T19:16:19.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.903+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93baff70 con 0x7f7338044070 2024-09-13T19:16:19.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.904+0000 7f733efa9640 1 -- 172.21.15.102:0/3779137195 <== osd.2 v2:172.21.15.102:6816/2238176080 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f733002dcf0 con 0x7f7338044070 2024-09-13T19:16:19.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.905+0000 7f716ffff640 20 reqs_thread_entry: start 2024-09-13T19:16:19.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.905+0000 7f73414b5800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:19.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.905+0000 7f73414b5800 20 Filter name: none 2024-09-13T19:16:19.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.905+0000 7f716dffb640 20 reqs_thread_entry: start 2024-09-13T19:16:19.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.905+0000 7f73414b5800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T19:16:19.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.905+0000 7f73414b5800 20 rados->read ofs=0 len=0 2024-09-13T19:16:19.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.905+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563a93bdaf20 con 0x7f7330059040 2024-09-13T19:16:19.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.905+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.0 v2:172.21.15.53:6800/4021716951 24 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f7328051070 con 0x7f7330059040 2024-09-13T19:16:19.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.906+0000 7f73414b5800 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T19:16:19.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.906+0000 7f73414b5800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-13T19:16:19.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.906+0000 7f73414b5800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T19:16:19.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.906+0000 7f73414b5800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:16:19.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.906+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563a93bdd4e0 con 0x7f7330059040 2024-09-13T19:16:19.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.906+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.0 v2:172.21.15.53:6800/4021716951 25 ==== osd_op_reply(95 fud.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 155+0+15 (crc 0 0 0) 0x7f7328051070 con 0x7f7330059040 2024-09-13T19:16:19.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.906+0000 7f73414b5800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-13T19:16:19.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.906+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93bdb480 con 0x7f7330059040 2024-09-13T19:16:19.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.907+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.0 v2:172.21.15.53:6800/4021716951 26 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v34'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f7328051070 con 0x7f7330059040 2024-09-13T19:16:19.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.907+0000 7f73414b5800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T19:16:19.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.907+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94809586774064 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563a93bdcd80 con 0x563a93b965a0 2024-09-13T19:16:19.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.907+0000 7f733f7aa640 1 -- 172.21.15.102:0/3779137195 <== osd.3 v2:172.21.15.102:6800/3096737090 28 ==== watch-notify(notify (1) cookie 94809586526912 notify 146028888067 ret 0) ==== 212+0+0 (crc 0 0 0) 0x563a93ba4ed0 con 0x563a93b965a0 2024-09-13T19:16:19.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.907+0000 7f72227fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888067 cookie 94809586526912 notifier 4538 bl.length()=170 2024-09-13T19:16:19.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.907+0000 7f733f7aa640 1 -- 172.21.15.102:0/3779137195 <== osd.3 v2:172.21.15.102:6800/3096737090 29 ==== osd_op_reply(97 notify.2 [notify cookie 94809586774064 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7338055070 con 0x563a93b965a0 2024-09-13T19:16:19.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.907+0000 7f72227fc640 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f7204003d60 con 0x563a93b965a0 2024-09-13T19:16:19.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.907+0000 7f733f7aa640 1 -- 172.21.15.102:0/3779137195 <== osd.3 v2:172.21.15.102:6800/3096737090 30 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7338055070 con 0x563a93b965a0 2024-09-13T19:16:19.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.908+0000 7f733f7aa640 1 -- 172.21.15.102:0/3779137195 <== osd.3 v2:172.21.15.102:6800/3096737090 31 ==== watch-notify(notify_complete (2) cookie 94809586774064 notify 146028888067 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f733805f020 con 0x563a93b965a0 2024-09-13T19:16:19.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.908+0000 7f73414b5800 10 removing email index: 2024-09-13T19:16:19.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.908+0000 7f73414b5800 10 removing user buckets index 2024-09-13T19:16:19.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.908+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:99 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93bdb000 con 0x7f7330059040 2024-09-13T19:16:19.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.909+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.0 v2:172.21.15.53:6800/4021716951 27 ==== osd_op_reply(99 fud.buckets [delete] v34'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f7328051070 con 0x7f7330059040 2024-09-13T19:16:19.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.909+0000 7f73414b5800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-13T19:16:19.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.909+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94809586774016 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563a93bdc8d0 con 0x7f7330059040 2024-09-13T19:16:19.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.909+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.0 v2:172.21.15.53:6800/4021716951 28 ==== watch-notify(notify (1) cookie 94809586523168 notify 146028888076 ret 0) ==== 202+0+0 (crc 0 0 0) 0x563a93baf030 con 0x7f7330059040 2024-09-13T19:16:19.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.909+0000 7f7221ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888076 cookie 94809586523168 notifier 4538 bl.length()=160 2024-09-13T19:16:19.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.909+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.0 v2:172.21.15.53:6800/4021716951 29 ==== osd_op_reply(100 notify.6 [notify cookie 94809586774016 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7328051070 con 0x7f7330059040 2024-09-13T19:16:19.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.909+0000 7f7221ffb640 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f71740032c0 con 0x7f7330059040 2024-09-13T19:16:19.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.909+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.0 v2:172.21.15.53:6800/4021716951 30 ==== watch-notify(notify_complete (2) cookie 94809586774016 notify 146028888076 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563a93ba4d00 con 0x7f7330059040 2024-09-13T19:16:19.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.909+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.0 v2:172.21.15.53:6800/4021716951 31 ==== osd_op_reply(101 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7328051070 con 0x7f7330059040 2024-09-13T19:16:19.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.909+0000 7f73414b5800 10 removing user index: fud 2024-09-13T19:16:19.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.909+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93bdd170 con 0x7f7330059040 2024-09-13T19:16:19.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.910+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.0 v2:172.21.15.53:6800/4021716951 32 ==== osd_op_reply(102 fud [call,call,delete] v34'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f7328051070 con 0x7f7330059040 2024-09-13T19:16:19.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.910+0000 7f73414b5800 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-13T19:16:19.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.910+0000 7f73414b5800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-13T19:16:19.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.910+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify cookie 94809586782576 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563a93bdc880 con 0x7f7330059040 2024-09-13T19:16:19.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.911+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.0 v2:172.21.15.53:6800/4021716951 33 ==== watch-notify(notify (1) cookie 94809586538272 notify 146028888077 ret 0) ==== 194+0+0 (crc 0 0 0) 0x563a93ba4d00 con 0x7f7330059040 2024-09-13T19:16:19.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.911+0000 7f72227fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888077 cookie 94809586538272 notifier 4538 bl.length()=152 2024-09-13T19:16:19.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.911+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.0 v2:172.21.15.53:6800/4021716951 34 ==== osd_op_reply(103 notify.5 [notify cookie 94809586782576 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7328051070 con 0x7f7330059040 2024-09-13T19:16:19.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.911+0000 7f72227fc640 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f7204003d60 con 0x7f7330059040 2024-09-13T19:16:19.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.911+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.0 v2:172.21.15.53:6800/4021716951 35 ==== osd_op_reply(104 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7328051070 con 0x7f7330059040 2024-09-13T19:16:19.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.911+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.0 v2:172.21.15.53:6800/4021716951 36 ==== watch-notify(notify_complete (2) cookie 94809586782576 notify 146028888077 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563a93ba55f0 con 0x7f7330059040 2024-09-13T19:16:19.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.912+0000 7f71f57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:19.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.912+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94809586554992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93bdd170 con 0x563a93b91b90 2024-09-13T19:16:19.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.913+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94809586554992] v34'125 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7328051070 con 0x563a93b91b90 2024-09-13T19:16:19.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.913+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94809586517984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93ba57c0 con 0x7f7338044070 2024-09-13T19:16:19.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.914+0000 7f733efa9640 1 -- 172.21.15.102:0/3779137195 <== osd.2 v2:172.21.15.102:6816/2238176080 18 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94809586517984] v34'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f733002dcf0 con 0x7f7338044070 2024-09-13T19:16:19.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.914+0000 7f73414b5800 20 remove_watcher() i=0 2024-09-13T19:16:19.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.914+0000 7f73414b5800 2 removed watcher, disabling cache 2024-09-13T19:16:19.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.914+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94809586522112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93b9c7e0 con 0x563a93b91b90 2024-09-13T19:16:19.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.915+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.1 v2:172.21.15.102:6808/2204418452 28 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94809586522112] v34'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7328051070 con 0x563a93b91b90 2024-09-13T19:16:19.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.915+0000 7f73414b5800 20 remove_watcher() i=1 2024-09-13T19:16:19.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.915+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94809586526912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93b9c7e0 con 0x563a93b965a0 2024-09-13T19:16:19.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.916+0000 7f733f7aa640 1 -- 172.21.15.102:0/3779137195 <== osd.3 v2:172.21.15.102:6800/3096737090 32 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94809586526912] v34'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7338055070 con 0x563a93b965a0 2024-09-13T19:16:19.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.916+0000 7f73414b5800 20 remove_watcher() i=2 2024-09-13T19:16:19.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.916+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94809586529712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93b9eac0 con 0x7f7338044070 2024-09-13T19:16:19.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.917+0000 7f733efa9640 1 -- 172.21.15.102:0/3779137195 <== osd.2 v2:172.21.15.102:6816/2238176080 19 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94809586529712] v34'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f733002dcf0 con 0x7f7338044070 2024-09-13T19:16:19.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.917+0000 7f73414b5800 20 remove_watcher() i=3 2024-09-13T19:16:19.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.917+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94809586533328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93b9c7e0 con 0x563a93b91b90 2024-09-13T19:16:19.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.918+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.1 v2:172.21.15.102:6808/2204418452 29 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94809586533328] v34'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7328051070 con 0x563a93b91b90 2024-09-13T19:16:19.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.918+0000 7f73414b5800 20 remove_watcher() i=4 2024-09-13T19:16:19.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.918+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94809586538272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93b9f5b0 con 0x7f7330059040 2024-09-13T19:16:19.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.919+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.0 v2:172.21.15.53:6800/4021716951 37 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94809586538272] v34'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7328051070 con 0x7f7330059040 2024-09-13T19:16:19.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.919+0000 7f73414b5800 20 remove_watcher() i=5 2024-09-13T19:16:19.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.919+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94809586523168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93b9eac0 con 0x7f7330059040 2024-09-13T19:16:19.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.920+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.0 v2:172.21.15.53:6800/4021716951 38 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94809586523168] v34'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7328051070 con 0x7f7330059040 2024-09-13T19:16:19.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.920+0000 7f73414b5800 20 remove_watcher() i=6 2024-09-13T19:16:19.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.920+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94809586540528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563a93ba03d0 con 0x7f7330059040 2024-09-13T19:16:19.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.921+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 <== osd.0 v2:172.21.15.53:6800/4021716951 39 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94809586540528] v34'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7328051070 con 0x7f7330059040 2024-09-13T19:16:19.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.921+0000 7f73414b5800 20 remove_watcher() i=7 2024-09-13T19:16:19.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.921+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f7330059040 msgr2=0x7f733002d3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.921+0000 7f73414b5800 1 --2- 172.21.15.102:0/3779137195 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f7330059040 0x7f733002d3f0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.921+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563a93b91b90 msgr2=0x563a93b94050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.921+0000 7f73414b5800 1 --2- 172.21.15.102:0/3779137195 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563a93b91b90 0x563a93b94050 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.921+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f7338044070 msgr2=0x7f733804b250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.921+0000 7f73414b5800 1 --2- 172.21.15.102:0/3779137195 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f7338044070 0x7f733804b250 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.921+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563a93b965a0 msgr2=0x563a93b98990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.921+0000 7f73414b5800 1 --2- 172.21.15.102:0/3779137195 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563a93b965a0 0x563a93b98990 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.921+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7208036b40 msgr2=0x7f7208039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.921+0000 7f73414b5800 1 --2- 172.21.15.102:0/3779137195 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7208036b40 0x7f7208039000 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7330000fd0 tx=0x7f7330036000 comp rx=0 tx=0).stop 2024-09-13T19:16:19.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.921+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a93b7ee60 msgr2=0x563a93b862d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.921+0000 7f73414b5800 1 --2- 172.21.15.102:0/3779137195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a93b7ee60 0x563a93b862d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f7338048010 tx=0x7f733804cd90 comp rx=0 tx=0).stop 2024-09-13T19:16:19.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.921+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 reap_dead start 2024-09-13T19:16:19.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.921+0000 7f7337fff640 1 -- 172.21.15.102:0/3779137195 reap_dead start 2024-09-13T19:16:19.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.921+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 shutdown_connections 2024-09-13T19:16:19.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.921+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 >> 172.21.15.102:0/3779137195 conn(0x563a93b7b1c0 msgr2=0x563a93b79290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:19.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.922+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 shutdown_connections 2024-09-13T19:16:19.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.922+0000 7f73414b5800 1 -- 172.21.15.102:0/3779137195 wait complete. 2024-09-13T19:16:19.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.922+0000 7f73414b5800 1 -- 172.21.15.102:0/466560844 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7218036b90 msgr2=0x7f7218039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.922+0000 7f73414b5800 1 --2- 172.21.15.102:0/466560844 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7218036b90 0x7f7218039050 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x563a93b5b990 tx=0x7f733000e530 comp rx=0 tx=0).stop 2024-09-13T19:16:19.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.922+0000 7f73414b5800 1 -- 172.21.15.102:0/466560844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a93b721a0 msgr2=0x563a93b725c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.922+0000 7f73414b5800 1 --2- 172.21.15.102:0/466560844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a93b721a0 0x563a93b725c0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x563a93b584e0 tx=0x7f73380167b0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.922+0000 7f73414b5800 1 -- 172.21.15.102:0/466560844 shutdown_connections 2024-09-13T19:16:19.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.922+0000 7f73414b5800 1 --2- 172.21.15.102:0/466560844 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7218036b90 0x7f7218039050 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.922+0000 7f73414b5800 1 --2- 172.21.15.102:0/466560844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a93b721a0 0x563a93b725c0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.922+0000 7f73414b5800 1 -- 172.21.15.102:0/466560844 >> 172.21.15.102:0/466560844 conn(0x563a93b67130 msgr2=0x563a93b69cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:19.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.922+0000 7f73414b5800 1 -- 172.21.15.102:0/466560844 shutdown_connections 2024-09-13T19:16:19.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.922+0000 7f73414b5800 1 -- 172.21.15.102:0/466560844 wait complete. 2024-09-13T19:16:19.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.922+0000 7f73414b5800 1 -- 172.21.15.102:0/1943541040 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563a93a64d20 msgr2=0x563a93b5e4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.922+0000 7f73414b5800 1 --2- 172.21.15.102:0/1943541040 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563a93a64d20 0x563a93b5e4a0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.922+0000 7f73414b5800 1 -- 172.21.15.102:0/1943541040 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563a93b60d80 msgr2=0x563a93b63170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.922+0000 7f73414b5800 1 --2- 172.21.15.102:0/1943541040 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563a93b60d80 0x563a93b63170 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.922+0000 7f73414b5800 1 -- 172.21.15.102:0/1943541040 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7224036b40 msgr2=0x7f7224039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.922+0000 7f73414b5800 1 --2- 172.21.15.102:0/1943541040 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7224036b40 0x7f7224039000 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7328057000 tx=0x7f7328052000 comp rx=0 tx=0).stop 2024-09-13T19:16:19.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.922+0000 7f73414b5800 1 -- 172.21.15.102:0/1943541040 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a939d1dd0 msgr2=0x563a93b57430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.922+0000 7f73414b5800 1 --2- 172.21.15.102:0/1943541040 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a939d1dd0 0x563a93b57430 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f733000b7c0 tx=0x7f7330000ed0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.923+0000 7f73414b5800 1 -- 172.21.15.102:0/1943541040 shutdown_connections 2024-09-13T19:16:19.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.923+0000 7f73414b5800 1 --2- 172.21.15.102:0/1943541040 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563a93b60d80 0x563a93b63170 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.923+0000 7f73414b5800 1 --2- 172.21.15.102:0/1943541040 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563a93a64d20 0x563a93b5e4a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.923+0000 7f73414b5800 1 --2- 172.21.15.102:0/1943541040 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7224036b40 0x7f7224039000 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.923+0000 7f73414b5800 1 --2- 172.21.15.102:0/1943541040 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a939d1dd0 0x563a93b57430 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.923+0000 7f73414b5800 1 -- 172.21.15.102:0/1943541040 >> 172.21.15.102:0/1943541040 conn(0x563a93a58df0 msgr2=0x563a93b49d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:19.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.923+0000 7f73414b5800 1 -- 172.21.15.102:0/1943541040 shutdown_connections 2024-09-13T19:16:19.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.923+0000 7f73414b5800 1 -- 172.21.15.102:0/1943541040 wait complete. 2024-09-13T19:16:19.934 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-13T19:16:19.934 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-13T19:16:19.935 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-13T19:16:19.990 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:19.990 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:19.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.987+0000 7f7b76610800 1 Processor -- start 2024-09-13T19:16:19.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.987+0000 7f7b76610800 1 -- start start 2024-09-13T19:16:19.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.987+0000 7f7b76610800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x558720c75950 0x558720c77d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:19.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.987+0000 7f7b76610800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558720b30b30 con 0x558720be5660 2024-09-13T19:16:19.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.987+0000 7f7b76610800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x558720b12360 con 0x558720c75950 2024-09-13T19:16:19.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.988+0000 7f7b714f6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x558720c75950 0x558720c77d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:19.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.988+0000 7f7b714f6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x558720c75950 0x558720c77d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55706/0 (socket says 172.21.15.102:55706) 2024-09-13T19:16:19.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.988+0000 7f7b71cf7640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x558720be5660 0x558720c74230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:50046/0 (socket says 172.21.15.102:50046) 2024-09-13T19:16:19.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.988+0000 7f7b714f6640 1 -- 172.21.15.102:0/2953554199 learned_addr learned my addr 172.21.15.102:0/2953554199 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:19.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.988+0000 7f7b714f6640 1 -- 172.21.15.102:0/2953554199 >> v1:172.21.15.53:6789/0 conn(0x558720be5660 legacy=0x558720c74230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.988+0000 7f7b714f6640 1 -- 172.21.15.102:0/2953554199 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558720b38e00 con 0x558720c75950 2024-09-13T19:16:19.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.990+0000 7f7b714f6640 1 --2- 172.21.15.102:0/2953554199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558720c75950 0x558720c77d40 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f7b6800a520 tx=0x7f7b68045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1340c0bdb396905 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:19.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.990+0000 7f7b70cf5640 1 -- 172.21.15.102:0/2953554199 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b68055070 con 0x558720c75950 2024-09-13T19:16:19.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.990+0000 7f7b70cf5640 1 -- 172.21.15.102:0/2953554199 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b680515b0 con 0x558720c75950 2024-09-13T19:16:19.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.990+0000 7f7b70cf5640 1 -- 172.21.15.102:0/2953554199 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b680518d0 con 0x558720c75950 2024-09-13T19:16:19.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.990+0000 7f7b76610800 1 -- 172.21.15.102:0/2953554199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558720c75950 msgr2=0x558720c77d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:19.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.990+0000 7f7b76610800 1 --2- 172.21.15.102:0/2953554199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558720c75950 0x558720c77d40 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f7b6800a520 tx=0x7f7b68045ba0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.990+0000 7f7b76610800 1 -- 172.21.15.102:0/2953554199 shutdown_connections 2024-09-13T19:16:19.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.990+0000 7f7b76610800 1 --2- 172.21.15.102:0/2953554199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558720c75950 0x558720c77d40 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:19.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.990+0000 7f7b76610800 1 -- 172.21.15.102:0/2953554199 >> 172.21.15.102:0/2953554199 conn(0x558720c6bde0 msgr2=0x558720c6e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:19.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.990+0000 7f7b76610800 1 -- 172.21.15.102:0/2953554199 shutdown_connections 2024-09-13T19:16:19.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:19.990+0000 7f7b76610800 1 -- 172.21.15.102:0/2953554199 wait complete. 2024-09-13T19:16:20.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.004+0000 7f7b76610800 1 Processor -- start 2024-09-13T19:16:20.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.004+0000 7f7b76610800 1 -- start start 2024-09-13T19:16:20.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.005+0000 7f7b76610800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558720be5660 0x558720d60950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.005+0000 7f7b76610800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558720bbd450 con 0x558720be5660 2024-09-13T19:16:20.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.005+0000 7f7b71cf7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558720be5660 0x558720d60950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.005+0000 7f7b71cf7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558720be5660 0x558720d60950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55712/0 (socket says 172.21.15.102:55712) 2024-09-13T19:16:20.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.005+0000 7f7b71cf7640 1 -- 172.21.15.102:0/3912303866 learned_addr learned my addr 172.21.15.102:0/3912303866 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:20.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.005+0000 7f7b71cf7640 1 -- 172.21.15.102:0/3912303866 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558720b0abc0 con 0x558720be5660 2024-09-13T19:16:20.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.005+0000 7f7b71cf7640 1 --2- 172.21.15.102:0/3912303866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558720be5660 0x558720d60950 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f7b64001650 tx=0x7f7b64001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=119d0379f02ac2fc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.005+0000 7f7a5fe07640 1 -- 172.21.15.102:0/3912303866 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b64013420 con 0x558720be5660 2024-09-13T19:16:20.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.005+0000 7f7a5fe07640 1 -- 172.21.15.102:0/3912303866 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b640135c0 con 0x558720be5660 2024-09-13T19:16:20.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.005+0000 7f7a5fe07640 1 -- 172.21.15.102:0/3912303866 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b640138c0 con 0x558720be5660 2024-09-13T19:16:20.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.006+0000 7f7b76610800 1 -- 172.21.15.102:0/3912303866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558720be5660 msgr2=0x558720d60950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.006+0000 7f7b76610800 1 --2- 172.21.15.102:0/3912303866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558720be5660 0x558720d60950 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f7b64001650 tx=0x7f7b64001b10 comp rx=0 tx=0).stop 2024-09-13T19:16:20.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.006+0000 7f7b76610800 1 -- 172.21.15.102:0/3912303866 shutdown_connections 2024-09-13T19:16:20.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.006+0000 7f7b76610800 1 --2- 172.21.15.102:0/3912303866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558720be5660 0x558720d60950 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.006+0000 7f7b76610800 1 -- 172.21.15.102:0/3912303866 >> 172.21.15.102:0/3912303866 conn(0x558720c6bde0 msgr2=0x558720d5c310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:20.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.006+0000 7f7b76610800 1 -- 172.21.15.102:0/3912303866 shutdown_connections 2024-09-13T19:16:20.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.006+0000 7f7b76610800 1 -- 172.21.15.102:0/3912303866 wait complete. 2024-09-13T19:16:20.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.007+0000 7f7b76610800 1 Processor -- start 2024-09-13T19:16:20.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.007+0000 7f7b76610800 1 -- start start 2024-09-13T19:16:20.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.007+0000 7f7b76610800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558720be5660 0x558720c71b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.007+0000 7f7b76610800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558720c78640 con 0x558720be5660 2024-09-13T19:16:20.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.007+0000 7f7b71cf7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558720be5660 0x558720c71b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.007+0000 7f7b71cf7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558720be5660 0x558720c71b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55722/0 (socket says 172.21.15.102:55722) 2024-09-13T19:16:20.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.007+0000 7f7b71cf7640 1 -- 172.21.15.102:0/4029535774 learned_addr learned my addr 172.21.15.102:0/4029535774 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:20.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.007+0000 7f7b71cf7640 1 -- 172.21.15.102:0/4029535774 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558720b1efe0 con 0x558720be5660 2024-09-13T19:16:20.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.007+0000 7f7b71cf7640 1 --2- 172.21.15.102:0/4029535774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558720be5660 0x558720c71b40 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x558720d617b0 tx=0x7f7b64001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.007+0000 7f7a5e604640 1 -- 172.21.15.102:0/4029535774 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b64022020 con 0x558720be5660 2024-09-13T19:16:20.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.008+0000 7f7a5e604640 1 -- 172.21.15.102:0/4029535774 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b64006830 con 0x558720be5660 2024-09-13T19:16:20.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.008+0000 7f7b76610800 1 -- 172.21.15.102:0/4029535774 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558720c70230 con 0x558720be5660 2024-09-13T19:16:20.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.008+0000 7f7a5e604640 1 -- 172.21.15.102:0/4029535774 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b64004b30 con 0x558720be5660 2024-09-13T19:16:20.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.008+0000 7f7b76610800 1 -- 172.21.15.102:0/4029535774 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558720c70750 con 0x558720be5660 2024-09-13T19:16:20.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.008+0000 7f7a5e604640 1 -- 172.21.15.102:0/4029535774 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7b64025020 con 0x558720be5660 2024-09-13T19:16:20.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.008+0000 7f7a5e604640 1 --2- 172.21.15.102:0/4029535774 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7a58036b90 0x7f7a58039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.009+0000 7f7a5e604640 1 -- 172.21.15.102:0/4029535774 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f7b64018030 con 0x558720be5660 2024-09-13T19:16:20.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.009+0000 7f7b714f6640 1 --2- 172.21.15.102:0/4029535774 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7a58036b90 0x7f7a58039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.009+0000 7f7b76610800 1 --2- 172.21.15.102:0/4029535774 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x558720c75950 0x558720d71770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.009+0000 7f7b76610800 1 -- 172.21.15.102:0/4029535774 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558720d71cb0 con 0x558720c75950 2024-09-13T19:16:20.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.009+0000 7f7b724f8640 1 --2- 172.21.15.102:0/4029535774 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x558720c75950 0x558720d71770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.009+0000 7f7b714f6640 1 --2- 172.21.15.102:0/4029535774 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7a58036b90 0x7f7a58039050 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7b68057000 tx=0x7f7b68052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.009+0000 7f7b724f8640 1 --2- 172.21.15.102:0/4029535774 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x558720c75950 0x558720d71770 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.009+0000 7f7b724f8640 1 -- 172.21.15.102:0/4029535774 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b6c0083e0 con 0x558720c75950 2024-09-13T19:16:20.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.009+0000 7f7b76610800 1 -- 172.21.15.102:0/4029535774 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558720d72070 con 0x558720c75950 2024-09-13T19:16:20.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.010+0000 7f7b724f8640 1 -- 172.21.15.102:0/4029535774 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7b6c0083e0 con 0x558720c75950 2024-09-13T19:16:20.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.010+0000 7f7b76610800 1 --2- 172.21.15.102:0/4029535774 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x558720d73e80 0x558720d76270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.010+0000 7f7b76610800 1 -- 172.21.15.102:0/4029535774 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558720d769b0 con 0x558720d73e80 2024-09-13T19:16:20.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.010+0000 7f7b71cf7640 1 --2- 172.21.15.102:0/4029535774 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x558720d73e80 0x558720d76270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.010+0000 7f7b71cf7640 1 --2- 172.21.15.102:0/4029535774 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x558720d73e80 0x558720d76270 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.010+0000 7f7b71cf7640 1 -- 172.21.15.102:0/4029535774 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7b6401b070 con 0x558720d73e80 2024-09-13T19:16:20.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.010+0000 7f7b76610800 1 -- 172.21.15.102:0/4029535774 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558720d72d20 con 0x558720c75950 2024-09-13T19:16:20.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.011+0000 7f7b724f8640 1 -- 172.21.15.102:0/4029535774 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7b6c0083e0 con 0x558720c75950 2024-09-13T19:16:20.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.011+0000 7f7b76610800 1 -- 172.21.15.102:0/4029535774 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558720d731c0 con 0x558720d73e80 2024-09-13T19:16:20.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.011+0000 7f7b71cf7640 1 -- 172.21.15.102:0/4029535774 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7b6401b070 con 0x558720d73e80 2024-09-13T19:16:20.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.011+0000 7f7b76610800 1 Processor -- start 2024-09-13T19:16:20.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.011+0000 7f7b76610800 1 -- start start 2024-09-13T19:16:20.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.011+0000 7f7b76610800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558720d85310 0x558720d85730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.011+0000 7f7b76610800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558720b0c580 con 0x558720d85310 2024-09-13T19:16:20.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.012+0000 7f7b724f8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558720d85310 0x558720d85730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.012+0000 7f7b724f8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558720d85310 0x558720d85730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55728/0 (socket says 172.21.15.102:55728) 2024-09-13T19:16:20.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.012+0000 7f7b724f8640 1 -- 172.21.15.102:0/1165797208 learned_addr learned my addr 172.21.15.102:0/1165797208 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:20.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.012+0000 7f7b724f8640 1 -- 172.21.15.102:0/1165797208 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558720d85c70 con 0x558720d85310 2024-09-13T19:16:20.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.012+0000 7f7b724f8640 1 --2- 172.21.15.102:0/1165797208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558720d85310 0x558720d85730 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x558720c71530 tx=0x7f7b6c00beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.012+0000 7f7a577fe640 1 -- 172.21.15.102:0/1165797208 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b6c01c020 con 0x558720d85310 2024-09-13T19:16:20.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.012+0000 7f7a577fe640 1 -- 172.21.15.102:0/1165797208 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b6c007ca0 con 0x558720d85310 2024-09-13T19:16:20.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.012+0000 7f7b76610800 1 -- 172.21.15.102:0/1165797208 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558720d85f00 con 0x558720d85310 2024-09-13T19:16:20.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.012+0000 7f7a577fe640 1 -- 172.21.15.102:0/1165797208 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b6c018440 con 0x558720d85310 2024-09-13T19:16:20.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.013+0000 7f7b76610800 1 -- 172.21.15.102:0/1165797208 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558720d88be0 con 0x558720d85310 2024-09-13T19:16:20.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.013+0000 7f7a577fe640 1 -- 172.21.15.102:0/1165797208 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7b6c01f020 con 0x558720d85310 2024-09-13T19:16:20.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.013+0000 7f7a577fe640 1 --2- 172.21.15.102:0/1165797208 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7a4c036b90 0x7f7a4c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.013+0000 7f7a577fe640 1 -- 172.21.15.102:0/1165797208 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f7b6c04e210 con 0x558720d85310 2024-09-13T19:16:20.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.013+0000 7f7b71cf7640 1 --2- 172.21.15.102:0/1165797208 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7a4c036b90 0x7f7a4c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.014+0000 7f7b76610800 1 Processor -- start 2024-09-13T19:16:20.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.014+0000 7f7b71cf7640 1 --2- 172.21.15.102:0/1165797208 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7a4c036b90 0x7f7a4c039050 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x558720d72430 tx=0x7f7b64026e50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.014+0000 7f7b76610800 1 -- start start 2024-09-13T19:16:20.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.014+0000 7f7b76610800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558720d91f90 0x558720d92390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.014+0000 7f7b76610800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558720d61100 con 0x558720d91f90 2024-09-13T19:16:20.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.014+0000 7f7b724f8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558720d91f90 0x558720d92390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.014+0000 7f7b724f8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558720d91f90 0x558720d92390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55742/0 (socket says 172.21.15.102:55742) 2024-09-13T19:16:20.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.014+0000 7f7b724f8640 1 -- 172.21.15.102:0/1499145895 learned_addr learned my addr 172.21.15.102:0/1499145895 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:20.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.014+0000 7f7b724f8640 1 -- 172.21.15.102:0/1499145895 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558720d92960 con 0x558720d91f90 2024-09-13T19:16:20.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.015+0000 7f7b724f8640 1 --2- 172.21.15.102:0/1499145895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558720d91f90 0x558720d92390 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c04c5a0 tx=0x7f7b6c04c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=455cbdb301e2bc7d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.015+0000 7f7a557fa640 1 -- 172.21.15.102:0/1499145895 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b6c045070 con 0x558720d91f90 2024-09-13T19:16:20.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.015+0000 7f7a557fa640 1 -- 172.21.15.102:0/1499145895 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b6c0187c0 con 0x558720d91f90 2024-09-13T19:16:20.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.015+0000 7f7a557fa640 1 -- 172.21.15.102:0/1499145895 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b6c021400 con 0x558720d91f90 2024-09-13T19:16:20.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.015+0000 7f7b76610800 1 -- 172.21.15.102:0/1499145895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558720d91f90 msgr2=0x558720d92390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.015+0000 7f7b76610800 1 --2- 172.21.15.102:0/1499145895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558720d91f90 0x558720d92390 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c04c5a0 tx=0x7f7b6c04c7a0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.015+0000 7f7b76610800 1 -- 172.21.15.102:0/1499145895 shutdown_connections 2024-09-13T19:16:20.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.015+0000 7f7b76610800 1 --2- 172.21.15.102:0/1499145895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558720d91f90 0x558720d92390 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.015+0000 7f7b76610800 1 -- 172.21.15.102:0/1499145895 >> 172.21.15.102:0/1499145895 conn(0x558720d8e2f0 msgr2=0x558720d8c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:20.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.015+0000 7f7b76610800 1 -- 172.21.15.102:0/1499145895 shutdown_connections 2024-09-13T19:16:20.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.015+0000 7f7b76610800 1 -- 172.21.15.102:0/1499145895 wait complete. 2024-09-13T19:16:20.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.015+0000 7f7b76610800 1 Processor -- start 2024-09-13T19:16:20.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.016+0000 7f7b76610800 1 -- start start 2024-09-13T19:16:20.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.016+0000 7f7b76610800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558720d91f90 0x558720d994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.016+0000 7f7b76610800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558720d92fd0 con 0x558720d91f90 2024-09-13T19:16:20.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.016+0000 7f7b724f8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558720d91f90 0x558720d994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.016+0000 7f7b724f8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558720d91f90 0x558720d994f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55752/0 (socket says 172.21.15.102:55752) 2024-09-13T19:16:20.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.016+0000 7f7b724f8640 1 -- 172.21.15.102:0/924195233 learned_addr learned my addr 172.21.15.102:0/924195233 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:20.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.016+0000 7f7b724f8640 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558720d99a30 con 0x558720d91f90 2024-09-13T19:16:20.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.016+0000 7f7b724f8640 1 --2- 172.21.15.102:0/924195233 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558720d91f90 0x558720d994f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c043040 tx=0x7f7b6c04c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.016+0000 7f7a437fe640 1 -- 172.21.15.102:0/924195233 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b6c045030 con 0x558720d91f90 2024-09-13T19:16:20.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.016+0000 7f7a437fe640 1 -- 172.21.15.102:0/924195233 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b6c016b50 con 0x558720d91f90 2024-09-13T19:16:20.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.016+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558720d99cc0 con 0x558720d91f90 2024-09-13T19:16:20.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.016+0000 7f7a437fe640 1 -- 172.21.15.102:0/924195233 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b6c03f040 con 0x558720d91f90 2024-09-13T19:16:20.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.017+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558720d99cc0 con 0x558720d91f90 2024-09-13T19:16:20.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.017+0000 7f7a437fe640 1 -- 172.21.15.102:0/924195233 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7b6c016040 con 0x558720d91f90 2024-09-13T19:16:20.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.017+0000 7f7a437fe640 1 --2- 172.21.15.102:0/924195233 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7a3c036b90 0x7f7a3c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.017+0000 7f7a437fe640 1 -- 172.21.15.102:0/924195233 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f7b6c046070 con 0x558720d91f90 2024-09-13T19:16:20.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.018+0000 7f7b71cf7640 1 --2- 172.21.15.102:0/924195233 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7a3c036b90 0x7f7a3c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.018+0000 7f7b71cf7640 1 --2- 172.21.15.102:0/924195233 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7a3c036b90 0x7f7a3c039050 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7b64002060 tx=0x7f7b6401df90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.018+0000 7f7b76610800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.018+0000 7f7b76610800 1 --2- 172.21.15.102:0/924195233 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x558720da4d40 0x558720da7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.018+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558720da7950 con 0x558720da4d40 2024-09-13T19:16:20.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.018+0000 7f7b714f6640 1 --2- 172.21.15.102:0/924195233 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x558720da4d40 0x558720da7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.019+0000 7f7b714f6640 1 --2- 172.21.15.102:0/924195233 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x558720da4d40 0x558720da7200 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.019+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b68057030 con 0x558720da4d40 2024-09-13T19:16:20.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.019+0000 7f7b76610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:20.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.019+0000 7f7b76610800 20 realm 2024-09-13T19:16:20.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.019+0000 7f7b76610800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.019+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558720da7d80 con 0x558720da4d40 2024-09-13T19:16:20.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.019+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b68057030 con 0x558720da4d40 2024-09-13T19:16:20.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.019+0000 7f7b76610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:20.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.019+0000 7f7b76610800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:20.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.019+0000 7f7b76610800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.019+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558720da8650 con 0x558720da4d40 2024-09-13T19:16:20.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.019+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b68057030 con 0x558720da4d40 2024-09-13T19:16:20.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.019+0000 7f7b76610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:20.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.019+0000 7f7b76610800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.019+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558720da89f0 con 0x558720da4d40 2024-09-13T19:16:20.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.020+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7b68057030 con 0x558720da4d40 2024-09-13T19:16:20.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.020+0000 7f7b76610800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:20.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.020+0000 7f7b76610800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.020+0000 7f7b76610800 1 --2- 172.21.15.102:0/924195233 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x558720da9750 0x558720dabb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.020+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558720dac150 con 0x558720da9750 2024-09-13T19:16:20.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.020+0000 7f7b724f8640 1 --2- 172.21.15.102:0/924195233 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x558720da9750 0x558720dabb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.020+0000 7f7b724f8640 1 --2- 172.21.15.102:0/924195233 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x558720da9750 0x558720dabb40 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.020+0000 7f7b724f8640 1 -- 172.21.15.102:0/924195233 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7b6c028070 con 0x558720da9750 2024-09-13T19:16:20.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.020+0000 7f7b76610800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:20.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.020+0000 7f7b76610800 20 searching for the correct realm 2024-09-13T19:16:20.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.020+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558720dada60 con 0x558720da9750 2024-09-13T19:16:20.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.020+0000 7f7b724f8640 1 -- 172.21.15.102:0/924195233 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b6c028070 con 0x558720da9750 2024-09-13T19:16:20.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.020+0000 7f7b724f8640 1 --2- 172.21.15.102:0/924195233 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f7b6c021020 0x7f7b6c019070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.020+0000 7f7b724f8640 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558720dada60 con 0x7f7b6c021020 2024-09-13T19:16:20.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.021+0000 7f7b71cf7640 1 --2- 172.21.15.102:0/924195233 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f7b6c021020 0x7f7b6c019070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.021+0000 7f7b71cf7640 1 --2- 172.21.15.102:0/924195233 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f7b6c021020 0x7f7b6c019070 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.021+0000 7f7b71cf7640 1 -- 172.21.15.102:0/924195233 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b6401b070 con 0x7f7b6c021020 2024-09-13T19:16:20.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.021+0000 7f7b71cf7640 1 --2- 172.21.15.102:0/924195233 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f7b64027020 0x7f7b640265d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.021+0000 7f7b71cf7640 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558720dada60 con 0x7f7b64027020 2024-09-13T19:16:20.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.021+0000 7f7b714f6640 1 --2- 172.21.15.102:0/924195233 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f7b64027020 0x7f7b640265d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.022+0000 7f7b714f6640 1 --2- 172.21.15.102:0/924195233 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f7b64027020 0x7f7b640265d0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.022+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b68057030 con 0x7f7b64027020 2024-09-13T19:16:20.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.022+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558720dada60 con 0x558720da4d40 2024-09-13T19:16:20.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.022+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b68057030 con 0x558720da4d40 2024-09-13T19:16:20.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.022+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558720dada60 con 0x558720da4d40 2024-09-13T19:16:20.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.022+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b68057030 con 0x558720da4d40 2024-09-13T19:16:20.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.022+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558720dada60 con 0x7f7b64027020 2024-09-13T19:16:20.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.023+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b68057030 con 0x7f7b64027020 2024-09-13T19:16:20.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.023+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558720dada60 con 0x7f7b64027020 2024-09-13T19:16:20.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.023+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b68057030 con 0x7f7b64027020 2024-09-13T19:16:20.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.023+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558720dada60 con 0x7f7b6c021020 2024-09-13T19:16:20.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.023+0000 7f7b71cf7640 1 -- 172.21.15.102:0/924195233 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b6401b070 con 0x7f7b6c021020 2024-09-13T19:16:20.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.023+0000 7f7b71cf7640 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558720dada60 con 0x558720da9750 2024-09-13T19:16:20.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.023+0000 7f7b724f8640 1 -- 172.21.15.102:0/924195233 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b6c05d040 con 0x558720da9750 2024-09-13T19:16:20.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.023+0000 7f7b724f8640 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558720dada60 con 0x558720da4d40 2024-09-13T19:16:20.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.024+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b68057030 con 0x558720da4d40 2024-09-13T19:16:20.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.024+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558720dada60 con 0x7f7b64027020 2024-09-13T19:16:20.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.024+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b68057030 con 0x7f7b64027020 2024-09-13T19:16:20.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.024+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558720dada60 con 0x558720da4d40 2024-09-13T19:16:20.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.024+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b68057030 con 0x558720da4d40 2024-09-13T19:16:20.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.024+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558720dada60 con 0x7f7b6c021020 2024-09-13T19:16:20.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.024+0000 7f7b71cf7640 1 -- 172.21.15.102:0/924195233 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7b6401b070 con 0x7f7b6c021020 2024-09-13T19:16:20.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.024+0000 7f7b71cf7640 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558720dada60 con 0x558720da9750 2024-09-13T19:16:20.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.025+0000 7f7b724f8640 1 -- 172.21.15.102:0/924195233 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b6c05d040 con 0x558720da9750 2024-09-13T19:16:20.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.025+0000 7f7b724f8640 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558720dada60 con 0x558720da9750 2024-09-13T19:16:20.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.025+0000 7f7b724f8640 1 -- 172.21.15.102:0/924195233 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7b6c05d040 con 0x558720da9750 2024-09-13T19:16:20.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.025+0000 7f7b724f8640 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558720dada60 con 0x7f7b64027020 2024-09-13T19:16:20.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.025+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b68057030 con 0x7f7b64027020 2024-09-13T19:16:20.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.025+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558720dada60 con 0x558720da9750 2024-09-13T19:16:20.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.025+0000 7f7b724f8640 1 -- 172.21.15.102:0/924195233 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7b6c05d040 con 0x558720da9750 2024-09-13T19:16:20.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.025+0000 7f7b724f8640 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558720dada60 con 0x558720da9750 2024-09-13T19:16:20.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.026+0000 7f7b724f8640 1 -- 172.21.15.102:0/924195233 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b6c05d040 con 0x558720da9750 2024-09-13T19:16:20.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.026+0000 7f7b724f8640 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558720dada60 con 0x558720da4d40 2024-09-13T19:16:20.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.026+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b68057030 con 0x558720da4d40 2024-09-13T19:16:20.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.026+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558720dada60 con 0x558720da4d40 2024-09-13T19:16:20.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.026+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7b68057030 con 0x558720da4d40 2024-09-13T19:16:20.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.026+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558720dada60 con 0x7f7b64027020 2024-09-13T19:16:20.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.026+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b68057030 con 0x7f7b64027020 2024-09-13T19:16:20.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.026+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558720dada60 con 0x558720da9750 2024-09-13T19:16:20.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.027+0000 7f7b724f8640 1 -- 172.21.15.102:0/924195233 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b6c05d040 con 0x558720da9750 2024-09-13T19:16:20.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.027+0000 7f7b724f8640 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558720dada60 con 0x7f7b6c021020 2024-09-13T19:16:20.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.027+0000 7f7b71cf7640 1 -- 172.21.15.102:0/924195233 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b6401b070 con 0x7f7b6c021020 2024-09-13T19:16:20.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.027+0000 7f7b71cf7640 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558720dada60 con 0x558720da4d40 2024-09-13T19:16:20.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.027+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b68057030 con 0x558720da4d40 2024-09-13T19:16:20.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.027+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558720dada60 con 0x7f7b64027020 2024-09-13T19:16:20.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.027+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b68057030 con 0x7f7b64027020 2024-09-13T19:16:20.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.027+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558720dada60 con 0x558720da9750 2024-09-13T19:16:20.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.028+0000 7f7b724f8640 1 -- 172.21.15.102:0/924195233 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b6c05d040 con 0x558720da9750 2024-09-13T19:16:20.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.028+0000 7f7b724f8640 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558720dada60 con 0x7f7b64027020 2024-09-13T19:16:20.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.028+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b68057030 con 0x7f7b64027020 2024-09-13T19:16:20.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.028+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558720dada60 con 0x7f7b6c021020 2024-09-13T19:16:20.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.028+0000 7f7b71cf7640 1 -- 172.21.15.102:0/924195233 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b6401b070 con 0x7f7b6c021020 2024-09-13T19:16:20.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.028+0000 7f7b71cf7640 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558720dada60 con 0x558720da9750 2024-09-13T19:16:20.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.028+0000 7f7b724f8640 1 -- 172.21.15.102:0/924195233 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b6c05d040 con 0x558720da9750 2024-09-13T19:16:20.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.029+0000 7f7b724f8640 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7b6c069040 con 0x7f7b64027020 2024-09-13T19:16:20.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.029+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b68057030 con 0x7f7b64027020 2024-09-13T19:16:20.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.029+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7b6c069040 con 0x558720da4d40 2024-09-13T19:16:20.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.029+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7b68057030 con 0x558720da4d40 2024-09-13T19:16:20.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.029+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7b6808a080 con 0x7f7b6c021020 2024-09-13T19:16:20.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.029+0000 7f7b71cf7640 1 -- 172.21.15.102:0/924195233 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b6401b070 con 0x7f7b6c021020 2024-09-13T19:16:20.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.029+0000 7f7b76610800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:20.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.029+0000 7f7b76610800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:20.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.029+0000 7f7b76610800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:20.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.029+0000 7f7b76610800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:20.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.029+0000 7f7b76610800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:20.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.029+0000 7f7b76610800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:20.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.029+0000 7f7b76610800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.029+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558720dac9a0 con 0x558720da4d40 2024-09-13T19:16:20.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.029+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b68057030 con 0x558720da4d40 2024-09-13T19:16:20.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.030+0000 7f7b76610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:20.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.030+0000 7f7b76610800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.030+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558720dacd90 con 0x558720da4d40 2024-09-13T19:16:20.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.030+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7b68057030 con 0x558720da4d40 2024-09-13T19:16:20.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.030+0000 7f7b76610800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:20.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.030+0000 7f7b76610800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.030+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558720dadee0 con 0x558720da9750 2024-09-13T19:16:20.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.030+0000 7f7b724f8640 1 -- 172.21.15.102:0/924195233 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7b6c05d040 con 0x558720da9750 2024-09-13T19:16:20.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.030+0000 7f7b76610800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:20.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.030+0000 7f7b76610800 20 zone default found 2024-09-13T19:16:20.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.030+0000 7f7b76610800 4 Realm: () 2024-09-13T19:16:20.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.030+0000 7f7b76610800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:20.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.030+0000 7f7b76610800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:20.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.030+0000 7f7b76610800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:20.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.030+0000 7f7b76610800 20 zonegroup default 2024-09-13T19:16:20.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.030+0000 7f7b76610800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.030+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558720dae730 con 0x7f7b64027020 2024-09-13T19:16:20.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.030+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7b68057030 con 0x7f7b64027020 2024-09-13T19:16:20.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.030+0000 7f7b76610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:20.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.030+0000 7f7b76610800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.030+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558720db0110 con 0x558720da9750 2024-09-13T19:16:20.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.031+0000 7f7b724f8640 1 -- 172.21.15.102:0/924195233 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7b6c05d040 con 0x558720da9750 2024-09-13T19:16:20.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.031+0000 7f7b76610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:20.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.031+0000 7f7b76610800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.031+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558720db0540 con 0x558720da9750 2024-09-13T19:16:20.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.031+0000 7f7b724f8640 1 -- 172.21.15.102:0/924195233 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7b6c05d040 con 0x558720da9750 2024-09-13T19:16:20.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.031+0000 7f7b76610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:20.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.031+0000 7f7b76610800 20 started sync module instance, tier type = 2024-09-13T19:16:20.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.031+0000 7f7b76610800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:20.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.031+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558720daf550 con 0x7f7b6c021020 2024-09-13T19:16:20.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.032+0000 7f7b71cf7640 1 -- 172.21.15.102:0/924195233 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(44 notify.0 [create] v34'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b6401b070 con 0x7f7b6c021020 2024-09-13T19:16:20.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.032+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94038860165280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558720db0540 con 0x7f7b6c021020 2024-09-13T19:16:20.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.032+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558720db0d90 con 0x558720da4d40 2024-09-13T19:16:20.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.033+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v34'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b68057030 con 0x558720da4d40 2024-09-13T19:16:20.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.033+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94038860171760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558720db14c0 con 0x558720da4d40 2024-09-13T19:16:20.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.033+0000 7f7b71cf7640 1 -- 172.21.15.102:0/924195233 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94038860165280] v34'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b6401b070 con 0x7f7b6c021020 2024-09-13T19:16:20.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.033+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558720daf9b0 con 0x558720da9750 2024-09-13T19:16:20.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.034+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94038860171760] v34'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b68057030 con 0x558720da4d40 2024-09-13T19:16:20.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.035+0000 7f7b724f8640 1 -- 172.21.15.102:0/924195233 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v34'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b6c05d040 con 0x558720da9750 2024-09-13T19:16:20.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.035+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94038860173072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558720db1480 con 0x558720da9750 2024-09-13T19:16:20.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.035+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558720db2580 con 0x7f7b6c021020 2024-09-13T19:16:20.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.036+0000 7f7b724f8640 1 -- 172.21.15.102:0/924195233 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94038860173072] v34'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b6c05d040 con 0x558720da9750 2024-09-13T19:16:20.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.036+0000 7f7b71cf7640 1 -- 172.21.15.102:0/924195233 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(50 notify.3 [create] v34'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b6401b070 con 0x7f7b6c021020 2024-09-13T19:16:20.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.036+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94038860177616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558720db2920 con 0x7f7b6c021020 2024-09-13T19:16:20.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.036+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558720db3320 con 0x558720da4d40 2024-09-13T19:16:20.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.037+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v34'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b68057030 con 0x558720da4d40 2024-09-13T19:16:20.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.037+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94038860181040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558720db32f0 con 0x558720da4d40 2024-09-13T19:16:20.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.037+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558720db4310 con 0x7f7b64027020 2024-09-13T19:16:20.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.037+0000 7f7b71cf7640 1 -- 172.21.15.102:0/924195233 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94038860177616] v34'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b6401b070 con 0x7f7b6c021020 2024-09-13T19:16:20.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.038+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94038860181040] v34'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b68057030 con 0x558720da4d40 2024-09-13T19:16:20.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.038+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(54 notify.5 [create] v34'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b68057030 con 0x7f7b64027020 2024-09-13T19:16:20.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.038+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94038860185056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558720db34d0 con 0x7f7b64027020 2024-09-13T19:16:20.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.038+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558720db4bb0 con 0x7f7b64027020 2024-09-13T19:16:20.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.039+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94038860185056] v34'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b68057030 con 0x7f7b64027020 2024-09-13T19:16:20.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.039+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(56 notify.6 [create] v34'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b68057030 con 0x7f7b64027020 2024-09-13T19:16:20.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.039+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94038860176048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558720db34d0 con 0x7f7b64027020 2024-09-13T19:16:20.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.039+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558720db51d0 con 0x7f7b64027020 2024-09-13T19:16:20.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.040+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94038860176048] v34'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b68057030 con 0x7f7b64027020 2024-09-13T19:16:20.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.040+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(58 notify.7 [create] v34'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b68057030 con 0x7f7b64027020 2024-09-13T19:16:20.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.040+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94038860187392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558720db51d0 con 0x7f7b64027020 2024-09-13T19:16:20.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.040+0000 7f7b76610800 20 add_watcher() i=0 2024-09-13T19:16:20.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.040+0000 7f7b76610800 20 add_watcher() i=1 2024-09-13T19:16:20.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.040+0000 7f7b76610800 20 add_watcher() i=2 2024-09-13T19:16:20.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.040+0000 7f7b76610800 20 add_watcher() i=3 2024-09-13T19:16:20.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.040+0000 7f7b76610800 20 add_watcher() i=4 2024-09-13T19:16:20.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.040+0000 7f7b76610800 20 add_watcher() i=5 2024-09-13T19:16:20.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.040+0000 7f7b76610800 20 add_watcher() i=6 2024-09-13T19:16:20.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.041+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94038860187392] v34'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b68057030 con 0x7f7b64027020 2024-09-13T19:16:20.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.041+0000 7f7b76610800 20 add_watcher() i=7 2024-09-13T19:16:20.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.041+0000 7f7b76610800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:20.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.041+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558720db8530 con 0x558720da4d40 2024-09-13T19:16:20.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.041+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7b68057030 con 0x558720da4d40 2024-09-13T19:16:20.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.041+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94038860189328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558720db5760 con 0x558720da4d40 2024-09-13T19:16:20.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.042+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94038860189328] v34'126 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7b68057030 con 0x558720da4d40 2024-09-13T19:16:20.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.042+0000 7f7a237fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:20.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.042+0000 7f7b76610800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:20.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.042+0000 7f7b76610800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:20.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.043+0000 7f7b76610800 5 note: GC not initialized 2024-09-13T19:16:20.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.043+0000 7f7a227fc640 20 reqs_thread_entry: start 2024-09-13T19:16:20.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.043+0000 7f7b76610800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:20.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.043+0000 7f7b76610800 20 Filter name: none 2024-09-13T19:16:20.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.043+0000 7f7993fff640 20 reqs_thread_entry: start 2024-09-13T19:16:20.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.043+0000 7f7b76610800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-13T19:16:20.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.043+0000 7f7b76610800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.043+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558720debb70 con 0x7f7b64027020 2024-09-13T19:16:20.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.044+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(62 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 246+0+0 (crc 0 0 0) 0x7f7b68057030 con 0x7f7b64027020 2024-09-13T19:16:20.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.044+0000 7f7b76610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:20.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.044+0000 7f7b76610800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2024-09-13T19:16:20.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.044+0000 7f7b76610800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-13T19:16:20.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.044+0000 7f7b76610800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-13T19:16:20.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.044+0000 7f7b76610800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.044+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558720dea100 con 0x7f7b64027020 2024-09-13T19:16:20.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.044+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f7b68057030 con 0x7f7b64027020 2024-09-13T19:16:20.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.044+0000 7f7b76610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:20.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.044+0000 7f7b76610800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-13T19:16:20.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.044+0000 7f7b76610800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T19:16:20.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.044+0000 7f7b76610800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T19:16:20.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.044+0000 7f7b76610800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T19:16:20.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.044+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:64 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~419 in=419b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558720dee880 con 0x7f7b64027020 2024-09-13T19:16:20.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.045+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(64 testx$tenanteduser [delete,create,call,writefull 0~419] v34'5 uv5 ondisk = 0) ==== 288+0+0 (crc 0 0 0) 0x7f7b68057030 con 0x7f7b64027020 2024-09-13T19:16:20.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.045+0000 7f7b76610800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-13T19:16:20.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.045+0000 7f7b76610800 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-13T19:16:20.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.045+0000 7f7b76610800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-13T19:16:20.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.045+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:65 7.e 7:7759931f:::notify.3:head [notify cookie 94038860423744 in=622b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558720def3d0 con 0x7f7b6c021020 2024-09-13T19:16:20.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.045+0000 7f7b71cf7640 1 -- 172.21.15.102:0/924195233 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== watch-notify(notify (1) cookie 94038860177616 notify 146028888076 ret 0) ==== 652+0+0 (crc 0 0 0) 0x558720c70750 con 0x7f7b6c021020 2024-09-13T19:16:20.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.045+0000 7f7a557fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888076 cookie 94038860177616 notifier 4545 bl.length()=610 2024-09-13T19:16:20.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.045+0000 7f7a557fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-13T19:16:20.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.045+0000 7f7a557fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-13T19:16:20.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.045+0000 7f7a557fa640 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f7a34003ea0 con 0x7f7b6c021020 2024-09-13T19:16:20.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.045+0000 7f7b71cf7640 1 -- 172.21.15.102:0/924195233 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(65 notify.3 [notify cookie 94038860423744 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7b6401b070 con 0x7f7b6c021020 2024-09-13T19:16:20.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.046+0000 7f7b71cf7640 1 -- 172.21.15.102:0/924195233 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(66 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b6401b070 con 0x7f7b6c021020 2024-09-13T19:16:20.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.046+0000 7f7b71cf7640 1 -- 172.21.15.102:0/924195233 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== watch-notify(notify_complete (2) cookie 94038860423744 notify 146028888076 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558720c70230 con 0x7f7b6c021020 2024-09-13T19:16:20.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.046+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558720dee210 con 0x7f7b64027020 2024-09-13T19:16:20.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.047+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 <== osd.0 v2:172.21.15.53:6800/4021716951 20 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v34'6 uv6 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f7b68057030 con 0x7f7b64027020 2024-09-13T19:16:20.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.047+0000 7f7b76610800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T19:16:20.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.047+0000 7f7b76610800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T19:16:20.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.047+0000 7f7b76610800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T19:16:20.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.047+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94038860423648 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558720ded700 con 0x558720da9750 2024-09-13T19:16:20.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.047+0000 7f7b724f8640 1 -- 172.21.15.102:0/924195233 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== watch-notify(notify (1) cookie 94038860173072 notify 146028888068 ret 0) ==== 234+0+0 (crc 0 0 0) 0x558720d99a30 con 0x558720da9750 2024-09-13T19:16:20.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.047+0000 7f7a54ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888068 cookie 94038860173072 notifier 4545 bl.length()=192 2024-09-13T19:16:20.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.047+0000 7f7a54ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T19:16:20.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.047+0000 7f7a54ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T19:16:20.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.047+0000 7f7a54ff9640 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f799c003400 con 0x558720da9750 2024-09-13T19:16:20.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.047+0000 7f7b724f8640 1 -- 172.21.15.102:0/924195233 <== osd.3 v2:172.21.15.102:6800/3096737090 17 ==== osd_op_reply(68 notify.2 [notify cookie 94038860423648 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7b6c05d040 con 0x558720da9750 2024-09-13T19:16:20.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.048+0000 7f7b724f8640 1 -- 172.21.15.102:0/924195233 <== osd.3 v2:172.21.15.102:6800/3096737090 18 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b6c05d040 con 0x558720da9750 2024-09-13T19:16:20.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.048+0000 7f7b724f8640 1 -- 172.21.15.102:0/924195233 <== osd.3 v2:172.21.15.102:6800/3096737090 19 ==== watch-notify(notify_complete (2) cookie 94038860423648 notify 146028888068 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f7b6c03fe30 con 0x558720da9750 2024-09-13T19:16:20.064 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"testx$tenanteduser","display_name":"tenanted-user","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"testx$tenanteduser","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-13T19:16:20.045312Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:16:20.045301Z","tags":[],"group_ids":[]} 2024-09-13T19:16:20.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.049+0000 7f7a237fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:20.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.049+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94038860189328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558720de9690 con 0x558720da4d40 2024-09-13T19:16:20.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.050+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94038860189328] v34'127 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7b68057030 con 0x558720da4d40 2024-09-13T19:16:20.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.050+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94038860165280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558720de9690 con 0x7f7b6c021020 2024-09-13T19:16:20.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.051+0000 7f7b71cf7640 1 -- 172.21.15.102:0/924195233 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94038860165280] v34'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b6401b070 con 0x7f7b6c021020 2024-09-13T19:16:20.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.051+0000 7f7b76610800 20 remove_watcher() i=0 2024-09-13T19:16:20.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.051+0000 7f7b76610800 2 removed watcher, disabling cache 2024-09-13T19:16:20.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.051+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94038860171760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558720de9690 con 0x558720da4d40 2024-09-13T19:16:20.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.052+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94038860171760] v34'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b68057030 con 0x558720da4d40 2024-09-13T19:16:20.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.052+0000 7f7b76610800 20 remove_watcher() i=1 2024-09-13T19:16:20.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.052+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94038860173072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558720de9690 con 0x558720da9750 2024-09-13T19:16:20.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.053+0000 7f7b724f8640 1 -- 172.21.15.102:0/924195233 <== osd.3 v2:172.21.15.102:6800/3096737090 20 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94038860173072] v34'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b6c05d040 con 0x558720da9750 2024-09-13T19:16:20.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.053+0000 7f7b76610800 20 remove_watcher() i=2 2024-09-13T19:16:20.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.053+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94038860177616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558720de9690 con 0x7f7b6c021020 2024-09-13T19:16:20.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.054+0000 7f7b71cf7640 1 -- 172.21.15.102:0/924195233 <== osd.2 v2:172.21.15.102:6816/2238176080 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94038860177616] v34'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b6401b070 con 0x7f7b6c021020 2024-09-13T19:16:20.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.054+0000 7f7b76610800 20 remove_watcher() i=3 2024-09-13T19:16:20.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.054+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94038860181040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558720de9690 con 0x558720da4d40 2024-09-13T19:16:20.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.055+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94038860181040] v34'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b68057030 con 0x558720da4d40 2024-09-13T19:16:20.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.055+0000 7f7b76610800 20 remove_watcher() i=4 2024-09-13T19:16:20.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.055+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94038860185056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558720de9690 con 0x7f7b64027020 2024-09-13T19:16:20.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.055+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 <== osd.0 v2:172.21.15.53:6800/4021716951 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94038860185056] v34'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b68057030 con 0x7f7b64027020 2024-09-13T19:16:20.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.056+0000 7f7b76610800 20 remove_watcher() i=5 2024-09-13T19:16:20.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.056+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94038860176048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558720de9690 con 0x7f7b64027020 2024-09-13T19:16:20.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.056+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 <== osd.0 v2:172.21.15.53:6800/4021716951 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94038860176048] v34'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b68057030 con 0x7f7b64027020 2024-09-13T19:16:20.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.056+0000 7f7b76610800 20 remove_watcher() i=6 2024-09-13T19:16:20.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.056+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94038860187392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558720de9690 con 0x7f7b64027020 2024-09-13T19:16:20.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.057+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 <== osd.0 v2:172.21.15.53:6800/4021716951 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94038860187392] v34'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b68057030 con 0x7f7b64027020 2024-09-13T19:16:20.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.057+0000 7f7b76610800 20 remove_watcher() i=7 2024-09-13T19:16:20.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.058+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f7b64027020 msgr2=0x7f7b640265d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.058+0000 7f7b76610800 1 --2- 172.21.15.102:0/924195233 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f7b64027020 0x7f7b640265d0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.058+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x558720da4d40 msgr2=0x558720da7200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.058+0000 7f7b76610800 1 --2- 172.21.15.102:0/924195233 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x558720da4d40 0x558720da7200 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.058+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f7b6c021020 msgr2=0x7f7b6c019070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.058+0000 7f7b76610800 1 --2- 172.21.15.102:0/924195233 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f7b6c021020 0x7f7b6c019070 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.058+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x558720da9750 msgr2=0x558720dabb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.058+0000 7f7b76610800 1 --2- 172.21.15.102:0/924195233 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x558720da9750 0x558720dabb40 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.058+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7a3c036b90 msgr2=0x7f7a3c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.058+0000 7f7b76610800 1 --2- 172.21.15.102:0/924195233 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7a3c036b90 0x7f7a3c039050 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7b64002060 tx=0x7f7b6401df90 comp rx=0 tx=0).stop 2024-09-13T19:16:20.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.058+0000 7f7b714f6640 1 -- 172.21.15.102:0/924195233 reap_dead start 2024-09-13T19:16:20.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.058+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558720d91f90 msgr2=0x558720d994f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.058+0000 7f7b76610800 1 --2- 172.21.15.102:0/924195233 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558720d91f90 0x558720d994f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c043040 tx=0x7f7b6c04c530 comp rx=0 tx=0).stop 2024-09-13T19:16:20.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.058+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 shutdown_connections 2024-09-13T19:16:20.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.058+0000 7f7b76610800 1 --2- 172.21.15.102:0/924195233 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558720d91f90 0x558720d994f0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.058+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 >> 172.21.15.102:0/924195233 conn(0x558720d8e2f0 msgr2=0x558720d8c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:20.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.058+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 shutdown_connections 2024-09-13T19:16:20.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.058+0000 7f7b76610800 1 -- 172.21.15.102:0/924195233 wait complete. 2024-09-13T19:16:20.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.058+0000 7f7b76610800 1 -- 172.21.15.102:0/1165797208 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7a4c036b90 msgr2=0x7f7a4c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.058+0000 7f7b76610800 1 --2- 172.21.15.102:0/1165797208 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7a4c036b90 0x7f7a4c039050 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x558720d72430 tx=0x7f7b64026e50 comp rx=0 tx=0).stop 2024-09-13T19:16:20.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.058+0000 7f7b76610800 1 -- 172.21.15.102:0/1165797208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558720d85310 msgr2=0x558720d85730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.058+0000 7f7b76610800 1 --2- 172.21.15.102:0/1165797208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558720d85310 0x558720d85730 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x558720c71530 tx=0x7f7b6c00beb0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.058+0000 7f7b76610800 1 -- 172.21.15.102:0/1165797208 shutdown_connections 2024-09-13T19:16:20.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.058+0000 7f7b76610800 1 --2- 172.21.15.102:0/1165797208 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7a4c036b90 0x7f7a4c039050 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.058+0000 7f7b76610800 1 --2- 172.21.15.102:0/1165797208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558720d85310 0x558720d85730 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.058+0000 7f7b76610800 1 -- 172.21.15.102:0/1165797208 >> 172.21.15.102:0/1165797208 conn(0x558720d7a2a0 msgr2=0x558720d7ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:20.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.058+0000 7f7b76610800 1 -- 172.21.15.102:0/1165797208 shutdown_connections 2024-09-13T19:16:20.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.058+0000 7f7b76610800 1 -- 172.21.15.102:0/1165797208 wait complete. 2024-09-13T19:16:20.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.059+0000 7f7b76610800 1 -- 172.21.15.102:0/4029535774 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x558720c75950 msgr2=0x558720d71770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.059+0000 7f7b76610800 1 --2- 172.21.15.102:0/4029535774 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x558720c75950 0x558720d71770 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.059+0000 7f7b76610800 1 -- 172.21.15.102:0/4029535774 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x558720d73e80 msgr2=0x558720d76270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.059+0000 7f7b76610800 1 --2- 172.21.15.102:0/4029535774 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x558720d73e80 0x558720d76270 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.059+0000 7f7b76610800 1 -- 172.21.15.102:0/4029535774 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7a58036b90 msgr2=0x7f7a58039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.059+0000 7f7b76610800 1 --2- 172.21.15.102:0/4029535774 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7a58036b90 0x7f7a58039050 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7b68057000 tx=0x7f7b68052000 comp rx=0 tx=0).stop 2024-09-13T19:16:20.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.059+0000 7f7b76610800 1 -- 172.21.15.102:0/4029535774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558720be5660 msgr2=0x558720c71b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.059+0000 7f7b76610800 1 --2- 172.21.15.102:0/4029535774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558720be5660 0x558720c71b40 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x558720d617b0 tx=0x7f7b64001250 comp rx=0 tx=0).stop 2024-09-13T19:16:20.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.059+0000 7f7b76610800 1 -- 172.21.15.102:0/4029535774 shutdown_connections 2024-09-13T19:16:20.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.059+0000 7f7b76610800 1 --2- 172.21.15.102:0/4029535774 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x558720d73e80 0x558720d76270 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.059+0000 7f7b76610800 1 --2- 172.21.15.102:0/4029535774 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x558720c75950 0x558720d71770 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.059+0000 7f7b76610800 1 --2- 172.21.15.102:0/4029535774 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7a58036b90 0x7f7a58039050 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.059+0000 7f7b76610800 1 --2- 172.21.15.102:0/4029535774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558720be5660 0x558720c71b40 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.059+0000 7f7b76610800 1 -- 172.21.15.102:0/4029535774 >> 172.21.15.102:0/4029535774 conn(0x558720c6bde0 msgr2=0x558720d5abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:20.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.059+0000 7f7b76610800 1 -- 172.21.15.102:0/4029535774 shutdown_connections 2024-09-13T19:16:20.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.059+0000 7f7b76610800 1 -- 172.21.15.102:0/4029535774 wait complete. 2024-09-13T19:16:20.076 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-13T19:16:20.045312Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:16:20.045301Z', 'tags': [], 'group_ids': []} 2024-09-13T19:16:20.076 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-13T19:16:20.076 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-13T19:16:20.076 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2024-09-13T19:16:20.126 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:20.126 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:20.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.123+0000 7fa496a0e800 1 Processor -- start 2024-09-13T19:16:20.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.123+0000 7fa496a0e800 1 -- start start 2024-09-13T19:16:20.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.123+0000 7fa496a0e800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f0f6f92a30 0x55f0f6f94e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.123+0000 7fa496a0e800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f0f6e4db30 con 0x55f0f6f025b0 2024-09-13T19:16:20.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.123+0000 7fa496a0e800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55f0f6e2f360 con 0x55f0f6f92a30 2024-09-13T19:16:20.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.124+0000 7fa4898c0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f0f6f92a30 0x55f0f6f94e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.124+0000 7fa4920c1640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55f0f6f025b0 0x55f0f6f91310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:50048/0 (socket says 172.21.15.102:50048) 2024-09-13T19:16:20.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.124+0000 7fa4898c0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f0f6f92a30 0x55f0f6f94e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55758/0 (socket says 172.21.15.102:55758) 2024-09-13T19:16:20.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.124+0000 7fa4920c1640 1 -- 172.21.15.102:0/2958035633 learned_addr learned my addr 172.21.15.102:0/2958035633 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:16:20.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.124+0000 7fa4898c0640 1 -- 172.21.15.102:0/2958035633 >> v1:172.21.15.53:6789/0 conn(0x55f0f6f025b0 legacy=0x55f0f6f91310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.124+0000 7fa4898c0640 1 -- 172.21.15.102:0/2958035633 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0f6e55e00 con 0x55f0f6f92a30 2024-09-13T19:16:20.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.124+0000 7fa4918c0640 1 -- 172.21.15.102:0/2958035633 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3332172265 0 0) 0x55f0f6e4db30 con 0x55f0f6f025b0 2024-09-13T19:16:20.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.126+0000 7fa4898c0640 1 --2- 172.21.15.102:0/2958035633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0f6f92a30 0x55f0f6f94e20 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa47c00a470 tx=0x7fa47c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fd23e8bc8c9215b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.126+0000 7fa4918c0640 1 -- 172.21.15.102:0/2958035633 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa47c053570 con 0x55f0f6f92a30 2024-09-13T19:16:20.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.126+0000 7fa4918c0640 1 -- 172.21.15.102:0/2958035633 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa47c058070 con 0x55f0f6f92a30 2024-09-13T19:16:20.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.126+0000 7fa4918c0640 1 -- 172.21.15.102:0/2958035633 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa47c053880 con 0x55f0f6f92a30 2024-09-13T19:16:20.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.127+0000 7fa496a0e800 1 -- 172.21.15.102:0/2958035633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0f6f92a30 msgr2=0x55f0f6f94e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.127+0000 7fa496a0e800 1 --2- 172.21.15.102:0/2958035633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0f6f92a30 0x55f0f6f94e20 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa47c00a470 tx=0x7fa47c045a20 comp rx=0 tx=0).stop 2024-09-13T19:16:20.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.127+0000 7fa496a0e800 1 -- 172.21.15.102:0/2958035633 shutdown_connections 2024-09-13T19:16:20.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.127+0000 7fa496a0e800 1 --2- 172.21.15.102:0/2958035633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0f6f92a30 0x55f0f6f94e20 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.127+0000 7fa496a0e800 1 -- 172.21.15.102:0/2958035633 >> 172.21.15.102:0/2958035633 conn(0x55f0f6f88e00 msgr2=0x55f0f6f8b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:20.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.127+0000 7fa496a0e800 1 -- 172.21.15.102:0/2958035633 shutdown_connections 2024-09-13T19:16:20.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.127+0000 7fa496a0e800 1 -- 172.21.15.102:0/2958035633 wait complete. 2024-09-13T19:16:20.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.140+0000 7fa496a0e800 1 Processor -- start 2024-09-13T19:16:20.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.140+0000 7fa496a0e800 1 -- start start 2024-09-13T19:16:20.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.140+0000 7fa496a0e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0f6f025b0 0x55f0f707d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.140+0000 7fa496a0e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f0f6eda350 con 0x55f0f6f025b0 2024-09-13T19:16:20.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.141+0000 7fa4920c1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0f6f025b0 0x55f0f707d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.141+0000 7fa4920c1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0f6f025b0 0x55f0f707d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55766/0 (socket says 172.21.15.102:55766) 2024-09-13T19:16:20.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.141+0000 7fa4920c1640 1 -- 172.21.15.102:0/1354625386 learned_addr learned my addr 172.21.15.102:0/1354625386 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:20.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.141+0000 7fa4920c1640 1 -- 172.21.15.102:0/1354625386 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0f6e27bc0 con 0x55f0f6f025b0 2024-09-13T19:16:20.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.141+0000 7fa4920c1640 1 --2- 172.21.15.102:0/1354625386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0f6f025b0 0x55f0f707d610 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fa48400b240 tx=0x7fa48400b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0ac8f4a3f3801fc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.141+0000 7fa380608640 1 -- 172.21.15.102:0/1354625386 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa484008070 con 0x55f0f6f025b0 2024-09-13T19:16:20.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.141+0000 7fa380608640 1 -- 172.21.15.102:0/1354625386 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa48400d500 con 0x55f0f6f025b0 2024-09-13T19:16:20.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.141+0000 7fa380608640 1 -- 172.21.15.102:0/1354625386 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa48400d860 con 0x55f0f6f025b0 2024-09-13T19:16:20.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.142+0000 7fa496a0e800 1 -- 172.21.15.102:0/1354625386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0f6f025b0 msgr2=0x55f0f707d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.142+0000 7fa496a0e800 1 --2- 172.21.15.102:0/1354625386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0f6f025b0 0x55f0f707d610 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fa48400b240 tx=0x7fa48400b700 comp rx=0 tx=0).stop 2024-09-13T19:16:20.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.142+0000 7fa496a0e800 1 -- 172.21.15.102:0/1354625386 shutdown_connections 2024-09-13T19:16:20.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.142+0000 7fa496a0e800 1 --2- 172.21.15.102:0/1354625386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0f6f025b0 0x55f0f707d610 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.142+0000 7fa496a0e800 1 -- 172.21.15.102:0/1354625386 >> 172.21.15.102:0/1354625386 conn(0x55f0f6f88e00 msgr2=0x55f0f7078fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:20.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.142+0000 7fa496a0e800 1 -- 172.21.15.102:0/1354625386 shutdown_connections 2024-09-13T19:16:20.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.142+0000 7fa496a0e800 1 -- 172.21.15.102:0/1354625386 wait complete. 2024-09-13T19:16:20.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.142+0000 7fa496a0e800 1 Processor -- start 2024-09-13T19:16:20.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.142+0000 7fa496a0e800 1 -- start start 2024-09-13T19:16:20.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.143+0000 7fa496a0e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0f6f025b0 0x55f0f70850a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.143+0000 7fa496a0e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f0f6f956f0 con 0x55f0f6f025b0 2024-09-13T19:16:20.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.143+0000 7fa4920c1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0f6f025b0 0x55f0f70850a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.143+0000 7fa4920c1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0f6f025b0 0x55f0f70850a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55776/0 (socket says 172.21.15.102:55776) 2024-09-13T19:16:20.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.143+0000 7fa4920c1640 1 -- 172.21.15.102:0/3717059283 learned_addr learned my addr 172.21.15.102:0/3717059283 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:20.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.143+0000 7fa4920c1640 1 -- 172.21.15.102:0/3717059283 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0f6e3bfe0 con 0x55f0f6f025b0 2024-09-13T19:16:20.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.143+0000 7fa4920c1640 1 --2- 172.21.15.102:0/3717059283 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0f6f025b0 0x55f0f70850a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x55f0f707e470 tx=0x7fa484000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.143+0000 7fa37ee05640 1 -- 172.21.15.102:0/3717059283 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa484019870 con 0x55f0f6f025b0 2024-09-13T19:16:20.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.143+0000 7fa37ee05640 1 -- 172.21.15.102:0/3717059283 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa484019a10 con 0x55f0f6f025b0 2024-09-13T19:16:20.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.143+0000 7fa496a0e800 1 -- 172.21.15.102:0/3717059283 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f0f70855e0 con 0x55f0f6f025b0 2024-09-13T19:16:20.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.143+0000 7fa37ee05640 1 -- 172.21.15.102:0/3717059283 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa484019d30 con 0x55f0f6f025b0 2024-09-13T19:16:20.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.143+0000 7fa496a0e800 1 -- 172.21.15.102:0/3717059283 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0f7085b00 con 0x55f0f6f025b0 2024-09-13T19:16:20.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.144+0000 7fa37ee05640 1 -- 172.21.15.102:0/3717059283 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa484017040 con 0x55f0f6f025b0 2024-09-13T19:16:20.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.144+0000 7fa37ee05640 1 --2- 172.21.15.102:0/3717059283 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa378036b90 0x7fa378039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.144+0000 7fa37ee05640 1 -- 172.21.15.102:0/3717059283 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fa484015020 con 0x55f0f6f025b0 2024-09-13T19:16:20.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.145+0000 7fa4898c0640 1 --2- 172.21.15.102:0/3717059283 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa378036b90 0x7fa378039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.145+0000 7fa496a0e800 1 --2- 172.21.15.102:0/3717059283 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55f0f6f92a30 0x55f0f708c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.145+0000 7fa496a0e800 1 -- 172.21.15.102:0/3717059283 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0f708c650 con 0x55f0f6f92a30 2024-09-13T19:16:20.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.145+0000 7fa4928c2640 1 --2- 172.21.15.102:0/3717059283 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55f0f6f92a30 0x55f0f708c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.145+0000 7fa4898c0640 1 --2- 172.21.15.102:0/3717059283 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa378036b90 0x7fa378039050 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa47c00a470 tx=0x7fa47c052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.145+0000 7fa4928c2640 1 --2- 172.21.15.102:0/3717059283 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55f0f6f92a30 0x55f0f708c110 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.145+0000 7fa4928c2640 1 -- 172.21.15.102:0/3717059283 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa48c00a4a0 con 0x55f0f6f92a30 2024-09-13T19:16:20.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.145+0000 7fa496a0e800 1 -- 172.21.15.102:0/3717059283 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70896e0 con 0x55f0f6f92a30 2024-09-13T19:16:20.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.146+0000 7fa4928c2640 1 -- 172.21.15.102:0/3717059283 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa48c00a4a0 con 0x55f0f6f92a30 2024-09-13T19:16:20.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.146+0000 7fa496a0e800 1 --2- 172.21.15.102:0/3717059283 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55f0f708e960 0x55f0f7090d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.146+0000 7fa496a0e800 1 -- 172.21.15.102:0/3717059283 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70913f0 con 0x55f0f708e960 2024-09-13T19:16:20.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.146+0000 7fa4920c1640 1 --2- 172.21.15.102:0/3717059283 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55f0f708e960 0x55f0f7090d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.146+0000 7fa4920c1640 1 --2- 172.21.15.102:0/3717059283 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55f0f708e960 0x55f0f7090d50 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.146+0000 7fa4920c1640 1 -- 172.21.15.102:0/3717059283 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa48402d070 con 0x55f0f708e960 2024-09-13T19:16:20.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.146+0000 7fa496a0e800 1 -- 172.21.15.102:0/3717059283 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0f708d800 con 0x55f0f6f92a30 2024-09-13T19:16:20.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.146+0000 7fa4928c2640 1 -- 172.21.15.102:0/3717059283 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa48c00a4a0 con 0x55f0f6f92a30 2024-09-13T19:16:20.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.146+0000 7fa496a0e800 1 -- 172.21.15.102:0/3717059283 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0f708dce0 con 0x55f0f708e960 2024-09-13T19:16:20.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.147+0000 7fa4920c1640 1 -- 172.21.15.102:0/3717059283 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa48402d070 con 0x55f0f708e960 2024-09-13T19:16:20.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.147+0000 7fa496a0e800 1 Processor -- start 2024-09-13T19:16:20.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.147+0000 7fa496a0e800 1 -- start start 2024-09-13T19:16:20.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.147+0000 7fa496a0e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0f709fd80 0x55f0f70a01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.147+0000 7fa496a0e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f0f6e29580 con 0x55f0f709fd80 2024-09-13T19:16:20.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.148+0000 7fa4928c2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0f709fd80 0x55f0f70a01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.148+0000 7fa4928c2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0f709fd80 0x55f0f70a01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55782/0 (socket says 172.21.15.102:55782) 2024-09-13T19:16:20.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.148+0000 7fa4928c2640 1 -- 172.21.15.102:0/3994355974 learned_addr learned my addr 172.21.15.102:0/3994355974 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:20.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.148+0000 7fa4928c2640 1 -- 172.21.15.102:0/3994355974 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0f70a06e0 con 0x55f0f709fd80 2024-09-13T19:16:20.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.148+0000 7fa4928c2640 1 --2- 172.21.15.102:0/3994355974 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0f709fd80 0x55f0f70a01a0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x55f0f7086150 tx=0x7fa48c0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.148+0000 7fa377fff640 1 -- 172.21.15.102:0/3994355974 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa48c013640 con 0x55f0f709fd80 2024-09-13T19:16:20.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.148+0000 7fa377fff640 1 -- 172.21.15.102:0/3994355974 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa48c0137e0 con 0x55f0f709fd80 2024-09-13T19:16:20.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.148+0000 7fa496a0e800 1 -- 172.21.15.102:0/3994355974 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f0f70a0970 con 0x55f0f709fd80 2024-09-13T19:16:20.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.148+0000 7fa377fff640 1 -- 172.21.15.102:0/3994355974 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa48c013ae0 con 0x55f0f709fd80 2024-09-13T19:16:20.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.148+0000 7fa496a0e800 1 -- 172.21.15.102:0/3994355974 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0f70a3650 con 0x55f0f709fd80 2024-09-13T19:16:20.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.149+0000 7fa377fff640 1 -- 172.21.15.102:0/3994355974 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa48c011040 con 0x55f0f709fd80 2024-09-13T19:16:20.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.149+0000 7fa377fff640 1 --2- 172.21.15.102:0/3994355974 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa36c036b90 0x7fa36c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.149+0000 7fa377fff640 1 -- 172.21.15.102:0/3994355974 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fa48c00e040 con 0x55f0f709fd80 2024-09-13T19:16:20.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.149+0000 7fa4920c1640 1 --2- 172.21.15.102:0/3994355974 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa36c036b90 0x7fa36c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.150+0000 7fa496a0e800 1 Processor -- start 2024-09-13T19:16:20.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.150+0000 7fa4920c1640 1 --2- 172.21.15.102:0/3994355974 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa36c036b90 0x7fa36c039050 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x55f0f7089600 tx=0x7fa48401b540 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.150+0000 7fa496a0e800 1 -- start start 2024-09-13T19:16:20.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.150+0000 7fa496a0e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0f70acaa0 0x55f0f70acea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.150+0000 7fa496a0e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f0f707ddc0 con 0x55f0f70acaa0 2024-09-13T19:16:20.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.150+0000 7fa4928c2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0f70acaa0 0x55f0f70acea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.150+0000 7fa4928c2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0f70acaa0 0x55f0f70acea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55792/0 (socket says 172.21.15.102:55792) 2024-09-13T19:16:20.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.150+0000 7fa4928c2640 1 -- 172.21.15.102:0/3449375453 learned_addr learned my addr 172.21.15.102:0/3449375453 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:20.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.150+0000 7fa4928c2640 1 -- 172.21.15.102:0/3449375453 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0f70ad470 con 0x55f0f70acaa0 2024-09-13T19:16:20.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.150+0000 7fa4928c2640 1 --2- 172.21.15.102:0/3449375453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0f70acaa0 0x55f0f70acea0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fa48c04cde0 tx=0x7fa48c0203a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaf45e70f6fae2ce server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.150+0000 7fa375ffb640 1 -- 172.21.15.102:0/3449375453 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa48c012c00 con 0x55f0f70acaa0 2024-09-13T19:16:20.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.151+0000 7fa375ffb640 1 -- 172.21.15.102:0/3449375453 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa48c021960 con 0x55f0f70acaa0 2024-09-13T19:16:20.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.151+0000 7fa375ffb640 1 -- 172.21.15.102:0/3449375453 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa48c021440 con 0x55f0f70acaa0 2024-09-13T19:16:20.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.151+0000 7fa496a0e800 1 -- 172.21.15.102:0/3449375453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0f70acaa0 msgr2=0x55f0f70acea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.151+0000 7fa496a0e800 1 --2- 172.21.15.102:0/3449375453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0f70acaa0 0x55f0f70acea0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fa48c04cde0 tx=0x7fa48c0203a0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.151+0000 7fa496a0e800 1 -- 172.21.15.102:0/3449375453 shutdown_connections 2024-09-13T19:16:20.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.151+0000 7fa496a0e800 1 --2- 172.21.15.102:0/3449375453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0f70acaa0 0x55f0f70acea0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.151+0000 7fa496a0e800 1 -- 172.21.15.102:0/3449375453 >> 172.21.15.102:0/3449375453 conn(0x55f0f70a8e00 msgr2=0x55f0f70a6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:20.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.151+0000 7fa496a0e800 1 -- 172.21.15.102:0/3449375453 shutdown_connections 2024-09-13T19:16:20.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.151+0000 7fa496a0e800 1 -- 172.21.15.102:0/3449375453 wait complete. 2024-09-13T19:16:20.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.151+0000 7fa496a0e800 1 Processor -- start 2024-09-13T19:16:20.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.151+0000 7fa496a0e800 1 -- start start 2024-09-13T19:16:20.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.151+0000 7fa496a0e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0f70acaa0 0x55f0f70b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.152+0000 7fa496a0e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f0f70adae0 con 0x55f0f70acaa0 2024-09-13T19:16:20.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.152+0000 7fa4928c2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0f70acaa0 0x55f0f70b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.152+0000 7fa4928c2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0f70acaa0 0x55f0f70b3e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55802/0 (socket says 172.21.15.102:55802) 2024-09-13T19:16:20.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.152+0000 7fa4928c2640 1 -- 172.21.15.102:0/1005966877 learned_addr learned my addr 172.21.15.102:0/1005966877 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:20.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.152+0000 7fa4928c2640 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0f70b4370 con 0x55f0f70acaa0 2024-09-13T19:16:20.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.152+0000 7fa4928c2640 1 --2- 172.21.15.102:0/1005966877 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0f70acaa0 0x55f0f70b3e30 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fa48c04cd40 tx=0x7fa48c00af70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.152+0000 7fa363fff640 1 -- 172.21.15.102:0/1005966877 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa48c039070 con 0x55f0f70acaa0 2024-09-13T19:16:20.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.152+0000 7fa363fff640 1 -- 172.21.15.102:0/1005966877 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa48c01f480 con 0x55f0f70acaa0 2024-09-13T19:16:20.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.152+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f0f70b4600 con 0x55f0f70acaa0 2024-09-13T19:16:20.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.152+0000 7fa363fff640 1 -- 172.21.15.102:0/1005966877 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa48c021570 con 0x55f0f70acaa0 2024-09-13T19:16:20.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.153+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0f70b72b0 con 0x55f0f70acaa0 2024-09-13T19:16:20.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.153+0000 7fa363fff640 1 -- 172.21.15.102:0/1005966877 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa48c04eb30 con 0x55f0f70acaa0 2024-09-13T19:16:20.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.154+0000 7fa363fff640 1 --2- 172.21.15.102:0/1005966877 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa35c036af0 0x7fa35c038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.154+0000 7fa363fff640 1 -- 172.21.15.102:0/1005966877 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7fa48c031050 con 0x55f0f70acaa0 2024-09-13T19:16:20.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.154+0000 7fa4920c1640 1 --2- 172.21.15.102:0/1005966877 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa35c036af0 0x7fa35c038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.154+0000 7fa4920c1640 1 --2- 172.21.15.102:0/1005966877 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa35c036af0 0x7fa35c038fb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa48404a4c0 tx=0x7fa48404d000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.154+0000 7fa496a0e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.154+0000 7fa496a0e800 1 --2- 172.21.15.102:0/1005966877 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55f0f70bf9c0 0x55f0f70c1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.154+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70c25d0 con 0x55f0f70bf9c0 2024-09-13T19:16:20.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.154+0000 7fa4898c0640 1 --2- 172.21.15.102:0/1005966877 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55f0f70bf9c0 0x55f0f70c1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.155+0000 7fa4898c0640 1 --2- 172.21.15.102:0/1005966877 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55f0f70bf9c0 0x55f0f70c1e80 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.155+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa47c051070 con 0x55f0f70bf9c0 2024-09-13T19:16:20.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.155+0000 7fa496a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:20.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.155+0000 7fa496a0e800 20 realm 2024-09-13T19:16:20.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.155+0000 7fa496a0e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.155+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70c2a00 con 0x55f0f70bf9c0 2024-09-13T19:16:20.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.155+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa47c051070 con 0x55f0f70bf9c0 2024-09-13T19:16:20.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.155+0000 7fa496a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:20.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.155+0000 7fa496a0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:20.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.155+0000 7fa496a0e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.155+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70c32d0 con 0x55f0f70bf9c0 2024-09-13T19:16:20.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.155+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa47c051070 con 0x55f0f70bf9c0 2024-09-13T19:16:20.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.155+0000 7fa496a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:20.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.155+0000 7fa496a0e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.155+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70c3670 con 0x55f0f70bf9c0 2024-09-13T19:16:20.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.156+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa47c051070 con 0x55f0f70bf9c0 2024-09-13T19:16:20.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.156+0000 7fa496a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:20.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.156+0000 7fa496a0e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.156+0000 7fa496a0e800 1 --2- 172.21.15.102:0/1005966877 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55f0f70c43d0 0x55f0f70c67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.156+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70c6dd0 con 0x55f0f70c43d0 2024-09-13T19:16:20.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.156+0000 7fa4928c2640 1 --2- 172.21.15.102:0/1005966877 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55f0f70c43d0 0x55f0f70c67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.156+0000 7fa4928c2640 1 --2- 172.21.15.102:0/1005966877 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55f0f70c43d0 0x55f0f70c67c0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.156+0000 7fa4928c2640 1 -- 172.21.15.102:0/1005966877 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa48c03b030 con 0x55f0f70c43d0 2024-09-13T19:16:20.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.156+0000 7fa496a0e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:20.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.156+0000 7fa496a0e800 20 searching for the correct realm 2024-09-13T19:16:20.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.156+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70c8700 con 0x55f0f70c43d0 2024-09-13T19:16:20.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.157+0000 7fa4928c2640 1 -- 172.21.15.102:0/1005966877 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa48c03b030 con 0x55f0f70c43d0 2024-09-13T19:16:20.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.157+0000 7fa4928c2640 1 --2- 172.21.15.102:0/1005966877 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fa48c03b640 0x7fa48c044890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.157+0000 7fa4928c2640 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70c8700 con 0x7fa48c03b640 2024-09-13T19:16:20.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.157+0000 7fa4920c1640 1 --2- 172.21.15.102:0/1005966877 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fa48c03b640 0x7fa48c044890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.157+0000 7fa4920c1640 1 --2- 172.21.15.102:0/1005966877 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fa48c03b640 0x7fa48c044890 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.157+0000 7fa4920c1640 1 -- 172.21.15.102:0/1005966877 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa48402d070 con 0x7fa48c03b640 2024-09-13T19:16:20.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.157+0000 7fa4920c1640 1 --2- 172.21.15.102:0/1005966877 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fa4840187f0 0x7fa48401c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.157+0000 7fa4920c1640 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70c8700 con 0x7fa4840187f0 2024-09-13T19:16:20.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.157+0000 7fa4898c0640 1 --2- 172.21.15.102:0/1005966877 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fa4840187f0 0x7fa48401c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.158+0000 7fa4898c0640 1 --2- 172.21.15.102:0/1005966877 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fa4840187f0 0x7fa48401c610 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.158+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa47c051070 con 0x7fa4840187f0 2024-09-13T19:16:20.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.158+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70c8700 con 0x55f0f70bf9c0 2024-09-13T19:16:20.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.158+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa47c051070 con 0x55f0f70bf9c0 2024-09-13T19:16:20.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.158+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70c8700 con 0x55f0f70bf9c0 2024-09-13T19:16:20.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.158+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa47c051070 con 0x55f0f70bf9c0 2024-09-13T19:16:20.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.158+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70c8700 con 0x7fa4840187f0 2024-09-13T19:16:20.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.159+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa47c051070 con 0x7fa4840187f0 2024-09-13T19:16:20.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.159+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70c8700 con 0x7fa4840187f0 2024-09-13T19:16:20.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.159+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa47c051070 con 0x7fa4840187f0 2024-09-13T19:16:20.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.159+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70c8700 con 0x7fa48c03b640 2024-09-13T19:16:20.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.159+0000 7fa4920c1640 1 -- 172.21.15.102:0/1005966877 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa48402d070 con 0x7fa48c03b640 2024-09-13T19:16:20.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.159+0000 7fa4920c1640 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70c8700 con 0x55f0f70c43d0 2024-09-13T19:16:20.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.159+0000 7fa4928c2640 1 -- 172.21.15.102:0/1005966877 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa48c03b030 con 0x55f0f70c43d0 2024-09-13T19:16:20.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.159+0000 7fa4928c2640 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70c8700 con 0x55f0f70bf9c0 2024-09-13T19:16:20.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.159+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa47c051070 con 0x55f0f70bf9c0 2024-09-13T19:16:20.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.159+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70c8700 con 0x7fa4840187f0 2024-09-13T19:16:20.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.160+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa47c051070 con 0x7fa4840187f0 2024-09-13T19:16:20.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.160+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70c8700 con 0x55f0f70bf9c0 2024-09-13T19:16:20.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.160+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa47c051070 con 0x55f0f70bf9c0 2024-09-13T19:16:20.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.160+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70c8700 con 0x7fa48c03b640 2024-09-13T19:16:20.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.160+0000 7fa4920c1640 1 -- 172.21.15.102:0/1005966877 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa48402d070 con 0x7fa48c03b640 2024-09-13T19:16:20.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.160+0000 7fa4920c1640 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70c8700 con 0x55f0f70c43d0 2024-09-13T19:16:20.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.160+0000 7fa4928c2640 1 -- 172.21.15.102:0/1005966877 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa48c03b030 con 0x55f0f70c43d0 2024-09-13T19:16:20.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.160+0000 7fa4928c2640 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70c8700 con 0x55f0f70c43d0 2024-09-13T19:16:20.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.161+0000 7fa4928c2640 1 -- 172.21.15.102:0/1005966877 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa48c03b030 con 0x55f0f70c43d0 2024-09-13T19:16:20.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.161+0000 7fa4928c2640 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70c8700 con 0x7fa4840187f0 2024-09-13T19:16:20.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.161+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa47c051070 con 0x7fa4840187f0 2024-09-13T19:16:20.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.161+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70c8700 con 0x55f0f70c43d0 2024-09-13T19:16:20.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.161+0000 7fa4928c2640 1 -- 172.21.15.102:0/1005966877 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa48c03b030 con 0x55f0f70c43d0 2024-09-13T19:16:20.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.161+0000 7fa4928c2640 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70c8700 con 0x55f0f70c43d0 2024-09-13T19:16:20.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.161+0000 7fa4928c2640 1 -- 172.21.15.102:0/1005966877 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa48c03b030 con 0x55f0f70c43d0 2024-09-13T19:16:20.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.161+0000 7fa4928c2640 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70c8700 con 0x55f0f70bf9c0 2024-09-13T19:16:20.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.162+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa47c051070 con 0x55f0f70bf9c0 2024-09-13T19:16:20.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.162+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70c8700 con 0x55f0f70bf9c0 2024-09-13T19:16:20.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.162+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa47c051070 con 0x55f0f70bf9c0 2024-09-13T19:16:20.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.162+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70c8700 con 0x7fa4840187f0 2024-09-13T19:16:20.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.162+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa47c051070 con 0x7fa4840187f0 2024-09-13T19:16:20.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.162+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70c8700 con 0x55f0f70c43d0 2024-09-13T19:16:20.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.162+0000 7fa4928c2640 1 -- 172.21.15.102:0/1005966877 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa48c03b030 con 0x55f0f70c43d0 2024-09-13T19:16:20.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.162+0000 7fa4928c2640 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70c8700 con 0x7fa48c03b640 2024-09-13T19:16:20.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.163+0000 7fa4920c1640 1 -- 172.21.15.102:0/1005966877 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa48402d070 con 0x7fa48c03b640 2024-09-13T19:16:20.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.163+0000 7fa4920c1640 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70c8700 con 0x55f0f70bf9c0 2024-09-13T19:16:20.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.163+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa47c051070 con 0x55f0f70bf9c0 2024-09-13T19:16:20.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.163+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70c8700 con 0x7fa4840187f0 2024-09-13T19:16:20.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.163+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa47c051070 con 0x7fa4840187f0 2024-09-13T19:16:20.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.163+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70c8700 con 0x55f0f70c43d0 2024-09-13T19:16:20.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.163+0000 7fa4928c2640 1 -- 172.21.15.102:0/1005966877 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa48c03b030 con 0x55f0f70c43d0 2024-09-13T19:16:20.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.163+0000 7fa4928c2640 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70c8700 con 0x7fa4840187f0 2024-09-13T19:16:20.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.164+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa47c051070 con 0x7fa4840187f0 2024-09-13T19:16:20.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.164+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70c8700 con 0x7fa48c03b640 2024-09-13T19:16:20.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.164+0000 7fa4920c1640 1 -- 172.21.15.102:0/1005966877 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa48402d070 con 0x7fa48c03b640 2024-09-13T19:16:20.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.164+0000 7fa4920c1640 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70c8700 con 0x55f0f70c43d0 2024-09-13T19:16:20.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.164+0000 7fa4928c2640 1 -- 172.21.15.102:0/1005966877 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa48c03b030 con 0x55f0f70c43d0 2024-09-13T19:16:20.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.164+0000 7fa4928c2640 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70c8700 con 0x7fa4840187f0 2024-09-13T19:16:20.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.164+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa47c051070 con 0x7fa4840187f0 2024-09-13T19:16:20.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.164+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70c8700 con 0x55f0f70bf9c0 2024-09-13T19:16:20.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.165+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa47c051070 con 0x55f0f70bf9c0 2024-09-13T19:16:20.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.165+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70c8700 con 0x7fa48c03b640 2024-09-13T19:16:20.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.165+0000 7fa4920c1640 1 -- 172.21.15.102:0/1005966877 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa48402d070 con 0x7fa48c03b640 2024-09-13T19:16:20.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.165+0000 7fa496a0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:20.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.165+0000 7fa496a0e800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:20.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.165+0000 7fa496a0e800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:20.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.165+0000 7fa496a0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:20.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.165+0000 7fa496a0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:20.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.165+0000 7fa496a0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:20.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.165+0000 7fa496a0e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.165+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70c7790 con 0x55f0f70bf9c0 2024-09-13T19:16:20.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.165+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa47c051070 con 0x55f0f70bf9c0 2024-09-13T19:16:20.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.165+0000 7fa496a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:20.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.165+0000 7fa496a0e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.165+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70c8030 con 0x55f0f70bf9c0 2024-09-13T19:16:20.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.165+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa47c051070 con 0x55f0f70bf9c0 2024-09-13T19:16:20.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.165+0000 7fa496a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:20.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.165+0000 7fa496a0e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.165+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70c8b80 con 0x55f0f70c43d0 2024-09-13T19:16:20.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.166+0000 7fa4928c2640 1 -- 172.21.15.102:0/1005966877 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa48c03b030 con 0x55f0f70c43d0 2024-09-13T19:16:20.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.166+0000 7fa496a0e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:20.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.166+0000 7fa496a0e800 20 zone default found 2024-09-13T19:16:20.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.166+0000 7fa496a0e800 4 Realm: () 2024-09-13T19:16:20.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.166+0000 7fa496a0e800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:20.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.166+0000 7fa496a0e800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:20.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.166+0000 7fa496a0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:20.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.166+0000 7fa496a0e800 20 zonegroup default 2024-09-13T19:16:20.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.166+0000 7fa496a0e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.166+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70c93d0 con 0x7fa4840187f0 2024-09-13T19:16:20.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.166+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa47c051070 con 0x7fa4840187f0 2024-09-13T19:16:20.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.166+0000 7fa496a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:20.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.166+0000 7fa496a0e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.166+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70cb150 con 0x55f0f70c43d0 2024-09-13T19:16:20.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.166+0000 7fa4928c2640 1 -- 172.21.15.102:0/1005966877 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa48c03b030 con 0x55f0f70c43d0 2024-09-13T19:16:20.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.166+0000 7fa496a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:20.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.166+0000 7fa496a0e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.166+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70cb570 con 0x55f0f70c43d0 2024-09-13T19:16:20.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.167+0000 7fa4928c2640 1 -- 172.21.15.102:0/1005966877 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa48c03b030 con 0x55f0f70c43d0 2024-09-13T19:16:20.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.167+0000 7fa496a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:20.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.167+0000 7fa496a0e800 20 started sync module instance, tier type = 2024-09-13T19:16:20.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.167+0000 7fa496a0e800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:20.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.167+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70ca5f0 con 0x7fa48c03b640 2024-09-13T19:16:20.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.168+0000 7fa4920c1640 1 -- 172.21.15.102:0/1005966877 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(44 notify.0 [create] v34'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa48402d070 con 0x7fa48c03b640 2024-09-13T19:16:20.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.168+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94493425314320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70cbe50 con 0x7fa48c03b640 2024-09-13T19:16:20.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.168+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70cc6a0 con 0x55f0f70bf9c0 2024-09-13T19:16:20.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.169+0000 7fa4920c1640 1 -- 172.21.15.102:0/1005966877 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94493425314320] v34'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa48402d070 con 0x7fa48c03b640 2024-09-13T19:16:20.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.169+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v34'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa47c051070 con 0x55f0f70bf9c0 2024-09-13T19:16:20.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.169+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94493425318304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70cc720 con 0x55f0f70bf9c0 2024-09-13T19:16:20.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.169+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70cd220 con 0x55f0f70c43d0 2024-09-13T19:16:20.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.170+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94493425318304] v34'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa47c051070 con 0x55f0f70bf9c0 2024-09-13T19:16:20.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.170+0000 7fa4928c2640 1 -- 172.21.15.102:0/1005966877 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v34'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa48c03b030 con 0x55f0f70c43d0 2024-09-13T19:16:20.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.170+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94493425323280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70cd1e0 con 0x55f0f70c43d0 2024-09-13T19:16:20.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.170+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70cdcb0 con 0x7fa48c03b640 2024-09-13T19:16:20.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.171+0000 7fa4928c2640 1 -- 172.21.15.102:0/1005966877 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94493425323280] v34'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa48c03b030 con 0x55f0f70c43d0 2024-09-13T19:16:20.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.171+0000 7fa4920c1640 1 -- 172.21.15.102:0/1005966877 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(50 notify.3 [create] v34'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa48402d070 con 0x7fa48c03b640 2024-09-13T19:16:20.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.171+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94493425325984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70ce050 con 0x7fa48c03b640 2024-09-13T19:16:20.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.171+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70ceb10 con 0x55f0f70bf9c0 2024-09-13T19:16:20.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.172+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v34'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa47c051070 con 0x55f0f70bf9c0 2024-09-13T19:16:20.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.172+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94493425329632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70cf3b0 con 0x55f0f70bf9c0 2024-09-13T19:16:20.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.172+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70cfe90 con 0x7fa4840187f0 2024-09-13T19:16:20.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.172+0000 7fa4920c1640 1 -- 172.21.15.102:0/1005966877 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94493425325984] v34'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa48402d070 con 0x7fa48c03b640 2024-09-13T19:16:20.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.173+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(54 notify.5 [create] v34'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa47c051070 con 0x7fa4840187f0 2024-09-13T19:16:20.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.173+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94493425334688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70cfe90 con 0x7fa4840187f0 2024-09-13T19:16:20.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.173+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94493425329632] v34'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa47c051070 con 0x55f0f70bf9c0 2024-09-13T19:16:20.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.173+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70d0920 con 0x7fa4840187f0 2024-09-13T19:16:20.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.174+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(56 notify.6 [create] v34'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa47c051070 con 0x7fa4840187f0 2024-09-13T19:16:20.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.174+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94493425332096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70d08e0 con 0x7fa4840187f0 2024-09-13T19:16:20.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.174+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70d1330 con 0x7fa4840187f0 2024-09-13T19:16:20.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.174+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94493425334688] v34'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa47c051070 con 0x7fa4840187f0 2024-09-13T19:16:20.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.175+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(58 notify.7 [create] v34'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa47c051070 con 0x7fa4840187f0 2024-09-13T19:16:20.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.175+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94493425332096] v34'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa47c051070 con 0x7fa4840187f0 2024-09-13T19:16:20.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.175+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94493425339936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70cc1f0 con 0x7fa4840187f0 2024-09-13T19:16:20.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.175+0000 7fa496a0e800 20 add_watcher() i=0 2024-09-13T19:16:20.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.175+0000 7fa496a0e800 20 add_watcher() i=1 2024-09-13T19:16:20.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.175+0000 7fa496a0e800 20 add_watcher() i=2 2024-09-13T19:16:20.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.175+0000 7fa496a0e800 20 add_watcher() i=3 2024-09-13T19:16:20.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.175+0000 7fa496a0e800 20 add_watcher() i=4 2024-09-13T19:16:20.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.175+0000 7fa496a0e800 20 add_watcher() i=5 2024-09-13T19:16:20.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.175+0000 7fa496a0e800 20 add_watcher() i=6 2024-09-13T19:16:20.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.176+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94493425339936] v34'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa47c051070 con 0x7fa4840187f0 2024-09-13T19:16:20.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.176+0000 7fa496a0e800 20 add_watcher() i=7 2024-09-13T19:16:20.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.176+0000 7fa496a0e800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:20.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.176+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70d4320 con 0x55f0f70bf9c0 2024-09-13T19:16:20.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.176+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa47c051070 con 0x55f0f70bf9c0 2024-09-13T19:16:20.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.176+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94493425337328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0f70d17a0 con 0x55f0f70bf9c0 2024-09-13T19:16:20.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.177+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94493425337328] v34'128 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa47c07f040 con 0x55f0f70bf9c0 2024-09-13T19:16:20.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.177+0000 7fa348fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:20.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.177+0000 7fa496a0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:20.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.177+0000 7fa496a0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:20.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.178+0000 7fa496a0e800 5 note: GC not initialized 2024-09-13T19:16:20.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.178+0000 7fa2c37fe640 20 reqs_thread_entry: start 2024-09-13T19:16:20.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.178+0000 7fa496a0e800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:20.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.178+0000 7fa496a0e800 20 Filter name: none 2024-09-13T19:16:20.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.178+0000 7fa2c17fa640 20 reqs_thread_entry: start 2024-09-13T19:16:20.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.178+0000 7fa496a0e800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-13T19:16:20.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.178+0000 7fa496a0e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.178+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0f7107730 con 0x7fa4840187f0 2024-09-13T19:16:20.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.179+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7fa47c07f040 con 0x7fa4840187f0 2024-09-13T19:16:20.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.179+0000 7fa496a0e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-13T19:16:20.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.179+0000 7fa496a0e800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-13T19:16:20.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.179+0000 7fa496a0e800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-13T19:16:20.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.179+0000 7fa496a0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:16:20.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.179+0000 7fa496a0e800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T19:16:20.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.179+0000 7fa496a0e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.179+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0f7109810 con 0x7fa48c03b640 2024-09-13T19:16:20.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.179+0000 7fa4920c1640 1 -- 172.21.15.102:0/1005966877 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv26 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fa48402d070 con 0x7fa48c03b640 2024-09-13T19:16:20.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.179+0000 7fa496a0e800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:16:20.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.179+0000 7fa496a0e800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T19:16:20.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.179+0000 7fa496a0e800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:16:20.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.179+0000 7fa496a0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 : miss 2024-09-13T19:16:20.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.179+0000 7fa496a0e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.179+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:64 8.9 8:917ee2d5:root::.bucket.meta.myfoo%3a509740b4-c081-4f37-bd6d-df9ca851489b.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0f710af30 con 0x7fa48c03b640 2024-09-13T19:16:20.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.180+0000 7fa4920c1640 1 -- 172.21.15.102:0/1005966877 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(64 .bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv24 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fa48402d070 con 0x7fa48c03b640 2024-09-13T19:16:20.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.180+0000 7fa496a0e800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:16:20.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.180+0000 7fa496a0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 info.flags=0x17 2024-09-13T19:16:20.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.180+0000 7fa496a0e800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 to cache LRU end 2024-09-13T19:16:20.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.180+0000 7fa496a0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:16:20.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.180+0000 7fa496a0e800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:16:20.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.180+0000 7fa496a0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 2024-09-13T19:16:20.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.180+0000 7fa496a0e800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2024-09-13T19:16:20.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.180+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0f710f650 con 0x7fa48c03b640 2024-09-13T19:16:20.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.181+0000 7fa4920c1640 1 -- 172.21.15.102:0/1005966877 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(65 foo.buckets [call] v34'27 uv27 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa48402d070 con 0x7fa48c03b640 2024-09-13T19:16:20.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.181+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:66 8.12 8:4fe6a3ef:root::.bucket.meta.testx%3amyfoo%3a509740b4-c081-4f37-bd6d-df9ca851489b.4237.1:head [create,call version.inc in=38b,writefull 0~412 in=412b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0f7112f40 con 0x55f0f70c43d0 2024-09-13T19:16:20.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.182+0000 7fa4928c2640 1 -- 172.21.15.102:0/1005966877 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(66 .bucket.meta.testx:myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 [create,call,writefull 0~412,setxattr (203)] v34'1 uv1 ondisk = 0) ==== 338+0+0 (crc 0 0 0) 0x7fa48c03b030 con 0x55f0f70c43d0 2024-09-13T19:16:20.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.182+0000 7fa496a0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 info.flags=0x7 2024-09-13T19:16:20.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.182+0000 7fa496a0e800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 to cache LRU end 2024-09-13T19:16:20.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.182+0000 7fa496a0e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-13T19:16:20.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.182+0000 7fa496a0e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1, ofs0, ns] 2024-09-13T19:16:20.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.182+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [notify cookie 94493425601472 in=859b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0f7112860 con 0x7fa48c03b640 2024-09-13T19:16:20.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.183+0000 7fa4920c1640 1 -- 172.21.15.102:0/1005966877 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== watch-notify(notify (1) cookie 94493425325984 notify 146028888077 ret 0) ==== 889+0+0 (crc 0 0 0) 0x55f0f710b320 con 0x7fa48c03b640 2024-09-13T19:16:20.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.183+0000 7fa375ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888077 cookie 94493425325984 notifier 4552 bl.length()=847 2024-09-13T19:16:20.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.183+0000 7fa4920c1640 1 -- 172.21.15.102:0/1005966877 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(67 notify.3 [notify cookie 94493425601472 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa48402d070 con 0x7fa48c03b640 2024-09-13T19:16:20.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.183+0000 7fa375ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 info.flags=0x7 2024-09-13T19:16:20.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.183+0000 7fa375ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 to cache LRU end 2024-09-13T19:16:20.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.183+0000 7fa375ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-13T19:16:20.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.183+0000 7fa375ffb640 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fa358003ea0 con 0x7fa48c03b640 2024-09-13T19:16:20.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.183+0000 7fa4920c1640 1 -- 172.21.15.102:0/1005966877 <== osd.2 v2:172.21.15.102:6816/2238176080 16 ==== osd_op_reply(68 notify.3 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa48402d070 con 0x7fa48c03b640 2024-09-13T19:16:20.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.183+0000 7fa4920c1640 1 -- 172.21.15.102:0/1005966877 <== osd.2 v2:172.21.15.102:6816/2238176080 17 ==== watch-notify(notify_complete (2) cookie 94493425601472 notify 146028888077 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f0f710a4d0 con 0x7fa48c03b640 2024-09-13T19:16:20.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.183+0000 7fa496a0e800 20 handle_bi_update(): bucket=testx:myfoo[509740b4-c081-4f37-bd6d-df9ca851489b.4237.1]): orig_sources= new_sources= 2024-09-13T19:16:20.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.183+0000 7fa496a0e800 20 handle_bi_update(): bucket=testx:myfoo[509740b4-c081-4f37-bd6d-df9ca851489b.4237.1]): potential sources added=[] removed=[] 2024-09-13T19:16:20.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.183+0000 7fa496a0e800 20 handle_bi_update(): bucket=testx:myfoo[509740b4-c081-4f37-bd6d-df9ca851489b.4237.1]): orig_dests= new_dests= 2024-09-13T19:16:20.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.183+0000 7fa496a0e800 20 handle_bi_update(): bucket=testx:myfoo[509740b4-c081-4f37-bd6d-df9ca851489b.4237.1]): potential dests added=[] removed=[] 2024-09-13T19:16:20.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.183+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:69 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0f710e880 con 0x55f0f70bf9c0 2024-09-13T19:16:20.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.184+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(69 testx$tenanteduser.buckets [call] v34'1 uv1 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7fa47c07f040 con 0x55f0f70bf9c0 2024-09-13T19:16:20.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.184+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:70 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0f710e3d0 con 0x55f0f70bf9c0 2024-09-13T19:16:20.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.185+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(70 testx/myfoo [delete,create,call,writefull 0~193] v34'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7fa47c07f040 con 0x55f0f70bf9c0 2024-09-13T19:16:20.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.185+0000 7fa496a0e800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-13T19:16:20.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.185+0000 7fa496a0e800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-13T19:16:20.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.185+0000 7fa496a0e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-13T19:16:20.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.185+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify cookie 94493425592688 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0f710e3d0 con 0x55f0f70bf9c0 2024-09-13T19:16:20.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.185+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== watch-notify(notify (1) cookie 94493425329632 notify 146028888078 ret 0) ==== 390+0+0 (crc 0 0 0) 0x55f0f710e770 con 0x55f0f70bf9c0 2024-09-13T19:16:20.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.185+0000 7fa375ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888078 cookie 94493425329632 notifier 4552 bl.length()=348 2024-09-13T19:16:20.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.185+0000 7fa375ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-13T19:16:20.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.185+0000 7fa375ffb640 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-13T19:16:20.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.185+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(71 notify.4 [notify cookie 94493425592688 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa47c07f040 con 0x55f0f70bf9c0 2024-09-13T19:16:20.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.185+0000 7fa375ffb640 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fa358003ea0 con 0x55f0f70bf9c0 2024-09-13T19:16:20.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.186+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(72 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa47c07f040 con 0x55f0f70bf9c0 2024-09-13T19:16:20.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.186+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== watch-notify(notify_complete (2) cookie 94493425592688 notify 146028888078 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f0f7113280 con 0x55f0f70bf9c0 2024-09-13T19:16:20.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.186+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:73 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0f710e3d0 con 0x7fa48c03b640 2024-09-13T19:16:20.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.187+0000 7fa4920c1640 1 -- 172.21.15.102:0/1005966877 <== osd.2 v2:172.21.15.102:6816/2238176080 18 ==== osd_op_reply(73 myfoo [call,delete] v34'28 uv28 ondisk = 0) ==== 191+0+0 (crc 0 0 0) 0x7fa48402d070 con 0x7fa48c03b640 2024-09-13T19:16:20.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.187+0000 7fa496a0e800 10 removing default.rgw.meta+root+myfoo from cache 2024-09-13T19:16:20.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.187+0000 7fa496a0e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T19:16:20.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.187+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94493425592688 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0f710e3d0 con 0x7fa4840187f0 2024-09-13T19:16:20.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.187+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== watch-notify(notify (1) cookie 94493425332096 notify 146028888078 ret 0) ==== 191+0+0 (crc 0 0 0) 0x55f0f7113280 con 0x7fa4840187f0 2024-09-13T19:16:20.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.187+0000 7fa375ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888078 cookie 94493425332096 notifier 4552 bl.length()=149 2024-09-13T19:16:20.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.187+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(74 notify.6 [notify cookie 94493425592688 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa47c07f040 con 0x7fa4840187f0 2024-09-13T19:16:20.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.187+0000 7fa375ffb640 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:75 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fa358003ea0 con 0x7fa4840187f0 2024-09-13T19:16:20.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.187+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.0 v2:172.21.15.53:6800/4021716951 20 ==== osd_op_reply(75 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa47c07f040 con 0x7fa4840187f0 2024-09-13T19:16:20.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.187+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.0 v2:172.21.15.53:6800/4021716951 21 ==== watch-notify(notify_complete (2) cookie 94493425592688 notify 146028888078 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f0f6e55e00 con 0x7fa4840187f0 2024-09-13T19:16:20.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.187+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:76 8.9 8:917ee2d5:root::.bucket.meta.myfoo%3a509740b4-c081-4f37-bd6d-df9ca851489b.4237.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0f710e3d0 con 0x7fa48c03b640 2024-09-13T19:16:20.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.188+0000 7fa4920c1640 1 -- 172.21.15.102:0/1005966877 <== osd.2 v2:172.21.15.102:6816/2238176080 19 ==== osd_op_reply(76 .bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 [call,delete] v34'29 uv29 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fa48402d070 con 0x7fa48c03b640 2024-09-13T19:16:20.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.188+0000 7fa496a0e800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 from cache 2024-09-13T19:16:20.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.188+0000 7fa496a0e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1, ofs0, ns] 2024-09-13T19:16:20.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.188+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [notify cookie 94493425579440 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f0f710e3d0 con 0x55f0f70bf9c0 2024-09-13T19:16:20.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.189+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== watch-notify(notify (1) cookie 94493425329632 notify 146028888079 ret 0) ==== 248+0+0 (crc 0 0 0) 0x55f0f6e55e00 con 0x55f0f70bf9c0 2024-09-13T19:16:20.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.189+0000 7fa375ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888079 cookie 94493425329632 notifier 4552 bl.length()=206 2024-09-13T19:16:20.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.189+0000 7fa375ffb640 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fa358003ea0 con 0x55f0f70bf9c0 2024-09-13T19:16:20.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.189+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.1 v2:172.21.15.102:6808/2204418452 28 ==== osd_op_reply(77 notify.4 [notify cookie 94493425579440 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa47c07f040 con 0x55f0f70bf9c0 2024-09-13T19:16:20.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.189+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.1 v2:172.21.15.102:6808/2204418452 29 ==== watch-notify(notify_complete (2) cookie 94493425579440 notify 146028888079 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa47c05fb50 con 0x55f0f70bf9c0 2024-09-13T19:16:20.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.189+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.1 v2:172.21.15.102:6808/2204418452 30 ==== osd_op_reply(78 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa47c07f040 con 0x55f0f70bf9c0 2024-09-13T19:16:20.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.190+0000 7fa348fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:20.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.190+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94493425337328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0f710e3d0 con 0x55f0f70bf9c0 2024-09-13T19:16:20.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.191+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.1 v2:172.21.15.102:6808/2204418452 31 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94493425337328] v34'129 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa47c07f040 con 0x55f0f70bf9c0 2024-09-13T19:16:20.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.191+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94493425314320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0f710e3d0 con 0x7fa48c03b640 2024-09-13T19:16:20.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.192+0000 7fa4920c1640 1 -- 172.21.15.102:0/1005966877 <== osd.2 v2:172.21.15.102:6816/2238176080 20 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94493425314320] v34'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa48402d070 con 0x7fa48c03b640 2024-09-13T19:16:20.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.192+0000 7fa496a0e800 20 remove_watcher() i=0 2024-09-13T19:16:20.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.192+0000 7fa496a0e800 2 removed watcher, disabling cache 2024-09-13T19:16:20.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.192+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94493425318304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0f710e3d0 con 0x55f0f70bf9c0 2024-09-13T19:16:20.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.193+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.1 v2:172.21.15.102:6808/2204418452 32 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94493425318304] v34'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa47c07f040 con 0x55f0f70bf9c0 2024-09-13T19:16:20.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.193+0000 7fa496a0e800 20 remove_watcher() i=1 2024-09-13T19:16:20.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.193+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94493425323280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0f710e3d0 con 0x55f0f70c43d0 2024-09-13T19:16:20.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.194+0000 7fa4928c2640 1 -- 172.21.15.102:0/1005966877 <== osd.3 v2:172.21.15.102:6800/3096737090 17 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94493425323280] v34'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa48c03b030 con 0x55f0f70c43d0 2024-09-13T19:16:20.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.194+0000 7fa496a0e800 20 remove_watcher() i=2 2024-09-13T19:16:20.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.194+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94493425325984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0f710e3d0 con 0x7fa48c03b640 2024-09-13T19:16:20.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.195+0000 7fa4920c1640 1 -- 172.21.15.102:0/1005966877 <== osd.2 v2:172.21.15.102:6816/2238176080 21 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94493425325984] v34'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa48402d070 con 0x7fa48c03b640 2024-09-13T19:16:20.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.195+0000 7fa496a0e800 20 remove_watcher() i=3 2024-09-13T19:16:20.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.195+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94493425329632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0f710e3d0 con 0x55f0f70bf9c0 2024-09-13T19:16:20.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.196+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.1 v2:172.21.15.102:6808/2204418452 33 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94493425329632] v34'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa47c07f040 con 0x55f0f70bf9c0 2024-09-13T19:16:20.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.196+0000 7fa496a0e800 20 remove_watcher() i=4 2024-09-13T19:16:20.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.196+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94493425334688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0f710e3d0 con 0x7fa4840187f0 2024-09-13T19:16:20.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.197+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.0 v2:172.21.15.53:6800/4021716951 22 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94493425334688] v34'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa47c07f040 con 0x7fa4840187f0 2024-09-13T19:16:20.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.197+0000 7fa496a0e800 20 remove_watcher() i=5 2024-09-13T19:16:20.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.197+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94493425332096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0f710e3d0 con 0x7fa4840187f0 2024-09-13T19:16:20.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.198+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.0 v2:172.21.15.53:6800/4021716951 23 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94493425332096] v34'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa47c07f040 con 0x7fa4840187f0 2024-09-13T19:16:20.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.198+0000 7fa496a0e800 20 remove_watcher() i=6 2024-09-13T19:16:20.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.198+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94493425339936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f0f710e3d0 con 0x7fa4840187f0 2024-09-13T19:16:20.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.199+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 <== osd.0 v2:172.21.15.53:6800/4021716951 24 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94493425339936] v34'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa47c07f040 con 0x7fa4840187f0 2024-09-13T19:16:20.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.199+0000 7fa496a0e800 20 remove_watcher() i=7 2024-09-13T19:16:20.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.199+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fa4840187f0 msgr2=0x7fa48401c610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.199+0000 7fa496a0e800 1 --2- 172.21.15.102:0/1005966877 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fa4840187f0 0x7fa48401c610 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.199+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55f0f70bf9c0 msgr2=0x55f0f70c1e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.199+0000 7fa496a0e800 1 --2- 172.21.15.102:0/1005966877 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55f0f70bf9c0 0x55f0f70c1e80 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.199+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fa48c03b640 msgr2=0x7fa48c044890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.199+0000 7fa496a0e800 1 --2- 172.21.15.102:0/1005966877 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fa48c03b640 0x7fa48c044890 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.199+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55f0f70c43d0 msgr2=0x55f0f70c67c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.199+0000 7fa496a0e800 1 --2- 172.21.15.102:0/1005966877 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55f0f70c43d0 0x55f0f70c67c0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.200+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa35c036af0 msgr2=0x7fa35c038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.200+0000 7fa496a0e800 1 --2- 172.21.15.102:0/1005966877 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa35c036af0 0x7fa35c038fb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa48404a4c0 tx=0x7fa48404d000 comp rx=0 tx=0).stop 2024-09-13T19:16:20.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.200+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0f70acaa0 msgr2=0x55f0f70b3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.200+0000 7fa4898c0640 1 -- 172.21.15.102:0/1005966877 reap_dead start 2024-09-13T19:16:20.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.200+0000 7fa496a0e800 1 --2- 172.21.15.102:0/1005966877 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0f70acaa0 0x55f0f70b3e30 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fa48c04cd40 tx=0x7fa48c00af70 comp rx=0 tx=0).stop 2024-09-13T19:16:20.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.200+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 shutdown_connections 2024-09-13T19:16:20.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.200+0000 7fa496a0e800 1 --2- 172.21.15.102:0/1005966877 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0f70acaa0 0x55f0f70b3e30 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.200+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 >> 172.21.15.102:0/1005966877 conn(0x55f0f70a8e00 msgr2=0x55f0f70a6ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:20.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.200+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 shutdown_connections 2024-09-13T19:16:20.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.200+0000 7fa496a0e800 1 -- 172.21.15.102:0/1005966877 wait complete. 2024-09-13T19:16:20.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.200+0000 7fa496a0e800 1 -- 172.21.15.102:0/3994355974 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa36c036b90 msgr2=0x7fa36c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.200+0000 7fa496a0e800 1 --2- 172.21.15.102:0/3994355974 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa36c036b90 0x7fa36c039050 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x55f0f7089600 tx=0x7fa48401b540 comp rx=0 tx=0).stop 2024-09-13T19:16:20.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.200+0000 7fa496a0e800 1 -- 172.21.15.102:0/3994355974 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0f709fd80 msgr2=0x55f0f70a01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.200+0000 7fa496a0e800 1 --2- 172.21.15.102:0/3994355974 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0f709fd80 0x55f0f70a01a0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x55f0f7086150 tx=0x7fa48c0167b0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.200+0000 7fa496a0e800 1 -- 172.21.15.102:0/3994355974 shutdown_connections 2024-09-13T19:16:20.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.200+0000 7fa496a0e800 1 --2- 172.21.15.102:0/3994355974 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa36c036b90 0x7fa36c039050 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.200+0000 7fa496a0e800 1 --2- 172.21.15.102:0/3994355974 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0f709fd80 0x55f0f70a01a0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.200+0000 7fa496a0e800 1 -- 172.21.15.102:0/3994355974 >> 172.21.15.102:0/3994355974 conn(0x55f0f7094d10 msgr2=0x55f0f7097890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:20.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.200+0000 7fa496a0e800 1 -- 172.21.15.102:0/3994355974 shutdown_connections 2024-09-13T19:16:20.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.200+0000 7fa496a0e800 1 -- 172.21.15.102:0/3994355974 wait complete. 2024-09-13T19:16:20.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.200+0000 7fa496a0e800 1 -- 172.21.15.102:0/3717059283 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55f0f6f92a30 msgr2=0x55f0f708c110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.201+0000 7fa496a0e800 1 --2- 172.21.15.102:0/3717059283 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55f0f6f92a30 0x55f0f708c110 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.201+0000 7fa496a0e800 1 -- 172.21.15.102:0/3717059283 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55f0f708e960 msgr2=0x55f0f7090d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.201+0000 7fa496a0e800 1 --2- 172.21.15.102:0/3717059283 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55f0f708e960 0x55f0f7090d50 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.201+0000 7fa496a0e800 1 -- 172.21.15.102:0/3717059283 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa378036b90 msgr2=0x7fa378039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.201+0000 7fa496a0e800 1 --2- 172.21.15.102:0/3717059283 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa378036b90 0x7fa378039050 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa47c00a470 tx=0x7fa47c052000 comp rx=0 tx=0).stop 2024-09-13T19:16:20.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.201+0000 7fa496a0e800 1 -- 172.21.15.102:0/3717059283 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0f6f025b0 msgr2=0x55f0f70850a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.201+0000 7fa496a0e800 1 --2- 172.21.15.102:0/3717059283 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0f6f025b0 0x55f0f70850a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x55f0f707e470 tx=0x7fa484000ed0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.201+0000 7fa496a0e800 1 -- 172.21.15.102:0/3717059283 shutdown_connections 2024-09-13T19:16:20.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.201+0000 7fa496a0e800 1 --2- 172.21.15.102:0/3717059283 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55f0f708e960 0x55f0f7090d50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.201+0000 7fa496a0e800 1 --2- 172.21.15.102:0/3717059283 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55f0f6f92a30 0x55f0f708c110 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.201+0000 7fa496a0e800 1 --2- 172.21.15.102:0/3717059283 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa378036b90 0x7fa378039050 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.201+0000 7fa496a0e800 1 --2- 172.21.15.102:0/3717059283 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0f6f025b0 0x55f0f70850a0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.201+0000 7fa496a0e800 1 -- 172.21.15.102:0/3717059283 >> 172.21.15.102:0/3717059283 conn(0x55f0f6f88e00 msgr2=0x55f0f70778a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:20.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.201+0000 7fa496a0e800 1 -- 172.21.15.102:0/3717059283 shutdown_connections 2024-09-13T19:16:20.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.201+0000 7fa496a0e800 1 -- 172.21.15.102:0/3717059283 wait complete. 2024-09-13T19:16:20.246 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2024-09-13T19:16:20.246 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2024-09-13T19:16:20.247 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2024-09-13T19:16:20.290 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:20.290 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:20.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.287+0000 7f0185f40800 1 Processor -- start 2024-09-13T19:16:20.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.287+0000 7f0185f40800 1 -- start start 2024-09-13T19:16:20.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.288+0000 7f0185f40800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5611e020e630 0x5611e029d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.288+0000 7f0185f40800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5611e0159b30 con 0x5611e029d790 2024-09-13T19:16:20.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.288+0000 7f0185f40800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5611e013b360 con 0x5611e020e630 2024-09-13T19:16:20.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.288+0000 7f0181cca640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5611e020e630 0x5611e029d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.288+0000 7f01814c9640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5611e029d790 0x5611e029fb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:50056/0 (socket says 172.21.15.102:50056) 2024-09-13T19:16:20.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.288+0000 7f01814c9640 1 -- 172.21.15.102:0/2612962925 learned_addr learned my addr 172.21.15.102:0/2612962925 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:16:20.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.288+0000 7f0181cca640 1 -- 172.21.15.102:0/2612962925 >> v1:172.21.15.53:6789/0 conn(0x5611e029d790 legacy=0x5611e029fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.288+0000 7f0180cc8640 1 -- 172.21.15.102:0/2612962925 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1895720297 0 0) 0x5611e0159b30 con 0x5611e029d790 2024-09-13T19:16:20.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.288+0000 7f0181cca640 1 -- 172.21.15.102:0/2612962925 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611e0161e00 con 0x5611e020e630 2024-09-13T19:16:20.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.290+0000 7f0181cca640 1 --2- 172.21.15.102:0/2612962925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611e020e630 0x5611e029d250 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f017c005fd0 tx=0x7f017c045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=801fd9b7d5a02482 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.290+0000 7f0180cc8640 1 -- 172.21.15.102:0/2612962925 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f017c058530 con 0x5611e020e630 2024-09-13T19:16:20.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.290+0000 7f0180cc8640 1 -- 172.21.15.102:0/2612962925 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f017c0586d0 con 0x5611e020e630 2024-09-13T19:16:20.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.290+0000 7f0180cc8640 1 -- 172.21.15.102:0/2612962925 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f017c0589d0 con 0x5611e020e630 2024-09-13T19:16:20.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.291+0000 7f0185f40800 1 -- 172.21.15.102:0/2612962925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611e020e630 msgr2=0x5611e029d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.291+0000 7f0185f40800 1 --2- 172.21.15.102:0/2612962925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611e020e630 0x5611e029d250 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f017c005fd0 tx=0x7f017c045c30 comp rx=0 tx=0).stop 2024-09-13T19:16:20.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.291+0000 7f0185f40800 1 -- 172.21.15.102:0/2612962925 shutdown_connections 2024-09-13T19:16:20.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.291+0000 7f0185f40800 1 --2- 172.21.15.102:0/2612962925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611e020e630 0x5611e029d250 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.291+0000 7f0185f40800 1 -- 172.21.15.102:0/2612962925 >> 172.21.15.102:0/2612962925 conn(0x5611e0294de0 msgr2=0x5611e0297200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:20.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.291+0000 7f0185f40800 1 -- 172.21.15.102:0/2612962925 shutdown_connections 2024-09-13T19:16:20.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.291+0000 7f0185f40800 1 -- 172.21.15.102:0/2612962925 wait complete. 2024-09-13T19:16:20.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.304+0000 7f0185f40800 1 Processor -- start 2024-09-13T19:16:20.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.305+0000 7f0185f40800 1 -- start start 2024-09-13T19:16:20.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.305+0000 7f0185f40800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611e020e630 0x5611e03896c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.305+0000 7f0185f40800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5611e01e6330 con 0x5611e020e630 2024-09-13T19:16:20.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.305+0000 7f0181cca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611e020e630 0x5611e03896c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.305+0000 7f0181cca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611e020e630 0x5611e03896c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55818/0 (socket says 172.21.15.102:55818) 2024-09-13T19:16:20.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.305+0000 7f0181cca640 1 -- 172.21.15.102:0/1205780883 learned_addr learned my addr 172.21.15.102:0/1205780883 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:20.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.305+0000 7f0181cca640 1 -- 172.21.15.102:0/1205780883 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611e0133bc0 con 0x5611e020e630 2024-09-13T19:16:20.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.306+0000 7f0181cca640 1 --2- 172.21.15.102:0/1205780883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611e020e630 0x5611e03896c0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f017c00a3f0 tx=0x7f017c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2bb2c2ed1ba4ba5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.306+0000 7f006fe07640 1 -- 172.21.15.102:0/1205780883 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f017c058a30 con 0x5611e020e630 2024-09-13T19:16:20.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.306+0000 7f006fe07640 1 -- 172.21.15.102:0/1205780883 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f017c068070 con 0x5611e020e630 2024-09-13T19:16:20.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.306+0000 7f006fe07640 1 -- 172.21.15.102:0/1205780883 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f017c058d60 con 0x5611e020e630 2024-09-13T19:16:20.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.306+0000 7f0185f40800 1 -- 172.21.15.102:0/1205780883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611e020e630 msgr2=0x5611e03896c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.306+0000 7f0185f40800 1 --2- 172.21.15.102:0/1205780883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611e020e630 0x5611e03896c0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f017c00a3f0 tx=0x7f017c051000 comp rx=0 tx=0).stop 2024-09-13T19:16:20.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.307+0000 7f0185f40800 1 -- 172.21.15.102:0/1205780883 shutdown_connections 2024-09-13T19:16:20.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.307+0000 7f0185f40800 1 --2- 172.21.15.102:0/1205780883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611e020e630 0x5611e03896c0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.307+0000 7f0185f40800 1 -- 172.21.15.102:0/1205780883 >> 172.21.15.102:0/1205780883 conn(0x5611e0294de0 msgr2=0x5611e0385080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:20.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.307+0000 7f0185f40800 1 -- 172.21.15.102:0/1205780883 shutdown_connections 2024-09-13T19:16:20.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.307+0000 7f0185f40800 1 -- 172.21.15.102:0/1205780883 wait complete. 2024-09-13T19:16:20.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.307+0000 7f0185f40800 1 Processor -- start 2024-09-13T19:16:20.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.307+0000 7f0185f40800 1 -- start start 2024-09-13T19:16:20.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.307+0000 7f0185f40800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611e020e630 0x5611e0391080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.307+0000 7f0185f40800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5611e02a1690 con 0x5611e020e630 2024-09-13T19:16:20.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.307+0000 7f0181cca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611e020e630 0x5611e0391080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.307+0000 7f0181cca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611e020e630 0x5611e0391080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55820/0 (socket says 172.21.15.102:55820) 2024-09-13T19:16:20.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.307+0000 7f0181cca640 1 -- 172.21.15.102:0/658395749 learned_addr learned my addr 172.21.15.102:0/658395749 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:20.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.307+0000 7f0181cca640 1 -- 172.21.15.102:0/658395749 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611e0147fe0 con 0x5611e020e630 2024-09-13T19:16:20.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.308+0000 7f0181cca640 1 --2- 172.21.15.102:0/658395749 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611e020e630 0x5611e0391080 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f017c00a3f0 tx=0x7f017c003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.308+0000 7f006e604640 1 -- 172.21.15.102:0/658395749 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f017c063680 con 0x5611e020e630 2024-09-13T19:16:20.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.308+0000 7f006e604640 1 -- 172.21.15.102:0/658395749 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f017c063820 con 0x5611e020e630 2024-09-13T19:16:20.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.308+0000 7f0185f40800 1 -- 172.21.15.102:0/658395749 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5611e03915c0 con 0x5611e020e630 2024-09-13T19:16:20.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.308+0000 7f006e604640 1 -- 172.21.15.102:0/658395749 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f017c063b40 con 0x5611e020e630 2024-09-13T19:16:20.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.308+0000 7f0185f40800 1 -- 172.21.15.102:0/658395749 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611e0391a80 con 0x5611e020e630 2024-09-13T19:16:20.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.309+0000 7f006e604640 1 -- 172.21.15.102:0/658395749 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f017c063ce0 con 0x5611e020e630 2024-09-13T19:16:20.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.309+0000 7f006e604640 1 --2- 172.21.15.102:0/658395749 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0068036b90 0x7f0068039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.309+0000 7f006e604640 1 -- 172.21.15.102:0/658395749 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f017c090d20 con 0x5611e020e630 2024-09-13T19:16:20.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.309+0000 7f01814c9640 1 --2- 172.21.15.102:0/658395749 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0068036b90 0x7f0068039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.309+0000 7f0185f40800 1 --2- 172.21.15.102:0/658395749 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5611e029d790 0x5611e0397f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.309+0000 7f0185f40800 1 -- 172.21.15.102:0/658395749 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5611e0398530 con 0x5611e029d790 2024-09-13T19:16:20.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.309+0000 7f01824cb640 1 --2- 172.21.15.102:0/658395749 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5611e029d790 0x5611e0397f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.309+0000 7f01814c9640 1 --2- 172.21.15.102:0/658395749 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0068036b90 0x7f0068039050 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f016c000c00 tx=0x7f016c0013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.309+0000 7f01824cb640 1 --2- 172.21.15.102:0/658395749 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5611e029d790 0x5611e0397f30 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.310+0000 7f01824cb640 1 -- 172.21.15.102:0/658395749 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01740083e0 con 0x5611e029d790 2024-09-13T19:16:20.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.310+0000 7f0185f40800 1 -- 172.21.15.102:0/658395749 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5611e0395630 con 0x5611e029d790 2024-09-13T19:16:20.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.310+0000 7f01824cb640 1 -- 172.21.15.102:0/658395749 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f01740083e0 con 0x5611e029d790 2024-09-13T19:16:20.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.310+0000 7f0185f40800 1 --2- 172.21.15.102:0/658395749 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5611e039a860 0x5611e039cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.310+0000 7f0185f40800 1 -- 172.21.15.102:0/658395749 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5611e039d320 con 0x5611e039a860 2024-09-13T19:16:20.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.310+0000 7f0181cca640 1 --2- 172.21.15.102:0/658395749 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5611e039a860 0x5611e039cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.310+0000 7f0181cca640 1 --2- 172.21.15.102:0/658395749 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5611e039a860 0x5611e039cc50 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.311+0000 7f0181cca640 1 -- 172.21.15.102:0/658395749 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f017c07fc40 con 0x5611e039a860 2024-09-13T19:16:20.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.311+0000 7f0185f40800 1 -- 172.21.15.102:0/658395749 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5611e0399700 con 0x5611e029d790 2024-09-13T19:16:20.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.311+0000 7f01824cb640 1 -- 172.21.15.102:0/658395749 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f01740083e0 con 0x5611e029d790 2024-09-13T19:16:20.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.311+0000 7f0185f40800 1 -- 172.21.15.102:0/658395749 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5611e0399be0 con 0x5611e039a860 2024-09-13T19:16:20.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.311+0000 7f0181cca640 1 -- 172.21.15.102:0/658395749 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f017c07fc40 con 0x5611e039a860 2024-09-13T19:16:20.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.311+0000 7f0185f40800 1 Processor -- start 2024-09-13T19:16:20.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.312+0000 7f0185f40800 1 -- start start 2024-09-13T19:16:20.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.312+0000 7f0185f40800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611e03abd30 0x5611e03ac150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.312+0000 7f0185f40800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5611e0135580 con 0x5611e03abd30 2024-09-13T19:16:20.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.312+0000 7f01824cb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611e03abd30 0x5611e03ac150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.312+0000 7f01824cb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611e03abd30 0x5611e03ac150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55832/0 (socket says 172.21.15.102:55832) 2024-09-13T19:16:20.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.312+0000 7f01824cb640 1 -- 172.21.15.102:0/3218931981 learned_addr learned my addr 172.21.15.102:0/3218931981 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:20.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.312+0000 7f01824cb640 1 -- 172.21.15.102:0/3218931981 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611e03ac690 con 0x5611e03abd30 2024-09-13T19:16:20.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.312+0000 7f01824cb640 1 --2- 172.21.15.102:0/3218931981 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611e03abd30 0x5611e03ac150 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x5611e0391ea0 tx=0x7f017400beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.313+0000 7f00677fe640 1 -- 172.21.15.102:0/3218931981 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f017401c020 con 0x5611e03abd30 2024-09-13T19:16:20.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.313+0000 7f00677fe640 1 -- 172.21.15.102:0/3218931981 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0174007c30 con 0x5611e03abd30 2024-09-13T19:16:20.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.313+0000 7f00677fe640 1 -- 172.21.15.102:0/3218931981 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0174018440 con 0x5611e03abd30 2024-09-13T19:16:20.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.313+0000 7f0185f40800 1 -- 172.21.15.102:0/3218931981 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5611e03ac920 con 0x5611e03abd30 2024-09-13T19:16:20.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.313+0000 7f0185f40800 1 -- 172.21.15.102:0/3218931981 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611e03af600 con 0x5611e03abd30 2024-09-13T19:16:20.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.313+0000 7f00677fe640 1 -- 172.21.15.102:0/3218931981 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f017401f020 con 0x5611e03abd30 2024-09-13T19:16:20.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.314+0000 7f00677fe640 1 --2- 172.21.15.102:0/3218931981 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f005c036b90 0x7f005c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.314+0000 7f00677fe640 1 -- 172.21.15.102:0/3218931981 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f017404e230 con 0x5611e03abd30 2024-09-13T19:16:20.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.314+0000 7f0181cca640 1 --2- 172.21.15.102:0/3218931981 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f005c036b90 0x7f005c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.314+0000 7f0185f40800 1 Processor -- start 2024-09-13T19:16:20.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.314+0000 7f0181cca640 1 --2- 172.21.15.102:0/3218931981 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f005c036b90 0x7f005c039050 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f017c073950 tx=0x7f017c059f90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.314+0000 7f0185f40800 1 -- start start 2024-09-13T19:16:20.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.314+0000 7f0185f40800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611e03b89f0 0x5611e03b8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.314+0000 7f0185f40800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5611e0389db0 con 0x5611e03b89f0 2024-09-13T19:16:20.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.314+0000 7f01824cb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611e03b89f0 0x5611e03b8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.314+0000 7f01824cb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611e03b89f0 0x5611e03b8df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55838/0 (socket says 172.21.15.102:55838) 2024-09-13T19:16:20.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.314+0000 7f01824cb640 1 -- 172.21.15.102:0/629903657 learned_addr learned my addr 172.21.15.102:0/629903657 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:20.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.315+0000 7f01824cb640 1 -- 172.21.15.102:0/629903657 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611e03b93c0 con 0x5611e03b89f0 2024-09-13T19:16:20.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.315+0000 7f01824cb640 1 --2- 172.21.15.102:0/629903657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611e03b89f0 0x5611e03b8df0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f017404c5f0 tx=0x7f0174029e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b8ac9cffb663137 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.315+0000 7f00657fa640 1 -- 172.21.15.102:0/629903657 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0174045070 con 0x5611e03b89f0 2024-09-13T19:16:20.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.315+0000 7f00657fa640 1 -- 172.21.15.102:0/629903657 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f017404b210 con 0x5611e03b89f0 2024-09-13T19:16:20.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.315+0000 7f00657fa640 1 -- 172.21.15.102:0/629903657 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0174029480 con 0x5611e03b89f0 2024-09-13T19:16:20.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.315+0000 7f0185f40800 1 -- 172.21.15.102:0/629903657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611e03b89f0 msgr2=0x5611e03b8df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.315+0000 7f0185f40800 1 --2- 172.21.15.102:0/629903657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611e03b89f0 0x5611e03b8df0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f017404c5f0 tx=0x7f0174029e70 comp rx=0 tx=0).stop 2024-09-13T19:16:20.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.315+0000 7f0185f40800 1 -- 172.21.15.102:0/629903657 shutdown_connections 2024-09-13T19:16:20.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.315+0000 7f0185f40800 1 --2- 172.21.15.102:0/629903657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611e03b89f0 0x5611e03b8df0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.315+0000 7f0185f40800 1 -- 172.21.15.102:0/629903657 >> 172.21.15.102:0/629903657 conn(0x5611e03b4c90 msgr2=0x5611e03b2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:20.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.315+0000 7f0185f40800 1 -- 172.21.15.102:0/629903657 shutdown_connections 2024-09-13T19:16:20.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.315+0000 7f0185f40800 1 -- 172.21.15.102:0/629903657 wait complete. 2024-09-13T19:16:20.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.316+0000 7f0185f40800 1 Processor -- start 2024-09-13T19:16:20.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.316+0000 7f0185f40800 1 -- start start 2024-09-13T19:16:20.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.316+0000 7f0185f40800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611e03b89f0 0x5611e029ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.316+0000 7f0185f40800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5611e03b9990 con 0x5611e03b89f0 2024-09-13T19:16:20.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.316+0000 7f01824cb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611e03b89f0 0x5611e029ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.316+0000 7f01824cb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611e03b89f0 0x5611e029ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55842/0 (socket says 172.21.15.102:55842) 2024-09-13T19:16:20.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.316+0000 7f01824cb640 1 -- 172.21.15.102:0/259502329 learned_addr learned my addr 172.21.15.102:0/259502329 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:20.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.316+0000 7f01824cb640 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611e0299270 con 0x5611e03b89f0 2024-09-13T19:16:20.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.317+0000 7f01824cb640 1 --2- 172.21.15.102:0/259502329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611e03b89f0 0x5611e029ab80 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f0174005340 tx=0x7f017404c550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.317+0000 7f00537fe640 1 -- 172.21.15.102:0/259502329 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0174045070 con 0x5611e03b89f0 2024-09-13T19:16:20.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.317+0000 7f00537fe640 1 -- 172.21.15.102:0/259502329 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f017403fe50 con 0x5611e03b89f0 2024-09-13T19:16:20.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.317+0000 7f0185f40800 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5611e0299500 con 0x5611e03b89f0 2024-09-13T19:16:20.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.317+0000 7f00537fe640 1 -- 172.21.15.102:0/259502329 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f017403f030 con 0x5611e03b89f0 2024-09-13T19:16:20.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.317+0000 7f0185f40800 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611e0299a00 con 0x5611e03b89f0 2024-09-13T19:16:20.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.318+0000 7f00537fe640 1 -- 172.21.15.102:0/259502329 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0174016040 con 0x5611e03b89f0 2024-09-13T19:16:20.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.318+0000 7f00537fe640 1 --2- 172.21.15.102:0/259502329 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f004c036af0 0x7f004c038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.318+0000 7f00537fe640 1 -- 172.21.15.102:0/259502329 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f017404fd10 con 0x5611e03b89f0 2024-09-13T19:16:20.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.318+0000 7f0181cca640 1 --2- 172.21.15.102:0/259502329 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f004c036af0 0x7f004c038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.318+0000 7f0185f40800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.318+0000 7f0185f40800 1 --2- 172.21.15.102:0/259502329 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5611e03cda90 0x5611e03cff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.318+0000 7f0185f40800 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5611e03d06a0 con 0x5611e03cda90 2024-09-13T19:16:20.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.318+0000 7f01814c9640 1 --2- 172.21.15.102:0/259502329 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5611e03cda90 0x5611e03cff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.318+0000 7f0181cca640 1 --2- 172.21.15.102:0/259502329 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f004c036af0 0x7f004c038fb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f017c07efb0 tx=0x7f017c097000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.319+0000 7f01814c9640 1 --2- 172.21.15.102:0/259502329 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5611e03cda90 0x5611e03cff50 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.319+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f016c00f5f0 con 0x5611e03cda90 2024-09-13T19:16:20.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.319+0000 7f0185f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:20.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.319+0000 7f0185f40800 20 realm 2024-09-13T19:16:20.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.319+0000 7f0185f40800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.319+0000 7f0185f40800 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5611e03ccee0 con 0x5611e03cda90 2024-09-13T19:16:20.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.319+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f016c00f5f0 con 0x5611e03cda90 2024-09-13T19:16:20.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.319+0000 7f0185f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:20.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.319+0000 7f0185f40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:20.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.319+0000 7f0185f40800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.319+0000 7f0185f40800 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5611e03d1180 con 0x5611e03cda90 2024-09-13T19:16:20.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.319+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f016c00f5f0 con 0x5611e03cda90 2024-09-13T19:16:20.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.319+0000 7f0185f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:20.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.319+0000 7f0185f40800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.319+0000 7f0185f40800 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5611e03d1a50 con 0x5611e03cda90 2024-09-13T19:16:20.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.320+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f016c00f5f0 con 0x5611e03cda90 2024-09-13T19:16:20.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.320+0000 7f0185f40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:20.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.320+0000 7f0185f40800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.320+0000 7f0185f40800 1 --2- 172.21.15.102:0/259502329 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5611e03d2390 0x5611e03d47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.320+0000 7f0185f40800 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5611e03d4f00 con 0x5611e03d2390 2024-09-13T19:16:20.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.320+0000 7f01824cb640 1 --2- 172.21.15.102:0/259502329 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5611e03d2390 0x5611e03d47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.320+0000 7f01824cb640 1 --2- 172.21.15.102:0/259502329 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5611e03d2390 0x5611e03d47a0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.320+0000 7f01824cb640 1 -- 172.21.15.102:0/259502329 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0174033020 con 0x5611e03d2390 2024-09-13T19:16:20.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.320+0000 7f0185f40800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:20.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.320+0000 7f0185f40800 20 searching for the correct realm 2024-09-13T19:16:20.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.320+0000 7f0185f40800 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611e03d68e0 con 0x5611e03d2390 2024-09-13T19:16:20.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.320+0000 7f01824cb640 1 -- 172.21.15.102:0/259502329 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0174033020 con 0x5611e03d2390 2024-09-13T19:16:20.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.320+0000 7f01824cb640 1 --2- 172.21.15.102:0/259502329 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f0174036020 0x7f01740176e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.320+0000 7f01824cb640 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611e03d68e0 con 0x7f0174036020 2024-09-13T19:16:20.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.321+0000 7f0181cca640 1 --2- 172.21.15.102:0/259502329 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f0174036020 0x7f01740176e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.321+0000 7f0181cca640 1 --2- 172.21.15.102:0/259502329 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f0174036020 0x7f01740176e0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.321+0000 7f0181cca640 1 -- 172.21.15.102:0/259502329 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f017c096070 con 0x7f0174036020 2024-09-13T19:16:20.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.321+0000 7f0181cca640 1 --2- 172.21.15.102:0/259502329 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f017c088bf0 0x7f017c090300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.321+0000 7f0181cca640 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611e03d68e0 con 0x7f017c088bf0 2024-09-13T19:16:20.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.321+0000 7f01814c9640 1 --2- 172.21.15.102:0/259502329 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f017c088bf0 0x7f017c090300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.322+0000 7f01814c9640 1 --2- 172.21.15.102:0/259502329 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f017c088bf0 0x7f017c090300 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.322+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f016c00f5f0 con 0x7f017c088bf0 2024-09-13T19:16:20.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.322+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611e03d68e0 con 0x5611e03cda90 2024-09-13T19:16:20.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.322+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f016c00f5f0 con 0x5611e03cda90 2024-09-13T19:16:20.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.322+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611e03d68e0 con 0x5611e03cda90 2024-09-13T19:16:20.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.322+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f016c02b040 con 0x5611e03cda90 2024-09-13T19:16:20.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.322+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611e03d68e0 con 0x7f017c088bf0 2024-09-13T19:16:20.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.323+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f016c02b040 con 0x7f017c088bf0 2024-09-13T19:16:20.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.323+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611e03d68e0 con 0x7f017c088bf0 2024-09-13T19:16:20.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.323+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f016c02b040 con 0x7f017c088bf0 2024-09-13T19:16:20.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.323+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611e03d68e0 con 0x7f0174036020 2024-09-13T19:16:20.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.323+0000 7f0181cca640 1 -- 172.21.15.102:0/259502329 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f017c096070 con 0x7f0174036020 2024-09-13T19:16:20.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.323+0000 7f0181cca640 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611e03d68e0 con 0x5611e03d2390 2024-09-13T19:16:20.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.323+0000 7f01824cb640 1 -- 172.21.15.102:0/259502329 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0174033020 con 0x5611e03d2390 2024-09-13T19:16:20.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.323+0000 7f01824cb640 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611e03d68e0 con 0x5611e03cda90 2024-09-13T19:16:20.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.324+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f016c02b040 con 0x5611e03cda90 2024-09-13T19:16:20.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.324+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611e03d68e0 con 0x7f017c088bf0 2024-09-13T19:16:20.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.324+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f016c02b040 con 0x7f017c088bf0 2024-09-13T19:16:20.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.324+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611e03d68e0 con 0x5611e03cda90 2024-09-13T19:16:20.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.324+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f016c02b040 con 0x5611e03cda90 2024-09-13T19:16:20.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.324+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611e03d68e0 con 0x7f0174036020 2024-09-13T19:16:20.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.324+0000 7f0181cca640 1 -- 172.21.15.102:0/259502329 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f017c096070 con 0x7f0174036020 2024-09-13T19:16:20.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.324+0000 7f0181cca640 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611e03d68e0 con 0x5611e03d2390 2024-09-13T19:16:20.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.324+0000 7f01824cb640 1 -- 172.21.15.102:0/259502329 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0174033020 con 0x5611e03d2390 2024-09-13T19:16:20.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.325+0000 7f01824cb640 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611e03d68e0 con 0x5611e03d2390 2024-09-13T19:16:20.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.325+0000 7f01824cb640 1 -- 172.21.15.102:0/259502329 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0174033020 con 0x5611e03d2390 2024-09-13T19:16:20.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.325+0000 7f01824cb640 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611e03d68e0 con 0x7f017c088bf0 2024-09-13T19:16:20.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.325+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f016c02b040 con 0x7f017c088bf0 2024-09-13T19:16:20.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.325+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611e03d68e0 con 0x5611e03d2390 2024-09-13T19:16:20.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.325+0000 7f01824cb640 1 -- 172.21.15.102:0/259502329 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0174033020 con 0x5611e03d2390 2024-09-13T19:16:20.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.325+0000 7f01824cb640 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611e03d68e0 con 0x5611e03d2390 2024-09-13T19:16:20.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.325+0000 7f01824cb640 1 -- 172.21.15.102:0/259502329 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0174033020 con 0x5611e03d2390 2024-09-13T19:16:20.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.325+0000 7f01824cb640 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611e03d68e0 con 0x5611e03cda90 2024-09-13T19:16:20.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.326+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f016c02b040 con 0x5611e03cda90 2024-09-13T19:16:20.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.326+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611e03d68e0 con 0x5611e03cda90 2024-09-13T19:16:20.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.326+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f016c02b040 con 0x5611e03cda90 2024-09-13T19:16:20.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.326+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611e03d68e0 con 0x7f017c088bf0 2024-09-13T19:16:20.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.326+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f016c02b040 con 0x7f017c088bf0 2024-09-13T19:16:20.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.326+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611e03d68e0 con 0x5611e03d2390 2024-09-13T19:16:20.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.326+0000 7f01824cb640 1 -- 172.21.15.102:0/259502329 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0174033020 con 0x5611e03d2390 2024-09-13T19:16:20.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.326+0000 7f01824cb640 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611e03d68e0 con 0x7f0174036020 2024-09-13T19:16:20.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.327+0000 7f0181cca640 1 -- 172.21.15.102:0/259502329 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f017c096070 con 0x7f0174036020 2024-09-13T19:16:20.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.327+0000 7f0181cca640 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611e03d68e0 con 0x5611e03cda90 2024-09-13T19:16:20.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.327+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f016c02b040 con 0x5611e03cda90 2024-09-13T19:16:20.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.327+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611e03d68e0 con 0x7f017c088bf0 2024-09-13T19:16:20.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.327+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f016c03b040 con 0x7f017c088bf0 2024-09-13T19:16:20.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.327+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611e03d68e0 con 0x5611e03d2390 2024-09-13T19:16:20.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.327+0000 7f01824cb640 1 -- 172.21.15.102:0/259502329 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0174033020 con 0x5611e03d2390 2024-09-13T19:16:20.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.327+0000 7f01824cb640 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611e03d68e0 con 0x7f017c088bf0 2024-09-13T19:16:20.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.328+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f016c03b040 con 0x7f017c088bf0 2024-09-13T19:16:20.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.328+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611e03d68e0 con 0x7f0174036020 2024-09-13T19:16:20.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.328+0000 7f0181cca640 1 -- 172.21.15.102:0/259502329 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f017c096070 con 0x7f0174036020 2024-09-13T19:16:20.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.328+0000 7f0181cca640 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611e03d68e0 con 0x5611e03d2390 2024-09-13T19:16:20.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.328+0000 7f01824cb640 1 -- 172.21.15.102:0/259502329 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0174033020 con 0x5611e03d2390 2024-09-13T19:16:20.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.328+0000 7f01824cb640 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611e03d68e0 con 0x7f017c088bf0 2024-09-13T19:16:20.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.328+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f016c03b040 con 0x7f017c088bf0 2024-09-13T19:16:20.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.328+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611e03d68e0 con 0x5611e03cda90 2024-09-13T19:16:20.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.329+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f016c03b040 con 0x5611e03cda90 2024-09-13T19:16:20.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.329+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5611e03d68e0 con 0x7f0174036020 2024-09-13T19:16:20.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.329+0000 7f0181cca640 1 -- 172.21.15.102:0/259502329 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f017c096070 con 0x7f0174036020 2024-09-13T19:16:20.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.329+0000 7f0185f40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:20.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.329+0000 7f0185f40800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:20.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.329+0000 7f0185f40800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:20.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.329+0000 7f0185f40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:20.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.329+0000 7f0185f40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:20.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.329+0000 7f0185f40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:20.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.329+0000 7f0185f40800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.329+0000 7f0185f40800 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5611e03d59b0 con 0x5611e03cda90 2024-09-13T19:16:20.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.329+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f016c03b040 con 0x5611e03cda90 2024-09-13T19:16:20.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.329+0000 7f0185f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:20.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.329+0000 7f0185f40800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.329+0000 7f0185f40800 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5611e03d55f0 con 0x5611e03cda90 2024-09-13T19:16:20.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.329+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f016c03b040 con 0x5611e03cda90 2024-09-13T19:16:20.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.329+0000 7f0185f40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:20.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.329+0000 7f0185f40800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.329+0000 7f0185f40800 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5611e03d6310 con 0x5611e03d2390 2024-09-13T19:16:20.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.330+0000 7f01824cb640 1 -- 172.21.15.102:0/259502329 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0174033020 con 0x5611e03d2390 2024-09-13T19:16:20.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.330+0000 7f0185f40800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:20.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.330+0000 7f0185f40800 20 zone default found 2024-09-13T19:16:20.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.330+0000 7f0185f40800 4 Realm: () 2024-09-13T19:16:20.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.330+0000 7f0185f40800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:20.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.330+0000 7f0185f40800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:20.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.330+0000 7f0185f40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:20.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.330+0000 7f0185f40800 20 zonegroup default 2024-09-13T19:16:20.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.330+0000 7f0185f40800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.330+0000 7f0185f40800 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5611e03d7260 con 0x7f017c088bf0 2024-09-13T19:16:20.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.330+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f016c03b040 con 0x7f017c088bf0 2024-09-13T19:16:20.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.330+0000 7f0185f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:20.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.330+0000 7f0185f40800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.330+0000 7f0185f40800 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5611e03d8ca0 con 0x5611e03d2390 2024-09-13T19:16:20.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.330+0000 7f01824cb640 1 -- 172.21.15.102:0/259502329 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0174033020 con 0x5611e03d2390 2024-09-13T19:16:20.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.330+0000 7f0185f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:20.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.330+0000 7f0185f40800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.330+0000 7f0185f40800 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5611e03d90e0 con 0x5611e03d2390 2024-09-13T19:16:20.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.331+0000 7f01824cb640 1 -- 172.21.15.102:0/259502329 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0174033020 con 0x5611e03d2390 2024-09-13T19:16:20.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.331+0000 7f0185f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:20.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.331+0000 7f0185f40800 20 started sync module instance, tier type = 2024-09-13T19:16:20.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.331+0000 7f0185f40800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:20.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.331+0000 7f0185f40800 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611e03d8080 con 0x7f0174036020 2024-09-13T19:16:20.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.332+0000 7f0181cca640 1 -- 172.21.15.102:0/259502329 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(44 notify.0 [create] v34'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f017c096070 con 0x7f0174036020 2024-09-13T19:16:20.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.332+0000 7f0185f40800 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94634776558544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611e03d9570 con 0x7f0174036020 2024-09-13T19:16:20.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.332+0000 7f0185f40800 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611e03d9dc0 con 0x5611e03cda90 2024-09-13T19:16:20.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.333+0000 7f0181cca640 1 -- 172.21.15.102:0/259502329 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94634776558544] v34'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f017c096070 con 0x7f0174036020 2024-09-13T19:16:20.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.333+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v34'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f016c03b040 con 0x5611e03cda90 2024-09-13T19:16:20.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.333+0000 7f0185f40800 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94634776566032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611e03da1e0 con 0x5611e03cda90 2024-09-13T19:16:20.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.333+0000 7f0185f40800 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611e03daa30 con 0x5611e03d2390 2024-09-13T19:16:20.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.334+0000 7f01824cb640 1 -- 172.21.15.102:0/259502329 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v34'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0174033020 con 0x5611e03d2390 2024-09-13T19:16:20.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.334+0000 7f0185f40800 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94634776568768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611e03daeb0 con 0x5611e03d2390 2024-09-13T19:16:20.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.334+0000 7f0185f40800 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611e03db9d0 con 0x7f0174036020 2024-09-13T19:16:20.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.334+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94634776566032] v34'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f016c03b040 con 0x5611e03cda90 2024-09-13T19:16:20.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.335+0000 7f0181cca640 1 -- 172.21.15.102:0/259502329 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(50 notify.3 [create] v34'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f017c096070 con 0x7f0174036020 2024-09-13T19:16:20.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.335+0000 7f01824cb640 1 -- 172.21.15.102:0/259502329 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94634776568768] v34'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0174033020 con 0x5611e03d2390 2024-09-13T19:16:20.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.335+0000 7f0185f40800 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94634776573088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611e03d9d30 con 0x7f0174036020 2024-09-13T19:16:20.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.335+0000 7f0185f40800 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611e03dc2d0 con 0x5611e03cda90 2024-09-13T19:16:20.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.336+0000 7f0181cca640 1 -- 172.21.15.102:0/259502329 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94634776573088] v34'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f017c096070 con 0x7f0174036020 2024-09-13T19:16:20.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.336+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v34'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f016c03b040 con 0x5611e03cda90 2024-09-13T19:16:20.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.337+0000 7f0185f40800 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94634776575424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611e03dc6c0 con 0x5611e03cda90 2024-09-13T19:16:20.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.337+0000 7f0185f40800 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611e03dd0e0 con 0x7f017c088bf0 2024-09-13T19:16:20.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.337+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94634776575424] v34'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f016c03b040 con 0x5611e03cda90 2024-09-13T19:16:20.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.338+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(54 notify.5 [create] v34'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f016c03b040 con 0x7f017c088bf0 2024-09-13T19:16:20.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.338+0000 7f0185f40800 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94634776579024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611e03dd0a0 con 0x7f017c088bf0 2024-09-13T19:16:20.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.338+0000 7f0185f40800 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611e03ddb10 con 0x7f017c088bf0 2024-09-13T19:16:20.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.339+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94634776579024] v34'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f016c03b040 con 0x7f017c088bf0 2024-09-13T19:16:20.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.339+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(56 notify.6 [create] v34'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f016c03b040 con 0x7f017c088bf0 2024-09-13T19:16:20.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.339+0000 7f0185f40800 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94634776581696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611e03ddb10 con 0x7f017c088bf0 2024-09-13T19:16:20.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.339+0000 7f0185f40800 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611e03de4d0 con 0x7f017c088bf0 2024-09-13T19:16:20.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.340+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(58 notify.7 [create] v34'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f016c03b040 con 0x7f017c088bf0 2024-09-13T19:16:20.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.340+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94634776581696] v34'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f016c03b040 con 0x7f017c088bf0 2024-09-13T19:16:20.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.340+0000 7f0185f40800 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94634776584224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611e03de440 con 0x7f017c088bf0 2024-09-13T19:16:20.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.340+0000 7f0185f40800 20 add_watcher() i=0 2024-09-13T19:16:20.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.340+0000 7f0185f40800 20 add_watcher() i=1 2024-09-13T19:16:20.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.340+0000 7f0185f40800 20 add_watcher() i=2 2024-09-13T19:16:20.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.340+0000 7f0185f40800 20 add_watcher() i=3 2024-09-13T19:16:20.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.340+0000 7f0185f40800 20 add_watcher() i=4 2024-09-13T19:16:20.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.340+0000 7f0185f40800 20 add_watcher() i=5 2024-09-13T19:16:20.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.340+0000 7f0185f40800 20 add_watcher() i=6 2024-09-13T19:16:20.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.341+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94634776584224] v34'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f016c03b040 con 0x7f017c088bf0 2024-09-13T19:16:20.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.341+0000 7f0185f40800 20 add_watcher() i=7 2024-09-13T19:16:20.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.341+0000 7f0185f40800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:20.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.341+0000 7f0185f40800 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5611e03e1900 con 0x5611e03cda90 2024-09-13T19:16:20.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.341+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f016c03b040 con 0x5611e03cda90 2024-09-13T19:16:20.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.341+0000 7f0185f40800 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94634776570112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611e03dee20 con 0x5611e03cda90 2024-09-13T19:16:20.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.342+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94634776570112] v34'130 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f016c03b040 con 0x5611e03cda90 2024-09-13T19:16:20.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.342+0000 7f00337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:20.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.342+0000 7f0185f40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:20.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.342+0000 7f0185f40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:20.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.342+0000 7f0185f40800 5 note: GC not initialized 2024-09-13T19:16:20.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.343+0000 7f00327fc640 20 reqs_thread_entry: start 2024-09-13T19:16:20.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.343+0000 7f0185f40800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:20.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.343+0000 7f0185f40800 20 Filter name: none 2024-09-13T19:16:20.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.343+0000 7effa3fff640 20 reqs_thread_entry: start 2024-09-13T19:16:20.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.343+0000 7f0185f40800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.343+0000 7f0185f40800 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5611e04147b0 con 0x5611e03cda90 2024-09-13T19:16:20.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.343+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 281+0+332 (crc 0 0 0) 0x7f016c03b040 con 0x5611e03cda90 2024-09-13T19:16:20.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.343+0000 7f0185f40800 20 rados_obj.operate() r=0 bl.length=193 2024-09-13T19:16:20.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.344+0000 7f00337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:20.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.344+0000 7f0185f40800 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94634776570112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611e0412650 con 0x5611e03cda90 2024-09-13T19:16:20.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.345+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94634776570112] v34'131 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f016c03b040 con 0x5611e03cda90 2024-09-13T19:16:20.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.345+0000 7f0185f40800 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94634776558544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611e0412650 con 0x7f0174036020 2024-09-13T19:16:20.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.346+0000 7f0181cca640 1 -- 172.21.15.102:0/259502329 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94634776558544] v34'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f017c096070 con 0x7f0174036020 2024-09-13T19:16:20.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.346+0000 7f0185f40800 20 remove_watcher() i=0 2024-09-13T19:16:20.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.346+0000 7f0185f40800 2 removed watcher, disabling cache 2024-09-13T19:16:20.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.346+0000 7f0185f40800 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94634776566032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611e0412650 con 0x5611e03cda90 2024-09-13T19:16:20.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.347+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94634776566032] v34'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f016c03b040 con 0x5611e03cda90 2024-09-13T19:16:20.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.347+0000 7f0185f40800 20 remove_watcher() i=1 2024-09-13T19:16:20.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.347+0000 7f0185f40800 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94634776568768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611e0412650 con 0x5611e03d2390 2024-09-13T19:16:20.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.348+0000 7f01824cb640 1 -- 172.21.15.102:0/259502329 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94634776568768] v34'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0174033020 con 0x5611e03d2390 2024-09-13T19:16:20.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.348+0000 7f0185f40800 20 remove_watcher() i=2 2024-09-13T19:16:20.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.348+0000 7f0185f40800 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94634776573088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611e0412650 con 0x7f0174036020 2024-09-13T19:16:20.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.349+0000 7f0181cca640 1 -- 172.21.15.102:0/259502329 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94634776573088] v34'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f017c096070 con 0x7f0174036020 2024-09-13T19:16:20.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.349+0000 7f0185f40800 20 remove_watcher() i=3 2024-09-13T19:16:20.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.349+0000 7f0185f40800 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94634776575424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611e0412650 con 0x5611e03cda90 2024-09-13T19:16:20.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.350+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94634776575424] v34'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f016c03b040 con 0x5611e03cda90 2024-09-13T19:16:20.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.350+0000 7f0185f40800 20 remove_watcher() i=4 2024-09-13T19:16:20.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.350+0000 7f0185f40800 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94634776579024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611e0412650 con 0x7f017c088bf0 2024-09-13T19:16:20.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.351+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94634776579024] v34'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f016c03b040 con 0x7f017c088bf0 2024-09-13T19:16:20.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.351+0000 7f0185f40800 20 remove_watcher() i=5 2024-09-13T19:16:20.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.351+0000 7f0185f40800 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94634776581696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611e0412650 con 0x7f017c088bf0 2024-09-13T19:16:20.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.352+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94634776581696] v34'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f016c03b040 con 0x7f017c088bf0 2024-09-13T19:16:20.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.352+0000 7f0185f40800 20 remove_watcher() i=6 2024-09-13T19:16:20.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.352+0000 7f0185f40800 1 -- 172.21.15.102:0/259502329 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94634776584224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5611e0412650 con 0x7f017c088bf0 2024-09-13T19:16:20.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.353+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94634776584224] v34'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f016c03b040 con 0x7f017c088bf0 2024-09-13T19:16:20.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.353+0000 7f0185f40800 20 remove_watcher() i=7 2024-09-13T19:16:20.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.353+0000 7f0185f40800 1 -- 172.21.15.102:0/259502329 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f017c088bf0 msgr2=0x7f017c090300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.353+0000 7f0185f40800 1 --2- 172.21.15.102:0/259502329 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f017c088bf0 0x7f017c090300 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.353+0000 7f0185f40800 1 -- 172.21.15.102:0/259502329 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5611e03cda90 msgr2=0x5611e03cff50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.353+0000 7f0185f40800 1 --2- 172.21.15.102:0/259502329 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5611e03cda90 0x5611e03cff50 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.353+0000 7f0185f40800 1 -- 172.21.15.102:0/259502329 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f0174036020 msgr2=0x7f01740176e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.353+0000 7f0185f40800 1 --2- 172.21.15.102:0/259502329 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f0174036020 0x7f01740176e0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.353+0000 7f0185f40800 1 -- 172.21.15.102:0/259502329 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5611e03d2390 msgr2=0x5611e03d47a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.353+0000 7f0185f40800 1 --2- 172.21.15.102:0/259502329 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5611e03d2390 0x5611e03d47a0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.353+0000 7f0185f40800 1 -- 172.21.15.102:0/259502329 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f004c036af0 msgr2=0x7f004c038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.353+0000 7f0185f40800 1 --2- 172.21.15.102:0/259502329 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f004c036af0 0x7f004c038fb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f017c07efb0 tx=0x7f017c097000 comp rx=0 tx=0).stop 2024-09-13T19:16:20.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.353+0000 7f0185f40800 1 -- 172.21.15.102:0/259502329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611e03b89f0 msgr2=0x5611e029ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.353+0000 7f01814c9640 1 -- 172.21.15.102:0/259502329 reap_dead start 2024-09-13T19:16:20.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.353+0000 7f0185f40800 1 --2- 172.21.15.102:0/259502329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611e03b89f0 0x5611e029ab80 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f0174005340 tx=0x7f017404c550 comp rx=0 tx=0).stop 2024-09-13T19:16:20.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.353+0000 7f0185f40800 1 -- 172.21.15.102:0/259502329 shutdown_connections 2024-09-13T19:16:20.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.353+0000 7f0185f40800 1 --2- 172.21.15.102:0/259502329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611e03b89f0 0x5611e029ab80 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.353+0000 7f0185f40800 1 -- 172.21.15.102:0/259502329 >> 172.21.15.102:0/259502329 conn(0x5611e03b4c90 msgr2=0x5611e03b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:20.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.353+0000 7f0185f40800 1 -- 172.21.15.102:0/259502329 shutdown_connections 2024-09-13T19:16:20.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.353+0000 7f0185f40800 1 -- 172.21.15.102:0/259502329 wait complete. 2024-09-13T19:16:20.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.354+0000 7f0185f40800 1 -- 172.21.15.102:0/3218931981 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f005c036b90 msgr2=0x7f005c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.354+0000 7f0185f40800 1 --2- 172.21.15.102:0/3218931981 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f005c036b90 0x7f005c039050 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f017c073950 tx=0x7f017c059f90 comp rx=0 tx=0).stop 2024-09-13T19:16:20.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.354+0000 7f0185f40800 1 -- 172.21.15.102:0/3218931981 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611e03abd30 msgr2=0x5611e03ac150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.354+0000 7f0185f40800 1 --2- 172.21.15.102:0/3218931981 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611e03abd30 0x5611e03ac150 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x5611e0391ea0 tx=0x7f017400beb0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.354+0000 7f0185f40800 1 -- 172.21.15.102:0/3218931981 shutdown_connections 2024-09-13T19:16:20.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.354+0000 7f0185f40800 1 --2- 172.21.15.102:0/3218931981 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f005c036b90 0x7f005c039050 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.354+0000 7f0185f40800 1 --2- 172.21.15.102:0/3218931981 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611e03abd30 0x5611e03ac150 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.354+0000 7f0185f40800 1 -- 172.21.15.102:0/3218931981 >> 172.21.15.102:0/3218931981 conn(0x5611e03a0cc0 msgr2=0x5611e03a3840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:20.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.354+0000 7f0185f40800 1 -- 172.21.15.102:0/3218931981 shutdown_connections 2024-09-13T19:16:20.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.354+0000 7f0185f40800 1 -- 172.21.15.102:0/3218931981 wait complete. 2024-09-13T19:16:20.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.354+0000 7f0185f40800 1 -- 172.21.15.102:0/658395749 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5611e029d790 msgr2=0x5611e0397f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.354+0000 7f0185f40800 1 --2- 172.21.15.102:0/658395749 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5611e029d790 0x5611e0397f30 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.354+0000 7f0185f40800 1 -- 172.21.15.102:0/658395749 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5611e039a860 msgr2=0x5611e039cc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.354+0000 7f0185f40800 1 --2- 172.21.15.102:0/658395749 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5611e039a860 0x5611e039cc50 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.354+0000 7f0185f40800 1 -- 172.21.15.102:0/658395749 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0068036b90 msgr2=0x7f0068039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.354+0000 7f0185f40800 1 --2- 172.21.15.102:0/658395749 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0068036b90 0x7f0068039050 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f016c000c00 tx=0x7f016c0013b0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.354+0000 7f0185f40800 1 -- 172.21.15.102:0/658395749 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611e020e630 msgr2=0x5611e0391080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.354+0000 7f0185f40800 1 --2- 172.21.15.102:0/658395749 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611e020e630 0x5611e0391080 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f017c00a3f0 tx=0x7f017c003330 comp rx=0 tx=0).stop 2024-09-13T19:16:20.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.354+0000 7f0185f40800 1 -- 172.21.15.102:0/658395749 shutdown_connections 2024-09-13T19:16:20.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.354+0000 7f0185f40800 1 --2- 172.21.15.102:0/658395749 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5611e039a860 0x5611e039cc50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.354+0000 7f0185f40800 1 --2- 172.21.15.102:0/658395749 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5611e029d790 0x5611e0397f30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.354+0000 7f0185f40800 1 --2- 172.21.15.102:0/658395749 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0068036b90 0x7f0068039050 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.354+0000 7f0185f40800 1 --2- 172.21.15.102:0/658395749 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5611e020e630 0x5611e0391080 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.354+0000 7f0185f40800 1 -- 172.21.15.102:0/658395749 >> 172.21.15.102:0/658395749 conn(0x5611e0294de0 msgr2=0x5611e03838f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:20.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.354+0000 7f0185f40800 1 -- 172.21.15.102:0/658395749 shutdown_connections 2024-09-13T19:16:20.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.354+0000 7f0185f40800 1 -- 172.21.15.102:0/658395749 wait complete. 2024-09-13T19:16:20.392 INFO:teuthology.orchestra.run.smithi102.stdout:{"key":"bucket:testx/myfoo","ver":{"tag":"ZWMAdTKxPy3HT3NentxKLBDr","ver":2},"mtime":"2024-09-13T19:16:20.185489Z","data":{"bucket":{"name":"myfoo","marker":"509740b4-c081-4f37-bd6d-df9ca851489b.4237.1","bucket_id":"509740b4-c081-4f37-bd6d-df9ca851489b.4237.1","tenant":"testx","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"testx$tenanteduser","creation_time":"2024-09-13T19:16:17.492008Z","linked":true,"has_bucket_info":false}} 2024-09-13T19:16:20.393 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': 'ZWMAdTKxPy3HT3NentxKLBDr', 'ver': 2}, 'mtime': '2024-09-13T19:16:20.185489Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '509740b4-c081-4f37-bd6d-df9ca851489b.4237.1', 'bucket_id': '509740b4-c081-4f37-bd6d-df9ca851489b.4237.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2024-09-13T19:16:17.492008Z', 'linked': True, 'has_bucket_info': False}} 2024-09-13T19:16:20.393 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-13T19:16:20.393 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-13T19:16:20.393 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2024-09-13T19:16:20.480 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:20.481 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:20.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.478+0000 7f37329af800 1 Processor -- start 2024-09-13T19:16:20.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.478+0000 7f37329af800 1 -- start start 2024-09-13T19:16:20.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.478+0000 7f37329af800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x557d61516d40 0x557d61519130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.478+0000 7f37329af800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557d613cfb30 con 0x557d61484610 2024-09-13T19:16:20.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.478+0000 7f37329af800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x557d613b1360 con 0x557d61516d40 2024-09-13T19:16:20.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.479+0000 7f3727fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x557d61516d40 0x557d61519130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.479+0000 7f37304a3640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x557d61484610 0x557d61515620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:50060/0 (socket says 172.21.15.102:50060) 2024-09-13T19:16:20.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.479+0000 7f3727fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x557d61516d40 0x557d61519130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55856/0 (socket says 172.21.15.102:55856) 2024-09-13T19:16:20.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.479+0000 7f37304a3640 1 -- 172.21.15.102:0/357123713 learned_addr learned my addr 172.21.15.102:0/357123713 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:16:20.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.479+0000 7f3727fff640 1 -- 172.21.15.102:0/357123713 >> v1:172.21.15.53:6789/0 conn(0x557d61484610 legacy=0x557d61515620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.479+0000 7f372fca2640 1 -- 172.21.15.102:0/357123713 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1333997602 0 0) 0x557d613cfb30 con 0x557d61484610 2024-09-13T19:16:20.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.479+0000 7f3727fff640 1 -- 172.21.15.102:0/357123713 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d613d7e00 con 0x557d61516d40 2024-09-13T19:16:20.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.481+0000 7f3727fff640 1 --2- 172.21.15.102:0/357123713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d61516d40 0x557d61519130 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f371800a470 tx=0x7f3718045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a09e52f9724f12f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.481+0000 7f372fca2640 1 -- 172.21.15.102:0/357123713 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3718053570 con 0x557d61516d40 2024-09-13T19:16:20.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.481+0000 7f372fca2640 1 -- 172.21.15.102:0/357123713 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3718058070 con 0x557d61516d40 2024-09-13T19:16:20.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.481+0000 7f372fca2640 1 -- 172.21.15.102:0/357123713 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3718053880 con 0x557d61516d40 2024-09-13T19:16:20.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.481+0000 7f37329af800 1 -- 172.21.15.102:0/357123713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d61516d40 msgr2=0x557d61519130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.481+0000 7f37329af800 1 --2- 172.21.15.102:0/357123713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d61516d40 0x557d61519130 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f371800a470 tx=0x7f3718045a20 comp rx=0 tx=0).stop 2024-09-13T19:16:20.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.481+0000 7f37329af800 1 -- 172.21.15.102:0/357123713 shutdown_connections 2024-09-13T19:16:20.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.481+0000 7f37329af800 1 --2- 172.21.15.102:0/357123713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d61516d40 0x557d61519130 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.481+0000 7f37329af800 1 -- 172.21.15.102:0/357123713 >> 172.21.15.102:0/357123713 conn(0x557d6150adb0 msgr2=0x557d6150d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:20.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.482+0000 7f37329af800 1 -- 172.21.15.102:0/357123713 shutdown_connections 2024-09-13T19:16:20.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.482+0000 7f37329af800 1 -- 172.21.15.102:0/357123713 wait complete. 2024-09-13T19:16:20.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.495+0000 7f37329af800 1 Processor -- start 2024-09-13T19:16:20.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.495+0000 7f37329af800 1 -- start start 2024-09-13T19:16:20.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.495+0000 7f37329af800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d61484610 0x557d61601810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.495+0000 7f37329af800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557d6145c360 con 0x557d61484610 2024-09-13T19:16:20.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.496+0000 7f37304a3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d61484610 0x557d61601810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.496+0000 7f37304a3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d61484610 0x557d61601810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55862/0 (socket says 172.21.15.102:55862) 2024-09-13T19:16:20.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.496+0000 7f37304a3640 1 -- 172.21.15.102:0/4108550752 learned_addr learned my addr 172.21.15.102:0/4108550752 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:20.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.496+0000 7f37304a3640 1 -- 172.21.15.102:0/4108550752 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d613a9bc0 con 0x557d61484610 2024-09-13T19:16:20.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.496+0000 7f37304a3640 1 --2- 172.21.15.102:0/4108550752 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d61484610 0x557d61601810 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f372000b240 tx=0x7f372000b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e43cdfa72011a9b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.496+0000 7f361e60c640 1 -- 172.21.15.102:0/4108550752 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3720008070 con 0x557d61484610 2024-09-13T19:16:20.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.496+0000 7f361e60c640 1 -- 172.21.15.102:0/4108550752 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f372000d500 con 0x557d61484610 2024-09-13T19:16:20.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.496+0000 7f361e60c640 1 -- 172.21.15.102:0/4108550752 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f372000d860 con 0x557d61484610 2024-09-13T19:16:20.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.497+0000 7f37329af800 1 -- 172.21.15.102:0/4108550752 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d61484610 msgr2=0x557d61601810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.497+0000 7f37329af800 1 --2- 172.21.15.102:0/4108550752 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d61484610 0x557d61601810 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f372000b240 tx=0x7f372000b700 comp rx=0 tx=0).stop 2024-09-13T19:16:20.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.497+0000 7f37329af800 1 -- 172.21.15.102:0/4108550752 shutdown_connections 2024-09-13T19:16:20.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.497+0000 7f37329af800 1 --2- 172.21.15.102:0/4108550752 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d61484610 0x557d61601810 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.497+0000 7f37329af800 1 -- 172.21.15.102:0/4108550752 >> 172.21.15.102:0/4108550752 conn(0x557d6150adb0 msgr2=0x557d615fd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:20.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.497+0000 7f37329af800 1 -- 172.21.15.102:0/4108550752 shutdown_connections 2024-09-13T19:16:20.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.497+0000 7f37329af800 1 -- 172.21.15.102:0/4108550752 wait complete. 2024-09-13T19:16:20.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.498+0000 7f37329af800 1 Processor -- start 2024-09-13T19:16:20.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.498+0000 7f37329af800 1 -- start start 2024-09-13T19:16:20.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.498+0000 7f37329af800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d61484610 0x557d61609290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.498+0000 7f37329af800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557d61519910 con 0x557d61484610 2024-09-13T19:16:20.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.498+0000 7f37304a3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d61484610 0x557d61609290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.498+0000 7f37304a3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d61484610 0x557d61609290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55876/0 (socket says 172.21.15.102:55876) 2024-09-13T19:16:20.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.498+0000 7f37304a3640 1 -- 172.21.15.102:0/1815044406 learned_addr learned my addr 172.21.15.102:0/1815044406 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:20.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.498+0000 7f37304a3640 1 -- 172.21.15.102:0/1815044406 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d613bdfe0 con 0x557d61484610 2024-09-13T19:16:20.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.498+0000 7f37304a3640 1 --2- 172.21.15.102:0/1815044406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d61484610 0x557d61609290 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x557d61602670 tx=0x7f3720000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.499+0000 7f361ce09640 1 -- 172.21.15.102:0/1815044406 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3720019870 con 0x557d61484610 2024-09-13T19:16:20.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.499+0000 7f361ce09640 1 -- 172.21.15.102:0/1815044406 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3720019a10 con 0x557d61484610 2024-09-13T19:16:20.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.499+0000 7f361ce09640 1 -- 172.21.15.102:0/1815044406 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3720019d30 con 0x557d61484610 2024-09-13T19:16:20.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.499+0000 7f37329af800 1 -- 172.21.15.102:0/1815044406 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d616097d0 con 0x557d61484610 2024-09-13T19:16:20.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.499+0000 7f37329af800 1 -- 172.21.15.102:0/1815044406 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d61609cf0 con 0x557d61484610 2024-09-13T19:16:20.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.499+0000 7f361ce09640 1 -- 172.21.15.102:0/1815044406 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3720017040 con 0x557d61484610 2024-09-13T19:16:20.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.500+0000 7f361ce09640 1 --2- 172.21.15.102:0/1815044406 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3618036b40 0x7f3618039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.500+0000 7f361ce09640 1 -- 172.21.15.102:0/1815044406 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f3720015020 con 0x557d61484610 2024-09-13T19:16:20.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.500+0000 7f3727fff640 1 --2- 172.21.15.102:0/1815044406 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3618036b40 0x7f3618039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.500+0000 7f37329af800 1 --2- 172.21.15.102:0/1815044406 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557d61516d40 0x557d61610300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.500+0000 7f37329af800 1 -- 172.21.15.102:0/1815044406 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d61610840 con 0x557d61516d40 2024-09-13T19:16:20.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.500+0000 7f3730ca4640 1 --2- 172.21.15.102:0/1815044406 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557d61516d40 0x557d61610300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.500+0000 7f3727fff640 1 --2- 172.21.15.102:0/1815044406 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3618036b40 0x7f3618039000 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3718057000 tx=0x7f3718052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.500+0000 7f3730ca4640 1 --2- 172.21.15.102:0/1815044406 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557d61516d40 0x557d61610300 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.500+0000 7f3730ca4640 1 -- 172.21.15.102:0/1815044406 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f372800a4a0 con 0x557d61516d40 2024-09-13T19:16:20.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.501+0000 7f37329af800 1 -- 172.21.15.102:0/1815044406 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d6160d8b0 con 0x557d61516d40 2024-09-13T19:16:20.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.501+0000 7f3730ca4640 1 -- 172.21.15.102:0/1815044406 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f372800a4a0 con 0x557d61516d40 2024-09-13T19:16:20.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.501+0000 7f37329af800 1 --2- 172.21.15.102:0/1815044406 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x557d61612b50 0x557d61614f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.501+0000 7f37329af800 1 -- 172.21.15.102:0/1815044406 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d616155e0 con 0x557d61612b50 2024-09-13T19:16:20.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.501+0000 7f37304a3640 1 --2- 172.21.15.102:0/1815044406 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x557d61612b50 0x557d61614f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.501+0000 7f37304a3640 1 --2- 172.21.15.102:0/1815044406 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x557d61612b50 0x557d61614f40 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.501+0000 7f37304a3640 1 -- 172.21.15.102:0/1815044406 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f372002d070 con 0x557d61612b50 2024-09-13T19:16:20.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.501+0000 7f37329af800 1 -- 172.21.15.102:0/1815044406 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d616119f0 con 0x557d61516d40 2024-09-13T19:16:20.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.502+0000 7f3730ca4640 1 -- 172.21.15.102:0/1815044406 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f372800a4a0 con 0x557d61516d40 2024-09-13T19:16:20.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.502+0000 7f37329af800 1 -- 172.21.15.102:0/1815044406 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d61611ed0 con 0x557d61612b50 2024-09-13T19:16:20.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.502+0000 7f37304a3640 1 -- 172.21.15.102:0/1815044406 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f372002d070 con 0x557d61612b50 2024-09-13T19:16:20.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.502+0000 7f37329af800 1 Processor -- start 2024-09-13T19:16:20.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.502+0000 7f37329af800 1 -- start start 2024-09-13T19:16:20.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.503+0000 7f37329af800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d61623f70 0x557d61624390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.503+0000 7f37329af800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557d613ab580 con 0x557d61623f70 2024-09-13T19:16:20.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.503+0000 7f3730ca4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d61623f70 0x557d61624390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.503+0000 7f3730ca4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d61623f70 0x557d61624390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55890/0 (socket says 172.21.15.102:55890) 2024-09-13T19:16:20.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.503+0000 7f3730ca4640 1 -- 172.21.15.102:0/1369814283 learned_addr learned my addr 172.21.15.102:0/1369814283 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:20.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.503+0000 7f3730ca4640 1 -- 172.21.15.102:0/1369814283 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d616248d0 con 0x557d61623f70 2024-09-13T19:16:20.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.503+0000 7f3730ca4640 1 --2- 172.21.15.102:0/1369814283 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d61623f70 0x557d61624390 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x557d6160a340 tx=0x7f37280167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.503+0000 7f3615ffb640 1 -- 172.21.15.102:0/1369814283 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3728013640 con 0x557d61623f70 2024-09-13T19:16:20.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.504+0000 7f3615ffb640 1 -- 172.21.15.102:0/1369814283 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37280137e0 con 0x557d61623f70 2024-09-13T19:16:20.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.504+0000 7f37329af800 1 -- 172.21.15.102:0/1369814283 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d61624b60 con 0x557d61623f70 2024-09-13T19:16:20.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.504+0000 7f3615ffb640 1 -- 172.21.15.102:0/1369814283 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3728013ae0 con 0x557d61623f70 2024-09-13T19:16:20.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.504+0000 7f37329af800 1 -- 172.21.15.102:0/1369814283 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d61627840 con 0x557d61623f70 2024-09-13T19:16:20.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.504+0000 7f3615ffb640 1 -- 172.21.15.102:0/1369814283 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3728011040 con 0x557d61623f70 2024-09-13T19:16:20.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.504+0000 7f3615ffb640 1 --2- 172.21.15.102:0/1369814283 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3608036b40 0x7f3608039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.505+0000 7f3615ffb640 1 -- 172.21.15.102:0/1369814283 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f372800e040 con 0x557d61623f70 2024-09-13T19:16:20.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.505+0000 7f37304a3640 1 --2- 172.21.15.102:0/1369814283 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3608036b40 0x7f3608039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.505+0000 7f37329af800 1 Processor -- start 2024-09-13T19:16:20.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.505+0000 7f37304a3640 1 --2- 172.21.15.102:0/1369814283 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3608036b40 0x7f3608039000 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x557d6160d7f0 tx=0x7f372004b670 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.505+0000 7f37329af800 1 -- start start 2024-09-13T19:16:20.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.505+0000 7f37329af800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d61630ca0 0x557d616310a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.505+0000 7f37329af800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557d61601fc0 con 0x557d61630ca0 2024-09-13T19:16:20.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.505+0000 7f3730ca4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d61630ca0 0x557d616310a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.505+0000 7f3730ca4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d61630ca0 0x557d616310a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55896/0 (socket says 172.21.15.102:55896) 2024-09-13T19:16:20.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.505+0000 7f3730ca4640 1 -- 172.21.15.102:0/2356906705 learned_addr learned my addr 172.21.15.102:0/2356906705 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:20.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.506+0000 7f3730ca4640 1 -- 172.21.15.102:0/2356906705 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d61631670 con 0x557d61630ca0 2024-09-13T19:16:20.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.506+0000 7f3730ca4640 1 --2- 172.21.15.102:0/2356906705 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d61630ca0 0x557d616310a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f372800afb0 tx=0x7f3728020f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba11a27ccf41bb2f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.506+0000 7f360f7fe640 1 -- 172.21.15.102:0/2356906705 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3728021ae0 con 0x557d61630ca0 2024-09-13T19:16:20.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.506+0000 7f360f7fe640 1 -- 172.21.15.102:0/2356906705 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f372804a030 con 0x557d61630ca0 2024-09-13T19:16:20.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.506+0000 7f360f7fe640 1 -- 172.21.15.102:0/2356906705 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f372801f470 con 0x557d61630ca0 2024-09-13T19:16:20.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.506+0000 7f37329af800 1 -- 172.21.15.102:0/2356906705 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d61630ca0 msgr2=0x557d616310a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.506+0000 7f37329af800 1 --2- 172.21.15.102:0/2356906705 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d61630ca0 0x557d616310a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f372800afb0 tx=0x7f3728020f10 comp rx=0 tx=0).stop 2024-09-13T19:16:20.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.506+0000 7f37329af800 1 -- 172.21.15.102:0/2356906705 shutdown_connections 2024-09-13T19:16:20.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.506+0000 7f37329af800 1 --2- 172.21.15.102:0/2356906705 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d61630ca0 0x557d616310a0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.506+0000 7f37329af800 1 -- 172.21.15.102:0/2356906705 >> 172.21.15.102:0/2356906705 conn(0x557d6162cfb0 msgr2=0x557d6162b100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:20.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.506+0000 7f37329af800 1 -- 172.21.15.102:0/2356906705 shutdown_connections 2024-09-13T19:16:20.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.506+0000 7f37329af800 1 -- 172.21.15.102:0/2356906705 wait complete. 2024-09-13T19:16:20.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.507+0000 7f37329af800 1 Processor -- start 2024-09-13T19:16:20.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.507+0000 7f37329af800 1 -- start start 2024-09-13T19:16:20.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.507+0000 7f37329af800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d61630ca0 0x557d616380c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.507+0000 7f37329af800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557d61631c80 con 0x557d61630ca0 2024-09-13T19:16:20.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.507+0000 7f3730ca4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d61630ca0 0x557d616380c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.507+0000 7f3730ca4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d61630ca0 0x557d616380c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55910/0 (socket says 172.21.15.102:55910) 2024-09-13T19:16:20.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.507+0000 7f3730ca4640 1 -- 172.21.15.102:0/3514753459 learned_addr learned my addr 172.21.15.102:0/3514753459 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:20.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.507+0000 7f3730ca4640 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d61638600 con 0x557d61630ca0 2024-09-13T19:16:20.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.508+0000 7f3730ca4640 1 --2- 172.21.15.102:0/3514753459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d61630ca0 0x557d616380c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f372804bca0 tx=0x7f372804cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.508+0000 7f360dffb640 1 -- 172.21.15.102:0/3514753459 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37280400e0 con 0x557d61630ca0 2024-09-13T19:16:20.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.508+0000 7f360dffb640 1 -- 172.21.15.102:0/3514753459 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f372803de50 con 0x557d61630ca0 2024-09-13T19:16:20.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.508+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d61638890 con 0x557d61630ca0 2024-09-13T19:16:20.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.508+0000 7f360dffb640 1 -- 172.21.15.102:0/3514753459 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3728040450 con 0x557d61630ca0 2024-09-13T19:16:20.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.508+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d61638890 con 0x557d61630ca0 2024-09-13T19:16:20.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.509+0000 7f360dffb640 1 -- 172.21.15.102:0/3514753459 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f372804e2a0 con 0x557d61630ca0 2024-09-13T19:16:20.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.509+0000 7f360dffb640 1 --2- 172.21.15.102:0/3514753459 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3600036b40 0x7f3600039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.509+0000 7f360dffb640 1 -- 172.21.15.102:0/3514753459 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f3728036c70 con 0x557d61630ca0 2024-09-13T19:16:20.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.509+0000 7f37304a3640 1 --2- 172.21.15.102:0/3514753459 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3600036b40 0x7f3600039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.509+0000 7f37304a3640 1 --2- 172.21.15.102:0/3514753459 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3600036b40 0x7f3600039000 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f372000ffd0 tx=0x7f3720033000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.509+0000 7f37329af800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.509+0000 7f37329af800 1 --2- 172.21.15.102:0/3514753459 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557d616439a0 0x557d61645e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.509+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d616465b0 con 0x557d616439a0 2024-09-13T19:16:20.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.510+0000 7f3727fff640 1 --2- 172.21.15.102:0/3514753459 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557d616439a0 0x557d61645e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.510+0000 7f3727fff640 1 --2- 172.21.15.102:0/3514753459 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557d616439a0 0x557d61645e60 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.510+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3718051070 con 0x557d616439a0 2024-09-13T19:16:20.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.510+0000 7f37329af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:20.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.510+0000 7f37329af800 20 realm 2024-09-13T19:16:20.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.510+0000 7f37329af800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.510+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d616469e0 con 0x557d616439a0 2024-09-13T19:16:20.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.510+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3718051070 con 0x557d616439a0 2024-09-13T19:16:20.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.510+0000 7f37329af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:20.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.510+0000 7f37329af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:20.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.510+0000 7f37329af800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.510+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d616472b0 con 0x557d616439a0 2024-09-13T19:16:20.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.511+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3718051070 con 0x557d616439a0 2024-09-13T19:16:20.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.511+0000 7f37329af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:20.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.511+0000 7f37329af800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.511+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d61647650 con 0x557d616439a0 2024-09-13T19:16:20.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.511+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3718051070 con 0x557d616439a0 2024-09-13T19:16:20.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.511+0000 7f37329af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:20.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.511+0000 7f37329af800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.511+0000 7f37329af800 1 --2- 172.21.15.102:0/3514753459 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x557d616483b0 0x557d6164a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.511+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d6164adb0 con 0x557d616483b0 2024-09-13T19:16:20.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.511+0000 7f3730ca4640 1 --2- 172.21.15.102:0/3514753459 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x557d616483b0 0x557d6164a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.511+0000 7f3730ca4640 1 --2- 172.21.15.102:0/3514753459 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x557d616483b0 0x557d6164a7a0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.511+0000 7f3730ca4640 1 -- 172.21.15.102:0/3514753459 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f372800a4a0 con 0x557d616483b0 2024-09-13T19:16:20.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.511+0000 7f37329af800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:20.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.511+0000 7f37329af800 20 searching for the correct realm 2024-09-13T19:16:20.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.511+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d6164c6c0 con 0x557d616483b0 2024-09-13T19:16:20.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.512+0000 7f3730ca4640 1 -- 172.21.15.102:0/3514753459 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f372800a4a0 con 0x557d616483b0 2024-09-13T19:16:20.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.512+0000 7f3730ca4640 1 --2- 172.21.15.102:0/3514753459 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f37280480e0 0x7f37280460a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.512+0000 7f3730ca4640 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d6164c6c0 con 0x7f37280480e0 2024-09-13T19:16:20.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.512+0000 7f37304a3640 1 --2- 172.21.15.102:0/3514753459 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f37280480e0 0x7f37280460a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.512+0000 7f37304a3640 1 --2- 172.21.15.102:0/3514753459 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f37280480e0 0x7f37280460a0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.512+0000 7f37304a3640 1 -- 172.21.15.102:0/3514753459 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3720044d70 con 0x7f37280480e0 2024-09-13T19:16:20.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.512+0000 7f37304a3640 1 --2- 172.21.15.102:0/3514753459 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f37200187f0 0x7f372001c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.512+0000 7f37304a3640 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d6164c6c0 con 0x7f37200187f0 2024-09-13T19:16:20.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.513+0000 7f3727fff640 1 --2- 172.21.15.102:0/3514753459 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f37200187f0 0x7f372001c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.513+0000 7f3727fff640 1 --2- 172.21.15.102:0/3514753459 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f37200187f0 0x7f372001c610 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.513+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3718051070 con 0x7f37200187f0 2024-09-13T19:16:20.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.514+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d6164c6c0 con 0x557d616439a0 2024-09-13T19:16:20.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.514+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3718051070 con 0x557d616439a0 2024-09-13T19:16:20.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.514+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d6164c6c0 con 0x557d616439a0 2024-09-13T19:16:20.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.514+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3718051070 con 0x557d616439a0 2024-09-13T19:16:20.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.514+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d6164c6c0 con 0x7f37200187f0 2024-09-13T19:16:20.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.514+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3718051070 con 0x7f37200187f0 2024-09-13T19:16:20.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.514+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d6164c6c0 con 0x7f37200187f0 2024-09-13T19:16:20.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.514+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3718051070 con 0x7f37200187f0 2024-09-13T19:16:20.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.514+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d6164c6c0 con 0x7f37280480e0 2024-09-13T19:16:20.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.515+0000 7f37304a3640 1 -- 172.21.15.102:0/3514753459 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3720044d70 con 0x7f37280480e0 2024-09-13T19:16:20.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.515+0000 7f37304a3640 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d6164c6c0 con 0x557d616483b0 2024-09-13T19:16:20.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.515+0000 7f3730ca4640 1 -- 172.21.15.102:0/3514753459 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f372800a4a0 con 0x557d616483b0 2024-09-13T19:16:20.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.515+0000 7f3730ca4640 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d6164c6c0 con 0x557d616439a0 2024-09-13T19:16:20.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.515+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3718051070 con 0x557d616439a0 2024-09-13T19:16:20.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.515+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d6164c6c0 con 0x7f37200187f0 2024-09-13T19:16:20.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.515+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3718051070 con 0x7f37200187f0 2024-09-13T19:16:20.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.515+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d6164c6c0 con 0x557d616439a0 2024-09-13T19:16:20.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.516+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3718051070 con 0x557d616439a0 2024-09-13T19:16:20.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.516+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d6164c6c0 con 0x7f37280480e0 2024-09-13T19:16:20.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.516+0000 7f37304a3640 1 -- 172.21.15.102:0/3514753459 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3720044d70 con 0x7f37280480e0 2024-09-13T19:16:20.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.516+0000 7f37304a3640 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f372005a060 con 0x557d616483b0 2024-09-13T19:16:20.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.516+0000 7f3730ca4640 1 -- 172.21.15.102:0/3514753459 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f372800a4a0 con 0x557d616483b0 2024-09-13T19:16:20.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.516+0000 7f3730ca4640 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f372005a060 con 0x557d616483b0 2024-09-13T19:16:20.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.516+0000 7f3730ca4640 1 -- 172.21.15.102:0/3514753459 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f372800a4a0 con 0x557d616483b0 2024-09-13T19:16:20.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.516+0000 7f3730ca4640 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f372005a060 con 0x7f37200187f0 2024-09-13T19:16:20.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.517+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3718051070 con 0x7f37200187f0 2024-09-13T19:16:20.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.517+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f372005a060 con 0x557d616483b0 2024-09-13T19:16:20.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.517+0000 7f3730ca4640 1 -- 172.21.15.102:0/3514753459 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f372800a4a0 con 0x557d616483b0 2024-09-13T19:16:20.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.517+0000 7f3730ca4640 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f372005a060 con 0x557d616483b0 2024-09-13T19:16:20.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.517+0000 7f3730ca4640 1 -- 172.21.15.102:0/3514753459 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f372800a4a0 con 0x557d616483b0 2024-09-13T19:16:20.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.517+0000 7f3730ca4640 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f372005a060 con 0x557d616439a0 2024-09-13T19:16:20.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.517+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3718051070 con 0x557d616439a0 2024-09-13T19:16:20.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.517+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f372005a060 con 0x557d616439a0 2024-09-13T19:16:20.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.517+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3718051070 con 0x557d616439a0 2024-09-13T19:16:20.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.517+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f372005a060 con 0x7f37200187f0 2024-09-13T19:16:20.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.518+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3718051070 con 0x7f37200187f0 2024-09-13T19:16:20.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.518+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f372005a060 con 0x557d616483b0 2024-09-13T19:16:20.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.518+0000 7f3730ca4640 1 -- 172.21.15.102:0/3514753459 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f372800a4a0 con 0x557d616483b0 2024-09-13T19:16:20.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.518+0000 7f3730ca4640 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f372005a060 con 0x7f37280480e0 2024-09-13T19:16:20.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.518+0000 7f37304a3640 1 -- 172.21.15.102:0/3514753459 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3720044d70 con 0x7f37280480e0 2024-09-13T19:16:20.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.518+0000 7f37304a3640 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f372005a060 con 0x557d616439a0 2024-09-13T19:16:20.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.518+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3718051070 con 0x557d616439a0 2024-09-13T19:16:20.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.518+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f372005a060 con 0x7f37200187f0 2024-09-13T19:16:20.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.519+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3718051070 con 0x7f37200187f0 2024-09-13T19:16:20.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.519+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f372005a060 con 0x557d616483b0 2024-09-13T19:16:20.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.519+0000 7f3730ca4640 1 -- 172.21.15.102:0/3514753459 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f372800a4a0 con 0x557d616483b0 2024-09-13T19:16:20.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.519+0000 7f3730ca4640 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f372005a060 con 0x7f37200187f0 2024-09-13T19:16:20.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.519+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3718051070 con 0x7f37200187f0 2024-09-13T19:16:20.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.519+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f372005a060 con 0x7f37280480e0 2024-09-13T19:16:20.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.519+0000 7f37304a3640 1 -- 172.21.15.102:0/3514753459 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3720044d70 con 0x7f37280480e0 2024-09-13T19:16:20.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.519+0000 7f37304a3640 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f372005a060 con 0x557d616483b0 2024-09-13T19:16:20.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.520+0000 7f3730ca4640 1 -- 172.21.15.102:0/3514753459 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f372800a4a0 con 0x557d616483b0 2024-09-13T19:16:20.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.520+0000 7f3730ca4640 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f372005a060 con 0x7f37200187f0 2024-09-13T19:16:20.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.520+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3718051070 con 0x7f37200187f0 2024-09-13T19:16:20.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.520+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f372005a060 con 0x557d616439a0 2024-09-13T19:16:20.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.520+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3718051070 con 0x557d616439a0 2024-09-13T19:16:20.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.520+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f372005a060 con 0x7f37280480e0 2024-09-13T19:16:20.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.520+0000 7f37304a3640 1 -- 172.21.15.102:0/3514753459 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3720044d70 con 0x7f37280480e0 2024-09-13T19:16:20.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.520+0000 7f37329af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:20.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.520+0000 7f37329af800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:20.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.520+0000 7f37329af800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:20.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.520+0000 7f37329af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:20.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.520+0000 7f37329af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:20.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.520+0000 7f37329af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:20.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.520+0000 7f37329af800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.520+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d6164b600 con 0x557d616439a0 2024-09-13T19:16:20.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.521+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3718051070 con 0x557d616439a0 2024-09-13T19:16:20.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.521+0000 7f37329af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:20.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.521+0000 7f37329af800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.521+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d6164b9f0 con 0x557d616439a0 2024-09-13T19:16:20.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.521+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3718051070 con 0x557d616439a0 2024-09-13T19:16:20.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.521+0000 7f37329af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:20.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.521+0000 7f37329af800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.521+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d6164cb40 con 0x557d616483b0 2024-09-13T19:16:20.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.521+0000 7f3730ca4640 1 -- 172.21.15.102:0/3514753459 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f372800a4a0 con 0x557d616483b0 2024-09-13T19:16:20.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.521+0000 7f37329af800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:20.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.521+0000 7f37329af800 20 zone default found 2024-09-13T19:16:20.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.521+0000 7f37329af800 4 Realm: () 2024-09-13T19:16:20.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.521+0000 7f37329af800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:20.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.521+0000 7f37329af800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:20.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.521+0000 7f37329af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:20.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.521+0000 7f37329af800 20 zonegroup default 2024-09-13T19:16:20.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.521+0000 7f37329af800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.521+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d6164d390 con 0x7f37200187f0 2024-09-13T19:16:20.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.522+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3718051070 con 0x7f37200187f0 2024-09-13T19:16:20.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.522+0000 7f37329af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:20.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.522+0000 7f37329af800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.522+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d6164ed70 con 0x557d616483b0 2024-09-13T19:16:20.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.522+0000 7f3730ca4640 1 -- 172.21.15.102:0/3514753459 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f372800a4a0 con 0x557d616483b0 2024-09-13T19:16:20.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.522+0000 7f37329af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:20.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.522+0000 7f37329af800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.522+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d6164eda0 con 0x557d616483b0 2024-09-13T19:16:20.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.522+0000 7f3730ca4640 1 -- 172.21.15.102:0/3514753459 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f372800a4a0 con 0x557d616483b0 2024-09-13T19:16:20.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.522+0000 7f37329af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:20.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.522+0000 7f37329af800 20 started sync module instance, tier type = 2024-09-13T19:16:20.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.522+0000 7f37329af800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:20.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.522+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d6164e1b0 con 0x7f37280480e0 2024-09-13T19:16:20.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.523+0000 7f37304a3640 1 -- 172.21.15.102:0/3514753459 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(44 notify.0 [create] v34'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3720044d70 con 0x7f37280480e0 2024-09-13T19:16:20.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.523+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93996993273088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d6164f270 con 0x7f37280480e0 2024-09-13T19:16:20.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.523+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d6164fac0 con 0x557d616439a0 2024-09-13T19:16:20.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.524+0000 7f37304a3640 1 -- 172.21.15.102:0/3514753459 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93996993273088] v34'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3720044d70 con 0x7f37280480e0 2024-09-13T19:16:20.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.524+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v34'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3718051070 con 0x557d616439a0 2024-09-13T19:16:20.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.524+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93996993279504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d6164fee0 con 0x557d616439a0 2024-09-13T19:16:20.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.524+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d61650730 con 0x557d616483b0 2024-09-13T19:16:20.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.525+0000 7f3730ca4640 1 -- 172.21.15.102:0/3514753459 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v34'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f372800a4a0 con 0x557d616483b0 2024-09-13T19:16:20.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.526+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93996993282240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d61650be0 con 0x557d616483b0 2024-09-13T19:16:20.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.526+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d616516d0 con 0x7f37280480e0 2024-09-13T19:16:20.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.526+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93996993279504] v34'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3718051070 con 0x557d616439a0 2024-09-13T19:16:20.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.526+0000 7f3730ca4640 1 -- 172.21.15.102:0/3514753459 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93996993282240] v34'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f372800a4a0 con 0x557d616483b0 2024-09-13T19:16:20.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.526+0000 7f37304a3640 1 -- 172.21.15.102:0/3514753459 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(50 notify.3 [create] v34'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3720044d70 con 0x7f37280480e0 2024-09-13T19:16:20.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.527+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93996993286560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d616505e0 con 0x7f37280480e0 2024-09-13T19:16:20.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.527+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d61652110 con 0x557d616439a0 2024-09-13T19:16:20.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.527+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v34'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3718051070 con 0x557d616439a0 2024-09-13T19:16:20.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.527+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93996993289312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d61652530 con 0x557d616439a0 2024-09-13T19:16:20.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.527+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d61652fb0 con 0x7f37200187f0 2024-09-13T19:16:20.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.528+0000 7f37304a3640 1 -- 172.21.15.102:0/3514753459 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93996993286560] v34'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3720044d70 con 0x7f37280480e0 2024-09-13T19:16:20.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.528+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(54 notify.5 [create] v34'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3718051070 con 0x7f37200187f0 2024-09-13T19:16:20.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.528+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93996993292960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d61652f70 con 0x7f37200187f0 2024-09-13T19:16:20.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.528+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d61653a60 con 0x7f37200187f0 2024-09-13T19:16:20.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.528+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93996993289312] v34'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3718051070 con 0x557d616439a0 2024-09-13T19:16:20.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.529+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93996993292960] v34'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3718051070 con 0x7f37200187f0 2024-09-13T19:16:20.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.529+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(56 notify.6 [create] v34'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3718051070 con 0x7f37200187f0 2024-09-13T19:16:20.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.529+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93996993280560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d61653540 con 0x7f37200187f0 2024-09-13T19:16:20.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.530+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d61653f10 con 0x7f37200187f0 2024-09-13T19:16:20.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.530+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(58 notify.7 [create] v34'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3718051070 con 0x7f37200187f0 2024-09-13T19:16:20.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.530+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93996993280560] v34'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3718051070 con 0x7f37200187f0 2024-09-13T19:16:20.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.530+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93996993296992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d61653e80 con 0x7f37200187f0 2024-09-13T19:16:20.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.531+0000 7f37329af800 20 add_watcher() i=0 2024-09-13T19:16:20.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.531+0000 7f37329af800 20 add_watcher() i=1 2024-09-13T19:16:20.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.531+0000 7f37329af800 20 add_watcher() i=2 2024-09-13T19:16:20.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.531+0000 7f37329af800 20 add_watcher() i=3 2024-09-13T19:16:20.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.531+0000 7f37329af800 20 add_watcher() i=4 2024-09-13T19:16:20.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.531+0000 7f37329af800 20 add_watcher() i=5 2024-09-13T19:16:20.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.531+0000 7f37329af800 20 add_watcher() i=6 2024-09-13T19:16:20.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.531+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93996993296992] v34'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3718051070 con 0x7f37200187f0 2024-09-13T19:16:20.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.531+0000 7f37329af800 20 add_watcher() i=7 2024-09-13T19:16:20.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.531+0000 7f37329af800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:20.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.531+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d616572e0 con 0x557d616439a0 2024-09-13T19:16:20.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.532+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3718051070 con 0x557d616439a0 2024-09-13T19:16:20.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.532+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93996993290368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d61654800 con 0x557d616439a0 2024-09-13T19:16:20.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.533+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93996993290368] v34'132 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3718051070 con 0x557d616439a0 2024-09-13T19:16:20.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.533+0000 7f35e67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:20.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.533+0000 7f37329af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:20.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.533+0000 7f37329af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:20.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.533+0000 7f37329af800 5 note: GC not initialized 2024-09-13T19:16:20.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.533+0000 7f35e57e2640 20 reqs_thread_entry: start 2024-09-13T19:16:20.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.533+0000 7f37329af800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:20.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.533+0000 7f37329af800 20 Filter name: none 2024-09-13T19:16:20.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.533+0000 7f3556ffd640 20 reqs_thread_entry: start 2024-09-13T19:16:20.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.534+0000 7f37329af800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:16:20.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.534+0000 7f37329af800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.534+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d6168a6b0 con 0x557d616439a0 2024-09-13T19:16:20.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.534+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f3718051070 con 0x557d616439a0 2024-09-13T19:16:20.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.534+0000 7f37329af800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:16:20.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.534+0000 7f37329af800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:16:20.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.534+0000 7f37329af800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:16:20.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.534+0000 7f37329af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:16:20.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.534+0000 7f37329af800 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2024-09-13T19:16:20.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.534+0000 7f37329af800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.534+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:63 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d6168a200 con 0x557d616439a0 2024-09-13T19:16:20.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.534+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(63 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv1 ondisk = 0) ==== 197+0+241 (crc 0 0 0) 0x7f3718051070 con 0x557d616439a0 2024-09-13T19:16:20.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.534+0000 7f37329af800 20 rados_obj.operate() r=0 bl.length=193 2024-09-13T19:16:20.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.534+0000 7f37329af800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2024-09-13T19:16:20.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.534+0000 7f37329af800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-13T19:16:20.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.534+0000 7f37329af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 : miss 2024-09-13T19:16:20.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.534+0000 7f37329af800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.534+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:64 8.12 8:4fe6a3ef:root::.bucket.meta.testx%3amyfoo%3a509740b4-c081-4f37-bd6d-df9ca851489b.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d6168e3b0 con 0x557d616483b0 2024-09-13T19:16:20.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.535+0000 7f3730ca4640 1 -- 172.21.15.102:0/3514753459 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(64 .bucket.meta.testx:myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 [call out=48b,stat out=16b,read 0~412 out=412b,getxattrs out=298b] v0'0 uv1 ondisk = 0) ==== 338+0+774 (crc 0 0 0) 0x7f372800a4a0 con 0x557d616483b0 2024-09-13T19:16:20.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.535+0000 7f37329af800 20 rados_obj.operate() r=0 bl.length=412 2024-09-13T19:16:20.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.535+0000 7f37329af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 info.flags=0x17 2024-09-13T19:16:20.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.535+0000 7f37329af800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 to cache LRU end 2024-09-13T19:16:20.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.535+0000 7f37329af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:16:20.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.535+0000 7f37329af800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-13T19:16:20.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.535+0000 7f37329af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 2024-09-13T19:16:20.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.535+0000 7f37329af800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-13T19:16:20.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.535+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d61692660 con 0x557d616439a0 2024-09-13T19:16:20.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.536+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(65 testx$tenanteduser.buckets [call] v34'2 uv2 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f3718051070 con 0x557d616439a0 2024-09-13T19:16:20.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.536+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:66 8.9 8:917ee2d5:root::.bucket.meta.myfoo%3a509740b4-c081-4f37-bd6d-df9ca851489b.4237.1:head [create,call version.inc in=38b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d61695f70 con 0x7f37280480e0 2024-09-13T19:16:20.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.537+0000 7f37304a3640 1 -- 172.21.15.102:0/3514753459 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(66 .bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 [create,call,writefull 0~379,setxattr (123)] v34'30 uv30 ondisk = 0) ==== 332+0+0 (crc 0 0 0) 0x7f3720044d70 con 0x7f37280480e0 2024-09-13T19:16:20.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.537+0000 7f37329af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 info.flags=0x7 2024-09-13T19:16:20.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.537+0000 7f37329af800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 to cache LRU end 2024-09-13T19:16:20.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.537+0000 7f37329af800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:16:20.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.537+0000 7f37329af800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1, ofs0, ns] 2024-09-13T19:16:20.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.537+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify cookie 93996993559824 in=740b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d61695a10 con 0x557d616439a0 2024-09-13T19:16:20.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.538+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== watch-notify(notify (1) cookie 93996993289312 notify 146028888080 ret 0) ==== 770+0+0 (crc 0 0 0) 0x557d613d7e00 con 0x557d616439a0 2024-09-13T19:16:20.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.538+0000 7f360f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888080 cookie 93996993289312 notifier 4566 bl.length()=728 2024-09-13T19:16:20.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.538+0000 7f360f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 info.flags=0x7 2024-09-13T19:16:20.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.538+0000 7f360f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 to cache LRU end 2024-09-13T19:16:20.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.538+0000 7f360f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:16:20.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.538+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(67 notify.4 [notify cookie 93996993559824 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3718051070 con 0x557d616439a0 2024-09-13T19:16:20.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.538+0000 7f360f7fe640 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f35f4003ea0 con 0x557d616439a0 2024-09-13T19:16:20.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.538+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== osd_op_reply(68 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3718051070 con 0x557d616439a0 2024-09-13T19:16:20.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.538+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== watch-notify(notify_complete (2) cookie 93996993559824 notify 146028888080 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f3718081940 con 0x557d616439a0 2024-09-13T19:16:20.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.538+0000 7f37329af800 20 handle_bi_update(): bucket=:myfoo[509740b4-c081-4f37-bd6d-df9ca851489b.4237.1]): orig_sources= new_sources= 2024-09-13T19:16:20.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.538+0000 7f37329af800 20 handle_bi_update(): bucket=:myfoo[509740b4-c081-4f37-bd6d-df9ca851489b.4237.1]): potential sources added=[] removed=[] 2024-09-13T19:16:20.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.538+0000 7f37329af800 20 handle_bi_update(): bucket=:myfoo[509740b4-c081-4f37-bd6d-df9ca851489b.4237.1]): orig_dests= new_dests= 2024-09-13T19:16:20.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.538+0000 7f37329af800 20 handle_bi_update(): bucket=:myfoo[509740b4-c081-4f37-bd6d-df9ca851489b.4237.1]): potential dests added=[] removed=[] 2024-09-13T19:16:20.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.538+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d61695a90 con 0x7f37280480e0 2024-09-13T19:16:20.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.539+0000 7f37304a3640 1 -- 172.21.15.102:0/3514753459 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(69 foo.buckets [call] v34'31 uv31 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f3720044d70 con 0x7f37280480e0 2024-09-13T19:16:20.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.539+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d61695a90 con 0x7f37280480e0 2024-09-13T19:16:20.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.540+0000 7f37304a3640 1 -- 172.21.15.102:0/3514753459 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v34'32 uv32 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f3720044d70 con 0x7f37280480e0 2024-09-13T19:16:20.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.540+0000 7f37329af800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-13T19:16:20.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.540+0000 7f37329af800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:16:20.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.540+0000 7f37329af800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T19:16:20.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.540+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93996993566176 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d61696500 con 0x7f37200187f0 2024-09-13T19:16:20.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.540+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== watch-notify(notify (1) cookie 93996993280560 notify 146028888079 ret 0) ==== 356+0+0 (crc 0 0 0) 0x7f3718081be0 con 0x7f37200187f0 2024-09-13T19:16:20.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.540+0000 7f360f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888079 cookie 93996993280560 notifier 4566 bl.length()=314 2024-09-13T19:16:20.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.540+0000 7f360f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-13T19:16:20.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.540+0000 7f360f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:16:20.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.540+0000 7f360f7fe640 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f35f4003ea0 con 0x7f37200187f0 2024-09-13T19:16:20.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.540+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(71 notify.6 [notify cookie 93996993566176 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3718051070 con 0x7f37200187f0 2024-09-13T19:16:20.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.541+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3718051070 con 0x7f37200187f0 2024-09-13T19:16:20.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.541+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.0 v2:172.21.15.53:6800/4021716951 20 ==== watch-notify(notify_complete (2) cookie 93996993566176 notify 146028888079 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f37180864b0 con 0x7f37200187f0 2024-09-13T19:16:20.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.541+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:73 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d61695a90 con 0x557d616439a0 2024-09-13T19:16:20.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.542+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.1 v2:172.21.15.102:6808/2204418452 28 ==== osd_op_reply(73 testx/myfoo [call,delete] v34'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f3718051070 con 0x557d616439a0 2024-09-13T19:16:20.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.542+0000 7f37329af800 10 removing default.rgw.meta+root+testx/myfoo from cache 2024-09-13T19:16:20.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.542+0000 7f37329af800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-13T19:16:20.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.542+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [notify cookie 93996993566176 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d61692d00 con 0x557d616439a0 2024-09-13T19:16:20.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.542+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.1 v2:172.21.15.102:6808/2204418452 29 ==== watch-notify(notify (1) cookie 93996993289312 notify 146028888081 ret 0) ==== 197+0+0 (crc 0 0 0) 0x7f37180864b0 con 0x557d616439a0 2024-09-13T19:16:20.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.542+0000 7f360effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888081 cookie 93996993289312 notifier 4566 bl.length()=155 2024-09-13T19:16:20.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.542+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.1 v2:172.21.15.102:6808/2204418452 30 ==== osd_op_reply(74 notify.4 [notify cookie 93996993566176 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3718051070 con 0x557d616439a0 2024-09-13T19:16:20.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.542+0000 7f360effd640 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f35640032c0 con 0x557d616439a0 2024-09-13T19:16:20.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.542+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.1 v2:172.21.15.102:6808/2204418452 31 ==== osd_op_reply(75 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3718051070 con 0x557d616439a0 2024-09-13T19:16:20.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.542+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.1 v2:172.21.15.102:6808/2204418452 32 ==== watch-notify(notify_complete (2) cookie 93996993566176 notify 146028888081 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f3718086750 con 0x557d616439a0 2024-09-13T19:16:20.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.542+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:76 8.12 8:4fe6a3ef:root::.bucket.meta.testx%3amyfoo%3a509740b4-c081-4f37-bd6d-df9ca851489b.4237.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d61695a90 con 0x557d616483b0 2024-09-13T19:16:20.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.543+0000 7f3730ca4640 1 -- 172.21.15.102:0/3514753459 <== osd.3 v2:172.21.15.102:6800/3096737090 17 ==== osd_op_reply(76 .bucket.meta.testx:myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 [call,delete] v34'2 uv2 ondisk = 0) ==== 254+0+0 (crc 0 0 0) 0x7f372800a4a0 con 0x557d616483b0 2024-09-13T19:16:20.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.543+0000 7f37329af800 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 from cache 2024-09-13T19:16:20.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.543+0000 7f37329af800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1, ofs0, ns] 2024-09-13T19:16:20.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.543+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [notify cookie 93996993536800 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d61695a90 con 0x7f37280480e0 2024-09-13T19:16:20.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.544+0000 7f37304a3640 1 -- 172.21.15.102:0/3514753459 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== watch-notify(notify (1) cookie 93996993286560 notify 146028888078 ret 0) ==== 254+0+0 (crc 0 0 0) 0x557d61694d20 con 0x7f37280480e0 2024-09-13T19:16:20.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.544+0000 7f360effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888078 cookie 93996993286560 notifier 4566 bl.length()=212 2024-09-13T19:16:20.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.544+0000 7f360effd640 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f3564003330 con 0x7f37280480e0 2024-09-13T19:16:20.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.544+0000 7f37304a3640 1 -- 172.21.15.102:0/3514753459 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(77 notify.3 [notify cookie 93996993536800 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3720044d70 con 0x7f37280480e0 2024-09-13T19:16:20.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.544+0000 7f37304a3640 1 -- 172.21.15.102:0/3514753459 <== osd.2 v2:172.21.15.102:6816/2238176080 16 ==== osd_op_reply(78 notify.3 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3720044d70 con 0x7f37280480e0 2024-09-13T19:16:20.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.544+0000 7f37304a3640 1 -- 172.21.15.102:0/3514753459 <== osd.2 v2:172.21.15.102:6816/2238176080 17 ==== watch-notify(notify_complete (2) cookie 93996993536800 notify 146028888078 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557d616928a0 con 0x7f37280480e0 2024-09-13T19:16:20.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.545+0000 7f35e67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:20.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.545+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93996993290368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d61688420 con 0x557d616439a0 2024-09-13T19:16:20.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.546+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.1 v2:172.21.15.102:6808/2204418452 33 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 93996993290368] v34'133 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3718051070 con 0x557d616439a0 2024-09-13T19:16:20.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.546+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93996993273088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d61688420 con 0x7f37280480e0 2024-09-13T19:16:20.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.547+0000 7f37304a3640 1 -- 172.21.15.102:0/3514753459 <== osd.2 v2:172.21.15.102:6816/2238176080 18 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 93996993273088] v34'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3720044d70 con 0x7f37280480e0 2024-09-13T19:16:20.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.547+0000 7f37329af800 20 remove_watcher() i=0 2024-09-13T19:16:20.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.547+0000 7f37329af800 2 removed watcher, disabling cache 2024-09-13T19:16:20.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.547+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93996993279504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d61688420 con 0x557d616439a0 2024-09-13T19:16:20.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.548+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.1 v2:172.21.15.102:6808/2204418452 34 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 93996993279504] v34'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3718051070 con 0x557d616439a0 2024-09-13T19:16:20.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.548+0000 7f37329af800 20 remove_watcher() i=1 2024-09-13T19:16:20.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.548+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93996993282240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d61688420 con 0x557d616483b0 2024-09-13T19:16:20.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.549+0000 7f3730ca4640 1 -- 172.21.15.102:0/3514753459 <== osd.3 v2:172.21.15.102:6800/3096737090 18 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 93996993282240] v34'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f372800a4a0 con 0x557d616483b0 2024-09-13T19:16:20.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.549+0000 7f37329af800 20 remove_watcher() i=2 2024-09-13T19:16:20.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.549+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93996993286560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d61688420 con 0x7f37280480e0 2024-09-13T19:16:20.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.550+0000 7f37304a3640 1 -- 172.21.15.102:0/3514753459 <== osd.2 v2:172.21.15.102:6816/2238176080 19 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 93996993286560] v34'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3720044d70 con 0x7f37280480e0 2024-09-13T19:16:20.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.550+0000 7f37329af800 20 remove_watcher() i=3 2024-09-13T19:16:20.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.550+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93996993289312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d61688420 con 0x557d616439a0 2024-09-13T19:16:20.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.551+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.1 v2:172.21.15.102:6808/2204418452 35 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 93996993289312] v34'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3718051070 con 0x557d616439a0 2024-09-13T19:16:20.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.551+0000 7f37329af800 20 remove_watcher() i=4 2024-09-13T19:16:20.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.551+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93996993292960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d61688420 con 0x7f37200187f0 2024-09-13T19:16:20.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.552+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.0 v2:172.21.15.53:6800/4021716951 21 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 93996993292960] v34'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3718051070 con 0x7f37200187f0 2024-09-13T19:16:20.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.552+0000 7f37329af800 20 remove_watcher() i=5 2024-09-13T19:16:20.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.552+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93996993280560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d61688420 con 0x7f37200187f0 2024-09-13T19:16:20.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.553+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.0 v2:172.21.15.53:6800/4021716951 22 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 93996993280560] v34'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3718051070 con 0x7f37200187f0 2024-09-13T19:16:20.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.553+0000 7f37329af800 20 remove_watcher() i=6 2024-09-13T19:16:20.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.553+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93996993296992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d61688420 con 0x7f37200187f0 2024-09-13T19:16:20.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.554+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 <== osd.0 v2:172.21.15.53:6800/4021716951 23 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 93996993296992] v34'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3718051070 con 0x7f37200187f0 2024-09-13T19:16:20.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.554+0000 7f37329af800 20 remove_watcher() i=7 2024-09-13T19:16:20.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.554+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f37200187f0 msgr2=0x7f372001c610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.554+0000 7f37329af800 1 --2- 172.21.15.102:0/3514753459 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f37200187f0 0x7f372001c610 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.554+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557d616439a0 msgr2=0x557d61645e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.554+0000 7f37329af800 1 --2- 172.21.15.102:0/3514753459 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557d616439a0 0x557d61645e60 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.554+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f37280480e0 msgr2=0x7f37280460a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.554+0000 7f37329af800 1 --2- 172.21.15.102:0/3514753459 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f37280480e0 0x7f37280460a0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.554+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x557d616483b0 msgr2=0x557d6164a7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.554+0000 7f37329af800 1 --2- 172.21.15.102:0/3514753459 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x557d616483b0 0x557d6164a7a0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.554+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3600036b40 msgr2=0x7f3600039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.554+0000 7f37329af800 1 --2- 172.21.15.102:0/3514753459 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3600036b40 0x7f3600039000 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f372000ffd0 tx=0x7f3720033000 comp rx=0 tx=0).stop 2024-09-13T19:16:20.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.554+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d61630ca0 msgr2=0x557d616380c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.554+0000 7f3727fff640 1 -- 172.21.15.102:0/3514753459 reap_dead start 2024-09-13T19:16:20.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.554+0000 7f37329af800 1 --2- 172.21.15.102:0/3514753459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d61630ca0 0x557d616380c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f372804bca0 tx=0x7f372804cdb0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.555+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 shutdown_connections 2024-09-13T19:16:20.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.555+0000 7f37329af800 1 --2- 172.21.15.102:0/3514753459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d61630ca0 0x557d616380c0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.555+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 >> 172.21.15.102:0/3514753459 conn(0x557d6162cfb0 msgr2=0x557d6162b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:20.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.555+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 shutdown_connections 2024-09-13T19:16:20.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.555+0000 7f37329af800 1 -- 172.21.15.102:0/3514753459 wait complete. 2024-09-13T19:16:20.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.555+0000 7f37329af800 1 -- 172.21.15.102:0/1369814283 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3608036b40 msgr2=0x7f3608039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.555+0000 7f37329af800 1 --2- 172.21.15.102:0/1369814283 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3608036b40 0x7f3608039000 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x557d6160d7f0 tx=0x7f372004b670 comp rx=0 tx=0).stop 2024-09-13T19:16:20.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.555+0000 7f37329af800 1 -- 172.21.15.102:0/1369814283 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d61623f70 msgr2=0x557d61624390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.555+0000 7f37329af800 1 --2- 172.21.15.102:0/1369814283 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d61623f70 0x557d61624390 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x557d6160a340 tx=0x7f37280167b0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.555+0000 7f37329af800 1 -- 172.21.15.102:0/1369814283 shutdown_connections 2024-09-13T19:16:20.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.555+0000 7f37329af800 1 --2- 172.21.15.102:0/1369814283 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3608036b40 0x7f3608039000 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.555+0000 7f37329af800 1 --2- 172.21.15.102:0/1369814283 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d61623f70 0x557d61624390 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.555+0000 7f37329af800 1 -- 172.21.15.102:0/1369814283 >> 172.21.15.102:0/1369814283 conn(0x557d61618f00 msgr2=0x557d6161ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:20.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.555+0000 7f37329af800 1 -- 172.21.15.102:0/1369814283 shutdown_connections 2024-09-13T19:16:20.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.555+0000 7f37329af800 1 -- 172.21.15.102:0/1369814283 wait complete. 2024-09-13T19:16:20.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.555+0000 7f37329af800 1 -- 172.21.15.102:0/1815044406 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557d61516d40 msgr2=0x557d61610300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.555+0000 7f37329af800 1 --2- 172.21.15.102:0/1815044406 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557d61516d40 0x557d61610300 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.555+0000 7f37329af800 1 -- 172.21.15.102:0/1815044406 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x557d61612b50 msgr2=0x557d61614f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.555+0000 7f37329af800 1 --2- 172.21.15.102:0/1815044406 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x557d61612b50 0x557d61614f40 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.555+0000 7f37329af800 1 -- 172.21.15.102:0/1815044406 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3618036b40 msgr2=0x7f3618039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.555+0000 7f37329af800 1 --2- 172.21.15.102:0/1815044406 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3618036b40 0x7f3618039000 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3718057000 tx=0x7f3718052000 comp rx=0 tx=0).stop 2024-09-13T19:16:20.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.555+0000 7f37329af800 1 -- 172.21.15.102:0/1815044406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d61484610 msgr2=0x557d61609290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.555+0000 7f37329af800 1 --2- 172.21.15.102:0/1815044406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d61484610 0x557d61609290 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x557d61602670 tx=0x7f3720000ed0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.555+0000 7f37329af800 1 -- 172.21.15.102:0/1815044406 shutdown_connections 2024-09-13T19:16:20.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.555+0000 7f37329af800 1 --2- 172.21.15.102:0/1815044406 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x557d61612b50 0x557d61614f40 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.555+0000 7f37329af800 1 --2- 172.21.15.102:0/1815044406 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557d61516d40 0x557d61610300 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.555+0000 7f37329af800 1 --2- 172.21.15.102:0/1815044406 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3618036b40 0x7f3618039000 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.555+0000 7f37329af800 1 --2- 172.21.15.102:0/1815044406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d61484610 0x557d61609290 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.555+0000 7f37329af800 1 -- 172.21.15.102:0/1815044406 >> 172.21.15.102:0/1815044406 conn(0x557d6150adb0 msgr2=0x557d615fbac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:20.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.555+0000 7f37329af800 1 -- 172.21.15.102:0/1815044406 shutdown_connections 2024-09-13T19:16:20.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.556+0000 7f37329af800 1 -- 172.21.15.102:0/1815044406 wait complete. 2024-09-13T19:16:20.571 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-13T19:16:20.572 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-13T19:16:20.572 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2024-09-13T19:16:20.617 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:20.618 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:20.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.615+0000 7ff766926800 1 Processor -- start 2024-09-13T19:16:20.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.615+0000 7ff766926800 1 -- start start 2024-09-13T19:16:20.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.615+0000 7ff766926800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x562b0ed4beb0 0x562b0eddb160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.615+0000 7ff766926800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562b0ec97b30 con 0x562b0eddb6a0 2024-09-13T19:16:20.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.615+0000 7ff766926800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x562b0ec79360 con 0x562b0ed4beb0 2024-09-13T19:16:20.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.616+0000 7ff762513640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x562b0ed4beb0 0x562b0eddb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.616+0000 7ff762513640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x562b0ed4beb0 0x562b0eddb160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55924/0 (socket says 172.21.15.102:55924) 2024-09-13T19:16:20.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.616+0000 7ff762513640 1 -- 172.21.15.102:0/657418564 learned_addr learned my addr 172.21.15.102:0/657418564 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:20.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.616+0000 7ff762513640 1 -- 172.21.15.102:0/657418564 >> v1:172.21.15.53:6789/0 conn(0x562b0eddb6a0 legacy=0x562b0edddab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.616+0000 7ff761d12640 1 -- 172.21.15.102:0/657418564 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3353318165 0 0) 0x562b0ec97b30 con 0x562b0eddb6a0 2024-09-13T19:16:20.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.616+0000 7ff762513640 1 -- 172.21.15.102:0/657418564 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b0ec9fe00 con 0x562b0ed4beb0 2024-09-13T19:16:20.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.618+0000 7ff762513640 1 --2- 172.21.15.102:0/657418564 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b0ed4beb0 0x562b0eddb160 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7ff75400a520 tx=0x7ff754045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d47725a062c824b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.618+0000 7ff761d12640 1 -- 172.21.15.102:0/657418564 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff754055070 con 0x562b0ed4beb0 2024-09-13T19:16:20.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.618+0000 7ff761d12640 1 -- 172.21.15.102:0/657418564 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7540515b0 con 0x562b0ed4beb0 2024-09-13T19:16:20.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.618+0000 7ff761d12640 1 -- 172.21.15.102:0/657418564 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7540518d0 con 0x562b0ed4beb0 2024-09-13T19:16:20.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.618+0000 7ff766926800 1 -- 172.21.15.102:0/657418564 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b0ed4beb0 msgr2=0x562b0eddb160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.618+0000 7ff766926800 1 --2- 172.21.15.102:0/657418564 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b0ed4beb0 0x562b0eddb160 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7ff75400a520 tx=0x7ff754045ba0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.619+0000 7ff766926800 1 -- 172.21.15.102:0/657418564 shutdown_connections 2024-09-13T19:16:20.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.619+0000 7ff766926800 1 --2- 172.21.15.102:0/657418564 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b0ed4beb0 0x562b0eddb160 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.619+0000 7ff766926800 1 -- 172.21.15.102:0/657418564 >> 172.21.15.102:0/657418564 conn(0x562b0edd2dd0 msgr2=0x562b0edd51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:20.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.619+0000 7ff766926800 1 -- 172.21.15.102:0/657418564 shutdown_connections 2024-09-13T19:16:20.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.619+0000 7ff766926800 1 -- 172.21.15.102:0/657418564 wait complete. 2024-09-13T19:16:20.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.632+0000 7ff766926800 1 Processor -- start 2024-09-13T19:16:20.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.632+0000 7ff766926800 1 -- start start 2024-09-13T19:16:20.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.633+0000 7ff766926800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b0ed4beb0 0x562b0eec76f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.633+0000 7ff766926800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562b0ed24360 con 0x562b0ed4beb0 2024-09-13T19:16:20.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.633+0000 7ff762513640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b0ed4beb0 0x562b0eec76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.633+0000 7ff762513640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b0ed4beb0 0x562b0eec76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55926/0 (socket says 172.21.15.102:55926) 2024-09-13T19:16:20.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.633+0000 7ff762513640 1 -- 172.21.15.102:0/514926389 learned_addr learned my addr 172.21.15.102:0/514926389 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:20.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.633+0000 7ff762513640 1 -- 172.21.15.102:0/514926389 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b0ec71bc0 con 0x562b0ed4beb0 2024-09-13T19:16:20.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.633+0000 7ff762513640 1 --2- 172.21.15.102:0/514926389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b0ed4beb0 0x562b0eec76f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7ff754000c00 tx=0x7ff754051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8489e8ade1f05e25 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.634+0000 7ff650608640 1 -- 172.21.15.102:0/514926389 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7540519d0 con 0x562b0ed4beb0 2024-09-13T19:16:20.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.634+0000 7ff650608640 1 -- 172.21.15.102:0/514926389 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff754051b70 con 0x562b0ed4beb0 2024-09-13T19:16:20.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.634+0000 7ff650608640 1 -- 172.21.15.102:0/514926389 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff754051e50 con 0x562b0ed4beb0 2024-09-13T19:16:20.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.634+0000 7ff766926800 1 -- 172.21.15.102:0/514926389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b0ed4beb0 msgr2=0x562b0eec76f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.634+0000 7ff766926800 1 --2- 172.21.15.102:0/514926389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b0ed4beb0 0x562b0eec76f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7ff754000c00 tx=0x7ff754051000 comp rx=0 tx=0).stop 2024-09-13T19:16:20.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.634+0000 7ff766926800 1 -- 172.21.15.102:0/514926389 shutdown_connections 2024-09-13T19:16:20.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.634+0000 7ff766926800 1 --2- 172.21.15.102:0/514926389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b0ed4beb0 0x562b0eec76f0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.634+0000 7ff766926800 1 -- 172.21.15.102:0/514926389 >> 172.21.15.102:0/514926389 conn(0x562b0edd2dd0 msgr2=0x562b0eec30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:20.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.634+0000 7ff766926800 1 -- 172.21.15.102:0/514926389 shutdown_connections 2024-09-13T19:16:20.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.634+0000 7ff766926800 1 -- 172.21.15.102:0/514926389 wait complete. 2024-09-13T19:16:20.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.635+0000 7ff766926800 1 Processor -- start 2024-09-13T19:16:20.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.635+0000 7ff766926800 1 -- start start 2024-09-13T19:16:20.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.635+0000 7ff766926800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b0ed4beb0 0x562b0eecf020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.635+0000 7ff766926800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562b0eddf610 con 0x562b0ed4beb0 2024-09-13T19:16:20.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.635+0000 7ff762513640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b0ed4beb0 0x562b0eecf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.635+0000 7ff762513640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b0ed4beb0 0x562b0eecf020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55928/0 (socket says 172.21.15.102:55928) 2024-09-13T19:16:20.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.635+0000 7ff762513640 1 -- 172.21.15.102:0/3196734502 learned_addr learned my addr 172.21.15.102:0/3196734502 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:20.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.635+0000 7ff762513640 1 -- 172.21.15.102:0/3196734502 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b0ec85fe0 con 0x562b0ed4beb0 2024-09-13T19:16:20.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.635+0000 7ff762513640 1 --2- 172.21.15.102:0/3196734502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b0ed4beb0 0x562b0eecf020 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ff754067040 tx=0x7ff754002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.636+0000 7ff64ee05640 1 -- 172.21.15.102:0/3196734502 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff754073070 con 0x562b0ed4beb0 2024-09-13T19:16:20.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.636+0000 7ff64ee05640 1 -- 172.21.15.102:0/3196734502 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff75405a450 con 0x562b0ed4beb0 2024-09-13T19:16:20.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.636+0000 7ff64ee05640 1 -- 172.21.15.102:0/3196734502 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff75405a750 con 0x562b0ed4beb0 2024-09-13T19:16:20.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.636+0000 7ff766926800 1 -- 172.21.15.102:0/3196734502 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562b0eecf560 con 0x562b0ed4beb0 2024-09-13T19:16:20.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.636+0000 7ff766926800 1 -- 172.21.15.102:0/3196734502 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b0eecfae0 con 0x562b0ed4beb0 2024-09-13T19:16:20.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.636+0000 7ff64ee05640 1 -- 172.21.15.102:0/3196734502 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff754076070 con 0x562b0ed4beb0 2024-09-13T19:16:20.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.637+0000 7ff64ee05640 1 --2- 172.21.15.102:0/3196734502 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff648036be0 0x7ff6480390a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.637+0000 7ff64ee05640 1 -- 172.21.15.102:0/3196734502 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7ff754062070 con 0x562b0ed4beb0 2024-09-13T19:16:20.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.637+0000 7ff759d12640 1 --2- 172.21.15.102:0/3196734502 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff648036be0 0x7ff6480390a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.637+0000 7ff766926800 1 --2- 172.21.15.102:0/3196734502 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x562b0eddb6a0 0x562b0eed6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.637+0000 7ff766926800 1 -- 172.21.15.102:0/3196734502 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562b0eed6610 con 0x562b0eddb6a0 2024-09-13T19:16:20.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.637+0000 7ff762d14640 1 --2- 172.21.15.102:0/3196734502 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x562b0eddb6a0 0x562b0eed6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.637+0000 7ff759d12640 1 --2- 172.21.15.102:0/3196734502 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff648036be0 0x7ff6480390a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff74c000f60 tx=0x7ff74c0013f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.637+0000 7ff762d14640 1 --2- 172.21.15.102:0/3196734502 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x562b0eddb6a0 0x562b0eed6090 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.637+0000 7ff762d14640 1 -- 172.21.15.102:0/3196734502 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff75c00a4a0 con 0x562b0eddb6a0 2024-09-13T19:16:20.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.637+0000 7ff766926800 1 -- 172.21.15.102:0/3196734502 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562b0eed3640 con 0x562b0eddb6a0 2024-09-13T19:16:20.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.638+0000 7ff762d14640 1 -- 172.21.15.102:0/3196734502 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff75c00a4a0 con 0x562b0eddb6a0 2024-09-13T19:16:20.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.638+0000 7ff766926800 1 --2- 172.21.15.102:0/3196734502 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x562b0eed8920 0x562b0eedad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.638+0000 7ff766926800 1 -- 172.21.15.102:0/3196734502 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562b0eedb3b0 con 0x562b0eed8920 2024-09-13T19:16:20.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.638+0000 7ff762513640 1 --2- 172.21.15.102:0/3196734502 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x562b0eed8920 0x562b0eedad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.638+0000 7ff762513640 1 --2- 172.21.15.102:0/3196734502 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x562b0eed8920 0x562b0eedad10 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.639+0000 7ff762513640 1 -- 172.21.15.102:0/3196734502 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff75407f070 con 0x562b0eed8920 2024-09-13T19:16:20.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.639+0000 7ff766926800 1 -- 172.21.15.102:0/3196734502 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562b0eed7790 con 0x562b0eddb6a0 2024-09-13T19:16:20.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.639+0000 7ff762d14640 1 -- 172.21.15.102:0/3196734502 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff75c00a4a0 con 0x562b0eddb6a0 2024-09-13T19:16:20.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.639+0000 7ff766926800 1 -- 172.21.15.102:0/3196734502 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562b0eed7c70 con 0x562b0eed8920 2024-09-13T19:16:20.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.639+0000 7ff762513640 1 -- 172.21.15.102:0/3196734502 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff75407f070 con 0x562b0eed8920 2024-09-13T19:16:20.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.639+0000 7ff766926800 1 Processor -- start 2024-09-13T19:16:20.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.640+0000 7ff766926800 1 -- start start 2024-09-13T19:16:20.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.640+0000 7ff766926800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b0eee9c90 0x562b0eeea0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.640+0000 7ff766926800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562b0ec73580 con 0x562b0eee9c90 2024-09-13T19:16:20.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.640+0000 7ff762d14640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b0eee9c90 0x562b0eeea0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.640+0000 7ff762d14640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b0eee9c90 0x562b0eeea0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55942/0 (socket says 172.21.15.102:55942) 2024-09-13T19:16:20.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.640+0000 7ff762d14640 1 -- 172.21.15.102:0/190853589 learned_addr learned my addr 172.21.15.102:0/190853589 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:20.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.640+0000 7ff762d14640 1 -- 172.21.15.102:0/190853589 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b0eeea5f0 con 0x562b0eee9c90 2024-09-13T19:16:20.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.641+0000 7ff762d14640 1 --2- 172.21.15.102:0/190853589 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b0eee9c90 0x562b0eeea0b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x562b0eed69f0 tx=0x7ff75c0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.641+0000 7ff647fff640 1 -- 172.21.15.102:0/190853589 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff75c013640 con 0x562b0eee9c90 2024-09-13T19:16:20.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.641+0000 7ff647fff640 1 -- 172.21.15.102:0/190853589 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff75c0137e0 con 0x562b0eee9c90 2024-09-13T19:16:20.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.641+0000 7ff766926800 1 -- 172.21.15.102:0/190853589 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562b0eeea880 con 0x562b0eee9c90 2024-09-13T19:16:20.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.641+0000 7ff647fff640 1 -- 172.21.15.102:0/190853589 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff75c013ae0 con 0x562b0eee9c90 2024-09-13T19:16:20.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.641+0000 7ff766926800 1 -- 172.21.15.102:0/190853589 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b0eeed560 con 0x562b0eee9c90 2024-09-13T19:16:20.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.642+0000 7ff647fff640 1 -- 172.21.15.102:0/190853589 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff75c011040 con 0x562b0eee9c90 2024-09-13T19:16:20.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.642+0000 7ff647fff640 1 --2- 172.21.15.102:0/190853589 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff63c036b90 0x7ff63c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.642+0000 7ff647fff640 1 -- 172.21.15.102:0/190853589 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7ff75c00e040 con 0x562b0eee9c90 2024-09-13T19:16:20.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.642+0000 7ff762513640 1 --2- 172.21.15.102:0/190853589 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff63c036b90 0x7ff63c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.642+0000 7ff766926800 1 Processor -- start 2024-09-13T19:16:20.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.642+0000 7ff766926800 1 -- start start 2024-09-13T19:16:20.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.642+0000 7ff762513640 1 --2- 172.21.15.102:0/190853589 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff63c036b90 0x7ff63c039050 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff75406ffd0 tx=0x7ff75408f130 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.642+0000 7ff766926800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b0edd83e0 0x562b0edd87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.642+0000 7ff766926800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562b0eec7de0 con 0x562b0edd83e0 2024-09-13T19:16:20.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.642+0000 7ff762d14640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b0edd83e0 0x562b0edd87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.643+0000 7ff762d14640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b0edd83e0 0x562b0edd87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55952/0 (socket says 172.21.15.102:55952) 2024-09-13T19:16:20.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.643+0000 7ff762d14640 1 -- 172.21.15.102:0/3882597939 learned_addr learned my addr 172.21.15.102:0/3882597939 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:20.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.643+0000 7ff762d14640 1 -- 172.21.15.102:0/3882597939 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b0edd8db0 con 0x562b0edd83e0 2024-09-13T19:16:20.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.643+0000 7ff762d14640 1 --2- 172.21.15.102:0/3882597939 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b0edd83e0 0x562b0edd87e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ff75c04cda0 tx=0x7ff75c020ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5920515d4cfbbf8c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.643+0000 7ff645ffb640 1 -- 172.21.15.102:0/3882597939 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff75c02a910 con 0x562b0edd83e0 2024-09-13T19:16:20.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.643+0000 7ff645ffb640 1 -- 172.21.15.102:0/3882597939 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff75c04a020 con 0x562b0edd83e0 2024-09-13T19:16:20.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.643+0000 7ff645ffb640 1 -- 172.21.15.102:0/3882597939 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff75c02a3f0 con 0x562b0edd83e0 2024-09-13T19:16:20.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.643+0000 7ff766926800 1 -- 172.21.15.102:0/3882597939 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b0edd83e0 msgr2=0x562b0edd87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.643+0000 7ff766926800 1 --2- 172.21.15.102:0/3882597939 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b0edd83e0 0x562b0edd87e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ff75c04cda0 tx=0x7ff75c020ea0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.643+0000 7ff766926800 1 -- 172.21.15.102:0/3882597939 shutdown_connections 2024-09-13T19:16:20.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.643+0000 7ff766926800 1 --2- 172.21.15.102:0/3882597939 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b0edd83e0 0x562b0edd87e0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.643+0000 7ff766926800 1 -- 172.21.15.102:0/3882597939 >> 172.21.15.102:0/3882597939 conn(0x562b0eef2ca0 msgr2=0x562b0eef0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:20.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.644+0000 7ff766926800 1 -- 172.21.15.102:0/3882597939 shutdown_connections 2024-09-13T19:16:20.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.644+0000 7ff766926800 1 -- 172.21.15.102:0/3882597939 wait complete. 2024-09-13T19:16:20.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.644+0000 7ff766926800 1 Processor -- start 2024-09-13T19:16:20.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.644+0000 7ff766926800 1 -- start start 2024-09-13T19:16:20.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.644+0000 7ff766926800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b0edd83e0 0x562b0eefffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.644+0000 7ff766926800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562b0edd70c0 con 0x562b0edd83e0 2024-09-13T19:16:20.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.644+0000 7ff762d14640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b0edd83e0 0x562b0eefffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.644+0000 7ff762d14640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b0edd83e0 0x562b0eefffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55968/0 (socket says 172.21.15.102:55968) 2024-09-13T19:16:20.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.644+0000 7ff762d14640 1 -- 172.21.15.102:0/1181126876 learned_addr learned my addr 172.21.15.102:0/1181126876 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:20.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.644+0000 7ff762d14640 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b0ef00500 con 0x562b0edd83e0 2024-09-13T19:16:20.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.645+0000 7ff762d14640 1 --2- 172.21.15.102:0/1181126876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b0edd83e0 0x562b0eefffc0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7ff75c020ee0 tx=0x7ff75c04cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.645+0000 7ff633fff640 1 -- 172.21.15.102:0/1181126876 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff75c038070 con 0x562b0edd83e0 2024-09-13T19:16:20.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.645+0000 7ff633fff640 1 -- 172.21.15.102:0/1181126876 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff75c01cb70 con 0x562b0edd83e0 2024-09-13T19:16:20.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.645+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562b0ef00790 con 0x562b0edd83e0 2024-09-13T19:16:20.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.645+0000 7ff633fff640 1 -- 172.21.15.102:0/1181126876 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff75c020580 con 0x562b0edd83e0 2024-09-13T19:16:20.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.645+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b0ef03440 con 0x562b0edd83e0 2024-09-13T19:16:20.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.645+0000 7ff633fff640 1 -- 172.21.15.102:0/1181126876 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff75c03b070 con 0x562b0edd83e0 2024-09-13T19:16:20.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.646+0000 7ff633fff640 1 --2- 172.21.15.102:0/1181126876 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff62c036b90 0x7ff62c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.646+0000 7ff633fff640 1 -- 172.21.15.102:0/1181126876 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7ff75c04b030 con 0x562b0edd83e0 2024-09-13T19:16:20.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.646+0000 7ff762513640 1 --2- 172.21.15.102:0/1181126876 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff62c036b90 0x7ff62c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.646+0000 7ff762513640 1 --2- 172.21.15.102:0/1181126876 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff62c036b90 0x7ff62c039050 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff75406ef90 tx=0x7ff754087000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.646+0000 7ff766926800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.646+0000 7ff766926800 1 --2- 172.21.15.102:0/1181126876 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x562b0ef0bab0 0x562b0ef0df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.646+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef0e6c0 con 0x562b0ef0bab0 2024-09-13T19:16:20.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.646+0000 7ff759d12640 1 --2- 172.21.15.102:0/1181126876 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x562b0ef0bab0 0x562b0ef0df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.647+0000 7ff759d12640 1 --2- 172.21.15.102:0/1181126876 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x562b0ef0bab0 0x562b0ef0df70 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.647+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff74c0104c0 con 0x562b0ef0bab0 2024-09-13T19:16:20.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.647+0000 7ff766926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:20.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.647+0000 7ff766926800 20 realm 2024-09-13T19:16:20.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.647+0000 7ff766926800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.647+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef0af00 con 0x562b0ef0bab0 2024-09-13T19:16:20.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.647+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff74c0104c0 con 0x562b0ef0bab0 2024-09-13T19:16:20.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.647+0000 7ff766926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:20.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.647+0000 7ff766926800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:20.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.647+0000 7ff766926800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.647+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef0f1b0 con 0x562b0ef0bab0 2024-09-13T19:16:20.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.647+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff74c0104c0 con 0x562b0ef0bab0 2024-09-13T19:16:20.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.647+0000 7ff766926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:20.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.647+0000 7ff766926800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.647+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef0fa80 con 0x562b0ef0bab0 2024-09-13T19:16:20.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.648+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff74c0104c0 con 0x562b0ef0bab0 2024-09-13T19:16:20.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.648+0000 7ff766926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:20.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.648+0000 7ff766926800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.648+0000 7ff766926800 1 --2- 172.21.15.102:0/1181126876 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x562b0ef104a0 0x562b0ef12890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.648+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef12fd0 con 0x562b0ef104a0 2024-09-13T19:16:20.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.648+0000 7ff762d14640 1 --2- 172.21.15.102:0/1181126876 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x562b0ef104a0 0x562b0ef12890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.648+0000 7ff762d14640 1 --2- 172.21.15.102:0/1181126876 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x562b0ef104a0 0x562b0ef12890 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.648+0000 7ff762d14640 1 -- 172.21.15.102:0/1181126876 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff75c03a030 con 0x562b0ef104a0 2024-09-13T19:16:20.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.648+0000 7ff766926800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:20.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.648+0000 7ff766926800 20 searching for the correct realm 2024-09-13T19:16:20.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.648+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef148e0 con 0x562b0ef104a0 2024-09-13T19:16:20.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.649+0000 7ff762d14640 1 -- 172.21.15.102:0/1181126876 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff75c03a030 con 0x562b0ef104a0 2024-09-13T19:16:20.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.649+0000 7ff762d14640 1 --2- 172.21.15.102:0/1181126876 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7ff75c04ea80 0x7ff75c01a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.649+0000 7ff762d14640 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef148e0 con 0x7ff75c04ea80 2024-09-13T19:16:20.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.649+0000 7ff762513640 1 --2- 172.21.15.102:0/1181126876 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7ff75c04ea80 0x7ff75c01a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.649+0000 7ff762513640 1 --2- 172.21.15.102:0/1181126876 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7ff75c04ea80 0x7ff75c01a0b0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.649+0000 7ff762513640 1 -- 172.21.15.102:0/1181126876 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff75407f070 con 0x7ff75c04ea80 2024-09-13T19:16:20.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.649+0000 7ff762513640 1 --2- 172.21.15.102:0/1181126876 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7ff754078070 0x7ff75408fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.649+0000 7ff762513640 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef148e0 con 0x7ff754078070 2024-09-13T19:16:20.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.649+0000 7ff759d12640 1 --2- 172.21.15.102:0/1181126876 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7ff754078070 0x7ff75408fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.650+0000 7ff759d12640 1 --2- 172.21.15.102:0/1181126876 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7ff754078070 0x7ff75408fa90 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.650+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff74c0104c0 con 0x7ff754078070 2024-09-13T19:16:20.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.650+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef148e0 con 0x562b0ef0bab0 2024-09-13T19:16:20.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.650+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff74c0104c0 con 0x562b0ef0bab0 2024-09-13T19:16:20.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.650+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef148e0 con 0x562b0ef0bab0 2024-09-13T19:16:20.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.651+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff74c02a040 con 0x562b0ef0bab0 2024-09-13T19:16:20.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.651+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef148e0 con 0x7ff754078070 2024-09-13T19:16:20.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.651+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff74c02a040 con 0x7ff754078070 2024-09-13T19:16:20.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.651+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef148e0 con 0x7ff754078070 2024-09-13T19:16:20.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.651+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff74c02a040 con 0x7ff754078070 2024-09-13T19:16:20.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.651+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef148e0 con 0x7ff75c04ea80 2024-09-13T19:16:20.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.651+0000 7ff762513640 1 -- 172.21.15.102:0/1181126876 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff75407f070 con 0x7ff75c04ea80 2024-09-13T19:16:20.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.651+0000 7ff762513640 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef148e0 con 0x562b0ef104a0 2024-09-13T19:16:20.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.651+0000 7ff762d14640 1 -- 172.21.15.102:0/1181126876 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff75c03a030 con 0x562b0ef104a0 2024-09-13T19:16:20.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.652+0000 7ff762d14640 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef148e0 con 0x562b0ef0bab0 2024-09-13T19:16:20.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.652+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff74c02a040 con 0x562b0ef0bab0 2024-09-13T19:16:20.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.652+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef148e0 con 0x7ff754078070 2024-09-13T19:16:20.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.652+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff74c02a040 con 0x7ff754078070 2024-09-13T19:16:20.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.652+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef148e0 con 0x562b0ef0bab0 2024-09-13T19:16:20.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.652+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff74c02a040 con 0x562b0ef0bab0 2024-09-13T19:16:20.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.652+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef148e0 con 0x7ff75c04ea80 2024-09-13T19:16:20.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.652+0000 7ff762513640 1 -- 172.21.15.102:0/1181126876 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff75407f070 con 0x7ff75c04ea80 2024-09-13T19:16:20.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.653+0000 7ff762513640 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff7540aa060 con 0x562b0ef104a0 2024-09-13T19:16:20.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.653+0000 7ff762d14640 1 -- 172.21.15.102:0/1181126876 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff75c03a030 con 0x562b0ef104a0 2024-09-13T19:16:20.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.653+0000 7ff762d14640 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff7540aa060 con 0x562b0ef104a0 2024-09-13T19:16:20.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.653+0000 7ff762d14640 1 -- 172.21.15.102:0/1181126876 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff75c03a030 con 0x562b0ef104a0 2024-09-13T19:16:20.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.653+0000 7ff762d14640 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff7540aa060 con 0x7ff754078070 2024-09-13T19:16:20.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.653+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff74c02a040 con 0x7ff754078070 2024-09-13T19:16:20.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.653+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff7540aa060 con 0x562b0ef104a0 2024-09-13T19:16:20.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.654+0000 7ff762d14640 1 -- 172.21.15.102:0/1181126876 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff75c03a030 con 0x562b0ef104a0 2024-09-13T19:16:20.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.654+0000 7ff762d14640 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff7540aa060 con 0x562b0ef104a0 2024-09-13T19:16:20.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.654+0000 7ff762d14640 1 -- 172.21.15.102:0/1181126876 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff75c03a030 con 0x562b0ef104a0 2024-09-13T19:16:20.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.654+0000 7ff762d14640 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff7540aa060 con 0x562b0ef0bab0 2024-09-13T19:16:20.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.654+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff74c02a040 con 0x562b0ef0bab0 2024-09-13T19:16:20.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.654+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff7540aa060 con 0x562b0ef0bab0 2024-09-13T19:16:20.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.654+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff74c02a040 con 0x562b0ef0bab0 2024-09-13T19:16:20.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.654+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff7540aa060 con 0x7ff754078070 2024-09-13T19:16:20.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.655+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff74c02a040 con 0x7ff754078070 2024-09-13T19:16:20.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.655+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff7540aa060 con 0x562b0ef104a0 2024-09-13T19:16:20.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.655+0000 7ff762d14640 1 -- 172.21.15.102:0/1181126876 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff75c03a030 con 0x562b0ef104a0 2024-09-13T19:16:20.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.655+0000 7ff762d14640 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff7540aa060 con 0x7ff75c04ea80 2024-09-13T19:16:20.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.655+0000 7ff762513640 1 -- 172.21.15.102:0/1181126876 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff75407f070 con 0x7ff75c04ea80 2024-09-13T19:16:20.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.655+0000 7ff762513640 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff7540aa060 con 0x562b0ef0bab0 2024-09-13T19:16:20.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.655+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff74c02a040 con 0x562b0ef0bab0 2024-09-13T19:16:20.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.655+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff7540aa060 con 0x7ff754078070 2024-09-13T19:16:20.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.656+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff74c02a040 con 0x7ff754078070 2024-09-13T19:16:20.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.656+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff7540aa060 con 0x562b0ef104a0 2024-09-13T19:16:20.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.656+0000 7ff762d14640 1 -- 172.21.15.102:0/1181126876 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff75c03a030 con 0x562b0ef104a0 2024-09-13T19:16:20.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.656+0000 7ff762d14640 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff7540aa060 con 0x7ff754078070 2024-09-13T19:16:20.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.656+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff74c02a040 con 0x7ff754078070 2024-09-13T19:16:20.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.656+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff7540aa060 con 0x7ff75c04ea80 2024-09-13T19:16:20.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.656+0000 7ff762513640 1 -- 172.21.15.102:0/1181126876 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff75407f070 con 0x7ff75c04ea80 2024-09-13T19:16:20.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.656+0000 7ff762513640 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff7540aa060 con 0x562b0ef104a0 2024-09-13T19:16:20.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.657+0000 7ff762d14640 1 -- 172.21.15.102:0/1181126876 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff75c03a030 con 0x562b0ef104a0 2024-09-13T19:16:20.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.657+0000 7ff762d14640 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff7540aa060 con 0x7ff754078070 2024-09-13T19:16:20.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.657+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff74c02a040 con 0x7ff754078070 2024-09-13T19:16:20.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.657+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff7540aa060 con 0x562b0ef0bab0 2024-09-13T19:16:20.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.657+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff74c02a040 con 0x562b0ef0bab0 2024-09-13T19:16:20.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.657+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff7540aa060 con 0x7ff75c04ea80 2024-09-13T19:16:20.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.657+0000 7ff762513640 1 -- 172.21.15.102:0/1181126876 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff75407f070 con 0x7ff75c04ea80 2024-09-13T19:16:20.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.657+0000 7ff766926800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:20.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.657+0000 7ff766926800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:20.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.657+0000 7ff766926800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:20.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.657+0000 7ff766926800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:20.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.657+0000 7ff766926800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:20.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.657+0000 7ff766926800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:20.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.657+0000 7ff766926800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.657+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef13820 con 0x562b0ef0bab0 2024-09-13T19:16:20.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.658+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff74c02a040 con 0x562b0ef0bab0 2024-09-13T19:16:20.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.658+0000 7ff766926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:20.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.658+0000 7ff766926800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.658+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef13c10 con 0x562b0ef0bab0 2024-09-13T19:16:20.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.658+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff74c02a040 con 0x562b0ef0bab0 2024-09-13T19:16:20.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.658+0000 7ff766926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:20.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.658+0000 7ff766926800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.658+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef14d60 con 0x562b0ef104a0 2024-09-13T19:16:20.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.658+0000 7ff762d14640 1 -- 172.21.15.102:0/1181126876 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff75c03a030 con 0x562b0ef104a0 2024-09-13T19:16:20.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.658+0000 7ff766926800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:20.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.658+0000 7ff766926800 20 zone default found 2024-09-13T19:16:20.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.658+0000 7ff766926800 4 Realm: () 2024-09-13T19:16:20.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.658+0000 7ff766926800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:20.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.658+0000 7ff766926800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:20.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.658+0000 7ff766926800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:20.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.658+0000 7ff766926800 20 zonegroup default 2024-09-13T19:16:20.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.658+0000 7ff766926800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.658+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef13450 con 0x7ff754078070 2024-09-13T19:16:20.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.659+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff74c02a040 con 0x7ff754078070 2024-09-13T19:16:20.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.659+0000 7ff766926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:20.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.659+0000 7ff766926800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.659+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef17010 con 0x562b0ef104a0 2024-09-13T19:16:20.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.659+0000 7ff762d14640 1 -- 172.21.15.102:0/1181126876 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff75c03a030 con 0x562b0ef104a0 2024-09-13T19:16:20.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.659+0000 7ff766926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:20.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.659+0000 7ff766926800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.659+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef173b0 con 0x562b0ef104a0 2024-09-13T19:16:20.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.659+0000 7ff762d14640 1 -- 172.21.15.102:0/1181126876 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff75c03a030 con 0x562b0ef104a0 2024-09-13T19:16:20.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.659+0000 7ff766926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:20.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.659+0000 7ff766926800 20 started sync module instance, tier type = 2024-09-13T19:16:20.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.659+0000 7ff766926800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:20.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.659+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef164b0 con 0x7ff75c04ea80 2024-09-13T19:16:20.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.660+0000 7ff762513640 1 -- 172.21.15.102:0/1181126876 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(44 notify.0 [create] v34'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff75407f070 con 0x7ff75c04ea80 2024-09-13T19:16:20.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.660+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94742934282240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef177a0 con 0x7ff75c04ea80 2024-09-13T19:16:20.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.660+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef17ff0 con 0x562b0ef0bab0 2024-09-13T19:16:20.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.661+0000 7ff762513640 1 -- 172.21.15.102:0/1181126876 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94742934282240] v34'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff75407f070 con 0x7ff75c04ea80 2024-09-13T19:16:20.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.661+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v34'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff74c02a040 con 0x562b0ef0bab0 2024-09-13T19:16:20.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.661+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94742934284496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef180d0 con 0x562b0ef0bab0 2024-09-13T19:16:20.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.661+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef18bf0 con 0x562b0ef104a0 2024-09-13T19:16:20.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.662+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94742934284496] v34'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff74c02a040 con 0x562b0ef0bab0 2024-09-13T19:16:20.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.663+0000 7ff762d14640 1 -- 172.21.15.102:0/1181126876 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v34'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff75c03a030 con 0x562b0ef104a0 2024-09-13T19:16:20.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.663+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94742934292160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef18bb0 con 0x562b0ef104a0 2024-09-13T19:16:20.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.663+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef19650 con 0x7ff75c04ea80 2024-09-13T19:16:20.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.664+0000 7ff762513640 1 -- 172.21.15.102:0/1181126876 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(50 notify.3 [create] v34'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff75407f070 con 0x7ff75c04ea80 2024-09-13T19:16:20.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.664+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94742934294912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef19f20 con 0x7ff75c04ea80 2024-09-13T19:16:20.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.664+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef1a9e0 con 0x562b0ef0bab0 2024-09-13T19:16:20.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.664+0000 7ff762d14640 1 -- 172.21.15.102:0/1181126876 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94742934292160] v34'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff75c03a030 con 0x562b0ef104a0 2024-09-13T19:16:20.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.665+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v34'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff74c02a040 con 0x562b0ef0bab0 2024-09-13T19:16:20.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.665+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94742934299824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef1a9a0 con 0x562b0ef0bab0 2024-09-13T19:16:20.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.665+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef1b470 con 0x7ff754078070 2024-09-13T19:16:20.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.665+0000 7ff762513640 1 -- 172.21.15.102:0/1181126876 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94742934294912] v34'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff75407f070 con 0x7ff75c04ea80 2024-09-13T19:16:20.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.666+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94742934299824] v34'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff74c02a040 con 0x562b0ef0bab0 2024-09-13T19:16:20.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.667+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(54 notify.5 [create] v34'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff74c02a040 con 0x7ff754078070 2024-09-13T19:16:20.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.667+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94742934289216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef1b470 con 0x7ff754078070 2024-09-13T19:16:20.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.667+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef1bd40 con 0x7ff754078070 2024-09-13T19:16:20.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.668+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94742934289216] v34'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff74c02a040 con 0x7ff754078070 2024-09-13T19:16:20.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.668+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(56 notify.6 [create] v34'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff74c02a040 con 0x7ff754078070 2024-09-13T19:16:20.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.668+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94742934302624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef1b920 con 0x7ff754078070 2024-09-13T19:16:20.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.668+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef1c340 con 0x7ff754078070 2024-09-13T19:16:20.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.669+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94742934302624] v34'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff74c02a040 con 0x7ff754078070 2024-09-13T19:16:20.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.669+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(58 notify.7 [create] v34'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff74c02a040 con 0x7ff754078070 2024-09-13T19:16:20.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.669+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94742934306352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef1c520 con 0x7ff754078070 2024-09-13T19:16:20.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.669+0000 7ff766926800 20 add_watcher() i=0 2024-09-13T19:16:20.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.669+0000 7ff766926800 20 add_watcher() i=1 2024-09-13T19:16:20.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.669+0000 7ff766926800 20 add_watcher() i=2 2024-09-13T19:16:20.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.669+0000 7ff766926800 20 add_watcher() i=3 2024-09-13T19:16:20.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.669+0000 7ff766926800 20 add_watcher() i=4 2024-09-13T19:16:20.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.669+0000 7ff766926800 20 add_watcher() i=5 2024-09-13T19:16:20.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.669+0000 7ff766926800 20 add_watcher() i=6 2024-09-13T19:16:20.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.670+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94742934306352] v34'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff74c02a040 con 0x7ff754078070 2024-09-13T19:16:20.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.670+0000 7ff766926800 20 add_watcher() i=7 2024-09-13T19:16:20.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.670+0000 7ff766926800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:20.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.670+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef1f8f0 con 0x562b0ef0bab0 2024-09-13T19:16:20.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.671+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff74c02a040 con 0x562b0ef0bab0 2024-09-13T19:16:20.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.671+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94742934307856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef1cce0 con 0x562b0ef0bab0 2024-09-13T19:16:20.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.672+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94742934307856] v34'134 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff74c02a040 con 0x562b0ef0bab0 2024-09-13T19:16:20.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.672+0000 7ff618fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:20.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.672+0000 7ff766926800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:20.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.672+0000 7ff766926800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:20.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.672+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef28230 con 0x562b0ef0bab0 2024-09-13T19:16:20.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.673+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff74c02a040 con 0x562b0ef0bab0 2024-09-13T19:16:20.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.673+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef28880 con 0x7ff754078070 2024-09-13T19:16:20.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.674+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'16 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff74c02a040 con 0x7ff754078070 2024-09-13T19:16:20.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.674+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef28ce0 con 0x562b0ef104a0 2024-09-13T19:16:20.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.675+0000 7ff762d14640 1 -- 172.21.15.102:0/1181126876 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff75c03a030 con 0x562b0ef104a0 2024-09-13T19:16:20.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.675+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef28b70 con 0x562b0ef0bab0 2024-09-13T19:16:20.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.676+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'135 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff74c02a040 con 0x562b0ef0bab0 2024-09-13T19:16:20.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.676+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef291c0 con 0x7ff75c04ea80 2024-09-13T19:16:20.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.677+0000 7ff762513640 1 -- 172.21.15.102:0/1181126876 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'38 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff75407f070 con 0x7ff75c04ea80 2024-09-13T19:16:20.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.677+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef29670 con 0x562b0ef104a0 2024-09-13T19:16:20.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.678+0000 7ff762d14640 1 -- 172.21.15.102:0/1181126876 <== osd.3 v2:172.21.15.102:6800/3096737090 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'26 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff75c03a030 con 0x562b0ef104a0 2024-09-13T19:16:20.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.678+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef29670 con 0x562b0ef0bab0 2024-09-13T19:16:20.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.679+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff74c02a040 con 0x562b0ef0bab0 2024-09-13T19:16:20.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.679+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef29a90 con 0x7ff754078070 2024-09-13T19:16:20.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.680+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'25 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff74c02a040 con 0x7ff754078070 2024-09-13T19:16:20.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.680+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef29a90 con 0x7ff75c04ea80 2024-09-13T19:16:20.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.682+0000 7ff762513640 1 -- 172.21.15.102:0/1181126876 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff75407f070 con 0x7ff75c04ea80 2024-09-13T19:16:20.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.682+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef29f40 con 0x562b0ef104a0 2024-09-13T19:16:20.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.683+0000 7ff762d14640 1 -- 172.21.15.102:0/1181126876 <== osd.3 v2:172.21.15.102:6800/3096737090 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff75c03a030 con 0x562b0ef104a0 2024-09-13T19:16:20.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.683+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef29f40 con 0x7ff75c04ea80 2024-09-13T19:16:20.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.683+0000 7ff762513640 1 -- 172.21.15.102:0/1181126876 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'39 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff75407f070 con 0x7ff75c04ea80 2024-09-13T19:16:20.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.684+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef29f40 con 0x7ff754078070 2024-09-13T19:16:20.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.684+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff74c02a040 con 0x7ff754078070 2024-09-13T19:16:20.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.685+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef29f40 con 0x7ff75c04ea80 2024-09-13T19:16:20.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.685+0000 7ff762513640 1 -- 172.21.15.102:0/1181126876 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff75407f070 con 0x7ff75c04ea80 2024-09-13T19:16:20.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.685+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef29f40 con 0x7ff754078070 2024-09-13T19:16:20.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.686+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.0 v2:172.21.15.53:6800/4021716951 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'31 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff74c02a040 con 0x7ff754078070 2024-09-13T19:16:20.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.687+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef29f40 con 0x562b0ef0bab0 2024-09-13T19:16:20.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.687+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'136 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff74c02a040 con 0x562b0ef0bab0 2024-09-13T19:16:20.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.687+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef29f40 con 0x562b0ef104a0 2024-09-13T19:16:20.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.688+0000 7ff762d14640 1 -- 172.21.15.102:0/1181126876 <== osd.3 v2:172.21.15.102:6800/3096737090 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'32 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff75c03a030 con 0x562b0ef104a0 2024-09-13T19:16:20.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.688+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef29f40 con 0x7ff75c04ea80 2024-09-13T19:16:20.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.689+0000 7ff762513640 1 -- 172.21.15.102:0/1181126876 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'40 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff75407f070 con 0x7ff75c04ea80 2024-09-13T19:16:20.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.689+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef29f40 con 0x562b0ef104a0 2024-09-13T19:16:20.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.690+0000 7ff762d14640 1 -- 172.21.15.102:0/1181126876 <== osd.3 v2:172.21.15.102:6800/3096737090 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff75c03a030 con 0x562b0ef104a0 2024-09-13T19:16:20.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.690+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef29f40 con 0x562b0ef0bab0 2024-09-13T19:16:20.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.691+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff74c02a040 con 0x562b0ef0bab0 2024-09-13T19:16:20.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.691+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef29f40 con 0x562b0ef0bab0 2024-09-13T19:16:20.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.692+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'137 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff74c02a040 con 0x562b0ef0bab0 2024-09-13T19:16:20.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.692+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef29f40 con 0x562b0ef104a0 2024-09-13T19:16:20.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.693+0000 7ff762d14640 1 -- 172.21.15.102:0/1181126876 <== osd.3 v2:172.21.15.102:6800/3096737090 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'33 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff75c03a030 con 0x562b0ef104a0 2024-09-13T19:16:20.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.693+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef29f40 con 0x7ff75c04ea80 2024-09-13T19:16:20.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.694+0000 7ff762513640 1 -- 172.21.15.102:0/1181126876 <== osd.2 v2:172.21.15.102:6816/2238176080 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff75407f070 con 0x7ff75c04ea80 2024-09-13T19:16:20.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.694+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef29f40 con 0x562b0ef104a0 2024-09-13T19:16:20.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.695+0000 7ff762d14640 1 -- 172.21.15.102:0/1181126876 <== osd.3 v2:172.21.15.102:6800/3096737090 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff75c03a030 con 0x562b0ef104a0 2024-09-13T19:16:20.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.695+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef29f40 con 0x562b0ef104a0 2024-09-13T19:16:20.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.696+0000 7ff762d14640 1 -- 172.21.15.102:0/1181126876 <== osd.3 v2:172.21.15.102:6800/3096737090 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff75c03a030 con 0x562b0ef104a0 2024-09-13T19:16:20.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.696+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef29f40 con 0x562b0ef104a0 2024-09-13T19:16:20.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.697+0000 7ff762d14640 1 -- 172.21.15.102:0/1181126876 <== osd.3 v2:172.21.15.102:6800/3096737090 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff75c03a030 con 0x562b0ef104a0 2024-09-13T19:16:20.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.697+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef29f40 con 0x562b0ef104a0 2024-09-13T19:16:20.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.698+0000 7ff762d14640 1 -- 172.21.15.102:0/1181126876 <== osd.3 v2:172.21.15.102:6800/3096737090 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'27 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff75c03a030 con 0x562b0ef104a0 2024-09-13T19:16:20.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.698+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef29f40 con 0x7ff754078070 2024-09-13T19:16:20.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.699+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.0 v2:172.21.15.53:6800/4021716951 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff74c02a040 con 0x7ff754078070 2024-09-13T19:16:20.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.699+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef29f40 con 0x562b0ef104a0 2024-09-13T19:16:20.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.700+0000 7ff762d14640 1 -- 172.21.15.102:0/1181126876 <== osd.3 v2:172.21.15.102:6800/3096737090 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff75c03a030 con 0x562b0ef104a0 2024-09-13T19:16:20.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.700+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef29f40 con 0x7ff754078070 2024-09-13T19:16:20.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.701+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.0 v2:172.21.15.53:6800/4021716951 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'26 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff74c02a040 con 0x7ff754078070 2024-09-13T19:16:20.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.701+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef29fd0 con 0x562b0ef104a0 2024-09-13T19:16:20.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.702+0000 7ff762d14640 1 -- 172.21.15.102:0/1181126876 <== osd.3 v2:172.21.15.102:6800/3096737090 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'34 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff75c03a030 con 0x562b0ef104a0 2024-09-13T19:16:20.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.702+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef29fd0 con 0x7ff754078070 2024-09-13T19:16:20.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.703+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.0 v2:172.21.15.53:6800/4021716951 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'32 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff74c02a040 con 0x7ff754078070 2024-09-13T19:16:20.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.703+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef29fd0 con 0x7ff75c04ea80 2024-09-13T19:16:20.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.705+0000 7ff762513640 1 -- 172.21.15.102:0/1181126876 <== osd.2 v2:172.21.15.102:6816/2238176080 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff75407f070 con 0x7ff75c04ea80 2024-09-13T19:16:20.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.705+0000 7ff5937fe640 20 reqs_thread_entry: start 2024-09-13T19:16:20.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.705+0000 7ff766926800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:20.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.705+0000 7ff766926800 20 Filter name: none 2024-09-13T19:16:20.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.705+0000 7ff5917fa640 20 reqs_thread_entry: start 2024-09-13T19:16:20.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.705+0000 7ff766926800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-13T19:16:20.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.705+0000 7ff766926800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.705+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef55070 con 0x7ff754078070 2024-09-13T19:16:20.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.706+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.0 v2:172.21.15.53:6800/4021716951 24 ==== osd_op_reply(94 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7ff74c02a040 con 0x7ff754078070 2024-09-13T19:16:20.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.706+0000 7ff766926800 20 rados_obj.operate() r=0 bl.length=419 2024-09-13T19:16:20.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.706+0000 7ff766926800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-13T19:16:20.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.706+0000 7ff766926800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-13T19:16:20.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.706+0000 7ff766926800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:16:20.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.706+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:95 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef54b50 con 0x562b0ef0bab0 2024-09-13T19:16:20.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.706+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(95 testx$tenanteduser.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 170+0+15 (crc 0 0 0) 0x7ff74c02a040 con 0x562b0ef0bab0 2024-09-13T19:16:20.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.706+0000 7ff766926800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-13T19:16:20.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.706+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef54b50 con 0x7ff754078070 2024-09-13T19:16:20.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.707+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.0 v2:172.21.15.53:6800/4021716951 25 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v34'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7ff74c02a040 con 0x7ff754078070 2024-09-13T19:16:20.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.707+0000 7ff766926800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T19:16:20.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.707+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94742934545904 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef57ed0 con 0x562b0ef104a0 2024-09-13T19:16:20.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.707+0000 7ff762d14640 1 -- 172.21.15.102:0/1181126876 <== osd.3 v2:172.21.15.102:6800/3096737090 28 ==== watch-notify(notify (1) cookie 94742934292160 notify 146028888069 ret 0) ==== 212+0+0 (crc 0 0 0) 0x562b0ef29390 con 0x562b0ef104a0 2024-09-13T19:16:20.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.707+0000 7ff645ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888069 cookie 94742934292160 notifier 4573 bl.length()=170 2024-09-13T19:16:20.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.707+0000 7ff762d14640 1 -- 172.21.15.102:0/1181126876 <== osd.3 v2:172.21.15.102:6800/3096737090 29 ==== osd_op_reply(97 notify.2 [notify cookie 94742934545904 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff75c03a030 con 0x562b0ef104a0 2024-09-13T19:16:20.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.707+0000 7ff645ffb640 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7ff628003d60 con 0x562b0ef104a0 2024-09-13T19:16:20.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.708+0000 7ff762d14640 1 -- 172.21.15.102:0/1181126876 <== osd.3 v2:172.21.15.102:6800/3096737090 30 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff75c03a030 con 0x562b0ef104a0 2024-09-13T19:16:20.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.708+0000 7ff762d14640 1 -- 172.21.15.102:0/1181126876 <== osd.3 v2:172.21.15.102:6800/3096737090 31 ==== watch-notify(notify_complete (2) cookie 94742934545904 notify 146028888069 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7ff75c060020 con 0x562b0ef104a0 2024-09-13T19:16:20.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.708+0000 7ff766926800 10 removing email index: 2024-09-13T19:16:20.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.708+0000 7ff766926800 10 removing user buckets index 2024-09-13T19:16:20.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.708+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:99 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef55a90 con 0x562b0ef0bab0 2024-09-13T19:16:20.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.709+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.1 v2:172.21.15.102:6808/2204418452 28 ==== osd_op_reply(99 testx$tenanteduser.buckets [delete] v34'3 uv3 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7ff74c02a040 con 0x562b0ef0bab0 2024-09-13T19:16:20.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.709+0000 7ff766926800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2024-09-13T19:16:20.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.709+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [notify cookie 94742934545904 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef57ed0 con 0x562b0ef0bab0 2024-09-13T19:16:20.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.709+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.1 v2:172.21.15.102:6808/2204418452 29 ==== watch-notify(notify (1) cookie 94742934299824 notify 146028888082 ret 0) ==== 217+0+0 (crc 0 0 0) 0x562b0ef28f10 con 0x562b0ef0bab0 2024-09-13T19:16:20.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.709+0000 7ff645ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888082 cookie 94742934299824 notifier 4573 bl.length()=175 2024-09-13T19:16:20.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.709+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.1 v2:172.21.15.102:6808/2204418452 30 ==== osd_op_reply(100 notify.4 [notify cookie 94742934545904 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff74c02a040 con 0x562b0ef0bab0 2024-09-13T19:16:20.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.709+0000 7ff645ffb640 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7ff628003d60 con 0x562b0ef0bab0 2024-09-13T19:16:20.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.709+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.1 v2:172.21.15.102:6808/2204418452 31 ==== watch-notify(notify_complete (2) cookie 94742934545904 notify 146028888082 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562b0ef28880 con 0x562b0ef0bab0 2024-09-13T19:16:20.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.709+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.1 v2:172.21.15.102:6808/2204418452 32 ==== osd_op_reply(101 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff74c02a040 con 0x562b0ef0bab0 2024-09-13T19:16:20.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.709+0000 7ff766926800 10 removing user index: testx$tenanteduser 2024-09-13T19:16:20.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.709+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:102 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef59c30 con 0x7ff754078070 2024-09-13T19:16:20.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.711+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.0 v2:172.21.15.53:6800/4021716951 26 ==== osd_op_reply(102 testx$tenanteduser [call,call,delete] v34'8 uv8 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7ff74c02a040 con 0x7ff754078070 2024-09-13T19:16:20.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.711+0000 7ff766926800 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2024-09-13T19:16:20.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.711+0000 7ff766926800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-13T19:16:20.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.711+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [notify cookie 94742934558592 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef59ba0 con 0x7ff75c04ea80 2024-09-13T19:16:20.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.711+0000 7ff762513640 1 -- 172.21.15.102:0/1181126876 <== osd.2 v2:172.21.15.102:6816/2238176080 18 ==== watch-notify(notify (1) cookie 94742934294912 notify 146028888079 ret 0) ==== 209+0+0 (crc 0 0 0) 0x562b0ef27c30 con 0x7ff75c04ea80 2024-09-13T19:16:20.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.711+0000 7ff6457fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888079 cookie 94742934294912 notifier 4573 bl.length()=167 2024-09-13T19:16:20.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.711+0000 7ff762513640 1 -- 172.21.15.102:0/1181126876 <== osd.2 v2:172.21.15.102:6816/2238176080 19 ==== osd_op_reply(103 notify.3 [notify cookie 94742934558592 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff75407f070 con 0x7ff75c04ea80 2024-09-13T19:16:20.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.711+0000 7ff6457fa640 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7ff5980032c0 con 0x7ff75c04ea80 2024-09-13T19:16:20.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.711+0000 7ff762513640 1 -- 172.21.15.102:0/1181126876 <== osd.2 v2:172.21.15.102:6816/2238176080 20 ==== watch-notify(notify_complete (2) cookie 94742934558592 notify 146028888079 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7ff7540a4040 con 0x7ff75c04ea80 2024-09-13T19:16:20.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.712+0000 7ff762513640 1 -- 172.21.15.102:0/1181126876 <== osd.2 v2:172.21.15.102:6816/2238176080 21 ==== osd_op_reply(104 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff75407f070 con 0x7ff75c04ea80 2024-09-13T19:16:20.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.712+0000 7ff618fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:20.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.712+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94742934307856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef59c30 con 0x562b0ef0bab0 2024-09-13T19:16:20.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.713+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.1 v2:172.21.15.102:6808/2204418452 33 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94742934307856] v34'138 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff74c02a040 con 0x562b0ef0bab0 2024-09-13T19:16:20.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.713+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94742934282240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef59c30 con 0x7ff75c04ea80 2024-09-13T19:16:20.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.714+0000 7ff762513640 1 -- 172.21.15.102:0/1181126876 <== osd.2 v2:172.21.15.102:6816/2238176080 22 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94742934282240] v34'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff75407f070 con 0x7ff75c04ea80 2024-09-13T19:16:20.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.714+0000 7ff766926800 20 remove_watcher() i=0 2024-09-13T19:16:20.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.714+0000 7ff766926800 2 removed watcher, disabling cache 2024-09-13T19:16:20.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.714+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94742934284496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef59c30 con 0x562b0ef0bab0 2024-09-13T19:16:20.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.715+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.1 v2:172.21.15.102:6808/2204418452 34 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94742934284496] v34'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff74c02a040 con 0x562b0ef0bab0 2024-09-13T19:16:20.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.715+0000 7ff766926800 20 remove_watcher() i=1 2024-09-13T19:16:20.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.715+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94742934292160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef59c30 con 0x562b0ef104a0 2024-09-13T19:16:20.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.716+0000 7ff762d14640 1 -- 172.21.15.102:0/1181126876 <== osd.3 v2:172.21.15.102:6800/3096737090 32 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94742934292160] v34'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff75c03a030 con 0x562b0ef104a0 2024-09-13T19:16:20.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.716+0000 7ff766926800 20 remove_watcher() i=2 2024-09-13T19:16:20.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.716+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94742934294912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef59c30 con 0x7ff75c04ea80 2024-09-13T19:16:20.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.717+0000 7ff762513640 1 -- 172.21.15.102:0/1181126876 <== osd.2 v2:172.21.15.102:6816/2238176080 23 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94742934294912] v34'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff75407f070 con 0x7ff75c04ea80 2024-09-13T19:16:20.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.717+0000 7ff766926800 20 remove_watcher() i=3 2024-09-13T19:16:20.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.717+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94742934299824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef59c30 con 0x562b0ef0bab0 2024-09-13T19:16:20.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.718+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.1 v2:172.21.15.102:6808/2204418452 35 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94742934299824] v34'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff74c02a040 con 0x562b0ef0bab0 2024-09-13T19:16:20.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.718+0000 7ff766926800 20 remove_watcher() i=4 2024-09-13T19:16:20.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.718+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94742934289216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef59c30 con 0x7ff754078070 2024-09-13T19:16:20.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.720+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.0 v2:172.21.15.53:6800/4021716951 27 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94742934289216] v34'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff74c02a040 con 0x7ff754078070 2024-09-13T19:16:20.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.720+0000 7ff766926800 20 remove_watcher() i=5 2024-09-13T19:16:20.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.720+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94742934302624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef59c30 con 0x7ff754078070 2024-09-13T19:16:20.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.721+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.0 v2:172.21.15.53:6800/4021716951 28 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94742934302624] v34'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff74c02a040 con 0x7ff754078070 2024-09-13T19:16:20.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.721+0000 7ff766926800 20 remove_watcher() i=6 2024-09-13T19:16:20.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.721+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94742934306352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562b0ef59c30 con 0x7ff754078070 2024-09-13T19:16:20.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.722+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 <== osd.0 v2:172.21.15.53:6800/4021716951 29 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94742934306352] v34'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff74c02a040 con 0x7ff754078070 2024-09-13T19:16:20.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.722+0000 7ff766926800 20 remove_watcher() i=7 2024-09-13T19:16:20.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.722+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7ff754078070 msgr2=0x7ff75408fa90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.722+0000 7ff766926800 1 --2- 172.21.15.102:0/1181126876 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7ff754078070 0x7ff75408fa90 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.722+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x562b0ef0bab0 msgr2=0x562b0ef0df70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.722+0000 7ff766926800 1 --2- 172.21.15.102:0/1181126876 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x562b0ef0bab0 0x562b0ef0df70 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.722+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7ff75c04ea80 msgr2=0x7ff75c01a0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.722+0000 7ff766926800 1 --2- 172.21.15.102:0/1181126876 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7ff75c04ea80 0x7ff75c01a0b0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.722+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x562b0ef104a0 msgr2=0x562b0ef12890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.722+0000 7ff766926800 1 --2- 172.21.15.102:0/1181126876 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x562b0ef104a0 0x562b0ef12890 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.722+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff62c036b90 msgr2=0x7ff62c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.722+0000 7ff766926800 1 --2- 172.21.15.102:0/1181126876 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff62c036b90 0x7ff62c039050 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff75406ef90 tx=0x7ff754087000 comp rx=0 tx=0).stop 2024-09-13T19:16:20.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.722+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b0edd83e0 msgr2=0x562b0eefffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.722+0000 7ff766926800 1 --2- 172.21.15.102:0/1181126876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b0edd83e0 0x562b0eefffc0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7ff75c020ee0 tx=0x7ff75c04cd00 comp rx=0 tx=0).stop 2024-09-13T19:16:20.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.722+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 reap_dead start 2024-09-13T19:16:20.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.722+0000 7ff759d12640 1 -- 172.21.15.102:0/1181126876 reap_dead start 2024-09-13T19:16:20.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.722+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 shutdown_connections 2024-09-13T19:16:20.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.722+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 >> 172.21.15.102:0/1181126876 conn(0x562b0eef2ca0 msgr2=0x562b0eef0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:20.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.722+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 shutdown_connections 2024-09-13T19:16:20.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.722+0000 7ff766926800 1 -- 172.21.15.102:0/1181126876 wait complete. 2024-09-13T19:16:20.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.723+0000 7ff766926800 1 -- 172.21.15.102:0/190853589 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff63c036b90 msgr2=0x7ff63c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.723+0000 7ff766926800 1 --2- 172.21.15.102:0/190853589 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff63c036b90 0x7ff63c039050 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff75406ffd0 tx=0x7ff75408f130 comp rx=0 tx=0).stop 2024-09-13T19:16:20.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.723+0000 7ff766926800 1 -- 172.21.15.102:0/190853589 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b0eee9c90 msgr2=0x562b0eeea0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.723+0000 7ff766926800 1 --2- 172.21.15.102:0/190853589 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b0eee9c90 0x562b0eeea0b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x562b0eed69f0 tx=0x7ff75c0167b0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.723+0000 7ff766926800 1 -- 172.21.15.102:0/190853589 shutdown_connections 2024-09-13T19:16:20.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.723+0000 7ff766926800 1 --2- 172.21.15.102:0/190853589 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff63c036b90 0x7ff63c039050 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.723+0000 7ff766926800 1 --2- 172.21.15.102:0/190853589 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b0eee9c90 0x562b0eeea0b0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.723+0000 7ff766926800 1 -- 172.21.15.102:0/190853589 >> 172.21.15.102:0/190853589 conn(0x562b0eedec20 msgr2=0x562b0eee17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:20.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.723+0000 7ff766926800 1 -- 172.21.15.102:0/190853589 shutdown_connections 2024-09-13T19:16:20.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.723+0000 7ff766926800 1 -- 172.21.15.102:0/190853589 wait complete. 2024-09-13T19:16:20.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.723+0000 7ff766926800 1 -- 172.21.15.102:0/3196734502 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x562b0eddb6a0 msgr2=0x562b0eed6090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.723+0000 7ff766926800 1 --2- 172.21.15.102:0/3196734502 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x562b0eddb6a0 0x562b0eed6090 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.723+0000 7ff766926800 1 -- 172.21.15.102:0/3196734502 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x562b0eed8920 msgr2=0x562b0eedad10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.723+0000 7ff766926800 1 --2- 172.21.15.102:0/3196734502 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x562b0eed8920 0x562b0eedad10 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.723+0000 7ff766926800 1 -- 172.21.15.102:0/3196734502 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff648036be0 msgr2=0x7ff6480390a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.723+0000 7ff766926800 1 --2- 172.21.15.102:0/3196734502 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff648036be0 0x7ff6480390a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff74c000f60 tx=0x7ff74c0013f0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.723+0000 7ff766926800 1 -- 172.21.15.102:0/3196734502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b0ed4beb0 msgr2=0x562b0eecf020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.723+0000 7ff766926800 1 --2- 172.21.15.102:0/3196734502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b0ed4beb0 0x562b0eecf020 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ff754067040 tx=0x7ff754002fb0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.723+0000 7ff766926800 1 -- 172.21.15.102:0/3196734502 shutdown_connections 2024-09-13T19:16:20.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.723+0000 7ff766926800 1 --2- 172.21.15.102:0/3196734502 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x562b0eed8920 0x562b0eedad10 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.723+0000 7ff766926800 1 --2- 172.21.15.102:0/3196734502 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x562b0eddb6a0 0x562b0eed6090 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.723+0000 7ff766926800 1 --2- 172.21.15.102:0/3196734502 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff648036be0 0x7ff6480390a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.723+0000 7ff766926800 1 --2- 172.21.15.102:0/3196734502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562b0ed4beb0 0x562b0eecf020 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.723+0000 7ff766926800 1 -- 172.21.15.102:0/3196734502 >> 172.21.15.102:0/3196734502 conn(0x562b0edd2dd0 msgr2=0x562b0eec1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:20.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.723+0000 7ff766926800 1 -- 172.21.15.102:0/3196734502 shutdown_connections 2024-09-13T19:16:20.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.723+0000 7ff766926800 1 -- 172.21.15.102:0/3196734502 wait complete. 2024-09-13T19:16:20.742 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-13T19:16:20.745 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2024-09-13T19:16:20.789 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:16:20.790 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-13T19:16:20.790 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-13T19:16:20.790 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2024-09-13T19:16:20.836 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:20.837 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:20.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.834+0000 7f2e9a71f800 1 Processor -- start 2024-09-13T19:16:20.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.834+0000 7f2e9a71f800 1 -- start start 2024-09-13T19:16:20.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.834+0000 7f2e9a71f800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x558c53ec7880 0x558c53ec9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.834+0000 7f2e9a71f800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558c53d82b30 con 0x558c53e376d0 2024-09-13T19:16:20.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.834+0000 7f2e9a71f800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x558c53d64360 con 0x558c53ec7880 2024-09-13T19:16:20.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.834+0000 7f2e95b94640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x558c53ec7880 0x558c53ec9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.835+0000 7f2e96395640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x558c53e376d0 0x558c53ec6160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:50070/0 (socket says 172.21.15.102:50070) 2024-09-13T19:16:20.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.835+0000 7f2e96395640 1 -- 172.21.15.102:0/172326370 learned_addr learned my addr 172.21.15.102:0/172326370 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:16:20.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.835+0000 7f2e95b94640 1 -- 172.21.15.102:0/172326370 >> v1:172.21.15.53:6789/0 conn(0x558c53e376d0 legacy=0x558c53ec6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.835+0000 7f2e95b94640 1 -- 172.21.15.102:0/172326370 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c53d8ae00 con 0x558c53ec7880 2024-09-13T19:16:20.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.837+0000 7f2e95b94640 1 --2- 172.21.15.102:0/172326370 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c53ec7880 0x558c53ec9c90 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c00a470 tx=0x7f2e8c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e286d30378f78402 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.837+0000 7f2e95393640 1 -- 172.21.15.102:0/172326370 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e8c053570 con 0x558c53ec7880 2024-09-13T19:16:20.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.837+0000 7f2e95393640 1 -- 172.21.15.102:0/172326370 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e8c058070 con 0x558c53ec7880 2024-09-13T19:16:20.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.837+0000 7f2e95393640 1 -- 172.21.15.102:0/172326370 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e8c053880 con 0x558c53ec7880 2024-09-13T19:16:20.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.837+0000 7f2e9a71f800 1 -- 172.21.15.102:0/172326370 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c53ec7880 msgr2=0x558c53ec9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.837+0000 7f2e9a71f800 1 --2- 172.21.15.102:0/172326370 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c53ec7880 0x558c53ec9c90 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c00a470 tx=0x7f2e8c045a20 comp rx=0 tx=0).stop 2024-09-13T19:16:20.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.837+0000 7f2e9a71f800 1 -- 172.21.15.102:0/172326370 shutdown_connections 2024-09-13T19:16:20.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.837+0000 7f2e9a71f800 1 --2- 172.21.15.102:0/172326370 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c53ec7880 0x558c53ec9c90 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.837+0000 7f2e9a71f800 1 -- 172.21.15.102:0/172326370 >> 172.21.15.102:0/172326370 conn(0x558c53ebddb0 msgr2=0x558c53ec01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:20.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.837+0000 7f2e9a71f800 1 -- 172.21.15.102:0/172326370 shutdown_connections 2024-09-13T19:16:20.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.837+0000 7f2e9a71f800 1 -- 172.21.15.102:0/172326370 wait complete. 2024-09-13T19:16:20.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.851+0000 7f2e9a71f800 1 Processor -- start 2024-09-13T19:16:20.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.851+0000 7f2e9a71f800 1 -- start start 2024-09-13T19:16:20.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.851+0000 7f2e9a71f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c53e376d0 0x558c53fb2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.851+0000 7f2e9a71f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558c53e0f360 con 0x558c53e376d0 2024-09-13T19:16:20.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.851+0000 7f2e96395640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c53e376d0 0x558c53fb2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.851+0000 7f2e96395640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c53e376d0 0x558c53fb2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55990/0 (socket says 172.21.15.102:55990) 2024-09-13T19:16:20.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.851+0000 7f2e96395640 1 -- 172.21.15.102:0/1226095452 learned_addr learned my addr 172.21.15.102:0/1226095452 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:20.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.852+0000 7f2e96395640 1 -- 172.21.15.102:0/1226095452 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c53d5cbc0 con 0x558c53e376d0 2024-09-13T19:16:20.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.852+0000 7f2e96395640 1 --2- 172.21.15.102:0/1226095452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c53e376d0 0x558c53fb2870 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f2e88001e10 tx=0x7f2e8800b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1090cdbe63244736 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.852+0000 7f2d84608640 1 -- 172.21.15.102:0/1226095452 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e88012020 con 0x558c53e376d0 2024-09-13T19:16:20.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.852+0000 7f2d84608640 1 -- 172.21.15.102:0/1226095452 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e8800e5a0 con 0x558c53e376d0 2024-09-13T19:16:20.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.852+0000 7f2d84608640 1 -- 172.21.15.102:0/1226095452 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e8800e8e0 con 0x558c53e376d0 2024-09-13T19:16:20.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.853+0000 7f2e9a71f800 1 -- 172.21.15.102:0/1226095452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c53e376d0 msgr2=0x558c53fb2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.853+0000 7f2e9a71f800 1 --2- 172.21.15.102:0/1226095452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c53e376d0 0x558c53fb2870 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f2e88001e10 tx=0x7f2e8800b780 comp rx=0 tx=0).stop 2024-09-13T19:16:20.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.853+0000 7f2e9a71f800 1 -- 172.21.15.102:0/1226095452 shutdown_connections 2024-09-13T19:16:20.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.853+0000 7f2e9a71f800 1 --2- 172.21.15.102:0/1226095452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c53e376d0 0x558c53fb2870 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.853+0000 7f2e9a71f800 1 -- 172.21.15.102:0/1226095452 >> 172.21.15.102:0/1226095452 conn(0x558c53ebddb0 msgr2=0x558c53fae230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:20.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.853+0000 7f2e9a71f800 1 -- 172.21.15.102:0/1226095452 shutdown_connections 2024-09-13T19:16:20.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.853+0000 7f2e9a71f800 1 -- 172.21.15.102:0/1226095452 wait complete. 2024-09-13T19:16:20.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.853+0000 7f2e9a71f800 1 Processor -- start 2024-09-13T19:16:20.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.853+0000 7f2e9a71f800 1 -- start start 2024-09-13T19:16:20.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.853+0000 7f2e9a71f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c53e376d0 0x558c53fba280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.853+0000 7f2e9a71f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558c53eca610 con 0x558c53e376d0 2024-09-13T19:16:20.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.853+0000 7f2e96395640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c53e376d0 0x558c53fba280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.853+0000 7f2e96395640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c53e376d0 0x558c53fba280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55992/0 (socket says 172.21.15.102:55992) 2024-09-13T19:16:20.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.853+0000 7f2e96395640 1 -- 172.21.15.102:0/3305222694 learned_addr learned my addr 172.21.15.102:0/3305222694 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:20.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.854+0000 7f2e96395640 1 -- 172.21.15.102:0/3305222694 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c53d70fe0 con 0x558c53e376d0 2024-09-13T19:16:20.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.854+0000 7f2e96395640 1 --2- 172.21.15.102:0/3305222694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c53e376d0 0x558c53fba280 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f2e8800b7c0 tx=0x7f2e88000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.854+0000 7f2d82e05640 1 -- 172.21.15.102:0/3305222694 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e88012030 con 0x558c53e376d0 2024-09-13T19:16:20.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.854+0000 7f2d82e05640 1 -- 172.21.15.102:0/3305222694 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e88001470 con 0x558c53e376d0 2024-09-13T19:16:20.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.854+0000 7f2e9a71f800 1 -- 172.21.15.102:0/3305222694 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558c53fba7c0 con 0x558c53e376d0 2024-09-13T19:16:20.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.854+0000 7f2d82e05640 1 -- 172.21.15.102:0/3305222694 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e8801a8d0 con 0x558c53e376d0 2024-09-13T19:16:20.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.854+0000 7f2e9a71f800 1 -- 172.21.15.102:0/3305222694 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c53fbace0 con 0x558c53e376d0 2024-09-13T19:16:20.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.855+0000 7f2d82e05640 1 -- 172.21.15.102:0/3305222694 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2e88015020 con 0x558c53e376d0 2024-09-13T19:16:20.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.855+0000 7f2d82e05640 1 --2- 172.21.15.102:0/3305222694 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2d7c036b90 0x7f2d7c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.855+0000 7f2d82e05640 1 -- 172.21.15.102:0/3305222694 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f2e88020030 con 0x558c53e376d0 2024-09-13T19:16:20.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.855+0000 7f2e95b94640 1 --2- 172.21.15.102:0/3305222694 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2d7c036b90 0x7f2d7c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.855+0000 7f2e9a71f800 1 --2- 172.21.15.102:0/3305222694 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x558c53ec7880 0x558c53fc12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.855+0000 7f2e9a71f800 1 -- 172.21.15.102:0/3305222694 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558c53fc1870 con 0x558c53ec7880 2024-09-13T19:16:20.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.855+0000 7f2e96b96640 1 --2- 172.21.15.102:0/3305222694 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x558c53ec7880 0x558c53fc12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.856+0000 7f2e95b94640 1 --2- 172.21.15.102:0/3305222694 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2d7c036b90 0x7f2d7c039050 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c057000 tx=0x7f2e8c052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.856+0000 7f2e96b96640 1 --2- 172.21.15.102:0/3305222694 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x558c53ec7880 0x558c53fc12f0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.856+0000 7f2e96b96640 1 -- 172.21.15.102:0/3305222694 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e9000a4a0 con 0x558c53ec7880 2024-09-13T19:16:20.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.856+0000 7f2e9a71f800 1 -- 172.21.15.102:0/3305222694 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558c53fbe8c0 con 0x558c53ec7880 2024-09-13T19:16:20.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.856+0000 7f2e96b96640 1 -- 172.21.15.102:0/3305222694 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2e9000a4a0 con 0x558c53ec7880 2024-09-13T19:16:20.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.856+0000 7f2e9a71f800 1 --2- 172.21.15.102:0/3305222694 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x558c53fc3b80 0x558c53fc5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.856+0000 7f2e9a71f800 1 -- 172.21.15.102:0/3305222694 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558c53fc6610 con 0x558c53fc3b80 2024-09-13T19:16:20.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.856+0000 7f2e96395640 1 --2- 172.21.15.102:0/3305222694 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x558c53fc3b80 0x558c53fc5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.857+0000 7f2e96395640 1 --2- 172.21.15.102:0/3305222694 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x558c53fc3b80 0x558c53fc5f70 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.857+0000 7f2e96395640 1 -- 172.21.15.102:0/3305222694 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2e8802dcf0 con 0x558c53fc3b80 2024-09-13T19:16:20.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.857+0000 7f2e9a71f800 1 -- 172.21.15.102:0/3305222694 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558c53fc2a20 con 0x558c53ec7880 2024-09-13T19:16:20.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.857+0000 7f2e96b96640 1 -- 172.21.15.102:0/3305222694 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2e9000a4a0 con 0x558c53ec7880 2024-09-13T19:16:20.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.857+0000 7f2e9a71f800 1 -- 172.21.15.102:0/3305222694 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558c53fc2f00 con 0x558c53fc3b80 2024-09-13T19:16:20.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.858+0000 7f2e96395640 1 -- 172.21.15.102:0/3305222694 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2e8802dcf0 con 0x558c53fc3b80 2024-09-13T19:16:20.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.858+0000 7f2e9a71f800 1 Processor -- start 2024-09-13T19:16:20.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.858+0000 7f2e9a71f800 1 -- start start 2024-09-13T19:16:20.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.858+0000 7f2e9a71f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c53fd4fa0 0x558c53fd53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.858+0000 7f2e9a71f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558c53d5e580 con 0x558c53fd4fa0 2024-09-13T19:16:20.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.858+0000 7f2e96b96640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c53fd4fa0 0x558c53fd53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.858+0000 7f2e96b96640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c53fd4fa0 0x558c53fd53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:56002/0 (socket says 172.21.15.102:56002) 2024-09-13T19:16:20.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.858+0000 7f2e96b96640 1 -- 172.21.15.102:0/2346284336 learned_addr learned my addr 172.21.15.102:0/2346284336 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:20.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.859+0000 7f2e96b96640 1 -- 172.21.15.102:0/2346284336 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c53fd5900 con 0x558c53fd4fa0 2024-09-13T19:16:20.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.859+0000 7f2e96b96640 1 --2- 172.21.15.102:0/2346284336 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c53fd4fa0 0x558c53fd53c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x558c53fc1c30 tx=0x7f2e900167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.859+0000 7f2d7bfff640 1 -- 172.21.15.102:0/2346284336 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e90013640 con 0x558c53fd4fa0 2024-09-13T19:16:20.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.859+0000 7f2d7bfff640 1 -- 172.21.15.102:0/2346284336 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e900137e0 con 0x558c53fd4fa0 2024-09-13T19:16:20.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.859+0000 7f2d7bfff640 1 -- 172.21.15.102:0/2346284336 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e90013ae0 con 0x558c53fd4fa0 2024-09-13T19:16:20.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.859+0000 7f2e9a71f800 1 -- 172.21.15.102:0/2346284336 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558c53fd5b90 con 0x558c53fd4fa0 2024-09-13T19:16:20.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.859+0000 7f2e9a71f800 1 -- 172.21.15.102:0/2346284336 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c53fd8870 con 0x558c53fd4fa0 2024-09-13T19:16:20.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.860+0000 7f2d7bfff640 1 -- 172.21.15.102:0/2346284336 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2e90011040 con 0x558c53fd4fa0 2024-09-13T19:16:20.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.860+0000 7f2d7bfff640 1 --2- 172.21.15.102:0/2346284336 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2d70036b90 0x7f2d70039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.860+0000 7f2d7bfff640 1 -- 172.21.15.102:0/2346284336 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f2e9000e040 con 0x558c53fd4fa0 2024-09-13T19:16:20.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.860+0000 7f2e96395640 1 --2- 172.21.15.102:0/2346284336 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2d70036b90 0x7f2d70039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.860+0000 7f2e9a71f800 1 Processor -- start 2024-09-13T19:16:20.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.860+0000 7f2e9a71f800 1 -- start start 2024-09-13T19:16:20.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.860+0000 7f2e96395640 1 --2- 172.21.15.102:0/2346284336 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2d70036b90 0x7f2d70039050 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x558c53fbe7e0 tx=0x7f2e8804b030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.861+0000 7f2e9a71f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c53fe1c40 0x558c53fe2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.861+0000 7f2e9a71f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558c53fb3020 con 0x558c53fe1c40 2024-09-13T19:16:20.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.861+0000 7f2e96b96640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c53fe1c40 0x558c53fe2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.861+0000 7f2e96b96640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c53fe1c40 0x558c53fe2040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:56008/0 (socket says 172.21.15.102:56008) 2024-09-13T19:16:20.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.861+0000 7f2e96b96640 1 -- 172.21.15.102:0/3001373901 learned_addr learned my addr 172.21.15.102:0/3001373901 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:20.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.861+0000 7f2e96b96640 1 -- 172.21.15.102:0/3001373901 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c53fe2610 con 0x558c53fe1c40 2024-09-13T19:16:20.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.861+0000 7f2e96b96640 1 --2- 172.21.15.102:0/3001373901 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c53fe1c40 0x558c53fe2040 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f2e90014fd0 tx=0x7f2e90020da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc0e9cce5679cd48 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.861+0000 7f2d79ffb640 1 -- 172.21.15.102:0/3001373901 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e90014c70 con 0x558c53fe1c40 2024-09-13T19:16:20.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.861+0000 7f2d79ffb640 1 -- 172.21.15.102:0/3001373901 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e9004a020 con 0x558c53fe1c40 2024-09-13T19:16:20.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.861+0000 7f2d79ffb640 1 -- 172.21.15.102:0/3001373901 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e9002aa60 con 0x558c53fe1c40 2024-09-13T19:16:20.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.862+0000 7f2e9a71f800 1 -- 172.21.15.102:0/3001373901 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c53fe1c40 msgr2=0x558c53fe2040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.862+0000 7f2e9a71f800 1 --2- 172.21.15.102:0/3001373901 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c53fe1c40 0x558c53fe2040 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f2e90014fd0 tx=0x7f2e90020da0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.862+0000 7f2e9a71f800 1 -- 172.21.15.102:0/3001373901 shutdown_connections 2024-09-13T19:16:20.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.862+0000 7f2e9a71f800 1 --2- 172.21.15.102:0/3001373901 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c53fe1c40 0x558c53fe2040 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.862+0000 7f2e9a71f800 1 -- 172.21.15.102:0/3001373901 >> 172.21.15.102:0/3001373901 conn(0x558c53fddfa0 msgr2=0x558c53fdc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:20.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.862+0000 7f2e9a71f800 1 -- 172.21.15.102:0/3001373901 shutdown_connections 2024-09-13T19:16:20.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.862+0000 7f2e9a71f800 1 -- 172.21.15.102:0/3001373901 wait complete. 2024-09-13T19:16:20.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.862+0000 7f2e9a71f800 1 Processor -- start 2024-09-13T19:16:20.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.862+0000 7f2e9a71f800 1 -- start start 2024-09-13T19:16:20.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.862+0000 7f2e9a71f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c53fe1c40 0x558c53ec3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.862+0000 7f2e9a71f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558c53fe2c80 con 0x558c53fe1c40 2024-09-13T19:16:20.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.862+0000 7f2e96b96640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c53fe1c40 0x558c53ec3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.862+0000 7f2e96b96640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c53fe1c40 0x558c53ec3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:56020/0 (socket says 172.21.15.102:56020) 2024-09-13T19:16:20.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.862+0000 7f2e96b96640 1 -- 172.21.15.102:0/962128909 learned_addr learned my addr 172.21.15.102:0/962128909 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:20.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.863+0000 7f2e96b96640 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c53ec2180 con 0x558c53fe1c40 2024-09-13T19:16:20.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.863+0000 7f2e96b96640 1 --2- 172.21.15.102:0/962128909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c53fe1c40 0x558c53ec3a90 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f2e90021040 tx=0x7f2e9004cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.863+0000 7f2d67fff640 1 -- 172.21.15.102:0/962128909 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e90038070 con 0x558c53fe1c40 2024-09-13T19:16:20.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.863+0000 7f2d67fff640 1 -- 172.21.15.102:0/962128909 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e9001c1f0 con 0x558c53fe1c40 2024-09-13T19:16:20.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.863+0000 7f2d67fff640 1 -- 172.21.15.102:0/962128909 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e90040150 con 0x558c53fe1c40 2024-09-13T19:16:20.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.863+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558c53ec2410 con 0x558c53fe1c40 2024-09-13T19:16:20.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.863+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c53ec2910 con 0x558c53fe1c40 2024-09-13T19:16:20.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.864+0000 7f2d67fff640 1 -- 172.21.15.102:0/962128909 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2e9003b070 con 0x558c53fe1c40 2024-09-13T19:16:20.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.864+0000 7f2d67fff640 1 --2- 172.21.15.102:0/962128909 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2d60036b40 0x7f2d60039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.864+0000 7f2d67fff640 1 -- 172.21.15.102:0/962128909 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f2e9004b030 con 0x558c53fe1c40 2024-09-13T19:16:20.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.864+0000 7f2e96395640 1 --2- 172.21.15.102:0/962128909 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2d60036b40 0x7f2d60039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.864+0000 7f2e96395640 1 --2- 172.21.15.102:0/962128909 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2d60036b40 0x7f2d60039000 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2e8801a6f0 tx=0x7f2e88031000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.865+0000 7f2e9a71f800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.865+0000 7f2e9a71f800 1 --2- 172.21.15.102:0/962128909 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x558c53ff6da0 0x558c53ff9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.865+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558c53ff99b0 con 0x558c53ff6da0 2024-09-13T19:16:20.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.865+0000 7f2e95b94640 1 --2- 172.21.15.102:0/962128909 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x558c53ff6da0 0x558c53ff9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.865+0000 7f2e95b94640 1 --2- 172.21.15.102:0/962128909 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x558c53ff6da0 0x558c53ff9260 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.865+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e8c051070 con 0x558c53ff6da0 2024-09-13T19:16:20.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.865+0000 7f2e9a71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:20.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.865+0000 7f2e9a71f800 20 realm 2024-09-13T19:16:20.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.865+0000 7f2e9a71f800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.865+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558c53ff9de0 con 0x558c53ff6da0 2024-09-13T19:16:20.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.866+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e8c051070 con 0x558c53ff6da0 2024-09-13T19:16:20.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.866+0000 7f2e9a71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:20.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.866+0000 7f2e9a71f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:20.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.866+0000 7f2e9a71f800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.866+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558c53ffa6b0 con 0x558c53ff6da0 2024-09-13T19:16:20.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.866+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e8c051070 con 0x558c53ff6da0 2024-09-13T19:16:20.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.866+0000 7f2e9a71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:20.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.866+0000 7f2e9a71f800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.866+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558c53ffaa50 con 0x558c53ff6da0 2024-09-13T19:16:20.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.866+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2e8c051070 con 0x558c53ff6da0 2024-09-13T19:16:20.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.866+0000 7f2e9a71f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:20.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.866+0000 7f2e9a71f800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.866+0000 7f2e9a71f800 1 --2- 172.21.15.102:0/962128909 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x558c53ffb7b0 0x558c53ffdba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.866+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558c53ffe1b0 con 0x558c53ffb7b0 2024-09-13T19:16:20.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.866+0000 7f2e96b96640 1 --2- 172.21.15.102:0/962128909 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x558c53ffb7b0 0x558c53ffdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.866+0000 7f2e96b96640 1 --2- 172.21.15.102:0/962128909 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x558c53ffb7b0 0x558c53ffdba0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.867+0000 7f2e96b96640 1 -- 172.21.15.102:0/962128909 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2e9003a030 con 0x558c53ffb7b0 2024-09-13T19:16:20.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.867+0000 7f2e9a71f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:20.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.867+0000 7f2e9a71f800 20 searching for the correct realm 2024-09-13T19:16:20.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.867+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558c53fffaa0 con 0x558c53ffb7b0 2024-09-13T19:16:20.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.867+0000 7f2e96b96640 1 -- 172.21.15.102:0/962128909 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e9003a030 con 0x558c53ffb7b0 2024-09-13T19:16:20.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.867+0000 7f2e96b96640 1 --2- 172.21.15.102:0/962128909 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f2e90040c20 0x7f2e900114d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.867+0000 7f2e96b96640 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558c53fffaa0 con 0x7f2e90040c20 2024-09-13T19:16:20.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.867+0000 7f2e96395640 1 --2- 172.21.15.102:0/962128909 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f2e90040c20 0x7f2e900114d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.867+0000 7f2e96395640 1 --2- 172.21.15.102:0/962128909 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f2e90040c20 0x7f2e900114d0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.868+0000 7f2e96395640 1 -- 172.21.15.102:0/962128909 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e8802dcf0 con 0x7f2e90040c20 2024-09-13T19:16:20.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.868+0000 7f2e96395640 1 --2- 172.21.15.102:0/962128909 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f2e88017050 0x7f2e8802d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.868+0000 7f2e96395640 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558c53fffaa0 con 0x7f2e88017050 2024-09-13T19:16:20.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.868+0000 7f2e95b94640 1 --2- 172.21.15.102:0/962128909 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f2e88017050 0x7f2e8802d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.868+0000 7f2e95b94640 1 --2- 172.21.15.102:0/962128909 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f2e88017050 0x7f2e8802d3f0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.868+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e8c051070 con 0x7f2e88017050 2024-09-13T19:16:20.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.868+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558c53fffaa0 con 0x558c53ff6da0 2024-09-13T19:16:20.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.869+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e8c051070 con 0x558c53ff6da0 2024-09-13T19:16:20.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.869+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558c53fffaa0 con 0x558c53ff6da0 2024-09-13T19:16:20.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.869+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e8c051070 con 0x558c53ff6da0 2024-09-13T19:16:20.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.869+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558c53fffaa0 con 0x7f2e88017050 2024-09-13T19:16:20.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.869+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e8c051070 con 0x7f2e88017050 2024-09-13T19:16:20.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.869+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558c53fffaa0 con 0x7f2e88017050 2024-09-13T19:16:20.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.869+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e8c051070 con 0x7f2e88017050 2024-09-13T19:16:20.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.869+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558c53fffaa0 con 0x7f2e90040c20 2024-09-13T19:16:20.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.870+0000 7f2e96395640 1 -- 172.21.15.102:0/962128909 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e8802dcf0 con 0x7f2e90040c20 2024-09-13T19:16:20.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.870+0000 7f2e96395640 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558c53fffaa0 con 0x558c53ffb7b0 2024-09-13T19:16:20.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.870+0000 7f2e96b96640 1 -- 172.21.15.102:0/962128909 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e9003a030 con 0x558c53ffb7b0 2024-09-13T19:16:20.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.870+0000 7f2e96b96640 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558c53fffaa0 con 0x558c53ff6da0 2024-09-13T19:16:20.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.870+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e8c051070 con 0x558c53ff6da0 2024-09-13T19:16:20.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.870+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558c53fffaa0 con 0x7f2e88017050 2024-09-13T19:16:20.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.870+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e8c051070 con 0x7f2e88017050 2024-09-13T19:16:20.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.870+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558c53fffaa0 con 0x558c53ff6da0 2024-09-13T19:16:20.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.871+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e8c051070 con 0x558c53ff6da0 2024-09-13T19:16:20.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.871+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558c53fffaa0 con 0x7f2e90040c20 2024-09-13T19:16:20.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.871+0000 7f2e96395640 1 -- 172.21.15.102:0/962128909 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2e8802dcf0 con 0x7f2e90040c20 2024-09-13T19:16:20.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.871+0000 7f2e96395640 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558c53fffaa0 con 0x558c53ffb7b0 2024-09-13T19:16:20.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.871+0000 7f2e96b96640 1 -- 172.21.15.102:0/962128909 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e9003a030 con 0x558c53ffb7b0 2024-09-13T19:16:20.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.871+0000 7f2e96b96640 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558c53fffaa0 con 0x558c53ffb7b0 2024-09-13T19:16:20.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.871+0000 7f2e96b96640 1 -- 172.21.15.102:0/962128909 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2e9003a030 con 0x558c53ffb7b0 2024-09-13T19:16:20.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.871+0000 7f2e96b96640 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558c53fffaa0 con 0x7f2e88017050 2024-09-13T19:16:20.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.872+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e8c051070 con 0x7f2e88017050 2024-09-13T19:16:20.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.872+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558c53fffaa0 con 0x558c53ffb7b0 2024-09-13T19:16:20.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.872+0000 7f2e96b96640 1 -- 172.21.15.102:0/962128909 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2e9003a030 con 0x558c53ffb7b0 2024-09-13T19:16:20.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.872+0000 7f2e96b96640 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558c53fffaa0 con 0x558c53ffb7b0 2024-09-13T19:16:20.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.872+0000 7f2e96b96640 1 -- 172.21.15.102:0/962128909 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e9003a030 con 0x558c53ffb7b0 2024-09-13T19:16:20.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.872+0000 7f2e96b96640 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558c53fffaa0 con 0x558c53ff6da0 2024-09-13T19:16:20.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.872+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e8c051070 con 0x558c53ff6da0 2024-09-13T19:16:20.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.872+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558c53fffaa0 con 0x558c53ff6da0 2024-09-13T19:16:20.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.872+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2e8c051070 con 0x558c53ff6da0 2024-09-13T19:16:20.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.872+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558c53fffaa0 con 0x7f2e88017050 2024-09-13T19:16:20.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.873+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e8c051070 con 0x7f2e88017050 2024-09-13T19:16:20.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.873+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558c53fffaa0 con 0x558c53ffb7b0 2024-09-13T19:16:20.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.873+0000 7f2e96b96640 1 -- 172.21.15.102:0/962128909 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e9006a040 con 0x558c53ffb7b0 2024-09-13T19:16:20.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.873+0000 7f2e96b96640 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558c53fffaa0 con 0x7f2e90040c20 2024-09-13T19:16:20.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.873+0000 7f2e96395640 1 -- 172.21.15.102:0/962128909 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e8802dcf0 con 0x7f2e90040c20 2024-09-13T19:16:20.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.873+0000 7f2e96395640 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558c53fffaa0 con 0x558c53ff6da0 2024-09-13T19:16:20.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.873+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e8c051070 con 0x558c53ff6da0 2024-09-13T19:16:20.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.873+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558c53fffaa0 con 0x7f2e88017050 2024-09-13T19:16:20.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.874+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e8c051070 con 0x7f2e88017050 2024-09-13T19:16:20.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.874+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558c53fffaa0 con 0x558c53ffb7b0 2024-09-13T19:16:20.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.874+0000 7f2e96b96640 1 -- 172.21.15.102:0/962128909 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e9006a040 con 0x558c53ffb7b0 2024-09-13T19:16:20.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.874+0000 7f2e96b96640 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558c53fffaa0 con 0x7f2e88017050 2024-09-13T19:16:20.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.874+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e8c051070 con 0x7f2e88017050 2024-09-13T19:16:20.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.874+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2e8c086040 con 0x7f2e90040c20 2024-09-13T19:16:20.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.874+0000 7f2e96395640 1 -- 172.21.15.102:0/962128909 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e8802dcf0 con 0x7f2e90040c20 2024-09-13T19:16:20.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.874+0000 7f2e96395640 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2e8c086040 con 0x558c53ffb7b0 2024-09-13T19:16:20.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.874+0000 7f2e96b96640 1 -- 172.21.15.102:0/962128909 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e9006a040 con 0x558c53ffb7b0 2024-09-13T19:16:20.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.875+0000 7f2e96b96640 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2e8c086040 con 0x7f2e88017050 2024-09-13T19:16:20.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.875+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e8c051070 con 0x7f2e88017050 2024-09-13T19:16:20.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.875+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2e8c086040 con 0x558c53ff6da0 2024-09-13T19:16:20.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.875+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2e8c051070 con 0x558c53ff6da0 2024-09-13T19:16:20.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.875+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2e8c086040 con 0x7f2e90040c20 2024-09-13T19:16:20.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.875+0000 7f2e96395640 1 -- 172.21.15.102:0/962128909 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e8802dcf0 con 0x7f2e90040c20 2024-09-13T19:16:20.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.875+0000 7f2e9a71f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:20.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.875+0000 7f2e9a71f800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:20.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.875+0000 7f2e9a71f800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:20.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.875+0000 7f2e9a71f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:20.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.875+0000 7f2e9a71f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:20.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.875+0000 7f2e9a71f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:20.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.875+0000 7f2e9a71f800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.875+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558c53fff690 con 0x558c53ff6da0 2024-09-13T19:16:20.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.876+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e8c051070 con 0x558c53ff6da0 2024-09-13T19:16:20.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.876+0000 7f2e9a71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:20.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.876+0000 7f2e9a71f800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.876+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558c53ffef00 con 0x558c53ff6da0 2024-09-13T19:16:20.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.876+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2e8c051070 con 0x558c53ff6da0 2024-09-13T19:16:20.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.876+0000 7f2e9a71f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:20.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.876+0000 7f2e9a71f800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.876+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558c53ffff20 con 0x558c53ffb7b0 2024-09-13T19:16:20.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.876+0000 7f2e96b96640 1 -- 172.21.15.102:0/962128909 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2e9006a040 con 0x558c53ffb7b0 2024-09-13T19:16:20.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.876+0000 7f2e9a71f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:20.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.876+0000 7f2e9a71f800 20 zone default found 2024-09-13T19:16:20.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.876+0000 7f2e9a71f800 4 Realm: () 2024-09-13T19:16:20.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.876+0000 7f2e9a71f800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:20.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.876+0000 7f2e9a71f800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:20.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.876+0000 7f2e9a71f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:20.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.876+0000 7f2e9a71f800 20 zonegroup default 2024-09-13T19:16:20.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.876+0000 7f2e9a71f800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.876+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558c54000770 con 0x7f2e88017050 2024-09-13T19:16:20.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.876+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2e8c051070 con 0x7f2e88017050 2024-09-13T19:16:20.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.876+0000 7f2e9a71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:20.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.876+0000 7f2e9a71f800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.876+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558c540024f0 con 0x558c53ffb7b0 2024-09-13T19:16:20.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.877+0000 7f2e96b96640 1 -- 172.21.15.102:0/962128909 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2e9006a040 con 0x558c53ffb7b0 2024-09-13T19:16:20.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.877+0000 7f2e9a71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:20.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.877+0000 7f2e9a71f800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.877+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558c54002980 con 0x558c53ffb7b0 2024-09-13T19:16:20.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.877+0000 7f2e96b96640 1 -- 172.21.15.102:0/962128909 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2e9006a040 con 0x558c53ffb7b0 2024-09-13T19:16:20.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.877+0000 7f2e9a71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:20.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.877+0000 7f2e9a71f800 20 started sync module instance, tier type = 2024-09-13T19:16:20.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.877+0000 7f2e9a71f800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:20.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.877+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c54001990 con 0x7f2e90040c20 2024-09-13T19:16:20.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.878+0000 7f2e96395640 1 -- 172.21.15.102:0/962128909 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(44 notify.0 [create] v34'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e8802dcf0 con 0x7f2e90040c20 2024-09-13T19:16:20.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.878+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94061193073888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c54002dc0 con 0x7f2e90040c20 2024-09-13T19:16:20.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.878+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c54003610 con 0x558c53ff6da0 2024-09-13T19:16:20.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.879+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v34'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e8c051070 con 0x558c53ff6da0 2024-09-13T19:16:20.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.879+0000 7f2e96395640 1 -- 172.21.15.102:0/962128909 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94061193073888] v34'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e8802dcf0 con 0x7f2e90040c20 2024-09-13T19:16:20.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.879+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94061193081184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c54003c30 con 0x558c53ff6da0 2024-09-13T19:16:20.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.879+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c54001dc0 con 0x558c53ffb7b0 2024-09-13T19:16:20.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.880+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94061193081184] v34'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e8c051070 con 0x558c53ff6da0 2024-09-13T19:16:20.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.880+0000 7f2e96b96640 1 -- 172.21.15.102:0/962128909 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v34'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e9006a040 con 0x558c53ffb7b0 2024-09-13T19:16:20.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.880+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94061193082496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c54003bf0 con 0x558c53ffb7b0 2024-09-13T19:16:20.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.880+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c54004cf0 con 0x7f2e90040c20 2024-09-13T19:16:20.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.881+0000 7f2e96b96640 1 -- 172.21.15.102:0/962128909 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94061193082496] v34'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e9006a040 con 0x558c53ffb7b0 2024-09-13T19:16:20.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.881+0000 7f2e96395640 1 -- 172.21.15.102:0/962128909 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(50 notify.3 [create] v34'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e8802dcf0 con 0x7f2e90040c20 2024-09-13T19:16:20.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.881+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94061193087040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c54005090 con 0x7f2e90040c20 2024-09-13T19:16:20.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.881+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c54005a90 con 0x558c53ff6da0 2024-09-13T19:16:20.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.882+0000 7f2e96395640 1 -- 172.21.15.102:0/962128909 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94061193087040] v34'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e8802dcf0 con 0x7f2e90040c20 2024-09-13T19:16:20.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.882+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v34'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e8c051070 con 0x558c53ff6da0 2024-09-13T19:16:20.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.882+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94061193085472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c54005e80 con 0x558c53ff6da0 2024-09-13T19:16:20.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.883+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c54006900 con 0x7f2e88017050 2024-09-13T19:16:20.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.883+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94061193085472] v34'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e8c051070 con 0x558c53ff6da0 2024-09-13T19:16:20.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.884+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(54 notify.5 [create] v34'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e8c051070 con 0x7f2e88017050 2024-09-13T19:16:20.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.884+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94061193094128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c540068c0 con 0x7f2e88017050 2024-09-13T19:16:20.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.884+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c54007330 con 0x7f2e88017050 2024-09-13T19:16:20.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.884+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94061193094128] v34'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e8c051070 con 0x7f2e88017050 2024-09-13T19:16:20.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.885+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(56 notify.6 [create] v34'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e8c051070 con 0x7f2e88017050 2024-09-13T19:16:20.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.885+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94061193096800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c54007330 con 0x7f2e88017050 2024-09-13T19:16:20.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.885+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c54007cf0 con 0x7f2e88017050 2024-09-13T19:16:20.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.886+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(58 notify.7 [create] v34'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e8c051070 con 0x7f2e88017050 2024-09-13T19:16:20.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.886+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94061193099328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c54007c60 con 0x7f2e88017050 2024-09-13T19:16:20.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.886+0000 7f2e9a71f800 20 add_watcher() i=0 2024-09-13T19:16:20.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.886+0000 7f2e9a71f800 20 add_watcher() i=1 2024-09-13T19:16:20.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.886+0000 7f2e9a71f800 20 add_watcher() i=2 2024-09-13T19:16:20.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.886+0000 7f2e9a71f800 20 add_watcher() i=3 2024-09-13T19:16:20.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.886+0000 7f2e9a71f800 20 add_watcher() i=4 2024-09-13T19:16:20.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.886+0000 7f2e9a71f800 20 add_watcher() i=5 2024-09-13T19:16:20.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.886+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94061193096800] v34'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e8c051070 con 0x7f2e88017050 2024-09-13T19:16:20.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.886+0000 7f2e9a71f800 20 add_watcher() i=6 2024-09-13T19:16:20.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.886+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94061193099328] v34'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e8c051070 con 0x7f2e88017050 2024-09-13T19:16:20.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.887+0000 7f2e9a71f800 20 add_watcher() i=7 2024-09-13T19:16:20.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.887+0000 7f2e9a71f800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:20.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.887+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558c540055a0 con 0x558c53ff6da0 2024-09-13T19:16:20.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.887+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2e8c051070 con 0x558c53ff6da0 2024-09-13T19:16:20.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.887+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94061193101360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c540055a0 con 0x558c53ff6da0 2024-09-13T19:16:20.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.888+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94061193101360] v34'139 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2e8c051070 con 0x558c53ff6da0 2024-09-13T19:16:20.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.888+0000 7f2d4cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:20.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.888+0000 7f2e9a71f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:20.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.888+0000 7f2e9a71f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:20.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.888+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c54013c00 con 0x558c53ff6da0 2024-09-13T19:16:20.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.889+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2e8c051070 con 0x558c53ff6da0 2024-09-13T19:16:20.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.889+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c540142d0 con 0x7f2e88017050 2024-09-13T19:16:20.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.890+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'17 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2e8c051070 con 0x7f2e88017050 2024-09-13T19:16:20.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.890+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c540146f0 con 0x558c53ffb7b0 2024-09-13T19:16:20.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.891+0000 7f2e96b96640 1 -- 172.21.15.102:0/962128909 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2e9006a040 con 0x558c53ffb7b0 2024-09-13T19:16:20.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.891+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c54014620 con 0x558c53ff6da0 2024-09-13T19:16:20.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.892+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'140 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2e8c051070 con 0x558c53ff6da0 2024-09-13T19:16:20.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.892+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c54014710 con 0x7f2e90040c20 2024-09-13T19:16:20.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.893+0000 7f2e96395640 1 -- 172.21.15.102:0/962128909 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'41 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2e8802dcf0 con 0x7f2e90040c20 2024-09-13T19:16:20.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.893+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c54014da0 con 0x558c53ffb7b0 2024-09-13T19:16:20.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.894+0000 7f2e96b96640 1 -- 172.21.15.102:0/962128909 <== osd.3 v2:172.21.15.102:6800/3096737090 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'28 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2e9006a040 con 0x558c53ffb7b0 2024-09-13T19:16:20.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.894+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c54014da0 con 0x558c53ff6da0 2024-09-13T19:16:20.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.895+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2e8c051070 con 0x558c53ff6da0 2024-09-13T19:16:20.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.895+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c54014da0 con 0x7f2e88017050 2024-09-13T19:16:20.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.896+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'27 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2e8c051070 con 0x7f2e88017050 2024-09-13T19:16:20.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.896+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c540151c0 con 0x7f2e90040c20 2024-09-13T19:16:20.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.897+0000 7f2e96395640 1 -- 172.21.15.102:0/962128909 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2e8802dcf0 con 0x7f2e90040c20 2024-09-13T19:16:20.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.897+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c540151c0 con 0x558c53ffb7b0 2024-09-13T19:16:20.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.898+0000 7f2e96b96640 1 -- 172.21.15.102:0/962128909 <== osd.3 v2:172.21.15.102:6800/3096737090 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2e9006a040 con 0x558c53ffb7b0 2024-09-13T19:16:20.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.898+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c540151c0 con 0x7f2e90040c20 2024-09-13T19:16:20.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.899+0000 7f2e96395640 1 -- 172.21.15.102:0/962128909 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'42 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e8802dcf0 con 0x7f2e90040c20 2024-09-13T19:16:20.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.899+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c540151c0 con 0x7f2e88017050 2024-09-13T19:16:20.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.900+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e8c051070 con 0x7f2e88017050 2024-09-13T19:16:20.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.900+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c540151c0 con 0x7f2e90040c20 2024-09-13T19:16:20.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.901+0000 7f2e96395640 1 -- 172.21.15.102:0/962128909 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e8802dcf0 con 0x7f2e90040c20 2024-09-13T19:16:20.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.901+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c540151c0 con 0x7f2e88017050 2024-09-13T19:16:20.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.902+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.0 v2:172.21.15.53:6800/4021716951 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'33 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e8c051070 con 0x7f2e88017050 2024-09-13T19:16:20.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.903+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c540151c0 con 0x558c53ff6da0 2024-09-13T19:16:20.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.904+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'141 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e8c051070 con 0x558c53ff6da0 2024-09-13T19:16:20.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.904+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c540151c0 con 0x558c53ffb7b0 2024-09-13T19:16:20.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.905+0000 7f2e96b96640 1 -- 172.21.15.102:0/962128909 <== osd.3 v2:172.21.15.102:6800/3096737090 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'35 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e9006a040 con 0x558c53ffb7b0 2024-09-13T19:16:20.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.905+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c540151c0 con 0x7f2e90040c20 2024-09-13T19:16:20.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.906+0000 7f2e96395640 1 -- 172.21.15.102:0/962128909 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'43 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e8802dcf0 con 0x7f2e90040c20 2024-09-13T19:16:20.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.906+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c540151c0 con 0x558c53ffb7b0 2024-09-13T19:16:20.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.907+0000 7f2e96b96640 1 -- 172.21.15.102:0/962128909 <== osd.3 v2:172.21.15.102:6800/3096737090 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e9006a040 con 0x558c53ffb7b0 2024-09-13T19:16:20.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.907+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c540151c0 con 0x558c53ff6da0 2024-09-13T19:16:20.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.908+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e8c051070 con 0x558c53ff6da0 2024-09-13T19:16:20.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.908+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c540151c0 con 0x558c53ff6da0 2024-09-13T19:16:20.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.909+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'142 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e8c051070 con 0x558c53ff6da0 2024-09-13T19:16:20.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.909+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c540151c0 con 0x558c53ffb7b0 2024-09-13T19:16:20.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.910+0000 7f2e96b96640 1 -- 172.21.15.102:0/962128909 <== osd.3 v2:172.21.15.102:6800/3096737090 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'36 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e9006a040 con 0x558c53ffb7b0 2024-09-13T19:16:20.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.910+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c540151c0 con 0x7f2e90040c20 2024-09-13T19:16:20.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.910+0000 7f2e96395640 1 -- 172.21.15.102:0/962128909 <== osd.2 v2:172.21.15.102:6816/2238176080 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e8802dcf0 con 0x7f2e90040c20 2024-09-13T19:16:20.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.911+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c540151c0 con 0x558c53ffb7b0 2024-09-13T19:16:20.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.912+0000 7f2e96b96640 1 -- 172.21.15.102:0/962128909 <== osd.3 v2:172.21.15.102:6800/3096737090 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e9006a040 con 0x558c53ffb7b0 2024-09-13T19:16:20.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.912+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c540151c0 con 0x558c53ffb7b0 2024-09-13T19:16:20.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.912+0000 7f2e96b96640 1 -- 172.21.15.102:0/962128909 <== osd.3 v2:172.21.15.102:6800/3096737090 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e9006a040 con 0x558c53ffb7b0 2024-09-13T19:16:20.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.912+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c540151c0 con 0x558c53ffb7b0 2024-09-13T19:16:20.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.913+0000 7f2e96b96640 1 -- 172.21.15.102:0/962128909 <== osd.3 v2:172.21.15.102:6800/3096737090 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e9006a040 con 0x558c53ffb7b0 2024-09-13T19:16:20.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.913+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c540151c0 con 0x558c53ffb7b0 2024-09-13T19:16:20.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.914+0000 7f2e96b96640 1 -- 172.21.15.102:0/962128909 <== osd.3 v2:172.21.15.102:6800/3096737090 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'29 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e9006a040 con 0x558c53ffb7b0 2024-09-13T19:16:20.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.914+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c540151c0 con 0x7f2e88017050 2024-09-13T19:16:20.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.915+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.0 v2:172.21.15.53:6800/4021716951 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e8c051070 con 0x7f2e88017050 2024-09-13T19:16:20.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.915+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c540151c0 con 0x558c53ffb7b0 2024-09-13T19:16:20.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.916+0000 7f2e96b96640 1 -- 172.21.15.102:0/962128909 <== osd.3 v2:172.21.15.102:6800/3096737090 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e9006a040 con 0x558c53ffb7b0 2024-09-13T19:16:20.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.916+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c540151c0 con 0x7f2e88017050 2024-09-13T19:16:20.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.918+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.0 v2:172.21.15.53:6800/4021716951 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'28 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e8c051070 con 0x7f2e88017050 2024-09-13T19:16:20.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.918+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c540151c0 con 0x558c53ffb7b0 2024-09-13T19:16:20.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.919+0000 7f2e96b96640 1 -- 172.21.15.102:0/962128909 <== osd.3 v2:172.21.15.102:6800/3096737090 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'37 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e9006a040 con 0x558c53ffb7b0 2024-09-13T19:16:20.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.919+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c540151c0 con 0x7f2e88017050 2024-09-13T19:16:20.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.920+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.0 v2:172.21.15.53:6800/4021716951 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'34 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e8c051070 con 0x7f2e88017050 2024-09-13T19:16:20.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.920+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c540151c0 con 0x7f2e90040c20 2024-09-13T19:16:20.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.921+0000 7f2e96395640 1 -- 172.21.15.102:0/962128909 <== osd.2 v2:172.21.15.102:6816/2238176080 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e8802dcf0 con 0x7f2e90040c20 2024-09-13T19:16:20.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.921+0000 7f2cc77fe640 20 reqs_thread_entry: start 2024-09-13T19:16:20.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.921+0000 7f2e9a71f800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:20.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.921+0000 7f2e9a71f800 20 Filter name: none 2024-09-13T19:16:20.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.921+0000 7f2cc57fa640 20 reqs_thread_entry: start 2024-09-13T19:16:20.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.921+0000 7f2e9a71f800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T19:16:20.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.921+0000 7f2e9a71f800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.921+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558c54040090 con 0x7f2e90040c20 2024-09-13T19:16:20.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.922+0000 7f2e96395640 1 -- 172.21.15.102:0/962128909 <== osd.2 v2:172.21.15.102:6816/2238176080 18 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv32 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f2e8802dcf0 con 0x7f2e90040c20 2024-09-13T19:16:20.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.922+0000 7f2e9a71f800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:16:20.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.922+0000 7f2e9a71f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T19:16:20.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.922+0000 7f2e9a71f800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:16:20.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.922+0000 7f2e9a71f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 : miss 2024-09-13T19:16:20.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.922+0000 7f2e9a71f800 20 rados->read ofs=0 len=0 2024-09-13T19:16:20.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.922+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:95 8.9 8:917ee2d5:root::.bucket.meta.myfoo%3a509740b4-c081-4f37-bd6d-df9ca851489b.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558c54041b60 con 0x7f2e90040c20 2024-09-13T19:16:20.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.922+0000 7f2e96395640 1 -- 172.21.15.102:0/962128909 <== osd.2 v2:172.21.15.102:6816/2238176080 19 ==== osd_op_reply(95 .bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv30 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f2e8802dcf0 con 0x7f2e90040c20 2024-09-13T19:16:20.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.922+0000 7f2e9a71f800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:16:20.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.922+0000 7f2e9a71f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 info.flags=0x17 2024-09-13T19:16:20.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.922+0000 7f2e9a71f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 to cache LRU end 2024-09-13T19:16:20.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.922+0000 7f2e9a71f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:16:20.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.922+0000 7f2e9a71f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:16:20.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.922+0000 7f2e9a71f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 2024-09-13T19:16:20.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.922+0000 7f2e9a71f800 20 get_obj_state: octx=0x7f2e88044bd0 obj=myfoo:four state=0x558c54042e08 s->prefetch_data=0 2024-09-13T19:16:20.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.922+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:96 3.0s0 3:03c6d5d9:::509740b4-c081-4f37-bd6d-df9ca851489b.4237.1_four:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558c54043c30 con 0x7f2e88017050 2024-09-13T19:16:20.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.922+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.0 v2:172.21.15.53:6800/4021716951 24 ==== osd_op_reply(96 509740b4-c081-4f37-bd6d-df9ca851489b.4237.1_four [getxattrs out=851b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 234+0+867 (crc 0 0 0) 0x7f2e8c051070 con 0x7f2e88017050 2024-09-13T19:16:20.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.922+0000 7f2e9a71f800 10 manifest: total_size = 4 2024-09-13T19:16:20.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.922+0000 7f2e9a71f800 20 get_obj_state: setting s->obj_tag to 509740b4-c081-4f37-bd6d-df9ca851489b.4237.11318881731651175696 2024-09-13T19:16:20.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.922+0000 7f2e9a71f800 20 get_obj_state: octx=0x7f2e88044bd0 obj=myfoo:four state=0x558c54042e08 s->prefetch_data=0 2024-09-13T19:16:20.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.922+0000 7f2e9a71f800 20 prepare_atomic_modification: state is not atomic. state=0x558c54042e08 2024-09-13T19:16:20.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.922+0000 7f2e9a71f800 20 bucket index object: :.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.6 2024-09-13T19:16:20.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.922+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:97 4.8 4:102eb403:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c540485c0 con 0x558c53ffb7b0 2024-09-13T19:16:20.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.924+0000 7f2e96b96640 1 -- 172.21.15.102:0/962128909 <== osd.3 v2:172.21.15.102:6800/3096737090 28 ==== osd_op_reply(97 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.6 [stat,call,call] v34'11 uv11 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f2e9006a040 con 0x558c53ffb7b0 2024-09-13T19:16:20.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.924+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:98 3.0s0 3:03c6d5d9:::509740b4-c081-4f37-bd6d-df9ca851489b.4237.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c540485c0 con 0x7f2e88017050 2024-09-13T19:16:20.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.925+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.0 v2:172.21.15.53:6800/4021716951 25 ==== osd_op_reply(98 509740b4-c081-4f37-bd6d-df9ca851489b.4237.1_four [call] v34'2 uv2 ondisk = 0) ==== 192+0+0 (crc 0 0 0) 0x7f2e8c051070 con 0x7f2e88017050 2024-09-13T19:16:20.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.925+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:99 4.8 4:102eb403:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c54049050 con 0x558c53ffb7b0 2024-09-13T19:16:20.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.926+0000 7f2d4cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:20.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.926+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94061193101360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c54049050 con 0x558c53ff6da0 2024-09-13T19:16:20.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.927+0000 7f2e96b96640 1 -- 172.21.15.102:0/962128909 <== osd.3 v2:172.21.15.102:6800/3096737090 29 ==== osd_op_reply(99 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.6 [stat,call,call] v34'12 uv12 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f2e9006a040 con 0x558c53ffb7b0 2024-09-13T19:16:20.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.927+0000 7f2d79ffb640 20 handle_completion(): completion ok for obj=four 2024-09-13T19:16:20.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.927+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(100 data_loggenerations_metadata [watch unwatch cookie 94061193101360] v34'143 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2e8c051070 con 0x558c53ff6da0 2024-09-13T19:16:20.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.927+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94061193073888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c54049050 con 0x7f2e90040c20 2024-09-13T19:16:20.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.928+0000 7f2e96395640 1 -- 172.21.15.102:0/962128909 <== osd.2 v2:172.21.15.102:6816/2238176080 20 ==== osd_op_reply(101 notify.0 [watch unwatch cookie 94061193073888] v34'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e8802dcf0 con 0x7f2e90040c20 2024-09-13T19:16:20.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.928+0000 7f2e9a71f800 20 remove_watcher() i=0 2024-09-13T19:16:20.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.928+0000 7f2e9a71f800 2 removed watcher, disabling cache 2024-09-13T19:16:20.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.928+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:102 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94061193081184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c540014e0 con 0x558c53ff6da0 2024-09-13T19:16:20.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.929+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.1 v2:172.21.15.102:6808/2204418452 28 ==== osd_op_reply(102 notify.1 [watch unwatch cookie 94061193081184] v34'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e8c051070 con 0x558c53ff6da0 2024-09-13T19:16:20.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.929+0000 7f2e9a71f800 20 remove_watcher() i=1 2024-09-13T19:16:20.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.929+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:103 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94061193082496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c540014e0 con 0x558c53ffb7b0 2024-09-13T19:16:20.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.931+0000 7f2e96b96640 1 -- 172.21.15.102:0/962128909 <== osd.3 v2:172.21.15.102:6800/3096737090 30 ==== osd_op_reply(103 notify.2 [watch unwatch cookie 94061193082496] v34'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e9006a040 con 0x558c53ffb7b0 2024-09-13T19:16:20.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.931+0000 7f2e9a71f800 20 remove_watcher() i=2 2024-09-13T19:16:20.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.931+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94061193087040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c540014e0 con 0x7f2e90040c20 2024-09-13T19:16:20.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.932+0000 7f2e96395640 1 -- 172.21.15.102:0/962128909 <== osd.2 v2:172.21.15.102:6816/2238176080 21 ==== osd_op_reply(104 notify.3 [watch unwatch cookie 94061193087040] v34'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e8802dcf0 con 0x7f2e90040c20 2024-09-13T19:16:20.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.932+0000 7f2e9a71f800 20 remove_watcher() i=3 2024-09-13T19:16:20.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.932+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94061193085472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c540014e0 con 0x558c53ff6da0 2024-09-13T19:16:20.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.932+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.1 v2:172.21.15.102:6808/2204418452 29 ==== osd_op_reply(105 notify.4 [watch unwatch cookie 94061193085472] v34'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e8c051070 con 0x558c53ff6da0 2024-09-13T19:16:20.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.932+0000 7f2e9a71f800 20 remove_watcher() i=4 2024-09-13T19:16:20.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.932+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94061193094128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c540014e0 con 0x7f2e88017050 2024-09-13T19:16:20.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.934+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.0 v2:172.21.15.53:6800/4021716951 26 ==== osd_op_reply(106 notify.5 [watch unwatch cookie 94061193094128] v34'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e8c051070 con 0x7f2e88017050 2024-09-13T19:16:20.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.934+0000 7f2e9a71f800 20 remove_watcher() i=5 2024-09-13T19:16:20.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.934+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:107 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94061193096800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c540014e0 con 0x7f2e88017050 2024-09-13T19:16:20.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.935+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.0 v2:172.21.15.53:6800/4021716951 27 ==== osd_op_reply(107 notify.6 [watch unwatch cookie 94061193096800] v34'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e8c051070 con 0x7f2e88017050 2024-09-13T19:16:20.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.935+0000 7f2e9a71f800 20 remove_watcher() i=6 2024-09-13T19:16:20.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.935+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:108 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94061193099328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558c54006e60 con 0x7f2e88017050 2024-09-13T19:16:20.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.936+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 <== osd.0 v2:172.21.15.53:6800/4021716951 28 ==== osd_op_reply(108 notify.7 [watch unwatch cookie 94061193099328] v34'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e8c051070 con 0x7f2e88017050 2024-09-13T19:16:20.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.936+0000 7f2e9a71f800 20 remove_watcher() i=7 2024-09-13T19:16:20.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.936+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f2e88017050 msgr2=0x7f2e8802d3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.936+0000 7f2e9a71f800 1 --2- 172.21.15.102:0/962128909 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f2e88017050 0x7f2e8802d3f0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.936+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x558c53ff6da0 msgr2=0x558c53ff9260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.936+0000 7f2e9a71f800 1 --2- 172.21.15.102:0/962128909 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x558c53ff6da0 0x558c53ff9260 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.936+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f2e90040c20 msgr2=0x7f2e900114d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.936+0000 7f2e9a71f800 1 --2- 172.21.15.102:0/962128909 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f2e90040c20 0x7f2e900114d0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.936+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x558c53ffb7b0 msgr2=0x558c53ffdba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.936+0000 7f2e9a71f800 1 --2- 172.21.15.102:0/962128909 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x558c53ffb7b0 0x558c53ffdba0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.936+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2d60036b40 msgr2=0x7f2d60039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.936+0000 7f2e9a71f800 1 --2- 172.21.15.102:0/962128909 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2d60036b40 0x7f2d60039000 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2e8801a6f0 tx=0x7f2e88031000 comp rx=0 tx=0).stop 2024-09-13T19:16:20.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.936+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c53fe1c40 msgr2=0x558c53ec3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.936+0000 7f2e9a71f800 1 --2- 172.21.15.102:0/962128909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c53fe1c40 0x558c53ec3a90 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f2e90021040 tx=0x7f2e9004cd00 comp rx=0 tx=0).stop 2024-09-13T19:16:20.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.936+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 reap_dead start 2024-09-13T19:16:20.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.936+0000 7f2e95b94640 1 -- 172.21.15.102:0/962128909 reap_dead start 2024-09-13T19:16:20.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.936+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 shutdown_connections 2024-09-13T19:16:20.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.936+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 >> 172.21.15.102:0/962128909 conn(0x558c53fddfa0 msgr2=0x558c53fdc070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:20.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.936+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 shutdown_connections 2024-09-13T19:16:20.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.936+0000 7f2e9a71f800 1 -- 172.21.15.102:0/962128909 wait complete. 2024-09-13T19:16:20.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.936+0000 7f2e9a71f800 1 -- 172.21.15.102:0/2346284336 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2d70036b90 msgr2=0x7f2d70039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.936+0000 7f2e9a71f800 1 --2- 172.21.15.102:0/2346284336 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2d70036b90 0x7f2d70039050 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x558c53fbe7e0 tx=0x7f2e8804b030 comp rx=0 tx=0).stop 2024-09-13T19:16:20.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.936+0000 7f2e9a71f800 1 -- 172.21.15.102:0/2346284336 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c53fd4fa0 msgr2=0x558c53fd53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.936+0000 7f2e9a71f800 1 --2- 172.21.15.102:0/2346284336 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c53fd4fa0 0x558c53fd53c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x558c53fc1c30 tx=0x7f2e900167b0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.937+0000 7f2e9a71f800 1 -- 172.21.15.102:0/2346284336 shutdown_connections 2024-09-13T19:16:20.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.937+0000 7f2e9a71f800 1 --2- 172.21.15.102:0/2346284336 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2d70036b90 0x7f2d70039050 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.937+0000 7f2e9a71f800 1 --2- 172.21.15.102:0/2346284336 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c53fd4fa0 0x558c53fd53c0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.937+0000 7f2e9a71f800 1 -- 172.21.15.102:0/2346284336 >> 172.21.15.102:0/2346284336 conn(0x558c53fc9f30 msgr2=0x558c53fccab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:20.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.937+0000 7f2e9a71f800 1 -- 172.21.15.102:0/2346284336 shutdown_connections 2024-09-13T19:16:20.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.937+0000 7f2e9a71f800 1 -- 172.21.15.102:0/2346284336 wait complete. 2024-09-13T19:16:20.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.937+0000 7f2e9a71f800 1 -- 172.21.15.102:0/3305222694 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x558c53ec7880 msgr2=0x558c53fc12f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.937+0000 7f2e9a71f800 1 --2- 172.21.15.102:0/3305222694 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x558c53ec7880 0x558c53fc12f0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.937+0000 7f2e9a71f800 1 -- 172.21.15.102:0/3305222694 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x558c53fc3b80 msgr2=0x558c53fc5f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.937+0000 7f2e9a71f800 1 --2- 172.21.15.102:0/3305222694 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x558c53fc3b80 0x558c53fc5f70 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.937+0000 7f2e9a71f800 1 -- 172.21.15.102:0/3305222694 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2d7c036b90 msgr2=0x7f2d7c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.937+0000 7f2e9a71f800 1 --2- 172.21.15.102:0/3305222694 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2d7c036b90 0x7f2d7c039050 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c057000 tx=0x7f2e8c052000 comp rx=0 tx=0).stop 2024-09-13T19:16:20.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.937+0000 7f2e9a71f800 1 -- 172.21.15.102:0/3305222694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c53e376d0 msgr2=0x558c53fba280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.937+0000 7f2e9a71f800 1 --2- 172.21.15.102:0/3305222694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c53e376d0 0x558c53fba280 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f2e8800b7c0 tx=0x7f2e88000ed0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.937+0000 7f2e9a71f800 1 -- 172.21.15.102:0/3305222694 shutdown_connections 2024-09-13T19:16:20.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.937+0000 7f2e9a71f800 1 --2- 172.21.15.102:0/3305222694 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x558c53fc3b80 0x558c53fc5f70 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.937+0000 7f2e9a71f800 1 --2- 172.21.15.102:0/3305222694 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x558c53ec7880 0x558c53fc12f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.937+0000 7f2e9a71f800 1 --2- 172.21.15.102:0/3305222694 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2d7c036b90 0x7f2d7c039050 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.937+0000 7f2e9a71f800 1 --2- 172.21.15.102:0/3305222694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c53e376d0 0x558c53fba280 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.937+0000 7f2e9a71f800 1 -- 172.21.15.102:0/3305222694 >> 172.21.15.102:0/3305222694 conn(0x558c53ebddb0 msgr2=0x558c53facaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:20.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.937+0000 7f2e9a71f800 1 -- 172.21.15.102:0/3305222694 shutdown_connections 2024-09-13T19:16:20.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.937+0000 7f2e9a71f800 1 -- 172.21.15.102:0/3305222694 wait complete. 2024-09-13T19:16:20.949 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-13T19:16:20.949 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-13T19:16:20.949 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-13T19:16:20.994 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:20.994 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:20.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.991+0000 7ff8da42f800 1 Processor -- start 2024-09-13T19:16:20.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.991+0000 7ff8da42f800 1 -- start start 2024-09-13T19:16:20.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.992+0000 7ff8da42f800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5590a41f84c0 0x5590a41f88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:20.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.992+0000 7ff8da42f800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5590a40b8b30 con 0x5590a41f8e00 2024-09-13T19:16:20.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.992+0000 7ff8da42f800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5590a409a360 con 0x5590a41f84c0 2024-09-13T19:16:20.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.992+0000 7ff8d7f2a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5590a41f84c0 0x5590a41f88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:20.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.992+0000 7ff8d7f2a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5590a41f84c0 0x5590a41f88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:56076/0 (socket says 172.21.15.102:56076) 2024-09-13T19:16:20.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.992+0000 7ff8d7f2a640 1 -- 172.21.15.102:0/2449085040 learned_addr learned my addr 172.21.15.102:0/2449085040 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:20.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.992+0000 7ff8d7729640 1 --1- 172.21.15.102:0/2449085040 >> v1:172.21.15.53:6789/0 conn(0x5590a41f8e00 0x5590a41fd980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:33060/0 (socket says 172.21.15.102:33060) 2024-09-13T19:16:20.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.992+0000 7ff8d7f2a640 1 -- 172.21.15.102:0/2449085040 >> v1:172.21.15.53:6789/0 conn(0x5590a41f8e00 legacy=0x5590a41fd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.992+0000 7ff8d7f2a640 1 -- 172.21.15.102:0/2449085040 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590a40c0e00 con 0x5590a41f84c0 2024-09-13T19:16:20.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.994+0000 7ff8d7f2a640 1 --2- 172.21.15.102:0/2449085040 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590a41f84c0 0x5590a41f88c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0005fd0 tx=0x7ff8d0045cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf509c448d474c61 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:20.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.994+0000 7ff8d6f28640 1 -- 172.21.15.102:0/2449085040 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8d004e600 con 0x5590a41f84c0 2024-09-13T19:16:20.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.994+0000 7ff8d6f28640 1 -- 172.21.15.102:0/2449085040 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8d004e7a0 con 0x5590a41f84c0 2024-09-13T19:16:20.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.994+0000 7ff8d6f28640 1 -- 172.21.15.102:0/2449085040 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8d004eaa0 con 0x5590a41f84c0 2024-09-13T19:16:20.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.995+0000 7ff8da42f800 1 -- 172.21.15.102:0/2449085040 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590a41f84c0 msgr2=0x5590a41f88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:20.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.995+0000 7ff8da42f800 1 --2- 172.21.15.102:0/2449085040 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590a41f84c0 0x5590a41f88c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0005fd0 tx=0x7ff8d0045cf0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.995+0000 7ff8da42f800 1 -- 172.21.15.102:0/2449085040 shutdown_connections 2024-09-13T19:16:20.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.995+0000 7ff8da42f800 1 --2- 172.21.15.102:0/2449085040 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590a41f84c0 0x5590a41f88c0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:20.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.995+0000 7ff8da42f800 1 -- 172.21.15.102:0/2449085040 >> 172.21.15.102:0/2449085040 conn(0x5590a41f3df0 msgr2=0x5590a41f6210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:20.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.995+0000 7ff8da42f800 1 -- 172.21.15.102:0/2449085040 shutdown_connections 2024-09-13T19:16:20.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:20.995+0000 7ff8da42f800 1 -- 172.21.15.102:0/2449085040 wait complete. 2024-09-13T19:16:21.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.008+0000 7ff8da42f800 1 Processor -- start 2024-09-13T19:16:21.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.009+0000 7ff8da42f800 1 -- start start 2024-09-13T19:16:21.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.009+0000 7ff8da42f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590a41f84c0 0x5590a416cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.009+0000 7ff8da42f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5590a4145330 con 0x5590a41f84c0 2024-09-13T19:16:21.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.009+0000 7ff8d7f2a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590a41f84c0 0x5590a416cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.009+0000 7ff8d7f2a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590a41f84c0 0x5590a416cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:56086/0 (socket says 172.21.15.102:56086) 2024-09-13T19:16:21.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.009+0000 7ff8d7f2a640 1 -- 172.21.15.102:0/751555374 learned_addr learned my addr 172.21.15.102:0/751555374 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:21.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.009+0000 7ff8d7f2a640 1 -- 172.21.15.102:0/751555374 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590a4092bc0 con 0x5590a41f84c0 2024-09-13T19:16:21.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.009+0000 7ff8d7f2a640 1 --2- 172.21.15.102:0/751555374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590a41f84c0 0x5590a416cd80 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0045d30 tx=0x7ff8d0050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fca71f8f0d796347 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.010+0000 7ff7c5e0b640 1 -- 172.21.15.102:0/751555374 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8d004eb40 con 0x5590a41f84c0 2024-09-13T19:16:21.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.010+0000 7ff7c5e0b640 1 -- 172.21.15.102:0/751555374 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8d005c040 con 0x5590a41f84c0 2024-09-13T19:16:21.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.010+0000 7ff7c5e0b640 1 -- 172.21.15.102:0/751555374 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8d004ee10 con 0x5590a41f84c0 2024-09-13T19:16:21.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.010+0000 7ff8da42f800 1 -- 172.21.15.102:0/751555374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590a41f84c0 msgr2=0x5590a416cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.010+0000 7ff8da42f800 1 --2- 172.21.15.102:0/751555374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590a41f84c0 0x5590a416cd80 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0045d30 tx=0x7ff8d0050000 comp rx=0 tx=0).stop 2024-09-13T19:16:21.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.010+0000 7ff8da42f800 1 -- 172.21.15.102:0/751555374 shutdown_connections 2024-09-13T19:16:21.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.010+0000 7ff8da42f800 1 --2- 172.21.15.102:0/751555374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590a41f84c0 0x5590a416cd80 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.010+0000 7ff8da42f800 1 -- 172.21.15.102:0/751555374 >> 172.21.15.102:0/751555374 conn(0x5590a41f3df0 msgr2=0x5590a42e3130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:21.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.010+0000 7ff8da42f800 1 -- 172.21.15.102:0/751555374 shutdown_connections 2024-09-13T19:16:21.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.010+0000 7ff8da42f800 1 -- 172.21.15.102:0/751555374 wait complete. 2024-09-13T19:16:21.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.011+0000 7ff8da42f800 1 Processor -- start 2024-09-13T19:16:21.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.011+0000 7ff8da42f800 1 -- start start 2024-09-13T19:16:21.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.011+0000 7ff8da42f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590a41f84c0 0x5590a42f2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.011+0000 7ff8da42f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5590a41ff4e0 con 0x5590a41f84c0 2024-09-13T19:16:21.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.011+0000 7ff8d7f2a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590a41f84c0 0x5590a42f2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.011+0000 7ff8d7f2a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590a41f84c0 0x5590a42f2400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:56094/0 (socket says 172.21.15.102:56094) 2024-09-13T19:16:21.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.011+0000 7ff8d7f2a640 1 -- 172.21.15.102:0/2640205409 learned_addr learned my addr 172.21.15.102:0/2640205409 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:21.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.011+0000 7ff8d7f2a640 1 -- 172.21.15.102:0/2640205409 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590a40a6fe0 con 0x5590a41f84c0 2024-09-13T19:16:21.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.012+0000 7ff8d7f2a640 1 --2- 172.21.15.102:0/2640205409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590a41f84c0 0x5590a42f2400 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0045d30 tx=0x7ff8d0003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.012+0000 7ff7bffff640 1 -- 172.21.15.102:0/2640205409 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8d0061420 con 0x5590a41f84c0 2024-09-13T19:16:21.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.012+0000 7ff7bffff640 1 -- 172.21.15.102:0/2640205409 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8d0070070 con 0x5590a41f84c0 2024-09-13T19:16:21.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.012+0000 7ff7bffff640 1 -- 172.21.15.102:0/2640205409 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8d00616f0 con 0x5590a41f84c0 2024-09-13T19:16:21.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.012+0000 7ff8da42f800 1 -- 172.21.15.102:0/2640205409 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5590a42f2940 con 0x5590a41f84c0 2024-09-13T19:16:21.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.012+0000 7ff8da42f800 1 -- 172.21.15.102:0/2640205409 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590a42f2de0 con 0x5590a41f84c0 2024-09-13T19:16:21.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.013+0000 7ff7bffff640 1 -- 172.21.15.102:0/2640205409 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff8d00618e0 con 0x5590a41f84c0 2024-09-13T19:16:21.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.013+0000 7ff7bffff640 1 --2- 172.21.15.102:0/2640205409 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff7c0036b40 0x7ff7c0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.013+0000 7ff7bffff640 1 -- 172.21.15.102:0/2640205409 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7ff8d0066070 con 0x5590a41f84c0 2024-09-13T19:16:21.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.013+0000 7ff8d7729640 1 --2- 172.21.15.102:0/2640205409 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff7c0036b40 0x7ff7c0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.013+0000 7ff8da42f800 1 --2- 172.21.15.102:0/2640205409 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5590a41f8e00 0x5590a42f9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.013+0000 7ff8da42f800 1 -- 172.21.15.102:0/2640205409 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5590a42f9930 con 0x5590a41f8e00 2024-09-13T19:16:21.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.013+0000 7ff8d872b640 1 --2- 172.21.15.102:0/2640205409 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5590a41f8e00 0x5590a42f9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.013+0000 7ff8d7729640 1 --2- 172.21.15.102:0/2640205409 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff7c0036b40 0x7ff7c0039000 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff8c0000f60 tx=0x7ff8c0001370 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.013+0000 7ff8d872b640 1 --2- 172.21.15.102:0/2640205409 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5590a41f8e00 0x5590a42f9360 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.014+0000 7ff8d872b640 1 -- 172.21.15.102:0/2640205409 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff8c80083e0 con 0x5590a41f8e00 2024-09-13T19:16:21.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.014+0000 7ff8da42f800 1 -- 172.21.15.102:0/2640205409 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5590a42f6a20 con 0x5590a41f8e00 2024-09-13T19:16:21.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.014+0000 7ff8d872b640 1 -- 172.21.15.102:0/2640205409 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff8c80083e0 con 0x5590a41f8e00 2024-09-13T19:16:21.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.014+0000 7ff8da42f800 1 --2- 172.21.15.102:0/2640205409 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5590a42fbc60 0x5590a42fe050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.014+0000 7ff8da42f800 1 -- 172.21.15.102:0/2640205409 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5590a42fe740 con 0x5590a42fbc60 2024-09-13T19:16:21.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.014+0000 7ff8d7f2a640 1 --2- 172.21.15.102:0/2640205409 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5590a42fbc60 0x5590a42fe050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.014+0000 7ff8d7f2a640 1 --2- 172.21.15.102:0/2640205409 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5590a42fbc60 0x5590a42fe050 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.015+0000 7ff8d7f2a640 1 -- 172.21.15.102:0/2640205409 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff8d007c070 con 0x5590a42fbc60 2024-09-13T19:16:21.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.015+0000 7ff8da42f800 1 -- 172.21.15.102:0/2640205409 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5590a42fab00 con 0x5590a41f8e00 2024-09-13T19:16:21.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.015+0000 7ff8d872b640 1 -- 172.21.15.102:0/2640205409 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff8c80083e0 con 0x5590a41f8e00 2024-09-13T19:16:21.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.015+0000 7ff8da42f800 1 -- 172.21.15.102:0/2640205409 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5590a42fafa0 con 0x5590a42fbc60 2024-09-13T19:16:21.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.015+0000 7ff8d7f2a640 1 -- 172.21.15.102:0/2640205409 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff8d007c070 con 0x5590a42fbc60 2024-09-13T19:16:21.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.016+0000 7ff8da42f800 1 Processor -- start 2024-09-13T19:16:21.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.016+0000 7ff8da42f800 1 -- start start 2024-09-13T19:16:21.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.016+0000 7ff8da42f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590a430d0a0 0x5590a430d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.016+0000 7ff8da42f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5590a4094580 con 0x5590a430d0a0 2024-09-13T19:16:21.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.016+0000 7ff8d872b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590a430d0a0 0x5590a430d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.016+0000 7ff8d872b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590a430d0a0 0x5590a430d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:56102/0 (socket says 172.21.15.102:56102) 2024-09-13T19:16:21.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.016+0000 7ff8d872b640 1 -- 172.21.15.102:0/3519359185 learned_addr learned my addr 172.21.15.102:0/3519359185 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:21.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.017+0000 7ff8d872b640 1 -- 172.21.15.102:0/3519359185 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590a430da00 con 0x5590a430d0a0 2024-09-13T19:16:21.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.017+0000 7ff8d872b640 1 --2- 172.21.15.102:0/3519359185 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590a430d0a0 0x5590a430d4c0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x5590a42f34b0 tx=0x7ff8c800beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.017+0000 7ff7bd7fa640 1 -- 172.21.15.102:0/3519359185 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8c801c020 con 0x5590a430d0a0 2024-09-13T19:16:21.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.017+0000 7ff7bd7fa640 1 -- 172.21.15.102:0/3519359185 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8c8007cf0 con 0x5590a430d0a0 2024-09-13T19:16:21.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.017+0000 7ff7bd7fa640 1 -- 172.21.15.102:0/3519359185 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8c8018440 con 0x5590a430d0a0 2024-09-13T19:16:21.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.017+0000 7ff8da42f800 1 -- 172.21.15.102:0/3519359185 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5590a430dc90 con 0x5590a430d0a0 2024-09-13T19:16:21.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.017+0000 7ff8da42f800 1 -- 172.21.15.102:0/3519359185 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590a4310970 con 0x5590a430d0a0 2024-09-13T19:16:21.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.018+0000 7ff7bd7fa640 1 -- 172.21.15.102:0/3519359185 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff8c801f020 con 0x5590a430d0a0 2024-09-13T19:16:21.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.018+0000 7ff7bd7fa640 1 --2- 172.21.15.102:0/3519359185 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff7b0036b90 0x7ff7b0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.018+0000 7ff7bd7fa640 1 -- 172.21.15.102:0/3519359185 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7ff8c804e260 con 0x5590a430d0a0 2024-09-13T19:16:21.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.018+0000 7ff8d7f2a640 1 --2- 172.21.15.102:0/3519359185 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff7b0036b90 0x7ff7b0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.018+0000 7ff8da42f800 1 Processor -- start 2024-09-13T19:16:21.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.018+0000 7ff8da42f800 1 -- start start 2024-09-13T19:16:21.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.018+0000 7ff8d7f2a640 1 --2- 172.21.15.102:0/3519359185 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff7b0036b90 0x7ff7b0039050 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x5590a42fa210 tx=0x7ff8d0046130 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.018+0000 7ff8da42f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590a4319d70 0x5590a431a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.018+0000 7ff8da42f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5590a42ed9a0 con 0x5590a4319d70 2024-09-13T19:16:21.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.019+0000 7ff8d872b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590a4319d70 0x5590a431a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.019+0000 7ff8d872b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590a4319d70 0x5590a431a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:56118/0 (socket says 172.21.15.102:56118) 2024-09-13T19:16:21.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.019+0000 7ff8d872b640 1 -- 172.21.15.102:0/3415177618 learned_addr learned my addr 172.21.15.102:0/3415177618 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:21.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.019+0000 7ff8d872b640 1 -- 172.21.15.102:0/3415177618 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590a431a740 con 0x5590a4319d70 2024-09-13T19:16:21.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.019+0000 7ff8d872b640 1 --2- 172.21.15.102:0/3415177618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590a4319d70 0x5590a431a170 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ff8c804c5f0 tx=0x7ff8c8016640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ffd586cc37caf28 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.019+0000 7ff7b6ffd640 1 -- 172.21.15.102:0/3415177618 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8c8045070 con 0x5590a4319d70 2024-09-13T19:16:21.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.019+0000 7ff7b6ffd640 1 -- 172.21.15.102:0/3415177618 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8c8021400 con 0x5590a4319d70 2024-09-13T19:16:21.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.019+0000 7ff7b6ffd640 1 -- 172.21.15.102:0/3415177618 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8c8018b40 con 0x5590a4319d70 2024-09-13T19:16:21.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.020+0000 7ff8da42f800 1 -- 172.21.15.102:0/3415177618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590a4319d70 msgr2=0x5590a431a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.020+0000 7ff8da42f800 1 --2- 172.21.15.102:0/3415177618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590a4319d70 0x5590a431a170 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ff8c804c5f0 tx=0x7ff8c8016640 comp rx=0 tx=0).stop 2024-09-13T19:16:21.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.020+0000 7ff8da42f800 1 -- 172.21.15.102:0/3415177618 shutdown_connections 2024-09-13T19:16:21.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.020+0000 7ff8da42f800 1 --2- 172.21.15.102:0/3415177618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590a4319d70 0x5590a431a170 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.020+0000 7ff8da42f800 1 -- 172.21.15.102:0/3415177618 >> 172.21.15.102:0/3415177618 conn(0x5590a43160d0 msgr2=0x5590a43141d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:21.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.020+0000 7ff8da42f800 1 -- 172.21.15.102:0/3415177618 shutdown_connections 2024-09-13T19:16:21.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.020+0000 7ff8da42f800 1 -- 172.21.15.102:0/3415177618 wait complete. 2024-09-13T19:16:21.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.020+0000 7ff8da42f800 1 Processor -- start 2024-09-13T19:16:21.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.020+0000 7ff8da42f800 1 -- start start 2024-09-13T19:16:21.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.020+0000 7ff8da42f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590a4319d70 0x5590a4321300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.020+0000 7ff8da42f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5590a431adb0 con 0x5590a4319d70 2024-09-13T19:16:21.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.020+0000 7ff8d872b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590a4319d70 0x5590a4321300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.020+0000 7ff8d872b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590a4319d70 0x5590a4321300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:56120/0 (socket says 172.21.15.102:56120) 2024-09-13T19:16:21.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.020+0000 7ff8d872b640 1 -- 172.21.15.102:0/462634242 learned_addr learned my addr 172.21.15.102:0/462634242 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:21.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.021+0000 7ff8d872b640 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590a4321840 con 0x5590a4319d70 2024-09-13T19:16:21.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.021+0000 7ff8d872b640 1 --2- 172.21.15.102:0/462634242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590a4319d70 0x5590a4321300 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7ff8c804b510 tx=0x7ff8c804c580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.021+0000 7ff7b57fa640 1 -- 172.21.15.102:0/462634242 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8c8045030 con 0x5590a4319d70 2024-09-13T19:16:21.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.021+0000 7ff7b57fa640 1 -- 172.21.15.102:0/462634242 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8c804b210 con 0x5590a4319d70 2024-09-13T19:16:21.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.021+0000 7ff7b57fa640 1 -- 172.21.15.102:0/462634242 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8c803f040 con 0x5590a4319d70 2024-09-13T19:16:21.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.021+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5590a4321ad0 con 0x5590a4319d70 2024-09-13T19:16:21.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.021+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590a4324780 con 0x5590a4319d70 2024-09-13T19:16:21.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.022+0000 7ff7b57fa640 1 -- 172.21.15.102:0/462634242 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff8c8016040 con 0x5590a4319d70 2024-09-13T19:16:21.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.022+0000 7ff7b57fa640 1 --2- 172.21.15.102:0/462634242 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff7a0036b90 0x7ff7a0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.022+0000 7ff7b57fa640 1 -- 172.21.15.102:0/462634242 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7ff8c8046070 con 0x5590a4319d70 2024-09-13T19:16:21.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.022+0000 7ff8d7f2a640 1 --2- 172.21.15.102:0/462634242 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff7a0036b90 0x7ff7a0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.022+0000 7ff8da42f800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.022+0000 7ff8da42f800 1 --2- 172.21.15.102:0/462634242 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5590a432cce0 0x5590a432f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.023+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5590a432f8f0 con 0x5590a432cce0 2024-09-13T19:16:21.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.023+0000 7ff8d7729640 1 --2- 172.21.15.102:0/462634242 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5590a432cce0 0x5590a432f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.023+0000 7ff8d7f2a640 1 --2- 172.21.15.102:0/462634242 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff7a0036b90 0x7ff7a0039050 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff8d004e5f0 tx=0x7ff8d0089000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.023+0000 7ff8d7729640 1 --2- 172.21.15.102:0/462634242 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5590a432cce0 0x5590a432f1a0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.023+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff8c000f610 con 0x5590a432cce0 2024-09-13T19:16:21.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.023+0000 7ff8da42f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:21.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.023+0000 7ff8da42f800 20 realm 2024-09-13T19:16:21.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.023+0000 7ff8da42f800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.023+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5590a432c130 con 0x5590a432cce0 2024-09-13T19:16:21.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.023+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff8c000f610 con 0x5590a432cce0 2024-09-13T19:16:21.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.023+0000 7ff8da42f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:21.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.023+0000 7ff8da42f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:21.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.023+0000 7ff8da42f800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.023+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5590a43303d0 con 0x5590a432cce0 2024-09-13T19:16:21.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.023+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff8c000f610 con 0x5590a432cce0 2024-09-13T19:16:21.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.023+0000 7ff8da42f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:21.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.024+0000 7ff8da42f800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.024+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5590a4330ca0 con 0x5590a432cce0 2024-09-13T19:16:21.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.024+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff8c000f610 con 0x5590a432cce0 2024-09-13T19:16:21.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.024+0000 7ff8da42f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:21.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.024+0000 7ff8da42f800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.024+0000 7ff8da42f800 1 --2- 172.21.15.102:0/462634242 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5590a4331550 0x5590a4333960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.024+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5590a43340c0 con 0x5590a4331550 2024-09-13T19:16:21.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.024+0000 7ff8d872b640 1 --2- 172.21.15.102:0/462634242 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5590a4331550 0x5590a4333960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.024+0000 7ff8d872b640 1 --2- 172.21.15.102:0/462634242 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5590a4331550 0x5590a4333960 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.024+0000 7ff8d872b640 1 -- 172.21.15.102:0/462634242 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff8c8028070 con 0x5590a4331550 2024-09-13T19:16:21.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.024+0000 7ff8da42f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:21.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.024+0000 7ff8da42f800 20 searching for the correct realm 2024-09-13T19:16:21.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.024+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5590a4335af0 con 0x5590a4331550 2024-09-13T19:16:21.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.025+0000 7ff8d872b640 1 -- 172.21.15.102:0/462634242 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8c8028070 con 0x5590a4331550 2024-09-13T19:16:21.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.025+0000 7ff8d872b640 1 --2- 172.21.15.102:0/462634242 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7ff8c8021020 0x7ff8c802b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.025+0000 7ff8d872b640 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5590a4335af0 con 0x7ff8c8021020 2024-09-13T19:16:21.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.025+0000 7ff8d7f2a640 1 --2- 172.21.15.102:0/462634242 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7ff8c8021020 0x7ff8c802b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.025+0000 7ff8d7f2a640 1 --2- 172.21.15.102:0/462634242 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7ff8c8021020 0x7ff8c802b450 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.025+0000 7ff8d7f2a640 1 -- 172.21.15.102:0/462634242 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8d007c070 con 0x7ff8c8021020 2024-09-13T19:16:21.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.025+0000 7ff8d7f2a640 1 --2- 172.21.15.102:0/462634242 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7ff8d00a6040 0x7ff8d00090d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.025+0000 7ff8d7f2a640 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5590a4335af0 con 0x7ff8d00a6040 2024-09-13T19:16:21.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.026+0000 7ff8d7729640 1 --2- 172.21.15.102:0/462634242 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7ff8d00a6040 0x7ff8d00090d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.026+0000 7ff8d7729640 1 --2- 172.21.15.102:0/462634242 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7ff8d00a6040 0x7ff8d00090d0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.026+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8c000f610 con 0x7ff8d00a6040 2024-09-13T19:16:21.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.026+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5590a4335af0 con 0x5590a432cce0 2024-09-13T19:16:21.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.027+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8c000f610 con 0x5590a432cce0 2024-09-13T19:16:21.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.027+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5590a4335af0 con 0x5590a432cce0 2024-09-13T19:16:21.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.027+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8c002b040 con 0x5590a432cce0 2024-09-13T19:16:21.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.027+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5590a4335af0 con 0x7ff8d00a6040 2024-09-13T19:16:21.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.027+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8c002b040 con 0x7ff8d00a6040 2024-09-13T19:16:21.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.027+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5590a4335af0 con 0x7ff8d00a6040 2024-09-13T19:16:21.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.027+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8c002b040 con 0x7ff8d00a6040 2024-09-13T19:16:21.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.027+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5590a4335af0 con 0x7ff8c8021020 2024-09-13T19:16:21.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.028+0000 7ff8d7f2a640 1 -- 172.21.15.102:0/462634242 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8d007c070 con 0x7ff8c8021020 2024-09-13T19:16:21.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.028+0000 7ff8d7f2a640 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5590a4335af0 con 0x5590a4331550 2024-09-13T19:16:21.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.028+0000 7ff8d872b640 1 -- 172.21.15.102:0/462634242 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8c8028070 con 0x5590a4331550 2024-09-13T19:16:21.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.028+0000 7ff8d872b640 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5590a4335af0 con 0x5590a432cce0 2024-09-13T19:16:21.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.028+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8c002b040 con 0x5590a432cce0 2024-09-13T19:16:21.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.028+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5590a4335af0 con 0x7ff8d00a6040 2024-09-13T19:16:21.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.028+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8c002b040 con 0x7ff8d00a6040 2024-09-13T19:16:21.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.028+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5590a4335af0 con 0x5590a432cce0 2024-09-13T19:16:21.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.029+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8c002b040 con 0x5590a432cce0 2024-09-13T19:16:21.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.029+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5590a4335af0 con 0x7ff8c8021020 2024-09-13T19:16:21.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.029+0000 7ff8d7f2a640 1 -- 172.21.15.102:0/462634242 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff8d007c070 con 0x7ff8c8021020 2024-09-13T19:16:21.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.029+0000 7ff8d7f2a640 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5590a4335af0 con 0x5590a4331550 2024-09-13T19:16:21.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.029+0000 7ff8d872b640 1 -- 172.21.15.102:0/462634242 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8c8028070 con 0x5590a4331550 2024-09-13T19:16:21.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.029+0000 7ff8d872b640 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5590a4335af0 con 0x5590a4331550 2024-09-13T19:16:21.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.029+0000 7ff8d872b640 1 -- 172.21.15.102:0/462634242 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff8c8028070 con 0x5590a4331550 2024-09-13T19:16:21.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.029+0000 7ff8d872b640 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5590a4335af0 con 0x7ff8d00a6040 2024-09-13T19:16:21.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.030+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8c002b040 con 0x7ff8d00a6040 2024-09-13T19:16:21.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.030+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5590a4335af0 con 0x5590a4331550 2024-09-13T19:16:21.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.030+0000 7ff8d872b640 1 -- 172.21.15.102:0/462634242 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff8c8028070 con 0x5590a4331550 2024-09-13T19:16:21.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.030+0000 7ff8d872b640 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5590a4335af0 con 0x5590a4331550 2024-09-13T19:16:21.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.030+0000 7ff8d872b640 1 -- 172.21.15.102:0/462634242 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8c8028070 con 0x5590a4331550 2024-09-13T19:16:21.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.030+0000 7ff8d872b640 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5590a4335af0 con 0x5590a432cce0 2024-09-13T19:16:21.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.030+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8c002b040 con 0x5590a432cce0 2024-09-13T19:16:21.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.030+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5590a4335af0 con 0x5590a432cce0 2024-09-13T19:16:21.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.030+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff8c002b040 con 0x5590a432cce0 2024-09-13T19:16:21.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.030+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5590a4335af0 con 0x7ff8d00a6040 2024-09-13T19:16:21.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.031+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8c002b040 con 0x7ff8d00a6040 2024-09-13T19:16:21.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.031+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5590a4335af0 con 0x5590a4331550 2024-09-13T19:16:21.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.031+0000 7ff8d872b640 1 -- 172.21.15.102:0/462634242 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8c8066040 con 0x5590a4331550 2024-09-13T19:16:21.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.031+0000 7ff8d872b640 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5590a4335af0 con 0x7ff8c8021020 2024-09-13T19:16:21.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.031+0000 7ff8d7f2a640 1 -- 172.21.15.102:0/462634242 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8d007c070 con 0x7ff8c8021020 2024-09-13T19:16:21.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.031+0000 7ff8d7f2a640 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5590a4335af0 con 0x5590a432cce0 2024-09-13T19:16:21.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.031+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8c002b040 con 0x5590a432cce0 2024-09-13T19:16:21.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.031+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5590a4335af0 con 0x7ff8d00a6040 2024-09-13T19:16:21.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.032+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8c003b040 con 0x7ff8d00a6040 2024-09-13T19:16:21.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.032+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5590a4335af0 con 0x5590a4331550 2024-09-13T19:16:21.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.032+0000 7ff8d872b640 1 -- 172.21.15.102:0/462634242 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8c8066040 con 0x5590a4331550 2024-09-13T19:16:21.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.032+0000 7ff8d872b640 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5590a4335af0 con 0x7ff8d00a6040 2024-09-13T19:16:21.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.032+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8c003b040 con 0x7ff8d00a6040 2024-09-13T19:16:21.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.032+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5590a4335af0 con 0x7ff8c8021020 2024-09-13T19:16:21.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.032+0000 7ff8d7f2a640 1 -- 172.21.15.102:0/462634242 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8d007c070 con 0x7ff8c8021020 2024-09-13T19:16:21.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.032+0000 7ff8d7f2a640 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5590a4335af0 con 0x5590a4331550 2024-09-13T19:16:21.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.033+0000 7ff8d872b640 1 -- 172.21.15.102:0/462634242 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8c8066040 con 0x5590a4331550 2024-09-13T19:16:21.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.033+0000 7ff8d872b640 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5590a4335af0 con 0x7ff8d00a6040 2024-09-13T19:16:21.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.033+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8c003b040 con 0x7ff8d00a6040 2024-09-13T19:16:21.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.033+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5590a4335af0 con 0x5590a432cce0 2024-09-13T19:16:21.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.033+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff8c003b040 con 0x5590a432cce0 2024-09-13T19:16:21.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.033+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5590a4335af0 con 0x7ff8c8021020 2024-09-13T19:16:21.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.033+0000 7ff8d7f2a640 1 -- 172.21.15.102:0/462634242 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8d00b3040 con 0x7ff8c8021020 2024-09-13T19:16:21.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.033+0000 7ff8da42f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:21.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.033+0000 7ff8da42f800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:21.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.033+0000 7ff8da42f800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:21.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.033+0000 7ff8da42f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:21.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.033+0000 7ff8da42f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:21.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.033+0000 7ff8da42f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:21.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.033+0000 7ff8da42f800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.033+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5590a4334b50 con 0x5590a432cce0 2024-09-13T19:16:21.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.034+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff8c003b040 con 0x5590a432cce0 2024-09-13T19:16:21.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.034+0000 7ff8da42f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:21.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.034+0000 7ff8da42f800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.034+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5590a43353f0 con 0x5590a432cce0 2024-09-13T19:16:21.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.034+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff8c003b040 con 0x5590a432cce0 2024-09-13T19:16:21.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.034+0000 7ff8da42f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:21.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.034+0000 7ff8da42f800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.034+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5590a4334790 con 0x5590a4331550 2024-09-13T19:16:21.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.034+0000 7ff8d872b640 1 -- 172.21.15.102:0/462634242 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff8c8066040 con 0x5590a4331550 2024-09-13T19:16:21.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.034+0000 7ff8da42f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:21.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.034+0000 7ff8da42f800 20 zone default found 2024-09-13T19:16:21.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.034+0000 7ff8da42f800 4 Realm: () 2024-09-13T19:16:21.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.034+0000 7ff8da42f800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:21.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.034+0000 7ff8da42f800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:21.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.034+0000 7ff8da42f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:21.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.034+0000 7ff8da42f800 20 zonegroup default 2024-09-13T19:16:21.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.034+0000 7ff8da42f800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.034+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5590a4336470 con 0x7ff8d00a6040 2024-09-13T19:16:21.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.034+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff8c003b040 con 0x7ff8d00a6040 2024-09-13T19:16:21.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.034+0000 7ff8da42f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:21.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.034+0000 7ff8da42f800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.035+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5590a4337eb0 con 0x5590a4331550 2024-09-13T19:16:21.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.035+0000 7ff8d872b640 1 -- 172.21.15.102:0/462634242 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff8c8066040 con 0x5590a4331550 2024-09-13T19:16:21.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.035+0000 7ff8da42f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:21.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.035+0000 7ff8da42f800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.035+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5590a43382d0 con 0x5590a4331550 2024-09-13T19:16:21.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.035+0000 7ff8d872b640 1 -- 172.21.15.102:0/462634242 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff8c8066040 con 0x5590a4331550 2024-09-13T19:16:21.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.035+0000 7ff8da42f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:21.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.035+0000 7ff8da42f800 20 started sync module instance, tier type = 2024-09-13T19:16:21.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.035+0000 7ff8da42f800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:21.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.035+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5590a4337290 con 0x7ff8c8021020 2024-09-13T19:16:21.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.036+0000 7ff8d7f2a640 1 -- 172.21.15.102:0/462634242 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(44 notify.0 [create] v34'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8d00b3040 con 0x7ff8c8021020 2024-09-13T19:16:21.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.036+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94079718485472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5590a4338760 con 0x7ff8c8021020 2024-09-13T19:16:21.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.036+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5590a4338fb0 con 0x5590a432cce0 2024-09-13T19:16:21.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.037+0000 7ff8d7f2a640 1 -- 172.21.15.102:0/462634242 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94079718485472] v34'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8d00b3040 con 0x7ff8c8021020 2024-09-13T19:16:21.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.037+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v34'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8c003b040 con 0x5590a432cce0 2024-09-13T19:16:21.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.037+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94079718492928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5590a43393d0 con 0x5590a432cce0 2024-09-13T19:16:21.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.037+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5590a4339c60 con 0x5590a4331550 2024-09-13T19:16:21.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.038+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94079718492928] v34'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8c003b040 con 0x5590a432cce0 2024-09-13T19:16:21.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.038+0000 7ff8d872b640 1 -- 172.21.15.102:0/462634242 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v34'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8c8066040 con 0x5590a4331550 2024-09-13T19:16:21.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.038+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94079718493984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5590a43397f0 con 0x5590a4331550 2024-09-13T19:16:21.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.038+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5590a433a700 con 0x7ff8c8021020 2024-09-13T19:16:21.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.039+0000 7ff8d872b640 1 -- 172.21.15.102:0/462634242 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94079718493984] v34'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8c8066040 con 0x5590a4331550 2024-09-13T19:16:21.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.039+0000 7ff8d7f2a640 1 -- 172.21.15.102:0/462634242 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(50 notify.3 [create] v34'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8d00b3040 con 0x7ff8c8021020 2024-09-13T19:16:21.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.039+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94079718498800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5590a43397f0 con 0x7ff8c8021020 2024-09-13T19:16:21.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.039+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5590a433b190 con 0x5590a432cce0 2024-09-13T19:16:21.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.040+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v34'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8c003b040 con 0x5590a432cce0 2024-09-13T19:16:21.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.040+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94079718501472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5590a433b150 con 0x5590a432cce0 2024-09-13T19:16:21.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.040+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5590a433c170 con 0x7ff8d00a6040 2024-09-13T19:16:21.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.040+0000 7ff8d7f2a640 1 -- 172.21.15.102:0/462634242 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94079718498800] v34'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8d00b3040 con 0x7ff8c8021020 2024-09-13T19:16:21.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.041+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(54 notify.5 [create] v34'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8c003b040 con 0x7ff8d00a6040 2024-09-13T19:16:21.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.041+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94079718501472] v34'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8c003b040 con 0x5590a432cce0 2024-09-13T19:16:21.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.041+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94079718505600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5590a433c170 con 0x7ff8d00a6040 2024-09-13T19:16:21.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.041+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5590a433b570 con 0x7ff8d00a6040 2024-09-13T19:16:21.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.042+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94079718505600] v34'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8c003b040 con 0x7ff8d00a6040 2024-09-13T19:16:21.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.042+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(56 notify.6 [create] v34'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8c003b040 con 0x7ff8d00a6040 2024-09-13T19:16:21.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.042+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94079718495040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5590a433c6d0 con 0x7ff8d00a6040 2024-09-13T19:16:21.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.042+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5590a433d090 con 0x7ff8d00a6040 2024-09-13T19:16:21.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.043+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94079718495040] v34'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8c003b040 con 0x7ff8d00a6040 2024-09-13T19:16:21.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.043+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(58 notify.7 [create] v34'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8c003b040 con 0x7ff8d00a6040 2024-09-13T19:16:21.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.043+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94079718503792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5590a433d090 con 0x7ff8d00a6040 2024-09-13T19:16:21.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.043+0000 7ff8da42f800 20 add_watcher() i=0 2024-09-13T19:16:21.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.043+0000 7ff8da42f800 20 add_watcher() i=1 2024-09-13T19:16:21.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.043+0000 7ff8da42f800 20 add_watcher() i=2 2024-09-13T19:16:21.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.043+0000 7ff8da42f800 20 add_watcher() i=3 2024-09-13T19:16:21.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.043+0000 7ff8da42f800 20 add_watcher() i=4 2024-09-13T19:16:21.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.043+0000 7ff8da42f800 20 add_watcher() i=5 2024-09-13T19:16:21.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.043+0000 7ff8da42f800 20 add_watcher() i=6 2024-09-13T19:16:21.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.044+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94079718503792] v34'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8c003b040 con 0x7ff8d00a6040 2024-09-13T19:16:21.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.044+0000 7ff8da42f800 20 add_watcher() i=7 2024-09-13T19:16:21.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.044+0000 7ff8da42f800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:21.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.044+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5590a43403b0 con 0x5590a432cce0 2024-09-13T19:16:21.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.044+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff8c003b040 con 0x5590a432cce0 2024-09-13T19:16:21.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.044+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94079718509904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5590a433d620 con 0x5590a432cce0 2024-09-13T19:16:21.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.046+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94079718509904] v34'144 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff8c003b040 con 0x5590a432cce0 2024-09-13T19:16:21.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.046+0000 7ff78dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:21.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.046+0000 7ff8da42f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:21.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.046+0000 7ff8da42f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:21.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.046+0000 7ff8da42f800 5 note: GC not initialized 2024-09-13T19:16:21.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.046+0000 7ff78cfe1640 20 reqs_thread_entry: start 2024-09-13T19:16:21.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.046+0000 7ff8da42f800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:21.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.047+0000 7ff8da42f800 20 Filter name: none 2024-09-13T19:16:21.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.047+0000 7ff7067fc640 20 reqs_thread_entry: start 2024-09-13T19:16:21.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.047+0000 7ff8da42f800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.047+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5590a43736f0 con 0x7ff8c8021020 2024-09-13T19:16:21.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.047+0000 7ff8d7f2a640 1 -- 172.21.15.102:0/462634242 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv32 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7ff8d00b3040 con 0x7ff8c8021020 2024-09-13T19:16:21.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.047+0000 7ff8da42f800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:16:21.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.047+0000 7ff8da42f800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.047+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:63 8.9 8:917ee2d5:root::.bucket.meta.myfoo%3a509740b4-c081-4f37-bd6d-df9ca851489b.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5590a4374060 con 0x7ff8c8021020 2024-09-13T19:16:21.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.047+0000 7ff8d7f2a640 1 -- 172.21.15.102:0/462634242 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(63 .bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv30 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7ff8d00b3040 con 0x7ff8c8021020 2024-09-13T19:16:21.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.047+0000 7ff8da42f800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:16:21.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.047+0000 7ff8da42f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T19:16:21.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.047+0000 7ff8da42f800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.047+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5590a4374010 con 0x7ff8c8021020 2024-09-13T19:16:21.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.048+0000 7ff8d7f2a640 1 -- 172.21.15.102:0/462634242 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv32 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7ff8d00b3040 con 0x7ff8c8021020 2024-09-13T19:16:21.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.048+0000 7ff8da42f800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:16:21.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.048+0000 7ff8da42f800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.048+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:65 8.9 8:917ee2d5:root::.bucket.meta.myfoo%3a509740b4-c081-4f37-bd6d-df9ca851489b.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5590a4375710 con 0x7ff8c8021020 2024-09-13T19:16:21.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.048+0000 7ff8d7f2a640 1 -- 172.21.15.102:0/462634242 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(65 .bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv30 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7ff8d00b3040 con 0x7ff8c8021020 2024-09-13T19:16:21.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.048+0000 7ff8da42f800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:16:21.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.048+0000 7ff8da42f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T19:16:21.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.048+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:66 4.3e 4:7eb89d75:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5590a4377030 con 0x7ff8c8021020 2024-09-13T19:16:21.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.048+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:67 4.28 4:16845d32:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5590a4379a00 con 0x5590a432cce0 2024-09-13T19:16:21.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.048+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:68 4.e 4:7015f333:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5590a437c500 con 0x7ff8c8021020 2024-09-13T19:16:21.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.048+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:69 4.31 4:8e14c63f:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5590a437eef0 con 0x5590a432cce0 2024-09-13T19:16:21.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.048+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:70 4.1f 4:fb695182:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5590a4381760 con 0x5590a4331550 2024-09-13T19:16:21.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.048+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:71 4.22 4:475c4288:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5590a43842d0 con 0x5590a432cce0 2024-09-13T19:16:21.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.048+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:72 4.8 4:102eb403:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5590a4387160 con 0x5590a4331550 2024-09-13T19:16:21.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.048+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:73 4.3d 4:be2d5322:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5590a43899d0 con 0x5590a4331550 2024-09-13T19:16:21.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.048+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:74 4.8 4:130dc037:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5590a4387160 con 0x5590a4331550 2024-09-13T19:16:21.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.048+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:75 4.32 4:4c01988a:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5590a438e820 con 0x5590a432cce0 2024-09-13T19:16:21.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.048+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:76 4.1c 4:3b6ce2a2:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5590a4390cf0 con 0x7ff8d00a6040 2024-09-13T19:16:21.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.048+0000 7ff8d7f2a640 1 -- 172.21.15.102:0/462634242 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(66 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff8d00b3040 con 0x7ff8c8021020 2024-09-13T19:16:21.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.049+0000 7ff8d7f2a640 1 -- 172.21.15.102:0/462634242 <== osd.2 v2:172.21.15.102:6816/2238176080 16 ==== osd_op_reply(68 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff8d00b3040 con 0x7ff8c8021020 2024-09-13T19:16:21.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.049+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(67 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff8c003b040 con 0x5590a432cce0 2024-09-13T19:16:21.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.049+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(69 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff8c003b040 con 0x5590a432cce0 2024-09-13T19:16:21.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.049+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(71 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.5 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7ff8c003b040 con 0x5590a432cce0 2024-09-13T19:16:21.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.049+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(75 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff8c003b040 con 0x5590a432cce0 2024-09-13T19:16:21.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.049+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(76 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff8c003b040 con 0x7ff8d00a6040 2024-09-13T19:16:21.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.049+0000 7ff8d872b640 1 -- 172.21.15.102:0/462634242 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(70 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff8c8066040 con 0x5590a4331550 2024-09-13T19:16:21.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.049+0000 7ff8d872b640 1 -- 172.21.15.102:0/462634242 <== osd.3 v2:172.21.15.102:6800/3096737090 17 ==== osd_op_reply(72 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.6 [call out=124b] v0'0 uv12 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7ff8c8066040 con 0x5590a4331550 2024-09-13T19:16:21.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.049+0000 7ff8d872b640 1 -- 172.21.15.102:0/462634242 <== osd.3 v2:172.21.15.102:6800/3096737090 18 ==== osd_op_reply(73 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff8c8066040 con 0x5590a4331550 2024-09-13T19:16:21.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.049+0000 7ff8d872b640 1 -- 172.21.15.102:0/462634242 <== osd.3 v2:172.21.15.102:6800/3096737090 19 ==== osd_op_reply(74 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.1.8 [call out=124b] v0'0 uv8 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7ff8c8066040 con 0x5590a4331550 2024-09-13T19:16:21.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.050+0000 7ff78dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:21.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.050+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94079718509904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5590a4371150 con 0x5590a432cce0 2024-09-13T19:16:21.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.051+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94079718509904] v34'145 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff8c0048040 con 0x5590a432cce0 2024-09-13T19:16:21.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.051+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94079718485472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5590a4371150 con 0x7ff8c8021020 2024-09-13T19:16:21.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.052+0000 7ff8d7f2a640 1 -- 172.21.15.102:0/462634242 <== osd.2 v2:172.21.15.102:6816/2238176080 17 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94079718485472] v34'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8d00b3040 con 0x7ff8c8021020 2024-09-13T19:16:21.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.052+0000 7ff8da42f800 20 remove_watcher() i=0 2024-09-13T19:16:21.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.052+0000 7ff8da42f800 2 removed watcher, disabling cache 2024-09-13T19:16:21.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.052+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94079718492928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5590a4371150 con 0x5590a432cce0 2024-09-13T19:16:21.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.053+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94079718492928] v34'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8c0048040 con 0x5590a432cce0 2024-09-13T19:16:21.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.053+0000 7ff8da42f800 20 remove_watcher() i=1 2024-09-13T19:16:21.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.053+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94079718493984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5590a4371150 con 0x5590a4331550 2024-09-13T19:16:21.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.054+0000 7ff8d872b640 1 -- 172.21.15.102:0/462634242 <== osd.3 v2:172.21.15.102:6800/3096737090 20 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94079718493984] v34'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8c8066040 con 0x5590a4331550 2024-09-13T19:16:21.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.054+0000 7ff8da42f800 20 remove_watcher() i=2 2024-09-13T19:16:21.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.054+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94079718498800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5590a4371150 con 0x7ff8c8021020 2024-09-13T19:16:21.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.055+0000 7ff8d7f2a640 1 -- 172.21.15.102:0/462634242 <== osd.2 v2:172.21.15.102:6816/2238176080 18 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94079718498800] v34'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8d00b3040 con 0x7ff8c8021020 2024-09-13T19:16:21.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.055+0000 7ff8da42f800 20 remove_watcher() i=3 2024-09-13T19:16:21.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.055+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94079718501472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5590a4371150 con 0x5590a432cce0 2024-09-13T19:16:21.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.056+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94079718501472] v34'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8c0048040 con 0x5590a432cce0 2024-09-13T19:16:21.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.056+0000 7ff8da42f800 20 remove_watcher() i=4 2024-09-13T19:16:21.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.056+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94079718505600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5590a4371150 con 0x7ff8d00a6040 2024-09-13T19:16:21.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.057+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94079718505600] v34'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8c0048040 con 0x7ff8d00a6040 2024-09-13T19:16:21.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.057+0000 7ff8da42f800 20 remove_watcher() i=5 2024-09-13T19:16:21.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.057+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94079718495040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5590a4371150 con 0x7ff8d00a6040 2024-09-13T19:16:21.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.058+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94079718495040] v34'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8c0048040 con 0x7ff8d00a6040 2024-09-13T19:16:21.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.058+0000 7ff8da42f800 20 remove_watcher() i=6 2024-09-13T19:16:21.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.058+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94079718503792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5590a4371150 con 0x7ff8d00a6040 2024-09-13T19:16:21.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.059+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 <== osd.0 v2:172.21.15.53:6800/4021716951 20 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94079718503792] v34'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8c0048040 con 0x7ff8d00a6040 2024-09-13T19:16:21.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.059+0000 7ff8da42f800 20 remove_watcher() i=7 2024-09-13T19:16:21.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.059+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7ff8d00a6040 msgr2=0x7ff8d00090d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.059+0000 7ff8da42f800 1 --2- 172.21.15.102:0/462634242 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7ff8d00a6040 0x7ff8d00090d0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.059+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5590a432cce0 msgr2=0x5590a432f1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.059+0000 7ff8da42f800 1 --2- 172.21.15.102:0/462634242 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5590a432cce0 0x5590a432f1a0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.059+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7ff8c8021020 msgr2=0x7ff8c802b450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.059+0000 7ff8da42f800 1 --2- 172.21.15.102:0/462634242 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7ff8c8021020 0x7ff8c802b450 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.059+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5590a4331550 msgr2=0x5590a4333960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.059+0000 7ff8da42f800 1 --2- 172.21.15.102:0/462634242 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5590a4331550 0x5590a4333960 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.059+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff7a0036b90 msgr2=0x7ff7a0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.059+0000 7ff8da42f800 1 --2- 172.21.15.102:0/462634242 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff7a0036b90 0x7ff7a0039050 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff8d004e5f0 tx=0x7ff8d0089000 comp rx=0 tx=0).stop 2024-09-13T19:16:21.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.059+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590a4319d70 msgr2=0x5590a4321300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.059+0000 7ff8d7729640 1 -- 172.21.15.102:0/462634242 reap_dead start 2024-09-13T19:16:21.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.059+0000 7ff8da42f800 1 --2- 172.21.15.102:0/462634242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590a4319d70 0x5590a4321300 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7ff8c804b510 tx=0x7ff8c804c580 comp rx=0 tx=0).stop 2024-09-13T19:16:21.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.059+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 shutdown_connections 2024-09-13T19:16:21.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.059+0000 7ff8da42f800 1 --2- 172.21.15.102:0/462634242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590a4319d70 0x5590a4321300 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.059+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 >> 172.21.15.102:0/462634242 conn(0x5590a43160d0 msgr2=0x5590a43141a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:21.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.059+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 shutdown_connections 2024-09-13T19:16:21.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.059+0000 7ff8da42f800 1 -- 172.21.15.102:0/462634242 wait complete. 2024-09-13T19:16:21.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.059+0000 7ff8da42f800 1 -- 172.21.15.102:0/3519359185 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff7b0036b90 msgr2=0x7ff7b0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.059+0000 7ff8da42f800 1 --2- 172.21.15.102:0/3519359185 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff7b0036b90 0x7ff7b0039050 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x5590a42fa210 tx=0x7ff8d0046130 comp rx=0 tx=0).stop 2024-09-13T19:16:21.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.059+0000 7ff8da42f800 1 -- 172.21.15.102:0/3519359185 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590a430d0a0 msgr2=0x5590a430d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.060+0000 7ff8da42f800 1 --2- 172.21.15.102:0/3519359185 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590a430d0a0 0x5590a430d4c0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x5590a42f34b0 tx=0x7ff8c800beb0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.060+0000 7ff8da42f800 1 -- 172.21.15.102:0/3519359185 shutdown_connections 2024-09-13T19:16:21.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.060+0000 7ff8da42f800 1 --2- 172.21.15.102:0/3519359185 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff7b0036b90 0x7ff7b0039050 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.060+0000 7ff8da42f800 1 --2- 172.21.15.102:0/3519359185 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590a430d0a0 0x5590a430d4c0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.060+0000 7ff8da42f800 1 -- 172.21.15.102:0/3519359185 >> 172.21.15.102:0/3519359185 conn(0x5590a4302030 msgr2=0x5590a4304bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:21.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.060+0000 7ff8da42f800 1 -- 172.21.15.102:0/3519359185 shutdown_connections 2024-09-13T19:16:21.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.060+0000 7ff8da42f800 1 -- 172.21.15.102:0/3519359185 wait complete. 2024-09-13T19:16:21.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.060+0000 7ff8da42f800 1 -- 172.21.15.102:0/2640205409 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5590a41f8e00 msgr2=0x5590a42f9360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.060+0000 7ff8da42f800 1 --2- 172.21.15.102:0/2640205409 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5590a41f8e00 0x5590a42f9360 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.060+0000 7ff8da42f800 1 -- 172.21.15.102:0/2640205409 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5590a42fbc60 msgr2=0x5590a42fe050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.060+0000 7ff8da42f800 1 --2- 172.21.15.102:0/2640205409 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5590a42fbc60 0x5590a42fe050 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.060+0000 7ff8da42f800 1 -- 172.21.15.102:0/2640205409 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff7c0036b40 msgr2=0x7ff7c0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.060+0000 7ff8da42f800 1 --2- 172.21.15.102:0/2640205409 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff7c0036b40 0x7ff7c0039000 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff8c0000f60 tx=0x7ff8c0001370 comp rx=0 tx=0).stop 2024-09-13T19:16:21.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.060+0000 7ff8da42f800 1 -- 172.21.15.102:0/2640205409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590a41f84c0 msgr2=0x5590a42f2400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.060+0000 7ff8da42f800 1 --2- 172.21.15.102:0/2640205409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590a41f84c0 0x5590a42f2400 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0045d30 tx=0x7ff8d0003330 comp rx=0 tx=0).stop 2024-09-13T19:16:21.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.060+0000 7ff8da42f800 1 -- 172.21.15.102:0/2640205409 shutdown_connections 2024-09-13T19:16:21.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.060+0000 7ff8da42f800 1 --2- 172.21.15.102:0/2640205409 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5590a42fbc60 0x5590a42fe050 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.060+0000 7ff8da42f800 1 --2- 172.21.15.102:0/2640205409 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5590a41f8e00 0x5590a42f9360 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.060+0000 7ff8da42f800 1 --2- 172.21.15.102:0/2640205409 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff7c0036b40 0x7ff7c0039000 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.060+0000 7ff8da42f800 1 --2- 172.21.15.102:0/2640205409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590a41f84c0 0x5590a42f2400 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.060+0000 7ff8da42f800 1 -- 172.21.15.102:0/2640205409 >> 172.21.15.102:0/2640205409 conn(0x5590a41f3df0 msgr2=0x5590a42e19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:21.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.060+0000 7ff8da42f800 1 -- 172.21.15.102:0/2640205409 shutdown_connections 2024-09-13T19:16:21.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.060+0000 7ff8da42f800 1 -- 172.21.15.102:0/2640205409 wait complete. 2024-09-13T19:16:21.079 INFO:teuthology.orchestra.run.smithi102.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"f767d22e-a5e7-4349-a797-2de84f67e90b","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"509740b4-c081-4f37-bd6d-df9ca851489b.4237.1","marker":"509740b4-c081-4f37-bd6d-df9ca851489b.4237.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-13T19:16:20.537249Z","creation_time":"2024-09-13T19:16:17.492008Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":0,"size_actual":0,"size_utilized":0,"size_kb":0,"size_kb_actual":0,"size_kb_utilized":0,"num_objects":0}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-09-13T19:16:21.080 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'f767d22e-a5e7-4349-a797-2de84f67e90b', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '509740b4-c081-4f37-bd6d-df9ca851489b.4237.1', 'marker': '509740b4-c081-4f37-bd6d-df9ca851489b.4237.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T19:16:20.537249Z', 'creation_time': '2024-09-13T19:16:17.492008Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-13T19:16:21.080 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2024-09-13T19:16:21.080 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2024-09-13T19:16:21.080 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2024-09-13T19:16:21.122 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:21.123 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:21.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.120+0000 7f48a672c800 1 Processor -- start 2024-09-13T19:16:21.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.120+0000 7f48a672c800 1 -- start start 2024-09-13T19:16:21.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.120+0000 7f48a672c800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55e52dd21da0 0x55e52ddb3610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.120+0000 7f48a672c800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e52dc6db30 con 0x55e52ddb3b50 2024-09-13T19:16:21.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.120+0000 7f48a672c800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55e52dc4f360 con 0x55e52dd21da0 2024-09-13T19:16:21.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.121+0000 7f48a24b7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55e52dd21da0 0x55e52ddb3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.121+0000 7f48a24b7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55e52dd21da0 0x55e52ddb3610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:56122/0 (socket says 172.21.15.102:56122) 2024-09-13T19:16:21.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.121+0000 7f48a1cb6640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55e52ddb3b50 0x55e52ddb5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:33062/0 (socket says 172.21.15.102:33062) 2024-09-13T19:16:21.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.121+0000 7f48a24b7640 1 -- 172.21.15.102:0/4194994082 learned_addr learned my addr 172.21.15.102:0/4194994082 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:21.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.121+0000 7f48a24b7640 1 -- 172.21.15.102:0/4194994082 >> v1:172.21.15.53:6789/0 conn(0x55e52ddb3b50 legacy=0x55e52ddb5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.121+0000 7f48a24b7640 1 -- 172.21.15.102:0/4194994082 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e52dc75e00 con 0x55e52dd21da0 2024-09-13T19:16:21.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.123+0000 7f48a24b7640 1 --2- 172.21.15.102:0/4194994082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e52dd21da0 0x55e52ddb3610 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f489400a520 tx=0x7f4894045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36346b6bfe200c1e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.123+0000 7f48a14b5640 1 -- 172.21.15.102:0/4194994082 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4894055070 con 0x55e52dd21da0 2024-09-13T19:16:21.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.123+0000 7f48a14b5640 1 -- 172.21.15.102:0/4194994082 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48940515b0 con 0x55e52dd21da0 2024-09-13T19:16:21.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.123+0000 7f48a14b5640 1 -- 172.21.15.102:0/4194994082 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48940518d0 con 0x55e52dd21da0 2024-09-13T19:16:21.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.123+0000 7f48a672c800 1 -- 172.21.15.102:0/4194994082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e52dd21da0 msgr2=0x55e52ddb3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.123+0000 7f48a672c800 1 --2- 172.21.15.102:0/4194994082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e52dd21da0 0x55e52ddb3610 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f489400a520 tx=0x7f4894045ba0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.123+0000 7f48a672c800 1 -- 172.21.15.102:0/4194994082 shutdown_connections 2024-09-13T19:16:21.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.123+0000 7f48a672c800 1 --2- 172.21.15.102:0/4194994082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e52dd21da0 0x55e52ddb3610 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.123+0000 7f48a672c800 1 -- 172.21.15.102:0/4194994082 >> 172.21.15.102:0/4194994082 conn(0x55e52dda8de0 msgr2=0x55e52ddab200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:21.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.124+0000 7f48a672c800 1 -- 172.21.15.102:0/4194994082 shutdown_connections 2024-09-13T19:16:21.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.124+0000 7f48a672c800 1 -- 172.21.15.102:0/4194994082 wait complete. 2024-09-13T19:16:21.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.137+0000 7f48a672c800 1 Processor -- start 2024-09-13T19:16:21.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.137+0000 7f48a672c800 1 -- start start 2024-09-13T19:16:21.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.138+0000 7f48a672c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e52dd21da0 0x55e52de9fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.138+0000 7f48a672c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e52dcfa320 con 0x55e52dd21da0 2024-09-13T19:16:21.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.138+0000 7f48a24b7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e52dd21da0 0x55e52de9fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.138+0000 7f48a24b7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e52dd21da0 0x55e52de9fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:56132/0 (socket says 172.21.15.102:56132) 2024-09-13T19:16:21.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.138+0000 7f48a24b7640 1 -- 172.21.15.102:0/1340478836 learned_addr learned my addr 172.21.15.102:0/1340478836 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:21.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.138+0000 7f48a24b7640 1 -- 172.21.15.102:0/1340478836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e52dc47bc0 con 0x55e52dd21da0 2024-09-13T19:16:21.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.138+0000 7f48a24b7640 1 --2- 172.21.15.102:0/1340478836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e52dd21da0 0x55e52de9fa40 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f4894025da0 tx=0x7f4894051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8db1dbd8f915c15 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.139+0000 7f4790608640 1 -- 172.21.15.102:0/1340478836 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4894051950 con 0x55e52dd21da0 2024-09-13T19:16:21.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.139+0000 7f4790608640 1 -- 172.21.15.102:0/1340478836 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4894051af0 con 0x55e52dd21da0 2024-09-13T19:16:21.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.139+0000 7f4790608640 1 -- 172.21.15.102:0/1340478836 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4894051dd0 con 0x55e52dd21da0 2024-09-13T19:16:21.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.139+0000 7f48a672c800 1 -- 172.21.15.102:0/1340478836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e52dd21da0 msgr2=0x55e52de9fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.139+0000 7f48a672c800 1 --2- 172.21.15.102:0/1340478836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e52dd21da0 0x55e52de9fa40 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f4894025da0 tx=0x7f4894051000 comp rx=0 tx=0).stop 2024-09-13T19:16:21.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.139+0000 7f48a672c800 1 -- 172.21.15.102:0/1340478836 shutdown_connections 2024-09-13T19:16:21.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.139+0000 7f48a672c800 1 --2- 172.21.15.102:0/1340478836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e52dd21da0 0x55e52de9fa40 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.139+0000 7f48a672c800 1 -- 172.21.15.102:0/1340478836 >> 172.21.15.102:0/1340478836 conn(0x55e52dda8de0 msgr2=0x55e52de9b400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:21.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.139+0000 7f48a672c800 1 -- 172.21.15.102:0/1340478836 shutdown_connections 2024-09-13T19:16:21.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.139+0000 7f48a672c800 1 -- 172.21.15.102:0/1340478836 wait complete. 2024-09-13T19:16:21.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.140+0000 7f48a672c800 1 Processor -- start 2024-09-13T19:16:21.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.140+0000 7f48a672c800 1 -- start start 2024-09-13T19:16:21.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.140+0000 7f48a672c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e52dd21da0 0x55e52dea7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.140+0000 7f48a672c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e52ddb7900 con 0x55e52dd21da0 2024-09-13T19:16:21.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.140+0000 7f48a24b7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e52dd21da0 0x55e52dea7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.140+0000 7f48a24b7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e52dd21da0 0x55e52dea7370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:56146/0 (socket says 172.21.15.102:56146) 2024-09-13T19:16:21.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.140+0000 7f48a24b7640 1 -- 172.21.15.102:0/3086628231 learned_addr learned my addr 172.21.15.102:0/3086628231 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:21.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.140+0000 7f48a24b7640 1 -- 172.21.15.102:0/3086628231 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e52dc5bfe0 con 0x55e52dd21da0 2024-09-13T19:16:21.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.140+0000 7f48a24b7640 1 --2- 172.21.15.102:0/3086628231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e52dd21da0 0x55e52dea7370 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f4894067040 tx=0x7f4894002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.140+0000 7f478ee05640 1 -- 172.21.15.102:0/3086628231 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4894073070 con 0x55e52dd21da0 2024-09-13T19:16:21.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.141+0000 7f478ee05640 1 -- 172.21.15.102:0/3086628231 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f489405a450 con 0x55e52dd21da0 2024-09-13T19:16:21.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.141+0000 7f48a672c800 1 -- 172.21.15.102:0/3086628231 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e52dea78b0 con 0x55e52dd21da0 2024-09-13T19:16:21.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.141+0000 7f478ee05640 1 -- 172.21.15.102:0/3086628231 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f489405a730 con 0x55e52dd21da0 2024-09-13T19:16:21.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.141+0000 7f48a672c800 1 -- 172.21.15.102:0/3086628231 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e52dea7e30 con 0x55e52dd21da0 2024-09-13T19:16:21.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.141+0000 7f478ee05640 1 -- 172.21.15.102:0/3086628231 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4894076070 con 0x55e52dd21da0 2024-09-13T19:16:21.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.141+0000 7f478ee05640 1 --2- 172.21.15.102:0/3086628231 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4788036b40 0x7f4788039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.142+0000 7f478ee05640 1 -- 172.21.15.102:0/3086628231 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f4894062070 con 0x55e52dd21da0 2024-09-13T19:16:21.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.142+0000 7f48a1cb6640 1 --2- 172.21.15.102:0/3086628231 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4788036b40 0x7f4788039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.142+0000 7f48a672c800 1 --2- 172.21.15.102:0/3086628231 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e52ddb3b50 0x55e52deae3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.142+0000 7f48a672c800 1 -- 172.21.15.102:0/3086628231 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e52deae960 con 0x55e52ddb3b50 2024-09-13T19:16:21.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.142+0000 7f48a2cb8640 1 --2- 172.21.15.102:0/3086628231 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e52ddb3b50 0x55e52deae3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.142+0000 7f48a1cb6640 1 --2- 172.21.15.102:0/3086628231 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4788036b40 0x7f4788039000 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4898000f60 tx=0x7f4898001370 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.142+0000 7f48a2cb8640 1 --2- 172.21.15.102:0/3086628231 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e52ddb3b50 0x55e52deae3e0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.142+0000 7f48a2cb8640 1 -- 172.21.15.102:0/3086628231 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f489c00a4a0 con 0x55e52ddb3b50 2024-09-13T19:16:21.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.142+0000 7f48a672c800 1 -- 172.21.15.102:0/3086628231 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e52deab9b0 con 0x55e52ddb3b50 2024-09-13T19:16:21.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.143+0000 7f48a2cb8640 1 -- 172.21.15.102:0/3086628231 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f489c00a4a0 con 0x55e52ddb3b50 2024-09-13T19:16:21.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.143+0000 7f48a672c800 1 --2- 172.21.15.102:0/3086628231 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e52deb0c90 0x55e52deb3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.143+0000 7f48a672c800 1 -- 172.21.15.102:0/3086628231 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e52deb3720 con 0x55e52deb0c90 2024-09-13T19:16:21.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.143+0000 7f48a24b7640 1 --2- 172.21.15.102:0/3086628231 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e52deb0c90 0x55e52deb3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.143+0000 7f48a24b7640 1 --2- 172.21.15.102:0/3086628231 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e52deb0c90 0x55e52deb3080 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.143+0000 7f48a24b7640 1 -- 172.21.15.102:0/3086628231 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4894075030 con 0x55e52deb0c90 2024-09-13T19:16:21.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.143+0000 7f48a672c800 1 -- 172.21.15.102:0/3086628231 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e52deafb30 con 0x55e52ddb3b50 2024-09-13T19:16:21.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.144+0000 7f48a2cb8640 1 -- 172.21.15.102:0/3086628231 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f489c00a4a0 con 0x55e52ddb3b50 2024-09-13T19:16:21.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.144+0000 7f48a672c800 1 -- 172.21.15.102:0/3086628231 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e52deb0010 con 0x55e52deb0c90 2024-09-13T19:16:21.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.144+0000 7f48a24b7640 1 -- 172.21.15.102:0/3086628231 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4894075030 con 0x55e52deb0c90 2024-09-13T19:16:21.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.144+0000 7f48a672c800 1 Processor -- start 2024-09-13T19:16:21.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.144+0000 7f48a672c800 1 -- start start 2024-09-13T19:16:21.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.144+0000 7f48a672c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e52dec2020 0x55e52dec2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.144+0000 7f48a672c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e52dc49580 con 0x55e52dec2020 2024-09-13T19:16:21.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.145+0000 7f48a2cb8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e52dec2020 0x55e52dec2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.145+0000 7f48a2cb8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e52dec2020 0x55e52dec2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:56152/0 (socket says 172.21.15.102:56152) 2024-09-13T19:16:21.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.145+0000 7f48a2cb8640 1 -- 172.21.15.102:0/4157953270 learned_addr learned my addr 172.21.15.102:0/4157953270 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:21.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.145+0000 7f48a2cb8640 1 -- 172.21.15.102:0/4157953270 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e52dec2980 con 0x55e52dec2020 2024-09-13T19:16:21.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.145+0000 7f48a2cb8640 1 --2- 172.21.15.102:0/4157953270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e52dec2020 0x55e52dec2440 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x55e52dea8420 tx=0x7f489c0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.145+0000 7f4787fff640 1 -- 172.21.15.102:0/4157953270 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f489c013640 con 0x55e52dec2020 2024-09-13T19:16:21.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.145+0000 7f4787fff640 1 -- 172.21.15.102:0/4157953270 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f489c0137e0 con 0x55e52dec2020 2024-09-13T19:16:21.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.145+0000 7f48a672c800 1 -- 172.21.15.102:0/4157953270 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e52dec2c10 con 0x55e52dec2020 2024-09-13T19:16:21.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.145+0000 7f4787fff640 1 -- 172.21.15.102:0/4157953270 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f489c013ae0 con 0x55e52dec2020 2024-09-13T19:16:21.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.145+0000 7f48a672c800 1 -- 172.21.15.102:0/4157953270 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e52dec58f0 con 0x55e52dec2020 2024-09-13T19:16:21.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.146+0000 7f4787fff640 1 -- 172.21.15.102:0/4157953270 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f489c011040 con 0x55e52dec2020 2024-09-13T19:16:21.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.146+0000 7f4787fff640 1 --2- 172.21.15.102:0/4157953270 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f477c036b90 0x7f477c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.146+0000 7f4787fff640 1 -- 172.21.15.102:0/4157953270 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f489c00e040 con 0x55e52dec2020 2024-09-13T19:16:21.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.146+0000 7f48a24b7640 1 --2- 172.21.15.102:0/4157953270 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f477c036b90 0x7f477c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.146+0000 7f48a672c800 1 Processor -- start 2024-09-13T19:16:21.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.146+0000 7f48a672c800 1 -- start start 2024-09-13T19:16:21.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.146+0000 7f48a24b7640 1 --2- 172.21.15.102:0/4157953270 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f477c036b90 0x7f477c039050 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f48940910b0 tx=0x7f489406f4a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.147+0000 7f48a672c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e52deced40 0x55e52decf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.147+0000 7f48a672c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e52dea0130 con 0x55e52deced40 2024-09-13T19:16:21.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.147+0000 7f48a2cb8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e52deced40 0x55e52decf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.147+0000 7f48a2cb8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e52deced40 0x55e52decf140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:56164/0 (socket says 172.21.15.102:56164) 2024-09-13T19:16:21.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.147+0000 7f48a2cb8640 1 -- 172.21.15.102:0/2588575525 learned_addr learned my addr 172.21.15.102:0/2588575525 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:21.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.147+0000 7f48a2cb8640 1 -- 172.21.15.102:0/2588575525 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e52decf710 con 0x55e52deced40 2024-09-13T19:16:21.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.147+0000 7f48a2cb8640 1 --2- 172.21.15.102:0/2588575525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e52deced40 0x55e52decf140 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f489c04ce10 tx=0x7f489c020450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbbd0726ff4fd409 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.147+0000 7f4785ffb640 1 -- 172.21.15.102:0/2588575525 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f489c012c00 con 0x55e52deced40 2024-09-13T19:16:21.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.147+0000 7f4785ffb640 1 -- 172.21.15.102:0/2588575525 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f489c021960 con 0x55e52deced40 2024-09-13T19:16:21.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.147+0000 7f4785ffb640 1 -- 172.21.15.102:0/2588575525 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f489c021440 con 0x55e52deced40 2024-09-13T19:16:21.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.148+0000 7f48a672c800 1 -- 172.21.15.102:0/2588575525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e52deced40 msgr2=0x55e52decf140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.148+0000 7f48a672c800 1 --2- 172.21.15.102:0/2588575525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e52deced40 0x55e52decf140 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f489c04ce10 tx=0x7f489c020450 comp rx=0 tx=0).stop 2024-09-13T19:16:21.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.148+0000 7f48a672c800 1 -- 172.21.15.102:0/2588575525 shutdown_connections 2024-09-13T19:16:21.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.148+0000 7f48a672c800 1 --2- 172.21.15.102:0/2588575525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e52deced40 0x55e52decf140 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.148+0000 7f48a672c800 1 -- 172.21.15.102:0/2588575525 >> 172.21.15.102:0/2588575525 conn(0x55e52decb0a0 msgr2=0x55e52dec91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:21.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.148+0000 7f48a672c800 1 -- 172.21.15.102:0/2588575525 shutdown_connections 2024-09-13T19:16:21.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.148+0000 7f48a672c800 1 -- 172.21.15.102:0/2588575525 wait complete. 2024-09-13T19:16:21.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.148+0000 7f48a672c800 1 Processor -- start 2024-09-13T19:16:21.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.148+0000 7f48a672c800 1 -- start start 2024-09-13T19:16:21.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.148+0000 7f48a672c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e52deced40 0x55e52ded61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.148+0000 7f48a672c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e52decfd80 con 0x55e52deced40 2024-09-13T19:16:21.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.148+0000 7f48a2cb8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e52deced40 0x55e52ded61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.148+0000 7f48a2cb8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e52deced40 0x55e52ded61b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:56166/0 (socket says 172.21.15.102:56166) 2024-09-13T19:16:21.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.148+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 learned_addr learned my addr 172.21.15.102:0/81065505 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:21.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.149+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e52ded66f0 con 0x55e52deced40 2024-09-13T19:16:21.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.149+0000 7f48a2cb8640 1 --2- 172.21.15.102:0/81065505 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e52deced40 0x55e52ded61b0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f489c03d040 tx=0x7f489c00af70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.149+0000 7f4773fff640 1 -- 172.21.15.102:0/81065505 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f489c039070 con 0x55e52deced40 2024-09-13T19:16:21.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.149+0000 7f4773fff640 1 -- 172.21.15.102:0/81065505 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f489c04cfe0 con 0x55e52deced40 2024-09-13T19:16:21.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.149+0000 7f48a672c800 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e52ded6980 con 0x55e52deced40 2024-09-13T19:16:21.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.149+0000 7f4773fff640 1 -- 172.21.15.102:0/81065505 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f489c021590 con 0x55e52deced40 2024-09-13T19:16:21.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.149+0000 7f48a672c800 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e52ded9630 con 0x55e52deced40 2024-09-13T19:16:21.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.150+0000 7f4773fff640 1 -- 172.21.15.102:0/81065505 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f489c04eb30 con 0x55e52deced40 2024-09-13T19:16:21.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.150+0000 7f4773fff640 1 --2- 172.21.15.102:0/81065505 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f476c036af0 0x7f476c038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.150+0000 7f4773fff640 1 -- 172.21.15.102:0/81065505 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f489c031050 con 0x55e52deced40 2024-09-13T19:16:21.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.150+0000 7f48a24b7640 1 --2- 172.21.15.102:0/81065505 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f476c036af0 0x7f476c038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.150+0000 7f48a672c800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.150+0000 7f48a24b7640 1 --2- 172.21.15.102:0/81065505 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f476c036af0 0x7f476c038fb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f489401bb60 tx=0x7f489408d000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.151+0000 7f48a672c800 1 --2- 172.21.15.102:0/81065505 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e52dee1bf0 0x55e52dee40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.151+0000 7f48a672c800 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e52dee4800 con 0x55e52dee1bf0 2024-09-13T19:16:21.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.151+0000 7f48a1cb6640 1 --2- 172.21.15.102:0/81065505 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e52dee1bf0 0x55e52dee40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.151+0000 7f48a1cb6640 1 --2- 172.21.15.102:0/81065505 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e52dee1bf0 0x55e52dee40b0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.151+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f489800f610 con 0x55e52dee1bf0 2024-09-13T19:16:21.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.151+0000 7f48a672c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:21.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.151+0000 7f48a672c800 20 realm 2024-09-13T19:16:21.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.151+0000 7f48a672c800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.151+0000 7f48a672c800 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e52dee1040 con 0x55e52dee1bf0 2024-09-13T19:16:21.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.151+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f489800f610 con 0x55e52dee1bf0 2024-09-13T19:16:21.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.151+0000 7f48a672c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:21.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.151+0000 7f48a672c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:21.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.151+0000 7f48a672c800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.151+0000 7f48a672c800 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e52dee52e0 con 0x55e52dee1bf0 2024-09-13T19:16:21.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.152+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f489800f610 con 0x55e52dee1bf0 2024-09-13T19:16:21.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.152+0000 7f48a672c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:21.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.152+0000 7f48a672c800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.152+0000 7f48a672c800 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e52dee5bb0 con 0x55e52dee1bf0 2024-09-13T19:16:21.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.152+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f489800f610 con 0x55e52dee1bf0 2024-09-13T19:16:21.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.152+0000 7f48a672c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:21.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.152+0000 7f48a672c800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.152+0000 7f48a672c800 1 --2- 172.21.15.102:0/81065505 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e52dee6460 0x55e52dee8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.152+0000 7f48a672c800 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e52dee8fd0 con 0x55e52dee6460 2024-09-13T19:16:21.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.152+0000 7f48a2cb8640 1 --2- 172.21.15.102:0/81065505 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e52dee6460 0x55e52dee8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.152+0000 7f48a2cb8640 1 --2- 172.21.15.102:0/81065505 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e52dee6460 0x55e52dee8870 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.152+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f489c03b030 con 0x55e52dee6460 2024-09-13T19:16:21.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.153+0000 7f48a672c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:21.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.153+0000 7f48a672c800 20 searching for the correct realm 2024-09-13T19:16:21.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.153+0000 7f48a672c800 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deeaa00 con 0x55e52dee6460 2024-09-13T19:16:21.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.153+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f489c03b030 con 0x55e52dee6460 2024-09-13T19:16:21.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.153+0000 7f48a2cb8640 1 --2- 172.21.15.102:0/81065505 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f489c04b290 0x7f489c0143c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.153+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deeaa00 con 0x7f489c04b290 2024-09-13T19:16:21.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.153+0000 7f48a24b7640 1 --2- 172.21.15.102:0/81065505 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f489c04b290 0x7f489c0143c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.153+0000 7f48a24b7640 1 --2- 172.21.15.102:0/81065505 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f489c04b290 0x7f489c0143c0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.153+0000 7f48a24b7640 1 -- 172.21.15.102:0/81065505 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4894075030 con 0x7f489c04b290 2024-09-13T19:16:21.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.153+0000 7f48a24b7640 1 --2- 172.21.15.102:0/81065505 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f48940a0070 0x7f489405a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.153+0000 7f48a24b7640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deeaa00 con 0x7f48940a0070 2024-09-13T19:16:21.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.154+0000 7f48a1cb6640 1 --2- 172.21.15.102:0/81065505 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f48940a0070 0x7f489405a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.154+0000 7f48a1cb6640 1 --2- 172.21.15.102:0/81065505 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f48940a0070 0x7f489405a960 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.154+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f489800f610 con 0x7f48940a0070 2024-09-13T19:16:21.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.154+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deeaa00 con 0x55e52dee1bf0 2024-09-13T19:16:21.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.155+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f489800f610 con 0x55e52dee1bf0 2024-09-13T19:16:21.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.155+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deeaa00 con 0x55e52dee1bf0 2024-09-13T19:16:21.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.155+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f489802b040 con 0x55e52dee1bf0 2024-09-13T19:16:21.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.155+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deeaa00 con 0x7f48940a0070 2024-09-13T19:16:21.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.155+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f489802b040 con 0x7f48940a0070 2024-09-13T19:16:21.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.155+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deeaa00 con 0x7f48940a0070 2024-09-13T19:16:21.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.155+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f489802b040 con 0x7f48940a0070 2024-09-13T19:16:21.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.155+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deeaa00 con 0x7f489c04b290 2024-09-13T19:16:21.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.156+0000 7f48a24b7640 1 -- 172.21.15.102:0/81065505 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4894075030 con 0x7f489c04b290 2024-09-13T19:16:21.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.156+0000 7f48a24b7640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deeaa00 con 0x55e52dee6460 2024-09-13T19:16:21.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.156+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f489c03b030 con 0x55e52dee6460 2024-09-13T19:16:21.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.156+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deeaa00 con 0x55e52dee1bf0 2024-09-13T19:16:21.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.156+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f489802b040 con 0x55e52dee1bf0 2024-09-13T19:16:21.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.156+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deeaa00 con 0x7f48940a0070 2024-09-13T19:16:21.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.156+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f489802b040 con 0x7f48940a0070 2024-09-13T19:16:21.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.156+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deeaa00 con 0x55e52dee1bf0 2024-09-13T19:16:21.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.157+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f489802b040 con 0x55e52dee1bf0 2024-09-13T19:16:21.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.157+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deeaa00 con 0x7f489c04b290 2024-09-13T19:16:21.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.157+0000 7f48a24b7640 1 -- 172.21.15.102:0/81065505 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f48940af040 con 0x7f489c04b290 2024-09-13T19:16:21.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.157+0000 7f48a24b7640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deeaa00 con 0x55e52dee6460 2024-09-13T19:16:21.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.157+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f489c03b030 con 0x55e52dee6460 2024-09-13T19:16:21.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.157+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deeaa00 con 0x55e52dee6460 2024-09-13T19:16:21.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.157+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f489c03b030 con 0x55e52dee6460 2024-09-13T19:16:21.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.157+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deeaa00 con 0x7f48940a0070 2024-09-13T19:16:21.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.157+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f489802b040 con 0x7f48940a0070 2024-09-13T19:16:21.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.157+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deeaa00 con 0x55e52dee6460 2024-09-13T19:16:21.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.158+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f489c03b030 con 0x55e52dee6460 2024-09-13T19:16:21.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.158+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deeaa00 con 0x55e52dee6460 2024-09-13T19:16:21.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.158+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f489c03b030 con 0x55e52dee6460 2024-09-13T19:16:21.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.158+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deeaa00 con 0x55e52dee1bf0 2024-09-13T19:16:21.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.158+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f489802b040 con 0x55e52dee1bf0 2024-09-13T19:16:21.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.158+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deeaa00 con 0x55e52dee1bf0 2024-09-13T19:16:21.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.158+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f489802b040 con 0x55e52dee1bf0 2024-09-13T19:16:21.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.158+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deeaa00 con 0x7f48940a0070 2024-09-13T19:16:21.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.159+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f489802b040 con 0x7f48940a0070 2024-09-13T19:16:21.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.159+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deeaa00 con 0x55e52dee6460 2024-09-13T19:16:21.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.159+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f489c03b030 con 0x55e52dee6460 2024-09-13T19:16:21.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.159+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deeaa00 con 0x7f489c04b290 2024-09-13T19:16:21.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.159+0000 7f48a24b7640 1 -- 172.21.15.102:0/81065505 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48940af040 con 0x7f489c04b290 2024-09-13T19:16:21.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.159+0000 7f48a24b7640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deeaa00 con 0x55e52dee1bf0 2024-09-13T19:16:21.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.159+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f489802b040 con 0x55e52dee1bf0 2024-09-13T19:16:21.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.159+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deeaa00 con 0x7f48940a0070 2024-09-13T19:16:21.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.160+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f489803b040 con 0x7f48940a0070 2024-09-13T19:16:21.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.160+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deeaa00 con 0x55e52dee6460 2024-09-13T19:16:21.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.160+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f489c03b030 con 0x55e52dee6460 2024-09-13T19:16:21.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.160+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deeaa00 con 0x7f48940a0070 2024-09-13T19:16:21.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.160+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f489803b040 con 0x7f48940a0070 2024-09-13T19:16:21.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.160+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deeaa00 con 0x7f489c04b290 2024-09-13T19:16:21.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.160+0000 7f48a24b7640 1 -- 172.21.15.102:0/81065505 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48940af040 con 0x7f489c04b290 2024-09-13T19:16:21.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.160+0000 7f48a24b7640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deeaa00 con 0x55e52dee6460 2024-09-13T19:16:21.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.161+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f489c03b030 con 0x55e52dee6460 2024-09-13T19:16:21.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.161+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deeaa00 con 0x7f48940a0070 2024-09-13T19:16:21.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.161+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f489803b040 con 0x7f48940a0070 2024-09-13T19:16:21.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.161+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deeaa00 con 0x55e52dee1bf0 2024-09-13T19:16:21.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.161+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f489803b040 con 0x55e52dee1bf0 2024-09-13T19:16:21.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.161+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deeaa00 con 0x7f489c04b290 2024-09-13T19:16:21.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.161+0000 7f48a24b7640 1 -- 172.21.15.102:0/81065505 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48940af040 con 0x7f489c04b290 2024-09-13T19:16:21.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.161+0000 7f48a672c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:21.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.161+0000 7f48a672c800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:21.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.161+0000 7f48a672c800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:21.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.161+0000 7f48a672c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:21.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.161+0000 7f48a672c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:21.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.161+0000 7f48a672c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:21.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.161+0000 7f48a672c800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.161+0000 7f48a672c800 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e52dee9b00 con 0x55e52dee1bf0 2024-09-13T19:16:21.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.162+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f489803b040 con 0x55e52dee1bf0 2024-09-13T19:16:21.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.162+0000 7f48a672c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:21.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.162+0000 7f48a672c800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.162+0000 7f48a672c800 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e52deea3a0 con 0x55e52dee1bf0 2024-09-13T19:16:21.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.162+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f489803b040 con 0x55e52dee1bf0 2024-09-13T19:16:21.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.162+0000 7f48a672c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:21.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.162+0000 7f48a672c800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.162+0000 7f48a672c800 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e52dee9740 con 0x55e52dee6460 2024-09-13T19:16:21.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.162+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f489c03b030 con 0x55e52dee6460 2024-09-13T19:16:21.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.162+0000 7f48a672c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:21.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.162+0000 7f48a672c800 20 zone default found 2024-09-13T19:16:21.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.162+0000 7f48a672c800 4 Realm: () 2024-09-13T19:16:21.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.162+0000 7f48a672c800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:21.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.162+0000 7f48a672c800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:21.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.162+0000 7f48a672c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:21.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.162+0000 7f48a672c800 20 zonegroup default 2024-09-13T19:16:21.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.162+0000 7f48a672c800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.162+0000 7f48a672c800 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e52deeb380 con 0x7f48940a0070 2024-09-13T19:16:21.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.163+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f489803b040 con 0x7f48940a0070 2024-09-13T19:16:21.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.163+0000 7f48a672c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:21.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.163+0000 7f48a672c800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.163+0000 7f48a672c800 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e52deece50 con 0x55e52dee6460 2024-09-13T19:16:21.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.163+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f489c03b030 con 0x55e52dee6460 2024-09-13T19:16:21.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.163+0000 7f48a672c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:21.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.163+0000 7f48a672c800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.163+0000 7f48a672c800 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e52deed290 con 0x55e52dee6460 2024-09-13T19:16:21.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.163+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f489c03b030 con 0x55e52dee6460 2024-09-13T19:16:21.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.163+0000 7f48a672c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:21.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.163+0000 7f48a672c800 20 started sync module instance, tier type = 2024-09-13T19:16:21.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.163+0000 7f48a672c800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:21.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.163+0000 7f48a672c800 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e52deebd50 con 0x7f489c04b290 2024-09-13T19:16:21.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.164+0000 7f48a24b7640 1 -- 172.21.15.102:0/81065505 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(44 notify.0 [create] v34'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48940af040 con 0x7f489c04b290 2024-09-13T19:16:21.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.164+0000 7f48a672c800 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94442806493552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e52deedb70 con 0x7f489c04b290 2024-09-13T19:16:21.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.164+0000 7f48a672c800 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e52deee3c0 con 0x55e52dee1bf0 2024-09-13T19:16:21.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.165+0000 7f48a24b7640 1 -- 172.21.15.102:0/81065505 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94442806493552] v34'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48940af040 con 0x7f489c04b290 2024-09-13T19:16:21.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.165+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v34'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f489803b040 con 0x55e52dee1bf0 2024-09-13T19:16:21.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.165+0000 7f48a672c800 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94442806499008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e52deee460 con 0x55e52dee1bf0 2024-09-13T19:16:21.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.165+0000 7f48a672c800 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e52deeef80 con 0x55e52dee6460 2024-09-13T19:16:21.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.166+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94442806499008] v34'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f489803b040 con 0x55e52dee1bf0 2024-09-13T19:16:21.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.166+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v34'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f489c03b030 con 0x55e52dee6460 2024-09-13T19:16:21.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.166+0000 7f48a672c800 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94442806504016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e52deeef40 con 0x55e52dee6460 2024-09-13T19:16:21.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.166+0000 7f48a672c800 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e52deefa00 con 0x7f489c04b290 2024-09-13T19:16:21.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.167+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94442806504016] v34'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f489c03b030 con 0x55e52dee6460 2024-09-13T19:16:21.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.167+0000 7f48a24b7640 1 -- 172.21.15.102:0/81065505 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(50 notify.3 [create] v34'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48940af040 con 0x7f489c04b290 2024-09-13T19:16:21.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.167+0000 7f48a672c800 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94442806506768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e52deefdf0 con 0x7f489c04b290 2024-09-13T19:16:21.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.167+0000 7f48a672c800 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e52def0830 con 0x55e52dee1bf0 2024-09-13T19:16:21.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.168+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v34'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f489803b040 con 0x55e52dee1bf0 2024-09-13T19:16:21.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.168+0000 7f48a672c800 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94442806510336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e52def10d0 con 0x55e52dee1bf0 2024-09-13T19:16:21.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.169+0000 7f48a672c800 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e52def1bd0 con 0x7f48940a0070 2024-09-13T19:16:21.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.169+0000 7f48a24b7640 1 -- 172.21.15.102:0/81065505 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94442806506768] v34'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48940af040 con 0x7f489c04b290 2024-09-13T19:16:21.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.169+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94442806510336] v34'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f489803b040 con 0x55e52dee1bf0 2024-09-13T19:16:21.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.170+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(54 notify.5 [create] v34'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f489803b040 con 0x7f48940a0070 2024-09-13T19:16:21.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.170+0000 7f48a672c800 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94442806515392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e52def0bd0 con 0x7f48940a0070 2024-09-13T19:16:21.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.170+0000 7f48a672c800 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e52def2470 con 0x7f48940a0070 2024-09-13T19:16:21.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.171+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94442806515392] v34'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f489803b040 con 0x7f48940a0070 2024-09-13T19:16:21.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.171+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(56 notify.6 [create] v34'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f489803b040 con 0x7f48940a0070 2024-09-13T19:16:21.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.171+0000 7f48a672c800 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94442806501136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e52def0bd0 con 0x7f48940a0070 2024-09-13T19:16:21.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.171+0000 7f48a672c800 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e52def29f0 con 0x7f48940a0070 2024-09-13T19:16:21.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.172+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94442806501136] v34'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f489803b040 con 0x7f48940a0070 2024-09-13T19:16:21.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.172+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(58 notify.7 [create] v34'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f489803b040 con 0x7f48940a0070 2024-09-13T19:16:21.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.172+0000 7f48a672c800 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94442806517472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e52def29b0 con 0x7f48940a0070 2024-09-13T19:16:21.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.172+0000 7f48a672c800 20 add_watcher() i=0 2024-09-13T19:16:21.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.172+0000 7f48a672c800 20 add_watcher() i=1 2024-09-13T19:16:21.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.172+0000 7f48a672c800 20 add_watcher() i=2 2024-09-13T19:16:21.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.172+0000 7f48a672c800 20 add_watcher() i=3 2024-09-13T19:16:21.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.172+0000 7f48a672c800 20 add_watcher() i=4 2024-09-13T19:16:21.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.172+0000 7f48a672c800 20 add_watcher() i=5 2024-09-13T19:16:21.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.172+0000 7f48a672c800 20 add_watcher() i=6 2024-09-13T19:16:21.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.173+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94442806517472] v34'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f489803b040 con 0x7f48940a0070 2024-09-13T19:16:21.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.173+0000 7f48a672c800 20 add_watcher() i=7 2024-09-13T19:16:21.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.173+0000 7f48a672c800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:21.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.173+0000 7f48a672c800 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e52def5e40 con 0x55e52dee1bf0 2024-09-13T19:16:21.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.173+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f489803b040 con 0x55e52dee1bf0 2024-09-13T19:16:21.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.173+0000 7f48a672c800 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94442806519504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e52def3360 con 0x55e52dee1bf0 2024-09-13T19:16:21.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.174+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94442806519504] v34'146 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f489803b040 con 0x55e52dee1bf0 2024-09-13T19:16:21.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.174+0000 7f4758fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:21.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.174+0000 7f48a672c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:21.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.174+0000 7f48a672c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:21.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.174+0000 7f48a672c800 5 note: GC not initialized 2024-09-13T19:16:21.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.174+0000 7f46d37fe640 20 reqs_thread_entry: start 2024-09-13T19:16:21.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.174+0000 7f48a672c800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:21.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.175+0000 7f48a672c800 20 Filter name: none 2024-09-13T19:16:21.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.175+0000 7f46d17fa640 20 reqs_thread_entry: start 2024-09-13T19:16:21.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.175+0000 7f48a672c800 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:62 6.0 6:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52df28680 con 0x7f48940a0070 2024-09-13T19:16:21.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.175+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(62 [pgnls start_epoch 34 out=254b] v34'34 uv18 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f489803b040 con 0x7f48940a0070 2024-09-13T19:16:21.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.175+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:63 6.10 6:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deea3a0 con 0x7f48940a0070 2024-09-13T19:16:21.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.175+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(63 [pgnls start_epoch 34 out=131b] v34'4 uv4 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f489803b040 con 0x7f48940a0070 2024-09-13T19:16:21.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.175+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deea3a0 con 0x55e52dee6460 2024-09-13T19:16:21.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.176+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(64 [pgnls start_epoch 34 out=295b] v34'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f489c03b030 con 0x55e52dee6460 2024-09-13T19:16:21.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.176+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:65 6.18 6:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deed290 con 0x7f48940a0070 2024-09-13T19:16:21.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.176+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(65 [pgnls start_epoch 34 out=172b] v34'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f489803b040 con 0x7f48940a0070 2024-09-13T19:16:21.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.176+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:66 6.4 6:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deed290 con 0x55e52dee1bf0 2024-09-13T19:16:21.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.176+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(66 [pgnls start_epoch 34 out=335b] v34'146 uv23 ondisk = 1) ==== 144+0+335 (crc 0 0 0) 0x7f489803b040 con 0x55e52dee1bf0 2024-09-13T19:16:21.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.176+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:67 6.14 6:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deed290 con 0x7f489c04b290 2024-09-13T19:16:21.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.177+0000 7f48a24b7640 1 -- 172.21.15.102:0/81065505 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(67 [pgnls start_epoch 34 out=213b] v34'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f48940af040 con 0x7f489c04b290 2024-09-13T19:16:21.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.177+0000 7f48a24b7640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:68 6.c 6:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deefdf0 con 0x55e52dee6460 2024-09-13T19:16:21.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.177+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 <== osd.3 v2:172.21.15.102:6800/3096737090 17 ==== osd_op_reply(68 [pgnls start_epoch 34 out=254b] v34'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f489c03b030 con 0x55e52dee6460 2024-09-13T19:16:21.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.177+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:69 6.1c 6:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deefdf0 con 0x55e52dee6460 2024-09-13T19:16:21.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.177+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 <== osd.3 v2:172.21.15.102:6800/3096737090 18 ==== osd_op_reply(69 [pgnls start_epoch 34 out=295b] v34'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f489c03b030 con 0x55e52dee6460 2024-09-13T19:16:21.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.177+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:70 6.2 6:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deefdf0 con 0x55e52dee6460 2024-09-13T19:16:21.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.177+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 <== osd.3 v2:172.21.15.102:6800/3096737090 19 ==== osd_op_reply(70 [pgnls start_epoch 34 out=213b] v34'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f489c03b030 con 0x55e52dee6460 2024-09-13T19:16:21.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.177+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:71 6.12 6:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deefdf0 con 0x7f489c04b290 2024-09-13T19:16:21.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.178+0000 7f48a24b7640 1 -- 172.21.15.102:0/81065505 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(71 [pgnls start_epoch 34 out=172b] v34'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f48940af040 con 0x7f489c04b290 2024-09-13T19:16:21.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.178+0000 7f48a24b7640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:72 6.a 6:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deefdf0 con 0x7f489c04b290 2024-09-13T19:16:21.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.178+0000 7f48a24b7640 1 -- 172.21.15.102:0/81065505 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(72 [pgnls start_epoch 34 out=336b] v34'27 uv19 ondisk = 1) ==== 144+0+336 (crc 0 0 0) 0x7f48940af040 con 0x7f489c04b290 2024-09-13T19:16:21.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.178+0000 7f48a24b7640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:73 6.1a 6:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deefdf0 con 0x55e52dee6460 2024-09-13T19:16:21.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.178+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 <== osd.3 v2:172.21.15.102:6800/3096737090 20 ==== osd_op_reply(73 [pgnls start_epoch 34 out=131b] v34'17 uv9 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f489c03b030 con 0x55e52dee6460 2024-09-13T19:16:21.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.178+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:74 6.6 6:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deefdf0 con 0x55e52dee6460 2024-09-13T19:16:21.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.179+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 <== osd.3 v2:172.21.15.102:6800/3096737090 21 ==== osd_op_reply(74 [pgnls start_epoch 34 out=254b] v34'12 uv12 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f489c03b030 con 0x55e52dee6460 2024-09-13T19:16:21.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.179+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:75 6.16 6:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deefdf0 con 0x55e52dee6460 2024-09-13T19:16:21.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.179+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 <== osd.3 v2:172.21.15.102:6800/3096737090 22 ==== osd_op_reply(75 [pgnls start_epoch 34 out=90b] v34'17 uv9 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f489c03b030 con 0x55e52dee6460 2024-09-13T19:16:21.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.179+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:76 6.e 6:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deefdf0 con 0x55e52dee1bf0 2024-09-13T19:16:21.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.179+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(76 [pgnls start_epoch 34 out=213b] v34'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f489803b040 con 0x55e52dee1bf0 2024-09-13T19:16:21.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.179+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:77 6.1e 6:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deefdf0 con 0x55e52dee6460 2024-09-13T19:16:21.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.179+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 <== osd.3 v2:172.21.15.102:6800/3096737090 23 ==== osd_op_reply(77 [pgnls start_epoch 34 out=254b] v34'11 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f489c03b030 con 0x55e52dee6460 2024-09-13T19:16:21.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.179+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:78 6.1 6:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deefdf0 con 0x55e52dee1bf0 2024-09-13T19:16:21.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.180+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(78 [pgnls start_epoch 34 out=254b] v34'14 uv14 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f489803b040 con 0x55e52dee1bf0 2024-09-13T19:16:21.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.180+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:79 6.11 6:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deefdf0 con 0x55e52dee6460 2024-09-13T19:16:21.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.180+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 <== osd.3 v2:172.21.15.102:6800/3096737090 24 ==== osd_op_reply(79 [pgnls start_epoch 34 out=213b] v34'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f489c03b030 con 0x55e52dee6460 2024-09-13T19:16:21.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.180+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:80 6.9 6:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deefdf0 con 0x55e52dee6460 2024-09-13T19:16:21.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.180+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 <== osd.3 v2:172.21.15.102:6800/3096737090 25 ==== osd_op_reply(80 [pgnls start_epoch 34 out=172b] v34'29 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f489c03b030 con 0x55e52dee6460 2024-09-13T19:16:21.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.180+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:81 6.19 6:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deefdf0 con 0x55e52dee1bf0 2024-09-13T19:16:21.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.180+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(81 [pgnls start_epoch 34 out=295b] v34'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f489803b040 con 0x55e52dee1bf0 2024-09-13T19:16:21.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.180+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:82 6.5 6:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deefdf0 con 0x7f489c04b290 2024-09-13T19:16:21.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.181+0000 7f48a24b7640 1 -- 172.21.15.102:0/81065505 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(82 [pgnls start_epoch 34 out=276b] v34'15 uv15 ondisk = 1) ==== 144+0+276 (crc 0 0 0) 0x7f48940af040 con 0x7f489c04b290 2024-09-13T19:16:21.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.181+0000 7f48a24b7640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:83 6.15 6:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deefdf0 con 0x7f489c04b290 2024-09-13T19:16:21.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.181+0000 7f48a24b7640 1 -- 172.21.15.102:0/81065505 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(83 [pgnls start_epoch 34 out=172b] v34'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f48940af040 con 0x7f489c04b290 2024-09-13T19:16:21.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.181+0000 7f48a24b7640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:84 6.d 6:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deefdf0 con 0x55e52dee1bf0 2024-09-13T19:16:21.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.181+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(84 [pgnls start_epoch 34 out=295b] v34'25 uv17 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f489803b040 con 0x55e52dee1bf0 2024-09-13T19:16:21.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.181+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:85 6.1d 6:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deefdf0 con 0x7f48940a0070 2024-09-13T19:16:21.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.182+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.0 v2:172.21.15.53:6800/4021716951 20 ==== osd_op_reply(85 [pgnls start_epoch 34 out=172b] v34'28 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f489803b040 con 0x7f48940a0070 2024-09-13T19:16:21.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.182+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:86 6.3 6:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deefdf0 con 0x7f489c04b290 2024-09-13T19:16:21.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.182+0000 7f48a24b7640 1 -- 172.21.15.102:0/81065505 <== osd.2 v2:172.21.15.102:6816/2238176080 16 ==== osd_op_reply(86 [pgnls start_epoch 34 out=213b] v34'43 uv19 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f48940af040 con 0x7f489c04b290 2024-09-13T19:16:21.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.182+0000 7f48a24b7640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:87 6.13 6:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deefdf0 con 0x7f48940a0070 2024-09-13T19:16:21.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.182+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.0 v2:172.21.15.53:6800/4021716951 21 ==== osd_op_reply(87 [pgnls start_epoch 34 out=172b] v34'19 uv11 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f489803b040 con 0x7f48940a0070 2024-09-13T19:16:21.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.182+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:88 6.b 6:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deefdf0 con 0x55e52dee6460 2024-09-13T19:16:21.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.183+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 <== osd.3 v2:172.21.15.102:6800/3096737090 26 ==== osd_op_reply(88 [pgnls start_epoch 34 out=172b] v34'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f489c03b030 con 0x55e52dee6460 2024-09-13T19:16:21.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.183+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:89 6.1b 6:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deefdf0 con 0x55e52dee6460 2024-09-13T19:16:21.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.183+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 <== osd.3 v2:172.21.15.102:6800/3096737090 27 ==== osd_op_reply(89 [pgnls start_epoch 34 out=90b] v34'13 uv5 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f489c03b030 con 0x55e52dee6460 2024-09-13T19:16:21.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.183+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:90 6.7 6:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deefdf0 con 0x55e52dee6460 2024-09-13T19:16:21.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.183+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 <== osd.3 v2:172.21.15.102:6800/3096737090 28 ==== osd_op_reply(90 [pgnls start_epoch 34 out=90b] v34'37 uv13 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f489c03b030 con 0x55e52dee6460 2024-09-13T19:16:21.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.183+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:91 6.17 6:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deefdf0 con 0x55e52dee1bf0 2024-09-13T19:16:21.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.183+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== osd_op_reply(91 [pgnls start_epoch 34 out=131b] v34'7 uv6 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f489803b040 con 0x55e52dee1bf0 2024-09-13T19:16:21.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.183+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:92 6.f 6:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deefdf0 con 0x7f489c04b290 2024-09-13T19:16:21.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.184+0000 7f48a24b7640 1 -- 172.21.15.102:0/81065505 <== osd.2 v2:172.21.15.102:6816/2238176080 17 ==== osd_op_reply(92 [pgnls start_epoch 34 out=295b] v34'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f48940af040 con 0x7f489c04b290 2024-09-13T19:16:21.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.184+0000 7f48a24b7640 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:93 6.1f 6:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e52deefdf0 con 0x7f48940a0070 2024-09-13T19:16:21.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.184+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.0 v2:172.21.15.53:6800/4021716951 22 ==== osd_op_reply(93 [pgnls start_epoch 34 out=213b] v34'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f489803b040 con 0x7f48940a0070 2024-09-13T19:16:21.201 INFO:teuthology.orchestra.run.smithi102.stdout:["obj_delete_at_hint.0000000078","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","obj_delete_at_hint.0000000040","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_loggenerations_metadata","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","obj_delete_at_hint.0000000027","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2024-09-13T19:16:21.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.186+0000 7f4758fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:21.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.186+0000 7f48a672c800 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94442806519504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e52df28640 con 0x55e52dee1bf0 2024-09-13T19:16:21.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.187+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94442806519504] v34'147 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f489803b040 con 0x55e52dee1bf0 2024-09-13T19:16:21.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.187+0000 7f48a672c800 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94442806493552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e52deed290 con 0x7f489c04b290 2024-09-13T19:16:21.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.188+0000 7f48a24b7640 1 -- 172.21.15.102:0/81065505 <== osd.2 v2:172.21.15.102:6816/2238176080 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94442806493552] v34'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48940af040 con 0x7f489c04b290 2024-09-13T19:16:21.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.188+0000 7f48a672c800 20 remove_watcher() i=0 2024-09-13T19:16:21.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.188+0000 7f48a672c800 2 removed watcher, disabling cache 2024-09-13T19:16:21.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.188+0000 7f48a672c800 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94442806499008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e52deea3a0 con 0x55e52dee1bf0 2024-09-13T19:16:21.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.189+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.1 v2:172.21.15.102:6808/2204418452 28 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94442806499008] v34'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f489803b040 con 0x55e52dee1bf0 2024-09-13T19:16:21.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.189+0000 7f48a672c800 20 remove_watcher() i=1 2024-09-13T19:16:21.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.189+0000 7f48a672c800 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94442806504016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e52df28640 con 0x55e52dee6460 2024-09-13T19:16:21.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.190+0000 7f48a2cb8640 1 -- 172.21.15.102:0/81065505 <== osd.3 v2:172.21.15.102:6800/3096737090 29 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94442806504016] v34'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f489c03b030 con 0x55e52dee6460 2024-09-13T19:16:21.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.190+0000 7f48a672c800 20 remove_watcher() i=2 2024-09-13T19:16:21.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.190+0000 7f48a672c800 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94442806506768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e52deea3a0 con 0x7f489c04b290 2024-09-13T19:16:21.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.191+0000 7f48a24b7640 1 -- 172.21.15.102:0/81065505 <== osd.2 v2:172.21.15.102:6816/2238176080 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94442806506768] v34'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48940af040 con 0x7f489c04b290 2024-09-13T19:16:21.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.191+0000 7f48a672c800 20 remove_watcher() i=3 2024-09-13T19:16:21.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.191+0000 7f48a672c800 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94442806510336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e52deea3a0 con 0x55e52dee1bf0 2024-09-13T19:16:21.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.192+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.1 v2:172.21.15.102:6808/2204418452 29 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94442806510336] v34'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f489803b040 con 0x55e52dee1bf0 2024-09-13T19:16:21.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.192+0000 7f48a672c800 20 remove_watcher() i=4 2024-09-13T19:16:21.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.192+0000 7f48a672c800 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94442806515392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e52deea3a0 con 0x7f48940a0070 2024-09-13T19:16:21.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.193+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.0 v2:172.21.15.53:6800/4021716951 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94442806515392] v34'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4898057040 con 0x7f48940a0070 2024-09-13T19:16:21.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.193+0000 7f48a672c800 20 remove_watcher() i=5 2024-09-13T19:16:21.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.193+0000 7f48a672c800 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94442806501136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e52deea3a0 con 0x7f48940a0070 2024-09-13T19:16:21.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.194+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.0 v2:172.21.15.53:6800/4021716951 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94442806501136] v34'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4898057040 con 0x7f48940a0070 2024-09-13T19:16:21.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.194+0000 7f48a672c800 20 remove_watcher() i=6 2024-09-13T19:16:21.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.194+0000 7f48a672c800 1 -- 172.21.15.102:0/81065505 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94442806517472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e52deea3a0 con 0x7f48940a0070 2024-09-13T19:16:21.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.195+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 <== osd.0 v2:172.21.15.53:6800/4021716951 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94442806517472] v34'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4898057040 con 0x7f48940a0070 2024-09-13T19:16:21.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.195+0000 7f48a672c800 20 remove_watcher() i=7 2024-09-13T19:16:21.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.195+0000 7f48a672c800 1 -- 172.21.15.102:0/81065505 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f48940a0070 msgr2=0x7f489405a960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.195+0000 7f48a672c800 1 --2- 172.21.15.102:0/81065505 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f48940a0070 0x7f489405a960 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.195+0000 7f48a672c800 1 -- 172.21.15.102:0/81065505 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e52dee1bf0 msgr2=0x55e52dee40b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.195+0000 7f48a672c800 1 --2- 172.21.15.102:0/81065505 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e52dee1bf0 0x55e52dee40b0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.195+0000 7f48a672c800 1 -- 172.21.15.102:0/81065505 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f489c04b290 msgr2=0x7f489c0143c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.195+0000 7f48a672c800 1 --2- 172.21.15.102:0/81065505 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f489c04b290 0x7f489c0143c0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.195+0000 7f48a672c800 1 -- 172.21.15.102:0/81065505 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e52dee6460 msgr2=0x55e52dee8870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.195+0000 7f48a672c800 1 --2- 172.21.15.102:0/81065505 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e52dee6460 0x55e52dee8870 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.195+0000 7f48a672c800 1 -- 172.21.15.102:0/81065505 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f476c036af0 msgr2=0x7f476c038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.195+0000 7f48a672c800 1 --2- 172.21.15.102:0/81065505 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f476c036af0 0x7f476c038fb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f489401bb60 tx=0x7f489408d000 comp rx=0 tx=0).stop 2024-09-13T19:16:21.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.195+0000 7f48a672c800 1 -- 172.21.15.102:0/81065505 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e52deced40 msgr2=0x55e52ded61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.195+0000 7f48a672c800 1 --2- 172.21.15.102:0/81065505 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e52deced40 0x55e52ded61b0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f489c03d040 tx=0x7f489c00af70 comp rx=0 tx=0).stop 2024-09-13T19:16:21.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.195+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 reap_dead start 2024-09-13T19:16:21.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.195+0000 7f48a1cb6640 1 -- 172.21.15.102:0/81065505 reap_dead start 2024-09-13T19:16:21.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.195+0000 7f48a672c800 1 -- 172.21.15.102:0/81065505 shutdown_connections 2024-09-13T19:16:21.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.195+0000 7f48a672c800 1 -- 172.21.15.102:0/81065505 >> 172.21.15.102:0/81065505 conn(0x55e52decb0a0 msgr2=0x55e52dec9170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:21.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.196+0000 7f48a672c800 1 -- 172.21.15.102:0/81065505 shutdown_connections 2024-09-13T19:16:21.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.196+0000 7f48a672c800 1 -- 172.21.15.102:0/81065505 wait complete. 2024-09-13T19:16:21.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.196+0000 7f48a672c800 1 -- 172.21.15.102:0/4157953270 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f477c036b90 msgr2=0x7f477c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.196+0000 7f48a672c800 1 --2- 172.21.15.102:0/4157953270 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f477c036b90 0x7f477c039050 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f48940910b0 tx=0x7f489406f4a0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.196+0000 7f48a672c800 1 -- 172.21.15.102:0/4157953270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e52dec2020 msgr2=0x55e52dec2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.196+0000 7f48a672c800 1 --2- 172.21.15.102:0/4157953270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e52dec2020 0x55e52dec2440 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x55e52dea8420 tx=0x7f489c0167b0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.196+0000 7f48a672c800 1 -- 172.21.15.102:0/4157953270 shutdown_connections 2024-09-13T19:16:21.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.196+0000 7f48a672c800 1 --2- 172.21.15.102:0/4157953270 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f477c036b90 0x7f477c039050 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.196+0000 7f48a672c800 1 --2- 172.21.15.102:0/4157953270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e52dec2020 0x55e52dec2440 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.196+0000 7f48a672c800 1 -- 172.21.15.102:0/4157953270 >> 172.21.15.102:0/4157953270 conn(0x55e52deb6fb0 msgr2=0x55e52deb9b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:21.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.196+0000 7f48a672c800 1 -- 172.21.15.102:0/4157953270 shutdown_connections 2024-09-13T19:16:21.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.196+0000 7f48a672c800 1 -- 172.21.15.102:0/4157953270 wait complete. 2024-09-13T19:16:21.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.196+0000 7f48a672c800 1 -- 172.21.15.102:0/3086628231 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e52ddb3b50 msgr2=0x55e52deae3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.196+0000 7f48a672c800 1 --2- 172.21.15.102:0/3086628231 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e52ddb3b50 0x55e52deae3e0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.196+0000 7f48a672c800 1 -- 172.21.15.102:0/3086628231 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e52deb0c90 msgr2=0x55e52deb3080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.196+0000 7f48a672c800 1 --2- 172.21.15.102:0/3086628231 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e52deb0c90 0x55e52deb3080 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.196+0000 7f48a672c800 1 -- 172.21.15.102:0/3086628231 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4788036b40 msgr2=0x7f4788039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.196+0000 7f48a672c800 1 --2- 172.21.15.102:0/3086628231 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4788036b40 0x7f4788039000 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4898000f60 tx=0x7f4898001370 comp rx=0 tx=0).stop 2024-09-13T19:16:21.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.196+0000 7f48a672c800 1 -- 172.21.15.102:0/3086628231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e52dd21da0 msgr2=0x55e52dea7370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.196+0000 7f48a672c800 1 --2- 172.21.15.102:0/3086628231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e52dd21da0 0x55e52dea7370 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f4894067040 tx=0x7f4894002fb0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.196+0000 7f48a672c800 1 -- 172.21.15.102:0/3086628231 shutdown_connections 2024-09-13T19:16:21.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.196+0000 7f48a672c800 1 --2- 172.21.15.102:0/3086628231 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e52deb0c90 0x55e52deb3080 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.196+0000 7f48a672c800 1 --2- 172.21.15.102:0/3086628231 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e52ddb3b50 0x55e52deae3e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.196+0000 7f48a672c800 1 --2- 172.21.15.102:0/3086628231 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4788036b40 0x7f4788039000 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.196+0000 7f48a672c800 1 --2- 172.21.15.102:0/3086628231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e52dd21da0 0x55e52dea7370 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.196+0000 7f48a672c800 1 -- 172.21.15.102:0/3086628231 >> 172.21.15.102:0/3086628231 conn(0x55e52dda8de0 msgr2=0x55e52de99cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:21.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.197+0000 7f48a672c800 1 -- 172.21.15.102:0/3086628231 shutdown_connections 2024-09-13T19:16:21.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.197+0000 7f48a672c800 1 -- 172.21.15.102:0/3086628231 wait complete. 2024-09-13T19:16:21.213 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2024-09-13T19:16:21.214 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-13T19:16:21.214 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-13T19:16:21.214 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-13T19:16:21.298 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:21.298 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:21.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.296+0000 7f81cfe98800 1 Processor -- start 2024-09-13T19:16:21.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.296+0000 7f81cfe98800 1 -- start start 2024-09-13T19:16:21.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.296+0000 7f81cfe98800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5605479c8d90 0x5605479cb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.296+0000 7f81cfe98800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560547881b30 con 0x560547936610 2024-09-13T19:16:21.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.296+0000 7f81cfe98800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x560547863360 con 0x5605479c8d90 2024-09-13T19:16:21.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.296+0000 7f81cd18b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5605479c8d90 0x5605479cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.296+0000 7f81cd18b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5605479c8d90 0x5605479cb180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:56174/0 (socket says 172.21.15.102:56174) 2024-09-13T19:16:21.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.296+0000 7f81cd18b640 1 -- 172.21.15.102:0/1111835597 learned_addr learned my addr 172.21.15.102:0/1111835597 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:21.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.296+0000 7f81cd98c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x560547936610 0x5605479c7670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:33066/0 (socket says 172.21.15.102:33066) 2024-09-13T19:16:21.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.297+0000 7f81cd18b640 1 -- 172.21.15.102:0/1111835597 >> v1:172.21.15.53:6789/0 conn(0x560547936610 legacy=0x5605479c7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.297+0000 7f81cd18b640 1 -- 172.21.15.102:0/1111835597 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560547889e00 con 0x5605479c8d90 2024-09-13T19:16:21.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.298+0000 7f81cd18b640 1 --2- 172.21.15.102:0/1111835597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605479c8d90 0x5605479cb180 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f81c400a520 tx=0x7f81c4045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acb2edfc7b83bed3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.298+0000 7f81cc98a640 1 -- 172.21.15.102:0/1111835597 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81c4055070 con 0x5605479c8d90 2024-09-13T19:16:21.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.298+0000 7f81cc98a640 1 -- 172.21.15.102:0/1111835597 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81c40515b0 con 0x5605479c8d90 2024-09-13T19:16:21.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.298+0000 7f81cc98a640 1 -- 172.21.15.102:0/1111835597 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81c40518d0 con 0x5605479c8d90 2024-09-13T19:16:21.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.299+0000 7f81cfe98800 1 -- 172.21.15.102:0/1111835597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605479c8d90 msgr2=0x5605479cb180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.299+0000 7f81cfe98800 1 --2- 172.21.15.102:0/1111835597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605479c8d90 0x5605479cb180 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f81c400a520 tx=0x7f81c4045ba0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.299+0000 7f81cfe98800 1 -- 172.21.15.102:0/1111835597 shutdown_connections 2024-09-13T19:16:21.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.299+0000 7f81cfe98800 1 --2- 172.21.15.102:0/1111835597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605479c8d90 0x5605479cb180 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.299+0000 7f81cfe98800 1 -- 172.21.15.102:0/1111835597 >> 172.21.15.102:0/1111835597 conn(0x5605479bcde0 msgr2=0x5605479bf200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:21.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.299+0000 7f81cfe98800 1 -- 172.21.15.102:0/1111835597 shutdown_connections 2024-09-13T19:16:21.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.299+0000 7f81cfe98800 1 -- 172.21.15.102:0/1111835597 wait complete. 2024-09-13T19:16:21.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.313+0000 7f81cfe98800 1 Processor -- start 2024-09-13T19:16:21.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.313+0000 7f81cfe98800 1 -- start start 2024-09-13T19:16:21.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.313+0000 7f81cfe98800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560547936610 0x560547ab3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.313+0000 7f81cfe98800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56054790e330 con 0x560547936610 2024-09-13T19:16:21.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.313+0000 7f81cd98c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560547936610 0x560547ab3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.313+0000 7f81cd98c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560547936610 0x560547ab3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:56190/0 (socket says 172.21.15.102:56190) 2024-09-13T19:16:21.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.313+0000 7f81cd98c640 1 -- 172.21.15.102:0/4124494913 learned_addr learned my addr 172.21.15.102:0/4124494913 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:21.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.314+0000 7f81cd98c640 1 -- 172.21.15.102:0/4124494913 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56054785bbc0 con 0x560547936610 2024-09-13T19:16:21.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.314+0000 7f81cd98c640 1 --2- 172.21.15.102:0/4124494913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560547936610 0x560547ab3a90 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f81c000b230 tx=0x7f81c000b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=964e9355a81dfe95 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.314+0000 7f80bbe07640 1 -- 172.21.15.102:0/4124494913 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81c000e5c0 con 0x560547936610 2024-09-13T19:16:21.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.314+0000 7f80bbe07640 1 -- 172.21.15.102:0/4124494913 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81c0006070 con 0x560547936610 2024-09-13T19:16:21.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.314+0000 7f80bbe07640 1 -- 172.21.15.102:0/4124494913 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81c000e890 con 0x560547936610 2024-09-13T19:16:21.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.315+0000 7f81cfe98800 1 -- 172.21.15.102:0/4124494913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560547936610 msgr2=0x560547ab3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.315+0000 7f81cfe98800 1 --2- 172.21.15.102:0/4124494913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560547936610 0x560547ab3a90 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f81c000b230 tx=0x7f81c000b6f0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.315+0000 7f81cfe98800 1 -- 172.21.15.102:0/4124494913 shutdown_connections 2024-09-13T19:16:21.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.315+0000 7f81cfe98800 1 --2- 172.21.15.102:0/4124494913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560547936610 0x560547ab3a90 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.315+0000 7f81cfe98800 1 -- 172.21.15.102:0/4124494913 >> 172.21.15.102:0/4124494913 conn(0x5605479bcde0 msgr2=0x560547aaf450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:21.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.315+0000 7f81cfe98800 1 -- 172.21.15.102:0/4124494913 shutdown_connections 2024-09-13T19:16:21.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.315+0000 7f81cfe98800 1 -- 172.21.15.102:0/4124494913 wait complete. 2024-09-13T19:16:21.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.315+0000 7f81cfe98800 1 Processor -- start 2024-09-13T19:16:21.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.315+0000 7f81cfe98800 1 -- start start 2024-09-13T19:16:21.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.315+0000 7f81cfe98800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560547936610 0x560547abb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.315+0000 7f81cfe98800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5605479cb990 con 0x560547936610 2024-09-13T19:16:21.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.315+0000 7f81cd98c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560547936610 0x560547abb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.315+0000 7f81cd98c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560547936610 0x560547abb4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:56194/0 (socket says 172.21.15.102:56194) 2024-09-13T19:16:21.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.315+0000 7f81cd98c640 1 -- 172.21.15.102:0/1254770327 learned_addr learned my addr 172.21.15.102:0/1254770327 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:21.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.316+0000 7f81cd98c640 1 -- 172.21.15.102:0/1254770327 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56054786ffe0 con 0x560547936610 2024-09-13T19:16:21.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.316+0000 7f81cd98c640 1 --2- 172.21.15.102:0/1254770327 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560547936610 0x560547abb4c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f81c0000c00 tx=0x7f81c0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.316+0000 7f80ba604640 1 -- 172.21.15.102:0/1254770327 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81c000f8d0 con 0x560547936610 2024-09-13T19:16:21.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.316+0000 7f80ba604640 1 -- 172.21.15.102:0/1254770327 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81c000fa90 con 0x560547936610 2024-09-13T19:16:21.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.316+0000 7f81cfe98800 1 -- 172.21.15.102:0/1254770327 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560547abba00 con 0x560547936610 2024-09-13T19:16:21.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.316+0000 7f80ba604640 1 -- 172.21.15.102:0/1254770327 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81c000fdb0 con 0x560547936610 2024-09-13T19:16:21.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.316+0000 7f81cfe98800 1 -- 172.21.15.102:0/1254770327 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560547abbf20 con 0x560547936610 2024-09-13T19:16:21.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.317+0000 7f80ba604640 1 -- 172.21.15.102:0/1254770327 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f81c0017070 con 0x560547936610 2024-09-13T19:16:21.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.317+0000 7f80ba604640 1 --2- 172.21.15.102:0/1254770327 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f80b4036b40 0x7f80b4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.317+0000 7f80ba604640 1 -- 172.21.15.102:0/1254770327 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f81c0015020 con 0x560547936610 2024-09-13T19:16:21.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.317+0000 7f81cd18b640 1 --2- 172.21.15.102:0/1254770327 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f80b4036b40 0x7f80b4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.317+0000 7f81cfe98800 1 --2- 172.21.15.102:0/1254770327 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5605479c8d90 0x560547ac2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.317+0000 7f81cfe98800 1 -- 172.21.15.102:0/1254770327 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560547ac2ab0 con 0x5605479c8d90 2024-09-13T19:16:21.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.317+0000 7f81ce18d640 1 --2- 172.21.15.102:0/1254770327 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5605479c8d90 0x560547ac2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.318+0000 7f81cd18b640 1 --2- 172.21.15.102:0/1254770327 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f80b4036b40 0x7f80b4039000 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f81c4057000 tx=0x7f81c4052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.318+0000 7f81ce18d640 1 --2- 172.21.15.102:0/1254770327 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5605479c8d90 0x560547ac2530 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.318+0000 7f81ce18d640 1 -- 172.21.15.102:0/1254770327 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f81c800a4a0 con 0x5605479c8d90 2024-09-13T19:16:21.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.318+0000 7f81cfe98800 1 -- 172.21.15.102:0/1254770327 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560547abfb00 con 0x5605479c8d90 2024-09-13T19:16:21.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.318+0000 7f81ce18d640 1 -- 172.21.15.102:0/1254770327 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f81c800a4a0 con 0x5605479c8d90 2024-09-13T19:16:21.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.318+0000 7f81cfe98800 1 --2- 172.21.15.102:0/1254770327 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x560547ac4e00 0x560547ac71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.318+0000 7f81cfe98800 1 -- 172.21.15.102:0/1254770327 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560547ac78e0 con 0x560547ac4e00 2024-09-13T19:16:21.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.318+0000 7f81cd98c640 1 --2- 172.21.15.102:0/1254770327 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x560547ac4e00 0x560547ac71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.319+0000 7f81cd98c640 1 --2- 172.21.15.102:0/1254770327 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x560547ac4e00 0x560547ac71f0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.319+0000 7f81cd98c640 1 -- 172.21.15.102:0/1254770327 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f81c002e070 con 0x560547ac4e00 2024-09-13T19:16:21.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.319+0000 7f81cfe98800 1 -- 172.21.15.102:0/1254770327 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560547ac3c70 con 0x5605479c8d90 2024-09-13T19:16:21.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.319+0000 7f81ce18d640 1 -- 172.21.15.102:0/1254770327 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f81c800a4a0 con 0x5605479c8d90 2024-09-13T19:16:21.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.319+0000 7f81cfe98800 1 -- 172.21.15.102:0/1254770327 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560547ac4150 con 0x560547ac4e00 2024-09-13T19:16:21.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.319+0000 7f81cd98c640 1 -- 172.21.15.102:0/1254770327 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f81c002e070 con 0x560547ac4e00 2024-09-13T19:16:21.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.320+0000 7f81cfe98800 1 Processor -- start 2024-09-13T19:16:21.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.320+0000 7f81cfe98800 1 -- start start 2024-09-13T19:16:21.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.320+0000 7f81cfe98800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560547ad6260 0x560547ad6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.320+0000 7f81cfe98800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56054785d580 con 0x560547ad6260 2024-09-13T19:16:21.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.320+0000 7f81ce18d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560547ad6260 0x560547ad6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.320+0000 7f81ce18d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560547ad6260 0x560547ad6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:56202/0 (socket says 172.21.15.102:56202) 2024-09-13T19:16:21.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.320+0000 7f81ce18d640 1 -- 172.21.15.102:0/887242106 learned_addr learned my addr 172.21.15.102:0/887242106 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:21.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.320+0000 7f81ce18d640 1 -- 172.21.15.102:0/887242106 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560547ad6bc0 con 0x560547ad6260 2024-09-13T19:16:21.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.321+0000 7f81ce18d640 1 --2- 172.21.15.102:0/887242106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560547ad6260 0x560547ad6680 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x560547abc8c0 tx=0x7f81c80163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.321+0000 7f80b37fe640 1 -- 172.21.15.102:0/887242106 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81c8013450 con 0x560547ad6260 2024-09-13T19:16:21.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.321+0000 7f80b37fe640 1 -- 172.21.15.102:0/887242106 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81c80135f0 con 0x560547ad6260 2024-09-13T19:16:21.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.321+0000 7f81cfe98800 1 -- 172.21.15.102:0/887242106 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560547ad6e50 con 0x560547ad6260 2024-09-13T19:16:21.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.321+0000 7f80b37fe640 1 -- 172.21.15.102:0/887242106 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81c8013910 con 0x560547ad6260 2024-09-13T19:16:21.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.321+0000 7f81cfe98800 1 -- 172.21.15.102:0/887242106 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560547ad9b30 con 0x560547ad6260 2024-09-13T19:16:21.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.321+0000 7f80b37fe640 1 -- 172.21.15.102:0/887242106 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f81c8011040 con 0x560547ad6260 2024-09-13T19:16:21.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.322+0000 7f80b37fe640 1 --2- 172.21.15.102:0/887242106 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f80a8036bb0 0x7f80a8039070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.322+0000 7f80b37fe640 1 -- 172.21.15.102:0/887242106 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f81c800e040 con 0x560547ad6260 2024-09-13T19:16:21.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.322+0000 7f81cd98c640 1 --2- 172.21.15.102:0/887242106 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f80a8036bb0 0x7f80a8039070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.322+0000 7f81cfe98800 1 Processor -- start 2024-09-13T19:16:21.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.322+0000 7f81cfe98800 1 -- start start 2024-09-13T19:16:21.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.322+0000 7f81cd98c640 1 --2- 172.21.15.102:0/887242106 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f80a8036bb0 0x7f80a8039070 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x560547ac33b0 tx=0x7f81c004b740 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.322+0000 7f81cfe98800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560547ae2f80 0x560547ae3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.322+0000 7f81cfe98800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560547ab4240 con 0x560547ae2f80 2024-09-13T19:16:21.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.322+0000 7f81ce18d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560547ae2f80 0x560547ae3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.323+0000 7f81ce18d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560547ae2f80 0x560547ae3380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:56206/0 (socket says 172.21.15.102:56206) 2024-09-13T19:16:21.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.323+0000 7f81ce18d640 1 -- 172.21.15.102:0/1842367410 learned_addr learned my addr 172.21.15.102:0/1842367410 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:21.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.323+0000 7f81ce18d640 1 -- 172.21.15.102:0/1842367410 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560547ae3950 con 0x560547ae2f80 2024-09-13T19:16:21.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.323+0000 7f81ce18d640 1 --2- 172.21.15.102:0/1842367410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560547ae2f80 0x560547ae3380 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f81c804ce50 tx=0x7f81c8029f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5057f8eebdd15973 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.323+0000 7f80b17fa640 1 -- 172.21.15.102:0/1842367410 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81c802a960 con 0x560547ae2f80 2024-09-13T19:16:21.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.323+0000 7f80b17fa640 1 -- 172.21.15.102:0/1842367410 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81c802a440 con 0x560547ae2f80 2024-09-13T19:16:21.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.323+0000 7f80b17fa640 1 -- 172.21.15.102:0/1842367410 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81c802ab00 con 0x560547ae2f80 2024-09-13T19:16:21.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.324+0000 7f81cfe98800 1 -- 172.21.15.102:0/1842367410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560547ae2f80 msgr2=0x560547ae3380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.324+0000 7f81cfe98800 1 --2- 172.21.15.102:0/1842367410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560547ae2f80 0x560547ae3380 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f81c804ce50 tx=0x7f81c8029f40 comp rx=0 tx=0).stop 2024-09-13T19:16:21.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.324+0000 7f81cfe98800 1 -- 172.21.15.102:0/1842367410 shutdown_connections 2024-09-13T19:16:21.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.324+0000 7f81cfe98800 1 --2- 172.21.15.102:0/1842367410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560547ae2f80 0x560547ae3380 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.324+0000 7f81cfe98800 1 -- 172.21.15.102:0/1842367410 >> 172.21.15.102:0/1842367410 conn(0x560547adf330 msgr2=0x560547add430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:21.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.324+0000 7f81cfe98800 1 -- 172.21.15.102:0/1842367410 shutdown_connections 2024-09-13T19:16:21.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.324+0000 7f81cfe98800 1 -- 172.21.15.102:0/1842367410 wait complete. 2024-09-13T19:16:21.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.324+0000 7f81cfe98800 1 Processor -- start 2024-09-13T19:16:21.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.324+0000 7f81cfe98800 1 -- start start 2024-09-13T19:16:21.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.324+0000 7f81cfe98800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560547ae2f80 0x560547aea360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.324+0000 7f81cfe98800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560547ae3f20 con 0x560547ae2f80 2024-09-13T19:16:21.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.324+0000 7f81ce18d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560547ae2f80 0x560547aea360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.324+0000 7f81ce18d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560547ae2f80 0x560547aea360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:56208/0 (socket says 172.21.15.102:56208) 2024-09-13T19:16:21.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.324+0000 7f81ce18d640 1 -- 172.21.15.102:0/2507966519 learned_addr learned my addr 172.21.15.102:0/2507966519 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:21.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.324+0000 7f81ce18d640 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560547aea8a0 con 0x560547ae2f80 2024-09-13T19:16:21.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.325+0000 7f81ce18d640 1 --2- 172.21.15.102:0/2507966519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560547ae2f80 0x560547aea360 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f81c8029560 tx=0x7f81c804cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.325+0000 7f809f7fe640 1 -- 172.21.15.102:0/2507966519 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81c802f030 con 0x560547ae2f80 2024-09-13T19:16:21.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.325+0000 7f809f7fe640 1 -- 172.21.15.102:0/2507966519 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81c803b070 con 0x560547ae2f80 2024-09-13T19:16:21.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.325+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560547aeab30 con 0x560547ae2f80 2024-09-13T19:16:21.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.325+0000 7f809f7fe640 1 -- 172.21.15.102:0/2507966519 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81c801f920 con 0x560547ae2f80 2024-09-13T19:16:21.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.325+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560547aed7e0 con 0x560547ae2f80 2024-09-13T19:16:21.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.325+0000 7f809f7fe640 1 -- 172.21.15.102:0/2507966519 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f81c804ebb0 con 0x560547ae2f80 2024-09-13T19:16:21.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.326+0000 7f809f7fe640 1 --2- 172.21.15.102:0/2507966519 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8098036b40 0x7f8098039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.326+0000 7f809f7fe640 1 -- 172.21.15.102:0/2507966519 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f81c8030070 con 0x560547ae2f80 2024-09-13T19:16:21.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.326+0000 7f81cd98c640 1 --2- 172.21.15.102:0/2507966519 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8098036b40 0x7f8098039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.326+0000 7f81cd98c640 1 --2- 172.21.15.102:0/2507966519 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8098036b40 0x7f8098039000 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f81c00197f0 tx=0x7f81c004d2d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.326+0000 7f81cfe98800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.326+0000 7f81cfe98800 1 --2- 172.21.15.102:0/2507966519 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x560547af6060 0x560547af8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.326+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560547af8c70 con 0x560547af6060 2024-09-13T19:16:21.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.327+0000 7f81cd18b640 1 --2- 172.21.15.102:0/2507966519 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x560547af6060 0x560547af8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.327+0000 7f81cd18b640 1 --2- 172.21.15.102:0/2507966519 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x560547af6060 0x560547af8520 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.327+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f81c4057030 con 0x560547af6060 2024-09-13T19:16:21.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.327+0000 7f81cfe98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:21.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.327+0000 7f81cfe98800 20 realm 2024-09-13T19:16:21.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.327+0000 7f81cfe98800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.327+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560547af90a0 con 0x560547af6060 2024-09-13T19:16:21.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.327+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f81c4057030 con 0x560547af6060 2024-09-13T19:16:21.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.327+0000 7f81cfe98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:21.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.327+0000 7f81cfe98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:21.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.327+0000 7f81cfe98800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.327+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560547af9970 con 0x560547af6060 2024-09-13T19:16:21.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.328+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f81c4057030 con 0x560547af6060 2024-09-13T19:16:21.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.328+0000 7f81cfe98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:21.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.328+0000 7f81cfe98800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.328+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560547af9d10 con 0x560547af6060 2024-09-13T19:16:21.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.328+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f81c4057030 con 0x560547af6060 2024-09-13T19:16:21.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.328+0000 7f81cfe98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:21.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.328+0000 7f81cfe98800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.328+0000 7f81cfe98800 1 --2- 172.21.15.102:0/2507966519 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x560547afaa70 0x560547afce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.328+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560547afd4b0 con 0x560547afaa70 2024-09-13T19:16:21.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.328+0000 7f81ce18d640 1 --2- 172.21.15.102:0/2507966519 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x560547afaa70 0x560547afce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.328+0000 7f81ce18d640 1 --2- 172.21.15.102:0/2507966519 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x560547afaa70 0x560547afce60 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.329+0000 7f81ce18d640 1 -- 172.21.15.102:0/2507966519 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f81c8027020 con 0x560547afaa70 2024-09-13T19:16:21.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.329+0000 7f81cfe98800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:21.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.329+0000 7f81cfe98800 20 searching for the correct realm 2024-09-13T19:16:21.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.329+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560547afedc0 con 0x560547afaa70 2024-09-13T19:16:21.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.329+0000 7f81ce18d640 1 -- 172.21.15.102:0/2507966519 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81c8027020 con 0x560547afaa70 2024-09-13T19:16:21.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.329+0000 7f81ce18d640 1 --2- 172.21.15.102:0/2507966519 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f81c8013070 0x7f81c8051100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.329+0000 7f81ce18d640 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560547afedc0 con 0x7f81c8013070 2024-09-13T19:16:21.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.329+0000 7f81cd98c640 1 --2- 172.21.15.102:0/2507966519 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f81c8013070 0x7f81c8051100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.329+0000 7f81cd98c640 1 --2- 172.21.15.102:0/2507966519 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f81c8013070 0x7f81c8051100 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.329+0000 7f81cd98c640 1 -- 172.21.15.102:0/2507966519 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81c002e070 con 0x7f81c8013070 2024-09-13T19:16:21.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.329+0000 7f81cd98c640 1 --2- 172.21.15.102:0/2507966519 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f81c003e040 0x7f81c003f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.329+0000 7f81cd98c640 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560547afedc0 con 0x7f81c003e040 2024-09-13T19:16:21.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.330+0000 7f81cd18b640 1 --2- 172.21.15.102:0/2507966519 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f81c003e040 0x7f81c003f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.330+0000 7f81cd18b640 1 --2- 172.21.15.102:0/2507966519 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f81c003e040 0x7f81c003f430 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.330+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81c4057030 con 0x7f81c003e040 2024-09-13T19:16:21.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.330+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560547afedc0 con 0x560547af6060 2024-09-13T19:16:21.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.330+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81c4057030 con 0x560547af6060 2024-09-13T19:16:21.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.330+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560547afedc0 con 0x560547af6060 2024-09-13T19:16:21.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.331+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81c4057030 con 0x560547af6060 2024-09-13T19:16:21.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.331+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560547afedc0 con 0x7f81c003e040 2024-09-13T19:16:21.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.331+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81c4057030 con 0x7f81c003e040 2024-09-13T19:16:21.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.331+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560547afedc0 con 0x7f81c003e040 2024-09-13T19:16:21.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.331+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81c4057030 con 0x7f81c003e040 2024-09-13T19:16:21.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.331+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560547afedc0 con 0x7f81c8013070 2024-09-13T19:16:21.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.331+0000 7f81cd98c640 1 -- 172.21.15.102:0/2507966519 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81c002e070 con 0x7f81c8013070 2024-09-13T19:16:21.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.331+0000 7f81cd98c640 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560547afedc0 con 0x560547afaa70 2024-09-13T19:16:21.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.332+0000 7f81ce18d640 1 -- 172.21.15.102:0/2507966519 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81c8027020 con 0x560547afaa70 2024-09-13T19:16:21.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.332+0000 7f81ce18d640 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560547afedc0 con 0x560547af6060 2024-09-13T19:16:21.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.332+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81c4057030 con 0x560547af6060 2024-09-13T19:16:21.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.332+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560547afedc0 con 0x7f81c003e040 2024-09-13T19:16:21.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.332+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81c4057030 con 0x7f81c003e040 2024-09-13T19:16:21.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.332+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560547afedc0 con 0x560547af6060 2024-09-13T19:16:21.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.332+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81c4057030 con 0x560547af6060 2024-09-13T19:16:21.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.332+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560547afedc0 con 0x7f81c8013070 2024-09-13T19:16:21.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.332+0000 7f81cd98c640 1 -- 172.21.15.102:0/2507966519 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f81c002e070 con 0x7f81c8013070 2024-09-13T19:16:21.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.333+0000 7f81cd98c640 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560547afedc0 con 0x560547afaa70 2024-09-13T19:16:21.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.333+0000 7f81ce18d640 1 -- 172.21.15.102:0/2507966519 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81c8027020 con 0x560547afaa70 2024-09-13T19:16:21.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.333+0000 7f81ce18d640 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560547afedc0 con 0x560547afaa70 2024-09-13T19:16:21.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.333+0000 7f81ce18d640 1 -- 172.21.15.102:0/2507966519 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f81c8027020 con 0x560547afaa70 2024-09-13T19:16:21.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.333+0000 7f81ce18d640 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560547afedc0 con 0x7f81c003e040 2024-09-13T19:16:21.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.333+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81c4057030 con 0x7f81c003e040 2024-09-13T19:16:21.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.333+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560547afedc0 con 0x560547afaa70 2024-09-13T19:16:21.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.333+0000 7f81ce18d640 1 -- 172.21.15.102:0/2507966519 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f81c8027020 con 0x560547afaa70 2024-09-13T19:16:21.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.334+0000 7f81ce18d640 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560547afedc0 con 0x560547afaa70 2024-09-13T19:16:21.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.334+0000 7f81ce18d640 1 -- 172.21.15.102:0/2507966519 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81c8027020 con 0x560547afaa70 2024-09-13T19:16:21.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.334+0000 7f81ce18d640 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560547afedc0 con 0x560547af6060 2024-09-13T19:16:21.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.334+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81c4057030 con 0x560547af6060 2024-09-13T19:16:21.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.334+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560547afedc0 con 0x560547af6060 2024-09-13T19:16:21.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.334+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f81c4057030 con 0x560547af6060 2024-09-13T19:16:21.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.334+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560547afedc0 con 0x7f81c003e040 2024-09-13T19:16:21.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.334+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81c4057030 con 0x7f81c003e040 2024-09-13T19:16:21.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.334+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560547afedc0 con 0x560547afaa70 2024-09-13T19:16:21.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.335+0000 7f81ce18d640 1 -- 172.21.15.102:0/2507966519 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81c8027020 con 0x560547afaa70 2024-09-13T19:16:21.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.335+0000 7f81ce18d640 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560547afedc0 con 0x7f81c8013070 2024-09-13T19:16:21.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.335+0000 7f81cd98c640 1 -- 172.21.15.102:0/2507966519 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81c002e070 con 0x7f81c8013070 2024-09-13T19:16:21.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.335+0000 7f81cd98c640 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560547afedc0 con 0x560547af6060 2024-09-13T19:16:21.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.335+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81c4057030 con 0x560547af6060 2024-09-13T19:16:21.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.335+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560547afedc0 con 0x7f81c003e040 2024-09-13T19:16:21.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.336+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81c4057030 con 0x7f81c003e040 2024-09-13T19:16:21.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.336+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560547afedc0 con 0x560547afaa70 2024-09-13T19:16:21.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.336+0000 7f81ce18d640 1 -- 172.21.15.102:0/2507966519 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81c8027020 con 0x560547afaa70 2024-09-13T19:16:21.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.336+0000 7f81ce18d640 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560547afedc0 con 0x7f81c003e040 2024-09-13T19:16:21.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.336+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81c4057030 con 0x7f81c003e040 2024-09-13T19:16:21.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.336+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560547afedc0 con 0x7f81c8013070 2024-09-13T19:16:21.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.336+0000 7f81cd98c640 1 -- 172.21.15.102:0/2507966519 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81c002e070 con 0x7f81c8013070 2024-09-13T19:16:21.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.336+0000 7f81cd98c640 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560547afedc0 con 0x560547afaa70 2024-09-13T19:16:21.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.336+0000 7f81ce18d640 1 -- 172.21.15.102:0/2507966519 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81c8027020 con 0x560547afaa70 2024-09-13T19:16:21.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.336+0000 7f81ce18d640 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560547afedc0 con 0x7f81c003e040 2024-09-13T19:16:21.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.337+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81c4057030 con 0x7f81c003e040 2024-09-13T19:16:21.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.337+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560547afedc0 con 0x560547af6060 2024-09-13T19:16:21.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.337+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f81c4057030 con 0x560547af6060 2024-09-13T19:16:21.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.337+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f81c408a080 con 0x7f81c8013070 2024-09-13T19:16:21.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.337+0000 7f81cd98c640 1 -- 172.21.15.102:0/2507966519 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81c0065040 con 0x7f81c8013070 2024-09-13T19:16:21.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.337+0000 7f81cfe98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:21.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.337+0000 7f81cfe98800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:21.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.337+0000 7f81cfe98800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:21.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.337+0000 7f81cfe98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:21.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.337+0000 7f81cfe98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:21.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.337+0000 7f81cfe98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:21.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.337+0000 7f81cfe98800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.337+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560547afde70 con 0x560547af6060 2024-09-13T19:16:21.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.337+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f81c4057030 con 0x560547af6060 2024-09-13T19:16:21.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.337+0000 7f81cfe98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:21.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.337+0000 7f81cfe98800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.337+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560547afe710 con 0x560547af6060 2024-09-13T19:16:21.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.338+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f81c4057030 con 0x560547af6060 2024-09-13T19:16:21.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.338+0000 7f81cfe98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:21.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.338+0000 7f81cfe98800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.338+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560547aff240 con 0x560547afaa70 2024-09-13T19:16:21.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.338+0000 7f81ce18d640 1 -- 172.21.15.102:0/2507966519 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f81c8027020 con 0x560547afaa70 2024-09-13T19:16:21.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.338+0000 7f81cfe98800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:21.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.338+0000 7f81cfe98800 20 zone default found 2024-09-13T19:16:21.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.338+0000 7f81cfe98800 4 Realm: () 2024-09-13T19:16:21.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.338+0000 7f81cfe98800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:21.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.338+0000 7f81cfe98800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:21.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.338+0000 7f81cfe98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:21.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.338+0000 7f81cfe98800 20 zonegroup default 2024-09-13T19:16:21.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.338+0000 7f81cfe98800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.338+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560547affa90 con 0x7f81c003e040 2024-09-13T19:16:21.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.338+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f81c4057030 con 0x7f81c003e040 2024-09-13T19:16:21.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.338+0000 7f81cfe98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:21.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.338+0000 7f81cfe98800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.338+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560547b01470 con 0x560547afaa70 2024-09-13T19:16:21.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.339+0000 7f81ce18d640 1 -- 172.21.15.102:0/2507966519 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f81c8027020 con 0x560547afaa70 2024-09-13T19:16:21.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.339+0000 7f81cfe98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:21.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.339+0000 7f81cfe98800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.339+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560547b018d0 con 0x560547afaa70 2024-09-13T19:16:21.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.339+0000 7f81ce18d640 1 -- 172.21.15.102:0/2507966519 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f81c8027020 con 0x560547afaa70 2024-09-13T19:16:21.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.339+0000 7f81cfe98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:21.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.339+0000 7f81cfe98800 20 started sync module instance, tier type = 2024-09-13T19:16:21.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.339+0000 7f81cfe98800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:21.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.339+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560547b008b0 con 0x7f81c8013070 2024-09-13T19:16:21.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.340+0000 7f81cd98c640 1 -- 172.21.15.102:0/2507966519 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(44 notify.0 [create] v34'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81c0065040 con 0x7f81c8013070 2024-09-13T19:16:21.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.340+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94580677542912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560547b01d30 con 0x7f81c8013070 2024-09-13T19:16:21.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.340+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560547b02580 con 0x560547af6060 2024-09-13T19:16:21.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.341+0000 7f81cd98c640 1 -- 172.21.15.102:0/2507966519 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94580677542912] v34'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81c0065040 con 0x7f81c8013070 2024-09-13T19:16:21.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.341+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v34'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81c4057030 con 0x560547af6060 2024-09-13T19:16:21.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.341+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94580677550288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560547b029a0 con 0x560547af6060 2024-09-13T19:16:21.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.341+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560547b031f0 con 0x560547afaa70 2024-09-13T19:16:21.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.342+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94580677550288] v34'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81c4057030 con 0x560547af6060 2024-09-13T19:16:21.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.343+0000 7f81ce18d640 1 -- 172.21.15.102:0/2507966519 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v34'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81c8027020 con 0x560547afaa70 2024-09-13T19:16:21.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.343+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94580677551824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560547b030e0 con 0x560547afaa70 2024-09-13T19:16:21.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.343+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560547b03c00 con 0x7f81c8013070 2024-09-13T19:16:21.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.344+0000 7f81cd98c640 1 -- 172.21.15.102:0/2507966519 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(50 notify.3 [create] v34'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81c0065040 con 0x7f81c8013070 2024-09-13T19:16:21.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.344+0000 7f81ce18d640 1 -- 172.21.15.102:0/2507966519 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94580677551824] v34'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81c8027020 con 0x560547afaa70 2024-09-13T19:16:21.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.344+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94580677553008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560547b03ff0 con 0x7f81c8013070 2024-09-13T19:16:21.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.344+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560547b04a10 con 0x560547af6060 2024-09-13T19:16:21.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.345+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v34'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81c4057030 con 0x560547af6060 2024-09-13T19:16:21.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.345+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94580677559552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560547b052e0 con 0x560547af6060 2024-09-13T19:16:21.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.345+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560547b05d90 con 0x7f81c003e040 2024-09-13T19:16:21.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.345+0000 7f81cd98c640 1 -- 172.21.15.102:0/2507966519 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94580677553008] v34'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81c0065040 con 0x7f81c8013070 2024-09-13T19:16:21.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.346+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94580677559552] v34'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81c4057030 con 0x560547af6060 2024-09-13T19:16:21.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.346+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(54 notify.5 [create] v34'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81c4057030 con 0x7f81c003e040 2024-09-13T19:16:21.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.346+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94580677555920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560547b058a0 con 0x7f81c003e040 2024-09-13T19:16:21.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.346+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560547b062a0 con 0x7f81c003e040 2024-09-13T19:16:21.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.347+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94580677555920] v34'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81c4057030 con 0x7f81c003e040 2024-09-13T19:16:21.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.347+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(56 notify.6 [create] v34'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81c4057030 con 0x7f81c003e040 2024-09-13T19:16:21.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.347+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94580677561824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560547b06260 con 0x7f81c003e040 2024-09-13T19:16:21.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.347+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560547b06c60 con 0x7f81c003e040 2024-09-13T19:16:21.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.348+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94580677561824] v34'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81c4057030 con 0x7f81c003e040 2024-09-13T19:16:21.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.348+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(58 notify.7 [create] v34'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81c4057030 con 0x7f81c003e040 2024-09-13T19:16:21.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.348+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94580677568368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560547b06260 con 0x7f81c003e040 2024-09-13T19:16:21.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.348+0000 7f81cfe98800 20 add_watcher() i=0 2024-09-13T19:16:21.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.348+0000 7f81cfe98800 20 add_watcher() i=1 2024-09-13T19:16:21.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.348+0000 7f81cfe98800 20 add_watcher() i=2 2024-09-13T19:16:21.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.348+0000 7f81cfe98800 20 add_watcher() i=3 2024-09-13T19:16:21.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.348+0000 7f81cfe98800 20 add_watcher() i=4 2024-09-13T19:16:21.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.348+0000 7f81cfe98800 20 add_watcher() i=5 2024-09-13T19:16:21.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.348+0000 7f81cfe98800 20 add_watcher() i=6 2024-09-13T19:16:21.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.349+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94580677568368] v34'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81c4057030 con 0x7f81c003e040 2024-09-13T19:16:21.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.349+0000 7f81cfe98800 20 add_watcher() i=7 2024-09-13T19:16:21.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.349+0000 7f81cfe98800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:21.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.349+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560547b0a080 con 0x560547af6060 2024-09-13T19:16:21.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.349+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f81c4057030 con 0x560547af6060 2024-09-13T19:16:21.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.350+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94580677566336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560547b07550 con 0x560547af6060 2024-09-13T19:16:21.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.350+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94580677566336] v34'148 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f81c4057030 con 0x560547af6060 2024-09-13T19:16:21.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.351+0000 7f807f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:21.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.351+0000 7f81cfe98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:21.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.351+0000 7f81cfe98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:21.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.351+0000 7f81cfe98800 5 note: GC not initialized 2024-09-13T19:16:21.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.351+0000 7f807e7fc640 20 reqs_thread_entry: start 2024-09-13T19:16:21.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.351+0000 7f81cfe98800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:21.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.351+0000 7f81cfe98800 20 Filter name: none 2024-09-13T19:16:21.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.351+0000 7f7feffff640 20 reqs_thread_entry: start 2024-09-13T19:16:21.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.351+0000 7f81cfe98800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:16:21.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.351+0000 7f81cfe98800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.351+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560547b3d410 con 0x560547af6060 2024-09-13T19:16:21.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.352+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f81c4057030 con 0x560547af6060 2024-09-13T19:16:21.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.352+0000 7f81cfe98800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:16:21.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.352+0000 7f81cfe98800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:16:21.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.352+0000 7f81cfe98800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:16:21.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.352+0000 7f81cfe98800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:16:21.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.352+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560547b3fea0 con 0x7f81c8013070 2024-09-13T19:16:21.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.352+0000 7f81cd98c640 1 -- 172.21.15.102:0/2507966519 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv31 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f81c0065040 con 0x7f81c8013070 2024-09-13T19:16:21.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.352+0000 7f81cfe98800 20 disabling bucket name=myfoo 2024-09-13T19:16:21.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.352+0000 7f81cfe98800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T19:16:21.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.352+0000 7f81cfe98800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.352+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560547b3de80 con 0x7f81c8013070 2024-09-13T19:16:21.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.352+0000 7f81cd98c640 1 -- 172.21.15.102:0/2507966519 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv32 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f81c0065040 con 0x7f81c8013070 2024-09-13T19:16:21.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.352+0000 7f81cfe98800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:16:21.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.352+0000 7f81cfe98800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-13T19:16:21.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.352+0000 7f81cfe98800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:16:21.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.352+0000 7f81cfe98800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 : miss 2024-09-13T19:16:21.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.352+0000 7f81cfe98800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.352+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:65 8.9 8:917ee2d5:root::.bucket.meta.myfoo%3a509740b4-c081-4f37-bd6d-df9ca851489b.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560547b407d0 con 0x7f81c8013070 2024-09-13T19:16:21.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.353+0000 7f81cd98c640 1 -- 172.21.15.102:0/2507966519 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(65 .bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv30 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f81c0065040 con 0x7f81c8013070 2024-09-13T19:16:21.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.353+0000 7f81cfe98800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:16:21.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.353+0000 7f81cfe98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 info.flags=0x17 2024-09-13T19:16:21.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.353+0000 7f81cfe98800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 to cache LRU end 2024-09-13T19:16:21.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.353+0000 7f81cfe98800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:16:21.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.353+0000 7f81cfe98800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:16:21.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.353+0000 7f81cfe98800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 2024-09-13T19:16:21.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.353+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:66 8.9 8:917ee2d5:root::.bucket.meta.myfoo%3a509740b4-c081-4f37-bd6d-df9ca851489b.4237.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560547b48350 con 0x7f81c8013070 2024-09-13T19:16:21.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.354+0000 7f81cd98c640 1 -- 172.21.15.102:0/2507966519 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(66 .bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v34'33 uv33 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f81c0065040 con 0x7f81c8013070 2024-09-13T19:16:21.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.354+0000 7f81cfe98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 info.flags=0x17 2024-09-13T19:16:21.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.354+0000 7f81cfe98800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 to cache LRU end 2024-09-13T19:16:21.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.354+0000 7f81cfe98800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:16:21.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.354+0000 7f81cfe98800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1, ofs0, ns] 2024-09-13T19:16:21.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.354+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify cookie 94580677807696 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560547b42920 con 0x560547af6060 2024-09-13T19:16:21.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.355+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== watch-notify(notify (1) cookie 94580677559552 notify 146028888083 ret 0) ==== 794+0+0 (crc 0 0 0) 0x560547889e00 con 0x560547af6060 2024-09-13T19:16:21.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.355+0000 7f80b17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888083 cookie 94580677559552 notifier 4601 bl.length()=752 2024-09-13T19:16:21.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.355+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(67 notify.4 [notify cookie 94580677807696 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f81c4057030 con 0x560547af6060 2024-09-13T19:16:21.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.355+0000 7f80b17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 info.flags=0x17 2024-09-13T19:16:21.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.355+0000 7f80b17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 to cache LRU end 2024-09-13T19:16:21.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.355+0000 7f80b17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:16:21.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.355+0000 7f80b17fa640 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f8090003ea0 con 0x560547af6060 2024-09-13T19:16:21.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.355+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(68 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81c4057030 con 0x560547af6060 2024-09-13T19:16:21.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.355+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== watch-notify(notify_complete (2) cookie 94580677807696 notify 146028888083 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f81c405b9a0 con 0x560547af6060 2024-09-13T19:16:21.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.355+0000 7f81cfe98800 20 handle_bi_update(): bucket=:myfoo[509740b4-c081-4f37-bd6d-df9ca851489b.4237.1]): orig_sources= new_sources= 2024-09-13T19:16:21.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.355+0000 7f81cfe98800 20 handle_bi_update(): bucket=:myfoo[509740b4-c081-4f37-bd6d-df9ca851489b.4237.1]): potential sources added=[] removed=[] 2024-09-13T19:16:21.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.355+0000 7f81cfe98800 20 handle_bi_update(): bucket=:myfoo[509740b4-c081-4f37-bd6d-df9ca851489b.4237.1]): orig_dests= new_dests= 2024-09-13T19:16:21.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.355+0000 7f81cfe98800 20 handle_bi_update(): bucket=:myfoo[509740b4-c081-4f37-bd6d-df9ca851489b.4237.1]): potential dests added=[] removed=[] 2024-09-13T19:16:21.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.355+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560547b3f010 con 0x560547af6060 2024-09-13T19:16:21.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.356+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v34'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f81c4057030 con 0x560547af6060 2024-09-13T19:16:21.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.356+0000 7f81cfe98800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:16:21.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.356+0000 7f81cfe98800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:16:21.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.356+0000 7f81cfe98800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T19:16:21.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.356+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94580677801552 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560547b3f010 con 0x560547af6060 2024-09-13T19:16:21.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.356+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== watch-notify(notify (1) cookie 94580677559552 notify 146028888084 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f81c405b9a0 con 0x560547af6060 2024-09-13T19:16:21.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.357+0000 7f80b17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888084 cookie 94580677559552 notifier 4601 bl.length()=567 2024-09-13T19:16:21.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.357+0000 7f80b17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:16:21.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.357+0000 7f80b17fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:16:21.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.357+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 <== osd.1 v2:172.21.15.102:6808/2204418452 28 ==== osd_op_reply(70 notify.4 [notify cookie 94580677801552 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f81c4057030 con 0x560547af6060 2024-09-13T19:16:21.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.357+0000 7f80b17fa640 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f8090003ea0 con 0x560547af6060 2024-09-13T19:16:21.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.357+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 <== osd.1 v2:172.21.15.102:6808/2204418452 29 ==== watch-notify(notify_complete (2) cookie 94580677801552 notify 146028888084 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f81c4081700 con 0x560547af6060 2024-09-13T19:16:21.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.357+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 <== osd.1 v2:172.21.15.102:6808/2204418452 30 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81c4057030 con 0x560547af6060 2024-09-13T19:16:21.372 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:16:14.779675Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:16:14.779665Z","tags":[],"group_ids":[]} 2024-09-13T19:16:21.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.358+0000 7f807f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:21.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.358+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94580677566336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560547b3b160 con 0x560547af6060 2024-09-13T19:16:21.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.359+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 <== osd.1 v2:172.21.15.102:6808/2204418452 31 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94580677566336] v34'149 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f81c4057030 con 0x560547af6060 2024-09-13T19:16:21.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.359+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94580677542912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560547b3b160 con 0x7f81c8013070 2024-09-13T19:16:21.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.360+0000 7f81cd98c640 1 -- 172.21.15.102:0/2507966519 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94580677542912] v34'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81c0065040 con 0x7f81c8013070 2024-09-13T19:16:21.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.360+0000 7f81cfe98800 20 remove_watcher() i=0 2024-09-13T19:16:21.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.360+0000 7f81cfe98800 2 removed watcher, disabling cache 2024-09-13T19:16:21.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.360+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94580677550288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560547b3b160 con 0x560547af6060 2024-09-13T19:16:21.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.361+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 <== osd.1 v2:172.21.15.102:6808/2204418452 32 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94580677550288] v34'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81c4057030 con 0x560547af6060 2024-09-13T19:16:21.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.361+0000 7f81cfe98800 20 remove_watcher() i=1 2024-09-13T19:16:21.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.361+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94580677551824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560547b3b160 con 0x560547afaa70 2024-09-13T19:16:21.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.362+0000 7f81ce18d640 1 -- 172.21.15.102:0/2507966519 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94580677551824] v34'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81c8027020 con 0x560547afaa70 2024-09-13T19:16:21.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.362+0000 7f81cfe98800 20 remove_watcher() i=2 2024-09-13T19:16:21.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.362+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94580677553008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560547b3b160 con 0x7f81c8013070 2024-09-13T19:16:21.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.363+0000 7f81cd98c640 1 -- 172.21.15.102:0/2507966519 <== osd.2 v2:172.21.15.102:6816/2238176080 16 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94580677553008] v34'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81c0065040 con 0x7f81c8013070 2024-09-13T19:16:21.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.363+0000 7f81cfe98800 20 remove_watcher() i=3 2024-09-13T19:16:21.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.363+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94580677559552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560547b3b160 con 0x560547af6060 2024-09-13T19:16:21.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.364+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 <== osd.1 v2:172.21.15.102:6808/2204418452 33 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94580677559552] v34'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81c4057030 con 0x560547af6060 2024-09-13T19:16:21.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.364+0000 7f81cfe98800 20 remove_watcher() i=4 2024-09-13T19:16:21.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.364+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94580677555920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560547b3b160 con 0x7f81c003e040 2024-09-13T19:16:21.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.365+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94580677555920] v34'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81c4057030 con 0x7f81c003e040 2024-09-13T19:16:21.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.365+0000 7f81cfe98800 20 remove_watcher() i=5 2024-09-13T19:16:21.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.365+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94580677561824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560547b3b160 con 0x7f81c003e040 2024-09-13T19:16:21.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.366+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94580677561824] v34'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81c4057030 con 0x7f81c003e040 2024-09-13T19:16:21.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.366+0000 7f81cfe98800 20 remove_watcher() i=6 2024-09-13T19:16:21.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.366+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94580677568368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560547b3b160 con 0x7f81c003e040 2024-09-13T19:16:21.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.367+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94580677568368] v34'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81c4057030 con 0x7f81c003e040 2024-09-13T19:16:21.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.367+0000 7f81cfe98800 20 remove_watcher() i=7 2024-09-13T19:16:21.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.367+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f81c003e040 msgr2=0x7f81c003f430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.367+0000 7f81cfe98800 1 --2- 172.21.15.102:0/2507966519 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f81c003e040 0x7f81c003f430 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.367+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x560547af6060 msgr2=0x560547af8520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.367+0000 7f81cfe98800 1 --2- 172.21.15.102:0/2507966519 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x560547af6060 0x560547af8520 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.367+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f81c8013070 msgr2=0x7f81c8051100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.367+0000 7f81cfe98800 1 --2- 172.21.15.102:0/2507966519 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f81c8013070 0x7f81c8051100 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.367+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x560547afaa70 msgr2=0x560547afce60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.367+0000 7f81cfe98800 1 --2- 172.21.15.102:0/2507966519 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x560547afaa70 0x560547afce60 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.367+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8098036b40 msgr2=0x7f8098039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.367+0000 7f81cfe98800 1 --2- 172.21.15.102:0/2507966519 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8098036b40 0x7f8098039000 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f81c00197f0 tx=0x7f81c004d2d0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.367+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560547ae2f80 msgr2=0x560547aea360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.367+0000 7f81cfe98800 1 --2- 172.21.15.102:0/2507966519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560547ae2f80 0x560547aea360 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f81c8029560 tx=0x7f81c804cdb0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.367+0000 7f81cd18b640 1 -- 172.21.15.102:0/2507966519 reap_dead start 2024-09-13T19:16:21.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.367+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 shutdown_connections 2024-09-13T19:16:21.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.367+0000 7f81cfe98800 1 --2- 172.21.15.102:0/2507966519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560547ae2f80 0x560547aea360 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.367+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 >> 172.21.15.102:0/2507966519 conn(0x560547adf330 msgr2=0x560547ae4690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:21.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.367+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 shutdown_connections 2024-09-13T19:16:21.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.367+0000 7f81cfe98800 1 -- 172.21.15.102:0/2507966519 wait complete. 2024-09-13T19:16:21.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.368+0000 7f81cfe98800 1 -- 172.21.15.102:0/887242106 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f80a8036bb0 msgr2=0x7f80a8039070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.368+0000 7f81cfe98800 1 --2- 172.21.15.102:0/887242106 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f80a8036bb0 0x7f80a8039070 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x560547ac33b0 tx=0x7f81c004b740 comp rx=0 tx=0).stop 2024-09-13T19:16:21.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.368+0000 7f81cfe98800 1 -- 172.21.15.102:0/887242106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560547ad6260 msgr2=0x560547ad6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.368+0000 7f81cfe98800 1 --2- 172.21.15.102:0/887242106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560547ad6260 0x560547ad6680 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x560547abc8c0 tx=0x7f81c80163e0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.368+0000 7f81cfe98800 1 -- 172.21.15.102:0/887242106 shutdown_connections 2024-09-13T19:16:21.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.368+0000 7f81cfe98800 1 --2- 172.21.15.102:0/887242106 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f80a8036bb0 0x7f80a8039070 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.368+0000 7f81cfe98800 1 --2- 172.21.15.102:0/887242106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560547ad6260 0x560547ad6680 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.368+0000 7f81cfe98800 1 -- 172.21.15.102:0/887242106 >> 172.21.15.102:0/887242106 conn(0x560547acb1f0 msgr2=0x560547acdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:21.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.368+0000 7f81cfe98800 1 -- 172.21.15.102:0/887242106 shutdown_connections 2024-09-13T19:16:21.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.368+0000 7f81cfe98800 1 -- 172.21.15.102:0/887242106 wait complete. 2024-09-13T19:16:21.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.368+0000 7f81cfe98800 1 -- 172.21.15.102:0/1254770327 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5605479c8d90 msgr2=0x560547ac2530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.368+0000 7f81cfe98800 1 --2- 172.21.15.102:0/1254770327 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5605479c8d90 0x560547ac2530 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.368+0000 7f81cfe98800 1 -- 172.21.15.102:0/1254770327 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x560547ac4e00 msgr2=0x560547ac71f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.368+0000 7f81cfe98800 1 --2- 172.21.15.102:0/1254770327 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x560547ac4e00 0x560547ac71f0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.368+0000 7f81cfe98800 1 -- 172.21.15.102:0/1254770327 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f80b4036b40 msgr2=0x7f80b4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.368+0000 7f81cfe98800 1 --2- 172.21.15.102:0/1254770327 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f80b4036b40 0x7f80b4039000 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f81c4057000 tx=0x7f81c4052000 comp rx=0 tx=0).stop 2024-09-13T19:16:21.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.368+0000 7f81cfe98800 1 -- 172.21.15.102:0/1254770327 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560547936610 msgr2=0x560547abb4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.368+0000 7f81cfe98800 1 --2- 172.21.15.102:0/1254770327 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560547936610 0x560547abb4c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f81c0000c00 tx=0x7f81c0000ed0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.368+0000 7f81cfe98800 1 -- 172.21.15.102:0/1254770327 shutdown_connections 2024-09-13T19:16:21.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.368+0000 7f81cfe98800 1 --2- 172.21.15.102:0/1254770327 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x560547ac4e00 0x560547ac71f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.368+0000 7f81cfe98800 1 --2- 172.21.15.102:0/1254770327 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5605479c8d90 0x560547ac2530 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.368+0000 7f81cfe98800 1 --2- 172.21.15.102:0/1254770327 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f80b4036b40 0x7f80b4039000 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.368+0000 7f81cfe98800 1 --2- 172.21.15.102:0/1254770327 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560547936610 0x560547abb4c0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.368+0000 7f81cfe98800 1 -- 172.21.15.102:0/1254770327 >> 172.21.15.102:0/1254770327 conn(0x5605479bcde0 msgr2=0x560547aadcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:21.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.368+0000 7f81cfe98800 1 -- 172.21.15.102:0/1254770327 shutdown_connections 2024-09-13T19:16:21.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.368+0000 7f81cfe98800 1 -- 172.21.15.102:0/1254770327 wait complete. 2024-09-13T19:16:21.383 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:16:14.779675Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:16:14.779665Z', 'tags': [], 'group_ids': []} 2024-09-13T19:16:21.385 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-13T19:16:21.385 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-13T19:16:21.386 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-13T19:16:21.429 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:21.430 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:21.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.427+0000 7f4f05c87800 1 Processor -- start 2024-09-13T19:16:21.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.427+0000 7f4f05c87800 1 -- start start 2024-09-13T19:16:21.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.427+0000 7f4f05c87800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x557d187074c0 0x557d187078c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.427+0000 7f4f05c87800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557d185c7b30 con 0x557d18707e00 2024-09-13T19:16:21.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.427+0000 7f4f05c87800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x557d185a9360 con 0x557d187074c0 2024-09-13T19:16:21.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.428+0000 7f4f0377b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x557d187074c0 0x557d187078c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.428+0000 7f4f02f7a640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x557d18707e00 0x557d1870c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:33080/0 (socket says 172.21.15.102:33080) 2024-09-13T19:16:21.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.428+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2881506676 learned_addr learned my addr 172.21.15.102:0/2881506676 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:16:21.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.428+0000 7f4f0377b640 1 -- 172.21.15.102:0/2881506676 >> v1:172.21.15.53:6789/0 conn(0x557d18707e00 legacy=0x557d1870c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.428+0000 7f4f0377b640 1 -- 172.21.15.102:0/2881506676 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d185cfe00 con 0x557d187074c0 2024-09-13T19:16:21.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.430+0000 7f4f0377b640 1 --2- 172.21.15.102:0/2881506676 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d187074c0 0x557d187078c0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f4ef400a470 tx=0x7f4ef4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f34e308f5799a0a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.430+0000 7f4f02779640 1 -- 172.21.15.102:0/2881506676 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ef4053570 con 0x557d187074c0 2024-09-13T19:16:21.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.430+0000 7f4f02779640 1 -- 172.21.15.102:0/2881506676 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ef4058070 con 0x557d187074c0 2024-09-13T19:16:21.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.430+0000 7f4f02779640 1 -- 172.21.15.102:0/2881506676 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ef4053880 con 0x557d187074c0 2024-09-13T19:16:21.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.430+0000 7f4f05c87800 1 -- 172.21.15.102:0/2881506676 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d187074c0 msgr2=0x557d187078c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.430+0000 7f4f05c87800 1 --2- 172.21.15.102:0/2881506676 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d187074c0 0x557d187078c0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f4ef400a470 tx=0x7f4ef4045a20 comp rx=0 tx=0).stop 2024-09-13T19:16:21.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.430+0000 7f4f05c87800 1 -- 172.21.15.102:0/2881506676 shutdown_connections 2024-09-13T19:16:21.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.430+0000 7f4f05c87800 1 --2- 172.21.15.102:0/2881506676 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d187074c0 0x557d187078c0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.430+0000 7f4f05c87800 1 -- 172.21.15.102:0/2881506676 >> 172.21.15.102:0/2881506676 conn(0x557d18702df0 msgr2=0x557d18705210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:21.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.430+0000 7f4f05c87800 1 -- 172.21.15.102:0/2881506676 shutdown_connections 2024-09-13T19:16:21.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.430+0000 7f4f05c87800 1 -- 172.21.15.102:0/2881506676 wait complete. 2024-09-13T19:16:21.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.444+0000 7f4f05c87800 1 Processor -- start 2024-09-13T19:16:21.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.444+0000 7f4f05c87800 1 -- start start 2024-09-13T19:16:21.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.444+0000 7f4f05c87800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d187074c0 0x557d1867bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.444+0000 7f4f05c87800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557d18654330 con 0x557d187074c0 2024-09-13T19:16:21.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.445+0000 7f4f0377b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d187074c0 0x557d1867bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.445+0000 7f4f0377b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d187074c0 0x557d1867bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:56236/0 (socket says 172.21.15.102:56236) 2024-09-13T19:16:21.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.445+0000 7f4f0377b640 1 -- 172.21.15.102:0/3495828320 learned_addr learned my addr 172.21.15.102:0/3495828320 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:21.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.445+0000 7f4f0377b640 1 -- 172.21.15.102:0/3495828320 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d185a1bc0 con 0x557d187074c0 2024-09-13T19:16:21.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.445+0000 7f4f0377b640 1 --2- 172.21.15.102:0/3495828320 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d187074c0 0x557d1867bd80 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f4ef4025c20 tx=0x7f4ef4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0daff390febaa42 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.445+0000 7f4df160a640 1 -- 172.21.15.102:0/3495828320 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ef4053ba0 con 0x557d187074c0 2024-09-13T19:16:21.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.445+0000 7f4df160a640 1 -- 172.21.15.102:0/3495828320 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ef4063030 con 0x557d187074c0 2024-09-13T19:16:21.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.445+0000 7f4df160a640 1 -- 172.21.15.102:0/3495828320 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ef4053440 con 0x557d187074c0 2024-09-13T19:16:21.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.446+0000 7f4f05c87800 1 -- 172.21.15.102:0/3495828320 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d187074c0 msgr2=0x557d1867bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.446+0000 7f4f05c87800 1 --2- 172.21.15.102:0/3495828320 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d187074c0 0x557d1867bd80 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f4ef4025c20 tx=0x7f4ef4051000 comp rx=0 tx=0).stop 2024-09-13T19:16:21.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.446+0000 7f4f05c87800 1 -- 172.21.15.102:0/3495828320 shutdown_connections 2024-09-13T19:16:21.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.446+0000 7f4f05c87800 1 --2- 172.21.15.102:0/3495828320 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d187074c0 0x557d1867bd80 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.446+0000 7f4f05c87800 1 -- 172.21.15.102:0/3495828320 >> 172.21.15.102:0/3495828320 conn(0x557d18702df0 msgr2=0x557d187f2130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:21.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.446+0000 7f4f05c87800 1 -- 172.21.15.102:0/3495828320 shutdown_connections 2024-09-13T19:16:21.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.446+0000 7f4f05c87800 1 -- 172.21.15.102:0/3495828320 wait complete. 2024-09-13T19:16:21.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.446+0000 7f4f05c87800 1 Processor -- start 2024-09-13T19:16:21.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.446+0000 7f4f05c87800 1 -- start start 2024-09-13T19:16:21.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.447+0000 7f4f05c87800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d187074c0 0x557d187f7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.447+0000 7f4f05c87800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557d1870e4e0 con 0x557d187074c0 2024-09-13T19:16:21.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.447+0000 7f4f0377b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d187074c0 0x557d187f7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.447+0000 7f4f0377b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d187074c0 0x557d187f7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:56240/0 (socket says 172.21.15.102:56240) 2024-09-13T19:16:21.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.447+0000 7f4f0377b640 1 -- 172.21.15.102:0/2157915809 learned_addr learned my addr 172.21.15.102:0/2157915809 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:21.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.447+0000 7f4f0377b640 1 -- 172.21.15.102:0/2157915809 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d185b5fe0 con 0x557d187074c0 2024-09-13T19:16:21.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.447+0000 7f4f0377b640 1 --2- 172.21.15.102:0/2157915809 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d187074c0 0x557d187f7ed0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x557d1867b480 tx=0x7f4ef4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.447+0000 7f4defe07640 1 -- 172.21.15.102:0/2157915809 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ef4078070 con 0x557d187074c0 2024-09-13T19:16:21.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.447+0000 7f4defe07640 1 -- 172.21.15.102:0/2157915809 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ef4053570 con 0x557d187074c0 2024-09-13T19:16:21.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.447+0000 7f4f05c87800 1 -- 172.21.15.102:0/2157915809 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d187f65c0 con 0x557d187074c0 2024-09-13T19:16:21.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.447+0000 7f4defe07640 1 -- 172.21.15.102:0/2157915809 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ef4053850 con 0x557d187074c0 2024-09-13T19:16:21.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.448+0000 7f4f05c87800 1 -- 172.21.15.102:0/2157915809 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d187f6b40 con 0x557d187074c0 2024-09-13T19:16:21.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.448+0000 7f4defe07640 1 -- 172.21.15.102:0/2157915809 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4ef407b070 con 0x557d187074c0 2024-09-13T19:16:21.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.448+0000 7f4defe07640 1 --2- 172.21.15.102:0/2157915809 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4de8036b40 0x7f4de8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.448+0000 7f4defe07640 1 -- 172.21.15.102:0/2157915809 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f4ef4070070 con 0x557d187074c0 2024-09-13T19:16:21.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.449+0000 7f4f02f7a640 1 --2- 172.21.15.102:0/2157915809 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4de8036b40 0x7f4de8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.449+0000 7f4f05c87800 1 --2- 172.21.15.102:0/2157915809 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557d18707e00 0x557d18808560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.449+0000 7f4f05c87800 1 -- 172.21.15.102:0/2157915809 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d18808aa0 con 0x557d18707e00 2024-09-13T19:16:21.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.449+0000 7f4f03f7c640 1 --2- 172.21.15.102:0/2157915809 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557d18707e00 0x557d18808560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.449+0000 7f4f02f7a640 1 --2- 172.21.15.102:0/2157915809 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4de8036b40 0x7f4de8039000 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8000f60 tx=0x7f4ef80012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.449+0000 7f4f03f7c640 1 --2- 172.21.15.102:0/2157915809 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557d18707e00 0x557d18808560 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.449+0000 7f4f03f7c640 1 -- 172.21.15.102:0/2157915809 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4efc00a4a0 con 0x557d18707e00 2024-09-13T19:16:21.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.449+0000 7f4f05c87800 1 -- 172.21.15.102:0/2157915809 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d18809320 con 0x557d18707e00 2024-09-13T19:16:21.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.450+0000 7f4f03f7c640 1 -- 172.21.15.102:0/2157915809 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4efc00a4a0 con 0x557d18707e00 2024-09-13T19:16:21.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.450+0000 7f4f05c87800 1 --2- 172.21.15.102:0/2157915809 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x557d1880ad50 0x557d1880d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.450+0000 7f4f05c87800 1 -- 172.21.15.102:0/2157915809 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d1880d9a0 con 0x557d1880ad50 2024-09-13T19:16:21.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.450+0000 7f4f0377b640 1 --2- 172.21.15.102:0/2157915809 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x557d1880ad50 0x557d1880d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.450+0000 7f4f0377b640 1 --2- 172.21.15.102:0/2157915809 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x557d1880ad50 0x557d1880d210 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.450+0000 7f4f0377b640 1 -- 172.21.15.102:0/2157915809 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4ef407a030 con 0x557d1880ad50 2024-09-13T19:16:21.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.450+0000 7f4f05c87800 1 -- 172.21.15.102:0/2157915809 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d18809b70 con 0x557d18707e00 2024-09-13T19:16:21.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.451+0000 7f4f03f7c640 1 -- 172.21.15.102:0/2157915809 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4efc00a4a0 con 0x557d18707e00 2024-09-13T19:16:21.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.451+0000 7f4f05c87800 1 -- 172.21.15.102:0/2157915809 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d18809f10 con 0x557d1880ad50 2024-09-13T19:16:21.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.451+0000 7f4f0377b640 1 -- 172.21.15.102:0/2157915809 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4ef407a030 con 0x557d1880ad50 2024-09-13T19:16:21.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.451+0000 7f4f05c87800 1 Processor -- start 2024-09-13T19:16:21.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.451+0000 7f4f05c87800 1 -- start start 2024-09-13T19:16:21.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.451+0000 7f4f05c87800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d1881c280 0x557d1881c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.451+0000 7f4f05c87800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557d187f8410 con 0x557d1881c280 2024-09-13T19:16:21.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.452+0000 7f4f03f7c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d1881c280 0x557d1881c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.452+0000 7f4f03f7c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d1881c280 0x557d1881c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:56254/0 (socket says 172.21.15.102:56254) 2024-09-13T19:16:21.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.452+0000 7f4f03f7c640 1 -- 172.21.15.102:0/1851957291 learned_addr learned my addr 172.21.15.102:0/1851957291 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:21.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.452+0000 7f4f03f7c640 1 -- 172.21.15.102:0/1851957291 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d1881cbe0 con 0x557d1881c280 2024-09-13T19:16:21.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.452+0000 7f4f03f7c640 1 --2- 172.21.15.102:0/1851957291 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d1881c280 0x557d1881c6a0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x557d18808e40 tx=0x7f4efc0163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.452+0000 7f4ded602640 1 -- 172.21.15.102:0/1851957291 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4efc013450 con 0x557d1881c280 2024-09-13T19:16:21.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.452+0000 7f4ded602640 1 -- 172.21.15.102:0/1851957291 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4efc0135f0 con 0x557d1881c280 2024-09-13T19:16:21.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.452+0000 7f4f05c87800 1 -- 172.21.15.102:0/1851957291 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d1881ce70 con 0x557d1881c280 2024-09-13T19:16:21.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.452+0000 7f4ded602640 1 -- 172.21.15.102:0/1851957291 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4efc0138d0 con 0x557d1881c280 2024-09-13T19:16:21.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.452+0000 7f4f05c87800 1 -- 172.21.15.102:0/1851957291 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d1881fb50 con 0x557d1881c280 2024-09-13T19:16:21.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.453+0000 7f4ded602640 1 -- 172.21.15.102:0/1851957291 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4efc011040 con 0x557d1881c280 2024-09-13T19:16:21.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.453+0000 7f4ded602640 1 --2- 172.21.15.102:0/1851957291 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4ddc036b40 0x7f4ddc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.453+0000 7f4ded602640 1 -- 172.21.15.102:0/1851957291 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f4efc00e040 con 0x557d1881c280 2024-09-13T19:16:21.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.453+0000 7f4f0377b640 1 --2- 172.21.15.102:0/1851957291 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4ddc036b40 0x7f4ddc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.454+0000 7f4f05c87800 1 Processor -- start 2024-09-13T19:16:21.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.454+0000 7f4f0377b640 1 --2- 172.21.15.102:0/1851957291 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4ddc036b40 0x7f4ddc039000 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x557d187f7020 tx=0x7f4ef408ec10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.454+0000 7f4f05c87800 1 -- start start 2024-09-13T19:16:21.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.454+0000 7f4f05c87800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d18828fd0 0x557d188293d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.454+0000 7f4f05c87800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557d185a3580 con 0x557d18828fd0 2024-09-13T19:16:21.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.454+0000 7f4f03f7c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d18828fd0 0x557d188293d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.454+0000 7f4f03f7c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d18828fd0 0x557d188293d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:56270/0 (socket says 172.21.15.102:56270) 2024-09-13T19:16:21.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.454+0000 7f4f03f7c640 1 -- 172.21.15.102:0/2246880511 learned_addr learned my addr 172.21.15.102:0/2246880511 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:21.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.454+0000 7f4f03f7c640 1 -- 172.21.15.102:0/2246880511 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d188299a0 con 0x557d18828fd0 2024-09-13T19:16:21.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.454+0000 7f4f03f7c640 1 --2- 172.21.15.102:0/2246880511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d18828fd0 0x557d188293d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f4efc04cdd0 tx=0x7f4efc014ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0cd282e16e0f06f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.455+0000 7f4de6ffd640 1 -- 172.21.15.102:0/2246880511 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4efc01f390 con 0x557d18828fd0 2024-09-13T19:16:21.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.455+0000 7f4de6ffd640 1 -- 172.21.15.102:0/2246880511 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4efc012cb0 con 0x557d18828fd0 2024-09-13T19:16:21.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.455+0000 7f4de6ffd640 1 -- 172.21.15.102:0/2246880511 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4efc01f530 con 0x557d18828fd0 2024-09-13T19:16:21.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.455+0000 7f4f05c87800 1 -- 172.21.15.102:0/2246880511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d18828fd0 msgr2=0x557d188293d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.455+0000 7f4f05c87800 1 --2- 172.21.15.102:0/2246880511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d18828fd0 0x557d188293d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f4efc04cdd0 tx=0x7f4efc014ae0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.455+0000 7f4f05c87800 1 -- 172.21.15.102:0/2246880511 shutdown_connections 2024-09-13T19:16:21.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.455+0000 7f4f05c87800 1 --2- 172.21.15.102:0/2246880511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d18828fd0 0x557d188293d0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.455+0000 7f4f05c87800 1 -- 172.21.15.102:0/2246880511 >> 172.21.15.102:0/2246880511 conn(0x557d18825330 msgr2=0x557d18823430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:21.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.455+0000 7f4f05c87800 1 -- 172.21.15.102:0/2246880511 shutdown_connections 2024-09-13T19:16:21.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.455+0000 7f4f05c87800 1 -- 172.21.15.102:0/2246880511 wait complete. 2024-09-13T19:16:21.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.455+0000 7f4f05c87800 1 Processor -- start 2024-09-13T19:16:21.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.455+0000 7f4f05c87800 1 -- start start 2024-09-13T19:16:21.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.456+0000 7f4f05c87800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d18828fd0 0x557d18830320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.456+0000 7f4f05c87800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557d18829e90 con 0x557d18828fd0 2024-09-13T19:16:21.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.456+0000 7f4f03f7c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d18828fd0 0x557d18830320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.456+0000 7f4f03f7c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d18828fd0 0x557d18830320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:56274/0 (socket says 172.21.15.102:56274) 2024-09-13T19:16:21.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.456+0000 7f4f03f7c640 1 -- 172.21.15.102:0/2391901799 learned_addr learned my addr 172.21.15.102:0/2391901799 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:21.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.456+0000 7f4f03f7c640 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d18830860 con 0x557d18828fd0 2024-09-13T19:16:21.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.456+0000 7f4f03f7c640 1 --2- 172.21.15.102:0/2391901799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d18828fd0 0x557d18830320 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x557d18823fa0 tx=0x7f4efc04cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.456+0000 7f4de57fa640 1 -- 172.21.15.102:0/2391901799 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4efc039020 con 0x557d18828fd0 2024-09-13T19:16:21.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.456+0000 7f4de57fa640 1 -- 172.21.15.102:0/2391901799 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4efc01f990 con 0x557d18828fd0 2024-09-13T19:16:21.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.456+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d18830af0 con 0x557d18828fd0 2024-09-13T19:16:21.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.456+0000 7f4de57fa640 1 -- 172.21.15.102:0/2391901799 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4efc030040 con 0x557d18828fd0 2024-09-13T19:16:21.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.456+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d188337a0 con 0x557d18828fd0 2024-09-13T19:16:21.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.457+0000 7f4de57fa640 1 -- 172.21.15.102:0/2391901799 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4efc03c020 con 0x557d18828fd0 2024-09-13T19:16:21.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.457+0000 7f4de57fa640 1 --2- 172.21.15.102:0/2391901799 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4dcc036b40 0x7f4dcc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.457+0000 7f4de57fa640 1 -- 172.21.15.102:0/2391901799 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6110+0+0 (secure 0 0 0) 0x7f4efc03fc40 con 0x557d18828fd0 2024-09-13T19:16:21.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.457+0000 7f4f0377b640 1 --2- 172.21.15.102:0/2391901799 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4dcc036b40 0x7f4dcc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.458+0000 7f4f0377b640 1 --2- 172.21.15.102:0/2391901799 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4dcc036b40 0x7f4dcc039000 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4ef407c730 tx=0x7f4ef4092000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.458+0000 7f4f05c87800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.458+0000 7f4f05c87800 1 --2- 172.21.15.102:0/2391901799 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557d1883bf90 0x557d1883e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.458+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d1883eba0 con 0x557d1883bf90 2024-09-13T19:16:21.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.458+0000 7f4f02f7a640 1 --2- 172.21.15.102:0/2391901799 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557d1883bf90 0x557d1883e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.458+0000 7f4f02f7a640 1 --2- 172.21.15.102:0/2391901799 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557d1883bf90 0x557d1883e450 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.459+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ef8009050 con 0x557d1883bf90 2024-09-13T19:16:21.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.459+0000 7f4f05c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:21.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.459+0000 7f4f05c87800 20 realm 2024-09-13T19:16:21.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.459+0000 7f4f05c87800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.459+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d1883b3e0 con 0x557d1883bf90 2024-09-13T19:16:21.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.459+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ef8009050 con 0x557d1883bf90 2024-09-13T19:16:21.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.459+0000 7f4f05c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:21.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.459+0000 7f4f05c87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:21.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.459+0000 7f4f05c87800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.459+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d1883f690 con 0x557d1883bf90 2024-09-13T19:16:21.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.459+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ef8009050 con 0x557d1883bf90 2024-09-13T19:16:21.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.459+0000 7f4f05c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:21.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.459+0000 7f4f05c87800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.459+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d1883ff60 con 0x557d1883bf90 2024-09-13T19:16:21.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.459+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4ef8009050 con 0x557d1883bf90 2024-09-13T19:16:21.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.459+0000 7f4f05c87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:21.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.459+0000 7f4f05c87800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.459+0000 7f4f05c87800 1 --2- 172.21.15.102:0/2391901799 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x557d188408a0 0x557d18842c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.459+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d18843420 con 0x557d188408a0 2024-09-13T19:16:21.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.460+0000 7f4f03f7c640 1 --2- 172.21.15.102:0/2391901799 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x557d188408a0 0x557d18842c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.460+0000 7f4f03f7c640 1 --2- 172.21.15.102:0/2391901799 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x557d188408a0 0x557d18842c90 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.460+0000 7f4f03f7c640 1 -- 172.21.15.102:0/2391901799 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4efc033040 con 0x557d188408a0 2024-09-13T19:16:21.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.460+0000 7f4f05c87800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:21.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.460+0000 7f4f05c87800 20 searching for the correct realm 2024-09-13T19:16:21.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.460+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d18844da0 con 0x557d188408a0 2024-09-13T19:16:21.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.460+0000 7f4f03f7c640 1 -- 172.21.15.102:0/2391901799 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4efc033040 con 0x557d188408a0 2024-09-13T19:16:21.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.460+0000 7f4f03f7c640 1 --2- 172.21.15.102:0/2391901799 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f4efc03e020 0x7f4efc04e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.460+0000 7f4f03f7c640 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d18844da0 con 0x7f4efc03e020 2024-09-13T19:16:21.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.460+0000 7f4f0377b640 1 --2- 172.21.15.102:0/2391901799 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f4efc03e020 0x7f4efc04e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.461+0000 7f4f0377b640 1 --2- 172.21.15.102:0/2391901799 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f4efc03e020 0x7f4efc04e270 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.461+0000 7f4f0377b640 1 -- 172.21.15.102:0/2391901799 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ef407a030 con 0x7f4efc03e020 2024-09-13T19:16:21.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.461+0000 7f4f0377b640 1 --2- 172.21.15.102:0/2391901799 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f4ef409d070 0x7f4ef40908f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:21.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.461+0000 7f4f0377b640 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d18844da0 con 0x7f4ef409d070 2024-09-13T19:16:21.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.461+0000 7f4f02f7a640 1 --2- 172.21.15.102:0/2391901799 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f4ef409d070 0x7f4ef40908f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:21.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.461+0000 7f4f02f7a640 1 --2- 172.21.15.102:0/2391901799 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f4ef409d070 0x7f4ef40908f0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:21.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.462+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ef8009050 con 0x7f4ef409d070 2024-09-13T19:16:21.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.462+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d18844da0 con 0x557d1883bf90 2024-09-13T19:16:21.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.462+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ef8009050 con 0x557d1883bf90 2024-09-13T19:16:21.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.462+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d18844da0 con 0x557d1883bf90 2024-09-13T19:16:21.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.462+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ef8029040 con 0x557d1883bf90 2024-09-13T19:16:21.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.462+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d18844da0 con 0x7f4ef409d070 2024-09-13T19:16:21.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.462+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ef8029040 con 0x7f4ef409d070 2024-09-13T19:16:21.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.462+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d18844da0 con 0x7f4ef409d070 2024-09-13T19:16:21.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.463+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ef8029040 con 0x7f4ef409d070 2024-09-13T19:16:21.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.463+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d18844da0 con 0x7f4efc03e020 2024-09-13T19:16:21.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.463+0000 7f4f0377b640 1 -- 172.21.15.102:0/2391901799 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ef407a030 con 0x7f4efc03e020 2024-09-13T19:16:21.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.463+0000 7f4f0377b640 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d18844da0 con 0x557d188408a0 2024-09-13T19:16:21.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.463+0000 7f4f03f7c640 1 -- 172.21.15.102:0/2391901799 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4efc033040 con 0x557d188408a0 2024-09-13T19:16:21.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.463+0000 7f4f03f7c640 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d18844da0 con 0x557d1883bf90 2024-09-13T19:16:21.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.463+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ef8029040 con 0x557d1883bf90 2024-09-13T19:16:21.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.463+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d18844da0 con 0x7f4ef409d070 2024-09-13T19:16:21.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.463+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ef8029040 con 0x7f4ef409d070 2024-09-13T19:16:21.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.463+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d18844da0 con 0x557d1883bf90 2024-09-13T19:16:21.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.464+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ef8029040 con 0x557d1883bf90 2024-09-13T19:16:21.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.464+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d18844da0 con 0x7f4efc03e020 2024-09-13T19:16:21.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.464+0000 7f4f0377b640 1 -- 172.21.15.102:0/2391901799 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4ef407a030 con 0x7f4efc03e020 2024-09-13T19:16:21.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.464+0000 7f4f0377b640 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d18844da0 con 0x557d188408a0 2024-09-13T19:16:21.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.464+0000 7f4f03f7c640 1 -- 172.21.15.102:0/2391901799 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4efc033040 con 0x557d188408a0 2024-09-13T19:16:21.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.464+0000 7f4f03f7c640 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d18844da0 con 0x557d188408a0 2024-09-13T19:16:21.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.464+0000 7f4f03f7c640 1 -- 172.21.15.102:0/2391901799 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4efc033040 con 0x557d188408a0 2024-09-13T19:16:21.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.464+0000 7f4f03f7c640 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d18844da0 con 0x7f4ef409d070 2024-09-13T19:16:21.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.465+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ef8029040 con 0x7f4ef409d070 2024-09-13T19:16:21.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.465+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d18844da0 con 0x557d188408a0 2024-09-13T19:16:21.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.465+0000 7f4f03f7c640 1 -- 172.21.15.102:0/2391901799 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4efc033040 con 0x557d188408a0 2024-09-13T19:16:21.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.465+0000 7f4f03f7c640 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d18844da0 con 0x557d188408a0 2024-09-13T19:16:21.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.465+0000 7f4f03f7c640 1 -- 172.21.15.102:0/2391901799 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4efc033040 con 0x557d188408a0 2024-09-13T19:16:21.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.465+0000 7f4f03f7c640 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d18844da0 con 0x557d1883bf90 2024-09-13T19:16:21.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.465+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ef8029040 con 0x557d1883bf90 2024-09-13T19:16:21.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.465+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d18844da0 con 0x557d1883bf90 2024-09-13T19:16:21.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.465+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4ef8029040 con 0x557d1883bf90 2024-09-13T19:16:21.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.465+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d18844da0 con 0x7f4ef409d070 2024-09-13T19:16:21.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.466+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ef8029040 con 0x7f4ef409d070 2024-09-13T19:16:21.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.466+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d18844da0 con 0x557d188408a0 2024-09-13T19:16:21.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.466+0000 7f4f03f7c640 1 -- 172.21.15.102:0/2391901799 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4efc033040 con 0x557d188408a0 2024-09-13T19:16:21.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.466+0000 7f4f03f7c640 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d18844da0 con 0x7f4efc03e020 2024-09-13T19:16:21.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.466+0000 7f4f0377b640 1 -- 172.21.15.102:0/2391901799 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ef407a030 con 0x7f4efc03e020 2024-09-13T19:16:21.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.466+0000 7f4f0377b640 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d18844da0 con 0x557d1883bf90 2024-09-13T19:16:21.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.466+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ef8029040 con 0x557d1883bf90 2024-09-13T19:16:21.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.466+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d18844da0 con 0x7f4ef409d070 2024-09-13T19:16:21.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.467+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ef8029040 con 0x7f4ef409d070 2024-09-13T19:16:21.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.467+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d18844da0 con 0x557d188408a0 2024-09-13T19:16:21.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.467+0000 7f4f03f7c640 1 -- 172.21.15.102:0/2391901799 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4efc033040 con 0x557d188408a0 2024-09-13T19:16:21.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.467+0000 7f4f03f7c640 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d18844da0 con 0x7f4ef409d070 2024-09-13T19:16:21.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.467+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ef8029040 con 0x7f4ef409d070 2024-09-13T19:16:21.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.467+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d18844da0 con 0x7f4efc03e020 2024-09-13T19:16:21.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.467+0000 7f4f0377b640 1 -- 172.21.15.102:0/2391901799 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ef407a030 con 0x7f4efc03e020 2024-09-13T19:16:21.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.467+0000 7f4f0377b640 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d18844da0 con 0x557d188408a0 2024-09-13T19:16:21.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.468+0000 7f4f03f7c640 1 -- 172.21.15.102:0/2391901799 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4efc033040 con 0x557d188408a0 2024-09-13T19:16:21.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.468+0000 7f4f03f7c640 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d18844da0 con 0x7f4ef409d070 2024-09-13T19:16:21.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.468+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ef8029040 con 0x7f4ef409d070 2024-09-13T19:16:21.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.468+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d18844da0 con 0x557d1883bf90 2024-09-13T19:16:21.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.468+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4ef8029040 con 0x557d1883bf90 2024-09-13T19:16:21.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.468+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557d18844da0 con 0x7f4efc03e020 2024-09-13T19:16:21.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.468+0000 7f4f0377b640 1 -- 172.21.15.102:0/2391901799 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ef407a030 con 0x7f4efc03e020 2024-09-13T19:16:21.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.468+0000 7f4f05c87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:21.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.468+0000 7f4f05c87800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:21.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.468+0000 7f4f05c87800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:21.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.468+0000 7f4f05c87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:21.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.468+0000 7f4f05c87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:21.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.468+0000 7f4f05c87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:21.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.469+0000 7f4f05c87800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.469+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d18843ce0 con 0x557d1883bf90 2024-09-13T19:16:21.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.469+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ef8029040 con 0x557d1883bf90 2024-09-13T19:16:21.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.469+0000 7f4f05c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:21.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.469+0000 7f4f05c87800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.469+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d188440d0 con 0x557d1883bf90 2024-09-13T19:16:21.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.469+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4ef8029040 con 0x557d1883bf90 2024-09-13T19:16:21.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.469+0000 7f4f05c87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:21.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.469+0000 7f4f05c87800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.469+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d18845220 con 0x557d188408a0 2024-09-13T19:16:21.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.469+0000 7f4f03f7c640 1 -- 172.21.15.102:0/2391901799 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4efc033040 con 0x557d188408a0 2024-09-13T19:16:21.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.469+0000 7f4f05c87800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:21.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.469+0000 7f4f05c87800 20 zone default found 2024-09-13T19:16:21.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.469+0000 7f4f05c87800 4 Realm: () 2024-09-13T19:16:21.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.469+0000 7f4f05c87800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:21.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.469+0000 7f4f05c87800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:21.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.469+0000 7f4f05c87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:21.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.469+0000 7f4f05c87800 20 zonegroup default 2024-09-13T19:16:21.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.469+0000 7f4f05c87800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.469+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d18845a70 con 0x7f4ef409d070 2024-09-13T19:16:21.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.470+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4ef8029040 con 0x7f4ef409d070 2024-09-13T19:16:21.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.470+0000 7f4f05c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:21.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.470+0000 7f4f05c87800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.470+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d188477f0 con 0x557d188408a0 2024-09-13T19:16:21.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.470+0000 7f4f03f7c640 1 -- 172.21.15.102:0/2391901799 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4efc033040 con 0x557d188408a0 2024-09-13T19:16:21.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.470+0000 7f4f05c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:21.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.470+0000 7f4f05c87800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.470+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d18847840 con 0x557d188408a0 2024-09-13T19:16:21.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.470+0000 7f4f03f7c640 1 -- 172.21.15.102:0/2391901799 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4efc033040 con 0x557d188408a0 2024-09-13T19:16:21.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.470+0000 7f4f05c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:21.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.470+0000 7f4f05c87800 20 started sync module instance, tier type = 2024-09-13T19:16:21.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.470+0000 7f4f05c87800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:21.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.470+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d18846c90 con 0x7f4efc03e020 2024-09-13T19:16:21.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.471+0000 7f4f0377b640 1 -- 172.21.15.102:0/2391901799 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(44 notify.0 [create] v34'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ef407a030 con 0x7f4efc03e020 2024-09-13T19:16:21.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.471+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93995770603488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d18847d10 con 0x7f4efc03e020 2024-09-13T19:16:21.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.471+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d18848560 con 0x557d1883bf90 2024-09-13T19:16:21.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.472+0000 7f4f0377b640 1 -- 172.21.15.102:0/2391901799 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93995770603488] v34'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ef407a030 con 0x7f4efc03e020 2024-09-13T19:16:21.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.473+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v34'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ef8029040 con 0x557d1883bf90 2024-09-13T19:16:21.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.473+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93995770609840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d18848980 con 0x557d1883bf90 2024-09-13T19:16:21.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.473+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d188491d0 con 0x557d188408a0 2024-09-13T19:16:21.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.474+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93995770609840] v34'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ef8029040 con 0x557d1883bf90 2024-09-13T19:16:21.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.474+0000 7f4f03f7c640 1 -- 172.21.15.102:0/2391901799 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v34'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4efc033040 con 0x557d188408a0 2024-09-13T19:16:21.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.474+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93995770611376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d18849100 con 0x557d188408a0 2024-09-13T19:16:21.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.474+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d18849c50 con 0x7f4efc03e020 2024-09-13T19:16:21.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.475+0000 7f4f0377b640 1 -- 172.21.15.102:0/2391901799 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(50 notify.3 [create] v34'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ef407a030 con 0x7f4efc03e020 2024-09-13T19:16:21.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.475+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93995770615648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d1884a520 con 0x7f4efc03e020 2024-09-13T19:16:21.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.475+0000 7f4f03f7c640 1 -- 172.21.15.102:0/2391901799 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93995770611376] v34'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4efc033040 con 0x557d188408a0 2024-09-13T19:16:21.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.475+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d18848bd0 con 0x557d1883bf90 2024-09-13T19:16:21.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.476+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v34'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ef8029040 con 0x557d1883bf90 2024-09-13T19:16:21.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.476+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93995770620688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d18848b90 con 0x557d1883bf90 2024-09-13T19:16:21.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.476+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d1884bab0 con 0x7f4ef409d070 2024-09-13T19:16:21.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.476+0000 7f4f0377b640 1 -- 172.21.15.102:0/2391901799 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93995770615648] v34'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ef407a030 con 0x7f4efc03e020 2024-09-13T19:16:21.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.477+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(54 notify.5 [create] v34'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ef8029040 con 0x7f4ef409d070 2024-09-13T19:16:21.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.477+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93995770620688] v34'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ef8029040 con 0x557d1883bf90 2024-09-13T19:16:21.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.477+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93995770617968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d1884bab0 con 0x7f4ef409d070 2024-09-13T19:16:21.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.477+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d1884c010 con 0x7f4ef409d070 2024-09-13T19:16:21.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.478+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93995770617968] v34'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ef8029040 con 0x7f4ef409d070 2024-09-13T19:16:21.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.479+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(56 notify.6 [create] v34'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ef8029040 con 0x7f4ef409d070 2024-09-13T19:16:21.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.479+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93995770623488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d1884ba20 con 0x7f4ef409d070 2024-09-13T19:16:21.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.479+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d1884c970 con 0x7f4ef409d070 2024-09-13T19:16:21.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.480+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93995770623488] v34'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ef8029040 con 0x7f4ef409d070 2024-09-13T19:16:21.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.480+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(58 notify.7 [create] v34'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ef8029040 con 0x7f4ef409d070 2024-09-13T19:16:21.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.480+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93995770626064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d1884c8e0 con 0x7f4ef409d070 2024-09-13T19:16:21.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.480+0000 7f4f05c87800 20 add_watcher() i=0 2024-09-13T19:16:21.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.480+0000 7f4f05c87800 20 add_watcher() i=1 2024-09-13T19:16:21.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.480+0000 7f4f05c87800 20 add_watcher() i=2 2024-09-13T19:16:21.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.480+0000 7f4f05c87800 20 add_watcher() i=3 2024-09-13T19:16:21.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.480+0000 7f4f05c87800 20 add_watcher() i=4 2024-09-13T19:16:21.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.480+0000 7f4f05c87800 20 add_watcher() i=5 2024-09-13T19:16:21.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.480+0000 7f4f05c87800 20 add_watcher() i=6 2024-09-13T19:16:21.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.481+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93995770626064] v34'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ef8029040 con 0x7f4ef409d070 2024-09-13T19:16:21.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.481+0000 7f4f05c87800 20 add_watcher() i=7 2024-09-13T19:16:21.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.481+0000 7f4f05c87800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:21.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.481+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d1884fd70 con 0x557d1883bf90 2024-09-13T19:16:21.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.481+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4ef8029040 con 0x557d1883bf90 2024-09-13T19:16:21.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.481+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93995770627584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d1884d230 con 0x557d1883bf90 2024-09-13T19:16:21.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.482+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93995770627584] v34'150 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4ef8029040 con 0x557d1883bf90 2024-09-13T19:16:21.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.482+0000 7f4db9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:21.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.482+0000 7f4f05c87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:21.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.482+0000 7f4f05c87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:21.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.482+0000 7f4f05c87800 5 note: GC not initialized 2024-09-13T19:16:21.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.483+0000 7f4db8fe1640 20 reqs_thread_entry: start 2024-09-13T19:16:21.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.483+0000 7f4f05c87800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:21.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.483+0000 7f4f05c87800 20 Filter name: none 2024-09-13T19:16:21.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.483+0000 7f4d327fc640 20 reqs_thread_entry: start 2024-09-13T19:16:21.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.483+0000 7f4f05c87800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:16:21.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.483+0000 7f4f05c87800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.483+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d18883270 con 0x557d1883bf90 2024-09-13T19:16:21.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.483+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f4ef8029040 con 0x557d1883bf90 2024-09-13T19:16:21.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.483+0000 7f4f05c87800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:16:21.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.483+0000 7f4f05c87800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:16:21.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.483+0000 7f4f05c87800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:16:21.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.483+0000 7f4f05c87800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:16:21.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.483+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d18885d00 con 0x7f4efc03e020 2024-09-13T19:16:21.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.484+0000 7f4f0377b640 1 -- 172.21.15.102:0/2391901799 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv31 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f4ef407a030 con 0x7f4efc03e020 2024-09-13T19:16:21.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.484+0000 7f4f05c87800 20 enabling bucket name=myfoo 2024-09-13T19:16:21.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.484+0000 7f4f05c87800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T19:16:21.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.484+0000 7f4f05c87800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.484+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d18883ce0 con 0x7f4efc03e020 2024-09-13T19:16:21.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.484+0000 7f4f0377b640 1 -- 172.21.15.102:0/2391901799 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv32 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f4ef407a030 con 0x7f4efc03e020 2024-09-13T19:16:21.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.484+0000 7f4f05c87800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:16:21.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.484+0000 7f4f05c87800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-13T19:16:21.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.484+0000 7f4f05c87800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:16:21.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.484+0000 7f4f05c87800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 : miss 2024-09-13T19:16:21.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.484+0000 7f4f05c87800 20 rados->read ofs=0 len=0 2024-09-13T19:16:21.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.484+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:65 8.9 8:917ee2d5:root::.bucket.meta.myfoo%3a509740b4-c081-4f37-bd6d-df9ca851489b.4237.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d18886670 con 0x7f4efc03e020 2024-09-13T19:16:21.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.485+0000 7f4f0377b640 1 -- 172.21.15.102:0/2391901799 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(65 .bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv33 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f4ef407a030 con 0x7f4efc03e020 2024-09-13T19:16:21.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.485+0000 7f4f05c87800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:16:21.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.485+0000 7f4f05c87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 info.flags=0x17 2024-09-13T19:16:21.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.485+0000 7f4f05c87800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 to cache LRU end 2024-09-13T19:16:21.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.485+0000 7f4f05c87800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:16:21.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.485+0000 7f4f05c87800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:16:21.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.485+0000 7f4f05c87800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 2024-09-13T19:16:21.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.485+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:66 8.9 8:917ee2d5:root::.bucket.meta.myfoo%3a509740b4-c081-4f37-bd6d-df9ca851489b.4237.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d1888e2a0 con 0x7f4efc03e020 2024-09-13T19:16:21.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.486+0000 7f4f0377b640 1 -- 172.21.15.102:0/2391901799 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(66 .bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v34'34 uv34 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f4ef407a030 con 0x7f4efc03e020 2024-09-13T19:16:21.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.486+0000 7f4f05c87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 info.flags=0x17 2024-09-13T19:16:21.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.486+0000 7f4f05c87800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 to cache LRU end 2024-09-13T19:16:21.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.486+0000 7f4f05c87800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:16:21.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.486+0000 7f4f05c87800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1, ofs0, ns] 2024-09-13T19:16:21.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.486+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify cookie 93995770866960 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d18888870 con 0x557d1883bf90 2024-09-13T19:16:21.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.486+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== watch-notify(notify (1) cookie 93995770620688 notify 146028888085 ret 0) ==== 794+0+0 (crc 0 0 0) 0x557d185c7b30 con 0x557d1883bf90 2024-09-13T19:16:21.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.486+0000 7f4de6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888085 cookie 93995770620688 notifier 4608 bl.length()=752 2024-09-13T19:16:21.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.486+0000 7f4de6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 info.flags=0x17 2024-09-13T19:16:21.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.486+0000 7f4de6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1 to cache LRU end 2024-09-13T19:16:21.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.486+0000 7f4de6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:16:21.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.486+0000 7f4de6ffd640 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f4dc8003ea0 con 0x557d1883bf90 2024-09-13T19:16:21.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.486+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(67 notify.4 [notify cookie 93995770866960 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4ef8029040 con 0x557d1883bf90 2024-09-13T19:16:21.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.487+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(68 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ef8029040 con 0x557d1883bf90 2024-09-13T19:16:21.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.487+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== watch-notify(notify_complete (2) cookie 93995770866960 notify 146028888085 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f4ef803b740 con 0x557d1883bf90 2024-09-13T19:16:21.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.487+0000 7f4f05c87800 20 handle_bi_update(): bucket=:myfoo[509740b4-c081-4f37-bd6d-df9ca851489b.4237.1]): orig_sources= new_sources= 2024-09-13T19:16:21.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.487+0000 7f4f05c87800 20 handle_bi_update(): bucket=:myfoo[509740b4-c081-4f37-bd6d-df9ca851489b.4237.1]): potential sources added=[] removed=[] 2024-09-13T19:16:21.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.487+0000 7f4f05c87800 20 handle_bi_update(): bucket=:myfoo[509740b4-c081-4f37-bd6d-df9ca851489b.4237.1]): orig_dests= new_dests= 2024-09-13T19:16:21.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.487+0000 7f4f05c87800 20 handle_bi_update(): bucket=:myfoo[509740b4-c081-4f37-bd6d-df9ca851489b.4237.1]): potential dests added=[] removed=[] 2024-09-13T19:16:21.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.487+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d18884e60 con 0x557d1883bf90 2024-09-13T19:16:21.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.488+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v34'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f4ef8029040 con 0x557d1883bf90 2024-09-13T19:16:21.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.488+0000 7f4f05c87800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:16:21.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.488+0000 7f4f05c87800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:16:21.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.488+0000 7f4f05c87800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T19:16:21.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.488+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 93995770860608 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557d18884e60 con 0x557d1883bf90 2024-09-13T19:16:21.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.488+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== watch-notify(notify (1) cookie 93995770620688 notify 146028888086 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f4ef803b740 con 0x557d1883bf90 2024-09-13T19:16:21.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.488+0000 7f4de67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888086 cookie 93995770620688 notifier 4608 bl.length()=567 2024-09-13T19:16:21.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.488+0000 7f4de67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:16:21.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.488+0000 7f4de67fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:16:21.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.488+0000 7f4de67fc640 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f4d38003430 con 0x557d1883bf90 2024-09-13T19:16:21.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.488+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 <== osd.1 v2:172.21.15.102:6808/2204418452 28 ==== osd_op_reply(70 notify.4 [notify cookie 93995770860608 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4ef8029040 con 0x557d1883bf90 2024-09-13T19:16:21.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.488+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 <== osd.1 v2:172.21.15.102:6808/2204418452 29 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ef8029040 con 0x557d1883bf90 2024-09-13T19:16:21.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.489+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 <== osd.1 v2:172.21.15.102:6808/2204418452 30 ==== watch-notify(notify_complete (2) cookie 93995770860608 notify 146028888086 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f4ef803d430 con 0x557d1883bf90 2024-09-13T19:16:21.506 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:16:14.779675Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:16:14.779665Z","tags":[],"group_ids":[]} 2024-09-13T19:16:21.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.489+0000 7f4db9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:21.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.489+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93995770627584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d18880fc0 con 0x557d1883bf90 2024-09-13T19:16:21.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.490+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 <== osd.1 v2:172.21.15.102:6808/2204418452 31 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 93995770627584] v34'151 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4ef8029040 con 0x557d1883bf90 2024-09-13T19:16:21.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.490+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93995770603488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d18880fc0 con 0x7f4efc03e020 2024-09-13T19:16:21.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.491+0000 7f4f0377b640 1 -- 172.21.15.102:0/2391901799 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 93995770603488] v34'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ef407a030 con 0x7f4efc03e020 2024-09-13T19:16:21.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.491+0000 7f4f05c87800 20 remove_watcher() i=0 2024-09-13T19:16:21.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.491+0000 7f4f05c87800 2 removed watcher, disabling cache 2024-09-13T19:16:21.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.491+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93995770609840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d18880fc0 con 0x557d1883bf90 2024-09-13T19:16:21.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.492+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 <== osd.1 v2:172.21.15.102:6808/2204418452 32 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 93995770609840] v34'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ef8029040 con 0x557d1883bf90 2024-09-13T19:16:21.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.493+0000 7f4f05c87800 20 remove_watcher() i=1 2024-09-13T19:16:21.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.493+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93995770611376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d18880fc0 con 0x557d188408a0 2024-09-13T19:16:21.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.493+0000 7f4f03f7c640 1 -- 172.21.15.102:0/2391901799 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 93995770611376] v34'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4efc033040 con 0x557d188408a0 2024-09-13T19:16:21.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.493+0000 7f4f05c87800 20 remove_watcher() i=2 2024-09-13T19:16:21.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.493+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93995770615648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d18880fc0 con 0x7f4efc03e020 2024-09-13T19:16:21.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.494+0000 7f4f0377b640 1 -- 172.21.15.102:0/2391901799 <== osd.2 v2:172.21.15.102:6816/2238176080 16 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 93995770615648] v34'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ef407a030 con 0x7f4efc03e020 2024-09-13T19:16:21.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.495+0000 7f4f05c87800 20 remove_watcher() i=3 2024-09-13T19:16:21.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.495+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93995770620688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d18880fc0 con 0x557d1883bf90 2024-09-13T19:16:21.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.495+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 <== osd.1 v2:172.21.15.102:6808/2204418452 33 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 93995770620688] v34'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ef8029040 con 0x557d1883bf90 2024-09-13T19:16:21.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.495+0000 7f4f05c87800 20 remove_watcher() i=4 2024-09-13T19:16:21.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.495+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93995770617968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d18880fc0 con 0x7f4ef409d070 2024-09-13T19:16:21.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.496+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 93995770617968] v34'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ef8029040 con 0x7f4ef409d070 2024-09-13T19:16:21.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.496+0000 7f4f05c87800 20 remove_watcher() i=5 2024-09-13T19:16:21.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.496+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93995770623488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d18880fc0 con 0x7f4ef409d070 2024-09-13T19:16:21.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.497+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 93995770623488] v34'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ef8029040 con 0x7f4ef409d070 2024-09-13T19:16:21.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.497+0000 7f4f05c87800 20 remove_watcher() i=6 2024-09-13T19:16:21.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.497+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93995770626064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557d18880fc0 con 0x7f4ef409d070 2024-09-13T19:16:21.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.498+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 93995770626064] v34'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ef8029040 con 0x7f4ef409d070 2024-09-13T19:16:21.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.498+0000 7f4f05c87800 20 remove_watcher() i=7 2024-09-13T19:16:21.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.498+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f4ef409d070 msgr2=0x7f4ef40908f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.498+0000 7f4f05c87800 1 --2- 172.21.15.102:0/2391901799 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f4ef409d070 0x7f4ef40908f0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.498+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557d1883bf90 msgr2=0x557d1883e450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.498+0000 7f4f05c87800 1 --2- 172.21.15.102:0/2391901799 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557d1883bf90 0x557d1883e450 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.498+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f4efc03e020 msgr2=0x7f4efc04e270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.498+0000 7f4f05c87800 1 --2- 172.21.15.102:0/2391901799 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f4efc03e020 0x7f4efc04e270 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.498+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x557d188408a0 msgr2=0x557d18842c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.498+0000 7f4f05c87800 1 --2- 172.21.15.102:0/2391901799 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x557d188408a0 0x557d18842c90 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.498+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4dcc036b40 msgr2=0x7f4dcc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.498+0000 7f4f05c87800 1 --2- 172.21.15.102:0/2391901799 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4dcc036b40 0x7f4dcc039000 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4ef407c730 tx=0x7f4ef4092000 comp rx=0 tx=0).stop 2024-09-13T19:16:21.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.498+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d18828fd0 msgr2=0x557d18830320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.498+0000 7f4f05c87800 1 --2- 172.21.15.102:0/2391901799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d18828fd0 0x557d18830320 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x557d18823fa0 tx=0x7f4efc04cd60 comp rx=0 tx=0).stop 2024-09-13T19:16:21.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.498+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 reap_dead start 2024-09-13T19:16:21.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.498+0000 7f4f02f7a640 1 -- 172.21.15.102:0/2391901799 reap_dead start 2024-09-13T19:16:21.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.498+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 shutdown_connections 2024-09-13T19:16:21.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.498+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 >> 172.21.15.102:0/2391901799 conn(0x557d18825330 msgr2=0x557d18823400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:21.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.499+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 shutdown_connections 2024-09-13T19:16:21.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.499+0000 7f4f05c87800 1 -- 172.21.15.102:0/2391901799 wait complete. 2024-09-13T19:16:21.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.499+0000 7f4f05c87800 1 -- 172.21.15.102:0/1851957291 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4ddc036b40 msgr2=0x7f4ddc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.499+0000 7f4f05c87800 1 --2- 172.21.15.102:0/1851957291 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4ddc036b40 0x7f4ddc039000 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x557d187f7020 tx=0x7f4ef408ec10 comp rx=0 tx=0).stop 2024-09-13T19:16:21.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.499+0000 7f4f05c87800 1 -- 172.21.15.102:0/1851957291 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d1881c280 msgr2=0x557d1881c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.499+0000 7f4f05c87800 1 --2- 172.21.15.102:0/1851957291 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d1881c280 0x557d1881c6a0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x557d18808e40 tx=0x7f4efc0163e0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.499+0000 7f4f05c87800 1 -- 172.21.15.102:0/1851957291 shutdown_connections 2024-09-13T19:16:21.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.499+0000 7f4f05c87800 1 --2- 172.21.15.102:0/1851957291 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4ddc036b40 0x7f4ddc039000 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.499+0000 7f4f05c87800 1 --2- 172.21.15.102:0/1851957291 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d1881c280 0x557d1881c6a0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.499+0000 7f4f05c87800 1 -- 172.21.15.102:0/1851957291 >> 172.21.15.102:0/1851957291 conn(0x557d18811210 msgr2=0x557d18813d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:21.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.499+0000 7f4f05c87800 1 -- 172.21.15.102:0/1851957291 shutdown_connections 2024-09-13T19:16:21.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.499+0000 7f4f05c87800 1 -- 172.21.15.102:0/1851957291 wait complete. 2024-09-13T19:16:21.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.499+0000 7f4f05c87800 1 -- 172.21.15.102:0/2157915809 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557d18707e00 msgr2=0x557d18808560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.499+0000 7f4f05c87800 1 --2- 172.21.15.102:0/2157915809 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557d18707e00 0x557d18808560 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.499+0000 7f4f05c87800 1 -- 172.21.15.102:0/2157915809 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x557d1880ad50 msgr2=0x557d1880d210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.499+0000 7f4f05c87800 1 --2- 172.21.15.102:0/2157915809 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x557d1880ad50 0x557d1880d210 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.499+0000 7f4f05c87800 1 -- 172.21.15.102:0/2157915809 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4de8036b40 msgr2=0x7f4de8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.499+0000 7f4f05c87800 1 --2- 172.21.15.102:0/2157915809 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4de8036b40 0x7f4de8039000 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8000f60 tx=0x7f4ef80012b0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.499+0000 7f4f05c87800 1 -- 172.21.15.102:0/2157915809 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d187074c0 msgr2=0x557d187f7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:21.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.499+0000 7f4f05c87800 1 --2- 172.21.15.102:0/2157915809 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d187074c0 0x557d187f7ed0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x557d1867b480 tx=0x7f4ef4002fb0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.499+0000 7f4f05c87800 1 -- 172.21.15.102:0/2157915809 shutdown_connections 2024-09-13T19:16:21.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.499+0000 7f4f05c87800 1 --2- 172.21.15.102:0/2157915809 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x557d1880ad50 0x557d1880d210 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.499+0000 7f4f05c87800 1 --2- 172.21.15.102:0/2157915809 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557d18707e00 0x557d18808560 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.499+0000 7f4f05c87800 1 --2- 172.21.15.102:0/2157915809 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4de8036b40 0x7f4de8039000 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.499+0000 7f4f05c87800 1 --2- 172.21.15.102:0/2157915809 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d187074c0 0x557d187f7ed0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:21.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.499+0000 7f4f05c87800 1 -- 172.21.15.102:0/2157915809 >> 172.21.15.102:0/2157915809 conn(0x557d18702df0 msgr2=0x557d187f09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:21.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.500+0000 7f4f05c87800 1 -- 172.21.15.102:0/2157915809 shutdown_connections 2024-09-13T19:16:21.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:21.500+0000 7f4f05c87800 1 -- 172.21.15.102:0/2157915809 wait complete. 2024-09-13T19:16:21.518 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:16:14.779675Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:16:14.779665Z', 'tags': [], 'group_ids': []} 2024-09-13T19:16:21.549 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-13T19:16:21.818 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2024-09-13T19:16:21.828 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:16:36.829 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-13T19:16:36.830 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-13T19:16:36.830 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-13T19:16:36.879 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:36.880 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:36.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.877+0000 7f0815c0e800 1 Processor -- start 2024-09-13T19:16:36.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.877+0000 7f0815c0e800 1 -- start start 2024-09-13T19:16:36.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.877+0000 7f0815c0e800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x556741af15f0 0x556741b82690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:36.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.877+0000 7f0815c0e800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556741a3cb30 con 0x556741b82bd0 2024-09-13T19:16:36.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.877+0000 7f0815c0e800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x556741a1e360 con 0x556741af15f0 2024-09-13T19:16:36.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.878+0000 7f081143b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x556741af15f0 0x556741b82690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:36.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.878+0000 7f0810c3a640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x556741b82bd0 0x556741b84fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:48476/0 (socket says 172.21.15.102:48476) 2024-09-13T19:16:36.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.878+0000 7f0810c3a640 1 -- 172.21.15.102:0/972644044 learned_addr learned my addr 172.21.15.102:0/972644044 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:16:36.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.878+0000 7f081143b640 1 -- 172.21.15.102:0/972644044 >> v1:172.21.15.53:6789/0 conn(0x556741b82bd0 legacy=0x556741b84fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:36.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.878+0000 7f080bfff640 1 -- 172.21.15.102:0/972644044 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3244828013 0 0) 0x556741a3cb30 con 0x556741b82bd0 2024-09-13T19:16:36.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.878+0000 7f081143b640 1 -- 172.21.15.102:0/972644044 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556741a44e00 con 0x556741af15f0 2024-09-13T19:16:36.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.880+0000 7f081143b640 1 --2- 172.21.15.102:0/972644044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556741af15f0 0x556741b82690 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f0804005fd0 tx=0x7f0804045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85ec00067a3daa4b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:36.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.880+0000 7f080bfff640 1 -- 172.21.15.102:0/972644044 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0804058530 con 0x556741af15f0 2024-09-13T19:16:36.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.880+0000 7f080bfff640 1 -- 172.21.15.102:0/972644044 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08040586d0 con 0x556741af15f0 2024-09-13T19:16:36.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.880+0000 7f080bfff640 1 -- 172.21.15.102:0/972644044 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08040589d0 con 0x556741af15f0 2024-09-13T19:16:36.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.881+0000 7f0815c0e800 1 -- 172.21.15.102:0/972644044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556741af15f0 msgr2=0x556741b82690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:36.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.881+0000 7f0815c0e800 1 --2- 172.21.15.102:0/972644044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556741af15f0 0x556741b82690 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f0804005fd0 tx=0x7f0804045c30 comp rx=0 tx=0).stop 2024-09-13T19:16:36.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.881+0000 7f0815c0e800 1 -- 172.21.15.102:0/972644044 shutdown_connections 2024-09-13T19:16:36.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.881+0000 7f0815c0e800 1 --2- 172.21.15.102:0/972644044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556741af15f0 0x556741b82690 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:36.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.881+0000 7f0815c0e800 1 -- 172.21.15.102:0/972644044 >> 172.21.15.102:0/972644044 conn(0x556741b77de0 msgr2=0x556741b7a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:36.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.881+0000 7f0815c0e800 1 -- 172.21.15.102:0/972644044 shutdown_connections 2024-09-13T19:16:36.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.881+0000 7f0815c0e800 1 -- 172.21.15.102:0/972644044 wait complete. 2024-09-13T19:16:36.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.896+0000 7f0815c0e800 1 Processor -- start 2024-09-13T19:16:36.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.896+0000 7f0815c0e800 1 -- start start 2024-09-13T19:16:36.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.896+0000 7f0815c0e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556741af15f0 0x556741c6e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:36.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.896+0000 7f0815c0e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556741ac9330 con 0x556741af15f0 2024-09-13T19:16:36.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.897+0000 7f081143b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556741af15f0 0x556741c6e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:36.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.897+0000 7f081143b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556741af15f0 0x556741c6e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55212/0 (socket says 172.21.15.102:55212) 2024-09-13T19:16:36.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.897+0000 7f081143b640 1 -- 172.21.15.102:0/3059801034 learned_addr learned my addr 172.21.15.102:0/3059801034 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:36.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.897+0000 7f081143b640 1 -- 172.21.15.102:0/3059801034 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556741a16bc0 con 0x556741af15f0 2024-09-13T19:16:36.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.897+0000 7f081143b640 1 --2- 172.21.15.102:0/3059801034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556741af15f0 0x556741c6e840 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f080400a3f0 tx=0x7f0804051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdf757c31b6b8b20 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:36.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.898+0000 7f06ff606640 1 -- 172.21.15.102:0/3059801034 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0804058a30 con 0x556741af15f0 2024-09-13T19:16:36.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.898+0000 7f06ff606640 1 -- 172.21.15.102:0/3059801034 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0804068070 con 0x556741af15f0 2024-09-13T19:16:36.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.898+0000 7f06ff606640 1 -- 172.21.15.102:0/3059801034 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0804058d60 con 0x556741af15f0 2024-09-13T19:16:36.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.898+0000 7f0815c0e800 1 -- 172.21.15.102:0/3059801034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556741af15f0 msgr2=0x556741c6e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:36.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.898+0000 7f0815c0e800 1 --2- 172.21.15.102:0/3059801034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556741af15f0 0x556741c6e840 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f080400a3f0 tx=0x7f0804051000 comp rx=0 tx=0).stop 2024-09-13T19:16:36.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.898+0000 7f0815c0e800 1 -- 172.21.15.102:0/3059801034 shutdown_connections 2024-09-13T19:16:36.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.898+0000 7f0815c0e800 1 --2- 172.21.15.102:0/3059801034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556741af15f0 0x556741c6e840 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:36.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.898+0000 7f0815c0e800 1 -- 172.21.15.102:0/3059801034 >> 172.21.15.102:0/3059801034 conn(0x556741b77de0 msgr2=0x556741c6a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:36.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.898+0000 7f0815c0e800 1 -- 172.21.15.102:0/3059801034 shutdown_connections 2024-09-13T19:16:36.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.898+0000 7f0815c0e800 1 -- 172.21.15.102:0/3059801034 wait complete. 2024-09-13T19:16:36.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.899+0000 7f0815c0e800 1 Processor -- start 2024-09-13T19:16:36.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.899+0000 7f0815c0e800 1 -- start start 2024-09-13T19:16:36.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.899+0000 7f0815c0e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556741af15f0 0x556741c761c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:36.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.899+0000 7f0815c0e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556741b86980 con 0x556741af15f0 2024-09-13T19:16:36.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.899+0000 7f081143b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556741af15f0 0x556741c761c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:36.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.899+0000 7f081143b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556741af15f0 0x556741c761c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55226/0 (socket says 172.21.15.102:55226) 2024-09-13T19:16:36.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.899+0000 7f081143b640 1 -- 172.21.15.102:0/1923224379 learned_addr learned my addr 172.21.15.102:0/1923224379 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:36.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.900+0000 7f081143b640 1 -- 172.21.15.102:0/1923224379 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556741a2afe0 con 0x556741af15f0 2024-09-13T19:16:36.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.900+0000 7f081143b640 1 --2- 172.21.15.102:0/1923224379 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556741af15f0 0x556741c761c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f080400a3f0 tx=0x7f0804003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:36.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.900+0000 7f06fde03640 1 -- 172.21.15.102:0/1923224379 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0804063680 con 0x556741af15f0 2024-09-13T19:16:36.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.900+0000 7f06fde03640 1 -- 172.21.15.102:0/1923224379 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0804063820 con 0x556741af15f0 2024-09-13T19:16:36.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.900+0000 7f06fde03640 1 -- 172.21.15.102:0/1923224379 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0804063b40 con 0x556741af15f0 2024-09-13T19:16:36.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.900+0000 7f0815c0e800 1 -- 172.21.15.102:0/1923224379 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556741c76700 con 0x556741af15f0 2024-09-13T19:16:36.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.900+0000 7f0815c0e800 1 -- 172.21.15.102:0/1923224379 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556741c76bc0 con 0x556741af15f0 2024-09-13T19:16:36.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.901+0000 7f06fde03640 1 -- 172.21.15.102:0/1923224379 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0804063ce0 con 0x556741af15f0 2024-09-13T19:16:36.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.901+0000 7f06fde03640 1 --2- 172.21.15.102:0/1923224379 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f06f8036b90 0x7f06f8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:36.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.901+0000 7f06fde03640 1 -- 172.21.15.102:0/1923224379 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f0804090eb0 con 0x556741af15f0 2024-09-13T19:16:36.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.902+0000 7f0810c3a640 1 --2- 172.21.15.102:0/1923224379 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f06f8036b90 0x7f06f8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:36.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.902+0000 7f0815c0e800 1 --2- 172.21.15.102:0/1923224379 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x556741b82bd0 0x556741c7d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:36.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.902+0000 7f0815c0e800 1 -- 172.21.15.102:0/1923224379 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741c7d6c0 con 0x556741b82bd0 2024-09-13T19:16:36.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.902+0000 7f0811c3c640 1 --2- 172.21.15.102:0/1923224379 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x556741b82bd0 0x556741c7d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:36.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.902+0000 7f0810c3a640 1 --2- 172.21.15.102:0/1923224379 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f06f8036b90 0x7f06f8039050 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f07fc000c00 tx=0x7f07fc0013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:36.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.902+0000 7f0811c3c640 1 --2- 172.21.15.102:0/1923224379 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x556741b82bd0 0x556741c7d0c0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:36.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.902+0000 7f0811c3c640 1 -- 172.21.15.102:0/1923224379 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f080c0083e0 con 0x556741b82bd0 2024-09-13T19:16:36.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.902+0000 7f0815c0e800 1 -- 172.21.15.102:0/1923224379 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741c7a7c0 con 0x556741b82bd0 2024-09-13T19:16:36.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.903+0000 7f0811c3c640 1 -- 172.21.15.102:0/1923224379 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f080c0083e0 con 0x556741b82bd0 2024-09-13T19:16:36.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.903+0000 7f0815c0e800 1 --2- 172.21.15.102:0/1923224379 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x556741c7f9f0 0x556741c81de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:36.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.903+0000 7f0815c0e800 1 -- 172.21.15.102:0/1923224379 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741c824b0 con 0x556741c7f9f0 2024-09-13T19:16:36.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.903+0000 7f081143b640 1 --2- 172.21.15.102:0/1923224379 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x556741c7f9f0 0x556741c81de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:36.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.903+0000 7f081143b640 1 --2- 172.21.15.102:0/1923224379 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x556741c7f9f0 0x556741c81de0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:36.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.903+0000 7f081143b640 1 -- 172.21.15.102:0/1923224379 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f080407fc40 con 0x556741c7f9f0 2024-09-13T19:16:36.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.903+0000 7f0815c0e800 1 -- 172.21.15.102:0/1923224379 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741c7e890 con 0x556741b82bd0 2024-09-13T19:16:36.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.904+0000 7f0811c3c640 1 -- 172.21.15.102:0/1923224379 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f080c0083e0 con 0x556741b82bd0 2024-09-13T19:16:36.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.904+0000 7f0815c0e800 1 -- 172.21.15.102:0/1923224379 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741c7ed70 con 0x556741c7f9f0 2024-09-13T19:16:36.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.904+0000 7f081143b640 1 -- 172.21.15.102:0/1923224379 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f080407fc40 con 0x556741c7f9f0 2024-09-13T19:16:36.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.904+0000 7f0815c0e800 1 Processor -- start 2024-09-13T19:16:36.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.904+0000 7f0815c0e800 1 -- start start 2024-09-13T19:16:36.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.905+0000 7f0815c0e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556741c90ec0 0x556741c912e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:36.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.905+0000 7f0815c0e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556741a18580 con 0x556741c90ec0 2024-09-13T19:16:36.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.905+0000 7f0811c3c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556741c90ec0 0x556741c912e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:36.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.905+0000 7f0811c3c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556741c90ec0 0x556741c912e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55236/0 (socket says 172.21.15.102:55236) 2024-09-13T19:16:36.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.905+0000 7f0811c3c640 1 -- 172.21.15.102:0/2606095668 learned_addr learned my addr 172.21.15.102:0/2606095668 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:36.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.905+0000 7f0811c3c640 1 -- 172.21.15.102:0/2606095668 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556741c91820 con 0x556741c90ec0 2024-09-13T19:16:36.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.905+0000 7f0811c3c640 1 --2- 172.21.15.102:0/2606095668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556741c90ec0 0x556741c912e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x556741c76fe0 tx=0x7f080c00beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:36.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.906+0000 7f06f6ffd640 1 -- 172.21.15.102:0/2606095668 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f080c01c020 con 0x556741c90ec0 2024-09-13T19:16:36.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.906+0000 7f06f6ffd640 1 -- 172.21.15.102:0/2606095668 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f080c007c30 con 0x556741c90ec0 2024-09-13T19:16:36.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.906+0000 7f0815c0e800 1 -- 172.21.15.102:0/2606095668 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556741c91ab0 con 0x556741c90ec0 2024-09-13T19:16:36.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.906+0000 7f06f6ffd640 1 -- 172.21.15.102:0/2606095668 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f080c018440 con 0x556741c90ec0 2024-09-13T19:16:36.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.906+0000 7f0815c0e800 1 -- 172.21.15.102:0/2606095668 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556741c94790 con 0x556741c90ec0 2024-09-13T19:16:36.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.907+0000 7f06f6ffd640 1 -- 172.21.15.102:0/2606095668 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f080c01f020 con 0x556741c90ec0 2024-09-13T19:16:36.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.907+0000 7f06f6ffd640 1 --2- 172.21.15.102:0/2606095668 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f06ec036b40 0x7f06ec039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:36.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.907+0000 7f06f6ffd640 1 -- 172.21.15.102:0/2606095668 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f080c04e3c0 con 0x556741c90ec0 2024-09-13T19:16:36.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.907+0000 7f081143b640 1 --2- 172.21.15.102:0/2606095668 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f06ec036b40 0x7f06ec039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:36.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.907+0000 7f0815c0e800 1 Processor -- start 2024-09-13T19:16:36.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.907+0000 7f0815c0e800 1 -- start start 2024-09-13T19:16:36.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.907+0000 7f081143b640 1 --2- 172.21.15.102:0/2606095668 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f06ec036b40 0x7f06ec039000 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0804073950 tx=0x7f0804059f90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:36.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.907+0000 7f0815c0e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556741c9dac0 0x556741c9dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:36.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.907+0000 7f0815c0e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556741c6ef30 con 0x556741c9dac0 2024-09-13T19:16:36.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.908+0000 7f0811c3c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556741c9dac0 0x556741c9dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:36.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.908+0000 7f0811c3c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556741c9dac0 0x556741c9dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55242/0 (socket says 172.21.15.102:55242) 2024-09-13T19:16:36.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.908+0000 7f0811c3c640 1 -- 172.21.15.102:0/1863584291 learned_addr learned my addr 172.21.15.102:0/1863584291 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:36.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.908+0000 7f0811c3c640 1 -- 172.21.15.102:0/1863584291 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556741c9e490 con 0x556741c9dac0 2024-09-13T19:16:36.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.908+0000 7f0811c3c640 1 --2- 172.21.15.102:0/1863584291 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556741c9dac0 0x556741c9dec0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f080c04c670 tx=0x7f080c029e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59edc09ea87d28 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:36.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.908+0000 7f06f4ff9640 1 -- 172.21.15.102:0/1863584291 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f080c04e070 con 0x556741c9dac0 2024-09-13T19:16:36.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.908+0000 7f06f4ff9640 1 -- 172.21.15.102:0/1863584291 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f080c029350 con 0x556741c9dac0 2024-09-13T19:16:36.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.908+0000 7f06f4ff9640 1 -- 172.21.15.102:0/1863584291 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f080c016b50 con 0x556741c9dac0 2024-09-13T19:16:36.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.909+0000 7f0815c0e800 1 -- 172.21.15.102:0/1863584291 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556741c9dac0 msgr2=0x556741c9dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:36.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.909+0000 7f0815c0e800 1 --2- 172.21.15.102:0/1863584291 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556741c9dac0 0x556741c9dec0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f080c04c670 tx=0x7f080c029e70 comp rx=0 tx=0).stop 2024-09-13T19:16:36.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.909+0000 7f0815c0e800 1 -- 172.21.15.102:0/1863584291 shutdown_connections 2024-09-13T19:16:36.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.909+0000 7f0815c0e800 1 --2- 172.21.15.102:0/1863584291 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556741c9dac0 0x556741c9dec0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:36.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.909+0000 7f0815c0e800 1 -- 172.21.15.102:0/1863584291 >> 172.21.15.102:0/1863584291 conn(0x556741c99e70 msgr2=0x556741c97f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:36.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.909+0000 7f0815c0e800 1 -- 172.21.15.102:0/1863584291 shutdown_connections 2024-09-13T19:16:36.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.909+0000 7f0815c0e800 1 -- 172.21.15.102:0/1863584291 wait complete. 2024-09-13T19:16:36.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.909+0000 7f0815c0e800 1 Processor -- start 2024-09-13T19:16:36.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.909+0000 7f0815c0e800 1 -- start start 2024-09-13T19:16:36.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.909+0000 7f0815c0e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556741c9dac0 0x556741ca4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:36.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.909+0000 7f0815c0e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556741c9ea60 con 0x556741c9dac0 2024-09-13T19:16:36.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.910+0000 7f0811c3c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556741c9dac0 0x556741ca4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:36.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.910+0000 7f0811c3c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556741c9dac0 0x556741ca4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55254/0 (socket says 172.21.15.102:55254) 2024-09-13T19:16:36.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.910+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 learned_addr learned my addr 172.21.15.102:0/2324875119 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:36.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.910+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556741ca5450 con 0x556741c9dac0 2024-09-13T19:16:36.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.910+0000 7f0811c3c640 1 --2- 172.21.15.102:0/2324875119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556741c9dac0 0x556741ca4f10 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f080c016fd0 tx=0x7f080c021f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:36.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.910+0000 7f06e2ffd640 1 -- 172.21.15.102:0/2324875119 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f080c021580 con 0x556741c9dac0 2024-09-13T19:16:36.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.910+0000 7f06e2ffd640 1 -- 172.21.15.102:0/2324875119 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f080c029500 con 0x556741c9dac0 2024-09-13T19:16:36.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.910+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556741ca56e0 con 0x556741c9dac0 2024-09-13T19:16:36.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.910+0000 7f06e2ffd640 1 -- 172.21.15.102:0/2324875119 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f080c020ba0 con 0x556741c9dac0 2024-09-13T19:16:36.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.910+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556741ca56e0 con 0x556741c9dac0 2024-09-13T19:16:36.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.911+0000 7f06e2ffd640 1 -- 172.21.15.102:0/2324875119 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f080c016040 con 0x556741c9dac0 2024-09-13T19:16:36.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.911+0000 7f06e2ffd640 1 --2- 172.21.15.102:0/2324875119 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f06dc036b40 0x7f06dc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:36.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.911+0000 7f06e2ffd640 1 -- 172.21.15.102:0/2324875119 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f080c02cdd0 con 0x556741c9dac0 2024-09-13T19:16:36.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.911+0000 7f081143b640 1 --2- 172.21.15.102:0/2324875119 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f06dc036b40 0x7f06dc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:36.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.912+0000 7f0815c0e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:36.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.912+0000 7f0815c0e800 1 --2- 172.21.15.102:0/2324875119 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x556741cb07c0 0x556741cb2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:36.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.912+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cb33d0 con 0x556741cb07c0 2024-09-13T19:16:36.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.912+0000 7f0810c3a640 1 --2- 172.21.15.102:0/2324875119 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x556741cb07c0 0x556741cb2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:36.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.912+0000 7f081143b640 1 --2- 172.21.15.102:0/2324875119 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f06dc036b40 0x7f06dc039000 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f080408f470 tx=0x7f0804095000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:36.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.912+0000 7f0810c3a640 1 --2- 172.21.15.102:0/2324875119 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x556741cb07c0 0x556741cb2c80 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:36.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.912+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07fc00f5f0 con 0x556741cb07c0 2024-09-13T19:16:36.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.912+0000 7f0815c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:36.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.912+0000 7f0815c0e800 20 realm 2024-09-13T19:16:36.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.912+0000 7f0815c0e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:36.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.912+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cafc10 con 0x556741cb07c0 2024-09-13T19:16:36.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.913+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07fc00f5f0 con 0x556741cb07c0 2024-09-13T19:16:36.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.913+0000 7f0815c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:36.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.913+0000 7f0815c0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:36.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.913+0000 7f0815c0e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:36.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.913+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cb3eb0 con 0x556741cb07c0 2024-09-13T19:16:36.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.913+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07fc00f5f0 con 0x556741cb07c0 2024-09-13T19:16:36.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.913+0000 7f0815c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:36.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.913+0000 7f0815c0e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:36.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.913+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cb4780 con 0x556741cb07c0 2024-09-13T19:16:36.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.913+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f07fc00f5f0 con 0x556741cb07c0 2024-09-13T19:16:36.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.913+0000 7f0815c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:36.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.913+0000 7f0815c0e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:36.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.913+0000 7f0815c0e800 1 --2- 172.21.15.102:0/2324875119 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x556741cb5080 0x556741cb7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:36.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.913+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cb7bf0 con 0x556741cb5080 2024-09-13T19:16:36.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.913+0000 7f0811c3c640 1 --2- 172.21.15.102:0/2324875119 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x556741cb5080 0x556741cb7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:36.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.913+0000 7f0811c3c640 1 --2- 172.21.15.102:0/2324875119 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x556741cb5080 0x556741cb7490 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:36.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.914+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:36.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.914+0000 7f0815c0e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:36.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.914+0000 7f0815c0e800 20 searching for the correct realm 2024-09-13T19:16:36.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.914+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556741cb95d0 con 0x556741cb5080 2024-09-13T19:16:36.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.914+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:36.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.914+0000 7f0811c3c640 1 --2- 172.21.15.102:0/2324875119 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f080c021020 0x7f080c04bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:36.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.914+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556741cb95d0 con 0x7f080c021020 2024-09-13T19:16:36.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.914+0000 7f081143b640 1 --2- 172.21.15.102:0/2324875119 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f080c021020 0x7f080c04bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:36.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.915+0000 7f081143b640 1 --2- 172.21.15.102:0/2324875119 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f080c021020 0x7f080c04bd80 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:36.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.915+0000 7f081143b640 1 -- 172.21.15.102:0/2324875119 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0804089050 con 0x7f080c021020 2024-09-13T19:16:36.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.915+0000 7f081143b640 1 --2- 172.21.15.102:0/2324875119 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f08040866d0 0x7f080407e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:36.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.915+0000 7f081143b640 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556741cb95d0 con 0x7f08040866d0 2024-09-13T19:16:36.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.915+0000 7f0810c3a640 1 --2- 172.21.15.102:0/2324875119 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f08040866d0 0x7f080407e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:36.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.915+0000 7f0810c3a640 1 --2- 172.21.15.102:0/2324875119 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f08040866d0 0x7f080407e590 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:36.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.916+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07fc00f5f0 con 0x7f08040866d0 2024-09-13T19:16:36.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.916+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556741cb95d0 con 0x556741cb07c0 2024-09-13T19:16:36.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.916+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07fc00f5f0 con 0x556741cb07c0 2024-09-13T19:16:36.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.916+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556741cb95d0 con 0x556741cb07c0 2024-09-13T19:16:36.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.916+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07fc02b040 con 0x556741cb07c0 2024-09-13T19:16:36.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.916+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556741cb95d0 con 0x7f08040866d0 2024-09-13T19:16:36.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.917+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07fc02b040 con 0x7f08040866d0 2024-09-13T19:16:36.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.917+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556741cb95d0 con 0x7f08040866d0 2024-09-13T19:16:36.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.917+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07fc02b040 con 0x7f08040866d0 2024-09-13T19:16:36.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.917+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556741cb95d0 con 0x7f080c021020 2024-09-13T19:16:36.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.918+0000 7f081143b640 1 -- 172.21.15.102:0/2324875119 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0804089050 con 0x7f080c021020 2024-09-13T19:16:36.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.918+0000 7f081143b640 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556741cb95d0 con 0x556741cb5080 2024-09-13T19:16:36.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.918+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:36.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.918+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556741cb95d0 con 0x556741cb07c0 2024-09-13T19:16:36.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.918+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07fc02b040 con 0x556741cb07c0 2024-09-13T19:16:36.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.918+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556741cb95d0 con 0x7f080c021020 2024-09-13T19:16:36.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.918+0000 7f081143b640 1 -- 172.21.15.102:0/2324875119 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0804089050 con 0x7f080c021020 2024-09-13T19:16:36.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.918+0000 7f081143b640 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556741cb95d0 con 0x556741cb07c0 2024-09-13T19:16:36.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.919+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07fc02b040 con 0x556741cb07c0 2024-09-13T19:16:36.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.919+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556741cb95d0 con 0x7f080c021020 2024-09-13T19:16:36.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.919+0000 7f081143b640 1 -- 172.21.15.102:0/2324875119 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0804089050 con 0x7f080c021020 2024-09-13T19:16:36.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.919+0000 7f081143b640 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556741cb95d0 con 0x556741cb5080 2024-09-13T19:16:36.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.919+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:36.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.919+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556741cb95d0 con 0x556741cb5080 2024-09-13T19:16:36.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.919+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:36.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.919+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556741cb95d0 con 0x7f08040866d0 2024-09-13T19:16:36.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.920+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07fc02b040 con 0x7f08040866d0 2024-09-13T19:16:36.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.920+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556741cb95d0 con 0x556741cb5080 2024-09-13T19:16:36.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.920+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:36.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.920+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556741cb95d0 con 0x556741cb5080 2024-09-13T19:16:36.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.920+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:36.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.920+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556741cb95d0 con 0x556741cb07c0 2024-09-13T19:16:36.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.920+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07fc02b040 con 0x556741cb07c0 2024-09-13T19:16:36.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.920+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556741cb95d0 con 0x556741cb07c0 2024-09-13T19:16:36.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.921+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f07fc02b040 con 0x556741cb07c0 2024-09-13T19:16:36.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.921+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556741cb95d0 con 0x7f08040866d0 2024-09-13T19:16:36.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.921+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07fc02b040 con 0x7f08040866d0 2024-09-13T19:16:36.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.921+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556741cb95d0 con 0x556741cb5080 2024-09-13T19:16:36.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.922+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:36.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.922+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556741cb95d0 con 0x7f080c021020 2024-09-13T19:16:36.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.922+0000 7f081143b640 1 -- 172.21.15.102:0/2324875119 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0804089050 con 0x7f080c021020 2024-09-13T19:16:36.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.922+0000 7f081143b640 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556741cb95d0 con 0x556741cb07c0 2024-09-13T19:16:36.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.922+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07fc02b040 con 0x556741cb07c0 2024-09-13T19:16:36.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.922+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556741cb95d0 con 0x7f080c021020 2024-09-13T19:16:36.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.922+0000 7f081143b640 1 -- 172.21.15.102:0/2324875119 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0804089050 con 0x7f080c021020 2024-09-13T19:16:36.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.922+0000 7f081143b640 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556741cb95d0 con 0x556741cb5080 2024-09-13T19:16:36.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.923+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:36.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.923+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556741cb95d0 con 0x7f08040866d0 2024-09-13T19:16:36.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.923+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07fc02b040 con 0x7f08040866d0 2024-09-13T19:16:36.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.923+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556741cb95d0 con 0x7f080c021020 2024-09-13T19:16:36.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.923+0000 7f081143b640 1 -- 172.21.15.102:0/2324875119 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0804089050 con 0x7f080c021020 2024-09-13T19:16:36.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.923+0000 7f081143b640 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556741cb95d0 con 0x556741cb5080 2024-09-13T19:16:36.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.924+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:36.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.924+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556741cb95d0 con 0x7f08040866d0 2024-09-13T19:16:36.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.924+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07fc02b040 con 0x7f08040866d0 2024-09-13T19:16:36.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.924+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556741cb95d0 con 0x556741cb07c0 2024-09-13T19:16:36.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.924+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f07fc02b040 con 0x556741cb07c0 2024-09-13T19:16:36.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.924+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556741cb95d0 con 0x7f080c021020 2024-09-13T19:16:36.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.925+0000 7f081143b640 1 -- 172.21.15.102:0/2324875119 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0804089050 con 0x7f080c021020 2024-09-13T19:16:36.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.925+0000 7f0815c0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:36.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.925+0000 7f0815c0e800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:36.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.925+0000 7f0815c0e800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:36.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.925+0000 7f0815c0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:36.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.925+0000 7f0815c0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:36.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.925+0000 7f0815c0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:36.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.925+0000 7f0815c0e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:36.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.925+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cb86a0 con 0x556741cb07c0 2024-09-13T19:16:36.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.925+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07fc02b040 con 0x556741cb07c0 2024-09-13T19:16:36.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.925+0000 7f0815c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:36.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.925+0000 7f0815c0e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:36.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.925+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cb82e0 con 0x556741cb07c0 2024-09-13T19:16:36.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.925+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f07fc02b040 con 0x556741cb07c0 2024-09-13T19:16:36.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.925+0000 7f0815c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:36.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.925+0000 7f0815c0e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:36.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.925+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cb9000 con 0x556741cb5080 2024-09-13T19:16:36.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.925+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:36.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.925+0000 7f0815c0e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:36.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.925+0000 7f0815c0e800 20 zone default found 2024-09-13T19:16:36.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.925+0000 7f0815c0e800 4 Realm: () 2024-09-13T19:16:36.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.925+0000 7f0815c0e800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:36.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.925+0000 7f0815c0e800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:36.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.925+0000 7f0815c0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:36.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.925+0000 7f0815c0e800 20 zonegroup default 2024-09-13T19:16:36.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.925+0000 7f0815c0e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:36.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.925+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cb9f50 con 0x7f080c021020 2024-09-13T19:16:36.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.926+0000 7f081143b640 1 -- 172.21.15.102:0/2324875119 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0804089050 con 0x7f080c021020 2024-09-13T19:16:36.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.926+0000 7f0815c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:36.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.926+0000 7f0815c0e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:36.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.926+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cbbd30 con 0x556741cb5080 2024-09-13T19:16:36.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.926+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:36.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.926+0000 7f0815c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:36.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.926+0000 7f0815c0e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:36.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.926+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cbc170 con 0x556741cb5080 2024-09-13T19:16:36.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.926+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:36.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.926+0000 7f0815c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:36.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.926+0000 7f0815c0e800 20 started sync module instance, tier type = 2024-09-13T19:16:36.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.926+0000 7f0815c0e800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:36.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.926+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741cbb170 con 0x7f080c021020 2024-09-13T19:16:36.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.927+0000 7f081143b640 1 -- 172.21.15.102:0/2324875119 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(44 notify.0 [create] v36'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0804089050 con 0x7f080c021020 2024-09-13T19:16:36.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.927+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93901973859520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741cbc600 con 0x7f080c021020 2024-09-13T19:16:36.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.927+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741cbce50 con 0x556741cb07c0 2024-09-13T19:16:36.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.928+0000 7f081143b640 1 -- 172.21.15.102:0/2324875119 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93901973859520] v36'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0804089050 con 0x7f080c021020 2024-09-13T19:16:36.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.929+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v36'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07fc02b040 con 0x556741cb07c0 2024-09-13T19:16:36.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.929+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93901973866912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741cbd290 con 0x556741cb07c0 2024-09-13T19:16:36.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.929+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741cbddb0 con 0x556741cb5080 2024-09-13T19:16:36.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.930+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93901973866912] v36'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07fc02b040 con 0x556741cb07c0 2024-09-13T19:16:36.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.930+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v36'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:36.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.930+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93901973870720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741cbdd70 con 0x556741cb5080 2024-09-13T19:16:36.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.930+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741cbe890 con 0x7f080c021020 2024-09-13T19:16:36.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.931+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93901973870720] v36'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:36.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.931+0000 7f081143b640 1 -- 172.21.15.102:0/2324875119 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(50 notify.3 [create] v36'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0804089050 con 0x7f080c021020 2024-09-13T19:16:36.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.931+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93901973873568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741cbec80 con 0x7f080c021020 2024-09-13T19:16:36.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.931+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741cbf6b0 con 0x556741cb07c0 2024-09-13T19:16:36.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.932+0000 7f081143b640 1 -- 172.21.15.102:0/2324875119 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93901973873568] v36'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0804089050 con 0x7f080c021020 2024-09-13T19:16:36.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.933+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v36'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07fc02b040 con 0x556741cb07c0 2024-09-13T19:16:36.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.933+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93901973877184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741cbf6b0 con 0x556741cb07c0 2024-09-13T19:16:36.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.933+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741cc0150 con 0x7f08040866d0 2024-09-13T19:16:36.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.934+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(54 notify.5 [create] v36'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07fc02b040 con 0x7f08040866d0 2024-09-13T19:16:36.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.934+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93901973879872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741cc0110 con 0x7f08040866d0 2024-09-13T19:16:36.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.934+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741cc10c0 con 0x7f08040866d0 2024-09-13T19:16:36.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.934+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93901973877184] v36'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07fc02b040 con 0x556741cb07c0 2024-09-13T19:16:36.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.935+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 93901973879872] v36'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07fc02b040 con 0x7f08040866d0 2024-09-13T19:16:36.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.935+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(56 notify.6 [create] v36'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07fc02b040 con 0x7f08040866d0 2024-09-13T19:16:36.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.935+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93901973882224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741cbb560 con 0x7f08040866d0 2024-09-13T19:16:36.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.935+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741cc1570 con 0x7f08040866d0 2024-09-13T19:16:36.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.938+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(58 notify.7 [create] v36'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07fc02b040 con 0x7f08040866d0 2024-09-13T19:16:36.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.938+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93901973885056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741cc1990 con 0x7f08040866d0 2024-09-13T19:16:36.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.938+0000 7f0815c0e800 20 add_watcher() i=0 2024-09-13T19:16:36.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.938+0000 7f0815c0e800 20 add_watcher() i=1 2024-09-13T19:16:36.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.938+0000 7f0815c0e800 20 add_watcher() i=2 2024-09-13T19:16:36.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.938+0000 7f0815c0e800 20 add_watcher() i=3 2024-09-13T19:16:36.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.938+0000 7f0815c0e800 20 add_watcher() i=4 2024-09-13T19:16:36.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.938+0000 7f0815c0e800 20 add_watcher() i=5 2024-09-13T19:16:36.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.938+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 93901973882224] v36'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07fc02b040 con 0x7f08040866d0 2024-09-13T19:16:36.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.938+0000 7f0815c0e800 20 add_watcher() i=6 2024-09-13T19:16:36.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.939+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 93901973885056] v36'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07fc02b040 con 0x7f08040866d0 2024-09-13T19:16:36.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.939+0000 7f0815c0e800 20 add_watcher() i=7 2024-09-13T19:16:36.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.939+0000 7f0815c0e800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:36.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.939+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cc0b90 con 0x556741cb07c0 2024-09-13T19:16:36.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.940+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f07fc02b040 con 0x556741cb07c0 2024-09-13T19:16:36.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.940+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93901973886112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741cc0b90 con 0x556741cb07c0 2024-09-13T19:16:36.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.941+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93901973886112] v36'152 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f07fc02b040 con 0x556741cb07c0 2024-09-13T19:16:36.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.941+0000 7f06c77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:36.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.941+0000 7f0815c0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:36.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.941+0000 7f0815c0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:36.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.941+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741ccd1b0 con 0x556741cb07c0 2024-09-13T19:16:36.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.942+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v36'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f07fc02b040 con 0x556741cb07c0 2024-09-13T19:16:36.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.942+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741ccd770 con 0x7f08040866d0 2024-09-13T19:16:36.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.943+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v36'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f07fc02b040 con 0x7f08040866d0 2024-09-13T19:16:36.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.943+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741ccdb70 con 0x556741cb5080 2024-09-13T19:16:36.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.945+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v36'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:36.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.945+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741ccdaa0 con 0x556741cb07c0 2024-09-13T19:16:36.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.946+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v36'153 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f07fc02b040 con 0x556741cb07c0 2024-09-13T19:16:36.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.946+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741cce0b0 con 0x7f080c021020 2024-09-13T19:16:36.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.947+0000 7f081143b640 1 -- 172.21.15.102:0/2324875119 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v36'45 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0804089050 con 0x7f080c021020 2024-09-13T19:16:36.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.947+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741cce560 con 0x556741cb5080 2024-09-13T19:16:36.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.948+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v36'30 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:36.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.948+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741cce5f0 con 0x556741cb07c0 2024-09-13T19:16:36.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.949+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v36'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f07fc02b040 con 0x556741cb07c0 2024-09-13T19:16:36.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.949+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741cce5f0 con 0x7f08040866d0 2024-09-13T19:16:36.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.950+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(69 gc.7 [create,call,call,call] v36'29 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f07fc02b040 con 0x7f08040866d0 2024-09-13T19:16:36.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.950+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741cce5f0 con 0x7f080c021020 2024-09-13T19:16:36.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.951+0000 7f081143b640 1 -- 172.21.15.102:0/2324875119 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v36'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0804089050 con 0x7f080c021020 2024-09-13T19:16:36.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.951+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741cceaa0 con 0x556741cb5080 2024-09-13T19:16:36.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.952+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v36'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:36.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.952+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741cceaa0 con 0x7f080c021020 2024-09-13T19:16:36.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.953+0000 7f081143b640 1 -- 172.21.15.102:0/2324875119 <== osd.2 v2:172.21.15.102:6816/2238176080 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v36'46 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0804089050 con 0x7f080c021020 2024-09-13T19:16:36.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.953+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741cceaa0 con 0x7f08040866d0 2024-09-13T19:16:36.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.954+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v36'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07fc02b040 con 0x7f08040866d0 2024-09-13T19:16:36.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.954+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741cce9a0 con 0x7f080c021020 2024-09-13T19:16:36.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.955+0000 7f081143b640 1 -- 172.21.15.102:0/2324875119 <== osd.2 v2:172.21.15.102:6816/2238176080 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v36'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0804089050 con 0x7f080c021020 2024-09-13T19:16:36.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.955+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741cce9a0 con 0x7f08040866d0 2024-09-13T19:16:36.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.956+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(75 gc.13 [create,call,call,call] v36'35 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07fc02b040 con 0x7f08040866d0 2024-09-13T19:16:36.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.956+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741cce9a0 con 0x556741cb07c0 2024-09-13T19:16:36.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.957+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v36'154 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07fc02b040 con 0x556741cb07c0 2024-09-13T19:16:36.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.957+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741cce9a0 con 0x556741cb5080 2024-09-13T19:16:36.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.958+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v36'38 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:36.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.959+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741cce9a0 con 0x7f080c021020 2024-09-13T19:16:36.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.959+0000 7f081143b640 1 -- 172.21.15.102:0/2324875119 <== osd.2 v2:172.21.15.102:6816/2238176080 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v36'47 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0804089050 con 0x7f080c021020 2024-09-13T19:16:36.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.959+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741cce9a0 con 0x556741cb5080 2024-09-13T19:16:36.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.960+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v36'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:36.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.960+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741cce9a0 con 0x556741cb07c0 2024-09-13T19:16:36.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.961+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v36'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07fc02b040 con 0x556741cb07c0 2024-09-13T19:16:36.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.962+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741cce9a0 con 0x556741cb07c0 2024-09-13T19:16:36.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.962+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v36'155 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07fc02b040 con 0x556741cb07c0 2024-09-13T19:16:36.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.962+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741cce9a0 con 0x556741cb5080 2024-09-13T19:16:36.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.964+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v36'39 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:36.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.964+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741cce9a0 con 0x7f080c021020 2024-09-13T19:16:36.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.964+0000 7f081143b640 1 -- 172.21.15.102:0/2324875119 <== osd.2 v2:172.21.15.102:6816/2238176080 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v36'28 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0804089050 con 0x7f080c021020 2024-09-13T19:16:36.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.965+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741cce9a0 con 0x556741cb5080 2024-09-13T19:16:36.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.965+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v36'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:36.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.966+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741ccea30 con 0x556741cb5080 2024-09-13T19:16:36.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.966+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v36'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:36.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.966+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741ccea30 con 0x556741cb5080 2024-09-13T19:16:36.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.967+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v36'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:36.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.967+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741ccea30 con 0x556741cb5080 2024-09-13T19:16:36.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.968+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v36'31 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:36.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.968+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741ccea30 con 0x7f08040866d0 2024-09-13T19:16:36.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.969+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(88 gc.26 [create,call,call,call] v36'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07fc02b040 con 0x7f08040866d0 2024-09-13T19:16:36.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.969+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741ccea30 con 0x556741cb5080 2024-09-13T19:16:36.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.970+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v36'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:36.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.970+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741ccea30 con 0x7f08040866d0 2024-09-13T19:16:36.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.971+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(90 gc.28 [create,call,call,call] v36'30 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07fc02b040 con 0x7f08040866d0 2024-09-13T19:16:36.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.972+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741ccea30 con 0x556741cb5080 2024-09-13T19:16:36.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.973+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v36'40 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:36.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.973+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741ccea60 con 0x7f08040866d0 2024-09-13T19:16:36.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.974+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.0 v2:172.21.15.53:6800/4021716951 20 ==== osd_op_reply(92 gc.30 [create,call,call,call] v36'36 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07fc02b040 con 0x7f08040866d0 2024-09-13T19:16:36.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.974+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741ccea60 con 0x7f080c021020 2024-09-13T19:16:36.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.975+0000 7f081143b640 1 -- 172.21.15.102:0/2324875119 <== osd.2 v2:172.21.15.102:6816/2238176080 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v36'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0804089050 con 0x7f080c021020 2024-09-13T19:16:36.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.976+0000 7f06c67e4640 20 reqs_thread_entry: start 2024-09-13T19:16:36.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.976+0000 7f0815c0e800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:36.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.976+0000 7f0815c0e800 20 Filter name: none 2024-09-13T19:16:36.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.976+0000 7f0637fff640 20 reqs_thread_entry: start 2024-09-13T19:16:36.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.976+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cc9490 con 0x556741cb07c0 2024-09-13T19:16:36.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.976+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f07fc02b040 con 0x556741cb07c0 2024-09-13T19:16:36.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.976+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cc9490 con 0x556741cb07c0 2024-09-13T19:16:36.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.976+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.1 v2:172.21.15.102:6808/2204418452 28 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f07fc02b040 con 0x556741cb07c0 2024-09-13T19:16:36.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.976+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cc9490 con 0x556741cb07c0 2024-09-13T19:16:36.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.977+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.1 v2:172.21.15.102:6808/2204418452 29 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f07fc02b040 con 0x556741cb07c0 2024-09-13T19:16:36.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.977+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cc9490 con 0x7f08040866d0 2024-09-13T19:16:36.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.977+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.0 v2:172.21.15.53:6800/4021716951 21 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f07fc02b040 con 0x7f08040866d0 2024-09-13T19:16:36.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.977+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cc9490 con 0x7f08040866d0 2024-09-13T19:16:36.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.977+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.0 v2:172.21.15.53:6800/4021716951 22 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv9 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f07fc02b040 con 0x7f08040866d0 2024-09-13T19:16:36.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.977+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cc9490 con 0x7f08040866d0 2024-09-13T19:16:36.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.978+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.0 v2:172.21.15.53:6800/4021716951 23 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f07fc02b040 con 0x7f08040866d0 2024-09-13T19:16:36.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.978+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cc9490 con 0x556741cb5080 2024-09-13T19:16:36.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.978+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 28 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:36.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.978+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cc9490 con 0x556741cb5080 2024-09-13T19:16:36.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.978+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 29 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:36.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.978+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cc9490 con 0x556741cb5080 2024-09-13T19:16:36.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.978+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 30 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:36.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.978+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cc9490 con 0x556741cb07c0 2024-09-13T19:16:36.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.979+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.1 v2:172.21.15.102:6808/2204418452 30 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv15 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f07fc02b040 con 0x556741cb07c0 2024-09-13T19:16:36.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.979+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cc9490 con 0x556741cb07c0 2024-09-13T19:16:36.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.979+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.1 v2:172.21.15.102:6808/2204418452 31 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv15 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f07fc02b040 con 0x556741cb07c0 2024-09-13T19:16:36.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.979+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cc9490 con 0x556741cb07c0 2024-09-13T19:16:36.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.979+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.1 v2:172.21.15.102:6808/2204418452 32 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv15 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f07fc02b040 con 0x556741cb07c0 2024-09-13T19:16:36.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.979+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cc9490 con 0x7f080c021020 2024-09-13T19:16:36.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.979+0000 7f081143b640 1 -- 172.21.15.102:0/2324875119 <== osd.2 v2:172.21.15.102:6816/2238176080 21 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv13 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0804089050 con 0x7f080c021020 2024-09-13T19:16:36.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.979+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cc9490 con 0x7f080c021020 2024-09-13T19:16:36.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.980+0000 7f081143b640 1 -- 172.21.15.102:0/2324875119 <== osd.2 v2:172.21.15.102:6816/2238176080 22 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv13 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f0804089050 con 0x7f080c021020 2024-09-13T19:16:36.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.980+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cc9490 con 0x7f080c021020 2024-09-13T19:16:36.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.980+0000 7f081143b640 1 -- 172.21.15.102:0/2324875119 <== osd.2 v2:172.21.15.102:6816/2238176080 23 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv13 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0804089050 con 0x7f080c021020 2024-09-13T19:16:36.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.980+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cc9490 con 0x556741cb5080 2024-09-13T19:16:36.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.980+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 31 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:36.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.980+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cc9490 con 0x556741cb5080 2024-09-13T19:16:36.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.980+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 32 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv4 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:36.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.980+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cc9490 con 0x556741cb5080 2024-09-13T19:16:36.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.981+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 33 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:36.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.981+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cc9490 con 0x556741cb07c0 2024-09-13T19:16:36.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.981+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.1 v2:172.21.15.102:6808/2204418452 33 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f07fc02b040 con 0x556741cb07c0 2024-09-13T19:16:36.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.981+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cc9490 con 0x556741cb07c0 2024-09-13T19:16:36.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.981+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.1 v2:172.21.15.102:6808/2204418452 34 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f07fc02b040 con 0x556741cb07c0 2024-09-13T19:16:36.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.981+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cc9490 con 0x556741cb07c0 2024-09-13T19:16:36.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.981+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.1 v2:172.21.15.102:6808/2204418452 35 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f07fc02b040 con 0x556741cb07c0 2024-09-13T19:16:36.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.981+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cc9490 con 0x7f08040866d0 2024-09-13T19:16:37.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.982+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.0 v2:172.21.15.53:6800/4021716951 24 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f07fc02b040 con 0x7f08040866d0 2024-09-13T19:16:37.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.982+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cc9490 con 0x7f08040866d0 2024-09-13T19:16:37.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.982+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.0 v2:172.21.15.53:6800/4021716951 25 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv4 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f07fc02b040 con 0x7f08040866d0 2024-09-13T19:16:37.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.982+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cc9490 con 0x7f08040866d0 2024-09-13T19:16:37.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.982+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.0 v2:172.21.15.53:6800/4021716951 26 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f07fc02b040 con 0x7f08040866d0 2024-09-13T19:16:37.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.982+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cc9490 con 0x7f080c021020 2024-09-13T19:16:37.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.982+0000 7f081143b640 1 -- 172.21.15.102:0/2324875119 <== osd.2 v2:172.21.15.102:6816/2238176080 24 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0804089050 con 0x7f080c021020 2024-09-13T19:16:37.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.982+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cc9490 con 0x7f080c021020 2024-09-13T19:16:37.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.983+0000 7f081143b640 1 -- 172.21.15.102:0/2324875119 <== osd.2 v2:172.21.15.102:6816/2238176080 25 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f0804089050 con 0x7f080c021020 2024-09-13T19:16:37.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.983+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cc9490 con 0x7f080c021020 2024-09-13T19:16:37.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.983+0000 7f081143b640 1 -- 172.21.15.102:0/2324875119 <== osd.2 v2:172.21.15.102:6816/2238176080 26 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0804089050 con 0x7f080c021020 2024-09-13T19:16:37.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.983+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cc9490 con 0x556741cb5080 2024-09-13T19:16:37.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.983+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 34 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:37.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.983+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cc9490 con 0x556741cb5080 2024-09-13T19:16:37.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.983+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 35 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:37.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.983+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cc9490 con 0x556741cb5080 2024-09-13T19:16:37.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.984+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 36 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:37.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.984+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cc9490 con 0x7f080c021020 2024-09-13T19:16:37.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.984+0000 7f081143b640 1 -- 172.21.15.102:0/2324875119 <== osd.2 v2:172.21.15.102:6816/2238176080 27 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0804089050 con 0x7f080c021020 2024-09-13T19:16:37.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.984+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cc9490 con 0x7f080c021020 2024-09-13T19:16:37.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.984+0000 7f081143b640 1 -- 172.21.15.102:0/2324875119 <== osd.2 v2:172.21.15.102:6816/2238176080 28 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0804089050 con 0x7f080c021020 2024-09-13T19:16:37.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.984+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cc9490 con 0x7f080c021020 2024-09-13T19:16:37.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.984+0000 7f081143b640 1 -- 172.21.15.102:0/2324875119 <== osd.2 v2:172.21.15.102:6816/2238176080 29 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0804089050 con 0x7f080c021020 2024-09-13T19:16:37.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.984+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cc9490 con 0x7f08040866d0 2024-09-13T19:16:37.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.985+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.0 v2:172.21.15.53:6800/4021716951 27 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f07fc02b040 con 0x7f08040866d0 2024-09-13T19:16:37.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.985+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cc9490 con 0x7f08040866d0 2024-09-13T19:16:37.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.985+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.0 v2:172.21.15.53:6800/4021716951 28 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f07fc02b040 con 0x7f08040866d0 2024-09-13T19:16:37.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.985+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cc9490 con 0x7f08040866d0 2024-09-13T19:16:37.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.985+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.0 v2:172.21.15.53:6800/4021716951 29 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f07fc02b040 con 0x7f08040866d0 2024-09-13T19:16:37.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.985+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cc9490 con 0x7f080c021020 2024-09-13T19:16:37.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.986+0000 7f081143b640 1 -- 172.21.15.102:0/2324875119 <== osd.2 v2:172.21.15.102:6816/2238176080 30 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0804089050 con 0x7f080c021020 2024-09-13T19:16:37.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.986+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cc9490 con 0x7f080c021020 2024-09-13T19:16:37.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.986+0000 7f081143b640 1 -- 172.21.15.102:0/2324875119 <== osd.2 v2:172.21.15.102:6816/2238176080 31 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0804089050 con 0x7f080c021020 2024-09-13T19:16:37.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.986+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cc9490 con 0x7f080c021020 2024-09-13T19:16:37.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.986+0000 7f081143b640 1 -- 172.21.15.102:0/2324875119 <== osd.2 v2:172.21.15.102:6816/2238176080 32 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0804089050 con 0x7f080c021020 2024-09-13T19:16:37.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.986+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cc9490 con 0x7f08040866d0 2024-09-13T19:16:37.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.987+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.0 v2:172.21.15.53:6800/4021716951 30 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f07fc02b040 con 0x7f08040866d0 2024-09-13T19:16:37.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.987+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cc9490 con 0x7f08040866d0 2024-09-13T19:16:37.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.987+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.0 v2:172.21.15.53:6800/4021716951 31 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv6 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f07fc02b040 con 0x7f08040866d0 2024-09-13T19:16:37.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.987+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cc9490 con 0x7f08040866d0 2024-09-13T19:16:37.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.987+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.0 v2:172.21.15.53:6800/4021716951 32 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f07fc02b040 con 0x7f08040866d0 2024-09-13T19:16:37.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.987+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cc9490 con 0x556741cb07c0 2024-09-13T19:16:37.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.988+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.1 v2:172.21.15.102:6808/2204418452 36 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f07fc02b040 con 0x556741cb07c0 2024-09-13T19:16:37.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.988+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cc9490 con 0x556741cb07c0 2024-09-13T19:16:37.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.988+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.1 v2:172.21.15.102:6808/2204418452 37 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f07fc02b040 con 0x556741cb07c0 2024-09-13T19:16:37.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.988+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cc9490 con 0x556741cb07c0 2024-09-13T19:16:37.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.988+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.1 v2:172.21.15.102:6808/2204418452 38 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f07fc02b040 con 0x556741cb07c0 2024-09-13T19:16:37.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.988+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cc9490 con 0x556741cb5080 2024-09-13T19:16:37.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.988+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 37 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:37.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.988+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cc9490 con 0x556741cb5080 2024-09-13T19:16:37.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.989+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 38 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:37.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.989+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cc9490 con 0x556741cb5080 2024-09-13T19:16:37.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.989+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 39 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:37.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.989+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cc9490 con 0x7f080c021020 2024-09-13T19:16:37.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.989+0000 7f081143b640 1 -- 172.21.15.102:0/2324875119 <== osd.2 v2:172.21.15.102:6816/2238176080 33 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0804089050 con 0x7f080c021020 2024-09-13T19:16:37.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.989+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cc9490 con 0x7f080c021020 2024-09-13T19:16:37.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.989+0000 7f081143b640 1 -- 172.21.15.102:0/2324875119 <== osd.2 v2:172.21.15.102:6816/2238176080 34 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv44 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0804089050 con 0x7f080c021020 2024-09-13T19:16:37.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.989+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cc9490 con 0x7f080c021020 2024-09-13T19:16:37.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.990+0000 7f081143b640 1 -- 172.21.15.102:0/2324875119 <== osd.2 v2:172.21.15.102:6816/2238176080 35 ==== osd_op_reply(144 gc.16 [call out=1701b] v0'0 uv44 ondisk = 0) ==== 149+0+1701 (crc 0 0 0) 0x7f0804089050 con 0x7f080c021020 2024-09-13T19:16:37.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.990+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cfaba0 con 0x556741cb5080 2024-09-13T19:16:37.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.990+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 40 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:37.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.990+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cf9b90 con 0x556741cb5080 2024-09-13T19:16:37.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.990+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 41 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:37.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.990+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cfaba0 con 0x556741cb5080 2024-09-13T19:16:37.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.990+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 42 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:37.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.991+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cfaba0 con 0x556741cb07c0 2024-09-13T19:16:37.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.991+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.1 v2:172.21.15.102:6808/2204418452 39 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f07fc02b040 con 0x556741cb07c0 2024-09-13T19:16:37.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.991+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cf9b90 con 0x556741cb07c0 2024-09-13T19:16:37.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.991+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.1 v2:172.21.15.102:6808/2204418452 40 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f07fc02b040 con 0x556741cb07c0 2024-09-13T19:16:37.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.991+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cfaba0 con 0x556741cb07c0 2024-09-13T19:16:37.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.991+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.1 v2:172.21.15.102:6808/2204418452 41 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f07fc02b040 con 0x556741cb07c0 2024-09-13T19:16:37.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.991+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cfaba0 con 0x556741cb07c0 2024-09-13T19:16:37.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.991+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.1 v2:172.21.15.102:6808/2204418452 42 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f07fc02b040 con 0x556741cb07c0 2024-09-13T19:16:37.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.991+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cf9b90 con 0x556741cb07c0 2024-09-13T19:16:37.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.992+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.1 v2:172.21.15.102:6808/2204418452 43 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f07fc02b040 con 0x556741cb07c0 2024-09-13T19:16:37.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.992+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cfaba0 con 0x556741cb07c0 2024-09-13T19:16:37.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.992+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.1 v2:172.21.15.102:6808/2204418452 44 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f07fc02b040 con 0x556741cb07c0 2024-09-13T19:16:37.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.992+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cfaba0 con 0x556741cb5080 2024-09-13T19:16:37.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.992+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 43 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:37.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.992+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cf9b90 con 0x556741cb5080 2024-09-13T19:16:37.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.992+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 44 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:37.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.993+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cfaba0 con 0x556741cb5080 2024-09-13T19:16:37.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.993+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 45 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:37.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.993+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cfaba0 con 0x7f080c021020 2024-09-13T19:16:37.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.993+0000 7f081143b640 1 -- 172.21.15.102:0/2324875119 <== osd.2 v2:172.21.15.102:6816/2238176080 36 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0804089050 con 0x7f080c021020 2024-09-13T19:16:37.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.993+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cf9b90 con 0x7f080c021020 2024-09-13T19:16:37.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.993+0000 7f081143b640 1 -- 172.21.15.102:0/2324875119 <== osd.2 v2:172.21.15.102:6816/2238176080 37 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0804089050 con 0x7f080c021020 2024-09-13T19:16:37.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.993+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cfaba0 con 0x7f080c021020 2024-09-13T19:16:37.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.994+0000 7f081143b640 1 -- 172.21.15.102:0/2324875119 <== osd.2 v2:172.21.15.102:6816/2238176080 38 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0804089050 con 0x7f080c021020 2024-09-13T19:16:37.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.994+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cfaba0 con 0x556741cb5080 2024-09-13T19:16:37.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.994+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 46 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:37.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.994+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cf9b90 con 0x556741cb5080 2024-09-13T19:16:37.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.994+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 47 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:37.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.994+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cfaba0 con 0x556741cb5080 2024-09-13T19:16:37.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.994+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 48 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:37.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.994+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cfaba0 con 0x556741cb5080 2024-09-13T19:16:37.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.995+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 49 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:37.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.995+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cf9b90 con 0x556741cb5080 2024-09-13T19:16:37.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.995+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 50 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:37.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.995+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cfaba0 con 0x556741cb5080 2024-09-13T19:16:37.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.995+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 51 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:37.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.995+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cfaba0 con 0x556741cb5080 2024-09-13T19:16:37.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.995+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 52 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:37.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.995+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cf9b90 con 0x556741cb5080 2024-09-13T19:16:37.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.995+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 53 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:37.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.995+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cfaba0 con 0x556741cb5080 2024-09-13T19:16:37.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.996+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 54 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:37.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.996+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cfaba0 con 0x556741cb5080 2024-09-13T19:16:37.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.996+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 55 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv8 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:37.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.996+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cf9b90 con 0x556741cb5080 2024-09-13T19:16:37.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.996+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 56 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv8 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:37.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.996+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cfaba0 con 0x556741cb5080 2024-09-13T19:16:37.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.996+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 57 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv8 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:37.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.996+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cfaba0 con 0x7f08040866d0 2024-09-13T19:16:37.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.997+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.0 v2:172.21.15.53:6800/4021716951 33 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f07fc02b040 con 0x7f08040866d0 2024-09-13T19:16:37.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.997+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cf9b90 con 0x7f08040866d0 2024-09-13T19:16:37.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.997+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.0 v2:172.21.15.53:6800/4021716951 34 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f07fc02b040 con 0x7f08040866d0 2024-09-13T19:16:37.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.997+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cfaba0 con 0x7f08040866d0 2024-09-13T19:16:37.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.998+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.0 v2:172.21.15.53:6800/4021716951 35 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f07fc02b040 con 0x7f08040866d0 2024-09-13T19:16:37.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.998+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cfaba0 con 0x556741cb5080 2024-09-13T19:16:37.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.998+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 58 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:37.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.998+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cf9b90 con 0x556741cb5080 2024-09-13T19:16:37.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.998+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 59 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:37.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.998+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cfaba0 con 0x556741cb5080 2024-09-13T19:16:37.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.998+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 60 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:37.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.998+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cfaba0 con 0x7f08040866d0 2024-09-13T19:16:37.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.999+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.0 v2:172.21.15.53:6800/4021716951 36 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv8 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f07fc02b040 con 0x7f08040866d0 2024-09-13T19:16:37.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.999+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cf9b90 con 0x7f08040866d0 2024-09-13T19:16:37.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.999+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.0 v2:172.21.15.53:6800/4021716951 37 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv8 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f07fc02b040 con 0x7f08040866d0 2024-09-13T19:16:37.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:36.999+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cfaba0 con 0x7f08040866d0 2024-09-13T19:16:37.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.000+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.0 v2:172.21.15.53:6800/4021716951 38 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv8 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f07fc02b040 con 0x7f08040866d0 2024-09-13T19:16:37.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.000+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cfaba0 con 0x556741cb5080 2024-09-13T19:16:37.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.000+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 61 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:37.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.000+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cf9b90 con 0x556741cb5080 2024-09-13T19:16:37.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.000+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 62 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:37.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.000+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cfaba0 con 0x556741cb5080 2024-09-13T19:16:37.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.000+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 63 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:37.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.000+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cfaba0 con 0x7f08040866d0 2024-09-13T19:16:37.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.001+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.0 v2:172.21.15.53:6800/4021716951 39 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f07fc02b040 con 0x7f08040866d0 2024-09-13T19:16:37.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.001+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cf9b90 con 0x7f08040866d0 2024-09-13T19:16:37.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.001+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.0 v2:172.21.15.53:6800/4021716951 40 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv12 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f07fc02b040 con 0x7f08040866d0 2024-09-13T19:16:37.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.001+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cfaba0 con 0x7f08040866d0 2024-09-13T19:16:37.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.002+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.0 v2:172.21.15.53:6800/4021716951 41 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f07fc02b040 con 0x7f08040866d0 2024-09-13T19:16:37.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.002+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cfaba0 con 0x7f080c021020 2024-09-13T19:16:37.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.002+0000 7f081143b640 1 -- 172.21.15.102:0/2324875119 <== osd.2 v2:172.21.15.102:6816/2238176080 39 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0804089050 con 0x7f080c021020 2024-09-13T19:16:37.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.002+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cf9b90 con 0x7f080c021020 2024-09-13T19:16:37.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.002+0000 7f081143b640 1 -- 172.21.15.102:0/2324875119 <== osd.2 v2:172.21.15.102:6816/2238176080 40 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0804089050 con 0x7f080c021020 2024-09-13T19:16:37.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.002+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556741cfaba0 con 0x7f080c021020 2024-09-13T19:16:37.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.002+0000 7f081143b640 1 -- 172.21.15.102:0/2324875119 <== osd.2 v2:172.21.15.102:6816/2238176080 41 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0804089050 con 0x7f080c021020 2024-09-13T19:16:37.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.003+0000 7f06c77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:37.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.003+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93901973886112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741cc8b60 con 0x556741cb07c0 2024-09-13T19:16:37.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.004+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.1 v2:172.21.15.102:6808/2204418452 45 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 93901973886112] v36'156 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f07fc02b040 con 0x556741cb07c0 2024-09-13T19:16:37.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.004+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93901973859520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741cc14a0 con 0x7f080c021020 2024-09-13T19:16:37.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.005+0000 7f081143b640 1 -- 172.21.15.102:0/2324875119 <== osd.2 v2:172.21.15.102:6816/2238176080 42 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 93901973859520] v36'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0804089050 con 0x7f080c021020 2024-09-13T19:16:37.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.005+0000 7f0815c0e800 20 remove_watcher() i=0 2024-09-13T19:16:37.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.005+0000 7f0815c0e800 2 removed watcher, disabling cache 2024-09-13T19:16:37.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.005+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93901973866912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741cc14a0 con 0x556741cb07c0 2024-09-13T19:16:37.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.007+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.1 v2:172.21.15.102:6808/2204418452 46 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 93901973866912] v36'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07fc02b040 con 0x556741cb07c0 2024-09-13T19:16:37.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.007+0000 7f0815c0e800 20 remove_watcher() i=1 2024-09-13T19:16:37.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.007+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93901973870720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741cbc9a0 con 0x556741cb5080 2024-09-13T19:16:37.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.008+0000 7f0811c3c640 1 -- 172.21.15.102:0/2324875119 <== osd.3 v2:172.21.15.102:6800/3096737090 64 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 93901973870720] v36'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f080c028070 con 0x556741cb5080 2024-09-13T19:16:37.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.008+0000 7f0815c0e800 20 remove_watcher() i=2 2024-09-13T19:16:37.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.008+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93901973873568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741cc14a0 con 0x7f080c021020 2024-09-13T19:16:37.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.009+0000 7f081143b640 1 -- 172.21.15.102:0/2324875119 <== osd.2 v2:172.21.15.102:6816/2238176080 43 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 93901973873568] v36'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0804089050 con 0x7f080c021020 2024-09-13T19:16:37.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.009+0000 7f0815c0e800 20 remove_watcher() i=3 2024-09-13T19:16:37.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.009+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93901973877184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741cc14a0 con 0x556741cb07c0 2024-09-13T19:16:37.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.010+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.1 v2:172.21.15.102:6808/2204418452 47 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 93901973877184] v36'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07fc02b040 con 0x556741cb07c0 2024-09-13T19:16:37.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.010+0000 7f0815c0e800 20 remove_watcher() i=4 2024-09-13T19:16:37.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.010+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93901973879872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741cc14a0 con 0x7f08040866d0 2024-09-13T19:16:37.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.011+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.0 v2:172.21.15.53:6800/4021716951 42 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 93901973879872] v36'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07fc02b040 con 0x7f08040866d0 2024-09-13T19:16:37.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.011+0000 7f0815c0e800 20 remove_watcher() i=5 2024-09-13T19:16:37.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.011+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93901973882224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741cbfc40 con 0x7f08040866d0 2024-09-13T19:16:37.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.012+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.0 v2:172.21.15.53:6800/4021716951 43 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 93901973882224] v36'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07fc02b040 con 0x7f08040866d0 2024-09-13T19:16:37.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.012+0000 7f0815c0e800 20 remove_watcher() i=6 2024-09-13T19:16:37.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.012+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93901973885056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556741cc14a0 con 0x7f08040866d0 2024-09-13T19:16:37.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.013+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 <== osd.0 v2:172.21.15.53:6800/4021716951 44 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 93901973885056] v36'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07fc02b040 con 0x7f08040866d0 2024-09-13T19:16:37.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.013+0000 7f0815c0e800 20 remove_watcher() i=7 2024-09-13T19:16:37.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.013+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f08040866d0 msgr2=0x7f080407e590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.013+0000 7f0815c0e800 1 --2- 172.21.15.102:0/2324875119 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f08040866d0 0x7f080407e590 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.013+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x556741cb07c0 msgr2=0x556741cb2c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.013+0000 7f0815c0e800 1 --2- 172.21.15.102:0/2324875119 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x556741cb07c0 0x556741cb2c80 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.013+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f080c021020 msgr2=0x7f080c04bd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.013+0000 7f0815c0e800 1 --2- 172.21.15.102:0/2324875119 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f080c021020 0x7f080c04bd80 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.013+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x556741cb5080 msgr2=0x556741cb7490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.013+0000 7f0815c0e800 1 --2- 172.21.15.102:0/2324875119 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x556741cb5080 0x556741cb7490 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.013+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f06dc036b40 msgr2=0x7f06dc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.013+0000 7f0815c0e800 1 --2- 172.21.15.102:0/2324875119 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f06dc036b40 0x7f06dc039000 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f080408f470 tx=0x7f0804095000 comp rx=0 tx=0).stop 2024-09-13T19:16:37.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.013+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556741c9dac0 msgr2=0x556741ca4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.013+0000 7f0815c0e800 1 --2- 172.21.15.102:0/2324875119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556741c9dac0 0x556741ca4f10 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f080c016fd0 tx=0x7f080c021f60 comp rx=0 tx=0).stop 2024-09-13T19:16:37.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.013+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 reap_dead start 2024-09-13T19:16:37.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.013+0000 7f0810c3a640 1 -- 172.21.15.102:0/2324875119 reap_dead start 2024-09-13T19:16:37.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.013+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 shutdown_connections 2024-09-13T19:16:37.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.013+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 >> 172.21.15.102:0/2324875119 conn(0x556741c99e70 msgr2=0x556741c97f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:37.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.013+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 shutdown_connections 2024-09-13T19:16:37.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.013+0000 7f0815c0e800 1 -- 172.21.15.102:0/2324875119 wait complete. 2024-09-13T19:16:37.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.014+0000 7f0815c0e800 1 -- 172.21.15.102:0/2606095668 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f06ec036b40 msgr2=0x7f06ec039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.014+0000 7f0815c0e800 1 --2- 172.21.15.102:0/2606095668 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f06ec036b40 0x7f06ec039000 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0804073950 tx=0x7f0804059f90 comp rx=0 tx=0).stop 2024-09-13T19:16:37.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.014+0000 7f0815c0e800 1 -- 172.21.15.102:0/2606095668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556741c90ec0 msgr2=0x556741c912e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.014+0000 7f0815c0e800 1 --2- 172.21.15.102:0/2606095668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556741c90ec0 0x556741c912e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x556741c76fe0 tx=0x7f080c00beb0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.014+0000 7f0815c0e800 1 -- 172.21.15.102:0/2606095668 shutdown_connections 2024-09-13T19:16:37.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.014+0000 7f0815c0e800 1 --2- 172.21.15.102:0/2606095668 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f06ec036b40 0x7f06ec039000 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.014+0000 7f0815c0e800 1 --2- 172.21.15.102:0/2606095668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556741c90ec0 0x556741c912e0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.014+0000 7f0815c0e800 1 -- 172.21.15.102:0/2606095668 >> 172.21.15.102:0/2606095668 conn(0x556741c85e50 msgr2=0x556741c889d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:37.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.014+0000 7f0815c0e800 1 -- 172.21.15.102:0/2606095668 shutdown_connections 2024-09-13T19:16:37.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.014+0000 7f0815c0e800 1 -- 172.21.15.102:0/2606095668 wait complete. 2024-09-13T19:16:37.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.014+0000 7f0815c0e800 1 -- 172.21.15.102:0/1923224379 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x556741b82bd0 msgr2=0x556741c7d0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.014+0000 7f0815c0e800 1 --2- 172.21.15.102:0/1923224379 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x556741b82bd0 0x556741c7d0c0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.014+0000 7f0815c0e800 1 -- 172.21.15.102:0/1923224379 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x556741c7f9f0 msgr2=0x556741c81de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.014+0000 7f0815c0e800 1 --2- 172.21.15.102:0/1923224379 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x556741c7f9f0 0x556741c81de0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.014+0000 7f0815c0e800 1 -- 172.21.15.102:0/1923224379 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f06f8036b90 msgr2=0x7f06f8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.014+0000 7f0815c0e800 1 --2- 172.21.15.102:0/1923224379 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f06f8036b90 0x7f06f8039050 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f07fc000c00 tx=0x7f07fc0013b0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.014+0000 7f0815c0e800 1 -- 172.21.15.102:0/1923224379 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556741af15f0 msgr2=0x556741c761c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.014+0000 7f0815c0e800 1 --2- 172.21.15.102:0/1923224379 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556741af15f0 0x556741c761c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f080400a3f0 tx=0x7f0804003330 comp rx=0 tx=0).stop 2024-09-13T19:16:37.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.014+0000 7f0815c0e800 1 -- 172.21.15.102:0/1923224379 shutdown_connections 2024-09-13T19:16:37.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.014+0000 7f0815c0e800 1 --2- 172.21.15.102:0/1923224379 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x556741c7f9f0 0x556741c81de0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.014+0000 7f0815c0e800 1 --2- 172.21.15.102:0/1923224379 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x556741b82bd0 0x556741c7d0c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.014+0000 7f0815c0e800 1 --2- 172.21.15.102:0/1923224379 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f06f8036b90 0x7f06f8039050 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.014+0000 7f0815c0e800 1 --2- 172.21.15.102:0/1923224379 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556741af15f0 0x556741c761c0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.014+0000 7f0815c0e800 1 -- 172.21.15.102:0/1923224379 >> 172.21.15.102:0/1923224379 conn(0x556741b77de0 msgr2=0x556741c68a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:37.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.014+0000 7f0815c0e800 1 -- 172.21.15.102:0/1923224379 shutdown_connections 2024-09-13T19:16:37.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.014+0000 7f0815c0e800 1 -- 172.21.15.102:0/1923224379 wait complete. 2024-09-13T19:16:37.028 INFO:teuthology.orchestra.run.smithi102.stdout:[{"tag":"509740b4-c081-4f37-bd6d-df9ca851489b.4237.3616192488651661690\u0000","time":"2024-09-13T19:16:36.821463+0000","objs":[{"pool":"default.rgw.buckets.data","oid":"509740b4-c081-4f37-bd6d-df9ca851489b.4237.1__shadow_.hcWfUtI_71tbADaoXKrrr_CNCUpDA_d_1","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"509740b4-c081-4f37-bd6d-df9ca851489b.4237.1__shadow_.hcWfUtI_71tbADaoXKrrr_CNCUpDA_d_2","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"509740b4-c081-4f37-bd6d-df9ca851489b.4237.1__shadow_.hcWfUtI_71tbADaoXKrrr_CNCUpDA_d_3","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"509740b4-c081-4f37-bd6d-df9ca851489b.4237.1__shadow_.hcWfUtI_71tbADaoXKrrr_CNCUpDA_d_4","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"509740b4-c081-4f37-bd6d-df9ca851489b.4237.1__shadow_.hcWfUtI_71tbADaoXKrrr_CNCUpDA_d_5","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"509740b4-c081-4f37-bd6d-df9ca851489b.4237.1__shadow_.hcWfUtI_71tbADaoXKrrr_CNCUpDA_d_6","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"509740b4-c081-4f37-bd6d-df9ca851489b.4237.1__shadow_.hcWfUtI_71tbADaoXKrrr_CNCUpDA_d_7","key":"","instance":""}]}] 2024-09-13T19:16:37.029 DEBUG:tasks.util.rgw: json result: [{'tag': '509740b4-c081-4f37-bd6d-df9ca851489b.4237.3616192488651661690\x00', 'time': '2024-09-13T19:16:36.821463+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': '509740b4-c081-4f37-bd6d-df9ca851489b.4237.1__shadow_.hcWfUtI_71tbADaoXKrrr_CNCUpDA_d_1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '509740b4-c081-4f37-bd6d-df9ca851489b.4237.1__shadow_.hcWfUtI_71tbADaoXKrrr_CNCUpDA_d_2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '509740b4-c081-4f37-bd6d-df9ca851489b.4237.1__shadow_.hcWfUtI_71tbADaoXKrrr_CNCUpDA_d_3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '509740b4-c081-4f37-bd6d-df9ca851489b.4237.1__shadow_.hcWfUtI_71tbADaoXKrrr_CNCUpDA_d_4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '509740b4-c081-4f37-bd6d-df9ca851489b.4237.1__shadow_.hcWfUtI_71tbADaoXKrrr_CNCUpDA_d_5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '509740b4-c081-4f37-bd6d-df9ca851489b.4237.1__shadow_.hcWfUtI_71tbADaoXKrrr_CNCUpDA_d_6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '509740b4-c081-4f37-bd6d-df9ca851489b.4237.1__shadow_.hcWfUtI_71tbADaoXKrrr_CNCUpDA_d_7', 'key': '', 'instance': ''}]}] 2024-09-13T19:16:37.029 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2024-09-13T19:16:37.029 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2024-09-13T19:16:37.029 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2024-09-13T19:16:37.071 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:37.071 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:37.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.069+0000 7f4e87615800 1 Processor -- start 2024-09-13T19:16:37.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.069+0000 7f4e87615800 1 -- start start 2024-09-13T19:16:37.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.069+0000 7f4e87615800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5599cc5d44b0 0x5599cc5d48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.069+0000 7f4e87615800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5599cc494b30 con 0x5599cc5d4df0 2024-09-13T19:16:37.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.069+0000 7f4e87615800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5599cc476360 con 0x5599cc5d44b0 2024-09-13T19:16:37.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.069+0000 7f4e82d9c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5599cc5d44b0 0x5599cc5d48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.069+0000 7f4e7bfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5599cc5d4df0 0x5599cc5d9970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:48488/0 (socket says 172.21.15.102:48488) 2024-09-13T19:16:37.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.069+0000 7f4e7bfff640 1 -- 172.21.15.102:0/2447452615 learned_addr learned my addr 172.21.15.102:0/2447452615 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:16:37.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.070+0000 7f4e8259b640 1 -- 172.21.15.102:0/2447452615 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 907531635 0 0) 0x5599cc494b30 con 0x5599cc5d4df0 2024-09-13T19:16:37.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.070+0000 7f4e8259b640 1 -- 172.21.15.102:0/2447452615 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e70001e10 con 0x5599cc5d4df0 2024-09-13T19:16:37.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.070+0000 7f4e82d9c640 1 -- 172.21.15.102:0/2447452615 >> v1:172.21.15.53:6789/0 conn(0x5599cc5d4df0 legacy=0x5599cc5d9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.070+0000 7f4e82d9c640 1 -- 172.21.15.102:0/2447452615 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599cc49ce00 con 0x5599cc5d44b0 2024-09-13T19:16:37.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.072+0000 7f4e82d9c640 1 --2- 172.21.15.102:0/2447452615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599cc5d44b0 0x5599cc5d48b0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f4e7400a470 tx=0x7f4e74045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87c0606c2ef57a02 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.072+0000 7f4e8259b640 1 -- 172.21.15.102:0/2447452615 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e74059070 con 0x5599cc5d44b0 2024-09-13T19:16:37.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.072+0000 7f4e8259b640 1 -- 172.21.15.102:0/2447452615 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e74054570 con 0x5599cc5d44b0 2024-09-13T19:16:37.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.072+0000 7f4e8259b640 1 -- 172.21.15.102:0/2447452615 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e74054850 con 0x5599cc5d44b0 2024-09-13T19:16:37.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.072+0000 7f4e87615800 1 -- 172.21.15.102:0/2447452615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599cc5d44b0 msgr2=0x5599cc5d48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.072+0000 7f4e87615800 1 --2- 172.21.15.102:0/2447452615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599cc5d44b0 0x5599cc5d48b0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f4e7400a470 tx=0x7f4e74045920 comp rx=0 tx=0).stop 2024-09-13T19:16:37.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.072+0000 7f4e87615800 1 -- 172.21.15.102:0/2447452615 shutdown_connections 2024-09-13T19:16:37.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.072+0000 7f4e87615800 1 --2- 172.21.15.102:0/2447452615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599cc5d44b0 0x5599cc5d48b0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.072+0000 7f4e87615800 1 -- 172.21.15.102:0/2447452615 >> 172.21.15.102:0/2447452615 conn(0x5599cc5cfde0 msgr2=0x5599cc5d2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:37.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.072+0000 7f4e87615800 1 -- 172.21.15.102:0/2447452615 shutdown_connections 2024-09-13T19:16:37.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.072+0000 7f4e87615800 1 -- 172.21.15.102:0/2447452615 wait complete. 2024-09-13T19:16:37.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.086+0000 7f4e87615800 1 Processor -- start 2024-09-13T19:16:37.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.086+0000 7f4e87615800 1 -- start start 2024-09-13T19:16:37.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.086+0000 7f4e87615800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599cc5d44b0 0x5599cc548d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.086+0000 7f4e87615800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5599cc521320 con 0x5599cc5d44b0 2024-09-13T19:16:37.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.086+0000 7f4e82d9c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599cc5d44b0 0x5599cc548d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.086+0000 7f4e82d9c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599cc5d44b0 0x5599cc548d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55280/0 (socket says 172.21.15.102:55280) 2024-09-13T19:16:37.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.086+0000 7f4e82d9c640 1 -- 172.21.15.102:0/339513721 learned_addr learned my addr 172.21.15.102:0/339513721 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:37.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.087+0000 7f4e82d9c640 1 -- 172.21.15.102:0/339513721 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599cc46ebc0 con 0x5599cc5d44b0 2024-09-13T19:16:37.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.087+0000 7f4e82d9c640 1 --2- 172.21.15.102:0/339513721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599cc5d44b0 0x5599cc548d70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f4e74025b20 tx=0x7f4e7404e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72c0a43d3fbcb03b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.087+0000 7f4d70e09640 1 -- 172.21.15.102:0/339513721 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e74062070 con 0x5599cc5d44b0 2024-09-13T19:16:37.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.087+0000 7f4d70e09640 1 -- 172.21.15.102:0/339513721 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e7400a230 con 0x5599cc5d44b0 2024-09-13T19:16:37.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.087+0000 7f4d70e09640 1 -- 172.21.15.102:0/339513721 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e74059040 con 0x5599cc5d44b0 2024-09-13T19:16:37.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.088+0000 7f4e87615800 1 -- 172.21.15.102:0/339513721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599cc5d44b0 msgr2=0x5599cc548d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.088+0000 7f4e87615800 1 --2- 172.21.15.102:0/339513721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599cc5d44b0 0x5599cc548d70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f4e74025b20 tx=0x7f4e7404e000 comp rx=0 tx=0).stop 2024-09-13T19:16:37.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.088+0000 7f4e87615800 1 -- 172.21.15.102:0/339513721 shutdown_connections 2024-09-13T19:16:37.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.088+0000 7f4e87615800 1 --2- 172.21.15.102:0/339513721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599cc5d44b0 0x5599cc548d70 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.088+0000 7f4e87615800 1 -- 172.21.15.102:0/339513721 >> 172.21.15.102:0/339513721 conn(0x5599cc5cfde0 msgr2=0x5599cc6bef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:37.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.088+0000 7f4e87615800 1 -- 172.21.15.102:0/339513721 shutdown_connections 2024-09-13T19:16:37.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.088+0000 7f4e87615800 1 -- 172.21.15.102:0/339513721 wait complete. 2024-09-13T19:16:37.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.088+0000 7f4e87615800 1 Processor -- start 2024-09-13T19:16:37.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.088+0000 7f4e87615800 1 -- start start 2024-09-13T19:16:37.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.088+0000 7f4e87615800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599cc5d44b0 0x5599cc6cc040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.089+0000 7f4e87615800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5599cc5db4d0 con 0x5599cc5d44b0 2024-09-13T19:16:37.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.089+0000 7f4e82d9c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599cc5d44b0 0x5599cc6cc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.089+0000 7f4e82d9c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599cc5d44b0 0x5599cc6cc040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55282/0 (socket says 172.21.15.102:55282) 2024-09-13T19:16:37.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.089+0000 7f4e82d9c640 1 -- 172.21.15.102:0/2077400757 learned_addr learned my addr 172.21.15.102:0/2077400757 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:37.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.089+0000 7f4e82d9c640 1 -- 172.21.15.102:0/2077400757 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599cc482fe0 con 0x5599cc5d44b0 2024-09-13T19:16:37.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.089+0000 7f4e82d9c640 1 --2- 172.21.15.102:0/2077400757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599cc5d44b0 0x5599cc6cc040 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f4e74045960 tx=0x7f4e74002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.090+0000 7f4d6f606640 1 -- 172.21.15.102:0/2077400757 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e74062070 con 0x5599cc5d44b0 2024-09-13T19:16:37.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.090+0000 7f4d6f606640 1 -- 172.21.15.102:0/2077400757 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e74054910 con 0x5599cc5d44b0 2024-09-13T19:16:37.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.090+0000 7f4d6f606640 1 -- 172.21.15.102:0/2077400757 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e74059040 con 0x5599cc5d44b0 2024-09-13T19:16:37.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.090+0000 7f4e87615800 1 -- 172.21.15.102:0/2077400757 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5599cc6cc580 con 0x5599cc5d44b0 2024-09-13T19:16:37.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.090+0000 7f4e87615800 1 -- 172.21.15.102:0/2077400757 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599cc6ccaa0 con 0x5599cc5d44b0 2024-09-13T19:16:37.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.090+0000 7f4d6f606640 1 -- 172.21.15.102:0/2077400757 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4e74065040 con 0x5599cc5d44b0 2024-09-13T19:16:37.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.091+0000 7f4d6f606640 1 --2- 172.21.15.102:0/2077400757 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4d68036b40 0x7f4d68039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.091+0000 7f4d6f606640 1 -- 172.21.15.102:0/2077400757 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f4e7408fb00 con 0x5599cc5d44b0 2024-09-13T19:16:37.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.091+0000 7f4e7bfff640 1 --2- 172.21.15.102:0/2077400757 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4d68036b40 0x7f4d68039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.091+0000 7f4e87615800 1 --2- 172.21.15.102:0/2077400757 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5599cc5d4df0 0x5599cc6d30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.091+0000 7f4e87615800 1 -- 172.21.15.102:0/2077400757 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc6d35f0 con 0x5599cc5d4df0 2024-09-13T19:16:37.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.091+0000 7f4e8359d640 1 --2- 172.21.15.102:0/2077400757 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5599cc5d4df0 0x5599cc6d30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.091+0000 7f4e7bfff640 1 --2- 172.21.15.102:0/2077400757 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4d68036b40 0x7f4d68039000 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c000f60 tx=0x7f4e6c0010a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.091+0000 7f4e8359d640 1 --2- 172.21.15.102:0/2077400757 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5599cc5d4df0 0x5599cc6d30b0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.092+0000 7f4e8359d640 1 -- 172.21.15.102:0/2077400757 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4e7c00a4a0 con 0x5599cc5d4df0 2024-09-13T19:16:37.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.092+0000 7f4e87615800 1 -- 172.21.15.102:0/2077400757 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc6d0660 con 0x5599cc5d4df0 2024-09-13T19:16:37.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.092+0000 7f4e8359d640 1 -- 172.21.15.102:0/2077400757 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4e7c00a4a0 con 0x5599cc5d4df0 2024-09-13T19:16:37.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.092+0000 7f4e87615800 1 --2- 172.21.15.102:0/2077400757 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5599cc6d5900 0x5599cc6d7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.092+0000 7f4e87615800 1 -- 172.21.15.102:0/2077400757 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc6d8390 con 0x5599cc6d5900 2024-09-13T19:16:37.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.092+0000 7f4e82d9c640 1 --2- 172.21.15.102:0/2077400757 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5599cc6d5900 0x5599cc6d7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.092+0000 7f4e82d9c640 1 --2- 172.21.15.102:0/2077400757 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5599cc6d5900 0x5599cc6d7cf0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.092+0000 7f4e82d9c640 1 -- 172.21.15.102:0/2077400757 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4e7405c040 con 0x5599cc6d5900 2024-09-13T19:16:37.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.092+0000 7f4e87615800 1 -- 172.21.15.102:0/2077400757 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc6d47a0 con 0x5599cc5d4df0 2024-09-13T19:16:37.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.093+0000 7f4e8359d640 1 -- 172.21.15.102:0/2077400757 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4e7c00a4a0 con 0x5599cc5d4df0 2024-09-13T19:16:37.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.093+0000 7f4e87615800 1 -- 172.21.15.102:0/2077400757 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc6d4c80 con 0x5599cc6d5900 2024-09-13T19:16:37.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.093+0000 7f4e82d9c640 1 -- 172.21.15.102:0/2077400757 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4e7405c040 con 0x5599cc6d5900 2024-09-13T19:16:37.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.093+0000 7f4e87615800 1 Processor -- start 2024-09-13T19:16:37.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.093+0000 7f4e87615800 1 -- start start 2024-09-13T19:16:37.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.094+0000 7f4e87615800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599cc6e6d40 0x5599cc6e7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.094+0000 7f4e87615800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5599cc470580 con 0x5599cc6e6d40 2024-09-13T19:16:37.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.094+0000 7f4e8359d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599cc6e6d40 0x5599cc6e7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.094+0000 7f4e8359d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599cc6e6d40 0x5599cc6e7160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55290/0 (socket says 172.21.15.102:55290) 2024-09-13T19:16:37.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.094+0000 7f4e8359d640 1 -- 172.21.15.102:0/2163451566 learned_addr learned my addr 172.21.15.102:0/2163451566 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:37.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.094+0000 7f4e8359d640 1 -- 172.21.15.102:0/2163451566 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599cc6e76a0 con 0x5599cc6e6d40 2024-09-13T19:16:37.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.094+0000 7f4e8359d640 1 --2- 172.21.15.102:0/2163451566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599cc6e6d40 0x5599cc6e7160 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x5599cc6cd0f0 tx=0x7f4e7c0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.095+0000 7f4d6ce01640 1 -- 172.21.15.102:0/2163451566 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e7c013640 con 0x5599cc6e6d40 2024-09-13T19:16:37.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.095+0000 7f4d6ce01640 1 -- 172.21.15.102:0/2163451566 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e7c0137e0 con 0x5599cc6e6d40 2024-09-13T19:16:37.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.095+0000 7f4e87615800 1 -- 172.21.15.102:0/2163451566 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5599cc6e7930 con 0x5599cc6e6d40 2024-09-13T19:16:37.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.095+0000 7f4d6ce01640 1 -- 172.21.15.102:0/2163451566 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e7c013ae0 con 0x5599cc6e6d40 2024-09-13T19:16:37.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.095+0000 7f4e87615800 1 -- 172.21.15.102:0/2163451566 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599cc6ea610 con 0x5599cc6e6d40 2024-09-13T19:16:37.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.095+0000 7f4d6ce01640 1 -- 172.21.15.102:0/2163451566 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4e7c011040 con 0x5599cc6e6d40 2024-09-13T19:16:37.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.096+0000 7f4d6ce01640 1 --2- 172.21.15.102:0/2163451566 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4d5c036b40 0x7f4d5c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.096+0000 7f4d6ce01640 1 -- 172.21.15.102:0/2163451566 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f4e7c00e040 con 0x5599cc6e6d40 2024-09-13T19:16:37.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.096+0000 7f4e82d9c640 1 --2- 172.21.15.102:0/2163451566 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4d5c036b40 0x7f4d5c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.096+0000 7f4e87615800 1 Processor -- start 2024-09-13T19:16:37.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.096+0000 7f4e87615800 1 -- start start 2024-09-13T19:16:37.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.096+0000 7f4e82d9c640 1 --2- 172.21.15.102:0/2163451566 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4d5c036b40 0x7f4d5c039000 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x5599cc6d05a0 tx=0x7f4e74056ee0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.096+0000 7f4e87615800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599cc6c45c0 0x5599cc6c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.096+0000 7f4e87615800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5599cc6c7480 con 0x5599cc6c45c0 2024-09-13T19:16:37.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.096+0000 7f4e8359d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599cc6c45c0 0x5599cc6c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.096+0000 7f4e8359d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599cc6c45c0 0x5599cc6c49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55294/0 (socket says 172.21.15.102:55294) 2024-09-13T19:16:37.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.096+0000 7f4e8359d640 1 -- 172.21.15.102:0/2248731623 learned_addr learned my addr 172.21.15.102:0/2248731623 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:37.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.097+0000 7f4e8359d640 1 -- 172.21.15.102:0/2248731623 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599cc6c4f90 con 0x5599cc6c45c0 2024-09-13T19:16:37.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.097+0000 7f4e8359d640 1 --2- 172.21.15.102:0/2248731623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599cc6c45c0 0x5599cc6c49c0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c04ce40 tx=0x7f4e7c01fed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7ab1dccc7b99fe9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.097+0000 7f4d667fc640 1 -- 172.21.15.102:0/2248731623 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e7c021960 con 0x5599cc6c45c0 2024-09-13T19:16:37.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.097+0000 7f4d667fc640 1 -- 172.21.15.102:0/2248731623 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e7c04a030 con 0x5599cc6c45c0 2024-09-13T19:16:37.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.097+0000 7f4d667fc640 1 -- 172.21.15.102:0/2248731623 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e7c021440 con 0x5599cc6c45c0 2024-09-13T19:16:37.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.097+0000 7f4e87615800 1 -- 172.21.15.102:0/2248731623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599cc6c45c0 msgr2=0x5599cc6c49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.097+0000 7f4e87615800 1 --2- 172.21.15.102:0/2248731623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599cc6c45c0 0x5599cc6c49c0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c04ce40 tx=0x7f4e7c01fed0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.097+0000 7f4e87615800 1 -- 172.21.15.102:0/2248731623 shutdown_connections 2024-09-13T19:16:37.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.097+0000 7f4e87615800 1 --2- 172.21.15.102:0/2248731623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599cc6c45c0 0x5599cc6c49c0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.097+0000 7f4e87615800 1 -- 172.21.15.102:0/2248731623 >> 172.21.15.102:0/2248731623 conn(0x5599cc6efe10 msgr2=0x5599cc6edf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:37.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.097+0000 7f4e87615800 1 -- 172.21.15.102:0/2248731623 shutdown_connections 2024-09-13T19:16:37.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.097+0000 7f4e87615800 1 -- 172.21.15.102:0/2248731623 wait complete. 2024-09-13T19:16:37.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.098+0000 7f4e87615800 1 Processor -- start 2024-09-13T19:16:37.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.098+0000 7f4e87615800 1 -- start start 2024-09-13T19:16:37.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.098+0000 7f4e87615800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599cc6c45c0 0x5599cc6fd150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.098+0000 7f4e87615800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5599cc6c32f0 con 0x5599cc6c45c0 2024-09-13T19:16:37.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.098+0000 7f4e8359d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599cc6c45c0 0x5599cc6fd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.098+0000 7f4e8359d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599cc6c45c0 0x5599cc6fd150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55296/0 (socket says 172.21.15.102:55296) 2024-09-13T19:16:37.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.098+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 learned_addr learned my addr 172.21.15.102:0/510752663 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:37.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.098+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599cc6fd690 con 0x5599cc6c45c0 2024-09-13T19:16:37.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.099+0000 7f4e8359d640 1 --2- 172.21.15.102:0/510752663 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599cc6c45c0 0x5599cc6fd150 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c012e50 tx=0x7f4e7c04cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.099+0000 7f4d64ff9640 1 -- 172.21.15.102:0/510752663 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e7c039070 con 0x5599cc6c45c0 2024-09-13T19:16:37.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.099+0000 7f4d64ff9640 1 -- 172.21.15.102:0/510752663 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e7c021a90 con 0x5599cc6c45c0 2024-09-13T19:16:37.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.099+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5599cc6fd920 con 0x5599cc6c45c0 2024-09-13T19:16:37.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.099+0000 7f4d64ff9640 1 -- 172.21.15.102:0/510752663 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e7c0215b0 con 0x5599cc6c45c0 2024-09-13T19:16:37.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.099+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599cc7005d0 con 0x5599cc6c45c0 2024-09-13T19:16:37.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.100+0000 7f4d64ff9640 1 -- 172.21.15.102:0/510752663 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4e7c0400e0 con 0x5599cc6c45c0 2024-09-13T19:16:37.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.100+0000 7f4d64ff9640 1 --2- 172.21.15.102:0/510752663 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4d4c036aa0 0x7f4d4c038f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.100+0000 7f4d64ff9640 1 -- 172.21.15.102:0/510752663 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f4e7c031070 con 0x5599cc6c45c0 2024-09-13T19:16:37.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.100+0000 7f4e82d9c640 1 --2- 172.21.15.102:0/510752663 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4d4c036aa0 0x7f4d4c038f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.100+0000 7f4e87615800 20 rados->read ofs=0 len=0 2024-09-13T19:16:37.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.100+0000 7f4e82d9c640 1 --2- 172.21.15.102:0/510752663 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4d4c036aa0 0x7f4d4c038f60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4e7406ff70 tx=0x7f4e74091000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.100+0000 7f4e87615800 1 --2- 172.21.15.102:0/510752663 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5599cc708bd0 0x5599cc70b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.100+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc70b7e0 con 0x5599cc708bd0 2024-09-13T19:16:37.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.101+0000 7f4e7bfff640 1 --2- 172.21.15.102:0/510752663 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5599cc708bd0 0x5599cc70b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.101+0000 7f4e7bfff640 1 --2- 172.21.15.102:0/510752663 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5599cc708bd0 0x5599cc70b090 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.101+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4e6c009050 con 0x5599cc708bd0 2024-09-13T19:16:37.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.101+0000 7f4e87615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:37.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.101+0000 7f4e87615800 20 realm 2024-09-13T19:16:37.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.101+0000 7f4e87615800 20 rados->read ofs=0 len=0 2024-09-13T19:16:37.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.101+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc708020 con 0x5599cc708bd0 2024-09-13T19:16:37.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.101+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4e6c009050 con 0x5599cc708bd0 2024-09-13T19:16:37.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.101+0000 7f4e87615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:37.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.101+0000 7f4e87615800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:37.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.101+0000 7f4e87615800 20 rados->read ofs=0 len=0 2024-09-13T19:16:37.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.101+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc70c2d0 con 0x5599cc708bd0 2024-09-13T19:16:37.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.102+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4e6c009050 con 0x5599cc708bd0 2024-09-13T19:16:37.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.102+0000 7f4e87615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:37.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.102+0000 7f4e87615800 20 rados->read ofs=0 len=0 2024-09-13T19:16:37.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.102+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc70cba0 con 0x5599cc708bd0 2024-09-13T19:16:37.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.102+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4e6c009050 con 0x5599cc708bd0 2024-09-13T19:16:37.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.102+0000 7f4e87615800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:37.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.102+0000 7f4e87615800 20 rados->read ofs=0 len=0 2024-09-13T19:16:37.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.102+0000 7f4e87615800 1 --2- 172.21.15.102:0/510752663 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5599cc70d5c0 0x5599cc70f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.102+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7100a0 con 0x5599cc70d5c0 2024-09-13T19:16:37.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.102+0000 7f4e8359d640 1 --2- 172.21.15.102:0/510752663 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5599cc70d5c0 0x5599cc70f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.102+0000 7f4e8359d640 1 --2- 172.21.15.102:0/510752663 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5599cc70d5c0 0x5599cc70f9b0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.102+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.102+0000 7f4e87615800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:37.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.102+0000 7f4e87615800 20 searching for the correct realm 2024-09-13T19:16:37.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.102+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7119f0 con 0x5599cc70d5c0 2024-09-13T19:16:37.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.103+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.103+0000 7f4e8359d640 1 --2- 172.21.15.102:0/510752663 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f4e7c058040 0x7f4e7c04b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.103+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7119f0 con 0x7f4e7c058040 2024-09-13T19:16:37.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.103+0000 7f4e82d9c640 1 --2- 172.21.15.102:0/510752663 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f4e7c058040 0x7f4e7c04b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.103+0000 7f4e82d9c640 1 --2- 172.21.15.102:0/510752663 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f4e7c058040 0x7f4e7c04b280 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.103+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.103+0000 7f4e82d9c640 1 --2- 172.21.15.102:0/510752663 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f4e740665d0 0x7f4e740783f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.103+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7119f0 con 0x7f4e740665d0 2024-09-13T19:16:37.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.104+0000 7f4e7bfff640 1 --2- 172.21.15.102:0/510752663 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f4e740665d0 0x7f4e740783f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.104+0000 7f4e7bfff640 1 --2- 172.21.15.102:0/510752663 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f4e740665d0 0x7f4e740783f0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.104+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e6c009050 con 0x7f4e740665d0 2024-09-13T19:16:37.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.104+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7119f0 con 0x5599cc708bd0 2024-09-13T19:16:37.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.104+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e6c009050 con 0x5599cc708bd0 2024-09-13T19:16:37.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.105+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7119f0 con 0x5599cc708bd0 2024-09-13T19:16:37.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.105+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.105+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7119f0 con 0x7f4e740665d0 2024-09-13T19:16:37.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.105+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.105+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7119f0 con 0x7f4e740665d0 2024-09-13T19:16:37.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.105+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.105+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7119f0 con 0x7f4e7c058040 2024-09-13T19:16:37.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.106+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.106+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7119f0 con 0x5599cc70d5c0 2024-09-13T19:16:37.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.106+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.106+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7119f0 con 0x5599cc708bd0 2024-09-13T19:16:37.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.106+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.106+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7119f0 con 0x7f4e7c058040 2024-09-13T19:16:37.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.106+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.106+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7119f0 con 0x5599cc708bd0 2024-09-13T19:16:37.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.107+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.107+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7119f0 con 0x7f4e7c058040 2024-09-13T19:16:37.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.107+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.107+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7119f0 con 0x5599cc70d5c0 2024-09-13T19:16:37.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.107+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.107+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7119f0 con 0x5599cc70d5c0 2024-09-13T19:16:37.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.107+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.107+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7119f0 con 0x7f4e740665d0 2024-09-13T19:16:37.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.108+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.108+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7119f0 con 0x5599cc70d5c0 2024-09-13T19:16:37.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.108+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.108+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7119f0 con 0x5599cc70d5c0 2024-09-13T19:16:37.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.108+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.108+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7119f0 con 0x5599cc708bd0 2024-09-13T19:16:37.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.108+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.108+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7119f0 con 0x5599cc708bd0 2024-09-13T19:16:37.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.109+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.109+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7119f0 con 0x7f4e740665d0 2024-09-13T19:16:37.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.109+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.109+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7119f0 con 0x5599cc70d5c0 2024-09-13T19:16:37.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.109+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.109+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7119f0 con 0x7f4e7c058040 2024-09-13T19:16:37.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.109+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.109+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7119f0 con 0x5599cc708bd0 2024-09-13T19:16:37.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.110+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.110+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7119f0 con 0x7f4e7c058040 2024-09-13T19:16:37.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.110+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.110+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7119f0 con 0x5599cc70d5c0 2024-09-13T19:16:37.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.110+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.110+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7119f0 con 0x7f4e740665d0 2024-09-13T19:16:37.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.110+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.110+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7119f0 con 0x7f4e7c058040 2024-09-13T19:16:37.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.111+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.111+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7119f0 con 0x5599cc70d5c0 2024-09-13T19:16:37.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.111+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.111+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7119f0 con 0x7f4e740665d0 2024-09-13T19:16:37.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.111+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.111+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7119f0 con 0x5599cc708bd0 2024-09-13T19:16:37.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.112+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.112+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7119f0 con 0x7f4e7c058040 2024-09-13T19:16:37.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.112+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.112+0000 7f4e87615800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:37.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.112+0000 7f4e87615800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:37.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.112+0000 7f4e87615800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:37.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.112+0000 7f4e87615800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:37.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.112+0000 7f4e87615800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:37.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.112+0000 7f4e87615800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:37.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.112+0000 7f4e87615800 20 rados->read ofs=0 len=0 2024-09-13T19:16:37.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.112+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc710a60 con 0x5599cc708bd0 2024-09-13T19:16:37.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.112+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.112+0000 7f4e87615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:37.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.112+0000 7f4e87615800 20 rados->read ofs=0 len=0 2024-09-13T19:16:37.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.112+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc711300 con 0x5599cc708bd0 2024-09-13T19:16:37.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.112+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.112+0000 7f4e87615800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:37.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.112+0000 7f4e87615800 20 rados->read ofs=0 len=0 2024-09-13T19:16:37.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.112+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc711e70 con 0x5599cc70d5c0 2024-09-13T19:16:37.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.113+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.113+0000 7f4e87615800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:37.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.113+0000 7f4e87615800 20 zone default found 2024-09-13T19:16:37.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.113+0000 7f4e87615800 4 Realm: () 2024-09-13T19:16:37.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.113+0000 7f4e87615800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:37.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.113+0000 7f4e87615800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:37.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.113+0000 7f4e87615800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:37.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.113+0000 7f4e87615800 20 zonegroup default 2024-09-13T19:16:37.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.113+0000 7f4e87615800 20 rados->read ofs=0 len=0 2024-09-13T19:16:37.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.113+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7126c0 con 0x7f4e7c058040 2024-09-13T19:16:37.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.113+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.113+0000 7f4e87615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:37.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.113+0000 7f4e87615800 20 rados->read ofs=0 len=0 2024-09-13T19:16:37.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.113+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc714440 con 0x5599cc70d5c0 2024-09-13T19:16:37.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.113+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.113+0000 7f4e87615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:37.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.113+0000 7f4e87615800 20 rados->read ofs=0 len=0 2024-09-13T19:16:37.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.113+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc714890 con 0x5599cc70d5c0 2024-09-13T19:16:37.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.113+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.113+0000 7f4e87615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:37.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.113+0000 7f4e87615800 20 started sync module instance, tier type = 2024-09-13T19:16:37.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.113+0000 7f4e87615800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:37.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.113+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7138e0 con 0x7f4e7c058040 2024-09-13T19:16:37.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.115+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(44 notify.0 [create] v36'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.115+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94119048328240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc714cf0 con 0x7f4e7c058040 2024-09-13T19:16:37.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.115+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc715540 con 0x5599cc708bd0 2024-09-13T19:16:37.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.116+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94119048328240] v36'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.116+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v36'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.116+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94119048330496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7158e0 con 0x5599cc708bd0 2024-09-13T19:16:37.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.116+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc716170 con 0x5599cc70d5c0 2024-09-13T19:16:37.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.117+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94119048330496] v36'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.117+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v36'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.117+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94119048334576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc715d90 con 0x5599cc70d5c0 2024-09-13T19:16:37.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.117+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc716c20 con 0x7f4e7c058040 2024-09-13T19:16:37.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.118+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(50 notify.3 [create] v36'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.118+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94119048334576] v36'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.118+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94119048341296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc716c20 con 0x7f4e7c058040 2024-09-13T19:16:37.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.118+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7158e0 con 0x5599cc708bd0 2024-09-13T19:16:37.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.120+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v36'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.120+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94119048345264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7158e0 con 0x5599cc708bd0 2024-09-13T19:16:37.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.120+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc718600 con 0x7f4e740665d0 2024-09-13T19:16:37.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.120+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94119048341296] v36'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.121+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(54 notify.5 [create] v36'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.121+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94119048347888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7185c0 con 0x7f4e740665d0 2024-09-13T19:16:37.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.121+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc719040 con 0x7f4e740665d0 2024-09-13T19:16:37.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.121+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94119048345264] v36'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.122+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94119048347888] v36'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.122+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(56 notify.6 [create] v36'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.122+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94119048343568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc718b90 con 0x7f4e740665d0 2024-09-13T19:16:37.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.122+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc719550 con 0x7f4e740665d0 2024-09-13T19:16:37.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.123+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94119048343568] v36'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.123+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(58 notify.7 [create] v36'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.123+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94119048346320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc719550 con 0x7f4e740665d0 2024-09-13T19:16:37.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.123+0000 7f4e87615800 20 add_watcher() i=0 2024-09-13T19:16:37.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.123+0000 7f4e87615800 20 add_watcher() i=1 2024-09-13T19:16:37.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.123+0000 7f4e87615800 20 add_watcher() i=2 2024-09-13T19:16:37.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.123+0000 7f4e87615800 20 add_watcher() i=3 2024-09-13T19:16:37.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.123+0000 7f4e87615800 20 add_watcher() i=4 2024-09-13T19:16:37.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.123+0000 7f4e87615800 20 add_watcher() i=5 2024-09-13T19:16:37.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.123+0000 7f4e87615800 20 add_watcher() i=6 2024-09-13T19:16:37.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.124+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94119048346320] v36'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.124+0000 7f4e87615800 20 add_watcher() i=7 2024-09-13T19:16:37.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.124+0000 7f4e87615800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:37.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.124+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc71c890 con 0x5599cc708bd0 2024-09-13T19:16:37.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.124+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.125+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94119048352272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc719ae0 con 0x5599cc708bd0 2024-09-13T19:16:37.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.125+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94119048352272] v36'157 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.126+0000 7f4d397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:37.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.126+0000 7f4e87615800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:37.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.126+0000 7f4e87615800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:37.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.126+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc71c180 con 0x5599cc708bd0 2024-09-13T19:16:37.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.127+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v36'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.127+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc725a90 con 0x7f4e740665d0 2024-09-13T19:16:37.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.128+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v36'19 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.128+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc725eb0 con 0x5599cc70d5c0 2024-09-13T19:16:37.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.129+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v36'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.129+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc725e10 con 0x5599cc708bd0 2024-09-13T19:16:37.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.130+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v36'158 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.130+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc726440 con 0x7f4e7c058040 2024-09-13T19:16:37.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.131+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v36'48 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.131+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7268f0 con 0x5599cc70d5c0 2024-09-13T19:16:37.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.132+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v36'32 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.132+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7268f0 con 0x5599cc708bd0 2024-09-13T19:16:37.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.133+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v36'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.133+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7268f0 con 0x7f4e740665d0 2024-09-13T19:16:37.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.134+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(69 gc.7 [create,call,call,call] v36'31 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.134+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7268f0 con 0x7f4e7c058040 2024-09-13T19:16:37.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.135+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v36'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.135+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc726ac0 con 0x5599cc70d5c0 2024-09-13T19:16:37.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.136+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v36'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.136+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc726ac0 con 0x7f4e7c058040 2024-09-13T19:16:37.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.137+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v36'49 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.137+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc726ac0 con 0x7f4e740665d0 2024-09-13T19:16:37.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.139+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v36'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.139+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc726ac0 con 0x7f4e7c058040 2024-09-13T19:16:37.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.140+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v36'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.140+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc726ac0 con 0x7f4e740665d0 2024-09-13T19:16:37.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.141+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(75 gc.13 [create,call,call,call] v36'37 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.141+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc726ac0 con 0x5599cc708bd0 2024-09-13T19:16:37.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.142+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v36'159 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.142+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc726ac0 con 0x5599cc70d5c0 2024-09-13T19:16:37.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.143+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v36'41 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.143+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc726ac0 con 0x7f4e7c058040 2024-09-13T19:16:37.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.144+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v36'50 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.144+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc726ac0 con 0x5599cc70d5c0 2024-09-13T19:16:37.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.145+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v36'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.145+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc726ac0 con 0x5599cc708bd0 2024-09-13T19:16:37.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.146+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v36'27 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.146+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc726ac0 con 0x5599cc708bd0 2024-09-13T19:16:37.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.147+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v36'160 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.147+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc726ac0 con 0x5599cc70d5c0 2024-09-13T19:16:37.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.148+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v36'42 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.148+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc726ac0 con 0x7f4e7c058040 2024-09-13T19:16:37.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.149+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v36'29 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.149+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7268f0 con 0x5599cc70d5c0 2024-09-13T19:16:37.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.150+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v36'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.150+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7268f0 con 0x5599cc70d5c0 2024-09-13T19:16:37.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.151+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v36'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.151+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7268f0 con 0x5599cc70d5c0 2024-09-13T19:16:37.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.152+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v36'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.152+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7268f0 con 0x5599cc70d5c0 2024-09-13T19:16:37.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.153+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v36'33 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.153+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7268f0 con 0x7f4e740665d0 2024-09-13T19:16:37.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.154+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(88 gc.26 [create,call,call,call] v36'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.154+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7268f0 con 0x5599cc70d5c0 2024-09-13T19:16:37.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.155+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v36'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.155+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7268f0 con 0x7f4e740665d0 2024-09-13T19:16:37.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.156+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(90 gc.28 [create,call,call,call] v36'32 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.156+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7268f0 con 0x5599cc70d5c0 2024-09-13T19:16:37.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.158+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v36'43 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.158+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7268f0 con 0x7f4e740665d0 2024-09-13T19:16:37.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.159+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 20 ==== osd_op_reply(92 gc.30 [create,call,call,call] v36'38 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.159+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7268f0 con 0x7f4e7c058040 2024-09-13T19:16:37.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.160+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v36'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.160+0000 7f4cb3fff640 20 reqs_thread_entry: start 2024-09-13T19:16:37.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.160+0000 7f4e87615800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:37.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.160+0000 7f4e87615800 20 Filter name: none 2024-09-13T19:16:37.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.160+0000 7f4cb1ffb640 20 reqs_thread_entry: start 2024-09-13T19:16:37.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.160+0000 7f4e87615800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2024-09-13T19:16:37.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.161+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:94 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc752cb0 con 0x7f4e740665d0 2024-09-13T19:16:37.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.162+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 21 ==== osd_op_reply(94 gc.11 [call] v36'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.162+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:95 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc752cb0 con 0x7f4e740665d0 2024-09-13T19:16:37.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.162+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 22 ==== osd_op_reply(95 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.162+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.162+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:96 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc751ca0 con 0x7f4e740665d0 2024-09-13T19:16:37.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.162+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 23 ==== osd_op_reply(96 gc.11 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.162+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:97 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc752cb0 con 0x7f4e740665d0 2024-09-13T19:16:37.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.162+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 24 ==== osd_op_reply(97 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.162+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:16:37.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.162+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:98 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc752cb0 con 0x7f4e740665d0 2024-09-13T19:16:37.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.163+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 25 ==== osd_op_reply(98 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.163+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.163+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:99 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc752cb0 con 0x7f4e740665d0 2024-09-13T19:16:37.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.164+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 26 ==== osd_op_reply(99 gc.11 [call] v36'24 uv24 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.164+0000 7f4e87615800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2024-09-13T19:16:37.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.164+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:100 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc752cb0 con 0x7f4e7c058040 2024-09-13T19:16:37.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.165+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 21 ==== osd_op_reply(100 gc.12 [call] v36'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.165+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:101 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc752cb0 con 0x7f4e7c058040 2024-09-13T19:16:37.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.165+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 22 ==== osd_op_reply(101 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.165+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.165+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:102 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc751ca0 con 0x7f4e7c058040 2024-09-13T19:16:37.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.165+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 23 ==== osd_op_reply(102 gc.12 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.165+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:103 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc752cb0 con 0x7f4e7c058040 2024-09-13T19:16:37.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.166+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 24 ==== osd_op_reply(103 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.166+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:16:37.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.166+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:104 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc752cb0 con 0x7f4e7c058040 2024-09-13T19:16:37.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.166+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 25 ==== osd_op_reply(104 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.166+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.166+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:105 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc752cb0 con 0x7f4e7c058040 2024-09-13T19:16:37.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.167+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 26 ==== osd_op_reply(105 gc.12 [call] v36'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.167+0000 7f4e87615800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2024-09-13T19:16:37.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.167+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:106 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc752cb0 con 0x7f4e740665d0 2024-09-13T19:16:37.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.168+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 27 ==== osd_op_reply(106 gc.13 [call] v36'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.168+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:107 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc752cb0 con 0x7f4e740665d0 2024-09-13T19:16:37.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.168+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 28 ==== osd_op_reply(107 gc.13 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.168+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.168+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:108 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc751ca0 con 0x7f4e740665d0 2024-09-13T19:16:37.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.169+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 29 ==== osd_op_reply(108 gc.13 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.169+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:109 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc752cb0 con 0x7f4e740665d0 2024-09-13T19:16:37.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.169+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 30 ==== osd_op_reply(109 gc.13 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.169+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:16:37.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.169+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:110 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc752cb0 con 0x7f4e740665d0 2024-09-13T19:16:37.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.169+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 31 ==== osd_op_reply(110 gc.13 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.169+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.169+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:111 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc752cb0 con 0x7f4e740665d0 2024-09-13T19:16:37.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.171+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 32 ==== osd_op_reply(111 gc.13 [call] v36'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.171+0000 7f4e87615800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2024-09-13T19:16:37.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.171+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:112 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc752cb0 con 0x5599cc708bd0 2024-09-13T19:16:37.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.172+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(112 gc.14 [call] v36'161 uv161 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.172+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:113 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc752cb0 con 0x5599cc708bd0 2024-09-13T19:16:37.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.172+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 28 ==== osd_op_reply(113 gc.14 [call out=15b] v0'0 uv161 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.172+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.172+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:114 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc751ca0 con 0x5599cc708bd0 2024-09-13T19:16:37.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.172+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 29 ==== osd_op_reply(114 gc.14 [call out=24b] v0'0 uv161 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.172+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:115 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc752cb0 con 0x5599cc708bd0 2024-09-13T19:16:37.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.172+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 30 ==== osd_op_reply(115 gc.14 [call out=15b] v0'0 uv161 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.172+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:16:37.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.172+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:116 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc752cb0 con 0x5599cc708bd0 2024-09-13T19:16:37.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.172+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 31 ==== osd_op_reply(116 gc.14 [call out=15b] v0'0 uv161 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.172+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.172+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:117 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc752cb0 con 0x5599cc708bd0 2024-09-13T19:16:37.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.173+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 32 ==== osd_op_reply(117 gc.14 [call] v36'162 uv162 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.173+0000 7f4e87615800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2024-09-13T19:16:37.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.173+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:118 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc752cb0 con 0x5599cc70d5c0 2024-09-13T19:16:37.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.174+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 28 ==== osd_op_reply(118 gc.15 [call] v36'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.174+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:119 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc752cb0 con 0x5599cc70d5c0 2024-09-13T19:16:37.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.175+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 29 ==== osd_op_reply(119 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.175+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.175+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:120 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc751ca0 con 0x5599cc70d5c0 2024-09-13T19:16:37.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.175+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 30 ==== osd_op_reply(120 gc.15 [call out=24b] v0'0 uv44 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.175+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:121 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc752cb0 con 0x5599cc70d5c0 2024-09-13T19:16:37.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.175+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 31 ==== osd_op_reply(121 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.175+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:16:37.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.175+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:122 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc752cb0 con 0x5599cc70d5c0 2024-09-13T19:16:37.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.175+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 32 ==== osd_op_reply(122 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.175+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.175+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:123 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc752cb0 con 0x5599cc70d5c0 2024-09-13T19:16:37.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.176+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 33 ==== osd_op_reply(123 gc.15 [call] v36'45 uv45 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.176+0000 7f4e87615800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2024-09-13T19:16:37.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.176+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:124 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc752cb0 con 0x7f4e7c058040 2024-09-13T19:16:37.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.177+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 27 ==== osd_op_reply(124 gc.16 [call] v36'51 uv51 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.177+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:125 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc752cb0 con 0x7f4e7c058040 2024-09-13T19:16:37.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.178+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 28 ==== osd_op_reply(125 gc.16 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.178+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.178+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:126 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc751ca0 con 0x7f4e7c058040 2024-09-13T19:16:37.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.178+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 29 ==== osd_op_reply(126 gc.16 [call out=24b] v0'0 uv51 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.178+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:127 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc752cb0 con 0x7f4e7c058040 2024-09-13T19:16:37.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.178+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 30 ==== osd_op_reply(127 gc.16 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.178+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:16:37.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.178+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:128 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc752cb0 con 0x7f4e7c058040 2024-09-13T19:16:37.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.179+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 31 ==== osd_op_reply(128 gc.16 [call out=1701b] v0'0 uv51 ondisk = 0) ==== 149+0+1701 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.179+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-13T19:16:37.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.179+0000 7f4e87615800 20 garbage collection: RGWGC::process iterating over entry tag='509740b4-c081-4f37-bd6d-df9ca851489b.4237.3616192488651661690', time=2024-09-13T19:16:36.821463+0000, chain.objs.size()=7 2024-09-13T19:16:37.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.179+0000 7f4e87615800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1__shadow_.hcWfUtI_71tbADaoXKrrr_CNCUpDA_d_1 2024-09-13T19:16:37.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.179+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:129 3.35s0 3:ad06487a:::509740b4-c081-4f37-bd6d-df9ca851489b.4237.1__shadow_.hcWfUtI_71tbADaoXKrrr_CNCUpDA_d_1:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7532d0 con 0x5599cc708bd0 2024-09-13T19:16:37.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.179+0000 7f4e87615800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1__shadow_.hcWfUtI_71tbADaoXKrrr_CNCUpDA_d_2 2024-09-13T19:16:37.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.179+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:130 3.16s0 3:68c4eaa4:::509740b4-c081-4f37-bd6d-df9ca851489b.4237.1__shadow_.hcWfUtI_71tbADaoXKrrr_CNCUpDA_d_2:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc755fa0 con 0x7f4e7c058040 2024-09-13T19:16:37.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.179+0000 7f4e87615800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1__shadow_.hcWfUtI_71tbADaoXKrrr_CNCUpDA_d_3 2024-09-13T19:16:37.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.179+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:131 3.1s0 3:80775fee:::509740b4-c081-4f37-bd6d-df9ca851489b.4237.1__shadow_.hcWfUtI_71tbADaoXKrrr_CNCUpDA_d_3:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7588d0 con 0x7f4e740665d0 2024-09-13T19:16:37.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.179+0000 7f4e87615800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1__shadow_.hcWfUtI_71tbADaoXKrrr_CNCUpDA_d_4 2024-09-13T19:16:37.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.179+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:132 3.25s0 3:a43c323c:::509740b4-c081-4f37-bd6d-df9ca851489b.4237.1__shadow_.hcWfUtI_71tbADaoXKrrr_CNCUpDA_d_4:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc75b140 con 0x5599cc708bd0 2024-09-13T19:16:37.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.179+0000 7f4e87615800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1__shadow_.hcWfUtI_71tbADaoXKrrr_CNCUpDA_d_5 2024-09-13T19:16:37.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.179+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:133 3.15s0 3:aa994d9a:::509740b4-c081-4f37-bd6d-df9ca851489b.4237.1__shadow_.hcWfUtI_71tbADaoXKrrr_CNCUpDA_d_5:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc75db90 con 0x7f4e7c058040 2024-09-13T19:16:37.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.179+0000 7f4e87615800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1__shadow_.hcWfUtI_71tbADaoXKrrr_CNCUpDA_d_6 2024-09-13T19:16:37.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.179+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:134 3.17s0 3:eab8d4f2:::509740b4-c081-4f37-bd6d-df9ca851489b.4237.1__shadow_.hcWfUtI_71tbADaoXKrrr_CNCUpDA_d_6:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7604c0 con 0x5599cc708bd0 2024-09-13T19:16:37.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.179+0000 7f4e87615800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:509740b4-c081-4f37-bd6d-df9ca851489b.4237.1__shadow_.hcWfUtI_71tbADaoXKrrr_CNCUpDA_d_7 2024-09-13T19:16:37.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.179+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:135 3.cs0 3:3371b7cb:::509740b4-c081-4f37-bd6d-df9ca851489b.4237.1__shadow_.hcWfUtI_71tbADaoXKrrr_CNCUpDA_d_7:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7604c0 con 0x5599cc70d5c0 2024-09-13T19:16:37.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.181+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 33 ==== osd_op_reply(134 509740b4-c081-4f37-bd6d-df9ca851489b.4237.1__shadow_.hcWfUtI_71tbADaoXKrrr_CNCUpDA_d_6 [call] v36'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.181+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 32 ==== osd_op_reply(130 509740b4-c081-4f37-bd6d-df9ca851489b.4237.1__shadow_.hcWfUtI_71tbADaoXKrrr_CNCUpDA_d_2 [call] v36'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.181+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 33 ==== osd_op_reply(131 509740b4-c081-4f37-bd6d-df9ca851489b.4237.1__shadow_.hcWfUtI_71tbADaoXKrrr_CNCUpDA_d_3 [call] v36'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.182+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 34 ==== osd_op_reply(132 509740b4-c081-4f37-bd6d-df9ca851489b.4237.1__shadow_.hcWfUtI_71tbADaoXKrrr_CNCUpDA_d_4 [call] v36'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.183+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 34 ==== osd_op_reply(135 509740b4-c081-4f37-bd6d-df9ca851489b.4237.1__shadow_.hcWfUtI_71tbADaoXKrrr_CNCUpDA_d_7 [call] v36'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.183+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 35 ==== osd_op_reply(129 509740b4-c081-4f37-bd6d-df9ca851489b.4237.1__shadow_.hcWfUtI_71tbADaoXKrrr_CNCUpDA_d_1 [call] v36'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.184+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 33 ==== osd_op_reply(133 509740b4-c081-4f37-bd6d-df9ca851489b.4237.1__shadow_.hcWfUtI_71tbADaoXKrrr_CNCUpDA_d_5 [call] v36'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.184+0000 7f4e87615800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-13T19:16:37.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.184+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:136 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc75db90 con 0x7f4e7c058040 2024-09-13T19:16:37.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.186+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 34 ==== osd_op_reply(136 gc.16 [call] v36'52 uv52 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.186+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:137 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc75db90 con 0x7f4e7c058040 2024-09-13T19:16:37.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.187+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 35 ==== osd_op_reply(137 gc.16 [call] v36'53 uv53 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.187+0000 7f4e87615800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2024-09-13T19:16:37.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.187+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:138 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc75db90 con 0x5599cc70d5c0 2024-09-13T19:16:37.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.188+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 35 ==== osd_op_reply(138 gc.17 [call] v36'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.188+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:139 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc75db90 con 0x5599cc70d5c0 2024-09-13T19:16:37.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.188+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 36 ==== osd_op_reply(139 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.188+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.188+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:140 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc75db90 con 0x5599cc70d5c0 2024-09-13T19:16:37.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.188+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 37 ==== osd_op_reply(140 gc.17 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.188+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:141 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc75db90 con 0x5599cc70d5c0 2024-09-13T19:16:37.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.188+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 38 ==== osd_op_reply(141 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.188+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:16:37.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.188+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:142 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc75db90 con 0x5599cc70d5c0 2024-09-13T19:16:37.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.189+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 39 ==== osd_op_reply(142 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.189+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.189+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:143 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc75db90 con 0x5599cc70d5c0 2024-09-13T19:16:37.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.190+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 40 ==== osd_op_reply(143 gc.17 [call] v36'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.190+0000 7f4e87615800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2024-09-13T19:16:37.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.190+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:144 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc75db90 con 0x5599cc708bd0 2024-09-13T19:16:37.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.191+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 36 ==== osd_op_reply(144 gc.18 [call] v36'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.191+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:145 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc75db90 con 0x5599cc708bd0 2024-09-13T19:16:37.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.192+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 37 ==== osd_op_reply(145 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.192+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.192+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:146 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc75db90 con 0x5599cc708bd0 2024-09-13T19:16:37.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.192+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 38 ==== osd_op_reply(146 gc.18 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.192+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:147 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc75db90 con 0x5599cc708bd0 2024-09-13T19:16:37.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.192+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 39 ==== osd_op_reply(147 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.192+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:16:37.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.192+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc75db90 con 0x5599cc708bd0 2024-09-13T19:16:37.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.192+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 40 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.192+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.192+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc75db90 con 0x5599cc708bd0 2024-09-13T19:16:37.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.193+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 41 ==== osd_op_reply(149 gc.18 [call] v36'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.193+0000 7f4e87615800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2024-09-13T19:16:37.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.193+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:150 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc75db90 con 0x5599cc708bd0 2024-09-13T19:16:37.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.194+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 42 ==== osd_op_reply(150 gc.19 [call] v36'163 uv163 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.194+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc75db90 con 0x5599cc708bd0 2024-09-13T19:16:37.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.195+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 43 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.195+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.195+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc75db90 con 0x5599cc708bd0 2024-09-13T19:16:37.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.195+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 44 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv163 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.195+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc75db90 con 0x5599cc708bd0 2024-09-13T19:16:37.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.195+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 45 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.195+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:16:37.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.195+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:154 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc75db90 con 0x5599cc708bd0 2024-09-13T19:16:37.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.195+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 46 ==== osd_op_reply(154 gc.19 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.195+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.195+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:155 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc75db90 con 0x5599cc708bd0 2024-09-13T19:16:37.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.196+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 47 ==== osd_op_reply(155 gc.19 [call] v36'164 uv164 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.196+0000 7f4e87615800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2024-09-13T19:16:37.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.196+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc75db90 con 0x5599cc70d5c0 2024-09-13T19:16:37.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.197+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 41 ==== osd_op_reply(156 gc.20 [call] v36'46 uv46 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.197+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:157 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc75db90 con 0x5599cc70d5c0 2024-09-13T19:16:37.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.198+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 42 ==== osd_op_reply(157 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.198+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.198+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:158 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc75db90 con 0x5599cc70d5c0 2024-09-13T19:16:37.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.198+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 43 ==== osd_op_reply(158 gc.20 [call out=24b] v0'0 uv46 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.198+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:159 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc75db90 con 0x5599cc70d5c0 2024-09-13T19:16:37.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.198+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 44 ==== osd_op_reply(159 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.198+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:16:37.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.198+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:160 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc75db90 con 0x5599cc70d5c0 2024-09-13T19:16:37.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.198+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 45 ==== osd_op_reply(160 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.198+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.198+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:161 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc75db90 con 0x5599cc70d5c0 2024-09-13T19:16:37.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.200+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 46 ==== osd_op_reply(161 gc.20 [call] v36'47 uv47 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.200+0000 7f4e87615800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2024-09-13T19:16:37.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.200+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:162 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc75db90 con 0x7f4e7c058040 2024-09-13T19:16:37.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.201+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 36 ==== osd_op_reply(162 gc.21 [call] v36'30 uv30 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.201+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:163 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc75db90 con 0x7f4e7c058040 2024-09-13T19:16:37.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.201+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 37 ==== osd_op_reply(163 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.201+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.201+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:164 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7547a0 con 0x7f4e7c058040 2024-09-13T19:16:37.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.201+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 38 ==== osd_op_reply(164 gc.21 [call out=24b] v0'0 uv30 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.201+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:165 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7547a0 con 0x7f4e7c058040 2024-09-13T19:16:37.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.201+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 39 ==== osd_op_reply(165 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.201+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:16:37.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.201+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:166 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7547a0 con 0x7f4e7c058040 2024-09-13T19:16:37.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.202+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 40 ==== osd_op_reply(166 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.202+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.202+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:167 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x7f4e7c058040 2024-09-13T19:16:37.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.202+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 41 ==== osd_op_reply(167 gc.21 [call] v36'31 uv31 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.202+0000 7f4e87615800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2024-09-13T19:16:37.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.202+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:168 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.203+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 47 ==== osd_op_reply(168 gc.22 [call] v36'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.203+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:169 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.204+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 48 ==== osd_op_reply(169 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.204+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.204+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:170 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.204+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 49 ==== osd_op_reply(170 gc.22 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.204+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:171 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.204+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 50 ==== osd_op_reply(171 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.204+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:16:37.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.204+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:172 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.204+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 51 ==== osd_op_reply(172 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.204+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.204+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:173 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.205+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 52 ==== osd_op_reply(173 gc.22 [call] v36'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.205+0000 7f4e87615800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2024-09-13T19:16:37.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.205+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:174 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.206+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 53 ==== osd_op_reply(174 gc.23 [call] v36'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.206+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:175 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.206+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 54 ==== osd_op_reply(175 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.206+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.206+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:176 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.207+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 55 ==== osd_op_reply(176 gc.23 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.207+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:177 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.207+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 56 ==== osd_op_reply(177 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.207+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:16:37.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.207+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:178 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.207+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 57 ==== osd_op_reply(178 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.207+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.207+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:179 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.208+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 58 ==== osd_op_reply(179 gc.23 [call] v36'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.208+0000 7f4e87615800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2024-09-13T19:16:37.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.208+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:180 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.209+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 59 ==== osd_op_reply(180 gc.24 [call] v36'16 uv16 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.209+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:181 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.209+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 60 ==== osd_op_reply(181 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.209+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.209+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:182 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.209+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 61 ==== osd_op_reply(182 gc.24 [call out=24b] v0'0 uv16 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.209+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:183 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.210+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 62 ==== osd_op_reply(183 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.210+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:16:37.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.210+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:184 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.210+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 63 ==== osd_op_reply(184 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.210+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.210+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:185 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.211+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 64 ==== osd_op_reply(185 gc.24 [call] v36'17 uv17 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.211+0000 7f4e87615800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2024-09-13T19:16:37.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.211+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:186 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.212+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 65 ==== osd_op_reply(186 gc.25 [call] v36'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.212+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:187 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.212+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 66 ==== osd_op_reply(187 gc.25 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.212+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.212+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:188 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.212+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 67 ==== osd_op_reply(188 gc.25 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.212+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:189 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.212+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 68 ==== osd_op_reply(189 gc.25 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.212+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:16:37.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.212+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:190 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.213+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 69 ==== osd_op_reply(190 gc.25 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.213+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.213+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:191 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.214+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 70 ==== osd_op_reply(191 gc.25 [call] v36'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.214+0000 7f4e87615800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2024-09-13T19:16:37.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.214+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:192 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x7f4e740665d0 2024-09-13T19:16:37.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.215+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 34 ==== osd_op_reply(192 gc.26 [call] v36'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.215+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:193 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x7f4e740665d0 2024-09-13T19:16:37.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.215+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 35 ==== osd_op_reply(193 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.215+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.215+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:194 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x7f4e740665d0 2024-09-13T19:16:37.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.215+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 36 ==== osd_op_reply(194 gc.26 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.215+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:195 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x7f4e740665d0 2024-09-13T19:16:37.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.216+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 37 ==== osd_op_reply(195 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.216+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:16:37.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.216+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:196 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x7f4e740665d0 2024-09-13T19:16:37.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.216+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 38 ==== osd_op_reply(196 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.216+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.216+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:197 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x7f4e740665d0 2024-09-13T19:16:37.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.217+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 39 ==== osd_op_reply(197 gc.26 [call] v36'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.217+0000 7f4e87615800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2024-09-13T19:16:37.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.217+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:198 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.218+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 71 ==== osd_op_reply(198 gc.27 [call] v36'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.218+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:199 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.218+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 72 ==== osd_op_reply(199 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.218+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.218+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:200 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.218+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 73 ==== osd_op_reply(200 gc.27 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.218+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:201 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.219+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 74 ==== osd_op_reply(201 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.219+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:16:37.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.219+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:202 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.219+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 75 ==== osd_op_reply(202 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.219+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.219+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:203 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.220+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 76 ==== osd_op_reply(203 gc.27 [call] v36'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.220+0000 7f4e87615800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2024-09-13T19:16:37.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.220+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:204 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x7f4e740665d0 2024-09-13T19:16:37.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.221+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 40 ==== osd_op_reply(204 gc.28 [call] v36'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.221+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:205 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x7f4e740665d0 2024-09-13T19:16:37.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.221+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 41 ==== osd_op_reply(205 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.221+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.221+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:206 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x7f4e740665d0 2024-09-13T19:16:37.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.221+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 42 ==== osd_op_reply(206 gc.28 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.222+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:207 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x7f4e740665d0 2024-09-13T19:16:37.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.222+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 43 ==== osd_op_reply(207 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.222+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:16:37.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.222+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:208 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x7f4e740665d0 2024-09-13T19:16:37.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.222+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 44 ==== osd_op_reply(208 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.222+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.222+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:209 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x7f4e740665d0 2024-09-13T19:16:37.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.223+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 45 ==== osd_op_reply(209 gc.28 [call] v36'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.223+0000 7f4e87615800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2024-09-13T19:16:37.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.223+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:210 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.224+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 77 ==== osd_op_reply(210 gc.29 [call] v36'48 uv48 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.224+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:211 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.224+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 78 ==== osd_op_reply(211 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.224+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.224+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:212 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.224+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 79 ==== osd_op_reply(212 gc.29 [call out=24b] v0'0 uv48 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.224+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:213 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.225+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 80 ==== osd_op_reply(213 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.225+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:16:37.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.225+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:214 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.225+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 81 ==== osd_op_reply(214 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.225+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.225+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:215 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.226+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 82 ==== osd_op_reply(215 gc.29 [call] v36'49 uv49 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.226+0000 7f4e87615800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2024-09-13T19:16:37.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.226+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:216 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x7f4e740665d0 2024-09-13T19:16:37.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.227+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 46 ==== osd_op_reply(216 gc.30 [call] v36'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.227+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:217 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x7f4e740665d0 2024-09-13T19:16:37.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.227+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 47 ==== osd_op_reply(217 gc.30 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.227+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.227+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:218 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x7f4e740665d0 2024-09-13T19:16:37.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.227+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 48 ==== osd_op_reply(218 gc.30 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.228+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:219 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x7f4e740665d0 2024-09-13T19:16:37.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.228+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 49 ==== osd_op_reply(219 gc.30 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.228+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:16:37.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.228+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:220 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x7f4e740665d0 2024-09-13T19:16:37.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.228+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 50 ==== osd_op_reply(220 gc.30 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.228+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.228+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:221 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x7f4e740665d0 2024-09-13T19:16:37.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.229+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 51 ==== osd_op_reply(221 gc.30 [call] v36'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.229+0000 7f4e87615800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2024-09-13T19:16:37.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.229+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:222 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x7f4e7c058040 2024-09-13T19:16:37.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.230+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 42 ==== osd_op_reply(222 gc.31 [call] v36'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.230+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:223 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x7f4e7c058040 2024-09-13T19:16:37.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.230+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 43 ==== osd_op_reply(223 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.230+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.230+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:224 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7547a0 con 0x7f4e7c058040 2024-09-13T19:16:37.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.230+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 44 ==== osd_op_reply(224 gc.31 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.231+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:225 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7547a0 con 0x7f4e7c058040 2024-09-13T19:16:37.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.231+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 45 ==== osd_op_reply(225 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.231+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:16:37.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.231+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:226 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7547a0 con 0x7f4e7c058040 2024-09-13T19:16:37.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.231+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 46 ==== osd_op_reply(226 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.231+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.231+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:227 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x7f4e7c058040 2024-09-13T19:16:37.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.232+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 47 ==== osd_op_reply(227 gc.31 [call] v36'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.232+0000 7f4e87615800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2024-09-13T19:16:37.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.232+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:228 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc708bd0 2024-09-13T19:16:37.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.233+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 48 ==== osd_op_reply(228 gc.0 [call] v36'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.233+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:229 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc708bd0 2024-09-13T19:16:37.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.233+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 49 ==== osd_op_reply(229 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.233+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.233+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:230 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc708bd0 2024-09-13T19:16:37.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.234+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 50 ==== osd_op_reply(230 gc.0 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.234+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:231 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc708bd0 2024-09-13T19:16:37.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.234+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 51 ==== osd_op_reply(231 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.234+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:16:37.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.234+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:232 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc708bd0 2024-09-13T19:16:37.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.234+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 52 ==== osd_op_reply(232 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.234+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.234+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:233 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc708bd0 2024-09-13T19:16:37.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.235+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 53 ==== osd_op_reply(233 gc.0 [call] v36'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.235+0000 7f4e87615800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2024-09-13T19:16:37.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.235+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:234 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x7f4e740665d0 2024-09-13T19:16:37.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.236+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 52 ==== osd_op_reply(234 gc.1 [call] v36'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.236+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:235 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x7f4e740665d0 2024-09-13T19:16:37.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.237+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 53 ==== osd_op_reply(235 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.237+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.237+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:236 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x7f4e740665d0 2024-09-13T19:16:37.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.237+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 54 ==== osd_op_reply(236 gc.1 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.237+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:237 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x7f4e740665d0 2024-09-13T19:16:37.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.237+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 55 ==== osd_op_reply(237 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.237+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:16:37.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.237+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:238 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x7f4e740665d0 2024-09-13T19:16:37.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.237+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 56 ==== osd_op_reply(238 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.237+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.237+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:239 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x7f4e740665d0 2024-09-13T19:16:37.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.238+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 57 ==== osd_op_reply(239 gc.1 [call] v36'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.238+0000 7f4e87615800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2024-09-13T19:16:37.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.238+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:240 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.239+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 83 ==== osd_op_reply(240 gc.2 [call] v36'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.239+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:241 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.240+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 84 ==== osd_op_reply(241 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.240+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.240+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:242 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.240+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 85 ==== osd_op_reply(242 gc.2 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.240+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:243 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.240+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 86 ==== osd_op_reply(243 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.240+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:16:37.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.240+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:244 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.240+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 87 ==== osd_op_reply(244 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.240+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.240+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:245 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.242+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 88 ==== osd_op_reply(245 gc.2 [call] v36'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.242+0000 7f4e87615800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2024-09-13T19:16:37.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.242+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:246 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc708bd0 2024-09-13T19:16:37.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.243+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 54 ==== osd_op_reply(246 gc.3 [call] v36'165 uv165 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.243+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:247 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc708bd0 2024-09-13T19:16:37.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.243+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 55 ==== osd_op_reply(247 gc.3 [call out=15b] v0'0 uv165 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.243+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.243+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:248 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc708bd0 2024-09-13T19:16:37.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.244+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 56 ==== osd_op_reply(248 gc.3 [call out=24b] v0'0 uv165 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.244+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:249 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc708bd0 2024-09-13T19:16:37.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.244+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 57 ==== osd_op_reply(249 gc.3 [call out=15b] v0'0 uv165 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.244+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:16:37.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.244+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:250 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc708bd0 2024-09-13T19:16:37.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.244+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 58 ==== osd_op_reply(250 gc.3 [call out=15b] v0'0 uv165 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.244+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.244+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:251 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc708bd0 2024-09-13T19:16:37.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.245+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 59 ==== osd_op_reply(251 gc.3 [call] v36'166 uv166 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.245+0000 7f4e87615800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2024-09-13T19:16:37.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.245+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:252 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x7f4e7c058040 2024-09-13T19:16:37.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.246+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 48 ==== osd_op_reply(252 gc.4 [call] v36'54 uv54 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.246+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:253 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x7f4e7c058040 2024-09-13T19:16:37.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.246+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 49 ==== osd_op_reply(253 gc.4 [call out=15b] v0'0 uv54 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.246+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.246+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:254 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7547a0 con 0x7f4e7c058040 2024-09-13T19:16:37.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.246+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 50 ==== osd_op_reply(254 gc.4 [call out=24b] v0'0 uv54 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.246+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:255 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7547a0 con 0x7f4e7c058040 2024-09-13T19:16:37.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.247+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 51 ==== osd_op_reply(255 gc.4 [call out=15b] v0'0 uv54 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.247+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:16:37.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.247+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:256 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7547a0 con 0x7f4e7c058040 2024-09-13T19:16:37.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.247+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 52 ==== osd_op_reply(256 gc.4 [call out=15b] v0'0 uv54 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.247+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.247+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:257 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x7f4e7c058040 2024-09-13T19:16:37.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.248+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 53 ==== osd_op_reply(257 gc.4 [call] v36'55 uv55 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.248+0000 7f4e87615800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2024-09-13T19:16:37.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.248+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:258 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.249+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 89 ==== osd_op_reply(258 gc.5 [call] v36'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.249+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:259 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.249+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 90 ==== osd_op_reply(259 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.249+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.249+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:260 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.249+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 91 ==== osd_op_reply(260 gc.5 [call out=24b] v0'0 uv36 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.249+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:261 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.249+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 92 ==== osd_op_reply(261 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.249+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:16:37.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.249+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:262 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.250+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 93 ==== osd_op_reply(262 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.250+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.250+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:263 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.251+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 94 ==== osd_op_reply(263 gc.5 [call] v36'37 uv37 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.251+0000 7f4e87615800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2024-09-13T19:16:37.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.251+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:264 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc708bd0 2024-09-13T19:16:37.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.252+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 60 ==== osd_op_reply(264 gc.6 [call] v36'22 uv22 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.252+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:265 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc708bd0 2024-09-13T19:16:37.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.252+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 61 ==== osd_op_reply(265 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.252+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.252+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:266 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc708bd0 2024-09-13T19:16:37.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.252+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 62 ==== osd_op_reply(266 gc.6 [call out=24b] v0'0 uv22 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.252+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:267 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc708bd0 2024-09-13T19:16:37.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.252+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 63 ==== osd_op_reply(267 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.252+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:16:37.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.252+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:268 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc708bd0 2024-09-13T19:16:37.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.253+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 64 ==== osd_op_reply(268 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.253+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.253+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:269 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc708bd0 2024-09-13T19:16:37.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.253+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 65 ==== osd_op_reply(269 gc.6 [call] v36'23 uv23 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.254+0000 7f4e87615800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2024-09-13T19:16:37.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.254+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:270 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x7f4e740665d0 2024-09-13T19:16:37.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.255+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 58 ==== osd_op_reply(270 gc.7 [call] v36'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.255+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:271 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x7f4e740665d0 2024-09-13T19:16:37.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.255+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 59 ==== osd_op_reply(271 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.255+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.255+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:272 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x7f4e740665d0 2024-09-13T19:16:37.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.255+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 60 ==== osd_op_reply(272 gc.7 [call out=24b] v0'0 uv35 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.255+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:273 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x7f4e740665d0 2024-09-13T19:16:37.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.255+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 61 ==== osd_op_reply(273 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.255+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:16:37.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.255+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:274 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x7f4e740665d0 2024-09-13T19:16:37.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.256+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 62 ==== osd_op_reply(274 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.256+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.256+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:275 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x7f4e740665d0 2024-09-13T19:16:37.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.256+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 63 ==== osd_op_reply(275 gc.7 [call] v36'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.256+0000 7f4e87615800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2024-09-13T19:16:37.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.256+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:276 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x7f4e7c058040 2024-09-13T19:16:37.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.257+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 54 ==== osd_op_reply(276 gc.8 [call] v36'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.258+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:277 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x7f4e7c058040 2024-09-13T19:16:37.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.258+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 55 ==== osd_op_reply(277 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.258+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.258+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:278 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7547a0 con 0x7f4e7c058040 2024-09-13T19:16:37.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.258+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 56 ==== osd_op_reply(278 gc.8 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.258+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:279 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7547a0 con 0x7f4e7c058040 2024-09-13T19:16:37.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.258+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 57 ==== osd_op_reply(279 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.258+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:16:37.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.258+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:280 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7547a0 con 0x7f4e7c058040 2024-09-13T19:16:37.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.258+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 58 ==== osd_op_reply(280 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.258+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.258+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:281 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x7f4e7c058040 2024-09-13T19:16:37.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.259+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 59 ==== osd_op_reply(281 gc.8 [call] v36'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.259+0000 7f4e87615800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2024-09-13T19:16:37.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.260+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:282 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.261+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 95 ==== osd_op_reply(282 gc.9 [call] v36'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.261+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:283 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.261+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 96 ==== osd_op_reply(283 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.261+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.261+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:284 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.261+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 97 ==== osd_op_reply(284 gc.9 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.261+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:285 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.261+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 98 ==== osd_op_reply(285 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.261+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:16:37.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.261+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:286 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.261+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 99 ==== osd_op_reply(286 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.261+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.261+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:287 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.262+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 100 ==== osd_op_reply(287 gc.9 [call] v36'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.262+0000 7f4e87615800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2024-09-13T19:16:37.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.262+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:288 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x7f4e7c058040 2024-09-13T19:16:37.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.263+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 60 ==== osd_op_reply(288 gc.10 [call] v36'56 uv56 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.263+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:289 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x7f4e7c058040 2024-09-13T19:16:37.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.264+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 61 ==== osd_op_reply(289 gc.10 [call out=15b] v0'0 uv56 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.264+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.264+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:290 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7547a0 con 0x7f4e7c058040 2024-09-13T19:16:37.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.264+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 62 ==== osd_op_reply(290 gc.10 [call out=24b] v0'0 uv56 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.264+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:291 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7547a0 con 0x7f4e7c058040 2024-09-13T19:16:37.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.264+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 63 ==== osd_op_reply(291 gc.10 [call out=15b] v0'0 uv56 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.264+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:16:37.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.264+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:292 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7547a0 con 0x7f4e7c058040 2024-09-13T19:16:37.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.264+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 64 ==== osd_op_reply(292 gc.10 [call out=15b] v0'0 uv56 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.264+0000 7f4e87615800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:16:37.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.264+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:293 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x7f4e7c058040 2024-09-13T19:16:37.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.265+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 65 ==== osd_op_reply(293 gc.10 [call] v36'57 uv57 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.266+0000 7f4d397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:37.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.266+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94119048352272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc708bd0 2024-09-13T19:16:37.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.267+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 66 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94119048352272] v36'167 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.267+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94119048328240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x7f4e7c058040 2024-09-13T19:16:37.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.268+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 66 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94119048328240] v36'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.268+0000 7f4e87615800 20 remove_watcher() i=0 2024-09-13T19:16:37.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.268+0000 7f4e87615800 2 removed watcher, disabling cache 2024-09-13T19:16:37.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.268+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94119048330496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc708bd0 2024-09-13T19:16:37.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.269+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 67 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94119048330496] v36'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.269+0000 7f4e87615800 20 remove_watcher() i=1 2024-09-13T19:16:37.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.269+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94119048334576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x5599cc70d5c0 2024-09-13T19:16:37.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.270+0000 7f4e8359d640 1 -- 172.21.15.102:0/510752663 <== osd.3 v2:172.21.15.102:6800/3096737090 101 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94119048334576] v36'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e7c03b030 con 0x5599cc70d5c0 2024-09-13T19:16:37.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.270+0000 7f4e87615800 20 remove_watcher() i=2 2024-09-13T19:16:37.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.270+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94119048341296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc750e00 con 0x7f4e7c058040 2024-09-13T19:16:37.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.271+0000 7f4e82d9c640 1 -- 172.21.15.102:0/510752663 <== osd.2 v2:172.21.15.102:6816/2238176080 67 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94119048341296] v36'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e74081040 con 0x7f4e7c058040 2024-09-13T19:16:37.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.271+0000 7f4e87615800 20 remove_watcher() i=3 2024-09-13T19:16:37.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.271+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94119048345264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc719210 con 0x5599cc708bd0 2024-09-13T19:16:37.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.272+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.1 v2:172.21.15.102:6808/2204418452 68 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94119048345264] v36'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x5599cc708bd0 2024-09-13T19:16:37.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.272+0000 7f4e87615800 20 remove_watcher() i=4 2024-09-13T19:16:37.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.272+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94119048347888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc713430 con 0x7f4e740665d0 2024-09-13T19:16:37.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.273+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 64 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94119048347888] v36'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.273+0000 7f4e87615800 20 remove_watcher() i=5 2024-09-13T19:16:37.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.273+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94119048343568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc713d00 con 0x7f4e740665d0 2024-09-13T19:16:37.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.274+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 65 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94119048343568] v36'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.274+0000 7f4e87615800 20 remove_watcher() i=6 2024-09-13T19:16:37.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.274+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94119048346320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599cc7176b0 con 0x7f4e740665d0 2024-09-13T19:16:37.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.275+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 <== osd.0 v2:172.21.15.53:6800/4021716951 66 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94119048346320] v36'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e6c029040 con 0x7f4e740665d0 2024-09-13T19:16:37.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.275+0000 7f4e87615800 20 remove_watcher() i=7 2024-09-13T19:16:37.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.276+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f4e740665d0 msgr2=0x7f4e740783f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.276+0000 7f4e87615800 1 --2- 172.21.15.102:0/510752663 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f4e740665d0 0x7f4e740783f0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.276+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5599cc708bd0 msgr2=0x5599cc70b090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.276+0000 7f4e87615800 1 --2- 172.21.15.102:0/510752663 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5599cc708bd0 0x5599cc70b090 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.276+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f4e7c058040 msgr2=0x7f4e7c04b280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.276+0000 7f4e87615800 1 --2- 172.21.15.102:0/510752663 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f4e7c058040 0x7f4e7c04b280 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.276+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5599cc70d5c0 msgr2=0x5599cc70f9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.276+0000 7f4e87615800 1 --2- 172.21.15.102:0/510752663 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5599cc70d5c0 0x5599cc70f9b0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.276+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4d4c036aa0 msgr2=0x7f4d4c038f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.276+0000 7f4e87615800 1 --2- 172.21.15.102:0/510752663 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4d4c036aa0 0x7f4d4c038f60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4e7406ff70 tx=0x7f4e74091000 comp rx=0 tx=0).stop 2024-09-13T19:16:37.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.276+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599cc6c45c0 msgr2=0x5599cc6fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.276+0000 7f4e87615800 1 --2- 172.21.15.102:0/510752663 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599cc6c45c0 0x5599cc6fd150 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c012e50 tx=0x7f4e7c04cda0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.276+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 reap_dead start 2024-09-13T19:16:37.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.276+0000 7f4e7bfff640 1 -- 172.21.15.102:0/510752663 reap_dead start 2024-09-13T19:16:37.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.276+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 shutdown_connections 2024-09-13T19:16:37.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.276+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 >> 172.21.15.102:0/510752663 conn(0x5599cc6efe10 msgr2=0x5599cc6edee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:37.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.276+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 shutdown_connections 2024-09-13T19:16:37.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.276+0000 7f4e87615800 1 -- 172.21.15.102:0/510752663 wait complete. 2024-09-13T19:16:37.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.276+0000 7f4e87615800 1 -- 172.21.15.102:0/2163451566 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4d5c036b40 msgr2=0x7f4d5c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.276+0000 7f4e87615800 1 --2- 172.21.15.102:0/2163451566 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4d5c036b40 0x7f4d5c039000 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x5599cc6d05a0 tx=0x7f4e74056ee0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.276+0000 7f4e87615800 1 -- 172.21.15.102:0/2163451566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599cc6e6d40 msgr2=0x5599cc6e7160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.276+0000 7f4e87615800 1 --2- 172.21.15.102:0/2163451566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599cc6e6d40 0x5599cc6e7160 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x5599cc6cd0f0 tx=0x7f4e7c0167b0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.276+0000 7f4e87615800 1 -- 172.21.15.102:0/2163451566 shutdown_connections 2024-09-13T19:16:37.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.276+0000 7f4e87615800 1 --2- 172.21.15.102:0/2163451566 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4d5c036b40 0x7f4d5c039000 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.276+0000 7f4e87615800 1 --2- 172.21.15.102:0/2163451566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599cc6e6d40 0x5599cc6e7160 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.276+0000 7f4e87615800 1 -- 172.21.15.102:0/2163451566 >> 172.21.15.102:0/2163451566 conn(0x5599cc6dbcd0 msgr2=0x5599cc6de850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:37.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.276+0000 7f4e87615800 1 -- 172.21.15.102:0/2163451566 shutdown_connections 2024-09-13T19:16:37.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.276+0000 7f4e87615800 1 -- 172.21.15.102:0/2163451566 wait complete. 2024-09-13T19:16:37.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.277+0000 7f4e87615800 1 -- 172.21.15.102:0/2077400757 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5599cc5d4df0 msgr2=0x5599cc6d30b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.277+0000 7f4e87615800 1 --2- 172.21.15.102:0/2077400757 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5599cc5d4df0 0x5599cc6d30b0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.277+0000 7f4e87615800 1 -- 172.21.15.102:0/2077400757 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5599cc6d5900 msgr2=0x5599cc6d7cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.277+0000 7f4e87615800 1 --2- 172.21.15.102:0/2077400757 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5599cc6d5900 0x5599cc6d7cf0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.277+0000 7f4e87615800 1 -- 172.21.15.102:0/2077400757 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4d68036b40 msgr2=0x7f4d68039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.277+0000 7f4e87615800 1 --2- 172.21.15.102:0/2077400757 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4d68036b40 0x7f4d68039000 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c000f60 tx=0x7f4e6c0010a0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.277+0000 7f4e87615800 1 -- 172.21.15.102:0/2077400757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599cc5d44b0 msgr2=0x5599cc6cc040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.277+0000 7f4e87615800 1 --2- 172.21.15.102:0/2077400757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599cc5d44b0 0x5599cc6cc040 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f4e74045960 tx=0x7f4e74002fb0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.277+0000 7f4e87615800 1 -- 172.21.15.102:0/2077400757 shutdown_connections 2024-09-13T19:16:37.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.277+0000 7f4e87615800 1 --2- 172.21.15.102:0/2077400757 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5599cc6d5900 0x5599cc6d7cf0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.277+0000 7f4e87615800 1 --2- 172.21.15.102:0/2077400757 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5599cc5d4df0 0x5599cc6d30b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.277+0000 7f4e87615800 1 --2- 172.21.15.102:0/2077400757 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4d68036b40 0x7f4d68039000 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.277+0000 7f4e87615800 1 --2- 172.21.15.102:0/2077400757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599cc5d44b0 0x5599cc6cc040 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.277+0000 7f4e87615800 1 -- 172.21.15.102:0/2077400757 >> 172.21.15.102:0/2077400757 conn(0x5599cc5cfde0 msgr2=0x5599cc6bd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:37.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.277+0000 7f4e87615800 1 -- 172.21.15.102:0/2077400757 shutdown_connections 2024-09-13T19:16:37.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.277+0000 7f4e87615800 1 -- 172.21.15.102:0/2077400757 wait complete. 2024-09-13T19:16:37.288 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-13T19:16:37.289 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-13T19:16:37.289 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-13T19:16:37.372 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:37.372 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:37.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.370+0000 7fb94d719800 1 Processor -- start 2024-09-13T19:16:37.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.370+0000 7fb94d719800 1 -- start start 2024-09-13T19:16:37.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.370+0000 7fb94d719800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5652e0324a60 0x5652e0326e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.370+0000 7fb94d719800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5652e01dfb30 con 0x5652e0320760 2024-09-13T19:16:37.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.370+0000 7fb94d719800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5652e01c1360 con 0x5652e0324a60 2024-09-13T19:16:37.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.370+0000 7fb94aa13640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5652e0324a60 0x5652e0326e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.370+0000 7fb94aa13640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5652e0324a60 0x5652e0326e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55304/0 (socket says 172.21.15.102:55304) 2024-09-13T19:16:37.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.370+0000 7fb94aa13640 1 -- 172.21.15.102:0/1911869675 learned_addr learned my addr 172.21.15.102:0/1911869675 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:37.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.371+0000 7fb94aa13640 1 -- 172.21.15.102:0/1911869675 >> v1:172.21.15.53:6789/0 conn(0x5652e0320760 legacy=0x5652e0320b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.371+0000 7fb94aa13640 1 -- 172.21.15.102:0/1911869675 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652e01e7e00 con 0x5652e0324a60 2024-09-13T19:16:37.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.372+0000 7fb94aa13640 1 --2- 172.21.15.102:0/1911869675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652e0324a60 0x5652e0326e50 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fb93c00a520 tx=0x7fb93c045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52582ce06c753575 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.373+0000 7fb94a212640 1 -- 172.21.15.102:0/1911869675 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb93c055070 con 0x5652e0324a60 2024-09-13T19:16:37.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.373+0000 7fb94a212640 1 -- 172.21.15.102:0/1911869675 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb93c0515b0 con 0x5652e0324a60 2024-09-13T19:16:37.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.373+0000 7fb94a212640 1 -- 172.21.15.102:0/1911869675 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb93c0518d0 con 0x5652e0324a60 2024-09-13T19:16:37.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.373+0000 7fb94d719800 1 -- 172.21.15.102:0/1911869675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652e0324a60 msgr2=0x5652e0326e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.373+0000 7fb94d719800 1 --2- 172.21.15.102:0/1911869675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652e0324a60 0x5652e0326e50 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fb93c00a520 tx=0x7fb93c045ba0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.373+0000 7fb94d719800 1 -- 172.21.15.102:0/1911869675 shutdown_connections 2024-09-13T19:16:37.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.373+0000 7fb94d719800 1 --2- 172.21.15.102:0/1911869675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652e0324a60 0x5652e0326e50 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.373+0000 7fb94d719800 1 -- 172.21.15.102:0/1911869675 >> 172.21.15.102:0/1911869675 conn(0x5652e031bff0 msgr2=0x5652e031e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:37.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.373+0000 7fb94d719800 1 -- 172.21.15.102:0/1911869675 shutdown_connections 2024-09-13T19:16:37.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.373+0000 7fb94d719800 1 -- 172.21.15.102:0/1911869675 wait complete. 2024-09-13T19:16:37.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.387+0000 7fb94d719800 1 Processor -- start 2024-09-13T19:16:37.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.387+0000 7fb94d719800 1 -- start start 2024-09-13T19:16:37.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.387+0000 7fb94d719800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652e0320760 0x5652e040f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.387+0000 7fb94d719800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5652e026c330 con 0x5652e0320760 2024-09-13T19:16:37.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.387+0000 7fb94b214640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652e0320760 0x5652e040f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.387+0000 7fb94b214640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652e0320760 0x5652e040f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55312/0 (socket says 172.21.15.102:55312) 2024-09-13T19:16:37.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.387+0000 7fb94b214640 1 -- 172.21.15.102:0/3138826359 learned_addr learned my addr 172.21.15.102:0/3138826359 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:37.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.388+0000 7fb94b214640 1 -- 172.21.15.102:0/3138826359 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652e01b9bc0 con 0x5652e0320760 2024-09-13T19:16:37.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.388+0000 7fb94b214640 1 --2- 172.21.15.102:0/3138826359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652e0320760 0x5652e040f860 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fb934001d50 tx=0x7fb93400b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=895e9b989efa5c08 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.388+0000 7fb83960a640 1 -- 172.21.15.102:0/3138826359 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb93400f400 con 0x5652e0320760 2024-09-13T19:16:37.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.388+0000 7fb83960a640 1 -- 172.21.15.102:0/3138826359 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb93400f5a0 con 0x5652e0320760 2024-09-13T19:16:37.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.388+0000 7fb83960a640 1 -- 172.21.15.102:0/3138826359 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb93400f7d0 con 0x5652e0320760 2024-09-13T19:16:37.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.389+0000 7fb94d719800 1 -- 172.21.15.102:0/3138826359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652e0320760 msgr2=0x5652e040f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.389+0000 7fb94d719800 1 --2- 172.21.15.102:0/3138826359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652e0320760 0x5652e040f860 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fb934001d50 tx=0x7fb93400b5b0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.389+0000 7fb94d719800 1 -- 172.21.15.102:0/3138826359 shutdown_connections 2024-09-13T19:16:37.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.389+0000 7fb94d719800 1 --2- 172.21.15.102:0/3138826359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652e0320760 0x5652e040f860 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.389+0000 7fb94d719800 1 -- 172.21.15.102:0/3138826359 >> 172.21.15.102:0/3138826359 conn(0x5652e031bff0 msgr2=0x5652e040b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:37.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.389+0000 7fb94d719800 1 -- 172.21.15.102:0/3138826359 shutdown_connections 2024-09-13T19:16:37.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.389+0000 7fb94d719800 1 -- 172.21.15.102:0/3138826359 wait complete. 2024-09-13T19:16:37.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.389+0000 7fb94d719800 1 Processor -- start 2024-09-13T19:16:37.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.389+0000 7fb94d719800 1 -- start start 2024-09-13T19:16:37.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.389+0000 7fb94d719800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652e0320760 0x5652e0417290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.389+0000 7fb94d719800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5652e0327690 con 0x5652e0320760 2024-09-13T19:16:37.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.389+0000 7fb94b214640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652e0320760 0x5652e0417290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.389+0000 7fb94b214640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652e0320760 0x5652e0417290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55314/0 (socket says 172.21.15.102:55314) 2024-09-13T19:16:37.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.390+0000 7fb94b214640 1 -- 172.21.15.102:0/2136315643 learned_addr learned my addr 172.21.15.102:0/2136315643 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:37.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.390+0000 7fb94b214640 1 -- 172.21.15.102:0/2136315643 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652e01cdfe0 con 0x5652e0320760 2024-09-13T19:16:37.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.390+0000 7fb94b214640 1 --2- 172.21.15.102:0/2136315643 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652e0320760 0x5652e0417290 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fb93400b5f0 tx=0x7fb934000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.390+0000 7fb837e07640 1 -- 172.21.15.102:0/2136315643 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb93401a7c0 con 0x5652e0320760 2024-09-13T19:16:37.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.390+0000 7fb837e07640 1 -- 172.21.15.102:0/2136315643 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb93401a960 con 0x5652e0320760 2024-09-13T19:16:37.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.390+0000 7fb94d719800 1 -- 172.21.15.102:0/2136315643 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5652e04177d0 con 0x5652e0320760 2024-09-13T19:16:37.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.390+0000 7fb837e07640 1 -- 172.21.15.102:0/2136315643 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb93401ac40 con 0x5652e0320760 2024-09-13T19:16:37.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.390+0000 7fb94d719800 1 -- 172.21.15.102:0/2136315643 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652e0417d50 con 0x5652e0320760 2024-09-13T19:16:37.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.391+0000 7fb837e07640 1 -- 172.21.15.102:0/2136315643 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb934017070 con 0x5652e0320760 2024-09-13T19:16:37.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.391+0000 7fb837e07640 1 --2- 172.21.15.102:0/2136315643 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb830036b40 0x7fb830039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.391+0000 7fb837e07640 1 -- 172.21.15.102:0/2136315643 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fb934015020 con 0x5652e0320760 2024-09-13T19:16:37.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.391+0000 7fb94aa13640 1 --2- 172.21.15.102:0/2136315643 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb830036b40 0x7fb830039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.392+0000 7fb94d719800 1 --2- 172.21.15.102:0/2136315643 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5652e0324a60 0x5652e041e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.392+0000 7fb94d719800 1 -- 172.21.15.102:0/2136315643 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e041e880 con 0x5652e0324a60 2024-09-13T19:16:37.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.392+0000 7fb94ba15640 1 --2- 172.21.15.102:0/2136315643 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5652e0324a60 0x5652e041e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.392+0000 7fb94aa13640 1 --2- 172.21.15.102:0/2136315643 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb830036b40 0x7fb830039000 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb93c057000 tx=0x7fb93c052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.392+0000 7fb94ba15640 1 --2- 172.21.15.102:0/2136315643 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5652e0324a60 0x5652e041e300 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.392+0000 7fb94ba15640 1 -- 172.21.15.102:0/2136315643 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0324a60 2024-09-13T19:16:37.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.392+0000 7fb94d719800 1 -- 172.21.15.102:0/2136315643 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e041b8d0 con 0x5652e0324a60 2024-09-13T19:16:37.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.392+0000 7fb94ba15640 1 -- 172.21.15.102:0/2136315643 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0324a60 2024-09-13T19:16:37.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.393+0000 7fb94d719800 1 --2- 172.21.15.102:0/2136315643 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5652e0420bb0 0x5652e0422fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.393+0000 7fb94d719800 1 -- 172.21.15.102:0/2136315643 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e0423640 con 0x5652e0420bb0 2024-09-13T19:16:37.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.393+0000 7fb94b214640 1 --2- 172.21.15.102:0/2136315643 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5652e0420bb0 0x5652e0422fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.393+0000 7fb94b214640 1 --2- 172.21.15.102:0/2136315643 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5652e0420bb0 0x5652e0422fa0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.393+0000 7fb94b214640 1 -- 172.21.15.102:0/2136315643 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb93402e070 con 0x5652e0420bb0 2024-09-13T19:16:37.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.393+0000 7fb94d719800 1 -- 172.21.15.102:0/2136315643 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e041fa50 con 0x5652e0324a60 2024-09-13T19:16:37.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.393+0000 7fb94ba15640 1 -- 172.21.15.102:0/2136315643 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0324a60 2024-09-13T19:16:37.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.393+0000 7fb94d719800 1 -- 172.21.15.102:0/2136315643 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e041ff30 con 0x5652e0420bb0 2024-09-13T19:16:37.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.394+0000 7fb94b214640 1 -- 172.21.15.102:0/2136315643 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb93402e070 con 0x5652e0420bb0 2024-09-13T19:16:37.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.394+0000 7fb94d719800 1 Processor -- start 2024-09-13T19:16:37.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.394+0000 7fb94d719800 1 -- start start 2024-09-13T19:16:37.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.394+0000 7fb94d719800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652e0431ff0 0x5652e0432410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.394+0000 7fb94d719800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5652e01bb580 con 0x5652e0431ff0 2024-09-13T19:16:37.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.395+0000 7fb94ba15640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652e0431ff0 0x5652e0432410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.395+0000 7fb94ba15640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652e0431ff0 0x5652e0432410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55316/0 (socket says 172.21.15.102:55316) 2024-09-13T19:16:37.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.395+0000 7fb94ba15640 1 -- 172.21.15.102:0/2541012954 learned_addr learned my addr 172.21.15.102:0/2541012954 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:37.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.395+0000 7fb94ba15640 1 -- 172.21.15.102:0/2541012954 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652e0432950 con 0x5652e0431ff0 2024-09-13T19:16:37.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.395+0000 7fb94ba15640 1 --2- 172.21.15.102:0/2541012954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652e0431ff0 0x5652e0432410 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x5652e0418340 tx=0x7fb9440167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.395+0000 7fb835602640 1 -- 172.21.15.102:0/2541012954 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb944013640 con 0x5652e0431ff0 2024-09-13T19:16:37.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.395+0000 7fb835602640 1 -- 172.21.15.102:0/2541012954 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9440137e0 con 0x5652e0431ff0 2024-09-13T19:16:37.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.395+0000 7fb835602640 1 -- 172.21.15.102:0/2541012954 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb944013ac0 con 0x5652e0431ff0 2024-09-13T19:16:37.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.395+0000 7fb94d719800 1 -- 172.21.15.102:0/2541012954 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5652e0432be0 con 0x5652e0431ff0 2024-09-13T19:16:37.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.395+0000 7fb94d719800 1 -- 172.21.15.102:0/2541012954 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652e04358c0 con 0x5652e0431ff0 2024-09-13T19:16:37.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.396+0000 7fb835602640 1 -- 172.21.15.102:0/2541012954 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb944011040 con 0x5652e0431ff0 2024-09-13T19:16:37.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.396+0000 7fb835602640 1 --2- 172.21.15.102:0/2541012954 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb824036b40 0x7fb824039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.396+0000 7fb835602640 1 -- 172.21.15.102:0/2541012954 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fb94400e040 con 0x5652e0431ff0 2024-09-13T19:16:37.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.396+0000 7fb94b214640 1 --2- 172.21.15.102:0/2541012954 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb824036b40 0x7fb824039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.397+0000 7fb94d719800 1 Processor -- start 2024-09-13T19:16:37.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.397+0000 7fb94b214640 1 --2- 172.21.15.102:0/2541012954 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb824036b40 0x7fb824039000 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x5652e041b7f0 tx=0x7fb93401ae70 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.397+0000 7fb94d719800 1 -- start start 2024-09-13T19:16:37.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.397+0000 7fb94d719800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652e043ecf0 0x5652e043f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.397+0000 7fb94d719800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5652e0410010 con 0x5652e043ecf0 2024-09-13T19:16:37.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.397+0000 7fb94ba15640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652e043ecf0 0x5652e043f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.397+0000 7fb94ba15640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652e043ecf0 0x5652e043f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55320/0 (socket says 172.21.15.102:55320) 2024-09-13T19:16:37.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.397+0000 7fb94ba15640 1 -- 172.21.15.102:0/1592701174 learned_addr learned my addr 172.21.15.102:0/1592701174 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:37.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.397+0000 7fb94ba15640 1 -- 172.21.15.102:0/1592701174 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652e043f6c0 con 0x5652e043ecf0 2024-09-13T19:16:37.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.397+0000 7fb94ba15640 1 --2- 172.21.15.102:0/1592701174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652e043ecf0 0x5652e043f0f0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fb944005a10 tx=0x7fb944020e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2676339d9ad173 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.398+0000 7fb82effd640 1 -- 172.21.15.102:0/1592701174 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb944021440 con 0x5652e043ecf0 2024-09-13T19:16:37.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.398+0000 7fb82effd640 1 -- 172.21.15.102:0/1592701174 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb94401f340 con 0x5652e043ecf0 2024-09-13T19:16:37.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.398+0000 7fb82effd640 1 -- 172.21.15.102:0/1592701174 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9440215e0 con 0x5652e043ecf0 2024-09-13T19:16:37.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.398+0000 7fb94d719800 1 -- 172.21.15.102:0/1592701174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652e043ecf0 msgr2=0x5652e043f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.398+0000 7fb94d719800 1 --2- 172.21.15.102:0/1592701174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652e043ecf0 0x5652e043f0f0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fb944005a10 tx=0x7fb944020e60 comp rx=0 tx=0).stop 2024-09-13T19:16:37.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.398+0000 7fb94d719800 1 -- 172.21.15.102:0/1592701174 shutdown_connections 2024-09-13T19:16:37.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.398+0000 7fb94d719800 1 --2- 172.21.15.102:0/1592701174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652e043ecf0 0x5652e043f0f0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.398+0000 7fb94d719800 1 -- 172.21.15.102:0/1592701174 >> 172.21.15.102:0/1592701174 conn(0x5652e043b050 msgr2=0x5652e04391a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:37.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.398+0000 7fb94d719800 1 -- 172.21.15.102:0/1592701174 shutdown_connections 2024-09-13T19:16:37.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.398+0000 7fb94d719800 1 -- 172.21.15.102:0/1592701174 wait complete. 2024-09-13T19:16:37.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.398+0000 7fb94d719800 1 Processor -- start 2024-09-13T19:16:37.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.398+0000 7fb94d719800 1 -- start start 2024-09-13T19:16:37.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.399+0000 7fb94d719800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652e043ecf0 0x5652e04461a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.399+0000 7fb94d719800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5652e043fc90 con 0x5652e043ecf0 2024-09-13T19:16:37.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.399+0000 7fb94ba15640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652e043ecf0 0x5652e04461a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.399+0000 7fb94ba15640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652e043ecf0 0x5652e04461a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55324/0 (socket says 172.21.15.102:55324) 2024-09-13T19:16:37.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.399+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 learned_addr learned my addr 172.21.15.102:0/3069965680 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:37.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.399+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652e04466e0 con 0x5652e043ecf0 2024-09-13T19:16:37.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.399+0000 7fb94ba15640 1 --2- 172.21.15.102:0/3069965680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652e043ecf0 0x5652e04461a0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fb944012fd0 tx=0x7fb94404cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.399+0000 7fb82d7fa640 1 -- 172.21.15.102:0/3069965680 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb94403a070 con 0x5652e043ecf0 2024-09-13T19:16:37.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.399+0000 7fb82d7fa640 1 -- 172.21.15.102:0/3069965680 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9440400d0 con 0x5652e043ecf0 2024-09-13T19:16:37.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.399+0000 7fb82d7fa640 1 -- 172.21.15.102:0/3069965680 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9440403b0 con 0x5652e043ecf0 2024-09-13T19:16:37.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.399+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5652e0446970 con 0x5652e043ecf0 2024-09-13T19:16:37.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.399+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652e0449620 con 0x5652e043ecf0 2024-09-13T19:16:37.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.400+0000 7fb82d7fa640 1 -- 172.21.15.102:0/3069965680 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb9440205b0 con 0x5652e043ecf0 2024-09-13T19:16:37.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.401+0000 7fb82d7fa640 1 --2- 172.21.15.102:0/3069965680 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb814036b40 0x7fb814039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.401+0000 7fb82d7fa640 1 -- 172.21.15.102:0/3069965680 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fb944036d90 con 0x5652e043ecf0 2024-09-13T19:16:37.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.401+0000 7fb94b214640 1 --2- 172.21.15.102:0/3069965680 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb814036b40 0x7fb814039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.401+0000 7fb94d719800 20 rados->read ofs=0 len=0 2024-09-13T19:16:37.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.401+0000 7fb94d719800 1 --2- 172.21.15.102:0/3069965680 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5652e0451c70 0x5652e0454130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.401+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e0454880 con 0x5652e0451c70 2024-09-13T19:16:37.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.401+0000 7fb94aa13640 1 --2- 172.21.15.102:0/3069965680 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5652e0451c70 0x5652e0454130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.401+0000 7fb94b214640 1 --2- 172.21.15.102:0/3069965680 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb814036b40 0x7fb814039000 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb93404b2d0 tx=0x7fb934039000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.401+0000 7fb94aa13640 1 --2- 172.21.15.102:0/3069965680 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5652e0451c70 0x5652e0454130 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.402+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb93c057030 con 0x5652e0451c70 2024-09-13T19:16:37.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.402+0000 7fb94d719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:37.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.402+0000 7fb94d719800 20 realm 2024-09-13T19:16:37.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.402+0000 7fb94d719800 20 rados->read ofs=0 len=0 2024-09-13T19:16:37.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.402+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e0454cb0 con 0x5652e0451c70 2024-09-13T19:16:37.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.402+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb93c057030 con 0x5652e0451c70 2024-09-13T19:16:37.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.402+0000 7fb94d719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:37.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.402+0000 7fb94d719800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:37.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.402+0000 7fb94d719800 20 rados->read ofs=0 len=0 2024-09-13T19:16:37.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.402+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e0455580 con 0x5652e0451c70 2024-09-13T19:16:37.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.402+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb93c057030 con 0x5652e0451c70 2024-09-13T19:16:37.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.402+0000 7fb94d719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:37.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.402+0000 7fb94d719800 20 rados->read ofs=0 len=0 2024-09-13T19:16:37.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.402+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e0455920 con 0x5652e0451c70 2024-09-13T19:16:37.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.402+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb93c057030 con 0x5652e0451c70 2024-09-13T19:16:37.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.402+0000 7fb94d719800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:37.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.402+0000 7fb94d719800 20 rados->read ofs=0 len=0 2024-09-13T19:16:37.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.402+0000 7fb94d719800 1 --2- 172.21.15.102:0/3069965680 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5652e0456680 0x5652e0458a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.402+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e0458fb0 con 0x5652e0456680 2024-09-13T19:16:37.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.402+0000 7fb94ba15640 1 --2- 172.21.15.102:0/3069965680 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5652e0456680 0x5652e0458a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.403+0000 7fb94ba15640 1 --2- 172.21.15.102:0/3069965680 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5652e0456680 0x5652e0458a70 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.403+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.403+0000 7fb94d719800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:37.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.403+0000 7fb94d719800 20 searching for the correct realm 2024-09-13T19:16:37.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.403+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5652e045a9c0 con 0x5652e0456680 2024-09-13T19:16:37.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.403+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.403+0000 7fb94ba15640 1 --2- 172.21.15.102:0/3069965680 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fb944045c10 0x7fb944023820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.403+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5652e045a9c0 con 0x7fb944045c10 2024-09-13T19:16:37.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.403+0000 7fb94b214640 1 --2- 172.21.15.102:0/3069965680 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fb944045c10 0x7fb944023820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.404+0000 7fb94b214640 1 --2- 172.21.15.102:0/3069965680 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fb944045c10 0x7fb944023820 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.404+0000 7fb94b214640 1 -- 172.21.15.102:0/3069965680 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb93402e070 con 0x7fb944045c10 2024-09-13T19:16:37.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.404+0000 7fb94b214640 1 --2- 172.21.15.102:0/3069965680 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fb9340448a0 0x7fb93401b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.404+0000 7fb94b214640 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5652e045a9c0 con 0x7fb9340448a0 2024-09-13T19:16:37.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.404+0000 7fb94aa13640 1 --2- 172.21.15.102:0/3069965680 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fb9340448a0 0x7fb93401b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.405+0000 7fb94aa13640 1 --2- 172.21.15.102:0/3069965680 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fb9340448a0 0x7fb93401b830 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.405+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb93c057030 con 0x7fb9340448a0 2024-09-13T19:16:37.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.405+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5652e045a9c0 con 0x5652e0451c70 2024-09-13T19:16:37.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.405+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb93c057030 con 0x5652e0451c70 2024-09-13T19:16:37.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.405+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5652e045a9c0 con 0x5652e0451c70 2024-09-13T19:16:37.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.406+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb93c057030 con 0x5652e0451c70 2024-09-13T19:16:37.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.406+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5652e045a9c0 con 0x7fb9340448a0 2024-09-13T19:16:37.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.406+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb93c057030 con 0x7fb9340448a0 2024-09-13T19:16:37.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.406+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5652e045a9c0 con 0x7fb9340448a0 2024-09-13T19:16:37.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.406+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb93c057030 con 0x7fb9340448a0 2024-09-13T19:16:37.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.406+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5652e045a9c0 con 0x7fb944045c10 2024-09-13T19:16:37.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.406+0000 7fb94b214640 1 -- 172.21.15.102:0/3069965680 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb93402e070 con 0x7fb944045c10 2024-09-13T19:16:37.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.406+0000 7fb94b214640 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5652e045a9c0 con 0x5652e0456680 2024-09-13T19:16:37.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.407+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.407+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5652e045a9c0 con 0x5652e0451c70 2024-09-13T19:16:37.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.407+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb93c057030 con 0x5652e0451c70 2024-09-13T19:16:37.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.407+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5652e045a9c0 con 0x7fb944045c10 2024-09-13T19:16:37.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.407+0000 7fb94b214640 1 -- 172.21.15.102:0/3069965680 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb934064040 con 0x7fb944045c10 2024-09-13T19:16:37.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.407+0000 7fb94b214640 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5652e045a9c0 con 0x5652e0451c70 2024-09-13T19:16:37.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.407+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb93c057030 con 0x5652e0451c70 2024-09-13T19:16:37.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.407+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5652e045a9c0 con 0x7fb944045c10 2024-09-13T19:16:37.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.408+0000 7fb94b214640 1 -- 172.21.15.102:0/3069965680 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb934064040 con 0x7fb944045c10 2024-09-13T19:16:37.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.408+0000 7fb94b214640 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5652e045a9c0 con 0x5652e0456680 2024-09-13T19:16:37.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.408+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.408+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5652e045a9c0 con 0x5652e0456680 2024-09-13T19:16:37.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.408+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.408+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5652e045a9c0 con 0x7fb9340448a0 2024-09-13T19:16:37.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.408+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb93c057030 con 0x7fb9340448a0 2024-09-13T19:16:37.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.408+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5652e045a9c0 con 0x5652e0456680 2024-09-13T19:16:37.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.409+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.409+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5652e045a9c0 con 0x5652e0456680 2024-09-13T19:16:37.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.409+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.409+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5652e045a9c0 con 0x5652e0451c70 2024-09-13T19:16:37.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.409+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb93c057030 con 0x5652e0451c70 2024-09-13T19:16:37.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.409+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5652e045a9c0 con 0x5652e0451c70 2024-09-13T19:16:37.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.409+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb93c057030 con 0x5652e0451c70 2024-09-13T19:16:37.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.409+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5652e045a9c0 con 0x7fb9340448a0 2024-09-13T19:16:37.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.410+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb93c057030 con 0x7fb9340448a0 2024-09-13T19:16:37.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.410+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5652e045a9c0 con 0x5652e0456680 2024-09-13T19:16:37.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.410+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.410+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5652e045a9c0 con 0x7fb944045c10 2024-09-13T19:16:37.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.410+0000 7fb94b214640 1 -- 172.21.15.102:0/3069965680 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb934064040 con 0x7fb944045c10 2024-09-13T19:16:37.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.410+0000 7fb94b214640 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5652e045a9c0 con 0x5652e0451c70 2024-09-13T19:16:37.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.410+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb93c057030 con 0x5652e0451c70 2024-09-13T19:16:37.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.410+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5652e045a9c0 con 0x7fb944045c10 2024-09-13T19:16:37.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.411+0000 7fb94b214640 1 -- 172.21.15.102:0/3069965680 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb934064040 con 0x7fb944045c10 2024-09-13T19:16:37.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.411+0000 7fb94b214640 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5652e045a9c0 con 0x5652e0456680 2024-09-13T19:16:37.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.411+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.411+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5652e045a9c0 con 0x7fb9340448a0 2024-09-13T19:16:37.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.411+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb93c057030 con 0x7fb9340448a0 2024-09-13T19:16:37.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.411+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5652e045a9c0 con 0x7fb944045c10 2024-09-13T19:16:37.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.411+0000 7fb94b214640 1 -- 172.21.15.102:0/3069965680 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb934064040 con 0x7fb944045c10 2024-09-13T19:16:37.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.411+0000 7fb94b214640 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5652e045a9c0 con 0x5652e0456680 2024-09-13T19:16:37.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.412+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.412+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5652e045a9c0 con 0x7fb9340448a0 2024-09-13T19:16:37.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.412+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb93c057030 con 0x7fb9340448a0 2024-09-13T19:16:37.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.412+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5652e045a9c0 con 0x5652e0451c70 2024-09-13T19:16:37.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.412+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb93c057030 con 0x5652e0451c70 2024-09-13T19:16:37.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.412+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5652e045a9c0 con 0x7fb944045c10 2024-09-13T19:16:37.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.412+0000 7fb94b214640 1 -- 172.21.15.102:0/3069965680 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb934064040 con 0x7fb944045c10 2024-09-13T19:16:37.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.413+0000 7fb94d719800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:37.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.413+0000 7fb94d719800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:37.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.413+0000 7fb94d719800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:37.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.413+0000 7fb94d719800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:37.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.413+0000 7fb94d719800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:37.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.413+0000 7fb94d719800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:37.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.413+0000 7fb94d719800 20 rados->read ofs=0 len=0 2024-09-13T19:16:37.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.413+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e045a5b0 con 0x5652e0451c70 2024-09-13T19:16:37.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.413+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb93c057030 con 0x5652e0451c70 2024-09-13T19:16:37.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.413+0000 7fb94d719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:37.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.413+0000 7fb94d719800 20 rados->read ofs=0 len=0 2024-09-13T19:16:37.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.413+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e0459560 con 0x5652e0451c70 2024-09-13T19:16:37.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.413+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb93c057030 con 0x5652e0451c70 2024-09-13T19:16:37.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.413+0000 7fb94d719800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:37.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.413+0000 7fb94d719800 20 rados->read ofs=0 len=0 2024-09-13T19:16:37.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.413+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e0459ee0 con 0x5652e0456680 2024-09-13T19:16:37.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.413+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.413+0000 7fb94d719800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:37.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.413+0000 7fb94d719800 20 zone default found 2024-09-13T19:16:37.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.413+0000 7fb94d719800 4 Realm: () 2024-09-13T19:16:37.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.413+0000 7fb94d719800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:37.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.413+0000 7fb94d719800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:37.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.413+0000 7fb94d719800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:37.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.413+0000 7fb94d719800 20 zonegroup default 2024-09-13T19:16:37.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.413+0000 7fb94d719800 20 rados->read ofs=0 len=0 2024-09-13T19:16:37.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.413+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e045b340 con 0x7fb944045c10 2024-09-13T19:16:37.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.414+0000 7fb94b214640 1 -- 172.21.15.102:0/3069965680 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb934064040 con 0x7fb944045c10 2024-09-13T19:16:37.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.414+0000 7fb94d719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:37.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.414+0000 7fb94d719800 20 rados->read ofs=0 len=0 2024-09-13T19:16:37.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.414+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e045d150 con 0x5652e0456680 2024-09-13T19:16:37.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.414+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.414+0000 7fb94d719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:37.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.414+0000 7fb94d719800 20 rados->read ofs=0 len=0 2024-09-13T19:16:37.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.414+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e045d5b0 con 0x5652e0456680 2024-09-13T19:16:37.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.414+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.414+0000 7fb94d719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:37.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.414+0000 7fb94d719800 20 started sync module instance, tier type = 2024-09-13T19:16:37.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.414+0000 7fb94d719800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:37.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.414+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e045c560 con 0x7fb944045c10 2024-09-13T19:16:37.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.415+0000 7fb94b214640 1 -- 172.21.15.102:0/3069965680 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(44 notify.0 [create] v36'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb934064040 con 0x7fb944045c10 2024-09-13T19:16:37.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.415+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94913949976912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e045cd70 con 0x7fb944045c10 2024-09-13T19:16:37.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.415+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e045e4e0 con 0x5652e0451c70 2024-09-13T19:16:37.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.416+0000 7fb94b214640 1 -- 172.21.15.102:0/3069965680 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94913949976912] v36'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb934064040 con 0x7fb944045c10 2024-09-13T19:16:37.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.416+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v36'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb93c057030 con 0x5652e0451c70 2024-09-13T19:16:37.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.416+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94913949981200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e045ed80 con 0x5652e0451c70 2024-09-13T19:16:37.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.416+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e045f740 con 0x5652e0456680 2024-09-13T19:16:37.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.418+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94913949981200] v36'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb93c057030 con 0x5652e0451c70 2024-09-13T19:16:37.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.418+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v36'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.418+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94913949987472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e045fb60 con 0x5652e0456680 2024-09-13T19:16:37.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.418+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e0460520 con 0x7fb944045c10 2024-09-13T19:16:37.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.419+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94913949987472] v36'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.419+0000 7fb94b214640 1 -- 172.21.15.102:0/3069965680 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(50 notify.3 [create] v36'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb934064040 con 0x7fb944045c10 2024-09-13T19:16:37.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.419+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94913949991504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e045fb60 con 0x7fb944045c10 2024-09-13T19:16:37.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.419+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e0460f30 con 0x5652e0451c70 2024-09-13T19:16:37.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.420+0000 7fb94b214640 1 -- 172.21.15.102:0/3069965680 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94913949991504] v36'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb934064040 con 0x7fb944045c10 2024-09-13T19:16:37.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.420+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v36'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb93c057030 con 0x5652e0451c70 2024-09-13T19:16:37.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.420+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94913949994112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e045fb60 con 0x5652e0451c70 2024-09-13T19:16:37.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.420+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e04619b0 con 0x7fb9340448a0 2024-09-13T19:16:37.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.421+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(54 notify.5 [create] v36'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb93c057030 con 0x7fb9340448a0 2024-09-13T19:16:37.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.421+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94913949996224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e0461960 con 0x7fb9340448a0 2024-09-13T19:16:37.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.421+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e0462950 con 0x7fb9340448a0 2024-09-13T19:16:37.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.421+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94913949994112] v36'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb93c057030 con 0x5652e0451c70 2024-09-13T19:16:37.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.422+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94913949996224] v36'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb93c057030 con 0x7fb9340448a0 2024-09-13T19:16:37.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.422+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(56 notify.6 [create] v36'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb93c057030 con 0x7fb9340448a0 2024-09-13T19:16:37.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.422+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94913949998544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e045f6b0 con 0x7fb9340448a0 2024-09-13T19:16:37.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.422+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e0462e00 con 0x7fb9340448a0 2024-09-13T19:16:37.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.423+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(58 notify.7 [create] v36'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb93c057030 con 0x7fb9340448a0 2024-09-13T19:16:37.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.423+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94913950001424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e0462d30 con 0x7fb9340448a0 2024-09-13T19:16:37.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.423+0000 7fb94d719800 20 add_watcher() i=0 2024-09-13T19:16:37.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.423+0000 7fb94d719800 20 add_watcher() i=1 2024-09-13T19:16:37.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.423+0000 7fb94d719800 20 add_watcher() i=2 2024-09-13T19:16:37.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.423+0000 7fb94d719800 20 add_watcher() i=3 2024-09-13T19:16:37.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.423+0000 7fb94d719800 20 add_watcher() i=4 2024-09-13T19:16:37.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.423+0000 7fb94d719800 20 add_watcher() i=5 2024-09-13T19:16:37.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.423+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94913949998544] v36'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb93c057030 con 0x7fb9340448a0 2024-09-13T19:16:37.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.423+0000 7fb94d719800 20 add_watcher() i=6 2024-09-13T19:16:37.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.424+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94913950001424] v36'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb93c057030 con 0x7fb9340448a0 2024-09-13T19:16:37.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.424+0000 7fb94d719800 20 add_watcher() i=7 2024-09-13T19:16:37.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.424+0000 7fb94d719800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:37.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.425+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e0462420 con 0x5652e0451c70 2024-09-13T19:16:37.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.425+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb93c057030 con 0x5652e0451c70 2024-09-13T19:16:37.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.425+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94913950003616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e0462420 con 0x5652e0451c70 2024-09-13T19:16:37.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.426+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94913950003616] v36'168 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb93c057030 con 0x5652e0451c70 2024-09-13T19:16:37.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.426+0000 7fb801fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:37.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.426+0000 7fb94d719800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:37.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.426+0000 7fb94d719800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:37.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.426+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e046ea20 con 0x5652e0451c70 2024-09-13T19:16:37.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.427+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v36'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb93c057030 con 0x5652e0451c70 2024-09-13T19:16:37.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.427+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e046ef90 con 0x7fb9340448a0 2024-09-13T19:16:37.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.428+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v36'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb93c057030 con 0x7fb9340448a0 2024-09-13T19:16:37.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.428+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e046f440 con 0x5652e0456680 2024-09-13T19:16:37.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.429+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v36'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.429+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e046f440 con 0x5652e0451c70 2024-09-13T19:16:37.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.430+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v36'169 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb93c057030 con 0x5652e0451c70 2024-09-13T19:16:37.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.430+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e046f9b0 con 0x7fb944045c10 2024-09-13T19:16:37.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.431+0000 7fb94b214640 1 -- 172.21.15.102:0/3069965680 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v36'58 uv55 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb934064040 con 0x7fb944045c10 2024-09-13T19:16:37.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.431+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e046fa40 con 0x5652e0456680 2024-09-13T19:16:37.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.432+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v36'38 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.432+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e046fad0 con 0x5652e0451c70 2024-09-13T19:16:37.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.433+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v36'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb93c057030 con 0x5652e0451c70 2024-09-13T19:16:37.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.433+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e046fff0 con 0x7fb9340448a0 2024-09-13T19:16:37.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.434+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(69 gc.7 [create,call,call,call] v36'37 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb93c057030 con 0x7fb9340448a0 2024-09-13T19:16:37.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.434+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e046fff0 con 0x7fb944045c10 2024-09-13T19:16:37.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.435+0000 7fb94b214640 1 -- 172.21.15.102:0/3069965680 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v36'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb934064040 con 0x7fb944045c10 2024-09-13T19:16:37.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.435+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e046fff0 con 0x5652e0456680 2024-09-13T19:16:37.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.436+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v36'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.436+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e046fff0 con 0x7fb944045c10 2024-09-13T19:16:37.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.437+0000 7fb94b214640 1 -- 172.21.15.102:0/3069965680 <== osd.2 v2:172.21.15.102:6816/2238176080 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v36'59 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb934064040 con 0x7fb944045c10 2024-09-13T19:16:37.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.437+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e046fff0 con 0x7fb9340448a0 2024-09-13T19:16:37.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.438+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v36'25 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb93c057030 con 0x7fb9340448a0 2024-09-13T19:16:37.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.438+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e046fff0 con 0x7fb944045c10 2024-09-13T19:16:37.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.439+0000 7fb94b214640 1 -- 172.21.15.102:0/3069965680 <== osd.2 v2:172.21.15.102:6816/2238176080 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v36'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb934064040 con 0x7fb944045c10 2024-09-13T19:16:37.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.439+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e0470080 con 0x7fb9340448a0 2024-09-13T19:16:37.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.441+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(75 gc.13 [create,call,call,call] v36'43 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb93c057030 con 0x7fb9340448a0 2024-09-13T19:16:37.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.441+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e0470080 con 0x5652e0451c70 2024-09-13T19:16:37.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.442+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v36'170 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb93c057030 con 0x5652e0451c70 2024-09-13T19:16:37.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.442+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e0470080 con 0x5652e0456680 2024-09-13T19:16:37.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.443+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v36'50 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.443+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e0470110 con 0x7fb944045c10 2024-09-13T19:16:37.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.444+0000 7fb94b214640 1 -- 172.21.15.102:0/3069965680 <== osd.2 v2:172.21.15.102:6816/2238176080 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v36'60 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb934064040 con 0x7fb944045c10 2024-09-13T19:16:37.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.444+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e0470110 con 0x5652e0456680 2024-09-13T19:16:37.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.445+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v36'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.445+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e0470110 con 0x5652e0451c70 2024-09-13T19:16:37.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.446+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v36'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb93c057030 con 0x5652e0451c70 2024-09-13T19:16:37.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.446+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e0470110 con 0x5652e0451c70 2024-09-13T19:16:37.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.447+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v36'171 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb93c057030 con 0x5652e0451c70 2024-09-13T19:16:37.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.447+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e0470110 con 0x5652e0456680 2024-09-13T19:16:37.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.448+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v36'51 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.448+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e0470110 con 0x7fb944045c10 2024-09-13T19:16:37.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.449+0000 7fb94b214640 1 -- 172.21.15.102:0/3069965680 <== osd.2 v2:172.21.15.102:6816/2238176080 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v36'32 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb934064040 con 0x7fb944045c10 2024-09-13T19:16:37.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.449+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e04702e0 con 0x5652e0456680 2024-09-13T19:16:37.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.450+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v36'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.450+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e04702e0 con 0x5652e0456680 2024-09-13T19:16:37.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.451+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v36'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.451+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e0470250 con 0x5652e0456680 2024-09-13T19:16:37.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.452+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v36'18 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.452+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e0470250 con 0x5652e0456680 2024-09-13T19:16:37.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.452+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v36'39 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.453+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e0470760 con 0x7fb9340448a0 2024-09-13T19:16:37.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.454+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(88 gc.26 [create,call,call,call] v36'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb93c057030 con 0x7fb9340448a0 2024-09-13T19:16:37.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.454+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e0470760 con 0x5652e0456680 2024-09-13T19:16:37.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.455+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v36'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.455+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e0470760 con 0x7fb9340448a0 2024-09-13T19:16:37.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.456+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(90 gc.28 [create,call,call,call] v36'38 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb93c057030 con 0x7fb9340448a0 2024-09-13T19:16:37.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.456+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e0470760 con 0x5652e0456680 2024-09-13T19:16:37.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.457+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v36'52 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.457+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e0470760 con 0x7fb9340448a0 2024-09-13T19:16:37.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.458+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.0 v2:172.21.15.53:6800/4021716951 20 ==== osd_op_reply(92 gc.30 [create,call,call,call] v36'44 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb93c057030 con 0x7fb9340448a0 2024-09-13T19:16:37.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.458+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e0470760 con 0x7fb944045c10 2024-09-13T19:16:37.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.459+0000 7fb94b214640 1 -- 172.21.15.102:0/3069965680 <== osd.2 v2:172.21.15.102:6816/2238176080 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v36'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb934064040 con 0x7fb944045c10 2024-09-13T19:16:37.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.459+0000 7fb800fe1640 20 reqs_thread_entry: start 2024-09-13T19:16:37.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.459+0000 7fb94d719800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:37.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.459+0000 7fb94d719800 20 Filter name: none 2024-09-13T19:16:37.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.459+0000 7fb77a7fc640 20 reqs_thread_entry: start 2024-09-13T19:16:37.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.459+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x5652e0451c70 2024-09-13T19:16:37.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.460+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb93c057030 con 0x5652e0451c70 2024-09-13T19:16:37.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.460+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049ab80 con 0x5652e0451c70 2024-09-13T19:16:37.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.460+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.1 v2:172.21.15.102:6808/2204418452 28 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb93c057030 con 0x5652e0451c70 2024-09-13T19:16:37.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.460+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x5652e0451c70 2024-09-13T19:16:37.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.460+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.1 v2:172.21.15.102:6808/2204418452 29 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb93c057030 con 0x5652e0451c70 2024-09-13T19:16:37.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.460+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x7fb9340448a0 2024-09-13T19:16:37.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.461+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.0 v2:172.21.15.53:6800/4021716951 21 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb93c057030 con 0x7fb9340448a0 2024-09-13T19:16:37.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.461+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049ab80 con 0x7fb9340448a0 2024-09-13T19:16:37.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.461+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.0 v2:172.21.15.53:6800/4021716951 22 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb93c057030 con 0x7fb9340448a0 2024-09-13T19:16:37.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.461+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x7fb9340448a0 2024-09-13T19:16:37.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.461+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.0 v2:172.21.15.53:6800/4021716951 23 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb93c057030 con 0x7fb9340448a0 2024-09-13T19:16:37.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.461+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x5652e0456680 2024-09-13T19:16:37.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.462+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 28 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.462+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049ab80 con 0x5652e0456680 2024-09-13T19:16:37.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.462+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 29 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.462+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x5652e0456680 2024-09-13T19:16:37.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.462+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 30 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.462+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x5652e0451c70 2024-09-13T19:16:37.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.462+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.1 v2:172.21.15.102:6808/2204418452 30 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv166 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb93c057030 con 0x5652e0451c70 2024-09-13T19:16:37.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.462+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049ab80 con 0x5652e0451c70 2024-09-13T19:16:37.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.463+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.1 v2:172.21.15.102:6808/2204418452 31 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv166 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb93c057030 con 0x5652e0451c70 2024-09-13T19:16:37.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.463+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x5652e0451c70 2024-09-13T19:16:37.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.463+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.1 v2:172.21.15.102:6808/2204418452 32 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv166 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb93c057030 con 0x5652e0451c70 2024-09-13T19:16:37.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.463+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x7fb944045c10 2024-09-13T19:16:37.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.463+0000 7fb94b214640 1 -- 172.21.15.102:0/3069965680 <== osd.2 v2:172.21.15.102:6816/2238176080 21 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv55 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb934064040 con 0x7fb944045c10 2024-09-13T19:16:37.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.463+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049ab80 con 0x7fb944045c10 2024-09-13T19:16:37.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.463+0000 7fb94b214640 1 -- 172.21.15.102:0/3069965680 <== osd.2 v2:172.21.15.102:6816/2238176080 22 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv55 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb934064040 con 0x7fb944045c10 2024-09-13T19:16:37.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.463+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x7fb944045c10 2024-09-13T19:16:37.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.464+0000 7fb94b214640 1 -- 172.21.15.102:0/3069965680 <== osd.2 v2:172.21.15.102:6816/2238176080 23 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv55 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb934064040 con 0x7fb944045c10 2024-09-13T19:16:37.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.464+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x5652e0456680 2024-09-13T19:16:37.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.464+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 31 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv37 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.464+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049ab80 con 0x5652e0456680 2024-09-13T19:16:37.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.464+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 32 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv37 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.464+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x5652e0456680 2024-09-13T19:16:37.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.464+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 33 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv37 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.464+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x5652e0451c70 2024-09-13T19:16:37.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.465+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.1 v2:172.21.15.102:6808/2204418452 33 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb93c057030 con 0x5652e0451c70 2024-09-13T19:16:37.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.465+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049ab80 con 0x5652e0451c70 2024-09-13T19:16:37.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.465+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.1 v2:172.21.15.102:6808/2204418452 34 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv23 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb93c057030 con 0x5652e0451c70 2024-09-13T19:16:37.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.465+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x5652e0451c70 2024-09-13T19:16:37.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.465+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.1 v2:172.21.15.102:6808/2204418452 35 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb93c057030 con 0x5652e0451c70 2024-09-13T19:16:37.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.465+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x7fb9340448a0 2024-09-13T19:16:37.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.466+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.0 v2:172.21.15.53:6800/4021716951 24 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb93c057030 con 0x7fb9340448a0 2024-09-13T19:16:37.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.466+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049ab80 con 0x7fb9340448a0 2024-09-13T19:16:37.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.466+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.0 v2:172.21.15.53:6800/4021716951 25 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv36 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb93c057030 con 0x7fb9340448a0 2024-09-13T19:16:37.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.466+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x7fb9340448a0 2024-09-13T19:16:37.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.466+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.0 v2:172.21.15.53:6800/4021716951 26 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb93c057030 con 0x7fb9340448a0 2024-09-13T19:16:37.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.466+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x7fb944045c10 2024-09-13T19:16:37.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.466+0000 7fb94b214640 1 -- 172.21.15.102:0/3069965680 <== osd.2 v2:172.21.15.102:6816/2238176080 24 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb934064040 con 0x7fb944045c10 2024-09-13T19:16:37.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.466+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049ab80 con 0x7fb944045c10 2024-09-13T19:16:37.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.467+0000 7fb94b214640 1 -- 172.21.15.102:0/3069965680 <== osd.2 v2:172.21.15.102:6816/2238176080 25 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb934064040 con 0x7fb944045c10 2024-09-13T19:16:37.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.467+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x7fb944045c10 2024-09-13T19:16:37.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.467+0000 7fb94b214640 1 -- 172.21.15.102:0/3069965680 <== osd.2 v2:172.21.15.102:6816/2238176080 26 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb934064040 con 0x7fb944045c10 2024-09-13T19:16:37.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.467+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x5652e0456680 2024-09-13T19:16:37.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.467+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 34 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.467+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049ab80 con 0x5652e0456680 2024-09-13T19:16:37.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.467+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 35 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.467+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x5652e0456680 2024-09-13T19:16:37.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.468+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 36 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.468+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x7fb944045c10 2024-09-13T19:16:37.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.468+0000 7fb94b214640 1 -- 172.21.15.102:0/3069965680 <== osd.2 v2:172.21.15.102:6816/2238176080 27 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb934064040 con 0x7fb944045c10 2024-09-13T19:16:37.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.468+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049ab80 con 0x7fb944045c10 2024-09-13T19:16:37.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.468+0000 7fb94b214640 1 -- 172.21.15.102:0/3069965680 <== osd.2 v2:172.21.15.102:6816/2238176080 28 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv57 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb934064040 con 0x7fb944045c10 2024-09-13T19:16:37.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.468+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x7fb944045c10 2024-09-13T19:16:37.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.468+0000 7fb94b214640 1 -- 172.21.15.102:0/3069965680 <== osd.2 v2:172.21.15.102:6816/2238176080 29 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb934064040 con 0x7fb944045c10 2024-09-13T19:16:37.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.468+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x7fb9340448a0 2024-09-13T19:16:37.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.469+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.0 v2:172.21.15.53:6800/4021716951 27 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb93c057030 con 0x7fb9340448a0 2024-09-13T19:16:37.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.469+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049ab80 con 0x7fb9340448a0 2024-09-13T19:16:37.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.469+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.0 v2:172.21.15.53:6800/4021716951 28 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv24 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb93c057030 con 0x7fb9340448a0 2024-09-13T19:16:37.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.469+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x7fb9340448a0 2024-09-13T19:16:37.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.469+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.0 v2:172.21.15.53:6800/4021716951 29 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb93c057030 con 0x7fb9340448a0 2024-09-13T19:16:37.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.469+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x7fb944045c10 2024-09-13T19:16:37.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.470+0000 7fb94b214640 1 -- 172.21.15.102:0/3069965680 <== osd.2 v2:172.21.15.102:6816/2238176080 30 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb934064040 con 0x7fb944045c10 2024-09-13T19:16:37.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.470+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049ab80 con 0x7fb944045c10 2024-09-13T19:16:37.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.470+0000 7fb94b214640 1 -- 172.21.15.102:0/3069965680 <== osd.2 v2:172.21.15.102:6816/2238176080 31 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb934064040 con 0x7fb944045c10 2024-09-13T19:16:37.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.470+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x7fb944045c10 2024-09-13T19:16:37.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.470+0000 7fb94b214640 1 -- 172.21.15.102:0/3069965680 <== osd.2 v2:172.21.15.102:6816/2238176080 32 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb934064040 con 0x7fb944045c10 2024-09-13T19:16:37.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.470+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x7fb9340448a0 2024-09-13T19:16:37.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.471+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.0 v2:172.21.15.53:6800/4021716951 30 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb93c057030 con 0x7fb9340448a0 2024-09-13T19:16:37.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.471+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049ab80 con 0x7fb9340448a0 2024-09-13T19:16:37.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.471+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.0 v2:172.21.15.53:6800/4021716951 31 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb93c057030 con 0x7fb9340448a0 2024-09-13T19:16:37.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.471+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x7fb9340448a0 2024-09-13T19:16:37.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.472+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.0 v2:172.21.15.53:6800/4021716951 32 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb93c057030 con 0x7fb9340448a0 2024-09-13T19:16:37.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.472+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x5652e0451c70 2024-09-13T19:16:37.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.472+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.1 v2:172.21.15.102:6808/2204418452 36 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv162 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb93c057030 con 0x5652e0451c70 2024-09-13T19:16:37.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.472+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049ab80 con 0x5652e0451c70 2024-09-13T19:16:37.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.472+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.1 v2:172.21.15.102:6808/2204418452 37 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv162 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb93c057030 con 0x5652e0451c70 2024-09-13T19:16:37.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.472+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x5652e0451c70 2024-09-13T19:16:37.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.472+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.1 v2:172.21.15.102:6808/2204418452 38 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv162 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb93c057030 con 0x5652e0451c70 2024-09-13T19:16:37.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.472+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x5652e0456680 2024-09-13T19:16:37.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.473+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 37 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.473+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049ab80 con 0x5652e0456680 2024-09-13T19:16:37.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.473+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 38 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv45 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.473+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x5652e0456680 2024-09-13T19:16:37.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.473+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 39 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.473+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x7fb944045c10 2024-09-13T19:16:37.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.473+0000 7fb94b214640 1 -- 172.21.15.102:0/3069965680 <== osd.2 v2:172.21.15.102:6816/2238176080 33 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb934064040 con 0x7fb944045c10 2024-09-13T19:16:37.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.473+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049ab80 con 0x7fb944045c10 2024-09-13T19:16:37.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.474+0000 7fb94b214640 1 -- 172.21.15.102:0/3069965680 <== osd.2 v2:172.21.15.102:6816/2238176080 34 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv53 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb934064040 con 0x7fb944045c10 2024-09-13T19:16:37.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.474+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x7fb944045c10 2024-09-13T19:16:37.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.474+0000 7fb94b214640 1 -- 172.21.15.102:0/3069965680 <== osd.2 v2:172.21.15.102:6816/2238176080 35 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb934064040 con 0x7fb944045c10 2024-09-13T19:16:37.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.474+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x5652e0456680 2024-09-13T19:16:37.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.474+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 40 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.474+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049ab80 con 0x5652e0456680 2024-09-13T19:16:37.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.474+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 41 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.474+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x5652e0456680 2024-09-13T19:16:37.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.475+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 42 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.475+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x5652e0451c70 2024-09-13T19:16:37.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.475+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.1 v2:172.21.15.102:6808/2204418452 39 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb93c057030 con 0x5652e0451c70 2024-09-13T19:16:37.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.475+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049ab80 con 0x5652e0451c70 2024-09-13T19:16:37.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.475+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.1 v2:172.21.15.102:6808/2204418452 40 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb93c057030 con 0x5652e0451c70 2024-09-13T19:16:37.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.475+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x5652e0451c70 2024-09-13T19:16:37.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.475+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.1 v2:172.21.15.102:6808/2204418452 41 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb93c057030 con 0x5652e0451c70 2024-09-13T19:16:37.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.476+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x5652e0451c70 2024-09-13T19:16:37.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.476+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.1 v2:172.21.15.102:6808/2204418452 42 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv164 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb93c057030 con 0x5652e0451c70 2024-09-13T19:16:37.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.476+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049ab80 con 0x5652e0451c70 2024-09-13T19:16:37.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.476+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.1 v2:172.21.15.102:6808/2204418452 43 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv164 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb93c057030 con 0x5652e0451c70 2024-09-13T19:16:37.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.476+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x5652e0451c70 2024-09-13T19:16:37.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.476+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.1 v2:172.21.15.102:6808/2204418452 44 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv164 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb93c057030 con 0x5652e0451c70 2024-09-13T19:16:37.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.476+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x5652e0456680 2024-09-13T19:16:37.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.476+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 43 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.476+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049ab80 con 0x5652e0456680 2024-09-13T19:16:37.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.477+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 44 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv47 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.477+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x5652e0456680 2024-09-13T19:16:37.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.477+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 45 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.477+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x7fb944045c10 2024-09-13T19:16:37.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.477+0000 7fb94b214640 1 -- 172.21.15.102:0/3069965680 <== osd.2 v2:172.21.15.102:6816/2238176080 36 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb934064040 con 0x7fb944045c10 2024-09-13T19:16:37.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.477+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049ab80 con 0x7fb944045c10 2024-09-13T19:16:37.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.478+0000 7fb94b214640 1 -- 172.21.15.102:0/3069965680 <== osd.2 v2:172.21.15.102:6816/2238176080 37 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv31 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb934064040 con 0x7fb944045c10 2024-09-13T19:16:37.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.478+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x7fb944045c10 2024-09-13T19:16:37.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.478+0000 7fb94b214640 1 -- 172.21.15.102:0/3069965680 <== osd.2 v2:172.21.15.102:6816/2238176080 38 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb934064040 con 0x7fb944045c10 2024-09-13T19:16:37.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.478+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x5652e0456680 2024-09-13T19:16:37.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.478+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 46 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.478+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049ab80 con 0x5652e0456680 2024-09-13T19:16:37.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.478+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 47 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.478+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x5652e0456680 2024-09-13T19:16:37.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.479+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 48 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.479+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x5652e0456680 2024-09-13T19:16:37.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.479+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 49 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.479+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049ab80 con 0x5652e0456680 2024-09-13T19:16:37.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.479+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 50 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.479+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x5652e0456680 2024-09-13T19:16:37.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.479+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 51 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.479+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x5652e0456680 2024-09-13T19:16:37.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.479+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 52 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.479+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049ab80 con 0x5652e0456680 2024-09-13T19:16:37.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.480+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 53 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv17 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.480+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x5652e0456680 2024-09-13T19:16:37.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.480+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 54 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.480+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x5652e0456680 2024-09-13T19:16:37.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.480+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 55 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.480+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049ab80 con 0x5652e0456680 2024-09-13T19:16:37.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.480+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 56 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.480+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x5652e0456680 2024-09-13T19:16:37.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.481+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 57 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.481+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x7fb9340448a0 2024-09-13T19:16:37.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.481+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.0 v2:172.21.15.53:6800/4021716951 33 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb93c057030 con 0x7fb9340448a0 2024-09-13T19:16:37.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.481+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049ab80 con 0x7fb9340448a0 2024-09-13T19:16:37.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.481+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.0 v2:172.21.15.53:6800/4021716951 34 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb93c057030 con 0x7fb9340448a0 2024-09-13T19:16:37.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.481+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x7fb9340448a0 2024-09-13T19:16:37.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.482+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.0 v2:172.21.15.53:6800/4021716951 35 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb93c057030 con 0x7fb9340448a0 2024-09-13T19:16:37.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.482+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x5652e0456680 2024-09-13T19:16:37.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.482+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 58 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.482+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049ab80 con 0x5652e0456680 2024-09-13T19:16:37.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.482+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 59 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.482+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x5652e0456680 2024-09-13T19:16:37.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.482+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 60 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.482+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x7fb9340448a0 2024-09-13T19:16:37.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.483+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.0 v2:172.21.15.53:6800/4021716951 36 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb93c057030 con 0x7fb9340448a0 2024-09-13T19:16:37.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.483+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049ab80 con 0x7fb9340448a0 2024-09-13T19:16:37.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.483+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.0 v2:172.21.15.53:6800/4021716951 37 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb93c057030 con 0x7fb9340448a0 2024-09-13T19:16:37.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.483+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x7fb9340448a0 2024-09-13T19:16:37.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.483+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.0 v2:172.21.15.53:6800/4021716951 38 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb93c057030 con 0x7fb9340448a0 2024-09-13T19:16:37.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.483+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x5652e0456680 2024-09-13T19:16:37.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.483+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 61 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.483+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049ab80 con 0x5652e0456680 2024-09-13T19:16:37.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.484+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 62 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv49 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.484+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x5652e0456680 2024-09-13T19:16:37.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.484+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 63 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.484+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x7fb9340448a0 2024-09-13T19:16:37.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.484+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.0 v2:172.21.15.53:6800/4021716951 39 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb93c057030 con 0x7fb9340448a0 2024-09-13T19:16:37.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.485+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049ab80 con 0x7fb9340448a0 2024-09-13T19:16:37.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.485+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.0 v2:172.21.15.53:6800/4021716951 40 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb93c057030 con 0x7fb9340448a0 2024-09-13T19:16:37.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.485+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x7fb9340448a0 2024-09-13T19:16:37.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.485+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.0 v2:172.21.15.53:6800/4021716951 41 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb93c057030 con 0x7fb9340448a0 2024-09-13T19:16:37.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.485+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x7fb944045c10 2024-09-13T19:16:37.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.486+0000 7fb94b214640 1 -- 172.21.15.102:0/3069965680 <== osd.2 v2:172.21.15.102:6816/2238176080 39 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb934064040 con 0x7fb944045c10 2024-09-13T19:16:37.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.486+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049ab80 con 0x7fb944045c10 2024-09-13T19:16:37.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.486+0000 7fb94b214640 1 -- 172.21.15.102:0/3069965680 <== osd.2 v2:172.21.15.102:6816/2238176080 40 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb934064040 con 0x7fb944045c10 2024-09-13T19:16:37.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.486+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5652e049bb90 con 0x7fb944045c10 2024-09-13T19:16:37.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.486+0000 7fb94b214640 1 -- 172.21.15.102:0/3069965680 <== osd.2 v2:172.21.15.102:6816/2238176080 41 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb934064040 con 0x7fb944045c10 2024-09-13T19:16:37.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.487+0000 7fb801fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:37.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.487+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94913950003616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e046d560 con 0x5652e0451c70 2024-09-13T19:16:37.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.488+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.1 v2:172.21.15.102:6808/2204418452 45 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94913950003616] v36'172 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb93c057030 con 0x5652e0451c70 2024-09-13T19:16:37.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.488+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94913949976912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e046ae00 con 0x7fb944045c10 2024-09-13T19:16:37.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.489+0000 7fb94b214640 1 -- 172.21.15.102:0/3069965680 <== osd.2 v2:172.21.15.102:6816/2238176080 42 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94913949976912] v36'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb934064040 con 0x7fb944045c10 2024-09-13T19:16:37.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.489+0000 7fb94d719800 20 remove_watcher() i=0 2024-09-13T19:16:37.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.489+0000 7fb94d719800 2 removed watcher, disabling cache 2024-09-13T19:16:37.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.489+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94913949981200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e046ae00 con 0x5652e0451c70 2024-09-13T19:16:37.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.490+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.1 v2:172.21.15.102:6808/2204418452 46 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94913949981200] v36'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb93c057030 con 0x5652e0451c70 2024-09-13T19:16:37.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.490+0000 7fb94d719800 20 remove_watcher() i=1 2024-09-13T19:16:37.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.490+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94913949987472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e046ae00 con 0x5652e0456680 2024-09-13T19:16:37.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.491+0000 7fb94ba15640 1 -- 172.21.15.102:0/3069965680 <== osd.3 v2:172.21.15.102:6800/3096737090 64 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94913949987472] v36'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb94400a4a0 con 0x5652e0456680 2024-09-13T19:16:37.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.491+0000 7fb94d719800 20 remove_watcher() i=2 2024-09-13T19:16:37.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.491+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94913949991504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e046ae00 con 0x7fb944045c10 2024-09-13T19:16:37.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.492+0000 7fb94b214640 1 -- 172.21.15.102:0/3069965680 <== osd.2 v2:172.21.15.102:6816/2238176080 43 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94913949991504] v36'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb934064040 con 0x7fb944045c10 2024-09-13T19:16:37.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.492+0000 7fb94d719800 20 remove_watcher() i=3 2024-09-13T19:16:37.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.492+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94913949994112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e046ae00 con 0x5652e0451c70 2024-09-13T19:16:37.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.493+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.1 v2:172.21.15.102:6808/2204418452 47 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94913949994112] v36'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb93c057030 con 0x5652e0451c70 2024-09-13T19:16:37.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.493+0000 7fb94d719800 20 remove_watcher() i=4 2024-09-13T19:16:37.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.493+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94913949996224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e046ae00 con 0x7fb9340448a0 2024-09-13T19:16:37.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.494+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.0 v2:172.21.15.53:6800/4021716951 42 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94913949996224] v36'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb93c057030 con 0x7fb9340448a0 2024-09-13T19:16:37.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.494+0000 7fb94d719800 20 remove_watcher() i=5 2024-09-13T19:16:37.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.494+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94913949998544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e046ae00 con 0x7fb9340448a0 2024-09-13T19:16:37.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.495+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.0 v2:172.21.15.53:6800/4021716951 43 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94913949998544] v36'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb93c057030 con 0x7fb9340448a0 2024-09-13T19:16:37.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.495+0000 7fb94d719800 20 remove_watcher() i=6 2024-09-13T19:16:37.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.495+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94913950001424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5652e046ae00 con 0x7fb9340448a0 2024-09-13T19:16:37.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.496+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 <== osd.0 v2:172.21.15.53:6800/4021716951 44 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94913950001424] v36'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb93c057030 con 0x7fb9340448a0 2024-09-13T19:16:37.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.496+0000 7fb94d719800 20 remove_watcher() i=7 2024-09-13T19:16:37.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.497+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fb9340448a0 msgr2=0x7fb93401b830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.497+0000 7fb94d719800 1 --2- 172.21.15.102:0/3069965680 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fb9340448a0 0x7fb93401b830 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.497+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5652e0451c70 msgr2=0x5652e0454130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.497+0000 7fb94d719800 1 --2- 172.21.15.102:0/3069965680 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5652e0451c70 0x5652e0454130 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.497+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fb944045c10 msgr2=0x7fb944023820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.497+0000 7fb94d719800 1 --2- 172.21.15.102:0/3069965680 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fb944045c10 0x7fb944023820 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.497+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5652e0456680 msgr2=0x5652e0458a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.497+0000 7fb94d719800 1 --2- 172.21.15.102:0/3069965680 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5652e0456680 0x5652e0458a70 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.497+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb814036b40 msgr2=0x7fb814039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.497+0000 7fb94d719800 1 --2- 172.21.15.102:0/3069965680 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb814036b40 0x7fb814039000 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb93404b2d0 tx=0x7fb934039000 comp rx=0 tx=0).stop 2024-09-13T19:16:37.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.497+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652e043ecf0 msgr2=0x5652e04461a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.497+0000 7fb94d719800 1 --2- 172.21.15.102:0/3069965680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652e043ecf0 0x5652e04461a0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fb944012fd0 tx=0x7fb94404cd10 comp rx=0 tx=0).stop 2024-09-13T19:16:37.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.497+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 reap_dead start 2024-09-13T19:16:37.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.497+0000 7fb94aa13640 1 -- 172.21.15.102:0/3069965680 reap_dead start 2024-09-13T19:16:37.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.497+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 shutdown_connections 2024-09-13T19:16:37.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.497+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 >> 172.21.15.102:0/3069965680 conn(0x5652e043b050 msgr2=0x5652e0439110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:37.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.497+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 shutdown_connections 2024-09-13T19:16:37.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.497+0000 7fb94d719800 1 -- 172.21.15.102:0/3069965680 wait complete. 2024-09-13T19:16:37.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.497+0000 7fb94d719800 1 -- 172.21.15.102:0/2541012954 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb824036b40 msgr2=0x7fb824039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.497+0000 7fb94d719800 1 --2- 172.21.15.102:0/2541012954 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb824036b40 0x7fb824039000 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x5652e041b7f0 tx=0x7fb93401ae70 comp rx=0 tx=0).stop 2024-09-13T19:16:37.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.497+0000 7fb94d719800 1 -- 172.21.15.102:0/2541012954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652e0431ff0 msgr2=0x5652e0432410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.497+0000 7fb94d719800 1 --2- 172.21.15.102:0/2541012954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652e0431ff0 0x5652e0432410 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x5652e0418340 tx=0x7fb9440167b0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.497+0000 7fb94d719800 1 -- 172.21.15.102:0/2541012954 shutdown_connections 2024-09-13T19:16:37.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.497+0000 7fb94d719800 1 --2- 172.21.15.102:0/2541012954 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb824036b40 0x7fb824039000 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.497+0000 7fb94d719800 1 --2- 172.21.15.102:0/2541012954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652e0431ff0 0x5652e0432410 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.497+0000 7fb94d719800 1 -- 172.21.15.102:0/2541012954 >> 172.21.15.102:0/2541012954 conn(0x5652e0426f80 msgr2=0x5652e0429b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:37.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.497+0000 7fb94d719800 1 -- 172.21.15.102:0/2541012954 shutdown_connections 2024-09-13T19:16:37.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.497+0000 7fb94d719800 1 -- 172.21.15.102:0/2541012954 wait complete. 2024-09-13T19:16:37.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.498+0000 7fb94d719800 1 -- 172.21.15.102:0/2136315643 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5652e0324a60 msgr2=0x5652e041e300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.498+0000 7fb94d719800 1 --2- 172.21.15.102:0/2136315643 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5652e0324a60 0x5652e041e300 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.498+0000 7fb94d719800 1 -- 172.21.15.102:0/2136315643 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5652e0420bb0 msgr2=0x5652e0422fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.498+0000 7fb94d719800 1 --2- 172.21.15.102:0/2136315643 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5652e0420bb0 0x5652e0422fa0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.498+0000 7fb94d719800 1 -- 172.21.15.102:0/2136315643 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb830036b40 msgr2=0x7fb830039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.498+0000 7fb94d719800 1 --2- 172.21.15.102:0/2136315643 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb830036b40 0x7fb830039000 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb93c057000 tx=0x7fb93c052000 comp rx=0 tx=0).stop 2024-09-13T19:16:37.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.498+0000 7fb94d719800 1 -- 172.21.15.102:0/2136315643 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652e0320760 msgr2=0x5652e0417290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.498+0000 7fb94d719800 1 --2- 172.21.15.102:0/2136315643 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652e0320760 0x5652e0417290 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fb93400b5f0 tx=0x7fb934000ed0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.498+0000 7fb94d719800 1 -- 172.21.15.102:0/2136315643 shutdown_connections 2024-09-13T19:16:37.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.498+0000 7fb94d719800 1 --2- 172.21.15.102:0/2136315643 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5652e0420bb0 0x5652e0422fa0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.498+0000 7fb94d719800 1 --2- 172.21.15.102:0/2136315643 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5652e0324a60 0x5652e041e300 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.498+0000 7fb94d719800 1 --2- 172.21.15.102:0/2136315643 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb830036b40 0x7fb830039000 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.498+0000 7fb94d719800 1 --2- 172.21.15.102:0/2136315643 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652e0320760 0x5652e0417290 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.498+0000 7fb94d719800 1 -- 172.21.15.102:0/2136315643 >> 172.21.15.102:0/2136315643 conn(0x5652e031bff0 msgr2=0x5652e0409a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:37.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.498+0000 7fb94d719800 1 -- 172.21.15.102:0/2136315643 shutdown_connections 2024-09-13T19:16:37.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.498+0000 7fb94d719800 1 -- 172.21.15.102:0/2136315643 wait complete. 2024-09-13T19:16:37.512 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-13T19:16:37.512 DEBUG:tasks.util.rgw: json result: [] 2024-09-13T19:16:37.513 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-13T19:16:37.513 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-13T19:16:37.513 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-13T19:16:37.596 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:37.597 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:37.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.594+0000 7fa485506800 1 Processor -- start 2024-09-13T19:16:37.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.594+0000 7fa485506800 1 -- start start 2024-09-13T19:16:37.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.594+0000 7fa485506800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f1bc7ef900 0x55f1bc7f1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.594+0000 7fa485506800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f1bc6abb30 con 0x55f1bc7eb4c0 2024-09-13T19:16:37.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.594+0000 7fa485506800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55f1bc68d360 con 0x55f1bc7ef900 2024-09-13T19:16:37.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.595+0000 7fa4827f9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f1bc7ef900 0x55f1bc7f1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.595+0000 7fa482ffa640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55f1bc7eb4c0 0x55f1bc7eb8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:48506/0 (socket says 172.21.15.102:48506) 2024-09-13T19:16:37.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.595+0000 7fa482ffa640 1 -- 172.21.15.102:0/2262523221 learned_addr learned my addr 172.21.15.102:0/2262523221 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:16:37.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.595+0000 7fa4827f9640 1 -- 172.21.15.102:0/2262523221 >> v1:172.21.15.53:6789/0 conn(0x55f1bc7eb4c0 legacy=0x55f1bc7eb8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.595+0000 7fa481ff8640 1 -- 172.21.15.102:0/2262523221 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 243487449 0 0) 0x55f1bc6abb30 con 0x55f1bc7eb4c0 2024-09-13T19:16:37.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.595+0000 7fa4827f9640 1 -- 172.21.15.102:0/2262523221 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1bc6b3e00 con 0x55f1bc7ef900 2024-09-13T19:16:37.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.597+0000 7fa4827f9640 1 --2- 172.21.15.102:0/2262523221 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1bc7ef900 0x55f1bc7f1cf0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fa47800a470 tx=0x7fa478045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=229d04ec5ae8d705 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.597+0000 7fa481ff8640 1 -- 172.21.15.102:0/2262523221 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa478053570 con 0x55f1bc7ef900 2024-09-13T19:16:37.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.597+0000 7fa481ff8640 1 -- 172.21.15.102:0/2262523221 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa478058070 con 0x55f1bc7ef900 2024-09-13T19:16:37.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.597+0000 7fa481ff8640 1 -- 172.21.15.102:0/2262523221 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa478053880 con 0x55f1bc7ef900 2024-09-13T19:16:37.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.597+0000 7fa485506800 1 -- 172.21.15.102:0/2262523221 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1bc7ef900 msgr2=0x55f1bc7f1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.597+0000 7fa485506800 1 --2- 172.21.15.102:0/2262523221 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1bc7ef900 0x55f1bc7f1cf0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fa47800a470 tx=0x7fa478045a20 comp rx=0 tx=0).stop 2024-09-13T19:16:37.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.597+0000 7fa485506800 1 -- 172.21.15.102:0/2262523221 shutdown_connections 2024-09-13T19:16:37.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.597+0000 7fa485506800 1 --2- 172.21.15.102:0/2262523221 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1bc7ef900 0x55f1bc7f1cf0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.597+0000 7fa485506800 1 -- 172.21.15.102:0/2262523221 >> 172.21.15.102:0/2262523221 conn(0x55f1bc7e6df0 msgr2=0x55f1bc7e9210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:37.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.597+0000 7fa485506800 1 -- 172.21.15.102:0/2262523221 shutdown_connections 2024-09-13T19:16:37.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.597+0000 7fa485506800 1 -- 172.21.15.102:0/2262523221 wait complete. 2024-09-13T19:16:37.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.611+0000 7fa485506800 1 Processor -- start 2024-09-13T19:16:37.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.611+0000 7fa485506800 1 -- start start 2024-09-13T19:16:37.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.612+0000 7fa485506800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1bc7eb4c0 0x55f1bc8da510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.612+0000 7fa485506800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f1bc738330 con 0x55f1bc7eb4c0 2024-09-13T19:16:37.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.612+0000 7fa482ffa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1bc7eb4c0 0x55f1bc8da510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.612+0000 7fa482ffa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1bc7eb4c0 0x55f1bc8da510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55328/0 (socket says 172.21.15.102:55328) 2024-09-13T19:16:37.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.612+0000 7fa482ffa640 1 -- 172.21.15.102:0/237583429 learned_addr learned my addr 172.21.15.102:0/237583429 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:37.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.612+0000 7fa482ffa640 1 -- 172.21.15.102:0/237583429 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1bc685bc0 con 0x55f1bc7eb4c0 2024-09-13T19:16:37.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.613+0000 7fa482ffa640 1 --2- 172.21.15.102:0/237583429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1bc7eb4c0 0x55f1bc8da510 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fa474001660 tx=0x7fa474001b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bfd849412211143 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.613+0000 7fa370e09640 1 -- 172.21.15.102:0/237583429 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa474003450 con 0x55f1bc7eb4c0 2024-09-13T19:16:37.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.613+0000 7fa370e09640 1 -- 172.21.15.102:0/237583429 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa474003610 con 0x55f1bc7eb4c0 2024-09-13T19:16:37.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.613+0000 7fa370e09640 1 -- 172.21.15.102:0/237583429 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4740039b0 con 0x55f1bc7eb4c0 2024-09-13T19:16:37.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.613+0000 7fa485506800 1 -- 172.21.15.102:0/237583429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1bc7eb4c0 msgr2=0x55f1bc8da510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.613+0000 7fa485506800 1 --2- 172.21.15.102:0/237583429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1bc7eb4c0 0x55f1bc8da510 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fa474001660 tx=0x7fa474001b20 comp rx=0 tx=0).stop 2024-09-13T19:16:37.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.613+0000 7fa485506800 1 -- 172.21.15.102:0/237583429 shutdown_connections 2024-09-13T19:16:37.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.613+0000 7fa485506800 1 --2- 172.21.15.102:0/237583429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1bc7eb4c0 0x55f1bc8da510 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.613+0000 7fa485506800 1 -- 172.21.15.102:0/237583429 >> 172.21.15.102:0/237583429 conn(0x55f1bc7e6df0 msgr2=0x55f1bc8d5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:37.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.613+0000 7fa485506800 1 -- 172.21.15.102:0/237583429 shutdown_connections 2024-09-13T19:16:37.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.613+0000 7fa485506800 1 -- 172.21.15.102:0/237583429 wait complete. 2024-09-13T19:16:37.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.614+0000 7fa485506800 1 Processor -- start 2024-09-13T19:16:37.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.614+0000 7fa485506800 1 -- start start 2024-09-13T19:16:37.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.614+0000 7fa485506800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1bc7eb4c0 0x55f1bc8e1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.614+0000 7fa485506800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f1bc7f2530 con 0x55f1bc7eb4c0 2024-09-13T19:16:37.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.614+0000 7fa482ffa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1bc7eb4c0 0x55f1bc8e1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.614+0000 7fa482ffa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1bc7eb4c0 0x55f1bc8e1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55332/0 (socket says 172.21.15.102:55332) 2024-09-13T19:16:37.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.614+0000 7fa482ffa640 1 -- 172.21.15.102:0/1850470737 learned_addr learned my addr 172.21.15.102:0/1850470737 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:37.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.615+0000 7fa482ffa640 1 -- 172.21.15.102:0/1850470737 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1bc699fe0 con 0x55f1bc7eb4c0 2024-09-13T19:16:37.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.615+0000 7fa482ffa640 1 --2- 172.21.15.102:0/1850470737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1bc7eb4c0 0x55f1bc8e1f20 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x55f1bc8db370 tx=0x7fa474001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.615+0000 7fa36f606640 1 -- 172.21.15.102:0/1850470737 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa474013820 con 0x55f1bc7eb4c0 2024-09-13T19:16:37.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.615+0000 7fa36f606640 1 -- 172.21.15.102:0/1850470737 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4740139c0 con 0x55f1bc7eb4c0 2024-09-13T19:16:37.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.615+0000 7fa485506800 1 -- 172.21.15.102:0/1850470737 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f1bc8e2460 con 0x55f1bc7eb4c0 2024-09-13T19:16:37.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.615+0000 7fa36f606640 1 -- 172.21.15.102:0/1850470737 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa474013ca0 con 0x55f1bc7eb4c0 2024-09-13T19:16:37.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.615+0000 7fa485506800 1 -- 172.21.15.102:0/1850470737 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1bc8e29e0 con 0x55f1bc7eb4c0 2024-09-13T19:16:37.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.616+0000 7fa36f606640 1 -- 172.21.15.102:0/1850470737 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa474010070 con 0x55f1bc7eb4c0 2024-09-13T19:16:37.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.616+0000 7fa36f606640 1 --2- 172.21.15.102:0/1850470737 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa368036b90 0x7fa368039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.616+0000 7fa36f606640 1 -- 172.21.15.102:0/1850470737 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fa47404e670 con 0x55f1bc7eb4c0 2024-09-13T19:16:37.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.616+0000 7fa4827f9640 1 --2- 172.21.15.102:0/1850470737 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa368036b90 0x7fa368039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.616+0000 7fa485506800 1 --2- 172.21.15.102:0/1850470737 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55f1bc7ef900 0x55f1bc8e7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.616+0000 7fa485506800 1 -- 172.21.15.102:0/1850470737 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc8e8420 con 0x55f1bc7ef900 2024-09-13T19:16:37.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.616+0000 7fa4837fb640 1 --2- 172.21.15.102:0/1850470737 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55f1bc7ef900 0x55f1bc8e7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.617+0000 7fa4827f9640 1 --2- 172.21.15.102:0/1850470737 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa368036b90 0x7fa368039050 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa478057000 tx=0x7fa478052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.617+0000 7fa4837fb640 1 --2- 172.21.15.102:0/1850470737 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55f1bc7ef900 0x55f1bc8e7ee0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.617+0000 7fa4837fb640 1 -- 172.21.15.102:0/1850470737 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa47c0083e0 con 0x55f1bc7ef900 2024-09-13T19:16:37.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.617+0000 7fa485506800 1 -- 172.21.15.102:0/1850470737 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc8e5490 con 0x55f1bc7ef900 2024-09-13T19:16:37.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.617+0000 7fa4837fb640 1 -- 172.21.15.102:0/1850470737 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa47c0083e0 con 0x55f1bc7ef900 2024-09-13T19:16:37.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.617+0000 7fa485506800 1 --2- 172.21.15.102:0/1850470737 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55f1bc8ea710 0x55f1bc8ecb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.617+0000 7fa485506800 1 -- 172.21.15.102:0/1850470737 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc8ed1f0 con 0x55f1bc8ea710 2024-09-13T19:16:37.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.617+0000 7fa482ffa640 1 --2- 172.21.15.102:0/1850470737 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55f1bc8ea710 0x55f1bc8ecb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.618+0000 7fa482ffa640 1 --2- 172.21.15.102:0/1850470737 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55f1bc8ea710 0x55f1bc8ecb00 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.618+0000 7fa482ffa640 1 -- 172.21.15.102:0/1850470737 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa47402d070 con 0x55f1bc8ea710 2024-09-13T19:16:37.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.618+0000 7fa485506800 1 -- 172.21.15.102:0/1850470737 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc8e95b0 con 0x55f1bc7ef900 2024-09-13T19:16:37.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.618+0000 7fa4837fb640 1 -- 172.21.15.102:0/1850470737 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa47c0083e0 con 0x55f1bc7ef900 2024-09-13T19:16:37.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.618+0000 7fa485506800 1 -- 172.21.15.102:0/1850470737 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc8e9a50 con 0x55f1bc8ea710 2024-09-13T19:16:37.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.618+0000 7fa482ffa640 1 -- 172.21.15.102:0/1850470737 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa47402d070 con 0x55f1bc8ea710 2024-09-13T19:16:37.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.619+0000 7fa485506800 1 Processor -- start 2024-09-13T19:16:37.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.619+0000 7fa485506800 1 -- start start 2024-09-13T19:16:37.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.619+0000 7fa485506800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1bc8fffa0 0x55f1bc9003c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.619+0000 7fa485506800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f1bc687580 con 0x55f1bc8fffa0 2024-09-13T19:16:37.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.619+0000 7fa4837fb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1bc8fffa0 0x55f1bc9003c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.619+0000 7fa4837fb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1bc8fffa0 0x55f1bc9003c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55334/0 (socket says 172.21.15.102:55334) 2024-09-13T19:16:37.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.619+0000 7fa4837fb640 1 -- 172.21.15.102:0/234689397 learned_addr learned my addr 172.21.15.102:0/234689397 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:37.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.620+0000 7fa4837fb640 1 -- 172.21.15.102:0/234689397 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1bc900900 con 0x55f1bc8fffa0 2024-09-13T19:16:37.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.620+0000 7fa4837fb640 1 --2- 172.21.15.102:0/234689397 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1bc8fffa0 0x55f1bc9003c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x55f1bc8e3320 tx=0x7fa47c00beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.620+0000 7fa36ce01640 1 -- 172.21.15.102:0/234689397 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa47c01c020 con 0x55f1bc8fffa0 2024-09-13T19:16:37.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.620+0000 7fa36ce01640 1 -- 172.21.15.102:0/234689397 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa47c007c30 con 0x55f1bc8fffa0 2024-09-13T19:16:37.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.620+0000 7fa36ce01640 1 -- 172.21.15.102:0/234689397 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa47c018440 con 0x55f1bc8fffa0 2024-09-13T19:16:37.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.620+0000 7fa485506800 1 -- 172.21.15.102:0/234689397 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f1bc900b90 con 0x55f1bc8fffa0 2024-09-13T19:16:37.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.620+0000 7fa485506800 1 -- 172.21.15.102:0/234689397 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1bc903870 con 0x55f1bc8fffa0 2024-09-13T19:16:37.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.621+0000 7fa36ce01640 1 -- 172.21.15.102:0/234689397 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa47c01f020 con 0x55f1bc8fffa0 2024-09-13T19:16:37.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.621+0000 7fa36ce01640 1 --2- 172.21.15.102:0/234689397 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa35c036b90 0x7fa35c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.621+0000 7fa36ce01640 1 -- 172.21.15.102:0/234689397 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fa47c04e2e0 con 0x55f1bc8fffa0 2024-09-13T19:16:37.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.621+0000 7fa482ffa640 1 --2- 172.21.15.102:0/234689397 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa35c036b90 0x7fa35c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.621+0000 7fa485506800 1 Processor -- start 2024-09-13T19:16:37.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.622+0000 7fa485506800 1 -- start start 2024-09-13T19:16:37.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.622+0000 7fa482ffa640 1 --2- 172.21.15.102:0/234689397 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa35c036b90 0x7fa35c039050 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x55f1bc8e9580 tx=0x7fa474003450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.622+0000 7fa485506800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1bc90ccc0 0x55f1bc90d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.622+0000 7fa485506800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f1bc8dac60 con 0x55f1bc90ccc0 2024-09-13T19:16:37.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.622+0000 7fa4837fb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1bc90ccc0 0x55f1bc90d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.622+0000 7fa4837fb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1bc90ccc0 0x55f1bc90d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55346/0 (socket says 172.21.15.102:55346) 2024-09-13T19:16:37.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.622+0000 7fa4837fb640 1 -- 172.21.15.102:0/1316566128 learned_addr learned my addr 172.21.15.102:0/1316566128 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:37.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.622+0000 7fa4837fb640 1 -- 172.21.15.102:0/1316566128 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1bc90d690 con 0x55f1bc90ccc0 2024-09-13T19:16:37.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.622+0000 7fa4837fb640 1 --2- 172.21.15.102:0/1316566128 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1bc90ccc0 0x55f1bc90d0c0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fa47c007fd0 tx=0x7fa47c020920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2318b270c873cd51 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.622+0000 7fa3667fc640 1 -- 172.21.15.102:0/1316566128 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa47c03f070 con 0x55f1bc90ccc0 2024-09-13T19:16:37.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.622+0000 7fa3667fc640 1 -- 172.21.15.102:0/1316566128 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa47c029350 con 0x55f1bc90ccc0 2024-09-13T19:16:37.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.622+0000 7fa3667fc640 1 -- 172.21.15.102:0/1316566128 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa47c0203b0 con 0x55f1bc90ccc0 2024-09-13T19:16:37.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.623+0000 7fa485506800 1 -- 172.21.15.102:0/1316566128 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1bc90ccc0 msgr2=0x55f1bc90d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.623+0000 7fa485506800 1 --2- 172.21.15.102:0/1316566128 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1bc90ccc0 0x55f1bc90d0c0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fa47c007fd0 tx=0x7fa47c020920 comp rx=0 tx=0).stop 2024-09-13T19:16:37.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.623+0000 7fa485506800 1 -- 172.21.15.102:0/1316566128 shutdown_connections 2024-09-13T19:16:37.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.623+0000 7fa485506800 1 --2- 172.21.15.102:0/1316566128 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1bc90ccc0 0x55f1bc90d0c0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.623+0000 7fa485506800 1 -- 172.21.15.102:0/1316566128 >> 172.21.15.102:0/1316566128 conn(0x55f1bc909070 msgr2=0x55f1bc907170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:37.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.623+0000 7fa485506800 1 -- 172.21.15.102:0/1316566128 shutdown_connections 2024-09-13T19:16:37.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.623+0000 7fa485506800 1 -- 172.21.15.102:0/1316566128 wait complete. 2024-09-13T19:16:37.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.623+0000 7fa485506800 1 Processor -- start 2024-09-13T19:16:37.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.623+0000 7fa485506800 1 -- start start 2024-09-13T19:16:37.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.623+0000 7fa485506800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1bc90ccc0 0x55f1bc9141d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.623+0000 7fa485506800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f1bc90dca0 con 0x55f1bc90ccc0 2024-09-13T19:16:37.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.624+0000 7fa4837fb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1bc90ccc0 0x55f1bc9141d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.624+0000 7fa4837fb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1bc90ccc0 0x55f1bc9141d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55352/0 (socket says 172.21.15.102:55352) 2024-09-13T19:16:37.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.624+0000 7fa4837fb640 1 -- 172.21.15.102:0/3351106890 learned_addr learned my addr 172.21.15.102:0/3351106890 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:37.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.624+0000 7fa4837fb640 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1bc914710 con 0x55f1bc90ccc0 2024-09-13T19:16:37.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.624+0000 7fa4837fb640 1 --2- 172.21.15.102:0/3351106890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1bc90ccc0 0x55f1bc9141d0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fa47c04c4c0 tx=0x7fa47c0088c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.624+0000 7fa364ff9640 1 -- 172.21.15.102:0/3351106890 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa47c046070 con 0x55f1bc90ccc0 2024-09-13T19:16:37.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.624+0000 7fa364ff9640 1 -- 172.21.15.102:0/3351106890 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa47c02f070 con 0x55f1bc90ccc0 2024-09-13T19:16:37.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.624+0000 7fa364ff9640 1 -- 172.21.15.102:0/3351106890 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa47c03f040 con 0x55f1bc90ccc0 2024-09-13T19:16:37.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.624+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f1bc9149a0 con 0x55f1bc90ccc0 2024-09-13T19:16:37.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.624+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1bc917650 con 0x55f1bc90ccc0 2024-09-13T19:16:37.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.625+0000 7fa364ff9640 1 -- 172.21.15.102:0/3351106890 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa47c016040 con 0x55f1bc90ccc0 2024-09-13T19:16:37.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.625+0000 7fa364ff9640 1 --2- 172.21.15.102:0/3351106890 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa34c036b40 0x7fa34c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.625+0000 7fa364ff9640 1 -- 172.21.15.102:0/3351106890 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fa47c040db0 con 0x55f1bc90ccc0 2024-09-13T19:16:37.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.625+0000 7fa482ffa640 1 --2- 172.21.15.102:0/3351106890 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa34c036b40 0x7fa34c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.626+0000 7fa482ffa640 1 --2- 172.21.15.102:0/3351106890 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa34c036b40 0x7fa34c039000 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa474018440 tx=0x7fa474033040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.626+0000 7fa485506800 20 rados->read ofs=0 len=0 2024-09-13T19:16:37.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.626+0000 7fa485506800 1 --2- 172.21.15.102:0/3351106890 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55f1bc91fcb0 0x55f1bc922170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.626+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc9228c0 con 0x55f1bc91fcb0 2024-09-13T19:16:37.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.626+0000 7fa4827f9640 1 --2- 172.21.15.102:0/3351106890 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55f1bc91fcb0 0x55f1bc922170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.626+0000 7fa4827f9640 1 --2- 172.21.15.102:0/3351106890 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55f1bc91fcb0 0x55f1bc922170 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.627+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa478051070 con 0x55f1bc91fcb0 2024-09-13T19:16:37.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.627+0000 7fa485506800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:37.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.627+0000 7fa485506800 20 realm 2024-09-13T19:16:37.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.627+0000 7fa485506800 20 rados->read ofs=0 len=0 2024-09-13T19:16:37.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.627+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc922cf0 con 0x55f1bc91fcb0 2024-09-13T19:16:37.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.627+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa478051070 con 0x55f1bc91fcb0 2024-09-13T19:16:37.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.627+0000 7fa485506800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:37.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.627+0000 7fa485506800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:37.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.627+0000 7fa485506800 20 rados->read ofs=0 len=0 2024-09-13T19:16:37.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.627+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc9235c0 con 0x55f1bc91fcb0 2024-09-13T19:16:37.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.627+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa478051070 con 0x55f1bc91fcb0 2024-09-13T19:16:37.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.627+0000 7fa485506800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:37.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.627+0000 7fa485506800 20 rados->read ofs=0 len=0 2024-09-13T19:16:37.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.627+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc923960 con 0x55f1bc91fcb0 2024-09-13T19:16:37.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.627+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa478051070 con 0x55f1bc91fcb0 2024-09-13T19:16:37.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.627+0000 7fa485506800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:37.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.627+0000 7fa485506800 20 rados->read ofs=0 len=0 2024-09-13T19:16:37.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.627+0000 7fa485506800 1 --2- 172.21.15.102:0/3351106890 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55f1bc9246c0 0x55f1bc926ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.627+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc9270c0 con 0x55f1bc9246c0 2024-09-13T19:16:37.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.627+0000 7fa4837fb640 1 --2- 172.21.15.102:0/3351106890 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55f1bc9246c0 0x55f1bc926ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.628+0000 7fa4837fb640 1 --2- 172.21.15.102:0/3351106890 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55f1bc9246c0 0x55f1bc926ab0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.628+0000 7fa4837fb640 1 -- 172.21.15.102:0/3351106890 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa47c028070 con 0x55f1bc9246c0 2024-09-13T19:16:37.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.628+0000 7fa485506800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:37.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.628+0000 7fa485506800 20 searching for the correct realm 2024-09-13T19:16:37.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.628+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc9289d0 con 0x55f1bc9246c0 2024-09-13T19:16:37.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.628+0000 7fa4837fb640 1 -- 172.21.15.102:0/3351106890 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa47c028070 con 0x55f1bc9246c0 2024-09-13T19:16:37.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.628+0000 7fa4837fb640 1 --2- 172.21.15.102:0/3351106890 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fa47c021020 0x7fa47c02b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.628+0000 7fa4837fb640 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc9289d0 con 0x7fa47c021020 2024-09-13T19:16:37.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.628+0000 7fa482ffa640 1 --2- 172.21.15.102:0/3351106890 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fa47c021020 0x7fa47c02b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.629+0000 7fa482ffa640 1 --2- 172.21.15.102:0/3351106890 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fa47c021020 0x7fa47c02b480 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.629+0000 7fa482ffa640 1 -- 172.21.15.102:0/3351106890 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa47402d070 con 0x7fa47c021020 2024-09-13T19:16:37.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.629+0000 7fa482ffa640 1 --2- 172.21.15.102:0/3351106890 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fa474026020 0x7fa4740115e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.629+0000 7fa482ffa640 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc9289d0 con 0x7fa474026020 2024-09-13T19:16:37.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.629+0000 7fa4827f9640 1 --2- 172.21.15.102:0/3351106890 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fa474026020 0x7fa4740115e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.630+0000 7fa4827f9640 1 --2- 172.21.15.102:0/3351106890 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fa474026020 0x7fa4740115e0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.630+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa478051070 con 0x7fa474026020 2024-09-13T19:16:37.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.630+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc9289d0 con 0x55f1bc91fcb0 2024-09-13T19:16:37.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.630+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa478051070 con 0x55f1bc91fcb0 2024-09-13T19:16:37.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.630+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc9289d0 con 0x55f1bc91fcb0 2024-09-13T19:16:37.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.630+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa478051070 con 0x55f1bc91fcb0 2024-09-13T19:16:37.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.630+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc9289d0 con 0x7fa474026020 2024-09-13T19:16:37.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.631+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa478051070 con 0x7fa474026020 2024-09-13T19:16:37.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.631+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc9289d0 con 0x7fa474026020 2024-09-13T19:16:37.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.631+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa478051070 con 0x7fa474026020 2024-09-13T19:16:37.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.631+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc9289d0 con 0x7fa47c021020 2024-09-13T19:16:37.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.631+0000 7fa482ffa640 1 -- 172.21.15.102:0/3351106890 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa47402d070 con 0x7fa47c021020 2024-09-13T19:16:37.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.631+0000 7fa482ffa640 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc9289d0 con 0x55f1bc9246c0 2024-09-13T19:16:37.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.631+0000 7fa4837fb640 1 -- 172.21.15.102:0/3351106890 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa47c028070 con 0x55f1bc9246c0 2024-09-13T19:16:37.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.631+0000 7fa4837fb640 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc9289d0 con 0x55f1bc91fcb0 2024-09-13T19:16:37.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.631+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa478051070 con 0x55f1bc91fcb0 2024-09-13T19:16:37.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.631+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc9289d0 con 0x7fa47c021020 2024-09-13T19:16:37.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.632+0000 7fa482ffa640 1 -- 172.21.15.102:0/3351106890 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa47402d070 con 0x7fa47c021020 2024-09-13T19:16:37.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.632+0000 7fa482ffa640 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc9289d0 con 0x55f1bc91fcb0 2024-09-13T19:16:37.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.632+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa478051070 con 0x55f1bc91fcb0 2024-09-13T19:16:37.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.632+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc9289d0 con 0x7fa47c021020 2024-09-13T19:16:37.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.632+0000 7fa482ffa640 1 -- 172.21.15.102:0/3351106890 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa47402d070 con 0x7fa47c021020 2024-09-13T19:16:37.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.632+0000 7fa482ffa640 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc9289d0 con 0x55f1bc9246c0 2024-09-13T19:16:37.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.632+0000 7fa4837fb640 1 -- 172.21.15.102:0/3351106890 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa47c028070 con 0x55f1bc9246c0 2024-09-13T19:16:37.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.632+0000 7fa4837fb640 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc9289d0 con 0x55f1bc9246c0 2024-09-13T19:16:37.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.633+0000 7fa4837fb640 1 -- 172.21.15.102:0/3351106890 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa47c028070 con 0x55f1bc9246c0 2024-09-13T19:16:37.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.633+0000 7fa4837fb640 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc9289d0 con 0x7fa474026020 2024-09-13T19:16:37.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.633+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa478051070 con 0x7fa474026020 2024-09-13T19:16:37.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.633+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc9289d0 con 0x55f1bc9246c0 2024-09-13T19:16:37.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.633+0000 7fa4837fb640 1 -- 172.21.15.102:0/3351106890 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa47c028070 con 0x55f1bc9246c0 2024-09-13T19:16:37.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.633+0000 7fa4837fb640 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc9289d0 con 0x55f1bc9246c0 2024-09-13T19:16:37.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.633+0000 7fa4837fb640 1 -- 172.21.15.102:0/3351106890 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa47c028070 con 0x55f1bc9246c0 2024-09-13T19:16:37.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.633+0000 7fa4837fb640 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa47c065040 con 0x55f1bc91fcb0 2024-09-13T19:16:37.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.634+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa478051070 con 0x55f1bc91fcb0 2024-09-13T19:16:37.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.634+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa47c065040 con 0x55f1bc91fcb0 2024-09-13T19:16:37.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.634+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa478051070 con 0x55f1bc91fcb0 2024-09-13T19:16:37.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.634+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa47c065040 con 0x7fa474026020 2024-09-13T19:16:37.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.634+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa478051070 con 0x7fa474026020 2024-09-13T19:16:37.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.634+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa47c065040 con 0x55f1bc9246c0 2024-09-13T19:16:37.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.634+0000 7fa4837fb640 1 -- 172.21.15.102:0/3351106890 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa47c028070 con 0x55f1bc9246c0 2024-09-13T19:16:37.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.634+0000 7fa4837fb640 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa47c065040 con 0x7fa47c021020 2024-09-13T19:16:37.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.635+0000 7fa482ffa640 1 -- 172.21.15.102:0/3351106890 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa47402d070 con 0x7fa47c021020 2024-09-13T19:16:37.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.635+0000 7fa482ffa640 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa47c065040 con 0x55f1bc91fcb0 2024-09-13T19:16:37.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.635+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa478051070 con 0x55f1bc91fcb0 2024-09-13T19:16:37.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.635+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa47c065040 con 0x7fa47c021020 2024-09-13T19:16:37.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.635+0000 7fa482ffa640 1 -- 172.21.15.102:0/3351106890 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa47402d070 con 0x7fa47c021020 2024-09-13T19:16:37.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.635+0000 7fa482ffa640 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa47c065040 con 0x55f1bc9246c0 2024-09-13T19:16:37.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.635+0000 7fa4837fb640 1 -- 172.21.15.102:0/3351106890 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa47c028070 con 0x55f1bc9246c0 2024-09-13T19:16:37.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.635+0000 7fa4837fb640 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa47c065040 con 0x7fa474026020 2024-09-13T19:16:37.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.636+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa478051070 con 0x7fa474026020 2024-09-13T19:16:37.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.636+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa47c065040 con 0x7fa47c021020 2024-09-13T19:16:37.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.636+0000 7fa482ffa640 1 -- 172.21.15.102:0/3351106890 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa47402d070 con 0x7fa47c021020 2024-09-13T19:16:37.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.636+0000 7fa482ffa640 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa47c065040 con 0x55f1bc9246c0 2024-09-13T19:16:37.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.636+0000 7fa4837fb640 1 -- 172.21.15.102:0/3351106890 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa47c028070 con 0x55f1bc9246c0 2024-09-13T19:16:37.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.636+0000 7fa4837fb640 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa47c065040 con 0x7fa474026020 2024-09-13T19:16:37.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.636+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa478051070 con 0x7fa474026020 2024-09-13T19:16:37.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.636+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa47c065040 con 0x55f1bc91fcb0 2024-09-13T19:16:37.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.637+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa478051070 con 0x55f1bc91fcb0 2024-09-13T19:16:37.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.637+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa47c065040 con 0x7fa47c021020 2024-09-13T19:16:37.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.637+0000 7fa482ffa640 1 -- 172.21.15.102:0/3351106890 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa47402d070 con 0x7fa47c021020 2024-09-13T19:16:37.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.637+0000 7fa485506800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:37.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.637+0000 7fa485506800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:37.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.637+0000 7fa485506800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:37.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.637+0000 7fa485506800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:37.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.637+0000 7fa485506800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:37.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.637+0000 7fa485506800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:37.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.637+0000 7fa485506800 20 rados->read ofs=0 len=0 2024-09-13T19:16:37.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.637+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc927460 con 0x55f1bc91fcb0 2024-09-13T19:16:37.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.637+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa478051070 con 0x55f1bc91fcb0 2024-09-13T19:16:37.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.637+0000 7fa485506800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:37.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.637+0000 7fa485506800 20 rados->read ofs=0 len=0 2024-09-13T19:16:37.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.637+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc927850 con 0x55f1bc91fcb0 2024-09-13T19:16:37.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.637+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa478051070 con 0x55f1bc91fcb0 2024-09-13T19:16:37.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.637+0000 7fa485506800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:37.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.637+0000 7fa485506800 20 rados->read ofs=0 len=0 2024-09-13T19:16:37.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.637+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc927c70 con 0x55f1bc9246c0 2024-09-13T19:16:37.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.638+0000 7fa4837fb640 1 -- 172.21.15.102:0/3351106890 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa47c028070 con 0x55f1bc9246c0 2024-09-13T19:16:37.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.638+0000 7fa485506800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:37.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.638+0000 7fa485506800 20 zone default found 2024-09-13T19:16:37.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.638+0000 7fa485506800 4 Realm: () 2024-09-13T19:16:37.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.638+0000 7fa485506800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:37.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.638+0000 7fa485506800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:37.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.638+0000 7fa485506800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:37.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.638+0000 7fa485506800 20 zonegroup default 2024-09-13T19:16:37.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.638+0000 7fa485506800 20 rados->read ofs=0 len=0 2024-09-13T19:16:37.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.638+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc928580 con 0x7fa47c021020 2024-09-13T19:16:37.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.638+0000 7fa482ffa640 1 -- 172.21.15.102:0/3351106890 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa47402d070 con 0x7fa47c021020 2024-09-13T19:16:37.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.638+0000 7fa485506800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:37.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.638+0000 7fa485506800 20 rados->read ofs=0 len=0 2024-09-13T19:16:37.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.638+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc92b210 con 0x55f1bc9246c0 2024-09-13T19:16:37.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.638+0000 7fa4837fb640 1 -- 172.21.15.102:0/3351106890 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa47c028070 con 0x55f1bc9246c0 2024-09-13T19:16:37.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.638+0000 7fa485506800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:37.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.638+0000 7fa485506800 20 rados->read ofs=0 len=0 2024-09-13T19:16:37.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.638+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc92b210 con 0x55f1bc9246c0 2024-09-13T19:16:37.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.638+0000 7fa4837fb640 1 -- 172.21.15.102:0/3351106890 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa47c028070 con 0x55f1bc9246c0 2024-09-13T19:16:37.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.638+0000 7fa485506800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:37.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.638+0000 7fa485506800 20 started sync module instance, tier type = 2024-09-13T19:16:37.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.638+0000 7fa485506800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:37.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.638+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc92a650 con 0x7fa47c021020 2024-09-13T19:16:37.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.639+0000 7fa482ffa640 1 -- 172.21.15.102:0/3351106890 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(44 notify.0 [create] v36'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa47402d070 con 0x7fa47c021020 2024-09-13T19:16:37.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.639+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94496739205808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc92acb0 con 0x7fa47c021020 2024-09-13T19:16:37.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.639+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc92b7d0 con 0x55f1bc91fcb0 2024-09-13T19:16:37.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.640+0000 7fa482ffa640 1 -- 172.21.15.102:0/3351106890 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94496739205808] v36'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa47402d070 con 0x7fa47c021020 2024-09-13T19:16:37.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.640+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v36'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa478051070 con 0x55f1bc91fcb0 2024-09-13T19:16:37.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.641+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94496739209888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc92b790 con 0x55f1bc91fcb0 2024-09-13T19:16:37.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.641+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc92c2b0 con 0x55f1bc9246c0 2024-09-13T19:16:37.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.641+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94496739209888] v36'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa478051070 con 0x55f1bc91fcb0 2024-09-13T19:16:37.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.642+0000 7fa4837fb640 1 -- 172.21.15.102:0/3351106890 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v36'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa47c028070 con 0x55f1bc9246c0 2024-09-13T19:16:37.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.642+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94496739212736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc92c2b0 con 0x55f1bc9246c0 2024-09-13T19:16:37.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.642+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc92cd40 con 0x7fa47c021020 2024-09-13T19:16:37.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.643+0000 7fa4837fb640 1 -- 172.21.15.102:0/3351106890 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94496739212736] v36'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa47c028070 con 0x55f1bc9246c0 2024-09-13T19:16:37.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.643+0000 7fa482ffa640 1 -- 172.21.15.102:0/3351106890 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(50 notify.3 [create] v36'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa47402d070 con 0x7fa47c021020 2024-09-13T19:16:37.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.643+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94496739215376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc92cd00 con 0x7fa47c021020 2024-09-13T19:16:37.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.643+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc92d7b0 con 0x55f1bc91fcb0 2024-09-13T19:16:37.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.644+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v36'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa478051070 con 0x55f1bc91fcb0 2024-09-13T19:16:37.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.644+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94496739218176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc92d780 con 0x55f1bc91fcb0 2024-09-13T19:16:37.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.644+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc92e7a0 con 0x7fa474026020 2024-09-13T19:16:37.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.644+0000 7fa482ffa640 1 -- 172.21.15.102:0/3351106890 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94496739215376] v36'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa47402d070 con 0x7fa47c021020 2024-09-13T19:16:37.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.645+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(54 notify.5 [create] v36'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa478051070 con 0x7fa474026020 2024-09-13T19:16:37.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.645+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94496739222128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc92e760 con 0x7fa474026020 2024-09-13T19:16:37.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.645+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc92f250 con 0x7fa474026020 2024-09-13T19:16:37.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.645+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94496739218176] v36'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa478051070 con 0x55f1bc91fcb0 2024-09-13T19:16:37.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.646+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94496739222128] v36'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa478051070 con 0x7fa474026020 2024-09-13T19:16:37.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.646+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(56 notify.6 [create] v36'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa478051070 con 0x7fa474026020 2024-09-13T19:16:37.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.646+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94496739207040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc92dbd0 con 0x7fa474026020 2024-09-13T19:16:37.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.646+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc92f700 con 0x7fa474026020 2024-09-13T19:16:37.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.647+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(58 notify.7 [create] v36'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa478051070 con 0x7fa474026020 2024-09-13T19:16:37.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.647+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94496739207040] v36'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa478051070 con 0x7fa474026020 2024-09-13T19:16:37.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.647+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94496739226192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc92f670 con 0x7fa474026020 2024-09-13T19:16:37.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.647+0000 7fa485506800 20 add_watcher() i=0 2024-09-13T19:16:37.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.647+0000 7fa485506800 20 add_watcher() i=1 2024-09-13T19:16:37.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.647+0000 7fa485506800 20 add_watcher() i=2 2024-09-13T19:16:37.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.647+0000 7fa485506800 20 add_watcher() i=3 2024-09-13T19:16:37.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.647+0000 7fa485506800 20 add_watcher() i=4 2024-09-13T19:16:37.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.647+0000 7fa485506800 20 add_watcher() i=5 2024-09-13T19:16:37.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.647+0000 7fa485506800 20 add_watcher() i=6 2024-09-13T19:16:37.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.648+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94496739226192] v36'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa478051070 con 0x7fa474026020 2024-09-13T19:16:37.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.648+0000 7fa485506800 20 add_watcher() i=7 2024-09-13T19:16:37.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.648+0000 7fa485506800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:37.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.648+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc932ad0 con 0x55f1bc91fcb0 2024-09-13T19:16:37.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.648+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa478051070 con 0x55f1bc91fcb0 2024-09-13T19:16:37.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.648+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94496739224880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc92fff0 con 0x55f1bc91fcb0 2024-09-13T19:16:37.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.649+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94496739224880] v36'173 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa478051070 con 0x55f1bc91fcb0 2024-09-13T19:16:37.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.650+0000 7fa3397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:37.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.650+0000 7fa485506800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:37.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.650+0000 7fa485506800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:37.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.650+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc932920 con 0x55f1bc91fcb0 2024-09-13T19:16:37.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.651+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v36'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa478051070 con 0x55f1bc91fcb0 2024-09-13T19:16:37.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.651+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc93bc40 con 0x7fa474026020 2024-09-13T19:16:37.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.652+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v36'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa478051070 con 0x7fa474026020 2024-09-13T19:16:37.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.652+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc93c060 con 0x55f1bc9246c0 2024-09-13T19:16:37.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.653+0000 7fa4837fb640 1 -- 172.21.15.102:0/3351106890 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v36'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa47c028070 con 0x55f1bc9246c0 2024-09-13T19:16:37.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.653+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc93bfb0 con 0x55f1bc91fcb0 2024-09-13T19:16:37.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.654+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v36'174 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa478051070 con 0x55f1bc91fcb0 2024-09-13T19:16:37.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.654+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc93c520 con 0x7fa47c021020 2024-09-13T19:16:37.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.655+0000 7fa482ffa640 1 -- 172.21.15.102:0/3351106890 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v36'61 uv55 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa47402d070 con 0x7fa47c021020 2024-09-13T19:16:37.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.655+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc93ca90 con 0x55f1bc9246c0 2024-09-13T19:16:37.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.656+0000 7fa4837fb640 1 -- 172.21.15.102:0/3351106890 <== osd.3 v2:172.21.15.102:6800/3096737090 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v36'40 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa47c028070 con 0x55f1bc9246c0 2024-09-13T19:16:37.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.656+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc93ca90 con 0x55f1bc91fcb0 2024-09-13T19:16:37.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.657+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v36'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa478051070 con 0x55f1bc91fcb0 2024-09-13T19:16:37.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.657+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc93cb20 con 0x7fa474026020 2024-09-13T19:16:37.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.658+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(69 gc.7 [create,call,call,call] v36'39 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa478051070 con 0x7fa474026020 2024-09-13T19:16:37.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.658+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc93cb20 con 0x7fa47c021020 2024-09-13T19:16:37.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.659+0000 7fa482ffa640 1 -- 172.21.15.102:0/3351106890 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v36'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa47402d070 con 0x7fa47c021020 2024-09-13T19:16:37.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.659+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc93cbb0 con 0x55f1bc9246c0 2024-09-13T19:16:37.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.660+0000 7fa4837fb640 1 -- 172.21.15.102:0/3351106890 <== osd.3 v2:172.21.15.102:6800/3096737090 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v36'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa47c028070 con 0x55f1bc9246c0 2024-09-13T19:16:37.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.660+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc93cc70 con 0x7fa47c021020 2024-09-13T19:16:37.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.661+0000 7fa482ffa640 1 -- 172.21.15.102:0/3351106890 <== osd.2 v2:172.21.15.102:6816/2238176080 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v36'62 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa47402d070 con 0x7fa47c021020 2024-09-13T19:16:37.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.661+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc93cd00 con 0x7fa474026020 2024-09-13T19:16:37.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.662+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v36'26 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa478051070 con 0x7fa474026020 2024-09-13T19:16:37.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.662+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc93cd00 con 0x7fa47c021020 2024-09-13T19:16:37.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.663+0000 7fa482ffa640 1 -- 172.21.15.102:0/3351106890 <== osd.2 v2:172.21.15.102:6816/2238176080 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v36'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa47402d070 con 0x7fa47c021020 2024-09-13T19:16:37.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.663+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc93cd00 con 0x7fa474026020 2024-09-13T19:16:37.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.664+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(75 gc.13 [create,call,call,call] v36'45 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa478051070 con 0x7fa474026020 2024-09-13T19:16:37.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.664+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc93cd00 con 0x55f1bc91fcb0 2024-09-13T19:16:37.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.665+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v36'175 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa478051070 con 0x55f1bc91fcb0 2024-09-13T19:16:37.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.665+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc93cd00 con 0x55f1bc9246c0 2024-09-13T19:16:37.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.666+0000 7fa4837fb640 1 -- 172.21.15.102:0/3351106890 <== osd.3 v2:172.21.15.102:6800/3096737090 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v36'53 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa47c028070 con 0x55f1bc9246c0 2024-09-13T19:16:37.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.666+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc93d410 con 0x7fa47c021020 2024-09-13T19:16:37.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.667+0000 7fa482ffa640 1 -- 172.21.15.102:0/3351106890 <== osd.2 v2:172.21.15.102:6816/2238176080 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v36'63 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa47402d070 con 0x7fa47c021020 2024-09-13T19:16:37.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.667+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc93d390 con 0x55f1bc9246c0 2024-09-13T19:16:37.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.668+0000 7fa4837fb640 1 -- 172.21.15.102:0/3351106890 <== osd.3 v2:172.21.15.102:6800/3096737090 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v36'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa47c028070 con 0x55f1bc9246c0 2024-09-13T19:16:37.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.668+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc93d390 con 0x55f1bc91fcb0 2024-09-13T19:16:37.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.669+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v36'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa478051070 con 0x55f1bc91fcb0 2024-09-13T19:16:37.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.669+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc93d390 con 0x55f1bc91fcb0 2024-09-13T19:16:37.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.670+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v36'176 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa478051070 con 0x55f1bc91fcb0 2024-09-13T19:16:37.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.670+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc93d390 con 0x55f1bc9246c0 2024-09-13T19:16:37.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.671+0000 7fa4837fb640 1 -- 172.21.15.102:0/3351106890 <== osd.3 v2:172.21.15.102:6800/3096737090 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v36'54 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa47c028070 con 0x55f1bc9246c0 2024-09-13T19:16:37.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.671+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc93d390 con 0x7fa47c021020 2024-09-13T19:16:37.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.672+0000 7fa482ffa640 1 -- 172.21.15.102:0/3351106890 <== osd.2 v2:172.21.15.102:6816/2238176080 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v36'33 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa47402d070 con 0x7fa47c021020 2024-09-13T19:16:37.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.672+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc93d390 con 0x55f1bc9246c0 2024-09-13T19:16:37.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.673+0000 7fa4837fb640 1 -- 172.21.15.102:0/3351106890 <== osd.3 v2:172.21.15.102:6800/3096737090 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v36'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa47c028070 con 0x55f1bc9246c0 2024-09-13T19:16:37.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.673+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc93d390 con 0x55f1bc9246c0 2024-09-13T19:16:37.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.674+0000 7fa4837fb640 1 -- 172.21.15.102:0/3351106890 <== osd.3 v2:172.21.15.102:6800/3096737090 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v36'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa47c028070 con 0x55f1bc9246c0 2024-09-13T19:16:37.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.674+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc93d390 con 0x55f1bc9246c0 2024-09-13T19:16:37.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.675+0000 7fa4837fb640 1 -- 172.21.15.102:0/3351106890 <== osd.3 v2:172.21.15.102:6800/3096737090 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v36'19 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa47c028070 con 0x55f1bc9246c0 2024-09-13T19:16:37.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.675+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc93d390 con 0x55f1bc9246c0 2024-09-13T19:16:37.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.675+0000 7fa4837fb640 1 -- 172.21.15.102:0/3351106890 <== osd.3 v2:172.21.15.102:6800/3096737090 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v36'41 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa47c028070 con 0x55f1bc9246c0 2024-09-13T19:16:37.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.675+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc93d390 con 0x7fa474026020 2024-09-13T19:16:37.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.677+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(88 gc.26 [create,call,call,call] v36'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa478051070 con 0x7fa474026020 2024-09-13T19:16:37.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.677+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc93d390 con 0x55f1bc9246c0 2024-09-13T19:16:37.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.677+0000 7fa4837fb640 1 -- 172.21.15.102:0/3351106890 <== osd.3 v2:172.21.15.102:6800/3096737090 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v36'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa47c028070 con 0x55f1bc9246c0 2024-09-13T19:16:37.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.677+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc93d390 con 0x7fa474026020 2024-09-13T19:16:37.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.678+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(90 gc.28 [create,call,call,call] v36'40 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa478051070 con 0x7fa474026020 2024-09-13T19:16:37.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.679+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc93d390 con 0x55f1bc9246c0 2024-09-13T19:16:37.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.680+0000 7fa4837fb640 1 -- 172.21.15.102:0/3351106890 <== osd.3 v2:172.21.15.102:6800/3096737090 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v36'55 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa47c028070 con 0x55f1bc9246c0 2024-09-13T19:16:37.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.680+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc93d390 con 0x7fa474026020 2024-09-13T19:16:37.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.681+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.0 v2:172.21.15.53:6800/4021716951 20 ==== osd_op_reply(92 gc.30 [create,call,call,call] v36'46 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa478051070 con 0x7fa474026020 2024-09-13T19:16:37.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.681+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc93d390 con 0x7fa47c021020 2024-09-13T19:16:37.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.682+0000 7fa482ffa640 1 -- 172.21.15.102:0/3351106890 <== osd.2 v2:172.21.15.102:6816/2238176080 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v36'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa47402d070 con 0x7fa47c021020 2024-09-13T19:16:37.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.682+0000 7fa2b3fff640 20 reqs_thread_entry: start 2024-09-13T19:16:37.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.682+0000 7fa485506800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:37.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.682+0000 7fa485506800 20 Filter name: none 2024-09-13T19:16:37.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.682+0000 7fa2b1ffb640 20 reqs_thread_entry: start 2024-09-13T19:16:37.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.682+0000 7fa485506800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:16:37.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.682+0000 7fa485506800 20 rados->read ofs=0 len=0 2024-09-13T19:16:37.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.682+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc967dd0 con 0x55f1bc91fcb0 2024-09-13T19:16:37.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.683+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa478051070 con 0x55f1bc91fcb0 2024-09-13T19:16:37.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.683+0000 7fa485506800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:16:37.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.683+0000 7fa485506800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:16:37.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.683+0000 7fa485506800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:16:37.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.683+0000 7fa485506800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:16:37.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.683+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc967d90 con 0x7fa47c021020 2024-09-13T19:16:37.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.683+0000 7fa482ffa640 1 -- 172.21.15.102:0/3351106890 <== osd.2 v2:172.21.15.102:6816/2238176080 21 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv31 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fa47402d070 con 0x7fa47c021020 2024-09-13T19:16:37.688 INFO:teuthology.orchestra.run.smithi102.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-13T19:16:37.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.684+0000 7fa3397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:37.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.684+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94496739224880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc91be50 con 0x55f1bc91fcb0 2024-09-13T19:16:37.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.685+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.1 v2:172.21.15.102:6808/2204418452 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94496739224880] v36'177 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa478051070 con 0x55f1bc91fcb0 2024-09-13T19:16:37.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.685+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94496739205808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc92ed30 con 0x7fa47c021020 2024-09-13T19:16:37.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.686+0000 7fa482ffa640 1 -- 172.21.15.102:0/3351106890 <== osd.2 v2:172.21.15.102:6816/2238176080 22 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94496739205808] v36'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa47402d070 con 0x7fa47c021020 2024-09-13T19:16:37.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.686+0000 7fa485506800 20 remove_watcher() i=0 2024-09-13T19:16:37.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.686+0000 7fa485506800 2 removed watcher, disabling cache 2024-09-13T19:16:37.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.686+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94496739209888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc92a2b0 con 0x55f1bc91fcb0 2024-09-13T19:16:37.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.687+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.1 v2:172.21.15.102:6808/2204418452 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94496739209888] v36'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa478051070 con 0x55f1bc91fcb0 2024-09-13T19:16:37.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.687+0000 7fa485506800 20 remove_watcher() i=1 2024-09-13T19:16:37.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.687+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94496739212736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc92a2b0 con 0x55f1bc9246c0 2024-09-13T19:16:37.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.688+0000 7fa4837fb640 1 -- 172.21.15.102:0/3351106890 <== osd.3 v2:172.21.15.102:6800/3096737090 28 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94496739212736] v36'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa47c028070 con 0x55f1bc9246c0 2024-09-13T19:16:37.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.688+0000 7fa485506800 20 remove_watcher() i=2 2024-09-13T19:16:37.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.688+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94496739215376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc92bdc0 con 0x7fa47c021020 2024-09-13T19:16:37.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.689+0000 7fa482ffa640 1 -- 172.21.15.102:0/3351106890 <== osd.2 v2:172.21.15.102:6816/2238176080 23 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94496739215376] v36'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa47402d070 con 0x7fa47c021020 2024-09-13T19:16:37.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.689+0000 7fa485506800 20 remove_watcher() i=3 2024-09-13T19:16:37.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.689+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94496739218176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc92a2b0 con 0x55f1bc91fcb0 2024-09-13T19:16:37.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.690+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.1 v2:172.21.15.102:6808/2204418452 30 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94496739218176] v36'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa478051070 con 0x55f1bc91fcb0 2024-09-13T19:16:37.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.690+0000 7fa485506800 20 remove_watcher() i=4 2024-09-13T19:16:37.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.690+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94496739222128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc92c810 con 0x7fa474026020 2024-09-13T19:16:37.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.691+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.0 v2:172.21.15.53:6800/4021716951 21 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94496739222128] v36'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa478051070 con 0x7fa474026020 2024-09-13T19:16:37.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.691+0000 7fa485506800 20 remove_watcher() i=5 2024-09-13T19:16:37.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.691+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94496739207040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc92bdc0 con 0x7fa474026020 2024-09-13T19:16:37.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.692+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.0 v2:172.21.15.53:6800/4021716951 22 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94496739207040] v36'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa478051070 con 0x7fa474026020 2024-09-13T19:16:37.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.692+0000 7fa485506800 20 remove_watcher() i=6 2024-09-13T19:16:37.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.692+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94496739226192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f1bc92d300 con 0x7fa474026020 2024-09-13T19:16:37.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.693+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 <== osd.0 v2:172.21.15.53:6800/4021716951 23 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94496739226192] v36'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa478051070 con 0x7fa474026020 2024-09-13T19:16:37.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.693+0000 7fa485506800 20 remove_watcher() i=7 2024-09-13T19:16:37.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.693+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fa474026020 msgr2=0x7fa4740115e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.693+0000 7fa485506800 1 --2- 172.21.15.102:0/3351106890 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fa474026020 0x7fa4740115e0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.693+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55f1bc91fcb0 msgr2=0x55f1bc922170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.693+0000 7fa485506800 1 --2- 172.21.15.102:0/3351106890 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55f1bc91fcb0 0x55f1bc922170 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.693+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fa47c021020 msgr2=0x7fa47c02b480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.693+0000 7fa485506800 1 --2- 172.21.15.102:0/3351106890 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fa47c021020 0x7fa47c02b480 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.693+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55f1bc9246c0 msgr2=0x55f1bc926ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.693+0000 7fa485506800 1 --2- 172.21.15.102:0/3351106890 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55f1bc9246c0 0x55f1bc926ab0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.693+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa34c036b40 msgr2=0x7fa34c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.693+0000 7fa485506800 1 --2- 172.21.15.102:0/3351106890 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa34c036b40 0x7fa34c039000 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa474018440 tx=0x7fa474033040 comp rx=0 tx=0).stop 2024-09-13T19:16:37.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.693+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1bc90ccc0 msgr2=0x55f1bc9141d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.693+0000 7fa485506800 1 --2- 172.21.15.102:0/3351106890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1bc90ccc0 0x55f1bc9141d0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fa47c04c4c0 tx=0x7fa47c0088c0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.693+0000 7fa4827f9640 1 -- 172.21.15.102:0/3351106890 reap_dead start 2024-09-13T19:16:37.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.693+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 shutdown_connections 2024-09-13T19:16:37.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.693+0000 7fa485506800 1 --2- 172.21.15.102:0/3351106890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1bc90ccc0 0x55f1bc9141d0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.693+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 >> 172.21.15.102:0/3351106890 conn(0x55f1bc909070 msgr2=0x55f1bc90e400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:37.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.693+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 shutdown_connections 2024-09-13T19:16:37.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.693+0000 7fa485506800 1 -- 172.21.15.102:0/3351106890 wait complete. 2024-09-13T19:16:37.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.694+0000 7fa485506800 1 -- 172.21.15.102:0/234689397 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa35c036b90 msgr2=0x7fa35c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.694+0000 7fa485506800 1 --2- 172.21.15.102:0/234689397 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa35c036b90 0x7fa35c039050 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x55f1bc8e9580 tx=0x7fa474003450 comp rx=0 tx=0).stop 2024-09-13T19:16:37.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.694+0000 7fa485506800 1 -- 172.21.15.102:0/234689397 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1bc8fffa0 msgr2=0x55f1bc9003c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.694+0000 7fa485506800 1 --2- 172.21.15.102:0/234689397 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1bc8fffa0 0x55f1bc9003c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x55f1bc8e3320 tx=0x7fa47c00beb0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.694+0000 7fa485506800 1 -- 172.21.15.102:0/234689397 shutdown_connections 2024-09-13T19:16:37.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.694+0000 7fa485506800 1 --2- 172.21.15.102:0/234689397 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa35c036b90 0x7fa35c039050 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.694+0000 7fa485506800 1 --2- 172.21.15.102:0/234689397 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1bc8fffa0 0x55f1bc9003c0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.694+0000 7fa485506800 1 -- 172.21.15.102:0/234689397 >> 172.21.15.102:0/234689397 conn(0x55f1bc8f0b20 msgr2=0x55f1bc8f36a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:37.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.694+0000 7fa485506800 1 -- 172.21.15.102:0/234689397 shutdown_connections 2024-09-13T19:16:37.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.694+0000 7fa485506800 1 -- 172.21.15.102:0/234689397 wait complete. 2024-09-13T19:16:37.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.694+0000 7fa485506800 1 -- 172.21.15.102:0/1850470737 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55f1bc7ef900 msgr2=0x55f1bc8e7ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.694+0000 7fa485506800 1 --2- 172.21.15.102:0/1850470737 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55f1bc7ef900 0x55f1bc8e7ee0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.694+0000 7fa485506800 1 -- 172.21.15.102:0/1850470737 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55f1bc8ea710 msgr2=0x55f1bc8ecb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.694+0000 7fa485506800 1 --2- 172.21.15.102:0/1850470737 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55f1bc8ea710 0x55f1bc8ecb00 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.694+0000 7fa485506800 1 -- 172.21.15.102:0/1850470737 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa368036b90 msgr2=0x7fa368039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.694+0000 7fa485506800 1 --2- 172.21.15.102:0/1850470737 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa368036b90 0x7fa368039050 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa478057000 tx=0x7fa478052000 comp rx=0 tx=0).stop 2024-09-13T19:16:37.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.694+0000 7fa485506800 1 -- 172.21.15.102:0/1850470737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1bc7eb4c0 msgr2=0x55f1bc8e1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.694+0000 7fa485506800 1 --2- 172.21.15.102:0/1850470737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1bc7eb4c0 0x55f1bc8e1f20 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x55f1bc8db370 tx=0x7fa474001250 comp rx=0 tx=0).stop 2024-09-13T19:16:37.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.694+0000 7fa485506800 1 -- 172.21.15.102:0/1850470737 shutdown_connections 2024-09-13T19:16:37.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.694+0000 7fa485506800 1 --2- 172.21.15.102:0/1850470737 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55f1bc8ea710 0x55f1bc8ecb00 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.694+0000 7fa485506800 1 --2- 172.21.15.102:0/1850470737 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55f1bc7ef900 0x55f1bc8e7ee0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.694+0000 7fa485506800 1 --2- 172.21.15.102:0/1850470737 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa368036b90 0x7fa368039050 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.694+0000 7fa485506800 1 --2- 172.21.15.102:0/1850470737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f1bc7eb4c0 0x55f1bc8e1f20 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.694+0000 7fa485506800 1 -- 172.21.15.102:0/1850470737 >> 172.21.15.102:0/1850470737 conn(0x55f1bc7e6df0 msgr2=0x55f1bc8d4840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:37.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.694+0000 7fa485506800 1 -- 172.21.15.102:0/1850470737 shutdown_connections 2024-09-13T19:16:37.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.694+0000 7fa485506800 1 -- 172.21.15.102:0/1850470737 wait complete. 2024-09-13T19:16:37.705 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-13T19:16:37.715 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2024-09-13T19:16:37.719 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:16:37.746 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:16:37.759 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:16:37.801 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-13T19:16:37.807 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:16:37.807 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-13T19:16:37.807 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-13T19:16:37.807 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-13T19:16:37.853 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:37.853 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:37.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.850+0000 7fa06560f800 1 Processor -- start 2024-09-13T19:16:37.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.850+0000 7fa06560f800 1 -- start start 2024-09-13T19:16:37.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.850+0000 7fa06560f800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56190edbd920 0x56190edbfd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.850+0000 7fa06560f800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56190ec79b30 con 0x56190edb94e0 2024-09-13T19:16:37.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.850+0000 7fa06560f800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x56190ec5b360 con 0x56190edbd920 2024-09-13T19:16:37.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.851+0000 7fa058466640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56190edbd920 0x56190edbfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.851+0000 7fa058466640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56190edbd920 0x56190edbfd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55368/0 (socket says 172.21.15.102:55368) 2024-09-13T19:16:37.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.851+0000 7fa058466640 1 -- 172.21.15.102:0/1066644549 learned_addr learned my addr 172.21.15.102:0/1066644549 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:37.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.851+0000 7fa058466640 1 -- 172.21.15.102:0/1066644549 >> v1:172.21.15.53:6789/0 conn(0x56190edb94e0 legacy=0x56190edb98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.851+0000 7fa058466640 1 -- 172.21.15.102:0/1066644549 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56190ec81e00 con 0x56190edbd920 2024-09-13T19:16:37.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.853+0000 7fa058466640 1 --2- 172.21.15.102:0/1066644549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56190edbd920 0x56190edbfd10 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fa04800a520 tx=0x7fa048045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a90203b8627f3762 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.853+0000 7fa05bfff640 1 -- 172.21.15.102:0/1066644549 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa048055070 con 0x56190edbd920 2024-09-13T19:16:37.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.853+0000 7fa05bfff640 1 -- 172.21.15.102:0/1066644549 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0480515b0 con 0x56190edbd920 2024-09-13T19:16:37.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.853+0000 7fa05bfff640 1 -- 172.21.15.102:0/1066644549 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0480518d0 con 0x56190edbd920 2024-09-13T19:16:37.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.854+0000 7fa06560f800 1 -- 172.21.15.102:0/1066644549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56190edbd920 msgr2=0x56190edbfd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.854+0000 7fa06560f800 1 --2- 172.21.15.102:0/1066644549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56190edbd920 0x56190edbfd10 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fa04800a520 tx=0x7fa048045ba0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.854+0000 7fa06560f800 1 -- 172.21.15.102:0/1066644549 shutdown_connections 2024-09-13T19:16:37.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.854+0000 7fa06560f800 1 --2- 172.21.15.102:0/1066644549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56190edbd920 0x56190edbfd10 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.854+0000 7fa06560f800 1 -- 172.21.15.102:0/1066644549 >> 172.21.15.102:0/1066644549 conn(0x56190edb4dd0 msgr2=0x56190edb71f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:37.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.854+0000 7fa06560f800 1 -- 172.21.15.102:0/1066644549 shutdown_connections 2024-09-13T19:16:37.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.854+0000 7fa06560f800 1 -- 172.21.15.102:0/1066644549 wait complete. 2024-09-13T19:16:37.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.867+0000 7fa06560f800 1 Processor -- start 2024-09-13T19:16:37.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.867+0000 7fa06560f800 1 -- start start 2024-09-13T19:16:37.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.868+0000 7fa06560f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56190edb94e0 0x56190ed2dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.868+0000 7fa06560f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56190ed06360 con 0x56190edb94e0 2024-09-13T19:16:37.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.868+0000 7fa060c67640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56190edb94e0 0x56190ed2dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.868+0000 7fa060c67640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56190edb94e0 0x56190ed2dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55378/0 (socket says 172.21.15.102:55378) 2024-09-13T19:16:37.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.868+0000 7fa060c67640 1 -- 172.21.15.102:0/3968345648 learned_addr learned my addr 172.21.15.102:0/3968345648 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:37.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.868+0000 7fa060c67640 1 -- 172.21.15.102:0/3968345648 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56190ec53bc0 con 0x56190edb94e0 2024-09-13T19:16:37.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.868+0000 7fa060c67640 1 --2- 172.21.15.102:0/3968345648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56190edb94e0 0x56190ed2dda0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fa050001d50 tx=0x7fa05000b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aed919efa31244b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.869+0000 7f9f4ee0d640 1 -- 172.21.15.102:0/3968345648 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa05000f400 con 0x56190edb94e0 2024-09-13T19:16:37.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.869+0000 7f9f4ee0d640 1 -- 172.21.15.102:0/3968345648 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa05000f5a0 con 0x56190edb94e0 2024-09-13T19:16:37.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.869+0000 7f9f4ee0d640 1 -- 172.21.15.102:0/3968345648 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa05000f7d0 con 0x56190edb94e0 2024-09-13T19:16:37.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.869+0000 7fa06560f800 1 -- 172.21.15.102:0/3968345648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56190edb94e0 msgr2=0x56190ed2dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.869+0000 7fa06560f800 1 --2- 172.21.15.102:0/3968345648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56190edb94e0 0x56190ed2dda0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fa050001d50 tx=0x7fa05000b5b0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.869+0000 7fa06560f800 1 -- 172.21.15.102:0/3968345648 shutdown_connections 2024-09-13T19:16:37.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.869+0000 7fa06560f800 1 --2- 172.21.15.102:0/3968345648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56190edb94e0 0x56190ed2dda0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.869+0000 7fa06560f800 1 -- 172.21.15.102:0/3968345648 >> 172.21.15.102:0/3968345648 conn(0x56190edb4dd0 msgr2=0x56190eea4190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:37.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.869+0000 7fa06560f800 1 -- 172.21.15.102:0/3968345648 shutdown_connections 2024-09-13T19:16:37.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.869+0000 7fa06560f800 1 -- 172.21.15.102:0/3968345648 wait complete. 2024-09-13T19:16:37.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.870+0000 7fa06560f800 1 Processor -- start 2024-09-13T19:16:37.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.870+0000 7fa06560f800 1 -- start start 2024-09-13T19:16:37.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.870+0000 7fa06560f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56190edb94e0 0x56190eeb1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.870+0000 7fa06560f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56190edc0550 con 0x56190edb94e0 2024-09-13T19:16:37.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.870+0000 7fa060c67640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56190edb94e0 0x56190eeb1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.870+0000 7fa060c67640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56190edb94e0 0x56190eeb1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55388/0 (socket says 172.21.15.102:55388) 2024-09-13T19:16:37.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.870+0000 7fa060c67640 1 -- 172.21.15.102:0/3692440542 learned_addr learned my addr 172.21.15.102:0/3692440542 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:37.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.870+0000 7fa060c67640 1 -- 172.21.15.102:0/3692440542 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56190ec67fe0 con 0x56190edb94e0 2024-09-13T19:16:37.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.870+0000 7fa060c67640 1 --2- 172.21.15.102:0/3692440542 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56190edb94e0 0x56190eeb1310 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x56190ed2d4a0 tx=0x7fa050000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.871+0000 7f9f4d60a640 1 -- 172.21.15.102:0/3692440542 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa05001a7c0 con 0x56190edb94e0 2024-09-13T19:16:37.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.871+0000 7f9f4d60a640 1 -- 172.21.15.102:0/3692440542 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa05001a960 con 0x56190edb94e0 2024-09-13T19:16:37.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.871+0000 7fa06560f800 1 -- 172.21.15.102:0/3692440542 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56190eeb1850 con 0x56190edb94e0 2024-09-13T19:16:37.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.871+0000 7f9f4d60a640 1 -- 172.21.15.102:0/3692440542 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa05001ac60 con 0x56190edb94e0 2024-09-13T19:16:37.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.871+0000 7fa06560f800 1 -- 172.21.15.102:0/3692440542 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56190eeb1d70 con 0x56190edb94e0 2024-09-13T19:16:37.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.871+0000 7f9f4d60a640 1 -- 172.21.15.102:0/3692440542 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa050017070 con 0x56190edb94e0 2024-09-13T19:16:37.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.872+0000 7f9f4d60a640 1 --2- 172.21.15.102:0/3692440542 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9f48036b90 0x7f9f48039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.872+0000 7f9f4d60a640 1 -- 172.21.15.102:0/3692440542 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fa050015020 con 0x56190edb94e0 2024-09-13T19:16:37.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.872+0000 7fa058466640 1 --2- 172.21.15.102:0/3692440542 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9f48036b90 0x7f9f48039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.872+0000 7fa06560f800 1 --2- 172.21.15.102:0/3692440542 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56190edbd920 0x56190eeb8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.872+0000 7fa06560f800 1 -- 172.21.15.102:0/3692440542 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56190eeb88c0 con 0x56190edbd920 2024-09-13T19:16:37.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.872+0000 7fa061468640 1 --2- 172.21.15.102:0/3692440542 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56190edbd920 0x56190eeb8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.872+0000 7fa058466640 1 --2- 172.21.15.102:0/3692440542 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9f48036b90 0x7f9f48039050 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa048057000 tx=0x7fa048052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.872+0000 7fa061468640 1 --2- 172.21.15.102:0/3692440542 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56190edbd920 0x56190eeb8380 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.873+0000 7fa061468640 1 -- 172.21.15.102:0/3692440542 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa05c00a4a0 con 0x56190edbd920 2024-09-13T19:16:37.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.873+0000 7fa06560f800 1 -- 172.21.15.102:0/3692440542 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56190eeb5950 con 0x56190edbd920 2024-09-13T19:16:37.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.873+0000 7fa061468640 1 -- 172.21.15.102:0/3692440542 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa05c00a4a0 con 0x56190edbd920 2024-09-13T19:16:37.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.873+0000 7fa06560f800 1 --2- 172.21.15.102:0/3692440542 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56190eebabf0 0x56190eebcfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.873+0000 7fa06560f800 1 -- 172.21.15.102:0/3692440542 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56190eebd6d0 con 0x56190eebabf0 2024-09-13T19:16:37.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.873+0000 7fa060c67640 1 --2- 172.21.15.102:0/3692440542 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56190eebabf0 0x56190eebcfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.873+0000 7fa060c67640 1 --2- 172.21.15.102:0/3692440542 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56190eebabf0 0x56190eebcfe0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.874+0000 7fa060c67640 1 -- 172.21.15.102:0/3692440542 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa05002e070 con 0x56190eebabf0 2024-09-13T19:16:37.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.874+0000 7fa06560f800 1 -- 172.21.15.102:0/3692440542 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56190eeb9a90 con 0x56190edbd920 2024-09-13T19:16:37.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.874+0000 7fa061468640 1 -- 172.21.15.102:0/3692440542 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa05c00a4a0 con 0x56190edbd920 2024-09-13T19:16:37.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.874+0000 7fa06560f800 1 -- 172.21.15.102:0/3692440542 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56190eeb9f70 con 0x56190eebabf0 2024-09-13T19:16:37.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.874+0000 7fa060c67640 1 -- 172.21.15.102:0/3692440542 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa05002e070 con 0x56190eebabf0 2024-09-13T19:16:37.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.874+0000 7fa06560f800 1 Processor -- start 2024-09-13T19:16:37.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.875+0000 7fa06560f800 1 -- start start 2024-09-13T19:16:37.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.875+0000 7fa06560f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56190eecc050 0x56190eecc470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.875+0000 7fa06560f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56190ec55580 con 0x56190eecc050 2024-09-13T19:16:37.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.875+0000 7fa061468640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56190eecc050 0x56190eecc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.875+0000 7fa061468640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56190eecc050 0x56190eecc470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55392/0 (socket says 172.21.15.102:55392) 2024-09-13T19:16:37.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.875+0000 7fa061468640 1 -- 172.21.15.102:0/717749090 learned_addr learned my addr 172.21.15.102:0/717749090 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:37.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.875+0000 7fa061468640 1 -- 172.21.15.102:0/717749090 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56190eecc9b0 con 0x56190eecc050 2024-09-13T19:16:37.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.876+0000 7fa061468640 1 --2- 172.21.15.102:0/717749090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56190eecc050 0x56190eecc470 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x56190eeb8ca0 tx=0x7fa05c0163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.876+0000 7f9f467fc640 1 -- 172.21.15.102:0/717749090 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa05c013450 con 0x56190eecc050 2024-09-13T19:16:37.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.876+0000 7f9f467fc640 1 -- 172.21.15.102:0/717749090 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa05c0135f0 con 0x56190eecc050 2024-09-13T19:16:37.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.876+0000 7fa06560f800 1 -- 172.21.15.102:0/717749090 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56190eeccc40 con 0x56190eecc050 2024-09-13T19:16:37.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.876+0000 7f9f467fc640 1 -- 172.21.15.102:0/717749090 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa05c0138d0 con 0x56190eecc050 2024-09-13T19:16:37.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.876+0000 7fa06560f800 1 -- 172.21.15.102:0/717749090 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56190eecf920 con 0x56190eecc050 2024-09-13T19:16:37.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.877+0000 7f9f467fc640 1 -- 172.21.15.102:0/717749090 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa05c011040 con 0x56190eecc050 2024-09-13T19:16:37.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.877+0000 7f9f467fc640 1 --2- 172.21.15.102:0/717749090 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9f38036c00 0x7f9f380390c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.877+0000 7f9f467fc640 1 -- 172.21.15.102:0/717749090 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fa05c00e040 con 0x56190eecc050 2024-09-13T19:16:37.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.877+0000 7fa060c67640 1 --2- 172.21.15.102:0/717749090 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9f38036c00 0x7f9f380390c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.877+0000 7fa06560f800 1 Processor -- start 2024-09-13T19:16:37.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.877+0000 7fa060c67640 1 --2- 172.21.15.102:0/717749090 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9f38036c00 0x7f9f380390c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa050000fb0 tx=0x7fa050000f40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.877+0000 7fa06560f800 1 -- start start 2024-09-13T19:16:37.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.877+0000 7fa06560f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56190eea9820 0x56190eea9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.877+0000 7fa06560f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56190eeac7b0 con 0x56190eea9820 2024-09-13T19:16:37.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.878+0000 7fa061468640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56190eea9820 0x56190eea9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.878+0000 7fa061468640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56190eea9820 0x56190eea9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55406/0 (socket says 172.21.15.102:55406) 2024-09-13T19:16:37.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.878+0000 7fa061468640 1 -- 172.21.15.102:0/2654497467 learned_addr learned my addr 172.21.15.102:0/2654497467 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:37.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.878+0000 7fa061468640 1 -- 172.21.15.102:0/2654497467 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56190eeaa1f0 con 0x56190eea9820 2024-09-13T19:16:37.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.878+0000 7fa061468640 1 --2- 172.21.15.102:0/2654497467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56190eea9820 0x56190eea9c20 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fa05c014e60 tx=0x7fa05c014f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bd810437cc99900 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.878+0000 7f9f37fff640 1 -- 172.21.15.102:0/2654497467 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa05c02a980 con 0x56190eea9820 2024-09-13T19:16:37.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.878+0000 7f9f37fff640 1 -- 172.21.15.102:0/2654497467 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa05c02a440 con 0x56190eea9820 2024-09-13T19:16:37.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.878+0000 7f9f37fff640 1 -- 172.21.15.102:0/2654497467 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa05c02ab20 con 0x56190eea9820 2024-09-13T19:16:37.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.878+0000 7fa06560f800 1 -- 172.21.15.102:0/2654497467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56190eea9820 msgr2=0x56190eea9c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.878+0000 7fa06560f800 1 --2- 172.21.15.102:0/2654497467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56190eea9820 0x56190eea9c20 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fa05c014e60 tx=0x7fa05c014f50 comp rx=0 tx=0).stop 2024-09-13T19:16:37.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.879+0000 7fa06560f800 1 -- 172.21.15.102:0/2654497467 shutdown_connections 2024-09-13T19:16:37.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.879+0000 7fa06560f800 1 --2- 172.21.15.102:0/2654497467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56190eea9820 0x56190eea9c20 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.879+0000 7fa06560f800 1 -- 172.21.15.102:0/2654497467 >> 172.21.15.102:0/2654497467 conn(0x56190eed5030 msgr2=0x56190eed3180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:37.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.879+0000 7fa06560f800 1 -- 172.21.15.102:0/2654497467 shutdown_connections 2024-09-13T19:16:37.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.879+0000 7fa06560f800 1 -- 172.21.15.102:0/2654497467 wait complete. 2024-09-13T19:16:37.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.879+0000 7fa06560f800 1 Processor -- start 2024-09-13T19:16:37.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.879+0000 7fa06560f800 1 -- start start 2024-09-13T19:16:37.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.879+0000 7fa06560f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56190eea9820 0x56190eee2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.879+0000 7fa06560f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56190eea8560 con 0x56190eea9820 2024-09-13T19:16:37.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.879+0000 7fa061468640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56190eea9820 0x56190eee2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.879+0000 7fa061468640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56190eea9820 0x56190eee2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55416/0 (socket says 172.21.15.102:55416) 2024-09-13T19:16:37.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.879+0000 7fa061468640 1 -- 172.21.15.102:0/3712461131 learned_addr learned my addr 172.21.15.102:0/3712461131 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:37.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.880+0000 7fa061468640 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56190eee2890 con 0x56190eea9820 2024-09-13T19:16:37.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.880+0000 7fa061468640 1 --2- 172.21.15.102:0/3712461131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56190eea9820 0x56190eee2350 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fa05c014e60 tx=0x7fa05c04cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.880+0000 7f9f367fc640 1 -- 172.21.15.102:0/3712461131 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa05c013a70 con 0x56190eea9820 2024-09-13T19:16:37.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.880+0000 7f9f367fc640 1 -- 172.21.15.102:0/3712461131 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa05c013c10 con 0x56190eea9820 2024-09-13T19:16:37.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.880+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56190eee2b20 con 0x56190eea9820 2024-09-13T19:16:37.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.880+0000 7f9f367fc640 1 -- 172.21.15.102:0/3712461131 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa05c0143c0 con 0x56190eea9820 2024-09-13T19:16:37.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.880+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56190eee57d0 con 0x56190eea9820 2024-09-13T19:16:37.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.881+0000 7f9f367fc640 1 -- 172.21.15.102:0/3712461131 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa05c03b060 con 0x56190eea9820 2024-09-13T19:16:37.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.881+0000 7f9f367fc640 1 --2- 172.21.15.102:0/3712461131 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9f2c036b40 0x7f9f2c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.881+0000 7f9f367fc640 1 -- 172.21.15.102:0/3712461131 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fa05c035d00 con 0x56190eea9820 2024-09-13T19:16:37.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.881+0000 7fa060c67640 1 --2- 172.21.15.102:0/3712461131 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9f2c036b40 0x7f9f2c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.881+0000 7fa060c67640 1 --2- 172.21.15.102:0/3712461131 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9f2c036b40 0x7f9f2c039000 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa05000bb00 tx=0x7fa050037000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.881+0000 7fa06560f800 20 rados->read ofs=0 len=0 2024-09-13T19:16:37.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.881+0000 7fa06560f800 1 --2- 172.21.15.102:0/3712461131 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56190eeee010 0x56190eef04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.881+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56190eef0c20 con 0x56190eeee010 2024-09-13T19:16:37.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.882+0000 7fa058466640 1 --2- 172.21.15.102:0/3712461131 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56190eeee010 0x56190eef04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.882+0000 7fa058466640 1 --2- 172.21.15.102:0/3712461131 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56190eeee010 0x56190eef04d0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.882+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa048057030 con 0x56190eeee010 2024-09-13T19:16:37.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.882+0000 7fa06560f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:37.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.882+0000 7fa06560f800 20 realm 2024-09-13T19:16:37.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.882+0000 7fa06560f800 20 rados->read ofs=0 len=0 2024-09-13T19:16:37.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.882+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56190eef1050 con 0x56190eeee010 2024-09-13T19:16:37.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.882+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa048057030 con 0x56190eeee010 2024-09-13T19:16:37.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.882+0000 7fa06560f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:37.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.882+0000 7fa06560f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:37.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.882+0000 7fa06560f800 20 rados->read ofs=0 len=0 2024-09-13T19:16:37.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.882+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56190eef1920 con 0x56190eeee010 2024-09-13T19:16:37.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.882+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa048057030 con 0x56190eeee010 2024-09-13T19:16:37.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.882+0000 7fa06560f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:37.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.882+0000 7fa06560f800 20 rados->read ofs=0 len=0 2024-09-13T19:16:37.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.883+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56190eef1cc0 con 0x56190eeee010 2024-09-13T19:16:37.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.883+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa048057030 con 0x56190eeee010 2024-09-13T19:16:37.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.883+0000 7fa06560f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:37.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.883+0000 7fa06560f800 20 rados->read ofs=0 len=0 2024-09-13T19:16:37.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.883+0000 7fa06560f800 1 --2- 172.21.15.102:0/3712461131 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56190eef2a20 0x56190eef4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.883+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56190eef5420 con 0x56190eef2a20 2024-09-13T19:16:37.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.883+0000 7fa061468640 1 --2- 172.21.15.102:0/3712461131 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56190eef2a20 0x56190eef4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.883+0000 7fa061468640 1 --2- 172.21.15.102:0/3712461131 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56190eef2a20 0x56190eef4e10 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.883+0000 7fa061468640 1 -- 172.21.15.102:0/3712461131 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa05c027020 con 0x56190eef2a20 2024-09-13T19:16:37.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.883+0000 7fa06560f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:37.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.883+0000 7fa06560f800 20 searching for the correct realm 2024-09-13T19:16:37.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.883+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56190eef6d70 con 0x56190eef2a20 2024-09-13T19:16:37.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.884+0000 7fa061468640 1 -- 172.21.15.102:0/3712461131 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa05c027020 con 0x56190eef2a20 2024-09-13T19:16:37.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.884+0000 7fa061468640 1 --2- 172.21.15.102:0/3712461131 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fa05c044050 0x7fa05c04b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.884+0000 7fa061468640 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56190eef6d70 con 0x7fa05c044050 2024-09-13T19:16:37.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.884+0000 7fa060c67640 1 --2- 172.21.15.102:0/3712461131 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fa05c044050 0x7fa05c04b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.884+0000 7fa060c67640 1 --2- 172.21.15.102:0/3712461131 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fa05c044050 0x7fa05c04b210 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.884+0000 7fa060c67640 1 -- 172.21.15.102:0/3712461131 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa05002e070 con 0x7fa05c044050 2024-09-13T19:16:37.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.884+0000 7fa060c67640 1 --2- 172.21.15.102:0/3712461131 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fa05001b880 0x7fa05000e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:37.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.884+0000 7fa060c67640 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56190eef6d70 con 0x7fa05001b880 2024-09-13T19:16:37.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.884+0000 7fa058466640 1 --2- 172.21.15.102:0/3712461131 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fa05001b880 0x7fa05000e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:37.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.885+0000 7fa058466640 1 --2- 172.21.15.102:0/3712461131 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fa05001b880 0x7fa05000e590 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:37.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.885+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa048057030 con 0x7fa05001b880 2024-09-13T19:16:37.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.885+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56190eef6d70 con 0x56190eeee010 2024-09-13T19:16:37.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.885+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa048057030 con 0x56190eeee010 2024-09-13T19:16:37.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.885+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56190eef6d70 con 0x56190eeee010 2024-09-13T19:16:37.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.886+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa048057030 con 0x56190eeee010 2024-09-13T19:16:37.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.886+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56190eef6d70 con 0x7fa05001b880 2024-09-13T19:16:37.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.886+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa048057030 con 0x7fa05001b880 2024-09-13T19:16:37.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.886+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56190eef6d70 con 0x7fa05001b880 2024-09-13T19:16:37.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.886+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa048057030 con 0x7fa05001b880 2024-09-13T19:16:37.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.886+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56190eef6d70 con 0x7fa05c044050 2024-09-13T19:16:37.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.886+0000 7fa060c67640 1 -- 172.21.15.102:0/3712461131 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa05002e070 con 0x7fa05c044050 2024-09-13T19:16:37.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.886+0000 7fa060c67640 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56190eef6d70 con 0x56190eef2a20 2024-09-13T19:16:37.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.887+0000 7fa061468640 1 -- 172.21.15.102:0/3712461131 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa05c027020 con 0x56190eef2a20 2024-09-13T19:16:37.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.887+0000 7fa061468640 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56190eef6d70 con 0x56190eeee010 2024-09-13T19:16:37.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.887+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa048057030 con 0x56190eeee010 2024-09-13T19:16:37.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.887+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56190eef6d70 con 0x7fa05c044050 2024-09-13T19:16:37.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.887+0000 7fa060c67640 1 -- 172.21.15.102:0/3712461131 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa05002e070 con 0x7fa05c044050 2024-09-13T19:16:37.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.887+0000 7fa060c67640 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56190eef6d70 con 0x56190eeee010 2024-09-13T19:16:37.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.887+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa048057030 con 0x56190eeee010 2024-09-13T19:16:37.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.887+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56190eef6d70 con 0x7fa05c044050 2024-09-13T19:16:37.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.888+0000 7fa060c67640 1 -- 172.21.15.102:0/3712461131 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa05002e070 con 0x7fa05c044050 2024-09-13T19:16:37.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.888+0000 7fa060c67640 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56190eef6d70 con 0x56190eef2a20 2024-09-13T19:16:37.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.888+0000 7fa061468640 1 -- 172.21.15.102:0/3712461131 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa05c027020 con 0x56190eef2a20 2024-09-13T19:16:37.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.888+0000 7fa061468640 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56190eef6d70 con 0x56190eef2a20 2024-09-13T19:16:37.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.888+0000 7fa061468640 1 -- 172.21.15.102:0/3712461131 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa05c027020 con 0x56190eef2a20 2024-09-13T19:16:37.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.888+0000 7fa061468640 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56190eef6d70 con 0x7fa05001b880 2024-09-13T19:16:37.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.888+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa048057030 con 0x7fa05001b880 2024-09-13T19:16:37.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.888+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56190eef6d70 con 0x56190eef2a20 2024-09-13T19:16:37.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.889+0000 7fa061468640 1 -- 172.21.15.102:0/3712461131 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa05c027020 con 0x56190eef2a20 2024-09-13T19:16:37.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.889+0000 7fa061468640 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56190eef6d70 con 0x56190eef2a20 2024-09-13T19:16:37.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.889+0000 7fa061468640 1 -- 172.21.15.102:0/3712461131 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa05c027020 con 0x56190eef2a20 2024-09-13T19:16:37.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.889+0000 7fa061468640 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56190eef6d70 con 0x56190eeee010 2024-09-13T19:16:37.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.889+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa048057030 con 0x56190eeee010 2024-09-13T19:16:37.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.889+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56190eef6d70 con 0x56190eeee010 2024-09-13T19:16:37.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.889+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa048057030 con 0x56190eeee010 2024-09-13T19:16:37.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.889+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56190eef6d70 con 0x7fa05001b880 2024-09-13T19:16:37.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.890+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa048057030 con 0x7fa05001b880 2024-09-13T19:16:37.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.890+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56190eef6d70 con 0x56190eef2a20 2024-09-13T19:16:37.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.890+0000 7fa061468640 1 -- 172.21.15.102:0/3712461131 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa05c027020 con 0x56190eef2a20 2024-09-13T19:16:37.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.890+0000 7fa061468640 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56190eef6d70 con 0x7fa05c044050 2024-09-13T19:16:37.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.890+0000 7fa060c67640 1 -- 172.21.15.102:0/3712461131 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa05002e070 con 0x7fa05c044050 2024-09-13T19:16:37.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.890+0000 7fa060c67640 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56190eef6d70 con 0x56190eeee010 2024-09-13T19:16:37.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.890+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa048057030 con 0x56190eeee010 2024-09-13T19:16:37.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.890+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56190eef6d70 con 0x7fa05c044050 2024-09-13T19:16:37.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.891+0000 7fa060c67640 1 -- 172.21.15.102:0/3712461131 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa05002e070 con 0x7fa05c044050 2024-09-13T19:16:37.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.891+0000 7fa060c67640 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56190eef6d70 con 0x56190eef2a20 2024-09-13T19:16:37.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.891+0000 7fa061468640 1 -- 172.21.15.102:0/3712461131 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa05c027020 con 0x56190eef2a20 2024-09-13T19:16:37.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.891+0000 7fa061468640 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56190eef6d70 con 0x7fa05001b880 2024-09-13T19:16:37.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.891+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa048057030 con 0x7fa05001b880 2024-09-13T19:16:37.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.891+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56190eef6d70 con 0x7fa05c044050 2024-09-13T19:16:37.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.892+0000 7fa060c67640 1 -- 172.21.15.102:0/3712461131 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa05002e070 con 0x7fa05c044050 2024-09-13T19:16:37.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.892+0000 7fa060c67640 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56190eef6d70 con 0x56190eef2a20 2024-09-13T19:16:37.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.892+0000 7fa061468640 1 -- 172.21.15.102:0/3712461131 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa05c027020 con 0x56190eef2a20 2024-09-13T19:16:37.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.892+0000 7fa061468640 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56190eef6d70 con 0x7fa05001b880 2024-09-13T19:16:37.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.892+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa048057030 con 0x7fa05001b880 2024-09-13T19:16:37.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.892+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56190eef6d70 con 0x56190eeee010 2024-09-13T19:16:37.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.892+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa048057030 con 0x56190eeee010 2024-09-13T19:16:37.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.892+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56190eef6d70 con 0x7fa05c044050 2024-09-13T19:16:37.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.893+0000 7fa060c67640 1 -- 172.21.15.102:0/3712461131 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa05002e070 con 0x7fa05c044050 2024-09-13T19:16:37.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.893+0000 7fa06560f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:37.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.893+0000 7fa06560f800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:37.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.893+0000 7fa06560f800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:37.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.893+0000 7fa06560f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:37.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.893+0000 7fa06560f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:37.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.893+0000 7fa06560f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:37.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.893+0000 7fa06560f800 20 rados->read ofs=0 len=0 2024-09-13T19:16:37.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.893+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56190eef5de0 con 0x56190eeee010 2024-09-13T19:16:37.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.893+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa048057030 con 0x56190eeee010 2024-09-13T19:16:37.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.893+0000 7fa06560f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:37.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.893+0000 7fa06560f800 20 rados->read ofs=0 len=0 2024-09-13T19:16:37.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.893+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56190eef6680 con 0x56190eeee010 2024-09-13T19:16:37.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.893+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa048057030 con 0x56190eeee010 2024-09-13T19:16:37.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.893+0000 7fa06560f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:37.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.893+0000 7fa06560f800 20 rados->read ofs=0 len=0 2024-09-13T19:16:37.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.893+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56190eef71f0 con 0x56190eef2a20 2024-09-13T19:16:37.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.893+0000 7fa061468640 1 -- 172.21.15.102:0/3712461131 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa05c027020 con 0x56190eef2a20 2024-09-13T19:16:37.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.893+0000 7fa06560f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:37.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.893+0000 7fa06560f800 20 zone default found 2024-09-13T19:16:37.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.893+0000 7fa06560f800 4 Realm: () 2024-09-13T19:16:37.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.893+0000 7fa06560f800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:37.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.893+0000 7fa06560f800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:37.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.893+0000 7fa06560f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:37.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.893+0000 7fa06560f800 20 zonegroup default 2024-09-13T19:16:37.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.893+0000 7fa06560f800 20 rados->read ofs=0 len=0 2024-09-13T19:16:37.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.894+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56190eef6290 con 0x7fa05c044050 2024-09-13T19:16:37.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.894+0000 7fa060c67640 1 -- 172.21.15.102:0/3712461131 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa05002e070 con 0x7fa05c044050 2024-09-13T19:16:37.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.894+0000 7fa06560f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:37.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.894+0000 7fa06560f800 20 rados->read ofs=0 len=0 2024-09-13T19:16:37.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.894+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56190eef9920 con 0x56190eef2a20 2024-09-13T19:16:37.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.894+0000 7fa061468640 1 -- 172.21.15.102:0/3712461131 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa05c027020 con 0x56190eef2a20 2024-09-13T19:16:37.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.894+0000 7fa06560f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:37.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.894+0000 7fa06560f800 20 rados->read ofs=0 len=0 2024-09-13T19:16:37.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.894+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56190eef9cc0 con 0x56190eef2a20 2024-09-13T19:16:37.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.894+0000 7fa061468640 1 -- 172.21.15.102:0/3712461131 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa05c027020 con 0x56190eef2a20 2024-09-13T19:16:37.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.894+0000 7fa06560f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:37.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.894+0000 7fa06560f800 20 started sync module instance, tier type = 2024-09-13T19:16:37.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.894+0000 7fa06560f800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:37.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.894+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56190eef8db0 con 0x7fa05c044050 2024-09-13T19:16:37.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.896+0000 7fa060c67640 1 -- 172.21.15.102:0/3712461131 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(44 notify.0 [create] v36'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa05002e070 con 0x7fa05c044050 2024-09-13T19:16:37.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.896+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94665624752544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56190eef8a10 con 0x7fa05c044050 2024-09-13T19:16:37.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.896+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56190eefa9c0 con 0x56190eeee010 2024-09-13T19:16:37.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.897+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v36'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa048057030 con 0x56190eeee010 2024-09-13T19:16:37.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.897+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94665624759728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56190eefb680 con 0x56190eeee010 2024-09-13T19:16:37.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.897+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56190eefbd20 con 0x56190eef2a20 2024-09-13T19:16:37.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.897+0000 7fa060c67640 1 -- 172.21.15.102:0/3712461131 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94665624752544] v36'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa05002e070 con 0x7fa05c044050 2024-09-13T19:16:37.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.898+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94665624759728] v36'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa048057030 con 0x56190eeee010 2024-09-13T19:16:37.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.898+0000 7fa061468640 1 -- 172.21.15.102:0/3712461131 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v36'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa05c027020 con 0x56190eef2a20 2024-09-13T19:16:37.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.898+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94665624760784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56190eefa060 con 0x56190eef2a20 2024-09-13T19:16:37.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.898+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56190eefa060 con 0x7fa05c044050 2024-09-13T19:16:37.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.899+0000 7fa061468640 1 -- 172.21.15.102:0/3712461131 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94665624760784] v36'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa05c027020 con 0x56190eef2a20 2024-09-13T19:16:37.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.899+0000 7fa060c67640 1 -- 172.21.15.102:0/3712461131 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(50 notify.3 [create] v36'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa05002e070 con 0x7fa05c044050 2024-09-13T19:16:37.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.899+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94665624762352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56190eefc670 con 0x7fa05c044050 2024-09-13T19:16:37.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.899+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56190eefd110 con 0x56190eeee010 2024-09-13T19:16:37.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.900+0000 7fa060c67640 1 -- 172.21.15.102:0/3712461131 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94665624762352] v36'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa05002e070 con 0x7fa05c044050 2024-09-13T19:16:37.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.901+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v36'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa048057030 con 0x56190eeee010 2024-09-13T19:16:37.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.901+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94665624767456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56190eefd0d0 con 0x56190eeee010 2024-09-13T19:16:37.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.901+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56190eefdb70 con 0x7fa05001b880 2024-09-13T19:16:37.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.902+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94665624767456] v36'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa048057030 con 0x56190eeee010 2024-09-13T19:16:37.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.902+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(54 notify.5 [create] v36'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa048057030 con 0x7fa05001b880 2024-09-13T19:16:37.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.902+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94665624770208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56190eefdb70 con 0x7fa05001b880 2024-09-13T19:16:37.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.902+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56190eefe5e0 con 0x7fa05001b880 2024-09-13T19:16:37.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.903+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94665624770208] v36'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa048057030 con 0x7fa05001b880 2024-09-13T19:16:37.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.903+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(56 notify.6 [create] v36'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa048057030 con 0x7fa05001b880 2024-09-13T19:16:37.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.903+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94665624772816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56190eefe5a0 con 0x7fa05001b880 2024-09-13T19:16:37.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.903+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56190eefefe0 con 0x7fa05001b880 2024-09-13T19:16:37.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.904+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94665624772816] v36'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa048057030 con 0x7fa05001b880 2024-09-13T19:16:37.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.904+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(58 notify.7 [create] v36'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa048057030 con 0x7fa05001b880 2024-09-13T19:16:37.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.904+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94665624775344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56190eefefa0 con 0x7fa05001b880 2024-09-13T19:16:37.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.904+0000 7fa06560f800 20 add_watcher() i=0 2024-09-13T19:16:37.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.904+0000 7fa06560f800 20 add_watcher() i=1 2024-09-13T19:16:37.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.904+0000 7fa06560f800 20 add_watcher() i=2 2024-09-13T19:16:37.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.904+0000 7fa06560f800 20 add_watcher() i=3 2024-09-13T19:16:37.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.904+0000 7fa06560f800 20 add_watcher() i=4 2024-09-13T19:16:37.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.904+0000 7fa06560f800 20 add_watcher() i=5 2024-09-13T19:16:37.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.904+0000 7fa06560f800 20 add_watcher() i=6 2024-09-13T19:16:37.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.905+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94665624775344] v36'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa048057030 con 0x7fa05001b880 2024-09-13T19:16:37.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.905+0000 7fa06560f800 20 add_watcher() i=7 2024-09-13T19:16:37.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.905+0000 7fa06560f800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:37.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.905+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56190ef02400 con 0x56190eeee010 2024-09-13T19:16:37.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.905+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa048057030 con 0x56190eeee010 2024-09-13T19:16:37.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.905+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94665624764736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56190eeff950 con 0x56190eeee010 2024-09-13T19:16:37.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.906+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94665624764736] v36'178 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa048057030 con 0x56190eeee010 2024-09-13T19:16:37.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.906+0000 7f9f16fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:37.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.906+0000 7fa06560f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:37.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.906+0000 7fa06560f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:37.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.906+0000 7fa06560f800 5 note: GC not initialized 2024-09-13T19:16:37.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.907+0000 7f9f15fe3640 20 reqs_thread_entry: start 2024-09-13T19:16:37.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.907+0000 7fa06560f800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:37.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.907+0000 7fa06560f800 20 Filter name: none 2024-09-13T19:16:37.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.907+0000 7f9e877fe640 20 reqs_thread_entry: start 2024-09-13T19:16:37.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.907+0000 7fa06560f800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T19:16:37.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.907+0000 7fa06560f800 20 rados->read ofs=0 len=0 2024-09-13T19:16:37.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.907+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56190ef35c50 con 0x7fa05c044050 2024-09-13T19:16:37.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.908+0000 7fa060c67640 1 -- 172.21.15.102:0/3712461131 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv41 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fa05002e070 con 0x7fa05c044050 2024-09-13T19:16:37.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.908+0000 7fa06560f800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:16:37.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.908+0000 7fa06560f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T19:16:37.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.908+0000 7fa06560f800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:16:37.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.908+0000 7fa06560f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.5 : miss 2024-09-13T19:16:37.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.908+0000 7fa06560f800 20 rados->read ofs=0 len=0 2024-09-13T19:16:37.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.908+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:63 8.4 8:240cf6e4:root::.bucket.meta.myfoo%3a509740b4-c081-4f37-bd6d-df9ca851489b.4237.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56190ef377f0 con 0x7fa05c044050 2024-09-13T19:16:37.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.908+0000 7fa060c67640 1 -- 172.21.15.102:0/3712461131 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(63 .bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fa05002e070 con 0x7fa05c044050 2024-09-13T19:16:37.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.908+0000 7fa06560f800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:16:37.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.908+0000 7fa06560f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.5 info.flags=0x17 2024-09-13T19:16:37.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.908+0000 7fa06560f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.5 to cache LRU end 2024-09-13T19:16:37.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.908+0000 7fa06560f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:16:37.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.908+0000 7fa06560f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:16:37.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.908+0000 7fa06560f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.5 2024-09-13T19:16:37.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.908+0000 7fa06560f800 20 get_obj_state: octx=0x7fa050035040 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x56190ef39c68 s->prefetch_data=0 2024-09-13T19:16:37.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.908+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:64 3.0s0 3:00f550d3:::509740b4-c081-4f37-bd6d-df9ca851489b.4237.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56190ef3ae60 con 0x7fa05001b880 2024-09-13T19:16:37.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.908+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(64 509740b4-c081-4f37-bd6d-df9ca851489b.4237.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=848b,stat out=16b] v0'0 uv4 ondisk = 0) ==== 262+0+864 (crc 0 0 0) 0x7fa048057030 con 0x7fa05001b880 2024-09-13T19:16:37.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.909+0000 7fa06560f800 10 manifest: total_size = 5 2024-09-13T19:16:37.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.909+0000 7fa06560f800 20 get_obj_state: setting s->obj_tag to _tnXIVfQwOE3n_DBOEUnJ0_nvcFN_wGm 2024-09-13T19:16:37.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.909+0000 7f9f16fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:37.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.909+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94665624764736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56190ef33560 con 0x56190eeee010 2024-09-13T19:16:37.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.910+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94665624764736] v36'179 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa048057030 con 0x56190eeee010 2024-09-13T19:16:37.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.910+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94665624752544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56190ef3ae60 con 0x7fa05c044050 2024-09-13T19:16:37.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.911+0000 7fa060c67640 1 -- 172.21.15.102:0/3712461131 <== osd.2 v2:172.21.15.102:6816/2238176080 16 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94665624752544] v36'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa05002e070 con 0x7fa05c044050 2024-09-13T19:16:37.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.911+0000 7fa06560f800 20 remove_watcher() i=0 2024-09-13T19:16:37.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.911+0000 7fa06560f800 2 removed watcher, disabling cache 2024-09-13T19:16:37.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.911+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94665624759728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56190ef3ae60 con 0x56190eeee010 2024-09-13T19:16:37.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.912+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94665624759728] v36'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa048057030 con 0x56190eeee010 2024-09-13T19:16:37.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.912+0000 7fa06560f800 20 remove_watcher() i=1 2024-09-13T19:16:37.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.912+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94665624760784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56190ef3ae60 con 0x56190eef2a20 2024-09-13T19:16:37.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.913+0000 7fa061468640 1 -- 172.21.15.102:0/3712461131 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94665624760784] v36'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa05c027020 con 0x56190eef2a20 2024-09-13T19:16:37.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.914+0000 7fa06560f800 20 remove_watcher() i=2 2024-09-13T19:16:37.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.914+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94665624762352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56190ef3ae60 con 0x7fa05c044050 2024-09-13T19:16:37.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.915+0000 7fa060c67640 1 -- 172.21.15.102:0/3712461131 <== osd.2 v2:172.21.15.102:6816/2238176080 17 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94665624762352] v36'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa05002e070 con 0x7fa05c044050 2024-09-13T19:16:37.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.915+0000 7fa06560f800 20 remove_watcher() i=3 2024-09-13T19:16:37.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.915+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94665624767456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56190ef3ae60 con 0x56190eeee010 2024-09-13T19:16:37.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.916+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94665624767456] v36'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa048057030 con 0x56190eeee010 2024-09-13T19:16:37.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.916+0000 7fa06560f800 20 remove_watcher() i=4 2024-09-13T19:16:37.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.916+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94665624770208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56190ef3ae60 con 0x7fa05001b880 2024-09-13T19:16:37.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.917+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94665624770208] v36'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa048057030 con 0x7fa05001b880 2024-09-13T19:16:37.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.917+0000 7fa06560f800 20 remove_watcher() i=5 2024-09-13T19:16:37.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.917+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94665624772816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56190ef3ae60 con 0x7fa05001b880 2024-09-13T19:16:37.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.918+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94665624772816] v36'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa048057030 con 0x7fa05001b880 2024-09-13T19:16:37.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.918+0000 7fa06560f800 20 remove_watcher() i=6 2024-09-13T19:16:37.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.918+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94665624775344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56190ef3ae60 con 0x7fa05001b880 2024-09-13T19:16:37.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.919+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94665624775344] v36'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa048057030 con 0x7fa05001b880 2024-09-13T19:16:37.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.919+0000 7fa06560f800 20 remove_watcher() i=7 2024-09-13T19:16:37.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.919+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fa05001b880 msgr2=0x7fa05000e590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.919+0000 7fa06560f800 1 --2- 172.21.15.102:0/3712461131 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fa05001b880 0x7fa05000e590 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.919+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56190eeee010 msgr2=0x56190eef04d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.919+0000 7fa06560f800 1 --2- 172.21.15.102:0/3712461131 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56190eeee010 0x56190eef04d0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.919+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fa05c044050 msgr2=0x7fa05c04b210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.919+0000 7fa06560f800 1 --2- 172.21.15.102:0/3712461131 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fa05c044050 0x7fa05c04b210 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.919+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56190eef2a20 msgr2=0x56190eef4e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.919+0000 7fa06560f800 1 --2- 172.21.15.102:0/3712461131 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56190eef2a20 0x56190eef4e10 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.919+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9f2c036b40 msgr2=0x7f9f2c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.919+0000 7fa06560f800 1 --2- 172.21.15.102:0/3712461131 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9f2c036b40 0x7f9f2c039000 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa05000bb00 tx=0x7fa050037000 comp rx=0 tx=0).stop 2024-09-13T19:16:37.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.919+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56190eea9820 msgr2=0x56190eee2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.919+0000 7fa06560f800 1 --2- 172.21.15.102:0/3712461131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56190eea9820 0x56190eee2350 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fa05c014e60 tx=0x7fa05c04cd30 comp rx=0 tx=0).stop 2024-09-13T19:16:37.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.919+0000 7fa058466640 1 -- 172.21.15.102:0/3712461131 reap_dead start 2024-09-13T19:16:37.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.919+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 shutdown_connections 2024-09-13T19:16:37.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.919+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 >> 172.21.15.102:0/3712461131 conn(0x56190eed5030 msgr2=0x56190eed30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:37.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.919+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 shutdown_connections 2024-09-13T19:16:37.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.920+0000 7fa06560f800 1 -- 172.21.15.102:0/3712461131 wait complete. 2024-09-13T19:16:37.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.920+0000 7fa06560f800 1 -- 172.21.15.102:0/717749090 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9f38036c00 msgr2=0x7f9f380390c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.920+0000 7fa06560f800 1 --2- 172.21.15.102:0/717749090 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9f38036c00 0x7f9f380390c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa050000fb0 tx=0x7fa050000f40 comp rx=0 tx=0).stop 2024-09-13T19:16:37.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.920+0000 7fa06560f800 1 -- 172.21.15.102:0/717749090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56190eecc050 msgr2=0x56190eecc470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.920+0000 7fa06560f800 1 --2- 172.21.15.102:0/717749090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56190eecc050 0x56190eecc470 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x56190eeb8ca0 tx=0x7fa05c0163e0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.920+0000 7fa06560f800 1 -- 172.21.15.102:0/717749090 shutdown_connections 2024-09-13T19:16:37.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.920+0000 7fa06560f800 1 --2- 172.21.15.102:0/717749090 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9f38036c00 0x7f9f380390c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.920+0000 7fa06560f800 1 --2- 172.21.15.102:0/717749090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56190eecc050 0x56190eecc470 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.920+0000 7fa06560f800 1 -- 172.21.15.102:0/717749090 >> 172.21.15.102:0/717749090 conn(0x56190eec0fe0 msgr2=0x56190eec3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:37.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.920+0000 7fa06560f800 1 -- 172.21.15.102:0/717749090 shutdown_connections 2024-09-13T19:16:37.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.920+0000 7fa06560f800 1 -- 172.21.15.102:0/717749090 wait complete. 2024-09-13T19:16:37.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.920+0000 7fa06560f800 1 -- 172.21.15.102:0/3692440542 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56190edbd920 msgr2=0x56190eeb8380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.920+0000 7fa06560f800 1 --2- 172.21.15.102:0/3692440542 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56190edbd920 0x56190eeb8380 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.920+0000 7fa06560f800 1 -- 172.21.15.102:0/3692440542 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56190eebabf0 msgr2=0x56190eebcfe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.920+0000 7fa06560f800 1 --2- 172.21.15.102:0/3692440542 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56190eebabf0 0x56190eebcfe0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.920+0000 7fa06560f800 1 -- 172.21.15.102:0/3692440542 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9f48036b90 msgr2=0x7f9f48039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.920+0000 7fa06560f800 1 --2- 172.21.15.102:0/3692440542 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9f48036b90 0x7f9f48039050 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa048057000 tx=0x7fa048052000 comp rx=0 tx=0).stop 2024-09-13T19:16:37.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.920+0000 7fa06560f800 1 -- 172.21.15.102:0/3692440542 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56190edb94e0 msgr2=0x56190eeb1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:37.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.920+0000 7fa06560f800 1 --2- 172.21.15.102:0/3692440542 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56190edb94e0 0x56190eeb1310 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x56190ed2d4a0 tx=0x7fa050000ed0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.920+0000 7fa06560f800 1 -- 172.21.15.102:0/3692440542 shutdown_connections 2024-09-13T19:16:37.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.920+0000 7fa06560f800 1 --2- 172.21.15.102:0/3692440542 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56190eebabf0 0x56190eebcfe0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.920+0000 7fa06560f800 1 --2- 172.21.15.102:0/3692440542 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56190edbd920 0x56190eeb8380 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.921+0000 7fa06560f800 1 --2- 172.21.15.102:0/3692440542 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9f48036b90 0x7f9f48039050 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.921+0000 7fa06560f800 1 --2- 172.21.15.102:0/3692440542 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56190edb94e0 0x56190eeb1310 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:37.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.921+0000 7fa06560f800 1 -- 172.21.15.102:0/3692440542 >> 172.21.15.102:0/3692440542 conn(0x56190edb4dd0 msgr2=0x56190eea2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:37.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.921+0000 7fa06560f800 1 -- 172.21.15.102:0/3692440542 shutdown_connections 2024-09-13T19:16:37.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.921+0000 7fa06560f800 1 -- 172.21.15.102:0/3692440542 wait complete. 2024-09-13T19:16:37.947 INFO:teuthology.orchestra.run.smithi102.stdout:fooFoofooFooFULL_CONTROL 2024-09-13T19:16:37.947 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2024-09-13T19:16:37.950 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2024-09-13T19:16:37.955 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:16:37.955 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-13T19:16:37.955 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-13T19:16:37.955 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-13T19:16:38.000 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:38.001 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:38.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.998+0000 7fd972940800 1 Processor -- start 2024-09-13T19:16:38.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.998+0000 7fd972940800 1 -- start start 2024-09-13T19:16:38.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.998+0000 7fd972940800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5613b279f5d0 0x5613b279ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.998+0000 7fd972940800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5613b26e8b30 con 0x5613b279e2f0 2024-09-13T19:16:38.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.998+0000 7fd972940800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5613b26ca360 con 0x5613b279f5d0 2024-09-13T19:16:38.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.999+0000 7fd96e6d1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5613b279f5d0 0x5613b279ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.999+0000 7fd96e6d1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5613b279f5d0 0x5613b279ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55426/0 (socket says 172.21.15.102:55426) 2024-09-13T19:16:38.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.999+0000 7fd96e6d1640 1 -- 172.21.15.102:0/2361827697 learned_addr learned my addr 172.21.15.102:0/2361827697 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:38.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.999+0000 7fd96e6d1640 1 -- 172.21.15.102:0/2361827697 >> v1:172.21.15.53:6789/0 conn(0x5613b279e2f0 legacy=0x5613b2831680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:37.999+0000 7fd96e6d1640 1 -- 172.21.15.102:0/2361827697 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613b26f0e00 con 0x5613b279f5d0 2024-09-13T19:16:38.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.001+0000 7fd96e6d1640 1 --2- 172.21.15.102:0/2361827697 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613b279f5d0 0x5613b279ddb0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fd96000a520 tx=0x7fd960045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e7c019a44ad77a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.001+0000 7fd96ded0640 1 -- 172.21.15.102:0/2361827697 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd960055070 con 0x5613b279f5d0 2024-09-13T19:16:38.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.001+0000 7fd96ded0640 1 -- 172.21.15.102:0/2361827697 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9600515b0 con 0x5613b279f5d0 2024-09-13T19:16:38.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.001+0000 7fd96ded0640 1 -- 172.21.15.102:0/2361827697 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9600518d0 con 0x5613b279f5d0 2024-09-13T19:16:38.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.001+0000 7fd972940800 1 -- 172.21.15.102:0/2361827697 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613b279f5d0 msgr2=0x5613b279ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.001+0000 7fd972940800 1 --2- 172.21.15.102:0/2361827697 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613b279f5d0 0x5613b279ddb0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fd96000a520 tx=0x7fd960045ba0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.001+0000 7fd972940800 1 -- 172.21.15.102:0/2361827697 shutdown_connections 2024-09-13T19:16:38.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.001+0000 7fd972940800 1 --2- 172.21.15.102:0/2361827697 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613b279f5d0 0x5613b279ddb0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.001+0000 7fd972940800 1 -- 172.21.15.102:0/2361827697 >> 172.21.15.102:0/2361827697 conn(0x5613b2824fe0 msgr2=0x5613b2827400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:38.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.001+0000 7fd972940800 1 -- 172.21.15.102:0/2361827697 shutdown_connections 2024-09-13T19:16:38.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.001+0000 7fd972940800 1 -- 172.21.15.102:0/2361827697 wait complete. 2024-09-13T19:16:38.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.015+0000 7fd972940800 1 Processor -- start 2024-09-13T19:16:38.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.015+0000 7fd972940800 1 -- start start 2024-09-13T19:16:38.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.015+0000 7fd972940800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613b279e2f0 0x5613b291aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.015+0000 7fd972940800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5613b2775360 con 0x5613b279e2f0 2024-09-13T19:16:38.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.016+0000 7fd96e6d1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613b279e2f0 0x5613b291aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.016+0000 7fd96e6d1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613b279e2f0 0x5613b291aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55434/0 (socket says 172.21.15.102:55434) 2024-09-13T19:16:38.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.016+0000 7fd96e6d1640 1 -- 172.21.15.102:0/899517087 learned_addr learned my addr 172.21.15.102:0/899517087 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:38.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.016+0000 7fd96e6d1640 1 -- 172.21.15.102:0/899517087 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613b26c2bc0 con 0x5613b279e2f0 2024-09-13T19:16:38.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.016+0000 7fd96e6d1640 1 --2- 172.21.15.102:0/899517087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613b279e2f0 0x5613b291aaf0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fd960025da0 tx=0x7fd960051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fab0470cab6d674 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.016+0000 7fd85c608640 1 -- 172.21.15.102:0/899517087 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd960051950 con 0x5613b279e2f0 2024-09-13T19:16:38.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.017+0000 7fd85c608640 1 -- 172.21.15.102:0/899517087 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd960051af0 con 0x5613b279e2f0 2024-09-13T19:16:38.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.017+0000 7fd85c608640 1 -- 172.21.15.102:0/899517087 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd960051dd0 con 0x5613b279e2f0 2024-09-13T19:16:38.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.017+0000 7fd972940800 1 -- 172.21.15.102:0/899517087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613b279e2f0 msgr2=0x5613b291aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.017+0000 7fd972940800 1 --2- 172.21.15.102:0/899517087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613b279e2f0 0x5613b291aaf0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fd960025da0 tx=0x7fd960051000 comp rx=0 tx=0).stop 2024-09-13T19:16:38.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.017+0000 7fd972940800 1 -- 172.21.15.102:0/899517087 shutdown_connections 2024-09-13T19:16:38.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.017+0000 7fd972940800 1 --2- 172.21.15.102:0/899517087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613b279e2f0 0x5613b291aaf0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.017+0000 7fd972940800 1 -- 172.21.15.102:0/899517087 >> 172.21.15.102:0/899517087 conn(0x5613b2824fe0 msgr2=0x5613b29164b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:38.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.017+0000 7fd972940800 1 -- 172.21.15.102:0/899517087 shutdown_connections 2024-09-13T19:16:38.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.017+0000 7fd972940800 1 -- 172.21.15.102:0/899517087 wait complete. 2024-09-13T19:16:38.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.018+0000 7fd972940800 1 Processor -- start 2024-09-13T19:16:38.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.018+0000 7fd972940800 1 -- start start 2024-09-13T19:16:38.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.018+0000 7fd972940800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613b279e2f0 0x5613b2922420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.018+0000 7fd972940800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5613b279e9e0 con 0x5613b279e2f0 2024-09-13T19:16:38.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.018+0000 7fd96e6d1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613b279e2f0 0x5613b2922420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.018+0000 7fd96e6d1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613b279e2f0 0x5613b2922420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55450/0 (socket says 172.21.15.102:55450) 2024-09-13T19:16:38.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.018+0000 7fd96e6d1640 1 -- 172.21.15.102:0/254175103 learned_addr learned my addr 172.21.15.102:0/254175103 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:38.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.018+0000 7fd96e6d1640 1 -- 172.21.15.102:0/254175103 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613b26d6fe0 con 0x5613b279e2f0 2024-09-13T19:16:38.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.018+0000 7fd96e6d1640 1 --2- 172.21.15.102:0/254175103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613b279e2f0 0x5613b2922420 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fd960067040 tx=0x7fd960002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.018+0000 7fd85ae05640 1 -- 172.21.15.102:0/254175103 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd960073070 con 0x5613b279e2f0 2024-09-13T19:16:38.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.018+0000 7fd85ae05640 1 -- 172.21.15.102:0/254175103 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd96005a450 con 0x5613b279e2f0 2024-09-13T19:16:38.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.018+0000 7fd972940800 1 -- 172.21.15.102:0/254175103 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5613b2922960 con 0x5613b279e2f0 2024-09-13T19:16:38.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.019+0000 7fd85ae05640 1 -- 172.21.15.102:0/254175103 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd96005a730 con 0x5613b279e2f0 2024-09-13T19:16:38.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.019+0000 7fd972940800 1 -- 172.21.15.102:0/254175103 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613b2922ee0 con 0x5613b279e2f0 2024-09-13T19:16:38.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.019+0000 7fd85ae05640 1 -- 172.21.15.102:0/254175103 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd960076070 con 0x5613b279e2f0 2024-09-13T19:16:38.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.019+0000 7fd85ae05640 1 --2- 172.21.15.102:0/254175103 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd854036b90 0x7fd854039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.019+0000 7fd85ae05640 1 -- 172.21.15.102:0/254175103 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fd960062070 con 0x5613b279e2f0 2024-09-13T19:16:38.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.020+0000 7fd965ed0640 1 --2- 172.21.15.102:0/254175103 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd854036b90 0x7fd854039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.020+0000 7fd972940800 1 --2- 172.21.15.102:0/254175103 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5613b279f5d0 0x5613b2929490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.020+0000 7fd972940800 1 -- 172.21.15.102:0/254175103 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5613b2929a10 con 0x5613b279f5d0 2024-09-13T19:16:38.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.020+0000 7fd96eed2640 1 --2- 172.21.15.102:0/254175103 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5613b279f5d0 0x5613b2929490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.020+0000 7fd965ed0640 1 --2- 172.21.15.102:0/254175103 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd854036b90 0x7fd854039050 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd958001e10 tx=0x7fd958001390 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.020+0000 7fd96eed2640 1 --2- 172.21.15.102:0/254175103 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5613b279f5d0 0x5613b2929490 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.020+0000 7fd96eed2640 1 -- 172.21.15.102:0/254175103 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd96800a4a0 con 0x5613b279f5d0 2024-09-13T19:16:38.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.020+0000 7fd972940800 1 -- 172.21.15.102:0/254175103 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5613b292a2d0 con 0x5613b279f5d0 2024-09-13T19:16:38.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.021+0000 7fd96eed2640 1 -- 172.21.15.102:0/254175103 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd96800a4a0 con 0x5613b279f5d0 2024-09-13T19:16:38.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.021+0000 7fd972940800 1 --2- 172.21.15.102:0/254175103 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5613b292bc20 0x5613b292e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.021+0000 7fd972940800 1 -- 172.21.15.102:0/254175103 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5613b292e840 con 0x5613b292bc20 2024-09-13T19:16:38.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.021+0000 7fd96e6d1640 1 --2- 172.21.15.102:0/254175103 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5613b292bc20 0x5613b292e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.021+0000 7fd96e6d1640 1 --2- 172.21.15.102:0/254175103 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5613b292bc20 0x5613b292e0b0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.021+0000 7fd96e6d1640 1 -- 172.21.15.102:0/254175103 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd960075030 con 0x5613b292bc20 2024-09-13T19:16:38.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.021+0000 7fd972940800 1 -- 172.21.15.102:0/254175103 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5613b292ab20 con 0x5613b279f5d0 2024-09-13T19:16:38.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.022+0000 7fd96eed2640 1 -- 172.21.15.102:0/254175103 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd96800a4a0 con 0x5613b279f5d0 2024-09-13T19:16:38.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.022+0000 7fd972940800 1 -- 172.21.15.102:0/254175103 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5613b292af00 con 0x5613b292bc20 2024-09-13T19:16:38.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.022+0000 7fd96e6d1640 1 -- 172.21.15.102:0/254175103 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd960075030 con 0x5613b292bc20 2024-09-13T19:16:38.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.022+0000 7fd972940800 1 Processor -- start 2024-09-13T19:16:38.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.022+0000 7fd972940800 1 -- start start 2024-09-13T19:16:38.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.022+0000 7fd972940800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613b293d160 0x5613b293d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.022+0000 7fd972940800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5613b26c4580 con 0x5613b293d160 2024-09-13T19:16:38.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.023+0000 7fd96eed2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613b293d160 0x5613b293d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.023+0000 7fd96eed2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613b293d160 0x5613b293d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55452/0 (socket says 172.21.15.102:55452) 2024-09-13T19:16:38.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.023+0000 7fd96eed2640 1 -- 172.21.15.102:0/1709016574 learned_addr learned my addr 172.21.15.102:0/1709016574 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:38.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.023+0000 7fd96eed2640 1 -- 172.21.15.102:0/1709016574 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613b293dac0 con 0x5613b293d160 2024-09-13T19:16:38.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.023+0000 7fd96eed2640 1 --2- 172.21.15.102:0/1709016574 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613b293d160 0x5613b293d580 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x5613b2929df0 tx=0x7fd9680163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.023+0000 7fd853fff640 1 -- 172.21.15.102:0/1709016574 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd968013450 con 0x5613b293d160 2024-09-13T19:16:38.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.023+0000 7fd853fff640 1 -- 172.21.15.102:0/1709016574 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9680135f0 con 0x5613b293d160 2024-09-13T19:16:38.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.023+0000 7fd972940800 1 -- 172.21.15.102:0/1709016574 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5613b293dd50 con 0x5613b293d160 2024-09-13T19:16:38.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.023+0000 7fd853fff640 1 -- 172.21.15.102:0/1709016574 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9680138d0 con 0x5613b293d160 2024-09-13T19:16:38.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.023+0000 7fd972940800 1 -- 172.21.15.102:0/1709016574 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613b2940a30 con 0x5613b293d160 2024-09-13T19:16:38.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.024+0000 7fd853fff640 1 -- 172.21.15.102:0/1709016574 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd968011040 con 0x5613b293d160 2024-09-13T19:16:38.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.024+0000 7fd853fff640 1 --2- 172.21.15.102:0/1709016574 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd848036b40 0x7fd848039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.024+0000 7fd853fff640 1 -- 172.21.15.102:0/1709016574 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fd96800e040 con 0x5613b293d160 2024-09-13T19:16:38.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.024+0000 7fd96e6d1640 1 --2- 172.21.15.102:0/1709016574 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd848036b40 0x7fd848039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.024+0000 7fd972940800 1 Processor -- start 2024-09-13T19:16:38.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.025+0000 7fd972940800 1 -- start start 2024-09-13T19:16:38.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.025+0000 7fd96e6d1640 1 --2- 172.21.15.102:0/1709016574 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd848036b40 0x7fd848039000 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x5613b2926aa0 tx=0x7fd96008f550 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.025+0000 7fd972940800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613b2949e50 0x5613b294a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.025+0000 7fd972940800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5613b291b1e0 con 0x5613b2949e50 2024-09-13T19:16:38.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.025+0000 7fd96eed2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613b2949e50 0x5613b294a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.025+0000 7fd96eed2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613b2949e50 0x5613b294a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55460/0 (socket says 172.21.15.102:55460) 2024-09-13T19:16:38.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.025+0000 7fd96eed2640 1 -- 172.21.15.102:0/1647347345 learned_addr learned my addr 172.21.15.102:0/1647347345 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:38.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.025+0000 7fd96eed2640 1 -- 172.21.15.102:0/1647347345 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613b294a820 con 0x5613b2949e50 2024-09-13T19:16:38.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.025+0000 7fd96eed2640 1 --2- 172.21.15.102:0/1647347345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613b2949e50 0x5613b294a250 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fd968016fd0 tx=0x7fd968014ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf2d32a403fdf468 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.025+0000 7fd851ffb640 1 -- 172.21.15.102:0/1647347345 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd96804a070 con 0x5613b2949e50 2024-09-13T19:16:38.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.025+0000 7fd851ffb640 1 -- 172.21.15.102:0/1647347345 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd968014bd0 con 0x5613b2949e50 2024-09-13T19:16:38.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.025+0000 7fd851ffb640 1 -- 172.21.15.102:0/1647347345 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd96802a980 con 0x5613b2949e50 2024-09-13T19:16:38.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.026+0000 7fd972940800 1 -- 172.21.15.102:0/1647347345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613b2949e50 msgr2=0x5613b294a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.026+0000 7fd972940800 1 --2- 172.21.15.102:0/1647347345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613b2949e50 0x5613b294a250 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fd968016fd0 tx=0x7fd968014ef0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.026+0000 7fd972940800 1 -- 172.21.15.102:0/1647347345 shutdown_connections 2024-09-13T19:16:38.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.026+0000 7fd972940800 1 --2- 172.21.15.102:0/1647347345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613b2949e50 0x5613b294a250 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.026+0000 7fd972940800 1 -- 172.21.15.102:0/1647347345 >> 172.21.15.102:0/1647347345 conn(0x5613b29461b0 msgr2=0x5613b29442b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:38.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.026+0000 7fd972940800 1 -- 172.21.15.102:0/1647347345 shutdown_connections 2024-09-13T19:16:38.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.026+0000 7fd972940800 1 -- 172.21.15.102:0/1647347345 wait complete. 2024-09-13T19:16:38.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.026+0000 7fd972940800 1 Processor -- start 2024-09-13T19:16:38.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.026+0000 7fd972940800 1 -- start start 2024-09-13T19:16:38.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.026+0000 7fd972940800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613b2949e50 0x5613b2951280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.026+0000 7fd972940800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5613b294ae90 con 0x5613b2949e50 2024-09-13T19:16:38.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.026+0000 7fd96eed2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613b2949e50 0x5613b2951280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.026+0000 7fd96eed2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613b2949e50 0x5613b2951280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55470/0 (socket says 172.21.15.102:55470) 2024-09-13T19:16:38.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.027+0000 7fd96eed2640 1 -- 172.21.15.102:0/1733841896 learned_addr learned my addr 172.21.15.102:0/1733841896 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:38.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.027+0000 7fd96eed2640 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613b29517c0 con 0x5613b2949e50 2024-09-13T19:16:38.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.027+0000 7fd96eed2640 1 --2- 172.21.15.102:0/1733841896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613b2949e50 0x5613b2951280 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fd968014fd0 tx=0x7fd96804cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.027+0000 7fd83ffff640 1 -- 172.21.15.102:0/1733841896 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd968038070 con 0x5613b2949e50 2024-09-13T19:16:38.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.027+0000 7fd83ffff640 1 -- 172.21.15.102:0/1733841896 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd96802aab0 con 0x5613b2949e50 2024-09-13T19:16:38.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.027+0000 7fd83ffff640 1 -- 172.21.15.102:0/1733841896 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9680144f0 con 0x5613b2949e50 2024-09-13T19:16:38.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.027+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5613b2951a50 con 0x5613b2949e50 2024-09-13T19:16:38.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.027+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613b2954700 con 0x5613b2949e50 2024-09-13T19:16:38.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.028+0000 7fd83ffff640 1 -- 172.21.15.102:0/1733841896 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd96803b070 con 0x5613b2949e50 2024-09-13T19:16:38.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.028+0000 7fd83ffff640 1 --2- 172.21.15.102:0/1733841896 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd838036b40 0x7fd838039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.028+0000 7fd83ffff640 1 -- 172.21.15.102:0/1733841896 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fd968034da0 con 0x5613b2949e50 2024-09-13T19:16:38.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.028+0000 7fd96e6d1640 1 --2- 172.21.15.102:0/1733841896 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd838036b40 0x7fd838039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.028+0000 7fd96e6d1640 1 --2- 172.21.15.102:0/1733841896 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd838036b40 0x7fd838039000 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x5613b2926b90 tx=0x7fd96008c000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.029+0000 7fd972940800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.029+0000 7fd972940800 1 --2- 172.21.15.102:0/1733841896 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5613b295cf70 0x5613b295f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.029+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5613b295fb80 con 0x5613b295cf70 2024-09-13T19:16:38.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.029+0000 7fd965ed0640 1 --2- 172.21.15.102:0/1733841896 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5613b295cf70 0x5613b295f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.029+0000 7fd965ed0640 1 --2- 172.21.15.102:0/1733841896 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5613b295cf70 0x5613b295f430 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.029+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd95800bdb0 con 0x5613b295cf70 2024-09-13T19:16:38.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.029+0000 7fd972940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:38.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.029+0000 7fd972940800 20 realm 2024-09-13T19:16:38.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.029+0000 7fd972940800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.029+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5613b295c3c0 con 0x5613b295cf70 2024-09-13T19:16:38.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.030+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd95800bdb0 con 0x5613b295cf70 2024-09-13T19:16:38.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.030+0000 7fd972940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:38.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.030+0000 7fd972940800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:38.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.030+0000 7fd972940800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.030+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5613b2960670 con 0x5613b295cf70 2024-09-13T19:16:38.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.030+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd95800bdb0 con 0x5613b295cf70 2024-09-13T19:16:38.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.030+0000 7fd972940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:38.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.030+0000 7fd972940800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.030+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5613b2960f40 con 0x5613b295cf70 2024-09-13T19:16:38.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.030+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd95800bdb0 con 0x5613b295cf70 2024-09-13T19:16:38.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.030+0000 7fd972940800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:38.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.030+0000 7fd972940800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.030+0000 7fd972940800 1 --2- 172.21.15.102:0/1733841896 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5613b2961880 0x5613b2963cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.030+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5613b2964440 con 0x5613b2961880 2024-09-13T19:16:38.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.030+0000 7fd96eed2640 1 --2- 172.21.15.102:0/1733841896 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5613b2961880 0x5613b2963cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.030+0000 7fd96eed2640 1 --2- 172.21.15.102:0/1733841896 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5613b2961880 0x5613b2963cb0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.031+0000 7fd96eed2640 1 -- 172.21.15.102:0/1733841896 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd96803a030 con 0x5613b2961880 2024-09-13T19:16:38.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.031+0000 7fd972940800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:38.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.031+0000 7fd972940800 20 searching for the correct realm 2024-09-13T19:16:38.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.031+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5613b2965d90 con 0x5613b2961880 2024-09-13T19:16:38.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.031+0000 7fd96eed2640 1 -- 172.21.15.102:0/1733841896 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd96803a030 con 0x5613b2961880 2024-09-13T19:16:38.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.031+0000 7fd96eed2640 1 --2- 172.21.15.102:0/1733841896 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fd968013070 0x7fd968015420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.031+0000 7fd96eed2640 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5613b2965d90 con 0x7fd968013070 2024-09-13T19:16:38.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.031+0000 7fd96e6d1640 1 --2- 172.21.15.102:0/1733841896 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fd968013070 0x7fd968015420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.031+0000 7fd96e6d1640 1 --2- 172.21.15.102:0/1733841896 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fd968013070 0x7fd968015420 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.032+0000 7fd96e6d1640 1 -- 172.21.15.102:0/1733841896 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd960075030 con 0x7fd968013070 2024-09-13T19:16:38.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.032+0000 7fd96e6d1640 1 --2- 172.21.15.102:0/1733841896 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fd9600a0070 0x7fd96004f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.032+0000 7fd96e6d1640 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5613b2965d90 con 0x7fd9600a0070 2024-09-13T19:16:38.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.032+0000 7fd965ed0640 1 --2- 172.21.15.102:0/1733841896 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fd9600a0070 0x7fd96004f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.032+0000 7fd965ed0640 1 --2- 172.21.15.102:0/1733841896 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fd9600a0070 0x7fd96004f360 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.033+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd95800bdb0 con 0x7fd9600a0070 2024-09-13T19:16:38.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.033+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5613b2965d90 con 0x5613b295cf70 2024-09-13T19:16:38.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.033+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd95800bdb0 con 0x5613b295cf70 2024-09-13T19:16:38.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.033+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5613b2965d90 con 0x5613b295cf70 2024-09-13T19:16:38.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.033+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd95802a040 con 0x5613b295cf70 2024-09-13T19:16:38.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.033+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5613b2965d90 con 0x7fd9600a0070 2024-09-13T19:16:38.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.033+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd95802a040 con 0x7fd9600a0070 2024-09-13T19:16:38.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.033+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5613b2965d90 con 0x7fd9600a0070 2024-09-13T19:16:38.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.034+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd95802a040 con 0x7fd9600a0070 2024-09-13T19:16:38.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.034+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5613b2965d90 con 0x7fd968013070 2024-09-13T19:16:38.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.034+0000 7fd96e6d1640 1 -- 172.21.15.102:0/1733841896 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd960075030 con 0x7fd968013070 2024-09-13T19:16:38.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.034+0000 7fd96e6d1640 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5613b2965d90 con 0x5613b2961880 2024-09-13T19:16:38.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.034+0000 7fd96eed2640 1 -- 172.21.15.102:0/1733841896 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd96803a030 con 0x5613b2961880 2024-09-13T19:16:38.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.034+0000 7fd96eed2640 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5613b2965d90 con 0x5613b295cf70 2024-09-13T19:16:38.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.034+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd95802a040 con 0x5613b295cf70 2024-09-13T19:16:38.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.034+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5613b2965d90 con 0x7fd968013070 2024-09-13T19:16:38.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.035+0000 7fd96e6d1640 1 -- 172.21.15.102:0/1733841896 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9600af040 con 0x7fd968013070 2024-09-13T19:16:38.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.035+0000 7fd96e6d1640 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5613b2965d90 con 0x5613b295cf70 2024-09-13T19:16:38.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.035+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd95802a040 con 0x5613b295cf70 2024-09-13T19:16:38.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.035+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5613b2965d90 con 0x7fd968013070 2024-09-13T19:16:38.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.035+0000 7fd96e6d1640 1 -- 172.21.15.102:0/1733841896 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd9600af040 con 0x7fd968013070 2024-09-13T19:16:38.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.035+0000 7fd96e6d1640 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5613b2965d90 con 0x5613b2961880 2024-09-13T19:16:38.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.035+0000 7fd96eed2640 1 -- 172.21.15.102:0/1733841896 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd96803a030 con 0x5613b2961880 2024-09-13T19:16:38.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.035+0000 7fd96eed2640 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5613b2965d90 con 0x5613b2961880 2024-09-13T19:16:38.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.035+0000 7fd96eed2640 1 -- 172.21.15.102:0/1733841896 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd96803a030 con 0x5613b2961880 2024-09-13T19:16:38.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.035+0000 7fd96eed2640 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5613b2965d90 con 0x7fd9600a0070 2024-09-13T19:16:38.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.036+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd95802a040 con 0x7fd9600a0070 2024-09-13T19:16:38.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.036+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5613b2965d90 con 0x5613b2961880 2024-09-13T19:16:38.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.036+0000 7fd96eed2640 1 -- 172.21.15.102:0/1733841896 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd96803a030 con 0x5613b2961880 2024-09-13T19:16:38.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.036+0000 7fd96eed2640 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5613b2965d90 con 0x5613b2961880 2024-09-13T19:16:38.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.036+0000 7fd96eed2640 1 -- 172.21.15.102:0/1733841896 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd96803a030 con 0x5613b2961880 2024-09-13T19:16:38.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.036+0000 7fd96eed2640 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5613b2965d90 con 0x5613b295cf70 2024-09-13T19:16:38.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.036+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd95802a040 con 0x5613b295cf70 2024-09-13T19:16:38.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.036+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5613b2965d90 con 0x5613b295cf70 2024-09-13T19:16:38.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.037+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd95802a040 con 0x5613b295cf70 2024-09-13T19:16:38.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.037+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5613b2965d90 con 0x7fd9600a0070 2024-09-13T19:16:38.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.037+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd95802a040 con 0x7fd9600a0070 2024-09-13T19:16:38.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.037+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5613b2965d90 con 0x5613b2961880 2024-09-13T19:16:38.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.037+0000 7fd96eed2640 1 -- 172.21.15.102:0/1733841896 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd96803a030 con 0x5613b2961880 2024-09-13T19:16:38.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.037+0000 7fd96eed2640 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5613b2965d90 con 0x7fd968013070 2024-09-13T19:16:38.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.037+0000 7fd96e6d1640 1 -- 172.21.15.102:0/1733841896 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9600af040 con 0x7fd968013070 2024-09-13T19:16:38.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.037+0000 7fd96e6d1640 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5613b2965d90 con 0x5613b295cf70 2024-09-13T19:16:38.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.037+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd95802a040 con 0x5613b295cf70 2024-09-13T19:16:38.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.037+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5613b2965d90 con 0x7fd968013070 2024-09-13T19:16:38.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.038+0000 7fd96e6d1640 1 -- 172.21.15.102:0/1733841896 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9600af040 con 0x7fd968013070 2024-09-13T19:16:38.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.038+0000 7fd96e6d1640 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5613b2965d90 con 0x5613b2961880 2024-09-13T19:16:38.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.038+0000 7fd96eed2640 1 -- 172.21.15.102:0/1733841896 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd96803a030 con 0x5613b2961880 2024-09-13T19:16:38.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.038+0000 7fd96eed2640 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5613b2965d90 con 0x7fd9600a0070 2024-09-13T19:16:38.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.038+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd95802a040 con 0x7fd9600a0070 2024-09-13T19:16:38.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.038+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5613b2965d90 con 0x7fd968013070 2024-09-13T19:16:38.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.038+0000 7fd96e6d1640 1 -- 172.21.15.102:0/1733841896 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9600af040 con 0x7fd968013070 2024-09-13T19:16:38.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.038+0000 7fd96e6d1640 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5613b2965d90 con 0x5613b2961880 2024-09-13T19:16:38.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.039+0000 7fd96eed2640 1 -- 172.21.15.102:0/1733841896 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd96803a030 con 0x5613b2961880 2024-09-13T19:16:38.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.039+0000 7fd96eed2640 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5613b2965d90 con 0x7fd9600a0070 2024-09-13T19:16:38.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.039+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd95802a040 con 0x7fd9600a0070 2024-09-13T19:16:38.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.039+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5613b2965d90 con 0x5613b295cf70 2024-09-13T19:16:38.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.039+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd95802a040 con 0x5613b295cf70 2024-09-13T19:16:38.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.039+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5613b2965d90 con 0x7fd968013070 2024-09-13T19:16:38.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.039+0000 7fd96e6d1640 1 -- 172.21.15.102:0/1733841896 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9600af040 con 0x7fd968013070 2024-09-13T19:16:38.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.039+0000 7fd972940800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:38.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.039+0000 7fd972940800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:38.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.039+0000 7fd972940800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:38.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.039+0000 7fd972940800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:38.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.039+0000 7fd972940800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:38.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.039+0000 7fd972940800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:38.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.039+0000 7fd972940800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.039+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5613b2964e00 con 0x5613b295cf70 2024-09-13T19:16:38.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.040+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd95802a040 con 0x5613b295cf70 2024-09-13T19:16:38.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.040+0000 7fd972940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:38.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.040+0000 7fd972940800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.040+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5613b29656a0 con 0x5613b295cf70 2024-09-13T19:16:38.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.040+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd95802a040 con 0x5613b295cf70 2024-09-13T19:16:38.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.040+0000 7fd972940800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:38.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.040+0000 7fd972940800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.040+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5613b2966210 con 0x5613b2961880 2024-09-13T19:16:38.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.040+0000 7fd96eed2640 1 -- 172.21.15.102:0/1733841896 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd96803a030 con 0x5613b2961880 2024-09-13T19:16:38.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.040+0000 7fd972940800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:38.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.040+0000 7fd972940800 20 zone default found 2024-09-13T19:16:38.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.040+0000 7fd972940800 4 Realm: () 2024-09-13T19:16:38.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.040+0000 7fd972940800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:38.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.040+0000 7fd972940800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:38.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.040+0000 7fd972940800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:38.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.040+0000 7fd972940800 20 zonegroup default 2024-09-13T19:16:38.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.040+0000 7fd972940800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.040+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5613b2966a60 con 0x7fd968013070 2024-09-13T19:16:38.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.040+0000 7fd96e6d1640 1 -- 172.21.15.102:0/1733841896 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd9600af040 con 0x7fd968013070 2024-09-13T19:16:38.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.040+0000 7fd972940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:38.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.040+0000 7fd972940800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.040+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5613b29687e0 con 0x5613b2961880 2024-09-13T19:16:38.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.041+0000 7fd96eed2640 1 -- 172.21.15.102:0/1733841896 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd96803a030 con 0x5613b2961880 2024-09-13T19:16:38.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.041+0000 7fd972940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:38.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.041+0000 7fd972940800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.041+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5613b2968c10 con 0x5613b2961880 2024-09-13T19:16:38.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.041+0000 7fd96eed2640 1 -- 172.21.15.102:0/1733841896 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd96803a030 con 0x5613b2961880 2024-09-13T19:16:38.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.041+0000 7fd972940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:38.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.041+0000 7fd972940800 20 started sync module instance, tier type = 2024-09-13T19:16:38.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.041+0000 7fd972940800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:38.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.041+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5613b2967c80 con 0x7fd968013070 2024-09-13T19:16:38.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.042+0000 7fd96e6d1640 1 -- 172.21.15.102:0/1733841896 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(44 notify.0 [create] v36'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9600af040 con 0x7fd968013070 2024-09-13T19:16:38.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.042+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94642600575088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5613b2969550 con 0x7fd968013070 2024-09-13T19:16:38.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.042+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5613b2969da0 con 0x5613b295cf70 2024-09-13T19:16:38.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.043+0000 7fd96e6d1640 1 -- 172.21.15.102:0/1733841896 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94642600575088] v36'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9600af040 con 0x7fd968013070 2024-09-13T19:16:38.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.043+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v36'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd95802a040 con 0x5613b295cf70 2024-09-13T19:16:38.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.043+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94642600581360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5613b296a180 con 0x5613b295cf70 2024-09-13T19:16:38.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.043+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5613b296ac70 con 0x5613b2961880 2024-09-13T19:16:38.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.044+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94642600581360] v36'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd95802a040 con 0x5613b295cf70 2024-09-13T19:16:38.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.044+0000 7fd96eed2640 1 -- 172.21.15.102:0/1733841896 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v36'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd96803a030 con 0x5613b2961880 2024-09-13T19:16:38.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.044+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94642600585024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5613b296ac30 con 0x5613b2961880 2024-09-13T19:16:38.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.044+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5613b296b700 con 0x7fd968013070 2024-09-13T19:16:38.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.045+0000 7fd96eed2640 1 -- 172.21.15.102:0/1733841896 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94642600585024] v36'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd96803a030 con 0x5613b2961880 2024-09-13T19:16:38.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.046+0000 7fd96e6d1640 1 -- 172.21.15.102:0/1733841896 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(50 notify.3 [create] v36'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9600af040 con 0x7fd968013070 2024-09-13T19:16:38.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.046+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94642600587728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5613b296b6c0 con 0x7fd968013070 2024-09-13T19:16:38.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.046+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5613b296c190 con 0x5613b295cf70 2024-09-13T19:16:38.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.047+0000 7fd96e6d1640 1 -- 172.21.15.102:0/1733841896 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94642600587728] v36'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9600af040 con 0x7fd968013070 2024-09-13T19:16:38.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.047+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v36'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd95802a040 con 0x5613b295cf70 2024-09-13T19:16:38.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.047+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94642600590432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5613b296c150 con 0x5613b295cf70 2024-09-13T19:16:38.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.047+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5613b296cbf0 con 0x7fd9600a0070 2024-09-13T19:16:38.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.048+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94642600590432] v36'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd95802a040 con 0x5613b295cf70 2024-09-13T19:16:38.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.048+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(54 notify.5 [create] v36'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd95802a040 con 0x7fd9600a0070 2024-09-13T19:16:38.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.048+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94642600579232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5613b296cbf0 con 0x7fd9600a0070 2024-09-13T19:16:38.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.048+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5613b296d660 con 0x7fd9600a0070 2024-09-13T19:16:38.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.049+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94642600579232] v36'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd95802a040 con 0x7fd9600a0070 2024-09-13T19:16:38.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.049+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(56 notify.6 [create] v36'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd95802a040 con 0x7fd9600a0070 2024-09-13T19:16:38.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.049+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94642600595792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5613b296d620 con 0x7fd9600a0070 2024-09-13T19:16:38.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.049+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5613b296e060 con 0x7fd9600a0070 2024-09-13T19:16:38.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.050+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94642600595792] v36'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd95802a040 con 0x7fd9600a0070 2024-09-13T19:16:38.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.050+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(58 notify.7 [create] v36'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd95802a040 con 0x7fd9600a0070 2024-09-13T19:16:38.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.050+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94642600598320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5613b296e020 con 0x7fd9600a0070 2024-09-13T19:16:38.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.050+0000 7fd972940800 20 add_watcher() i=0 2024-09-13T19:16:38.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.050+0000 7fd972940800 20 add_watcher() i=1 2024-09-13T19:16:38.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.050+0000 7fd972940800 20 add_watcher() i=2 2024-09-13T19:16:38.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.050+0000 7fd972940800 20 add_watcher() i=3 2024-09-13T19:16:38.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.050+0000 7fd972940800 20 add_watcher() i=4 2024-09-13T19:16:38.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.050+0000 7fd972940800 20 add_watcher() i=5 2024-09-13T19:16:38.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.050+0000 7fd972940800 20 add_watcher() i=6 2024-09-13T19:16:38.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.051+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94642600598320] v36'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd95802a040 con 0x7fd9600a0070 2024-09-13T19:16:38.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.051+0000 7fd972940800 20 add_watcher() i=7 2024-09-13T19:16:38.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.051+0000 7fd972940800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:38.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.051+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5613b2971480 con 0x5613b295cf70 2024-09-13T19:16:38.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.051+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd95802a040 con 0x5613b295cf70 2024-09-13T19:16:38.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.051+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94642600593136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5613b296e9d0 con 0x5613b295cf70 2024-09-13T19:16:38.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.052+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94642600593136] v36'180 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd95802a040 con 0x5613b295cf70 2024-09-13T19:16:38.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.052+0000 7fd824fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:38.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.052+0000 7fd972940800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:38.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.052+0000 7fd972940800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:38.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.052+0000 7fd972940800 5 note: GC not initialized 2024-09-13T19:16:38.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.053+0000 7fd79f7fe640 20 reqs_thread_entry: start 2024-09-13T19:16:38.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.053+0000 7fd972940800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:38.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.053+0000 7fd972940800 20 Filter name: none 2024-09-13T19:16:38.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.053+0000 7fd79d7fa640 20 reqs_thread_entry: start 2024-09-13T19:16:38.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.053+0000 7fd972940800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T19:16:38.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.053+0000 7fd972940800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.053+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5613b29a4d30 con 0x7fd968013070 2024-09-13T19:16:38.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.053+0000 7fd96e6d1640 1 -- 172.21.15.102:0/1733841896 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv41 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fd9600af040 con 0x7fd968013070 2024-09-13T19:16:38.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.053+0000 7fd972940800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:16:38.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.053+0000 7fd972940800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T19:16:38.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.053+0000 7fd972940800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:16:38.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.053+0000 7fd972940800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.5 : miss 2024-09-13T19:16:38.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.053+0000 7fd972940800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.053+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:63 8.4 8:240cf6e4:root::.bucket.meta.myfoo%3a509740b4-c081-4f37-bd6d-df9ca851489b.4237.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5613b29a6910 con 0x7fd968013070 2024-09-13T19:16:38.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.054+0000 7fd96e6d1640 1 -- 172.21.15.102:0/1733841896 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(63 .bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fd9600af040 con 0x7fd968013070 2024-09-13T19:16:38.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.054+0000 7fd972940800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:16:38.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.054+0000 7fd972940800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.5 info.flags=0x17 2024-09-13T19:16:38.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.054+0000 7fd972940800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.5 to cache LRU end 2024-09-13T19:16:38.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.054+0000 7fd972940800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:16:38.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.054+0000 7fd972940800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:16:38.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.054+0000 7fd972940800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.5 2024-09-13T19:16:38.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.054+0000 7fd972940800 20 get_obj_state: octx=0x7fd96006e7e0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x5613b29a8fd8 s->prefetch_data=0 2024-09-13T19:16:38.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.054+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:64 3.0s0 3:00f550d3:::509740b4-c081-4f37-bd6d-df9ca851489b.4237.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5613b29a9fa0 con 0x7fd9600a0070 2024-09-13T19:16:38.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.054+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(64 509740b4-c081-4f37-bd6d-df9ca851489b.4237.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=910b,stat out=16b] v0'0 uv5 ondisk = 0) ==== 262+0+926 (crc 0 0 0) 0x7fd95802a040 con 0x7fd9600a0070 2024-09-13T19:16:38.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.054+0000 7fd972940800 10 manifest: total_size = 5 2024-09-13T19:16:38.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.054+0000 7fd972940800 20 get_obj_state: setting s->obj_tag to _9umJ68M27V-mDgpXqsJE7PUQhzrdwDg 2024-09-13T19:16:38.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.055+0000 7fd824fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:38.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.055+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94642600593136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5613b29a2620 con 0x5613b295cf70 2024-09-13T19:16:38.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.056+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94642600593136] v36'181 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd95802a040 con 0x5613b295cf70 2024-09-13T19:16:38.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.056+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94642600575088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5613b29a9fa0 con 0x7fd968013070 2024-09-13T19:16:38.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.057+0000 7fd96e6d1640 1 -- 172.21.15.102:0/1733841896 <== osd.2 v2:172.21.15.102:6816/2238176080 16 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94642600575088] v36'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9600af040 con 0x7fd968013070 2024-09-13T19:16:38.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.057+0000 7fd972940800 20 remove_watcher() i=0 2024-09-13T19:16:38.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.057+0000 7fd972940800 2 removed watcher, disabling cache 2024-09-13T19:16:38.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.057+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94642600581360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5613b29a9fa0 con 0x5613b295cf70 2024-09-13T19:16:38.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.058+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94642600581360] v36'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd95802a040 con 0x5613b295cf70 2024-09-13T19:16:38.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.058+0000 7fd972940800 20 remove_watcher() i=1 2024-09-13T19:16:38.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.058+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94642600585024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5613b29a9fa0 con 0x5613b2961880 2024-09-13T19:16:38.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.059+0000 7fd96eed2640 1 -- 172.21.15.102:0/1733841896 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94642600585024] v36'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd96803a030 con 0x5613b2961880 2024-09-13T19:16:38.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.059+0000 7fd972940800 20 remove_watcher() i=2 2024-09-13T19:16:38.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.059+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94642600587728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5613b29a9fa0 con 0x7fd968013070 2024-09-13T19:16:38.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.060+0000 7fd96e6d1640 1 -- 172.21.15.102:0/1733841896 <== osd.2 v2:172.21.15.102:6816/2238176080 17 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94642600587728] v36'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9600af040 con 0x7fd968013070 2024-09-13T19:16:38.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.060+0000 7fd972940800 20 remove_watcher() i=3 2024-09-13T19:16:38.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.060+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94642600590432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5613b29a9fa0 con 0x5613b295cf70 2024-09-13T19:16:38.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.061+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94642600590432] v36'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd95802a040 con 0x5613b295cf70 2024-09-13T19:16:38.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.061+0000 7fd972940800 20 remove_watcher() i=4 2024-09-13T19:16:38.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.061+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94642600579232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5613b29a9fa0 con 0x7fd9600a0070 2024-09-13T19:16:38.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.062+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94642600579232] v36'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd95802a040 con 0x7fd9600a0070 2024-09-13T19:16:38.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.062+0000 7fd972940800 20 remove_watcher() i=5 2024-09-13T19:16:38.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.062+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94642600595792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5613b29a9fa0 con 0x7fd9600a0070 2024-09-13T19:16:38.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.063+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94642600595792] v36'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd95802a040 con 0x7fd9600a0070 2024-09-13T19:16:38.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.063+0000 7fd972940800 20 remove_watcher() i=6 2024-09-13T19:16:38.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.063+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94642600598320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5613b29a9fa0 con 0x7fd9600a0070 2024-09-13T19:16:38.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.064+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94642600598320] v36'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd95802a040 con 0x7fd9600a0070 2024-09-13T19:16:38.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.064+0000 7fd972940800 20 remove_watcher() i=7 2024-09-13T19:16:38.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.064+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fd9600a0070 msgr2=0x7fd96004f360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.064+0000 7fd972940800 1 --2- 172.21.15.102:0/1733841896 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fd9600a0070 0x7fd96004f360 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.064+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5613b295cf70 msgr2=0x5613b295f430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.064+0000 7fd972940800 1 --2- 172.21.15.102:0/1733841896 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5613b295cf70 0x5613b295f430 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.064+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fd968013070 msgr2=0x7fd968015420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.064+0000 7fd972940800 1 --2- 172.21.15.102:0/1733841896 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fd968013070 0x7fd968015420 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.064+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5613b2961880 msgr2=0x5613b2963cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.064+0000 7fd972940800 1 --2- 172.21.15.102:0/1733841896 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5613b2961880 0x5613b2963cb0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.065+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd838036b40 msgr2=0x7fd838039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.065+0000 7fd972940800 1 --2- 172.21.15.102:0/1733841896 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd838036b40 0x7fd838039000 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x5613b2926b90 tx=0x7fd96008c000 comp rx=0 tx=0).stop 2024-09-13T19:16:38.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.065+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613b2949e50 msgr2=0x5613b2951280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.065+0000 7fd972940800 1 --2- 172.21.15.102:0/1733841896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613b2949e50 0x5613b2951280 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fd968014fd0 tx=0x7fd96804cd80 comp rx=0 tx=0).stop 2024-09-13T19:16:38.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.065+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 reap_dead start 2024-09-13T19:16:38.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.065+0000 7fd965ed0640 1 -- 172.21.15.102:0/1733841896 reap_dead start 2024-09-13T19:16:38.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.065+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 shutdown_connections 2024-09-13T19:16:38.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.065+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 >> 172.21.15.102:0/1733841896 conn(0x5613b29461b0 msgr2=0x5613b2944280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:38.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.065+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 shutdown_connections 2024-09-13T19:16:38.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.065+0000 7fd972940800 1 -- 172.21.15.102:0/1733841896 wait complete. 2024-09-13T19:16:38.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.065+0000 7fd972940800 1 -- 172.21.15.102:0/1709016574 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd848036b40 msgr2=0x7fd848039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.065+0000 7fd972940800 1 --2- 172.21.15.102:0/1709016574 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd848036b40 0x7fd848039000 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x5613b2926aa0 tx=0x7fd96008f550 comp rx=0 tx=0).stop 2024-09-13T19:16:38.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.065+0000 7fd972940800 1 -- 172.21.15.102:0/1709016574 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613b293d160 msgr2=0x5613b293d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.065+0000 7fd972940800 1 --2- 172.21.15.102:0/1709016574 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613b293d160 0x5613b293d580 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x5613b2929df0 tx=0x7fd9680163e0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.065+0000 7fd972940800 1 -- 172.21.15.102:0/1709016574 shutdown_connections 2024-09-13T19:16:38.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.065+0000 7fd972940800 1 --2- 172.21.15.102:0/1709016574 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd848036b40 0x7fd848039000 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.065+0000 7fd972940800 1 --2- 172.21.15.102:0/1709016574 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613b293d160 0x5613b293d580 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.065+0000 7fd972940800 1 -- 172.21.15.102:0/1709016574 >> 172.21.15.102:0/1709016574 conn(0x5613b29320f0 msgr2=0x5613b2934c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:38.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.065+0000 7fd972940800 1 -- 172.21.15.102:0/1709016574 shutdown_connections 2024-09-13T19:16:38.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.065+0000 7fd972940800 1 -- 172.21.15.102:0/1709016574 wait complete. 2024-09-13T19:16:38.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.065+0000 7fd972940800 1 -- 172.21.15.102:0/254175103 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5613b279f5d0 msgr2=0x5613b2929490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.065+0000 7fd972940800 1 --2- 172.21.15.102:0/254175103 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5613b279f5d0 0x5613b2929490 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.065+0000 7fd972940800 1 -- 172.21.15.102:0/254175103 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5613b292bc20 msgr2=0x5613b292e0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.065+0000 7fd972940800 1 --2- 172.21.15.102:0/254175103 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5613b292bc20 0x5613b292e0b0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.065+0000 7fd972940800 1 -- 172.21.15.102:0/254175103 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd854036b90 msgr2=0x7fd854039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.065+0000 7fd972940800 1 --2- 172.21.15.102:0/254175103 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd854036b90 0x7fd854039050 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd958001e10 tx=0x7fd958001390 comp rx=0 tx=0).stop 2024-09-13T19:16:38.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.065+0000 7fd972940800 1 -- 172.21.15.102:0/254175103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613b279e2f0 msgr2=0x5613b2922420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.065+0000 7fd972940800 1 --2- 172.21.15.102:0/254175103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613b279e2f0 0x5613b2922420 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fd960067040 tx=0x7fd960002fb0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.066+0000 7fd972940800 1 -- 172.21.15.102:0/254175103 shutdown_connections 2024-09-13T19:16:38.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.066+0000 7fd972940800 1 --2- 172.21.15.102:0/254175103 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5613b292bc20 0x5613b292e0b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.066+0000 7fd972940800 1 --2- 172.21.15.102:0/254175103 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5613b279f5d0 0x5613b2929490 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.066+0000 7fd972940800 1 --2- 172.21.15.102:0/254175103 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd854036b90 0x7fd854039050 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.066+0000 7fd972940800 1 --2- 172.21.15.102:0/254175103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5613b279e2f0 0x5613b2922420 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.066+0000 7fd972940800 1 -- 172.21.15.102:0/254175103 >> 172.21.15.102:0/254175103 conn(0x5613b2824fe0 msgr2=0x5613b2914d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:38.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.066+0000 7fd972940800 1 -- 172.21.15.102:0/254175103 shutdown_connections 2024-09-13T19:16:38.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.066+0000 7fd972940800 1 -- 172.21.15.102:0/254175103 wait complete. 2024-09-13T19:16:38.089 INFO:teuthology.orchestra.run.smithi102.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-13T19:16:38.089 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-13T19:16:38.092 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2024-09-13T19:16:38.108 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:16:38.205 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-13T19:16:38.205 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-13T19:16:38.206 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-13T19:16:38.206 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-13T19:16:38.206 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-13T19:16:38.206 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-13T19:16:38.206 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2024-09-13T19:16:38.252 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:38.252 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:38.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.250+0000 7f20c1a0e800 1 Processor -- start 2024-09-13T19:16:38.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.250+0000 7f20c1a0e800 1 -- start start 2024-09-13T19:16:38.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.250+0000 7f20c1a0e800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56403bb4c650 0x56403bbdb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.250+0000 7f20c1a0e800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56403ba97b30 con 0x56403bbdb720 2024-09-13T19:16:38.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.250+0000 7f20c1a0e800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x56403ba79360 con 0x56403bb4c650 2024-09-13T19:16:38.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.250+0000 7f20bd0f7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56403bb4c650 0x56403bbdb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.250+0000 7f20bc8f6640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x56403bbdb720 0x56403bbddb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:48528/0 (socket says 172.21.15.102:48528) 2024-09-13T19:16:38.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.250+0000 7f20bd0f7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56403bb4c650 0x56403bbdb1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55478/0 (socket says 172.21.15.102:55478) 2024-09-13T19:16:38.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.250+0000 7f20bc8f6640 1 -- 172.21.15.102:0/564414434 learned_addr learned my addr 172.21.15.102:0/564414434 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:16:38.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.251+0000 7f20bd0f7640 1 -- 172.21.15.102:0/564414434 >> v1:172.21.15.53:6789/0 conn(0x56403bbdb720 legacy=0x56403bbddb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.251+0000 7f20bd0f7640 1 -- 172.21.15.102:0/564414434 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56403ba9fe00 con 0x56403bb4c650 2024-09-13T19:16:38.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.252+0000 7f20bd0f7640 1 --2- 172.21.15.102:0/564414434 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56403bb4c650 0x56403bbdb1e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f20b000a470 tx=0x7f20b0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83148e6d68d54481 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.252+0000 7f20affff640 1 -- 172.21.15.102:0/564414434 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20b0053570 con 0x56403bb4c650 2024-09-13T19:16:38.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.252+0000 7f20affff640 1 -- 172.21.15.102:0/564414434 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20b0058070 con 0x56403bb4c650 2024-09-13T19:16:38.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.252+0000 7f20affff640 1 -- 172.21.15.102:0/564414434 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20b0053880 con 0x56403bb4c650 2024-09-13T19:16:38.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.253+0000 7f20c1a0e800 1 -- 172.21.15.102:0/564414434 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56403bb4c650 msgr2=0x56403bbdb1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.253+0000 7f20c1a0e800 1 --2- 172.21.15.102:0/564414434 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56403bb4c650 0x56403bbdb1e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f20b000a470 tx=0x7f20b0045a20 comp rx=0 tx=0).stop 2024-09-13T19:16:38.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.253+0000 7f20c1a0e800 1 -- 172.21.15.102:0/564414434 shutdown_connections 2024-09-13T19:16:38.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.253+0000 7f20c1a0e800 1 --2- 172.21.15.102:0/564414434 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56403bb4c650 0x56403bbdb1e0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.253+0000 7f20c1a0e800 1 -- 172.21.15.102:0/564414434 >> 172.21.15.102:0/564414434 conn(0x56403bbd2db0 msgr2=0x56403bbd51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:38.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.253+0000 7f20c1a0e800 1 -- 172.21.15.102:0/564414434 shutdown_connections 2024-09-13T19:16:38.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.253+0000 7f20c1a0e800 1 -- 172.21.15.102:0/564414434 wait complete. 2024-09-13T19:16:38.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.267+0000 7f20c1a0e800 1 Processor -- start 2024-09-13T19:16:38.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.267+0000 7f20c1a0e800 1 -- start start 2024-09-13T19:16:38.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.267+0000 7f20c1a0e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56403bb4c650 0x56403bbd8b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.267+0000 7f20c1a0e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56403bb24360 con 0x56403bb4c650 2024-09-13T19:16:38.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.267+0000 7f20bd0f7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56403bb4c650 0x56403bbd8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.267+0000 7f20bd0f7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56403bb4c650 0x56403bbd8b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55484/0 (socket says 172.21.15.102:55484) 2024-09-13T19:16:38.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.267+0000 7f20bd0f7640 1 -- 172.21.15.102:0/3169837706 learned_addr learned my addr 172.21.15.102:0/3169837706 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:38.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.268+0000 7f20bd0f7640 1 -- 172.21.15.102:0/3169837706 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56403ba71bc0 con 0x56403bb4c650 2024-09-13T19:16:38.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.268+0000 7f20bd0f7640 1 --2- 172.21.15.102:0/3169837706 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56403bb4c650 0x56403bbd8b10 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f20b0025c20 tx=0x7f20b0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d60624cf029ffcdc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.268+0000 7f1fab606640 1 -- 172.21.15.102:0/3169837706 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20b005c580 con 0x56403bb4c650 2024-09-13T19:16:38.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.268+0000 7f1fab606640 1 -- 172.21.15.102:0/3169837706 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20b0063030 con 0x56403bb4c650 2024-09-13T19:16:38.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.268+0000 7f1fab606640 1 -- 172.21.15.102:0/3169837706 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20b005c850 con 0x56403bb4c650 2024-09-13T19:16:38.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.269+0000 7f20c1a0e800 1 -- 172.21.15.102:0/3169837706 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56403bb4c650 msgr2=0x56403bbd8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.269+0000 7f20c1a0e800 1 --2- 172.21.15.102:0/3169837706 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56403bb4c650 0x56403bbd8b10 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f20b0025c20 tx=0x7f20b0051000 comp rx=0 tx=0).stop 2024-09-13T19:16:38.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.269+0000 7f20c1a0e800 1 -- 172.21.15.102:0/3169837706 shutdown_connections 2024-09-13T19:16:38.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.269+0000 7f20c1a0e800 1 --2- 172.21.15.102:0/3169837706 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56403bb4c650 0x56403bbd8b10 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.269+0000 7f20c1a0e800 1 -- 172.21.15.102:0/3169837706 >> 172.21.15.102:0/3169837706 conn(0x56403bbd2db0 msgr2=0x56403bcc3240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:38.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.269+0000 7f20c1a0e800 1 -- 172.21.15.102:0/3169837706 shutdown_connections 2024-09-13T19:16:38.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.269+0000 7f20c1a0e800 1 -- 172.21.15.102:0/3169837706 wait complete. 2024-09-13T19:16:38.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.269+0000 7f20c1a0e800 1 Processor -- start 2024-09-13T19:16:38.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.269+0000 7f20c1a0e800 1 -- start start 2024-09-13T19:16:38.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.269+0000 7f20c1a0e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56403bb4c650 0x56403bcd1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.269+0000 7f20c1a0e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56403bbdf620 con 0x56403bb4c650 2024-09-13T19:16:38.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.270+0000 7f20bd0f7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56403bb4c650 0x56403bcd1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.270+0000 7f20bd0f7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56403bb4c650 0x56403bcd1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55486/0 (socket says 172.21.15.102:55486) 2024-09-13T19:16:38.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.270+0000 7f20bd0f7640 1 -- 172.21.15.102:0/3306005797 learned_addr learned my addr 172.21.15.102:0/3306005797 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:38.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.270+0000 7f20bd0f7640 1 -- 172.21.15.102:0/3306005797 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56403ba85fe0 con 0x56403bb4c650 2024-09-13T19:16:38.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.270+0000 7f20bd0f7640 1 --2- 172.21.15.102:0/3306005797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56403bb4c650 0x56403bcd1400 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x56403bbd8210 tx=0x7f20b0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.270+0000 7f1fa9e03640 1 -- 172.21.15.102:0/3306005797 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20b0054ad0 con 0x56403bb4c650 2024-09-13T19:16:38.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.270+0000 7f1fa9e03640 1 -- 172.21.15.102:0/3306005797 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20b0054c70 con 0x56403bb4c650 2024-09-13T19:16:38.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.270+0000 7f20c1a0e800 1 -- 172.21.15.102:0/3306005797 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56403bcd1940 con 0x56403bb4c650 2024-09-13T19:16:38.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.270+0000 7f1fa9e03640 1 -- 172.21.15.102:0/3306005797 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20b0068420 con 0x56403bb4c650 2024-09-13T19:16:38.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.270+0000 7f20c1a0e800 1 -- 172.21.15.102:0/3306005797 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56403bcd1e60 con 0x56403bb4c650 2024-09-13T19:16:38.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.271+0000 7f1fa9e03640 1 -- 172.21.15.102:0/3306005797 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f20b00685c0 con 0x56403bb4c650 2024-09-13T19:16:38.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.271+0000 7f1fa9e03640 1 --2- 172.21.15.102:0/3306005797 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f1fa4036b40 0x7f1fa4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.271+0000 7f1fa9e03640 1 -- 172.21.15.102:0/3306005797 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f20b0070030 con 0x56403bb4c650 2024-09-13T19:16:38.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.271+0000 7f20bc8f6640 1 --2- 172.21.15.102:0/3306005797 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f1fa4036b40 0x7f1fa4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.271+0000 7f20c1a0e800 1 --2- 172.21.15.102:0/3306005797 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56403bbdb720 0x56403bcd8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.271+0000 7f20c1a0e800 1 -- 172.21.15.102:0/3306005797 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bcd8a00 con 0x56403bbdb720 2024-09-13T19:16:38.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.272+0000 7f20bd8f8640 1 --2- 172.21.15.102:0/3306005797 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56403bbdb720 0x56403bcd8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.272+0000 7f20bc8f6640 1 --2- 172.21.15.102:0/3306005797 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f1fa4036b40 0x7f1fa4039000 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f20b4000f60 tx=0x7f20b40012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.272+0000 7f20bd8f8640 1 --2- 172.21.15.102:0/3306005797 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56403bbdb720 0x56403bcd8470 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.272+0000 7f20bd8f8640 1 -- 172.21.15.102:0/3306005797 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20b800a4a0 con 0x56403bbdb720 2024-09-13T19:16:38.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.272+0000 7f20c1a0e800 1 -- 172.21.15.102:0/3306005797 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bcd5a40 con 0x56403bbdb720 2024-09-13T19:16:38.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.272+0000 7f20bd8f8640 1 -- 172.21.15.102:0/3306005797 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f20b800a4a0 con 0x56403bbdb720 2024-09-13T19:16:38.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.272+0000 7f20c1a0e800 1 --2- 172.21.15.102:0/3306005797 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56403bcdad80 0x56403bcdd170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.272+0000 7f20c1a0e800 1 -- 172.21.15.102:0/3306005797 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bcdd860 con 0x56403bcdad80 2024-09-13T19:16:38.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.273+0000 7f20bd0f7640 1 --2- 172.21.15.102:0/3306005797 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56403bcdad80 0x56403bcdd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.273+0000 7f20bd0f7640 1 --2- 172.21.15.102:0/3306005797 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56403bcdad80 0x56403bcdd170 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.273+0000 7f20bd0f7640 1 -- 172.21.15.102:0/3306005797 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f20b0051070 con 0x56403bcdad80 2024-09-13T19:16:38.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.273+0000 7f20c1a0e800 1 -- 172.21.15.102:0/3306005797 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bcd9c20 con 0x56403bbdb720 2024-09-13T19:16:38.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.273+0000 7f20bd8f8640 1 -- 172.21.15.102:0/3306005797 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f20b800a4a0 con 0x56403bbdb720 2024-09-13T19:16:38.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.273+0000 7f20c1a0e800 1 -- 172.21.15.102:0/3306005797 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bcda0c0 con 0x56403bcdad80 2024-09-13T19:16:38.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.274+0000 7f20bd0f7640 1 -- 172.21.15.102:0/3306005797 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f20b0051070 con 0x56403bcdad80 2024-09-13T19:16:38.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.274+0000 7f20c1a0e800 1 Processor -- start 2024-09-13T19:16:38.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.274+0000 7f20c1a0e800 1 -- start start 2024-09-13T19:16:38.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.274+0000 7f20c1a0e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56403bcec1a0 0x56403bcec5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.274+0000 7f20c1a0e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56403ba73580 con 0x56403bcec1a0 2024-09-13T19:16:38.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.275+0000 7f20bd8f8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56403bcec1a0 0x56403bcec5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.275+0000 7f20bd8f8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56403bcec1a0 0x56403bcec5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55492/0 (socket says 172.21.15.102:55492) 2024-09-13T19:16:38.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.275+0000 7f20bd8f8640 1 -- 172.21.15.102:0/186300184 learned_addr learned my addr 172.21.15.102:0/186300184 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:38.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.275+0000 7f20bd8f8640 1 -- 172.21.15.102:0/186300184 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56403bcecb00 con 0x56403bcec1a0 2024-09-13T19:16:38.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.275+0000 7f20bd8f8640 1 --2- 172.21.15.102:0/186300184 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56403bcec1a0 0x56403bcec5c0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x56403bcd2620 tx=0x7f20b80167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.275+0000 7f1fa2ffd640 1 -- 172.21.15.102:0/186300184 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20b8013640 con 0x56403bcec1a0 2024-09-13T19:16:38.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.275+0000 7f1fa2ffd640 1 -- 172.21.15.102:0/186300184 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20b80137e0 con 0x56403bcec1a0 2024-09-13T19:16:38.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.275+0000 7f1fa2ffd640 1 -- 172.21.15.102:0/186300184 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20b8013ae0 con 0x56403bcec1a0 2024-09-13T19:16:38.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.275+0000 7f20c1a0e800 1 -- 172.21.15.102:0/186300184 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56403bcecd90 con 0x56403bcec1a0 2024-09-13T19:16:38.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.275+0000 7f20c1a0e800 1 -- 172.21.15.102:0/186300184 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56403bcefa70 con 0x56403bcec1a0 2024-09-13T19:16:38.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.276+0000 7f1fa2ffd640 1 -- 172.21.15.102:0/186300184 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f20b8011040 con 0x56403bcec1a0 2024-09-13T19:16:38.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.276+0000 7f1fa2ffd640 1 --2- 172.21.15.102:0/186300184 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f1f94036b40 0x7f1f94039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.276+0000 7f1fa2ffd640 1 -- 172.21.15.102:0/186300184 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f20b800e040 con 0x56403bcec1a0 2024-09-13T19:16:38.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.276+0000 7f20bd0f7640 1 --2- 172.21.15.102:0/186300184 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f1f94036b40 0x7f1f94039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.276+0000 7f20c1a0e800 1 Processor -- start 2024-09-13T19:16:38.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.277+0000 7f20c1a0e800 1 -- start start 2024-09-13T19:16:38.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.277+0000 7f20bd0f7640 1 --2- 172.21.15.102:0/186300184 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f1f94036b40 0x7f1f94039000 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f20b0025c20 tx=0x7f20b0060ee0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.277+0000 7f20c1a0e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56403bcf8ed0 0x56403bcf92d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.277+0000 7f20c1a0e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56403bbd7180 con 0x56403bcf8ed0 2024-09-13T19:16:38.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.277+0000 7f20bd8f8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56403bcf8ed0 0x56403bcf92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.277+0000 7f20bd8f8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56403bcf8ed0 0x56403bcf92d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55496/0 (socket says 172.21.15.102:55496) 2024-09-13T19:16:38.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.277+0000 7f20bd8f8640 1 -- 172.21.15.102:0/2196192969 learned_addr learned my addr 172.21.15.102:0/2196192969 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:38.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.277+0000 7f20bd8f8640 1 -- 172.21.15.102:0/2196192969 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56403bcf98a0 con 0x56403bcf8ed0 2024-09-13T19:16:38.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.277+0000 7f20bd8f8640 1 --2- 172.21.15.102:0/2196192969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56403bcf8ed0 0x56403bcf92d0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f20b804cdf0 tx=0x7f20b801fee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15838999876faa97 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.277+0000 7f1fa0ff9640 1 -- 172.21.15.102:0/2196192969 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20b8014bf0 con 0x56403bcf8ed0 2024-09-13T19:16:38.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.277+0000 7f1fa0ff9640 1 -- 172.21.15.102:0/2196192969 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20b804a020 con 0x56403bcf8ed0 2024-09-13T19:16:38.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.277+0000 7f1fa0ff9640 1 -- 172.21.15.102:0/2196192969 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20b802aa60 con 0x56403bcf8ed0 2024-09-13T19:16:38.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.278+0000 7f20c1a0e800 1 -- 172.21.15.102:0/2196192969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56403bcf8ed0 msgr2=0x56403bcf92d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.278+0000 7f20c1a0e800 1 --2- 172.21.15.102:0/2196192969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56403bcf8ed0 0x56403bcf92d0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f20b804cdf0 tx=0x7f20b801fee0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.278+0000 7f20c1a0e800 1 -- 172.21.15.102:0/2196192969 shutdown_connections 2024-09-13T19:16:38.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.278+0000 7f20c1a0e800 1 --2- 172.21.15.102:0/2196192969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56403bcf8ed0 0x56403bcf92d0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.278+0000 7f20c1a0e800 1 -- 172.21.15.102:0/2196192969 >> 172.21.15.102:0/2196192969 conn(0x56403bcf51e0 msgr2=0x56403bcf3330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:38.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.278+0000 7f20c1a0e800 1 -- 172.21.15.102:0/2196192969 shutdown_connections 2024-09-13T19:16:38.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.278+0000 7f20c1a0e800 1 -- 172.21.15.102:0/2196192969 wait complete. 2024-09-13T19:16:38.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.278+0000 7f20c1a0e800 1 Processor -- start 2024-09-13T19:16:38.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.278+0000 7f20c1a0e800 1 -- start start 2024-09-13T19:16:38.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.278+0000 7f20c1a0e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56403bcf8ed0 0x56403bd00390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.278+0000 7f20c1a0e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56403bcf9e50 con 0x56403bcf8ed0 2024-09-13T19:16:38.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.278+0000 7f20bd8f8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56403bcf8ed0 0x56403bd00390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.278+0000 7f20bd8f8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56403bcf8ed0 0x56403bd00390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55512/0 (socket says 172.21.15.102:55512) 2024-09-13T19:16:38.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.278+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 learned_addr learned my addr 172.21.15.102:0/832490072 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:38.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.279+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56403bd008d0 con 0x56403bcf8ed0 2024-09-13T19:16:38.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.279+0000 7f20bd8f8640 1 --2- 172.21.15.102:0/832490072 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56403bcf8ed0 0x56403bd00390 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f20b8020000 tx=0x7f20b804cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.279+0000 7f1f92ffd640 1 -- 172.21.15.102:0/832490072 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20b8037070 con 0x56403bcf8ed0 2024-09-13T19:16:38.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.279+0000 7f1f92ffd640 1 -- 172.21.15.102:0/832490072 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20b801f470 con 0x56403bcf8ed0 2024-09-13T19:16:38.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.279+0000 7f1f92ffd640 1 -- 172.21.15.102:0/832490072 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20b802aa40 con 0x56403bcf8ed0 2024-09-13T19:16:38.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.279+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56403bd00b60 con 0x56403bcf8ed0 2024-09-13T19:16:38.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.279+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56403bd03810 con 0x56403bcf8ed0 2024-09-13T19:16:38.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.280+0000 7f1f92ffd640 1 -- 172.21.15.102:0/832490072 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f20b803a070 con 0x56403bcf8ed0 2024-09-13T19:16:38.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.280+0000 7f1f92ffd640 1 --2- 172.21.15.102:0/832490072 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f1f88036b40 0x7f1f88039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.280+0000 7f1f92ffd640 1 -- 172.21.15.102:0/832490072 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f20b804b030 con 0x56403bcf8ed0 2024-09-13T19:16:38.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.280+0000 7f20bd0f7640 1 --2- 172.21.15.102:0/832490072 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f1f88036b40 0x7f1f88039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.280+0000 7f20bd0f7640 1 --2- 172.21.15.102:0/832490072 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f1f88036b40 0x7f1f88039000 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f20b008f470 tx=0x7f20b0094000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.281+0000 7f20c1a0e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.281+0000 7f20c1a0e800 1 --2- 172.21.15.102:0/832490072 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56403bd0bda0 0x56403bd0e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.281+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bd0e9b0 con 0x56403bd0bda0 2024-09-13T19:16:38.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.281+0000 7f20bc8f6640 1 --2- 172.21.15.102:0/832490072 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56403bd0bda0 0x56403bd0e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.281+0000 7f20bc8f6640 1 --2- 172.21.15.102:0/832490072 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56403bd0bda0 0x56403bd0e260 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.281+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20b4009050 con 0x56403bd0bda0 2024-09-13T19:16:38.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.281+0000 7f20c1a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:38.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.281+0000 7f20c1a0e800 20 realm 2024-09-13T19:16:38.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.281+0000 7f20c1a0e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.281+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bd0b1f0 con 0x56403bd0bda0 2024-09-13T19:16:38.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.281+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20b4009050 con 0x56403bd0bda0 2024-09-13T19:16:38.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.281+0000 7f20c1a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:38.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.281+0000 7f20c1a0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:38.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.281+0000 7f20c1a0e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.281+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bd0f4a0 con 0x56403bd0bda0 2024-09-13T19:16:38.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.282+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20b4009050 con 0x56403bd0bda0 2024-09-13T19:16:38.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.282+0000 7f20c1a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:38.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.282+0000 7f20c1a0e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.282+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bd0fd70 con 0x56403bd0bda0 2024-09-13T19:16:38.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.282+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f20b4009050 con 0x56403bd0bda0 2024-09-13T19:16:38.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.282+0000 7f20c1a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:38.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.282+0000 7f20c1a0e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.282+0000 7f20c1a0e800 1 --2- 172.21.15.102:0/832490072 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56403bd106b0 0x56403bd12ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.282+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bd13250 con 0x56403bd106b0 2024-09-13T19:16:38.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.282+0000 7f20bd8f8640 1 --2- 172.21.15.102:0/832490072 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56403bd106b0 0x56403bd12ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.282+0000 7f20bd8f8640 1 --2- 172.21.15.102:0/832490072 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56403bd106b0 0x56403bd12ac0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.283+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f20b8039030 con 0x56403bd106b0 2024-09-13T19:16:38.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.283+0000 7f20c1a0e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:38.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.283+0000 7f20c1a0e800 20 searching for the correct realm 2024-09-13T19:16:38.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.283+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56403bd14ba0 con 0x56403bd106b0 2024-09-13T19:16:38.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.283+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b8039030 con 0x56403bd106b0 2024-09-13T19:16:38.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.283+0000 7f20bd8f8640 1 --2- 172.21.15.102:0/832490072 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f20b8044070 0x7f20b802b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.283+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56403bd14ba0 con 0x7f20b8044070 2024-09-13T19:16:38.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.283+0000 7f20bd0f7640 1 --2- 172.21.15.102:0/832490072 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f20b8044070 0x7f20b802b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.283+0000 7f20bd0f7640 1 --2- 172.21.15.102:0/832490072 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f20b8044070 0x7f20b802b060 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.283+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b009a040 con 0x7f20b8044070 2024-09-13T19:16:38.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.284+0000 7f20bd0f7640 1 --2- 172.21.15.102:0/832490072 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f20b005c070 0x7f20b00688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.284+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56403bd14ba0 con 0x7f20b005c070 2024-09-13T19:16:38.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.284+0000 7f20bc8f6640 1 --2- 172.21.15.102:0/832490072 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f20b005c070 0x7f20b00688b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.284+0000 7f20bc8f6640 1 --2- 172.21.15.102:0/832490072 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f20b005c070 0x7f20b00688b0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.284+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b4009050 con 0x7f20b005c070 2024-09-13T19:16:38.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.284+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56403bd14ba0 con 0x56403bd0bda0 2024-09-13T19:16:38.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.284+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b4009050 con 0x56403bd0bda0 2024-09-13T19:16:38.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.285+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56403bd14ba0 con 0x56403bd0bda0 2024-09-13T19:16:38.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.285+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b4029040 con 0x56403bd0bda0 2024-09-13T19:16:38.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.285+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56403bd14ba0 con 0x7f20b005c070 2024-09-13T19:16:38.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.285+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b4029040 con 0x7f20b005c070 2024-09-13T19:16:38.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.285+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56403bd14ba0 con 0x7f20b005c070 2024-09-13T19:16:38.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.285+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b4029040 con 0x7f20b005c070 2024-09-13T19:16:38.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.285+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56403bd14ba0 con 0x7f20b8044070 2024-09-13T19:16:38.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.285+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b009a040 con 0x7f20b8044070 2024-09-13T19:16:38.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.285+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56403bd14ba0 con 0x56403bd106b0 2024-09-13T19:16:38.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.286+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b8039030 con 0x56403bd106b0 2024-09-13T19:16:38.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.286+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56403bd14ba0 con 0x56403bd0bda0 2024-09-13T19:16:38.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.286+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b4029040 con 0x56403bd0bda0 2024-09-13T19:16:38.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.286+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56403bd14ba0 con 0x7f20b8044070 2024-09-13T19:16:38.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.286+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b009a040 con 0x7f20b8044070 2024-09-13T19:16:38.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.286+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56403bd14ba0 con 0x56403bd0bda0 2024-09-13T19:16:38.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.286+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b4029040 con 0x56403bd0bda0 2024-09-13T19:16:38.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.286+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56403bd14ba0 con 0x7f20b8044070 2024-09-13T19:16:38.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.287+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f20b009a040 con 0x7f20b8044070 2024-09-13T19:16:38.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.287+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56403bd14ba0 con 0x56403bd106b0 2024-09-13T19:16:38.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.287+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b8039030 con 0x56403bd106b0 2024-09-13T19:16:38.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.287+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56403bd14ba0 con 0x56403bd106b0 2024-09-13T19:16:38.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.287+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f20b8039030 con 0x56403bd106b0 2024-09-13T19:16:38.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.287+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56403bd14ba0 con 0x7f20b005c070 2024-09-13T19:16:38.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.287+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b4029040 con 0x7f20b005c070 2024-09-13T19:16:38.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.287+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56403bd14ba0 con 0x56403bd106b0 2024-09-13T19:16:38.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.288+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f20b8039030 con 0x56403bd106b0 2024-09-13T19:16:38.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.288+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56403bd14ba0 con 0x56403bd106b0 2024-09-13T19:16:38.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.288+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b8039030 con 0x56403bd106b0 2024-09-13T19:16:38.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.288+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56403bd14ba0 con 0x56403bd0bda0 2024-09-13T19:16:38.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.288+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b4029040 con 0x56403bd0bda0 2024-09-13T19:16:38.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.288+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56403bd14ba0 con 0x56403bd0bda0 2024-09-13T19:16:38.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.288+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f20b4029040 con 0x56403bd0bda0 2024-09-13T19:16:38.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.288+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56403bd14ba0 con 0x7f20b005c070 2024-09-13T19:16:38.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.289+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b4029040 con 0x7f20b005c070 2024-09-13T19:16:38.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.289+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56403bd14ba0 con 0x56403bd106b0 2024-09-13T19:16:38.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.289+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b8068040 con 0x56403bd106b0 2024-09-13T19:16:38.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.289+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56403bd14ba0 con 0x7f20b8044070 2024-09-13T19:16:38.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.289+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b009a040 con 0x7f20b8044070 2024-09-13T19:16:38.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.289+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56403bd14ba0 con 0x56403bd0bda0 2024-09-13T19:16:38.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.289+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b4029040 con 0x56403bd0bda0 2024-09-13T19:16:38.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.289+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56403bd14ba0 con 0x7f20b8044070 2024-09-13T19:16:38.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.290+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b009a040 con 0x7f20b8044070 2024-09-13T19:16:38.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.290+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56403bd14ba0 con 0x56403bd106b0 2024-09-13T19:16:38.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.290+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b8068040 con 0x56403bd106b0 2024-09-13T19:16:38.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.290+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56403bd14ba0 con 0x7f20b005c070 2024-09-13T19:16:38.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.290+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b4029040 con 0x7f20b005c070 2024-09-13T19:16:38.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.290+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56403bd14ba0 con 0x7f20b8044070 2024-09-13T19:16:38.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.290+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b009a040 con 0x7f20b8044070 2024-09-13T19:16:38.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.290+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56403bd14ba0 con 0x56403bd106b0 2024-09-13T19:16:38.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.291+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b8068040 con 0x56403bd106b0 2024-09-13T19:16:38.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.291+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56403bd14ba0 con 0x7f20b005c070 2024-09-13T19:16:38.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.291+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b4029040 con 0x7f20b005c070 2024-09-13T19:16:38.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.291+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56403bd14ba0 con 0x56403bd0bda0 2024-09-13T19:16:38.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.291+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f20b4029040 con 0x56403bd0bda0 2024-09-13T19:16:38.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.291+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56403bd14ba0 con 0x7f20b8044070 2024-09-13T19:16:38.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.291+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b009a040 con 0x7f20b8044070 2024-09-13T19:16:38.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.291+0000 7f20c1a0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:38.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.291+0000 7f20c1a0e800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:38.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.291+0000 7f20c1a0e800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:38.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.291+0000 7f20c1a0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:38.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.291+0000 7f20c1a0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:38.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.291+0000 7f20c1a0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:38.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.291+0000 7f20c1a0e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.291+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bd13c10 con 0x56403bd0bda0 2024-09-13T19:16:38.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.292+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20b4029040 con 0x56403bd0bda0 2024-09-13T19:16:38.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.292+0000 7f20c1a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:38.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.292+0000 7f20c1a0e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.292+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bd144b0 con 0x56403bd0bda0 2024-09-13T19:16:38.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.292+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f20b4029040 con 0x56403bd0bda0 2024-09-13T19:16:38.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.292+0000 7f20c1a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:38.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.292+0000 7f20c1a0e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.292+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bd15020 con 0x56403bd106b0 2024-09-13T19:16:38.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.292+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f20b8068040 con 0x56403bd106b0 2024-09-13T19:16:38.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.292+0000 7f20c1a0e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:38.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.292+0000 7f20c1a0e800 20 zone default found 2024-09-13T19:16:38.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.292+0000 7f20c1a0e800 4 Realm: () 2024-09-13T19:16:38.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.292+0000 7f20c1a0e800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:38.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.292+0000 7f20c1a0e800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:38.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.292+0000 7f20c1a0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:38.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.292+0000 7f20c1a0e800 20 zonegroup default 2024-09-13T19:16:38.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.292+0000 7f20c1a0e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.292+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bd15870 con 0x7f20b8044070 2024-09-13T19:16:38.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.293+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f20b009a040 con 0x7f20b8044070 2024-09-13T19:16:38.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.293+0000 7f20c1a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:38.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.293+0000 7f20c1a0e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.293+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bd175f0 con 0x56403bd106b0 2024-09-13T19:16:38.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.293+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f20b8068040 con 0x56403bd106b0 2024-09-13T19:16:38.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.293+0000 7f20c1a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:38.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.293+0000 7f20c1a0e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.293+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bd17a20 con 0x56403bd106b0 2024-09-13T19:16:38.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.293+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f20b8068040 con 0x56403bd106b0 2024-09-13T19:16:38.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.293+0000 7f20c1a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:38.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.293+0000 7f20c1a0e800 20 started sync module instance, tier type = 2024-09-13T19:16:38.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.293+0000 7f20c1a0e800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:38.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.293+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd16a90 con 0x7f20b8044070 2024-09-13T19:16:38.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.294+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(44 notify.0 [create] v36'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b009a040 con 0x7f20b8044070 2024-09-13T19:16:38.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.294+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94833881474528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd17e50 con 0x7f20b8044070 2024-09-13T19:16:38.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.294+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd186a0 con 0x56403bd0bda0 2024-09-13T19:16:38.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.295+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94833881474528] v36'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b009a040 con 0x7f20b8044070 2024-09-13T19:16:38.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.296+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v36'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b4029040 con 0x56403bd0bda0 2024-09-13T19:16:38.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.296+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94833881480784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd18270 con 0x56403bd0bda0 2024-09-13T19:16:38.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.296+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd193e0 con 0x56403bd106b0 2024-09-13T19:16:38.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.297+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94833881480784] v36'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b4029040 con 0x56403bd0bda0 2024-09-13T19:16:38.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.297+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v36'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b8068040 con 0x56403bd106b0 2024-09-13T19:16:38.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.297+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94833881483840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd19310 con 0x56403bd106b0 2024-09-13T19:16:38.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.297+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd19e30 con 0x7f20b8044070 2024-09-13T19:16:38.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.298+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94833881483840] v36'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b8068040 con 0x56403bd106b0 2024-09-13T19:16:38.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.298+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(50 notify.3 [create] v36'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b009a040 con 0x7f20b8044070 2024-09-13T19:16:38.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.298+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94833881487680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd19310 con 0x7f20b8044070 2024-09-13T19:16:38.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.298+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd1a8c0 con 0x56403bd0bda0 2024-09-13T19:16:38.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.299+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v36'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b4029040 con 0x56403bd0bda0 2024-09-13T19:16:38.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.299+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94833881490320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd1a880 con 0x56403bd0bda0 2024-09-13T19:16:38.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.299+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd1b860 con 0x7f20b005c070 2024-09-13T19:16:38.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.299+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94833881487680] v36'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b009a040 con 0x7f20b8044070 2024-09-13T19:16:38.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.300+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94833881490320] v36'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b4029040 con 0x56403bd0bda0 2024-09-13T19:16:38.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.300+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(54 notify.5 [create] v36'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b4029040 con 0x7f20b005c070 2024-09-13T19:16:38.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.300+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94833881492656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd1b3b0 con 0x7f20b005c070 2024-09-13T19:16:38.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.300+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd1c130 con 0x7f20b005c070 2024-09-13T19:16:38.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.301+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94833881492656] v36'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b4029040 con 0x7f20b005c070 2024-09-13T19:16:38.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.301+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(56 notify.6 [create] v36'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b4029040 con 0x7f20b005c070 2024-09-13T19:16:38.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.301+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94833881484896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd1be20 con 0x7f20b005c070 2024-09-13T19:16:38.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.301+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd1c7e0 con 0x7f20b005c070 2024-09-13T19:16:38.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.302+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(58 notify.7 [create] v36'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b4029040 con 0x7f20b005c070 2024-09-13T19:16:38.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.302+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94833881484896] v36'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b4029040 con 0x7f20b005c070 2024-09-13T19:16:38.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.302+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94833881498416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd1cc00 con 0x7f20b005c070 2024-09-13T19:16:38.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.302+0000 7f20c1a0e800 20 add_watcher() i=0 2024-09-13T19:16:38.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.302+0000 7f20c1a0e800 20 add_watcher() i=1 2024-09-13T19:16:38.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.302+0000 7f20c1a0e800 20 add_watcher() i=2 2024-09-13T19:16:38.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.302+0000 7f20c1a0e800 20 add_watcher() i=3 2024-09-13T19:16:38.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.302+0000 7f20c1a0e800 20 add_watcher() i=4 2024-09-13T19:16:38.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.302+0000 7f20c1a0e800 20 add_watcher() i=5 2024-09-13T19:16:38.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.302+0000 7f20c1a0e800 20 add_watcher() i=6 2024-09-13T19:16:38.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.303+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94833881498416] v36'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b4029040 con 0x7f20b005c070 2024-09-13T19:16:38.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.303+0000 7f20c1a0e800 20 add_watcher() i=7 2024-09-13T19:16:38.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.303+0000 7f20c1a0e800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:38.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.303+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bd1fc30 con 0x56403bd0bda0 2024-09-13T19:16:38.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.304+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f20b4029040 con 0x56403bd0bda0 2024-09-13T19:16:38.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.304+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94833881499472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd1d0c0 con 0x56403bd0bda0 2024-09-13T19:16:38.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.305+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94833881499472] v36'182 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f20b4029040 con 0x56403bd0bda0 2024-09-13T19:16:38.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.305+0000 7f1f737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:38.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.305+0000 7f20c1a0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:38.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.305+0000 7f20c1a0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:38.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.305+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd286b0 con 0x56403bd0bda0 2024-09-13T19:16:38.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.306+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v36'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f20b4029040 con 0x56403bd0bda0 2024-09-13T19:16:38.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.306+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd28d80 con 0x7f20b005c070 2024-09-13T19:16:38.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.307+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v36'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f20b4029040 con 0x7f20b005c070 2024-09-13T19:16:38.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.307+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd291a0 con 0x56403bd106b0 2024-09-13T19:16:38.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.308+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v36'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f20b8068040 con 0x56403bd106b0 2024-09-13T19:16:38.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.308+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd29060 con 0x56403bd0bda0 2024-09-13T19:16:38.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.309+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v36'183 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f20b4029040 con 0x56403bd0bda0 2024-09-13T19:16:38.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.309+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd295d0 con 0x7f20b8044070 2024-09-13T19:16:38.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.310+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v36'64 uv55 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f20b009a040 con 0x7f20b8044070 2024-09-13T19:16:38.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.310+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd29a80 con 0x56403bd106b0 2024-09-13T19:16:38.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.311+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 <== osd.3 v2:172.21.15.102:6800/3096737090 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v36'42 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f20b8068040 con 0x56403bd106b0 2024-09-13T19:16:38.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.311+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd29a80 con 0x56403bd0bda0 2024-09-13T19:16:38.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.312+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v36'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f20b4029040 con 0x56403bd0bda0 2024-09-13T19:16:38.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.312+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd29940 con 0x7f20b005c070 2024-09-13T19:16:38.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.313+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(69 gc.7 [create,call,call,call] v36'41 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f20b4029040 con 0x7f20b005c070 2024-09-13T19:16:38.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.313+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd299d0 con 0x7f20b8044070 2024-09-13T19:16:38.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.314+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v36'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f20b009a040 con 0x7f20b8044070 2024-09-13T19:16:38.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.315+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd29ab0 con 0x56403bd106b0 2024-09-13T19:16:38.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.315+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 <== osd.3 v2:172.21.15.102:6800/3096737090 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v36'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f20b8068040 con 0x56403bd106b0 2024-09-13T19:16:38.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.315+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd29ab0 con 0x7f20b8044070 2024-09-13T19:16:38.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.316+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 <== osd.2 v2:172.21.15.102:6816/2238176080 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v36'65 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20b009a040 con 0x7f20b8044070 2024-09-13T19:16:38.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.316+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd29ab0 con 0x7f20b005c070 2024-09-13T19:16:38.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.317+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v36'27 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20b4029040 con 0x7f20b005c070 2024-09-13T19:16:38.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.317+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd29ab0 con 0x7f20b8044070 2024-09-13T19:16:38.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.318+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 <== osd.2 v2:172.21.15.102:6816/2238176080 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v36'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20b009a040 con 0x7f20b8044070 2024-09-13T19:16:38.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.318+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd2a170 con 0x7f20b005c070 2024-09-13T19:16:38.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.319+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(75 gc.13 [create,call,call,call] v36'47 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20b4029040 con 0x7f20b005c070 2024-09-13T19:16:38.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.319+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd2a170 con 0x56403bd0bda0 2024-09-13T19:16:38.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.320+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v36'184 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20b4029040 con 0x56403bd0bda0 2024-09-13T19:16:38.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.320+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd28090 con 0x56403bd106b0 2024-09-13T19:16:38.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.321+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 <== osd.3 v2:172.21.15.102:6800/3096737090 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v36'56 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20b8068040 con 0x56403bd106b0 2024-09-13T19:16:38.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.321+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd28090 con 0x7f20b8044070 2024-09-13T19:16:38.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.322+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 <== osd.2 v2:172.21.15.102:6816/2238176080 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v36'66 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20b009a040 con 0x7f20b8044070 2024-09-13T19:16:38.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.322+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd28090 con 0x56403bd106b0 2024-09-13T19:16:38.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.323+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 <== osd.3 v2:172.21.15.102:6800/3096737090 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v36'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20b8068040 con 0x56403bd106b0 2024-09-13T19:16:38.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.323+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd28090 con 0x56403bd0bda0 2024-09-13T19:16:38.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.324+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v36'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20b4029040 con 0x56403bd0bda0 2024-09-13T19:16:38.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.325+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd28090 con 0x56403bd0bda0 2024-09-13T19:16:38.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.325+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v36'185 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20b4029040 con 0x56403bd0bda0 2024-09-13T19:16:38.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.325+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd28090 con 0x56403bd106b0 2024-09-13T19:16:38.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.326+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 <== osd.3 v2:172.21.15.102:6800/3096737090 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v36'57 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20b8068040 con 0x56403bd106b0 2024-09-13T19:16:38.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.326+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd28090 con 0x7f20b8044070 2024-09-13T19:16:38.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.327+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 <== osd.2 v2:172.21.15.102:6816/2238176080 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v36'34 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20b009a040 con 0x7f20b8044070 2024-09-13T19:16:38.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.327+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd28090 con 0x56403bd106b0 2024-09-13T19:16:38.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.328+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 <== osd.3 v2:172.21.15.102:6800/3096737090 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v36'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20b8068040 con 0x56403bd106b0 2024-09-13T19:16:38.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.328+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd28090 con 0x56403bd106b0 2024-09-13T19:16:38.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.329+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 <== osd.3 v2:172.21.15.102:6800/3096737090 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v36'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20b8068040 con 0x56403bd106b0 2024-09-13T19:16:38.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.329+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd28090 con 0x56403bd106b0 2024-09-13T19:16:38.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.330+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 <== osd.3 v2:172.21.15.102:6800/3096737090 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v36'20 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20b8068040 con 0x56403bd106b0 2024-09-13T19:16:38.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.330+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd28090 con 0x56403bd106b0 2024-09-13T19:16:38.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.331+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 <== osd.3 v2:172.21.15.102:6800/3096737090 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v36'43 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20b8068040 con 0x56403bd106b0 2024-09-13T19:16:38.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.331+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd28090 con 0x7f20b005c070 2024-09-13T19:16:38.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.332+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(88 gc.26 [create,call,call,call] v36'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20b4029040 con 0x7f20b005c070 2024-09-13T19:16:38.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.333+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd28090 con 0x56403bd106b0 2024-09-13T19:16:38.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.333+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 <== osd.3 v2:172.21.15.102:6800/3096737090 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v36'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20b8068040 con 0x56403bd106b0 2024-09-13T19:16:38.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.333+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd28090 con 0x7f20b005c070 2024-09-13T19:16:38.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.334+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(90 gc.28 [create,call,call,call] v36'42 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20b4029040 con 0x7f20b005c070 2024-09-13T19:16:38.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.334+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd28090 con 0x56403bd106b0 2024-09-13T19:16:38.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.335+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 <== osd.3 v2:172.21.15.102:6800/3096737090 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v36'58 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20b8068040 con 0x56403bd106b0 2024-09-13T19:16:38.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.335+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd28090 con 0x7f20b005c070 2024-09-13T19:16:38.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.336+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.0 v2:172.21.15.53:6800/4021716951 20 ==== osd_op_reply(92 gc.30 [create,call,call,call] v36'48 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20b4029040 con 0x7f20b005c070 2024-09-13T19:16:38.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.337+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd28090 con 0x7f20b8044070 2024-09-13T19:16:38.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.338+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 <== osd.2 v2:172.21.15.102:6816/2238176080 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v36'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20b009a040 con 0x7f20b8044070 2024-09-13T19:16:38.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.338+0000 7f1f727e4640 20 reqs_thread_entry: start 2024-09-13T19:16:38.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.338+0000 7f20c1a0e800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:38.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.338+0000 7f20c1a0e800 20 Filter name: none 2024-09-13T19:16:38.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.338+0000 7f1ee3fff640 20 reqs_thread_entry: start 2024-09-13T19:16:38.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.338+0000 7f20c1a0e800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T19:16:38.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.338+0000 7f20c1a0e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.338+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bd54ee0 con 0x7f20b8044070 2024-09-13T19:16:38.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.338+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 <== osd.2 v2:172.21.15.102:6816/2238176080 21 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv41 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f20b009a040 con 0x7f20b8044070 2024-09-13T19:16:38.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.339+0000 7f20c1a0e800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:16:38.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.339+0000 7f20c1a0e800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T19:16:38.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.339+0000 7f20c1a0e800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:16:38.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.339+0000 7f20c1a0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.5 : miss 2024-09-13T19:16:38.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.339+0000 7f20c1a0e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.339+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:95 8.4 8:240cf6e4:root::.bucket.meta.myfoo%3a509740b4-c081-4f37-bd6d-df9ca851489b.4237.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bd568f0 con 0x7f20b8044070 2024-09-13T19:16:38.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.339+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 <== osd.2 v2:172.21.15.102:6816/2238176080 22 ==== osd_op_reply(95 .bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f20b009a040 con 0x7f20b8044070 2024-09-13T19:16:38.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.339+0000 7f20c1a0e800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:16:38.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.339+0000 7f20c1a0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.5 info.flags=0x17 2024-09-13T19:16:38.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.339+0000 7f20c1a0e800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.5 to cache LRU end 2024-09-13T19:16:38.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.339+0000 7f20c1a0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:16:38.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.339+0000 7f20c1a0e800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:16:38.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.339+0000 7f20c1a0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.5 2024-09-13T19:16:38.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.339+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:96 4.10 4:0ad63410:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bdd4120 con 0x7f20b8044070 2024-09-13T19:16:38.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.339+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 <== osd.2 v2:172.21.15.102:6816/2238176080 23 ==== osd_op_reply(96 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f20b009a040 con 0x7f20b8044070 2024-09-13T19:16:38.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.339+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:97 4.1 4:81328fb4:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bdd4120 con 0x7f20b8044070 2024-09-13T19:16:38.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.340+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 <== osd.2 v2:172.21.15.102:6816/2238176080 24 ==== osd_op_reply(97 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f20b009a040 con 0x7f20b8044070 2024-09-13T19:16:38.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.340+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:98 4.2 4:42afcf31:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bdd4120 con 0x56403bd0bda0 2024-09-13T19:16:38.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.340+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(98 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.2 [call out=426b] v0'0 uv3 ondisk = 0) ==== 194+0+426 (crc 0 0 0) 0x7f20b4029040 con 0x56403bd0bda0 2024-09-13T19:16:38.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.340+0000 7f20c1a0e800 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2024-09-13T19:16:38.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.340+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:99 4.2a 4:5437f537:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bdd4120 con 0x56403bd0bda0 2024-09-13T19:16:38.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.340+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 28 ==== osd_op_reply(99 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f20b4029040 con 0x56403bd0bda0 2024-09-13T19:16:38.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.340+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:100 4.1d 4:b9f7bb14:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bdd4650 con 0x56403bd106b0 2024-09-13T19:16:38.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.341+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 <== osd.3 v2:172.21.15.102:6800/3096737090 28 ==== osd_op_reply(100 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f20b8068040 con 0x56403bd106b0 2024-09-13T19:16:38.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.341+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:101 4.2f 4:f67fe04c:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bdd4650 con 0x56403bd0bda0 2024-09-13T19:16:38.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.341+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 29 ==== osd_op_reply(101 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f20b4029040 con 0x56403bd0bda0 2024-09-13T19:16:38.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.341+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:102 4.36 4:6c0e1a70:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bdd4650 con 0x56403bd0bda0 2024-09-13T19:16:38.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.341+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 30 ==== osd_op_reply(102 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.6 [call out=425b] v0'0 uv3 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7f20b4029040 con 0x56403bd0bda0 2024-09-13T19:16:38.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.341+0000 7f20c1a0e800 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2024-09-13T19:16:38.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.341+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:103 4.10 4:08e67c39:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bdd4650 con 0x7f20b8044070 2024-09-13T19:16:38.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.342+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 <== osd.2 v2:172.21.15.102:6816/2238176080 25 ==== osd_op_reply(103 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.7 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f20b009a040 con 0x7f20b8044070 2024-09-13T19:16:38.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.342+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:104 4.29 4:9739a826:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bdd4650 con 0x56403bd106b0 2024-09-13T19:16:38.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.342+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 <== osd.3 v2:172.21.15.102:6800/3096737090 29 ==== osd_op_reply(104 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.8 [call out=425b] v0'0 uv7 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7f20b8068040 con 0x56403bd106b0 2024-09-13T19:16:38.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.342+0000 7f20c1a0e800 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2024-09-13T19:16:38.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.342+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:105 4.10 4:0a052158:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bdd4650 con 0x7f20b8044070 2024-09-13T19:16:38.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.342+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 <== osd.2 v2:172.21.15.102:6816/2238176080 26 ==== osd_op_reply(105 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.9 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f20b009a040 con 0x7f20b8044070 2024-09-13T19:16:38.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.342+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:106 4.1d 4:b90cbbec:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bdd4650 con 0x56403bd106b0 2024-09-13T19:16:38.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.343+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 <== osd.3 v2:172.21.15.102:6800/3096737090 30 ==== osd_op_reply(106 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.10 [call out=697b] v0'0 uv12 ondisk = 0) ==== 195+0+697 (crc 0 0 0) 0x7f20b8068040 con 0x56403bd106b0 2024-09-13T19:16:38.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.343+0000 7f20c1a0e800 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2024-09-13T19:16:38.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.343+0000 7f20c1a0e800 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2024-09-13T19:16:38.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.343+0000 7f20c1a0e800 20 get_obj_state: octx=0x7f20b005e4a0 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x56403bd576c8 s->prefetch_data=0 2024-09-13T19:16:38.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.343+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:107 3.1s0 3:82434e85:::509740b4-c081-4f37-bd6d-df9ca851489b.4237.5_9c8454ddf7aa50116496bac348d7550d:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bdd1e20 con 0x7f20b005c070 2024-09-13T19:16:38.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.343+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.0 v2:172.21.15.53:6800/4021716951 21 ==== osd_op_reply(107 509740b4-c081-4f37-bd6d-df9ca851489b.4237.5_9c8454ddf7aa50116496bac348d7550d [getxattrs out=879b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7f20b4029040 con 0x7f20b005c070 2024-09-13T19:16:38.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.343+0000 7f20c1a0e800 10 manifest: total_size = 6 2024-09-13T19:16:38.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.343+0000 7f20c1a0e800 20 get_obj_state: setting s->obj_tag to 509740b4-c081-4f37-bd6d-df9ca851489b.4237.11472701801030357285 2024-09-13T19:16:38.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.343+0000 7f20c1a0e800 20 get_obj_state: octx=0x7f20b005e4a0 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x56403bd576c8 s->prefetch_data=0 2024-09-13T19:16:38.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.343+0000 7f20c1a0e800 20 prepare_atomic_modification: state is not atomic. state=0x56403bd576c8 2024-09-13T19:16:38.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.343+0000 7f20c1a0e800 20 bucket index object: :.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.2 2024-09-13T19:16:38.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.343+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:108 4.2 4:42afcf31:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd5c530 con 0x56403bd0bda0 2024-09-13T19:16:38.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.345+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 31 ==== osd_op_reply(108 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.2 [stat,call,call] v36'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f20b4029040 con 0x56403bd0bda0 2024-09-13T19:16:38.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.345+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:109 3.1s0 3:82434e85:::509740b4-c081-4f37-bd6d-df9ca851489b.4237.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bdd3d90 con 0x7f20b005c070 2024-09-13T19:16:38.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.346+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.0 v2:172.21.15.53:6800/4021716951 22 ==== osd_op_reply(109 509740b4-c081-4f37-bd6d-df9ca851489b.4237.5_9c8454ddf7aa50116496bac348d7550d [call] v36'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f20b4029040 con 0x7f20b005c070 2024-09-13T19:16:38.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.346+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:110 4.2 4:42afcf31:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd5c530 con 0x56403bd0bda0 2024-09-13T19:16:38.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.346+0000 7f20c1a0e800 20 get_obj_state: octx=0x7f20b005e4a0 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x56403bd576c8 s->prefetch_data=0 2024-09-13T19:16:38.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.346+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:111 3.27s0 3:e6204ac0:::509740b4-c081-4f37-bd6d-df9ca851489b.4237.5_b1b9a972ccd8c962a473909b97007eb4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bd5c530 con 0x7f20b005c070 2024-09-13T19:16:38.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.347+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.0 v2:172.21.15.53:6800/4021716951 23 ==== osd_op_reply(111 509740b4-c081-4f37-bd6d-df9ca851489b.4237.5_b1b9a972ccd8c962a473909b97007eb4 [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f20b4029040 con 0x7f20b005c070 2024-09-13T19:16:38.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.347+0000 7f20c1a0e800 10 manifest: total_size = 3 2024-09-13T19:16:38.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.347+0000 7f20c1a0e800 20 get_obj_state: setting s->obj_tag to 509740b4-c081-4f37-bd6d-df9ca851489b.4237.5219400357640213049 2024-09-13T19:16:38.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.347+0000 7f20c1a0e800 20 get_obj_state: octx=0x7f20b005e4a0 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x56403bd576c8 s->prefetch_data=0 2024-09-13T19:16:38.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.347+0000 7f20c1a0e800 20 prepare_atomic_modification: state is not atomic. state=0x56403bd576c8 2024-09-13T19:16:38.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.347+0000 7f20c1a0e800 20 bucket index object: :.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.6 2024-09-13T19:16:38.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.347+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:112 4.36 4:6c0e1a70:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd61660 con 0x56403bd0bda0 2024-09-13T19:16:38.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.347+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 32 ==== osd_op_reply(110 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.2 [stat,call,call] v36'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f20b4029040 con 0x56403bd0bda0 2024-09-13T19:16:38.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.347+0000 7f1fa0ff9640 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2024-09-13T19:16:38.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.348+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 33 ==== osd_op_reply(112 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.6 [stat,call,call] v36'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f20b4029040 con 0x56403bd0bda0 2024-09-13T19:16:38.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.348+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:113 3.27s0 3:e6204ac0:::509740b4-c081-4f37-bd6d-df9ca851489b.4237.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd61660 con 0x7f20b005c070 2024-09-13T19:16:38.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.349+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.0 v2:172.21.15.53:6800/4021716951 24 ==== osd_op_reply(113 509740b4-c081-4f37-bd6d-df9ca851489b.4237.5_b1b9a972ccd8c962a473909b97007eb4 [call] v36'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f20b4029040 con 0x7f20b005c070 2024-09-13T19:16:38.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.349+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:114 4.36 4:6c0e1a70:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd5d090 con 0x56403bd0bda0 2024-09-13T19:16:38.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.349+0000 7f20c1a0e800 20 get_obj_state: octx=0x7f20b005e4a0 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x56403bd576c8 s->prefetch_data=0 2024-09-13T19:16:38.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.349+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:115 3.29s0 3:95951b8c:::509740b4-c081-4f37-bd6d-df9ca851489b.4237.5_c785e1ed2950e3e36b1e2ca01f299a54:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bd5dec0 con 0x7f20b005c070 2024-09-13T19:16:38.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.349+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.0 v2:172.21.15.53:6800/4021716951 25 ==== osd_op_reply(115 509740b4-c081-4f37-bd6d-df9ca851489b.4237.5_c785e1ed2950e3e36b1e2ca01f299a54 [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f20b4029040 con 0x7f20b005c070 2024-09-13T19:16:38.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.350+0000 7f20c1a0e800 10 manifest: total_size = 4 2024-09-13T19:16:38.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.350+0000 7f20c1a0e800 20 get_obj_state: setting s->obj_tag to 509740b4-c081-4f37-bd6d-df9ca851489b.4237.6077982162854545563 2024-09-13T19:16:38.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.350+0000 7f20c1a0e800 20 get_obj_state: octx=0x7f20b005e4a0 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x56403bd576c8 s->prefetch_data=0 2024-09-13T19:16:38.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.350+0000 7f20c1a0e800 20 prepare_atomic_modification: state is not atomic. state=0x56403bd576c8 2024-09-13T19:16:38.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.350+0000 7f20c1a0e800 20 bucket index object: :.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.8 2024-09-13T19:16:38.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.350+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:116 4.29 4:9739a826:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd60a40 con 0x56403bd106b0 2024-09-13T19:16:38.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.350+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 34 ==== osd_op_reply(114 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.6 [stat,call,call] v36'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f20b4029040 con 0x56403bd0bda0 2024-09-13T19:16:38.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.350+0000 7f1f93fff640 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2024-09-13T19:16:38.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.351+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 <== osd.3 v2:172.21.15.102:6800/3096737090 31 ==== osd_op_reply(116 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.8 [stat,call,call] v36'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f20b8068040 con 0x56403bd106b0 2024-09-13T19:16:38.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.351+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:117 3.29s0 3:95951b8c:::509740b4-c081-4f37-bd6d-df9ca851489b.4237.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd61660 con 0x7f20b005c070 2024-09-13T19:16:38.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.353+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.0 v2:172.21.15.53:6800/4021716951 26 ==== osd_op_reply(117 509740b4-c081-4f37-bd6d-df9ca851489b.4237.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v36'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f20b4029040 con 0x7f20b005c070 2024-09-13T19:16:38.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.353+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:118 4.29 4:9739a826:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd61660 con 0x56403bd106b0 2024-09-13T19:16:38.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.353+0000 7f20c1a0e800 20 get_obj_state: octx=0x7f20b005e4a0 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x56403bd576c8 s->prefetch_data=0 2024-09-13T19:16:38.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.353+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:119 3.15s0 3:a8c9720b:::509740b4-c081-4f37-bd6d-df9ca851489b.4237.5_24d27c169c2c881eb09a065116f2aa5c:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bd61660 con 0x7f20b8044070 2024-09-13T19:16:38.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.353+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 <== osd.2 v2:172.21.15.102:6816/2238176080 27 ==== osd_op_reply(119 509740b4-c081-4f37-bd6d-df9ca851489b.4237.5_24d27c169c2c881eb09a065116f2aa5c [getxattrs out=877b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f20b009a040 con 0x7f20b8044070 2024-09-13T19:16:38.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.353+0000 7f20c1a0e800 10 manifest: total_size = 5 2024-09-13T19:16:38.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.353+0000 7f20c1a0e800 20 get_obj_state: setting s->obj_tag to 509740b4-c081-4f37-bd6d-df9ca851489b.4237.5603527478867635139 2024-09-13T19:16:38.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.353+0000 7f20c1a0e800 20 get_obj_state: octx=0x7f20b005e4a0 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x56403bd576c8 s->prefetch_data=0 2024-09-13T19:16:38.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.353+0000 7f20c1a0e800 20 prepare_atomic_modification: state is not atomic. state=0x56403bd576c8 2024-09-13T19:16:38.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.353+0000 7f20c1a0e800 20 bucket index object: :.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.10 2024-09-13T19:16:38.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.353+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:120 4.1d 4:b90cbbec:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd62c30 con 0x56403bd106b0 2024-09-13T19:16:38.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.354+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 <== osd.3 v2:172.21.15.102:6800/3096737090 32 ==== osd_op_reply(118 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.8 [stat,call,call] v36'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f20b8068040 con 0x56403bd106b0 2024-09-13T19:16:38.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.354+0000 7f1fa0ff9640 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2024-09-13T19:16:38.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.355+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 <== osd.3 v2:172.21.15.102:6800/3096737090 33 ==== osd_op_reply(120 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.10 [stat,call,call] v36'13 uv13 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f20b8068040 con 0x56403bd106b0 2024-09-13T19:16:38.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.355+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:121 3.15s0 3:a8c9720b:::509740b4-c081-4f37-bd6d-df9ca851489b.4237.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd62c30 con 0x7f20b8044070 2024-09-13T19:16:38.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.356+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 <== osd.2 v2:172.21.15.102:6816/2238176080 28 ==== osd_op_reply(121 509740b4-c081-4f37-bd6d-df9ca851489b.4237.5_24d27c169c2c881eb09a065116f2aa5c [call] v36'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f20b009a040 con 0x7f20b8044070 2024-09-13T19:16:38.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.356+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:122 4.1d 4:b90cbbec:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd60fc0 con 0x56403bd106b0 2024-09-13T19:16:38.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.356+0000 7f20c1a0e800 20 get_obj_state: octx=0x7f20b005e4a0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x56403bd576c8 s->prefetch_data=0 2024-09-13T19:16:38.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.357+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:123 3.0s0 3:00f550d3:::509740b4-c081-4f37-bd6d-df9ca851489b.4237.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bd58850 con 0x7f20b005c070 2024-09-13T19:16:38.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.357+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.0 v2:172.21.15.53:6800/4021716951 27 ==== osd_op_reply(123 509740b4-c081-4f37-bd6d-df9ca851489b.4237.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=910b,stat out=16b] v0'0 uv5 ondisk = 0) ==== 262+0+926 (crc 0 0 0) 0x7f20b4029040 con 0x7f20b005c070 2024-09-13T19:16:38.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.357+0000 7f20c1a0e800 10 manifest: total_size = 5 2024-09-13T19:16:38.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.357+0000 7f20c1a0e800 20 get_obj_state: setting s->obj_tag to _9umJ68M27V-mDgpXqsJE7PUQhzrdwDg 2024-09-13T19:16:38.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.357+0000 7f20c1a0e800 20 get_obj_state: octx=0x7f20b005e4a0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x56403bd576c8 s->prefetch_data=0 2024-09-13T19:16:38.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.357+0000 7f20c1a0e800 20 prepare_atomic_modification: state is not atomic. state=0x56403bd576c8 2024-09-13T19:16:38.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.357+0000 7f20c1a0e800 20 bucket index object: :.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.10 2024-09-13T19:16:38.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.357+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:124 4.1d 4:b90cbbec:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd5b880 con 0x56403bd106b0 2024-09-13T19:16:38.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.358+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 <== osd.3 v2:172.21.15.102:6800/3096737090 34 ==== osd_op_reply(122 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.10 [stat,call,call] v36'14 uv14 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f20b8068040 con 0x56403bd106b0 2024-09-13T19:16:38.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.358+0000 7f1f93fff640 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2024-09-13T19:16:38.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.358+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 <== osd.3 v2:172.21.15.102:6800/3096737090 35 ==== osd_op_reply(124 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.10 [stat,call,call] v36'15 uv15 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f20b8068040 con 0x56403bd106b0 2024-09-13T19:16:38.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.358+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:125 3.0s0 3:00f550d3:::509740b4-c081-4f37-bd6d-df9ca851489b.4237.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd5e9c0 con 0x7f20b005c070 2024-09-13T19:16:38.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.360+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.0 v2:172.21.15.53:6800/4021716951 28 ==== osd_op_reply(125 509740b4-c081-4f37-bd6d-df9ca851489b.4237.5_bb3aec0fdcdbc2974890f805c585d432 [call] v36'6 uv6 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f20b4029040 con 0x7f20b005c070 2024-09-13T19:16:38.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.360+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:126 4.1d 4:b90cbbec:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd5fe20 con 0x56403bd106b0 2024-09-13T19:16:38.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.360+0000 7f20c1a0e800 20 list_objects_ordered: starting attempt 1 2024-09-13T19:16:38.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.360+0000 7f20c1a0e800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-13T19:16:38.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.360+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:127 4.10 4:0ad63410:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bd5fe20 con 0x7f20b8044070 2024-09-13T19:16:38.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.360+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:128 4.1 4:81328fb4:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bd61120 con 0x7f20b8044070 2024-09-13T19:16:38.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.360+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:129 4.2 4:42afcf31:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bd5b9f0 con 0x56403bd0bda0 2024-09-13T19:16:38.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.360+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:130 4.2a 4:5437f537:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bd692c0 con 0x56403bd0bda0 2024-09-13T19:16:38.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.360+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:131 4.1d 4:b9f7bb14:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bd6bd70 con 0x56403bd106b0 2024-09-13T19:16:38.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.360+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:132 4.2f 4:f67fe04c:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bd6eb30 con 0x56403bd0bda0 2024-09-13T19:16:38.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.360+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:133 4.36 4:6c0e1a70:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bd71890 con 0x56403bd0bda0 2024-09-13T19:16:38.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.360+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:134 4.10 4:08e67c39:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bd74300 con 0x7f20b8044070 2024-09-13T19:16:38.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.360+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:135 4.29 4:9739a826:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bd77130 con 0x56403bd106b0 2024-09-13T19:16:38.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.360+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:136 4.10 4:0a052158:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bd79a20 con 0x7f20b8044070 2024-09-13T19:16:38.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.360+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:137 4.1d 4:b90cbbec:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bd77130 con 0x56403bd106b0 2024-09-13T19:16:38.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.361+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 <== osd.2 v2:172.21.15.102:6816/2238176080 29 ==== osd_op_reply(127 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f20b009a040 con 0x7f20b8044070 2024-09-13T19:16:38.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.361+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 <== osd.3 v2:172.21.15.102:6800/3096737090 36 ==== osd_op_reply(135 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.8 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f20b8068040 con 0x56403bd106b0 2024-09-13T19:16:38.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.361+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 <== osd.3 v2:172.21.15.102:6800/3096737090 37 ==== osd_op_reply(131 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f20b8068040 con 0x56403bd106b0 2024-09-13T19:16:38.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.361+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 35 ==== osd_op_reply(129 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.2 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f20b4029040 con 0x56403bd0bda0 2024-09-13T19:16:38.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.361+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 <== osd.2 v2:172.21.15.102:6816/2238176080 30 ==== osd_op_reply(128 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f20b009a040 con 0x7f20b8044070 2024-09-13T19:16:38.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.361+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 36 ==== osd_op_reply(132 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f20b4029040 con 0x56403bd0bda0 2024-09-13T19:16:38.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.361+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 <== osd.2 v2:172.21.15.102:6816/2238176080 31 ==== osd_op_reply(134 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.7 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f20b009a040 con 0x7f20b8044070 2024-09-13T19:16:38.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.361+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 37 ==== osd_op_reply(130 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f20b4029040 con 0x56403bd0bda0 2024-09-13T19:16:38.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.361+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 <== osd.2 v2:172.21.15.102:6816/2238176080 32 ==== osd_op_reply(136 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.9 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f20b009a040 con 0x7f20b8044070 2024-09-13T19:16:38.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.361+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 38 ==== osd_op_reply(133 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.6 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f20b4029040 con 0x56403bd0bda0 2024-09-13T19:16:38.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.361+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 <== osd.3 v2:172.21.15.102:6800/3096737090 38 ==== osd_op_reply(126 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.10 [stat,call,call] v36'16 uv16 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f20b8068040 con 0x56403bd106b0 2024-09-13T19:16:38.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.361+0000 7f1fa0ff9640 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2024-09-13T19:16:38.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.362+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 <== osd.3 v2:172.21.15.102:6800/3096737090 39 ==== osd_op_reply(137 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.10 [call out=124b] v0'0 uv16 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f20b8068040 con 0x56403bd106b0 2024-09-13T19:16:38.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.362+0000 7f20c1a0e800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-13T19:16:38.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.362+0000 7f20c1a0e800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-13T19:16:38.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.362+0000 7f20c1a0e800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-13T19:16:38.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.362+0000 7f20c1a0e800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-13T19:16:38.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.362+0000 7f20c1a0e800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[509740b4-c081-4f37-bd6d-df9ca851489b.4237.5])"; uploads.size()=0; is_truncated=0 2024-09-13T19:16:38.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.362+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:138 4.10 4:0ad63410:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bd77130 con 0x7f20b8044070 2024-09-13T19:16:38.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.362+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:139 4.1 4:81328fb4:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bd6eb30 con 0x7f20b8044070 2024-09-13T19:16:38.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.362+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:140 4.2 4:42afcf31:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bd6e4e0 con 0x56403bd0bda0 2024-09-13T19:16:38.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.362+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:141 4.2a 4:5437f537:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bd77130 con 0x56403bd0bda0 2024-09-13T19:16:38.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.362+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:142 4.1d 4:b9f7bb14:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bd6eb30 con 0x56403bd106b0 2024-09-13T19:16:38.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.362+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:143 4.2f 4:f67fe04c:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bd77130 con 0x56403bd0bda0 2024-09-13T19:16:38.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.362+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:144 4.36 4:6c0e1a70:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bd77130 con 0x56403bd0bda0 2024-09-13T19:16:38.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.362+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:145 4.10 4:08e67c39:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bd77130 con 0x7f20b8044070 2024-09-13T19:16:38.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.362+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:146 4.29 4:9739a826:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bd77130 con 0x56403bd106b0 2024-09-13T19:16:38.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.362+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:147 4.10 4:0a052158:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bd74070 con 0x7f20b8044070 2024-09-13T19:16:38.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.362+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:148 4.1d 4:b90cbbec:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bd74070 con 0x56403bd106b0 2024-09-13T19:16:38.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.362+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 <== osd.3 v2:172.21.15.102:6800/3096737090 40 ==== osd_op_reply(142 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f20b8068040 con 0x56403bd106b0 2024-09-13T19:16:38.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.362+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 <== osd.2 v2:172.21.15.102:6816/2238176080 33 ==== osd_op_reply(138 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f20b009a040 con 0x7f20b8044070 2024-09-13T19:16:38.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.362+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 <== osd.2 v2:172.21.15.102:6816/2238176080 34 ==== osd_op_reply(139 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f20b009a040 con 0x7f20b8044070 2024-09-13T19:16:38.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.362+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 39 ==== osd_op_reply(140 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.2 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f20b4029040 con 0x56403bd0bda0 2024-09-13T19:16:38.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.362+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 40 ==== osd_op_reply(141 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f20b4029040 con 0x56403bd0bda0 2024-09-13T19:16:38.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.362+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 <== osd.2 v2:172.21.15.102:6816/2238176080 35 ==== osd_op_reply(145 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.7 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f20b009a040 con 0x7f20b8044070 2024-09-13T19:16:38.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.362+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 41 ==== osd_op_reply(143 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f20b4029040 con 0x56403bd0bda0 2024-09-13T19:16:38.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.362+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 42 ==== osd_op_reply(144 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.6 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f20b4029040 con 0x56403bd0bda0 2024-09-13T19:16:38.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.362+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 <== osd.3 v2:172.21.15.102:6800/3096737090 41 ==== osd_op_reply(146 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.8 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f20b8068040 con 0x56403bd106b0 2024-09-13T19:16:38.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.362+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 <== osd.2 v2:172.21.15.102:6816/2238176080 36 ==== osd_op_reply(147 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.9 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f20b009a040 con 0x7f20b8044070 2024-09-13T19:16:38.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.362+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 <== osd.3 v2:172.21.15.102:6800/3096737090 42 ==== osd_op_reply(148 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.10 [call out=124b] v0'0 uv16 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f20b8068040 con 0x56403bd106b0 2024-09-13T19:16:38.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.363+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:149 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd770a0 con 0x7f20b8044070 2024-09-13T19:16:38.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.364+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 <== osd.2 v2:172.21.15.102:6816/2238176080 37 ==== osd_op_reply(149 foo.buckets [call] v36'45 uv45 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f20b009a040 con 0x7f20b8044070 2024-09-13T19:16:38.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.364+0000 7f20c1a0e800 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x11) 2024-09-13T19:16:38.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.364+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:150 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd770a0 con 0x7f20b8044070 2024-09-13T19:16:38.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.365+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 <== osd.2 v2:172.21.15.102:6816/2238176080 38 ==== osd_op_reply(150 myfoo [call,call,delete] v36'46 uv46 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7f20b009a040 con 0x7f20b8044070 2024-09-13T19:16:38.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.365+0000 7f20c1a0e800 10 removing default.rgw.meta+root+myfoo from cache 2024-09-13T19:16:38.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.365+0000 7f20c1a0e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T19:16:38.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.365+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:151 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94833881870496 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bd574e0 con 0x7f20b005c070 2024-09-13T19:16:38.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.365+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.0 v2:172.21.15.53:6800/4021716951 29 ==== watch-notify(notify (1) cookie 94833881484896 notify 154618822674 ret 0) ==== 191+0+0 (crc 0 0 0) 0x56403bd28d80 con 0x7f20b005c070 2024-09-13T19:16:38.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.365+0000 7f1fa0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822674 cookie 94833881484896 notifier 4657 bl.length()=149 2024-09-13T19:16:38.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.365+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.0 v2:172.21.15.53:6800/4021716951 30 ==== osd_op_reply(151 notify.6 [notify cookie 94833881870496 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f20b4029040 con 0x7f20b005c070 2024-09-13T19:16:38.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.365+0000 7f1fa0ff9640 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:152 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f1f80003d60 con 0x7f20b005c070 2024-09-13T19:16:38.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.365+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.0 v2:172.21.15.53:6800/4021716951 31 ==== osd_op_reply(152 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b4029040 con 0x7f20b005c070 2024-09-13T19:16:38.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.365+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.0 v2:172.21.15.53:6800/4021716951 32 ==== watch-notify(notify_complete (2) cookie 94833881870496 notify 154618822674 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56403bd00b60 con 0x7f20b005c070 2024-09-13T19:16:38.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.365+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:153 8.4 8:240cf6e4:root::.bucket.meta.myfoo%3a509740b4-c081-4f37-bd6d-df9ca851489b.4237.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd574e0 con 0x7f20b8044070 2024-09-13T19:16:38.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.366+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 <== osd.2 v2:172.21.15.102:6816/2238176080 39 ==== osd_op_reply(153 .bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.5 [call,call,delete] v36'2 uv2 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7f20b009a040 con 0x7f20b8044070 2024-09-13T19:16:38.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.366+0000 7f20c1a0e800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.5 from cache 2024-09-13T19:16:38.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.366+0000 7f20c1a0e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.5, ofs0, ns] 2024-09-13T19:16:38.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.366+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:154 7.d 7:b4812045:::notify.4:head [notify cookie 94833881763648 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bd769d0 con 0x56403bd0bda0 2024-09-13T19:16:38.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.367+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 43 ==== watch-notify(notify (1) cookie 94833881490320 notify 154618822683 ret 0) ==== 248+0+0 (crc 0 0 0) 0x56403bd00b60 con 0x56403bd0bda0 2024-09-13T19:16:38.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.367+0000 7f1fa0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822683 cookie 94833881490320 notifier 4657 bl.length()=206 2024-09-13T19:16:38.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.367+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 44 ==== osd_op_reply(154 notify.4 [notify cookie 94833881763648 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f20b4029040 con 0x56403bd0bda0 2024-09-13T19:16:38.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.367+0000 7f1fa0ff9640 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:155 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f1f80003d60 con 0x56403bd0bda0 2024-09-13T19:16:38.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.367+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 45 ==== osd_op_reply(155 notify.4 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b4029040 con 0x56403bd0bda0 2024-09-13T19:16:38.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.367+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 46 ==== watch-notify(notify_complete (2) cookie 94833881763648 notify 154618822683 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56403bd28840 con 0x56403bd0bda0 2024-09-13T19:16:38.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.367+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:156 4.10 4:0ad63410:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bdd1fb0 con 0x7f20b8044070 2024-09-13T19:16:38.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.367+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:157 4.1 4:81328fb4:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd60250 con 0x7f20b8044070 2024-09-13T19:16:38.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.367+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:158 4.2 4:42afcf31:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd605f0 con 0x56403bd0bda0 2024-09-13T19:16:38.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.367+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:159 4.2a 4:5437f537:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd57440 con 0x56403bd0bda0 2024-09-13T19:16:38.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.367+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:160 4.1d 4:b9f7bb14:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd5de60 con 0x56403bd106b0 2024-09-13T19:16:38.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.367+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:161 4.2f 4:f67fe04c:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd60250 con 0x56403bd0bda0 2024-09-13T19:16:38.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.367+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:162 4.36 4:6c0e1a70:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd57440 con 0x56403bd0bda0 2024-09-13T19:16:38.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.367+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:163 4.10 4:08e67c39:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd53d60 con 0x7f20b8044070 2024-09-13T19:16:38.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.368+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:164 4.29 4:9739a826:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd54210 con 0x56403bd106b0 2024-09-13T19:16:38.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.368+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:165 4.10 4:0a052158:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd557a0 con 0x7f20b8044070 2024-09-13T19:16:38.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.368+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:166 4.1d 4:b90cbbec:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd557a0 con 0x56403bd106b0 2024-09-13T19:16:38.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.369+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 47 ==== osd_op_reply(159 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.3 [delete] v36'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f20b4029040 con 0x56403bd0bda0 2024-09-13T19:16:38.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.369+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 <== osd.2 v2:172.21.15.102:6816/2238176080 40 ==== osd_op_reply(157 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.1 [delete] v36'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f20b009a040 con 0x7f20b8044070 2024-09-13T19:16:38.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.369+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 <== osd.2 v2:172.21.15.102:6816/2238176080 41 ==== osd_op_reply(156 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.0 [delete] v36'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f20b009a040 con 0x7f20b8044070 2024-09-13T19:16:38.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.369+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 <== osd.3 v2:172.21.15.102:6800/3096737090 43 ==== osd_op_reply(160 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.4 [delete] v36'17 uv17 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f20b8068040 con 0x56403bd106b0 2024-09-13T19:16:38.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.370+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 <== osd.2 v2:172.21.15.102:6816/2238176080 42 ==== osd_op_reply(163 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.7 [delete] v36'7 uv7 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f20b009a040 con 0x7f20b8044070 2024-09-13T19:16:38.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.370+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 48 ==== osd_op_reply(158 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.2 [delete] v36'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f20b4029040 con 0x56403bd0bda0 2024-09-13T19:16:38.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.370+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 49 ==== osd_op_reply(161 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.5 [delete] v36'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f20b4029040 con 0x56403bd0bda0 2024-09-13T19:16:38.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.370+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 50 ==== osd_op_reply(162 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.6 [delete] v36'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f20b4029040 con 0x56403bd0bda0 2024-09-13T19:16:38.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.370+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 <== osd.3 v2:172.21.15.102:6800/3096737090 44 ==== osd_op_reply(164 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.8 [delete] v36'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f20b8068040 con 0x56403bd106b0 2024-09-13T19:16:38.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.370+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 <== osd.2 v2:172.21.15.102:6816/2238176080 43 ==== osd_op_reply(165 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.9 [delete] v36'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f20b009a040 con 0x7f20b8044070 2024-09-13T19:16:38.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.370+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 <== osd.3 v2:172.21.15.102:6800/3096737090 45 ==== osd_op_reply(166 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.5.10 [delete] v36'18 uv18 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f20b8068040 con 0x56403bd106b0 2024-09-13T19:16:38.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.370+0000 7f20c1a0e800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/509740b4-c081-4f37-bd6d-df9ca851489b.4237.5 : miss 2024-09-13T19:16:38.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.370+0000 7f20c1a0e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.370+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:167 6.17 6:eeeb10a4:::pubsub..bucket.myfoo%2f509740b4-c081-4f37-bd6d-df9ca851489b.4237.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56403bd60250 con 0x56403bd0bda0 2024-09-13T19:16:38.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.370+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 51 ==== osd_op_reply(167 pubsub..bucket.myfoo/509740b4-c081-4f37-bd6d-df9ca851489b.4237.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f20b4029040 con 0x56403bd0bda0 2024-09-13T19:16:38.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.370+0000 7f20c1a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:38.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.370+0000 7f20c1a0e800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/509740b4-c081-4f37-bd6d-df9ca851489b.4237.5 info.flags=0x0 2024-09-13T19:16:38.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.370+0000 7f20c1a0e800 10 adding default.rgw.log++pubsub..bucket.myfoo/509740b4-c081-4f37-bd6d-df9ca851489b.4237.5 to cache LRU end 2024-09-13T19:16:38.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.370+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:168 6.17 6:eeeb10a4:::pubsub..bucket.myfoo%2f509740b4-c081-4f37-bd6d-df9ca851489b.4237.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd6bd30 con 0x56403bd0bda0 2024-09-13T19:16:38.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.372+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 52 ==== osd_op_reply(168 pubsub..bucket.myfoo/509740b4-c081-4f37-bd6d-df9ca851489b.4237.5 [delete] v36'8 uv6 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f20b4029040 con 0x56403bd0bda0 2024-09-13T19:16:38.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.372+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:169 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd6bd30 con 0x7f20b8044070 2024-09-13T19:16:38.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.373+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 <== osd.2 v2:172.21.15.102:6816/2238176080 44 ==== osd_op_reply(169 foo.buckets [call] v36'47 uv47 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f20b009a040 con 0x7f20b8044070 2024-09-13T19:16:38.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.374+0000 7f1f737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:38.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.374+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:170 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94833881499472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd6bd30 con 0x56403bd0bda0 2024-09-13T19:16:38.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.375+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 53 ==== osd_op_reply(170 data_loggenerations_metadata [watch unwatch cookie 94833881499472] v36'186 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f20b4029040 con 0x56403bd0bda0 2024-09-13T19:16:38.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.375+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:171 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94833881474528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd6bd30 con 0x7f20b8044070 2024-09-13T19:16:38.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.375+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 <== osd.2 v2:172.21.15.102:6816/2238176080 45 ==== osd_op_reply(171 notify.0 [watch unwatch cookie 94833881474528] v36'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b009a040 con 0x7f20b8044070 2024-09-13T19:16:38.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.376+0000 7f20c1a0e800 20 remove_watcher() i=0 2024-09-13T19:16:38.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.376+0000 7f20c1a0e800 2 removed watcher, disabling cache 2024-09-13T19:16:38.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.376+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94833881480784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd6bd30 con 0x56403bd0bda0 2024-09-13T19:16:38.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.377+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 54 ==== osd_op_reply(172 notify.1 [watch unwatch cookie 94833881480784] v36'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b4029040 con 0x56403bd0bda0 2024-09-13T19:16:38.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.377+0000 7f20c1a0e800 20 remove_watcher() i=1 2024-09-13T19:16:38.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.377+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:173 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94833881483840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd6bd30 con 0x56403bd106b0 2024-09-13T19:16:38.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.378+0000 7f20bd8f8640 1 -- 172.21.15.102:0/832490072 <== osd.3 v2:172.21.15.102:6800/3096737090 46 ==== osd_op_reply(173 notify.2 [watch unwatch cookie 94833881483840] v36'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b8068040 con 0x56403bd106b0 2024-09-13T19:16:38.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.378+0000 7f20c1a0e800 20 remove_watcher() i=2 2024-09-13T19:16:38.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.378+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:174 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94833881487680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd6bd30 con 0x7f20b8044070 2024-09-13T19:16:38.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.379+0000 7f20bd0f7640 1 -- 172.21.15.102:0/832490072 <== osd.2 v2:172.21.15.102:6816/2238176080 46 ==== osd_op_reply(174 notify.3 [watch unwatch cookie 94833881487680] v36'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b009a040 con 0x7f20b8044070 2024-09-13T19:16:38.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.379+0000 7f20c1a0e800 20 remove_watcher() i=3 2024-09-13T19:16:38.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.379+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:175 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94833881490320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd6bd30 con 0x56403bd0bda0 2024-09-13T19:16:38.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.380+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.1 v2:172.21.15.102:6808/2204418452 55 ==== osd_op_reply(175 notify.4 [watch unwatch cookie 94833881490320] v36'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b4029040 con 0x56403bd0bda0 2024-09-13T19:16:38.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.380+0000 7f20c1a0e800 20 remove_watcher() i=4 2024-09-13T19:16:38.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.380+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94833881492656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd6bd30 con 0x7f20b005c070 2024-09-13T19:16:38.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.381+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.0 v2:172.21.15.53:6800/4021716951 33 ==== osd_op_reply(176 notify.5 [watch unwatch cookie 94833881492656] v36'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b4029040 con 0x7f20b005c070 2024-09-13T19:16:38.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.381+0000 7f20c1a0e800 20 remove_watcher() i=5 2024-09-13T19:16:38.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.381+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:177 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94833881484896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd6bd30 con 0x7f20b005c070 2024-09-13T19:16:38.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.381+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.0 v2:172.21.15.53:6800/4021716951 34 ==== osd_op_reply(177 notify.6 [watch unwatch cookie 94833881484896] v36'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b4029040 con 0x7f20b005c070 2024-09-13T19:16:38.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.382+0000 7f20c1a0e800 20 remove_watcher() i=6 2024-09-13T19:16:38.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.382+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:178 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94833881498416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56403bd6bd30 con 0x7f20b005c070 2024-09-13T19:16:38.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.383+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 <== osd.0 v2:172.21.15.53:6800/4021716951 35 ==== osd_op_reply(178 notify.7 [watch unwatch cookie 94833881498416] v36'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b4029040 con 0x7f20b005c070 2024-09-13T19:16:38.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.383+0000 7f20c1a0e800 20 remove_watcher() i=7 2024-09-13T19:16:38.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.383+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f20b005c070 msgr2=0x7f20b00688b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.383+0000 7f20c1a0e800 1 --2- 172.21.15.102:0/832490072 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f20b005c070 0x7f20b00688b0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.383+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56403bd0bda0 msgr2=0x56403bd0e260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.383+0000 7f20c1a0e800 1 --2- 172.21.15.102:0/832490072 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56403bd0bda0 0x56403bd0e260 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.383+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f20b8044070 msgr2=0x7f20b802b060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.383+0000 7f20c1a0e800 1 --2- 172.21.15.102:0/832490072 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f20b8044070 0x7f20b802b060 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.383+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56403bd106b0 msgr2=0x56403bd12ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.383+0000 7f20c1a0e800 1 --2- 172.21.15.102:0/832490072 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56403bd106b0 0x56403bd12ac0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.383+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f1f88036b40 msgr2=0x7f1f88039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.383+0000 7f20c1a0e800 1 --2- 172.21.15.102:0/832490072 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f1f88036b40 0x7f1f88039000 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f20b008f470 tx=0x7f20b0094000 comp rx=0 tx=0).stop 2024-09-13T19:16:38.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.383+0000 7f20bc8f6640 1 -- 172.21.15.102:0/832490072 reap_dead start 2024-09-13T19:16:38.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.383+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56403bcf8ed0 msgr2=0x56403bd00390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.383+0000 7f20c1a0e800 1 --2- 172.21.15.102:0/832490072 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56403bcf8ed0 0x56403bd00390 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f20b8020000 tx=0x7f20b804cd50 comp rx=0 tx=0).stop 2024-09-13T19:16:38.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.383+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 shutdown_connections 2024-09-13T19:16:38.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.383+0000 7f20c1a0e800 1 --2- 172.21.15.102:0/832490072 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56403bcf8ed0 0x56403bd00390 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.383+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 >> 172.21.15.102:0/832490072 conn(0x56403bcf51e0 msgr2=0x56403bcf32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:38.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.383+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 shutdown_connections 2024-09-13T19:16:38.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.383+0000 7f20c1a0e800 1 -- 172.21.15.102:0/832490072 wait complete. 2024-09-13T19:16:38.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.383+0000 7f20c1a0e800 1 -- 172.21.15.102:0/186300184 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f1f94036b40 msgr2=0x7f1f94039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.383+0000 7f20c1a0e800 1 --2- 172.21.15.102:0/186300184 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f1f94036b40 0x7f1f94039000 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f20b0025c20 tx=0x7f20b0060ee0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.383+0000 7f20c1a0e800 1 -- 172.21.15.102:0/186300184 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56403bcec1a0 msgr2=0x56403bcec5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.383+0000 7f20c1a0e800 1 --2- 172.21.15.102:0/186300184 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56403bcec1a0 0x56403bcec5c0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x56403bcd2620 tx=0x7f20b80167b0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.383+0000 7f20c1a0e800 1 -- 172.21.15.102:0/186300184 shutdown_connections 2024-09-13T19:16:38.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.383+0000 7f20c1a0e800 1 --2- 172.21.15.102:0/186300184 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f1f94036b40 0x7f1f94039000 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.383+0000 7f20c1a0e800 1 --2- 172.21.15.102:0/186300184 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56403bcec1a0 0x56403bcec5c0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.383+0000 7f20c1a0e800 1 -- 172.21.15.102:0/186300184 >> 172.21.15.102:0/186300184 conn(0x56403bce1130 msgr2=0x56403bce3cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:38.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.383+0000 7f20c1a0e800 1 -- 172.21.15.102:0/186300184 shutdown_connections 2024-09-13T19:16:38.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.383+0000 7f20c1a0e800 1 -- 172.21.15.102:0/186300184 wait complete. 2024-09-13T19:16:38.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.384+0000 7f20c1a0e800 1 -- 172.21.15.102:0/3306005797 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56403bbdb720 msgr2=0x56403bcd8470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.384+0000 7f20c1a0e800 1 --2- 172.21.15.102:0/3306005797 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56403bbdb720 0x56403bcd8470 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.384+0000 7f20c1a0e800 1 -- 172.21.15.102:0/3306005797 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56403bcdad80 msgr2=0x56403bcdd170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.384+0000 7f20c1a0e800 1 --2- 172.21.15.102:0/3306005797 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56403bcdad80 0x56403bcdd170 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.384+0000 7f20c1a0e800 1 -- 172.21.15.102:0/3306005797 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f1fa4036b40 msgr2=0x7f1fa4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.384+0000 7f20c1a0e800 1 --2- 172.21.15.102:0/3306005797 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f1fa4036b40 0x7f1fa4039000 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f20b4000f60 tx=0x7f20b40012b0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.384+0000 7f20c1a0e800 1 -- 172.21.15.102:0/3306005797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56403bb4c650 msgr2=0x56403bcd1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.384+0000 7f20c1a0e800 1 --2- 172.21.15.102:0/3306005797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56403bb4c650 0x56403bcd1400 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x56403bbd8210 tx=0x7f20b0002fb0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.384+0000 7f20c1a0e800 1 -- 172.21.15.102:0/3306005797 shutdown_connections 2024-09-13T19:16:38.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.384+0000 7f20c1a0e800 1 --2- 172.21.15.102:0/3306005797 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56403bcdad80 0x56403bcdd170 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.384+0000 7f20c1a0e800 1 --2- 172.21.15.102:0/3306005797 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56403bbdb720 0x56403bcd8470 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.384+0000 7f20c1a0e800 1 --2- 172.21.15.102:0/3306005797 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f1fa4036b40 0x7f1fa4039000 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.384+0000 7f20c1a0e800 1 --2- 172.21.15.102:0/3306005797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56403bb4c650 0x56403bcd1400 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.384+0000 7f20c1a0e800 1 -- 172.21.15.102:0/3306005797 >> 172.21.15.102:0/3306005797 conn(0x56403bbd2db0 msgr2=0x56403bcc2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:38.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.384+0000 7f20c1a0e800 1 -- 172.21.15.102:0/3306005797 shutdown_connections 2024-09-13T19:16:38.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.384+0000 7f20c1a0e800 1 -- 172.21.15.102:0/3306005797 wait complete. 2024-09-13T19:16:38.396 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-13T19:16:38.396 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-13T19:16:38.396 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2024-09-13T19:16:38.442 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:38.442 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:38.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.439+0000 7f0e08b32800 1 Processor -- start 2024-09-13T19:16:38.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.440+0000 7f0e08b32800 1 -- start start 2024-09-13T19:16:38.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.440+0000 7f0e08b32800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5576056bb650 0x55760574a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.440+0000 7f0e08b32800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557605606b30 con 0x55760574a720 2024-09-13T19:16:38.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.440+0000 7f0e08b32800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5576055e8360 con 0x5576056bb650 2024-09-13T19:16:38.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.440+0000 7f0e0485c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5576056bb650 0x55760574a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.440+0000 7f0e0485c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5576056bb650 0x55760574a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55524/0 (socket says 172.21.15.102:55524) 2024-09-13T19:16:38.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.440+0000 7f0dfffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55760574a720 0x55760574cb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:48534/0 (socket says 172.21.15.102:48534) 2024-09-13T19:16:38.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.440+0000 7f0e0485c640 1 -- 172.21.15.102:0/4237971390 learned_addr learned my addr 172.21.15.102:0/4237971390 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:38.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.440+0000 7f0e0485c640 1 -- 172.21.15.102:0/4237971390 >> v1:172.21.15.53:6789/0 conn(0x55760574a720 legacy=0x55760574cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.440+0000 7f0e0485c640 1 -- 172.21.15.102:0/4237971390 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55760560ee00 con 0x5576056bb650 2024-09-13T19:16:38.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.442+0000 7f0e0485c640 1 --2- 172.21.15.102:0/4237971390 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576056bb650 0x55760574a1e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f0df800a520 tx=0x7f0df8045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60c86500859e1f2a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.442+0000 7f0dff7fe640 1 -- 172.21.15.102:0/4237971390 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0df8055070 con 0x5576056bb650 2024-09-13T19:16:38.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.442+0000 7f0dff7fe640 1 -- 172.21.15.102:0/4237971390 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0df80515b0 con 0x5576056bb650 2024-09-13T19:16:38.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.442+0000 7f0dff7fe640 1 -- 172.21.15.102:0/4237971390 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0df80518d0 con 0x5576056bb650 2024-09-13T19:16:38.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.443+0000 7f0e08b32800 1 -- 172.21.15.102:0/4237971390 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576056bb650 msgr2=0x55760574a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.443+0000 7f0e08b32800 1 --2- 172.21.15.102:0/4237971390 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576056bb650 0x55760574a1e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f0df800a520 tx=0x7f0df8045ba0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.443+0000 7f0e08b32800 1 -- 172.21.15.102:0/4237971390 shutdown_connections 2024-09-13T19:16:38.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.443+0000 7f0e08b32800 1 --2- 172.21.15.102:0/4237971390 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576056bb650 0x55760574a1e0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.443+0000 7f0e08b32800 1 -- 172.21.15.102:0/4237971390 >> 172.21.15.102:0/4237971390 conn(0x557605741db0 msgr2=0x5576057441d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:38.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.443+0000 7f0e08b32800 1 -- 172.21.15.102:0/4237971390 shutdown_connections 2024-09-13T19:16:38.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.443+0000 7f0e08b32800 1 -- 172.21.15.102:0/4237971390 wait complete. 2024-09-13T19:16:38.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.457+0000 7f0e08b32800 1 Processor -- start 2024-09-13T19:16:38.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.457+0000 7f0e08b32800 1 -- start start 2024-09-13T19:16:38.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.457+0000 7f0e08b32800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576056bb650 0x557605747b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.457+0000 7f0e08b32800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557605693360 con 0x5576056bb650 2024-09-13T19:16:38.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.457+0000 7f0e0485c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576056bb650 0x557605747b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.457+0000 7f0e0485c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576056bb650 0x557605747b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55536/0 (socket says 172.21.15.102:55536) 2024-09-13T19:16:38.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.457+0000 7f0e0485c640 1 -- 172.21.15.102:0/3231098878 learned_addr learned my addr 172.21.15.102:0/3231098878 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:38.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.458+0000 7f0e0485c640 1 -- 172.21.15.102:0/3231098878 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576055e0bc0 con 0x5576056bb650 2024-09-13T19:16:38.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.458+0000 7f0e0485c640 1 --2- 172.21.15.102:0/3231098878 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576056bb650 0x557605747b10 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f0df8025da0 tx=0x7f0df8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1c425e5c21a6a05 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.458+0000 7f0cf2e05640 1 -- 172.21.15.102:0/3231098878 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0df8051950 con 0x5576056bb650 2024-09-13T19:16:38.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.458+0000 7f0cf2e05640 1 -- 172.21.15.102:0/3231098878 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0df8051af0 con 0x5576056bb650 2024-09-13T19:16:38.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.458+0000 7f0cf2e05640 1 -- 172.21.15.102:0/3231098878 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0df8051dd0 con 0x5576056bb650 2024-09-13T19:16:38.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.459+0000 7f0e08b32800 1 -- 172.21.15.102:0/3231098878 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576056bb650 msgr2=0x557605747b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.459+0000 7f0e08b32800 1 --2- 172.21.15.102:0/3231098878 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576056bb650 0x557605747b10 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f0df8025da0 tx=0x7f0df8051000 comp rx=0 tx=0).stop 2024-09-13T19:16:38.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.459+0000 7f0e08b32800 1 -- 172.21.15.102:0/3231098878 shutdown_connections 2024-09-13T19:16:38.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.459+0000 7f0e08b32800 1 --2- 172.21.15.102:0/3231098878 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576056bb650 0x557605747b10 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.459+0000 7f0e08b32800 1 -- 172.21.15.102:0/3231098878 >> 172.21.15.102:0/3231098878 conn(0x557605741db0 msgr2=0x557605832240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:38.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.459+0000 7f0e08b32800 1 -- 172.21.15.102:0/3231098878 shutdown_connections 2024-09-13T19:16:38.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.459+0000 7f0e08b32800 1 -- 172.21.15.102:0/3231098878 wait complete. 2024-09-13T19:16:38.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.459+0000 7f0e08b32800 1 Processor -- start 2024-09-13T19:16:38.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.459+0000 7f0e08b32800 1 -- start start 2024-09-13T19:16:38.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.459+0000 7f0e08b32800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576056bb650 0x557605840300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.459+0000 7f0e08b32800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55760574e620 con 0x5576056bb650 2024-09-13T19:16:38.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.459+0000 7f0e0485c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576056bb650 0x557605840300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.459+0000 7f0e0485c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576056bb650 0x557605840300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55546/0 (socket says 172.21.15.102:55546) 2024-09-13T19:16:38.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.459+0000 7f0e0485c640 1 -- 172.21.15.102:0/1573631078 learned_addr learned my addr 172.21.15.102:0/1573631078 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:38.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.460+0000 7f0e0485c640 1 -- 172.21.15.102:0/1573631078 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576055f4fe0 con 0x5576056bb650 2024-09-13T19:16:38.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.460+0000 7f0e0485c640 1 --2- 172.21.15.102:0/1573631078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576056bb650 0x557605840300 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f0df8067040 tx=0x7f0df8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.460+0000 7f0cf1602640 1 -- 172.21.15.102:0/1573631078 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0df8073070 con 0x5576056bb650 2024-09-13T19:16:38.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.460+0000 7f0cf1602640 1 -- 172.21.15.102:0/1573631078 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0df805a450 con 0x5576056bb650 2024-09-13T19:16:38.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.460+0000 7f0e08b32800 1 -- 172.21.15.102:0/1573631078 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557605840840 con 0x5576056bb650 2024-09-13T19:16:38.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.460+0000 7f0cf1602640 1 -- 172.21.15.102:0/1573631078 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0df805a730 con 0x5576056bb650 2024-09-13T19:16:38.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.460+0000 7f0e08b32800 1 -- 172.21.15.102:0/1573631078 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557605840dc0 con 0x5576056bb650 2024-09-13T19:16:38.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.461+0000 7f0cf1602640 1 -- 172.21.15.102:0/1573631078 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0df8076070 con 0x5576056bb650 2024-09-13T19:16:38.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.461+0000 7f0cf1602640 1 --2- 172.21.15.102:0/1573631078 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0cec036b40 0x7f0cec039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.461+0000 7f0cf1602640 1 -- 172.21.15.102:0/1573631078 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f0df8062070 con 0x5576056bb650 2024-09-13T19:16:38.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.461+0000 7f0dfffff640 1 --2- 172.21.15.102:0/1573631078 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0cec036b40 0x7f0cec039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.461+0000 7f0e08b32800 1 --2- 172.21.15.102:0/1573631078 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55760574a720 0x557605847370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.461+0000 7f0e08b32800 1 -- 172.21.15.102:0/1573631078 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5576058478b0 con 0x55760574a720 2024-09-13T19:16:38.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.461+0000 7f0e0505d640 1 --2- 172.21.15.102:0/1573631078 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55760574a720 0x557605847370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.462+0000 7f0dfffff640 1 --2- 172.21.15.102:0/1573631078 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0cec036b40 0x7f0cec039000 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0df0001e40 tx=0x7f0df00013a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.462+0000 7f0e0505d640 1 --2- 172.21.15.102:0/1573631078 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55760574a720 0x557605847370 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.462+0000 7f0e0505d640 1 -- 172.21.15.102:0/1573631078 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0e0000a4a0 con 0x55760574a720 2024-09-13T19:16:38.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.462+0000 7f0e08b32800 1 -- 172.21.15.102:0/1573631078 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557605844920 con 0x55760574a720 2024-09-13T19:16:38.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.462+0000 7f0e0505d640 1 -- 172.21.15.102:0/1573631078 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0e0000a4a0 con 0x55760574a720 2024-09-13T19:16:38.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.462+0000 7f0e08b32800 1 --2- 172.21.15.102:0/1573631078 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x557605849bc0 0x55760584bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.462+0000 7f0e08b32800 1 -- 172.21.15.102:0/1573631078 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55760584c650 con 0x557605849bc0 2024-09-13T19:16:38.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.462+0000 7f0e0485c640 1 --2- 172.21.15.102:0/1573631078 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x557605849bc0 0x55760584bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.463+0000 7f0e0485c640 1 --2- 172.21.15.102:0/1573631078 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x557605849bc0 0x55760584bfb0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.463+0000 7f0e0485c640 1 -- 172.21.15.102:0/1573631078 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0df8075030 con 0x557605849bc0 2024-09-13T19:16:38.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.463+0000 7f0e08b32800 1 -- 172.21.15.102:0/1573631078 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557605848a60 con 0x55760574a720 2024-09-13T19:16:38.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.463+0000 7f0e0505d640 1 -- 172.21.15.102:0/1573631078 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0e0000a4a0 con 0x55760574a720 2024-09-13T19:16:38.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.463+0000 7f0e08b32800 1 -- 172.21.15.102:0/1573631078 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557605848f40 con 0x557605849bc0 2024-09-13T19:16:38.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.463+0000 7f0e0485c640 1 -- 172.21.15.102:0/1573631078 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0df8075030 con 0x557605849bc0 2024-09-13T19:16:38.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.464+0000 7f0e08b32800 1 Processor -- start 2024-09-13T19:16:38.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.464+0000 7f0e08b32800 1 -- start start 2024-09-13T19:16:38.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.464+0000 7f0e08b32800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55760585afd0 0x55760585b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.464+0000 7f0e08b32800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5576055e2580 con 0x55760585afd0 2024-09-13T19:16:38.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.464+0000 7f0e0505d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55760585afd0 0x55760585b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.464+0000 7f0e0505d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55760585afd0 0x55760585b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55548/0 (socket says 172.21.15.102:55548) 2024-09-13T19:16:38.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.464+0000 7f0e0505d640 1 -- 172.21.15.102:0/2999280722 learned_addr learned my addr 172.21.15.102:0/2999280722 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:38.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.465+0000 7f0e0505d640 1 -- 172.21.15.102:0/2999280722 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55760585b930 con 0x55760585afd0 2024-09-13T19:16:38.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.465+0000 7f0e0505d640 1 --2- 172.21.15.102:0/2999280722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55760585afd0 0x55760585b3f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x5576058413b0 tx=0x7f0e000167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.465+0000 7f0cea7fc640 1 -- 172.21.15.102:0/2999280722 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e00013640 con 0x55760585afd0 2024-09-13T19:16:38.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.465+0000 7f0cea7fc640 1 -- 172.21.15.102:0/2999280722 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e000137e0 con 0x55760585afd0 2024-09-13T19:16:38.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.465+0000 7f0cea7fc640 1 -- 172.21.15.102:0/2999280722 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e00013ae0 con 0x55760585afd0 2024-09-13T19:16:38.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.465+0000 7f0e08b32800 1 -- 172.21.15.102:0/2999280722 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55760585bbc0 con 0x55760585afd0 2024-09-13T19:16:38.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.465+0000 7f0e08b32800 1 -- 172.21.15.102:0/2999280722 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55760585e8a0 con 0x55760585afd0 2024-09-13T19:16:38.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.466+0000 7f0cea7fc640 1 -- 172.21.15.102:0/2999280722 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0e00011040 con 0x55760585afd0 2024-09-13T19:16:38.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.466+0000 7f0cea7fc640 1 --2- 172.21.15.102:0/2999280722 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0cdc036bb0 0x7f0cdc039070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.466+0000 7f0cea7fc640 1 -- 172.21.15.102:0/2999280722 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f0e0000e040 con 0x55760585afd0 2024-09-13T19:16:38.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.466+0000 7f0e0485c640 1 --2- 172.21.15.102:0/2999280722 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0cdc036bb0 0x7f0cdc039070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.466+0000 7f0e08b32800 1 Processor -- start 2024-09-13T19:16:38.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.466+0000 7f0e08b32800 1 -- start start 2024-09-13T19:16:38.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.466+0000 7f0e0485c640 1 --2- 172.21.15.102:0/2999280722 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0cdc036bb0 0x7f0cdc039070 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0df808f870 tx=0x7f0df808f2f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.466+0000 7f0e08b32800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557605867ce0 0x5576058680e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.467+0000 7f0e08b32800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5576057460f0 con 0x557605867ce0 2024-09-13T19:16:38.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.467+0000 7f0e0505d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557605867ce0 0x5576058680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.467+0000 7f0e0505d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557605867ce0 0x5576058680e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55550/0 (socket says 172.21.15.102:55550) 2024-09-13T19:16:38.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.467+0000 7f0e0505d640 1 -- 172.21.15.102:0/2170944107 learned_addr learned my addr 172.21.15.102:0/2170944107 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:38.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.467+0000 7f0e0505d640 1 -- 172.21.15.102:0/2170944107 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576058686b0 con 0x557605867ce0 2024-09-13T19:16:38.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.467+0000 7f0e0505d640 1 --2- 172.21.15.102:0/2170944107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557605867ce0 0x5576058680e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f0e0000afb0 tx=0x7f0e0001fd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=595f7a81314b1035 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.467+0000 7f0cdbfff640 1 -- 172.21.15.102:0/2170944107 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e0004a070 con 0x557605867ce0 2024-09-13T19:16:38.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.467+0000 7f0cdbfff640 1 -- 172.21.15.102:0/2170944107 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e0001f340 con 0x557605867ce0 2024-09-13T19:16:38.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.467+0000 7f0cdbfff640 1 -- 172.21.15.102:0/2170944107 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e00014cc0 con 0x557605867ce0 2024-09-13T19:16:38.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.468+0000 7f0e08b32800 1 -- 172.21.15.102:0/2170944107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557605867ce0 msgr2=0x5576058680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.468+0000 7f0e08b32800 1 --2- 172.21.15.102:0/2170944107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557605867ce0 0x5576058680e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f0e0000afb0 tx=0x7f0e0001fd00 comp rx=0 tx=0).stop 2024-09-13T19:16:38.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.468+0000 7f0e08b32800 1 -- 172.21.15.102:0/2170944107 shutdown_connections 2024-09-13T19:16:38.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.468+0000 7f0e08b32800 1 --2- 172.21.15.102:0/2170944107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557605867ce0 0x5576058680e0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.468+0000 7f0e08b32800 1 -- 172.21.15.102:0/2170944107 >> 172.21.15.102:0/2170944107 conn(0x557605864040 msgr2=0x557605862140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:38.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.468+0000 7f0e08b32800 1 -- 172.21.15.102:0/2170944107 shutdown_connections 2024-09-13T19:16:38.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.468+0000 7f0e08b32800 1 -- 172.21.15.102:0/2170944107 wait complete. 2024-09-13T19:16:38.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.468+0000 7f0e08b32800 1 Processor -- start 2024-09-13T19:16:38.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.468+0000 7f0e08b32800 1 -- start start 2024-09-13T19:16:38.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.468+0000 7f0e08b32800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557605867ce0 0x55760586f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.468+0000 7f0e08b32800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557605868d20 con 0x557605867ce0 2024-09-13T19:16:38.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.468+0000 7f0e0505d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557605867ce0 0x55760586f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.468+0000 7f0e0505d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557605867ce0 0x55760586f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55566/0 (socket says 172.21.15.102:55566) 2024-09-13T19:16:38.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.468+0000 7f0e0505d640 1 -- 172.21.15.102:0/852731885 learned_addr learned my addr 172.21.15.102:0/852731885 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:38.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.469+0000 7f0e0505d640 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55760586f690 con 0x557605867ce0 2024-09-13T19:16:38.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.469+0000 7f0e0505d640 1 --2- 172.21.15.102:0/852731885 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557605867ce0 0x55760586f150 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f0e0000a120 tx=0x7f0e0004cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.469+0000 7f0cda7fc640 1 -- 172.21.15.102:0/852731885 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e0001f9f0 con 0x557605867ce0 2024-09-13T19:16:38.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.469+0000 7f0cda7fc640 1 -- 172.21.15.102:0/852731885 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e00040340 con 0x557605867ce0 2024-09-13T19:16:38.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.469+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55760586f920 con 0x557605867ce0 2024-09-13T19:16:38.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.469+0000 7f0cda7fc640 1 -- 172.21.15.102:0/852731885 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e000205b0 con 0x557605867ce0 2024-09-13T19:16:38.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.469+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576058725d0 con 0x557605867ce0 2024-09-13T19:16:38.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.470+0000 7f0cda7fc640 1 -- 172.21.15.102:0/852731885 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0e00020770 con 0x557605867ce0 2024-09-13T19:16:38.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.470+0000 7f0cda7fc640 1 --2- 172.21.15.102:0/852731885 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0cd0036b90 0x7f0cd0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.470+0000 7f0cda7fc640 1 -- 172.21.15.102:0/852731885 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f0e0002f070 con 0x557605867ce0 2024-09-13T19:16:38.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.470+0000 7f0e0485c640 1 --2- 172.21.15.102:0/852731885 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0cd0036b90 0x7f0cd0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.470+0000 7f0e0485c640 1 --2- 172.21.15.102:0/852731885 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0cd0036b90 0x7f0cd0039050 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x557605847d00 tx=0x7f0df808e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.471+0000 7f0e08b32800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.471+0000 7f0e08b32800 1 --2- 172.21.15.102:0/852731885 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55760587abe0 0x55760587d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.471+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55760587d7f0 con 0x55760587abe0 2024-09-13T19:16:38.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.471+0000 7f0dfffff640 1 --2- 172.21.15.102:0/852731885 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55760587abe0 0x55760587d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.471+0000 7f0dfffff640 1 --2- 172.21.15.102:0/852731885 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55760587abe0 0x55760587d0a0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.471+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0df000f670 con 0x55760587abe0 2024-09-13T19:16:38.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.471+0000 7f0e08b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:38.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.471+0000 7f0e08b32800 20 realm 2024-09-13T19:16:38.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.471+0000 7f0e08b32800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.471+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55760587a030 con 0x55760587abe0 2024-09-13T19:16:38.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.471+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0df000f670 con 0x55760587abe0 2024-09-13T19:16:38.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.471+0000 7f0e08b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:38.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.471+0000 7f0e08b32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:38.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.471+0000 7f0e08b32800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.471+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55760587e2e0 con 0x55760587abe0 2024-09-13T19:16:38.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.472+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0df000f670 con 0x55760587abe0 2024-09-13T19:16:38.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.472+0000 7f0e08b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:38.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.472+0000 7f0e08b32800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.472+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55760587ebb0 con 0x55760587abe0 2024-09-13T19:16:38.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.472+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0df000f670 con 0x55760587abe0 2024-09-13T19:16:38.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.472+0000 7f0e08b32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:38.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.472+0000 7f0e08b32800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.472+0000 7f0e08b32800 1 --2- 172.21.15.102:0/852731885 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55760587f4b0 0x5576058818e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.472+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557605882070 con 0x55760587f4b0 2024-09-13T19:16:38.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.472+0000 7f0e0505d640 1 --2- 172.21.15.102:0/852731885 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55760587f4b0 0x5576058818e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.472+0000 7f0e0505d640 1 --2- 172.21.15.102:0/852731885 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55760587f4b0 0x5576058818e0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.473+0000 7f0e0505d640 1 -- 172.21.15.102:0/852731885 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0e00038020 con 0x55760587f4b0 2024-09-13T19:16:38.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.473+0000 7f0e08b32800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:38.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.473+0000 7f0e08b32800 20 searching for the correct realm 2024-09-13T19:16:38.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.473+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5576058839c0 con 0x55760587f4b0 2024-09-13T19:16:38.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.473+0000 7f0e0505d640 1 -- 172.21.15.102:0/852731885 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e00038020 con 0x55760587f4b0 2024-09-13T19:16:38.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.473+0000 7f0e0505d640 1 --2- 172.21.15.102:0/852731885 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f0e00032030 0x7f0e0003d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.473+0000 7f0e0505d640 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5576058839c0 con 0x7f0e00032030 2024-09-13T19:16:38.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.473+0000 7f0e0485c640 1 --2- 172.21.15.102:0/852731885 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f0e00032030 0x7f0e0003d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.473+0000 7f0e0485c640 1 --2- 172.21.15.102:0/852731885 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f0e00032030 0x7f0e0003d3b0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.474+0000 7f0e0485c640 1 -- 172.21.15.102:0/852731885 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0df80a8040 con 0x7f0e00032030 2024-09-13T19:16:38.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.474+0000 7f0e0485c640 1 --2- 172.21.15.102:0/852731885 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f0df809f040 0x7f0df805a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.474+0000 7f0e0485c640 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5576058839c0 con 0x7f0df809f040 2024-09-13T19:16:38.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.474+0000 7f0dfffff640 1 --2- 172.21.15.102:0/852731885 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f0df809f040 0x7f0df805a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.474+0000 7f0dfffff640 1 --2- 172.21.15.102:0/852731885 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f0df809f040 0x7f0df805a960 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.474+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0df000f670 con 0x7f0df809f040 2024-09-13T19:16:38.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.474+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5576058839c0 con 0x55760587abe0 2024-09-13T19:16:38.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.475+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0df000f670 con 0x55760587abe0 2024-09-13T19:16:38.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.475+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5576058839c0 con 0x55760587abe0 2024-09-13T19:16:38.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.475+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0df002b040 con 0x55760587abe0 2024-09-13T19:16:38.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.475+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5576058839c0 con 0x7f0df809f040 2024-09-13T19:16:38.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.475+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0df002b040 con 0x7f0df809f040 2024-09-13T19:16:38.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.475+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5576058839c0 con 0x7f0df809f040 2024-09-13T19:16:38.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.475+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0df002b040 con 0x7f0df809f040 2024-09-13T19:16:38.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.475+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5576058839c0 con 0x7f0e00032030 2024-09-13T19:16:38.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.476+0000 7f0e0485c640 1 -- 172.21.15.102:0/852731885 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0df80a8040 con 0x7f0e00032030 2024-09-13T19:16:38.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.476+0000 7f0e0485c640 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5576058839c0 con 0x55760587f4b0 2024-09-13T19:16:38.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.476+0000 7f0e0505d640 1 -- 172.21.15.102:0/852731885 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e00038020 con 0x55760587f4b0 2024-09-13T19:16:38.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.476+0000 7f0e0505d640 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5576058839c0 con 0x55760587abe0 2024-09-13T19:16:38.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.476+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0df002b040 con 0x55760587abe0 2024-09-13T19:16:38.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.476+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5576058839c0 con 0x7f0e00032030 2024-09-13T19:16:38.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.476+0000 7f0e0485c640 1 -- 172.21.15.102:0/852731885 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0df80a8040 con 0x7f0e00032030 2024-09-13T19:16:38.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.476+0000 7f0e0485c640 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5576058839c0 con 0x55760587abe0 2024-09-13T19:16:38.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.477+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0df002b040 con 0x55760587abe0 2024-09-13T19:16:38.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.477+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5576058839c0 con 0x7f0e00032030 2024-09-13T19:16:38.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.477+0000 7f0e0485c640 1 -- 172.21.15.102:0/852731885 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0df80a8040 con 0x7f0e00032030 2024-09-13T19:16:38.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.477+0000 7f0e0485c640 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5576058839c0 con 0x55760587f4b0 2024-09-13T19:16:38.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.477+0000 7f0e0505d640 1 -- 172.21.15.102:0/852731885 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e00038020 con 0x55760587f4b0 2024-09-13T19:16:38.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.477+0000 7f0e0505d640 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5576058839c0 con 0x55760587f4b0 2024-09-13T19:16:38.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.477+0000 7f0e0505d640 1 -- 172.21.15.102:0/852731885 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0e00038020 con 0x55760587f4b0 2024-09-13T19:16:38.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.477+0000 7f0e0505d640 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5576058839c0 con 0x7f0df809f040 2024-09-13T19:16:38.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.478+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0df002b040 con 0x7f0df809f040 2024-09-13T19:16:38.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.478+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5576058839c0 con 0x55760587f4b0 2024-09-13T19:16:38.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.478+0000 7f0e0505d640 1 -- 172.21.15.102:0/852731885 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0e00038020 con 0x55760587f4b0 2024-09-13T19:16:38.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.478+0000 7f0e0505d640 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5576058839c0 con 0x55760587f4b0 2024-09-13T19:16:38.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.478+0000 7f0e0505d640 1 -- 172.21.15.102:0/852731885 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e00038020 con 0x55760587f4b0 2024-09-13T19:16:38.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.478+0000 7f0e0505d640 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5576058839c0 con 0x55760587abe0 2024-09-13T19:16:38.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.478+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0df002b040 con 0x55760587abe0 2024-09-13T19:16:38.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.478+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5576058839c0 con 0x55760587abe0 2024-09-13T19:16:38.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.478+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0df002b040 con 0x55760587abe0 2024-09-13T19:16:38.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.478+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5576058839c0 con 0x7f0df809f040 2024-09-13T19:16:38.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.479+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0df002b040 con 0x7f0df809f040 2024-09-13T19:16:38.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.479+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5576058839c0 con 0x55760587f4b0 2024-09-13T19:16:38.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.479+0000 7f0e0505d640 1 -- 172.21.15.102:0/852731885 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e00038020 con 0x55760587f4b0 2024-09-13T19:16:38.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.479+0000 7f0e0505d640 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5576058839c0 con 0x7f0e00032030 2024-09-13T19:16:38.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.479+0000 7f0e0485c640 1 -- 172.21.15.102:0/852731885 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0df80a8040 con 0x7f0e00032030 2024-09-13T19:16:38.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.479+0000 7f0e0485c640 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5576058839c0 con 0x55760587abe0 2024-09-13T19:16:38.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.479+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0df002b040 con 0x55760587abe0 2024-09-13T19:16:38.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.479+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5576058839c0 con 0x7f0e00032030 2024-09-13T19:16:38.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.480+0000 7f0e0485c640 1 -- 172.21.15.102:0/852731885 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0df80a8040 con 0x7f0e00032030 2024-09-13T19:16:38.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.480+0000 7f0e0485c640 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5576058839c0 con 0x55760587f4b0 2024-09-13T19:16:38.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.480+0000 7f0e0505d640 1 -- 172.21.15.102:0/852731885 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e00038020 con 0x55760587f4b0 2024-09-13T19:16:38.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.480+0000 7f0e0505d640 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5576058839c0 con 0x7f0df809f040 2024-09-13T19:16:38.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.480+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0df002b040 con 0x7f0df809f040 2024-09-13T19:16:38.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.480+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5576058839c0 con 0x7f0e00032030 2024-09-13T19:16:38.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.480+0000 7f0e0485c640 1 -- 172.21.15.102:0/852731885 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0df80a8040 con 0x7f0e00032030 2024-09-13T19:16:38.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.480+0000 7f0e0485c640 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5576058839c0 con 0x55760587f4b0 2024-09-13T19:16:38.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.481+0000 7f0e0505d640 1 -- 172.21.15.102:0/852731885 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e00038020 con 0x55760587f4b0 2024-09-13T19:16:38.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.481+0000 7f0e0505d640 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f0e00064040 con 0x7f0df809f040 2024-09-13T19:16:38.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.481+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0df002b040 con 0x7f0df809f040 2024-09-13T19:16:38.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.481+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f0e00064040 con 0x55760587abe0 2024-09-13T19:16:38.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.481+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0df002b040 con 0x55760587abe0 2024-09-13T19:16:38.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.481+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f0e00064040 con 0x7f0e00032030 2024-09-13T19:16:38.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.481+0000 7f0e0485c640 1 -- 172.21.15.102:0/852731885 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0df80a8040 con 0x7f0e00032030 2024-09-13T19:16:38.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.482+0000 7f0e08b32800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:38.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.482+0000 7f0e08b32800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:38.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.482+0000 7f0e08b32800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:38.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.482+0000 7f0e08b32800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:38.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.482+0000 7f0e08b32800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:38.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.482+0000 7f0e08b32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:38.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.482+0000 7f0e08b32800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.482+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557605882a30 con 0x55760587abe0 2024-09-13T19:16:38.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.482+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0df002b040 con 0x55760587abe0 2024-09-13T19:16:38.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.482+0000 7f0e08b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:38.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.482+0000 7f0e08b32800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.482+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5576058832d0 con 0x55760587abe0 2024-09-13T19:16:38.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.482+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0df002b040 con 0x55760587abe0 2024-09-13T19:16:38.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.482+0000 7f0e08b32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:38.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.482+0000 7f0e08b32800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.482+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557605883e40 con 0x55760587f4b0 2024-09-13T19:16:38.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.482+0000 7f0e0505d640 1 -- 172.21.15.102:0/852731885 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0e00038020 con 0x55760587f4b0 2024-09-13T19:16:38.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.482+0000 7f0e08b32800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:38.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.482+0000 7f0e08b32800 20 zone default found 2024-09-13T19:16:38.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.482+0000 7f0e08b32800 4 Realm: () 2024-09-13T19:16:38.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.482+0000 7f0e08b32800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:38.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.482+0000 7f0e08b32800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:38.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.482+0000 7f0e08b32800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:38.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.482+0000 7f0e08b32800 20 zonegroup default 2024-09-13T19:16:38.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.482+0000 7f0e08b32800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.482+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557605882f30 con 0x7f0e00032030 2024-09-13T19:16:38.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.483+0000 7f0e0485c640 1 -- 172.21.15.102:0/852731885 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0df80a8040 con 0x7f0e00032030 2024-09-13T19:16:38.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.483+0000 7f0e08b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:38.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.483+0000 7f0e08b32800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.483+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5576058865c0 con 0x55760587f4b0 2024-09-13T19:16:38.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.483+0000 7f0e0505d640 1 -- 172.21.15.102:0/852731885 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0e00038020 con 0x55760587f4b0 2024-09-13T19:16:38.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.483+0000 7f0e08b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:38.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.483+0000 7f0e08b32800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.483+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557605886960 con 0x55760587f4b0 2024-09-13T19:16:38.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.483+0000 7f0e0505d640 1 -- 172.21.15.102:0/852731885 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0e00038020 con 0x55760587f4b0 2024-09-13T19:16:38.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.483+0000 7f0e08b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:38.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.483+0000 7f0e08b32800 20 started sync module instance, tier type = 2024-09-13T19:16:38.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.483+0000 7f0e08b32800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:38.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.483+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557605885a00 con 0x7f0e00032030 2024-09-13T19:16:38.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.484+0000 7f0e0485c640 1 -- 172.21.15.102:0/852731885 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(44 notify.0 [create] v36'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0df80a8040 con 0x7f0e00032030 2024-09-13T19:16:38.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.484+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93965387324960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557605886e10 con 0x7f0e00032030 2024-09-13T19:16:38.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.484+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557605887660 con 0x55760587abe0 2024-09-13T19:16:38.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.485+0000 7f0e0485c640 1 -- 172.21.15.102:0/852731885 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93965387324960] v36'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0df80a8040 con 0x7f0e00032030 2024-09-13T19:16:38.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.486+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v36'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0df002b040 con 0x55760587abe0 2024-09-13T19:16:38.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.486+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93965387329968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557605887a00 con 0x55760587abe0 2024-09-13T19:16:38.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.486+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5576058884d0 con 0x55760587f4b0 2024-09-13T19:16:38.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.487+0000 7f0e0505d640 1 -- 172.21.15.102:0/852731885 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v36'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e00038020 con 0x55760587f4b0 2024-09-13T19:16:38.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.487+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93965387333568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5576058884d0 con 0x55760587f4b0 2024-09-13T19:16:38.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.487+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5576058894d0 con 0x7f0e00032030 2024-09-13T19:16:38.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.487+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93965387329968] v36'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0df002b040 con 0x55760587abe0 2024-09-13T19:16:38.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.488+0000 7f0e0505d640 1 -- 172.21.15.102:0/852731885 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93965387333568] v36'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e00038020 con 0x55760587f4b0 2024-09-13T19:16:38.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.488+0000 7f0e0485c640 1 -- 172.21.15.102:0/852731885 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(50 notify.3 [create] v36'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0df80a8040 con 0x7f0e00032030 2024-09-13T19:16:38.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.488+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93965387335920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557605886960 con 0x7f0e00032030 2024-09-13T19:16:38.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.488+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557605889ee0 con 0x55760587abe0 2024-09-13T19:16:38.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.489+0000 7f0e0485c640 1 -- 172.21.15.102:0/852731885 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93965387335920] v36'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0df80a8040 con 0x7f0e00032030 2024-09-13T19:16:38.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.489+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v36'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0df002b040 con 0x55760587abe0 2024-09-13T19:16:38.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.489+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93965387337664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557605889ee0 con 0x55760587abe0 2024-09-13T19:16:38.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.489+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55760588a8a0 con 0x7f0df809f040 2024-09-13T19:16:38.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.490+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(54 notify.5 [create] v36'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0df002b040 con 0x7f0df809f040 2024-09-13T19:16:38.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.490+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93965387342832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55760588acc0 con 0x7f0df809f040 2024-09-13T19:16:38.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.490+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55760588b7c0 con 0x7f0df809f040 2024-09-13T19:16:38.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.490+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93965387337664] v36'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0df002b040 con 0x55760587abe0 2024-09-13T19:16:38.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.491+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(56 notify.6 [create] v36'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0df002b040 con 0x7f0df809f040 2024-09-13T19:16:38.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.491+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93965387346608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55760588b780 con 0x7f0df809f040 2024-09-13T19:16:38.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.491+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55760588c1a0 con 0x7f0df809f040 2024-09-13T19:16:38.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.491+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 93965387342832] v36'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0df002b040 con 0x7f0df809f040 2024-09-13T19:16:38.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.492+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 93965387346608] v36'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0df002b040 con 0x7f0df809f040 2024-09-13T19:16:38.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.492+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(58 notify.7 [create] v36'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0df002b040 con 0x7f0df809f040 2024-09-13T19:16:38.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.492+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93965387340336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55760588a810 con 0x7f0df809f040 2024-09-13T19:16:38.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.492+0000 7f0e08b32800 20 add_watcher() i=0 2024-09-13T19:16:38.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.492+0000 7f0e08b32800 20 add_watcher() i=1 2024-09-13T19:16:38.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.492+0000 7f0e08b32800 20 add_watcher() i=2 2024-09-13T19:16:38.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.492+0000 7f0e08b32800 20 add_watcher() i=3 2024-09-13T19:16:38.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.492+0000 7f0e08b32800 20 add_watcher() i=4 2024-09-13T19:16:38.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.492+0000 7f0e08b32800 20 add_watcher() i=5 2024-09-13T19:16:38.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.492+0000 7f0e08b32800 20 add_watcher() i=6 2024-09-13T19:16:38.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.493+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 93965387340336] v36'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0df002b040 con 0x7f0df809f040 2024-09-13T19:16:38.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.493+0000 7f0e08b32800 20 add_watcher() i=7 2024-09-13T19:16:38.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.493+0000 7f0e08b32800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:38.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.493+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55760588f190 con 0x55760587abe0 2024-09-13T19:16:38.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.494+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0df002b040 con 0x55760587abe0 2024-09-13T19:16:38.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.494+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93965387349136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55760588c610 con 0x55760587abe0 2024-09-13T19:16:38.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.494+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93965387349136] v36'187 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0df002b040 con 0x55760587abe0 2024-09-13T19:16:38.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.495+0000 7f0cbafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:38.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.495+0000 7f0e08b32800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:38.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.495+0000 7f0e08b32800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:38.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.495+0000 7f0e08b32800 5 note: GC not initialized 2024-09-13T19:16:38.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.495+0000 7f0cb9fe3640 20 reqs_thread_entry: start 2024-09-13T19:16:38.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.495+0000 7f0e08b32800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:38.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.495+0000 7f0e08b32800 20 Filter name: none 2024-09-13T19:16:38.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.495+0000 7f0c2b7fe640 20 reqs_thread_entry: start 2024-09-13T19:16:38.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.495+0000 7f0e08b32800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:16:38.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.495+0000 7f0e08b32800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.495+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5576058c2510 con 0x55760587abe0 2024-09-13T19:16:38.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.496+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f0df002b040 con 0x55760587abe0 2024-09-13T19:16:38.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.496+0000 7f0e08b32800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:16:38.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.496+0000 7f0e08b32800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:16:38.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.496+0000 7f0e08b32800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:16:38.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.496+0000 7f0e08b32800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:16:38.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.496+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~403 in=403b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5576058c8760 con 0x55760587abe0 2024-09-13T19:16:38.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.497+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~403] v36'14 uv14 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f0df002b040 con 0x55760587abe0 2024-09-13T19:16:38.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.497+0000 7f0e08b32800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:16:38.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.497+0000 7f0e08b32800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:16:38.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.497+0000 7f0e08b32800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T19:16:38.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.497+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93965387596096 in=591b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5576058c3f90 con 0x55760587abe0 2024-09-13T19:16:38.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.497+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== watch-notify(notify (1) cookie 93965387337664 notify 154618822684 ret 0) ==== 621+0+0 (crc 0 0 0) 0x7f0df0018040 con 0x55760587abe0 2024-09-13T19:16:38.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.497+0000 7f0cdbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822684 cookie 93965387337664 notifier 4664 bl.length()=579 2024-09-13T19:16:38.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.497+0000 7f0cdbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:16:38.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.497+0000 7f0cdbfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:16:38.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.497+0000 7f0cdbfff640 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f0cc8003ea0 con 0x55760587abe0 2024-09-13T19:16:38.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.497+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(64 notify.4 [notify cookie 93965387596096 out=8b] v0'0 uv180 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0df002b040 con 0x55760587abe0 2024-09-13T19:16:38.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.497+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0df002b040 con 0x55760587abe0 2024-09-13T19:16:38.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.497+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== watch-notify(notify_complete (2) cookie 93965387596096 notify 154618822684 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f0df0009050 con 0x55760587abe0 2024-09-13T19:16:38.529 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:16:14.779675Z"}],"swift_keys":[],"caps":[{"type":"user","perm":"read"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:16:14.779665Z","tags":[],"group_ids":[]} 2024-09-13T19:16:38.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.498+0000 7f0cbafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:38.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.498+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93965387349136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5576058c0260 con 0x55760587abe0 2024-09-13T19:16:38.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.499+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93965387349136] v36'188 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0df002b040 con 0x55760587abe0 2024-09-13T19:16:38.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.499+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93965387324960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5576058c0260 con 0x7f0e00032030 2024-09-13T19:16:38.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.500+0000 7f0e0485c640 1 -- 172.21.15.102:0/852731885 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93965387324960] v36'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0df80a8040 con 0x7f0e00032030 2024-09-13T19:16:38.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.500+0000 7f0e08b32800 20 remove_watcher() i=0 2024-09-13T19:16:38.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.500+0000 7f0e08b32800 2 removed watcher, disabling cache 2024-09-13T19:16:38.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.500+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93965387329968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5576058c0260 con 0x55760587abe0 2024-09-13T19:16:38.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.501+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 <== osd.1 v2:172.21.15.102:6808/2204418452 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93965387329968] v36'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0df002b040 con 0x55760587abe0 2024-09-13T19:16:38.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.501+0000 7f0e08b32800 20 remove_watcher() i=1 2024-09-13T19:16:38.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.501+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93965387333568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5576058c0260 con 0x55760587f4b0 2024-09-13T19:16:38.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.502+0000 7f0e0505d640 1 -- 172.21.15.102:0/852731885 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93965387333568] v36'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e00038020 con 0x55760587f4b0 2024-09-13T19:16:38.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.502+0000 7f0e08b32800 20 remove_watcher() i=2 2024-09-13T19:16:38.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.502+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93965387335920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5576058c0260 con 0x7f0e00032030 2024-09-13T19:16:38.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.503+0000 7f0e0485c640 1 -- 172.21.15.102:0/852731885 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93965387335920] v36'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0df80a8040 con 0x7f0e00032030 2024-09-13T19:16:38.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.503+0000 7f0e08b32800 20 remove_watcher() i=3 2024-09-13T19:16:38.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.503+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93965387337664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5576058c0260 con 0x55760587abe0 2024-09-13T19:16:38.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.505+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 <== osd.1 v2:172.21.15.102:6808/2204418452 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93965387337664] v36'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0df002b040 con 0x55760587abe0 2024-09-13T19:16:38.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.505+0000 7f0e08b32800 20 remove_watcher() i=4 2024-09-13T19:16:38.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.505+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93965387342832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5576058c0260 con 0x7f0df809f040 2024-09-13T19:16:38.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.506+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93965387342832] v36'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0df002b040 con 0x7f0df809f040 2024-09-13T19:16:38.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.506+0000 7f0e08b32800 20 remove_watcher() i=5 2024-09-13T19:16:38.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.506+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93965387346608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5576058c0260 con 0x7f0df809f040 2024-09-13T19:16:38.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.507+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93965387346608] v36'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0df002b040 con 0x7f0df809f040 2024-09-13T19:16:38.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.507+0000 7f0e08b32800 20 remove_watcher() i=6 2024-09-13T19:16:38.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.507+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93965387340336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5576058c0260 con 0x7f0df809f040 2024-09-13T19:16:38.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.508+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93965387340336] v36'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0df002b040 con 0x7f0df809f040 2024-09-13T19:16:38.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.508+0000 7f0e08b32800 20 remove_watcher() i=7 2024-09-13T19:16:38.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.508+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f0df809f040 msgr2=0x7f0df805a960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.508+0000 7f0e08b32800 1 --2- 172.21.15.102:0/852731885 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f0df809f040 0x7f0df805a960 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.508+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55760587abe0 msgr2=0x55760587d0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.508+0000 7f0e08b32800 1 --2- 172.21.15.102:0/852731885 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55760587abe0 0x55760587d0a0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.508+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f0e00032030 msgr2=0x7f0e0003d3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.508+0000 7f0e08b32800 1 --2- 172.21.15.102:0/852731885 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f0e00032030 0x7f0e0003d3b0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.508+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55760587f4b0 msgr2=0x5576058818e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.508+0000 7f0e08b32800 1 --2- 172.21.15.102:0/852731885 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55760587f4b0 0x5576058818e0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.508+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0cd0036b90 msgr2=0x7f0cd0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.508+0000 7f0e08b32800 1 --2- 172.21.15.102:0/852731885 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0cd0036b90 0x7f0cd0039050 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x557605847d00 tx=0x7f0df808e000 comp rx=0 tx=0).stop 2024-09-13T19:16:38.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.508+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557605867ce0 msgr2=0x55760586f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.508+0000 7f0dfffff640 1 -- 172.21.15.102:0/852731885 reap_dead start 2024-09-13T19:16:38.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.508+0000 7f0e08b32800 1 --2- 172.21.15.102:0/852731885 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557605867ce0 0x55760586f150 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f0e0000a120 tx=0x7f0e0004cdb0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.508+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 shutdown_connections 2024-09-13T19:16:38.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.508+0000 7f0e08b32800 1 --2- 172.21.15.102:0/852731885 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557605867ce0 0x55760586f150 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.508+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 >> 172.21.15.102:0/852731885 conn(0x557605864040 msgr2=0x557605862110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:38.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.508+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 shutdown_connections 2024-09-13T19:16:38.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.508+0000 7f0e08b32800 1 -- 172.21.15.102:0/852731885 wait complete. 2024-09-13T19:16:38.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.509+0000 7f0e08b32800 1 -- 172.21.15.102:0/2999280722 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0cdc036bb0 msgr2=0x7f0cdc039070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.509+0000 7f0e08b32800 1 --2- 172.21.15.102:0/2999280722 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0cdc036bb0 0x7f0cdc039070 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0df808f870 tx=0x7f0df808f2f0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.509+0000 7f0e08b32800 1 -- 172.21.15.102:0/2999280722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55760585afd0 msgr2=0x55760585b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.509+0000 7f0e08b32800 1 --2- 172.21.15.102:0/2999280722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55760585afd0 0x55760585b3f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x5576058413b0 tx=0x7f0e000167b0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.509+0000 7f0e08b32800 1 -- 172.21.15.102:0/2999280722 shutdown_connections 2024-09-13T19:16:38.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.509+0000 7f0e08b32800 1 --2- 172.21.15.102:0/2999280722 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0cdc036bb0 0x7f0cdc039070 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.509+0000 7f0e08b32800 1 --2- 172.21.15.102:0/2999280722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55760585afd0 0x55760585b3f0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.509+0000 7f0e08b32800 1 -- 172.21.15.102:0/2999280722 >> 172.21.15.102:0/2999280722 conn(0x55760584ff60 msgr2=0x557605852ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:38.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.509+0000 7f0e08b32800 1 -- 172.21.15.102:0/2999280722 shutdown_connections 2024-09-13T19:16:38.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.509+0000 7f0e08b32800 1 -- 172.21.15.102:0/2999280722 wait complete. 2024-09-13T19:16:38.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.509+0000 7f0e08b32800 1 -- 172.21.15.102:0/1573631078 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55760574a720 msgr2=0x557605847370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.509+0000 7f0e08b32800 1 --2- 172.21.15.102:0/1573631078 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55760574a720 0x557605847370 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.509+0000 7f0e08b32800 1 -- 172.21.15.102:0/1573631078 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x557605849bc0 msgr2=0x55760584bfb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.509+0000 7f0e08b32800 1 --2- 172.21.15.102:0/1573631078 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x557605849bc0 0x55760584bfb0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.509+0000 7f0e08b32800 1 -- 172.21.15.102:0/1573631078 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0cec036b40 msgr2=0x7f0cec039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.509+0000 7f0e08b32800 1 --2- 172.21.15.102:0/1573631078 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0cec036b40 0x7f0cec039000 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0df0001e40 tx=0x7f0df00013a0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.509+0000 7f0e08b32800 1 -- 172.21.15.102:0/1573631078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576056bb650 msgr2=0x557605840300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.509+0000 7f0e08b32800 1 --2- 172.21.15.102:0/1573631078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576056bb650 0x557605840300 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f0df8067040 tx=0x7f0df8002fb0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.509+0000 7f0e08b32800 1 -- 172.21.15.102:0/1573631078 shutdown_connections 2024-09-13T19:16:38.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.509+0000 7f0e08b32800 1 --2- 172.21.15.102:0/1573631078 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x557605849bc0 0x55760584bfb0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.509+0000 7f0e08b32800 1 --2- 172.21.15.102:0/1573631078 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55760574a720 0x557605847370 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.509+0000 7f0e08b32800 1 --2- 172.21.15.102:0/1573631078 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0cec036b40 0x7f0cec039000 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.509+0000 7f0e08b32800 1 --2- 172.21.15.102:0/1573631078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5576056bb650 0x557605840300 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.509+0000 7f0e08b32800 1 -- 172.21.15.102:0/1573631078 >> 172.21.15.102:0/1573631078 conn(0x557605741db0 msgr2=0x557605746620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:38.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.509+0000 7f0e08b32800 1 -- 172.21.15.102:0/1573631078 shutdown_connections 2024-09-13T19:16:38.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.509+0000 7f0e08b32800 1 -- 172.21.15.102:0/1573631078 wait complete. 2024-09-13T19:16:38.543 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:16:14.779675Z'}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:16:14.779665Z', 'tags': [], 'group_ids': []} 2024-09-13T19:16:38.543 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-13T19:16:38.543 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-13T19:16:38.543 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2024-09-13T19:16:38.589 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:38.589 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:38.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.587+0000 7f8b17810800 1 Processor -- start 2024-09-13T19:16:38.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.587+0000 7f8b17810800 1 -- start start 2024-09-13T19:16:38.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.587+0000 7f8b17810800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5582f98d44e0 0x5582f98d48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.587+0000 7f8b17810800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5582f9794b30 con 0x5582f98d4e20 2024-09-13T19:16:38.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.587+0000 7f8b17810800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5582f9776360 con 0x5582f98d44e0 2024-09-13T19:16:38.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.587+0000 7f8b12f84640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5582f98d44e0 0x5582f98d48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.587+0000 7f8b12f84640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5582f98d44e0 0x5582f98d48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55584/0 (socket says 172.21.15.102:55584) 2024-09-13T19:16:38.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.587+0000 7f8b12783640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5582f98d4e20 0x5582f98d99a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:48538/0 (socket says 172.21.15.102:48538) 2024-09-13T19:16:38.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.587+0000 7f8b12f84640 1 -- 172.21.15.102:0/782396907 learned_addr learned my addr 172.21.15.102:0/782396907 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:38.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.588+0000 7f8b12f84640 1 -- 172.21.15.102:0/782396907 >> v1:172.21.15.53:6789/0 conn(0x5582f98d4e20 legacy=0x5582f98d99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.588+0000 7f8b11f82640 1 -- 172.21.15.102:0/782396907 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3617328402 0 0) 0x5582f9794b30 con 0x5582f98d4e20 2024-09-13T19:16:38.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.588+0000 7f8b12f84640 1 -- 172.21.15.102:0/782396907 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582f979ce00 con 0x5582f98d44e0 2024-09-13T19:16:38.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.589+0000 7f8b12f84640 1 --2- 172.21.15.102:0/782396907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582f98d44e0 0x5582f98d48e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f8b0400a520 tx=0x7f8b04045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce61d40837cac67f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.590+0000 7f8b11f82640 1 -- 172.21.15.102:0/782396907 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b04055070 con 0x5582f98d44e0 2024-09-13T19:16:38.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.590+0000 7f8b11f82640 1 -- 172.21.15.102:0/782396907 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b040515b0 con 0x5582f98d44e0 2024-09-13T19:16:38.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.590+0000 7f8b11f82640 1 -- 172.21.15.102:0/782396907 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b040518d0 con 0x5582f98d44e0 2024-09-13T19:16:38.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.590+0000 7f8b17810800 1 -- 172.21.15.102:0/782396907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582f98d44e0 msgr2=0x5582f98d48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.590+0000 7f8b17810800 1 --2- 172.21.15.102:0/782396907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582f98d44e0 0x5582f98d48e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f8b0400a520 tx=0x7f8b04045ba0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.590+0000 7f8b17810800 1 -- 172.21.15.102:0/782396907 shutdown_connections 2024-09-13T19:16:38.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.590+0000 7f8b17810800 1 --2- 172.21.15.102:0/782396907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582f98d44e0 0x5582f98d48e0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.590+0000 7f8b17810800 1 -- 172.21.15.102:0/782396907 >> 172.21.15.102:0/782396907 conn(0x5582f98cfdd0 msgr2=0x5582f98d21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:38.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.590+0000 7f8b17810800 1 -- 172.21.15.102:0/782396907 shutdown_connections 2024-09-13T19:16:38.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.590+0000 7f8b17810800 1 -- 172.21.15.102:0/782396907 wait complete. 2024-09-13T19:16:38.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.604+0000 7f8b17810800 1 Processor -- start 2024-09-13T19:16:38.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.604+0000 7f8b17810800 1 -- start start 2024-09-13T19:16:38.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.604+0000 7f8b17810800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582f98d44e0 0x5582f9848da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.604+0000 7f8b17810800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5582f9821360 con 0x5582f98d44e0 2024-09-13T19:16:38.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.605+0000 7f8b12f84640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582f98d44e0 0x5582f9848da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.605+0000 7f8b12f84640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582f98d44e0 0x5582f9848da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55594/0 (socket says 172.21.15.102:55594) 2024-09-13T19:16:38.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.605+0000 7f8b12f84640 1 -- 172.21.15.102:0/1570490199 learned_addr learned my addr 172.21.15.102:0/1570490199 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:38.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.605+0000 7f8b12f84640 1 -- 172.21.15.102:0/1570490199 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582f976ebc0 con 0x5582f98d44e0 2024-09-13T19:16:38.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.605+0000 7f8b12f84640 1 --2- 172.21.15.102:0/1570490199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582f98d44e0 0x5582f9848da0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f8b04025da0 tx=0x7f8b04051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f40df7d1b1fef9e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.605+0000 7f8a00e09640 1 -- 172.21.15.102:0/1570490199 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b04051ac0 con 0x5582f98d44e0 2024-09-13T19:16:38.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.605+0000 7f8a00e09640 1 -- 172.21.15.102:0/1570490199 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b04051c60 con 0x5582f98d44e0 2024-09-13T19:16:38.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.605+0000 7f8a00e09640 1 -- 172.21.15.102:0/1570490199 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b04066460 con 0x5582f98d44e0 2024-09-13T19:16:38.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.606+0000 7f8b17810800 1 -- 172.21.15.102:0/1570490199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582f98d44e0 msgr2=0x5582f9848da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.606+0000 7f8b17810800 1 --2- 172.21.15.102:0/1570490199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582f98d44e0 0x5582f9848da0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f8b04025da0 tx=0x7f8b04051000 comp rx=0 tx=0).stop 2024-09-13T19:16:38.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.606+0000 7f8b17810800 1 -- 172.21.15.102:0/1570490199 shutdown_connections 2024-09-13T19:16:38.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.606+0000 7f8b17810800 1 --2- 172.21.15.102:0/1570490199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582f98d44e0 0x5582f9848da0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.606+0000 7f8b17810800 1 -- 172.21.15.102:0/1570490199 >> 172.21.15.102:0/1570490199 conn(0x5582f98cfdd0 msgr2=0x5582f99bef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:38.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.606+0000 7f8b17810800 1 -- 172.21.15.102:0/1570490199 shutdown_connections 2024-09-13T19:16:38.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.606+0000 7f8b17810800 1 -- 172.21.15.102:0/1570490199 wait complete. 2024-09-13T19:16:38.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.606+0000 7f8b17810800 1 Processor -- start 2024-09-13T19:16:38.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.606+0000 7f8b17810800 1 -- start start 2024-09-13T19:16:38.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.607+0000 7f8b17810800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582f98d44e0 0x5582f99cbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.607+0000 7f8b17810800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5582f98db500 con 0x5582f98d44e0 2024-09-13T19:16:38.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.607+0000 7f8b12f84640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582f98d44e0 0x5582f99cbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.607+0000 7f8b12f84640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582f98d44e0 0x5582f99cbfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55604/0 (socket says 172.21.15.102:55604) 2024-09-13T19:16:38.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.607+0000 7f8b12f84640 1 -- 172.21.15.102:0/3189994662 learned_addr learned my addr 172.21.15.102:0/3189994662 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:38.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.607+0000 7f8b12f84640 1 -- 172.21.15.102:0/3189994662 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582f9782fe0 con 0x5582f98d44e0 2024-09-13T19:16:38.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.607+0000 7f8b12f84640 1 --2- 172.21.15.102:0/3189994662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582f98d44e0 0x5582f99cbfe0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f8b040460a0 tx=0x7f8b04003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.608+0000 7f89ff606640 1 -- 172.21.15.102:0/3189994662 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b04066650 con 0x5582f98d44e0 2024-09-13T19:16:38.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.608+0000 7f89ff606640 1 -- 172.21.15.102:0/3189994662 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b04066810 con 0x5582f98d44e0 2024-09-13T19:16:38.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.608+0000 7f89ff606640 1 -- 172.21.15.102:0/3189994662 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b04066b30 con 0x5582f98d44e0 2024-09-13T19:16:38.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.608+0000 7f8b17810800 1 -- 172.21.15.102:0/3189994662 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5582f99cc520 con 0x5582f98d44e0 2024-09-13T19:16:38.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.608+0000 7f8b17810800 1 -- 172.21.15.102:0/3189994662 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582f99cca40 con 0x5582f98d44e0 2024-09-13T19:16:38.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.608+0000 7f89ff606640 1 -- 172.21.15.102:0/3189994662 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8b04079060 con 0x5582f98d44e0 2024-09-13T19:16:38.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.609+0000 7f89ff606640 1 --2- 172.21.15.102:0/3189994662 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f89f8036b90 0x7f89f8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.609+0000 7f89ff606640 1 -- 172.21.15.102:0/3189994662 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f8b04062070 con 0x5582f98d44e0 2024-09-13T19:16:38.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.609+0000 7f8b12783640 1 --2- 172.21.15.102:0/3189994662 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f89f8036b90 0x7f89f8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.609+0000 7f8b17810800 1 --2- 172.21.15.102:0/3189994662 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5582f98d4e20 0x5582f99d3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.609+0000 7f8b17810800 1 -- 172.21.15.102:0/3189994662 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5582f99d3620 con 0x5582f98d4e20 2024-09-13T19:16:38.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.609+0000 7f8b13785640 1 --2- 172.21.15.102:0/3189994662 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5582f98d4e20 0x5582f99d3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.609+0000 7f8b12783640 1 --2- 172.21.15.102:0/3189994662 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f89f8036b90 0x7f89f8039050 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8b08000c00 tx=0x7f8b080013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.609+0000 7f8b13785640 1 --2- 172.21.15.102:0/3189994662 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5582f98d4e20 0x5582f99d3050 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.609+0000 7f8b13785640 1 -- 172.21.15.102:0/3189994662 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b0c00a4a0 con 0x5582f98d4e20 2024-09-13T19:16:38.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.610+0000 7f8b17810800 1 -- 172.21.15.102:0/3189994662 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5582f99d0600 con 0x5582f98d4e20 2024-09-13T19:16:38.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.610+0000 7f8b13785640 1 -- 172.21.15.102:0/3189994662 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8b0c00a4a0 con 0x5582f98d4e20 2024-09-13T19:16:38.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.610+0000 7f8b17810800 1 --2- 172.21.15.102:0/3189994662 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5582f99d5910 0x5582f99d7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.610+0000 7f8b17810800 1 -- 172.21.15.102:0/3189994662 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5582f99d83a0 con 0x5582f99d5910 2024-09-13T19:16:38.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.610+0000 7f8b12f84640 1 --2- 172.21.15.102:0/3189994662 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5582f99d5910 0x5582f99d7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.610+0000 7f8b12f84640 1 --2- 172.21.15.102:0/3189994662 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5582f99d5910 0x5582f99d7d00 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.610+0000 7f8b12f84640 1 -- 172.21.15.102:0/3189994662 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8b04057030 con 0x5582f99d5910 2024-09-13T19:16:38.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.610+0000 7f8b17810800 1 -- 172.21.15.102:0/3189994662 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5582f99d47b0 con 0x5582f98d4e20 2024-09-13T19:16:38.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.611+0000 7f8b13785640 1 -- 172.21.15.102:0/3189994662 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8b0c00a4a0 con 0x5582f98d4e20 2024-09-13T19:16:38.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.611+0000 7f8b17810800 1 -- 172.21.15.102:0/3189994662 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5582f99d4c90 con 0x5582f99d5910 2024-09-13T19:16:38.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.611+0000 7f8b12f84640 1 -- 172.21.15.102:0/3189994662 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8b04057030 con 0x5582f99d5910 2024-09-13T19:16:38.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.611+0000 7f8b17810800 1 Processor -- start 2024-09-13T19:16:38.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.611+0000 7f8b17810800 1 -- start start 2024-09-13T19:16:38.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.611+0000 7f8b17810800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582f99e6d50 0x5582f99e7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.612+0000 7f8b17810800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5582f9770580 con 0x5582f99e6d50 2024-09-13T19:16:38.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.612+0000 7f8b13785640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582f99e6d50 0x5582f99e7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.612+0000 7f8b13785640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582f99e6d50 0x5582f99e7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55606/0 (socket says 172.21.15.102:55606) 2024-09-13T19:16:38.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.612+0000 7f8b13785640 1 -- 172.21.15.102:0/1771444018 learned_addr learned my addr 172.21.15.102:0/1771444018 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:38.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.612+0000 7f8b13785640 1 -- 172.21.15.102:0/1771444018 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582f99e76b0 con 0x5582f99e6d50 2024-09-13T19:16:38.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.612+0000 7f8b13785640 1 --2- 172.21.15.102:0/1771444018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582f99e6d50 0x5582f99e7170 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x5582f99cd090 tx=0x7f8b0c0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.612+0000 7f89fce01640 1 -- 172.21.15.102:0/1771444018 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b0c013640 con 0x5582f99e6d50 2024-09-13T19:16:38.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.612+0000 7f89fce01640 1 -- 172.21.15.102:0/1771444018 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b0c0137e0 con 0x5582f99e6d50 2024-09-13T19:16:38.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.612+0000 7f8b17810800 1 -- 172.21.15.102:0/1771444018 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5582f99e7940 con 0x5582f99e6d50 2024-09-13T19:16:38.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.612+0000 7f89fce01640 1 -- 172.21.15.102:0/1771444018 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b0c013ae0 con 0x5582f99e6d50 2024-09-13T19:16:38.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.612+0000 7f8b17810800 1 -- 172.21.15.102:0/1771444018 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582f99ea620 con 0x5582f99e6d50 2024-09-13T19:16:38.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.613+0000 7f89fce01640 1 -- 172.21.15.102:0/1771444018 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8b0c011040 con 0x5582f99e6d50 2024-09-13T19:16:38.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.613+0000 7f89fce01640 1 --2- 172.21.15.102:0/1771444018 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f89ec036b40 0x7f89ec039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.613+0000 7f89fce01640 1 -- 172.21.15.102:0/1771444018 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f8b0c00e040 con 0x5582f99e6d50 2024-09-13T19:16:38.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.613+0000 7f8b12f84640 1 --2- 172.21.15.102:0/1771444018 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f89ec036b40 0x7f89ec039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.614+0000 7f8b17810800 1 Processor -- start 2024-09-13T19:16:38.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.614+0000 7f8b17810800 1 -- start start 2024-09-13T19:16:38.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.614+0000 7f8b12f84640 1 --2- 172.21.15.102:0/1771444018 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f89ec036b40 0x7f89ec039000 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x5582f99d0540 tx=0x7f8b0408e5d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.614+0000 7f8b17810800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582f99f3a30 0x5582f99f3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.614+0000 7f8b17810800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5582f99c7480 con 0x5582f99f3a30 2024-09-13T19:16:38.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.614+0000 7f8b13785640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582f99f3a30 0x5582f99f3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.614+0000 7f8b13785640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582f99f3a30 0x5582f99f3e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55616/0 (socket says 172.21.15.102:55616) 2024-09-13T19:16:38.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.614+0000 7f8b13785640 1 -- 172.21.15.102:0/843702799 learned_addr learned my addr 172.21.15.102:0/843702799 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:38.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.614+0000 7f8b13785640 1 -- 172.21.15.102:0/843702799 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582f99f4400 con 0x5582f99f3a30 2024-09-13T19:16:38.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.615+0000 7f8b13785640 1 --2- 172.21.15.102:0/843702799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582f99f3a30 0x5582f99f3e30 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c00afb0 tx=0x7f8b0c020f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fcf894d0541d231 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.615+0000 7f89f67fc640 1 -- 172.21.15.102:0/843702799 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b0c04a070 con 0x5582f99f3a30 2024-09-13T19:16:38.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.615+0000 7f89f67fc640 1 -- 172.21.15.102:0/843702799 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b0c01f340 con 0x5582f99f3a30 2024-09-13T19:16:38.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.615+0000 7f89f67fc640 1 -- 172.21.15.102:0/843702799 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b0c014cc0 con 0x5582f99f3a30 2024-09-13T19:16:38.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.615+0000 7f8b17810800 1 -- 172.21.15.102:0/843702799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582f99f3a30 msgr2=0x5582f99f3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.615+0000 7f8b17810800 1 --2- 172.21.15.102:0/843702799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582f99f3a30 0x5582f99f3e30 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c00afb0 tx=0x7f8b0c020f10 comp rx=0 tx=0).stop 2024-09-13T19:16:38.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.615+0000 7f8b17810800 1 -- 172.21.15.102:0/843702799 shutdown_connections 2024-09-13T19:16:38.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.615+0000 7f8b17810800 1 --2- 172.21.15.102:0/843702799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582f99f3a30 0x5582f99f3e30 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.615+0000 7f8b17810800 1 -- 172.21.15.102:0/843702799 >> 172.21.15.102:0/843702799 conn(0x5582f99efde0 msgr2=0x5582f99edee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:38.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.615+0000 7f8b17810800 1 -- 172.21.15.102:0/843702799 shutdown_connections 2024-09-13T19:16:38.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.615+0000 7f8b17810800 1 -- 172.21.15.102:0/843702799 wait complete. 2024-09-13T19:16:38.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.616+0000 7f8b17810800 1 Processor -- start 2024-09-13T19:16:38.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.616+0000 7f8b17810800 1 -- start start 2024-09-13T19:16:38.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.616+0000 7f8b17810800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582f99f3a30 0x5582f99faf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.616+0000 7f8b17810800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5582f99f49d0 con 0x5582f99f3a30 2024-09-13T19:16:38.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.616+0000 7f8b13785640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582f99f3a30 0x5582f99faf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.616+0000 7f8b13785640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582f99f3a30 0x5582f99faf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55626/0 (socket says 172.21.15.102:55626) 2024-09-13T19:16:38.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.616+0000 7f8b13785640 1 -- 172.21.15.102:0/1592604851 learned_addr learned my addr 172.21.15.102:0/1592604851 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:38.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.616+0000 7f8b13785640 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582f99fb460 con 0x5582f99f3a30 2024-09-13T19:16:38.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.617+0000 7f8b13785640 1 --2- 172.21.15.102:0/1592604851 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582f99f3a30 0x5582f99faf20 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c04bca0 tx=0x7f8b0c04cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.617+0000 7f89f4ff9640 1 -- 172.21.15.102:0/1592604851 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b0c040340 con 0x5582f99f3a30 2024-09-13T19:16:38.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.617+0000 7f89f4ff9640 1 -- 172.21.15.102:0/1592604851 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b0c0205b0 con 0x5582f99f3a30 2024-09-13T19:16:38.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.617+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5582f99fb6f0 con 0x5582f99f3a30 2024-09-13T19:16:38.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.617+0000 7f89f4ff9640 1 -- 172.21.15.102:0/1592604851 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b0c0208d0 con 0x5582f99f3a30 2024-09-13T19:16:38.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.617+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582f99fe3a0 con 0x5582f99f3a30 2024-09-13T19:16:38.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.617+0000 7f89f4ff9640 1 -- 172.21.15.102:0/1592604851 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8b0c020a70 con 0x5582f99f3a30 2024-09-13T19:16:38.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.618+0000 7f89f4ff9640 1 --2- 172.21.15.102:0/1592604851 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f89dc036b90 0x7f89dc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.618+0000 7f89f4ff9640 1 -- 172.21.15.102:0/1592604851 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f8b0c031070 con 0x5582f99f3a30 2024-09-13T19:16:38.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.618+0000 7f8b12f84640 1 --2- 172.21.15.102:0/1592604851 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f89dc036b90 0x7f89dc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.618+0000 7f8b12f84640 1 --2- 172.21.15.102:0/1592604851 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f89dc036b90 0x7f89dc039050 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8b04070000 tx=0x7f8b0408a000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.618+0000 7f8b17810800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.618+0000 7f8b17810800 1 --2- 172.21.15.102:0/1592604851 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5582f9a069a0 0x5582f9a08e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.618+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a095b0 con 0x5582f9a069a0 2024-09-13T19:16:38.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.619+0000 7f8b12783640 1 --2- 172.21.15.102:0/1592604851 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5582f9a069a0 0x5582f9a08e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.619+0000 7f8b12783640 1 --2- 172.21.15.102:0/1592604851 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5582f9a069a0 0x5582f9a08e60 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.619+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b0800f5f0 con 0x5582f9a069a0 2024-09-13T19:16:38.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.619+0000 7f8b17810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:38.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.619+0000 7f8b17810800 20 realm 2024-09-13T19:16:38.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.619+0000 7f8b17810800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.619+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a05df0 con 0x5582f9a069a0 2024-09-13T19:16:38.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.619+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b0800f5f0 con 0x5582f9a069a0 2024-09-13T19:16:38.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.619+0000 7f8b17810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:38.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.619+0000 7f8b17810800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:38.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.619+0000 7f8b17810800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.619+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a0a0a0 con 0x5582f9a069a0 2024-09-13T19:16:38.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.619+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b0800f5f0 con 0x5582f9a069a0 2024-09-13T19:16:38.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.619+0000 7f8b17810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:38.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.619+0000 7f8b17810800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.619+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a0a970 con 0x5582f9a069a0 2024-09-13T19:16:38.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.620+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8b0800f5f0 con 0x5582f9a069a0 2024-09-13T19:16:38.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.620+0000 7f8b17810800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:38.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.620+0000 7f8b17810800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.620+0000 7f8b17810800 1 --2- 172.21.15.102:0/1592604851 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5582f9a0b390 0x5582f9a0d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.620+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a0def0 con 0x5582f9a0b390 2024-09-13T19:16:38.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.620+0000 7f8b13785640 1 --2- 172.21.15.102:0/1592604851 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5582f9a0b390 0x5582f9a0d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.620+0000 7f8b13785640 1 --2- 172.21.15.102:0/1592604851 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5582f9a0b390 0x5582f9a0d780 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.620+0000 7f8b13785640 1 -- 172.21.15.102:0/1592604851 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8b0c03b020 con 0x5582f9a0b390 2024-09-13T19:16:38.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.620+0000 7f8b17810800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:38.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.620+0000 7f8b17810800 20 searching for the correct realm 2024-09-13T19:16:38.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.620+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a0f820 con 0x5582f9a0b390 2024-09-13T19:16:38.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.621+0000 7f8b13785640 1 -- 172.21.15.102:0/1592604851 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0c03b020 con 0x5582f9a0b390 2024-09-13T19:16:38.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.621+0000 7f8b13785640 1 --2- 172.21.15.102:0/1592604851 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f8b0c0143c0 0x7f8b0c012850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.621+0000 7f8b13785640 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a0f820 con 0x7f8b0c0143c0 2024-09-13T19:16:38.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.621+0000 7f8b12f84640 1 --2- 172.21.15.102:0/1592604851 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f8b0c0143c0 0x7f8b0c012850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.621+0000 7f8b12f84640 1 --2- 172.21.15.102:0/1592604851 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f8b0c0143c0 0x7f8b0c012850 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.621+0000 7f8b12f84640 1 -- 172.21.15.102:0/1592604851 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b04057030 con 0x7f8b0c0143c0 2024-09-13T19:16:38.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.621+0000 7f8b12f84640 1 --2- 172.21.15.102:0/1592604851 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f8b0409d040 0x7f8b0408e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.621+0000 7f8b12f84640 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a0f820 con 0x7f8b0409d040 2024-09-13T19:16:38.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.621+0000 7f8b12783640 1 --2- 172.21.15.102:0/1592604851 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f8b0409d040 0x7f8b0408e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.622+0000 7f8b12783640 1 --2- 172.21.15.102:0/1592604851 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f8b0409d040 0x7f8b0408e780 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.622+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0800f5f0 con 0x7f8b0409d040 2024-09-13T19:16:38.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.622+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a0f820 con 0x5582f9a069a0 2024-09-13T19:16:38.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.622+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0800f5f0 con 0x5582f9a069a0 2024-09-13T19:16:38.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.622+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a0f820 con 0x5582f9a069a0 2024-09-13T19:16:38.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.622+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0802b040 con 0x5582f9a069a0 2024-09-13T19:16:38.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.622+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a0f820 con 0x7f8b0409d040 2024-09-13T19:16:38.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.623+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0802b040 con 0x7f8b0409d040 2024-09-13T19:16:38.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.623+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a0f820 con 0x7f8b0409d040 2024-09-13T19:16:38.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.623+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0802b040 con 0x7f8b0409d040 2024-09-13T19:16:38.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.623+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a0f820 con 0x7f8b0c0143c0 2024-09-13T19:16:38.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.623+0000 7f8b12f84640 1 -- 172.21.15.102:0/1592604851 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b04057030 con 0x7f8b0c0143c0 2024-09-13T19:16:38.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.623+0000 7f8b12f84640 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a0f820 con 0x5582f9a0b390 2024-09-13T19:16:38.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.623+0000 7f8b13785640 1 -- 172.21.15.102:0/1592604851 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0c03b020 con 0x5582f9a0b390 2024-09-13T19:16:38.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.623+0000 7f8b13785640 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a0f820 con 0x5582f9a069a0 2024-09-13T19:16:38.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.624+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0802b040 con 0x5582f9a069a0 2024-09-13T19:16:38.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.624+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a0f820 con 0x7f8b0c0143c0 2024-09-13T19:16:38.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.624+0000 7f8b12f84640 1 -- 172.21.15.102:0/1592604851 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b04057030 con 0x7f8b0c0143c0 2024-09-13T19:16:38.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.624+0000 7f8b12f84640 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a0f820 con 0x5582f9a069a0 2024-09-13T19:16:38.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.624+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0802b040 con 0x5582f9a069a0 2024-09-13T19:16:38.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.624+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a0f820 con 0x7f8b0c0143c0 2024-09-13T19:16:38.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.624+0000 7f8b12f84640 1 -- 172.21.15.102:0/1592604851 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8b04057030 con 0x7f8b0c0143c0 2024-09-13T19:16:38.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.624+0000 7f8b12f84640 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a0f820 con 0x5582f9a0b390 2024-09-13T19:16:38.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.624+0000 7f8b13785640 1 -- 172.21.15.102:0/1592604851 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0c03b020 con 0x5582f9a0b390 2024-09-13T19:16:38.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.624+0000 7f8b13785640 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a0f820 con 0x5582f9a0b390 2024-09-13T19:16:38.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.625+0000 7f8b13785640 1 -- 172.21.15.102:0/1592604851 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8b0c03b020 con 0x5582f9a0b390 2024-09-13T19:16:38.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.625+0000 7f8b13785640 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a0f820 con 0x7f8b0409d040 2024-09-13T19:16:38.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.625+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0802b040 con 0x7f8b0409d040 2024-09-13T19:16:38.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.625+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a0f820 con 0x5582f9a0b390 2024-09-13T19:16:38.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.625+0000 7f8b13785640 1 -- 172.21.15.102:0/1592604851 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8b0c03b020 con 0x5582f9a0b390 2024-09-13T19:16:38.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.625+0000 7f8b13785640 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a0f820 con 0x5582f9a0b390 2024-09-13T19:16:38.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.625+0000 7f8b13785640 1 -- 172.21.15.102:0/1592604851 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0c03b020 con 0x5582f9a0b390 2024-09-13T19:16:38.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.625+0000 7f8b13785640 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a0f820 con 0x5582f9a069a0 2024-09-13T19:16:38.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.626+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0802b040 con 0x5582f9a069a0 2024-09-13T19:16:38.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.626+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a0f820 con 0x5582f9a069a0 2024-09-13T19:16:38.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.626+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8b0802b040 con 0x5582f9a069a0 2024-09-13T19:16:38.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.626+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a0f820 con 0x7f8b0409d040 2024-09-13T19:16:38.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.626+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0802b040 con 0x7f8b0409d040 2024-09-13T19:16:38.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.626+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a0f820 con 0x5582f9a0b390 2024-09-13T19:16:38.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.626+0000 7f8b13785640 1 -- 172.21.15.102:0/1592604851 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0c03b020 con 0x5582f9a0b390 2024-09-13T19:16:38.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.627+0000 7f8b13785640 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a0f820 con 0x7f8b0c0143c0 2024-09-13T19:16:38.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.627+0000 7f8b12f84640 1 -- 172.21.15.102:0/1592604851 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b04057030 con 0x7f8b0c0143c0 2024-09-13T19:16:38.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.627+0000 7f8b12f84640 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a0f820 con 0x5582f9a069a0 2024-09-13T19:16:38.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.627+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0802b040 con 0x5582f9a069a0 2024-09-13T19:16:38.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.627+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a0f820 con 0x7f8b0c0143c0 2024-09-13T19:16:38.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.627+0000 7f8b12f84640 1 -- 172.21.15.102:0/1592604851 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b04057030 con 0x7f8b0c0143c0 2024-09-13T19:16:38.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.627+0000 7f8b12f84640 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a0f820 con 0x5582f9a0b390 2024-09-13T19:16:38.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.627+0000 7f8b13785640 1 -- 172.21.15.102:0/1592604851 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0c03b020 con 0x5582f9a0b390 2024-09-13T19:16:38.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.627+0000 7f8b13785640 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a0f820 con 0x7f8b0409d040 2024-09-13T19:16:38.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.628+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0802b040 con 0x7f8b0409d040 2024-09-13T19:16:38.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.628+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a0f820 con 0x7f8b0c0143c0 2024-09-13T19:16:38.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.628+0000 7f8b12f84640 1 -- 172.21.15.102:0/1592604851 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b04057030 con 0x7f8b0c0143c0 2024-09-13T19:16:38.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.628+0000 7f8b12f84640 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a0f820 con 0x5582f9a0b390 2024-09-13T19:16:38.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.628+0000 7f8b13785640 1 -- 172.21.15.102:0/1592604851 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0c03b020 con 0x5582f9a0b390 2024-09-13T19:16:38.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.628+0000 7f8b13785640 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a0f820 con 0x7f8b0409d040 2024-09-13T19:16:38.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.629+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0802b040 con 0x7f8b0409d040 2024-09-13T19:16:38.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.629+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a0f820 con 0x5582f9a069a0 2024-09-13T19:16:38.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.629+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8b0802b040 con 0x5582f9a069a0 2024-09-13T19:16:38.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.629+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a0f820 con 0x7f8b0c0143c0 2024-09-13T19:16:38.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.629+0000 7f8b12f84640 1 -- 172.21.15.102:0/1592604851 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b04057030 con 0x7f8b0c0143c0 2024-09-13T19:16:38.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.630+0000 7f8b17810800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:38.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.630+0000 7f8b17810800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:38.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.630+0000 7f8b17810800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:38.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.630+0000 7f8b17810800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:38.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.630+0000 7f8b17810800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:38.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.630+0000 7f8b17810800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:38.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.630+0000 7f8b17810800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.630+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a0e8b0 con 0x5582f9a069a0 2024-09-13T19:16:38.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.630+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b0802b040 con 0x5582f9a069a0 2024-09-13T19:16:38.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.630+0000 7f8b17810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:38.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.630+0000 7f8b17810800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.630+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a0f150 con 0x5582f9a069a0 2024-09-13T19:16:38.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.630+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8b0802b040 con 0x5582f9a069a0 2024-09-13T19:16:38.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.630+0000 7f8b17810800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:38.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.630+0000 7f8b17810800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.630+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a0fca0 con 0x5582f9a0b390 2024-09-13T19:16:38.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.630+0000 7f8b13785640 1 -- 172.21.15.102:0/1592604851 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8b0c03b020 con 0x5582f9a0b390 2024-09-13T19:16:38.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.630+0000 7f8b17810800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:38.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.630+0000 7f8b17810800 20 zone default found 2024-09-13T19:16:38.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.630+0000 7f8b17810800 4 Realm: () 2024-09-13T19:16:38.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.630+0000 7f8b17810800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:38.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.630+0000 7f8b17810800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:38.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.630+0000 7f8b17810800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:38.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.630+0000 7f8b17810800 20 zonegroup default 2024-09-13T19:16:38.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.630+0000 7f8b17810800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.630+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a0ed90 con 0x7f8b0c0143c0 2024-09-13T19:16:38.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.630+0000 7f8b12f84640 1 -- 172.21.15.102:0/1592604851 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8b04057030 con 0x7f8b0c0143c0 2024-09-13T19:16:38.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.630+0000 7f8b17810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:38.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.631+0000 7f8b17810800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.631+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a12400 con 0x5582f9a0b390 2024-09-13T19:16:38.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.631+0000 7f8b13785640 1 -- 172.21.15.102:0/1592604851 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8b0c03b020 con 0x5582f9a0b390 2024-09-13T19:16:38.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.631+0000 7f8b17810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:38.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.631+0000 7f8b17810800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.631+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a127a0 con 0x5582f9a0b390 2024-09-13T19:16:38.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.631+0000 7f8b13785640 1 -- 172.21.15.102:0/1592604851 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8b0c03b020 con 0x5582f9a0b390 2024-09-13T19:16:38.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.631+0000 7f8b17810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:38.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.631+0000 7f8b17810800 20 started sync module instance, tier type = 2024-09-13T19:16:38.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.631+0000 7f8b17810800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:38.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.631+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a11840 con 0x7f8b0c0143c0 2024-09-13T19:16:38.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.632+0000 7f8b12f84640 1 -- 172.21.15.102:0/1592604851 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(44 notify.0 [create] v36'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b04057030 con 0x7f8b0c0143c0 2024-09-13T19:16:38.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.632+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94021022194784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a114a0 con 0x7f8b0c0143c0 2024-09-13T19:16:38.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.632+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a13100 con 0x5582f9a069a0 2024-09-13T19:16:38.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.633+0000 7f8b12f84640 1 -- 172.21.15.102:0/1592604851 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94021022194784] v36'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b04057030 con 0x7f8b0c0143c0 2024-09-13T19:16:38.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.633+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v36'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b0802b040 con 0x5582f9a069a0 2024-09-13T19:16:38.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.633+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94021022198176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a139a0 con 0x5582f9a069a0 2024-09-13T19:16:38.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.633+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a14360 con 0x5582f9a0b390 2024-09-13T19:16:38.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.634+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94021022198176] v36'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b0802b040 con 0x5582f9a069a0 2024-09-13T19:16:38.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.634+0000 7f8b13785640 1 -- 172.21.15.102:0/1592604851 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v36'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b0c03b020 con 0x5582f9a0b390 2024-09-13T19:16:38.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.634+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94021022201552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a14360 con 0x5582f9a0b390 2024-09-13T19:16:38.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.634+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a14d60 con 0x7f8b0c0143c0 2024-09-13T19:16:38.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.635+0000 7f8b13785640 1 -- 172.21.15.102:0/1592604851 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94021022201552] v36'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b0c03b020 con 0x5582f9a0b390 2024-09-13T19:16:38.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.636+0000 7f8b12f84640 1 -- 172.21.15.102:0/1592604851 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(50 notify.3 [create] v36'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b04057030 con 0x7f8b0c0143c0 2024-09-13T19:16:38.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.636+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94021022203568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a142d0 con 0x7f8b0c0143c0 2024-09-13T19:16:38.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.636+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a15c20 con 0x5582f9a069a0 2024-09-13T19:16:38.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.637+0000 7f8b12f84640 1 -- 172.21.15.102:0/1592604851 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94021022203568] v36'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b04057030 con 0x7f8b0c0143c0 2024-09-13T19:16:38.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.637+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v36'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b0802b040 con 0x5582f9a069a0 2024-09-13T19:16:38.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.637+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94021022208336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a15c20 con 0x5582f9a069a0 2024-09-13T19:16:38.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.637+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a165e0 con 0x7f8b0409d040 2024-09-13T19:16:38.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.638+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94021022208336] v36'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b0802b040 con 0x5582f9a069a0 2024-09-13T19:16:38.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.638+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(54 notify.5 [create] v36'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b0802b040 con 0x7f8b0409d040 2024-09-13T19:16:38.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.638+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94021022212880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a15c20 con 0x7f8b0409d040 2024-09-13T19:16:38.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.638+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a17070 con 0x7f8b0409d040 2024-09-13T19:16:38.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.639+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(56 notify.6 [create] v36'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b0802b040 con 0x7f8b0409d040 2024-09-13T19:16:38.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.639+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94021022214976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a17030 con 0x7f8b0409d040 2024-09-13T19:16:38.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.639+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a18050 con 0x7f8b0409d040 2024-09-13T19:16:38.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.639+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94021022212880] v36'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b0802b040 con 0x7f8b0409d040 2024-09-13T19:16:38.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.640+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94021022214976] v36'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b0802b040 con 0x7f8b0409d040 2024-09-13T19:16:38.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.640+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(58 notify.7 [create] v36'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b0802b040 con 0x7f8b0409d040 2024-09-13T19:16:38.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.640+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94021022219104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a18050 con 0x7f8b0409d040 2024-09-13T19:16:38.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.640+0000 7f8b17810800 20 add_watcher() i=0 2024-09-13T19:16:38.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.640+0000 7f8b17810800 20 add_watcher() i=1 2024-09-13T19:16:38.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.640+0000 7f8b17810800 20 add_watcher() i=2 2024-09-13T19:16:38.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.640+0000 7f8b17810800 20 add_watcher() i=3 2024-09-13T19:16:38.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.640+0000 7f8b17810800 20 add_watcher() i=4 2024-09-13T19:16:38.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.640+0000 7f8b17810800 20 add_watcher() i=5 2024-09-13T19:16:38.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.640+0000 7f8b17810800 20 add_watcher() i=6 2024-09-13T19:16:38.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.641+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94021022219104] v36'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b0802b040 con 0x7f8b0409d040 2024-09-13T19:16:38.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.641+0000 7f8b17810800 20 add_watcher() i=7 2024-09-13T19:16:38.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.641+0000 7f8b17810800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:38.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.641+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a17380 con 0x5582f9a069a0 2024-09-13T19:16:38.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.641+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8b0802b040 con 0x5582f9a069a0 2024-09-13T19:16:38.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.641+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94021022217088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a15880 con 0x5582f9a069a0 2024-09-13T19:16:38.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.642+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94021022217088] v36'189 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8b0802b040 con 0x5582f9a069a0 2024-09-13T19:16:38.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.642+0000 7f89c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:38.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.642+0000 7f8b17810800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:38.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.642+0000 7f8b17810800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:38.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.642+0000 7f8b17810800 5 note: GC not initialized 2024-09-13T19:16:38.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.642+0000 7f8943fff640 20 reqs_thread_entry: start 2024-09-13T19:16:38.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.643+0000 7f8b17810800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:38.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.643+0000 7f8b17810800 20 Filter name: none 2024-09-13T19:16:38.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.643+0000 7f8941ffb640 20 reqs_thread_entry: start 2024-09-13T19:16:38.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.643+0000 7f8b17810800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:16:38.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.643+0000 7f8b17810800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.643+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a4e320 con 0x5582f9a069a0 2024-09-13T19:16:38.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.643+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 foo [call out=48b,read 0~403 out=403b,getxattrs out=75b] v0'0 uv14 ondisk = 0) ==== 231+0+526 (crc 0 0 0) 0x7f8b0802b040 con 0x5582f9a069a0 2024-09-13T19:16:38.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.643+0000 7f8b17810800 20 rados_obj.operate() r=0 bl.length=403 2024-09-13T19:16:38.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.643+0000 7f8b17810800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:16:38.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.643+0000 7f8b17810800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:16:38.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.643+0000 7f8b17810800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:16:38.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.643+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a545c0 con 0x5582f9a069a0 2024-09-13T19:16:38.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.645+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v36'15 uv15 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f8b0802b040 con 0x5582f9a069a0 2024-09-13T19:16:38.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.645+0000 7f8b17810800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:16:38.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.645+0000 7f8b17810800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:16:38.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.645+0000 7f8b17810800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T19:16:38.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.645+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94021022465920 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a4fda0 con 0x5582f9a069a0 2024-09-13T19:16:38.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.645+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== watch-notify(notify (1) cookie 94021022208336 notify 154618822685 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f8b08018040 con 0x5582f9a069a0 2024-09-13T19:16:38.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.645+0000 7f89f67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822685 cookie 94021022208336 notifier 4671 bl.length()=567 2024-09-13T19:16:38.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.645+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(64 notify.4 [notify cookie 94021022465920 out=8b] v0'0 uv183 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8b0802b040 con 0x5582f9a069a0 2024-09-13T19:16:38.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.645+0000 7f89f67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:16:38.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.645+0000 7f89f67fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:16:38.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.645+0000 7f89f67fc640 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f89d8003ea0 con 0x5582f9a069a0 2024-09-13T19:16:38.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.645+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b0802b040 con 0x5582f9a069a0 2024-09-13T19:16:38.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.645+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== watch-notify(notify_complete (2) cookie 94021022465920 notify 154618822685 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f8b0802fba0 con 0x5582f9a069a0 2024-09-13T19:16:38.673 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:16:14.779675Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:16:14.779665Z","tags":[],"group_ids":[]} 2024-09-13T19:16:38.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.646+0000 7f89c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:38.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.646+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94021022217088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a4c090 con 0x5582f9a069a0 2024-09-13T19:16:38.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.647+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94021022217088] v36'190 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8b0802b040 con 0x5582f9a069a0 2024-09-13T19:16:38.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.647+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94021022194784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a4c090 con 0x7f8b0c0143c0 2024-09-13T19:16:38.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.648+0000 7f8b12f84640 1 -- 172.21.15.102:0/1592604851 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94021022194784] v36'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b04057030 con 0x7f8b0c0143c0 2024-09-13T19:16:38.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.648+0000 7f8b17810800 20 remove_watcher() i=0 2024-09-13T19:16:38.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.648+0000 7f8b17810800 2 removed watcher, disabling cache 2024-09-13T19:16:38.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.648+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94021022198176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a4c090 con 0x5582f9a069a0 2024-09-13T19:16:38.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.649+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 <== osd.1 v2:172.21.15.102:6808/2204418452 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94021022198176] v36'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b0802b040 con 0x5582f9a069a0 2024-09-13T19:16:38.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.649+0000 7f8b17810800 20 remove_watcher() i=1 2024-09-13T19:16:38.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.649+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94021022201552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a4c090 con 0x5582f9a0b390 2024-09-13T19:16:38.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.650+0000 7f8b13785640 1 -- 172.21.15.102:0/1592604851 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94021022201552] v36'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b0c03b020 con 0x5582f9a0b390 2024-09-13T19:16:38.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.650+0000 7f8b17810800 20 remove_watcher() i=2 2024-09-13T19:16:38.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.650+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94021022203568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a4c090 con 0x7f8b0c0143c0 2024-09-13T19:16:38.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.651+0000 7f8b12f84640 1 -- 172.21.15.102:0/1592604851 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94021022203568] v36'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b04057030 con 0x7f8b0c0143c0 2024-09-13T19:16:38.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.651+0000 7f8b17810800 20 remove_watcher() i=3 2024-09-13T19:16:38.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.651+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94021022208336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a4c090 con 0x5582f9a069a0 2024-09-13T19:16:38.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.652+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 <== osd.1 v2:172.21.15.102:6808/2204418452 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94021022208336] v36'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b0802b040 con 0x5582f9a069a0 2024-09-13T19:16:38.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.652+0000 7f8b17810800 20 remove_watcher() i=4 2024-09-13T19:16:38.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.652+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94021022212880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a4c090 con 0x7f8b0409d040 2024-09-13T19:16:38.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.653+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94021022212880] v36'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b0802b040 con 0x7f8b0409d040 2024-09-13T19:16:38.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.653+0000 7f8b17810800 20 remove_watcher() i=5 2024-09-13T19:16:38.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.653+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94021022214976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a4c090 con 0x7f8b0409d040 2024-09-13T19:16:38.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.654+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94021022214976] v36'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b0802b040 con 0x7f8b0409d040 2024-09-13T19:16:38.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.654+0000 7f8b17810800 20 remove_watcher() i=6 2024-09-13T19:16:38.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.654+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94021022219104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5582f9a4c090 con 0x7f8b0409d040 2024-09-13T19:16:38.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.655+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94021022219104] v36'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b0802b040 con 0x7f8b0409d040 2024-09-13T19:16:38.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.655+0000 7f8b17810800 20 remove_watcher() i=7 2024-09-13T19:16:38.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.655+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f8b0409d040 msgr2=0x7f8b0408e780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.655+0000 7f8b17810800 1 --2- 172.21.15.102:0/1592604851 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f8b0409d040 0x7f8b0408e780 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.655+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5582f9a069a0 msgr2=0x5582f9a08e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.655+0000 7f8b17810800 1 --2- 172.21.15.102:0/1592604851 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5582f9a069a0 0x5582f9a08e60 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.655+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f8b0c0143c0 msgr2=0x7f8b0c012850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.655+0000 7f8b17810800 1 --2- 172.21.15.102:0/1592604851 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f8b0c0143c0 0x7f8b0c012850 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.655+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5582f9a0b390 msgr2=0x5582f9a0d780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.655+0000 7f8b17810800 1 --2- 172.21.15.102:0/1592604851 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5582f9a0b390 0x5582f9a0d780 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.656+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f89dc036b90 msgr2=0x7f89dc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.656+0000 7f8b17810800 1 --2- 172.21.15.102:0/1592604851 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f89dc036b90 0x7f89dc039050 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8b04070000 tx=0x7f8b0408a000 comp rx=0 tx=0).stop 2024-09-13T19:16:38.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.656+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582f99f3a30 msgr2=0x5582f99faf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.656+0000 7f8b12783640 1 -- 172.21.15.102:0/1592604851 reap_dead start 2024-09-13T19:16:38.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.656+0000 7f8b17810800 1 --2- 172.21.15.102:0/1592604851 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582f99f3a30 0x5582f99faf20 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c04bca0 tx=0x7f8b0c04cdb0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.656+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 shutdown_connections 2024-09-13T19:16:38.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.656+0000 7f8b17810800 1 --2- 172.21.15.102:0/1592604851 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582f99f3a30 0x5582f99faf20 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.656+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 >> 172.21.15.102:0/1592604851 conn(0x5582f99efde0 msgr2=0x5582f99f5140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:38.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.656+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 shutdown_connections 2024-09-13T19:16:38.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.656+0000 7f8b17810800 1 -- 172.21.15.102:0/1592604851 wait complete. 2024-09-13T19:16:38.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.656+0000 7f8b17810800 1 -- 172.21.15.102:0/1771444018 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f89ec036b40 msgr2=0x7f89ec039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.656+0000 7f8b17810800 1 --2- 172.21.15.102:0/1771444018 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f89ec036b40 0x7f89ec039000 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x5582f99d0540 tx=0x7f8b0408e5d0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.656+0000 7f8b17810800 1 -- 172.21.15.102:0/1771444018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582f99e6d50 msgr2=0x5582f99e7170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.656+0000 7f8b17810800 1 --2- 172.21.15.102:0/1771444018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582f99e6d50 0x5582f99e7170 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x5582f99cd090 tx=0x7f8b0c0167b0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.656+0000 7f8b17810800 1 -- 172.21.15.102:0/1771444018 shutdown_connections 2024-09-13T19:16:38.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.656+0000 7f8b17810800 1 --2- 172.21.15.102:0/1771444018 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f89ec036b40 0x7f89ec039000 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.656+0000 7f8b17810800 1 --2- 172.21.15.102:0/1771444018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582f99e6d50 0x5582f99e7170 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.656+0000 7f8b17810800 1 -- 172.21.15.102:0/1771444018 >> 172.21.15.102:0/1771444018 conn(0x5582f99dbce0 msgr2=0x5582f99de860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:38.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.656+0000 7f8b17810800 1 -- 172.21.15.102:0/1771444018 shutdown_connections 2024-09-13T19:16:38.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.656+0000 7f8b17810800 1 -- 172.21.15.102:0/1771444018 wait complete. 2024-09-13T19:16:38.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.656+0000 7f8b17810800 1 -- 172.21.15.102:0/3189994662 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5582f98d4e20 msgr2=0x5582f99d3050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.656+0000 7f8b17810800 1 --2- 172.21.15.102:0/3189994662 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5582f98d4e20 0x5582f99d3050 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.656+0000 7f8b17810800 1 -- 172.21.15.102:0/3189994662 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5582f99d5910 msgr2=0x5582f99d7d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.656+0000 7f8b17810800 1 --2- 172.21.15.102:0/3189994662 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5582f99d5910 0x5582f99d7d00 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.657+0000 7f8b17810800 1 -- 172.21.15.102:0/3189994662 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f89f8036b90 msgr2=0x7f89f8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.657+0000 7f8b17810800 1 --2- 172.21.15.102:0/3189994662 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f89f8036b90 0x7f89f8039050 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8b08000c00 tx=0x7f8b080013b0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.657+0000 7f8b17810800 1 -- 172.21.15.102:0/3189994662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582f98d44e0 msgr2=0x5582f99cbfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.657+0000 7f8b17810800 1 --2- 172.21.15.102:0/3189994662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582f98d44e0 0x5582f99cbfe0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f8b040460a0 tx=0x7f8b04003020 comp rx=0 tx=0).stop 2024-09-13T19:16:38.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.657+0000 7f8b17810800 1 -- 172.21.15.102:0/3189994662 shutdown_connections 2024-09-13T19:16:38.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.657+0000 7f8b17810800 1 --2- 172.21.15.102:0/3189994662 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5582f99d5910 0x5582f99d7d00 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.657+0000 7f8b17810800 1 --2- 172.21.15.102:0/3189994662 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5582f98d4e20 0x5582f99d3050 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.657+0000 7f8b17810800 1 --2- 172.21.15.102:0/3189994662 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f89f8036b90 0x7f89f8039050 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.657+0000 7f8b17810800 1 --2- 172.21.15.102:0/3189994662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582f98d44e0 0x5582f99cbfe0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.657+0000 7f8b17810800 1 -- 172.21.15.102:0/3189994662 >> 172.21.15.102:0/3189994662 conn(0x5582f98cfdd0 msgr2=0x5582f99bd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:38.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.657+0000 7f8b17810800 1 -- 172.21.15.102:0/3189994662 shutdown_connections 2024-09-13T19:16:38.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.657+0000 7f8b17810800 1 -- 172.21.15.102:0/3189994662 wait complete. 2024-09-13T19:16:38.689 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:16:14.779675Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:16:14.779665Z', 'tags': [], 'group_ids': []} 2024-09-13T19:16:38.703 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:16:38.703 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-13T19:16:38.703 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-13T19:16:38.703 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-13T19:16:38.747 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:16:38.748 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:16:38.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.745+0000 7fe7eeb2e800 1 Processor -- start 2024-09-13T19:16:38.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.745+0000 7fe7eeb2e800 1 -- start start 2024-09-13T19:16:38.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.745+0000 7fe7eeb2e800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55e7822556b0 0x55e7822e41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.745+0000 7fe7eeb2e800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e7821a0b30 con 0x55e7822e4710 2024-09-13T19:16:38.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.745+0000 7fe7eeb2e800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55e782182360 con 0x55e7822556b0 2024-09-13T19:16:38.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.745+0000 7fe7ea76e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55e7822556b0 0x55e7822e41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.745+0000 7fe7ea76e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55e7822556b0 0x55e7822e41d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55632/0 (socket says 172.21.15.102:55632) 2024-09-13T19:16:38.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.745+0000 7fe7ea76e640 1 -- 172.21.15.102:0/1382735805 learned_addr learned my addr 172.21.15.102:0/1382735805 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:38.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.746+0000 7fe7ea76e640 1 -- 172.21.15.102:0/1382735805 >> v1:172.21.15.53:6789/0 conn(0x55e7822e4710 legacy=0x55e7822e6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.746+0000 7fe7ea76e640 1 -- 172.21.15.102:0/1382735805 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7821a8e00 con 0x55e7822556b0 2024-09-13T19:16:38.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.747+0000 7fe7ea76e640 1 --2- 172.21.15.102:0/1382735805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7822556b0 0x55e7822e41d0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc005fd0 tx=0x7fe7dc045cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6247396edafbd27e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.748+0000 7fe7e976c640 1 -- 172.21.15.102:0/1382735805 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7dc04e600 con 0x55e7822556b0 2024-09-13T19:16:38.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.748+0000 7fe7e976c640 1 -- 172.21.15.102:0/1382735805 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7dc04e7a0 con 0x55e7822556b0 2024-09-13T19:16:38.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.748+0000 7fe7e976c640 1 -- 172.21.15.102:0/1382735805 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7dc04eaa0 con 0x55e7822556b0 2024-09-13T19:16:38.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.748+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/1382735805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7822556b0 msgr2=0x55e7822e41d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.748+0000 7fe7eeb2e800 1 --2- 172.21.15.102:0/1382735805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7822556b0 0x55e7822e41d0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc005fd0 tx=0x7fe7dc045cf0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.748+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/1382735805 shutdown_connections 2024-09-13T19:16:38.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.748+0000 7fe7eeb2e800 1 --2- 172.21.15.102:0/1382735805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7822556b0 0x55e7822e41d0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.748+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/1382735805 >> 172.21.15.102:0/1382735805 conn(0x55e7822dbde0 msgr2=0x55e7822de200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:38.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.748+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/1382735805 shutdown_connections 2024-09-13T19:16:38.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.748+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/1382735805 wait complete. 2024-09-13T19:16:38.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.762+0000 7fe7eeb2e800 1 Processor -- start 2024-09-13T19:16:38.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.762+0000 7fe7eeb2e800 1 -- start start 2024-09-13T19:16:38.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.762+0000 7fe7eeb2e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7822556b0 0x55e7823d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.762+0000 7fe7eeb2e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e78222d330 con 0x55e7822556b0 2024-09-13T19:16:38.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.762+0000 7fe7ea76e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7822556b0 0x55e7823d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.762+0000 7fe7ea76e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7822556b0 0x55e7823d08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55648/0 (socket says 172.21.15.102:55648) 2024-09-13T19:16:38.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.762+0000 7fe7ea76e640 1 -- 172.21.15.102:0/1866505020 learned_addr learned my addr 172.21.15.102:0/1866505020 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:38.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.762+0000 7fe7ea76e640 1 -- 172.21.15.102:0/1866505020 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e78217abc0 con 0x55e7822556b0 2024-09-13T19:16:38.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.763+0000 7fe7ea76e640 1 --2- 172.21.15.102:0/1866505020 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7822556b0 0x55e7823d08c0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc045d30 tx=0x7fe7dc050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38b9f2290cabb856 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.763+0000 7fe6d8608640 1 -- 172.21.15.102:0/1866505020 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7dc04eb40 con 0x55e7822556b0 2024-09-13T19:16:38.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.763+0000 7fe6d8608640 1 -- 172.21.15.102:0/1866505020 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7dc05c040 con 0x55e7822556b0 2024-09-13T19:16:38.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.763+0000 7fe6d8608640 1 -- 172.21.15.102:0/1866505020 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7dc04ee10 con 0x55e7822556b0 2024-09-13T19:16:38.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.763+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/1866505020 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7822556b0 msgr2=0x55e7823d08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.763+0000 7fe7eeb2e800 1 --2- 172.21.15.102:0/1866505020 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7822556b0 0x55e7823d08c0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc045d30 tx=0x7fe7dc050000 comp rx=0 tx=0).stop 2024-09-13T19:16:38.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.763+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/1866505020 shutdown_connections 2024-09-13T19:16:38.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.763+0000 7fe7eeb2e800 1 --2- 172.21.15.102:0/1866505020 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7822556b0 0x55e7823d08c0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.763+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/1866505020 >> 172.21.15.102:0/1866505020 conn(0x55e7822dbde0 msgr2=0x55e7823cc280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:38.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.763+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/1866505020 shutdown_connections 2024-09-13T19:16:38.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.763+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/1866505020 wait complete. 2024-09-13T19:16:38.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.764+0000 7fe7eeb2e800 1 Processor -- start 2024-09-13T19:16:38.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.764+0000 7fe7eeb2e800 1 -- start start 2024-09-13T19:16:38.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.764+0000 7fe7eeb2e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7822556b0 0x55e7823d8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.764+0000 7fe7eeb2e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e7822e8680 con 0x55e7822556b0 2024-09-13T19:16:38.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.764+0000 7fe7ea76e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7822556b0 0x55e7823d8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.764+0000 7fe7ea76e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7822556b0 0x55e7823d8240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55658/0 (socket says 172.21.15.102:55658) 2024-09-13T19:16:38.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.764+0000 7fe7ea76e640 1 -- 172.21.15.102:0/3659501964 learned_addr learned my addr 172.21.15.102:0/3659501964 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:38.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.764+0000 7fe7ea76e640 1 -- 172.21.15.102:0/3659501964 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e78218efe0 con 0x55e7822556b0 2024-09-13T19:16:38.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.765+0000 7fe7ea76e640 1 --2- 172.21.15.102:0/3659501964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7822556b0 0x55e7823d8240 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc045d30 tx=0x7fe7dc003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.765+0000 7fe6d6e05640 1 -- 172.21.15.102:0/3659501964 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7dc061420 con 0x55e7822556b0 2024-09-13T19:16:38.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.765+0000 7fe6d6e05640 1 -- 172.21.15.102:0/3659501964 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7dc070070 con 0x55e7822556b0 2024-09-13T19:16:38.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.765+0000 7fe6d6e05640 1 -- 172.21.15.102:0/3659501964 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7dc0616f0 con 0x55e7822556b0 2024-09-13T19:16:38.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.765+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/3659501964 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e7823d8780 con 0x55e7822556b0 2024-09-13T19:16:38.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.765+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/3659501964 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7823d8c20 con 0x55e7822556b0 2024-09-13T19:16:38.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.766+0000 7fe6d6e05640 1 -- 172.21.15.102:0/3659501964 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe7dc0618e0 con 0x55e7822556b0 2024-09-13T19:16:38.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.766+0000 7fe6d6e05640 1 --2- 172.21.15.102:0/3659501964 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe6d0036b40 0x7fe6d0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.766+0000 7fe6d6e05640 1 -- 172.21.15.102:0/3659501964 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fe7dc066070 con 0x55e7822556b0 2024-09-13T19:16:38.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.766+0000 7fe7e9f6d640 1 --2- 172.21.15.102:0/3659501964 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe6d0036b40 0x7fe6d0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.766+0000 7fe7eeb2e800 1 --2- 172.21.15.102:0/3659501964 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e7822e4710 0x55e7823df1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.766+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/3659501964 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e7823df790 con 0x55e7822e4710 2024-09-13T19:16:38.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.766+0000 7fe7eaf6f640 1 --2- 172.21.15.102:0/3659501964 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e7822e4710 0x55e7823df1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.766+0000 7fe7e9f6d640 1 --2- 172.21.15.102:0/3659501964 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe6d0036b40 0x7fe6d0039000 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x55e782255050 tx=0x7fe7e0001390 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.766+0000 7fe7eaf6f640 1 --2- 172.21.15.102:0/3659501964 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e7822e4710 0x55e7823df1c0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.767+0000 7fe7eaf6f640 1 -- 172.21.15.102:0/3659501964 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe7e40083e0 con 0x55e7822e4710 2024-09-13T19:16:38.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.767+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/3659501964 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e7823dc860 con 0x55e7822e4710 2024-09-13T19:16:38.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.767+0000 7fe7eaf6f640 1 -- 172.21.15.102:0/3659501964 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe7e40083e0 con 0x55e7822e4710 2024-09-13T19:16:38.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.767+0000 7fe7eeb2e800 1 --2- 172.21.15.102:0/3659501964 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e7823e1ac0 0x55e7823e3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.767+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/3659501964 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e7823e45a0 con 0x55e7823e1ac0 2024-09-13T19:16:38.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.767+0000 7fe7ea76e640 1 --2- 172.21.15.102:0/3659501964 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e7823e1ac0 0x55e7823e3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.767+0000 7fe7ea76e640 1 --2- 172.21.15.102:0/3659501964 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e7823e1ac0 0x55e7823e3eb0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.768+0000 7fe7ea76e640 1 -- 172.21.15.102:0/3659501964 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe7dc07c070 con 0x55e7823e1ac0 2024-09-13T19:16:38.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.768+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/3659501964 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e7823e0960 con 0x55e7822e4710 2024-09-13T19:16:38.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.768+0000 7fe7eaf6f640 1 -- 172.21.15.102:0/3659501964 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe7e40083e0 con 0x55e7822e4710 2024-09-13T19:16:38.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.768+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/3659501964 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e7823e0e00 con 0x55e7823e1ac0 2024-09-13T19:16:38.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.768+0000 7fe7ea76e640 1 -- 172.21.15.102:0/3659501964 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe7dc07c070 con 0x55e7823e1ac0 2024-09-13T19:16:38.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.768+0000 7fe7eeb2e800 1 Processor -- start 2024-09-13T19:16:38.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.769+0000 7fe7eeb2e800 1 -- start start 2024-09-13T19:16:38.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.769+0000 7fe7eeb2e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7823f2f00 0x55e7823f3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.769+0000 7fe7eeb2e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e78217c580 con 0x55e7823f2f00 2024-09-13T19:16:38.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.769+0000 7fe7eaf6f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7823f2f00 0x55e7823f3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.769+0000 7fe7eaf6f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7823f2f00 0x55e7823f3320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55674/0 (socket says 172.21.15.102:55674) 2024-09-13T19:16:38.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.769+0000 7fe7eaf6f640 1 -- 172.21.15.102:0/102961003 learned_addr learned my addr 172.21.15.102:0/102961003 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:38.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.769+0000 7fe7eaf6f640 1 -- 172.21.15.102:0/102961003 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7823f3860 con 0x55e7823f2f00 2024-09-13T19:16:38.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.769+0000 7fe7eaf6f640 1 --2- 172.21.15.102:0/102961003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7823f2f00 0x55e7823f3320 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x55e7823d92f0 tx=0x7fe7e400beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.769+0000 7fe6cffff640 1 -- 172.21.15.102:0/102961003 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7e401c020 con 0x55e7823f2f00 2024-09-13T19:16:38.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.770+0000 7fe6cffff640 1 -- 172.21.15.102:0/102961003 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7e4007cf0 con 0x55e7823f2f00 2024-09-13T19:16:38.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.770+0000 7fe6cffff640 1 -- 172.21.15.102:0/102961003 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7e4018440 con 0x55e7823f2f00 2024-09-13T19:16:38.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.770+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/102961003 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e7823f3af0 con 0x55e7823f2f00 2024-09-13T19:16:38.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.770+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/102961003 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7823f67d0 con 0x55e7823f2f00 2024-09-13T19:16:38.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.770+0000 7fe6cffff640 1 -- 172.21.15.102:0/102961003 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe7e401f020 con 0x55e7823f2f00 2024-09-13T19:16:38.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.770+0000 7fe6cffff640 1 --2- 172.21.15.102:0/102961003 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe6c4036b40 0x7fe6c4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.771+0000 7fe6cffff640 1 -- 172.21.15.102:0/102961003 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fe7e404e380 con 0x55e7823f2f00 2024-09-13T19:16:38.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.771+0000 7fe7ea76e640 1 --2- 172.21.15.102:0/102961003 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe6c4036b40 0x7fe6c4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.771+0000 7fe7eeb2e800 1 Processor -- start 2024-09-13T19:16:38.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.771+0000 7fe7ea76e640 1 --2- 172.21.15.102:0/102961003 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe6c4036b40 0x7fe6c4039000 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x55e7823e0070 tx=0x7fe7dc053fd0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.771+0000 7fe7eeb2e800 1 -- start start 2024-09-13T19:16:38.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.771+0000 7fe7eeb2e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7822e1400 0x55e7822e1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.771+0000 7fe7eeb2e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e7823d0fb0 con 0x55e7822e1400 2024-09-13T19:16:38.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.771+0000 7fe7eaf6f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7822e1400 0x55e7822e1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.771+0000 7fe7eaf6f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7822e1400 0x55e7822e1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55690/0 (socket says 172.21.15.102:55690) 2024-09-13T19:16:38.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.771+0000 7fe7eaf6f640 1 -- 172.21.15.102:0/2340184797 learned_addr learned my addr 172.21.15.102:0/2340184797 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:38.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.771+0000 7fe7eaf6f640 1 -- 172.21.15.102:0/2340184797 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7822e1dd0 con 0x55e7822e1400 2024-09-13T19:16:38.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.772+0000 7fe7eaf6f640 1 --2- 172.21.15.102:0/2340184797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7822e1400 0x55e7822e1800 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fe7e404c670 tx=0x7fe7e4016630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68db6f7d997d2694 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.772+0000 7fe6cdffb640 1 -- 172.21.15.102:0/2340184797 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7e4045070 con 0x55e7822e1400 2024-09-13T19:16:38.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.772+0000 7fe6cdffb640 1 -- 172.21.15.102:0/2340184797 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7e4018810 con 0x55e7822e1400 2024-09-13T19:16:38.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.772+0000 7fe6cdffb640 1 -- 172.21.15.102:0/2340184797 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7e4021400 con 0x55e7822e1400 2024-09-13T19:16:38.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.772+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/2340184797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7822e1400 msgr2=0x55e7822e1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.772+0000 7fe7eeb2e800 1 --2- 172.21.15.102:0/2340184797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7822e1400 0x55e7822e1800 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fe7e404c670 tx=0x7fe7e4016630 comp rx=0 tx=0).stop 2024-09-13T19:16:38.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.772+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/2340184797 shutdown_connections 2024-09-13T19:16:38.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.772+0000 7fe7eeb2e800 1 --2- 172.21.15.102:0/2340184797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7822e1400 0x55e7822e1800 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.772+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/2340184797 >> 172.21.15.102:0/2340184797 conn(0x55e7823fbf30 msgr2=0x55e7823fa030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:38.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.772+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/2340184797 shutdown_connections 2024-09-13T19:16:38.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.772+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/2340184797 wait complete. 2024-09-13T19:16:38.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.772+0000 7fe7eeb2e800 1 Processor -- start 2024-09-13T19:16:38.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.773+0000 7fe7eeb2e800 1 -- start start 2024-09-13T19:16:38.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.773+0000 7fe7eeb2e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7822e1400 0x55e782409270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.773+0000 7fe7eeb2e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e7822e0130 con 0x55e7822e1400 2024-09-13T19:16:38.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.773+0000 7fe7eaf6f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7822e1400 0x55e782409270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.773+0000 7fe7eaf6f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7822e1400 0x55e782409270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:55700/0 (socket says 172.21.15.102:55700) 2024-09-13T19:16:38.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.773+0000 7fe7eaf6f640 1 -- 172.21.15.102:0/475549270 learned_addr learned my addr 172.21.15.102:0/475549270 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:16:38.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.773+0000 7fe7eaf6f640 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7824097b0 con 0x55e7822e1400 2024-09-13T19:16:38.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.773+0000 7fe7eaf6f640 1 --2- 172.21.15.102:0/475549270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7822e1400 0x55e782409270 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fe7e4043040 tx=0x7fe7e404c5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.773+0000 7fe6bbfff640 1 -- 172.21.15.102:0/475549270 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7e4045070 con 0x55e7822e1400 2024-09-13T19:16:38.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.773+0000 7fe6bbfff640 1 -- 172.21.15.102:0/475549270 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7e4046040 con 0x55e7822e1400 2024-09-13T19:16:38.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.773+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e782409a40 con 0x55e7822e1400 2024-09-13T19:16:38.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.773+0000 7fe6bbfff640 1 -- 172.21.15.102:0/475549270 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7e403f040 con 0x55e7822e1400 2024-09-13T19:16:38.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.774+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e78240c6f0 con 0x55e7822e1400 2024-09-13T19:16:38.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.774+0000 7fe6bbfff640 1 -- 172.21.15.102:0/475549270 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe7e4016040 con 0x55e7822e1400 2024-09-13T19:16:38.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.775+0000 7fe6bbfff640 1 --2- 172.21.15.102:0/475549270 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe6b4036af0 0x7fe6b4038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.775+0000 7fe6bbfff640 1 -- 172.21.15.102:0/475549270 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fe7e4022870 con 0x55e7822e1400 2024-09-13T19:16:38.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.775+0000 7fe7ea76e640 1 --2- 172.21.15.102:0/475549270 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe6b4036af0 0x7fe6b4038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.775+0000 7fe7ea76e640 1 --2- 172.21.15.102:0/475549270 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe6b4036af0 0x7fe6b4038fb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc08f6d0 tx=0x7fe7dc088000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.775+0000 7fe7eeb2e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.775+0000 7fe7eeb2e800 1 --2- 172.21.15.102:0/475549270 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e782414d80 0x55e782417240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.775+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e782417990 con 0x55e782414d80 2024-09-13T19:16:38.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.775+0000 7fe7e9f6d640 1 --2- 172.21.15.102:0/475549270 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e782414d80 0x55e782417240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.776+0000 7fe7e9f6d640 1 --2- 172.21.15.102:0/475549270 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e782414d80 0x55e782417240 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.776+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe7e000bdb0 con 0x55e782414d80 2024-09-13T19:16:38.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.776+0000 7fe7eeb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:38.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.776+0000 7fe7eeb2e800 20 realm 2024-09-13T19:16:38.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.776+0000 7fe7eeb2e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.776+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e7824141d0 con 0x55e782414d80 2024-09-13T19:16:38.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.776+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe7e000bdb0 con 0x55e782414d80 2024-09-13T19:16:38.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.776+0000 7fe7eeb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:38.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.776+0000 7fe7eeb2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:16:38.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.776+0000 7fe7eeb2e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.776+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e782418480 con 0x55e782414d80 2024-09-13T19:16:38.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.776+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe7e000bdb0 con 0x55e782414d80 2024-09-13T19:16:38.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.776+0000 7fe7eeb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:38.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.776+0000 7fe7eeb2e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.776+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e782418d50 con 0x55e782414d80 2024-09-13T19:16:38.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.777+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe7e000bdb0 con 0x55e782414d80 2024-09-13T19:16:38.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.777+0000 7fe7eeb2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:38.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.777+0000 7fe7eeb2e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.777+0000 7fe7eeb2e800 1 --2- 172.21.15.102:0/475549270 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e782419770 0x55e78241bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.777+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e78241c250 con 0x55e782419770 2024-09-13T19:16:38.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.777+0000 7fe7eaf6f640 1 --2- 172.21.15.102:0/475549270 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e782419770 0x55e78241bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.777+0000 7fe7eaf6f640 1 --2- 172.21.15.102:0/475549270 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e782419770 0x55e78241bb60 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.777+0000 7fe7eaf6f640 1 -- 172.21.15.102:0/475549270 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe7e403a020 con 0x55e782419770 2024-09-13T19:16:38.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.777+0000 7fe7eeb2e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:16:38.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.777+0000 7fe7eeb2e800 20 searching for the correct realm 2024-09-13T19:16:38.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.777+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e78241dba0 con 0x55e782419770 2024-09-13T19:16:38.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.778+0000 7fe7eaf6f640 1 -- 172.21.15.102:0/475549270 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7e403a020 con 0x55e782419770 2024-09-13T19:16:38.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.778+0000 7fe7eaf6f640 1 --2- 172.21.15.102:0/475549270 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fe7e4021020 0x7fe7e4029880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.778+0000 7fe7eaf6f640 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e78241dba0 con 0x7fe7e4021020 2024-09-13T19:16:38.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.778+0000 7fe7ea76e640 1 --2- 172.21.15.102:0/475549270 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fe7e4021020 0x7fe7e4029880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.778+0000 7fe7ea76e640 1 --2- 172.21.15.102:0/475549270 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fe7e4021020 0x7fe7e4029880 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.778+0000 7fe7ea76e640 1 -- 172.21.15.102:0/475549270 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7dc09e070 con 0x7fe7e4021020 2024-09-13T19:16:38.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.778+0000 7fe7ea76e640 1 --2- 172.21.15.102:0/475549270 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fe7dc08f780 0x7fe7dc06c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:16:38.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.778+0000 7fe7ea76e640 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e78241dba0 con 0x7fe7dc08f780 2024-09-13T19:16:38.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.778+0000 7fe7e9f6d640 1 --2- 172.21.15.102:0/475549270 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fe7dc08f780 0x7fe7dc06c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:16:38.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.779+0000 7fe7e9f6d640 1 --2- 172.21.15.102:0/475549270 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fe7dc08f780 0x7fe7dc06c3f0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:16:38.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.779+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7e000bdb0 con 0x7fe7dc08f780 2024-09-13T19:16:38.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.779+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e78241dba0 con 0x55e782414d80 2024-09-13T19:16:38.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.779+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7e000bdb0 con 0x55e782414d80 2024-09-13T19:16:38.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.779+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e78241dba0 con 0x55e782414d80 2024-09-13T19:16:38.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.780+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7e002a040 con 0x55e782414d80 2024-09-13T19:16:38.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.780+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e78241dba0 con 0x7fe7dc08f780 2024-09-13T19:16:38.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.780+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7e002a040 con 0x7fe7dc08f780 2024-09-13T19:16:38.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.780+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e78241dba0 con 0x7fe7dc08f780 2024-09-13T19:16:38.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.780+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7e002a040 con 0x7fe7dc08f780 2024-09-13T19:16:38.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.780+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e78241dba0 con 0x7fe7e4021020 2024-09-13T19:16:38.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.780+0000 7fe7ea76e640 1 -- 172.21.15.102:0/475549270 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7dc09e070 con 0x7fe7e4021020 2024-09-13T19:16:38.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.780+0000 7fe7ea76e640 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e78241dba0 con 0x55e782419770 2024-09-13T19:16:38.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.780+0000 7fe7eaf6f640 1 -- 172.21.15.102:0/475549270 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7e403a020 con 0x55e782419770 2024-09-13T19:16:38.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.780+0000 7fe7eaf6f640 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e78241dba0 con 0x55e782414d80 2024-09-13T19:16:38.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.781+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7e002a040 con 0x55e782414d80 2024-09-13T19:16:38.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.781+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e78241dba0 con 0x7fe7e4021020 2024-09-13T19:16:38.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.781+0000 7fe7ea76e640 1 -- 172.21.15.102:0/475549270 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7dc09e070 con 0x7fe7e4021020 2024-09-13T19:16:38.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.781+0000 7fe7ea76e640 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e78241dba0 con 0x55e782414d80 2024-09-13T19:16:38.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.781+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7e002a040 con 0x55e782414d80 2024-09-13T19:16:38.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.781+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e78241dba0 con 0x7fe7e4021020 2024-09-13T19:16:38.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.781+0000 7fe7ea76e640 1 -- 172.21.15.102:0/475549270 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe7dc09e070 con 0x7fe7e4021020 2024-09-13T19:16:38.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.781+0000 7fe7ea76e640 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e78241dba0 con 0x55e782419770 2024-09-13T19:16:38.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.782+0000 7fe7eaf6f640 1 -- 172.21.15.102:0/475549270 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7e403a020 con 0x55e782419770 2024-09-13T19:16:38.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.782+0000 7fe7eaf6f640 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e78241dba0 con 0x55e782419770 2024-09-13T19:16:38.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.782+0000 7fe7eaf6f640 1 -- 172.21.15.102:0/475549270 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe7e403a020 con 0x55e782419770 2024-09-13T19:16:38.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.782+0000 7fe7eaf6f640 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e78241dba0 con 0x7fe7dc08f780 2024-09-13T19:16:38.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.782+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7e002a040 con 0x7fe7dc08f780 2024-09-13T19:16:38.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.782+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e78241dba0 con 0x55e782419770 2024-09-13T19:16:38.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.782+0000 7fe7eaf6f640 1 -- 172.21.15.102:0/475549270 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe7e403a020 con 0x55e782419770 2024-09-13T19:16:38.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.783+0000 7fe7eaf6f640 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e78241dba0 con 0x55e782419770 2024-09-13T19:16:38.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.783+0000 7fe7eaf6f640 1 -- 172.21.15.102:0/475549270 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7e403a020 con 0x55e782419770 2024-09-13T19:16:38.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.783+0000 7fe7eaf6f640 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e78241dba0 con 0x55e782414d80 2024-09-13T19:16:38.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.783+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7e002a040 con 0x55e782414d80 2024-09-13T19:16:38.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.783+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e78241dba0 con 0x55e782414d80 2024-09-13T19:16:38.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.783+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe7e002a040 con 0x55e782414d80 2024-09-13T19:16:38.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.783+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e78241dba0 con 0x7fe7dc08f780 2024-09-13T19:16:38.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.783+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7e002a040 con 0x7fe7dc08f780 2024-09-13T19:16:38.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.783+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e78241dba0 con 0x55e782419770 2024-09-13T19:16:38.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.784+0000 7fe7eaf6f640 1 -- 172.21.15.102:0/475549270 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7e403a020 con 0x55e782419770 2024-09-13T19:16:38.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.784+0000 7fe7eaf6f640 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e78241dba0 con 0x7fe7e4021020 2024-09-13T19:16:38.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.784+0000 7fe7ea76e640 1 -- 172.21.15.102:0/475549270 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7dc09e070 con 0x7fe7e4021020 2024-09-13T19:16:38.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.784+0000 7fe7ea76e640 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e78241dba0 con 0x55e782414d80 2024-09-13T19:16:38.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.784+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7e002a040 con 0x55e782414d80 2024-09-13T19:16:38.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.784+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e78241dba0 con 0x7fe7e4021020 2024-09-13T19:16:38.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.784+0000 7fe7ea76e640 1 -- 172.21.15.102:0/475549270 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7dc09e070 con 0x7fe7e4021020 2024-09-13T19:16:38.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.784+0000 7fe7ea76e640 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e78241dba0 con 0x55e782419770 2024-09-13T19:16:38.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.785+0000 7fe7eaf6f640 1 -- 172.21.15.102:0/475549270 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7e403a020 con 0x55e782419770 2024-09-13T19:16:38.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.785+0000 7fe7eaf6f640 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e78241dba0 con 0x7fe7dc08f780 2024-09-13T19:16:38.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.785+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7e002a040 con 0x7fe7dc08f780 2024-09-13T19:16:38.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.785+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e78241dba0 con 0x7fe7e4021020 2024-09-13T19:16:38.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.785+0000 7fe7ea76e640 1 -- 172.21.15.102:0/475549270 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7dc09e070 con 0x7fe7e4021020 2024-09-13T19:16:38.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.785+0000 7fe7ea76e640 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e78241dba0 con 0x55e782419770 2024-09-13T19:16:38.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.785+0000 7fe7eaf6f640 1 -- 172.21.15.102:0/475549270 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7e403a020 con 0x55e782419770 2024-09-13T19:16:38.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.785+0000 7fe7eaf6f640 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e78241dba0 con 0x7fe7dc08f780 2024-09-13T19:16:38.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.786+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7e002a040 con 0x7fe7dc08f780 2024-09-13T19:16:38.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.786+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e78241dba0 con 0x55e782414d80 2024-09-13T19:16:38.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.786+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe7e002a040 con 0x55e782414d80 2024-09-13T19:16:38.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.786+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e78241dba0 con 0x7fe7e4021020 2024-09-13T19:16:38.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.786+0000 7fe7ea76e640 1 -- 172.21.15.102:0/475549270 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7dc09e070 con 0x7fe7e4021020 2024-09-13T19:16:38.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.786+0000 7fe7eeb2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:16:38.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.786+0000 7fe7eeb2e800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:16:38.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.786+0000 7fe7eeb2e800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:16:38.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.786+0000 7fe7eeb2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:16:38.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.786+0000 7fe7eeb2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:16:38.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.786+0000 7fe7eeb2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:16:38.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.786+0000 7fe7eeb2e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.786+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e78241cc40 con 0x55e782414d80 2024-09-13T19:16:38.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.786+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe7e002a040 con 0x55e782414d80 2024-09-13T19:16:38.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.786+0000 7fe7eeb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:38.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.787+0000 7fe7eeb2e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.787+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e78241d4e0 con 0x55e782414d80 2024-09-13T19:16:38.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.787+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe7e002a040 con 0x55e782414d80 2024-09-13T19:16:38.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.787+0000 7fe7eeb2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:16:38.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.787+0000 7fe7eeb2e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.787+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e78241e020 con 0x55e782419770 2024-09-13T19:16:38.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.787+0000 7fe7eaf6f640 1 -- 172.21.15.102:0/475549270 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe7e403a020 con 0x55e782419770 2024-09-13T19:16:38.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.787+0000 7fe7eeb2e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:16:38.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.787+0000 7fe7eeb2e800 20 zone default found 2024-09-13T19:16:38.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.787+0000 7fe7eeb2e800 4 Realm: () 2024-09-13T19:16:38.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.787+0000 7fe7eeb2e800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:16:38.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.787+0000 7fe7eeb2e800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:16:38.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.787+0000 7fe7eeb2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:16:38.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.787+0000 7fe7eeb2e800 20 zonegroup default 2024-09-13T19:16:38.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.787+0000 7fe7eeb2e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.787+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e78241e870 con 0x7fe7e4021020 2024-09-13T19:16:38.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.787+0000 7fe7ea76e640 1 -- 172.21.15.102:0/475549270 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe7dc09e070 con 0x7fe7e4021020 2024-09-13T19:16:38.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.787+0000 7fe7eeb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:38.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.787+0000 7fe7eeb2e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.787+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e7824205f0 con 0x55e782419770 2024-09-13T19:16:38.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.788+0000 7fe7eaf6f640 1 -- 172.21.15.102:0/475549270 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe7e403a020 con 0x55e782419770 2024-09-13T19:16:38.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.788+0000 7fe7eeb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:38.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.788+0000 7fe7eeb2e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.788+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e782420a40 con 0x55e782419770 2024-09-13T19:16:38.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.788+0000 7fe7eaf6f640 1 -- 172.21.15.102:0/475549270 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe7e403a020 con 0x55e782419770 2024-09-13T19:16:38.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.788+0000 7fe7eeb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:16:38.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.788+0000 7fe7eeb2e800 20 started sync module instance, tier type = 2024-09-13T19:16:38.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.788+0000 7fe7eeb2e800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:16:38.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.788+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e78241fa90 con 0x7fe7e4021020 2024-09-13T19:16:38.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.789+0000 7fe7ea76e640 1 -- 172.21.15.102:0/475549270 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(44 notify.0 [create] v36'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7dc09e070 con 0x7fe7e4021020 2024-09-13T19:16:38.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.789+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94452811167200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e782420ea0 con 0x7fe7e4021020 2024-09-13T19:16:38.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.789+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e7824216f0 con 0x55e782414d80 2024-09-13T19:16:38.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.790+0000 7fe7ea76e640 1 -- 172.21.15.102:0/475549270 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94452811167200] v36'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7dc09e070 con 0x7fe7e4021020 2024-09-13T19:16:38.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.790+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v36'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7e002a040 con 0x55e782414d80 2024-09-13T19:16:38.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.790+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94452811173536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e7824212c0 con 0x55e782414d80 2024-09-13T19:16:38.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.790+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e7824223f0 con 0x55e782419770 2024-09-13T19:16:38.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.791+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94452811173536] v36'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7e002a040 con 0x55e782414d80 2024-09-13T19:16:38.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.791+0000 7fe7eaf6f640 1 -- 172.21.15.102:0/475549270 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v36'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7e403a020 con 0x55e782419770 2024-09-13T19:16:38.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.791+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94452811176592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e782422360 con 0x55e782419770 2024-09-13T19:16:38.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.791+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e782422e20 con 0x7fe7e4021020 2024-09-13T19:16:38.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.792+0000 7fe7eaf6f640 1 -- 172.21.15.102:0/475549270 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94452811176592] v36'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7e403a020 con 0x55e782419770 2024-09-13T19:16:38.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.792+0000 7fe7ea76e640 1 -- 172.21.15.102:0/475549270 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(50 notify.3 [create] v36'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7dc09e070 con 0x7fe7e4021020 2024-09-13T19:16:38.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.793+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94452811180368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e782422360 con 0x7fe7e4021020 2024-09-13T19:16:38.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.793+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e782423870 con 0x55e782414d80 2024-09-13T19:16:38.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.793+0000 7fe7ea76e640 1 -- 172.21.15.102:0/475549270 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94452811180368] v36'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7dc09e070 con 0x7fe7e4021020 2024-09-13T19:16:38.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.794+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v36'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7e002a040 con 0x55e782414d80 2024-09-13T19:16:38.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.794+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94452811182976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e782422360 con 0x55e782414d80 2024-09-13T19:16:38.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.794+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e7824242c0 con 0x7fe7dc08f780 2024-09-13T19:16:38.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.795+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94452811182976] v36'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7e002a040 con 0x55e782414d80 2024-09-13T19:16:38.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.795+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(54 notify.5 [create] v36'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7e002a040 con 0x7fe7dc08f780 2024-09-13T19:16:38.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.795+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94452811185616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e782422360 con 0x7fe7dc08f780 2024-09-13T19:16:38.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.795+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e782424d30 con 0x7fe7dc08f780 2024-09-13T19:16:38.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.796+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(56 notify.6 [create] v36'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7e002a040 con 0x7fe7dc08f780 2024-09-13T19:16:38.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.796+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94452811188256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e7824251a0 con 0x7fe7dc08f780 2024-09-13T19:16:38.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.796+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e782425cc0 con 0x7fe7dc08f780 2024-09-13T19:16:38.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.796+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94452811185616] v36'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7e002a040 con 0x7fe7dc08f780 2024-09-13T19:16:38.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.797+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94452811188256] v36'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7e002a040 con 0x7fe7dc08f780 2024-09-13T19:16:38.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.797+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(58 notify.7 [create] v36'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7e002a040 con 0x7fe7dc08f780 2024-09-13T19:16:38.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.797+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94452811192208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e782424d30 con 0x7fe7dc08f780 2024-09-13T19:16:38.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.797+0000 7fe7eeb2e800 20 add_watcher() i=0 2024-09-13T19:16:38.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.797+0000 7fe7eeb2e800 20 add_watcher() i=1 2024-09-13T19:16:38.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.797+0000 7fe7eeb2e800 20 add_watcher() i=2 2024-09-13T19:16:38.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.797+0000 7fe7eeb2e800 20 add_watcher() i=3 2024-09-13T19:16:38.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.797+0000 7fe7eeb2e800 20 add_watcher() i=4 2024-09-13T19:16:38.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.797+0000 7fe7eeb2e800 20 add_watcher() i=5 2024-09-13T19:16:38.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.797+0000 7fe7eeb2e800 20 add_watcher() i=6 2024-09-13T19:16:38.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.798+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94452811192208] v36'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7e002a040 con 0x7fe7dc08f780 2024-09-13T19:16:38.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.798+0000 7fe7eeb2e800 20 add_watcher() i=7 2024-09-13T19:16:38.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.798+0000 7fe7eeb2e800 2 all 8 watchers are set, enabling cache 2024-09-13T19:16:38.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.798+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e782428dc0 con 0x55e782414d80 2024-09-13T19:16:38.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.798+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe7e002a040 con 0x55e782414d80 2024-09-13T19:16:38.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.798+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94452811177648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e782426240 con 0x55e782414d80 2024-09-13T19:16:38.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.799+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94452811177648] v36'191 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe7e002a040 con 0x55e782414d80 2024-09-13T19:16:38.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.800+0000 7fe6a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:38.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.800+0000 7fe7eeb2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:16:38.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.800+0000 7fe7eeb2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:16:38.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.800+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e7824316f0 con 0x55e782414d80 2024-09-13T19:16:38.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.801+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v36'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe7e002a040 con 0x55e782414d80 2024-09-13T19:16:38.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.801+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e782431dc0 con 0x7fe7dc08f780 2024-09-13T19:16:38.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.802+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v36'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe7e002a040 con 0x7fe7dc08f780 2024-09-13T19:16:38.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.802+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e7824321e0 con 0x55e782419770 2024-09-13T19:16:38.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.803+0000 7fe7eaf6f640 1 -- 172.21.15.102:0/475549270 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v36'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe7e403a020 con 0x55e782419770 2024-09-13T19:16:38.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.803+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e782432130 con 0x55e782414d80 2024-09-13T19:16:38.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.804+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v36'192 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe7e002a040 con 0x55e782414d80 2024-09-13T19:16:38.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.804+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e7824326e0 con 0x7fe7e4021020 2024-09-13T19:16:38.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.805+0000 7fe7ea76e640 1 -- 172.21.15.102:0/475549270 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v36'67 uv55 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe7dc09e070 con 0x7fe7e4021020 2024-09-13T19:16:38.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.805+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e782432c50 con 0x55e782419770 2024-09-13T19:16:38.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.806+0000 7fe7eaf6f640 1 -- 172.21.15.102:0/475549270 <== osd.3 v2:172.21.15.102:6800/3096737090 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v36'44 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe7e403a020 con 0x55e782419770 2024-09-13T19:16:38.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.806+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e782433060 con 0x55e782414d80 2024-09-13T19:16:38.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.807+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v36'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe7e002a040 con 0x55e782414d80 2024-09-13T19:16:38.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.807+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e782433060 con 0x7fe7dc08f780 2024-09-13T19:16:38.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.808+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(69 gc.7 [create,call,call,call] v36'43 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe7e002a040 con 0x7fe7dc08f780 2024-09-13T19:16:38.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.808+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e782433060 con 0x7fe7e4021020 2024-09-13T19:16:38.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.809+0000 7fe7ea76e640 1 -- 172.21.15.102:0/475549270 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v36'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe7dc09e070 con 0x7fe7e4021020 2024-09-13T19:16:38.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.809+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e782433060 con 0x55e782419770 2024-09-13T19:16:38.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.810+0000 7fe7eaf6f640 1 -- 172.21.15.102:0/475549270 <== osd.3 v2:172.21.15.102:6800/3096737090 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v36'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe7e403a020 con 0x55e782419770 2024-09-13T19:16:38.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.810+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e7824330f0 con 0x7fe7e4021020 2024-09-13T19:16:38.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.811+0000 7fe7ea76e640 1 -- 172.21.15.102:0/475549270 <== osd.2 v2:172.21.15.102:6816/2238176080 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v36'68 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe7dc09e070 con 0x7fe7e4021020 2024-09-13T19:16:38.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.811+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e7824330f0 con 0x7fe7dc08f780 2024-09-13T19:16:38.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.812+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v36'28 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe7e002a040 con 0x7fe7dc08f780 2024-09-13T19:16:38.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.812+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e7824334f0 con 0x7fe7e4021020 2024-09-13T19:16:38.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.813+0000 7fe7ea76e640 1 -- 172.21.15.102:0/475549270 <== osd.2 v2:172.21.15.102:6816/2238176080 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v36'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe7dc09e070 con 0x7fe7e4021020 2024-09-13T19:16:38.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.813+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e7824334f0 con 0x7fe7dc08f780 2024-09-13T19:16:38.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.814+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(75 gc.13 [create,call,call,call] v36'49 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe7e002a040 con 0x7fe7dc08f780 2024-09-13T19:16:38.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.814+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e7824334f0 con 0x55e782414d80 2024-09-13T19:16:38.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.815+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v36'193 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe7e002a040 con 0x55e782414d80 2024-09-13T19:16:38.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.815+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e7824334f0 con 0x55e782419770 2024-09-13T19:16:38.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.816+0000 7fe7eaf6f640 1 -- 172.21.15.102:0/475549270 <== osd.3 v2:172.21.15.102:6800/3096737090 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v36'59 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe7e403a020 con 0x55e782419770 2024-09-13T19:16:38.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.816+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e7824334f0 con 0x7fe7e4021020 2024-09-13T19:16:38.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.817+0000 7fe7ea76e640 1 -- 172.21.15.102:0/475549270 <== osd.2 v2:172.21.15.102:6816/2238176080 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v36'69 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe7dc09e070 con 0x7fe7e4021020 2024-09-13T19:16:38.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.817+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e7824334f0 con 0x55e782419770 2024-09-13T19:16:38.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.818+0000 7fe7eaf6f640 1 -- 172.21.15.102:0/475549270 <== osd.3 v2:172.21.15.102:6800/3096737090 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v36'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe7e403a020 con 0x55e782419770 2024-09-13T19:16:38.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.818+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e7824334f0 con 0x55e782414d80 2024-09-13T19:16:38.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.819+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v36'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe7e002a040 con 0x55e782414d80 2024-09-13T19:16:38.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.819+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e7824334f0 con 0x55e782414d80 2024-09-13T19:16:38.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.820+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v36'194 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe7e002a040 con 0x55e782414d80 2024-09-13T19:16:38.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.820+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e7824334f0 con 0x55e782419770 2024-09-13T19:16:38.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.821+0000 7fe7eaf6f640 1 -- 172.21.15.102:0/475549270 <== osd.3 v2:172.21.15.102:6800/3096737090 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v36'60 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe7e403a020 con 0x55e782419770 2024-09-13T19:16:38.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.821+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e7824334f0 con 0x7fe7e4021020 2024-09-13T19:16:38.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.822+0000 7fe7ea76e640 1 -- 172.21.15.102:0/475549270 <== osd.2 v2:172.21.15.102:6816/2238176080 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v36'35 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe7dc09e070 con 0x7fe7e4021020 2024-09-13T19:16:38.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.822+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e7824334f0 con 0x55e782419770 2024-09-13T19:16:38.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.823+0000 7fe7eaf6f640 1 -- 172.21.15.102:0/475549270 <== osd.3 v2:172.21.15.102:6800/3096737090 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v36'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe7e403a020 con 0x55e782419770 2024-09-13T19:16:38.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.823+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e7824334f0 con 0x55e782419770 2024-09-13T19:16:38.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.824+0000 7fe7eaf6f640 1 -- 172.21.15.102:0/475549270 <== osd.3 v2:172.21.15.102:6800/3096737090 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v36'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe7e403a020 con 0x55e782419770 2024-09-13T19:16:38.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.824+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e782433970 con 0x55e782419770 2024-09-13T19:16:38.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.825+0000 7fe7eaf6f640 1 -- 172.21.15.102:0/475549270 <== osd.3 v2:172.21.15.102:6800/3096737090 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v36'21 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe7e403a020 con 0x55e782419770 2024-09-13T19:16:38.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.825+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e782433970 con 0x55e782419770 2024-09-13T19:16:38.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.826+0000 7fe7eaf6f640 1 -- 172.21.15.102:0/475549270 <== osd.3 v2:172.21.15.102:6800/3096737090 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v36'45 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe7e403a020 con 0x55e782419770 2024-09-13T19:16:38.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.826+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e782433970 con 0x7fe7dc08f780 2024-09-13T19:16:38.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.828+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(88 gc.26 [create,call,call,call] v36'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe7e002a040 con 0x7fe7dc08f780 2024-09-13T19:16:38.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.828+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e782433970 con 0x55e782419770 2024-09-13T19:16:38.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.829+0000 7fe7eaf6f640 1 -- 172.21.15.102:0/475549270 <== osd.3 v2:172.21.15.102:6800/3096737090 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v36'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe7e403a020 con 0x55e782419770 2024-09-13T19:16:38.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.829+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e782433970 con 0x7fe7dc08f780 2024-09-13T19:16:38.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.829+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(90 gc.28 [create,call,call,call] v36'44 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe7e002a040 con 0x7fe7dc08f780 2024-09-13T19:16:38.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.830+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e782433970 con 0x55e782419770 2024-09-13T19:16:38.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.830+0000 7fe7eaf6f640 1 -- 172.21.15.102:0/475549270 <== osd.3 v2:172.21.15.102:6800/3096737090 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v36'61 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe7e403a020 con 0x55e782419770 2024-09-13T19:16:38.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.831+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e782433970 con 0x7fe7dc08f780 2024-09-13T19:16:38.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.831+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.0 v2:172.21.15.53:6800/4021716951 20 ==== osd_op_reply(92 gc.30 [create,call,call,call] v36'50 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe7e002a040 con 0x7fe7dc08f780 2024-09-13T19:16:38.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.832+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e782433970 con 0x7fe7e4021020 2024-09-13T19:16:38.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.833+0000 7fe7ea76e640 1 -- 172.21.15.102:0/475549270 <== osd.2 v2:172.21.15.102:6816/2238176080 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v36'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe7dc09e070 con 0x7fe7e4021020 2024-09-13T19:16:38.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.833+0000 7fe61b7fe640 20 reqs_thread_entry: start 2024-09-13T19:16:38.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.833+0000 7fe7eeb2e800 20 init_complete bucket index max shards: 11 2024-09-13T19:16:38.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.833+0000 7fe7eeb2e800 20 Filter name: none 2024-09-13T19:16:38.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.833+0000 7fe6197fa640 20 reqs_thread_entry: start 2024-09-13T19:16:38.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.833+0000 7fe7eeb2e800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:16:38.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.833+0000 7fe7eeb2e800 20 rados->read ofs=0 len=0 2024-09-13T19:16:38.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.833+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e78245e240 con 0x55e782414d80 2024-09-13T19:16:38.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.834+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fe7e002a040 con 0x55e782414d80 2024-09-13T19:16:38.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.834+0000 7fe7eeb2e800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:16:38.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.834+0000 7fe7eeb2e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:16:38.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.834+0000 7fe7eeb2e800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:16:38.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.834+0000 7fe7eeb2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:16:38.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.834+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e78245e200 con 0x7fe7e4021020 2024-09-13T19:16:38.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.834+0000 7fe7ea76e640 1 -- 172.21.15.102:0/475549270 <== osd.2 v2:172.21.15.102:6816/2238176080 21 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv49 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fe7dc09e070 con 0x7fe7e4021020 2024-09-13T19:16:38.838 INFO:teuthology.orchestra.run.smithi102.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-13T19:16:38.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.835+0000 7fe6a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:16:38.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.835+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94452811177648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e782430760 con 0x55e782414d80 2024-09-13T19:16:38.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.836+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.1 v2:172.21.15.102:6808/2204418452 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94452811177648] v36'195 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe7e002a040 con 0x55e782414d80 2024-09-13T19:16:38.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.836+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94452811167200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e782421eb0 con 0x7fe7e4021020 2024-09-13T19:16:38.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.837+0000 7fe7ea76e640 1 -- 172.21.15.102:0/475549270 <== osd.2 v2:172.21.15.102:6816/2238176080 22 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94452811167200] v36'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7dc09e070 con 0x7fe7e4021020 2024-09-13T19:16:38.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.837+0000 7fe7eeb2e800 20 remove_watcher() i=0 2024-09-13T19:16:38.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.837+0000 7fe7eeb2e800 2 removed watcher, disabling cache 2024-09-13T19:16:38.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.837+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94452811173536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e78241f5e0 con 0x55e782414d80 2024-09-13T19:16:38.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.838+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.1 v2:172.21.15.102:6808/2204418452 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94452811173536] v36'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7e002a040 con 0x55e782414d80 2024-09-13T19:16:38.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.838+0000 7fe7eeb2e800 20 remove_watcher() i=1 2024-09-13T19:16:38.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.838+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94452811176592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e78241f5e0 con 0x55e782419770 2024-09-13T19:16:38.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.839+0000 7fe7eaf6f640 1 -- 172.21.15.102:0/475549270 <== osd.3 v2:172.21.15.102:6800/3096737090 28 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94452811176592] v36'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7e403a020 con 0x55e782419770 2024-09-13T19:16:38.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.839+0000 7fe7eeb2e800 20 remove_watcher() i=2 2024-09-13T19:16:38.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.839+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94452811180368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e782421f40 con 0x7fe7e4021020 2024-09-13T19:16:38.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.840+0000 7fe7ea76e640 1 -- 172.21.15.102:0/475549270 <== osd.2 v2:172.21.15.102:6816/2238176080 23 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94452811180368] v36'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7dc09e070 con 0x7fe7e4021020 2024-09-13T19:16:38.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.840+0000 7fe7eeb2e800 20 remove_watcher() i=3 2024-09-13T19:16:38.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.840+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94452811182976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e782421f40 con 0x55e782414d80 2024-09-13T19:16:38.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.841+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.1 v2:172.21.15.102:6808/2204418452 30 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94452811182976] v36'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7e002a040 con 0x55e782414d80 2024-09-13T19:16:38.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.841+0000 7fe7eeb2e800 20 remove_watcher() i=4 2024-09-13T19:16:38.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.841+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94452811185616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e782421f40 con 0x7fe7dc08f780 2024-09-13T19:16:38.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.842+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.0 v2:172.21.15.53:6800/4021716951 21 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94452811185616] v36'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7e002a040 con 0x7fe7dc08f780 2024-09-13T19:16:38.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.842+0000 7fe7eeb2e800 20 remove_watcher() i=5 2024-09-13T19:16:38.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.842+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94452811188256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e782421f40 con 0x7fe7dc08f780 2024-09-13T19:16:38.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.843+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.0 v2:172.21.15.53:6800/4021716951 22 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94452811188256] v36'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7e002a040 con 0x7fe7dc08f780 2024-09-13T19:16:38.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.843+0000 7fe7eeb2e800 20 remove_watcher() i=6 2024-09-13T19:16:38.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.843+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94452811192208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e78241f5e0 con 0x7fe7dc08f780 2024-09-13T19:16:38.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.844+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 <== osd.0 v2:172.21.15.53:6800/4021716951 23 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94452811192208] v36'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7e002a040 con 0x7fe7dc08f780 2024-09-13T19:16:38.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.844+0000 7fe7eeb2e800 20 remove_watcher() i=7 2024-09-13T19:16:38.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.844+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fe7dc08f780 msgr2=0x7fe7dc06c3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.844+0000 7fe7eeb2e800 1 --2- 172.21.15.102:0/475549270 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fe7dc08f780 0x7fe7dc06c3f0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.844+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e782414d80 msgr2=0x55e782417240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.844+0000 7fe7eeb2e800 1 --2- 172.21.15.102:0/475549270 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e782414d80 0x55e782417240 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.844+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fe7e4021020 msgr2=0x7fe7e4029880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.844+0000 7fe7eeb2e800 1 --2- 172.21.15.102:0/475549270 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fe7e4021020 0x7fe7e4029880 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.844+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e782419770 msgr2=0x55e78241bb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.844+0000 7fe7eeb2e800 1 --2- 172.21.15.102:0/475549270 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e782419770 0x55e78241bb60 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.844+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe6b4036af0 msgr2=0x7fe6b4038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.844+0000 7fe7eeb2e800 1 --2- 172.21.15.102:0/475549270 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe6b4036af0 0x7fe6b4038fb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc08f6d0 tx=0x7fe7dc088000 comp rx=0 tx=0).stop 2024-09-13T19:16:38.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.844+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7822e1400 msgr2=0x55e782409270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.844+0000 7fe7eeb2e800 1 --2- 172.21.15.102:0/475549270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7822e1400 0x55e782409270 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fe7e4043040 tx=0x7fe7e404c5d0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.844+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 reap_dead start 2024-09-13T19:16:38.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.844+0000 7fe7e9f6d640 1 -- 172.21.15.102:0/475549270 reap_dead start 2024-09-13T19:16:38.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.844+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 shutdown_connections 2024-09-13T19:16:38.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.844+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 >> 172.21.15.102:0/475549270 conn(0x55e7823fbf30 msgr2=0x55e7823fa000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:38.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.844+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 shutdown_connections 2024-09-13T19:16:38.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.844+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/475549270 wait complete. 2024-09-13T19:16:38.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.845+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/102961003 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe6c4036b40 msgr2=0x7fe6c4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.845+0000 7fe7eeb2e800 1 --2- 172.21.15.102:0/102961003 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe6c4036b40 0x7fe6c4039000 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x55e7823e0070 tx=0x7fe7dc053fd0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.845+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/102961003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7823f2f00 msgr2=0x55e7823f3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.845+0000 7fe7eeb2e800 1 --2- 172.21.15.102:0/102961003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7823f2f00 0x55e7823f3320 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x55e7823d92f0 tx=0x7fe7e400beb0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.845+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/102961003 shutdown_connections 2024-09-13T19:16:38.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.845+0000 7fe7eeb2e800 1 --2- 172.21.15.102:0/102961003 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe6c4036b40 0x7fe6c4039000 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.845+0000 7fe7eeb2e800 1 --2- 172.21.15.102:0/102961003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7823f2f00 0x55e7823f3320 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.845+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/102961003 >> 172.21.15.102:0/102961003 conn(0x55e7823e7e90 msgr2=0x55e7823eaa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:38.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.845+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/102961003 shutdown_connections 2024-09-13T19:16:38.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.845+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/102961003 wait complete. 2024-09-13T19:16:38.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.845+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/3659501964 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e7822e4710 msgr2=0x55e7823df1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.845+0000 7fe7eeb2e800 1 --2- 172.21.15.102:0/3659501964 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e7822e4710 0x55e7823df1c0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.845+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/3659501964 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e7823e1ac0 msgr2=0x55e7823e3eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.845+0000 7fe7eeb2e800 1 --2- 172.21.15.102:0/3659501964 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e7823e1ac0 0x55e7823e3eb0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.845+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/3659501964 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe6d0036b40 msgr2=0x7fe6d0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.845+0000 7fe7eeb2e800 1 --2- 172.21.15.102:0/3659501964 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe6d0036b40 0x7fe6d0039000 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x55e782255050 tx=0x7fe7e0001390 comp rx=0 tx=0).stop 2024-09-13T19:16:38.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.845+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/3659501964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7822556b0 msgr2=0x55e7823d8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:16:38.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.845+0000 7fe7eeb2e800 1 --2- 172.21.15.102:0/3659501964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7822556b0 0x55e7823d8240 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc045d30 tx=0x7fe7dc003330 comp rx=0 tx=0).stop 2024-09-13T19:16:38.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.845+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/3659501964 shutdown_connections 2024-09-13T19:16:38.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.845+0000 7fe7eeb2e800 1 --2- 172.21.15.102:0/3659501964 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e7823e1ac0 0x55e7823e3eb0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.845+0000 7fe7eeb2e800 1 --2- 172.21.15.102:0/3659501964 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e7822e4710 0x55e7823df1c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.845+0000 7fe7eeb2e800 1 --2- 172.21.15.102:0/3659501964 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe6d0036b40 0x7fe6d0039000 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.845+0000 7fe7eeb2e800 1 --2- 172.21.15.102:0/3659501964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e7822556b0 0x55e7823d8240 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:16:38.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.845+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/3659501964 >> 172.21.15.102:0/3659501964 conn(0x55e7822dbde0 msgr2=0x55e7823caaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:16:38.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.845+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/3659501964 shutdown_connections 2024-09-13T19:16:38.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:16:38.845+0000 7fe7eeb2e800 1 -- 172.21.15.102:0/3659501964 wait complete. 2024-09-13T19:16:38.857 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-13T19:16:38.876 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:16:38.880 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-13T19:17:13.881 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2024-09-13T19:17:13.881 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2024-09-13T19:17:13.882 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2024-09-13T19:17:13.933 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:17:13.933 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:17:13.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.931+0000 7feb1d210800 1 Processor -- start 2024-09-13T19:17:13.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.931+0000 7feb1d210800 1 -- start start 2024-09-13T19:17:13.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.931+0000 7feb1d210800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x561218591900 0x561218593cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:13.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.931+0000 7feb1d210800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56121844db30 con 0x56121858d4c0 2024-09-13T19:17:13.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.931+0000 7feb1d210800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x56121842f360 con 0x561218591900 2024-09-13T19:17:13.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.932+0000 7feb13fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x561218591900 0x561218593cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:13.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.932+0000 7feb188c1640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x56121858d4c0 0x56121858d8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:49998/0 (socket says 172.21.15.102:49998) 2024-09-13T19:17:13.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.932+0000 7feb188c1640 1 -- 172.21.15.102:0/1724211392 learned_addr learned my addr 172.21.15.102:0/1724211392 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:17:13.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.932+0000 7feb13fff640 1 -- 172.21.15.102:0/1724211392 >> v1:172.21.15.53:6789/0 conn(0x56121858d4c0 legacy=0x56121858d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:13.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.932+0000 7feb13fff640 1 -- 172.21.15.102:0/1724211392 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561218455e00 con 0x561218591900 2024-09-13T19:17:13.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.934+0000 7feb13fff640 1 --2- 172.21.15.102:0/1724211392 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561218591900 0x561218593cf0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7feb0400a470 tx=0x7feb04045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=816af521245d0ed5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:13.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.934+0000 7feb137fe640 1 -- 172.21.15.102:0/1724211392 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb04053570 con 0x561218591900 2024-09-13T19:17:13.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.934+0000 7feb137fe640 1 -- 172.21.15.102:0/1724211392 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb04058070 con 0x561218591900 2024-09-13T19:17:13.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.934+0000 7feb137fe640 1 -- 172.21.15.102:0/1724211392 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb04053880 con 0x561218591900 2024-09-13T19:17:13.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.935+0000 7feb1d210800 1 -- 172.21.15.102:0/1724211392 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561218591900 msgr2=0x561218593cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:13.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.935+0000 7feb1d210800 1 --2- 172.21.15.102:0/1724211392 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561218591900 0x561218593cf0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7feb0400a470 tx=0x7feb04045a20 comp rx=0 tx=0).stop 2024-09-13T19:17:13.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.935+0000 7feb1d210800 1 -- 172.21.15.102:0/1724211392 shutdown_connections 2024-09-13T19:17:13.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.935+0000 7feb1d210800 1 --2- 172.21.15.102:0/1724211392 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561218591900 0x561218593cf0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:13.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.935+0000 7feb1d210800 1 -- 172.21.15.102:0/1724211392 >> 172.21.15.102:0/1724211392 conn(0x561218588df0 msgr2=0x56121858b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:13.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.935+0000 7feb1d210800 1 -- 172.21.15.102:0/1724211392 shutdown_connections 2024-09-13T19:17:13.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.935+0000 7feb1d210800 1 -- 172.21.15.102:0/1724211392 wait complete. 2024-09-13T19:17:13.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.950+0000 7feb1d210800 1 Processor -- start 2024-09-13T19:17:13.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.950+0000 7feb1d210800 1 -- start start 2024-09-13T19:17:13.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.950+0000 7feb1d210800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56121858d4c0 0x561218501d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:13.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.950+0000 7feb1d210800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5612184da330 con 0x56121858d4c0 2024-09-13T19:17:13.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.951+0000 7feb188c1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56121858d4c0 0x561218501d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:13.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.951+0000 7feb188c1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56121858d4c0 0x561218501d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:40992/0 (socket says 172.21.15.102:40992) 2024-09-13T19:17:13.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.951+0000 7feb188c1640 1 -- 172.21.15.102:0/4022872734 learned_addr learned my addr 172.21.15.102:0/4022872734 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:13.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.951+0000 7feb188c1640 1 -- 172.21.15.102:0/4022872734 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561218427bc0 con 0x56121858d4c0 2024-09-13T19:17:13.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.951+0000 7feb188c1640 1 --2- 172.21.15.102:0/4022872734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56121858d4c0 0x561218501d80 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7feb0c001d80 tx=0x7feb0c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=158a62460a4a91fb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:13.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.951+0000 7fea06e05640 1 -- 172.21.15.102:0/4022872734 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb0c013030 con 0x56121858d4c0 2024-09-13T19:17:13.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.951+0000 7fea06e05640 1 -- 172.21.15.102:0/4022872734 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb0c00e470 con 0x56121858d4c0 2024-09-13T19:17:13.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.951+0000 7fea06e05640 1 -- 172.21.15.102:0/4022872734 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb0c00e810 con 0x56121858d4c0 2024-09-13T19:17:13.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.952+0000 7feb1d210800 1 -- 172.21.15.102:0/4022872734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56121858d4c0 msgr2=0x561218501d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:13.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.952+0000 7feb1d210800 1 --2- 172.21.15.102:0/4022872734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56121858d4c0 0x561218501d80 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7feb0c001d80 tx=0x7feb0c001e70 comp rx=0 tx=0).stop 2024-09-13T19:17:13.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.952+0000 7feb1d210800 1 -- 172.21.15.102:0/4022872734 shutdown_connections 2024-09-13T19:17:13.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.952+0000 7feb1d210800 1 --2- 172.21.15.102:0/4022872734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56121858d4c0 0x561218501d80 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:13.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.952+0000 7feb1d210800 1 -- 172.21.15.102:0/4022872734 >> 172.21.15.102:0/4022872734 conn(0x561218588df0 msgr2=0x561218678120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:13.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.952+0000 7feb1d210800 1 -- 172.21.15.102:0/4022872734 shutdown_connections 2024-09-13T19:17:13.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.952+0000 7feb1d210800 1 -- 172.21.15.102:0/4022872734 wait complete. 2024-09-13T19:17:13.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.953+0000 7feb1d210800 1 Processor -- start 2024-09-13T19:17:13.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.953+0000 7feb1d210800 1 -- start start 2024-09-13T19:17:13.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.953+0000 7feb1d210800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56121858d4c0 0x561218685270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:13.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.953+0000 7feb1d210800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561218594530 con 0x56121858d4c0 2024-09-13T19:17:13.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.953+0000 7feb188c1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56121858d4c0 0x561218685270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:13.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.953+0000 7feb188c1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56121858d4c0 0x561218685270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:40998/0 (socket says 172.21.15.102:40998) 2024-09-13T19:17:13.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.953+0000 7feb188c1640 1 -- 172.21.15.102:0/2348231855 learned_addr learned my addr 172.21.15.102:0/2348231855 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:13.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.953+0000 7feb188c1640 1 -- 172.21.15.102:0/2348231855 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56121843bfe0 con 0x56121858d4c0 2024-09-13T19:17:13.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.954+0000 7feb188c1640 1 --2- 172.21.15.102:0/2348231855 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56121858d4c0 0x561218685270 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7feb0c004000 tx=0x7feb0c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:13.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.954+0000 7fea05602640 1 -- 172.21.15.102:0/2348231855 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb0c027070 con 0x56121858d4c0 2024-09-13T19:17:13.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.954+0000 7fea05602640 1 -- 172.21.15.102:0/2348231855 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb0c019900 con 0x56121858d4c0 2024-09-13T19:17:13.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.954+0000 7feb1d210800 1 -- 172.21.15.102:0/2348231855 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5612186857b0 con 0x56121858d4c0 2024-09-13T19:17:13.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.954+0000 7fea05602640 1 -- 172.21.15.102:0/2348231855 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb0c019c60 con 0x56121858d4c0 2024-09-13T19:17:13.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.954+0000 7feb1d210800 1 -- 172.21.15.102:0/2348231855 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561218685cd0 con 0x56121858d4c0 2024-09-13T19:17:13.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.955+0000 7fea05602640 1 -- 172.21.15.102:0/2348231855 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7feb0c02a070 con 0x56121858d4c0 2024-09-13T19:17:13.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.955+0000 7fea05602640 1 --2- 172.21.15.102:0/2348231855 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fea00036b90 0x7fea00039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:13.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.955+0000 7fea05602640 1 -- 172.21.15.102:0/2348231855 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7feb0c01f070 con 0x56121858d4c0 2024-09-13T19:17:13.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.955+0000 7feb13fff640 1 --2- 172.21.15.102:0/2348231855 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fea00036b90 0x7fea00039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:13.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.955+0000 7feb1d210800 1 --2- 172.21.15.102:0/2348231855 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x561218591900 0x56121868c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:13.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.955+0000 7feb1d210800 1 -- 172.21.15.102:0/2348231855 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56121868c8b0 con 0x561218591900 2024-09-13T19:17:13.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.955+0000 7feb190c2640 1 --2- 172.21.15.102:0/2348231855 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x561218591900 0x56121868c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:13.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.956+0000 7feb13fff640 1 --2- 172.21.15.102:0/2348231855 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fea00036b90 0x7fea00039050 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7feb04057000 tx=0x7feb04052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:13.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.956+0000 7feb190c2640 1 --2- 172.21.15.102:0/2348231855 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x561218591900 0x56121868c2e0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:13.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.956+0000 7feb190c2640 1 -- 172.21.15.102:0/2348231855 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feb1400a4a0 con 0x561218591900 2024-09-13T19:17:13.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.956+0000 7feb1d210800 1 -- 172.21.15.102:0/2348231855 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5612186898b0 con 0x561218591900 2024-09-13T19:17:13.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.956+0000 7feb190c2640 1 -- 172.21.15.102:0/2348231855 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7feb1400a4a0 con 0x561218591900 2024-09-13T19:17:13.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.956+0000 7feb1d210800 1 --2- 172.21.15.102:0/2348231855 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56121868ebc0 0x561218690fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:13.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.956+0000 7feb1d210800 1 -- 172.21.15.102:0/2348231855 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561218691650 con 0x56121868ebc0 2024-09-13T19:17:13.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.957+0000 7feb188c1640 1 --2- 172.21.15.102:0/2348231855 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56121868ebc0 0x561218690fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:13.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.957+0000 7feb188c1640 1 --2- 172.21.15.102:0/2348231855 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56121868ebc0 0x561218690fb0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:13.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.957+0000 7feb188c1640 1 -- 172.21.15.102:0/2348231855 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7feb0c029030 con 0x56121868ebc0 2024-09-13T19:17:13.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.957+0000 7feb1d210800 1 -- 172.21.15.102:0/2348231855 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56121868da60 con 0x561218591900 2024-09-13T19:17:13.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.957+0000 7feb190c2640 1 -- 172.21.15.102:0/2348231855 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7feb1400a4a0 con 0x561218591900 2024-09-13T19:17:13.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.957+0000 7feb1d210800 1 -- 172.21.15.102:0/2348231855 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56121868df40 con 0x56121868ebc0 2024-09-13T19:17:13.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.958+0000 7feb188c1640 1 -- 172.21.15.102:0/2348231855 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7feb0c029030 con 0x56121868ebc0 2024-09-13T19:17:13.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.958+0000 7feb1d210800 1 Processor -- start 2024-09-13T19:17:13.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.958+0000 7feb1d210800 1 -- start start 2024-09-13T19:17:13.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.958+0000 7feb1d210800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56121869ffe0 0x5612186a0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:13.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.958+0000 7feb1d210800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561218429580 con 0x56121869ffe0 2024-09-13T19:17:13.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.959+0000 7feb190c2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56121869ffe0 0x5612186a0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:13.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.959+0000 7feb190c2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56121869ffe0 0x5612186a0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41002/0 (socket says 172.21.15.102:41002) 2024-09-13T19:17:13.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.959+0000 7feb190c2640 1 -- 172.21.15.102:0/207615064 learned_addr learned my addr 172.21.15.102:0/207615064 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:13.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.959+0000 7feb190c2640 1 -- 172.21.15.102:0/207615064 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612186a0940 con 0x56121869ffe0 2024-09-13T19:17:13.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.959+0000 7feb190c2640 1 --2- 172.21.15.102:0/207615064 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56121869ffe0 0x5612186a0400 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x56121868cc70 tx=0x7feb140167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:13.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.959+0000 7fe9fe7fc640 1 -- 172.21.15.102:0/207615064 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb14013640 con 0x56121869ffe0 2024-09-13T19:17:13.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.959+0000 7fe9fe7fc640 1 -- 172.21.15.102:0/207615064 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb140137e0 con 0x56121869ffe0 2024-09-13T19:17:13.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.959+0000 7feb1d210800 1 -- 172.21.15.102:0/207615064 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5612186a0bd0 con 0x56121869ffe0 2024-09-13T19:17:13.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.959+0000 7fe9fe7fc640 1 -- 172.21.15.102:0/207615064 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb14013ae0 con 0x56121869ffe0 2024-09-13T19:17:13.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.960+0000 7feb1d210800 1 -- 172.21.15.102:0/207615064 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612186a38b0 con 0x56121869ffe0 2024-09-13T19:17:13.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.960+0000 7fe9fe7fc640 1 -- 172.21.15.102:0/207615064 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7feb14011040 con 0x56121869ffe0 2024-09-13T19:17:13.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.961+0000 7fe9fe7fc640 1 --2- 172.21.15.102:0/207615064 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe9f0036b40 0x7fe9f0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:13.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.961+0000 7fe9fe7fc640 1 -- 172.21.15.102:0/207615064 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7feb1400e040 con 0x56121869ffe0 2024-09-13T19:17:13.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.961+0000 7feb188c1640 1 --2- 172.21.15.102:0/207615064 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe9f0036b40 0x7fe9f0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:13.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.961+0000 7feb1d210800 1 Processor -- start 2024-09-13T19:17:13.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.961+0000 7feb1d210800 1 -- start start 2024-09-13T19:17:13.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.961+0000 7feb188c1640 1 --2- 172.21.15.102:0/207615064 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe9f0036b40 0x7fe9f0039000 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x5612186897d0 tx=0x7feb0c04ad80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:13.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.961+0000 7feb1d210800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56121867d7c0 0x56121867dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:13.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.961+0000 7feb1d210800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561218680740 con 0x56121867d7c0 2024-09-13T19:17:13.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.961+0000 7feb190c2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56121867d7c0 0x56121867dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:13.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.961+0000 7feb190c2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56121867d7c0 0x56121867dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41006/0 (socket says 172.21.15.102:41006) 2024-09-13T19:17:13.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.961+0000 7feb190c2640 1 -- 172.21.15.102:0/1605862373 learned_addr learned my addr 172.21.15.102:0/1605862373 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:13.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.962+0000 7feb190c2640 1 -- 172.21.15.102:0/1605862373 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56121867e190 con 0x56121867d7c0 2024-09-13T19:17:13.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.962+0000 7feb190c2640 1 --2- 172.21.15.102:0/1605862373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56121867d7c0 0x56121867dbc0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7feb1404cf20 tx=0x7feb1401ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b711de7b10060987 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:13.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.962+0000 7fe9effff640 1 -- 172.21.15.102:0/1605862373 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb14046070 con 0x56121867d7c0 2024-09-13T19:17:13.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.962+0000 7fe9effff640 1 -- 172.21.15.102:0/1605862373 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb14029350 con 0x56121867d7c0 2024-09-13T19:17:13.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.962+0000 7fe9effff640 1 -- 172.21.15.102:0/1605862373 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb14021b00 con 0x56121867d7c0 2024-09-13T19:17:13.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.963+0000 7feb1d210800 1 -- 172.21.15.102:0/1605862373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56121867d7c0 msgr2=0x56121867dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:13.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.963+0000 7feb1d210800 1 --2- 172.21.15.102:0/1605862373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56121867d7c0 0x56121867dbc0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7feb1404cf20 tx=0x7feb1401ff90 comp rx=0 tx=0).stop 2024-09-13T19:17:13.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.963+0000 7feb1d210800 1 -- 172.21.15.102:0/1605862373 shutdown_connections 2024-09-13T19:17:13.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.963+0000 7feb1d210800 1 --2- 172.21.15.102:0/1605862373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56121867d7c0 0x56121867dbc0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:13.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.963+0000 7feb1d210800 1 -- 172.21.15.102:0/1605862373 >> 172.21.15.102:0/1605862373 conn(0x5612186a9090 msgr2=0x5612186a7190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:13.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.963+0000 7feb1d210800 1 -- 172.21.15.102:0/1605862373 shutdown_connections 2024-09-13T19:17:13.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.963+0000 7feb1d210800 1 -- 172.21.15.102:0/1605862373 wait complete. 2024-09-13T19:17:13.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.963+0000 7feb1d210800 1 Processor -- start 2024-09-13T19:17:13.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.963+0000 7feb1d210800 1 -- start start 2024-09-13T19:17:13.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.963+0000 7feb1d210800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56121867d7c0 0x5612186b6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:13.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.963+0000 7feb1d210800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56121867c4f0 con 0x56121867d7c0 2024-09-13T19:17:13.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.963+0000 7feb190c2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56121867d7c0 0x5612186b6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:13.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.963+0000 7feb190c2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56121867d7c0 0x5612186b6320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41022/0 (socket says 172.21.15.102:41022) 2024-09-13T19:17:13.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.963+0000 7feb190c2640 1 -- 172.21.15.102:0/3043984617 learned_addr learned my addr 172.21.15.102:0/3043984617 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:13.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.964+0000 7feb190c2640 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612186b6860 con 0x56121867d7c0 2024-09-13T19:17:13.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.964+0000 7feb190c2640 1 --2- 172.21.15.102:0/3043984617 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56121867d7c0 0x5612186b6320 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7feb14048010 tx=0x7feb1404ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:13.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.964+0000 7fe9ee7fc640 1 -- 172.21.15.102:0/3043984617 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb1403a070 con 0x56121867d7c0 2024-09-13T19:17:13.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.964+0000 7fe9ee7fc640 1 -- 172.21.15.102:0/3043984617 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb140298e0 con 0x56121867d7c0 2024-09-13T19:17:13.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.964+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5612186b6af0 con 0x56121867d7c0 2024-09-13T19:17:13.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.964+0000 7fe9ee7fc640 1 -- 172.21.15.102:0/3043984617 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb14046050 con 0x56121867d7c0 2024-09-13T19:17:13.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.964+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612186b97a0 con 0x56121867d7c0 2024-09-13T19:17:13.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.965+0000 7fe9ee7fc640 1 -- 172.21.15.102:0/3043984617 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7feb14046d10 con 0x56121867d7c0 2024-09-13T19:17:13.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.965+0000 7fe9ee7fc640 1 --2- 172.21.15.102:0/3043984617 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe9e4036b40 0x7fe9e4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:13.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.965+0000 7fe9ee7fc640 1 -- 172.21.15.102:0/3043984617 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7feb14031030 con 0x56121867d7c0 2024-09-13T19:17:13.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.965+0000 7feb188c1640 1 --2- 172.21.15.102:0/3043984617 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe9e4036b40 0x7fe9e4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:13.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.966+0000 7feb1d210800 20 rados->read ofs=0 len=0 2024-09-13T19:17:13.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.966+0000 7feb1d210800 1 --2- 172.21.15.102:0/3043984617 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5612186c1e00 0x5612186c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:13.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.966+0000 7feb188c1640 1 --2- 172.21.15.102:0/3043984617 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe9e4036b40 0x7fe9e4039000 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7feb0c016fd0 tx=0x7feb0c037000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:13.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.966+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5612186c4a10 con 0x5612186c1e00 2024-09-13T19:17:13.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.966+0000 7feb13fff640 1 --2- 172.21.15.102:0/3043984617 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5612186c1e00 0x5612186c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:13.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.966+0000 7feb13fff640 1 --2- 172.21.15.102:0/3043984617 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5612186c1e00 0x5612186c42c0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:13.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.966+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feb04051070 con 0x5612186c1e00 2024-09-13T19:17:13.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.966+0000 7feb1d210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:13.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.966+0000 7feb1d210800 20 realm 2024-09-13T19:17:13.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.966+0000 7feb1d210800 20 rados->read ofs=0 len=0 2024-09-13T19:17:13.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.966+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5612186c4e40 con 0x5612186c1e00 2024-09-13T19:17:13.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.967+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feb04051070 con 0x5612186c1e00 2024-09-13T19:17:13.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.967+0000 7feb1d210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:13.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.967+0000 7feb1d210800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:17:13.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.967+0000 7feb1d210800 20 rados->read ofs=0 len=0 2024-09-13T19:17:13.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.967+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5612186c5710 con 0x5612186c1e00 2024-09-13T19:17:13.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.967+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feb04051070 con 0x5612186c1e00 2024-09-13T19:17:13.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.967+0000 7feb1d210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:13.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.967+0000 7feb1d210800 20 rados->read ofs=0 len=0 2024-09-13T19:17:13.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.967+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5612186c5ab0 con 0x5612186c1e00 2024-09-13T19:17:13.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.967+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7feb04051070 con 0x5612186c1e00 2024-09-13T19:17:13.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.967+0000 7feb1d210800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:17:13.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.967+0000 7feb1d210800 20 rados->read ofs=0 len=0 2024-09-13T19:17:13.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.967+0000 7feb1d210800 1 --2- 172.21.15.102:0/3043984617 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5612186c6810 0x5612186c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:13.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.967+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5612186c9140 con 0x5612186c6810 2024-09-13T19:17:13.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.967+0000 7feb190c2640 1 --2- 172.21.15.102:0/3043984617 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5612186c6810 0x5612186c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:13.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.968+0000 7feb190c2640 1 --2- 172.21.15.102:0/3043984617 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5612186c6810 0x5612186c8c00 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:13.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.968+0000 7feb190c2640 1 -- 172.21.15.102:0/3043984617 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7feb14055070 con 0x5612186c6810 2024-09-13T19:17:13.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.968+0000 7feb1d210800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:17:13.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.968+0000 7feb1d210800 20 searching for the correct realm 2024-09-13T19:17:13.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.968+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5612186caaf0 con 0x5612186c6810 2024-09-13T19:17:13.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.968+0000 7feb190c2640 1 -- 172.21.15.102:0/3043984617 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb14055070 con 0x5612186c6810 2024-09-13T19:17:13.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.968+0000 7feb190c2640 1 --2- 172.21.15.102:0/3043984617 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7feb1401f8f0 0x7feb14040150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:13.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.968+0000 7feb190c2640 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5612186caaf0 con 0x7feb1401f8f0 2024-09-13T19:17:13.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.968+0000 7feb188c1640 1 --2- 172.21.15.102:0/3043984617 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7feb1401f8f0 0x7feb14040150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:13.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.969+0000 7feb188c1640 1 --2- 172.21.15.102:0/3043984617 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7feb1401f8f0 0x7feb14040150 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:13.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.969+0000 7feb188c1640 1 -- 172.21.15.102:0/3043984617 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb0c043050 con 0x7feb1401f8f0 2024-09-13T19:17:13.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.969+0000 7feb188c1640 1 --2- 172.21.15.102:0/3043984617 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7feb0c02c060 0x7feb0c02a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:13.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.969+0000 7feb188c1640 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5612186caaf0 con 0x7feb0c02c060 2024-09-13T19:17:13.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.969+0000 7feb13fff640 1 --2- 172.21.15.102:0/3043984617 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7feb0c02c060 0x7feb0c02a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:13.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.970+0000 7feb13fff640 1 --2- 172.21.15.102:0/3043984617 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7feb0c02c060 0x7feb0c02a580 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:13.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.970+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb04051070 con 0x7feb0c02c060 2024-09-13T19:17:13.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.970+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5612186caaf0 con 0x5612186c1e00 2024-09-13T19:17:13.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.970+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb04051070 con 0x5612186c1e00 2024-09-13T19:17:13.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.970+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5612186caaf0 con 0x5612186c1e00 2024-09-13T19:17:13.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.971+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb04051070 con 0x5612186c1e00 2024-09-13T19:17:13.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.971+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5612186caaf0 con 0x7feb0c02c060 2024-09-13T19:17:13.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.971+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb04051070 con 0x7feb0c02c060 2024-09-13T19:17:13.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.971+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5612186caaf0 con 0x7feb0c02c060 2024-09-13T19:17:13.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.971+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb04051070 con 0x7feb0c02c060 2024-09-13T19:17:13.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.971+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5612186caaf0 con 0x7feb1401f8f0 2024-09-13T19:17:13.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.972+0000 7feb188c1640 1 -- 172.21.15.102:0/3043984617 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb0c043050 con 0x7feb1401f8f0 2024-09-13T19:17:13.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.972+0000 7feb188c1640 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5612186caaf0 con 0x5612186c6810 2024-09-13T19:17:13.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.972+0000 7feb190c2640 1 -- 172.21.15.102:0/3043984617 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb14055070 con 0x5612186c6810 2024-09-13T19:17:13.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.972+0000 7feb190c2640 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5612186caaf0 con 0x5612186c1e00 2024-09-13T19:17:13.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.972+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb04051070 con 0x5612186c1e00 2024-09-13T19:17:13.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.972+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5612186caaf0 con 0x7feb1401f8f0 2024-09-13T19:17:13.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.972+0000 7feb188c1640 1 -- 172.21.15.102:0/3043984617 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb0c043050 con 0x7feb1401f8f0 2024-09-13T19:17:13.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.972+0000 7feb188c1640 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5612186caaf0 con 0x5612186c1e00 2024-09-13T19:17:13.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.973+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb04051070 con 0x5612186c1e00 2024-09-13T19:17:13.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.973+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5612186caaf0 con 0x7feb1401f8f0 2024-09-13T19:17:13.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.973+0000 7feb188c1640 1 -- 172.21.15.102:0/3043984617 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7feb0c043050 con 0x7feb1401f8f0 2024-09-13T19:17:13.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.973+0000 7feb188c1640 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5612186caaf0 con 0x5612186c6810 2024-09-13T19:17:13.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.973+0000 7feb190c2640 1 -- 172.21.15.102:0/3043984617 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb14055070 con 0x5612186c6810 2024-09-13T19:17:13.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.973+0000 7feb190c2640 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5612186caaf0 con 0x5612186c6810 2024-09-13T19:17:13.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.973+0000 7feb190c2640 1 -- 172.21.15.102:0/3043984617 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7feb14055070 con 0x5612186c6810 2024-09-13T19:17:13.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.973+0000 7feb190c2640 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5612186caaf0 con 0x7feb0c02c060 2024-09-13T19:17:13.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.974+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb04051070 con 0x7feb0c02c060 2024-09-13T19:17:13.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.974+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5612186caaf0 con 0x5612186c6810 2024-09-13T19:17:13.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.974+0000 7feb190c2640 1 -- 172.21.15.102:0/3043984617 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7feb14055070 con 0x5612186c6810 2024-09-13T19:17:13.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.974+0000 7feb190c2640 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5612186caaf0 con 0x5612186c6810 2024-09-13T19:17:13.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.974+0000 7feb190c2640 1 -- 172.21.15.102:0/3043984617 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb14055070 con 0x5612186c6810 2024-09-13T19:17:13.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.974+0000 7feb190c2640 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5612186caaf0 con 0x5612186c1e00 2024-09-13T19:17:13.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.974+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb04051070 con 0x5612186c1e00 2024-09-13T19:17:13.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.974+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5612186caaf0 con 0x5612186c1e00 2024-09-13T19:17:13.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.975+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7feb04051070 con 0x5612186c1e00 2024-09-13T19:17:13.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.975+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5612186caaf0 con 0x7feb0c02c060 2024-09-13T19:17:13.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.975+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb04051070 con 0x7feb0c02c060 2024-09-13T19:17:13.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.975+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5612186caaf0 con 0x5612186c6810 2024-09-13T19:17:13.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.975+0000 7feb190c2640 1 -- 172.21.15.102:0/3043984617 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb14055070 con 0x5612186c6810 2024-09-13T19:17:13.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.975+0000 7feb190c2640 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5612186caaf0 con 0x7feb1401f8f0 2024-09-13T19:17:13.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.976+0000 7feb188c1640 1 -- 172.21.15.102:0/3043984617 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb0c043050 con 0x7feb1401f8f0 2024-09-13T19:17:13.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.976+0000 7feb188c1640 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5612186caaf0 con 0x5612186c1e00 2024-09-13T19:17:13.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.976+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb04051070 con 0x5612186c1e00 2024-09-13T19:17:13.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.976+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5612186caaf0 con 0x7feb1401f8f0 2024-09-13T19:17:13.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.976+0000 7feb188c1640 1 -- 172.21.15.102:0/3043984617 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb0c043050 con 0x7feb1401f8f0 2024-09-13T19:17:13.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.976+0000 7feb188c1640 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5612186caaf0 con 0x5612186c6810 2024-09-13T19:17:13.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.976+0000 7feb190c2640 1 -- 172.21.15.102:0/3043984617 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb14055070 con 0x5612186c6810 2024-09-13T19:17:13.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.976+0000 7feb190c2640 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5612186caaf0 con 0x7feb0c02c060 2024-09-13T19:17:13.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.977+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb04051070 con 0x7feb0c02c060 2024-09-13T19:17:13.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.977+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5612186caaf0 con 0x7feb1401f8f0 2024-09-13T19:17:13.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.977+0000 7feb188c1640 1 -- 172.21.15.102:0/3043984617 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb0c043050 con 0x7feb1401f8f0 2024-09-13T19:17:13.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.977+0000 7feb188c1640 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5612186caaf0 con 0x5612186c6810 2024-09-13T19:17:13.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.977+0000 7feb190c2640 1 -- 172.21.15.102:0/3043984617 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb14055070 con 0x5612186c6810 2024-09-13T19:17:13.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.977+0000 7feb190c2640 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5612186caaf0 con 0x7feb0c02c060 2024-09-13T19:17:13.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.977+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb04051070 con 0x7feb0c02c060 2024-09-13T19:17:13.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.977+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5612186caaf0 con 0x5612186c1e00 2024-09-13T19:17:13.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.978+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7feb04051070 con 0x5612186c1e00 2024-09-13T19:17:13.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.978+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7feb04084080 con 0x7feb1401f8f0 2024-09-13T19:17:13.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.978+0000 7feb188c1640 1 -- 172.21.15.102:0/3043984617 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb0c043050 con 0x7feb1401f8f0 2024-09-13T19:17:13.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.978+0000 7feb1d210800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:17:13.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.978+0000 7feb1d210800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:17:13.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.978+0000 7feb1d210800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:17:13.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.978+0000 7feb1d210800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:17:13.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.978+0000 7feb1d210800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:17:13.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.978+0000 7feb1d210800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:17:13.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.978+0000 7feb1d210800 20 rados->read ofs=0 len=0 2024-09-13T19:17:13.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.978+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5612186c9bf0 con 0x5612186c1e00 2024-09-13T19:17:13.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.978+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feb04051070 con 0x5612186c1e00 2024-09-13T19:17:13.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.978+0000 7feb1d210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:13.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.978+0000 7feb1d210800 20 rados->read ofs=0 len=0 2024-09-13T19:17:13.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.978+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5612186ca490 con 0x5612186c1e00 2024-09-13T19:17:13.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.979+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7feb04051070 con 0x5612186c1e00 2024-09-13T19:17:13.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.979+0000 7feb1d210800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:17:13.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.979+0000 7feb1d210800 20 rados->read ofs=0 len=0 2024-09-13T19:17:13.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.979+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5612186c9830 con 0x5612186c6810 2024-09-13T19:17:13.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.979+0000 7feb190c2640 1 -- 172.21.15.102:0/3043984617 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7feb14055070 con 0x5612186c6810 2024-09-13T19:17:13.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.979+0000 7feb1d210800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:17:13.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.979+0000 7feb1d210800 20 zone default found 2024-09-13T19:17:13.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.979+0000 7feb1d210800 4 Realm: () 2024-09-13T19:17:13.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.979+0000 7feb1d210800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:17:13.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.979+0000 7feb1d210800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:17:13.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.979+0000 7feb1d210800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:17:13.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.979+0000 7feb1d210800 20 zonegroup default 2024-09-13T19:17:13.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.979+0000 7feb1d210800 20 rados->read ofs=0 len=0 2024-09-13T19:17:13.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.979+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5612186cb470 con 0x7feb1401f8f0 2024-09-13T19:17:13.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.979+0000 7feb188c1640 1 -- 172.21.15.102:0/3043984617 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7feb0c043050 con 0x7feb1401f8f0 2024-09-13T19:17:13.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.979+0000 7feb1d210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:13.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.979+0000 7feb1d210800 20 rados->read ofs=0 len=0 2024-09-13T19:17:13.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.979+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5612186cb080 con 0x5612186c6810 2024-09-13T19:17:13.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.979+0000 7feb190c2640 1 -- 172.21.15.102:0/3043984617 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7feb14055070 con 0x5612186c6810 2024-09-13T19:17:13.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.979+0000 7feb1d210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:13.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.979+0000 7feb1d210800 20 rados->read ofs=0 len=0 2024-09-13T19:17:13.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.979+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5612186cd710 con 0x5612186c6810 2024-09-13T19:17:13.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.980+0000 7feb190c2640 1 -- 172.21.15.102:0/3043984617 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7feb14055070 con 0x5612186c6810 2024-09-13T19:17:13.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.980+0000 7feb1d210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:13.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.980+0000 7feb1d210800 20 started sync module instance, tier type = 2024-09-13T19:17:13.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.980+0000 7feb1d210800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:17:13.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.980+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5612186ccae0 con 0x7feb1401f8f0 2024-09-13T19:17:13.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.981+0000 7feb188c1640 1 -- 172.21.15.102:0/3043984617 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(44 notify.0 [create] v36'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb0c043050 con 0x7feb1401f8f0 2024-09-13T19:17:13.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.981+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94635719181872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5612186cdba0 con 0x7feb1401f8f0 2024-09-13T19:17:13.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.981+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5612186ce3f0 con 0x5612186c1e00 2024-09-13T19:17:13.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.982+0000 7feb188c1640 1 -- 172.21.15.102:0/3043984617 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94635719181872] v36'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb0c043050 con 0x7feb1401f8f0 2024-09-13T19:17:13.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.982+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v36'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb04051070 con 0x5612186c1e00 2024-09-13T19:17:13.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.982+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94635719187360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5612186ce470 con 0x5612186c1e00 2024-09-13T19:17:13.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.982+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5612186ced00 con 0x5612186c6810 2024-09-13T19:17:13.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.983+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94635719187360] v36'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb04051070 con 0x5612186c1e00 2024-09-13T19:17:13.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.984+0000 7feb190c2640 1 -- 172.21.15.102:0/3043984617 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v36'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb14055070 con 0x5612186c6810 2024-09-13T19:17:13.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.984+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94635719188416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5612186ce890 con 0x5612186c6810 2024-09-13T19:17:13.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.984+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5612186cf780 con 0x7feb1401f8f0 2024-09-13T19:17:13.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.985+0000 7feb188c1640 1 -- 172.21.15.102:0/3043984617 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(50 notify.3 [create] v36'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb0c043050 con 0x7feb1401f8f0 2024-09-13T19:17:13.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.985+0000 7feb190c2640 1 -- 172.21.15.102:0/3043984617 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94635719188416] v36'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb14055070 con 0x5612186c6810 2024-09-13T19:17:13.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.985+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94635719193232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5612186cf750 con 0x7feb1401f8f0 2024-09-13T19:17:13.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.985+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5612186ce420 con 0x5612186c1e00 2024-09-13T19:17:13.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.986+0000 7feb188c1640 1 -- 172.21.15.102:0/3043984617 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94635719193232] v36'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb0c043050 con 0x7feb1401f8f0 2024-09-13T19:17:13.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.986+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v36'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb04051070 con 0x5612186c1e00 2024-09-13T19:17:13.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.986+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94635719195504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5612186cf710 con 0x5612186c1e00 2024-09-13T19:17:13.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.986+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5612186d0d10 con 0x7feb0c02c060 2024-09-13T19:17:13.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.987+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94635719195504] v36'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb04051070 con 0x5612186c1e00 2024-09-13T19:17:13.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.987+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(54 notify.5 [create] v36'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb04051070 con 0x7feb0c02c060 2024-09-13T19:17:13.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.987+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94635719197248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5612186d0d10 con 0x7feb0c02c060 2024-09-13T19:17:13.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.987+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5612186d1710 con 0x7feb0c02c060 2024-09-13T19:17:13.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.988+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94635719197248] v36'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb04051070 con 0x7feb0c02c060 2024-09-13T19:17:13.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.988+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(56 notify.6 [create] v36'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb04051070 con 0x7feb0c02c060 2024-09-13T19:17:13.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.988+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94635719201312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5612186d18f0 con 0x7feb0c02c060 2024-09-13T19:17:13.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.988+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5612186d2140 con 0x7feb0c02c060 2024-09-13T19:17:14.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.990+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(58 notify.7 [create] v36'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb04051070 con 0x7feb0c02c060 2024-09-13T19:17:14.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.990+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94635719201312] v36'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb04051070 con 0x7feb0c02c060 2024-09-13T19:17:14.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.990+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94635719203536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5612186d2520 con 0x7feb0c02c060 2024-09-13T19:17:14.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.990+0000 7feb1d210800 20 add_watcher() i=0 2024-09-13T19:17:14.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.990+0000 7feb1d210800 20 add_watcher() i=1 2024-09-13T19:17:14.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.990+0000 7feb1d210800 20 add_watcher() i=2 2024-09-13T19:17:14.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.990+0000 7feb1d210800 20 add_watcher() i=3 2024-09-13T19:17:14.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.990+0000 7feb1d210800 20 add_watcher() i=4 2024-09-13T19:17:14.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.990+0000 7feb1d210800 20 add_watcher() i=5 2024-09-13T19:17:14.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.990+0000 7feb1d210800 20 add_watcher() i=6 2024-09-13T19:17:14.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.991+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94635719203536] v36'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb04051070 con 0x7feb0c02c060 2024-09-13T19:17:14.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.991+0000 7feb1d210800 20 add_watcher() i=7 2024-09-13T19:17:14.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.991+0000 7feb1d210800 2 all 8 watchers are set, enabling cache 2024-09-13T19:17:14.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.991+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5612186d0950 con 0x5612186c1e00 2024-09-13T19:17:14.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.991+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7feb04051070 con 0x5612186c1e00 2024-09-13T19:17:14.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.991+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94635719204784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5612186d0950 con 0x5612186c1e00 2024-09-13T19:17:14.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.992+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94635719204784] v36'196 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7feb04051070 con 0x5612186c1e00 2024-09-13T19:17:14.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.992+0000 7fe9cefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:17:14.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.992+0000 7feb1d210800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:17:14.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.992+0000 7feb1d210800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:17:14.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.992+0000 7feb1d210800 5 note: GC not initialized 2024-09-13T19:17:14.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.992+0000 7fe9cdfe3640 20 reqs_thread_entry: start 2024-09-13T19:17:14.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.993+0000 7feb1d210800 20 init_complete bucket index max shards: 11 2024-09-13T19:17:14.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.993+0000 7feb1d210800 20 Filter name: none 2024-09-13T19:17:14.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.993+0000 7fe93f7fe640 20 reqs_thread_entry: start 2024-09-13T19:17:14.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.993+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561218708d60 con 0x5612186c1e00 2024-09-13T19:17:14.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.993+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7feb04051070 con 0x5612186c1e00 2024-09-13T19:17:14.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.993+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561218708d60 con 0x7feb1401f8f0 2024-09-13T19:17:14.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.993+0000 7feb188c1640 1 -- 172.21.15.102:0/3043984617 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7feb0c043050 con 0x7feb1401f8f0 2024-09-13T19:17:14.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.993+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561218708d60 con 0x5612186c1e00 2024-09-13T19:17:14.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.993+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7feb04051070 con 0x5612186c1e00 2024-09-13T19:17:14.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.993+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561218708d20 con 0x5612186c6810 2024-09-13T19:17:14.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.994+0000 7feb190c2640 1 -- 172.21.15.102:0/3043984617 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7feb14055070 con 0x5612186c6810 2024-09-13T19:17:14.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.994+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561218708d20 con 0x5612186c6810 2024-09-13T19:17:14.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.994+0000 7feb190c2640 1 -- 172.21.15.102:0/3043984617 <== osd.3 v2:172.21.15.102:6800/3096737090 17 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7feb14055070 con 0x5612186c6810 2024-09-13T19:17:14.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.994+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561218708d20 con 0x5612186c6810 2024-09-13T19:17:14.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.994+0000 7feb190c2640 1 -- 172.21.15.102:0/3043984617 <== osd.3 v2:172.21.15.102:6800/3096737090 18 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7feb14055070 con 0x5612186c6810 2024-09-13T19:17:14.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.994+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561218708d20 con 0x5612186c1e00 2024-09-13T19:17:14.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.994+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7feb04051070 con 0x5612186c1e00 2024-09-13T19:17:14.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.994+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561218708d20 con 0x5612186c1e00 2024-09-13T19:17:14.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.995+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7feb04051070 con 0x5612186c1e00 2024-09-13T19:17:14.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.995+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561218708d20 con 0x5612186c6810 2024-09-13T19:17:14.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.995+0000 7feb190c2640 1 -- 172.21.15.102:0/3043984617 <== osd.3 v2:172.21.15.102:6800/3096737090 19 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7feb14055070 con 0x5612186c6810 2024-09-13T19:17:14.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.995+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561218708d20 con 0x5612186c6810 2024-09-13T19:17:14.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.995+0000 7feb190c2640 1 -- 172.21.15.102:0/3043984617 <== osd.3 v2:172.21.15.102:6800/3096737090 20 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7feb14055070 con 0x5612186c6810 2024-09-13T19:17:14.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.995+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561218708d20 con 0x7feb0c02c060 2024-09-13T19:17:14.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.996+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7feb04051070 con 0x7feb0c02c060 2024-09-13T19:17:14.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.996+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56121870a840 con 0x5612186c1e00 2024-09-13T19:17:14.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.996+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7feb04051070 con 0x5612186c1e00 2024-09-13T19:17:14.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.996+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56121870a840 con 0x7feb1401f8f0 2024-09-13T19:17:14.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.996+0000 7feb188c1640 1 -- 172.21.15.102:0/3043984617 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7feb0c043050 con 0x7feb1401f8f0 2024-09-13T19:17:14.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.996+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56121870a840 con 0x5612186c6810 2024-09-13T19:17:14.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.996+0000 7feb190c2640 1 -- 172.21.15.102:0/3043984617 <== osd.3 v2:172.21.15.102:6800/3096737090 21 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7feb14055070 con 0x5612186c6810 2024-09-13T19:17:14.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.996+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56121870a840 con 0x7feb0c02c060 2024-09-13T19:17:14.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.997+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7feb04051070 con 0x7feb0c02c060 2024-09-13T19:17:14.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.997+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56121870a840 con 0x7feb0c02c060 2024-09-13T19:17:14.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.997+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7feb04051070 con 0x7feb0c02c060 2024-09-13T19:17:14.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.997+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56121870a840 con 0x5612186c6810 2024-09-13T19:17:14.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.997+0000 7feb190c2640 1 -- 172.21.15.102:0/3043984617 <== osd.3 v2:172.21.15.102:6800/3096737090 22 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7feb14055070 con 0x5612186c6810 2024-09-13T19:17:14.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.997+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56121870a7a0 con 0x7feb0c02c060 2024-09-13T19:17:14.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.998+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) ==== 152+0+163 (crc 0 0 0) 0x7feb04051070 con 0x7feb0c02c060 2024-09-13T19:17:14.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.998+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56121870a7a0 con 0x5612186c1e00 2024-09-13T19:17:14.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.998+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7feb04051070 con 0x5612186c1e00 2024-09-13T19:17:14.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.998+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56121870a7a0 con 0x5612186c6810 2024-09-13T19:17:14.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.998+0000 7feb190c2640 1 -- 172.21.15.102:0/3043984617 <== osd.3 v2:172.21.15.102:6800/3096737090 23 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7feb14055070 con 0x5612186c6810 2024-09-13T19:17:14.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.998+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56121870a7a0 con 0x7feb0c02c060 2024-09-13T19:17:14.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.998+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7feb04051070 con 0x7feb0c02c060 2024-09-13T19:17:14.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.998+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56121870a7a0 con 0x7feb1401f8f0 2024-09-13T19:17:14.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.999+0000 7feb188c1640 1 -- 172.21.15.102:0/3043984617 <== osd.2 v2:172.21.15.102:6816/2238176080 16 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7feb0c043050 con 0x7feb1401f8f0 2024-09-13T19:17:14.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.999+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56121870a780 con 0x7feb0c02c060 2024-09-13T19:17:14.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.999+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7feb04051070 con 0x7feb0c02c060 2024-09-13T19:17:14.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.999+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56121870a780 con 0x5612186c1e00 2024-09-13T19:17:14.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.999+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7feb04051070 con 0x5612186c1e00 2024-09-13T19:17:14.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.999+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56121870a780 con 0x5612186c1e00 2024-09-13T19:17:14.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.999+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.1 v2:172.21.15.102:6808/2204418452 28 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7feb04051070 con 0x5612186c1e00 2024-09-13T19:17:14.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:13.999+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56121870a780 con 0x5612186c6810 2024-09-13T19:17:14.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.000+0000 7feb190c2640 1 -- 172.21.15.102:0/3043984617 <== osd.3 v2:172.21.15.102:6800/3096737090 24 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7feb14055070 con 0x5612186c6810 2024-09-13T19:17:14.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.000+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56121870a780 con 0x5612186c1e00 2024-09-13T19:17:14.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.000+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.1 v2:172.21.15.102:6808/2204418452 29 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7feb04051070 con 0x5612186c1e00 2024-09-13T19:17:14.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.000+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56121870a780 con 0x5612186c1e00 2024-09-13T19:17:14.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.000+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.1 v2:172.21.15.102:6808/2204418452 30 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7feb04051070 con 0x5612186c1e00 2024-09-13T19:17:14.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.000+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56121870a780 con 0x5612186c6810 2024-09-13T19:17:14.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.000+0000 7feb190c2640 1 -- 172.21.15.102:0/3043984617 <== osd.3 v2:172.21.15.102:6800/3096737090 25 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7feb14055070 con 0x5612186c6810 2024-09-13T19:17:14.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.000+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56121870a780 con 0x5612186c6810 2024-09-13T19:17:14.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.000+0000 7feb190c2640 1 -- 172.21.15.102:0/3043984617 <== osd.3 v2:172.21.15.102:6800/3096737090 26 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7feb14055070 con 0x5612186c6810 2024-09-13T19:17:14.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.000+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56121870a780 con 0x5612186c6810 2024-09-13T19:17:14.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.001+0000 7feb190c2640 1 -- 172.21.15.102:0/3043984617 <== osd.3 v2:172.21.15.102:6800/3096737090 27 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7feb14055070 con 0x5612186c6810 2024-09-13T19:17:14.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.001+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56121870a780 con 0x7feb0c02c060 2024-09-13T19:17:14.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.001+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.0 v2:172.21.15.53:6800/4021716951 20 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7feb04051070 con 0x7feb0c02c060 2024-09-13T19:17:14.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.002+0000 7fe9cefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:17:14.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.002+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94635719204784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561218706230 con 0x5612186c1e00 2024-09-13T19:17:14.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.003+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.1 v2:172.21.15.102:6808/2204418452 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94635719204784] v36'197 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7feb04051070 con 0x5612186c1e00 2024-09-13T19:17:14.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.003+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94635719181872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561218706230 con 0x7feb1401f8f0 2024-09-13T19:17:14.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.004+0000 7feb188c1640 1 -- 172.21.15.102:0/3043984617 <== osd.2 v2:172.21.15.102:6816/2238176080 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94635719181872] v36'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb0c043050 con 0x7feb1401f8f0 2024-09-13T19:17:14.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.004+0000 7feb1d210800 20 remove_watcher() i=0 2024-09-13T19:17:14.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.004+0000 7feb1d210800 2 removed watcher, disabling cache 2024-09-13T19:17:14.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.004+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94635719187360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561218706230 con 0x5612186c1e00 2024-09-13T19:17:14.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.006+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.1 v2:172.21.15.102:6808/2204418452 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94635719187360] v36'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb04051070 con 0x5612186c1e00 2024-09-13T19:17:14.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.006+0000 7feb1d210800 20 remove_watcher() i=1 2024-09-13T19:17:14.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.006+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94635719188416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561218706230 con 0x5612186c6810 2024-09-13T19:17:14.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.007+0000 7feb190c2640 1 -- 172.21.15.102:0/3043984617 <== osd.3 v2:172.21.15.102:6800/3096737090 28 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94635719188416] v36'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb14055070 con 0x5612186c6810 2024-09-13T19:17:14.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.007+0000 7feb1d210800 20 remove_watcher() i=2 2024-09-13T19:17:14.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.007+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94635719193232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561218706230 con 0x7feb1401f8f0 2024-09-13T19:17:14.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.008+0000 7feb188c1640 1 -- 172.21.15.102:0/3043984617 <== osd.2 v2:172.21.15.102:6816/2238176080 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94635719193232] v36'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb0c043050 con 0x7feb1401f8f0 2024-09-13T19:17:14.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.008+0000 7feb1d210800 20 remove_watcher() i=3 2024-09-13T19:17:14.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.008+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94635719195504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561218706230 con 0x5612186c1e00 2024-09-13T19:17:14.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.009+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.1 v2:172.21.15.102:6808/2204418452 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94635719195504] v36'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb04051070 con 0x5612186c1e00 2024-09-13T19:17:14.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.009+0000 7feb1d210800 20 remove_watcher() i=4 2024-09-13T19:17:14.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.009+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94635719197248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561218706230 con 0x7feb0c02c060 2024-09-13T19:17:14.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.010+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.0 v2:172.21.15.53:6800/4021716951 21 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94635719197248] v36'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb04051070 con 0x7feb0c02c060 2024-09-13T19:17:14.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.010+0000 7feb1d210800 20 remove_watcher() i=5 2024-09-13T19:17:14.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.010+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94635719201312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561218706230 con 0x7feb0c02c060 2024-09-13T19:17:14.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.011+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.0 v2:172.21.15.53:6800/4021716951 22 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94635719201312] v36'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb04051070 con 0x7feb0c02c060 2024-09-13T19:17:14.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.011+0000 7feb1d210800 20 remove_watcher() i=6 2024-09-13T19:17:14.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.011+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94635719203536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561218706230 con 0x7feb0c02c060 2024-09-13T19:17:14.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.012+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 <== osd.0 v2:172.21.15.53:6800/4021716951 23 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94635719203536] v36'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb04051070 con 0x7feb0c02c060 2024-09-13T19:17:14.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.012+0000 7feb1d210800 20 remove_watcher() i=7 2024-09-13T19:17:14.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.012+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7feb0c02c060 msgr2=0x7feb0c02a580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.012+0000 7feb1d210800 1 --2- 172.21.15.102:0/3043984617 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7feb0c02c060 0x7feb0c02a580 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.012+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5612186c1e00 msgr2=0x5612186c42c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.012+0000 7feb1d210800 1 --2- 172.21.15.102:0/3043984617 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5612186c1e00 0x5612186c42c0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.012+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7feb1401f8f0 msgr2=0x7feb14040150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.013+0000 7feb1d210800 1 --2- 172.21.15.102:0/3043984617 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7feb1401f8f0 0x7feb14040150 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.013+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5612186c6810 msgr2=0x5612186c8c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.013+0000 7feb1d210800 1 --2- 172.21.15.102:0/3043984617 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5612186c6810 0x5612186c8c00 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.013+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe9e4036b40 msgr2=0x7fe9e4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.013+0000 7feb1d210800 1 --2- 172.21.15.102:0/3043984617 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe9e4036b40 0x7fe9e4039000 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7feb0c016fd0 tx=0x7feb0c037000 comp rx=0 tx=0).stop 2024-09-13T19:17:14.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.013+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56121867d7c0 msgr2=0x5612186b6320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.013+0000 7feb1d210800 1 --2- 172.21.15.102:0/3043984617 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56121867d7c0 0x5612186b6320 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7feb14048010 tx=0x7feb1404ceb0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.013+0000 7feb13fff640 1 -- 172.21.15.102:0/3043984617 reap_dead start 2024-09-13T19:17:14.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.013+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 shutdown_connections 2024-09-13T19:17:14.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.013+0000 7feb1d210800 1 --2- 172.21.15.102:0/3043984617 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56121867d7c0 0x5612186b6320 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.013+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 >> 172.21.15.102:0/3043984617 conn(0x5612186a9090 msgr2=0x5612186a7160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:14.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.013+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 shutdown_connections 2024-09-13T19:17:14.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.013+0000 7feb1d210800 1 -- 172.21.15.102:0/3043984617 wait complete. 2024-09-13T19:17:14.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.013+0000 7feb1d210800 1 -- 172.21.15.102:0/207615064 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe9f0036b40 msgr2=0x7fe9f0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.013+0000 7feb1d210800 1 --2- 172.21.15.102:0/207615064 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe9f0036b40 0x7fe9f0039000 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x5612186897d0 tx=0x7feb0c04ad80 comp rx=0 tx=0).stop 2024-09-13T19:17:14.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.013+0000 7feb1d210800 1 -- 172.21.15.102:0/207615064 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56121869ffe0 msgr2=0x5612186a0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.013+0000 7feb1d210800 1 --2- 172.21.15.102:0/207615064 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56121869ffe0 0x5612186a0400 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x56121868cc70 tx=0x7feb140167b0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.013+0000 7feb1d210800 1 -- 172.21.15.102:0/207615064 shutdown_connections 2024-09-13T19:17:14.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.013+0000 7feb1d210800 1 --2- 172.21.15.102:0/207615064 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe9f0036b40 0x7fe9f0039000 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.013+0000 7feb1d210800 1 --2- 172.21.15.102:0/207615064 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56121869ffe0 0x5612186a0400 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.013+0000 7feb1d210800 1 -- 172.21.15.102:0/207615064 >> 172.21.15.102:0/207615064 conn(0x561218694f70 msgr2=0x561218697af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:14.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.013+0000 7feb1d210800 1 -- 172.21.15.102:0/207615064 shutdown_connections 2024-09-13T19:17:14.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.013+0000 7feb1d210800 1 -- 172.21.15.102:0/207615064 wait complete. 2024-09-13T19:17:14.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.013+0000 7feb1d210800 1 -- 172.21.15.102:0/2348231855 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x561218591900 msgr2=0x56121868c2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.013+0000 7feb1d210800 1 --2- 172.21.15.102:0/2348231855 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x561218591900 0x56121868c2e0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.013+0000 7feb1d210800 1 -- 172.21.15.102:0/2348231855 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56121868ebc0 msgr2=0x561218690fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.013+0000 7feb1d210800 1 --2- 172.21.15.102:0/2348231855 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56121868ebc0 0x561218690fb0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.014+0000 7feb1d210800 1 -- 172.21.15.102:0/2348231855 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fea00036b90 msgr2=0x7fea00039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.014+0000 7feb1d210800 1 --2- 172.21.15.102:0/2348231855 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fea00036b90 0x7fea00039050 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7feb04057000 tx=0x7feb04052000 comp rx=0 tx=0).stop 2024-09-13T19:17:14.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.014+0000 7feb1d210800 1 -- 172.21.15.102:0/2348231855 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56121858d4c0 msgr2=0x561218685270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.014+0000 7feb1d210800 1 --2- 172.21.15.102:0/2348231855 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56121858d4c0 0x561218685270 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7feb0c004000 tx=0x7feb0c000bc0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.014+0000 7feb1d210800 1 -- 172.21.15.102:0/2348231855 shutdown_connections 2024-09-13T19:17:14.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.014+0000 7feb1d210800 1 --2- 172.21.15.102:0/2348231855 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56121868ebc0 0x561218690fb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.014+0000 7feb1d210800 1 --2- 172.21.15.102:0/2348231855 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x561218591900 0x56121868c2e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.014+0000 7feb1d210800 1 --2- 172.21.15.102:0/2348231855 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fea00036b90 0x7fea00039050 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.014+0000 7feb1d210800 1 --2- 172.21.15.102:0/2348231855 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56121858d4c0 0x561218685270 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.014+0000 7feb1d210800 1 -- 172.21.15.102:0/2348231855 >> 172.21.15.102:0/2348231855 conn(0x561218588df0 msgr2=0x561218676a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:14.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.014+0000 7feb1d210800 1 -- 172.21.15.102:0/2348231855 shutdown_connections 2024-09-13T19:17:14.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.014+0000 7feb1d210800 1 -- 172.21.15.102:0/2348231855 wait complete. 2024-09-13T19:17:14.025 INFO:teuthology.orchestra.run.smithi102.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"anonymous","categories":[]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[]}]}],"summary":[{"user":"anonymous","categories":[],"total":{"bytes_sent":0,"bytes_received":0,"ops":0,"successful_ops":0}},{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-09-13T19:17:14.025 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'anonymous', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-09-13T19:17:14.026 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-13T19:17:14.026 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-13T19:17:14.026 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-13T19:17:14.068 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:17:14.068 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:17:14.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.065+0000 7f9c0c80e800 1 Processor -- start 2024-09-13T19:17:14.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.066+0000 7f9c0c80e800 1 -- start start 2024-09-13T19:17:14.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.066+0000 7f9c0c80e800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55c49053f620 0x55c4905ce240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.066+0000 7f9c0c80e800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c49048ab30 con 0x55c4905ce780 2024-09-13T19:17:14.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.066+0000 7f9c0c80e800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55c49046c360 con 0x55c49053f620 2024-09-13T19:17:14.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.066+0000 7f9c07f1a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55c49053f620 0x55c4905ce240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.066+0000 7f9bfffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55c4905ce780 0x55c4905d0b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:50004/0 (socket says 172.21.15.102:50004) 2024-09-13T19:17:14.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.066+0000 7f9bfffff640 1 -- 172.21.15.102:0/3486770163 learned_addr learned my addr 172.21.15.102:0/3486770163 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:17:14.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.066+0000 7f9c07f1a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55c49053f620 0x55c4905ce240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41034/0 (socket says 172.21.15.102:41034) 2024-09-13T19:17:14.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.066+0000 7f9c07f1a640 1 -- 172.21.15.102:0/3486770163 >> v1:172.21.15.53:6789/0 conn(0x55c4905ce780 legacy=0x55c4905d0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.066+0000 7f9c07f1a640 1 -- 172.21.15.102:0/3486770163 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c490492e00 con 0x55c49053f620 2024-09-13T19:17:14.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.068+0000 7f9c07f1a640 1 --2- 172.21.15.102:0/3486770163 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c49053f620 0x55c4905ce240 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f9bf800a470 tx=0x7f9bf8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18aecb5814952a68 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.068+0000 7f9c07719640 1 -- 172.21.15.102:0/3486770163 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bf8053570 con 0x55c49053f620 2024-09-13T19:17:14.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.068+0000 7f9c07719640 1 -- 172.21.15.102:0/3486770163 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bf8058070 con 0x55c49053f620 2024-09-13T19:17:14.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.068+0000 7f9c07719640 1 -- 172.21.15.102:0/3486770163 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bf8053880 con 0x55c49053f620 2024-09-13T19:17:14.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.069+0000 7f9c0c80e800 1 -- 172.21.15.102:0/3486770163 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c49053f620 msgr2=0x55c4905ce240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.069+0000 7f9c0c80e800 1 --2- 172.21.15.102:0/3486770163 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c49053f620 0x55c4905ce240 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f9bf800a470 tx=0x7f9bf8045a20 comp rx=0 tx=0).stop 2024-09-13T19:17:14.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.069+0000 7f9c0c80e800 1 -- 172.21.15.102:0/3486770163 shutdown_connections 2024-09-13T19:17:14.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.069+0000 7f9c0c80e800 1 --2- 172.21.15.102:0/3486770163 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c49053f620 0x55c4905ce240 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.069+0000 7f9c0c80e800 1 -- 172.21.15.102:0/3486770163 >> 172.21.15.102:0/3486770163 conn(0x55c4905c5dd0 msgr2=0x55c4905c81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:14.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.069+0000 7f9c0c80e800 1 -- 172.21.15.102:0/3486770163 shutdown_connections 2024-09-13T19:17:14.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.069+0000 7f9c0c80e800 1 -- 172.21.15.102:0/3486770163 wait complete. 2024-09-13T19:17:14.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.083+0000 7f9c0c80e800 1 Processor -- start 2024-09-13T19:17:14.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.083+0000 7f9c0c80e800 1 -- start start 2024-09-13T19:17:14.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.083+0000 7f9c0c80e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c49053f620 0x55c4906ba880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.083+0000 7f9c0c80e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c490517320 con 0x55c49053f620 2024-09-13T19:17:14.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.083+0000 7f9c07f1a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c49053f620 0x55c4906ba880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.083+0000 7f9c07f1a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c49053f620 0x55c4906ba880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41048/0 (socket says 172.21.15.102:41048) 2024-09-13T19:17:14.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.083+0000 7f9c07f1a640 1 -- 172.21.15.102:0/261960758 learned_addr learned my addr 172.21.15.102:0/261960758 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:14.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.084+0000 7f9c07f1a640 1 -- 172.21.15.102:0/261960758 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c490464bc0 con 0x55c49053f620 2024-09-13T19:17:14.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.084+0000 7f9c07f1a640 1 --2- 172.21.15.102:0/261960758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c49053f620 0x55c4906ba880 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8025c20 tx=0x7f9bf8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=547ff990e9b4b430 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.084+0000 7f9af5e0b640 1 -- 172.21.15.102:0/261960758 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bf8053ba0 con 0x55c49053f620 2024-09-13T19:17:14.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.084+0000 7f9af5e0b640 1 -- 172.21.15.102:0/261960758 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bf8063030 con 0x55c49053f620 2024-09-13T19:17:14.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.084+0000 7f9af5e0b640 1 -- 172.21.15.102:0/261960758 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bf8053440 con 0x55c49053f620 2024-09-13T19:17:14.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.085+0000 7f9c0c80e800 1 -- 172.21.15.102:0/261960758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c49053f620 msgr2=0x55c4906ba880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.085+0000 7f9c0c80e800 1 --2- 172.21.15.102:0/261960758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c49053f620 0x55c4906ba880 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8025c20 tx=0x7f9bf8051000 comp rx=0 tx=0).stop 2024-09-13T19:17:14.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.085+0000 7f9c0c80e800 1 -- 172.21.15.102:0/261960758 shutdown_connections 2024-09-13T19:17:14.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.085+0000 7f9c0c80e800 1 --2- 172.21.15.102:0/261960758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c49053f620 0x55c4906ba880 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.085+0000 7f9c0c80e800 1 -- 172.21.15.102:0/261960758 >> 172.21.15.102:0/261960758 conn(0x55c4905c5dd0 msgr2=0x55c4906b6240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:14.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.085+0000 7f9c0c80e800 1 -- 172.21.15.102:0/261960758 shutdown_connections 2024-09-13T19:17:14.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.085+0000 7f9c0c80e800 1 -- 172.21.15.102:0/261960758 wait complete. 2024-09-13T19:17:14.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.085+0000 7f9c0c80e800 1 Processor -- start 2024-09-13T19:17:14.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.085+0000 7f9c0c80e800 1 -- start start 2024-09-13T19:17:14.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.085+0000 7f9c0c80e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c49053f620 0x55c4905cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.085+0000 7f9c0c80e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c4905d2680 con 0x55c49053f620 2024-09-13T19:17:14.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.085+0000 7f9c07f1a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c49053f620 0x55c4905cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.085+0000 7f9c07f1a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c49053f620 0x55c4905cbb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41052/0 (socket says 172.21.15.102:41052) 2024-09-13T19:17:14.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.086+0000 7f9c07f1a640 1 -- 172.21.15.102:0/2995722312 learned_addr learned my addr 172.21.15.102:0/2995722312 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:14.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.086+0000 7f9c07f1a640 1 -- 172.21.15.102:0/2995722312 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c490478fe0 con 0x55c49053f620 2024-09-13T19:17:14.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.086+0000 7f9c07f1a640 1 --2- 172.21.15.102:0/2995722312 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c49053f620 0x55c4905cbb70 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x55c4906bb6e0 tx=0x7f9bf8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.086+0000 7f9aeffff640 1 -- 172.21.15.102:0/2995722312 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bf8078070 con 0x55c49053f620 2024-09-13T19:17:14.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.086+0000 7f9aeffff640 1 -- 172.21.15.102:0/2995722312 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bf8053570 con 0x55c49053f620 2024-09-13T19:17:14.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.086+0000 7f9aeffff640 1 -- 172.21.15.102:0/2995722312 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bf8053850 con 0x55c49053f620 2024-09-13T19:17:14.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.086+0000 7f9c0c80e800 1 -- 172.21.15.102:0/2995722312 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c4905ca260 con 0x55c49053f620 2024-09-13T19:17:14.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.086+0000 7f9c0c80e800 1 -- 172.21.15.102:0/2995722312 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4905ca7e0 con 0x55c49053f620 2024-09-13T19:17:14.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.087+0000 7f9aeffff640 1 -- 172.21.15.102:0/2995722312 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9bf807b070 con 0x55c49053f620 2024-09-13T19:17:14.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.087+0000 7f9aeffff640 1 --2- 172.21.15.102:0/2995722312 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9af0036b40 0x7f9af0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.087+0000 7f9aeffff640 1 -- 172.21.15.102:0/2995722312 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f9bf8070070 con 0x55c49053f620 2024-09-13T19:17:14.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.087+0000 7f9bfffff640 1 --2- 172.21.15.102:0/2995722312 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9af0036b40 0x7f9af0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.087+0000 7f9c0c80e800 1 --2- 172.21.15.102:0/2995722312 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55c4905ce780 0x55c4906cb580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.088+0000 7f9c0c80e800 1 -- 172.21.15.102:0/2995722312 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c4906cbac0 con 0x55c4905ce780 2024-09-13T19:17:14.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.088+0000 7f9c0871b640 1 --2- 172.21.15.102:0/2995722312 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55c4905ce780 0x55c4906cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.088+0000 7f9bfffff640 1 --2- 172.21.15.102:0/2995722312 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9af0036b40 0x7f9af0039000 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0000f60 tx=0x7f9bf00012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.088+0000 7f9c0871b640 1 --2- 172.21.15.102:0/2995722312 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55c4905ce780 0x55c4906cb580 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.088+0000 7f9c0871b640 1 -- 172.21.15.102:0/2995722312 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c0000a4a0 con 0x55c4905ce780 2024-09-13T19:17:14.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.088+0000 7f9c0c80e800 1 -- 172.21.15.102:0/2995722312 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c4906cc340 con 0x55c4905ce780 2024-09-13T19:17:14.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.088+0000 7f9c0871b640 1 -- 172.21.15.102:0/2995722312 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9c0000a4a0 con 0x55c4905ce780 2024-09-13T19:17:14.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.088+0000 7f9c0c80e800 1 --2- 172.21.15.102:0/2995722312 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55c4906cdd70 0x55c4906d0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.088+0000 7f9c0c80e800 1 -- 172.21.15.102:0/2995722312 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c4906d09c0 con 0x55c4906cdd70 2024-09-13T19:17:14.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.089+0000 7f9c07f1a640 1 --2- 172.21.15.102:0/2995722312 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55c4906cdd70 0x55c4906d0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.089+0000 7f9c07f1a640 1 --2- 172.21.15.102:0/2995722312 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55c4906cdd70 0x55c4906d0230 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.089+0000 7f9c07f1a640 1 -- 172.21.15.102:0/2995722312 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9bf807a030 con 0x55c4906cdd70 2024-09-13T19:17:14.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.089+0000 7f9c0c80e800 1 -- 172.21.15.102:0/2995722312 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c4906ccb90 con 0x55c4905ce780 2024-09-13T19:17:14.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.089+0000 7f9c0871b640 1 -- 172.21.15.102:0/2995722312 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9c0000a4a0 con 0x55c4905ce780 2024-09-13T19:17:14.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.089+0000 7f9c0c80e800 1 -- 172.21.15.102:0/2995722312 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c4906ccf30 con 0x55c4906cdd70 2024-09-13T19:17:14.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.090+0000 7f9c07f1a640 1 -- 172.21.15.102:0/2995722312 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9bf807a030 con 0x55c4906cdd70 2024-09-13T19:17:14.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.090+0000 7f9c0c80e800 1 Processor -- start 2024-09-13T19:17:14.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.090+0000 7f9c0c80e800 1 -- start start 2024-09-13T19:17:14.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.090+0000 7f9c0c80e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4906df2a0 0x55c4906df6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.090+0000 7f9c0c80e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c4905cc0b0 con 0x55c4906df2a0 2024-09-13T19:17:14.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.090+0000 7f9c0871b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4906df2a0 0x55c4906df6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.090+0000 7f9c0871b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4906df2a0 0x55c4906df6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41062/0 (socket says 172.21.15.102:41062) 2024-09-13T19:17:14.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.090+0000 7f9c0871b640 1 -- 172.21.15.102:0/2193940279 learned_addr learned my addr 172.21.15.102:0/2193940279 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:14.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.091+0000 7f9c0871b640 1 -- 172.21.15.102:0/2193940279 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4906dfc00 con 0x55c4906df2a0 2024-09-13T19:17:14.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.091+0000 7f9c0871b640 1 --2- 172.21.15.102:0/2193940279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4906df2a0 0x55c4906df6c0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x55c4906cbe60 tx=0x7f9c000163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.091+0000 7f9aed7fa640 1 -- 172.21.15.102:0/2193940279 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c00013450 con 0x55c4906df2a0 2024-09-13T19:17:14.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.091+0000 7f9aed7fa640 1 -- 172.21.15.102:0/2193940279 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c000135f0 con 0x55c4906df2a0 2024-09-13T19:17:14.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.091+0000 7f9c0c80e800 1 -- 172.21.15.102:0/2193940279 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c4906dfe90 con 0x55c4906df2a0 2024-09-13T19:17:14.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.091+0000 7f9aed7fa640 1 -- 172.21.15.102:0/2193940279 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c000138d0 con 0x55c4906df2a0 2024-09-13T19:17:14.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.091+0000 7f9c0c80e800 1 -- 172.21.15.102:0/2193940279 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4906e2b70 con 0x55c4906df2a0 2024-09-13T19:17:14.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.092+0000 7f9aed7fa640 1 -- 172.21.15.102:0/2193940279 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9c00011040 con 0x55c4906df2a0 2024-09-13T19:17:14.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.092+0000 7f9aed7fa640 1 --2- 172.21.15.102:0/2193940279 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9ae0036b40 0x7f9ae0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.092+0000 7f9aed7fa640 1 -- 172.21.15.102:0/2193940279 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f9c0000e040 con 0x55c4906df2a0 2024-09-13T19:17:14.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.092+0000 7f9c07f1a640 1 --2- 172.21.15.102:0/2193940279 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9ae0036b40 0x7f9ae0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.092+0000 7f9c0c80e800 1 Processor -- start 2024-09-13T19:17:14.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.093+0000 7f9c0c80e800 1 -- start start 2024-09-13T19:17:14.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.093+0000 7f9c07f1a640 1 --2- 172.21.15.102:0/2193940279 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9ae0036b40 0x7f9ae0039000 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x55c4905cacc0 tx=0x7f9bf808ec10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.093+0000 7f9c0c80e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4906ebfa0 0x55c4906ec3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.093+0000 7f9c0c80e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c490466580 con 0x55c4906ebfa0 2024-09-13T19:17:14.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.093+0000 7f9c0871b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4906ebfa0 0x55c4906ec3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.093+0000 7f9c0871b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4906ebfa0 0x55c4906ec3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41064/0 (socket says 172.21.15.102:41064) 2024-09-13T19:17:14.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.093+0000 7f9c0871b640 1 -- 172.21.15.102:0/169216445 learned_addr learned my addr 172.21.15.102:0/169216445 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:14.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.093+0000 7f9c0871b640 1 -- 172.21.15.102:0/169216445 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4906ec970 con 0x55c4906ebfa0 2024-09-13T19:17:14.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.094+0000 7f9c0871b640 1 --2- 172.21.15.102:0/169216445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4906ebfa0 0x55c4906ec3a0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f9c0004cdd0 tx=0x7f9c00029fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b41a46e081e02453 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.094+0000 7f9ae6ffd640 1 -- 172.21.15.102:0/169216445 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c0004a020 con 0x55c4906ebfa0 2024-09-13T19:17:14.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.094+0000 7f9ae6ffd640 1 -- 172.21.15.102:0/169216445 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c0002a570 con 0x55c4906ebfa0 2024-09-13T19:17:14.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.094+0000 7f9ae6ffd640 1 -- 172.21.15.102:0/169216445 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c0001f500 con 0x55c4906ebfa0 2024-09-13T19:17:14.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.094+0000 7f9c0c80e800 1 -- 172.21.15.102:0/169216445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4906ebfa0 msgr2=0x55c4906ec3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.094+0000 7f9c0c80e800 1 --2- 172.21.15.102:0/169216445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4906ebfa0 0x55c4906ec3a0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f9c0004cdd0 tx=0x7f9c00029fb0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.094+0000 7f9c0c80e800 1 -- 172.21.15.102:0/169216445 shutdown_connections 2024-09-13T19:17:14.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.094+0000 7f9c0c80e800 1 --2- 172.21.15.102:0/169216445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4906ebfa0 0x55c4906ec3a0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.094+0000 7f9c0c80e800 1 -- 172.21.15.102:0/169216445 >> 172.21.15.102:0/169216445 conn(0x55c4906e8350 msgr2=0x55c4906e6450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:14.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.094+0000 7f9c0c80e800 1 -- 172.21.15.102:0/169216445 shutdown_connections 2024-09-13T19:17:14.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.094+0000 7f9c0c80e800 1 -- 172.21.15.102:0/169216445 wait complete. 2024-09-13T19:17:14.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.095+0000 7f9c0c80e800 1 Processor -- start 2024-09-13T19:17:14.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.095+0000 7f9c0c80e800 1 -- start start 2024-09-13T19:17:14.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.095+0000 7f9c0c80e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4906ebfa0 0x55c4906f32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.095+0000 7f9c0c80e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c4906ece00 con 0x55c4906ebfa0 2024-09-13T19:17:14.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.095+0000 7f9c0871b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4906ebfa0 0x55c4906f32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.095+0000 7f9c0871b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4906ebfa0 0x55c4906f32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41074/0 (socket says 172.21.15.102:41074) 2024-09-13T19:17:14.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.095+0000 7f9c0871b640 1 -- 172.21.15.102:0/4152615934 learned_addr learned my addr 172.21.15.102:0/4152615934 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:14.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.095+0000 7f9c0871b640 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4906f37f0 con 0x55c4906ebfa0 2024-09-13T19:17:14.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.096+0000 7f9c0871b640 1 --2- 172.21.15.102:0/4152615934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4906ebfa0 0x55c4906f32b0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f9c0004cd30 tx=0x7f9c0004cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.096+0000 7f9ae57fa640 1 -- 172.21.15.102:0/4152615934 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c0003a070 con 0x55c4906ebfa0 2024-09-13T19:17:14.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.096+0000 7f9ae57fa640 1 -- 172.21.15.102:0/4152615934 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c0001f710 con 0x55c4906ebfa0 2024-09-13T19:17:14.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.096+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c4906f3a80 con 0x55c4906ebfa0 2024-09-13T19:17:14.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.096+0000 7f9ae57fa640 1 -- 172.21.15.102:0/4152615934 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c0001fa30 con 0x55c4906ebfa0 2024-09-13T19:17:14.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.096+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4906f6730 con 0x55c4906ebfa0 2024-09-13T19:17:14.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.097+0000 7f9ae57fa640 1 -- 172.21.15.102:0/4152615934 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9c0003d070 con 0x55c4906ebfa0 2024-09-13T19:17:14.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.097+0000 7f9ae57fa640 1 --2- 172.21.15.102:0/4152615934 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9ad0036ce0 0x7f9ad00391a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.097+0000 7f9ae57fa640 1 -- 172.21.15.102:0/4152615934 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f9c00046040 con 0x55c4906ebfa0 2024-09-13T19:17:14.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.097+0000 7f9c07f1a640 1 --2- 172.21.15.102:0/4152615934 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9ad0036ce0 0x7f9ad00391a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.097+0000 7f9c0c80e800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.097+0000 7f9c0c80e800 1 --2- 172.21.15.102:0/4152615934 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55c4906fed50 0x55c490701210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.097+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c490701960 con 0x55c4906fed50 2024-09-13T19:17:14.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.097+0000 7f9bfffff640 1 --2- 172.21.15.102:0/4152615934 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55c4906fed50 0x55c490701210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.097+0000 7f9c07f1a640 1 --2- 172.21.15.102:0/4152615934 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9ad0036ce0 0x7f9ad00391a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9bf807c730 tx=0x7f9bf8092000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.098+0000 7f9bfffff640 1 --2- 172.21.15.102:0/4152615934 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55c4906fed50 0x55c490701210 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.098+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9bf0009050 con 0x55c4906fed50 2024-09-13T19:17:14.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.098+0000 7f9c0c80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:14.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.098+0000 7f9c0c80e800 20 realm 2024-09-13T19:17:14.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.098+0000 7f9c0c80e800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.098+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c4906fe1a0 con 0x55c4906fed50 2024-09-13T19:17:14.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.098+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9bf0009050 con 0x55c4906fed50 2024-09-13T19:17:14.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.098+0000 7f9c0c80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:14.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.098+0000 7f9c0c80e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:17:14.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.098+0000 7f9c0c80e800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.098+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c490702440 con 0x55c4906fed50 2024-09-13T19:17:14.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.098+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9bf0009050 con 0x55c4906fed50 2024-09-13T19:17:14.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.098+0000 7f9c0c80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:14.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.098+0000 7f9c0c80e800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.098+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c490702d10 con 0x55c4906fed50 2024-09-13T19:17:14.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.099+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9bf0009050 con 0x55c4906fed50 2024-09-13T19:17:14.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.099+0000 7f9c0c80e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:17:14.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.099+0000 7f9c0c80e800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.099+0000 7f9c0c80e800 1 --2- 172.21.15.102:0/4152615934 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55c4907035c0 0x55c4907059b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.099+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c4907060f0 con 0x55c4907035c0 2024-09-13T19:17:14.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.099+0000 7f9c0871b640 1 --2- 172.21.15.102:0/4152615934 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55c4907035c0 0x55c4907059b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.099+0000 7f9c0871b640 1 --2- 172.21.15.102:0/4152615934 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55c4907035c0 0x55c4907059b0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.099+0000 7f9c0871b640 1 -- 172.21.15.102:0/4152615934 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9c0003c030 con 0x55c4907035c0 2024-09-13T19:17:14.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.099+0000 7f9c0c80e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:17:14.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.099+0000 7f9c0c80e800 20 searching for the correct realm 2024-09-13T19:17:14.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.099+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c490707b00 con 0x55c4907035c0 2024-09-13T19:17:14.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.099+0000 7f9c0871b640 1 -- 172.21.15.102:0/4152615934 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c0003c030 con 0x55c4907035c0 2024-09-13T19:17:14.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.099+0000 7f9c0871b640 1 --2- 172.21.15.102:0/4152615934 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f9c0003f070 0x7f9c00040040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.099+0000 7f9c0871b640 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c490707b00 con 0x7f9c0003f070 2024-09-13T19:17:14.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.100+0000 7f9c07f1a640 1 --2- 172.21.15.102:0/4152615934 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f9c0003f070 0x7f9c00040040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.100+0000 7f9c07f1a640 1 --2- 172.21.15.102:0/4152615934 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f9c0003f070 0x7f9c00040040 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.100+0000 7f9c07f1a640 1 -- 172.21.15.102:0/4152615934 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bf807a030 con 0x7f9c0003f070 2024-09-13T19:17:14.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.100+0000 7f9c07f1a640 1 --2- 172.21.15.102:0/4152615934 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f9bf809d070 0x7f9bf8004280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.100+0000 7f9c07f1a640 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c490707b00 con 0x7f9bf809d070 2024-09-13T19:17:14.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.100+0000 7f9bfffff640 1 --2- 172.21.15.102:0/4152615934 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f9bf809d070 0x7f9bf8004280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.101+0000 7f9bfffff640 1 --2- 172.21.15.102:0/4152615934 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f9bf809d070 0x7f9bf8004280 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.101+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bf0009050 con 0x7f9bf809d070 2024-09-13T19:17:14.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.101+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c490707b00 con 0x55c4906fed50 2024-09-13T19:17:14.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.101+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bf0009050 con 0x55c4906fed50 2024-09-13T19:17:14.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.101+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c490707b00 con 0x55c4906fed50 2024-09-13T19:17:14.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.101+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bf0029040 con 0x55c4906fed50 2024-09-13T19:17:14.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.101+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c490707b00 con 0x7f9bf809d070 2024-09-13T19:17:14.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.102+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bf0029040 con 0x7f9bf809d070 2024-09-13T19:17:14.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.102+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c490707b00 con 0x7f9bf809d070 2024-09-13T19:17:14.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.102+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bf0029040 con 0x7f9bf809d070 2024-09-13T19:17:14.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.102+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c490707b00 con 0x7f9c0003f070 2024-09-13T19:17:14.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.102+0000 7f9c07f1a640 1 -- 172.21.15.102:0/4152615934 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bf807a030 con 0x7f9c0003f070 2024-09-13T19:17:14.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.102+0000 7f9c07f1a640 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c490707b00 con 0x55c4907035c0 2024-09-13T19:17:14.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.102+0000 7f9c0871b640 1 -- 172.21.15.102:0/4152615934 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c0003c030 con 0x55c4907035c0 2024-09-13T19:17:14.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.102+0000 7f9c0871b640 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c490707b00 con 0x55c4906fed50 2024-09-13T19:17:14.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.103+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bf0029040 con 0x55c4906fed50 2024-09-13T19:17:14.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.103+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c490707b00 con 0x7f9c0003f070 2024-09-13T19:17:14.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.103+0000 7f9c07f1a640 1 -- 172.21.15.102:0/4152615934 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bf807a030 con 0x7f9c0003f070 2024-09-13T19:17:14.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.103+0000 7f9c07f1a640 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c490707b00 con 0x55c4906fed50 2024-09-13T19:17:14.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.103+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bf0029040 con 0x55c4906fed50 2024-09-13T19:17:14.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.103+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c490707b00 con 0x7f9c0003f070 2024-09-13T19:17:14.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.103+0000 7f9c07f1a640 1 -- 172.21.15.102:0/4152615934 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9bf807a030 con 0x7f9c0003f070 2024-09-13T19:17:14.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.103+0000 7f9c07f1a640 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c490707b00 con 0x55c4907035c0 2024-09-13T19:17:14.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.104+0000 7f9c0871b640 1 -- 172.21.15.102:0/4152615934 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c0003c030 con 0x55c4907035c0 2024-09-13T19:17:14.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.104+0000 7f9c0871b640 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c490707b00 con 0x55c4907035c0 2024-09-13T19:17:14.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.104+0000 7f9c0871b640 1 -- 172.21.15.102:0/4152615934 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9c0003c030 con 0x55c4907035c0 2024-09-13T19:17:14.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.104+0000 7f9c0871b640 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c490707b00 con 0x7f9bf809d070 2024-09-13T19:17:14.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.104+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bf0029040 con 0x7f9bf809d070 2024-09-13T19:17:14.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.104+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c490707b00 con 0x55c4907035c0 2024-09-13T19:17:14.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.105+0000 7f9c0871b640 1 -- 172.21.15.102:0/4152615934 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9c0003c030 con 0x55c4907035c0 2024-09-13T19:17:14.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.105+0000 7f9c0871b640 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c490707b00 con 0x55c4907035c0 2024-09-13T19:17:14.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.105+0000 7f9c0871b640 1 -- 172.21.15.102:0/4152615934 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c0003c030 con 0x55c4907035c0 2024-09-13T19:17:14.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.105+0000 7f9c0871b640 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c490707b00 con 0x55c4906fed50 2024-09-13T19:17:14.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.105+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bf0029040 con 0x55c4906fed50 2024-09-13T19:17:14.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.105+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c490707b00 con 0x55c4906fed50 2024-09-13T19:17:14.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.105+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9bf0029040 con 0x55c4906fed50 2024-09-13T19:17:14.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.105+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c490707b00 con 0x7f9bf809d070 2024-09-13T19:17:14.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.106+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bf0029040 con 0x7f9bf809d070 2024-09-13T19:17:14.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.106+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c490707b00 con 0x55c4907035c0 2024-09-13T19:17:14.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.106+0000 7f9c0871b640 1 -- 172.21.15.102:0/4152615934 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c0003c030 con 0x55c4907035c0 2024-09-13T19:17:14.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.106+0000 7f9c0871b640 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c490707b00 con 0x7f9c0003f070 2024-09-13T19:17:14.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.106+0000 7f9c07f1a640 1 -- 172.21.15.102:0/4152615934 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bf807a030 con 0x7f9c0003f070 2024-09-13T19:17:14.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.106+0000 7f9c07f1a640 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c490707b00 con 0x55c4906fed50 2024-09-13T19:17:14.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.106+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bf0029040 con 0x55c4906fed50 2024-09-13T19:17:14.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.106+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c490707b00 con 0x7f9c0003f070 2024-09-13T19:17:14.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.106+0000 7f9c07f1a640 1 -- 172.21.15.102:0/4152615934 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bf807a030 con 0x7f9c0003f070 2024-09-13T19:17:14.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.106+0000 7f9c07f1a640 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c490707b00 con 0x55c4907035c0 2024-09-13T19:17:14.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.107+0000 7f9c0871b640 1 -- 172.21.15.102:0/4152615934 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c0003c030 con 0x55c4907035c0 2024-09-13T19:17:14.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.107+0000 7f9c0871b640 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c490707b00 con 0x7f9bf809d070 2024-09-13T19:17:14.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.107+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bf0029040 con 0x7f9bf809d070 2024-09-13T19:17:14.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.107+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c490707b00 con 0x7f9c0003f070 2024-09-13T19:17:14.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.107+0000 7f9c07f1a640 1 -- 172.21.15.102:0/4152615934 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bf807a030 con 0x7f9c0003f070 2024-09-13T19:17:14.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.107+0000 7f9c07f1a640 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c490707b00 con 0x55c4907035c0 2024-09-13T19:17:14.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.108+0000 7f9c0871b640 1 -- 172.21.15.102:0/4152615934 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c0003c030 con 0x55c4907035c0 2024-09-13T19:17:14.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.108+0000 7f9c0871b640 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c490707b00 con 0x7f9bf809d070 2024-09-13T19:17:14.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.108+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bf0029040 con 0x7f9bf809d070 2024-09-13T19:17:14.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.108+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c490707b00 con 0x55c4906fed50 2024-09-13T19:17:14.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.108+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9bf0029040 con 0x55c4906fed50 2024-09-13T19:17:14.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.108+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c490707b00 con 0x7f9c0003f070 2024-09-13T19:17:14.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.108+0000 7f9c07f1a640 1 -- 172.21.15.102:0/4152615934 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bf807a030 con 0x7f9c0003f070 2024-09-13T19:17:14.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.108+0000 7f9c0c80e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:17:14.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.108+0000 7f9c0c80e800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:17:14.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.108+0000 7f9c0c80e800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:17:14.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.108+0000 7f9c0c80e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:17:14.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.108+0000 7f9c0c80e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:17:14.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.108+0000 7f9c0c80e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:17:14.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.108+0000 7f9c0c80e800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.108+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c490706c00 con 0x55c4906fed50 2024-09-13T19:17:14.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.109+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9bf0029040 con 0x55c4906fed50 2024-09-13T19:17:14.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.109+0000 7f9c0c80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:14.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.109+0000 7f9c0c80e800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.109+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c4907074a0 con 0x55c4906fed50 2024-09-13T19:17:14.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.109+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9bf0029040 con 0x55c4906fed50 2024-09-13T19:17:14.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.109+0000 7f9c0c80e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:17:14.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.109+0000 7f9c0c80e800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.109+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c490706840 con 0x55c4907035c0 2024-09-13T19:17:14.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.109+0000 7f9c0871b640 1 -- 172.21.15.102:0/4152615934 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9c0003c030 con 0x55c4907035c0 2024-09-13T19:17:14.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.109+0000 7f9c0c80e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:17:14.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.109+0000 7f9c0c80e800 20 zone default found 2024-09-13T19:17:14.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.109+0000 7f9c0c80e800 4 Realm: () 2024-09-13T19:17:14.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.109+0000 7f9c0c80e800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:17:14.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.109+0000 7f9c0c80e800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:17:14.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.109+0000 7f9c0c80e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:17:14.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.109+0000 7f9c0c80e800 20 zonegroup default 2024-09-13T19:17:14.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.109+0000 7f9c0c80e800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.109+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c490708480 con 0x7f9c0003f070 2024-09-13T19:17:14.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.109+0000 7f9c07f1a640 1 -- 172.21.15.102:0/4152615934 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9bf807a030 con 0x7f9c0003f070 2024-09-13T19:17:14.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.109+0000 7f9c0c80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:14.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.109+0000 7f9c0c80e800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.109+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c4907080c0 con 0x55c4907035c0 2024-09-13T19:17:14.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.110+0000 7f9c0871b640 1 -- 172.21.15.102:0/4152615934 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9c0003c030 con 0x55c4907035c0 2024-09-13T19:17:14.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.110+0000 7f9c0c80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:14.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.110+0000 7f9c0c80e800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.110+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c49070a760 con 0x55c4907035c0 2024-09-13T19:17:14.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.110+0000 7f9c0871b640 1 -- 172.21.15.102:0/4152615934 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9c0003c030 con 0x55c4907035c0 2024-09-13T19:17:14.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.110+0000 7f9c0c80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:14.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.110+0000 7f9c0c80e800 20 started sync module instance, tier type = 2024-09-13T19:17:14.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.110+0000 7f9c0c80e800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:17:14.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.110+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c490709af0 con 0x7f9c0003f070 2024-09-13T19:17:14.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.111+0000 7f9c07f1a640 1 -- 172.21.15.102:0/4152615934 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(44 notify.0 [create] v36'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bf807a030 con 0x7f9c0003f070 2024-09-13T19:17:14.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.111+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94302725248576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c49070abc0 con 0x7f9c0003f070 2024-09-13T19:17:14.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.111+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c49070b410 con 0x55c4906fed50 2024-09-13T19:17:14.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.112+0000 7f9c07f1a640 1 -- 172.21.15.102:0/4152615934 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94302725248576] v36'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bf807a030 con 0x7f9c0003f070 2024-09-13T19:17:14.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.112+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v36'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bf0029040 con 0x55c4906fed50 2024-09-13T19:17:14.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.112+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94302725254080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c49070afe0 con 0x55c4906fed50 2024-09-13T19:17:14.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.112+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c49070c150 con 0x55c4907035c0 2024-09-13T19:17:14.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.113+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94302725254080] v36'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bf0029040 con 0x55c4906fed50 2024-09-13T19:17:14.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.114+0000 7f9c0871b640 1 -- 172.21.15.102:0/4152615934 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v36'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c0003c030 con 0x55c4907035c0 2024-09-13T19:17:14.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.114+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94302725257136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c49070c080 con 0x55c4907035c0 2024-09-13T19:17:14.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.114+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c49070cba0 con 0x7f9c0003f070 2024-09-13T19:17:14.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.115+0000 7f9c0871b640 1 -- 172.21.15.102:0/4152615934 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94302725257136] v36'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c0003c030 con 0x55c4907035c0 2024-09-13T19:17:14.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.115+0000 7f9c07f1a640 1 -- 172.21.15.102:0/4152615934 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(50 notify.3 [create] v36'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bf807a030 con 0x7f9c0003f070 2024-09-13T19:17:14.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.115+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94302725260976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c49070c080 con 0x7f9c0003f070 2024-09-13T19:17:14.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.115+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c49070d620 con 0x55c4906fed50 2024-09-13T19:17:14.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.116+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v36'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bf0029040 con 0x55c4906fed50 2024-09-13T19:17:14.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.116+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94302725263664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c49070db10 con 0x55c4906fed50 2024-09-13T19:17:14.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.116+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c49070e5f0 con 0x7f9bf809d070 2024-09-13T19:17:14.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.116+0000 7f9c07f1a640 1 -- 172.21.15.102:0/4152615934 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94302725260976] v36'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bf807a030 con 0x7f9c0003f070 2024-09-13T19:17:14.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.117+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94302725263664] v36'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bf0029040 con 0x55c4906fed50 2024-09-13T19:17:14.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.117+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(54 notify.5 [create] v36'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bf0029040 con 0x7f9bf809d070 2024-09-13T19:17:14.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.117+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94302725258192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c49070e100 con 0x7f9bf809d070 2024-09-13T19:17:14.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.117+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c49070eec0 con 0x7f9bf809d070 2024-09-13T19:17:14.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.119+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94302725258192] v36'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bf0029040 con 0x7f9bf809d070 2024-09-13T19:17:14.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.119+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(56 notify.6 [create] v36'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bf0029040 con 0x7f9bf809d070 2024-09-13T19:17:14.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.119+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94302725264928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c49070ed80 con 0x7f9bf809d070 2024-09-13T19:17:14.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.119+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c49070f5d0 con 0x7f9bf809d070 2024-09-13T19:17:14.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.120+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(58 notify.7 [create] v36'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bf0029040 con 0x7f9bf809d070 2024-09-13T19:17:14.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.120+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94302725271392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c49070f930 con 0x7f9bf809d070 2024-09-13T19:17:14.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.120+0000 7f9c0c80e800 20 add_watcher() i=0 2024-09-13T19:17:14.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.120+0000 7f9c0c80e800 20 add_watcher() i=1 2024-09-13T19:17:14.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.120+0000 7f9c0c80e800 20 add_watcher() i=2 2024-09-13T19:17:14.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.120+0000 7f9c0c80e800 20 add_watcher() i=3 2024-09-13T19:17:14.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.120+0000 7f9c0c80e800 20 add_watcher() i=4 2024-09-13T19:17:14.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.120+0000 7f9c0c80e800 20 add_watcher() i=5 2024-09-13T19:17:14.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.120+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94302725264928] v36'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bf0029040 con 0x7f9bf809d070 2024-09-13T19:17:14.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.120+0000 7f9c0c80e800 20 add_watcher() i=6 2024-09-13T19:17:14.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.121+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94302725271392] v36'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bf0029040 con 0x7f9bf809d070 2024-09-13T19:17:14.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.121+0000 7f9c0c80e800 20 add_watcher() i=7 2024-09-13T19:17:14.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.121+0000 7f9c0c80e800 2 all 8 watchers are set, enabling cache 2024-09-13T19:17:14.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.121+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c49070e8d0 con 0x55c4906fed50 2024-09-13T19:17:14.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.121+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9bf0029040 con 0x55c4906fed50 2024-09-13T19:17:14.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.121+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94302725272512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c49070e8d0 con 0x55c4906fed50 2024-09-13T19:17:14.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.122+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94302725272512] v36'198 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9bf0029040 con 0x55c4906fed50 2024-09-13T19:17:14.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.123+0000 7f9abdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:17:14.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.123+0000 7f9c0c80e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:17:14.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.123+0000 7f9c0c80e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:17:14.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.123+0000 7f9c0c80e800 5 note: GC not initialized 2024-09-13T19:17:14.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.123+0000 7f9abcfe1640 20 reqs_thread_entry: start 2024-09-13T19:17:14.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.123+0000 7f9c0c80e800 20 init_complete bucket index max shards: 11 2024-09-13T19:17:14.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.123+0000 7f9c0c80e800 20 Filter name: none 2024-09-13T19:17:14.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.123+0000 7f9a367fc640 20 reqs_thread_entry: start 2024-09-13T19:17:14.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.123+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c4907462b0 con 0x55c4906fed50 2024-09-13T19:17:14.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.123+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9bf0029040 con 0x55c4906fed50 2024-09-13T19:17:14.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.123+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c4907462b0 con 0x7f9c0003f070 2024-09-13T19:17:14.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.124+0000 7f9c07f1a640 1 -- 172.21.15.102:0/4152615934 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9bf807a030 con 0x7f9c0003f070 2024-09-13T19:17:14.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.124+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c490746270 con 0x55c4906fed50 2024-09-13T19:17:14.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.124+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9bf0029040 con 0x55c4906fed50 2024-09-13T19:17:14.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.124+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c490746270 con 0x55c4907035c0 2024-09-13T19:17:14.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.124+0000 7f9c0871b640 1 -- 172.21.15.102:0/4152615934 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9c0003c030 con 0x55c4907035c0 2024-09-13T19:17:14.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.124+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c490746270 con 0x55c4907035c0 2024-09-13T19:17:14.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.124+0000 7f9c0871b640 1 -- 172.21.15.102:0/4152615934 <== osd.3 v2:172.21.15.102:6800/3096737090 17 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9c0003c030 con 0x55c4907035c0 2024-09-13T19:17:14.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.124+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c490746270 con 0x55c4907035c0 2024-09-13T19:17:14.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.125+0000 7f9c0871b640 1 -- 172.21.15.102:0/4152615934 <== osd.3 v2:172.21.15.102:6800/3096737090 18 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9c0003c030 con 0x55c4907035c0 2024-09-13T19:17:14.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.125+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c490746270 con 0x55c4906fed50 2024-09-13T19:17:14.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.125+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9bf0029040 con 0x55c4906fed50 2024-09-13T19:17:14.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.125+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c490746270 con 0x55c4906fed50 2024-09-13T19:17:14.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.125+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9bf0029040 con 0x55c4906fed50 2024-09-13T19:17:14.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.125+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c490746270 con 0x55c4907035c0 2024-09-13T19:17:14.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.125+0000 7f9c0871b640 1 -- 172.21.15.102:0/4152615934 <== osd.3 v2:172.21.15.102:6800/3096737090 19 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9c0003c030 con 0x55c4907035c0 2024-09-13T19:17:14.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.125+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c490746270 con 0x55c4907035c0 2024-09-13T19:17:14.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.125+0000 7f9c0871b640 1 -- 172.21.15.102:0/4152615934 <== osd.3 v2:172.21.15.102:6800/3096737090 20 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9c0003c030 con 0x55c4907035c0 2024-09-13T19:17:14.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.125+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c490746270 con 0x7f9bf809d070 2024-09-13T19:17:14.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.126+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f9bf0029040 con 0x7f9bf809d070 2024-09-13T19:17:14.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.126+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c490747fb0 con 0x55c4906fed50 2024-09-13T19:17:14.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.126+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9bf0029040 con 0x55c4906fed50 2024-09-13T19:17:14.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.126+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c490747fb0 con 0x7f9c0003f070 2024-09-13T19:17:14.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.126+0000 7f9c07f1a640 1 -- 172.21.15.102:0/4152615934 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9bf807a030 con 0x7f9c0003f070 2024-09-13T19:17:14.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.126+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c490747fb0 con 0x55c4907035c0 2024-09-13T19:17:14.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.126+0000 7f9c0871b640 1 -- 172.21.15.102:0/4152615934 <== osd.3 v2:172.21.15.102:6800/3096737090 21 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9c0003c030 con 0x55c4907035c0 2024-09-13T19:17:14.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.126+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c490747fb0 con 0x7f9bf809d070 2024-09-13T19:17:14.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.127+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9bf0029040 con 0x7f9bf809d070 2024-09-13T19:17:14.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.127+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c490747fb0 con 0x7f9bf809d070 2024-09-13T19:17:14.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.127+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9bf0029040 con 0x7f9bf809d070 2024-09-13T19:17:14.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.127+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c490747fb0 con 0x55c4907035c0 2024-09-13T19:17:14.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.127+0000 7f9c0871b640 1 -- 172.21.15.102:0/4152615934 <== osd.3 v2:172.21.15.102:6800/3096737090 22 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9c0003c030 con 0x55c4907035c0 2024-09-13T19:17:14.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.127+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c490747fb0 con 0x7f9bf809d070 2024-09-13T19:17:14.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.128+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) ==== 152+0+163 (crc 0 0 0) 0x7f9bf0029040 con 0x7f9bf809d070 2024-09-13T19:17:14.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.128+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c490747fb0 con 0x55c4906fed50 2024-09-13T19:17:14.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.128+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9bf0029040 con 0x55c4906fed50 2024-09-13T19:17:14.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.128+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c490747fb0 con 0x55c4907035c0 2024-09-13T19:17:14.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.128+0000 7f9c0871b640 1 -- 172.21.15.102:0/4152615934 <== osd.3 v2:172.21.15.102:6800/3096737090 23 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9c0003c030 con 0x55c4907035c0 2024-09-13T19:17:14.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.128+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c490747fb0 con 0x7f9bf809d070 2024-09-13T19:17:14.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.128+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9bf0029040 con 0x7f9bf809d070 2024-09-13T19:17:14.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.128+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c490747fb0 con 0x7f9c0003f070 2024-09-13T19:17:14.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.129+0000 7f9c07f1a640 1 -- 172.21.15.102:0/4152615934 <== osd.2 v2:172.21.15.102:6816/2238176080 16 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9bf807a030 con 0x7f9c0003f070 2024-09-13T19:17:14.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.129+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c490747fb0 con 0x7f9bf809d070 2024-09-13T19:17:14.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.129+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9bf0029040 con 0x7f9bf809d070 2024-09-13T19:17:14.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.129+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c490747fb0 con 0x55c4906fed50 2024-09-13T19:17:14.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.129+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9bf0029040 con 0x55c4906fed50 2024-09-13T19:17:14.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.129+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c490747fb0 con 0x55c4906fed50 2024-09-13T19:17:14.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.129+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.1 v2:172.21.15.102:6808/2204418452 28 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9bf0029040 con 0x55c4906fed50 2024-09-13T19:17:14.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.129+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c490747fb0 con 0x55c4907035c0 2024-09-13T19:17:14.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.130+0000 7f9c0871b640 1 -- 172.21.15.102:0/4152615934 <== osd.3 v2:172.21.15.102:6800/3096737090 24 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9c0003c030 con 0x55c4907035c0 2024-09-13T19:17:14.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.130+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c490747fb0 con 0x55c4906fed50 2024-09-13T19:17:14.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.130+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.1 v2:172.21.15.102:6808/2204418452 29 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9bf0029040 con 0x55c4906fed50 2024-09-13T19:17:14.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.130+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c490747fb0 con 0x55c4906fed50 2024-09-13T19:17:14.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.130+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.1 v2:172.21.15.102:6808/2204418452 30 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9bf0029040 con 0x55c4906fed50 2024-09-13T19:17:14.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.130+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c490747fb0 con 0x55c4907035c0 2024-09-13T19:17:14.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.130+0000 7f9c0871b640 1 -- 172.21.15.102:0/4152615934 <== osd.3 v2:172.21.15.102:6800/3096737090 25 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9c0003c030 con 0x55c4907035c0 2024-09-13T19:17:14.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.130+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c490747fb0 con 0x55c4907035c0 2024-09-13T19:17:14.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.130+0000 7f9c0871b640 1 -- 172.21.15.102:0/4152615934 <== osd.3 v2:172.21.15.102:6800/3096737090 26 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9c0003c030 con 0x55c4907035c0 2024-09-13T19:17:14.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.130+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c490747fb0 con 0x55c4907035c0 2024-09-13T19:17:14.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.131+0000 7f9c0871b640 1 -- 172.21.15.102:0/4152615934 <== osd.3 v2:172.21.15.102:6800/3096737090 27 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9c0003c030 con 0x55c4907035c0 2024-09-13T19:17:14.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.131+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c490747fb0 con 0x7f9bf809d070 2024-09-13T19:17:14.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.131+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.0 v2:172.21.15.53:6800/4021716951 20 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9bf0029040 con 0x7f9bf809d070 2024-09-13T19:17:14.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.132+0000 7f9abdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:17:14.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.132+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94302725272512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c490747b00 con 0x55c4906fed50 2024-09-13T19:17:14.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.133+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.1 v2:172.21.15.102:6808/2204418452 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94302725272512] v36'199 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9bf0029040 con 0x55c4906fed50 2024-09-13T19:17:14.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.133+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94302725248576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c49070f380 con 0x7f9c0003f070 2024-09-13T19:17:14.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.134+0000 7f9c07f1a640 1 -- 172.21.15.102:0/4152615934 <== osd.2 v2:172.21.15.102:6816/2238176080 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94302725248576] v36'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bf807a030 con 0x7f9c0003f070 2024-09-13T19:17:14.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.134+0000 7f9c0c80e800 20 remove_watcher() i=0 2024-09-13T19:17:14.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.134+0000 7f9c0c80e800 2 removed watcher, disabling cache 2024-09-13T19:17:14.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.134+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94302725254080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c490709640 con 0x55c4906fed50 2024-09-13T19:17:14.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.136+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.1 v2:172.21.15.102:6808/2204418452 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94302725254080] v36'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bf0029040 con 0x55c4906fed50 2024-09-13T19:17:14.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.136+0000 7f9c0c80e800 20 remove_watcher() i=1 2024-09-13T19:17:14.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.136+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94302725257136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c490709640 con 0x55c4907035c0 2024-09-13T19:17:14.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.137+0000 7f9c0871b640 1 -- 172.21.15.102:0/4152615934 <== osd.3 v2:172.21.15.102:6800/3096737090 28 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94302725257136] v36'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c0003c030 con 0x55c4907035c0 2024-09-13T19:17:14.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.137+0000 7f9c0c80e800 20 remove_watcher() i=2 2024-09-13T19:17:14.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.137+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94302725260976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c49070b7b0 con 0x7f9c0003f070 2024-09-13T19:17:14.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.138+0000 7f9c07f1a640 1 -- 172.21.15.102:0/4152615934 <== osd.2 v2:172.21.15.102:6816/2238176080 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94302725260976] v36'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bf807a030 con 0x7f9c0003f070 2024-09-13T19:17:14.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.138+0000 7f9c0c80e800 20 remove_watcher() i=3 2024-09-13T19:17:14.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.138+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94302725263664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c490709640 con 0x55c4906fed50 2024-09-13T19:17:14.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.139+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.1 v2:172.21.15.102:6808/2204418452 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94302725263664] v36'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bf0029040 con 0x55c4906fed50 2024-09-13T19:17:14.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.139+0000 7f9c0c80e800 20 remove_watcher() i=4 2024-09-13T19:17:14.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.139+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94302725258192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c49070c6b0 con 0x7f9bf809d070 2024-09-13T19:17:14.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.140+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.0 v2:172.21.15.53:6800/4021716951 21 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94302725258192] v36'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bf0029040 con 0x7f9bf809d070 2024-09-13T19:17:14.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.140+0000 7f9c0c80e800 20 remove_watcher() i=5 2024-09-13T19:17:14.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.140+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94302725264928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c49070d130 con 0x7f9bf809d070 2024-09-13T19:17:14.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.141+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.0 v2:172.21.15.53:6800/4021716951 22 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94302725264928] v36'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bf0029040 con 0x7f9bf809d070 2024-09-13T19:17:14.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.141+0000 7f9c0c80e800 20 remove_watcher() i=6 2024-09-13T19:17:14.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.141+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94302725271392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c49070bc60 con 0x7f9bf809d070 2024-09-13T19:17:14.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.142+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 <== osd.0 v2:172.21.15.53:6800/4021716951 23 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94302725271392] v36'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bf0029040 con 0x7f9bf809d070 2024-09-13T19:17:14.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.142+0000 7f9c0c80e800 20 remove_watcher() i=7 2024-09-13T19:17:14.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.142+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f9bf809d070 msgr2=0x7f9bf8004280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.142+0000 7f9c0c80e800 1 --2- 172.21.15.102:0/4152615934 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f9bf809d070 0x7f9bf8004280 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.142+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55c4906fed50 msgr2=0x55c490701210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.142+0000 7f9c0c80e800 1 --2- 172.21.15.102:0/4152615934 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55c4906fed50 0x55c490701210 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.142+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f9c0003f070 msgr2=0x7f9c00040040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.142+0000 7f9c0c80e800 1 --2- 172.21.15.102:0/4152615934 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f9c0003f070 0x7f9c00040040 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.142+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55c4907035c0 msgr2=0x55c4907059b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.142+0000 7f9c0c80e800 1 --2- 172.21.15.102:0/4152615934 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55c4907035c0 0x55c4907059b0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.142+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9ad0036ce0 msgr2=0x7f9ad00391a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.142+0000 7f9c0c80e800 1 --2- 172.21.15.102:0/4152615934 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9ad0036ce0 0x7f9ad00391a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9bf807c730 tx=0x7f9bf8092000 comp rx=0 tx=0).stop 2024-09-13T19:17:14.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.143+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4906ebfa0 msgr2=0x55c4906f32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.143+0000 7f9c0c80e800 1 --2- 172.21.15.102:0/4152615934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4906ebfa0 0x55c4906f32b0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f9c0004cd30 tx=0x7f9c0004cd60 comp rx=0 tx=0).stop 2024-09-13T19:17:14.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.143+0000 7f9bfffff640 1 -- 172.21.15.102:0/4152615934 reap_dead start 2024-09-13T19:17:14.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.143+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 shutdown_connections 2024-09-13T19:17:14.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.143+0000 7f9c0c80e800 1 --2- 172.21.15.102:0/4152615934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4906ebfa0 0x55c4906f32b0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.143+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 >> 172.21.15.102:0/4152615934 conn(0x55c4906e8350 msgr2=0x55c4906e6420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:14.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.143+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 shutdown_connections 2024-09-13T19:17:14.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.143+0000 7f9c0c80e800 1 -- 172.21.15.102:0/4152615934 wait complete. 2024-09-13T19:17:14.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.143+0000 7f9c0c80e800 1 -- 172.21.15.102:0/2193940279 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9ae0036b40 msgr2=0x7f9ae0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.143+0000 7f9c0c80e800 1 --2- 172.21.15.102:0/2193940279 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9ae0036b40 0x7f9ae0039000 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x55c4905cacc0 tx=0x7f9bf808ec10 comp rx=0 tx=0).stop 2024-09-13T19:17:14.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.143+0000 7f9c0c80e800 1 -- 172.21.15.102:0/2193940279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4906df2a0 msgr2=0x55c4906df6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.143+0000 7f9c0c80e800 1 --2- 172.21.15.102:0/2193940279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4906df2a0 0x55c4906df6c0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x55c4906cbe60 tx=0x7f9c000163e0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.143+0000 7f9c0c80e800 1 -- 172.21.15.102:0/2193940279 shutdown_connections 2024-09-13T19:17:14.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.143+0000 7f9c0c80e800 1 --2- 172.21.15.102:0/2193940279 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9ae0036b40 0x7f9ae0039000 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.143+0000 7f9c0c80e800 1 --2- 172.21.15.102:0/2193940279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4906df2a0 0x55c4906df6c0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.143+0000 7f9c0c80e800 1 -- 172.21.15.102:0/2193940279 >> 172.21.15.102:0/2193940279 conn(0x55c4906d4230 msgr2=0x55c4906d6db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:14.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.143+0000 7f9c0c80e800 1 -- 172.21.15.102:0/2193940279 shutdown_connections 2024-09-13T19:17:14.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.143+0000 7f9c0c80e800 1 -- 172.21.15.102:0/2193940279 wait complete. 2024-09-13T19:17:14.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.143+0000 7f9c0c80e800 1 -- 172.21.15.102:0/2995722312 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55c4905ce780 msgr2=0x55c4906cb580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.143+0000 7f9c0c80e800 1 --2- 172.21.15.102:0/2995722312 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55c4905ce780 0x55c4906cb580 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.143+0000 7f9c0c80e800 1 -- 172.21.15.102:0/2995722312 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55c4906cdd70 msgr2=0x55c4906d0230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.143+0000 7f9c0c80e800 1 --2- 172.21.15.102:0/2995722312 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55c4906cdd70 0x55c4906d0230 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.143+0000 7f9c0c80e800 1 -- 172.21.15.102:0/2995722312 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9af0036b40 msgr2=0x7f9af0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.143+0000 7f9c0c80e800 1 --2- 172.21.15.102:0/2995722312 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9af0036b40 0x7f9af0039000 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0000f60 tx=0x7f9bf00012b0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.143+0000 7f9c0c80e800 1 -- 172.21.15.102:0/2995722312 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c49053f620 msgr2=0x55c4905cbb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.143+0000 7f9c0c80e800 1 --2- 172.21.15.102:0/2995722312 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c49053f620 0x55c4905cbb70 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x55c4906bb6e0 tx=0x7f9bf8002fb0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.144+0000 7f9c0c80e800 1 -- 172.21.15.102:0/2995722312 shutdown_connections 2024-09-13T19:17:14.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.144+0000 7f9c0c80e800 1 --2- 172.21.15.102:0/2995722312 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55c4906cdd70 0x55c4906d0230 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.144+0000 7f9c0c80e800 1 --2- 172.21.15.102:0/2995722312 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55c4905ce780 0x55c4906cb580 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.144+0000 7f9c0c80e800 1 --2- 172.21.15.102:0/2995722312 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9af0036b40 0x7f9af0039000 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.144+0000 7f9c0c80e800 1 --2- 172.21.15.102:0/2995722312 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c49053f620 0x55c4905cbb70 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.144+0000 7f9c0c80e800 1 -- 172.21.15.102:0/2995722312 >> 172.21.15.102:0/2995722312 conn(0x55c4905c5dd0 msgr2=0x55c4906b4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:14.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.144+0000 7f9c0c80e800 1 -- 172.21.15.102:0/2995722312 shutdown_connections 2024-09-13T19:17:14.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.144+0000 7f9c0c80e800 1 -- 172.21.15.102:0/2995722312 wait complete. 2024-09-13T19:17:14.162 INFO:teuthology.orchestra.run.smithi102.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"total":{"bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}},{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-09-13T19:17:14.162 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-09-13T19:17:14.162 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-13T19:17:14.163 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-13T19:17:14.163 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-13T19:17:14.247 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:17:14.247 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:17:14.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.244+0000 7f9f19d32800 1 Processor -- start 2024-09-13T19:17:14.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.244+0000 7f9f19d32800 1 -- start start 2024-09-13T19:17:14.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.245+0000 7f9f19d32800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5621cb791990 0x5621cb793d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.245+0000 7f9f19d32800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5621cb64db30 con 0x5621cb78d550 2024-09-13T19:17:14.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.245+0000 7f9f19d32800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5621cb62f360 con 0x5621cb791990 2024-09-13T19:17:14.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.245+0000 7f9f0ffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5621cb791990 0x5621cb793d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.245+0000 7f9f15a80640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5621cb78d550 0x5621cb78d950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:50016/0 (socket says 172.21.15.102:50016) 2024-09-13T19:17:14.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.245+0000 7f9f15a80640 1 -- 172.21.15.102:0/1149469195 learned_addr learned my addr 172.21.15.102:0/1149469195 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:17:14.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.245+0000 7f9f0ffff640 1 --2- 172.21.15.102:0/1149469195 >> v2:172.21.15.53:3300/0 conn(0x5621cb791990 0x5621cb793d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41088/0 (socket says 172.21.15.102:41088) 2024-09-13T19:17:14.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.245+0000 7f9f0ffff640 1 -- 172.21.15.102:0/1149469195 >> v1:172.21.15.53:6789/0 conn(0x5621cb78d550 legacy=0x5621cb78d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.245+0000 7f9f0ffff640 1 -- 172.21.15.102:0/1149469195 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621cb655e00 con 0x5621cb791990 2024-09-13T19:17:14.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.247+0000 7f9f0ffff640 1 --2- 172.21.15.102:0/1149469195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621cb791990 0x5621cb793d80 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f9f0000a470 tx=0x7f9f00045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22f044800c81f423 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.247+0000 7f9f1527f640 1 -- 172.21.15.102:0/1149469195 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f00053570 con 0x5621cb791990 2024-09-13T19:17:14.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.247+0000 7f9f1527f640 1 -- 172.21.15.102:0/1149469195 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f00058070 con 0x5621cb791990 2024-09-13T19:17:14.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.247+0000 7f9f1527f640 1 -- 172.21.15.102:0/1149469195 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f00053880 con 0x5621cb791990 2024-09-13T19:17:14.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.248+0000 7f9f19d32800 1 -- 172.21.15.102:0/1149469195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621cb791990 msgr2=0x5621cb793d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.248+0000 7f9f19d32800 1 --2- 172.21.15.102:0/1149469195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621cb791990 0x5621cb793d80 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f9f0000a470 tx=0x7f9f00045a20 comp rx=0 tx=0).stop 2024-09-13T19:17:14.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.248+0000 7f9f19d32800 1 -- 172.21.15.102:0/1149469195 shutdown_connections 2024-09-13T19:17:14.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.248+0000 7f9f19d32800 1 --2- 172.21.15.102:0/1149469195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621cb791990 0x5621cb793d80 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.248+0000 7f9f19d32800 1 -- 172.21.15.102:0/1149469195 >> 172.21.15.102:0/1149469195 conn(0x5621cb788de0 msgr2=0x5621cb78b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:14.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.248+0000 7f9f19d32800 1 -- 172.21.15.102:0/1149469195 shutdown_connections 2024-09-13T19:17:14.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.248+0000 7f9f19d32800 1 -- 172.21.15.102:0/1149469195 wait complete. 2024-09-13T19:17:14.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.262+0000 7f9f19d32800 1 Processor -- start 2024-09-13T19:17:14.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.262+0000 7f9f19d32800 1 -- start start 2024-09-13T19:17:14.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.262+0000 7f9f19d32800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621cb78d550 0x5621cb87c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.262+0000 7f9f19d32800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5621cb6da330 con 0x5621cb78d550 2024-09-13T19:17:14.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.263+0000 7f9f15a80640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621cb78d550 0x5621cb87c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.263+0000 7f9f15a80640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621cb78d550 0x5621cb87c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41096/0 (socket says 172.21.15.102:41096) 2024-09-13T19:17:14.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.263+0000 7f9f15a80640 1 -- 172.21.15.102:0/3523575238 learned_addr learned my addr 172.21.15.102:0/3523575238 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:14.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.263+0000 7f9f15a80640 1 -- 172.21.15.102:0/3523575238 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621cb627bc0 con 0x5621cb78d550 2024-09-13T19:17:14.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.263+0000 7f9f15a80640 1 --2- 172.21.15.102:0/3523575238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621cb78d550 0x5621cb87c780 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f9f08001d80 tx=0x7f9f08001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59820841e9d18b7d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.263+0000 7f9e03e07640 1 -- 172.21.15.102:0/3523575238 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f08013030 con 0x5621cb78d550 2024-09-13T19:17:14.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.263+0000 7f9e03e07640 1 -- 172.21.15.102:0/3523575238 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f0800e470 con 0x5621cb78d550 2024-09-13T19:17:14.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.263+0000 7f9e03e07640 1 -- 172.21.15.102:0/3523575238 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f0800e810 con 0x5621cb78d550 2024-09-13T19:17:14.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.264+0000 7f9f19d32800 1 -- 172.21.15.102:0/3523575238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621cb78d550 msgr2=0x5621cb87c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.264+0000 7f9f19d32800 1 --2- 172.21.15.102:0/3523575238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621cb78d550 0x5621cb87c780 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f9f08001d80 tx=0x7f9f08001e70 comp rx=0 tx=0).stop 2024-09-13T19:17:14.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.264+0000 7f9f19d32800 1 -- 172.21.15.102:0/3523575238 shutdown_connections 2024-09-13T19:17:14.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.264+0000 7f9f19d32800 1 --2- 172.21.15.102:0/3523575238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621cb78d550 0x5621cb87c780 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.264+0000 7f9f19d32800 1 -- 172.21.15.102:0/3523575238 >> 172.21.15.102:0/3523575238 conn(0x5621cb788de0 msgr2=0x5621cb878140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:14.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.264+0000 7f9f19d32800 1 -- 172.21.15.102:0/3523575238 shutdown_connections 2024-09-13T19:17:14.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.264+0000 7f9f19d32800 1 -- 172.21.15.102:0/3523575238 wait complete. 2024-09-13T19:17:14.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.264+0000 7f9f19d32800 1 Processor -- start 2024-09-13T19:17:14.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.265+0000 7f9f19d32800 1 -- start start 2024-09-13T19:17:14.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.265+0000 7f9f19d32800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621cb78d550 0x5621cb884190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.265+0000 7f9f19d32800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5621cb7945c0 con 0x5621cb78d550 2024-09-13T19:17:14.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.265+0000 7f9f15a80640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621cb78d550 0x5621cb884190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.265+0000 7f9f15a80640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621cb78d550 0x5621cb884190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41108/0 (socket says 172.21.15.102:41108) 2024-09-13T19:17:14.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.265+0000 7f9f15a80640 1 -- 172.21.15.102:0/1079641088 learned_addr learned my addr 172.21.15.102:0/1079641088 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:14.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.266+0000 7f9f15a80640 1 -- 172.21.15.102:0/1079641088 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621cb63bfe0 con 0x5621cb78d550 2024-09-13T19:17:14.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.266+0000 7f9f15a80640 1 --2- 172.21.15.102:0/1079641088 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621cb78d550 0x5621cb884190 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f9f08004000 tx=0x7f9f08000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.266+0000 7f9e02604640 1 -- 172.21.15.102:0/1079641088 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f08027070 con 0x5621cb78d550 2024-09-13T19:17:14.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.266+0000 7f9e02604640 1 -- 172.21.15.102:0/1079641088 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f08019900 con 0x5621cb78d550 2024-09-13T19:17:14.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.266+0000 7f9f19d32800 1 -- 172.21.15.102:0/1079641088 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5621cb8846d0 con 0x5621cb78d550 2024-09-13T19:17:14.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.266+0000 7f9e02604640 1 -- 172.21.15.102:0/1079641088 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f08019c60 con 0x5621cb78d550 2024-09-13T19:17:14.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.266+0000 7f9f19d32800 1 -- 172.21.15.102:0/1079641088 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621cb884bf0 con 0x5621cb78d550 2024-09-13T19:17:14.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.267+0000 7f9e02604640 1 -- 172.21.15.102:0/1079641088 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9f0802a070 con 0x5621cb78d550 2024-09-13T19:17:14.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.267+0000 7f9e02604640 1 --2- 172.21.15.102:0/1079641088 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9dfc036b40 0x7f9dfc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.267+0000 7f9e02604640 1 -- 172.21.15.102:0/1079641088 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f9f0801f070 con 0x5621cb78d550 2024-09-13T19:17:14.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.267+0000 7f9f0ffff640 1 --2- 172.21.15.102:0/1079641088 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9dfc036b40 0x7f9dfc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.267+0000 7f9f19d32800 1 --2- 172.21.15.102:0/1079641088 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5621cb791990 0x5621cb88b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.267+0000 7f9f19d32800 1 -- 172.21.15.102:0/1079641088 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5621cb88b7d0 con 0x5621cb791990 2024-09-13T19:17:14.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.267+0000 7f9f16281640 1 --2- 172.21.15.102:0/1079641088 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5621cb791990 0x5621cb88b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.268+0000 7f9f0ffff640 1 --2- 172.21.15.102:0/1079641088 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9dfc036b40 0x7f9dfc039000 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9f00057000 tx=0x7f9f00052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.268+0000 7f9f16281640 1 --2- 172.21.15.102:0/1079641088 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5621cb791990 0x5621cb88b200 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.268+0000 7f9f16281640 1 -- 172.21.15.102:0/1079641088 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9f1000a4a0 con 0x5621cb791990 2024-09-13T19:17:14.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.268+0000 7f9f19d32800 1 -- 172.21.15.102:0/1079641088 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8887b0 con 0x5621cb791990 2024-09-13T19:17:14.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.268+0000 7f9f16281640 1 -- 172.21.15.102:0/1079641088 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9f1000a4a0 con 0x5621cb791990 2024-09-13T19:17:14.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.268+0000 7f9f19d32800 1 --2- 172.21.15.102:0/1079641088 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5621cb88dae0 0x5621cb88fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.268+0000 7f9f19d32800 1 -- 172.21.15.102:0/1079641088 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5621cb890570 con 0x5621cb88dae0 2024-09-13T19:17:14.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.268+0000 7f9f15a80640 1 --2- 172.21.15.102:0/1079641088 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5621cb88dae0 0x5621cb88fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.268+0000 7f9f15a80640 1 --2- 172.21.15.102:0/1079641088 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5621cb88dae0 0x5621cb88fed0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.269+0000 7f9f15a80640 1 -- 172.21.15.102:0/1079641088 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9f08029030 con 0x5621cb88dae0 2024-09-13T19:17:14.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.269+0000 7f9f19d32800 1 -- 172.21.15.102:0/1079641088 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5621cb88c980 con 0x5621cb791990 2024-09-13T19:17:14.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.269+0000 7f9f16281640 1 -- 172.21.15.102:0/1079641088 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9f1000a4a0 con 0x5621cb791990 2024-09-13T19:17:14.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.269+0000 7f9f19d32800 1 -- 172.21.15.102:0/1079641088 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5621cb88ce60 con 0x5621cb88dae0 2024-09-13T19:17:14.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.269+0000 7f9f15a80640 1 -- 172.21.15.102:0/1079641088 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9f08029030 con 0x5621cb88dae0 2024-09-13T19:17:14.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.270+0000 7f9f19d32800 1 Processor -- start 2024-09-13T19:17:14.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.270+0000 7f9f19d32800 1 -- start start 2024-09-13T19:17:14.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.270+0000 7f9f19d32800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621cb702660 0x5621cb8a50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.270+0000 7f9f19d32800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5621cb629580 con 0x5621cb702660 2024-09-13T19:17:14.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.270+0000 7f9f16281640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621cb702660 0x5621cb8a50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.270+0000 7f9f16281640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621cb702660 0x5621cb8a50b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41112/0 (socket says 172.21.15.102:41112) 2024-09-13T19:17:14.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.270+0000 7f9f16281640 1 -- 172.21.15.102:0/1807274302 learned_addr learned my addr 172.21.15.102:0/1807274302 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:14.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.271+0000 7f9f16281640 1 -- 172.21.15.102:0/1807274302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621cb8a0aa0 con 0x5621cb702660 2024-09-13T19:17:14.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.271+0000 7f9f16281640 1 --2- 172.21.15.102:0/1807274302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621cb702660 0x5621cb8a50b0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x5621cb88bbb0 tx=0x7f9f100167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.271+0000 7f9dfb7fe640 1 -- 172.21.15.102:0/1807274302 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f10013640 con 0x5621cb702660 2024-09-13T19:17:14.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.271+0000 7f9dfb7fe640 1 -- 172.21.15.102:0/1807274302 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f100137e0 con 0x5621cb702660 2024-09-13T19:17:14.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.271+0000 7f9f19d32800 1 -- 172.21.15.102:0/1807274302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5621cb8a55f0 con 0x5621cb702660 2024-09-13T19:17:14.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.271+0000 7f9dfb7fe640 1 -- 172.21.15.102:0/1807274302 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f10013ae0 con 0x5621cb702660 2024-09-13T19:17:14.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.271+0000 7f9f19d32800 1 -- 172.21.15.102:0/1807274302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621cb8a5af0 con 0x5621cb702660 2024-09-13T19:17:14.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.272+0000 7f9dfb7fe640 1 -- 172.21.15.102:0/1807274302 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9f10011040 con 0x5621cb702660 2024-09-13T19:17:14.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.272+0000 7f9dfb7fe640 1 --2- 172.21.15.102:0/1807274302 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9df0036b40 0x7f9df0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.272+0000 7f9dfb7fe640 1 -- 172.21.15.102:0/1807274302 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f9f1000e040 con 0x5621cb702660 2024-09-13T19:17:14.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.272+0000 7f9f15a80640 1 --2- 172.21.15.102:0/1807274302 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9df0036b40 0x7f9df0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.272+0000 7f9f19d32800 1 Processor -- start 2024-09-13T19:17:14.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.272+0000 7f9f15a80640 1 --2- 172.21.15.102:0/1807274302 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9df0036b40 0x7f9df0039000 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x5621cb8886f0 tx=0x7f9f0804ad80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.272+0000 7f9f19d32800 1 -- start start 2024-09-13T19:17:14.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.273+0000 7f9f19d32800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621cb8aef70 0x5621cb8af370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.273+0000 7f9f19d32800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5621cb87cf30 con 0x5621cb8aef70 2024-09-13T19:17:14.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.273+0000 7f9f16281640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621cb8aef70 0x5621cb8af370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.273+0000 7f9f16281640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621cb8aef70 0x5621cb8af370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41126/0 (socket says 172.21.15.102:41126) 2024-09-13T19:17:14.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.273+0000 7f9f16281640 1 -- 172.21.15.102:0/1602673789 learned_addr learned my addr 172.21.15.102:0/1602673789 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:14.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.273+0000 7f9f16281640 1 -- 172.21.15.102:0/1602673789 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621cb8af940 con 0x5621cb8aef70 2024-09-13T19:17:14.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.273+0000 7f9f16281640 1 --2- 172.21.15.102:0/1602673789 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621cb8aef70 0x5621cb8af370 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f9f1000b010 tx=0x7f9f1004d060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dca4e9d02b5602e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.273+0000 7f9df97fa640 1 -- 172.21.15.102:0/1602673789 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f10021a90 con 0x5621cb8aef70 2024-09-13T19:17:14.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.274+0000 7f9df97fa640 1 -- 172.21.15.102:0/1602673789 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f1004a030 con 0x5621cb8aef70 2024-09-13T19:17:14.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.274+0000 7f9df97fa640 1 -- 172.21.15.102:0/1602673789 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f10021570 con 0x5621cb8aef70 2024-09-13T19:17:14.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.274+0000 7f9f19d32800 1 -- 172.21.15.102:0/1602673789 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621cb8aef70 msgr2=0x5621cb8af370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.274+0000 7f9f19d32800 1 --2- 172.21.15.102:0/1602673789 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621cb8aef70 0x5621cb8af370 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f9f1000b010 tx=0x7f9f1004d060 comp rx=0 tx=0).stop 2024-09-13T19:17:14.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.274+0000 7f9f19d32800 1 -- 172.21.15.102:0/1602673789 shutdown_connections 2024-09-13T19:17:14.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.274+0000 7f9f19d32800 1 --2- 172.21.15.102:0/1602673789 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621cb8aef70 0x5621cb8af370 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.274+0000 7f9f19d32800 1 -- 172.21.15.102:0/1602673789 >> 172.21.15.102:0/1602673789 conn(0x5621cb8ab2d0 msgr2=0x5621cb8a93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:14.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.274+0000 7f9f19d32800 1 -- 172.21.15.102:0/1602673789 shutdown_connections 2024-09-13T19:17:14.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.274+0000 7f9f19d32800 1 -- 172.21.15.102:0/1602673789 wait complete. 2024-09-13T19:17:14.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.274+0000 7f9f19d32800 1 Processor -- start 2024-09-13T19:17:14.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.274+0000 7f9f19d32800 1 -- start start 2024-09-13T19:17:14.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.275+0000 7f9f19d32800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621cb8aef70 0x5621cb8b63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.275+0000 7f9f19d32800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5621cb8affb0 con 0x5621cb8aef70 2024-09-13T19:17:14.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.275+0000 7f9f16281640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621cb8aef70 0x5621cb8b63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.275+0000 7f9f16281640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621cb8aef70 0x5621cb8b63a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41136/0 (socket says 172.21.15.102:41136) 2024-09-13T19:17:14.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.275+0000 7f9f16281640 1 -- 172.21.15.102:0/2089263921 learned_addr learned my addr 172.21.15.102:0/2089263921 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:14.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.275+0000 7f9f16281640 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621cb8b68e0 con 0x5621cb8aef70 2024-09-13T19:17:14.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.275+0000 7f9f16281640 1 --2- 172.21.15.102:0/2089263921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621cb8aef70 0x5621cb8b63a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f9f1001ff70 tx=0x7f9f1004cd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.275+0000 7f9de77fe640 1 -- 172.21.15.102:0/2089263921 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f10038070 con 0x5621cb8aef70 2024-09-13T19:17:14.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.275+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5621cb8b6b70 con 0x5621cb8aef70 2024-09-13T19:17:14.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.275+0000 7f9de77fe640 1 -- 172.21.15.102:0/2089263921 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f10014e00 con 0x5621cb8aef70 2024-09-13T19:17:14.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.275+0000 7f9de77fe640 1 -- 172.21.15.102:0/2089263921 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f10021570 con 0x5621cb8aef70 2024-09-13T19:17:14.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.275+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621cb8b9820 con 0x5621cb8aef70 2024-09-13T19:17:14.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.276+0000 7f9de77fe640 1 -- 172.21.15.102:0/2089263921 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9f1003b070 con 0x5621cb8aef70 2024-09-13T19:17:14.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.276+0000 7f9de77fe640 1 --2- 172.21.15.102:0/2089263921 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9de0036af0 0x7f9de0038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.276+0000 7f9de77fe640 1 -- 172.21.15.102:0/2089263921 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f9f10034d70 con 0x5621cb8aef70 2024-09-13T19:17:14.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.276+0000 7f9f15a80640 1 --2- 172.21.15.102:0/2089263921 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9de0036af0 0x7f9de0038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.277+0000 7f9f19d32800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.277+0000 7f9f19d32800 1 --2- 172.21.15.102:0/2089263921 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5621cb8c1e60 0x5621cb8c4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.277+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8c4a70 con 0x5621cb8c1e60 2024-09-13T19:17:14.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.277+0000 7f9f0ffff640 1 --2- 172.21.15.102:0/2089263921 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5621cb8c1e60 0x5621cb8c4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.277+0000 7f9f15a80640 1 --2- 172.21.15.102:0/2089263921 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9de0036af0 0x7f9de0038fb0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9f08016fd0 tx=0x7f9f08037000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.277+0000 7f9f0ffff640 1 --2- 172.21.15.102:0/2089263921 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5621cb8c1e60 0x5621cb8c4320 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.277+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9f00051070 con 0x5621cb8c1e60 2024-09-13T19:17:14.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.277+0000 7f9f19d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:14.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.277+0000 7f9f19d32800 20 realm 2024-09-13T19:17:14.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.277+0000 7f9f19d32800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.277+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8c4ea0 con 0x5621cb8c1e60 2024-09-13T19:17:14.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.278+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9f00051070 con 0x5621cb8c1e60 2024-09-13T19:17:14.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.278+0000 7f9f19d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:14.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.278+0000 7f9f19d32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:17:14.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.278+0000 7f9f19d32800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.278+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8c5770 con 0x5621cb8c1e60 2024-09-13T19:17:14.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.278+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9f00051070 con 0x5621cb8c1e60 2024-09-13T19:17:14.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.278+0000 7f9f19d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:14.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.278+0000 7f9f19d32800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.278+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8c5b10 con 0x5621cb8c1e60 2024-09-13T19:17:14.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.278+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9f00051070 con 0x5621cb8c1e60 2024-09-13T19:17:14.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.278+0000 7f9f19d32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:17:14.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.278+0000 7f9f19d32800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.278+0000 7f9f19d32800 1 --2- 172.21.15.102:0/2089263921 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5621cb8c6870 0x5621cb8c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.278+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8c91a0 con 0x5621cb8c6870 2024-09-13T19:17:14.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.278+0000 7f9f16281640 1 --2- 172.21.15.102:0/2089263921 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5621cb8c6870 0x5621cb8c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.278+0000 7f9f16281640 1 --2- 172.21.15.102:0/2089263921 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5621cb8c6870 0x5621cb8c8c60 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.279+0000 7f9f16281640 1 -- 172.21.15.102:0/2089263921 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9f1003a030 con 0x5621cb8c6870 2024-09-13T19:17:14.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.279+0000 7f9f19d32800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:17:14.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.279+0000 7f9f19d32800 20 searching for the correct realm 2024-09-13T19:17:14.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.279+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8cab50 con 0x5621cb8c6870 2024-09-13T19:17:14.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.279+0000 7f9f16281640 1 -- 172.21.15.102:0/2089263921 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f1003a030 con 0x5621cb8c6870 2024-09-13T19:17:14.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.279+0000 7f9f16281640 1 --2- 172.21.15.102:0/2089263921 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f9f10036bb0 0x7f9f1003f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.279+0000 7f9f16281640 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8cab50 con 0x7f9f10036bb0 2024-09-13T19:17:14.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.279+0000 7f9f15a80640 1 --2- 172.21.15.102:0/2089263921 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f9f10036bb0 0x7f9f1003f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.279+0000 7f9f15a80640 1 --2- 172.21.15.102:0/2089263921 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f9f10036bb0 0x7f9f1003f7d0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.280+0000 7f9f15a80640 1 -- 172.21.15.102:0/2089263921 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f08043050 con 0x7f9f10036bb0 2024-09-13T19:17:14.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.280+0000 7f9f15a80640 1 --2- 172.21.15.102:0/2089263921 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f9f0802c060 0x7f9f0802a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.280+0000 7f9f15a80640 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8cab50 con 0x7f9f0802c060 2024-09-13T19:17:14.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.280+0000 7f9f0ffff640 1 --2- 172.21.15.102:0/2089263921 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f9f0802c060 0x7f9f0802a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.280+0000 7f9f0ffff640 1 --2- 172.21.15.102:0/2089263921 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f9f0802c060 0x7f9f0802a580 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.281+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f00051070 con 0x7f9f0802c060 2024-09-13T19:17:14.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.281+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8cab50 con 0x5621cb8c1e60 2024-09-13T19:17:14.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.281+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f00051070 con 0x5621cb8c1e60 2024-09-13T19:17:14.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.281+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8cab50 con 0x5621cb8c1e60 2024-09-13T19:17:14.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.281+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f00051070 con 0x5621cb8c1e60 2024-09-13T19:17:14.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.281+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8cab50 con 0x7f9f0802c060 2024-09-13T19:17:14.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.281+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f00051070 con 0x7f9f0802c060 2024-09-13T19:17:14.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.281+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8cab50 con 0x7f9f0802c060 2024-09-13T19:17:14.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.282+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f00051070 con 0x7f9f0802c060 2024-09-13T19:17:14.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.282+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8cab50 con 0x7f9f10036bb0 2024-09-13T19:17:14.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.282+0000 7f9f15a80640 1 -- 172.21.15.102:0/2089263921 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f08043050 con 0x7f9f10036bb0 2024-09-13T19:17:14.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.282+0000 7f9f15a80640 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8cab50 con 0x5621cb8c6870 2024-09-13T19:17:14.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.282+0000 7f9f16281640 1 -- 172.21.15.102:0/2089263921 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f1003a030 con 0x5621cb8c6870 2024-09-13T19:17:14.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.282+0000 7f9f16281640 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8cab50 con 0x5621cb8c1e60 2024-09-13T19:17:14.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.282+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f00051070 con 0x5621cb8c1e60 2024-09-13T19:17:14.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.282+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8cab50 con 0x7f9f10036bb0 2024-09-13T19:17:14.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.283+0000 7f9f15a80640 1 -- 172.21.15.102:0/2089263921 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f08043050 con 0x7f9f10036bb0 2024-09-13T19:17:14.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.283+0000 7f9f15a80640 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8cab50 con 0x5621cb8c1e60 2024-09-13T19:17:14.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.283+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f00051070 con 0x5621cb8c1e60 2024-09-13T19:17:14.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.283+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8cab50 con 0x7f9f10036bb0 2024-09-13T19:17:14.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.283+0000 7f9f15a80640 1 -- 172.21.15.102:0/2089263921 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9f08043050 con 0x7f9f10036bb0 2024-09-13T19:17:14.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.283+0000 7f9f15a80640 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8cab50 con 0x5621cb8c6870 2024-09-13T19:17:14.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.283+0000 7f9f16281640 1 -- 172.21.15.102:0/2089263921 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f1003a030 con 0x5621cb8c6870 2024-09-13T19:17:14.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.283+0000 7f9f16281640 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8cab50 con 0x5621cb8c6870 2024-09-13T19:17:14.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.283+0000 7f9f16281640 1 -- 172.21.15.102:0/2089263921 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9f1003a030 con 0x5621cb8c6870 2024-09-13T19:17:14.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.283+0000 7f9f16281640 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8cab50 con 0x7f9f0802c060 2024-09-13T19:17:14.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.284+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f00051070 con 0x7f9f0802c060 2024-09-13T19:17:14.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.284+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8cab50 con 0x5621cb8c6870 2024-09-13T19:17:14.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.284+0000 7f9f16281640 1 -- 172.21.15.102:0/2089263921 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9f1003a030 con 0x5621cb8c6870 2024-09-13T19:17:14.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.284+0000 7f9f16281640 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8cab50 con 0x5621cb8c6870 2024-09-13T19:17:14.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.284+0000 7f9f16281640 1 -- 172.21.15.102:0/2089263921 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f1003a030 con 0x5621cb8c6870 2024-09-13T19:17:14.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.284+0000 7f9f16281640 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8cab50 con 0x5621cb8c1e60 2024-09-13T19:17:14.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.285+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f00051070 con 0x5621cb8c1e60 2024-09-13T19:17:14.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.285+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8cab50 con 0x5621cb8c1e60 2024-09-13T19:17:14.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.285+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9f00051070 con 0x5621cb8c1e60 2024-09-13T19:17:14.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.285+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8cab50 con 0x7f9f0802c060 2024-09-13T19:17:14.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.285+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f00051070 con 0x7f9f0802c060 2024-09-13T19:17:14.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.285+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8cab50 con 0x5621cb8c6870 2024-09-13T19:17:14.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.286+0000 7f9f16281640 1 -- 172.21.15.102:0/2089263921 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f1003a030 con 0x5621cb8c6870 2024-09-13T19:17:14.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.286+0000 7f9f16281640 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8cab50 con 0x7f9f10036bb0 2024-09-13T19:17:14.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.286+0000 7f9f15a80640 1 -- 172.21.15.102:0/2089263921 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f08043050 con 0x7f9f10036bb0 2024-09-13T19:17:14.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.286+0000 7f9f15a80640 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8cab50 con 0x5621cb8c1e60 2024-09-13T19:17:14.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.286+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f00051070 con 0x5621cb8c1e60 2024-09-13T19:17:14.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.286+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8cab50 con 0x7f9f10036bb0 2024-09-13T19:17:14.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.286+0000 7f9f15a80640 1 -- 172.21.15.102:0/2089263921 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f08043050 con 0x7f9f10036bb0 2024-09-13T19:17:14.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.286+0000 7f9f15a80640 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8cab50 con 0x5621cb8c6870 2024-09-13T19:17:14.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.286+0000 7f9f16281640 1 -- 172.21.15.102:0/2089263921 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f1003a030 con 0x5621cb8c6870 2024-09-13T19:17:14.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.287+0000 7f9f16281640 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8cab50 con 0x7f9f0802c060 2024-09-13T19:17:14.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.287+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f00051070 con 0x7f9f0802c060 2024-09-13T19:17:14.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.287+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8cab50 con 0x7f9f10036bb0 2024-09-13T19:17:14.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.287+0000 7f9f15a80640 1 -- 172.21.15.102:0/2089263921 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f08043050 con 0x7f9f10036bb0 2024-09-13T19:17:14.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.287+0000 7f9f15a80640 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8cab50 con 0x5621cb8c6870 2024-09-13T19:17:14.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.287+0000 7f9f16281640 1 -- 172.21.15.102:0/2089263921 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f1003a030 con 0x5621cb8c6870 2024-09-13T19:17:14.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.287+0000 7f9f16281640 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8cab50 con 0x7f9f0802c060 2024-09-13T19:17:14.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.288+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f00051070 con 0x7f9f0802c060 2024-09-13T19:17:14.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.288+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8cab50 con 0x5621cb8c1e60 2024-09-13T19:17:14.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.288+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9f00051070 con 0x5621cb8c1e60 2024-09-13T19:17:14.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.288+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f9f00084080 con 0x7f9f10036bb0 2024-09-13T19:17:14.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.288+0000 7f9f15a80640 1 -- 172.21.15.102:0/2089263921 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f08043050 con 0x7f9f10036bb0 2024-09-13T19:17:14.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.288+0000 7f9f19d32800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:17:14.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.288+0000 7f9f19d32800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:17:14.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.288+0000 7f9f19d32800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:17:14.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.288+0000 7f9f19d32800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:17:14.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.288+0000 7f9f19d32800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:17:14.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.288+0000 7f9f19d32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:17:14.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.288+0000 7f9f19d32800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.288+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8c9c50 con 0x5621cb8c1e60 2024-09-13T19:17:14.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.289+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9f00051070 con 0x5621cb8c1e60 2024-09-13T19:17:14.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.289+0000 7f9f19d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:14.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.289+0000 7f9f19d32800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.289+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8ca4f0 con 0x5621cb8c1e60 2024-09-13T19:17:14.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.289+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9f00051070 con 0x5621cb8c1e60 2024-09-13T19:17:14.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.289+0000 7f9f19d32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:17:14.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.289+0000 7f9f19d32800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.289+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8c9890 con 0x5621cb8c6870 2024-09-13T19:17:14.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.289+0000 7f9f16281640 1 -- 172.21.15.102:0/2089263921 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9f1003a030 con 0x5621cb8c6870 2024-09-13T19:17:14.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.289+0000 7f9f19d32800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:17:14.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.289+0000 7f9f19d32800 20 zone default found 2024-09-13T19:17:14.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.289+0000 7f9f19d32800 4 Realm: () 2024-09-13T19:17:14.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.289+0000 7f9f19d32800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:17:14.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.289+0000 7f9f19d32800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:17:14.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.289+0000 7f9f19d32800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:17:14.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.289+0000 7f9f19d32800 20 zonegroup default 2024-09-13T19:17:14.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.289+0000 7f9f19d32800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.289+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8cb4d0 con 0x7f9f10036bb0 2024-09-13T19:17:14.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.289+0000 7f9f15a80640 1 -- 172.21.15.102:0/2089263921 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9f08043050 con 0x7f9f10036bb0 2024-09-13T19:17:14.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.289+0000 7f9f19d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:14.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.289+0000 7f9f19d32800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.289+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8cb110 con 0x5621cb8c6870 2024-09-13T19:17:14.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.290+0000 7f9f16281640 1 -- 172.21.15.102:0/2089263921 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9f1003a030 con 0x5621cb8c6870 2024-09-13T19:17:14.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.290+0000 7f9f19d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:14.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.290+0000 7f9f19d32800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.290+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8cd7a0 con 0x5621cb8c6870 2024-09-13T19:17:14.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.290+0000 7f9f16281640 1 -- 172.21.15.102:0/2089263921 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9f1003a030 con 0x5621cb8c6870 2024-09-13T19:17:14.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.290+0000 7f9f19d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:14.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.290+0000 7f9f19d32800 20 started sync module instance, tier type = 2024-09-13T19:17:14.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.290+0000 7f9f19d32800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:17:14.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.290+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8ccb90 con 0x7f9f10036bb0 2024-09-13T19:17:14.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.291+0000 7f9f15a80640 1 -- 172.21.15.102:0/2089263921 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(44 notify.0 [create] v36'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f08043050 con 0x7f9f10036bb0 2024-09-13T19:17:14.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.291+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94703148912512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8ce090 con 0x7f9f10036bb0 2024-09-13T19:17:14.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.291+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8ce8e0 con 0x5621cb8c1e60 2024-09-13T19:17:14.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.292+0000 7f9f15a80640 1 -- 172.21.15.102:0/2089263921 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94703148912512] v36'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f08043050 con 0x7f9f10036bb0 2024-09-13T19:17:14.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.292+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v36'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f00051070 con 0x5621cb8c1e60 2024-09-13T19:17:14.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.292+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94703148915952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8ce660 con 0x5621cb8c1e60 2024-09-13T19:17:14.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.292+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8cf150 con 0x5621cb8c6870 2024-09-13T19:17:14.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.293+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94703148915952] v36'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f00051070 con 0x5621cb8c1e60 2024-09-13T19:17:14.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.294+0000 7f9f16281640 1 -- 172.21.15.102:0/2089263921 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v36'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f1003a030 con 0x5621cb8c6870 2024-09-13T19:17:14.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.294+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94703148919840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8cf110 con 0x5621cb8c6870 2024-09-13T19:17:14.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.294+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8cfbc0 con 0x7f9f10036bb0 2024-09-13T19:17:14.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.295+0000 7f9f15a80640 1 -- 172.21.15.102:0/2089263921 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(50 notify.3 [create] v36'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f08043050 con 0x7f9f10036bb0 2024-09-13T19:17:14.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.295+0000 7f9f16281640 1 -- 172.21.15.102:0/2089263921 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94703148919840] v36'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f1003a030 con 0x5621cb8c6870 2024-09-13T19:17:14.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.295+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94703148922576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8d00c0 con 0x7f9f10036bb0 2024-09-13T19:17:14.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.295+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8ce150 con 0x5621cb8c1e60 2024-09-13T19:17:14.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.296+0000 7f9f15a80640 1 -- 172.21.15.102:0/2089263921 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94703148922576] v36'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f08043050 con 0x7f9f10036bb0 2024-09-13T19:17:14.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.296+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v36'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f00051070 con 0x5621cb8c1e60 2024-09-13T19:17:14.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.296+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94703148923696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8ce150 con 0x5621cb8c1e60 2024-09-13T19:17:14.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.296+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8d1180 con 0x7f9f0802c060 2024-09-13T19:17:14.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.297+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(54 notify.5 [create] v36'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f00051070 con 0x7f9f0802c060 2024-09-13T19:17:14.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.297+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94703148928208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8d1150 con 0x7f9f0802c060 2024-09-13T19:17:14.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.297+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8d2170 con 0x7f9f0802c060 2024-09-13T19:17:14.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.297+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94703148923696] v36'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f00051070 con 0x5621cb8c1e60 2024-09-13T19:17:14.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.298+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94703148928208] v36'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f00051070 con 0x7f9f0802c060 2024-09-13T19:17:14.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.298+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(56 notify.6 [create] v36'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f00051070 con 0x7f9f0802c060 2024-09-13T19:17:14.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.298+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94703148930416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8d06b0 con 0x7f9f0802c060 2024-09-13T19:17:14.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.298+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8d25e0 con 0x7f9f0802c060 2024-09-13T19:17:14.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.299+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(58 notify.7 [create] v36'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f00051070 con 0x7f9f0802c060 2024-09-13T19:17:14.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.299+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94703148933424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8d2550 con 0x7f9f0802c060 2024-09-13T19:17:14.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.299+0000 7f9f19d32800 20 add_watcher() i=0 2024-09-13T19:17:14.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.299+0000 7f9f19d32800 20 add_watcher() i=1 2024-09-13T19:17:14.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.299+0000 7f9f19d32800 20 add_watcher() i=2 2024-09-13T19:17:14.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.299+0000 7f9f19d32800 20 add_watcher() i=3 2024-09-13T19:17:14.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.299+0000 7f9f19d32800 20 add_watcher() i=4 2024-09-13T19:17:14.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.299+0000 7f9f19d32800 20 add_watcher() i=5 2024-09-13T19:17:14.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.299+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94703148930416] v36'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f00051070 con 0x7f9f0802c060 2024-09-13T19:17:14.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.299+0000 7f9f19d32800 20 add_watcher() i=6 2024-09-13T19:17:14.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.300+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94703148933424] v36'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f00051070 con 0x7f9f0802c060 2024-09-13T19:17:14.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.300+0000 7f9f19d32800 20 add_watcher() i=7 2024-09-13T19:17:14.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.300+0000 7f9f19d32800 2 all 8 watchers are set, enabling cache 2024-09-13T19:17:14.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.300+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8d1c40 con 0x5621cb8c1e60 2024-09-13T19:17:14.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.301+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9f00051070 con 0x5621cb8c1e60 2024-09-13T19:17:14.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.301+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94703148935456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8d1c40 con 0x5621cb8c1e60 2024-09-13T19:17:14.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.302+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94703148935456] v36'200 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9f00051070 con 0x5621cb8c1e60 2024-09-13T19:17:14.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.302+0000 7f9dc77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:17:14.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.302+0000 7f9f19d32800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:17:14.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.302+0000 7f9f19d32800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:17:14.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.302+0000 7f9f19d32800 5 note: GC not initialized 2024-09-13T19:17:14.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.302+0000 7f9dc67fc640 20 reqs_thread_entry: start 2024-09-13T19:17:14.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.302+0000 7f9f19d32800 20 init_complete bucket index max shards: 11 2024-09-13T19:17:14.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.302+0000 7f9f19d32800 20 Filter name: none 2024-09-13T19:17:14.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.303+0000 7f9d37fff640 20 reqs_thread_entry: start 2024-09-13T19:17:14.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.303+0000 7f9f19d32800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.303+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5621cb908930 con 0x5621cb8c1e60 2024-09-13T19:17:14.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.303+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f9f00051070 con 0x5621cb8c1e60 2024-09-13T19:17:14.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.303+0000 7f9f19d32800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:17:14.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.303+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5621cb909e80 con 0x7f9f0802c060 2024-09-13T19:17:14.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.304+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f9f00051070 con 0x7f9f0802c060 2024-09-13T19:17:14.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.304+0000 7f9dc77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:17:14.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.304+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94703148935456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8bf410 con 0x5621cb8c1e60 2024-09-13T19:17:14.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.305+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94703148935456] v36'201 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9f00051070 con 0x5621cb8c1e60 2024-09-13T19:17:14.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.305+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94703148912512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8d2920 con 0x7f9f10036bb0 2024-09-13T19:17:14.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.306+0000 7f9f15a80640 1 -- 172.21.15.102:0/2089263921 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94703148912512] v36'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f08043050 con 0x7f9f10036bb0 2024-09-13T19:17:14.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.306+0000 7f9f19d32800 20 remove_watcher() i=0 2024-09-13T19:17:14.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.306+0000 7f9f19d32800 2 removed watcher, disabling cache 2024-09-13T19:17:14.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.306+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94703148915952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8ccf80 con 0x5621cb8c1e60 2024-09-13T19:17:14.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.307+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94703148915952] v36'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f00051070 con 0x5621cb8c1e60 2024-09-13T19:17:14.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.308+0000 7f9f19d32800 20 remove_watcher() i=1 2024-09-13T19:17:14.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.308+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94703148919840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8ccf80 con 0x5621cb8c6870 2024-09-13T19:17:14.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.309+0000 7f9f16281640 1 -- 172.21.15.102:0/2089263921 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94703148919840] v36'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f1003a030 con 0x5621cb8c6870 2024-09-13T19:17:14.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.309+0000 7f9f19d32800 20 remove_watcher() i=2 2024-09-13T19:17:14.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.309+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94703148922576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8cec20 con 0x7f9f10036bb0 2024-09-13T19:17:14.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.310+0000 7f9f15a80640 1 -- 172.21.15.102:0/2089263921 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94703148922576] v36'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f08043050 con 0x7f9f10036bb0 2024-09-13T19:17:14.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.310+0000 7f9f19d32800 20 remove_watcher() i=3 2024-09-13T19:17:14.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.310+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94703148923696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8ccf80 con 0x5621cb8c1e60 2024-09-13T19:17:14.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.311+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94703148923696] v36'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f00051070 con 0x5621cb8c1e60 2024-09-13T19:17:14.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.311+0000 7f9f19d32800 20 remove_watcher() i=4 2024-09-13T19:17:14.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.311+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94703148928208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8cec20 con 0x7f9f0802c060 2024-09-13T19:17:14.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.312+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94703148928208] v36'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f00051070 con 0x7f9f0802c060 2024-09-13T19:17:14.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.312+0000 7f9f19d32800 20 remove_watcher() i=5 2024-09-13T19:17:14.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.312+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94703148930416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8ccf80 con 0x7f9f0802c060 2024-09-13T19:17:14.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.313+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94703148930416] v36'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f00051070 con 0x7f9f0802c060 2024-09-13T19:17:14.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.313+0000 7f9f19d32800 20 remove_watcher() i=6 2024-09-13T19:17:14.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.313+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94703148933424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5621cb8ccf80 con 0x7f9f0802c060 2024-09-13T19:17:14.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.315+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94703148933424] v36'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f00051070 con 0x7f9f0802c060 2024-09-13T19:17:14.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.315+0000 7f9f19d32800 20 remove_watcher() i=7 2024-09-13T19:17:14.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.315+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f9f0802c060 msgr2=0x7f9f0802a580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.315+0000 7f9f19d32800 1 --2- 172.21.15.102:0/2089263921 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f9f0802c060 0x7f9f0802a580 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.315+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5621cb8c1e60 msgr2=0x5621cb8c4320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.315+0000 7f9f19d32800 1 --2- 172.21.15.102:0/2089263921 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5621cb8c1e60 0x5621cb8c4320 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.315+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f9f10036bb0 msgr2=0x7f9f1003f7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.315+0000 7f9f19d32800 1 --2- 172.21.15.102:0/2089263921 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f9f10036bb0 0x7f9f1003f7d0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.315+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5621cb8c6870 msgr2=0x5621cb8c8c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.315+0000 7f9f19d32800 1 --2- 172.21.15.102:0/2089263921 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5621cb8c6870 0x5621cb8c8c60 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.315+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9de0036af0 msgr2=0x7f9de0038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.315+0000 7f9f19d32800 1 --2- 172.21.15.102:0/2089263921 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9de0036af0 0x7f9de0038fb0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9f08016fd0 tx=0x7f9f08037000 comp rx=0 tx=0).stop 2024-09-13T19:17:14.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.315+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621cb8aef70 msgr2=0x5621cb8b63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.315+0000 7f9f0ffff640 1 -- 172.21.15.102:0/2089263921 reap_dead start 2024-09-13T19:17:14.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.315+0000 7f9f19d32800 1 --2- 172.21.15.102:0/2089263921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621cb8aef70 0x5621cb8b63a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f9f1001ff70 tx=0x7f9f1004cd40 comp rx=0 tx=0).stop 2024-09-13T19:17:14.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.315+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 shutdown_connections 2024-09-13T19:17:14.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.315+0000 7f9f19d32800 1 --2- 172.21.15.102:0/2089263921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621cb8aef70 0x5621cb8b63a0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.315+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 >> 172.21.15.102:0/2089263921 conn(0x5621cb8ab2d0 msgr2=0x5621cb8a93a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:14.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.315+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 shutdown_connections 2024-09-13T19:17:14.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.315+0000 7f9f19d32800 1 -- 172.21.15.102:0/2089263921 wait complete. 2024-09-13T19:17:14.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.315+0000 7f9f19d32800 1 -- 172.21.15.102:0/1807274302 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9df0036b40 msgr2=0x7f9df0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.315+0000 7f9f19d32800 1 --2- 172.21.15.102:0/1807274302 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9df0036b40 0x7f9df0039000 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x5621cb8886f0 tx=0x7f9f0804ad80 comp rx=0 tx=0).stop 2024-09-13T19:17:14.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.315+0000 7f9f19d32800 1 -- 172.21.15.102:0/1807274302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621cb702660 msgr2=0x5621cb8a50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.315+0000 7f9f19d32800 1 --2- 172.21.15.102:0/1807274302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621cb702660 0x5621cb8a50b0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x5621cb88bbb0 tx=0x7f9f100167b0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.315+0000 7f9f19d32800 1 -- 172.21.15.102:0/1807274302 shutdown_connections 2024-09-13T19:17:14.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.315+0000 7f9f19d32800 1 --2- 172.21.15.102:0/1807274302 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9df0036b40 0x7f9df0039000 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.315+0000 7f9f19d32800 1 --2- 172.21.15.102:0/1807274302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621cb702660 0x5621cb8a50b0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.315+0000 7f9f19d32800 1 -- 172.21.15.102:0/1807274302 >> 172.21.15.102:0/1807274302 conn(0x5621cb893e90 msgr2=0x5621cb896a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:14.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.316+0000 7f9f19d32800 1 -- 172.21.15.102:0/1807274302 shutdown_connections 2024-09-13T19:17:14.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.316+0000 7f9f19d32800 1 -- 172.21.15.102:0/1807274302 wait complete. 2024-09-13T19:17:14.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.316+0000 7f9f19d32800 1 -- 172.21.15.102:0/1079641088 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5621cb791990 msgr2=0x5621cb88b200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.316+0000 7f9f19d32800 1 --2- 172.21.15.102:0/1079641088 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5621cb791990 0x5621cb88b200 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.316+0000 7f9f19d32800 1 -- 172.21.15.102:0/1079641088 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5621cb88dae0 msgr2=0x5621cb88fed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.316+0000 7f9f19d32800 1 --2- 172.21.15.102:0/1079641088 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5621cb88dae0 0x5621cb88fed0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.316+0000 7f9f19d32800 1 -- 172.21.15.102:0/1079641088 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9dfc036b40 msgr2=0x7f9dfc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.316+0000 7f9f19d32800 1 --2- 172.21.15.102:0/1079641088 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9dfc036b40 0x7f9dfc039000 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9f00057000 tx=0x7f9f00052000 comp rx=0 tx=0).stop 2024-09-13T19:17:14.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.316+0000 7f9f19d32800 1 -- 172.21.15.102:0/1079641088 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621cb78d550 msgr2=0x5621cb884190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.316+0000 7f9f19d32800 1 --2- 172.21.15.102:0/1079641088 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621cb78d550 0x5621cb884190 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f9f08004000 tx=0x7f9f08000bc0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.316+0000 7f9f19d32800 1 -- 172.21.15.102:0/1079641088 shutdown_connections 2024-09-13T19:17:14.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.316+0000 7f9f19d32800 1 --2- 172.21.15.102:0/1079641088 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5621cb88dae0 0x5621cb88fed0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.316+0000 7f9f19d32800 1 --2- 172.21.15.102:0/1079641088 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5621cb791990 0x5621cb88b200 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.316+0000 7f9f19d32800 1 --2- 172.21.15.102:0/1079641088 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9dfc036b40 0x7f9dfc039000 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.316+0000 7f9f19d32800 1 --2- 172.21.15.102:0/1079641088 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621cb78d550 0x5621cb884190 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.316+0000 7f9f19d32800 1 -- 172.21.15.102:0/1079641088 >> 172.21.15.102:0/1079641088 conn(0x5621cb788de0 msgr2=0x5621cb8769d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:14.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.316+0000 7f9f19d32800 1 -- 172.21.15.102:0/1079641088 shutdown_connections 2024-09-13T19:17:14.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.316+0000 7f9f19d32800 1 -- 172.21.15.102:0/1079641088 wait complete. 2024-09-13T19:17:14.332 INFO:teuthology.orchestra.run.smithi102.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-09-13T19:17:14.332 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-09-13T19:17:14.333 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-13T19:17:14.333 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-13T19:17:14.333 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2024-09-13T19:17:14.380 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:17:14.380 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:17:14.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.377+0000 7f716ff3a800 1 Processor -- start 2024-09-13T19:17:14.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.377+0000 7f716ff3a800 1 -- start start 2024-09-13T19:17:14.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.377+0000 7f716ff3a800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56218b47a710 0x56218b47ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.378+0000 7f716ff3a800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56218b339b30 con 0x56218b47b050 2024-09-13T19:17:14.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.378+0000 7f716ff3a800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x56218b31b360 con 0x56218b47a710 2024-09-13T19:17:14.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.378+0000 7f716bc8b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56218b47a710 0x56218b47ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.378+0000 7f716bc8b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56218b47a710 0x56218b47ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41140/0 (socket says 172.21.15.102:41140) 2024-09-13T19:17:14.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.378+0000 7f716bc8b640 1 -- 172.21.15.102:0/3811636451 learned_addr learned my addr 172.21.15.102:0/3811636451 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:14.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.378+0000 7f716b48a640 1 --1- 172.21.15.102:0/3811636451 >> v1:172.21.15.53:6789/0 conn(0x56218b47b050 0x56218b47fa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:50024/0 (socket says 172.21.15.102:50024) 2024-09-13T19:17:14.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.378+0000 7f716bc8b640 1 -- 172.21.15.102:0/3811636451 >> v1:172.21.15.53:6789/0 conn(0x56218b47b050 legacy=0x56218b47fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.378+0000 7f716bc8b640 1 -- 172.21.15.102:0/3811636451 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56218b341e00 con 0x56218b47a710 2024-09-13T19:17:14.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.380+0000 7f716bc8b640 1 --2- 172.21.15.102:0/3811636451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56218b47a710 0x56218b47ab10 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f715c00a520 tx=0x7f715c045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ecd8920b496fecb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.380+0000 7f716ac89640 1 -- 172.21.15.102:0/3811636451 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f715c055070 con 0x56218b47a710 2024-09-13T19:17:14.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.380+0000 7f716ac89640 1 -- 172.21.15.102:0/3811636451 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f715c0515b0 con 0x56218b47a710 2024-09-13T19:17:14.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.380+0000 7f716ac89640 1 -- 172.21.15.102:0/3811636451 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f715c0518d0 con 0x56218b47a710 2024-09-13T19:17:14.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.381+0000 7f716ff3a800 1 -- 172.21.15.102:0/3811636451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56218b47a710 msgr2=0x56218b47ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.381+0000 7f716ff3a800 1 --2- 172.21.15.102:0/3811636451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56218b47a710 0x56218b47ab10 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f715c00a520 tx=0x7f715c045ba0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.381+0000 7f716ff3a800 1 -- 172.21.15.102:0/3811636451 shutdown_connections 2024-09-13T19:17:14.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.381+0000 7f716ff3a800 1 --2- 172.21.15.102:0/3811636451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56218b47a710 0x56218b47ab10 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.381+0000 7f716ff3a800 1 -- 172.21.15.102:0/3811636451 >> 172.21.15.102:0/3811636451 conn(0x56218b475fe0 msgr2=0x56218b478400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:14.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.381+0000 7f716ff3a800 1 -- 172.21.15.102:0/3811636451 shutdown_connections 2024-09-13T19:17:14.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.381+0000 7f716ff3a800 1 -- 172.21.15.102:0/3811636451 wait complete. 2024-09-13T19:17:14.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.395+0000 7f716ff3a800 1 Processor -- start 2024-09-13T19:17:14.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.395+0000 7f716ff3a800 1 -- start start 2024-09-13T19:17:14.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.395+0000 7f716ff3a800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56218b47a710 0x56218b3f06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.395+0000 7f716ff3a800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56218b3c6360 con 0x56218b47a710 2024-09-13T19:17:14.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.396+0000 7f716bc8b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56218b47a710 0x56218b3f06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.396+0000 7f716bc8b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56218b47a710 0x56218b3f06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41148/0 (socket says 172.21.15.102:41148) 2024-09-13T19:17:14.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.396+0000 7f716bc8b640 1 -- 172.21.15.102:0/722691465 learned_addr learned my addr 172.21.15.102:0/722691465 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:14.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.396+0000 7f716bc8b640 1 -- 172.21.15.102:0/722691465 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56218b313bc0 con 0x56218b47a710 2024-09-13T19:17:14.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.396+0000 7f716bc8b640 1 --2- 172.21.15.102:0/722691465 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56218b47a710 0x56218b3f06e0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f715c025da0 tx=0x7f715c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2347a83addcd37e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.396+0000 7f7059e0b640 1 -- 172.21.15.102:0/722691465 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f715c051950 con 0x56218b47a710 2024-09-13T19:17:14.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.396+0000 7f7059e0b640 1 -- 172.21.15.102:0/722691465 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f715c051af0 con 0x56218b47a710 2024-09-13T19:17:14.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.396+0000 7f7059e0b640 1 -- 172.21.15.102:0/722691465 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f715c051dd0 con 0x56218b47a710 2024-09-13T19:17:14.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.397+0000 7f716ff3a800 1 -- 172.21.15.102:0/722691465 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56218b47a710 msgr2=0x56218b3f06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.397+0000 7f716ff3a800 1 --2- 172.21.15.102:0/722691465 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56218b47a710 0x56218b3f06e0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f715c025da0 tx=0x7f715c051000 comp rx=0 tx=0).stop 2024-09-13T19:17:14.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.397+0000 7f716ff3a800 1 -- 172.21.15.102:0/722691465 shutdown_connections 2024-09-13T19:17:14.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.397+0000 7f716ff3a800 1 --2- 172.21.15.102:0/722691465 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56218b47a710 0x56218b3f06e0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.397+0000 7f716ff3a800 1 -- 172.21.15.102:0/722691465 >> 172.21.15.102:0/722691465 conn(0x56218b475fe0 msgr2=0x56218b5652b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:14.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.397+0000 7f716ff3a800 1 -- 172.21.15.102:0/722691465 shutdown_connections 2024-09-13T19:17:14.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.397+0000 7f716ff3a800 1 -- 172.21.15.102:0/722691465 wait complete. 2024-09-13T19:17:14.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.397+0000 7f716ff3a800 1 Processor -- start 2024-09-13T19:17:14.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.398+0000 7f716ff3a800 1 -- start start 2024-09-13T19:17:14.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.398+0000 7f716ff3a800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56218b47a710 0x56218b573310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.398+0000 7f716ff3a800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56218b4815f0 con 0x56218b47a710 2024-09-13T19:17:14.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.398+0000 7f716bc8b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56218b47a710 0x56218b573310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.398+0000 7f716bc8b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56218b47a710 0x56218b573310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41154/0 (socket says 172.21.15.102:41154) 2024-09-13T19:17:14.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.398+0000 7f716bc8b640 1 -- 172.21.15.102:0/3533828659 learned_addr learned my addr 172.21.15.102:0/3533828659 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:14.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.398+0000 7f716bc8b640 1 -- 172.21.15.102:0/3533828659 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56218b327fe0 con 0x56218b47a710 2024-09-13T19:17:14.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.399+0000 7f716bc8b640 1 --2- 172.21.15.102:0/3533828659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56218b47a710 0x56218b573310 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f715c067040 tx=0x7f715c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.399+0000 7f7053fff640 1 -- 172.21.15.102:0/3533828659 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f715c073070 con 0x56218b47a710 2024-09-13T19:17:14.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.399+0000 7f7053fff640 1 -- 172.21.15.102:0/3533828659 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f715c05a450 con 0x56218b47a710 2024-09-13T19:17:14.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.399+0000 7f716ff3a800 1 -- 172.21.15.102:0/3533828659 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56218b573850 con 0x56218b47a710 2024-09-13T19:17:14.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.399+0000 7f7053fff640 1 -- 172.21.15.102:0/3533828659 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f715c05a730 con 0x56218b47a710 2024-09-13T19:17:14.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.399+0000 7f716ff3a800 1 -- 172.21.15.102:0/3533828659 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56218b573dd0 con 0x56218b47a710 2024-09-13T19:17:14.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.400+0000 7f7053fff640 1 -- 172.21.15.102:0/3533828659 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f715c076070 con 0x56218b47a710 2024-09-13T19:17:14.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.400+0000 7f7053fff640 1 --2- 172.21.15.102:0/3533828659 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7054036b40 0x7f7054039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.400+0000 7f7053fff640 1 -- 172.21.15.102:0/3533828659 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f715c062070 con 0x56218b47a710 2024-09-13T19:17:14.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.400+0000 7f716b48a640 1 --2- 172.21.15.102:0/3533828659 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7054036b40 0x7f7054039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.400+0000 7f716ff3a800 1 --2- 172.21.15.102:0/3533828659 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56218b47b050 0x56218b57a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.400+0000 7f716ff3a800 1 -- 172.21.15.102:0/3533828659 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56218b57a900 con 0x56218b47b050 2024-09-13T19:17:14.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.400+0000 7f716c48c640 1 --2- 172.21.15.102:0/3533828659 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56218b47b050 0x56218b57a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.400+0000 7f716b48a640 1 --2- 172.21.15.102:0/3533828659 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7054036b40 0x7f7054039000 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7160000f60 tx=0x7f7160001370 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.400+0000 7f716c48c640 1 --2- 172.21.15.102:0/3533828659 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56218b47b050 0x56218b57a380 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.401+0000 7f716c48c640 1 -- 172.21.15.102:0/3533828659 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f716400a4a0 con 0x56218b47b050 2024-09-13T19:17:14.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.401+0000 7f716ff3a800 1 -- 172.21.15.102:0/3533828659 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56218b577950 con 0x56218b47b050 2024-09-13T19:17:14.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.401+0000 7f716c48c640 1 -- 172.21.15.102:0/3533828659 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f716400a4a0 con 0x56218b47b050 2024-09-13T19:17:14.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.401+0000 7f716ff3a800 1 --2- 172.21.15.102:0/3533828659 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56218b57cc30 0x56218b57f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.401+0000 7f716ff3a800 1 -- 172.21.15.102:0/3533828659 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56218b57f6c0 con 0x56218b57cc30 2024-09-13T19:17:14.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.401+0000 7f716bc8b640 1 --2- 172.21.15.102:0/3533828659 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56218b57cc30 0x56218b57f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.401+0000 7f716bc8b640 1 --2- 172.21.15.102:0/3533828659 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56218b57cc30 0x56218b57f020 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.402+0000 7f716bc8b640 1 -- 172.21.15.102:0/3533828659 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f715c07f070 con 0x56218b57cc30 2024-09-13T19:17:14.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.402+0000 7f716ff3a800 1 -- 172.21.15.102:0/3533828659 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56218b57bad0 con 0x56218b47b050 2024-09-13T19:17:14.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.402+0000 7f716c48c640 1 -- 172.21.15.102:0/3533828659 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f716400a4a0 con 0x56218b47b050 2024-09-13T19:17:14.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.402+0000 7f716ff3a800 1 -- 172.21.15.102:0/3533828659 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56218b57bfb0 con 0x56218b57cc30 2024-09-13T19:17:14.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.402+0000 7f716bc8b640 1 -- 172.21.15.102:0/3533828659 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f715c07f070 con 0x56218b57cc30 2024-09-13T19:17:14.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.402+0000 7f716ff3a800 1 Processor -- start 2024-09-13T19:17:14.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.403+0000 7f716ff3a800 1 -- start start 2024-09-13T19:17:14.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.403+0000 7f716ff3a800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56218b58e050 0x56218b58e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.403+0000 7f716ff3a800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56218b315580 con 0x56218b58e050 2024-09-13T19:17:14.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.403+0000 7f716c48c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56218b58e050 0x56218b58e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.403+0000 7f716c48c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56218b58e050 0x56218b58e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41160/0 (socket says 172.21.15.102:41160) 2024-09-13T19:17:14.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.403+0000 7f716c48c640 1 -- 172.21.15.102:0/807565631 learned_addr learned my addr 172.21.15.102:0/807565631 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:14.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.403+0000 7f716c48c640 1 -- 172.21.15.102:0/807565631 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56218b58e9b0 con 0x56218b58e050 2024-09-13T19:17:14.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.403+0000 7f716c48c640 1 --2- 172.21.15.102:0/807565631 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56218b58e050 0x56218b58e470 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x56218b5743c0 tx=0x7f71640167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.404+0000 7f70517fa640 1 -- 172.21.15.102:0/807565631 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7164013640 con 0x56218b58e050 2024-09-13T19:17:14.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.404+0000 7f70517fa640 1 -- 172.21.15.102:0/807565631 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71640137e0 con 0x56218b58e050 2024-09-13T19:17:14.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.404+0000 7f70517fa640 1 -- 172.21.15.102:0/807565631 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7164013ae0 con 0x56218b58e050 2024-09-13T19:17:14.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.404+0000 7f716ff3a800 1 -- 172.21.15.102:0/807565631 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56218b58ec40 con 0x56218b58e050 2024-09-13T19:17:14.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.404+0000 7f716ff3a800 1 -- 172.21.15.102:0/807565631 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56218b591920 con 0x56218b58e050 2024-09-13T19:17:14.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.405+0000 7f70517fa640 1 -- 172.21.15.102:0/807565631 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7164011040 con 0x56218b58e050 2024-09-13T19:17:14.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.405+0000 7f70517fa640 1 --2- 172.21.15.102:0/807565631 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7044036b90 0x7f7044039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.405+0000 7f70517fa640 1 -- 172.21.15.102:0/807565631 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f716400e040 con 0x56218b58e050 2024-09-13T19:17:14.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.405+0000 7f716bc8b640 1 --2- 172.21.15.102:0/807565631 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7044036b90 0x7f7044039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.405+0000 7f716ff3a800 1 Processor -- start 2024-09-13T19:17:14.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.405+0000 7f716ff3a800 1 -- start start 2024-09-13T19:17:14.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.405+0000 7f716bc8b640 1 --2- 172.21.15.102:0/807565631 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7044036b90 0x7f7044039050 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x56218b577870 tx=0x7f715c08f220 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.405+0000 7f716ff3a800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56218b59ad10 0x56218b59b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.405+0000 7f716ff3a800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56218b3eecc0 con 0x56218b59ad10 2024-09-13T19:17:14.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.406+0000 7f716c48c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56218b59ad10 0x56218b59b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.406+0000 7f716c48c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56218b59ad10 0x56218b59b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41162/0 (socket says 172.21.15.102:41162) 2024-09-13T19:17:14.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.406+0000 7f716c48c640 1 -- 172.21.15.102:0/2779229681 learned_addr learned my addr 172.21.15.102:0/2779229681 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:14.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.406+0000 7f716c48c640 1 -- 172.21.15.102:0/2779229681 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56218b59b6e0 con 0x56218b59ad10 2024-09-13T19:17:14.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.406+0000 7f716c48c640 1 --2- 172.21.15.102:0/2779229681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56218b59ad10 0x56218b59b110 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f716400afb0 tx=0x7f716401fcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb33519ebf9d76b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.406+0000 7f704affd640 1 -- 172.21.15.102:0/2779229681 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7164021570 con 0x56218b59ad10 2024-09-13T19:17:14.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.406+0000 7f704affd640 1 -- 172.21.15.102:0/2779229681 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f716401f340 con 0x56218b59ad10 2024-09-13T19:17:14.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.406+0000 7f704affd640 1 -- 172.21.15.102:0/2779229681 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7164014cc0 con 0x56218b59ad10 2024-09-13T19:17:14.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.407+0000 7f716ff3a800 1 -- 172.21.15.102:0/2779229681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56218b59ad10 msgr2=0x56218b59b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.407+0000 7f716ff3a800 1 --2- 172.21.15.102:0/2779229681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56218b59ad10 0x56218b59b110 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f716400afb0 tx=0x7f716401fcc0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.407+0000 7f716ff3a800 1 -- 172.21.15.102:0/2779229681 shutdown_connections 2024-09-13T19:17:14.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.407+0000 7f716ff3a800 1 --2- 172.21.15.102:0/2779229681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56218b59ad10 0x56218b59b110 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.407+0000 7f716ff3a800 1 -- 172.21.15.102:0/2779229681 >> 172.21.15.102:0/2779229681 conn(0x56218b597070 msgr2=0x56218b595170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:14.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.407+0000 7f716ff3a800 1 -- 172.21.15.102:0/2779229681 shutdown_connections 2024-09-13T19:17:14.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.407+0000 7f716ff3a800 1 -- 172.21.15.102:0/2779229681 wait complete. 2024-09-13T19:17:14.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.407+0000 7f716ff3a800 1 Processor -- start 2024-09-13T19:17:14.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.407+0000 7f716ff3a800 1 -- start start 2024-09-13T19:17:14.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.407+0000 7f716ff3a800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56218b59ad10 0x56218b5a2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.407+0000 7f716ff3a800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56218b59bd50 con 0x56218b59ad10 2024-09-13T19:17:14.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.408+0000 7f716c48c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56218b59ad10 0x56218b5a2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.408+0000 7f716c48c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56218b59ad10 0x56218b5a2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41168/0 (socket says 172.21.15.102:41168) 2024-09-13T19:17:14.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.408+0000 7f716c48c640 1 -- 172.21.15.102:0/2217003031 learned_addr learned my addr 172.21.15.102:0/2217003031 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:14.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.408+0000 7f716c48c640 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56218b5a26c0 con 0x56218b59ad10 2024-09-13T19:17:14.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.408+0000 7f716c48c640 1 --2- 172.21.15.102:0/2217003031 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56218b59ad10 0x56218b5a2180 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f7164048010 tx=0x7f716404cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.408+0000 7f70497fa640 1 -- 172.21.15.102:0/2217003031 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7164013e60 con 0x56218b59ad10 2024-09-13T19:17:14.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.408+0000 7f70497fa640 1 -- 172.21.15.102:0/2217003031 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7164040360 con 0x56218b59ad10 2024-09-13T19:17:14.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.408+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56218b5a2950 con 0x56218b59ad10 2024-09-13T19:17:14.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.408+0000 7f70497fa640 1 -- 172.21.15.102:0/2217003031 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71640205b0 con 0x56218b59ad10 2024-09-13T19:17:14.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.408+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56218b5a2950 con 0x56218b59ad10 2024-09-13T19:17:14.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.409+0000 7f70497fa640 1 -- 172.21.15.102:0/2217003031 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7164020770 con 0x56218b59ad10 2024-09-13T19:17:14.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.409+0000 7f70497fa640 1 --2- 172.21.15.102:0/2217003031 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7034036b40 0x7f7034039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.409+0000 7f70497fa640 1 -- 172.21.15.102:0/2217003031 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f7164036180 con 0x56218b59ad10 2024-09-13T19:17:14.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.409+0000 7f716bc8b640 1 --2- 172.21.15.102:0/2217003031 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7034036b40 0x7f7034039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.409+0000 7f716ff3a800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.409+0000 7f716ff3a800 1 --2- 172.21.15.102:0/2217003031 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56218b5ad9f0 0x56218b5afeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.409+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56218b5b0600 con 0x56218b5ad9f0 2024-09-13T19:17:14.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.410+0000 7f716b48a640 1 --2- 172.21.15.102:0/2217003031 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56218b5ad9f0 0x56218b5afeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.410+0000 7f716bc8b640 1 --2- 172.21.15.102:0/2217003031 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7034036b40 0x7f7034039000 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f715c051840 tx=0x7f715c093000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.410+0000 7f716b48a640 1 --2- 172.21.15.102:0/2217003031 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56218b5ad9f0 0x56218b5afeb0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.410+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f716000f610 con 0x56218b5ad9f0 2024-09-13T19:17:14.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.410+0000 7f716ff3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:14.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.410+0000 7f716ff3a800 20 realm 2024-09-13T19:17:14.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.410+0000 7f716ff3a800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.410+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56218b5ace40 con 0x56218b5ad9f0 2024-09-13T19:17:14.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.410+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f716000f610 con 0x56218b5ad9f0 2024-09-13T19:17:14.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.410+0000 7f716ff3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:14.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.410+0000 7f716ff3a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:17:14.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.410+0000 7f716ff3a800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.410+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56218b5b10e0 con 0x56218b5ad9f0 2024-09-13T19:17:14.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.411+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f716000f610 con 0x56218b5ad9f0 2024-09-13T19:17:14.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.411+0000 7f716ff3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:14.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.411+0000 7f716ff3a800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.411+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56218b5b19b0 con 0x56218b5ad9f0 2024-09-13T19:17:14.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.411+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f716000f610 con 0x56218b5ad9f0 2024-09-13T19:17:14.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.411+0000 7f716ff3a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:17:14.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.411+0000 7f716ff3a800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.411+0000 7f716ff3a800 1 --2- 172.21.15.102:0/2217003031 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56218b5b2260 0x56218b5b4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.411+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56218b5b4dd0 con 0x56218b5b2260 2024-09-13T19:17:14.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.411+0000 7f716c48c640 1 --2- 172.21.15.102:0/2217003031 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56218b5b2260 0x56218b5b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.411+0000 7f716c48c640 1 --2- 172.21.15.102:0/2217003031 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56218b5b2260 0x56218b5b4670 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.412+0000 7f716c48c640 1 -- 172.21.15.102:0/2217003031 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f716400a4a0 con 0x56218b5b2260 2024-09-13T19:17:14.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.412+0000 7f716ff3a800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:17:14.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.412+0000 7f716ff3a800 20 searching for the correct realm 2024-09-13T19:17:14.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.412+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56218b5b6800 con 0x56218b5b2260 2024-09-13T19:17:14.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.412+0000 7f716c48c640 1 -- 172.21.15.102:0/2217003031 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f716400a4a0 con 0x56218b5b2260 2024-09-13T19:17:14.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.412+0000 7f716c48c640 1 --2- 172.21.15.102:0/2217003031 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f716404ec20 0x7f71640464f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.412+0000 7f716c48c640 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56218b5b6800 con 0x7f716404ec20 2024-09-13T19:17:14.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.412+0000 7f716bc8b640 1 --2- 172.21.15.102:0/2217003031 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f716404ec20 0x7f71640464f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.412+0000 7f716bc8b640 1 --2- 172.21.15.102:0/2217003031 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f716404ec20 0x7f71640464f0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.413+0000 7f716bc8b640 1 -- 172.21.15.102:0/2217003031 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f715c07f070 con 0x7f716404ec20 2024-09-13T19:17:14.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.413+0000 7f716bc8b640 1 --2- 172.21.15.102:0/2217003031 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f715c0a8040 0x7f715c009930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.413+0000 7f716bc8b640 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56218b5b6800 con 0x7f715c0a8040 2024-09-13T19:17:14.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.413+0000 7f716b48a640 1 --2- 172.21.15.102:0/2217003031 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f715c0a8040 0x7f715c009930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.413+0000 7f716b48a640 1 --2- 172.21.15.102:0/2217003031 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f715c0a8040 0x7f715c009930 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.413+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f716000f610 con 0x7f715c0a8040 2024-09-13T19:17:14.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.413+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56218b5b6800 con 0x56218b5ad9f0 2024-09-13T19:17:14.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.414+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f716000f610 con 0x56218b5ad9f0 2024-09-13T19:17:14.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.414+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56218b5b6800 con 0x56218b5ad9f0 2024-09-13T19:17:14.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.414+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f716002b040 con 0x56218b5ad9f0 2024-09-13T19:17:14.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.414+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56218b5b6800 con 0x7f715c0a8040 2024-09-13T19:17:14.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.414+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f716002b040 con 0x7f715c0a8040 2024-09-13T19:17:14.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.414+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56218b5b6800 con 0x7f715c0a8040 2024-09-13T19:17:14.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.414+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f716002b040 con 0x7f715c0a8040 2024-09-13T19:17:14.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.414+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56218b5b6800 con 0x7f716404ec20 2024-09-13T19:17:14.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.415+0000 7f716bc8b640 1 -- 172.21.15.102:0/2217003031 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f715c07f070 con 0x7f716404ec20 2024-09-13T19:17:14.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.415+0000 7f716bc8b640 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56218b5b6800 con 0x56218b5b2260 2024-09-13T19:17:14.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.415+0000 7f716c48c640 1 -- 172.21.15.102:0/2217003031 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f716400a4a0 con 0x56218b5b2260 2024-09-13T19:17:14.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.415+0000 7f716c48c640 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56218b5b6800 con 0x56218b5ad9f0 2024-09-13T19:17:14.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.415+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f716002b040 con 0x56218b5ad9f0 2024-09-13T19:17:14.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.415+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56218b5b6800 con 0x7f716404ec20 2024-09-13T19:17:14.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.415+0000 7f716bc8b640 1 -- 172.21.15.102:0/2217003031 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f715c07f070 con 0x7f716404ec20 2024-09-13T19:17:14.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.415+0000 7f716bc8b640 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56218b5b6800 con 0x56218b5ad9f0 2024-09-13T19:17:14.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.416+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f716002b040 con 0x56218b5ad9f0 2024-09-13T19:17:14.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.416+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56218b5b6800 con 0x7f716404ec20 2024-09-13T19:17:14.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.416+0000 7f716bc8b640 1 -- 172.21.15.102:0/2217003031 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f715c07f070 con 0x7f716404ec20 2024-09-13T19:17:14.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.416+0000 7f716bc8b640 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56218b5b6800 con 0x56218b5b2260 2024-09-13T19:17:14.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.416+0000 7f716c48c640 1 -- 172.21.15.102:0/2217003031 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f716400a4a0 con 0x56218b5b2260 2024-09-13T19:17:14.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.416+0000 7f716c48c640 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56218b5b6800 con 0x56218b5b2260 2024-09-13T19:17:14.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.416+0000 7f716c48c640 1 -- 172.21.15.102:0/2217003031 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f716400a4a0 con 0x56218b5b2260 2024-09-13T19:17:14.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.416+0000 7f716c48c640 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56218b5b6800 con 0x7f715c0a8040 2024-09-13T19:17:14.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.417+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f716002b040 con 0x7f715c0a8040 2024-09-13T19:17:14.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.417+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56218b5b6800 con 0x56218b5b2260 2024-09-13T19:17:14.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.417+0000 7f716c48c640 1 -- 172.21.15.102:0/2217003031 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f716400a4a0 con 0x56218b5b2260 2024-09-13T19:17:14.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.417+0000 7f716c48c640 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56218b5b6800 con 0x56218b5b2260 2024-09-13T19:17:14.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.417+0000 7f716c48c640 1 -- 172.21.15.102:0/2217003031 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f716400a4a0 con 0x56218b5b2260 2024-09-13T19:17:14.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.417+0000 7f716c48c640 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56218b5b6800 con 0x56218b5ad9f0 2024-09-13T19:17:14.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.417+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f716002b040 con 0x56218b5ad9f0 2024-09-13T19:17:14.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.417+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56218b5b6800 con 0x56218b5ad9f0 2024-09-13T19:17:14.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.417+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f716002b040 con 0x56218b5ad9f0 2024-09-13T19:17:14.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.417+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56218b5b6800 con 0x7f715c0a8040 2024-09-13T19:17:14.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.418+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f716002b040 con 0x7f715c0a8040 2024-09-13T19:17:14.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.418+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56218b5b6800 con 0x56218b5b2260 2024-09-13T19:17:14.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.418+0000 7f716c48c640 1 -- 172.21.15.102:0/2217003031 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f716400a4a0 con 0x56218b5b2260 2024-09-13T19:17:14.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.418+0000 7f716c48c640 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56218b5b6800 con 0x7f716404ec20 2024-09-13T19:17:14.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.418+0000 7f716bc8b640 1 -- 172.21.15.102:0/2217003031 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f715c07f070 con 0x7f716404ec20 2024-09-13T19:17:14.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.418+0000 7f716bc8b640 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56218b5b6800 con 0x56218b5ad9f0 2024-09-13T19:17:14.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.418+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f716002b040 con 0x56218b5ad9f0 2024-09-13T19:17:14.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.418+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56218b5b6800 con 0x7f716404ec20 2024-09-13T19:17:14.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.419+0000 7f716bc8b640 1 -- 172.21.15.102:0/2217003031 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f715c07f070 con 0x7f716404ec20 2024-09-13T19:17:14.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.419+0000 7f716bc8b640 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56218b5b6800 con 0x56218b5b2260 2024-09-13T19:17:14.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.419+0000 7f716c48c640 1 -- 172.21.15.102:0/2217003031 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f716400a4a0 con 0x56218b5b2260 2024-09-13T19:17:14.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.419+0000 7f716c48c640 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56218b5b6800 con 0x7f715c0a8040 2024-09-13T19:17:14.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.419+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f716002b040 con 0x7f715c0a8040 2024-09-13T19:17:14.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.419+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56218b5b6800 con 0x7f716404ec20 2024-09-13T19:17:14.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.420+0000 7f716bc8b640 1 -- 172.21.15.102:0/2217003031 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f715c07f070 con 0x7f716404ec20 2024-09-13T19:17:14.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.420+0000 7f716bc8b640 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56218b5b6800 con 0x56218b5b2260 2024-09-13T19:17:14.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.420+0000 7f716c48c640 1 -- 172.21.15.102:0/2217003031 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f716400a4a0 con 0x56218b5b2260 2024-09-13T19:17:14.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.420+0000 7f716c48c640 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56218b5b6800 con 0x7f715c0a8040 2024-09-13T19:17:14.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.420+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f716002b040 con 0x7f715c0a8040 2024-09-13T19:17:14.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.420+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56218b5b6800 con 0x56218b5ad9f0 2024-09-13T19:17:14.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.420+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f716002b040 con 0x56218b5ad9f0 2024-09-13T19:17:14.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.420+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56218b5b6800 con 0x7f716404ec20 2024-09-13T19:17:14.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.421+0000 7f716bc8b640 1 -- 172.21.15.102:0/2217003031 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f715c07f070 con 0x7f716404ec20 2024-09-13T19:17:14.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.421+0000 7f716ff3a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:17:14.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.421+0000 7f716ff3a800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:17:14.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.421+0000 7f716ff3a800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:17:14.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.421+0000 7f716ff3a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:17:14.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.421+0000 7f716ff3a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:17:14.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.421+0000 7f716ff3a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:17:14.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.421+0000 7f716ff3a800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.421+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56218b5b58d0 con 0x56218b5ad9f0 2024-09-13T19:17:14.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.421+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f716002b040 con 0x56218b5ad9f0 2024-09-13T19:17:14.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.421+0000 7f716ff3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:14.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.421+0000 7f716ff3a800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.421+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56218b5b5510 con 0x56218b5ad9f0 2024-09-13T19:17:14.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.421+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f716002b040 con 0x56218b5ad9f0 2024-09-13T19:17:14.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.421+0000 7f716ff3a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:17:14.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.421+0000 7f716ff3a800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.421+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56218b5b6230 con 0x56218b5b2260 2024-09-13T19:17:14.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.421+0000 7f716c48c640 1 -- 172.21.15.102:0/2217003031 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f716400a4a0 con 0x56218b5b2260 2024-09-13T19:17:14.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.421+0000 7f716ff3a800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:17:14.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.421+0000 7f716ff3a800 20 zone default found 2024-09-13T19:17:14.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.421+0000 7f716ff3a800 4 Realm: () 2024-09-13T19:17:14.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.421+0000 7f716ff3a800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:17:14.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.421+0000 7f716ff3a800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:17:14.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.421+0000 7f716ff3a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:17:14.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.421+0000 7f716ff3a800 20 zonegroup default 2024-09-13T19:17:14.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.421+0000 7f716ff3a800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.421+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56218b5b7180 con 0x7f716404ec20 2024-09-13T19:17:14.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.422+0000 7f716bc8b640 1 -- 172.21.15.102:0/2217003031 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f715c07f070 con 0x7f716404ec20 2024-09-13T19:17:14.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.422+0000 7f716ff3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:14.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.422+0000 7f716ff3a800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.422+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56218b5b8f90 con 0x56218b5b2260 2024-09-13T19:17:14.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.422+0000 7f716c48c640 1 -- 172.21.15.102:0/2217003031 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f716400a4a0 con 0x56218b5b2260 2024-09-13T19:17:14.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.422+0000 7f716ff3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:14.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.422+0000 7f716ff3a800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.422+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56218b5b93f0 con 0x56218b5b2260 2024-09-13T19:17:14.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.422+0000 7f716c48c640 1 -- 172.21.15.102:0/2217003031 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f716400a4a0 con 0x56218b5b2260 2024-09-13T19:17:14.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.422+0000 7f716ff3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:14.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.422+0000 7f716ff3a800 20 started sync module instance, tier type = 2024-09-13T19:17:14.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.422+0000 7f716ff3a800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:17:14.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.422+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56218b5b83a0 con 0x7f716404ec20 2024-09-13T19:17:14.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.423+0000 7f716bc8b640 1 -- 172.21.15.102:0/2217003031 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(44 notify.0 [create] v36'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f715c07f070 con 0x7f716404ec20 2024-09-13T19:17:14.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.423+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94702071941008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56218b5b8bb0 con 0x7f716404ec20 2024-09-13T19:17:14.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.423+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56218b5ba2f0 con 0x56218b5ad9f0 2024-09-13T19:17:14.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.424+0000 7f716bc8b640 1 -- 172.21.15.102:0/2217003031 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94702071941008] v36'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f715c07f070 con 0x7f716404ec20 2024-09-13T19:17:14.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.424+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v36'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f716002b040 con 0x56218b5ad9f0 2024-09-13T19:17:14.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.424+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94702071945216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56218b5bab90 con 0x56218b5ad9f0 2024-09-13T19:17:14.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.424+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56218b5bb550 con 0x56218b5b2260 2024-09-13T19:17:14.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.426+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94702071945216] v36'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f716002b040 con 0x56218b5ad9f0 2024-09-13T19:17:14.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.426+0000 7f716c48c640 1 -- 172.21.15.102:0/2217003031 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v36'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f716400a4a0 con 0x56218b5b2260 2024-09-13T19:17:14.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.426+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94702071949536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56218b5bb550 con 0x56218b5b2260 2024-09-13T19:17:14.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.426+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56218b5bbfc0 con 0x7f716404ec20 2024-09-13T19:17:14.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.427+0000 7f716c48c640 1 -- 172.21.15.102:0/2217003031 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94702071949536] v36'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f716400a4a0 con 0x56218b5b2260 2024-09-13T19:17:14.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.427+0000 7f716bc8b640 1 -- 172.21.15.102:0/2217003031 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(50 notify.3 [create] v36'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f715c07f070 con 0x7f716404ec20 2024-09-13T19:17:14.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.427+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94702071954064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56218b5bb550 con 0x7f716404ec20 2024-09-13T19:17:14.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.427+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56218b5bca50 con 0x56218b5ad9f0 2024-09-13T19:17:14.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.428+0000 7f716bc8b640 1 -- 172.21.15.102:0/2217003031 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94702071954064] v36'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f715c07f070 con 0x7f716404ec20 2024-09-13T19:17:14.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.428+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v36'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f716002b040 con 0x56218b5ad9f0 2024-09-13T19:17:14.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.428+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94702071956768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56218b5bb550 con 0x56218b5ad9f0 2024-09-13T19:17:14.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.428+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56218b5bd4e0 con 0x7f715c0a8040 2024-09-13T19:17:14.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.429+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94702071956768] v36'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f716002b040 con 0x56218b5ad9f0 2024-09-13T19:17:14.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.429+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(54 notify.5 [create] v36'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f716002b040 con 0x7f715c0a8040 2024-09-13T19:17:14.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.429+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94702071959472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56218b5bb550 con 0x7f715c0a8040 2024-09-13T19:17:14.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.429+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56218b5bdef0 con 0x7f715c0a8040 2024-09-13T19:17:14.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.430+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94702071959472] v36'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f716002b040 con 0x7f715c0a8040 2024-09-13T19:17:14.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.431+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(56 notify.6 [create] v36'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f716002b040 con 0x7f715c0a8040 2024-09-13T19:17:14.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.431+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94702071962656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56218b5bb550 con 0x7f715c0a8040 2024-09-13T19:17:14.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.431+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56218b5be900 con 0x7f715c0a8040 2024-09-13T19:17:14.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.432+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(58 notify.7 [create] v36'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f716002b040 con 0x7f715c0a8040 2024-09-13T19:17:14.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.432+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94702071964752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56218b5bed20 con 0x7f715c0a8040 2024-09-13T19:17:14.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.432+0000 7f716ff3a800 20 add_watcher() i=0 2024-09-13T19:17:14.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.432+0000 7f716ff3a800 20 add_watcher() i=1 2024-09-13T19:17:14.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.432+0000 7f716ff3a800 20 add_watcher() i=2 2024-09-13T19:17:14.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.432+0000 7f716ff3a800 20 add_watcher() i=3 2024-09-13T19:17:14.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.432+0000 7f716ff3a800 20 add_watcher() i=4 2024-09-13T19:17:14.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.432+0000 7f716ff3a800 20 add_watcher() i=5 2024-09-13T19:17:14.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.432+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94702071962656] v36'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f716002b040 con 0x7f715c0a8040 2024-09-13T19:17:14.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.432+0000 7f716ff3a800 20 add_watcher() i=6 2024-09-13T19:17:14.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.432+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94702071964752] v36'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f716002b040 con 0x7f715c0a8040 2024-09-13T19:17:14.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.432+0000 7f716ff3a800 20 add_watcher() i=7 2024-09-13T19:17:14.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.432+0000 7f716ff3a800 2 all 8 watchers are set, enabling cache 2024-09-13T19:17:14.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.433+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56218b5bb0a0 con 0x56218b5ad9f0 2024-09-13T19:17:14.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.433+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f716002b040 con 0x56218b5ad9f0 2024-09-13T19:17:14.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.433+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94702071951520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56218b5bf1e0 con 0x56218b5ad9f0 2024-09-13T19:17:14.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.434+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94702071951520] v36'202 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f716002b040 con 0x56218b5ad9f0 2024-09-13T19:17:14.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.434+0000 7f7021fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:17:14.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.434+0000 7f716ff3a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:17:14.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.434+0000 7f716ff3a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:17:14.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.434+0000 7f716ff3a800 5 note: GC not initialized 2024-09-13T19:17:14.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.434+0000 7f7020fe1640 20 reqs_thread_entry: start 2024-09-13T19:17:14.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.434+0000 7f716ff3a800 20 init_complete bucket index max shards: 11 2024-09-13T19:17:14.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.434+0000 7f716ff3a800 20 Filter name: none 2024-09-13T19:17:14.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.434+0000 7f6f9a7fc640 20 reqs_thread_entry: start 2024-09-13T19:17:14.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.435+0000 7f716ff3a800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.435+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56218b5f4c40 con 0x56218b5ad9f0 2024-09-13T19:17:14.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.435+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f716002b040 con 0x56218b5ad9f0 2024-09-13T19:17:14.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.435+0000 7f716ff3a800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:17:14.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.435+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56218b5f6190 con 0x7f715c0a8040 2024-09-13T19:17:14.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.435+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f716002b040 con 0x7f715c0a8040 2024-09-13T19:17:14.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.436+0000 7f7021fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:17:14.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.436+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94702071951520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56218b5f3280 con 0x56218b5ad9f0 2024-09-13T19:17:14.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.437+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94702071951520] v36'203 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f716002b040 con 0x56218b5ad9f0 2024-09-13T19:17:14.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.437+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94702071941008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56218b5bb0a0 con 0x7f716404ec20 2024-09-13T19:17:14.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.438+0000 7f716bc8b640 1 -- 172.21.15.102:0/2217003031 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94702071941008] v36'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f715c07f070 con 0x7f716404ec20 2024-09-13T19:17:14.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.438+0000 7f716ff3a800 20 remove_watcher() i=0 2024-09-13T19:17:14.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.438+0000 7f716ff3a800 2 removed watcher, disabling cache 2024-09-13T19:17:14.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.438+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94702071945216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56218b5b8790 con 0x56218b5ad9f0 2024-09-13T19:17:14.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.439+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94702071945216] v36'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f716002b040 con 0x56218b5ad9f0 2024-09-13T19:17:14.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.439+0000 7f716ff3a800 20 remove_watcher() i=1 2024-09-13T19:17:14.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.439+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94702071949536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56218b5b8790 con 0x56218b5b2260 2024-09-13T19:17:14.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.440+0000 7f716c48c640 1 -- 172.21.15.102:0/2217003031 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94702071949536] v36'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f716400a4a0 con 0x56218b5b2260 2024-09-13T19:17:14.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.441+0000 7f716ff3a800 20 remove_watcher() i=2 2024-09-13T19:17:14.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.441+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94702071954064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56218b5b8790 con 0x7f716404ec20 2024-09-13T19:17:14.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.442+0000 7f716bc8b640 1 -- 172.21.15.102:0/2217003031 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94702071954064] v36'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f715c07f070 con 0x7f716404ec20 2024-09-13T19:17:14.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.442+0000 7f716ff3a800 20 remove_watcher() i=3 2024-09-13T19:17:14.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.442+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94702071956768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56218b5b8790 con 0x56218b5ad9f0 2024-09-13T19:17:14.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.443+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94702071956768] v36'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f716002b040 con 0x56218b5ad9f0 2024-09-13T19:17:14.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.443+0000 7f716ff3a800 20 remove_watcher() i=4 2024-09-13T19:17:14.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.443+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94702071959472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56218b5b8790 con 0x7f715c0a8040 2024-09-13T19:17:14.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.444+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94702071959472] v36'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f716002b040 con 0x7f715c0a8040 2024-09-13T19:17:14.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.444+0000 7f716ff3a800 20 remove_watcher() i=5 2024-09-13T19:17:14.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.444+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94702071962656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56218b5bcfb0 con 0x7f715c0a8040 2024-09-13T19:17:14.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.445+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94702071962656] v36'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f716002b040 con 0x7f715c0a8040 2024-09-13T19:17:14.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.445+0000 7f716ff3a800 20 remove_watcher() i=6 2024-09-13T19:17:14.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.445+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94702071964752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56218b5b8790 con 0x7f715c0a8040 2024-09-13T19:17:14.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.446+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94702071964752] v36'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f716002b040 con 0x7f715c0a8040 2024-09-13T19:17:14.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.446+0000 7f716ff3a800 20 remove_watcher() i=7 2024-09-13T19:17:14.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.446+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f715c0a8040 msgr2=0x7f715c009930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.446+0000 7f716ff3a800 1 --2- 172.21.15.102:0/2217003031 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f715c0a8040 0x7f715c009930 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.446+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56218b5ad9f0 msgr2=0x56218b5afeb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.446+0000 7f716ff3a800 1 --2- 172.21.15.102:0/2217003031 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56218b5ad9f0 0x56218b5afeb0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.446+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f716404ec20 msgr2=0x7f71640464f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.446+0000 7f716ff3a800 1 --2- 172.21.15.102:0/2217003031 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f716404ec20 0x7f71640464f0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.446+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56218b5b2260 msgr2=0x56218b5b4670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.446+0000 7f716ff3a800 1 --2- 172.21.15.102:0/2217003031 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56218b5b2260 0x56218b5b4670 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.446+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7034036b40 msgr2=0x7f7034039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.446+0000 7f716ff3a800 1 --2- 172.21.15.102:0/2217003031 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7034036b40 0x7f7034039000 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f715c051840 tx=0x7f715c093000 comp rx=0 tx=0).stop 2024-09-13T19:17:14.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.446+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56218b59ad10 msgr2=0x56218b5a2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.446+0000 7f716b48a640 1 -- 172.21.15.102:0/2217003031 reap_dead start 2024-09-13T19:17:14.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.446+0000 7f716ff3a800 1 --2- 172.21.15.102:0/2217003031 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56218b59ad10 0x56218b5a2180 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f7164048010 tx=0x7f716404cd90 comp rx=0 tx=0).stop 2024-09-13T19:17:14.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.446+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 shutdown_connections 2024-09-13T19:17:14.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.446+0000 7f716ff3a800 1 --2- 172.21.15.102:0/2217003031 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56218b59ad10 0x56218b5a2180 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.446+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 >> 172.21.15.102:0/2217003031 conn(0x56218b597070 msgr2=0x56218b595140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:14.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.446+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 shutdown_connections 2024-09-13T19:17:14.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.446+0000 7f716ff3a800 1 -- 172.21.15.102:0/2217003031 wait complete. 2024-09-13T19:17:14.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.446+0000 7f716ff3a800 1 -- 172.21.15.102:0/807565631 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7044036b90 msgr2=0x7f7044039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.446+0000 7f716ff3a800 1 --2- 172.21.15.102:0/807565631 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7044036b90 0x7f7044039050 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x56218b577870 tx=0x7f715c08f220 comp rx=0 tx=0).stop 2024-09-13T19:17:14.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.446+0000 7f716ff3a800 1 -- 172.21.15.102:0/807565631 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56218b58e050 msgr2=0x56218b58e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.446+0000 7f716ff3a800 1 --2- 172.21.15.102:0/807565631 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56218b58e050 0x56218b58e470 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x56218b5743c0 tx=0x7f71640167b0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.446+0000 7f716ff3a800 1 -- 172.21.15.102:0/807565631 shutdown_connections 2024-09-13T19:17:14.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.446+0000 7f716ff3a800 1 --2- 172.21.15.102:0/807565631 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7044036b90 0x7f7044039050 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.446+0000 7f716ff3a800 1 --2- 172.21.15.102:0/807565631 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56218b58e050 0x56218b58e470 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.446+0000 7f716ff3a800 1 -- 172.21.15.102:0/807565631 >> 172.21.15.102:0/807565631 conn(0x56218b582fe0 msgr2=0x56218b585b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:14.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.446+0000 7f716ff3a800 1 -- 172.21.15.102:0/807565631 shutdown_connections 2024-09-13T19:17:14.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.446+0000 7f716ff3a800 1 -- 172.21.15.102:0/807565631 wait complete. 2024-09-13T19:17:14.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.447+0000 7f716ff3a800 1 -- 172.21.15.102:0/3533828659 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56218b47b050 msgr2=0x56218b57a380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.447+0000 7f716ff3a800 1 --2- 172.21.15.102:0/3533828659 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56218b47b050 0x56218b57a380 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.447+0000 7f716ff3a800 1 -- 172.21.15.102:0/3533828659 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56218b57cc30 msgr2=0x56218b57f020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.447+0000 7f716ff3a800 1 --2- 172.21.15.102:0/3533828659 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56218b57cc30 0x56218b57f020 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.447+0000 7f716ff3a800 1 -- 172.21.15.102:0/3533828659 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7054036b40 msgr2=0x7f7054039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.447+0000 7f716ff3a800 1 --2- 172.21.15.102:0/3533828659 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7054036b40 0x7f7054039000 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7160000f60 tx=0x7f7160001370 comp rx=0 tx=0).stop 2024-09-13T19:17:14.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.447+0000 7f716ff3a800 1 -- 172.21.15.102:0/3533828659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56218b47a710 msgr2=0x56218b573310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.447+0000 7f716ff3a800 1 --2- 172.21.15.102:0/3533828659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56218b47a710 0x56218b573310 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f715c067040 tx=0x7f715c002fb0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.447+0000 7f716ff3a800 1 -- 172.21.15.102:0/3533828659 shutdown_connections 2024-09-13T19:17:14.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.447+0000 7f716ff3a800 1 --2- 172.21.15.102:0/3533828659 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56218b57cc30 0x56218b57f020 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.447+0000 7f716ff3a800 1 --2- 172.21.15.102:0/3533828659 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56218b47b050 0x56218b57a380 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.447+0000 7f716ff3a800 1 --2- 172.21.15.102:0/3533828659 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7054036b40 0x7f7054039000 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.447+0000 7f716ff3a800 1 --2- 172.21.15.102:0/3533828659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56218b47a710 0x56218b573310 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.447+0000 7f716ff3a800 1 -- 172.21.15.102:0/3533828659 >> 172.21.15.102:0/3533828659 conn(0x56218b475fe0 msgr2=0x56218b3ef1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:14.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.447+0000 7f716ff3a800 1 -- 172.21.15.102:0/3533828659 shutdown_connections 2024-09-13T19:17:14.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.447+0000 7f716ff3a800 1 -- 172.21.15.102:0/3533828659 wait complete. 2024-09-13T19:17:14.466 INFO:teuthology.orchestra.run.smithi102.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5}]},{"bucket":"myfoo2","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}],"total":{"bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}}]} 2024-09-13T19:17:14.466 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}}]} 2024-09-13T19:17:14.466 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-13T19:17:14.466 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-13T19:17:14.466 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2024-09-13T19:17:14.512 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:17:14.512 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:17:14.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.510+0000 7fc73c324800 1 Processor -- start 2024-09-13T19:17:14.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.510+0000 7fc73c324800 1 -- start start 2024-09-13T19:17:14.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.510+0000 7fc73c324800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x558b47701d20 0x558b47704110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.510+0000 7fc73c324800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558b475bab30 con 0x558b4766f630 2024-09-13T19:17:14.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.510+0000 7fc73c324800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x558b4759c360 con 0x558b47701d20 2024-09-13T19:17:14.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.511+0000 7fc737815640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x558b47701d20 0x558b47704110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.511+0000 7fc737815640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x558b47701d20 0x558b47704110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41178/0 (socket says 172.21.15.102:41178) 2024-09-13T19:17:14.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.511+0000 7fc738016640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x558b4766f630 0x558b47700600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:50036/0 (socket says 172.21.15.102:50036) 2024-09-13T19:17:14.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.511+0000 7fc737815640 1 -- 172.21.15.102:0/756173200 learned_addr learned my addr 172.21.15.102:0/756173200 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:14.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.511+0000 7fc737815640 1 -- 172.21.15.102:0/756173200 >> v1:172.21.15.53:6789/0 conn(0x558b4766f630 legacy=0x558b47700600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.511+0000 7fc737815640 1 -- 172.21.15.102:0/756173200 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b475c2e00 con 0x558b47701d20 2024-09-13T19:17:14.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.513+0000 7fc737815640 1 --2- 172.21.15.102:0/756173200 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b47701d20 0x558b47704110 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fc72000a520 tx=0x7fc720045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbe3bddbd9ff439 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.513+0000 7fc737014640 1 -- 172.21.15.102:0/756173200 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc720055070 con 0x558b47701d20 2024-09-13T19:17:14.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.513+0000 7fc737014640 1 -- 172.21.15.102:0/756173200 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7200515b0 con 0x558b47701d20 2024-09-13T19:17:14.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.513+0000 7fc737014640 1 -- 172.21.15.102:0/756173200 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7200518d0 con 0x558b47701d20 2024-09-13T19:17:14.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.513+0000 7fc73c324800 1 -- 172.21.15.102:0/756173200 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b47701d20 msgr2=0x558b47704110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.513+0000 7fc73c324800 1 --2- 172.21.15.102:0/756173200 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b47701d20 0x558b47704110 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fc72000a520 tx=0x7fc720045ba0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.513+0000 7fc73c324800 1 -- 172.21.15.102:0/756173200 shutdown_connections 2024-09-13T19:17:14.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.513+0000 7fc73c324800 1 --2- 172.21.15.102:0/756173200 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b47701d20 0x558b47704110 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.513+0000 7fc73c324800 1 -- 172.21.15.102:0/756173200 >> 172.21.15.102:0/756173200 conn(0x558b476f5db0 msgr2=0x558b476f81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:14.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.513+0000 7fc73c324800 1 -- 172.21.15.102:0/756173200 shutdown_connections 2024-09-13T19:17:14.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.513+0000 7fc73c324800 1 -- 172.21.15.102:0/756173200 wait complete. 2024-09-13T19:17:14.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.527+0000 7fc73c324800 1 Processor -- start 2024-09-13T19:17:14.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.527+0000 7fc73c324800 1 -- start start 2024-09-13T19:17:14.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.527+0000 7fc73c324800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b4766f630 0x558b477ecad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.527+0000 7fc73c324800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558b47647360 con 0x558b4766f630 2024-09-13T19:17:14.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.527+0000 7fc738016640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b4766f630 0x558b477ecad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.527+0000 7fc738016640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b4766f630 0x558b477ecad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41194/0 (socket says 172.21.15.102:41194) 2024-09-13T19:17:14.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.527+0000 7fc738016640 1 -- 172.21.15.102:0/235344361 learned_addr learned my addr 172.21.15.102:0/235344361 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:14.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.528+0000 7fc738016640 1 -- 172.21.15.102:0/235344361 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b47594bc0 con 0x558b4766f630 2024-09-13T19:17:14.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.528+0000 7fc738016640 1 --2- 172.21.15.102:0/235344361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b4766f630 0x558b477ecad0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fc728001650 tx=0x7fc728001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15b6a816bed0b393 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.528+0000 7fc62660c640 1 -- 172.21.15.102:0/235344361 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc728013420 con 0x558b4766f630 2024-09-13T19:17:14.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.528+0000 7fc62660c640 1 -- 172.21.15.102:0/235344361 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7280135c0 con 0x558b4766f630 2024-09-13T19:17:14.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.528+0000 7fc62660c640 1 -- 172.21.15.102:0/235344361 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7280138c0 con 0x558b4766f630 2024-09-13T19:17:14.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.529+0000 7fc73c324800 1 -- 172.21.15.102:0/235344361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b4766f630 msgr2=0x558b477ecad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.529+0000 7fc73c324800 1 --2- 172.21.15.102:0/235344361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b4766f630 0x558b477ecad0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fc728001650 tx=0x7fc728001b10 comp rx=0 tx=0).stop 2024-09-13T19:17:14.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.529+0000 7fc73c324800 1 -- 172.21.15.102:0/235344361 shutdown_connections 2024-09-13T19:17:14.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.529+0000 7fc73c324800 1 --2- 172.21.15.102:0/235344361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b4766f630 0x558b477ecad0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.529+0000 7fc73c324800 1 -- 172.21.15.102:0/235344361 >> 172.21.15.102:0/235344361 conn(0x558b476f5db0 msgr2=0x558b477e8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:14.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.529+0000 7fc73c324800 1 -- 172.21.15.102:0/235344361 shutdown_connections 2024-09-13T19:17:14.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.529+0000 7fc73c324800 1 -- 172.21.15.102:0/235344361 wait complete. 2024-09-13T19:17:14.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.529+0000 7fc73c324800 1 Processor -- start 2024-09-13T19:17:14.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.529+0000 7fc73c324800 1 -- start start 2024-09-13T19:17:14.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.529+0000 7fc73c324800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b47701d20 0x558b477f4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.529+0000 7fc73c324800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558b47704920 con 0x558b47701d20 2024-09-13T19:17:14.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.529+0000 7fc738016640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b47701d20 0x558b477f4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.530+0000 7fc738016640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b47701d20 0x558b477f4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41200/0 (socket says 172.21.15.102:41200) 2024-09-13T19:17:14.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.530+0000 7fc738016640 1 -- 172.21.15.102:0/2548112357 learned_addr learned my addr 172.21.15.102:0/2548112357 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:14.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.530+0000 7fc738016640 1 -- 172.21.15.102:0/2548112357 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b475a8fe0 con 0x558b47701d20 2024-09-13T19:17:14.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.530+0000 7fc738016640 1 --2- 172.21.15.102:0/2548112357 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b47701d20 0x558b477f4710 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fc728000f80 tx=0x7fc728001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.530+0000 7fc624e09640 1 -- 172.21.15.102:0/2548112357 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc728022020 con 0x558b47701d20 2024-09-13T19:17:14.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.530+0000 7fc624e09640 1 -- 172.21.15.102:0/2548112357 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc728006830 con 0x558b47701d20 2024-09-13T19:17:14.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.530+0000 7fc73c324800 1 -- 172.21.15.102:0/2548112357 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558b477f4c50 con 0x558b47701d20 2024-09-13T19:17:14.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.530+0000 7fc624e09640 1 -- 172.21.15.102:0/2548112357 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc728004b10 con 0x558b47701d20 2024-09-13T19:17:14.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.530+0000 7fc73c324800 1 -- 172.21.15.102:0/2548112357 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b477f5170 con 0x558b47701d20 2024-09-13T19:17:14.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.531+0000 7fc624e09640 1 -- 172.21.15.102:0/2548112357 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc728025020 con 0x558b47701d20 2024-09-13T19:17:14.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.531+0000 7fc624e09640 1 --2- 172.21.15.102:0/2548112357 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc620036b40 0x7fc620039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.531+0000 7fc624e09640 1 -- 172.21.15.102:0/2548112357 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fc728018030 con 0x558b47701d20 2024-09-13T19:17:14.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.531+0000 7fc737815640 1 --2- 172.21.15.102:0/2548112357 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc620036b40 0x7fc620039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.531+0000 7fc73c324800 1 --2- 172.21.15.102:0/2548112357 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x558b477f9770 0x558b477fbb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.531+0000 7fc73c324800 1 -- 172.21.15.102:0/2548112357 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558b477fc130 con 0x558b477f9770 2024-09-13T19:17:14.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.532+0000 7fc738817640 1 --2- 172.21.15.102:0/2548112357 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x558b477f9770 0x558b477fbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.532+0000 7fc737815640 1 --2- 172.21.15.102:0/2548112357 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc620036b40 0x7fc620039000 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc720057000 tx=0x7fc720052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.532+0000 7fc738817640 1 --2- 172.21.15.102:0/2548112357 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x558b477f9770 0x558b477fbb60 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.532+0000 7fc738817640 1 -- 172.21.15.102:0/2548112357 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7300083e0 con 0x558b477f9770 2024-09-13T19:17:14.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.532+0000 7fc73c324800 1 -- 172.21.15.102:0/2548112357 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558b477f8d30 con 0x558b477f9770 2024-09-13T19:17:14.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.532+0000 7fc738817640 1 -- 172.21.15.102:0/2548112357 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc7300083e0 con 0x558b477f9770 2024-09-13T19:17:14.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.532+0000 7fc73c324800 1 --2- 172.21.15.102:0/2548112357 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x558b477fe420 0x558b47800810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.532+0000 7fc73c324800 1 -- 172.21.15.102:0/2548112357 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558b47800f00 con 0x558b477fe420 2024-09-13T19:17:14.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.533+0000 7fc738016640 1 --2- 172.21.15.102:0/2548112357 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x558b477fe420 0x558b47800810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.533+0000 7fc738016640 1 --2- 172.21.15.102:0/2548112357 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x558b477fe420 0x558b47800810 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.533+0000 7fc738016640 1 -- 172.21.15.102:0/2548112357 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc72801b070 con 0x558b477fe420 2024-09-13T19:17:14.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.533+0000 7fc73c324800 1 -- 172.21.15.102:0/2548112357 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558b477fd2c0 con 0x558b477f9770 2024-09-13T19:17:14.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.533+0000 7fc738817640 1 -- 172.21.15.102:0/2548112357 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc7300083e0 con 0x558b477f9770 2024-09-13T19:17:14.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.533+0000 7fc73c324800 1 -- 172.21.15.102:0/2548112357 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558b477fd760 con 0x558b477fe420 2024-09-13T19:17:14.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.534+0000 7fc738016640 1 -- 172.21.15.102:0/2548112357 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc72801b070 con 0x558b477fe420 2024-09-13T19:17:14.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.534+0000 7fc73c324800 1 Processor -- start 2024-09-13T19:17:14.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.534+0000 7fc73c324800 1 -- start start 2024-09-13T19:17:14.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.534+0000 7fc73c324800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b4780f880 0x558b4780fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.534+0000 7fc73c324800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558b47596580 con 0x558b4780f880 2024-09-13T19:17:14.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.535+0000 7fc738817640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b4780f880 0x558b4780fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.535+0000 7fc738817640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b4780f880 0x558b4780fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41214/0 (socket says 172.21.15.102:41214) 2024-09-13T19:17:14.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.535+0000 7fc738817640 1 -- 172.21.15.102:0/1025872797 learned_addr learned my addr 172.21.15.102:0/1025872797 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:14.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.535+0000 7fc738817640 1 -- 172.21.15.102:0/1025872797 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b478101e0 con 0x558b4780f880 2024-09-13T19:17:14.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.535+0000 7fc738817640 1 --2- 172.21.15.102:0/1025872797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b4780f880 0x558b4780fca0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x558b477f57c0 tx=0x7fc73000beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.535+0000 7fc61dffb640 1 -- 172.21.15.102:0/1025872797 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc73001c020 con 0x558b4780f880 2024-09-13T19:17:14.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.535+0000 7fc61dffb640 1 -- 172.21.15.102:0/1025872797 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc730007c30 con 0x558b4780f880 2024-09-13T19:17:14.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.535+0000 7fc73c324800 1 -- 172.21.15.102:0/1025872797 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558b47810470 con 0x558b4780f880 2024-09-13T19:17:14.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.535+0000 7fc61dffb640 1 -- 172.21.15.102:0/1025872797 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc730018440 con 0x558b4780f880 2024-09-13T19:17:14.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.535+0000 7fc73c324800 1 -- 172.21.15.102:0/1025872797 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b47813150 con 0x558b4780f880 2024-09-13T19:17:14.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.536+0000 7fc61dffb640 1 -- 172.21.15.102:0/1025872797 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc73001f020 con 0x558b4780f880 2024-09-13T19:17:14.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.536+0000 7fc61dffb640 1 --2- 172.21.15.102:0/1025872797 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc610036bb0 0x7fc610039070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.536+0000 7fc61dffb640 1 -- 172.21.15.102:0/1025872797 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fc73004e3e0 con 0x558b4780f880 2024-09-13T19:17:14.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.536+0000 7fc738016640 1 --2- 172.21.15.102:0/1025872797 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc610036bb0 0x7fc610039070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.537+0000 7fc73c324800 1 Processor -- start 2024-09-13T19:17:14.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.537+0000 7fc73c324800 1 -- start start 2024-09-13T19:17:14.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.537+0000 7fc738016640 1 --2- 172.21.15.102:0/1025872797 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc610036bb0 0x7fc610039070 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc728012fd0 tx=0x7fc728011f40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.537+0000 7fc73c324800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b4781c4c0 0x558b4781c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.537+0000 7fc73c324800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558b477ed280 con 0x558b4781c4c0 2024-09-13T19:17:14.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.537+0000 7fc738817640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b4781c4c0 0x558b4781c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.537+0000 7fc738817640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b4781c4c0 0x558b4781c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41218/0 (socket says 172.21.15.102:41218) 2024-09-13T19:17:14.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.537+0000 7fc738817640 1 -- 172.21.15.102:0/3189948944 learned_addr learned my addr 172.21.15.102:0/3189948944 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:14.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.538+0000 7fc738817640 1 -- 172.21.15.102:0/3189948944 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b4781ce90 con 0x558b4781c4c0 2024-09-13T19:17:14.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.538+0000 7fc738817640 1 --2- 172.21.15.102:0/3189948944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b4781c4c0 0x558b4781c8c0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fc730007fd0 tx=0x7fc730018950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92dd98b6d9362c17 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.538+0000 7fc6177fe640 1 -- 172.21.15.102:0/3189948944 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc730045070 con 0x558b4781c4c0 2024-09-13T19:17:14.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.538+0000 7fc6177fe640 1 -- 172.21.15.102:0/3189948944 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc73004e1a0 con 0x558b4781c4c0 2024-09-13T19:17:14.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.538+0000 7fc6177fe640 1 -- 172.21.15.102:0/3189948944 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc730021550 con 0x558b4781c4c0 2024-09-13T19:17:14.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.538+0000 7fc73c324800 1 -- 172.21.15.102:0/3189948944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b4781c4c0 msgr2=0x558b4781c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.538+0000 7fc73c324800 1 --2- 172.21.15.102:0/3189948944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b4781c4c0 0x558b4781c8c0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fc730007fd0 tx=0x7fc730018950 comp rx=0 tx=0).stop 2024-09-13T19:17:14.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.538+0000 7fc73c324800 1 -- 172.21.15.102:0/3189948944 shutdown_connections 2024-09-13T19:17:14.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.538+0000 7fc73c324800 1 --2- 172.21.15.102:0/3189948944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b4781c4c0 0x558b4781c8c0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.538+0000 7fc73c324800 1 -- 172.21.15.102:0/3189948944 >> 172.21.15.102:0/3189948944 conn(0x558b478188b0 msgr2=0x558b478169b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:14.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.538+0000 7fc73c324800 1 -- 172.21.15.102:0/3189948944 shutdown_connections 2024-09-13T19:17:14.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.538+0000 7fc73c324800 1 -- 172.21.15.102:0/3189948944 wait complete. 2024-09-13T19:17:14.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.539+0000 7fc73c324800 1 Processor -- start 2024-09-13T19:17:14.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.539+0000 7fc73c324800 1 -- start start 2024-09-13T19:17:14.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.539+0000 7fc73c324800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b4781c4c0 0x558b47823990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.539+0000 7fc73c324800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558b4781d4d0 con 0x558b4781c4c0 2024-09-13T19:17:14.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.539+0000 7fc738817640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b4781c4c0 0x558b47823990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.539+0000 7fc738817640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b4781c4c0 0x558b47823990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41226/0 (socket says 172.21.15.102:41226) 2024-09-13T19:17:14.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.539+0000 7fc738817640 1 -- 172.21.15.102:0/130508572 learned_addr learned my addr 172.21.15.102:0/130508572 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:14.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.539+0000 7fc738817640 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b47823ed0 con 0x558b4781c4c0 2024-09-13T19:17:14.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.539+0000 7fc738817640 1 --2- 172.21.15.102:0/130508572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b4781c4c0 0x558b47823990 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fc7300087f0 tx=0x7fc73004c5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.540+0000 7fc615ffb640 1 -- 172.21.15.102:0/130508572 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc73003f050 con 0x558b4781c4c0 2024-09-13T19:17:14.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.540+0000 7fc615ffb640 1 -- 172.21.15.102:0/130508572 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc73002f070 con 0x558b4781c4c0 2024-09-13T19:17:14.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.540+0000 7fc615ffb640 1 -- 172.21.15.102:0/130508572 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc730045040 con 0x558b4781c4c0 2024-09-13T19:17:14.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.540+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558b47824160 con 0x558b4781c4c0 2024-09-13T19:17:14.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.540+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b47826e10 con 0x558b4781c4c0 2024-09-13T19:17:14.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.540+0000 7fc615ffb640 1 -- 172.21.15.102:0/130508572 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc730016040 con 0x558b4781c4c0 2024-09-13T19:17:14.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.541+0000 7fc615ffb640 1 --2- 172.21.15.102:0/130508572 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc608036b40 0x7fc608039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.541+0000 7fc615ffb640 1 -- 172.21.15.102:0/130508572 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fc730042080 con 0x558b4781c4c0 2024-09-13T19:17:14.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.541+0000 7fc738016640 1 --2- 172.21.15.102:0/130508572 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc608036b40 0x7fc608039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.541+0000 7fc73c324800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.541+0000 7fc73c324800 1 --2- 172.21.15.102:0/130508572 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x558b4782f4e0 0x558b478319a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.541+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558b478320f0 con 0x558b4782f4e0 2024-09-13T19:17:14.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.541+0000 7fc737815640 1 --2- 172.21.15.102:0/130508572 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x558b4782f4e0 0x558b478319a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.541+0000 7fc738016640 1 --2- 172.21.15.102:0/130508572 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc608036b40 0x7fc608039000 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc72804b180 tx=0x7fc728037000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.541+0000 7fc737815640 1 --2- 172.21.15.102:0/130508572 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x558b4782f4e0 0x558b478319a0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.542+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc720057030 con 0x558b4782f4e0 2024-09-13T19:17:14.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.542+0000 7fc73c324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:14.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.542+0000 7fc73c324800 20 realm 2024-09-13T19:17:14.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.542+0000 7fc73c324800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.542+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558b47832520 con 0x558b4782f4e0 2024-09-13T19:17:14.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.542+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc720057030 con 0x558b4782f4e0 2024-09-13T19:17:14.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.542+0000 7fc73c324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:14.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.542+0000 7fc73c324800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:17:14.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.542+0000 7fc73c324800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.542+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558b47832df0 con 0x558b4782f4e0 2024-09-13T19:17:14.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.542+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc720057030 con 0x558b4782f4e0 2024-09-13T19:17:14.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.542+0000 7fc73c324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:14.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.542+0000 7fc73c324800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.542+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558b47833190 con 0x558b4782f4e0 2024-09-13T19:17:14.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.542+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc720057030 con 0x558b4782f4e0 2024-09-13T19:17:14.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.542+0000 7fc73c324800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:17:14.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.542+0000 7fc73c324800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.542+0000 7fc73c324800 1 --2- 172.21.15.102:0/130508572 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x558b47833ef0 0x558b478362e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.542+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558b47836820 con 0x558b47833ef0 2024-09-13T19:17:14.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.543+0000 7fc738817640 1 --2- 172.21.15.102:0/130508572 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x558b47833ef0 0x558b478362e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.543+0000 7fc738817640 1 --2- 172.21.15.102:0/130508572 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x558b47833ef0 0x558b478362e0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.543+0000 7fc738817640 1 -- 172.21.15.102:0/130508572 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc730028070 con 0x558b47833ef0 2024-09-13T19:17:14.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.543+0000 7fc73c324800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:17:14.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.543+0000 7fc73c324800 20 searching for the correct realm 2024-09-13T19:17:14.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.543+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558b478381d0 con 0x558b47833ef0 2024-09-13T19:17:14.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.543+0000 7fc738817640 1 -- 172.21.15.102:0/130508572 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc730028070 con 0x558b47833ef0 2024-09-13T19:17:14.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.543+0000 7fc738817640 1 --2- 172.21.15.102:0/130508572 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fc730021020 0x7fc7300500d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.543+0000 7fc738817640 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558b478381d0 con 0x7fc730021020 2024-09-13T19:17:14.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.543+0000 7fc738016640 1 --2- 172.21.15.102:0/130508572 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fc730021020 0x7fc7300500d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.544+0000 7fc738016640 1 --2- 172.21.15.102:0/130508572 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fc730021020 0x7fc7300500d0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.544+0000 7fc738016640 1 -- 172.21.15.102:0/130508572 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc72801b070 con 0x7fc730021020 2024-09-13T19:17:14.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.544+0000 7fc738016640 1 --2- 172.21.15.102:0/130508572 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fc728027020 0x7fc728026830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.544+0000 7fc738016640 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558b478381d0 con 0x7fc728027020 2024-09-13T19:17:14.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.544+0000 7fc737815640 1 --2- 172.21.15.102:0/130508572 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fc728027020 0x7fc728026830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.545+0000 7fc737815640 1 --2- 172.21.15.102:0/130508572 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fc728027020 0x7fc728026830 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.545+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc720057030 con 0x7fc728027020 2024-09-13T19:17:14.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.545+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558b478381d0 con 0x558b4782f4e0 2024-09-13T19:17:14.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.545+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc720057030 con 0x558b4782f4e0 2024-09-13T19:17:14.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.545+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558b478381d0 con 0x558b4782f4e0 2024-09-13T19:17:14.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.545+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc720057030 con 0x558b4782f4e0 2024-09-13T19:17:14.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.545+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558b478381d0 con 0x7fc728027020 2024-09-13T19:17:14.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.546+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc720057030 con 0x7fc728027020 2024-09-13T19:17:14.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.546+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558b478381d0 con 0x7fc728027020 2024-09-13T19:17:14.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.546+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc720057030 con 0x7fc728027020 2024-09-13T19:17:14.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.546+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558b478381d0 con 0x7fc730021020 2024-09-13T19:17:14.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.546+0000 7fc738016640 1 -- 172.21.15.102:0/130508572 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc72801b070 con 0x7fc730021020 2024-09-13T19:17:14.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.546+0000 7fc738016640 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558b478381d0 con 0x558b47833ef0 2024-09-13T19:17:14.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.546+0000 7fc738817640 1 -- 172.21.15.102:0/130508572 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc730028070 con 0x558b47833ef0 2024-09-13T19:17:14.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.546+0000 7fc738817640 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558b478381d0 con 0x558b4782f4e0 2024-09-13T19:17:14.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.547+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc720057030 con 0x558b4782f4e0 2024-09-13T19:17:14.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.547+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558b478381d0 con 0x7fc730021020 2024-09-13T19:17:14.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.547+0000 7fc738016640 1 -- 172.21.15.102:0/130508572 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc72801b070 con 0x7fc730021020 2024-09-13T19:17:14.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.547+0000 7fc738016640 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558b478381d0 con 0x558b4782f4e0 2024-09-13T19:17:14.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.547+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc720057030 con 0x558b4782f4e0 2024-09-13T19:17:14.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.547+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558b478381d0 con 0x7fc730021020 2024-09-13T19:17:14.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.547+0000 7fc738016640 1 -- 172.21.15.102:0/130508572 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc72801b070 con 0x7fc730021020 2024-09-13T19:17:14.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.547+0000 7fc738016640 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558b478381d0 con 0x558b47833ef0 2024-09-13T19:17:14.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.548+0000 7fc738817640 1 -- 172.21.15.102:0/130508572 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc730028070 con 0x558b47833ef0 2024-09-13T19:17:14.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.548+0000 7fc738817640 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558b478381d0 con 0x558b47833ef0 2024-09-13T19:17:14.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.548+0000 7fc738817640 1 -- 172.21.15.102:0/130508572 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc730028070 con 0x558b47833ef0 2024-09-13T19:17:14.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.548+0000 7fc738817640 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558b478381d0 con 0x7fc728027020 2024-09-13T19:17:14.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.548+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc720057030 con 0x7fc728027020 2024-09-13T19:17:14.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.548+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558b478381d0 con 0x558b47833ef0 2024-09-13T19:17:14.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.549+0000 7fc738817640 1 -- 172.21.15.102:0/130508572 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc730028070 con 0x558b47833ef0 2024-09-13T19:17:14.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.549+0000 7fc738817640 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558b478381d0 con 0x558b47833ef0 2024-09-13T19:17:14.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.549+0000 7fc738817640 1 -- 172.21.15.102:0/130508572 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc730028070 con 0x558b47833ef0 2024-09-13T19:17:14.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.549+0000 7fc738817640 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558b478381d0 con 0x558b4782f4e0 2024-09-13T19:17:14.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.549+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc720057030 con 0x558b4782f4e0 2024-09-13T19:17:14.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.549+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558b478381d0 con 0x558b4782f4e0 2024-09-13T19:17:14.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.549+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc720057030 con 0x558b4782f4e0 2024-09-13T19:17:14.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.549+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558b478381d0 con 0x7fc728027020 2024-09-13T19:17:14.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.550+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc720057030 con 0x7fc728027020 2024-09-13T19:17:14.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.550+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558b478381d0 con 0x558b47833ef0 2024-09-13T19:17:14.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.550+0000 7fc738817640 1 -- 172.21.15.102:0/130508572 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc730028070 con 0x558b47833ef0 2024-09-13T19:17:14.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.550+0000 7fc738817640 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558b478381d0 con 0x7fc730021020 2024-09-13T19:17:14.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.550+0000 7fc738016640 1 -- 172.21.15.102:0/130508572 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc72801b070 con 0x7fc730021020 2024-09-13T19:17:14.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.550+0000 7fc738016640 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558b478381d0 con 0x558b4782f4e0 2024-09-13T19:17:14.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.550+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc720057030 con 0x558b4782f4e0 2024-09-13T19:17:14.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.550+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558b478381d0 con 0x7fc730021020 2024-09-13T19:17:14.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.551+0000 7fc738016640 1 -- 172.21.15.102:0/130508572 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc72801b070 con 0x7fc730021020 2024-09-13T19:17:14.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.551+0000 7fc738016640 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558b478381d0 con 0x558b47833ef0 2024-09-13T19:17:14.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.551+0000 7fc738817640 1 -- 172.21.15.102:0/130508572 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc730028070 con 0x558b47833ef0 2024-09-13T19:17:14.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.551+0000 7fc738817640 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558b478381d0 con 0x7fc728027020 2024-09-13T19:17:14.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.551+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc720057030 con 0x7fc728027020 2024-09-13T19:17:14.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.551+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558b478381d0 con 0x7fc730021020 2024-09-13T19:17:14.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.551+0000 7fc738016640 1 -- 172.21.15.102:0/130508572 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc72801b070 con 0x7fc730021020 2024-09-13T19:17:14.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.551+0000 7fc738016640 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558b478381d0 con 0x558b47833ef0 2024-09-13T19:17:14.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.552+0000 7fc738817640 1 -- 172.21.15.102:0/130508572 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc730028070 con 0x558b47833ef0 2024-09-13T19:17:14.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.552+0000 7fc738817640 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558b478381d0 con 0x7fc728027020 2024-09-13T19:17:14.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.552+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc720057030 con 0x7fc728027020 2024-09-13T19:17:14.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.552+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558b478381d0 con 0x558b4782f4e0 2024-09-13T19:17:14.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.552+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc720057030 con 0x558b4782f4e0 2024-09-13T19:17:14.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.552+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558b478381d0 con 0x7fc730021020 2024-09-13T19:17:14.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.553+0000 7fc738016640 1 -- 172.21.15.102:0/130508572 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc72801b070 con 0x7fc730021020 2024-09-13T19:17:14.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.553+0000 7fc73c324800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:17:14.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.553+0000 7fc73c324800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:17:14.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.553+0000 7fc73c324800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:17:14.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.553+0000 7fc73c324800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:17:14.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.553+0000 7fc73c324800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:17:14.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.553+0000 7fc73c324800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:17:14.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.553+0000 7fc73c324800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.553+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558b478372a0 con 0x558b4782f4e0 2024-09-13T19:17:14.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.553+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc720057030 con 0x558b4782f4e0 2024-09-13T19:17:14.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.553+0000 7fc73c324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:14.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.553+0000 7fc73c324800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.553+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558b47837b40 con 0x558b4782f4e0 2024-09-13T19:17:14.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.553+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc720057030 con 0x558b4782f4e0 2024-09-13T19:17:14.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.553+0000 7fc73c324800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:17:14.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.553+0000 7fc73c324800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.553+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558b47836ee0 con 0x558b47833ef0 2024-09-13T19:17:14.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.553+0000 7fc738817640 1 -- 172.21.15.102:0/130508572 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc730028070 con 0x558b47833ef0 2024-09-13T19:17:14.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.553+0000 7fc73c324800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:17:14.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.553+0000 7fc73c324800 20 zone default found 2024-09-13T19:17:14.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.553+0000 7fc73c324800 4 Realm: () 2024-09-13T19:17:14.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.553+0000 7fc73c324800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:17:14.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.553+0000 7fc73c324800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:17:14.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.553+0000 7fc73c324800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:17:14.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.553+0000 7fc73c324800 20 zonegroup default 2024-09-13T19:17:14.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.553+0000 7fc73c324800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.553+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558b47838b50 con 0x7fc730021020 2024-09-13T19:17:14.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.554+0000 7fc738016640 1 -- 172.21.15.102:0/130508572 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc72801b070 con 0x7fc730021020 2024-09-13T19:17:14.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.554+0000 7fc73c324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:14.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.554+0000 7fc73c324800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.554+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558b47838760 con 0x558b47833ef0 2024-09-13T19:17:14.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.554+0000 7fc738817640 1 -- 172.21.15.102:0/130508572 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc730028070 con 0x558b47833ef0 2024-09-13T19:17:14.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.554+0000 7fc73c324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:14.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.554+0000 7fc73c324800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.554+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558b47838780 con 0x558b47833ef0 2024-09-13T19:17:14.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.554+0000 7fc738817640 1 -- 172.21.15.102:0/130508572 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc730028070 con 0x558b47833ef0 2024-09-13T19:17:14.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.554+0000 7fc73c324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:14.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.554+0000 7fc73c324800 20 started sync module instance, tier type = 2024-09-13T19:17:14.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.554+0000 7fc73c324800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:17:14.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.554+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558b4783a210 con 0x7fc730021020 2024-09-13T19:17:14.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.555+0000 7fc738016640 1 -- 172.21.15.102:0/130508572 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(44 notify.0 [create] v36'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc72801b070 con 0x7fc730021020 2024-09-13T19:17:14.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.555+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94056688625152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558b4783b340 con 0x7fc730021020 2024-09-13T19:17:14.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.555+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558b4783bb90 con 0x558b4782f4e0 2024-09-13T19:17:14.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.556+0000 7fc738016640 1 -- 172.21.15.102:0/130508572 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94056688625152] v36'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc72801b070 con 0x7fc730021020 2024-09-13T19:17:14.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.557+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v36'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc720057030 con 0x558b4782f4e0 2024-09-13T19:17:14.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.557+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94056688627344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558b4783c3e0 con 0x558b4782f4e0 2024-09-13T19:17:14.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.557+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558b4783cc30 con 0x558b47833ef0 2024-09-13T19:17:14.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.558+0000 7fc738817640 1 -- 172.21.15.102:0/130508572 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v36'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc730028070 con 0x558b47833ef0 2024-09-13T19:17:14.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.558+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94056688627344] v36'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc720057030 con 0x558b4782f4e0 2024-09-13T19:17:14.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.558+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94056688633280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558b4783ce90 con 0x558b47833ef0 2024-09-13T19:17:14.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.558+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558b4783d6e0 con 0x7fc730021020 2024-09-13T19:17:14.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.559+0000 7fc738016640 1 -- 172.21.15.102:0/130508572 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(50 notify.3 [create] v36'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc72801b070 con 0x7fc730021020 2024-09-13T19:17:14.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.559+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94056688636016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558b4783db40 con 0x7fc730021020 2024-09-13T19:17:14.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.559+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558b4783e640 con 0x558b4782f4e0 2024-09-13T19:17:14.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.559+0000 7fc738817640 1 -- 172.21.15.102:0/130508572 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94056688633280] v36'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc730028070 con 0x558b47833ef0 2024-09-13T19:17:14.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.560+0000 7fc738016640 1 -- 172.21.15.102:0/130508572 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94056688636016] v36'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc72801b070 con 0x7fc730021020 2024-09-13T19:17:14.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.560+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v36'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc720057030 con 0x558b4782f4e0 2024-09-13T19:17:14.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.560+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94056688640304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558b4783e600 con 0x558b4782f4e0 2024-09-13T19:17:14.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.560+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558b4783ef10 con 0x7fc728027020 2024-09-13T19:17:14.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.561+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94056688640304] v36'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc720057030 con 0x558b4782f4e0 2024-09-13T19:17:14.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.561+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(54 notify.5 [create] v36'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc720057030 con 0x7fc728027020 2024-09-13T19:17:14.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.561+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94056688634336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558b4783e600 con 0x7fc728027020 2024-09-13T19:17:14.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.561+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558b4783f540 con 0x7fc728027020 2024-09-13T19:17:14.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.562+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94056688634336] v36'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc720057030 con 0x7fc728027020 2024-09-13T19:17:14.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.562+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(56 notify.6 [create] v36'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc720057030 con 0x7fc728027020 2024-09-13T19:17:14.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.562+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94056688644144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558b4783f500 con 0x7fc728027020 2024-09-13T19:17:14.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.562+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558b4783ff40 con 0x7fc728027020 2024-09-13T19:17:14.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.563+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94056688644144] v36'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc720057030 con 0x7fc728027020 2024-09-13T19:17:14.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.563+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(58 notify.7 [create] v36'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc720057030 con 0x7fc728027020 2024-09-13T19:17:14.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.563+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94056688646672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558b4783ff00 con 0x7fc728027020 2024-09-13T19:17:14.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.563+0000 7fc73c324800 20 add_watcher() i=0 2024-09-13T19:17:14.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.563+0000 7fc73c324800 20 add_watcher() i=1 2024-09-13T19:17:14.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.563+0000 7fc73c324800 20 add_watcher() i=2 2024-09-13T19:17:14.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.563+0000 7fc73c324800 20 add_watcher() i=3 2024-09-13T19:17:14.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.563+0000 7fc73c324800 20 add_watcher() i=4 2024-09-13T19:17:14.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.563+0000 7fc73c324800 20 add_watcher() i=5 2024-09-13T19:17:14.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.563+0000 7fc73c324800 20 add_watcher() i=6 2024-09-13T19:17:14.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.564+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94056688646672] v36'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc720057030 con 0x7fc728027020 2024-09-13T19:17:14.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.564+0000 7fc73c324800 20 add_watcher() i=7 2024-09-13T19:17:14.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.564+0000 7fc73c324800 2 all 8 watchers are set, enabling cache 2024-09-13T19:17:14.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.564+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558b47843360 con 0x558b4782f4e0 2024-09-13T19:17:14.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.565+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc720057030 con 0x558b4782f4e0 2024-09-13T19:17:14.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.565+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94056688642576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558b47840830 con 0x558b4782f4e0 2024-09-13T19:17:14.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.566+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94056688642576] v36'204 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc720057030 con 0x558b4782f4e0 2024-09-13T19:17:14.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.566+0000 7fc5ee7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:17:14.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.566+0000 7fc73c324800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:17:14.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.566+0000 7fc73c324800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:17:14.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.566+0000 7fc73c324800 5 note: GC not initialized 2024-09-13T19:17:14.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.566+0000 7fc5ed7e2640 20 reqs_thread_entry: start 2024-09-13T19:17:14.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.566+0000 7fc73c324800 20 init_complete bucket index max shards: 11 2024-09-13T19:17:14.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.566+0000 7fc73c324800 20 Filter name: none 2024-09-13T19:17:14.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.566+0000 7fc55effd640 20 reqs_thread_entry: start 2024-09-13T19:17:14.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.566+0000 7fc73c324800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.566+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558b47876280 con 0x558b4782f4e0 2024-09-13T19:17:14.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.567+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc720057030 con 0x558b4782f4e0 2024-09-13T19:17:14.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.567+0000 7fc73c324800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:17:14.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.567+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558b478777d0 con 0x7fc728027020 2024-09-13T19:17:14.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.567+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7fc720057030 con 0x7fc728027020 2024-09-13T19:17:14.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.568+0000 7fc5ee7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:17:14.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.568+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94056688642576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558b47874880 con 0x558b4782f4e0 2024-09-13T19:17:14.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.569+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94056688642576] v36'205 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc720057030 con 0x558b4782f4e0 2024-09-13T19:17:14.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.569+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94056688625152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558b4783ea10 con 0x7fc730021020 2024-09-13T19:17:14.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.570+0000 7fc738016640 1 -- 172.21.15.102:0/130508572 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94056688625152] v36'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc72801b070 con 0x7fc730021020 2024-09-13T19:17:14.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.570+0000 7fc73c324800 20 remove_watcher() i=0 2024-09-13T19:17:14.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.570+0000 7fc73c324800 2 removed watcher, disabling cache 2024-09-13T19:17:14.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.570+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94056688627344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558b4783ea10 con 0x558b4782f4e0 2024-09-13T19:17:14.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.571+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94056688627344] v36'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc720057030 con 0x558b4782f4e0 2024-09-13T19:17:14.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.571+0000 7fc73c324800 20 remove_watcher() i=1 2024-09-13T19:17:14.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.571+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94056688633280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558b4783ae90 con 0x558b47833ef0 2024-09-13T19:17:14.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.572+0000 7fc738817640 1 -- 172.21.15.102:0/130508572 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94056688633280] v36'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc730028070 con 0x558b47833ef0 2024-09-13T19:17:14.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.572+0000 7fc73c324800 20 remove_watcher() i=2 2024-09-13T19:17:14.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.572+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94056688636016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558b4783ea10 con 0x7fc730021020 2024-09-13T19:17:14.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.573+0000 7fc738016640 1 -- 172.21.15.102:0/130508572 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94056688636016] v36'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc72801b070 con 0x7fc730021020 2024-09-13T19:17:14.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.573+0000 7fc73c324800 20 remove_watcher() i=3 2024-09-13T19:17:14.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.573+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94056688640304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558b4783c5c0 con 0x558b4782f4e0 2024-09-13T19:17:14.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.574+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94056688640304] v36'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc720057030 con 0x558b4782f4e0 2024-09-13T19:17:14.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.574+0000 7fc73c324800 20 remove_watcher() i=4 2024-09-13T19:17:14.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.574+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94056688634336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558b4783ae90 con 0x7fc728027020 2024-09-13T19:17:14.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.575+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94056688634336] v36'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc720057030 con 0x7fc728027020 2024-09-13T19:17:14.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.575+0000 7fc73c324800 20 remove_watcher() i=5 2024-09-13T19:17:14.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.575+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94056688644144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558b4783ea10 con 0x7fc728027020 2024-09-13T19:17:14.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.576+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94056688644144] v36'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc720057030 con 0x7fc728027020 2024-09-13T19:17:14.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.576+0000 7fc73c324800 20 remove_watcher() i=6 2024-09-13T19:17:14.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.576+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94056688646672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558b4783ae90 con 0x7fc728027020 2024-09-13T19:17:14.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.577+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94056688646672] v36'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc720057030 con 0x7fc728027020 2024-09-13T19:17:14.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.577+0000 7fc73c324800 20 remove_watcher() i=7 2024-09-13T19:17:14.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.577+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fc728027020 msgr2=0x7fc728026830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.577+0000 7fc73c324800 1 --2- 172.21.15.102:0/130508572 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fc728027020 0x7fc728026830 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.577+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x558b4782f4e0 msgr2=0x558b478319a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.577+0000 7fc73c324800 1 --2- 172.21.15.102:0/130508572 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x558b4782f4e0 0x558b478319a0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.577+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fc730021020 msgr2=0x7fc7300500d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.577+0000 7fc73c324800 1 --2- 172.21.15.102:0/130508572 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fc730021020 0x7fc7300500d0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.577+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x558b47833ef0 msgr2=0x558b478362e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.577+0000 7fc73c324800 1 --2- 172.21.15.102:0/130508572 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x558b47833ef0 0x558b478362e0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.578+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc608036b40 msgr2=0x7fc608039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.578+0000 7fc73c324800 1 --2- 172.21.15.102:0/130508572 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc608036b40 0x7fc608039000 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc72804b180 tx=0x7fc728037000 comp rx=0 tx=0).stop 2024-09-13T19:17:14.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.578+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b4781c4c0 msgr2=0x558b47823990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.578+0000 7fc73c324800 1 --2- 172.21.15.102:0/130508572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b4781c4c0 0x558b47823990 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fc7300087f0 tx=0x7fc73004c5f0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.578+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 reap_dead start 2024-09-13T19:17:14.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.578+0000 7fc737815640 1 -- 172.21.15.102:0/130508572 reap_dead start 2024-09-13T19:17:14.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.578+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 shutdown_connections 2024-09-13T19:17:14.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.578+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 >> 172.21.15.102:0/130508572 conn(0x558b478188b0 msgr2=0x558b47816980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:14.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.578+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 shutdown_connections 2024-09-13T19:17:14.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.578+0000 7fc73c324800 1 -- 172.21.15.102:0/130508572 wait complete. 2024-09-13T19:17:14.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.578+0000 7fc73c324800 1 -- 172.21.15.102:0/1025872797 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc610036bb0 msgr2=0x7fc610039070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.578+0000 7fc73c324800 1 --2- 172.21.15.102:0/1025872797 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc610036bb0 0x7fc610039070 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc728012fd0 tx=0x7fc728011f40 comp rx=0 tx=0).stop 2024-09-13T19:17:14.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.578+0000 7fc73c324800 1 -- 172.21.15.102:0/1025872797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b4780f880 msgr2=0x558b4780fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.578+0000 7fc73c324800 1 --2- 172.21.15.102:0/1025872797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b4780f880 0x558b4780fca0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x558b477f57c0 tx=0x7fc73000beb0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.578+0000 7fc73c324800 1 -- 172.21.15.102:0/1025872797 shutdown_connections 2024-09-13T19:17:14.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.578+0000 7fc73c324800 1 --2- 172.21.15.102:0/1025872797 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc610036bb0 0x7fc610039070 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.578+0000 7fc73c324800 1 --2- 172.21.15.102:0/1025872797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b4780f880 0x558b4780fca0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.578+0000 7fc73c324800 1 -- 172.21.15.102:0/1025872797 >> 172.21.15.102:0/1025872797 conn(0x558b47804810 msgr2=0x558b47807390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:14.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.578+0000 7fc73c324800 1 -- 172.21.15.102:0/1025872797 shutdown_connections 2024-09-13T19:17:14.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.578+0000 7fc73c324800 1 -- 172.21.15.102:0/1025872797 wait complete. 2024-09-13T19:17:14.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.578+0000 7fc73c324800 1 -- 172.21.15.102:0/2548112357 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x558b477f9770 msgr2=0x558b477fbb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.578+0000 7fc73c324800 1 --2- 172.21.15.102:0/2548112357 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x558b477f9770 0x558b477fbb60 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.578+0000 7fc73c324800 1 -- 172.21.15.102:0/2548112357 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x558b477fe420 msgr2=0x558b47800810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.578+0000 7fc73c324800 1 --2- 172.21.15.102:0/2548112357 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x558b477fe420 0x558b47800810 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.578+0000 7fc73c324800 1 -- 172.21.15.102:0/2548112357 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc620036b40 msgr2=0x7fc620039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.578+0000 7fc73c324800 1 --2- 172.21.15.102:0/2548112357 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc620036b40 0x7fc620039000 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc720057000 tx=0x7fc720052000 comp rx=0 tx=0).stop 2024-09-13T19:17:14.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.578+0000 7fc73c324800 1 -- 172.21.15.102:0/2548112357 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b47701d20 msgr2=0x558b477f4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.578+0000 7fc73c324800 1 --2- 172.21.15.102:0/2548112357 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b47701d20 0x558b477f4710 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fc728000f80 tx=0x7fc728001250 comp rx=0 tx=0).stop 2024-09-13T19:17:14.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.579+0000 7fc73c324800 1 -- 172.21.15.102:0/2548112357 shutdown_connections 2024-09-13T19:17:14.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.579+0000 7fc73c324800 1 --2- 172.21.15.102:0/2548112357 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x558b477fe420 0x558b47800810 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.579+0000 7fc73c324800 1 --2- 172.21.15.102:0/2548112357 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x558b477f9770 0x558b477fbb60 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.579+0000 7fc73c324800 1 --2- 172.21.15.102:0/2548112357 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc620036b40 0x7fc620039000 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.579+0000 7fc73c324800 1 --2- 172.21.15.102:0/2548112357 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558b47701d20 0x558b477f4710 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.579+0000 7fc73c324800 1 -- 172.21.15.102:0/2548112357 >> 172.21.15.102:0/2548112357 conn(0x558b476f5db0 msgr2=0x558b477e6d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:14.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.579+0000 7fc73c324800 1 -- 172.21.15.102:0/2548112357 shutdown_connections 2024-09-13T19:17:14.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.579+0000 7fc73c324800 1 -- 172.21.15.102:0/2548112357 wait complete. 2024-09-13T19:17:14.602 INFO:teuthology.orchestra.run.smithi102.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}}]} 2024-09-13T19:17:14.602 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}}]} 2024-09-13T19:17:14.602 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-13T19:17:14.603 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-13T19:17:14.603 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2024-09-13T19:17:14.649 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:17:14.649 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:17:14.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.646+0000 7f67a6f42800 1 Processor -- start 2024-09-13T19:17:14.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.646+0000 7f67a6f42800 1 -- start start 2024-09-13T19:17:14.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.647+0000 7f67a6f42800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55ceabaee900 0x55ceabaf0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.647+0000 7f67a6f42800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ceab9a9b30 con 0x55ceaba5e650 2024-09-13T19:17:14.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.647+0000 7f67a6f42800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55ceab98b360 con 0x55ceabaee900 2024-09-13T19:17:14.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.647+0000 7f679bfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55ceabaee900 0x55ceabaf0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.647+0000 7f679bfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55ceabaee900 0x55ceabaf0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41238/0 (socket says 172.21.15.102:41238) 2024-09-13T19:17:14.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.647+0000 7f67a2c90640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55ceaba5e650 0x55ceabaed1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:50046/0 (socket says 172.21.15.102:50046) 2024-09-13T19:17:14.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.647+0000 7f679bfff640 1 -- 172.21.15.102:0/2556928531 learned_addr learned my addr 172.21.15.102:0/2556928531 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:14.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.647+0000 7f679bfff640 1 -- 172.21.15.102:0/2556928531 >> v1:172.21.15.53:6789/0 conn(0x55ceaba5e650 legacy=0x55ceabaed1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.647+0000 7f67a248f640 1 -- 172.21.15.102:0/2556928531 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2550489850 0 0) 0x55ceab9a9b30 con 0x55ceaba5e650 2024-09-13T19:17:14.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.647+0000 7f679bfff640 1 -- 172.21.15.102:0/2556928531 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ceab9b1e00 con 0x55ceabaee900 2024-09-13T19:17:14.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.649+0000 7f679bfff640 1 --2- 172.21.15.102:0/2556928531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ceabaee900 0x55ceabaf0cf0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f678c00a520 tx=0x7f678c045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af283fb23a3d404f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.649+0000 7f67a248f640 1 -- 172.21.15.102:0/2556928531 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f678c055070 con 0x55ceabaee900 2024-09-13T19:17:14.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.649+0000 7f67a248f640 1 -- 172.21.15.102:0/2556928531 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f678c0515b0 con 0x55ceabaee900 2024-09-13T19:17:14.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.649+0000 7f67a248f640 1 -- 172.21.15.102:0/2556928531 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f678c0518d0 con 0x55ceabaee900 2024-09-13T19:17:14.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.650+0000 7f67a6f42800 1 -- 172.21.15.102:0/2556928531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ceabaee900 msgr2=0x55ceabaf0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.650+0000 7f67a6f42800 1 --2- 172.21.15.102:0/2556928531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ceabaee900 0x55ceabaf0cf0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f678c00a520 tx=0x7f678c045ba0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.650+0000 7f67a6f42800 1 -- 172.21.15.102:0/2556928531 shutdown_connections 2024-09-13T19:17:14.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.650+0000 7f67a6f42800 1 --2- 172.21.15.102:0/2556928531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ceabaee900 0x55ceabaf0cf0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.650+0000 7f67a6f42800 1 -- 172.21.15.102:0/2556928531 >> 172.21.15.102:0/2556928531 conn(0x55ceabae4db0 msgr2=0x55ceabae71d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:14.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.650+0000 7f67a6f42800 1 -- 172.21.15.102:0/2556928531 shutdown_connections 2024-09-13T19:17:14.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.650+0000 7f67a6f42800 1 -- 172.21.15.102:0/2556928531 wait complete. 2024-09-13T19:17:14.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.663+0000 7f67a6f42800 1 Processor -- start 2024-09-13T19:17:14.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.663+0000 7f67a6f42800 1 -- start start 2024-09-13T19:17:14.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.664+0000 7f67a6f42800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ceaba5e650 0x55ceabbd9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.664+0000 7f67a6f42800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ceaba36360 con 0x55ceaba5e650 2024-09-13T19:17:14.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.664+0000 7f67a2c90640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ceaba5e650 0x55ceabbd9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.664+0000 7f67a2c90640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ceaba5e650 0x55ceabbd9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41254/0 (socket says 172.21.15.102:41254) 2024-09-13T19:17:14.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.664+0000 7f67a2c90640 1 -- 172.21.15.102:0/2129993316 learned_addr learned my addr 172.21.15.102:0/2129993316 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:14.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.664+0000 7f67a2c90640 1 -- 172.21.15.102:0/2129993316 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ceab983bc0 con 0x55ceaba5e650 2024-09-13T19:17:14.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.664+0000 7f67a2c90640 1 --2- 172.21.15.102:0/2129993316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ceaba5e650 0x55ceabbd9660 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f679400b240 tx=0x7f679400b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee7b26e4f48433f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.665+0000 7f6690e09640 1 -- 172.21.15.102:0/2129993316 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6794008070 con 0x55ceaba5e650 2024-09-13T19:17:14.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.665+0000 7f6690e09640 1 -- 172.21.15.102:0/2129993316 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f679400d500 con 0x55ceaba5e650 2024-09-13T19:17:14.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.665+0000 7f6690e09640 1 -- 172.21.15.102:0/2129993316 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f679400d860 con 0x55ceaba5e650 2024-09-13T19:17:14.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.665+0000 7f67a6f42800 1 -- 172.21.15.102:0/2129993316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ceaba5e650 msgr2=0x55ceabbd9660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.665+0000 7f67a6f42800 1 --2- 172.21.15.102:0/2129993316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ceaba5e650 0x55ceabbd9660 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f679400b240 tx=0x7f679400b700 comp rx=0 tx=0).stop 2024-09-13T19:17:14.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.665+0000 7f67a6f42800 1 -- 172.21.15.102:0/2129993316 shutdown_connections 2024-09-13T19:17:14.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.665+0000 7f67a6f42800 1 --2- 172.21.15.102:0/2129993316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ceaba5e650 0x55ceabbd9660 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.665+0000 7f67a6f42800 1 -- 172.21.15.102:0/2129993316 >> 172.21.15.102:0/2129993316 conn(0x55ceabae4db0 msgr2=0x55ceabbd5020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:14.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.665+0000 7f67a6f42800 1 -- 172.21.15.102:0/2129993316 shutdown_connections 2024-09-13T19:17:14.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.666+0000 7f67a6f42800 1 -- 172.21.15.102:0/2129993316 wait complete. 2024-09-13T19:17:14.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.666+0000 7f67a6f42800 1 Processor -- start 2024-09-13T19:17:14.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.666+0000 7f67a6f42800 1 -- start start 2024-09-13T19:17:14.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.666+0000 7f67a6f42800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ceaba5e650 0x55ceabbe10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.666+0000 7f67a6f42800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ceabaf1620 con 0x55ceaba5e650 2024-09-13T19:17:14.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.666+0000 7f67a2c90640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ceaba5e650 0x55ceabbe10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.666+0000 7f67a2c90640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ceaba5e650 0x55ceabbe10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41264/0 (socket says 172.21.15.102:41264) 2024-09-13T19:17:14.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.666+0000 7f67a2c90640 1 -- 172.21.15.102:0/1068993053 learned_addr learned my addr 172.21.15.102:0/1068993053 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:14.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.667+0000 7f67a2c90640 1 -- 172.21.15.102:0/1068993053 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ceab997fe0 con 0x55ceaba5e650 2024-09-13T19:17:14.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.667+0000 7f67a2c90640 1 --2- 172.21.15.102:0/1068993053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ceaba5e650 0x55ceabbe10e0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x55ceabbda4c0 tx=0x7f6794000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.667+0000 7f668f606640 1 -- 172.21.15.102:0/1068993053 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6794019870 con 0x55ceaba5e650 2024-09-13T19:17:14.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.667+0000 7f668f606640 1 -- 172.21.15.102:0/1068993053 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6794019a10 con 0x55ceaba5e650 2024-09-13T19:17:14.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.667+0000 7f67a6f42800 1 -- 172.21.15.102:0/1068993053 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ceabbe1620 con 0x55ceaba5e650 2024-09-13T19:17:14.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.667+0000 7f668f606640 1 -- 172.21.15.102:0/1068993053 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6794019d30 con 0x55ceaba5e650 2024-09-13T19:17:14.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.667+0000 7f67a6f42800 1 -- 172.21.15.102:0/1068993053 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ceabbe1b40 con 0x55ceaba5e650 2024-09-13T19:17:14.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.668+0000 7f668f606640 1 -- 172.21.15.102:0/1068993053 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6794017040 con 0x55ceaba5e650 2024-09-13T19:17:14.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.668+0000 7f668f606640 1 --2- 172.21.15.102:0/1068993053 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6688036b90 0x7f6688039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.668+0000 7f668f606640 1 -- 172.21.15.102:0/1068993053 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f6794015020 con 0x55ceaba5e650 2024-09-13T19:17:14.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.668+0000 7f679bfff640 1 --2- 172.21.15.102:0/1068993053 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6688036b90 0x7f6688039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.668+0000 7f67a6f42800 1 --2- 172.21.15.102:0/1068993053 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55ceabaee900 0x55ceabbe8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.668+0000 7f67a6f42800 1 -- 172.21.15.102:0/1068993053 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ceabbe86d0 con 0x55ceabaee900 2024-09-13T19:17:14.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.668+0000 7f67a3491640 1 --2- 172.21.15.102:0/1068993053 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55ceabaee900 0x55ceabbe8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.669+0000 7f679bfff640 1 --2- 172.21.15.102:0/1068993053 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6688036b90 0x7f6688039050 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f678c057000 tx=0x7f678c052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.669+0000 7f67a3491640 1 --2- 172.21.15.102:0/1068993053 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55ceabaee900 0x55ceabbe8150 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.669+0000 7f67a3491640 1 -- 172.21.15.102:0/1068993053 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f679c00a4a0 con 0x55ceabaee900 2024-09-13T19:17:14.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.669+0000 7f67a6f42800 1 -- 172.21.15.102:0/1068993053 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ceabbe5700 con 0x55ceabaee900 2024-09-13T19:17:14.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.669+0000 7f67a3491640 1 -- 172.21.15.102:0/1068993053 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f679c00a4a0 con 0x55ceabaee900 2024-09-13T19:17:14.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.669+0000 7f67a6f42800 1 --2- 172.21.15.102:0/1068993053 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55ceabbeaa00 0x55ceabbecdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.669+0000 7f67a6f42800 1 -- 172.21.15.102:0/1068993053 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ceabbed490 con 0x55ceabbeaa00 2024-09-13T19:17:14.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.669+0000 7f67a2c90640 1 --2- 172.21.15.102:0/1068993053 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55ceabbeaa00 0x55ceabbecdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.670+0000 7f67a2c90640 1 --2- 172.21.15.102:0/1068993053 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55ceabbeaa00 0x55ceabbecdf0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.670+0000 7f67a2c90640 1 -- 172.21.15.102:0/1068993053 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f679402d070 con 0x55ceabbeaa00 2024-09-13T19:17:14.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.670+0000 7f67a6f42800 1 -- 172.21.15.102:0/1068993053 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ceabbe98a0 con 0x55ceabaee900 2024-09-13T19:17:14.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.670+0000 7f67a3491640 1 -- 172.21.15.102:0/1068993053 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f679c00a4a0 con 0x55ceabaee900 2024-09-13T19:17:14.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.670+0000 7f67a6f42800 1 -- 172.21.15.102:0/1068993053 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ceabbe9d80 con 0x55ceabbeaa00 2024-09-13T19:17:14.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.671+0000 7f67a2c90640 1 -- 172.21.15.102:0/1068993053 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f679402d070 con 0x55ceabbeaa00 2024-09-13T19:17:14.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.671+0000 7f67a6f42800 1 Processor -- start 2024-09-13T19:17:14.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.671+0000 7f67a6f42800 1 -- start start 2024-09-13T19:17:14.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.671+0000 7f67a6f42800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ceabbfbe40 0x55ceabbfc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.671+0000 7f67a6f42800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ceab985580 con 0x55ceabbfbe40 2024-09-13T19:17:14.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.671+0000 7f67a3491640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ceabbfbe40 0x55ceabbfc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.671+0000 7f67a3491640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ceabbfbe40 0x55ceabbfc260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41268/0 (socket says 172.21.15.102:41268) 2024-09-13T19:17:14.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.672+0000 7f67a3491640 1 -- 172.21.15.102:0/2033838771 learned_addr learned my addr 172.21.15.102:0/2033838771 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:14.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.672+0000 7f67a3491640 1 -- 172.21.15.102:0/2033838771 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ceabbfc7a0 con 0x55ceabbfbe40 2024-09-13T19:17:14.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.672+0000 7f67a3491640 1 --2- 172.21.15.102:0/2033838771 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ceabbfbe40 0x55ceabbfc260 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x55ceabbe2190 tx=0x7f679c0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.672+0000 7f668ce01640 1 -- 172.21.15.102:0/2033838771 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f679c013640 con 0x55ceabbfbe40 2024-09-13T19:17:14.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.672+0000 7f668ce01640 1 -- 172.21.15.102:0/2033838771 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f679c0137e0 con 0x55ceabbfbe40 2024-09-13T19:17:14.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.672+0000 7f668ce01640 1 -- 172.21.15.102:0/2033838771 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f679c013ae0 con 0x55ceabbfbe40 2024-09-13T19:17:14.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.672+0000 7f67a6f42800 1 -- 172.21.15.102:0/2033838771 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ceabbfca30 con 0x55ceabbfbe40 2024-09-13T19:17:14.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.672+0000 7f67a6f42800 1 -- 172.21.15.102:0/2033838771 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ceabbff710 con 0x55ceabbfbe40 2024-09-13T19:17:14.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.673+0000 7f668ce01640 1 -- 172.21.15.102:0/2033838771 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f679c011040 con 0x55ceabbfbe40 2024-09-13T19:17:14.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.673+0000 7f668ce01640 1 --2- 172.21.15.102:0/2033838771 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f667c036b40 0x7f667c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.673+0000 7f668ce01640 1 -- 172.21.15.102:0/2033838771 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f679c00e040 con 0x55ceabbfbe40 2024-09-13T19:17:14.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.673+0000 7f67a2c90640 1 --2- 172.21.15.102:0/2033838771 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f667c036b40 0x7f667c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.674+0000 7f67a6f42800 1 Processor -- start 2024-09-13T19:17:14.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.674+0000 7f67a2c90640 1 --2- 172.21.15.102:0/2033838771 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f667c036b40 0x7f667c039000 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x55ceabbe5640 tx=0x7f679404b640 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.674+0000 7f67a6f42800 1 -- start start 2024-09-13T19:17:14.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.674+0000 7f67a6f42800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ceabaea460 0x55ceabaea860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.674+0000 7f67a6f42800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ceabbd9e10 con 0x55ceabaea460 2024-09-13T19:17:14.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.674+0000 7f67a3491640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ceabaea460 0x55ceabaea860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.674+0000 7f67a3491640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ceabaea460 0x55ceabaea860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41284/0 (socket says 172.21.15.102:41284) 2024-09-13T19:17:14.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.674+0000 7f67a3491640 1 -- 172.21.15.102:0/3312594162 learned_addr learned my addr 172.21.15.102:0/3312594162 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:14.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.675+0000 7f67a3491640 1 -- 172.21.15.102:0/3312594162 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ceabaeae30 con 0x55ceabaea460 2024-09-13T19:17:14.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.675+0000 7f67a3491640 1 --2- 172.21.15.102:0/3312594162 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ceabaea460 0x55ceabaea860 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f679c00afb0 tx=0x7f679c020f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6ad719a8f48b553 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.675+0000 7f66867fc640 1 -- 172.21.15.102:0/3312594162 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f679c021ae0 con 0x55ceabaea460 2024-09-13T19:17:14.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.675+0000 7f66867fc640 1 -- 172.21.15.102:0/3312594162 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f679c04a030 con 0x55ceabaea460 2024-09-13T19:17:14.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.675+0000 7f66867fc640 1 -- 172.21.15.102:0/3312594162 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f679c01f470 con 0x55ceabaea460 2024-09-13T19:17:14.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.675+0000 7f67a6f42800 1 -- 172.21.15.102:0/3312594162 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ceabaea460 msgr2=0x55ceabaea860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.675+0000 7f67a6f42800 1 --2- 172.21.15.102:0/3312594162 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ceabaea460 0x55ceabaea860 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f679c00afb0 tx=0x7f679c020f10 comp rx=0 tx=0).stop 2024-09-13T19:17:14.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.675+0000 7f67a6f42800 1 -- 172.21.15.102:0/3312594162 shutdown_connections 2024-09-13T19:17:14.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.675+0000 7f67a6f42800 1 --2- 172.21.15.102:0/3312594162 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ceabaea460 0x55ceabaea860 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.675+0000 7f67a6f42800 1 -- 172.21.15.102:0/3312594162 >> 172.21.15.102:0/3312594162 conn(0x55ceabc04ed0 msgr2=0x55ceabc02fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:14.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.675+0000 7f67a6f42800 1 -- 172.21.15.102:0/3312594162 shutdown_connections 2024-09-13T19:17:14.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.675+0000 7f67a6f42800 1 -- 172.21.15.102:0/3312594162 wait complete. 2024-09-13T19:17:14.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.676+0000 7f67a6f42800 1 Processor -- start 2024-09-13T19:17:14.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.676+0000 7f67a6f42800 1 -- start start 2024-09-13T19:17:14.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.676+0000 7f67a6f42800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ceabaea460 0x55ceabc12110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.676+0000 7f67a6f42800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ceabae9140 con 0x55ceabaea460 2024-09-13T19:17:14.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.676+0000 7f67a3491640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ceabaea460 0x55ceabc12110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.676+0000 7f67a3491640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ceabaea460 0x55ceabc12110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41300/0 (socket says 172.21.15.102:41300) 2024-09-13T19:17:14.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.676+0000 7f67a3491640 1 -- 172.21.15.102:0/4215967611 learned_addr learned my addr 172.21.15.102:0/4215967611 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:14.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.676+0000 7f67a3491640 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ceabc12650 con 0x55ceabaea460 2024-09-13T19:17:14.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.677+0000 7f67a3491640 1 --2- 172.21.15.102:0/4215967611 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ceabaea460 0x55ceabc12110 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f679c00a120 tx=0x7f679c04cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.677+0000 7f6684ff9640 1 -- 172.21.15.102:0/4215967611 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f679c0400e0 con 0x55ceabaea460 2024-09-13T19:17:14.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.677+0000 7f6684ff9640 1 -- 172.21.15.102:0/4215967611 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f679c03de50 con 0x55ceabaea460 2024-09-13T19:17:14.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.677+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ceabc128e0 con 0x55ceabaea460 2024-09-13T19:17:14.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.677+0000 7f6684ff9640 1 -- 172.21.15.102:0/4215967611 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f679c040410 con 0x55ceabaea460 2024-09-13T19:17:14.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.677+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ceabc128e0 con 0x55ceabaea460 2024-09-13T19:17:14.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.677+0000 7f6684ff9640 1 -- 172.21.15.102:0/4215967611 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f679c0205b0 con 0x55ceabaea460 2024-09-13T19:17:14.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.678+0000 7f6684ff9640 1 --2- 172.21.15.102:0/4215967611 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f666c036b40 0x7f666c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.678+0000 7f6684ff9640 1 -- 172.21.15.102:0/4215967611 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f679c0509b0 con 0x55ceabaea460 2024-09-13T19:17:14.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.678+0000 7f67a2c90640 1 --2- 172.21.15.102:0/4215967611 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f666c036b40 0x7f666c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.678+0000 7f67a6f42800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.678+0000 7f67a6f42800 1 --2- 172.21.15.102:0/4215967611 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55ceabc1da30 0x55ceabc1fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.678+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ceabc20640 con 0x55ceabc1da30 2024-09-13T19:17:14.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.678+0000 7f679bfff640 1 --2- 172.21.15.102:0/4215967611 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55ceabc1da30 0x55ceabc1fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.678+0000 7f67a2c90640 1 --2- 172.21.15.102:0/4215967611 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f666c036b40 0x7f666c039000 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f679400e6d0 tx=0x7f6794033000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.678+0000 7f679bfff640 1 --2- 172.21.15.102:0/4215967611 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55ceabc1da30 0x55ceabc1fef0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.679+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f678c057030 con 0x55ceabc1da30 2024-09-13T19:17:14.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.679+0000 7f67a6f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:14.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.679+0000 7f67a6f42800 20 realm 2024-09-13T19:17:14.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.679+0000 7f67a6f42800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.679+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ceabc20a70 con 0x55ceabc1da30 2024-09-13T19:17:14.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.679+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f678c057030 con 0x55ceabc1da30 2024-09-13T19:17:14.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.679+0000 7f67a6f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:14.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.679+0000 7f67a6f42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:17:14.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.679+0000 7f67a6f42800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.679+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ceabc21340 con 0x55ceabc1da30 2024-09-13T19:17:14.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.679+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f678c057030 con 0x55ceabc1da30 2024-09-13T19:17:14.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.679+0000 7f67a6f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:14.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.679+0000 7f67a6f42800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.679+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ceabc216e0 con 0x55ceabc1da30 2024-09-13T19:17:14.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.679+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f678c057030 con 0x55ceabc1da30 2024-09-13T19:17:14.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.679+0000 7f67a6f42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:17:14.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.679+0000 7f67a6f42800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.679+0000 7f67a6f42800 1 --2- 172.21.15.102:0/4215967611 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55ceabc22440 0x55ceabc24830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.679+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ceabc24d70 con 0x55ceabc22440 2024-09-13T19:17:14.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.679+0000 7f67a3491640 1 --2- 172.21.15.102:0/4215967611 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55ceabc22440 0x55ceabc24830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.680+0000 7f67a3491640 1 --2- 172.21.15.102:0/4215967611 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55ceabc22440 0x55ceabc24830 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.680+0000 7f67a3491640 1 -- 172.21.15.102:0/4215967611 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f679c00a4a0 con 0x55ceabc22440 2024-09-13T19:17:14.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.680+0000 7f67a6f42800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:17:14.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.680+0000 7f67a6f42800 20 searching for the correct realm 2024-09-13T19:17:14.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.680+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ceabc266e0 con 0x55ceabc22440 2024-09-13T19:17:14.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.680+0000 7f67a3491640 1 -- 172.21.15.102:0/4215967611 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f679c00a4a0 con 0x55ceabc22440 2024-09-13T19:17:14.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.680+0000 7f67a3491640 1 --2- 172.21.15.102:0/4215967611 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f679c0123d0 0x7f679c040850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.680+0000 7f67a3491640 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ceabc266e0 con 0x7f679c0123d0 2024-09-13T19:17:14.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.680+0000 7f67a2c90640 1 --2- 172.21.15.102:0/4215967611 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f679c0123d0 0x7f679c040850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.681+0000 7f67a2c90640 1 --2- 172.21.15.102:0/4215967611 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f679c0123d0 0x7f679c040850 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.681+0000 7f67a2c90640 1 -- 172.21.15.102:0/4215967611 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f679402d070 con 0x7f679c0123d0 2024-09-13T19:17:14.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.681+0000 7f67a2c90640 1 --2- 172.21.15.102:0/4215967611 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f6794018810 0x7f679403f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.681+0000 7f67a2c90640 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ceabc266e0 con 0x7f6794018810 2024-09-13T19:17:14.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.681+0000 7f679bfff640 1 --2- 172.21.15.102:0/4215967611 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f6794018810 0x7f679403f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.682+0000 7f679bfff640 1 --2- 172.21.15.102:0/4215967611 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f6794018810 0x7f679403f1e0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.682+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f678c057030 con 0x7f6794018810 2024-09-13T19:17:14.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.682+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ceabc266e0 con 0x55ceabc1da30 2024-09-13T19:17:14.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.682+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f678c057030 con 0x55ceabc1da30 2024-09-13T19:17:14.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.682+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ceabc266e0 con 0x55ceabc1da30 2024-09-13T19:17:14.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.682+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f678c057030 con 0x55ceabc1da30 2024-09-13T19:17:14.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.682+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ceabc266e0 con 0x7f6794018810 2024-09-13T19:17:14.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.683+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f678c057030 con 0x7f6794018810 2024-09-13T19:17:14.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.683+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ceabc266e0 con 0x7f6794018810 2024-09-13T19:17:14.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.683+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f678c057030 con 0x7f6794018810 2024-09-13T19:17:14.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.683+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ceabc266e0 con 0x7f679c0123d0 2024-09-13T19:17:14.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.683+0000 7f67a2c90640 1 -- 172.21.15.102:0/4215967611 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f679402d070 con 0x7f679c0123d0 2024-09-13T19:17:14.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.683+0000 7f67a2c90640 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ceabc266e0 con 0x55ceabc22440 2024-09-13T19:17:14.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.683+0000 7f67a3491640 1 -- 172.21.15.102:0/4215967611 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f679c00a4a0 con 0x55ceabc22440 2024-09-13T19:17:14.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.683+0000 7f67a3491640 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ceabc266e0 con 0x55ceabc1da30 2024-09-13T19:17:14.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.684+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f678c057030 con 0x55ceabc1da30 2024-09-13T19:17:14.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.684+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ceabc266e0 con 0x7f679c0123d0 2024-09-13T19:17:14.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.684+0000 7f67a2c90640 1 -- 172.21.15.102:0/4215967611 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f679402d070 con 0x7f679c0123d0 2024-09-13T19:17:14.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.684+0000 7f67a2c90640 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f679405a040 con 0x55ceabc1da30 2024-09-13T19:17:14.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.684+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f678c057030 con 0x55ceabc1da30 2024-09-13T19:17:14.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.684+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f679405a040 con 0x7f679c0123d0 2024-09-13T19:17:14.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.684+0000 7f67a2c90640 1 -- 172.21.15.102:0/4215967611 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f679402d070 con 0x7f679c0123d0 2024-09-13T19:17:14.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.684+0000 7f67a2c90640 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f679405a040 con 0x55ceabc22440 2024-09-13T19:17:14.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.684+0000 7f67a3491640 1 -- 172.21.15.102:0/4215967611 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f679c00a4a0 con 0x55ceabc22440 2024-09-13T19:17:14.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.684+0000 7f67a3491640 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f679405a040 con 0x55ceabc22440 2024-09-13T19:17:14.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.685+0000 7f67a3491640 1 -- 172.21.15.102:0/4215967611 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f679c00a4a0 con 0x55ceabc22440 2024-09-13T19:17:14.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.685+0000 7f67a3491640 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f679405a040 con 0x7f6794018810 2024-09-13T19:17:14.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.685+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f678c057030 con 0x7f6794018810 2024-09-13T19:17:14.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.685+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f679405a040 con 0x55ceabc22440 2024-09-13T19:17:14.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.685+0000 7f67a3491640 1 -- 172.21.15.102:0/4215967611 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f679c00a4a0 con 0x55ceabc22440 2024-09-13T19:17:14.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.685+0000 7f67a3491640 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f679405a040 con 0x55ceabc22440 2024-09-13T19:17:14.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.685+0000 7f67a3491640 1 -- 172.21.15.102:0/4215967611 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f679c00a4a0 con 0x55ceabc22440 2024-09-13T19:17:14.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.685+0000 7f67a3491640 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f679405a040 con 0x55ceabc1da30 2024-09-13T19:17:14.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.686+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f678c057030 con 0x55ceabc1da30 2024-09-13T19:17:14.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.686+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f679405a040 con 0x55ceabc1da30 2024-09-13T19:17:14.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.686+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f678c057030 con 0x55ceabc1da30 2024-09-13T19:17:14.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.686+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f679405a040 con 0x7f6794018810 2024-09-13T19:17:14.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.686+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f678c057030 con 0x7f6794018810 2024-09-13T19:17:14.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.686+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f679405a040 con 0x55ceabc22440 2024-09-13T19:17:14.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.686+0000 7f67a3491640 1 -- 172.21.15.102:0/4215967611 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f679c00a4a0 con 0x55ceabc22440 2024-09-13T19:17:14.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.687+0000 7f67a3491640 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f679405a040 con 0x7f679c0123d0 2024-09-13T19:17:14.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.687+0000 7f67a2c90640 1 -- 172.21.15.102:0/4215967611 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f679402d070 con 0x7f679c0123d0 2024-09-13T19:17:14.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.687+0000 7f67a2c90640 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f679405a040 con 0x55ceabc1da30 2024-09-13T19:17:14.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.687+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f678c057030 con 0x55ceabc1da30 2024-09-13T19:17:14.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.687+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f679405a040 con 0x7f679c0123d0 2024-09-13T19:17:14.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.687+0000 7f67a2c90640 1 -- 172.21.15.102:0/4215967611 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f679402d070 con 0x7f679c0123d0 2024-09-13T19:17:14.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.687+0000 7f67a2c90640 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f679405a040 con 0x55ceabc22440 2024-09-13T19:17:14.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.687+0000 7f67a3491640 1 -- 172.21.15.102:0/4215967611 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f679c00a4a0 con 0x55ceabc22440 2024-09-13T19:17:14.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.687+0000 7f67a3491640 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f679405a040 con 0x7f6794018810 2024-09-13T19:17:14.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.688+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f678c057030 con 0x7f6794018810 2024-09-13T19:17:14.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.688+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f679405a040 con 0x7f679c0123d0 2024-09-13T19:17:14.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.688+0000 7f67a2c90640 1 -- 172.21.15.102:0/4215967611 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f679402d070 con 0x7f679c0123d0 2024-09-13T19:17:14.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.688+0000 7f67a2c90640 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f679405a040 con 0x55ceabc22440 2024-09-13T19:17:14.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.688+0000 7f67a3491640 1 -- 172.21.15.102:0/4215967611 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f679c00a4a0 con 0x55ceabc22440 2024-09-13T19:17:14.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.688+0000 7f67a3491640 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f679405a040 con 0x7f6794018810 2024-09-13T19:17:14.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.689+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f678c057030 con 0x7f6794018810 2024-09-13T19:17:14.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.689+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f679405a040 con 0x55ceabc1da30 2024-09-13T19:17:14.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.689+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f678c057030 con 0x55ceabc1da30 2024-09-13T19:17:14.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.689+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f679405a040 con 0x7f679c0123d0 2024-09-13T19:17:14.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.689+0000 7f67a2c90640 1 -- 172.21.15.102:0/4215967611 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f679402d070 con 0x7f679c0123d0 2024-09-13T19:17:14.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.689+0000 7f67a6f42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:17:14.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.689+0000 7f67a6f42800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:17:14.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.689+0000 7f67a6f42800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:17:14.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.689+0000 7f67a6f42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:17:14.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.689+0000 7f67a6f42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:17:14.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.689+0000 7f67a6f42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:17:14.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.689+0000 7f67a6f42800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.689+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ceabc257b0 con 0x55ceabc1da30 2024-09-13T19:17:14.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.689+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f678c057030 con 0x55ceabc1da30 2024-09-13T19:17:14.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.689+0000 7f67a6f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:14.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.689+0000 7f67a6f42800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.689+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ceabc26050 con 0x55ceabc1da30 2024-09-13T19:17:14.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.690+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f678c07e040 con 0x55ceabc1da30 2024-09-13T19:17:14.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.690+0000 7f67a6f42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:17:14.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.690+0000 7f67a6f42800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.690+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ceabc253f0 con 0x55ceabc22440 2024-09-13T19:17:14.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.690+0000 7f67a3491640 1 -- 172.21.15.102:0/4215967611 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f679c00a4a0 con 0x55ceabc22440 2024-09-13T19:17:14.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.690+0000 7f67a6f42800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:17:14.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.690+0000 7f67a6f42800 20 zone default found 2024-09-13T19:17:14.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.690+0000 7f67a6f42800 4 Realm: () 2024-09-13T19:17:14.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.690+0000 7f67a6f42800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:17:14.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.690+0000 7f67a6f42800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:17:14.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.690+0000 7f67a6f42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:17:14.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.690+0000 7f67a6f42800 20 zonegroup default 2024-09-13T19:17:14.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.690+0000 7f67a6f42800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.690+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ceabc27060 con 0x7f679c0123d0 2024-09-13T19:17:14.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.690+0000 7f67a2c90640 1 -- 172.21.15.102:0/4215967611 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f679402d070 con 0x7f679c0123d0 2024-09-13T19:17:14.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.690+0000 7f67a6f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:14.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.690+0000 7f67a6f42800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.690+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ceabc28e70 con 0x55ceabc22440 2024-09-13T19:17:14.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.690+0000 7f67a3491640 1 -- 172.21.15.102:0/4215967611 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f679c00a4a0 con 0x55ceabc22440 2024-09-13T19:17:14.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.690+0000 7f67a6f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:14.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.690+0000 7f67a6f42800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.690+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ceabc292d0 con 0x55ceabc22440 2024-09-13T19:17:14.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.691+0000 7f67a3491640 1 -- 172.21.15.102:0/4215967611 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f679c00a4a0 con 0x55ceabc22440 2024-09-13T19:17:14.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.691+0000 7f67a6f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:14.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.691+0000 7f67a6f42800 20 started sync module instance, tier type = 2024-09-13T19:17:14.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.691+0000 7f67a6f42800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:17:14.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.691+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ceabc28280 con 0x7f679c0123d0 2024-09-13T19:17:14.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.692+0000 7f67a2c90640 1 -- 172.21.15.102:0/4215967611 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(44 notify.0 [create] v36'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f679402d070 con 0x7f679c0123d0 2024-09-13T19:17:14.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.692+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94346133274064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ceabc29710 con 0x7f679c0123d0 2024-09-13T19:17:14.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.692+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ceabc29f60 con 0x55ceabc1da30 2024-09-13T19:17:14.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.693+0000 7f67a2c90640 1 -- 172.21.15.102:0/4215967611 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94346133274064] v36'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f679402d070 con 0x7f679c0123d0 2024-09-13T19:17:14.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.693+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v36'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f678c07e040 con 0x55ceabc1da30 2024-09-13T19:17:14.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.693+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94346133280528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ceabc29b30 con 0x55ceabc1da30 2024-09-13T19:17:14.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.693+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ceabc2aca0 con 0x55ceabc22440 2024-09-13T19:17:14.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.694+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94346133280528] v36'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f678c07e040 con 0x55ceabc1da30 2024-09-13T19:17:14.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.694+0000 7f67a3491640 1 -- 172.21.15.102:0/4215967611 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v36'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f679c00a4a0 con 0x55ceabc22440 2024-09-13T19:17:14.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.694+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94346133283584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ceabc2ac50 con 0x55ceabc22440 2024-09-13T19:17:14.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.694+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ceabc2b740 con 0x7f679c0123d0 2024-09-13T19:17:14.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.695+0000 7f67a3491640 1 -- 172.21.15.102:0/4215967611 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94346133283584] v36'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f679c00a4a0 con 0x55ceabc22440 2024-09-13T19:17:14.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.695+0000 7f67a2c90640 1 -- 172.21.15.102:0/4215967611 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(50 notify.3 [create] v36'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f679402d070 con 0x7f679c0123d0 2024-09-13T19:17:14.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.695+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94346133287440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ceabc2b700 con 0x7f679c0123d0 2024-09-13T19:17:14.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.695+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ceabc2b700 con 0x55ceabc1da30 2024-09-13T19:17:14.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.696+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v36'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f678c07e040 con 0x55ceabc1da30 2024-09-13T19:17:14.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.696+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94346133290144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ceabc2c6c0 con 0x55ceabc1da30 2024-09-13T19:17:14.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.696+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ceabc2d180 con 0x7f6794018810 2024-09-13T19:17:14.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.699+0000 7f67a2c90640 1 -- 172.21.15.102:0/4215967611 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94346133287440] v36'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f679402d070 con 0x7f679c0123d0 2024-09-13T19:17:14.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.699+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94346133290144] v36'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f678c07e040 con 0x55ceabc1da30 2024-09-13T19:17:14.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.699+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(54 notify.5 [create] v36'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f678c07e040 con 0x7f6794018810 2024-09-13T19:17:14.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.699+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94346133291536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ceabc2a720 con 0x7f6794018810 2024-09-13T19:17:14.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.699+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ceabc2d760 con 0x7f6794018810 2024-09-13T19:17:14.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.700+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94346133291536] v36'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f678c07e040 con 0x7f6794018810 2024-09-13T19:17:14.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.700+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(56 notify.6 [create] v36'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f678c07e040 con 0x7f6794018810 2024-09-13T19:17:14.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.700+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94346133294160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ceabc2d760 con 0x7f6794018810 2024-09-13T19:17:14.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.700+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ceabc2e120 con 0x7f6794018810 2024-09-13T19:17:14.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.701+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94346133294160] v36'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f678c07e040 con 0x7f6794018810 2024-09-13T19:17:14.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.701+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(58 notify.7 [create] v36'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f678c07e040 con 0x7f6794018810 2024-09-13T19:17:14.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.701+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94346133296272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ceabc2e120 con 0x7f6794018810 2024-09-13T19:17:14.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.701+0000 7f67a6f42800 20 add_watcher() i=0 2024-09-13T19:17:14.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.701+0000 7f67a6f42800 20 add_watcher() i=1 2024-09-13T19:17:14.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.701+0000 7f67a6f42800 20 add_watcher() i=2 2024-09-13T19:17:14.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.701+0000 7f67a6f42800 20 add_watcher() i=3 2024-09-13T19:17:14.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.701+0000 7f67a6f42800 20 add_watcher() i=4 2024-09-13T19:17:14.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.701+0000 7f67a6f42800 20 add_watcher() i=5 2024-09-13T19:17:14.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.701+0000 7f67a6f42800 20 add_watcher() i=6 2024-09-13T19:17:14.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.702+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94346133296272] v36'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f678c07e040 con 0x7f6794018810 2024-09-13T19:17:14.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.702+0000 7f67a6f42800 20 add_watcher() i=7 2024-09-13T19:17:14.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.702+0000 7f67a6f42800 2 all 8 watchers are set, enabling cache 2024-09-13T19:17:14.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.702+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ceabc31410 con 0x55ceabc1da30 2024-09-13T19:17:14.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.702+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f678c07e040 con 0x55ceabc1da30 2024-09-13T19:17:14.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.702+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94346133298656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ceabc2e6b0 con 0x55ceabc1da30 2024-09-13T19:17:14.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.703+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94346133298656] v36'206 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f678c07e040 con 0x55ceabc1da30 2024-09-13T19:17:14.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.704+0000 7f66597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:17:14.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.704+0000 7f67a6f42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:17:14.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.704+0000 7f67a6f42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:17:14.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.704+0000 7f67a6f42800 5 note: GC not initialized 2024-09-13T19:17:14.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.704+0000 7f65d3fff640 20 reqs_thread_entry: start 2024-09-13T19:17:14.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.704+0000 7f67a6f42800 20 init_complete bucket index max shards: 11 2024-09-13T19:17:14.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.704+0000 7f67a6f42800 20 Filter name: none 2024-09-13T19:17:14.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.704+0000 7f65d1ffb640 20 reqs_thread_entry: start 2024-09-13T19:17:14.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.704+0000 7f67a6f42800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.704+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ceabc64420 con 0x55ceabc1da30 2024-09-13T19:17:14.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.705+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f678c07e040 con 0x55ceabc1da30 2024-09-13T19:17:14.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.705+0000 7f67a6f42800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:17:14.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.705+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ceabc65970 con 0x7f6794018810 2024-09-13T19:17:14.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.705+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f678c07e040 con 0x7f6794018810 2024-09-13T19:17:14.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.706+0000 7f66597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:17:14.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.706+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94346133298656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ceabc303d0 con 0x55ceabc1da30 2024-09-13T19:17:14.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.707+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94346133298656] v36'207 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f678c07e040 con 0x55ceabc1da30 2024-09-13T19:17:14.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.707+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94346133274064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ceabc621d0 con 0x7f679c0123d0 2024-09-13T19:17:14.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.708+0000 7f67a2c90640 1 -- 172.21.15.102:0/4215967611 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94346133274064] v36'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f679402d070 con 0x7f679c0123d0 2024-09-13T19:17:14.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.708+0000 7f67a6f42800 20 remove_watcher() i=0 2024-09-13T19:17:14.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.708+0000 7f67a6f42800 2 removed watcher, disabling cache 2024-09-13T19:17:14.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.708+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94346133280528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ceabc621d0 con 0x55ceabc1da30 2024-09-13T19:17:14.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.709+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94346133280528] v36'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f678c07e040 con 0x55ceabc1da30 2024-09-13T19:17:14.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.709+0000 7f67a6f42800 20 remove_watcher() i=1 2024-09-13T19:17:14.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.709+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94346133283584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ceabc621d0 con 0x55ceabc22440 2024-09-13T19:17:14.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.710+0000 7f67a3491640 1 -- 172.21.15.102:0/4215967611 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94346133283584] v36'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f679c00a4a0 con 0x55ceabc22440 2024-09-13T19:17:14.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.710+0000 7f67a6f42800 20 remove_watcher() i=2 2024-09-13T19:17:14.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.710+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94346133287440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ceabc621d0 con 0x7f679c0123d0 2024-09-13T19:17:14.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.711+0000 7f67a2c90640 1 -- 172.21.15.102:0/4215967611 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94346133287440] v36'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f679402d070 con 0x7f679c0123d0 2024-09-13T19:17:14.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.712+0000 7f67a6f42800 20 remove_watcher() i=3 2024-09-13T19:17:14.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.712+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94346133290144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ceabc621d0 con 0x55ceabc1da30 2024-09-13T19:17:14.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.712+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94346133290144] v36'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f678c07e040 con 0x55ceabc1da30 2024-09-13T19:17:14.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.713+0000 7f67a6f42800 20 remove_watcher() i=4 2024-09-13T19:17:14.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.713+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94346133291536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ceabc621d0 con 0x7f6794018810 2024-09-13T19:17:14.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.713+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94346133291536] v36'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f678c07e040 con 0x7f6794018810 2024-09-13T19:17:14.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.714+0000 7f67a6f42800 20 remove_watcher() i=5 2024-09-13T19:17:14.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.714+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94346133294160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ceabc621d0 con 0x7f6794018810 2024-09-13T19:17:14.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.715+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94346133294160] v36'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f678c07e040 con 0x7f6794018810 2024-09-13T19:17:14.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.715+0000 7f67a6f42800 20 remove_watcher() i=6 2024-09-13T19:17:14.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.715+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94346133296272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ceabc621d0 con 0x7f6794018810 2024-09-13T19:17:14.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.716+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94346133296272] v36'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f678c07e040 con 0x7f6794018810 2024-09-13T19:17:14.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.716+0000 7f67a6f42800 20 remove_watcher() i=7 2024-09-13T19:17:14.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.716+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f6794018810 msgr2=0x7f679403f1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.716+0000 7f67a6f42800 1 --2- 172.21.15.102:0/4215967611 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f6794018810 0x7f679403f1e0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.716+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55ceabc1da30 msgr2=0x55ceabc1fef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.716+0000 7f67a6f42800 1 --2- 172.21.15.102:0/4215967611 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55ceabc1da30 0x55ceabc1fef0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.716+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f679c0123d0 msgr2=0x7f679c040850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.716+0000 7f67a6f42800 1 --2- 172.21.15.102:0/4215967611 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f679c0123d0 0x7f679c040850 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.716+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55ceabc22440 msgr2=0x55ceabc24830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.716+0000 7f67a6f42800 1 --2- 172.21.15.102:0/4215967611 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55ceabc22440 0x55ceabc24830 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.716+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f666c036b40 msgr2=0x7f666c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.716+0000 7f67a6f42800 1 --2- 172.21.15.102:0/4215967611 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f666c036b40 0x7f666c039000 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f679400e6d0 tx=0x7f6794033000 comp rx=0 tx=0).stop 2024-09-13T19:17:14.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.716+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ceabaea460 msgr2=0x55ceabc12110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.716+0000 7f67a6f42800 1 --2- 172.21.15.102:0/4215967611 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ceabaea460 0x55ceabc12110 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f679c00a120 tx=0x7f679c04cdb0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.716+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 reap_dead start 2024-09-13T19:17:14.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.716+0000 7f679bfff640 1 -- 172.21.15.102:0/4215967611 reap_dead start 2024-09-13T19:17:14.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.716+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 shutdown_connections 2024-09-13T19:17:14.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.716+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 >> 172.21.15.102:0/4215967611 conn(0x55ceabc04ed0 msgr2=0x55ceabc02fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:14.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.716+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 shutdown_connections 2024-09-13T19:17:14.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.716+0000 7f67a6f42800 1 -- 172.21.15.102:0/4215967611 wait complete. 2024-09-13T19:17:14.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.716+0000 7f67a6f42800 1 -- 172.21.15.102:0/2033838771 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f667c036b40 msgr2=0x7f667c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.716+0000 7f67a6f42800 1 --2- 172.21.15.102:0/2033838771 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f667c036b40 0x7f667c039000 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x55ceabbe5640 tx=0x7f679404b640 comp rx=0 tx=0).stop 2024-09-13T19:17:14.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.716+0000 7f67a6f42800 1 -- 172.21.15.102:0/2033838771 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ceabbfbe40 msgr2=0x55ceabbfc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.716+0000 7f67a6f42800 1 --2- 172.21.15.102:0/2033838771 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ceabbfbe40 0x55ceabbfc260 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x55ceabbe2190 tx=0x7f679c0167b0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.716+0000 7f67a6f42800 1 -- 172.21.15.102:0/2033838771 shutdown_connections 2024-09-13T19:17:14.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.716+0000 7f67a6f42800 1 --2- 172.21.15.102:0/2033838771 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f667c036b40 0x7f667c039000 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.716+0000 7f67a6f42800 1 --2- 172.21.15.102:0/2033838771 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ceabbfbe40 0x55ceabbfc260 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.716+0000 7f67a6f42800 1 -- 172.21.15.102:0/2033838771 >> 172.21.15.102:0/2033838771 conn(0x55ceabbf0dd0 msgr2=0x55ceabbf3950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:14.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.716+0000 7f67a6f42800 1 -- 172.21.15.102:0/2033838771 shutdown_connections 2024-09-13T19:17:14.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.716+0000 7f67a6f42800 1 -- 172.21.15.102:0/2033838771 wait complete. 2024-09-13T19:17:14.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.717+0000 7f67a6f42800 1 -- 172.21.15.102:0/1068993053 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55ceabaee900 msgr2=0x55ceabbe8150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.717+0000 7f67a6f42800 1 --2- 172.21.15.102:0/1068993053 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55ceabaee900 0x55ceabbe8150 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.717+0000 7f67a6f42800 1 -- 172.21.15.102:0/1068993053 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55ceabbeaa00 msgr2=0x55ceabbecdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.717+0000 7f67a6f42800 1 --2- 172.21.15.102:0/1068993053 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55ceabbeaa00 0x55ceabbecdf0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.717+0000 7f67a6f42800 1 -- 172.21.15.102:0/1068993053 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6688036b90 msgr2=0x7f6688039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.717+0000 7f67a6f42800 1 --2- 172.21.15.102:0/1068993053 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6688036b90 0x7f6688039050 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f678c057000 tx=0x7f678c052000 comp rx=0 tx=0).stop 2024-09-13T19:17:14.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.717+0000 7f67a6f42800 1 -- 172.21.15.102:0/1068993053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ceaba5e650 msgr2=0x55ceabbe10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.717+0000 7f67a6f42800 1 --2- 172.21.15.102:0/1068993053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ceaba5e650 0x55ceabbe10e0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x55ceabbda4c0 tx=0x7f6794000ed0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.717+0000 7f67a6f42800 1 -- 172.21.15.102:0/1068993053 shutdown_connections 2024-09-13T19:17:14.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.717+0000 7f67a6f42800 1 --2- 172.21.15.102:0/1068993053 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55ceabbeaa00 0x55ceabbecdf0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.717+0000 7f67a6f42800 1 --2- 172.21.15.102:0/1068993053 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55ceabaee900 0x55ceabbe8150 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.717+0000 7f67a6f42800 1 --2- 172.21.15.102:0/1068993053 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6688036b90 0x7f6688039050 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.717+0000 7f67a6f42800 1 --2- 172.21.15.102:0/1068993053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ceaba5e650 0x55ceabbe10e0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.717+0000 7f67a6f42800 1 -- 172.21.15.102:0/1068993053 >> 172.21.15.102:0/1068993053 conn(0x55ceabae4db0 msgr2=0x55ceabbd3950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:14.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.717+0000 7f67a6f42800 1 -- 172.21.15.102:0/1068993053 shutdown_connections 2024-09-13T19:17:14.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.717+0000 7f67a6f42800 1 -- 172.21.15.102:0/1068993053 wait complete. 2024-09-13T19:17:14.733 INFO:teuthology.orchestra.run.smithi102.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-09-13T19:17:14.734 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-09-13T19:17:14.734 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-13T19:17:14.734 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-13T19:17:14.734 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2024-09-13T19:17:14.780 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:17:14.780 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:17:14.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.778+0000 7fb09fc0f800 1 Processor -- start 2024-09-13T19:17:14.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.778+0000 7fb09fc0f800 1 -- start start 2024-09-13T19:17:14.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.778+0000 7fb09fc0f800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56099731e920 0x560997320d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.778+0000 7fb09fc0f800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5609971dab30 con 0x56099731a4e0 2024-09-13T19:17:14.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.778+0000 7fb09fc0f800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5609971bc360 con 0x56099731e920 2024-09-13T19:17:14.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.779+0000 7fb09cf02640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56099731e920 0x560997320d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.779+0000 7fb09d703640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x56099731a4e0 0x56099731a8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:50050/0 (socket says 172.21.15.102:50050) 2024-09-13T19:17:14.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.779+0000 7fb09d703640 1 -- 172.21.15.102:0/3819057868 learned_addr learned my addr 172.21.15.102:0/3819057868 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:17:14.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.779+0000 7fb09cf02640 1 -- 172.21.15.102:0/3819057868 >> v1:172.21.15.53:6789/0 conn(0x56099731a4e0 legacy=0x56099731a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.779+0000 7fb09cf02640 1 -- 172.21.15.102:0/3819057868 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609971e2e00 con 0x56099731e920 2024-09-13T19:17:14.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.779+0000 7fb08ffff640 1 -- 172.21.15.102:0/3819057868 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1324658969 0 0) 0x5609971dab30 con 0x56099731a4e0 2024-09-13T19:17:14.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.781+0000 7fb09cf02640 1 --2- 172.21.15.102:0/3819057868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56099731e920 0x560997320d10 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fb09400a470 tx=0x7fb094045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af2c713660ca5e21 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.781+0000 7fb08ffff640 1 -- 172.21.15.102:0/3819057868 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb094053570 con 0x56099731e920 2024-09-13T19:17:14.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.781+0000 7fb08ffff640 1 -- 172.21.15.102:0/3819057868 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb094058070 con 0x56099731e920 2024-09-13T19:17:14.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.781+0000 7fb08ffff640 1 -- 172.21.15.102:0/3819057868 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb094053880 con 0x56099731e920 2024-09-13T19:17:14.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.782+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3819057868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56099731e920 msgr2=0x560997320d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.782+0000 7fb09fc0f800 1 --2- 172.21.15.102:0/3819057868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56099731e920 0x560997320d10 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fb09400a470 tx=0x7fb094045a20 comp rx=0 tx=0).stop 2024-09-13T19:17:14.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.782+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3819057868 shutdown_connections 2024-09-13T19:17:14.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.782+0000 7fb09fc0f800 1 --2- 172.21.15.102:0/3819057868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56099731e920 0x560997320d10 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.782+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3819057868 >> 172.21.15.102:0/3819057868 conn(0x560997315db0 msgr2=0x5609973181d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:14.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.782+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3819057868 shutdown_connections 2024-09-13T19:17:14.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.782+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3819057868 wait complete. 2024-09-13T19:17:14.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.796+0000 7fb09fc0f800 1 Processor -- start 2024-09-13T19:17:14.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.796+0000 7fb09fc0f800 1 -- start start 2024-09-13T19:17:14.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.796+0000 7fb09fc0f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56099731a4e0 0x5609974064e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.796+0000 7fb09fc0f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560997267360 con 0x56099731a4e0 2024-09-13T19:17:14.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.796+0000 7fb09d703640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56099731a4e0 0x5609974064e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.796+0000 7fb09d703640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56099731a4e0 0x5609974064e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41314/0 (socket says 172.21.15.102:41314) 2024-09-13T19:17:14.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.796+0000 7fb09d703640 1 -- 172.21.15.102:0/1689584518 learned_addr learned my addr 172.21.15.102:0/1689584518 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:14.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.797+0000 7fb09d703640 1 -- 172.21.15.102:0/1689584518 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609971b4bc0 con 0x56099731a4e0 2024-09-13T19:17:14.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.797+0000 7fb09d703640 1 --2- 172.21.15.102:0/1689584518 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56099731a4e0 0x5609974064e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fb09000b240 tx=0x7fb09000b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c63b8ab2c532caec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.797+0000 7faf8b606640 1 -- 172.21.15.102:0/1689584518 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb090008070 con 0x56099731a4e0 2024-09-13T19:17:14.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.797+0000 7faf8b606640 1 -- 172.21.15.102:0/1689584518 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb09000d500 con 0x56099731a4e0 2024-09-13T19:17:14.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.797+0000 7faf8b606640 1 -- 172.21.15.102:0/1689584518 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb09000d860 con 0x56099731a4e0 2024-09-13T19:17:14.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.798+0000 7fb09fc0f800 1 -- 172.21.15.102:0/1689584518 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56099731a4e0 msgr2=0x5609974064e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.798+0000 7fb09fc0f800 1 --2- 172.21.15.102:0/1689584518 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56099731a4e0 0x5609974064e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fb09000b240 tx=0x7fb09000b700 comp rx=0 tx=0).stop 2024-09-13T19:17:14.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.798+0000 7fb09fc0f800 1 -- 172.21.15.102:0/1689584518 shutdown_connections 2024-09-13T19:17:14.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.798+0000 7fb09fc0f800 1 --2- 172.21.15.102:0/1689584518 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56099731a4e0 0x5609974064e0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.798+0000 7fb09fc0f800 1 -- 172.21.15.102:0/1689584518 >> 172.21.15.102:0/1689584518 conn(0x560997315db0 msgr2=0x560997408b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:14.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.798+0000 7fb09fc0f800 1 -- 172.21.15.102:0/1689584518 shutdown_connections 2024-09-13T19:17:14.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.798+0000 7fb09fc0f800 1 -- 172.21.15.102:0/1689584518 wait complete. 2024-09-13T19:17:14.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.798+0000 7fb09fc0f800 1 Processor -- start 2024-09-13T19:17:14.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.798+0000 7fb09fc0f800 1 -- start start 2024-09-13T19:17:14.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.798+0000 7fb09fc0f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56099731a4e0 0x5609974142b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.798+0000 7fb09fc0f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560997321550 con 0x56099731a4e0 2024-09-13T19:17:14.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.798+0000 7fb09d703640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56099731a4e0 0x5609974142b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.798+0000 7fb09d703640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56099731a4e0 0x5609974142b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41322/0 (socket says 172.21.15.102:41322) 2024-09-13T19:17:14.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.798+0000 7fb09d703640 1 -- 172.21.15.102:0/3361881336 learned_addr learned my addr 172.21.15.102:0/3361881336 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:14.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.799+0000 7fb09d703640 1 -- 172.21.15.102:0/3361881336 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609971c8fe0 con 0x56099731a4e0 2024-09-13T19:17:14.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.799+0000 7fb09d703640 1 --2- 172.21.15.102:0/3361881336 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56099731a4e0 0x5609974142b0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fb090000fb0 tx=0x7fb090000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.799+0000 7faf89e03640 1 -- 172.21.15.102:0/3361881336 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb09000f9d0 con 0x56099731a4e0 2024-09-13T19:17:14.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.799+0000 7faf89e03640 1 -- 172.21.15.102:0/3361881336 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb09000fb70 con 0x56099731a4e0 2024-09-13T19:17:14.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.799+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3361881336 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5609974147f0 con 0x56099731a4e0 2024-09-13T19:17:14.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.799+0000 7faf89e03640 1 -- 172.21.15.102:0/3361881336 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb09000fe50 con 0x56099731a4e0 2024-09-13T19:17:14.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.799+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3361881336 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560997414d10 con 0x56099731a4e0 2024-09-13T19:17:14.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.800+0000 7faf89e03640 1 -- 172.21.15.102:0/3361881336 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb090017040 con 0x56099731a4e0 2024-09-13T19:17:14.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.800+0000 7faf89e03640 1 --2- 172.21.15.102:0/3361881336 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7faf84036d30 0x7faf840391f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.800+0000 7faf89e03640 1 -- 172.21.15.102:0/3361881336 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fb090015020 con 0x56099731a4e0 2024-09-13T19:17:14.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.800+0000 7fb09cf02640 1 --2- 172.21.15.102:0/3361881336 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7faf84036d30 0x7faf840391f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.801+0000 7fb09fc0f800 1 --2- 172.21.15.102:0/3361881336 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56099731e920 0x56099741b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.801+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3361881336 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56099741b860 con 0x56099731e920 2024-09-13T19:17:14.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.801+0000 7fb09df04640 1 --2- 172.21.15.102:0/3361881336 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56099731e920 0x56099741b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.801+0000 7fb09cf02640 1 --2- 172.21.15.102:0/3361881336 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7faf84036d30 0x7faf840391f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb094057000 tx=0x7fb094052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.801+0000 7fb09df04640 1 --2- 172.21.15.102:0/3361881336 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56099731e920 0x56099741b320 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.801+0000 7fb09df04640 1 -- 172.21.15.102:0/3361881336 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb09800a4a0 con 0x56099731e920 2024-09-13T19:17:14.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.801+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3361881336 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5609974188f0 con 0x56099731e920 2024-09-13T19:17:14.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.801+0000 7fb09df04640 1 -- 172.21.15.102:0/3361881336 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb09800a4a0 con 0x56099731e920 2024-09-13T19:17:14.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.802+0000 7fb09fc0f800 1 --2- 172.21.15.102:0/3361881336 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56099741db70 0x56099741ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.802+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3361881336 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560997420650 con 0x56099741db70 2024-09-13T19:17:14.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.802+0000 7fb09d703640 1 --2- 172.21.15.102:0/3361881336 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56099741db70 0x56099741ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.802+0000 7fb09d703640 1 --2- 172.21.15.102:0/3361881336 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56099741db70 0x56099741ff60 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.802+0000 7fb09d703640 1 -- 172.21.15.102:0/3361881336 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb09002d070 con 0x56099741db70 2024-09-13T19:17:14.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.802+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3361881336 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56099741ca10 con 0x56099731e920 2024-09-13T19:17:14.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.802+0000 7fb09df04640 1 -- 172.21.15.102:0/3361881336 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb09800a4a0 con 0x56099731e920 2024-09-13T19:17:14.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.802+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3361881336 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56099741cef0 con 0x56099741db70 2024-09-13T19:17:14.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.803+0000 7fb09d703640 1 -- 172.21.15.102:0/3361881336 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb09002d070 con 0x56099741db70 2024-09-13T19:17:14.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.803+0000 7fb09fc0f800 1 Processor -- start 2024-09-13T19:17:14.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.803+0000 7fb09fc0f800 1 -- start start 2024-09-13T19:17:14.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.803+0000 7fb09fc0f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56099742efb0 0x56099742f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.803+0000 7fb09fc0f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5609971b6580 con 0x56099742efb0 2024-09-13T19:17:14.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.803+0000 7fb09df04640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56099742efb0 0x56099742f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.803+0000 7fb09df04640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56099742efb0 0x56099742f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41338/0 (socket says 172.21.15.102:41338) 2024-09-13T19:17:14.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.804+0000 7fb09df04640 1 -- 172.21.15.102:0/2104670575 learned_addr learned my addr 172.21.15.102:0/2104670575 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:14.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.804+0000 7fb09df04640 1 -- 172.21.15.102:0/2104670575 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56099742f910 con 0x56099742efb0 2024-09-13T19:17:14.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.804+0000 7fb09df04640 1 --2- 172.21.15.102:0/2104670575 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56099742efb0 0x56099742f3d0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x5609974156b0 tx=0x7fb0980163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.804+0000 7faf82ffd640 1 -- 172.21.15.102:0/2104670575 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb098013450 con 0x56099742efb0 2024-09-13T19:17:14.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.804+0000 7faf82ffd640 1 -- 172.21.15.102:0/2104670575 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0980135f0 con 0x56099742efb0 2024-09-13T19:17:14.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.804+0000 7faf82ffd640 1 -- 172.21.15.102:0/2104670575 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb098013910 con 0x56099742efb0 2024-09-13T19:17:14.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.804+0000 7fb09fc0f800 1 -- 172.21.15.102:0/2104670575 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56099742fba0 con 0x56099742efb0 2024-09-13T19:17:14.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.804+0000 7fb09fc0f800 1 -- 172.21.15.102:0/2104670575 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560997432880 con 0x56099742efb0 2024-09-13T19:17:14.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.805+0000 7faf82ffd640 1 -- 172.21.15.102:0/2104670575 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb098011040 con 0x56099742efb0 2024-09-13T19:17:14.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.805+0000 7faf82ffd640 1 --2- 172.21.15.102:0/2104670575 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7faf74036b90 0x7faf74039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.805+0000 7faf82ffd640 1 -- 172.21.15.102:0/2104670575 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fb09800e040 con 0x56099742efb0 2024-09-13T19:17:14.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.805+0000 7fb09d703640 1 --2- 172.21.15.102:0/2104670575 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7faf74036b90 0x7faf74039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.805+0000 7fb09fc0f800 1 Processor -- start 2024-09-13T19:17:14.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.805+0000 7fb09fc0f800 1 -- start start 2024-09-13T19:17:14.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.806+0000 7fb09d703640 1 --2- 172.21.15.102:0/2104670575 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7faf74036b90 0x7faf74039050 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb09000eb00 tx=0x7fb09000b700 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.806+0000 7fb09fc0f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56099743bd00 0x56099743c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.806+0000 7fb09fc0f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560997404c40 con 0x56099743bd00 2024-09-13T19:17:14.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.806+0000 7fb09df04640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56099743bd00 0x56099743c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.806+0000 7fb09df04640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56099743bd00 0x56099743c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41352/0 (socket says 172.21.15.102:41352) 2024-09-13T19:17:14.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.806+0000 7fb09df04640 1 -- 172.21.15.102:0/2918014384 learned_addr learned my addr 172.21.15.102:0/2918014384 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:14.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.806+0000 7fb09df04640 1 -- 172.21.15.102:0/2918014384 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56099743c6d0 con 0x56099743bd00 2024-09-13T19:17:14.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.807+0000 7fb09df04640 1 --2- 172.21.15.102:0/2918014384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56099743bd00 0x56099743c100 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fb09804ce00 tx=0x7fb09801fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f99334f078f41a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.807+0000 7faf80ff9640 1 -- 172.21.15.102:0/2918014384 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb098046250 con 0x56099743bd00 2024-09-13T19:17:14.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.807+0000 7faf80ff9640 1 -- 172.21.15.102:0/2918014384 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb09802a440 con 0x56099743bd00 2024-09-13T19:17:14.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.807+0000 7faf80ff9640 1 -- 172.21.15.102:0/2918014384 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb09801f390 con 0x56099743bd00 2024-09-13T19:17:14.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.807+0000 7fb09fc0f800 1 -- 172.21.15.102:0/2918014384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56099743bd00 msgr2=0x56099743c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.807+0000 7fb09fc0f800 1 --2- 172.21.15.102:0/2918014384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56099743bd00 0x56099743c100 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fb09804ce00 tx=0x7fb09801fd40 comp rx=0 tx=0).stop 2024-09-13T19:17:14.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.807+0000 7fb09fc0f800 1 -- 172.21.15.102:0/2918014384 shutdown_connections 2024-09-13T19:17:14.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.807+0000 7fb09fc0f800 1 --2- 172.21.15.102:0/2918014384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56099743bd00 0x56099743c100 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.807+0000 7fb09fc0f800 1 -- 172.21.15.102:0/2918014384 >> 172.21.15.102:0/2918014384 conn(0x560997438060 msgr2=0x560997436160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:14.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.807+0000 7fb09fc0f800 1 -- 172.21.15.102:0/2918014384 shutdown_connections 2024-09-13T19:17:14.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.807+0000 7fb09fc0f800 1 -- 172.21.15.102:0/2918014384 wait complete. 2024-09-13T19:17:14.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.807+0000 7fb09fc0f800 1 Processor -- start 2024-09-13T19:17:14.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.808+0000 7fb09fc0f800 1 -- start start 2024-09-13T19:17:14.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.808+0000 7fb09fc0f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56099743bd00 0x560997443200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.808+0000 7fb09fc0f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56099743cd40 con 0x56099743bd00 2024-09-13T19:17:14.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.808+0000 7fb09df04640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56099743bd00 0x560997443200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.808+0000 7fb09df04640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56099743bd00 0x560997443200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41354/0 (socket says 172.21.15.102:41354) 2024-09-13T19:17:14.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.808+0000 7fb09df04640 1 -- 172.21.15.102:0/3275439652 learned_addr learned my addr 172.21.15.102:0/3275439652 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:14.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.808+0000 7fb09df04640 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560997443740 con 0x56099743bd00 2024-09-13T19:17:14.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.808+0000 7fb09df04640 1 --2- 172.21.15.102:0/3275439652 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56099743bd00 0x560997443200 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fb098021000 tx=0x7fb09804cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.808+0000 7faf72ffd640 1 -- 172.21.15.102:0/3275439652 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb09803a020 con 0x56099743bd00 2024-09-13T19:17:14.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.808+0000 7faf72ffd640 1 -- 172.21.15.102:0/3275439652 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb098029560 con 0x56099743bd00 2024-09-13T19:17:14.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.808+0000 7faf72ffd640 1 -- 172.21.15.102:0/3275439652 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb098029840 con 0x56099743bd00 2024-09-13T19:17:14.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.808+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5609974439d0 con 0x56099743bd00 2024-09-13T19:17:14.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.809+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560997446680 con 0x56099743bd00 2024-09-13T19:17:14.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.809+0000 7faf72ffd640 1 -- 172.21.15.102:0/3275439652 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb09803d020 con 0x56099743bd00 2024-09-13T19:17:14.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.810+0000 7faf72ffd640 1 --2- 172.21.15.102:0/3275439652 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7faf68036b40 0x7faf68039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.810+0000 7faf72ffd640 1 -- 172.21.15.102:0/3275439652 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fb0980026e0 con 0x56099743bd00 2024-09-13T19:17:14.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.810+0000 7fb09d703640 1 --2- 172.21.15.102:0/3275439652 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7faf68036b40 0x7faf68039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.810+0000 7fb09fc0f800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.810+0000 7fb09fc0f800 1 --2- 172.21.15.102:0/3275439652 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56099744ec20 0x5609974510e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.810+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560997451830 con 0x56099744ec20 2024-09-13T19:17:14.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.810+0000 7fb09d703640 1 --2- 172.21.15.102:0/3275439652 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7faf68036b40 0x7faf68039000 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb09004d300 tx=0x7fb090032040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.810+0000 7fb09cf02640 1 --2- 172.21.15.102:0/3275439652 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56099744ec20 0x5609974510e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.810+0000 7fb09cf02640 1 --2- 172.21.15.102:0/3275439652 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56099744ec20 0x5609974510e0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.811+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb094051070 con 0x56099744ec20 2024-09-13T19:17:14.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.811+0000 7fb09fc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:14.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.811+0000 7fb09fc0f800 20 realm 2024-09-13T19:17:14.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.811+0000 7fb09fc0f800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.811+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560997451c60 con 0x56099744ec20 2024-09-13T19:17:14.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.811+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb094051070 con 0x56099744ec20 2024-09-13T19:17:14.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.811+0000 7fb09fc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:14.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.811+0000 7fb09fc0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:17:14.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.811+0000 7fb09fc0f800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.811+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560997452530 con 0x56099744ec20 2024-09-13T19:17:14.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.811+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb094051070 con 0x56099744ec20 2024-09-13T19:17:14.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.811+0000 7fb09fc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:14.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.811+0000 7fb09fc0f800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.811+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5609974528d0 con 0x56099744ec20 2024-09-13T19:17:14.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.811+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb094051070 con 0x56099744ec20 2024-09-13T19:17:14.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.811+0000 7fb09fc0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:17:14.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.811+0000 7fb09fc0f800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.811+0000 7fb09fc0f800 1 --2- 172.21.15.102:0/3275439652 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x560997453630 0x560997455a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.811+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560997455f60 con 0x560997453630 2024-09-13T19:17:14.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.811+0000 7fb09df04640 1 --2- 172.21.15.102:0/3275439652 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x560997453630 0x560997455a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.812+0000 7fb09df04640 1 --2- 172.21.15.102:0/3275439652 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x560997453630 0x560997455a20 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.812+0000 7fb09df04640 1 -- 172.21.15.102:0/3275439652 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb098032040 con 0x560997453630 2024-09-13T19:17:14.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.812+0000 7fb09fc0f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:17:14.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.812+0000 7fb09fc0f800 20 searching for the correct realm 2024-09-13T19:17:14.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.812+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5609974578d0 con 0x560997453630 2024-09-13T19:17:14.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.812+0000 7fb09df04640 1 -- 172.21.15.102:0/3275439652 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb098032040 con 0x560997453630 2024-09-13T19:17:14.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.812+0000 7fb09df04640 1 --2- 172.21.15.102:0/3275439652 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fb098058040 0x7fb0980409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.812+0000 7fb09df04640 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5609974578d0 con 0x7fb098058040 2024-09-13T19:17:14.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.812+0000 7fb09d703640 1 --2- 172.21.15.102:0/3275439652 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fb098058040 0x7fb0980409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.813+0000 7fb09d703640 1 --2- 172.21.15.102:0/3275439652 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fb098058040 0x7fb0980409d0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.813+0000 7fb09d703640 1 -- 172.21.15.102:0/3275439652 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb09002d070 con 0x7fb098058040 2024-09-13T19:17:14.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.813+0000 7fb09d703640 1 --2- 172.21.15.102:0/3275439652 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fb09004b810 0x7fb09001c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.813+0000 7fb09d703640 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5609974578d0 con 0x7fb09004b810 2024-09-13T19:17:14.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.813+0000 7fb09cf02640 1 --2- 172.21.15.102:0/3275439652 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fb09004b810 0x7fb09001c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.814+0000 7fb09cf02640 1 --2- 172.21.15.102:0/3275439652 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fb09004b810 0x7fb09001c610 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.814+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb094051070 con 0x7fb09004b810 2024-09-13T19:17:14.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.814+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5609974578d0 con 0x56099744ec20 2024-09-13T19:17:14.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.814+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb094051070 con 0x56099744ec20 2024-09-13T19:17:14.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.814+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5609974578d0 con 0x56099744ec20 2024-09-13T19:17:14.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.814+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb094051070 con 0x56099744ec20 2024-09-13T19:17:14.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.814+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5609974578d0 con 0x7fb09004b810 2024-09-13T19:17:14.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.815+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb094051070 con 0x7fb09004b810 2024-09-13T19:17:14.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.815+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5609974578d0 con 0x7fb09004b810 2024-09-13T19:17:14.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.815+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb094051070 con 0x7fb09004b810 2024-09-13T19:17:14.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.815+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5609974578d0 con 0x7fb098058040 2024-09-13T19:17:14.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.815+0000 7fb09d703640 1 -- 172.21.15.102:0/3275439652 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb09002d070 con 0x7fb098058040 2024-09-13T19:17:14.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.815+0000 7fb09d703640 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5609974578d0 con 0x560997453630 2024-09-13T19:17:14.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.815+0000 7fb09df04640 1 -- 172.21.15.102:0/3275439652 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb098032040 con 0x560997453630 2024-09-13T19:17:14.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.815+0000 7fb09df04640 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5609974578d0 con 0x56099744ec20 2024-09-13T19:17:14.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.816+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb094051070 con 0x56099744ec20 2024-09-13T19:17:14.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.816+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5609974578d0 con 0x7fb098058040 2024-09-13T19:17:14.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.816+0000 7fb09d703640 1 -- 172.21.15.102:0/3275439652 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb09002d070 con 0x7fb098058040 2024-09-13T19:17:14.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.816+0000 7fb09d703640 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5609974578d0 con 0x56099744ec20 2024-09-13T19:17:14.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.816+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb094051070 con 0x56099744ec20 2024-09-13T19:17:14.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.816+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5609974578d0 con 0x7fb098058040 2024-09-13T19:17:14.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.816+0000 7fb09d703640 1 -- 172.21.15.102:0/3275439652 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb09002d070 con 0x7fb098058040 2024-09-13T19:17:14.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.816+0000 7fb09d703640 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5609974578d0 con 0x560997453630 2024-09-13T19:17:14.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.817+0000 7fb09df04640 1 -- 172.21.15.102:0/3275439652 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb098032040 con 0x560997453630 2024-09-13T19:17:14.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.817+0000 7fb09df04640 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5609974578d0 con 0x560997453630 2024-09-13T19:17:14.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.817+0000 7fb09df04640 1 -- 172.21.15.102:0/3275439652 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb098032040 con 0x560997453630 2024-09-13T19:17:14.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.817+0000 7fb09df04640 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5609974578d0 con 0x7fb09004b810 2024-09-13T19:17:14.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.817+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb094051070 con 0x7fb09004b810 2024-09-13T19:17:14.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.817+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5609974578d0 con 0x560997453630 2024-09-13T19:17:14.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.817+0000 7fb09df04640 1 -- 172.21.15.102:0/3275439652 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb098032040 con 0x560997453630 2024-09-13T19:17:14.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.817+0000 7fb09df04640 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5609974578d0 con 0x560997453630 2024-09-13T19:17:14.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.818+0000 7fb09df04640 1 -- 172.21.15.102:0/3275439652 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb098032040 con 0x560997453630 2024-09-13T19:17:14.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.818+0000 7fb09df04640 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5609974578d0 con 0x56099744ec20 2024-09-13T19:17:14.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.818+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb094051070 con 0x56099744ec20 2024-09-13T19:17:14.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.818+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5609974578d0 con 0x56099744ec20 2024-09-13T19:17:14.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.818+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb094051070 con 0x56099744ec20 2024-09-13T19:17:14.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.818+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5609974578d0 con 0x7fb09004b810 2024-09-13T19:17:14.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.818+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb094051070 con 0x7fb09004b810 2024-09-13T19:17:14.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.818+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5609974578d0 con 0x560997453630 2024-09-13T19:17:14.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.819+0000 7fb09df04640 1 -- 172.21.15.102:0/3275439652 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb098032040 con 0x560997453630 2024-09-13T19:17:14.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.819+0000 7fb09df04640 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5609974578d0 con 0x7fb098058040 2024-09-13T19:17:14.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.819+0000 7fb09d703640 1 -- 172.21.15.102:0/3275439652 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb09002d070 con 0x7fb098058040 2024-09-13T19:17:14.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.819+0000 7fb09d703640 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5609974578d0 con 0x56099744ec20 2024-09-13T19:17:14.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.819+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb094051070 con 0x56099744ec20 2024-09-13T19:17:14.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.819+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5609974578d0 con 0x7fb098058040 2024-09-13T19:17:14.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.819+0000 7fb09d703640 1 -- 172.21.15.102:0/3275439652 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb09002d070 con 0x7fb098058040 2024-09-13T19:17:14.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.819+0000 7fb09d703640 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5609974578d0 con 0x560997453630 2024-09-13T19:17:14.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.819+0000 7fb09df04640 1 -- 172.21.15.102:0/3275439652 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb098032040 con 0x560997453630 2024-09-13T19:17:14.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.819+0000 7fb09df04640 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5609974578d0 con 0x7fb09004b810 2024-09-13T19:17:14.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.820+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb094051070 con 0x7fb09004b810 2024-09-13T19:17:14.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.820+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5609974578d0 con 0x7fb098058040 2024-09-13T19:17:14.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.820+0000 7fb09d703640 1 -- 172.21.15.102:0/3275439652 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb09002d070 con 0x7fb098058040 2024-09-13T19:17:14.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.820+0000 7fb09d703640 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5609974578d0 con 0x560997453630 2024-09-13T19:17:14.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.820+0000 7fb09df04640 1 -- 172.21.15.102:0/3275439652 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb098032040 con 0x560997453630 2024-09-13T19:17:14.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.820+0000 7fb09df04640 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5609974578d0 con 0x7fb09004b810 2024-09-13T19:17:14.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.821+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb094051070 con 0x7fb09004b810 2024-09-13T19:17:14.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.821+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5609974578d0 con 0x56099744ec20 2024-09-13T19:17:14.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.821+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb094051070 con 0x56099744ec20 2024-09-13T19:17:14.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.821+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fb094083080 con 0x7fb098058040 2024-09-13T19:17:14.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.821+0000 7fb09d703640 1 -- 172.21.15.102:0/3275439652 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb09002d070 con 0x7fb098058040 2024-09-13T19:17:14.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.821+0000 7fb09fc0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:17:14.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.821+0000 7fb09fc0f800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:17:14.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.821+0000 7fb09fc0f800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:17:14.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.821+0000 7fb09fc0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:17:14.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.821+0000 7fb09fc0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:17:14.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.821+0000 7fb09fc0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:17:14.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.821+0000 7fb09fc0f800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.821+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5609974569a0 con 0x56099744ec20 2024-09-13T19:17:14.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.821+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb094051070 con 0x56099744ec20 2024-09-13T19:17:14.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.821+0000 7fb09fc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:14.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.821+0000 7fb09fc0f800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.821+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560997457240 con 0x56099744ec20 2024-09-13T19:17:14.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.822+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb094051070 con 0x56099744ec20 2024-09-13T19:17:14.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.822+0000 7fb09fc0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:17:14.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.822+0000 7fb09fc0f800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.822+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5609974565e0 con 0x560997453630 2024-09-13T19:17:14.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.822+0000 7fb09df04640 1 -- 172.21.15.102:0/3275439652 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb098032040 con 0x560997453630 2024-09-13T19:17:14.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.822+0000 7fb09fc0f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:17:14.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.822+0000 7fb09fc0f800 20 zone default found 2024-09-13T19:17:14.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.822+0000 7fb09fc0f800 4 Realm: () 2024-09-13T19:17:14.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.822+0000 7fb09fc0f800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:17:14.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.822+0000 7fb09fc0f800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:17:14.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.822+0000 7fb09fc0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:17:14.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.822+0000 7fb09fc0f800 20 zonegroup default 2024-09-13T19:17:14.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.822+0000 7fb09fc0f800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.822+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560997458250 con 0x7fb098058040 2024-09-13T19:17:14.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.822+0000 7fb09d703640 1 -- 172.21.15.102:0/3275439652 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb09002d070 con 0x7fb098058040 2024-09-13T19:17:14.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.822+0000 7fb09fc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:14.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.822+0000 7fb09fc0f800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.822+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560997457e60 con 0x560997453630 2024-09-13T19:17:14.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.823+0000 7fb09df04640 1 -- 172.21.15.102:0/3275439652 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb098032040 con 0x560997453630 2024-09-13T19:17:14.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.823+0000 7fb09fc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:14.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.823+0000 7fb09fc0f800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.823+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56099745a500 con 0x560997453630 2024-09-13T19:17:14.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.823+0000 7fb09df04640 1 -- 172.21.15.102:0/3275439652 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb098032040 con 0x560997453630 2024-09-13T19:17:14.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.823+0000 7fb09fc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:14.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.823+0000 7fb09fc0f800 20 started sync module instance, tier type = 2024-09-13T19:17:14.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.823+0000 7fb09fc0f800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:17:14.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.823+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5609974598c0 con 0x7fb098058040 2024-09-13T19:17:14.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.824+0000 7fb09d703640 1 -- 172.21.15.102:0/3275439652 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(44 notify.0 [create] v36'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb09002d070 con 0x7fb098058040 2024-09-13T19:17:14.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.824+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94599192613904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56099745a940 con 0x7fb098058040 2024-09-13T19:17:14.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.824+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56099745b190 con 0x56099744ec20 2024-09-13T19:17:14.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.825+0000 7fb09d703640 1 -- 172.21.15.102:0/3275439652 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94599192613904] v36'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb09002d070 con 0x7fb098058040 2024-09-13T19:17:14.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.825+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v36'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb094051070 con 0x56099744ec20 2024-09-13T19:17:14.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.825+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94599192620256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56099745b5b0 con 0x56099744ec20 2024-09-13T19:17:14.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.825+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56099745be80 con 0x560997453630 2024-09-13T19:17:14.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.826+0000 7fb09df04640 1 -- 172.21.15.102:0/3275439652 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v36'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb098032040 con 0x560997453630 2024-09-13T19:17:14.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.826+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94599192622512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56099745ba30 con 0x560997453630 2024-09-13T19:17:14.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.826+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56099745ce70 con 0x7fb098058040 2024-09-13T19:17:14.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.826+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94599192620256] v36'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb094051070 con 0x56099744ec20 2024-09-13T19:17:14.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.827+0000 7fb09df04640 1 -- 172.21.15.102:0/3275439652 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94599192622512] v36'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb098032040 con 0x560997453630 2024-09-13T19:17:14.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.827+0000 7fb09d703640 1 -- 172.21.15.102:0/3275439652 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(50 notify.3 [create] v36'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb09002d070 con 0x7fb098058040 2024-09-13T19:17:14.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.827+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94599192625776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56099745ce30 con 0x7fb098058040 2024-09-13T19:17:14.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.827+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56099745d710 con 0x56099744ec20 2024-09-13T19:17:14.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.828+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v36'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb094051070 con 0x56099744ec20 2024-09-13T19:17:14.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.828+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94599192629856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56099745db30 con 0x56099744ec20 2024-09-13T19:17:14.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.828+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56099745e3e0 con 0x7fb09004b810 2024-09-13T19:17:14.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.828+0000 7fb09d703640 1 -- 172.21.15.102:0/3275439652 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94599192625776] v36'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb09002d070 con 0x7fb098058040 2024-09-13T19:17:14.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.829+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(54 notify.5 [create] v36'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb094051070 con 0x7fb09004b810 2024-09-13T19:17:14.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.829+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94599192627520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56099745dfe0 con 0x7fb09004b810 2024-09-13T19:17:14.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.829+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56099745ee50 con 0x7fb09004b810 2024-09-13T19:17:14.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.830+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94599192629856] v36'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb094051070 con 0x56099744ec20 2024-09-13T19:17:14.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.830+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94599192627520] v36'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb094051070 con 0x7fb09004b810 2024-09-13T19:17:14.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.830+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(56 notify.6 [create] v36'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb094051070 con 0x7fb09004b810 2024-09-13T19:17:14.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.831+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94599192630912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56099745df50 con 0x7fb09004b810 2024-09-13T19:17:14.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.831+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56099745f2e0 con 0x7fb09004b810 2024-09-13T19:17:14.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.831+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94599192630912] v36'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb094051070 con 0x7fb09004b810 2024-09-13T19:17:14.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.832+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(58 notify.7 [create] v36'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb094051070 con 0x7fb09004b810 2024-09-13T19:17:14.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.832+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94599192636944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56099745f4c0 con 0x7fb09004b810 2024-09-13T19:17:14.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.832+0000 7fb09fc0f800 20 add_watcher() i=0 2024-09-13T19:17:14.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.832+0000 7fb09fc0f800 20 add_watcher() i=1 2024-09-13T19:17:14.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.832+0000 7fb09fc0f800 20 add_watcher() i=2 2024-09-13T19:17:14.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.832+0000 7fb09fc0f800 20 add_watcher() i=3 2024-09-13T19:17:14.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.832+0000 7fb09fc0f800 20 add_watcher() i=4 2024-09-13T19:17:14.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.832+0000 7fb09fc0f800 20 add_watcher() i=5 2024-09-13T19:17:14.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.832+0000 7fb09fc0f800 20 add_watcher() i=6 2024-09-13T19:17:14.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.833+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94599192636944] v36'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb094051070 con 0x7fb09004b810 2024-09-13T19:17:14.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.833+0000 7fb09fc0f800 20 add_watcher() i=7 2024-09-13T19:17:14.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.833+0000 7fb09fc0f800 2 all 8 watchers are set, enabling cache 2024-09-13T19:17:14.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.833+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560997462890 con 0x56099744ec20 2024-09-13T19:17:14.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.833+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb094051070 con 0x56099744ec20 2024-09-13T19:17:14.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.833+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94599192638384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56099745fc80 con 0x56099744ec20 2024-09-13T19:17:14.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.834+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94599192638384] v36'208 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb094051070 con 0x56099744ec20 2024-09-13T19:17:14.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.834+0000 7faf53fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:17:14.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.834+0000 7fb09fc0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:17:14.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.834+0000 7fb09fc0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:17:14.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.834+0000 7fb09fc0f800 5 note: GC not initialized 2024-09-13T19:17:14.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.834+0000 7faf52fe5640 20 reqs_thread_entry: start 2024-09-13T19:17:14.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.834+0000 7fb09fc0f800 20 init_complete bucket index max shards: 11 2024-09-13T19:17:14.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.834+0000 7fb09fc0f800 20 Filter name: none 2024-09-13T19:17:14.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.835+0000 7faf50fe1640 20 reqs_thread_entry: start 2024-09-13T19:17:14.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.835+0000 7fb09fc0f800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.835+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5609974955e0 con 0x56099744ec20 2024-09-13T19:17:14.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.835+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb094051070 con 0x56099744ec20 2024-09-13T19:17:14.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.835+0000 7fb09fc0f800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:17:14.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.835+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560997496b30 con 0x7fb09004b810 2024-09-13T19:17:14.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.836+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7fb094051070 con 0x7fb09004b810 2024-09-13T19:17:14.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.837+0000 7faf53fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:17:14.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.837+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94599192638384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560997493c20 con 0x56099744ec20 2024-09-13T19:17:14.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.838+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94599192638384] v36'209 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb094051070 con 0x56099744ec20 2024-09-13T19:17:14.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.838+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94599192613904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56099745f3b0 con 0x7fb098058040 2024-09-13T19:17:14.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.839+0000 7fb09d703640 1 -- 172.21.15.102:0/3275439652 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94599192613904] v36'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb09002d070 con 0x7fb098058040 2024-09-13T19:17:14.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.839+0000 7fb09fc0f800 20 remove_watcher() i=0 2024-09-13T19:17:14.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.839+0000 7fb09fc0f800 2 removed watcher, disabling cache 2024-09-13T19:17:14.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.839+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94599192620256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56099745f3b0 con 0x56099744ec20 2024-09-13T19:17:14.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.840+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94599192620256] v36'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb094051070 con 0x56099744ec20 2024-09-13T19:17:14.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.840+0000 7fb09fc0f800 20 remove_watcher() i=1 2024-09-13T19:17:14.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.840+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94599192622512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56099745ace0 con 0x560997453630 2024-09-13T19:17:14.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.841+0000 7fb09df04640 1 -- 172.21.15.102:0/3275439652 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94599192622512] v36'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb098032040 con 0x560997453630 2024-09-13T19:17:14.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.841+0000 7fb09fc0f800 20 remove_watcher() i=2 2024-09-13T19:17:14.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.841+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94599192625776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56099745f3b0 con 0x7fb098058040 2024-09-13T19:17:14.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.842+0000 7fb09d703640 1 -- 172.21.15.102:0/3275439652 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94599192625776] v36'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb09002d070 con 0x7fb098058040 2024-09-13T19:17:14.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.842+0000 7fb09fc0f800 20 remove_watcher() i=3 2024-09-13T19:17:14.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.842+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94599192629856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56099745b5b0 con 0x56099744ec20 2024-09-13T19:17:14.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.843+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94599192629856] v36'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb094051070 con 0x56099744ec20 2024-09-13T19:17:14.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.843+0000 7fb09fc0f800 20 remove_watcher() i=4 2024-09-13T19:17:14.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.843+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94599192627520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56099745ace0 con 0x7fb09004b810 2024-09-13T19:17:14.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.844+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94599192627520] v36'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb094051070 con 0x7fb09004b810 2024-09-13T19:17:14.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.844+0000 7fb09fc0f800 20 remove_watcher() i=5 2024-09-13T19:17:14.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.844+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94599192630912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56099745f3b0 con 0x7fb09004b810 2024-09-13T19:17:14.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.844+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94599192630912] v36'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb094051070 con 0x7fb09004b810 2024-09-13T19:17:14.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.845+0000 7fb09fc0f800 20 remove_watcher() i=6 2024-09-13T19:17:14.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.845+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94599192636944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56099745f3b0 con 0x7fb09004b810 2024-09-13T19:17:14.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.846+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94599192636944] v36'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb094051070 con 0x7fb09004b810 2024-09-13T19:17:14.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.846+0000 7fb09fc0f800 20 remove_watcher() i=7 2024-09-13T19:17:14.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.846+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fb09004b810 msgr2=0x7fb09001c610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.846+0000 7fb09fc0f800 1 --2- 172.21.15.102:0/3275439652 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fb09004b810 0x7fb09001c610 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.846+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56099744ec20 msgr2=0x5609974510e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.846+0000 7fb09fc0f800 1 --2- 172.21.15.102:0/3275439652 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56099744ec20 0x5609974510e0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.846+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fb098058040 msgr2=0x7fb0980409d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.846+0000 7fb09fc0f800 1 --2- 172.21.15.102:0/3275439652 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fb098058040 0x7fb0980409d0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.846+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x560997453630 msgr2=0x560997455a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.846+0000 7fb09fc0f800 1 --2- 172.21.15.102:0/3275439652 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x560997453630 0x560997455a20 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.846+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7faf68036b40 msgr2=0x7faf68039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.846+0000 7fb09fc0f800 1 --2- 172.21.15.102:0/3275439652 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7faf68036b40 0x7faf68039000 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb09004d300 tx=0x7fb090032040 comp rx=0 tx=0).stop 2024-09-13T19:17:14.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.846+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56099743bd00 msgr2=0x560997443200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.846+0000 7fb09fc0f800 1 --2- 172.21.15.102:0/3275439652 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56099743bd00 0x560997443200 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fb098021000 tx=0x7fb09804cd90 comp rx=0 tx=0).stop 2024-09-13T19:17:14.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.846+0000 7fb09cf02640 1 -- 172.21.15.102:0/3275439652 reap_dead start 2024-09-13T19:17:14.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.846+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 shutdown_connections 2024-09-13T19:17:14.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.846+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 >> 172.21.15.102:0/3275439652 conn(0x560997438060 msgr2=0x560997436130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:14.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.846+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 shutdown_connections 2024-09-13T19:17:14.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.846+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3275439652 wait complete. 2024-09-13T19:17:14.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.846+0000 7fb09fc0f800 1 -- 172.21.15.102:0/2104670575 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7faf74036b90 msgr2=0x7faf74039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.846+0000 7fb09fc0f800 1 --2- 172.21.15.102:0/2104670575 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7faf74036b90 0x7faf74039050 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb09000eb00 tx=0x7fb09000b700 comp rx=0 tx=0).stop 2024-09-13T19:17:14.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.846+0000 7fb09fc0f800 1 -- 172.21.15.102:0/2104670575 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56099742efb0 msgr2=0x56099742f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.846+0000 7fb09fc0f800 1 --2- 172.21.15.102:0/2104670575 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56099742efb0 0x56099742f3d0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x5609974156b0 tx=0x7fb0980163e0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.846+0000 7fb09fc0f800 1 -- 172.21.15.102:0/2104670575 shutdown_connections 2024-09-13T19:17:14.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.846+0000 7fb09fc0f800 1 --2- 172.21.15.102:0/2104670575 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7faf74036b90 0x7faf74039050 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.846+0000 7fb09fc0f800 1 --2- 172.21.15.102:0/2104670575 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56099742efb0 0x56099742f3d0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.846+0000 7fb09fc0f800 1 -- 172.21.15.102:0/2104670575 >> 172.21.15.102:0/2104670575 conn(0x560997423f40 msgr2=0x560997426ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:14.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.846+0000 7fb09fc0f800 1 -- 172.21.15.102:0/2104670575 shutdown_connections 2024-09-13T19:17:14.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.846+0000 7fb09fc0f800 1 -- 172.21.15.102:0/2104670575 wait complete. 2024-09-13T19:17:14.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.847+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3361881336 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56099731e920 msgr2=0x56099741b320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.847+0000 7fb09fc0f800 1 --2- 172.21.15.102:0/3361881336 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56099731e920 0x56099741b320 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.847+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3361881336 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56099741db70 msgr2=0x56099741ff60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.847+0000 7fb09fc0f800 1 --2- 172.21.15.102:0/3361881336 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56099741db70 0x56099741ff60 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.847+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3361881336 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7faf84036d30 msgr2=0x7faf840391f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.847+0000 7fb09fc0f800 1 --2- 172.21.15.102:0/3361881336 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7faf84036d30 0x7faf840391f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb094057000 tx=0x7fb094052000 comp rx=0 tx=0).stop 2024-09-13T19:17:14.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.847+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3361881336 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56099731a4e0 msgr2=0x5609974142b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.847+0000 7fb09fc0f800 1 --2- 172.21.15.102:0/3361881336 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56099731a4e0 0x5609974142b0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fb090000fb0 tx=0x7fb090000ed0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.847+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3361881336 shutdown_connections 2024-09-13T19:17:14.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.847+0000 7fb09fc0f800 1 --2- 172.21.15.102:0/3361881336 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56099741db70 0x56099741ff60 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.847+0000 7fb09fc0f800 1 --2- 172.21.15.102:0/3361881336 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56099731e920 0x56099741b320 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.847+0000 7fb09fc0f800 1 --2- 172.21.15.102:0/3361881336 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7faf84036d30 0x7faf840391f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.847+0000 7fb09fc0f800 1 --2- 172.21.15.102:0/3361881336 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56099731a4e0 0x5609974142b0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.847+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3361881336 >> 172.21.15.102:0/3361881336 conn(0x560997315db0 msgr2=0x5609974038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:14.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.847+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3361881336 shutdown_connections 2024-09-13T19:17:14.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.847+0000 7fb09fc0f800 1 -- 172.21.15.102:0/3361881336 wait complete. 2024-09-13T19:17:14.865 INFO:teuthology.orchestra.run.smithi102.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1}]},{"bucket":"myfoo2","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}],"total":{"bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}}]} 2024-09-13T19:17:14.865 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}}]} 2024-09-13T19:17:14.866 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-13T19:17:14.866 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-13T19:17:14.866 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2024-09-13T19:17:14.918 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:17:14.918 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:17:14.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.916+0000 7fdc2653e800 1 Processor -- start 2024-09-13T19:17:14.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.916+0000 7fdc2653e800 1 -- start start 2024-09-13T19:17:14.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.916+0000 7fdc2653e800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b8579e6e10 0x55b857a78640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.916+0000 7fdc2653e800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b857932b30 con 0x55b857a78b80 2024-09-13T19:17:14.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.916+0000 7fdc2653e800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55b857914360 con 0x55b8579e6e10 2024-09-13T19:17:14.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.916+0000 7fdc22234640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b8579e6e10 0x55b857a78640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.916+0000 7fdc1bfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55b857a78b80 0x55b857a7af70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:50064/0 (socket says 172.21.15.102:50064) 2024-09-13T19:17:14.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.916+0000 7fdc1bfff640 1 -- 172.21.15.102:0/1580851723 learned_addr learned my addr 172.21.15.102:0/1580851723 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:17:14.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.917+0000 7fdc22234640 1 -- 172.21.15.102:0/1580851723 >> v1:172.21.15.53:6789/0 conn(0x55b857a78b80 legacy=0x55b857a7af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.917+0000 7fdc21a33640 1 -- 172.21.15.102:0/1580851723 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 215102125 0 0) 0x55b857932b30 con 0x55b857a78b80 2024-09-13T19:17:14.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.917+0000 7fdc22234640 1 -- 172.21.15.102:0/1580851723 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b85793ae00 con 0x55b8579e6e10 2024-09-13T19:17:14.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.918+0000 7fdc22234640 1 --2- 172.21.15.102:0/1580851723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8579e6e10 0x55b857a78640 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fdc1400a470 tx=0x7fdc14045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0e6e38ec933bd94 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.919+0000 7fdc21a33640 1 -- 172.21.15.102:0/1580851723 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc14053570 con 0x55b8579e6e10 2024-09-13T19:17:14.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.919+0000 7fdc21a33640 1 -- 172.21.15.102:0/1580851723 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc14058070 con 0x55b8579e6e10 2024-09-13T19:17:14.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.919+0000 7fdc21a33640 1 -- 172.21.15.102:0/1580851723 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc14053880 con 0x55b8579e6e10 2024-09-13T19:17:14.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.919+0000 7fdc2653e800 1 -- 172.21.15.102:0/1580851723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8579e6e10 msgr2=0x55b857a78640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.919+0000 7fdc2653e800 1 --2- 172.21.15.102:0/1580851723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8579e6e10 0x55b857a78640 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fdc1400a470 tx=0x7fdc14045a20 comp rx=0 tx=0).stop 2024-09-13T19:17:14.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.919+0000 7fdc2653e800 1 -- 172.21.15.102:0/1580851723 shutdown_connections 2024-09-13T19:17:14.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.919+0000 7fdc2653e800 1 --2- 172.21.15.102:0/1580851723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8579e6e10 0x55b857a78640 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.919+0000 7fdc2653e800 1 -- 172.21.15.102:0/1580851723 >> 172.21.15.102:0/1580851723 conn(0x55b857a6de30 msgr2=0x55b857a70250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:14.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.919+0000 7fdc2653e800 1 -- 172.21.15.102:0/1580851723 shutdown_connections 2024-09-13T19:17:14.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.919+0000 7fdc2653e800 1 -- 172.21.15.102:0/1580851723 wait complete. 2024-09-13T19:17:14.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.933+0000 7fdc2653e800 1 Processor -- start 2024-09-13T19:17:14.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.933+0000 7fdc2653e800 1 -- start start 2024-09-13T19:17:14.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.933+0000 7fdc2653e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8579e6e10 0x55b857b64960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.933+0000 7fdc2653e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b8579bf370 con 0x55b8579e6e10 2024-09-13T19:17:14.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.933+0000 7fdc22234640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8579e6e10 0x55b857b64960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.933+0000 7fdc22234640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8579e6e10 0x55b857b64960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41366/0 (socket says 172.21.15.102:41366) 2024-09-13T19:17:14.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.933+0000 7fdc22234640 1 -- 172.21.15.102:0/2027085415 learned_addr learned my addr 172.21.15.102:0/2027085415 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:14.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.934+0000 7fdc22234640 1 -- 172.21.15.102:0/2027085415 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b85790cbc0 con 0x55b8579e6e10 2024-09-13T19:17:14.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.934+0000 7fdc22234640 1 --2- 172.21.15.102:0/2027085415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8579e6e10 0x55b857b64960 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fdc14005870 tx=0x7fdc14051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d76b69e03c56c9c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.934+0000 7fdb10608640 1 -- 172.21.15.102:0/2027085415 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc1405c580 con 0x55b8579e6e10 2024-09-13T19:17:14.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.934+0000 7fdb10608640 1 -- 172.21.15.102:0/2027085415 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc14063030 con 0x55b8579e6e10 2024-09-13T19:17:14.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.934+0000 7fdb10608640 1 -- 172.21.15.102:0/2027085415 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc1405c850 con 0x55b8579e6e10 2024-09-13T19:17:14.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.935+0000 7fdc2653e800 1 -- 172.21.15.102:0/2027085415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8579e6e10 msgr2=0x55b857b64960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.935+0000 7fdc2653e800 1 --2- 172.21.15.102:0/2027085415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8579e6e10 0x55b857b64960 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fdc14005870 tx=0x7fdc14051000 comp rx=0 tx=0).stop 2024-09-13T19:17:14.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.935+0000 7fdc2653e800 1 -- 172.21.15.102:0/2027085415 shutdown_connections 2024-09-13T19:17:14.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.935+0000 7fdc2653e800 1 --2- 172.21.15.102:0/2027085415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8579e6e10 0x55b857b64960 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.935+0000 7fdc2653e800 1 -- 172.21.15.102:0/2027085415 >> 172.21.15.102:0/2027085415 conn(0x55b857a6de30 msgr2=0x55b857b60320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:14.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.935+0000 7fdc2653e800 1 -- 172.21.15.102:0/2027085415 shutdown_connections 2024-09-13T19:17:14.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.935+0000 7fdc2653e800 1 -- 172.21.15.102:0/2027085415 wait complete. 2024-09-13T19:17:14.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.935+0000 7fdc2653e800 1 Processor -- start 2024-09-13T19:17:14.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.935+0000 7fdc2653e800 1 -- start start 2024-09-13T19:17:14.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.935+0000 7fdc2653e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8579e6e10 0x55b857b6c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.935+0000 7fdc2653e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b857a7c930 con 0x55b8579e6e10 2024-09-13T19:17:14.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.935+0000 7fdc22234640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8579e6e10 0x55b857b6c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.935+0000 7fdc22234640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8579e6e10 0x55b857b6c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41378/0 (socket says 172.21.15.102:41378) 2024-09-13T19:17:14.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.935+0000 7fdc22234640 1 -- 172.21.15.102:0/1683300354 learned_addr learned my addr 172.21.15.102:0/1683300354 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:14.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.936+0000 7fdc22234640 1 -- 172.21.15.102:0/1683300354 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b857920fe0 con 0x55b8579e6e10 2024-09-13T19:17:14.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.936+0000 7fdc22234640 1 --2- 172.21.15.102:0/1683300354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8579e6e10 0x55b857b6c250 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fdc14045f50 tx=0x7fdc14002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.936+0000 7fdb0ee05640 1 -- 172.21.15.102:0/1683300354 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc14078070 con 0x55b8579e6e10 2024-09-13T19:17:14.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.936+0000 7fdb0ee05640 1 -- 172.21.15.102:0/1683300354 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc14054a70 con 0x55b8579e6e10 2024-09-13T19:17:14.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.936+0000 7fdc2653e800 1 -- 172.21.15.102:0/1683300354 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b857b6c790 con 0x55b8579e6e10 2024-09-13T19:17:14.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.936+0000 7fdb0ee05640 1 -- 172.21.15.102:0/1683300354 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc14054d50 con 0x55b8579e6e10 2024-09-13T19:17:14.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.936+0000 7fdc2653e800 1 -- 172.21.15.102:0/1683300354 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b857b6cd10 con 0x55b8579e6e10 2024-09-13T19:17:14.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.937+0000 7fdb0ee05640 1 -- 172.21.15.102:0/1683300354 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fdc1407b070 con 0x55b8579e6e10 2024-09-13T19:17:14.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.937+0000 7fdb0ee05640 1 --2- 172.21.15.102:0/1683300354 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdb08036b90 0x7fdb08039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.937+0000 7fdb0ee05640 1 -- 172.21.15.102:0/1683300354 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fdc14070070 con 0x55b8579e6e10 2024-09-13T19:17:14.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.937+0000 7fdc1bfff640 1 --2- 172.21.15.102:0/1683300354 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdb08036b90 0x7fdb08039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.937+0000 7fdc2653e800 1 --2- 172.21.15.102:0/1683300354 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55b857a78b80 0x55b857b732c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.937+0000 7fdc2653e800 1 -- 172.21.15.102:0/1683300354 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b857b73840 con 0x55b857a78b80 2024-09-13T19:17:14.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.938+0000 7fdc22a35640 1 --2- 172.21.15.102:0/1683300354 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55b857a78b80 0x55b857b732c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.938+0000 7fdc1bfff640 1 --2- 172.21.15.102:0/1683300354 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdb08036b90 0x7fdb08039050 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c000c00 tx=0x7fdc0c0013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.938+0000 7fdc22a35640 1 --2- 172.21.15.102:0/1683300354 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55b857a78b80 0x55b857b732c0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.938+0000 7fdc22a35640 1 -- 172.21.15.102:0/1683300354 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdc1c00a4a0 con 0x55b857a78b80 2024-09-13T19:17:14.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.938+0000 7fdc2653e800 1 -- 172.21.15.102:0/1683300354 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b857b70870 con 0x55b857a78b80 2024-09-13T19:17:14.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.938+0000 7fdc22a35640 1 -- 172.21.15.102:0/1683300354 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdc1c00a4a0 con 0x55b857a78b80 2024-09-13T19:17:14.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.939+0000 7fdc2653e800 1 --2- 172.21.15.102:0/1683300354 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55b857b75b70 0x55b857b77f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.939+0000 7fdc2653e800 1 -- 172.21.15.102:0/1683300354 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b857b78650 con 0x55b857b75b70 2024-09-13T19:17:14.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.939+0000 7fdc22234640 1 --2- 172.21.15.102:0/1683300354 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55b857b75b70 0x55b857b77f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.939+0000 7fdc22234640 1 --2- 172.21.15.102:0/1683300354 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55b857b75b70 0x55b857b77f60 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.939+0000 7fdc22234640 1 -- 172.21.15.102:0/1683300354 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdc1407a030 con 0x55b857b75b70 2024-09-13T19:17:14.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.939+0000 7fdc2653e800 1 -- 172.21.15.102:0/1683300354 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b857b74a10 con 0x55b857a78b80 2024-09-13T19:17:14.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.939+0000 7fdc22a35640 1 -- 172.21.15.102:0/1683300354 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdc1c00a4a0 con 0x55b857a78b80 2024-09-13T19:17:14.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.939+0000 7fdc2653e800 1 -- 172.21.15.102:0/1683300354 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b857b74ef0 con 0x55b857b75b70 2024-09-13T19:17:14.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.940+0000 7fdc22234640 1 -- 172.21.15.102:0/1683300354 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdc1407a030 con 0x55b857b75b70 2024-09-13T19:17:14.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.940+0000 7fdc2653e800 1 Processor -- start 2024-09-13T19:17:14.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.940+0000 7fdc2653e800 1 -- start start 2024-09-13T19:17:14.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.940+0000 7fdc2653e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b857b86fe0 0x55b857b87400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.940+0000 7fdc2653e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b85790e580 con 0x55b857b86fe0 2024-09-13T19:17:14.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.940+0000 7fdc22a35640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b857b86fe0 0x55b857b87400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.940+0000 7fdc22a35640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b857b86fe0 0x55b857b87400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41390/0 (socket says 172.21.15.102:41390) 2024-09-13T19:17:14.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.940+0000 7fdc22a35640 1 -- 172.21.15.102:0/3868802511 learned_addr learned my addr 172.21.15.102:0/3868802511 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:14.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.941+0000 7fdc22a35640 1 -- 172.21.15.102:0/3868802511 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b857b87940 con 0x55b857b86fe0 2024-09-13T19:17:14.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.941+0000 7fdc22a35640 1 --2- 172.21.15.102:0/3868802511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b857b86fe0 0x55b857b87400 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x55b857b73c40 tx=0x7fdc1c0163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.941+0000 7fdb07fff640 1 -- 172.21.15.102:0/3868802511 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc1c013450 con 0x55b857b86fe0 2024-09-13T19:17:14.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.941+0000 7fdb07fff640 1 -- 172.21.15.102:0/3868802511 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc1c0135f0 con 0x55b857b86fe0 2024-09-13T19:17:14.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.941+0000 7fdc2653e800 1 -- 172.21.15.102:0/3868802511 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b857b87bd0 con 0x55b857b86fe0 2024-09-13T19:17:14.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.941+0000 7fdb07fff640 1 -- 172.21.15.102:0/3868802511 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc1c0138d0 con 0x55b857b86fe0 2024-09-13T19:17:14.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.941+0000 7fdc2653e800 1 -- 172.21.15.102:0/3868802511 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b857b8a8b0 con 0x55b857b86fe0 2024-09-13T19:17:14.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.942+0000 7fdb07fff640 1 -- 172.21.15.102:0/3868802511 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fdc1c011040 con 0x55b857b86fe0 2024-09-13T19:17:14.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.942+0000 7fdb07fff640 1 --2- 172.21.15.102:0/3868802511 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdafc036b40 0x7fdafc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.942+0000 7fdb07fff640 1 -- 172.21.15.102:0/3868802511 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fdc1c00e040 con 0x55b857b86fe0 2024-09-13T19:17:14.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.942+0000 7fdc22234640 1 --2- 172.21.15.102:0/3868802511 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdafc036b40 0x7fdafc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.942+0000 7fdc2653e800 1 Processor -- start 2024-09-13T19:17:14.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.942+0000 7fdc22234640 1 --2- 172.21.15.102:0/3868802511 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdafc036b40 0x7fdafc039000 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x55b857b74120 tx=0x7fdc14054f70 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.942+0000 7fdc2653e800 1 -- start start 2024-09-13T19:17:14.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.943+0000 7fdc2653e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b857b93d30 0x55b857b94130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.943+0000 7fdc2653e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b857b650b0 con 0x55b857b93d30 2024-09-13T19:17:14.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.943+0000 7fdc22a35640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b857b93d30 0x55b857b94130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.943+0000 7fdc22a35640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b857b93d30 0x55b857b94130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41402/0 (socket says 172.21.15.102:41402) 2024-09-13T19:17:14.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.943+0000 7fdc22a35640 1 -- 172.21.15.102:0/1167954784 learned_addr learned my addr 172.21.15.102:0/1167954784 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:14.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.943+0000 7fdc22a35640 1 -- 172.21.15.102:0/1167954784 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b857b94700 con 0x55b857b93d30 2024-09-13T19:17:14.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.943+0000 7fdc22a35640 1 --2- 172.21.15.102:0/1167954784 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b857b93d30 0x55b857b94130 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c04cdd0 tx=0x7fdc1c014ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59fce348eb697101 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.943+0000 7fdb05ffb640 1 -- 172.21.15.102:0/1167954784 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc1c01f390 con 0x55b857b93d30 2024-09-13T19:17:14.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.943+0000 7fdb05ffb640 1 -- 172.21.15.102:0/1167954784 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc1c012cb0 con 0x55b857b93d30 2024-09-13T19:17:14.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.943+0000 7fdb05ffb640 1 -- 172.21.15.102:0/1167954784 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc1c01f530 con 0x55b857b93d30 2024-09-13T19:17:14.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.944+0000 7fdc2653e800 1 -- 172.21.15.102:0/1167954784 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b857b93d30 msgr2=0x55b857b94130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:14.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.944+0000 7fdc2653e800 1 --2- 172.21.15.102:0/1167954784 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b857b93d30 0x55b857b94130 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c04cdd0 tx=0x7fdc1c014ae0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.944+0000 7fdc2653e800 1 -- 172.21.15.102:0/1167954784 shutdown_connections 2024-09-13T19:17:14.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.944+0000 7fdc2653e800 1 --2- 172.21.15.102:0/1167954784 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b857b93d30 0x55b857b94130 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:14.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.944+0000 7fdc2653e800 1 -- 172.21.15.102:0/1167954784 >> 172.21.15.102:0/1167954784 conn(0x55b857b90090 msgr2=0x55b857b8e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:14.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.944+0000 7fdc2653e800 1 -- 172.21.15.102:0/1167954784 shutdown_connections 2024-09-13T19:17:14.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.944+0000 7fdc2653e800 1 -- 172.21.15.102:0/1167954784 wait complete. 2024-09-13T19:17:14.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.944+0000 7fdc2653e800 1 Processor -- start 2024-09-13T19:17:14.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.944+0000 7fdc2653e800 1 -- start start 2024-09-13T19:17:14.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.944+0000 7fdc2653e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b857b93d30 0x55b857b9b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.944+0000 7fdc2653e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b857b94d70 con 0x55b857b93d30 2024-09-13T19:17:14.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.945+0000 7fdc22a35640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b857b93d30 0x55b857b9b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.945+0000 7fdc22a35640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b857b93d30 0x55b857b9b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41408/0 (socket says 172.21.15.102:41408) 2024-09-13T19:17:14.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.945+0000 7fdc22a35640 1 -- 172.21.15.102:0/2877453094 learned_addr learned my addr 172.21.15.102:0/2877453094 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:14.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.945+0000 7fdc22a35640 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b857b9b6b0 con 0x55b857b93d30 2024-09-13T19:17:14.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.945+0000 7fdc22a35640 1 --2- 172.21.15.102:0/2877453094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b857b93d30 0x55b857b9b170 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x55b857b8ed00 tx=0x7fdc1c04cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.945+0000 7fdaf3fff640 1 -- 172.21.15.102:0/2877453094 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc1c039020 con 0x55b857b93d30 2024-09-13T19:17:14.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.945+0000 7fdaf3fff640 1 -- 172.21.15.102:0/2877453094 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc1c01f990 con 0x55b857b93d30 2024-09-13T19:17:14.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.945+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b857b9b940 con 0x55b857b93d30 2024-09-13T19:17:14.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.945+0000 7fdaf3fff640 1 -- 172.21.15.102:0/2877453094 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc1c030040 con 0x55b857b93d30 2024-09-13T19:17:14.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.945+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b857b9e5f0 con 0x55b857b93d30 2024-09-13T19:17:14.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.946+0000 7fdaf3fff640 1 -- 172.21.15.102:0/2877453094 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fdc1c03c020 con 0x55b857b93d30 2024-09-13T19:17:14.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.946+0000 7fdaf3fff640 1 --2- 172.21.15.102:0/2877453094 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdaec036b40 0x7fdaec039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.946+0000 7fdaf3fff640 1 -- 172.21.15.102:0/2877453094 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fdc1c03fd10 con 0x55b857b93d30 2024-09-13T19:17:14.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.946+0000 7fdc22234640 1 --2- 172.21.15.102:0/2877453094 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdaec036b40 0x7fdaec039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.947+0000 7fdc22234640 1 --2- 172.21.15.102:0/2877453094 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdaec036b40 0x7fdaec039000 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fdc14009e60 tx=0x7fdc14084000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.947+0000 7fdc2653e800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.947+0000 7fdc2653e800 1 --2- 172.21.15.102:0/2877453094 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55b857ba6e70 0x55b857ba9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.947+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b857ba9a80 con 0x55b857ba6e70 2024-09-13T19:17:14.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.947+0000 7fdc1bfff640 1 --2- 172.21.15.102:0/2877453094 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55b857ba6e70 0x55b857ba9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.948+0000 7fdc1bfff640 1 --2- 172.21.15.102:0/2877453094 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55b857ba6e70 0x55b857ba9330 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.948+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdc0c00f5f0 con 0x55b857ba6e70 2024-09-13T19:17:14.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.948+0000 7fdc2653e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:14.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.948+0000 7fdc2653e800 20 realm 2024-09-13T19:17:14.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.948+0000 7fdc2653e800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.948+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b857ba62c0 con 0x55b857ba6e70 2024-09-13T19:17:14.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.948+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdc0c00f5f0 con 0x55b857ba6e70 2024-09-13T19:17:14.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.948+0000 7fdc2653e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:14.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.948+0000 7fdc2653e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:17:14.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.948+0000 7fdc2653e800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.948+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b857baa570 con 0x55b857ba6e70 2024-09-13T19:17:14.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.948+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdc0c00f5f0 con 0x55b857ba6e70 2024-09-13T19:17:14.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.948+0000 7fdc2653e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:14.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.948+0000 7fdc2653e800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.948+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b857baae40 con 0x55b857ba6e70 2024-09-13T19:17:14.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.949+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdc0c00f5f0 con 0x55b857ba6e70 2024-09-13T19:17:14.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.949+0000 7fdc2653e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:17:14.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.949+0000 7fdc2653e800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.949+0000 7fdc2653e800 1 --2- 172.21.15.102:0/2877453094 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55b857bab860 0x55b857badc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.949+0000 7fdc22a35640 1 --2- 172.21.15.102:0/2877453094 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55b857bab860 0x55b857badc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.949+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b857bae3c0 con 0x55b857bab860 2024-09-13T19:17:14.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.949+0000 7fdc22a35640 1 --2- 172.21.15.102:0/2877453094 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55b857bab860 0x55b857badc50 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.949+0000 7fdc22a35640 1 -- 172.21.15.102:0/2877453094 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdc1c033040 con 0x55b857bab860 2024-09-13T19:17:14.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.949+0000 7fdc2653e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:17:14.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.949+0000 7fdc2653e800 20 searching for the correct realm 2024-09-13T19:17:14.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.949+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b857bafcf0 con 0x55b857bab860 2024-09-13T19:17:14.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.949+0000 7fdc22a35640 1 -- 172.21.15.102:0/2877453094 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc1c033040 con 0x55b857bab860 2024-09-13T19:17:14.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.949+0000 7fdc22a35640 1 --2- 172.21.15.102:0/2877453094 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fdc1c03e020 0x7fdc1c04b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.949+0000 7fdc22a35640 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b857bafcf0 con 0x7fdc1c03e020 2024-09-13T19:17:14.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.950+0000 7fdc22234640 1 --2- 172.21.15.102:0/2877453094 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fdc1c03e020 0x7fdc1c04b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.950+0000 7fdc22234640 1 --2- 172.21.15.102:0/2877453094 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fdc1c03e020 0x7fdc1c04b390 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.950+0000 7fdc22234640 1 -- 172.21.15.102:0/2877453094 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc1408b050 con 0x7fdc1c03e020 2024-09-13T19:17:14.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.950+0000 7fdc22234640 1 --2- 172.21.15.102:0/2877453094 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fdc1407d060 0x7fdc140900b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:14.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.950+0000 7fdc22234640 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b857bafcf0 con 0x7fdc1407d060 2024-09-13T19:17:14.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.950+0000 7fdc1bfff640 1 --2- 172.21.15.102:0/2877453094 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fdc1407d060 0x7fdc140900b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:14.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.951+0000 7fdc1bfff640 1 --2- 172.21.15.102:0/2877453094 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fdc1407d060 0x7fdc140900b0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:14.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.951+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc0c00f5f0 con 0x7fdc1407d060 2024-09-13T19:17:14.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.951+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b857bafcf0 con 0x55b857ba6e70 2024-09-13T19:17:14.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.951+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc0c00f5f0 con 0x55b857ba6e70 2024-09-13T19:17:14.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.951+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b857bafcf0 con 0x55b857ba6e70 2024-09-13T19:17:14.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.952+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc0c02b040 con 0x55b857ba6e70 2024-09-13T19:17:14.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.952+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b857bafcf0 con 0x7fdc1407d060 2024-09-13T19:17:14.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.952+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc0c02b040 con 0x7fdc1407d060 2024-09-13T19:17:14.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.952+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b857bafcf0 con 0x7fdc1407d060 2024-09-13T19:17:14.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.952+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc0c02b040 con 0x7fdc1407d060 2024-09-13T19:17:14.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.952+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b857bafcf0 con 0x7fdc1c03e020 2024-09-13T19:17:14.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.952+0000 7fdc22234640 1 -- 172.21.15.102:0/2877453094 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc1408b050 con 0x7fdc1c03e020 2024-09-13T19:17:14.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.952+0000 7fdc22234640 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b857bafcf0 con 0x55b857bab860 2024-09-13T19:17:14.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.953+0000 7fdc22a35640 1 -- 172.21.15.102:0/2877453094 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc1c033040 con 0x55b857bab860 2024-09-13T19:17:14.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.953+0000 7fdc22a35640 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b857bafcf0 con 0x55b857ba6e70 2024-09-13T19:17:14.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.953+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc0c02b040 con 0x55b857ba6e70 2024-09-13T19:17:14.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.953+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b857bafcf0 con 0x7fdc1c03e020 2024-09-13T19:17:14.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.953+0000 7fdc22234640 1 -- 172.21.15.102:0/2877453094 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc1408b050 con 0x7fdc1c03e020 2024-09-13T19:17:14.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.953+0000 7fdc22234640 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b857bafcf0 con 0x55b857ba6e70 2024-09-13T19:17:14.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.953+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc0c02b040 con 0x55b857ba6e70 2024-09-13T19:17:14.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.953+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b857bafcf0 con 0x7fdc1c03e020 2024-09-13T19:17:14.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.954+0000 7fdc22234640 1 -- 172.21.15.102:0/2877453094 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdc1408b050 con 0x7fdc1c03e020 2024-09-13T19:17:14.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.954+0000 7fdc22234640 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b857bafcf0 con 0x55b857bab860 2024-09-13T19:17:14.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.954+0000 7fdc22a35640 1 -- 172.21.15.102:0/2877453094 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc1c033040 con 0x55b857bab860 2024-09-13T19:17:14.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.954+0000 7fdc22a35640 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b857bafcf0 con 0x55b857bab860 2024-09-13T19:17:14.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.954+0000 7fdc22a35640 1 -- 172.21.15.102:0/2877453094 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdc1c033040 con 0x55b857bab860 2024-09-13T19:17:14.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.954+0000 7fdc22a35640 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b857bafcf0 con 0x7fdc1407d060 2024-09-13T19:17:14.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.954+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc0c02b040 con 0x7fdc1407d060 2024-09-13T19:17:14.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.954+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b857bafcf0 con 0x55b857bab860 2024-09-13T19:17:14.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.955+0000 7fdc22a35640 1 -- 172.21.15.102:0/2877453094 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdc1c033040 con 0x55b857bab860 2024-09-13T19:17:14.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.955+0000 7fdc22a35640 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b857bafcf0 con 0x55b857bab860 2024-09-13T19:17:14.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.955+0000 7fdc22a35640 1 -- 172.21.15.102:0/2877453094 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc1c033040 con 0x55b857bab860 2024-09-13T19:17:14.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.955+0000 7fdc22a35640 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b857bafcf0 con 0x55b857ba6e70 2024-09-13T19:17:14.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.955+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc0c02b040 con 0x55b857ba6e70 2024-09-13T19:17:14.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.955+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b857bafcf0 con 0x55b857ba6e70 2024-09-13T19:17:14.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.955+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdc0c02b040 con 0x55b857ba6e70 2024-09-13T19:17:14.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.955+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b857bafcf0 con 0x7fdc1407d060 2024-09-13T19:17:14.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.956+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc0c02b040 con 0x7fdc1407d060 2024-09-13T19:17:14.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.956+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b857bafcf0 con 0x55b857bab860 2024-09-13T19:17:14.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.956+0000 7fdc22a35640 1 -- 172.21.15.102:0/2877453094 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc1c033040 con 0x55b857bab860 2024-09-13T19:17:14.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.956+0000 7fdc22a35640 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b857bafcf0 con 0x7fdc1c03e020 2024-09-13T19:17:14.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.956+0000 7fdc22234640 1 -- 172.21.15.102:0/2877453094 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc1408b050 con 0x7fdc1c03e020 2024-09-13T19:17:14.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.956+0000 7fdc22234640 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b857bafcf0 con 0x55b857ba6e70 2024-09-13T19:17:14.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.956+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc0c02b040 con 0x55b857ba6e70 2024-09-13T19:17:14.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.956+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b857bafcf0 con 0x7fdc1c03e020 2024-09-13T19:17:14.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.956+0000 7fdc22234640 1 -- 172.21.15.102:0/2877453094 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc1408b050 con 0x7fdc1c03e020 2024-09-13T19:17:14.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.956+0000 7fdc22234640 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b857bafcf0 con 0x55b857bab860 2024-09-13T19:17:14.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.957+0000 7fdc22a35640 1 -- 172.21.15.102:0/2877453094 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc1c033040 con 0x55b857bab860 2024-09-13T19:17:14.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.957+0000 7fdc22a35640 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b857bafcf0 con 0x7fdc1407d060 2024-09-13T19:17:14.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.957+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc0c02b040 con 0x7fdc1407d060 2024-09-13T19:17:14.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.957+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b857bafcf0 con 0x7fdc1c03e020 2024-09-13T19:17:14.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.957+0000 7fdc22234640 1 -- 172.21.15.102:0/2877453094 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc1408b050 con 0x7fdc1c03e020 2024-09-13T19:17:14.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.957+0000 7fdc22234640 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b857bafcf0 con 0x55b857bab860 2024-09-13T19:17:14.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.958+0000 7fdc22a35640 1 -- 172.21.15.102:0/2877453094 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc1c033040 con 0x55b857bab860 2024-09-13T19:17:14.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.958+0000 7fdc22a35640 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b857bafcf0 con 0x7fdc1407d060 2024-09-13T19:17:14.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.958+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc0c02b040 con 0x7fdc1407d060 2024-09-13T19:17:14.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.958+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b857bafcf0 con 0x55b857ba6e70 2024-09-13T19:17:14.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.959+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdc0c02b040 con 0x55b857ba6e70 2024-09-13T19:17:14.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.959+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b857bafcf0 con 0x7fdc1c03e020 2024-09-13T19:17:14.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.959+0000 7fdc22234640 1 -- 172.21.15.102:0/2877453094 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc1408b050 con 0x7fdc1c03e020 2024-09-13T19:17:14.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.959+0000 7fdc2653e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:17:14.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.959+0000 7fdc2653e800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:17:14.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.959+0000 7fdc2653e800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:17:14.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.959+0000 7fdc2653e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:17:14.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.959+0000 7fdc2653e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:17:14.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.959+0000 7fdc2653e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:17:14.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.959+0000 7fdc2653e800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.959+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b857baed80 con 0x55b857ba6e70 2024-09-13T19:17:14.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.959+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdc0c02b040 con 0x55b857ba6e70 2024-09-13T19:17:14.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.959+0000 7fdc2653e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:14.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.959+0000 7fdc2653e800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.959+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b857baf620 con 0x55b857ba6e70 2024-09-13T19:17:14.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.959+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdc0c02b040 con 0x55b857ba6e70 2024-09-13T19:17:14.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.959+0000 7fdc2653e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:17:14.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.959+0000 7fdc2653e800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.959+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b857bb0170 con 0x55b857bab860 2024-09-13T19:17:14.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.960+0000 7fdc22a35640 1 -- 172.21.15.102:0/2877453094 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdc1c033040 con 0x55b857bab860 2024-09-13T19:17:14.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.960+0000 7fdc2653e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:17:14.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.960+0000 7fdc2653e800 20 zone default found 2024-09-13T19:17:14.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.960+0000 7fdc2653e800 4 Realm: () 2024-09-13T19:17:14.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.960+0000 7fdc2653e800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:17:14.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.960+0000 7fdc2653e800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:17:14.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.960+0000 7fdc2653e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:17:14.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.960+0000 7fdc2653e800 20 zonegroup default 2024-09-13T19:17:14.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.960+0000 7fdc2653e800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.960+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b857baf260 con 0x7fdc1c03e020 2024-09-13T19:17:14.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.960+0000 7fdc22234640 1 -- 172.21.15.102:0/2877453094 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdc1408b050 con 0x7fdc1c03e020 2024-09-13T19:17:14.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.960+0000 7fdc2653e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:14.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.960+0000 7fdc2653e800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.960+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b857bb28d0 con 0x55b857bab860 2024-09-13T19:17:14.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.960+0000 7fdc22a35640 1 -- 172.21.15.102:0/2877453094 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdc1c033040 con 0x55b857bab860 2024-09-13T19:17:14.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.960+0000 7fdc2653e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:14.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.960+0000 7fdc2653e800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.960+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b857bb28d0 con 0x55b857bab860 2024-09-13T19:17:14.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.960+0000 7fdc22a35640 1 -- 172.21.15.102:0/2877453094 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdc1c033040 con 0x55b857bab860 2024-09-13T19:17:14.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.960+0000 7fdc2653e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:14.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.960+0000 7fdc2653e800 20 started sync module instance, tier type = 2024-09-13T19:17:14.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.960+0000 7fdc2653e800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:17:14.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.960+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b857bb1d10 con 0x7fdc1c03e020 2024-09-13T19:17:14.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.962+0000 7fdc22234640 1 -- 172.21.15.102:0/2877453094 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(44 notify.0 [create] v36'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc1408b050 con 0x7fdc1c03e020 2024-09-13T19:17:14.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.962+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94250234224816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b857bb2980 con 0x7fdc1c03e020 2024-09-13T19:17:14.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.962+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b857bb3210 con 0x55b857ba6e70 2024-09-13T19:17:14.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.963+0000 7fdc22234640 1 -- 172.21.15.102:0/2877453094 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94250234224816] v36'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc1408b050 con 0x7fdc1c03e020 2024-09-13T19:17:14.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.963+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v36'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc0c02b040 con 0x55b857ba6e70 2024-09-13T19:17:14.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.963+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94250234225872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b857bb3ab0 con 0x55b857ba6e70 2024-09-13T19:17:14.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.963+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b857bb4470 con 0x55b857bab860 2024-09-13T19:17:14.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.964+0000 7fdc22a35640 1 -- 172.21.15.102:0/2877453094 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v36'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc1c033040 con 0x55b857bab860 2024-09-13T19:17:14.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.964+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94250234232768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b857bb4420 con 0x55b857bab860 2024-09-13T19:17:14.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.964+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b857bb5440 con 0x7fdc1c03e020 2024-09-13T19:17:14.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.964+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94250234225872] v36'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc0c02b040 con 0x55b857ba6e70 2024-09-13T19:17:14.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.965+0000 7fdc22234640 1 -- 172.21.15.102:0/2877453094 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(50 notify.3 [create] v36'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc1408b050 con 0x7fdc1c03e020 2024-09-13T19:17:14.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.965+0000 7fdc22a35640 1 -- 172.21.15.102:0/2877453094 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94250234232768] v36'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc1c033040 con 0x55b857bab860 2024-09-13T19:17:14.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.965+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94250234236720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b857bb5400 con 0x7fdc1c03e020 2024-09-13T19:17:14.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.965+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b857bb4860 con 0x55b857ba6e70 2024-09-13T19:17:14.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.966+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v36'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc0c02b040 con 0x55b857ba6e70 2024-09-13T19:17:14.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.966+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94250234239488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b857bb5400 con 0x55b857ba6e70 2024-09-13T19:17:14.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.966+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b857bb6930 con 0x7fdc1407d060 2024-09-13T19:17:14.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.966+0000 7fdc22234640 1 -- 172.21.15.102:0/2877453094 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94250234236720] v36'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc1408b050 con 0x7fdc1c03e020 2024-09-13T19:17:14.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.967+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(54 notify.5 [create] v36'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc0c02b040 con 0x7fdc1407d060 2024-09-13T19:17:14.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.967+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94250234230272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b857bb68f0 con 0x7fdc1407d060 2024-09-13T19:17:14.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.967+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b857bb73a0 con 0x7fdc1407d060 2024-09-13T19:17:14.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.967+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94250234239488] v36'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc0c02b040 con 0x55b857ba6e70 2024-09-13T19:17:14.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.968+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(56 notify.6 [create] v36'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc0c02b040 con 0x7fdc1407d060 2024-09-13T19:17:14.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.968+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94250234244752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b857bb7360 con 0x7fdc1407d060 2024-09-13T19:17:14.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.968+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b857bb7da0 con 0x7fdc1407d060 2024-09-13T19:17:14.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.968+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94250234230272] v36'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc0c02b040 con 0x7fdc1407d060 2024-09-13T19:17:14.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.969+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94250234244752] v36'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc0c02b040 con 0x7fdc1407d060 2024-09-13T19:17:14.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.969+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(58 notify.7 [create] v36'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc0c02b040 con 0x7fdc1407d060 2024-09-13T19:17:14.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.969+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94250234240544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b857bb6440 con 0x7fdc1407d060 2024-09-13T19:17:14.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.969+0000 7fdc2653e800 20 add_watcher() i=0 2024-09-13T19:17:14.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.969+0000 7fdc2653e800 20 add_watcher() i=1 2024-09-13T19:17:14.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.969+0000 7fdc2653e800 20 add_watcher() i=2 2024-09-13T19:17:14.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.969+0000 7fdc2653e800 20 add_watcher() i=3 2024-09-13T19:17:14.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.969+0000 7fdc2653e800 20 add_watcher() i=4 2024-09-13T19:17:14.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.969+0000 7fdc2653e800 20 add_watcher() i=5 2024-09-13T19:17:14.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.969+0000 7fdc2653e800 20 add_watcher() i=6 2024-09-13T19:17:14.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.970+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94250234240544] v36'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc0c02b040 con 0x7fdc1407d060 2024-09-13T19:17:14.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.970+0000 7fdc2653e800 20 add_watcher() i=7 2024-09-13T19:17:14.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.970+0000 7fdc2653e800 2 all 8 watchers are set, enabling cache 2024-09-13T19:17:14.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.970+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b857bbad90 con 0x55b857ba6e70 2024-09-13T19:17:14.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.971+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdc0c02b040 con 0x55b857ba6e70 2024-09-13T19:17:14.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.971+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94250234247280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b857bb8210 con 0x55b857ba6e70 2024-09-13T19:17:14.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.972+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94250234247280] v36'210 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdc0c02b040 con 0x55b857ba6e70 2024-09-13T19:17:14.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.972+0000 7fdad8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:17:14.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.972+0000 7fdc2653e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:17:14.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.972+0000 7fdc2653e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:17:14.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.972+0000 7fdc2653e800 5 note: GC not initialized 2024-09-13T19:17:14.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.972+0000 7fda537fe640 20 reqs_thread_entry: start 2024-09-13T19:17:14.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.972+0000 7fdc2653e800 20 init_complete bucket index max shards: 11 2024-09-13T19:17:14.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.972+0000 7fdc2653e800 20 Filter name: none 2024-09-13T19:17:14.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.972+0000 7fda517fa640 20 reqs_thread_entry: start 2024-09-13T19:17:14.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.972+0000 7fdc2653e800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-13T19:17:14.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.972+0000 7fdc2653e800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.972+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b857bee100 con 0x7fdc1407d060 2024-09-13T19:17:14.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.973+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fdc0c02b040 con 0x7fdc1407d060 2024-09-13T19:17:14.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.973+0000 7fdc2653e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:14.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.973+0000 7fdc2653e800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-13T19:17:14.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.973+0000 7fdc2653e800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-13T19:17:14.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.973+0000 7fdc2653e800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-13T19:17:14.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.973+0000 7fdc2653e800 20 rados->read ofs=0 len=0 2024-09-13T19:17:14.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.973+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:63 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b857bec740 con 0x55b857ba6e70 2024-09-13T19:17:14.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.973+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(63 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fdc0c02b040 con 0x55b857ba6e70 2024-09-13T19:17:14.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.973+0000 7fdc2653e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:14.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.973+0000 7fdc2653e800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-13T19:17:14.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.973+0000 7fdc2653e800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-13T19:17:14.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.973+0000 7fdc2653e800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-13T19:17:14.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.973+0000 7fdc2653e800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-13T19:17:14.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.973+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:64 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b857bed010 con 0x7fdc1407d060 2024-09-13T19:17:14.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.974+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(64 bar [delete,create,call,writefull 0~380] v36'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fdc0c02b040 con 0x7fdc1407d060 2024-09-13T19:17:14.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.974+0000 7fdc2653e800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-13T19:17:14.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.974+0000 7fdc2653e800 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-13T19:17:14.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.974+0000 7fdc2653e800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-13T19:17:14.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.974+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:65 7.9 7:93e5b521:::notify.7:head [notify cookie 94250234465120 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b857bf1ba0 con 0x7fdc1407d060 2024-09-13T19:17:14.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.975+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== watch-notify(notify (1) cookie 94250234240544 notify 154618822676 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55b857bed3b0 con 0x7fdc1407d060 2024-09-13T19:17:14.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.975+0000 7fdb05ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822676 cookie 94250234240544 notifier 4734 bl.length()=556 2024-09-13T19:17:14.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.975+0000 7fdb05ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-13T19:17:14.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.975+0000 7fdb05ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-13T19:17:14.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.975+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(65 notify.7 [notify cookie 94250234465120 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdc0c02b040 con 0x7fdc1407d060 2024-09-13T19:17:14.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.975+0000 7fdb05ffb640 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:66 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fdae8003ea0 con 0x7fdc1407d060 2024-09-13T19:17:14.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.975+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(66 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc0c02b040 con 0x7fdc1407d060 2024-09-13T19:17:14.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.975+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== watch-notify(notify_complete (2) cookie 94250234465120 notify 154618822676 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b857bedb50 con 0x7fdc1407d060 2024-09-13T19:17:14.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.975+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:67 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b857bef6d0 con 0x55b857ba6e70 2024-09-13T19:17:14.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.976+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(67 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v36'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fdc0c02b040 con 0x55b857ba6e70 2024-09-13T19:17:14.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.976+0000 7fdc2653e800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-13T19:17:14.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.976+0000 7fdc2653e800 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-13T19:17:14.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.976+0000 7fdc2653e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-13T19:17:14.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.976+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94250234464992 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b857bf1ba0 con 0x7fdc1407d060 2024-09-13T19:17:14.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.977+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 <== osd.0 v2:172.21.15.53:6800/4021716951 20 ==== watch-notify(notify (1) cookie 94250234230272 notify 154618822677 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55b857bedb50 con 0x7fdc1407d060 2024-09-13T19:17:14.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.977+0000 7fdb05ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822677 cookie 94250234230272 notifier 4734 bl.length()=177 2024-09-13T19:17:14.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.977+0000 7fdb05ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-13T19:17:14.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.977+0000 7fdb05ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-13T19:17:14.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.977+0000 7fdb05ffb640 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fdae8003ea0 con 0x7fdc1407d060 2024-09-13T19:17:14.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.977+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 <== osd.0 v2:172.21.15.53:6800/4021716951 21 ==== osd_op_reply(68 notify.5 [notify cookie 94250234464992 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdc0c02b040 con 0x7fdc1407d060 2024-09-13T19:17:14.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.977+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 <== osd.0 v2:172.21.15.53:6800/4021716951 22 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc0c02b040 con 0x7fdc1407d060 2024-09-13T19:17:14.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.977+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 <== osd.0 v2:172.21.15.53:6800/4021716951 23 ==== watch-notify(notify_complete (2) cookie 94250234464992 notify 154618822677 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fdc0c018040 con 0x7fdc1407d060 2024-09-13T19:17:14.997 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"bar","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bar","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-13T19:17:14.974541Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:17:14.974529Z","tags":[],"group_ids":[]} 2024-09-13T19:17:15.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.978+0000 7fdad8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:17:15.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.978+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94250234247280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b857bebdc0 con 0x55b857ba6e70 2024-09-13T19:17:15.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.979+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94250234247280] v36'211 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdc0c02b040 con 0x55b857ba6e70 2024-09-13T19:17:15.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.979+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94250234224816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b857bebdc0 con 0x7fdc1c03e020 2024-09-13T19:17:15.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.980+0000 7fdc22234640 1 -- 172.21.15.102:0/2877453094 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94250234224816] v36'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc1408b050 con 0x7fdc1c03e020 2024-09-13T19:17:15.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.980+0000 7fdc2653e800 20 remove_watcher() i=0 2024-09-13T19:17:15.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.980+0000 7fdc2653e800 2 removed watcher, disabling cache 2024-09-13T19:17:15.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.980+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94250234225872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b857bebdc0 con 0x55b857ba6e70 2024-09-13T19:17:15.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.981+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94250234225872] v36'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc0c02b040 con 0x55b857ba6e70 2024-09-13T19:17:15.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.981+0000 7fdc2653e800 20 remove_watcher() i=1 2024-09-13T19:17:15.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.981+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94250234232768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b857bebdc0 con 0x55b857bab860 2024-09-13T19:17:15.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.982+0000 7fdc22a35640 1 -- 172.21.15.102:0/2877453094 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94250234232768] v36'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc1c033040 con 0x55b857bab860 2024-09-13T19:17:15.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.982+0000 7fdc2653e800 20 remove_watcher() i=2 2024-09-13T19:17:15.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.982+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94250234236720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b857bebdc0 con 0x7fdc1c03e020 2024-09-13T19:17:15.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.983+0000 7fdc22234640 1 -- 172.21.15.102:0/2877453094 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94250234236720] v36'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc1408b050 con 0x7fdc1c03e020 2024-09-13T19:17:15.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.983+0000 7fdc2653e800 20 remove_watcher() i=3 2024-09-13T19:17:15.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.983+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94250234239488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b857bebdc0 con 0x55b857ba6e70 2024-09-13T19:17:15.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.985+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94250234239488] v36'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc0c02b040 con 0x55b857ba6e70 2024-09-13T19:17:15.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.985+0000 7fdc2653e800 20 remove_watcher() i=4 2024-09-13T19:17:15.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.985+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94250234230272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b857bebdc0 con 0x7fdc1407d060 2024-09-13T19:17:15.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.986+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 <== osd.0 v2:172.21.15.53:6800/4021716951 24 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94250234230272] v36'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc0c02b040 con 0x7fdc1407d060 2024-09-13T19:17:15.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.986+0000 7fdc2653e800 20 remove_watcher() i=5 2024-09-13T19:17:15.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.986+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94250234244752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b857bebdc0 con 0x7fdc1407d060 2024-09-13T19:17:15.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.987+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 <== osd.0 v2:172.21.15.53:6800/4021716951 25 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94250234244752] v36'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc0c02b040 con 0x7fdc1407d060 2024-09-13T19:17:15.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.987+0000 7fdc2653e800 20 remove_watcher() i=6 2024-09-13T19:17:15.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.987+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94250234240544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b857bebdc0 con 0x7fdc1407d060 2024-09-13T19:17:15.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.988+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 <== osd.0 v2:172.21.15.53:6800/4021716951 26 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94250234240544] v36'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc0c02b040 con 0x7fdc1407d060 2024-09-13T19:17:15.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.988+0000 7fdc2653e800 20 remove_watcher() i=7 2024-09-13T19:17:15.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.988+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fdc1407d060 msgr2=0x7fdc140900b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:15.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.988+0000 7fdc2653e800 1 --2- 172.21.15.102:0/2877453094 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fdc1407d060 0x7fdc140900b0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:15.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.988+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55b857ba6e70 msgr2=0x55b857ba9330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:15.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.988+0000 7fdc2653e800 1 --2- 172.21.15.102:0/2877453094 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55b857ba6e70 0x55b857ba9330 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:15.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.988+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fdc1c03e020 msgr2=0x7fdc1c04b390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:15.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.988+0000 7fdc2653e800 1 --2- 172.21.15.102:0/2877453094 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fdc1c03e020 0x7fdc1c04b390 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:15.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.988+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55b857bab860 msgr2=0x55b857badc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:15.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.988+0000 7fdc2653e800 1 --2- 172.21.15.102:0/2877453094 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55b857bab860 0x55b857badc50 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:15.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.988+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdaec036b40 msgr2=0x7fdaec039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:15.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.988+0000 7fdc2653e800 1 --2- 172.21.15.102:0/2877453094 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdaec036b40 0x7fdaec039000 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fdc14009e60 tx=0x7fdc14084000 comp rx=0 tx=0).stop 2024-09-13T19:17:15.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.988+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b857b93d30 msgr2=0x55b857b9b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:15.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.988+0000 7fdc2653e800 1 --2- 172.21.15.102:0/2877453094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b857b93d30 0x55b857b9b170 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x55b857b8ed00 tx=0x7fdc1c04cd60 comp rx=0 tx=0).stop 2024-09-13T19:17:15.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.988+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 reap_dead start 2024-09-13T19:17:15.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.988+0000 7fdc1bfff640 1 -- 172.21.15.102:0/2877453094 reap_dead start 2024-09-13T19:17:15.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.988+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 shutdown_connections 2024-09-13T19:17:15.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.988+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 >> 172.21.15.102:0/2877453094 conn(0x55b857b90090 msgr2=0x55b857b8e160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:15.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.988+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 shutdown_connections 2024-09-13T19:17:15.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.988+0000 7fdc2653e800 1 -- 172.21.15.102:0/2877453094 wait complete. 2024-09-13T19:17:15.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.988+0000 7fdc2653e800 1 -- 172.21.15.102:0/3868802511 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdafc036b40 msgr2=0x7fdafc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:15.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.988+0000 7fdc2653e800 1 --2- 172.21.15.102:0/3868802511 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdafc036b40 0x7fdafc039000 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x55b857b74120 tx=0x7fdc14054f70 comp rx=0 tx=0).stop 2024-09-13T19:17:15.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.988+0000 7fdc2653e800 1 -- 172.21.15.102:0/3868802511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b857b86fe0 msgr2=0x55b857b87400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:15.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.988+0000 7fdc2653e800 1 --2- 172.21.15.102:0/3868802511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b857b86fe0 0x55b857b87400 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x55b857b73c40 tx=0x7fdc1c0163e0 comp rx=0 tx=0).stop 2024-09-13T19:17:15.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.988+0000 7fdc2653e800 1 -- 172.21.15.102:0/3868802511 shutdown_connections 2024-09-13T19:17:15.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.988+0000 7fdc2653e800 1 --2- 172.21.15.102:0/3868802511 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdafc036b40 0x7fdafc039000 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:15.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.988+0000 7fdc2653e800 1 --2- 172.21.15.102:0/3868802511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b857b86fe0 0x55b857b87400 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:15.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.988+0000 7fdc2653e800 1 -- 172.21.15.102:0/3868802511 >> 172.21.15.102:0/3868802511 conn(0x55b857b7bf70 msgr2=0x55b857b7eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:15.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.988+0000 7fdc2653e800 1 -- 172.21.15.102:0/3868802511 shutdown_connections 2024-09-13T19:17:15.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.989+0000 7fdc2653e800 1 -- 172.21.15.102:0/3868802511 wait complete. 2024-09-13T19:17:15.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.989+0000 7fdc2653e800 1 -- 172.21.15.102:0/1683300354 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55b857a78b80 msgr2=0x55b857b732c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:15.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.989+0000 7fdc2653e800 1 --2- 172.21.15.102:0/1683300354 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55b857a78b80 0x55b857b732c0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:15.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.989+0000 7fdc2653e800 1 -- 172.21.15.102:0/1683300354 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55b857b75b70 msgr2=0x55b857b77f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:15.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.989+0000 7fdc2653e800 1 --2- 172.21.15.102:0/1683300354 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55b857b75b70 0x55b857b77f60 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:15.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.989+0000 7fdc2653e800 1 -- 172.21.15.102:0/1683300354 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdb08036b90 msgr2=0x7fdb08039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:15.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.989+0000 7fdc2653e800 1 --2- 172.21.15.102:0/1683300354 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdb08036b90 0x7fdb08039050 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c000c00 tx=0x7fdc0c0013b0 comp rx=0 tx=0).stop 2024-09-13T19:17:15.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.989+0000 7fdc2653e800 1 -- 172.21.15.102:0/1683300354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8579e6e10 msgr2=0x55b857b6c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:15.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.989+0000 7fdc2653e800 1 --2- 172.21.15.102:0/1683300354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8579e6e10 0x55b857b6c250 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fdc14045f50 tx=0x7fdc14002fb0 comp rx=0 tx=0).stop 2024-09-13T19:17:15.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.989+0000 7fdc2653e800 1 -- 172.21.15.102:0/1683300354 shutdown_connections 2024-09-13T19:17:15.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.989+0000 7fdc2653e800 1 --2- 172.21.15.102:0/1683300354 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55b857b75b70 0x55b857b77f60 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:15.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.989+0000 7fdc2653e800 1 --2- 172.21.15.102:0/1683300354 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55b857a78b80 0x55b857b732c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:15.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.989+0000 7fdc2653e800 1 --2- 172.21.15.102:0/1683300354 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fdb08036b90 0x7fdb08039050 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:15.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.989+0000 7fdc2653e800 1 --2- 172.21.15.102:0/1683300354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8579e6e10 0x55b857b6c250 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:15.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.989+0000 7fdc2653e800 1 -- 172.21.15.102:0/1683300354 >> 172.21.15.102:0/1683300354 conn(0x55b857a6de30 msgr2=0x55b857b5ec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:15.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.989+0000 7fdc2653e800 1 -- 172.21.15.102:0/1683300354 shutdown_connections 2024-09-13T19:17:15.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:14.989+0000 7fdc2653e800 1 -- 172.21.15.102:0/1683300354 wait complete. 2024-09-13T19:17:15.009 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-13T19:17:14.974541Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:17:14.974529Z', 'tags': [], 'group_ids': []} 2024-09-13T19:17:15.045 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:17:15.050 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2024-09-13T19:17:15.050 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-13T19:17:15.050 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-13T19:17:15.051 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2024-09-13T19:17:15.096 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:17:15.097 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:17:15.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.094+0000 7fb584926800 1 Processor -- start 2024-09-13T19:17:15.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.094+0000 7fb584926800 1 -- start start 2024-09-13T19:17:15.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.094+0000 7fb584926800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x555a2e117710 0x555a2e117b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:15.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.095+0000 7fb584926800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555a2dfd6b30 con 0x555a2e118050 2024-09-13T19:17:15.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.095+0000 7fb584926800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x555a2dfb8360 con 0x555a2e117710 2024-09-13T19:17:15.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.095+0000 7fb5805e3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x555a2e117710 0x555a2e117b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:15.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.095+0000 7fb57fde2640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x555a2e118050 0x555a2e11ca90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:50072/0 (socket says 172.21.15.102:50072) 2024-09-13T19:17:15.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.095+0000 7fb57fde2640 1 -- 172.21.15.102:0/2840256467 learned_addr learned my addr 172.21.15.102:0/2840256467 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:17:15.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.095+0000 7fb5805e3640 1 -- 172.21.15.102:0/2840256467 >> v1:172.21.15.53:6789/0 conn(0x555a2e118050 legacy=0x555a2e11ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:15.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.095+0000 7fb5805e3640 1 -- 172.21.15.102:0/2840256467 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a2dfdee00 con 0x555a2e117710 2024-09-13T19:17:15.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.097+0000 7fb5805e3640 1 --2- 172.21.15.102:0/2840256467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a2e117710 0x555a2e117b10 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fb578005fd0 tx=0x7fb578045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e1012876a211228 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:15.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.097+0000 7fb57f5e1640 1 -- 172.21.15.102:0/2840256467 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb578058530 con 0x555a2e117710 2024-09-13T19:17:15.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.097+0000 7fb57f5e1640 1 -- 172.21.15.102:0/2840256467 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5780586d0 con 0x555a2e117710 2024-09-13T19:17:15.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.097+0000 7fb57f5e1640 1 -- 172.21.15.102:0/2840256467 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5780589d0 con 0x555a2e117710 2024-09-13T19:17:15.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.098+0000 7fb584926800 1 -- 172.21.15.102:0/2840256467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a2e117710 msgr2=0x555a2e117b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:15.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.098+0000 7fb584926800 1 --2- 172.21.15.102:0/2840256467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a2e117710 0x555a2e117b10 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fb578005fd0 tx=0x7fb578045c30 comp rx=0 tx=0).stop 2024-09-13T19:17:15.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.098+0000 7fb584926800 1 -- 172.21.15.102:0/2840256467 shutdown_connections 2024-09-13T19:17:15.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.098+0000 7fb584926800 1 --2- 172.21.15.102:0/2840256467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a2e117710 0x555a2e117b10 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:15.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.098+0000 7fb584926800 1 -- 172.21.15.102:0/2840256467 >> 172.21.15.102:0/2840256467 conn(0x555a2e112fe0 msgr2=0x555a2e115400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:15.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.098+0000 7fb584926800 1 -- 172.21.15.102:0/2840256467 shutdown_connections 2024-09-13T19:17:15.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.098+0000 7fb584926800 1 -- 172.21.15.102:0/2840256467 wait complete. 2024-09-13T19:17:15.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.112+0000 7fb584926800 1 Processor -- start 2024-09-13T19:17:15.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.112+0000 7fb584926800 1 -- start start 2024-09-13T19:17:15.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.112+0000 7fb584926800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a2e117710 0x555a2e206900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:15.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.112+0000 7fb584926800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555a2e063360 con 0x555a2e117710 2024-09-13T19:17:15.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.112+0000 7fb5805e3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a2e117710 0x555a2e206900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:15.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.112+0000 7fb5805e3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a2e117710 0x555a2e206900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41418/0 (socket says 172.21.15.102:41418) 2024-09-13T19:17:15.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.112+0000 7fb5805e3640 1 -- 172.21.15.102:0/3906743445 learned_addr learned my addr 172.21.15.102:0/3906743445 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:15.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.113+0000 7fb5805e3640 1 -- 172.21.15.102:0/3906743445 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a2dfb0bc0 con 0x555a2e117710 2024-09-13T19:17:15.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.113+0000 7fb5805e3640 1 --2- 172.21.15.102:0/3906743445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a2e117710 0x555a2e206900 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fb57800a3f0 tx=0x7fb578051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ca9c279e7986d62 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:15.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.113+0000 7fb46e60c640 1 -- 172.21.15.102:0/3906743445 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5780589b0 con 0x555a2e117710 2024-09-13T19:17:15.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.113+0000 7fb46e60c640 1 -- 172.21.15.102:0/3906743445 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb578068070 con 0x555a2e117710 2024-09-13T19:17:15.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.113+0000 7fb46e60c640 1 -- 172.21.15.102:0/3906743445 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb578058c80 con 0x555a2e117710 2024-09-13T19:17:15.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.114+0000 7fb584926800 1 -- 172.21.15.102:0/3906743445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a2e117710 msgr2=0x555a2e206900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:15.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.114+0000 7fb584926800 1 --2- 172.21.15.102:0/3906743445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a2e117710 0x555a2e206900 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fb57800a3f0 tx=0x7fb578051000 comp rx=0 tx=0).stop 2024-09-13T19:17:15.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.114+0000 7fb584926800 1 -- 172.21.15.102:0/3906743445 shutdown_connections 2024-09-13T19:17:15.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.114+0000 7fb584926800 1 --2- 172.21.15.102:0/3906743445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a2e117710 0x555a2e206900 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:15.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.114+0000 7fb584926800 1 -- 172.21.15.102:0/3906743445 >> 172.21.15.102:0/3906743445 conn(0x555a2e112fe0 msgr2=0x555a2e2022c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:15.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.114+0000 7fb584926800 1 -- 172.21.15.102:0/3906743445 shutdown_connections 2024-09-13T19:17:15.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.114+0000 7fb584926800 1 -- 172.21.15.102:0/3906743445 wait complete. 2024-09-13T19:17:15.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.114+0000 7fb584926800 1 Processor -- start 2024-09-13T19:17:15.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.114+0000 7fb584926800 1 -- start start 2024-09-13T19:17:15.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.114+0000 7fb584926800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a2e117710 0x555a2e08d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:15.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.114+0000 7fb584926800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555a2e11e5f0 con 0x555a2e117710 2024-09-13T19:17:15.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.114+0000 7fb5805e3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a2e117710 0x555a2e08d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:15.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.114+0000 7fb5805e3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a2e117710 0x555a2e08d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41424/0 (socket says 172.21.15.102:41424) 2024-09-13T19:17:15.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.114+0000 7fb5805e3640 1 -- 172.21.15.102:0/2632263284 learned_addr learned my addr 172.21.15.102:0/2632263284 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:15.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.115+0000 7fb5805e3640 1 -- 172.21.15.102:0/2632263284 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a2dfc4fe0 con 0x555a2e117710 2024-09-13T19:17:15.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.115+0000 7fb5805e3640 1 --2- 172.21.15.102:0/2632263284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a2e117710 0x555a2e08d6e0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fb578065040 tx=0x7fb578003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:15.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.115+0000 7fb46ce09640 1 -- 172.21.15.102:0/2632263284 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb578063650 con 0x555a2e117710 2024-09-13T19:17:15.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.115+0000 7fb46ce09640 1 -- 172.21.15.102:0/2632263284 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5780637f0 con 0x555a2e117710 2024-09-13T19:17:15.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.115+0000 7fb584926800 1 -- 172.21.15.102:0/2632263284 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555a2e08bdd0 con 0x555a2e117710 2024-09-13T19:17:15.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.115+0000 7fb46ce09640 1 -- 172.21.15.102:0/2632263284 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb578063af0 con 0x555a2e117710 2024-09-13T19:17:15.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.115+0000 7fb584926800 1 -- 172.21.15.102:0/2632263284 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a2e08c2f0 con 0x555a2e117710 2024-09-13T19:17:15.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.116+0000 7fb46ce09640 1 -- 172.21.15.102:0/2632263284 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb578074020 con 0x555a2e117710 2024-09-13T19:17:15.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.116+0000 7fb46ce09640 1 --2- 172.21.15.102:0/2632263284 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb468036be0 0x7fb4680390a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:15.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.116+0000 7fb46ce09640 1 -- 172.21.15.102:0/2632263284 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fb578090a30 con 0x555a2e117710 2024-09-13T19:17:15.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.116+0000 7fb57fde2640 1 --2- 172.21.15.102:0/2632263284 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb468036be0 0x7fb4680390a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:15.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.116+0000 7fb584926800 1 --2- 172.21.15.102:0/2632263284 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x555a2e118050 0x555a2e217610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:15.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.116+0000 7fb584926800 1 -- 172.21.15.102:0/2632263284 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a2e217b50 con 0x555a2e118050 2024-09-13T19:17:15.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.116+0000 7fb580de4640 1 --2- 172.21.15.102:0/2632263284 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x555a2e118050 0x555a2e217610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:15.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.117+0000 7fb57fde2640 1 --2- 172.21.15.102:0/2632263284 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb468036be0 0x7fb4680390a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb568000f60 tx=0x7fb5680012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:15.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.117+0000 7fb580de4640 1 --2- 172.21.15.102:0/2632263284 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x555a2e118050 0x555a2e217610 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:15.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.117+0000 7fb580de4640 1 -- 172.21.15.102:0/2632263284 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb5700083e0 con 0x555a2e118050 2024-09-13T19:17:15.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.117+0000 7fb584926800 1 -- 172.21.15.102:0/2632263284 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a2e2183a0 con 0x555a2e118050 2024-09-13T19:17:15.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.117+0000 7fb580de4640 1 -- 172.21.15.102:0/2632263284 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb5700083e0 con 0x555a2e118050 2024-09-13T19:17:15.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.117+0000 7fb584926800 1 --2- 172.21.15.102:0/2632263284 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x555a2e219cb0 0x555a2e21c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:15.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.117+0000 7fb584926800 1 -- 172.21.15.102:0/2632263284 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a2e21c900 con 0x555a2e219cb0 2024-09-13T19:17:15.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.117+0000 7fb5805e3640 1 --2- 172.21.15.102:0/2632263284 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x555a2e219cb0 0x555a2e21c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:15.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.118+0000 7fb5805e3640 1 --2- 172.21.15.102:0/2632263284 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x555a2e219cb0 0x555a2e21c170 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:15.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.118+0000 7fb5805e3640 1 -- 172.21.15.102:0/2632263284 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb57806c3f0 con 0x555a2e219cb0 2024-09-13T19:17:15.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.118+0000 7fb584926800 1 -- 172.21.15.102:0/2632263284 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a2e218bf0 con 0x555a2e118050 2024-09-13T19:17:15.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.118+0000 7fb580de4640 1 -- 172.21.15.102:0/2632263284 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb5700083e0 con 0x555a2e118050 2024-09-13T19:17:15.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.118+0000 7fb584926800 1 -- 172.21.15.102:0/2632263284 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a2e218f90 con 0x555a2e219cb0 2024-09-13T19:17:15.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.118+0000 7fb5805e3640 1 -- 172.21.15.102:0/2632263284 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb57806c3f0 con 0x555a2e219cb0 2024-09-13T19:17:15.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.119+0000 7fb584926800 1 Processor -- start 2024-09-13T19:17:15.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.119+0000 7fb584926800 1 -- start start 2024-09-13T19:17:15.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.119+0000 7fb584926800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a2e22b2b0 0x555a2e22b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:15.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.119+0000 7fb584926800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555a2e08dc20 con 0x555a2e22b2b0 2024-09-13T19:17:15.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.119+0000 7fb580de4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a2e22b2b0 0x555a2e22b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:15.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.119+0000 7fb580de4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a2e22b2b0 0x555a2e22b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41438/0 (socket says 172.21.15.102:41438) 2024-09-13T19:17:15.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.119+0000 7fb580de4640 1 -- 172.21.15.102:0/3501454578 learned_addr learned my addr 172.21.15.102:0/3501454578 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:15.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.120+0000 7fb580de4640 1 -- 172.21.15.102:0/3501454578 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a2e22bc10 con 0x555a2e22b2b0 2024-09-13T19:17:15.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.120+0000 7fb580de4640 1 --2- 172.21.15.102:0/3501454578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a2e22b2b0 0x555a2e22b6d0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x555a2e08d420 tx=0x7fb57000beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:15.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.120+0000 7fb465ffb640 1 -- 172.21.15.102:0/3501454578 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb57001c020 con 0x555a2e22b2b0 2024-09-13T19:17:15.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.120+0000 7fb465ffb640 1 -- 172.21.15.102:0/3501454578 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb570007c30 con 0x555a2e22b2b0 2024-09-13T19:17:15.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.120+0000 7fb584926800 1 -- 172.21.15.102:0/3501454578 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555a2e22bea0 con 0x555a2e22b2b0 2024-09-13T19:17:15.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.120+0000 7fb465ffb640 1 -- 172.21.15.102:0/3501454578 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb570018440 con 0x555a2e22b2b0 2024-09-13T19:17:15.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.120+0000 7fb584926800 1 -- 172.21.15.102:0/3501454578 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a2e22eb80 con 0x555a2e22b2b0 2024-09-13T19:17:15.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.121+0000 7fb465ffb640 1 -- 172.21.15.102:0/3501454578 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb57001f020 con 0x555a2e22b2b0 2024-09-13T19:17:15.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.121+0000 7fb465ffb640 1 --2- 172.21.15.102:0/3501454578 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb458036b40 0x7fb458039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:15.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.121+0000 7fb465ffb640 1 -- 172.21.15.102:0/3501454578 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fb57004e2d0 con 0x555a2e22b2b0 2024-09-13T19:17:15.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.121+0000 7fb5805e3640 1 --2- 172.21.15.102:0/3501454578 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb458036b40 0x7fb458039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:15.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.121+0000 7fb584926800 1 Processor -- start 2024-09-13T19:17:15.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.121+0000 7fb5805e3640 1 --2- 172.21.15.102:0/3501454578 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb458036b40 0x7fb458039000 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb57800a3f0 tx=0x7fb57806c8c0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:15.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.121+0000 7fb584926800 1 -- start start 2024-09-13T19:17:15.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.121+0000 7fb584926800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a2e237ef0 0x555a2e2382f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:15.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.121+0000 7fb584926800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555a2dfb2580 con 0x555a2e237ef0 2024-09-13T19:17:15.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.122+0000 7fb580de4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a2e237ef0 0x555a2e2382f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:15.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.122+0000 7fb580de4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a2e237ef0 0x555a2e2382f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41446/0 (socket says 172.21.15.102:41446) 2024-09-13T19:17:15.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.122+0000 7fb580de4640 1 -- 172.21.15.102:0/2634713908 learned_addr learned my addr 172.21.15.102:0/2634713908 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:15.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.122+0000 7fb580de4640 1 -- 172.21.15.102:0/2634713908 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a2e2388c0 con 0x555a2e237ef0 2024-09-13T19:17:15.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.122+0000 7fb580de4640 1 --2- 172.21.15.102:0/2634713908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a2e237ef0 0x555a2e2382f0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fb57004c610 tx=0x7fb570021570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c4d74fab14154c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:15.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.122+0000 7fb45f7fe640 1 -- 172.21.15.102:0/2634713908 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb57004e070 con 0x555a2e237ef0 2024-09-13T19:17:15.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.122+0000 7fb45f7fe640 1 -- 172.21.15.102:0/2634713908 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb570029350 con 0x555a2e237ef0 2024-09-13T19:17:15.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.122+0000 7fb45f7fe640 1 -- 172.21.15.102:0/2634713908 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb570018670 con 0x555a2e237ef0 2024-09-13T19:17:15.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.123+0000 7fb584926800 1 -- 172.21.15.102:0/2634713908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a2e237ef0 msgr2=0x555a2e2382f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:15.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.123+0000 7fb584926800 1 --2- 172.21.15.102:0/2634713908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a2e237ef0 0x555a2e2382f0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fb57004c610 tx=0x7fb570021570 comp rx=0 tx=0).stop 2024-09-13T19:17:15.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.123+0000 7fb584926800 1 -- 172.21.15.102:0/2634713908 shutdown_connections 2024-09-13T19:17:15.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.123+0000 7fb584926800 1 --2- 172.21.15.102:0/2634713908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a2e237ef0 0x555a2e2382f0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:15.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.123+0000 7fb584926800 1 -- 172.21.15.102:0/2634713908 >> 172.21.15.102:0/2634713908 conn(0x555a2e234250 msgr2=0x555a2e2323a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:15.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.123+0000 7fb584926800 1 -- 172.21.15.102:0/2634713908 shutdown_connections 2024-09-13T19:17:15.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.123+0000 7fb584926800 1 -- 172.21.15.102:0/2634713908 wait complete. 2024-09-13T19:17:15.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.123+0000 7fb584926800 1 Processor -- start 2024-09-13T19:17:15.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.123+0000 7fb584926800 1 -- start start 2024-09-13T19:17:15.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.123+0000 7fb584926800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a2e237ef0 0x555a2e23f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:15.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.123+0000 7fb584926800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555a2e238d10 con 0x555a2e237ef0 2024-09-13T19:17:15.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.123+0000 7fb580de4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a2e237ef0 0x555a2e23f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:15.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.124+0000 7fb580de4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a2e237ef0 0x555a2e23f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41454/0 (socket says 172.21.15.102:41454) 2024-09-13T19:17:15.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.124+0000 7fb580de4640 1 -- 172.21.15.102:0/170207764 learned_addr learned my addr 172.21.15.102:0/170207764 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:15.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.124+0000 7fb580de4640 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a2e23f690 con 0x555a2e237ef0 2024-09-13T19:17:15.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.124+0000 7fb580de4640 1 --2- 172.21.15.102:0/170207764 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a2e237ef0 0x555a2e23f150 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fb5700215b0 tx=0x7fb57004b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:15.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.124+0000 7fb45dffb640 1 -- 172.21.15.102:0/170207764 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb570016e50 con 0x555a2e237ef0 2024-09-13T19:17:15.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.124+0000 7fb45dffb640 1 -- 172.21.15.102:0/170207764 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb570029500 con 0x555a2e237ef0 2024-09-13T19:17:15.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.124+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555a2e23f920 con 0x555a2e237ef0 2024-09-13T19:17:15.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.124+0000 7fb45dffb640 1 -- 172.21.15.102:0/170207764 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb57004cb20 con 0x555a2e237ef0 2024-09-13T19:17:15.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.124+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a2e23f920 con 0x555a2e237ef0 2024-09-13T19:17:15.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.125+0000 7fb45dffb640 1 -- 172.21.15.102:0/170207764 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb57003e060 con 0x555a2e237ef0 2024-09-13T19:17:15.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.125+0000 7fb45dffb640 1 --2- 172.21.15.102:0/170207764 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb450036ce0 0x7fb4500391a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:15.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.125+0000 7fb45dffb640 1 -- 172.21.15.102:0/170207764 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fb570001040 con 0x555a2e237ef0 2024-09-13T19:17:15.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.125+0000 7fb5805e3640 1 --2- 172.21.15.102:0/170207764 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb450036ce0 0x7fb4500391a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:15.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.126+0000 7fb5805e3640 1 --2- 172.21.15.102:0/170207764 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb450036ce0 0x7fb4500391a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb57806c700 tx=0x7fb578094000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:15.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.126+0000 7fb584926800 20 rados->read ofs=0 len=0 2024-09-13T19:17:15.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.126+0000 7fb584926800 1 --2- 172.21.15.102:0/170207764 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x555a2e24ab20 0x555a2e24cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:15.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.126+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a2e24d730 con 0x555a2e24ab20 2024-09-13T19:17:15.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.126+0000 7fb57fde2640 1 --2- 172.21.15.102:0/170207764 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x555a2e24ab20 0x555a2e24cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:15.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.126+0000 7fb57fde2640 1 --2- 172.21.15.102:0/170207764 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x555a2e24ab20 0x555a2e24cfe0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:15.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.126+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb568009050 con 0x555a2e24ab20 2024-09-13T19:17:15.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.126+0000 7fb584926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:15.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.126+0000 7fb584926800 20 realm 2024-09-13T19:17:15.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.126+0000 7fb584926800 20 rados->read ofs=0 len=0 2024-09-13T19:17:15.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.127+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a2e249f70 con 0x555a2e24ab20 2024-09-13T19:17:15.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.127+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb568009050 con 0x555a2e24ab20 2024-09-13T19:17:15.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.127+0000 7fb584926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:15.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.127+0000 7fb584926800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:17:15.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.127+0000 7fb584926800 20 rados->read ofs=0 len=0 2024-09-13T19:17:15.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.127+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a2e24e220 con 0x555a2e24ab20 2024-09-13T19:17:15.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.127+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb568009050 con 0x555a2e24ab20 2024-09-13T19:17:15.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.127+0000 7fb584926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:15.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.127+0000 7fb584926800 20 rados->read ofs=0 len=0 2024-09-13T19:17:15.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.127+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a2e24eaf0 con 0x555a2e24ab20 2024-09-13T19:17:15.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.127+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb568009050 con 0x555a2e24ab20 2024-09-13T19:17:15.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.127+0000 7fb584926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:17:15.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.127+0000 7fb584926800 20 rados->read ofs=0 len=0 2024-09-13T19:17:15.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.127+0000 7fb584926800 1 --2- 172.21.15.102:0/170207764 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x555a2e24f430 0x555a2e251840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:15.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.127+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a2e251fd0 con 0x555a2e24f430 2024-09-13T19:17:15.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.127+0000 7fb580de4640 1 --2- 172.21.15.102:0/170207764 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x555a2e24f430 0x555a2e251840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:15.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.127+0000 7fb580de4640 1 --2- 172.21.15.102:0/170207764 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x555a2e24f430 0x555a2e251840 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:15.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.128+0000 7fb580de4640 1 -- 172.21.15.102:0/170207764 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb570028070 con 0x555a2e24f430 2024-09-13T19:17:15.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.128+0000 7fb584926800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:17:15.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.128+0000 7fb584926800 20 searching for the correct realm 2024-09-13T19:17:15.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.128+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555a2e253920 con 0x555a2e24f430 2024-09-13T19:17:15.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.128+0000 7fb580de4640 1 -- 172.21.15.102:0/170207764 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb570028070 con 0x555a2e24f430 2024-09-13T19:17:15.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.128+0000 7fb580de4640 1 --2- 172.21.15.102:0/170207764 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fb5700203b0 0x7fb57003f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:15.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.128+0000 7fb580de4640 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555a2e253920 con 0x7fb5700203b0 2024-09-13T19:17:15.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.128+0000 7fb5805e3640 1 --2- 172.21.15.102:0/170207764 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fb5700203b0 0x7fb57003f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:15.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.128+0000 7fb5805e3640 1 --2- 172.21.15.102:0/170207764 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fb5700203b0 0x7fb57003f710 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:15.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.129+0000 7fb5805e3640 1 -- 172.21.15.102:0/170207764 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb57809a040 con 0x7fb5700203b0 2024-09-13T19:17:15.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.129+0000 7fb5805e3640 1 --2- 172.21.15.102:0/170207764 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fb57807e850 0x7fb57808d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:15.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.129+0000 7fb5805e3640 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555a2e253920 con 0x7fb57807e850 2024-09-13T19:17:15.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.129+0000 7fb57fde2640 1 --2- 172.21.15.102:0/170207764 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fb57807e850 0x7fb57808d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:15.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.129+0000 7fb57fde2640 1 --2- 172.21.15.102:0/170207764 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fb57807e850 0x7fb57808d3d0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:15.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.130+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb568009050 con 0x7fb57807e850 2024-09-13T19:17:15.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.130+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555a2e253920 con 0x555a2e24ab20 2024-09-13T19:17:15.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.130+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb568009050 con 0x555a2e24ab20 2024-09-13T19:17:15.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.130+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555a2e253920 con 0x555a2e24ab20 2024-09-13T19:17:15.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.130+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb568029040 con 0x555a2e24ab20 2024-09-13T19:17:15.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.130+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555a2e253920 con 0x7fb57807e850 2024-09-13T19:17:15.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.130+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb568029040 con 0x7fb57807e850 2024-09-13T19:17:15.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.130+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555a2e253920 con 0x7fb57807e850 2024-09-13T19:17:15.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.130+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb568029040 con 0x7fb57807e850 2024-09-13T19:17:15.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.130+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555a2e253920 con 0x7fb5700203b0 2024-09-13T19:17:15.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.131+0000 7fb5805e3640 1 -- 172.21.15.102:0/170207764 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb57809a040 con 0x7fb5700203b0 2024-09-13T19:17:15.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.131+0000 7fb5805e3640 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555a2e253920 con 0x555a2e24f430 2024-09-13T19:17:15.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.131+0000 7fb580de4640 1 -- 172.21.15.102:0/170207764 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb570028070 con 0x555a2e24f430 2024-09-13T19:17:15.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.131+0000 7fb580de4640 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555a2e253920 con 0x555a2e24ab20 2024-09-13T19:17:15.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.131+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb568029040 con 0x555a2e24ab20 2024-09-13T19:17:15.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.131+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555a2e253920 con 0x7fb5700203b0 2024-09-13T19:17:15.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.131+0000 7fb5805e3640 1 -- 172.21.15.102:0/170207764 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb57809a040 con 0x7fb5700203b0 2024-09-13T19:17:15.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.131+0000 7fb5805e3640 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555a2e253920 con 0x555a2e24ab20 2024-09-13T19:17:15.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.131+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb568029040 con 0x555a2e24ab20 2024-09-13T19:17:15.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.132+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555a2e253920 con 0x7fb5700203b0 2024-09-13T19:17:15.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.132+0000 7fb5805e3640 1 -- 172.21.15.102:0/170207764 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb57809a040 con 0x7fb5700203b0 2024-09-13T19:17:15.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.132+0000 7fb5805e3640 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555a2e253920 con 0x555a2e24f430 2024-09-13T19:17:15.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.132+0000 7fb580de4640 1 -- 172.21.15.102:0/170207764 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb570028070 con 0x555a2e24f430 2024-09-13T19:17:15.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.132+0000 7fb580de4640 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555a2e253920 con 0x555a2e24f430 2024-09-13T19:17:15.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.132+0000 7fb580de4640 1 -- 172.21.15.102:0/170207764 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb570028070 con 0x555a2e24f430 2024-09-13T19:17:15.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.132+0000 7fb580de4640 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555a2e253920 con 0x7fb57807e850 2024-09-13T19:17:15.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.133+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb568029040 con 0x7fb57807e850 2024-09-13T19:17:15.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.133+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555a2e253920 con 0x555a2e24f430 2024-09-13T19:17:15.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.133+0000 7fb580de4640 1 -- 172.21.15.102:0/170207764 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb570028070 con 0x555a2e24f430 2024-09-13T19:17:15.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.133+0000 7fb580de4640 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555a2e253920 con 0x555a2e24f430 2024-09-13T19:17:15.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.133+0000 7fb580de4640 1 -- 172.21.15.102:0/170207764 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb570028070 con 0x555a2e24f430 2024-09-13T19:17:15.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.133+0000 7fb580de4640 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555a2e253920 con 0x555a2e24ab20 2024-09-13T19:17:15.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.133+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb568029040 con 0x555a2e24ab20 2024-09-13T19:17:15.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.133+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555a2e253920 con 0x555a2e24ab20 2024-09-13T19:17:15.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.133+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb568029040 con 0x555a2e24ab20 2024-09-13T19:17:15.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.133+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555a2e253920 con 0x7fb57807e850 2024-09-13T19:17:15.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.134+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb568029040 con 0x7fb57807e850 2024-09-13T19:17:15.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.134+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555a2e253920 con 0x555a2e24f430 2024-09-13T19:17:15.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.134+0000 7fb580de4640 1 -- 172.21.15.102:0/170207764 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb570028070 con 0x555a2e24f430 2024-09-13T19:17:15.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.134+0000 7fb580de4640 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555a2e253920 con 0x7fb5700203b0 2024-09-13T19:17:15.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.134+0000 7fb5805e3640 1 -- 172.21.15.102:0/170207764 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb57809a040 con 0x7fb5700203b0 2024-09-13T19:17:15.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.134+0000 7fb5805e3640 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555a2e253920 con 0x555a2e24ab20 2024-09-13T19:17:15.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.134+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb568029040 con 0x555a2e24ab20 2024-09-13T19:17:15.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.134+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555a2e253920 con 0x7fb5700203b0 2024-09-13T19:17:15.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.135+0000 7fb5805e3640 1 -- 172.21.15.102:0/170207764 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb57809a040 con 0x7fb5700203b0 2024-09-13T19:17:15.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.135+0000 7fb5805e3640 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555a2e253920 con 0x555a2e24f430 2024-09-13T19:17:15.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.135+0000 7fb580de4640 1 -- 172.21.15.102:0/170207764 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb570028070 con 0x555a2e24f430 2024-09-13T19:17:15.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.135+0000 7fb580de4640 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555a2e253920 con 0x7fb57807e850 2024-09-13T19:17:15.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.135+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb568029040 con 0x7fb57807e850 2024-09-13T19:17:15.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.135+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555a2e253920 con 0x7fb5700203b0 2024-09-13T19:17:15.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.135+0000 7fb5805e3640 1 -- 172.21.15.102:0/170207764 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb57809a040 con 0x7fb5700203b0 2024-09-13T19:17:15.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.135+0000 7fb5805e3640 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555a2e253920 con 0x555a2e24f430 2024-09-13T19:17:15.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.136+0000 7fb580de4640 1 -- 172.21.15.102:0/170207764 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb570028070 con 0x555a2e24f430 2024-09-13T19:17:15.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.136+0000 7fb580de4640 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555a2e253920 con 0x7fb57807e850 2024-09-13T19:17:15.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.136+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb568029040 con 0x7fb57807e850 2024-09-13T19:17:15.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.136+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555a2e253920 con 0x555a2e24ab20 2024-09-13T19:17:15.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.136+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb568029040 con 0x555a2e24ab20 2024-09-13T19:17:15.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.136+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555a2e253920 con 0x7fb5700203b0 2024-09-13T19:17:15.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.136+0000 7fb5805e3640 1 -- 172.21.15.102:0/170207764 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb57809a040 con 0x7fb5700203b0 2024-09-13T19:17:15.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.136+0000 7fb584926800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:17:15.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.136+0000 7fb584926800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:17:15.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.136+0000 7fb584926800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:17:15.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.136+0000 7fb584926800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:17:15.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.136+0000 7fb584926800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:17:15.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.136+0000 7fb584926800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:17:15.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.136+0000 7fb584926800 20 rados->read ofs=0 len=0 2024-09-13T19:17:15.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.136+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a2e252990 con 0x555a2e24ab20 2024-09-13T19:17:15.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.137+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb568029040 con 0x555a2e24ab20 2024-09-13T19:17:15.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.137+0000 7fb584926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:15.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.137+0000 7fb584926800 20 rados->read ofs=0 len=0 2024-09-13T19:17:15.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.137+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a2e253230 con 0x555a2e24ab20 2024-09-13T19:17:15.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.137+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb568029040 con 0x555a2e24ab20 2024-09-13T19:17:15.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.137+0000 7fb584926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:17:15.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.137+0000 7fb584926800 20 rados->read ofs=0 len=0 2024-09-13T19:17:15.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.137+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a2e253da0 con 0x555a2e24f430 2024-09-13T19:17:15.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.137+0000 7fb580de4640 1 -- 172.21.15.102:0/170207764 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb570028070 con 0x555a2e24f430 2024-09-13T19:17:15.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.137+0000 7fb584926800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:17:15.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.137+0000 7fb584926800 20 zone default found 2024-09-13T19:17:15.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.137+0000 7fb584926800 4 Realm: () 2024-09-13T19:17:15.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.137+0000 7fb584926800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:17:15.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.137+0000 7fb584926800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:17:15.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.137+0000 7fb584926800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:17:15.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.137+0000 7fb584926800 20 zonegroup default 2024-09-13T19:17:15.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.137+0000 7fb584926800 20 rados->read ofs=0 len=0 2024-09-13T19:17:15.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.137+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a2e2545f0 con 0x7fb5700203b0 2024-09-13T19:17:15.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.137+0000 7fb5805e3640 1 -- 172.21.15.102:0/170207764 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb57809a040 con 0x7fb5700203b0 2024-09-13T19:17:15.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.137+0000 7fb584926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:15.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.137+0000 7fb584926800 20 rados->read ofs=0 len=0 2024-09-13T19:17:15.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.137+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a2e256370 con 0x555a2e24f430 2024-09-13T19:17:15.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.138+0000 7fb580de4640 1 -- 172.21.15.102:0/170207764 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb570028070 con 0x555a2e24f430 2024-09-13T19:17:15.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.138+0000 7fb584926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:15.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.138+0000 7fb584926800 20 rados->read ofs=0 len=0 2024-09-13T19:17:15.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.138+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a2e2567a0 con 0x555a2e24f430 2024-09-13T19:17:15.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.138+0000 7fb580de4640 1 -- 172.21.15.102:0/170207764 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb570028070 con 0x555a2e24f430 2024-09-13T19:17:15.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.138+0000 7fb584926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:15.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.138+0000 7fb584926800 20 started sync module instance, tier type = 2024-09-13T19:17:15.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.138+0000 7fb584926800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:17:15.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.138+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a2e255810 con 0x7fb5700203b0 2024-09-13T19:17:15.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.139+0000 7fb5805e3640 1 -- 172.21.15.102:0/170207764 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(44 notify.0 [create] v36'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb57809a040 con 0x7fb5700203b0 2024-09-13T19:17:15.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.139+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93845809615712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a2e256be0 con 0x7fb5700203b0 2024-09-13T19:17:15.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.139+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a2e257430 con 0x555a2e24ab20 2024-09-13T19:17:15.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.140+0000 7fb5805e3640 1 -- 172.21.15.102:0/170207764 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93845809615712] v36'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb57809a040 con 0x7fb5700203b0 2024-09-13T19:17:15.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.140+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v36'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb568029040 con 0x555a2e24ab20 2024-09-13T19:17:15.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.140+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93845809621984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a2e257000 con 0x555a2e24ab20 2024-09-13T19:17:15.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.140+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a2e258170 con 0x555a2e24f430 2024-09-13T19:17:15.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.141+0000 7fb580de4640 1 -- 172.21.15.102:0/170207764 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v36'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb570028070 con 0x555a2e24f430 2024-09-13T19:17:15.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.141+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93845809626240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a2e258630 con 0x555a2e24f430 2024-09-13T19:17:15.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.142+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a2e259150 con 0x7fb5700203b0 2024-09-13T19:17:15.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.142+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93845809621984] v36'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb568029040 con 0x555a2e24ab20 2024-09-13T19:17:15.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.143+0000 7fb580de4640 1 -- 172.21.15.102:0/170207764 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93845809626240] v36'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb570028070 con 0x555a2e24f430 2024-09-13T19:17:15.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.143+0000 7fb5805e3640 1 -- 172.21.15.102:0/170207764 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(50 notify.3 [create] v36'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb57809a040 con 0x7fb5700203b0 2024-09-13T19:17:15.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.143+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93845809630240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a2e259110 con 0x7fb5700203b0 2024-09-13T19:17:15.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.143+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a2e2599f0 con 0x555a2e24ab20 2024-09-13T19:17:15.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.145+0000 7fb5805e3640 1 -- 172.21.15.102:0/170207764 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93845809630240] v36'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb57809a040 con 0x7fb5700203b0 2024-09-13T19:17:15.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.145+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v36'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb568029040 con 0x555a2e24ab20 2024-09-13T19:17:15.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.145+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93845809625040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a2e259150 con 0x555a2e24ab20 2024-09-13T19:17:15.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.145+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a2e25a150 con 0x7fb57807e850 2024-09-13T19:17:15.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.146+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(54 notify.5 [create] v36'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb568029040 con 0x7fb57807e850 2024-09-13T19:17:15.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.147+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93845809634368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a2e25a150 con 0x7fb57807e850 2024-09-13T19:17:15.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.147+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a2e25b150 con 0x7fb57807e850 2024-09-13T19:17:15.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.147+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93845809625040] v36'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb568029040 con 0x555a2e24ab20 2024-09-13T19:17:15.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.148+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 93845809634368] v36'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb568029040 con 0x7fb57807e850 2024-09-13T19:17:15.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.148+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(56 notify.6 [create] v36'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb568029040 con 0x7fb57807e850 2024-09-13T19:17:15.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.148+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93845809638464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a2e25a3d0 con 0x7fb57807e850 2024-09-13T19:17:15.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.148+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a2e25b5c0 con 0x7fb57807e850 2024-09-13T19:17:15.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.149+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 93845809638464] v36'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb568029040 con 0x7fb57807e850 2024-09-13T19:17:15.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.149+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(58 notify.7 [create] v36'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb568029040 con 0x7fb57807e850 2024-09-13T19:17:15.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.149+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93845809632576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a2e25b5c0 con 0x7fb57807e850 2024-09-13T19:17:15.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.149+0000 7fb584926800 20 add_watcher() i=0 2024-09-13T19:17:15.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.149+0000 7fb584926800 20 add_watcher() i=1 2024-09-13T19:17:15.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.149+0000 7fb584926800 20 add_watcher() i=2 2024-09-13T19:17:15.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.149+0000 7fb584926800 20 add_watcher() i=3 2024-09-13T19:17:15.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.149+0000 7fb584926800 20 add_watcher() i=4 2024-09-13T19:17:15.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.149+0000 7fb584926800 20 add_watcher() i=5 2024-09-13T19:17:15.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.149+0000 7fb584926800 20 add_watcher() i=6 2024-09-13T19:17:15.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.150+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 93845809632576] v36'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb568029040 con 0x7fb57807e850 2024-09-13T19:17:15.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.150+0000 7fb584926800 20 add_watcher() i=7 2024-09-13T19:17:15.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.150+0000 7fb584926800 2 all 8 watchers are set, enabling cache 2024-09-13T19:17:15.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.150+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a2e25e960 con 0x555a2e24ab20 2024-09-13T19:17:15.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.151+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb568029040 con 0x555a2e24ab20 2024-09-13T19:17:15.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.151+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93845809652512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a2e25e960 con 0x555a2e24ab20 2024-09-13T19:17:15.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.152+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93845809652512] v36'212 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb568029040 con 0x555a2e24ab20 2024-09-13T19:17:15.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.152+0000 7fb4367e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:17:15.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.152+0000 7fb584926800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:17:15.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.152+0000 7fb584926800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:17:15.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.152+0000 7fb584926800 5 note: GC not initialized 2024-09-13T19:17:15.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.152+0000 7fb4357e2640 20 reqs_thread_entry: start 2024-09-13T19:17:15.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.152+0000 7fb584926800 20 init_complete bucket index max shards: 11 2024-09-13T19:17:15.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.152+0000 7fb584926800 20 Filter name: none 2024-09-13T19:17:15.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.152+0000 7fb3a6ffd640 20 reqs_thread_entry: start 2024-09-13T19:17:15.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.152+0000 7fb584926800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-13T19:17:15.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.152+0000 7fb584926800 20 rados->read ofs=0 len=0 2024-09-13T19:17:15.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.152+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a2e291e00 con 0x7fb57807e850 2024-09-13T19:17:15.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.153+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(62 bar [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fb568029040 con 0x7fb57807e850 2024-09-13T19:17:15.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.153+0000 7fb584926800 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T19:17:15.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.153+0000 7fb584926800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2024-09-13T19:17:15.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.153+0000 7fb584926800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-13T19:17:15.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.153+0000 7fb584926800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:17:15.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.153+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:63 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a2e296180 con 0x7fb5700203b0 2024-09-13T19:17:15.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.154+0000 7fb5805e3640 1 -- 172.21.15.102:0/170207764 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(63 bud [create,call,writefull 0~206] v36'3 uv3 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fb57809a040 con 0x7fb5700203b0 2024-09-13T19:17:15.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.154+0000 7fb584926800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-13T19:17:15.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.154+0000 7fb584926800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T19:17:15.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.154+0000 7fb584926800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-13T19:17:15.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.154+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:64 7.3 7:c609908c:::notify.5:head [notify cookie 93845809880176 in=394b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a2e296e30 con 0x7fb57807e850 2024-09-13T19:17:15.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.155+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== watch-notify(notify (1) cookie 93845809634368 notify 154618822679 ret 0) ==== 424+0+0 (crc 0 0 0) 0x555a2dfd6b30 con 0x7fb57807e850 2024-09-13T19:17:15.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.155+0000 7fb45effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822679 cookie 93845809634368 notifier 4741 bl.length()=382 2024-09-13T19:17:15.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.155+0000 7fb45effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-13T19:17:15.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.155+0000 7fb45effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T19:17:15.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.155+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(64 notify.5 [notify cookie 93845809880176 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb568029040 con 0x7fb57807e850 2024-09-13T19:17:15.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.155+0000 7fb45effd640 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fb444003ea0 con 0x7fb57807e850 2024-09-13T19:17:15.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.155+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(65 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb568029040 con 0x7fb57807e850 2024-09-13T19:17:15.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.155+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== watch-notify(notify_complete (2) cookie 93845809880176 notify 154618822679 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fb56802d650 con 0x7fb57807e850 2024-09-13T19:17:15.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.155+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:66 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a2e295c70 con 0x555a2e24ab20 2024-09-13T19:17:15.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.155+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(66 bar.buckets [call out=184b] v0'0 uv3 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7fb568029040 con 0x555a2e24ab20 2024-09-13T19:17:15.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.155+0000 7fb584926800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:509740b4-c081-4f37-bd6d-df9ca851489b.4237.9 : miss 2024-09-13T19:17:15.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.155+0000 7fb584926800 20 rados->read ofs=0 len=0 2024-09-13T19:17:15.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.155+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:67 8.6 8:601b7b74:root::.bucket.meta.myfoo6%3a509740b4-c081-4f37-bd6d-df9ca851489b.4237.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a2e293fa0 con 0x7fb57807e850 2024-09-13T19:17:15.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.156+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(67 .bucket.meta.myfoo6:509740b4-c081-4f37-bd6d-df9ca851489b.4237.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 333+0+662 (crc 0 0 0) 0x7fb568029040 con 0x7fb57807e850 2024-09-13T19:17:15.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.156+0000 7fb584926800 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T19:17:15.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.156+0000 7fb584926800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:509740b4-c081-4f37-bd6d-df9ca851489b.4237.9 info.flags=0x17 2024-09-13T19:17:15.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.156+0000 7fb584926800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:509740b4-c081-4f37-bd6d-df9ca851489b.4237.9 to cache LRU end 2024-09-13T19:17:15.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.156+0000 7fb584926800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:17:15.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.156+0000 7fb584926800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:17:15.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.156+0000 7fb584926800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:509740b4-c081-4f37-bd6d-df9ca851489b.4237.9 2024-09-13T19:17:15.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.156+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:68 8.6 8:601b7b74:root::.bucket.meta.myfoo6%3a509740b4-c081-4f37-bd6d-df9ca851489b.4237.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a2e29dfa0 con 0x7fb57807e850 2024-09-13T19:17:15.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.157+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.0 v2:172.21.15.53:6800/4021716951 20 ==== osd_op_reply(68 .bucket.meta.myfoo6:509740b4-c081-4f37-bd6d-df9ca851489b.4237.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v36'2 uv2 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7fb568029040 con 0x7fb57807e850 2024-09-13T19:17:15.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.158+0000 7fb584926800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:509740b4-c081-4f37-bd6d-df9ca851489b.4237.9 info.flags=0x17 2024-09-13T19:17:15.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.158+0000 7fb584926800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:509740b4-c081-4f37-bd6d-df9ca851489b.4237.9 to cache LRU end 2024-09-13T19:17:15.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.158+0000 7fb584926800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-13T19:17:15.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.158+0000 7fb584926800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:509740b4-c081-4f37-bd6d-df9ca851489b.4237.9, ofs0, ns] 2024-09-13T19:17:15.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.158+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:69 7.9 7:93e5b521:::notify.7:head [notify cookie 93845809867488 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a2e29ccb0 con 0x7fb57807e850 2024-09-13T19:17:15.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.158+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.0 v2:172.21.15.53:6800/4021716951 21 ==== watch-notify(notify (1) cookie 93845809632576 notify 154618822680 ret 0) ==== 790+0+0 (crc 0 0 0) 0x555a2e294390 con 0x7fb57807e850 2024-09-13T19:17:15.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.158+0000 7fb45effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822680 cookie 93845809632576 notifier 4741 bl.length()=748 2024-09-13T19:17:15.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.158+0000 7fb45effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:509740b4-c081-4f37-bd6d-df9ca851489b.4237.9 info.flags=0x17 2024-09-13T19:17:15.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.158+0000 7fb45effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:509740b4-c081-4f37-bd6d-df9ca851489b.4237.9 to cache LRU end 2024-09-13T19:17:15.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.158+0000 7fb45effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-13T19:17:15.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.158+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.0 v2:172.21.15.53:6800/4021716951 22 ==== osd_op_reply(69 notify.7 [notify cookie 93845809867488 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb568029040 con 0x7fb57807e850 2024-09-13T19:17:15.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.158+0000 7fb45effd640 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:70 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fb444003ea0 con 0x7fb57807e850 2024-09-13T19:17:15.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.158+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.0 v2:172.21.15.53:6800/4021716951 23 ==== osd_op_reply(70 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb568029040 con 0x7fb57807e850 2024-09-13T19:17:15.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.158+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.0 v2:172.21.15.53:6800/4021716951 24 ==== watch-notify(notify_complete (2) cookie 93845809867488 notify 154618822680 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555a2e295dd0 con 0x7fb57807e850 2024-09-13T19:17:15.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.158+0000 7fb584926800 20 handle_bi_update(): bucket=:myfoo6[509740b4-c081-4f37-bd6d-df9ca851489b.4237.9]): orig_sources= new_sources= 2024-09-13T19:17:15.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.158+0000 7fb584926800 20 handle_bi_update(): bucket=:myfoo6[509740b4-c081-4f37-bd6d-df9ca851489b.4237.9]): potential sources added=[] removed=[] 2024-09-13T19:17:15.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.158+0000 7fb584926800 20 handle_bi_update(): bucket=:myfoo6[509740b4-c081-4f37-bd6d-df9ca851489b.4237.9]): orig_dests= new_dests= 2024-09-13T19:17:15.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.158+0000 7fb584926800 20 handle_bi_update(): bucket=:myfoo6[509740b4-c081-4f37-bd6d-df9ca851489b.4237.9]): potential dests added=[] removed=[] 2024-09-13T19:17:15.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.158+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:71 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a2e292ae0 con 0x555a2e24ab20 2024-09-13T19:17:15.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.159+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(71 bud.buckets [call] v36'3 uv0 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb568029040 con 0x555a2e24ab20 2024-09-13T19:17:15.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.159+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:72 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a2e292ae0 con 0x555a2e24ab20 2024-09-13T19:17:15.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.160+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(72 bud.buckets [call] v36'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb568029040 con 0x555a2e24ab20 2024-09-13T19:17:15.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.160+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:73 8.18 8:1944a257:root::myfoo6:head [delete,create,call version.inc in=38b,writefull 0~166 in=166b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a2e292ae0 con 0x555a2e24ab20 2024-09-13T19:17:15.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.161+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(73 myfoo6 [delete,create,call,writefull 0~166] v36'17 uv17 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7fb568029040 con 0x555a2e24ab20 2024-09-13T19:17:15.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.161+0000 7fb584926800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-13T19:17:15.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.161+0000 7fb584926800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-13T19:17:15.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.161+0000 7fb584926800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-13T19:17:15.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.161+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [notify cookie 93845809867488 in=328b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a2e297210 con 0x7fb5700203b0 2024-09-13T19:17:15.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.162+0000 7fb5805e3640 1 -- 172.21.15.102:0/170207764 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== watch-notify(notify (1) cookie 93845809630240 notify 154618822673 ret 0) ==== 358+0+0 (crc 0 0 0) 0x555a2e08bdd0 con 0x7fb5700203b0 2024-09-13T19:17:15.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.162+0000 7fb45f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822673 cookie 93845809630240 notifier 4741 bl.length()=316 2024-09-13T19:17:15.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.162+0000 7fb45f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-13T19:17:15.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.162+0000 7fb45f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-13T19:17:15.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.162+0000 7fb45f7fe640 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:75 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fb3b4003400 con 0x7fb5700203b0 2024-09-13T19:17:15.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.162+0000 7fb5805e3640 1 -- 172.21.15.102:0/170207764 <== osd.2 v2:172.21.15.102:6816/2238176080 16 ==== osd_op_reply(74 notify.3 [notify cookie 93845809867488 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb57809a040 con 0x7fb5700203b0 2024-09-13T19:17:15.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.162+0000 7fb5805e3640 1 -- 172.21.15.102:0/170207764 <== osd.2 v2:172.21.15.102:6816/2238176080 17 ==== osd_op_reply(75 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb57809a040 con 0x7fb5700203b0 2024-09-13T19:17:15.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.162+0000 7fb5805e3640 1 -- 172.21.15.102:0/170207764 <== osd.2 v2:172.21.15.102:6816/2238176080 18 ==== watch-notify(notify_complete (2) cookie 93845809867488 notify 154618822673 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555a2dfc4fe0 con 0x7fb5700203b0 2024-09-13T19:17:15.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.162+0000 7fb584926800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:509740b4-c081-4f37-bd6d-df9ca851489b.4237.9 : hit (requested=0x17, cached=0x17) 2024-09-13T19:17:15.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.162+0000 7fb584926800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:509740b4-c081-4f37-bd6d-df9ca851489b.4237.9 2024-09-13T19:17:15.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.162+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:76 8.6 8:601b7b74:root::.bucket.meta.myfoo6%3a509740b4-c081-4f37-bd6d-df9ca851489b.4237.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a2e29be50 con 0x7fb57807e850 2024-09-13T19:17:15.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.164+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.0 v2:172.21.15.53:6800/4021716951 25 ==== osd_op_reply(76 .bucket.meta.myfoo6:509740b4-c081-4f37-bd6d-df9ca851489b.4237.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v36'3 uv3 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7fb568029040 con 0x7fb57807e850 2024-09-13T19:17:15.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.164+0000 7fb584926800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:509740b4-c081-4f37-bd6d-df9ca851489b.4237.9 info.flags=0x17 2024-09-13T19:17:15.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.164+0000 7fb584926800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:509740b4-c081-4f37-bd6d-df9ca851489b.4237.9 to cache LRU end 2024-09-13T19:17:15.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.164+0000 7fb584926800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-13T19:17:15.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.164+0000 7fb584926800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:509740b4-c081-4f37-bd6d-df9ca851489b.4237.9, ofs0, ns] 2024-09-13T19:17:15.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.164+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [notify cookie 93845809902704 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a2e29bd40 con 0x7fb57807e850 2024-09-13T19:17:15.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.164+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.0 v2:172.21.15.53:6800/4021716951 26 ==== watch-notify(notify (1) cookie 93845809632576 notify 154618822681 ret 0) ==== 790+0+0 (crc 0 0 0) 0x555a2e29e0e0 con 0x7fb57807e850 2024-09-13T19:17:15.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.164+0000 7fb45effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822681 cookie 93845809632576 notifier 4741 bl.length()=748 2024-09-13T19:17:15.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.164+0000 7fb45effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:509740b4-c081-4f37-bd6d-df9ca851489b.4237.9 info.flags=0x17 2024-09-13T19:17:15.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.164+0000 7fb45effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:509740b4-c081-4f37-bd6d-df9ca851489b.4237.9 to cache LRU end 2024-09-13T19:17:15.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.164+0000 7fb45effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-13T19:17:15.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.164+0000 7fb45effd640 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fb444003ea0 con 0x7fb57807e850 2024-09-13T19:17:15.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.164+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.0 v2:172.21.15.53:6800/4021716951 27 ==== osd_op_reply(77 notify.7 [notify cookie 93845809902704 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb568029040 con 0x7fb57807e850 2024-09-13T19:17:15.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.164+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.0 v2:172.21.15.53:6800/4021716951 28 ==== osd_op_reply(78 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb568029040 con 0x7fb57807e850 2024-09-13T19:17:15.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.164+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.0 v2:172.21.15.53:6800/4021716951 29 ==== watch-notify(notify_complete (2) cookie 93845809902704 notify 154618822681 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555a2e29b2a0 con 0x7fb57807e850 2024-09-13T19:17:15.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.164+0000 7fb584926800 20 handle_bi_update(): bucket=:myfoo6[509740b4-c081-4f37-bd6d-df9ca851489b.4237.9]): orig_sources= new_sources= 2024-09-13T19:17:15.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.164+0000 7fb584926800 20 handle_bi_update(): bucket=:myfoo6[509740b4-c081-4f37-bd6d-df9ca851489b.4237.9]): potential sources added=[] removed=[] 2024-09-13T19:17:15.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.164+0000 7fb584926800 20 handle_bi_update(): bucket=:myfoo6[509740b4-c081-4f37-bd6d-df9ca851489b.4237.9]): orig_dests= new_dests= 2024-09-13T19:17:15.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.164+0000 7fb584926800 20 handle_bi_update(): bucket=:myfoo6[509740b4-c081-4f37-bd6d-df9ca851489b.4237.9]): potential dests added=[] removed=[] 2024-09-13T19:17:15.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.164+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:79 4.24 4:2647217c:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a2e29b920 con 0x7fb57807e850 2024-09-13T19:17:15.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.165+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.0 v2:172.21.15.53:6800/4021716951 30 ==== osd_op_reply(79 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.0 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb568029040 con 0x7fb57807e850 2024-09-13T19:17:15.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.165+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:80 4.19 4:989757a2:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a2e29b470 con 0x555a2e24f430 2024-09-13T19:17:15.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.165+0000 7fb580de4640 1 -- 172.21.15.102:0/170207764 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(80 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb570028070 con 0x555a2e24f430 2024-09-13T19:17:15.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.165+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:81 4.10 4:0836b9cc:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a2e29b470 con 0x7fb5700203b0 2024-09-13T19:17:15.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.165+0000 7fb5805e3640 1 -- 172.21.15.102:0/170207764 <== osd.2 v2:172.21.15.102:6816/2238176080 19 ==== osd_op_reply(81 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.2 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb57809a040 con 0x7fb5700203b0 2024-09-13T19:17:15.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.165+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:82 4.11 4:8b972b0a:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a2e29b470 con 0x7fb57807e850 2024-09-13T19:17:15.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.166+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.0 v2:172.21.15.53:6800/4021716951 31 ==== osd_op_reply(82 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb568029040 con 0x7fb57807e850 2024-09-13T19:17:15.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.166+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:83 4.2b 4:d4752399:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a2e29b470 con 0x7fb5700203b0 2024-09-13T19:17:15.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.166+0000 7fb5805e3640 1 -- 172.21.15.102:0/170207764 <== osd.2 v2:172.21.15.102:6816/2238176080 20 ==== osd_op_reply(83 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb57809a040 con 0x7fb5700203b0 2024-09-13T19:17:15.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.166+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:84 4.3a 4:5caec590:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a2e29b470 con 0x555a2e24f430 2024-09-13T19:17:15.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.167+0000 7fb580de4640 1 -- 172.21.15.102:0/170207764 <== osd.3 v2:172.21.15.102:6800/3096737090 17 ==== osd_op_reply(84 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb570028070 con 0x555a2e24f430 2024-09-13T19:17:15.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.167+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:85 4.38 4:1c39a408:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a2e29b470 con 0x555a2e24ab20 2024-09-13T19:17:15.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.167+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(85 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb568029040 con 0x555a2e24ab20 2024-09-13T19:17:15.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.167+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:86 4.35 4:ae835331:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a2e29dac0 con 0x555a2e24ab20 2024-09-13T19:17:15.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.167+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== osd_op_reply(86 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb568029040 con 0x555a2e24ab20 2024-09-13T19:17:15.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.167+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:87 4.5 4:a026ac9d:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a2e29dac0 con 0x555a2e24f430 2024-09-13T19:17:15.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.168+0000 7fb580de4640 1 -- 172.21.15.102:0/170207764 <== osd.3 v2:172.21.15.102:6800/3096737090 18 ==== osd_op_reply(87 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.8 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb570028070 con 0x555a2e24f430 2024-09-13T19:17:15.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.168+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:88 4.4 4:22eb769a:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a2e29dac0 con 0x7fb57807e850 2024-09-13T19:17:15.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.168+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.0 v2:172.21.15.53:6800/4021716951 32 ==== osd_op_reply(88 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.9 [call out=378b] v0'0 uv5 ondisk = 0) ==== 194+0+378 (crc 0 0 0) 0x7fb568029040 con 0x7fb57807e850 2024-09-13T19:17:15.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.168+0000 7fb584926800 10 cls_bucket_list_unordered: got thirteen 2024-09-13T19:17:15.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.168+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:89 4.2e 4:74b87096:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a2e29dac0 con 0x7fb57807e850 2024-09-13T19:17:15.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.168+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.0 v2:172.21.15.53:6800/4021716951 33 ==== osd_op_reply(89 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb568029040 con 0x7fb57807e850 2024-09-13T19:17:15.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.168+0000 7fb584926800 20 get_obj_state: octx=0x7fb578063e10 obj=myfoo6:thirteen state=0x555a2e29c9e8 s->prefetch_data=0 2024-09-13T19:17:15.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.168+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:90 3.cs0 3:3148eb56:::509740b4-c081-4f37-bd6d-df9ca851489b.4237.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a2e29dac0 con 0x555a2e24f430 2024-09-13T19:17:15.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.169+0000 7fb580de4640 1 -- 172.21.15.102:0/170207764 <== osd.3 v2:172.21.15.102:6800/3096737090 19 ==== osd_op_reply(90 509740b4-c081-4f37-bd6d-df9ca851489b.4237.9_thirteen [getxattrs out=856b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 238+0+872 (crc 0 0 0) 0x7fb570028070 con 0x555a2e24f430 2024-09-13T19:17:15.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.169+0000 7fb584926800 10 manifest: total_size = 8 2024-09-13T19:17:15.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.169+0000 7fb584926800 20 get_obj_state: setting s->obj_tag to 509740b4-c081-4f37-bd6d-df9ca851489b.4237.16862108387792582348 2024-09-13T19:17:15.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.169+0000 7fb584926800 20 Read xattr rgw_rados: user.rgw.acl 2024-09-13T19:17:15.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.169+0000 7fb584926800 20 Read xattr rgw_rados: user.rgw.content_type 2024-09-13T19:17:15.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.169+0000 7fb584926800 20 Read xattr rgw_rados: user.rgw.etag 2024-09-13T19:17:15.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.169+0000 7fb584926800 20 Read xattr rgw_rados: user.rgw.idtag 2024-09-13T19:17:15.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.169+0000 7fb584926800 20 Read xattr rgw_rados: user.rgw.manifest 2024-09-13T19:17:15.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.169+0000 7fb584926800 20 Read xattr rgw_rados: user.rgw.pg_ver 2024-09-13T19:17:15.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.169+0000 7fb584926800 20 Read xattr rgw_rados: user.rgw.source_zone 2024-09-13T19:17:15.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.169+0000 7fb584926800 20 Read xattr rgw_rados: user.rgw.tail_tag 2024-09-13T19:17:15.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.169+0000 7fb584926800 20 get_obj_state: octx=0x7fb578063e10 obj=myfoo6:thirteen state=0x555a2e29c9e8 s->prefetch_data=0 2024-09-13T19:17:15.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.169+0000 7fb584926800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:509740b4-c081-4f37-bd6d-df9ca851489b.4237.9 : hit (requested=0x17, cached=0x17) 2024-09-13T19:17:15.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.169+0000 7fb584926800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:509740b4-c081-4f37-bd6d-df9ca851489b.4237.9 2024-09-13T19:17:15.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.169+0000 7fb584926800 20 bucket index object: :.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.9 2024-09-13T19:17:15.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.169+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:91 4.4 4:22eb769a:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a2e293a00 con 0x7fb57807e850 2024-09-13T19:17:15.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.170+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.0 v2:172.21.15.53:6800/4021716951 34 ==== osd_op_reply(91 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.9 [stat,call,call] v36'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fb568029040 con 0x7fb57807e850 2024-09-13T19:17:15.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.170+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:92 3.cs0 3:3148eb56:::509740b4-c081-4f37-bd6d-df9ca851489b.4237.9_thirteen:head [cmpxattr user.rgw.idtag (63) op 1 mode 1 in=77b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a2e293a00 con 0x555a2e24f430 2024-09-13T19:17:15.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.171+0000 7fb580de4640 1 -- 172.21.15.102:0/170207764 <== osd.3 v2:172.21.15.102:6800/3096737090 20 ==== osd_op_reply(92 509740b4-c081-4f37-bd6d-df9ca851489b.4237.9_thirteen [cmpxattr (63) op 1 mode 1,setxattr (117),setxattr (33)] v36'4 uv4 ondisk = 0) ==== 280+0+0 (crc 0 0 0) 0x7fb570028070 con 0x555a2e24f430 2024-09-13T19:17:15.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.171+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:93 4.4 4:22eb769a:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=323b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a2e2a0f80 con 0x7fb57807e850 2024-09-13T19:17:15.197 INFO:teuthology.orchestra.run.smithi102.stderr:1 objects processed in :myfoo6[509740b4-c081-4f37-bd6d-df9ca851489b.4237.9]). Next marker thirteen 2024-09-13T19:17:15.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.171+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a2e2a0f80 con 0x7fb5700203b0 2024-09-13T19:17:15.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.172+0000 7fb5805e3640 1 -- 172.21.15.102:0/170207764 <== osd.2 v2:172.21.15.102:6816/2238176080 21 ==== osd_op_reply(94 bud [delete,create,call,writefull 0~380] v36'4 uv4 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fb57809a040 con 0x7fb5700203b0 2024-09-13T19:17:15.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.172+0000 7fb584926800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-13T19:17:15.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.172+0000 7fb584926800 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T19:17:15.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.172+0000 7fb584926800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-13T19:17:15.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.172+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [notify cookie 93845809868736 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a2e2a0f80 con 0x7fb57807e850 2024-09-13T19:17:15.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.173+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.0 v2:172.21.15.53:6800/4021716951 35 ==== watch-notify(notify (1) cookie 93845809634368 notify 154618822682 ret 0) ==== 598+0+0 (crc 0 0 0) 0x555a2e29b2a0 con 0x7fb57807e850 2024-09-13T19:17:15.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.173+0000 7fb45f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822682 cookie 93845809634368 notifier 4741 bl.length()=556 2024-09-13T19:17:15.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.173+0000 7fb45f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-13T19:17:15.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.173+0000 7fb45f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T19:17:15.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.173+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.0 v2:172.21.15.53:6800/4021716951 36 ==== osd_op_reply(95 notify.5 [notify cookie 93845809868736 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb568029040 con 0x7fb57807e850 2024-09-13T19:17:15.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.173+0000 7fb45f7fe640 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fb3b4003460 con 0x7fb57807e850 2024-09-13T19:17:15.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.173+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.0 v2:172.21.15.53:6800/4021716951 37 ==== osd_op_reply(93 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.9 [stat,call,call] v36'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fb568029040 con 0x7fb57807e850 2024-09-13T19:17:15.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.173+0000 7fb45f7fe640 20 handle_completion(): completion ok for obj=thirteen 2024-09-13T19:17:15.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.173+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.0 v2:172.21.15.53:6800/4021716951 38 ==== osd_op_reply(96 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb568029040 con 0x7fb57807e850 2024-09-13T19:17:15.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.173+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.0 v2:172.21.15.53:6800/4021716951 39 ==== watch-notify(notify_complete (2) cookie 93845809868736 notify 154618822682 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555a2e295dd0 con 0x7fb57807e850 2024-09-13T19:17:15.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.173+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:97 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a2e296800 con 0x555a2e24ab20 2024-09-13T19:17:15.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.174+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(97 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v36'2 uv2 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fb568029040 con 0x555a2e24ab20 2024-09-13T19:17:15.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.174+0000 7fb584926800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-13T19:17:15.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.174+0000 7fb584926800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-13T19:17:15.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.174+0000 7fb584926800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-13T19:17:15.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.174+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify cookie 93845809868736 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a2e2a0a90 con 0x7fb57807e850 2024-09-13T19:17:15.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.174+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.0 v2:172.21.15.53:6800/4021716951 40 ==== watch-notify(notify (1) cookie 93845809634368 notify 154618822683 ret 0) ==== 219+0+0 (crc 0 0 0) 0x555a2e295dd0 con 0x7fb57807e850 2024-09-13T19:17:15.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.175+0000 7fb45f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822683 cookie 93845809634368 notifier 4741 bl.length()=177 2024-09-13T19:17:15.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.175+0000 7fb45f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-13T19:17:15.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.175+0000 7fb45f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-13T19:17:15.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.175+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.0 v2:172.21.15.53:6800/4021716951 41 ==== osd_op_reply(98 notify.5 [notify cookie 93845809868736 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb568029040 con 0x7fb57807e850 2024-09-13T19:17:15.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.175+0000 7fb45f7fe640 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:99 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fb3b4003460 con 0x7fb57807e850 2024-09-13T19:17:15.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.175+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.0 v2:172.21.15.53:6800/4021716951 42 ==== osd_op_reply(99 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb568029040 con 0x7fb57807e850 2024-09-13T19:17:15.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.175+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.0 v2:172.21.15.53:6800/4021716951 43 ==== watch-notify(notify_complete (2) cookie 93845809868736 notify 154618822683 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fb56802d650 con 0x7fb57807e850 2024-09-13T19:17:15.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.175+0000 7fb584926800 10 removing user index: bar 2024-09-13T19:17:15.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.175+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:100 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a2e296800 con 0x7fb57807e850 2024-09-13T19:17:15.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.176+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.0 v2:172.21.15.53:6800/4021716951 44 ==== osd_op_reply(100 bar [delete] v36'4 uv4 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7fb568029040 con 0x7fb57807e850 2024-09-13T19:17:15.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.176+0000 7fb584926800 10 removing default.rgw.meta+users.uid+bar from cache 2024-09-13T19:17:15.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.176+0000 7fb584926800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-13T19:17:15.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.176+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:101 7.9 7:93e5b521:::notify.7:head [notify cookie 93845809868736 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555a2e29c800 con 0x7fb57807e850 2024-09-13T19:17:15.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.176+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.0 v2:172.21.15.53:6800/4021716951 45 ==== watch-notify(notify (1) cookie 93845809632576 notify 154618822684 ret 0) ==== 194+0+0 (crc 0 0 0) 0x7fb56802d650 con 0x7fb57807e850 2024-09-13T19:17:15.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.176+0000 7fb45effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822684 cookie 93845809632576 notifier 4741 bl.length()=152 2024-09-13T19:17:15.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.176+0000 7fb45effd640 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fb444003ea0 con 0x7fb57807e850 2024-09-13T19:17:15.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.176+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.0 v2:172.21.15.53:6800/4021716951 46 ==== osd_op_reply(101 notify.7 [notify cookie 93845809868736 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb568029040 con 0x7fb57807e850 2024-09-13T19:17:15.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.176+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.0 v2:172.21.15.53:6800/4021716951 47 ==== osd_op_reply(102 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb568029040 con 0x7fb57807e850 2024-09-13T19:17:15.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.176+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.0 v2:172.21.15.53:6800/4021716951 48 ==== watch-notify(notify_complete (2) cookie 93845809868736 notify 154618822684 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fb568041540 con 0x7fb57807e850 2024-09-13T19:17:15.201 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"bud","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bud","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-13T19:17:14.974541Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:17:14.974529Z","tags":[],"group_ids":[]} 2024-09-13T19:17:15.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.177+0000 7fb4367e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:17:15.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.177+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93845809652512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a2e28fb50 con 0x555a2e24ab20 2024-09-13T19:17:15.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.178+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.1 v2:172.21.15.102:6808/2204418452 28 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 93845809652512] v36'213 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb568029040 con 0x555a2e24ab20 2024-09-13T19:17:15.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.178+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93845809615712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a2e28fb50 con 0x7fb5700203b0 2024-09-13T19:17:15.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.179+0000 7fb5805e3640 1 -- 172.21.15.102:0/170207764 <== osd.2 v2:172.21.15.102:6816/2238176080 22 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 93845809615712] v36'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb57809a040 con 0x7fb5700203b0 2024-09-13T19:17:15.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.179+0000 7fb584926800 20 remove_watcher() i=0 2024-09-13T19:17:15.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.179+0000 7fb584926800 2 removed watcher, disabling cache 2024-09-13T19:17:15.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.179+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93845809621984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a2e28fb50 con 0x555a2e24ab20 2024-09-13T19:17:15.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.180+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.1 v2:172.21.15.102:6808/2204418452 29 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 93845809621984] v36'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb568029040 con 0x555a2e24ab20 2024-09-13T19:17:15.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.180+0000 7fb584926800 20 remove_watcher() i=1 2024-09-13T19:17:15.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.180+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93845809626240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a2e28fb50 con 0x555a2e24f430 2024-09-13T19:17:15.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.181+0000 7fb580de4640 1 -- 172.21.15.102:0/170207764 <== osd.3 v2:172.21.15.102:6800/3096737090 21 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 93845809626240] v36'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb570028070 con 0x555a2e24f430 2024-09-13T19:17:15.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.181+0000 7fb584926800 20 remove_watcher() i=2 2024-09-13T19:17:15.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.181+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93845809630240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a2e28fb50 con 0x7fb5700203b0 2024-09-13T19:17:15.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.182+0000 7fb5805e3640 1 -- 172.21.15.102:0/170207764 <== osd.2 v2:172.21.15.102:6816/2238176080 23 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 93845809630240] v36'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb57809a040 con 0x7fb5700203b0 2024-09-13T19:17:15.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.182+0000 7fb584926800 20 remove_watcher() i=3 2024-09-13T19:17:15.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.182+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93845809625040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a2e28fb50 con 0x555a2e24ab20 2024-09-13T19:17:15.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.183+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.1 v2:172.21.15.102:6808/2204418452 30 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 93845809625040] v36'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb568029040 con 0x555a2e24ab20 2024-09-13T19:17:15.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.183+0000 7fb584926800 20 remove_watcher() i=4 2024-09-13T19:17:15.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.183+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93845809634368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a2e28fb50 con 0x7fb57807e850 2024-09-13T19:17:15.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.184+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.0 v2:172.21.15.53:6800/4021716951 49 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 93845809634368] v36'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb568029040 con 0x7fb57807e850 2024-09-13T19:17:15.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.184+0000 7fb584926800 20 remove_watcher() i=5 2024-09-13T19:17:15.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.184+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93845809638464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a2e28fb50 con 0x7fb57807e850 2024-09-13T19:17:15.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.185+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.0 v2:172.21.15.53:6800/4021716951 50 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 93845809638464] v36'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb568029040 con 0x7fb57807e850 2024-09-13T19:17:15.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.185+0000 7fb584926800 20 remove_watcher() i=6 2024-09-13T19:17:15.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.185+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93845809632576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555a2e28fb50 con 0x7fb57807e850 2024-09-13T19:17:15.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.186+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 <== osd.0 v2:172.21.15.53:6800/4021716951 51 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 93845809632576] v36'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb568029040 con 0x7fb57807e850 2024-09-13T19:17:15.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.186+0000 7fb584926800 20 remove_watcher() i=7 2024-09-13T19:17:15.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.187+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fb57807e850 msgr2=0x7fb57808d3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:15.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.187+0000 7fb584926800 1 --2- 172.21.15.102:0/170207764 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fb57807e850 0x7fb57808d3d0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:15.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.187+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x555a2e24ab20 msgr2=0x555a2e24cfe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:15.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.187+0000 7fb584926800 1 --2- 172.21.15.102:0/170207764 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x555a2e24ab20 0x555a2e24cfe0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:15.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.187+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fb5700203b0 msgr2=0x7fb57003f710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:15.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.187+0000 7fb584926800 1 --2- 172.21.15.102:0/170207764 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fb5700203b0 0x7fb57003f710 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:15.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.187+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x555a2e24f430 msgr2=0x555a2e251840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:15.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.187+0000 7fb584926800 1 --2- 172.21.15.102:0/170207764 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x555a2e24f430 0x555a2e251840 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:15.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.187+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb450036ce0 msgr2=0x7fb4500391a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:15.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.187+0000 7fb584926800 1 --2- 172.21.15.102:0/170207764 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb450036ce0 0x7fb4500391a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb57806c700 tx=0x7fb578094000 comp rx=0 tx=0).stop 2024-09-13T19:17:15.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.187+0000 7fb57fde2640 1 -- 172.21.15.102:0/170207764 reap_dead start 2024-09-13T19:17:15.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.187+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a2e237ef0 msgr2=0x555a2e23f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:15.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.187+0000 7fb584926800 1 --2- 172.21.15.102:0/170207764 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a2e237ef0 0x555a2e23f150 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fb5700215b0 tx=0x7fb57004b000 comp rx=0 tx=0).stop 2024-09-13T19:17:15.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.187+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 shutdown_connections 2024-09-13T19:17:15.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.187+0000 7fb584926800 1 --2- 172.21.15.102:0/170207764 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a2e237ef0 0x555a2e23f150 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:15.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.187+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 >> 172.21.15.102:0/170207764 conn(0x555a2e234250 msgr2=0x555a2e232310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:15.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.187+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 shutdown_connections 2024-09-13T19:17:15.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.187+0000 7fb584926800 1 -- 172.21.15.102:0/170207764 wait complete. 2024-09-13T19:17:15.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.187+0000 7fb584926800 1 -- 172.21.15.102:0/3501454578 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb458036b40 msgr2=0x7fb458039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:15.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.187+0000 7fb584926800 1 --2- 172.21.15.102:0/3501454578 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb458036b40 0x7fb458039000 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb57800a3f0 tx=0x7fb57806c8c0 comp rx=0 tx=0).stop 2024-09-13T19:17:15.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.187+0000 7fb584926800 1 -- 172.21.15.102:0/3501454578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a2e22b2b0 msgr2=0x555a2e22b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:15.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.187+0000 7fb584926800 1 --2- 172.21.15.102:0/3501454578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a2e22b2b0 0x555a2e22b6d0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x555a2e08d420 tx=0x7fb57000beb0 comp rx=0 tx=0).stop 2024-09-13T19:17:15.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.187+0000 7fb584926800 1 -- 172.21.15.102:0/3501454578 shutdown_connections 2024-09-13T19:17:15.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.187+0000 7fb584926800 1 --2- 172.21.15.102:0/3501454578 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb458036b40 0x7fb458039000 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:15.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.187+0000 7fb584926800 1 --2- 172.21.15.102:0/3501454578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a2e22b2b0 0x555a2e22b6d0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:15.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.187+0000 7fb584926800 1 -- 172.21.15.102:0/3501454578 >> 172.21.15.102:0/3501454578 conn(0x555a2e220240 msgr2=0x555a2e222dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:15.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.187+0000 7fb584926800 1 -- 172.21.15.102:0/3501454578 shutdown_connections 2024-09-13T19:17:15.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.187+0000 7fb584926800 1 -- 172.21.15.102:0/3501454578 wait complete. 2024-09-13T19:17:15.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.188+0000 7fb584926800 1 -- 172.21.15.102:0/2632263284 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x555a2e118050 msgr2=0x555a2e217610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:15.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.188+0000 7fb584926800 1 --2- 172.21.15.102:0/2632263284 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x555a2e118050 0x555a2e217610 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:15.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.188+0000 7fb584926800 1 -- 172.21.15.102:0/2632263284 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x555a2e219cb0 msgr2=0x555a2e21c170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:15.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.188+0000 7fb584926800 1 --2- 172.21.15.102:0/2632263284 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x555a2e219cb0 0x555a2e21c170 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:15.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.188+0000 7fb584926800 1 -- 172.21.15.102:0/2632263284 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb468036be0 msgr2=0x7fb4680390a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:15.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.188+0000 7fb584926800 1 --2- 172.21.15.102:0/2632263284 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb468036be0 0x7fb4680390a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb568000f60 tx=0x7fb5680012b0 comp rx=0 tx=0).stop 2024-09-13T19:17:15.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.188+0000 7fb584926800 1 -- 172.21.15.102:0/2632263284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a2e117710 msgr2=0x555a2e08d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:15.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.188+0000 7fb584926800 1 --2- 172.21.15.102:0/2632263284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a2e117710 0x555a2e08d6e0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fb578065040 tx=0x7fb578003330 comp rx=0 tx=0).stop 2024-09-13T19:17:15.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.188+0000 7fb584926800 1 -- 172.21.15.102:0/2632263284 shutdown_connections 2024-09-13T19:17:15.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.188+0000 7fb584926800 1 --2- 172.21.15.102:0/2632263284 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x555a2e219cb0 0x555a2e21c170 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:15.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.188+0000 7fb584926800 1 --2- 172.21.15.102:0/2632263284 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x555a2e118050 0x555a2e217610 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:15.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.188+0000 7fb584926800 1 --2- 172.21.15.102:0/2632263284 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fb468036be0 0x7fb4680390a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:15.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.188+0000 7fb584926800 1 --2- 172.21.15.102:0/2632263284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a2e117710 0x555a2e08d6e0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:15.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.188+0000 7fb584926800 1 -- 172.21.15.102:0/2632263284 >> 172.21.15.102:0/2632263284 conn(0x555a2e112fe0 msgr2=0x555a2e200b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:15.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.188+0000 7fb584926800 1 -- 172.21.15.102:0/2632263284 shutdown_connections 2024-09-13T19:17:15.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:15.188+0000 7fb584926800 1 -- 172.21.15.102:0/2632263284 wait complete. 2024-09-13T19:17:15.214 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-13T19:17:14.974541Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:17:14.974529Z', 'tags': [], 'group_ids': []} 2024-09-13T19:17:20.223 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:17:20.223 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-13T19:17:20.223 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-13T19:17:20.223 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-13T19:17:20.223 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2024-09-13T19:17:20.284 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:17:20.284 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:17:20.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.282+0000 7fa89e542800 1 Processor -- start 2024-09-13T19:17:20.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.282+0000 7fa89e542800 1 -- start start 2024-09-13T19:17:20.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.282+0000 7fa89e542800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56044391fed0 0x5604439af180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.282+0000 7fa89e542800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56044386bb30 con 0x5604439af6c0 2024-09-13T19:17:20.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.282+0000 7fa89e542800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x56044384d360 con 0x56044391fed0 2024-09-13T19:17:20.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.283+0000 7fa89a297640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56044391fed0 0x5604439af180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.283+0000 7fa89a297640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56044391fed0 0x5604439af180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41468/0 (socket says 172.21.15.102:41468) 2024-09-13T19:17:20.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.283+0000 7fa89a297640 1 -- 172.21.15.102:0/606214525 learned_addr learned my addr 172.21.15.102:0/606214525 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:20.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.283+0000 7fa899a96640 1 --1- 172.21.15.102:0/606214525 >> v1:172.21.15.53:6789/0 conn(0x5604439af6c0 0x5604439b1ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:50078/0 (socket says 172.21.15.102:50078) 2024-09-13T19:17:20.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.283+0000 7fa89a297640 1 -- 172.21.15.102:0/606214525 >> v1:172.21.15.53:6789/0 conn(0x5604439af6c0 legacy=0x5604439b1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.283+0000 7fa89a297640 1 -- 172.21.15.102:0/606214525 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560443873e00 con 0x56044391fed0 2024-09-13T19:17:20.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.285+0000 7fa89a297640 1 --2- 172.21.15.102:0/606214525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56044391fed0 0x5604439af180 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fa88c00a520 tx=0x7fa88c045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=380fb9fd40b93895 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.285+0000 7fa899295640 1 -- 172.21.15.102:0/606214525 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa88c055070 con 0x56044391fed0 2024-09-13T19:17:20.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.285+0000 7fa899295640 1 -- 172.21.15.102:0/606214525 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa88c0515b0 con 0x56044391fed0 2024-09-13T19:17:20.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.285+0000 7fa899295640 1 -- 172.21.15.102:0/606214525 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa88c0518d0 con 0x56044391fed0 2024-09-13T19:17:20.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.286+0000 7fa89e542800 1 -- 172.21.15.102:0/606214525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56044391fed0 msgr2=0x5604439af180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.286+0000 7fa89e542800 1 --2- 172.21.15.102:0/606214525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56044391fed0 0x5604439af180 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fa88c00a520 tx=0x7fa88c045ba0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.286+0000 7fa89e542800 1 -- 172.21.15.102:0/606214525 shutdown_connections 2024-09-13T19:17:20.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.286+0000 7fa89e542800 1 --2- 172.21.15.102:0/606214525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56044391fed0 0x5604439af180 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.286+0000 7fa89e542800 1 -- 172.21.15.102:0/606214525 >> 172.21.15.102:0/606214525 conn(0x5604439a6e30 msgr2=0x5604439a9250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:20.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.286+0000 7fa89e542800 1 -- 172.21.15.102:0/606214525 shutdown_connections 2024-09-13T19:17:20.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.286+0000 7fa89e542800 1 -- 172.21.15.102:0/606214525 wait complete. 2024-09-13T19:17:20.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.301+0000 7fa89e542800 1 Processor -- start 2024-09-13T19:17:20.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.302+0000 7fa89e542800 1 -- start start 2024-09-13T19:17:20.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.302+0000 7fa89e542800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56044391fed0 0x5604439acab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.302+0000 7fa89e542800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5604438f8370 con 0x56044391fed0 2024-09-13T19:17:20.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.302+0000 7fa89a297640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56044391fed0 0x5604439acab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.302+0000 7fa89a297640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56044391fed0 0x5604439acab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41480/0 (socket says 172.21.15.102:41480) 2024-09-13T19:17:20.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.302+0000 7fa89a297640 1 -- 172.21.15.102:0/2513147473 learned_addr learned my addr 172.21.15.102:0/2513147473 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:20.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.302+0000 7fa89a297640 1 -- 172.21.15.102:0/2513147473 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560443845bc0 con 0x56044391fed0 2024-09-13T19:17:20.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.303+0000 7fa89a297640 1 --2- 172.21.15.102:0/2513147473 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56044391fed0 0x5604439acab0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fa88c025da0 tx=0x7fa88c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ee979118871a6fa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.303+0000 7fa788608640 1 -- 172.21.15.102:0/2513147473 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa88c051950 con 0x56044391fed0 2024-09-13T19:17:20.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.303+0000 7fa788608640 1 -- 172.21.15.102:0/2513147473 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa88c051af0 con 0x56044391fed0 2024-09-13T19:17:20.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.303+0000 7fa788608640 1 -- 172.21.15.102:0/2513147473 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa88c051dd0 con 0x56044391fed0 2024-09-13T19:17:20.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.304+0000 7fa89e542800 1 -- 172.21.15.102:0/2513147473 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56044391fed0 msgr2=0x5604439acab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.304+0000 7fa89e542800 1 --2- 172.21.15.102:0/2513147473 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56044391fed0 0x5604439acab0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fa88c025da0 tx=0x7fa88c051000 comp rx=0 tx=0).stop 2024-09-13T19:17:20.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.304+0000 7fa89e542800 1 -- 172.21.15.102:0/2513147473 shutdown_connections 2024-09-13T19:17:20.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.304+0000 7fa89e542800 1 --2- 172.21.15.102:0/2513147473 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56044391fed0 0x5604439acab0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.304+0000 7fa89e542800 1 -- 172.21.15.102:0/2513147473 >> 172.21.15.102:0/2513147473 conn(0x5604439a6e30 msgr2=0x560443a97340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:20.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.304+0000 7fa89e542800 1 -- 172.21.15.102:0/2513147473 shutdown_connections 2024-09-13T19:17:20.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.304+0000 7fa89e542800 1 -- 172.21.15.102:0/2513147473 wait complete. 2024-09-13T19:17:20.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.304+0000 7fa89e542800 1 Processor -- start 2024-09-13T19:17:20.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.304+0000 7fa89e542800 1 -- start start 2024-09-13T19:17:20.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.304+0000 7fa89e542800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56044391fed0 0x560443aa5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.304+0000 7fa89e542800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5604439b3630 con 0x56044391fed0 2024-09-13T19:17:20.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.305+0000 7fa89a297640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56044391fed0 0x560443aa5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.305+0000 7fa89a297640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56044391fed0 0x560443aa5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41484/0 (socket says 172.21.15.102:41484) 2024-09-13T19:17:20.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.305+0000 7fa89a297640 1 -- 172.21.15.102:0/3705952778 learned_addr learned my addr 172.21.15.102:0/3705952778 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:20.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.305+0000 7fa89a297640 1 -- 172.21.15.102:0/3705952778 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560443859fe0 con 0x56044391fed0 2024-09-13T19:17:20.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.305+0000 7fa89a297640 1 --2- 172.21.15.102:0/3705952778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56044391fed0 0x560443aa5460 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fa88c067040 tx=0x7fa88c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.305+0000 7fa786e05640 1 -- 172.21.15.102:0/3705952778 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa88c073070 con 0x56044391fed0 2024-09-13T19:17:20.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.305+0000 7fa786e05640 1 -- 172.21.15.102:0/3705952778 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa88c05a580 con 0x56044391fed0 2024-09-13T19:17:20.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.305+0000 7fa89e542800 1 -- 172.21.15.102:0/3705952778 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560443aa59a0 con 0x56044391fed0 2024-09-13T19:17:20.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.305+0000 7fa786e05640 1 -- 172.21.15.102:0/3705952778 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa88c05a880 con 0x56044391fed0 2024-09-13T19:17:20.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.305+0000 7fa89e542800 1 -- 172.21.15.102:0/3705952778 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560443aa5f20 con 0x56044391fed0 2024-09-13T19:17:20.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.306+0000 7fa786e05640 1 -- 172.21.15.102:0/3705952778 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa88c076070 con 0x56044391fed0 2024-09-13T19:17:20.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.306+0000 7fa786e05640 1 --2- 172.21.15.102:0/3705952778 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa780036b40 0x7fa780039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.306+0000 7fa786e05640 1 -- 172.21.15.102:0/3705952778 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fa88c062070 con 0x56044391fed0 2024-09-13T19:17:20.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.307+0000 7fa899a96640 1 --2- 172.21.15.102:0/3705952778 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa780036b40 0x7fa780039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.307+0000 7fa89e542800 1 --2- 172.21.15.102:0/3705952778 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5604439af6c0 0x560443aac4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.307+0000 7fa89e542800 1 -- 172.21.15.102:0/3705952778 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560443aaca50 con 0x5604439af6c0 2024-09-13T19:17:20.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.307+0000 7fa89aa98640 1 --2- 172.21.15.102:0/3705952778 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5604439af6c0 0x560443aac4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.307+0000 7fa899a96640 1 --2- 172.21.15.102:0/3705952778 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa780036b40 0x7fa780039000 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa890000f60 tx=0x7fa890001370 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.307+0000 7fa89aa98640 1 --2- 172.21.15.102:0/3705952778 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5604439af6c0 0x560443aac4d0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.307+0000 7fa89aa98640 1 -- 172.21.15.102:0/3705952778 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa89400a4a0 con 0x5604439af6c0 2024-09-13T19:17:20.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.307+0000 7fa89e542800 1 -- 172.21.15.102:0/3705952778 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560443aa9aa0 con 0x5604439af6c0 2024-09-13T19:17:20.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.308+0000 7fa89aa98640 1 -- 172.21.15.102:0/3705952778 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa89400a4a0 con 0x5604439af6c0 2024-09-13T19:17:20.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.308+0000 7fa89e542800 1 --2- 172.21.15.102:0/3705952778 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x560443aaed80 0x560443ab1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.308+0000 7fa89e542800 1 -- 172.21.15.102:0/3705952778 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560443ab1810 con 0x560443aaed80 2024-09-13T19:17:20.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.308+0000 7fa89a297640 1 --2- 172.21.15.102:0/3705952778 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x560443aaed80 0x560443ab1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.308+0000 7fa89a297640 1 --2- 172.21.15.102:0/3705952778 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x560443aaed80 0x560443ab1170 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.308+0000 7fa89a297640 1 -- 172.21.15.102:0/3705952778 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa88c075030 con 0x560443aaed80 2024-09-13T19:17:20.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.308+0000 7fa89e542800 1 -- 172.21.15.102:0/3705952778 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560443aadc20 con 0x5604439af6c0 2024-09-13T19:17:20.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.309+0000 7fa89aa98640 1 -- 172.21.15.102:0/3705952778 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa89400a4a0 con 0x5604439af6c0 2024-09-13T19:17:20.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.309+0000 7fa89e542800 1 -- 172.21.15.102:0/3705952778 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560443aae100 con 0x560443aaed80 2024-09-13T19:17:20.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.309+0000 7fa89a297640 1 -- 172.21.15.102:0/3705952778 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa88c075030 con 0x560443aaed80 2024-09-13T19:17:20.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.309+0000 7fa89e542800 1 Processor -- start 2024-09-13T19:17:20.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.309+0000 7fa89e542800 1 -- start start 2024-09-13T19:17:20.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.310+0000 7fa89e542800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560443ac01b0 0x560443ac05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.310+0000 7fa89e542800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560443847580 con 0x560443ac01b0 2024-09-13T19:17:20.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.310+0000 7fa89aa98640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560443ac01b0 0x560443ac05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.310+0000 7fa89aa98640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560443ac01b0 0x560443ac05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41490/0 (socket says 172.21.15.102:41490) 2024-09-13T19:17:20.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.310+0000 7fa89aa98640 1 -- 172.21.15.102:0/1124219488 learned_addr learned my addr 172.21.15.102:0/1124219488 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:20.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.310+0000 7fa89aa98640 1 -- 172.21.15.102:0/1124219488 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560443ac0b10 con 0x560443ac01b0 2024-09-13T19:17:20.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.310+0000 7fa89aa98640 1 --2- 172.21.15.102:0/1124219488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560443ac01b0 0x560443ac05d0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x560443aace30 tx=0x7fa8940167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.310+0000 7fa77ffff640 1 -- 172.21.15.102:0/1124219488 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa894013640 con 0x560443ac01b0 2024-09-13T19:17:20.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.311+0000 7fa77ffff640 1 -- 172.21.15.102:0/1124219488 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8940137e0 con 0x560443ac01b0 2024-09-13T19:17:20.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.311+0000 7fa77ffff640 1 -- 172.21.15.102:0/1124219488 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa894013ae0 con 0x560443ac01b0 2024-09-13T19:17:20.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.311+0000 7fa89e542800 1 -- 172.21.15.102:0/1124219488 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560443ac0da0 con 0x560443ac01b0 2024-09-13T19:17:20.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.311+0000 7fa89e542800 1 -- 172.21.15.102:0/1124219488 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560443ac3a80 con 0x560443ac01b0 2024-09-13T19:17:20.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.311+0000 7fa77ffff640 1 -- 172.21.15.102:0/1124219488 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa894011040 con 0x560443ac01b0 2024-09-13T19:17:20.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.312+0000 7fa77ffff640 1 --2- 172.21.15.102:0/1124219488 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa774036b90 0x7fa774039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.312+0000 7fa77ffff640 1 -- 172.21.15.102:0/1124219488 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fa89400e040 con 0x560443ac01b0 2024-09-13T19:17:20.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.312+0000 7fa89a297640 1 --2- 172.21.15.102:0/1124219488 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa774036b90 0x7fa774039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.312+0000 7fa89e542800 1 Processor -- start 2024-09-13T19:17:20.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.312+0000 7fa89a297640 1 --2- 172.21.15.102:0/1124219488 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa774036b90 0x7fa774039050 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x560443aa99c0 tx=0x7fa88c08f530 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.312+0000 7fa89e542800 1 -- start start 2024-09-13T19:17:20.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.312+0000 7fa89e542800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560443acce50 0x560443acd250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.312+0000 7fa89e542800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5604439ab090 con 0x560443acce50 2024-09-13T19:17:20.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.313+0000 7fa89aa98640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560443acce50 0x560443acd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.313+0000 7fa89aa98640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560443acce50 0x560443acd250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41498/0 (socket says 172.21.15.102:41498) 2024-09-13T19:17:20.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.313+0000 7fa89aa98640 1 -- 172.21.15.102:0/576345128 learned_addr learned my addr 172.21.15.102:0/576345128 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:20.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.313+0000 7fa89aa98640 1 -- 172.21.15.102:0/576345128 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560443acd820 con 0x560443acce50 2024-09-13T19:17:20.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.313+0000 7fa89aa98640 1 --2- 172.21.15.102:0/576345128 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560443acce50 0x560443acd250 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fa894014fd0 tx=0x7fa894020da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=186b73780b262363 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.313+0000 7fa77dffb640 1 -- 172.21.15.102:0/576345128 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa894014c70 con 0x560443acce50 2024-09-13T19:17:20.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.313+0000 7fa77dffb640 1 -- 172.21.15.102:0/576345128 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa89404a020 con 0x560443acce50 2024-09-13T19:17:20.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.313+0000 7fa77dffb640 1 -- 172.21.15.102:0/576345128 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa89402aa60 con 0x560443acce50 2024-09-13T19:17:20.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.314+0000 7fa89e542800 1 -- 172.21.15.102:0/576345128 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560443acce50 msgr2=0x560443acd250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.314+0000 7fa89e542800 1 --2- 172.21.15.102:0/576345128 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560443acce50 0x560443acd250 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fa894014fd0 tx=0x7fa894020da0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.314+0000 7fa89e542800 1 -- 172.21.15.102:0/576345128 shutdown_connections 2024-09-13T19:17:20.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.314+0000 7fa89e542800 1 --2- 172.21.15.102:0/576345128 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560443acce50 0x560443acd250 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.314+0000 7fa89e542800 1 -- 172.21.15.102:0/576345128 >> 172.21.15.102:0/576345128 conn(0x560443ac91b0 msgr2=0x560443ac72b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:20.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.314+0000 7fa89e542800 1 -- 172.21.15.102:0/576345128 shutdown_connections 2024-09-13T19:17:20.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.314+0000 7fa89e542800 1 -- 172.21.15.102:0/576345128 wait complete. 2024-09-13T19:17:20.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.314+0000 7fa89e542800 1 Processor -- start 2024-09-13T19:17:20.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.314+0000 7fa89e542800 1 -- start start 2024-09-13T19:17:20.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.314+0000 7fa89e542800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560443acce50 0x560443ad4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.314+0000 7fa89e542800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560443acde90 con 0x560443acce50 2024-09-13T19:17:20.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.314+0000 7fa89aa98640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560443acce50 0x560443ad4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.315+0000 7fa89aa98640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560443acce50 0x560443ad4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41508/0 (socket says 172.21.15.102:41508) 2024-09-13T19:17:20.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.315+0000 7fa89aa98640 1 -- 172.21.15.102:0/2968622018 learned_addr learned my addr 172.21.15.102:0/2968622018 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:20.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.315+0000 7fa89aa98640 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560443ad4860 con 0x560443acce50 2024-09-13T19:17:20.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.315+0000 7fa89aa98640 1 --2- 172.21.15.102:0/2968622018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560443acce50 0x560443ad4320 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fa894021040 tx=0x7fa89404cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.315+0000 7fa76bfff640 1 -- 172.21.15.102:0/2968622018 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa894038070 con 0x560443acce50 2024-09-13T19:17:20.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.315+0000 7fa76bfff640 1 -- 172.21.15.102:0/2968622018 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa89404e050 con 0x560443acce50 2024-09-13T19:17:20.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.315+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560443ad4af0 con 0x560443acce50 2024-09-13T19:17:20.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.315+0000 7fa76bfff640 1 -- 172.21.15.102:0/2968622018 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa894040140 con 0x560443acce50 2024-09-13T19:17:20.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.315+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560443ad77a0 con 0x560443acce50 2024-09-13T19:17:20.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.316+0000 7fa76bfff640 1 -- 172.21.15.102:0/2968622018 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa89403b070 con 0x560443acce50 2024-09-13T19:17:20.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.316+0000 7fa76bfff640 1 --2- 172.21.15.102:0/2968622018 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa764036b40 0x7fa764039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.316+0000 7fa76bfff640 1 -- 172.21.15.102:0/2968622018 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fa89404b030 con 0x560443acce50 2024-09-13T19:17:20.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.316+0000 7fa89a297640 1 --2- 172.21.15.102:0/2968622018 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa764036b40 0x7fa764039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.317+0000 7fa89a297640 1 --2- 172.21.15.102:0/2968622018 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa764036b40 0x7fa764039000 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa88c064e70 tx=0x7fa88c092000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.317+0000 7fa89e542800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.317+0000 7fa89e542800 1 --2- 172.21.15.102:0/2968622018 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x560443adfe00 0x560443ae22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.317+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560443ae2a10 con 0x560443adfe00 2024-09-13T19:17:20.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.317+0000 7fa899a96640 1 --2- 172.21.15.102:0/2968622018 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x560443adfe00 0x560443ae22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.318+0000 7fa899a96640 1 --2- 172.21.15.102:0/2968622018 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x560443adfe00 0x560443ae22c0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.318+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa89000f5c0 con 0x560443adfe00 2024-09-13T19:17:20.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.318+0000 7fa89e542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:20.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.318+0000 7fa89e542800 20 realm 2024-09-13T19:17:20.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.318+0000 7fa89e542800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.318+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560443adf250 con 0x560443adfe00 2024-09-13T19:17:20.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.318+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa89000f5c0 con 0x560443adfe00 2024-09-13T19:17:20.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.318+0000 7fa89e542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:20.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.318+0000 7fa89e542800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:17:20.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.318+0000 7fa89e542800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.318+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560443ae3500 con 0x560443adfe00 2024-09-13T19:17:20.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.318+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa89000f5c0 con 0x560443adfe00 2024-09-13T19:17:20.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.318+0000 7fa89e542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:20.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.318+0000 7fa89e542800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.318+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560443ae3dd0 con 0x560443adfe00 2024-09-13T19:17:20.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.319+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa89000f5c0 con 0x560443adfe00 2024-09-13T19:17:20.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.319+0000 7fa89e542800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:17:20.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.319+0000 7fa89e542800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.319+0000 7fa89e542800 1 --2- 172.21.15.102:0/2968622018 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x560443ae47f0 0x560443ae6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.319+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560443ae72d0 con 0x560443ae47f0 2024-09-13T19:17:20.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.319+0000 7fa89aa98640 1 --2- 172.21.15.102:0/2968622018 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x560443ae47f0 0x560443ae6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.319+0000 7fa89aa98640 1 --2- 172.21.15.102:0/2968622018 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x560443ae47f0 0x560443ae6be0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.319+0000 7fa89aa98640 1 -- 172.21.15.102:0/2968622018 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa89403a030 con 0x560443ae47f0 2024-09-13T19:17:20.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.319+0000 7fa89e542800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:17:20.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.319+0000 7fa89e542800 20 searching for the correct realm 2024-09-13T19:17:20.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.319+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560443ae8c20 con 0x560443ae47f0 2024-09-13T19:17:20.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.320+0000 7fa89aa98640 1 -- 172.21.15.102:0/2968622018 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa89403a030 con 0x560443ae47f0 2024-09-13T19:17:20.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.320+0000 7fa89aa98640 1 --2- 172.21.15.102:0/2968622018 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fa894036bb0 0x7fa89404e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.320+0000 7fa89aa98640 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560443ae8c20 con 0x7fa894036bb0 2024-09-13T19:17:20.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.320+0000 7fa89a297640 1 --2- 172.21.15.102:0/2968622018 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fa894036bb0 0x7fa89404e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.320+0000 7fa89a297640 1 --2- 172.21.15.102:0/2968622018 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fa894036bb0 0x7fa89404e540 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.320+0000 7fa89a297640 1 -- 172.21.15.102:0/2968622018 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa88c075030 con 0x7fa894036bb0 2024-09-13T19:17:20.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.320+0000 7fa89a297640 1 --2- 172.21.15.102:0/2968622018 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fa88c078070 0x7fa88c081ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.320+0000 7fa89a297640 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560443ae8c20 con 0x7fa88c078070 2024-09-13T19:17:20.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.321+0000 7fa899a96640 1 --2- 172.21.15.102:0/2968622018 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fa88c078070 0x7fa88c081ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.321+0000 7fa899a96640 1 --2- 172.21.15.102:0/2968622018 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fa88c078070 0x7fa88c081ab0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.321+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa89000f5c0 con 0x7fa88c078070 2024-09-13T19:17:20.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.321+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560443ae8c20 con 0x560443adfe00 2024-09-13T19:17:20.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.322+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa89000f5c0 con 0x560443adfe00 2024-09-13T19:17:20.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.322+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560443ae8c20 con 0x560443adfe00 2024-09-13T19:17:20.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.322+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa89002b040 con 0x560443adfe00 2024-09-13T19:17:20.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.322+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560443ae8c20 con 0x7fa88c078070 2024-09-13T19:17:20.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.322+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa89002b040 con 0x7fa88c078070 2024-09-13T19:17:20.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.322+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560443ae8c20 con 0x7fa88c078070 2024-09-13T19:17:20.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.323+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa89002b040 con 0x7fa88c078070 2024-09-13T19:17:20.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.323+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560443ae8c20 con 0x7fa894036bb0 2024-09-13T19:17:20.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.323+0000 7fa89a297640 1 -- 172.21.15.102:0/2968622018 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa88c075030 con 0x7fa894036bb0 2024-09-13T19:17:20.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.323+0000 7fa89a297640 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560443ae8c20 con 0x560443ae47f0 2024-09-13T19:17:20.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.323+0000 7fa89aa98640 1 -- 172.21.15.102:0/2968622018 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa89403a030 con 0x560443ae47f0 2024-09-13T19:17:20.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.323+0000 7fa89aa98640 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560443ae8c20 con 0x560443adfe00 2024-09-13T19:17:20.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.323+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa89002b040 con 0x560443adfe00 2024-09-13T19:17:20.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.323+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560443ae8c20 con 0x7fa894036bb0 2024-09-13T19:17:20.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.324+0000 7fa89a297640 1 -- 172.21.15.102:0/2968622018 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa88c075030 con 0x7fa894036bb0 2024-09-13T19:17:20.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.324+0000 7fa89a297640 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa88c0ad040 con 0x560443adfe00 2024-09-13T19:17:20.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.324+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa89002b040 con 0x560443adfe00 2024-09-13T19:17:20.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.324+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa88c0ad040 con 0x7fa894036bb0 2024-09-13T19:17:20.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.324+0000 7fa89a297640 1 -- 172.21.15.102:0/2968622018 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa88c075030 con 0x7fa894036bb0 2024-09-13T19:17:20.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.324+0000 7fa89a297640 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa88c0ad040 con 0x560443ae47f0 2024-09-13T19:17:20.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.324+0000 7fa89aa98640 1 -- 172.21.15.102:0/2968622018 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa89403a030 con 0x560443ae47f0 2024-09-13T19:17:20.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.324+0000 7fa89aa98640 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa88c0ad040 con 0x560443ae47f0 2024-09-13T19:17:20.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.325+0000 7fa89aa98640 1 -- 172.21.15.102:0/2968622018 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa89403a030 con 0x560443ae47f0 2024-09-13T19:17:20.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.325+0000 7fa89aa98640 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa88c0ad040 con 0x7fa88c078070 2024-09-13T19:17:20.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.325+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa89002b040 con 0x7fa88c078070 2024-09-13T19:17:20.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.325+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa88c0ad040 con 0x560443ae47f0 2024-09-13T19:17:20.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.325+0000 7fa89aa98640 1 -- 172.21.15.102:0/2968622018 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa89403a030 con 0x560443ae47f0 2024-09-13T19:17:20.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.325+0000 7fa89aa98640 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa88c0ad040 con 0x560443ae47f0 2024-09-13T19:17:20.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.325+0000 7fa89aa98640 1 -- 172.21.15.102:0/2968622018 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa89403a030 con 0x560443ae47f0 2024-09-13T19:17:20.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.326+0000 7fa89aa98640 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa88c0ad040 con 0x560443adfe00 2024-09-13T19:17:20.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.326+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa89002b040 con 0x560443adfe00 2024-09-13T19:17:20.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.326+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa88c0ad040 con 0x560443adfe00 2024-09-13T19:17:20.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.326+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa89002b040 con 0x560443adfe00 2024-09-13T19:17:20.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.326+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa88c0ad040 con 0x7fa88c078070 2024-09-13T19:17:20.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.326+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa89002b040 con 0x7fa88c078070 2024-09-13T19:17:20.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.326+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa88c0ad040 con 0x560443ae47f0 2024-09-13T19:17:20.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.327+0000 7fa89aa98640 1 -- 172.21.15.102:0/2968622018 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa89403a030 con 0x560443ae47f0 2024-09-13T19:17:20.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.327+0000 7fa89aa98640 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa88c0ad040 con 0x7fa894036bb0 2024-09-13T19:17:20.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.327+0000 7fa89a297640 1 -- 172.21.15.102:0/2968622018 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa88c075030 con 0x7fa894036bb0 2024-09-13T19:17:20.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.327+0000 7fa89a297640 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa88c0ad040 con 0x560443adfe00 2024-09-13T19:17:20.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.327+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa89002b040 con 0x560443adfe00 2024-09-13T19:17:20.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.327+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa88c0ad040 con 0x7fa894036bb0 2024-09-13T19:17:20.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.327+0000 7fa89a297640 1 -- 172.21.15.102:0/2968622018 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa88c075030 con 0x7fa894036bb0 2024-09-13T19:17:20.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.327+0000 7fa89a297640 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa88c0ad040 con 0x560443ae47f0 2024-09-13T19:17:20.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.328+0000 7fa89aa98640 1 -- 172.21.15.102:0/2968622018 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa89403a030 con 0x560443ae47f0 2024-09-13T19:17:20.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.328+0000 7fa89aa98640 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa88c0ad040 con 0x7fa88c078070 2024-09-13T19:17:20.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.328+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa89002b040 con 0x7fa88c078070 2024-09-13T19:17:20.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.328+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa88c0ad040 con 0x7fa894036bb0 2024-09-13T19:17:20.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.328+0000 7fa89a297640 1 -- 172.21.15.102:0/2968622018 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa88c075030 con 0x7fa894036bb0 2024-09-13T19:17:20.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.328+0000 7fa89a297640 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa88c0ad040 con 0x560443ae47f0 2024-09-13T19:17:20.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.329+0000 7fa89aa98640 1 -- 172.21.15.102:0/2968622018 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa89403a030 con 0x560443ae47f0 2024-09-13T19:17:20.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.329+0000 7fa89aa98640 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa88c0ad040 con 0x7fa88c078070 2024-09-13T19:17:20.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.329+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa89002b040 con 0x7fa88c078070 2024-09-13T19:17:20.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.329+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa88c0ad040 con 0x560443adfe00 2024-09-13T19:17:20.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.329+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa89002b040 con 0x560443adfe00 2024-09-13T19:17:20.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.329+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fa88c0ad040 con 0x7fa894036bb0 2024-09-13T19:17:20.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.330+0000 7fa89a297640 1 -- 172.21.15.102:0/2968622018 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa88c075030 con 0x7fa894036bb0 2024-09-13T19:17:20.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.330+0000 7fa89e542800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:17:20.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.330+0000 7fa89e542800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:17:20.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.330+0000 7fa89e542800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:17:20.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.330+0000 7fa89e542800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:17:20.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.330+0000 7fa89e542800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:17:20.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.330+0000 7fa89e542800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:17:20.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.330+0000 7fa89e542800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.330+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560443ae7c90 con 0x560443adfe00 2024-09-13T19:17:20.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.330+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa89002b040 con 0x560443adfe00 2024-09-13T19:17:20.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.330+0000 7fa89e542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:20.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.330+0000 7fa89e542800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.330+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560443ae8530 con 0x560443adfe00 2024-09-13T19:17:20.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.330+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa89002b040 con 0x560443adfe00 2024-09-13T19:17:20.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.330+0000 7fa89e542800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:17:20.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.330+0000 7fa89e542800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.330+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560443ae90a0 con 0x560443ae47f0 2024-09-13T19:17:20.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.330+0000 7fa89aa98640 1 -- 172.21.15.102:0/2968622018 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa89403a030 con 0x560443ae47f0 2024-09-13T19:17:20.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.330+0000 7fa89e542800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:17:20.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.330+0000 7fa89e542800 20 zone default found 2024-09-13T19:17:20.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.330+0000 7fa89e542800 4 Realm: () 2024-09-13T19:17:20.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.330+0000 7fa89e542800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:17:20.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.330+0000 7fa89e542800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:17:20.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.330+0000 7fa89e542800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:17:20.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.330+0000 7fa89e542800 20 zonegroup default 2024-09-13T19:17:20.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.330+0000 7fa89e542800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.330+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560443ae94d0 con 0x7fa894036bb0 2024-09-13T19:17:20.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.331+0000 7fa89a297640 1 -- 172.21.15.102:0/2968622018 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa88c075030 con 0x7fa894036bb0 2024-09-13T19:17:20.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.331+0000 7fa89e542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:20.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.331+0000 7fa89e542800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.331+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560443aeb7a0 con 0x560443ae47f0 2024-09-13T19:17:20.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.331+0000 7fa89aa98640 1 -- 172.21.15.102:0/2968622018 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa89403a030 con 0x560443ae47f0 2024-09-13T19:17:20.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.331+0000 7fa89e542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:20.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.331+0000 7fa89e542800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.331+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560443aebb40 con 0x560443ae47f0 2024-09-13T19:17:20.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.331+0000 7fa89aa98640 1 -- 172.21.15.102:0/2968622018 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa89403a030 con 0x560443ae47f0 2024-09-13T19:17:20.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.331+0000 7fa89e542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:20.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.331+0000 7fa89e542800 20 started sync module instance, tier type = 2024-09-13T19:17:20.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.331+0000 7fa89e542800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:17:20.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.331+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560443aeabe0 con 0x7fa894036bb0 2024-09-13T19:17:20.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.332+0000 7fa89a297640 1 -- 172.21.15.102:0/2968622018 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(44 notify.0 [create] v36'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa88c075030 con 0x7fa894036bb0 2024-09-13T19:17:20.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.332+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94576315377456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560443aebf30 con 0x7fa894036bb0 2024-09-13T19:17:20.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.332+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560443aec780 con 0x560443adfe00 2024-09-13T19:17:20.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.333+0000 7fa89a297640 1 -- 172.21.15.102:0/2968622018 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94576315377456] v36'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa88c075030 con 0x7fa894036bb0 2024-09-13T19:17:20.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.334+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v36'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa89002b040 con 0x560443adfe00 2024-09-13T19:17:20.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.334+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94576315383600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560443aec350 con 0x560443adfe00 2024-09-13T19:17:20.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.334+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560443aed480 con 0x560443ae47f0 2024-09-13T19:17:20.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.335+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94576315383600] v36'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa89002b040 con 0x560443adfe00 2024-09-13T19:17:20.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.335+0000 7fa89aa98640 1 -- 172.21.15.102:0/2968622018 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v36'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa89403a030 con 0x560443ae47f0 2024-09-13T19:17:20.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.335+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94576315386656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560443aed3f0 con 0x560443ae47f0 2024-09-13T19:17:20.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.335+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560443aeddf0 con 0x7fa894036bb0 2024-09-13T19:17:20.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.337+0000 7fa89a297640 1 -- 172.21.15.102:0/2968622018 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(50 notify.3 [create] v36'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa88c075030 con 0x7fa894036bb0 2024-09-13T19:17:20.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.337+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94576315390208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560443aedda0 con 0x7fa894036bb0 2024-09-13T19:17:20.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.337+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560443aeedc0 con 0x560443adfe00 2024-09-13T19:17:20.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.337+0000 7fa89aa98640 1 -- 172.21.15.102:0/2968622018 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94576315386656] v36'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa89403a030 con 0x560443ae47f0 2024-09-13T19:17:20.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.338+0000 7fa89a297640 1 -- 172.21.15.102:0/2968622018 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94576315390208] v36'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa88c075030 con 0x7fa894036bb0 2024-09-13T19:17:20.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.338+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v36'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa89002b040 con 0x560443adfe00 2024-09-13T19:17:20.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.338+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94576315392480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560443aeed80 con 0x560443adfe00 2024-09-13T19:17:20.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.338+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560443aef660 con 0x7fa88c078070 2024-09-13T19:17:20.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.339+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94576315392480] v36'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa89002b040 con 0x560443adfe00 2024-09-13T19:17:20.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.339+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(54 notify.5 [create] v36'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa89002b040 con 0x7fa88c078070 2024-09-13T19:17:20.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.339+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94576315394224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560443aeed80 con 0x7fa88c078070 2024-09-13T19:17:20.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.339+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560443aefd40 con 0x7fa88c078070 2024-09-13T19:17:20.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.340+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94576315394224] v36'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa89002b040 con 0x7fa88c078070 2024-09-13T19:17:20.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.340+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(56 notify.6 [create] v36'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa89002b040 con 0x7fa88c078070 2024-09-13T19:17:20.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.341+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94576315398192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560443aefd00 con 0x7fa88c078070 2024-09-13T19:17:20.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.341+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560443af0750 con 0x7fa88c078070 2024-09-13T19:17:20.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.342+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(58 notify.7 [create] v36'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa89002b040 con 0x7fa88c078070 2024-09-13T19:17:20.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.342+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94576315398192] v36'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa89002b040 con 0x7fa88c078070 2024-09-13T19:17:20.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.342+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94576315400864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560443af0b70 con 0x7fa88c078070 2024-09-13T19:17:20.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.342+0000 7fa89e542800 20 add_watcher() i=0 2024-09-13T19:17:20.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.342+0000 7fa89e542800 20 add_watcher() i=1 2024-09-13T19:17:20.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.342+0000 7fa89e542800 20 add_watcher() i=2 2024-09-13T19:17:20.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.342+0000 7fa89e542800 20 add_watcher() i=3 2024-09-13T19:17:20.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.342+0000 7fa89e542800 20 add_watcher() i=4 2024-09-13T19:17:20.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.342+0000 7fa89e542800 20 add_watcher() i=5 2024-09-13T19:17:20.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.342+0000 7fa89e542800 20 add_watcher() i=6 2024-09-13T19:17:20.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.343+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94576315400864] v36'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa89002b040 con 0x7fa88c078070 2024-09-13T19:17:20.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.343+0000 7fa89e542800 20 add_watcher() i=7 2024-09-13T19:17:20.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.343+0000 7fa89e542800 2 all 8 watchers are set, enabling cache 2024-09-13T19:17:20.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.343+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560443af0b70 con 0x560443adfe00 2024-09-13T19:17:20.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.343+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa89002b040 con 0x560443adfe00 2024-09-13T19:17:20.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.343+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94576315401920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560443af1440 con 0x560443adfe00 2024-09-13T19:17:20.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.344+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94576315401920] v36'214 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa89002b040 con 0x560443adfe00 2024-09-13T19:17:20.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.345+0000 7fa750fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:17:20.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.345+0000 7fa89e542800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:17:20.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.345+0000 7fa89e542800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:17:20.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.345+0000 7fa89e542800 5 note: GC not initialized 2024-09-13T19:17:20.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.345+0000 7fa6cb7fe640 20 reqs_thread_entry: start 2024-09-13T19:17:20.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.345+0000 7fa89e542800 20 init_complete bucket index max shards: 11 2024-09-13T19:17:20.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.345+0000 7fa89e542800 20 Filter name: none 2024-09-13T19:17:20.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.345+0000 7fa6c97fa640 20 reqs_thread_entry: start 2024-09-13T19:17:20.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.345+0000 7fa89e542800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T19:17:20.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.345+0000 7fa89e542800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.345+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560443b27000 con 0x7fa88c078070 2024-09-13T19:17:20.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.346+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fa89002b040 con 0x7fa88c078070 2024-09-13T19:17:20.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.346+0000 7fa89e542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:20.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.346+0000 7fa89e542800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-13T19:17:20.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.346+0000 7fa89e542800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T19:17:20.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.346+0000 7fa89e542800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-13T19:17:20.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.346+0000 7fa89e542800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.346+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560443b25640 con 0x7fa88c078070 2024-09-13T19:17:20.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.346+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fa89002b040 con 0x7fa88c078070 2024-09-13T19:17:20.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.346+0000 7fa89e542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:20.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.346+0000 7fa89e542800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-13T19:17:20.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.346+0000 7fa89e542800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T19:17:20.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.346+0000 7fa89e542800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T19:17:20.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.346+0000 7fa89e542800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T19:17:20.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.346+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560443b25ee0 con 0x7fa88c078070 2024-09-13T19:17:20.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.348+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v36'5 uv5 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fa89002b040 con 0x7fa88c078070 2024-09-13T19:17:20.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.348+0000 7fa89e542800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-13T19:17:20.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.348+0000 7fa89e542800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T19:17:20.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.348+0000 7fa89e542800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-13T19:17:20.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.348+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94576315619888 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560443b2aaa0 con 0x7fa88c078070 2024-09-13T19:17:20.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.348+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== watch-notify(notify (1) cookie 94576315394224 notify 154618822685 ret 0) ==== 598+0+0 (crc 0 0 0) 0x560443b26280 con 0x7fa88c078070 2024-09-13T19:17:20.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.348+0000 7fa77dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822685 cookie 94576315394224 notifier 4748 bl.length()=556 2024-09-13T19:17:20.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.348+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(65 notify.5 [notify cookie 94576315619888 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa89002b040 con 0x7fa88c078070 2024-09-13T19:17:20.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.348+0000 7fa77dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-13T19:17:20.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.348+0000 7fa77dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T19:17:20.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.348+0000 7fa77dffb640 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fa760003ea0 con 0x7fa88c078070 2024-09-13T19:17:20.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.348+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa89002b040 con 0x7fa88c078070 2024-09-13T19:17:20.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.348+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 <== osd.0 v2:172.21.15.53:6800/4021716951 20 ==== watch-notify(notify_complete (2) cookie 94576315619888 notify 154618822685 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560443b26a50 con 0x7fa88c078070 2024-09-13T19:17:20.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.348+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560443b285d0 con 0x7fa88c078070 2024-09-13T19:17:20.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.349+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 <== osd.0 v2:172.21.15.53:6800/4021716951 21 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v36'11 uv11 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fa89002b040 con 0x7fa88c078070 2024-09-13T19:17:20.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.349+0000 7fa89e542800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T19:17:20.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.349+0000 7fa89e542800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T19:17:20.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.349+0000 7fa89e542800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T19:17:20.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.349+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94576315619776 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560443b2aaa0 con 0x560443ae47f0 2024-09-13T19:17:20.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.350+0000 7fa89aa98640 1 -- 172.21.15.102:0/2968622018 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== watch-notify(notify (1) cookie 94576315386656 notify 154618822662 ret 0) ==== 219+0+0 (crc 0 0 0) 0x560443ad4af0 con 0x560443ae47f0 2024-09-13T19:17:20.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.350+0000 7fa77dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822662 cookie 94576315386656 notifier 4748 bl.length()=177 2024-09-13T19:17:20.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.350+0000 7fa77dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T19:17:20.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.350+0000 7fa77dffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T19:17:20.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.350+0000 7fa89aa98640 1 -- 172.21.15.102:0/2968622018 <== osd.3 v2:172.21.15.102:6800/3096737090 17 ==== osd_op_reply(68 notify.2 [notify cookie 94576315619776 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa89403a030 con 0x560443ae47f0 2024-09-13T19:17:20.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.350+0000 7fa77dffb640 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fa760003ea0 con 0x560443ae47f0 2024-09-13T19:17:20.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.350+0000 7fa89aa98640 1 -- 172.21.15.102:0/2968622018 <== osd.3 v2:172.21.15.102:6800/3096737090 18 ==== watch-notify(notify_complete (2) cookie 94576315619776 notify 154618822662 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa894061020 con 0x560443ae47f0 2024-09-13T19:17:20.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.350+0000 7fa89aa98640 1 -- 172.21.15.102:0/2968622018 <== osd.3 v2:172.21.15.102:6800/3096737090 19 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa89403a030 con 0x560443ae47f0 2024-09-13T19:17:20.365 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-13T19:17:20.347805Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:17:20.347787Z","tags":[],"group_ids":[]} 2024-09-13T19:17:20.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.351+0000 7fa750fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:17:20.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.351+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94576315401920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560443b24cc0 con 0x560443adfe00 2024-09-13T19:17:20.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.352+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94576315401920] v36'215 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa89002b040 con 0x560443adfe00 2024-09-13T19:17:20.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.352+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94576315377456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560443b24cc0 con 0x7fa894036bb0 2024-09-13T19:17:20.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.353+0000 7fa89a297640 1 -- 172.21.15.102:0/2968622018 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94576315377456] v36'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa88c075030 con 0x7fa894036bb0 2024-09-13T19:17:20.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.353+0000 7fa89e542800 20 remove_watcher() i=0 2024-09-13T19:17:20.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.353+0000 7fa89e542800 2 removed watcher, disabling cache 2024-09-13T19:17:20.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.353+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94576315383600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560443b24cc0 con 0x560443adfe00 2024-09-13T19:17:20.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.354+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94576315383600] v36'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa89002b040 con 0x560443adfe00 2024-09-13T19:17:20.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.354+0000 7fa89e542800 20 remove_watcher() i=1 2024-09-13T19:17:20.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.354+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94576315386656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560443b24cc0 con 0x560443ae47f0 2024-09-13T19:17:20.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.356+0000 7fa89aa98640 1 -- 172.21.15.102:0/2968622018 <== osd.3 v2:172.21.15.102:6800/3096737090 20 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94576315386656] v36'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa89403a030 con 0x560443ae47f0 2024-09-13T19:17:20.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.356+0000 7fa89e542800 20 remove_watcher() i=2 2024-09-13T19:17:20.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.356+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94576315390208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560443b24cc0 con 0x7fa894036bb0 2024-09-13T19:17:20.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.357+0000 7fa89a297640 1 -- 172.21.15.102:0/2968622018 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94576315390208] v36'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa88c075030 con 0x7fa894036bb0 2024-09-13T19:17:20.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.357+0000 7fa89e542800 20 remove_watcher() i=3 2024-09-13T19:17:20.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.357+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94576315392480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560443b24cc0 con 0x560443adfe00 2024-09-13T19:17:20.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.358+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94576315392480] v36'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa89002b040 con 0x560443adfe00 2024-09-13T19:17:20.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.358+0000 7fa89e542800 20 remove_watcher() i=4 2024-09-13T19:17:20.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.358+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94576315394224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560443b24cc0 con 0x7fa88c078070 2024-09-13T19:17:20.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.359+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 <== osd.0 v2:172.21.15.53:6800/4021716951 22 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94576315394224] v36'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa89002b040 con 0x7fa88c078070 2024-09-13T19:17:20.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.359+0000 7fa89e542800 20 remove_watcher() i=5 2024-09-13T19:17:20.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.359+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94576315398192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560443b24cc0 con 0x7fa88c078070 2024-09-13T19:17:20.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.360+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 <== osd.0 v2:172.21.15.53:6800/4021716951 23 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94576315398192] v36'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa89002b040 con 0x7fa88c078070 2024-09-13T19:17:20.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.360+0000 7fa89e542800 20 remove_watcher() i=6 2024-09-13T19:17:20.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.360+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94576315400864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560443b24cc0 con 0x7fa88c078070 2024-09-13T19:17:20.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.361+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 <== osd.0 v2:172.21.15.53:6800/4021716951 24 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94576315400864] v36'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa89002b040 con 0x7fa88c078070 2024-09-13T19:17:20.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.361+0000 7fa89e542800 20 remove_watcher() i=7 2024-09-13T19:17:20.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.362+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fa88c078070 msgr2=0x7fa88c081ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.362+0000 7fa89e542800 1 --2- 172.21.15.102:0/2968622018 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fa88c078070 0x7fa88c081ab0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.362+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x560443adfe00 msgr2=0x560443ae22c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.362+0000 7fa89e542800 1 --2- 172.21.15.102:0/2968622018 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x560443adfe00 0x560443ae22c0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.362+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fa894036bb0 msgr2=0x7fa89404e540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.362+0000 7fa89e542800 1 --2- 172.21.15.102:0/2968622018 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fa894036bb0 0x7fa89404e540 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.362+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x560443ae47f0 msgr2=0x560443ae6be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.362+0000 7fa89e542800 1 --2- 172.21.15.102:0/2968622018 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x560443ae47f0 0x560443ae6be0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.362+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa764036b40 msgr2=0x7fa764039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.362+0000 7fa89e542800 1 --2- 172.21.15.102:0/2968622018 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa764036b40 0x7fa764039000 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa88c064e70 tx=0x7fa88c092000 comp rx=0 tx=0).stop 2024-09-13T19:17:20.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.362+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560443acce50 msgr2=0x560443ad4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.362+0000 7fa89e542800 1 --2- 172.21.15.102:0/2968622018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560443acce50 0x560443ad4320 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fa894021040 tx=0x7fa89404cd00 comp rx=0 tx=0).stop 2024-09-13T19:17:20.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.362+0000 7fa899a96640 1 -- 172.21.15.102:0/2968622018 reap_dead start 2024-09-13T19:17:20.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.362+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 shutdown_connections 2024-09-13T19:17:20.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.362+0000 7fa89e542800 1 --2- 172.21.15.102:0/2968622018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560443acce50 0x560443ad4320 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.362+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 >> 172.21.15.102:0/2968622018 conn(0x560443ac91b0 msgr2=0x560443ac7280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:20.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.362+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 shutdown_connections 2024-09-13T19:17:20.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.362+0000 7fa89e542800 1 -- 172.21.15.102:0/2968622018 wait complete. 2024-09-13T19:17:20.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.362+0000 7fa89e542800 1 -- 172.21.15.102:0/1124219488 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa774036b90 msgr2=0x7fa774039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.362+0000 7fa89e542800 1 --2- 172.21.15.102:0/1124219488 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa774036b90 0x7fa774039050 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x560443aa99c0 tx=0x7fa88c08f530 comp rx=0 tx=0).stop 2024-09-13T19:17:20.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.362+0000 7fa89e542800 1 -- 172.21.15.102:0/1124219488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560443ac01b0 msgr2=0x560443ac05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.362+0000 7fa89e542800 1 --2- 172.21.15.102:0/1124219488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560443ac01b0 0x560443ac05d0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x560443aace30 tx=0x7fa8940167b0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.362+0000 7fa89e542800 1 -- 172.21.15.102:0/1124219488 shutdown_connections 2024-09-13T19:17:20.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.362+0000 7fa89e542800 1 --2- 172.21.15.102:0/1124219488 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa774036b90 0x7fa774039050 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.362+0000 7fa89e542800 1 --2- 172.21.15.102:0/1124219488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560443ac01b0 0x560443ac05d0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.362+0000 7fa89e542800 1 -- 172.21.15.102:0/1124219488 >> 172.21.15.102:0/1124219488 conn(0x560443ab5140 msgr2=0x560443ab7cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:20.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.362+0000 7fa89e542800 1 -- 172.21.15.102:0/1124219488 shutdown_connections 2024-09-13T19:17:20.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.362+0000 7fa89e542800 1 -- 172.21.15.102:0/1124219488 wait complete. 2024-09-13T19:17:20.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.363+0000 7fa89e542800 1 -- 172.21.15.102:0/3705952778 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5604439af6c0 msgr2=0x560443aac4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.363+0000 7fa89e542800 1 --2- 172.21.15.102:0/3705952778 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5604439af6c0 0x560443aac4d0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.363+0000 7fa89e542800 1 -- 172.21.15.102:0/3705952778 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x560443aaed80 msgr2=0x560443ab1170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.363+0000 7fa89e542800 1 --2- 172.21.15.102:0/3705952778 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x560443aaed80 0x560443ab1170 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.363+0000 7fa89e542800 1 -- 172.21.15.102:0/3705952778 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa780036b40 msgr2=0x7fa780039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.363+0000 7fa89e542800 1 --2- 172.21.15.102:0/3705952778 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa780036b40 0x7fa780039000 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa890000f60 tx=0x7fa890001370 comp rx=0 tx=0).stop 2024-09-13T19:17:20.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.363+0000 7fa89e542800 1 -- 172.21.15.102:0/3705952778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56044391fed0 msgr2=0x560443aa5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.363+0000 7fa89e542800 1 --2- 172.21.15.102:0/3705952778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56044391fed0 0x560443aa5460 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fa88c067040 tx=0x7fa88c002fb0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.363+0000 7fa89e542800 1 -- 172.21.15.102:0/3705952778 shutdown_connections 2024-09-13T19:17:20.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.363+0000 7fa89e542800 1 --2- 172.21.15.102:0/3705952778 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x560443aaed80 0x560443ab1170 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.363+0000 7fa89e542800 1 --2- 172.21.15.102:0/3705952778 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5604439af6c0 0x560443aac4d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.363+0000 7fa89e542800 1 --2- 172.21.15.102:0/3705952778 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa780036b40 0x7fa780039000 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.363+0000 7fa89e542800 1 --2- 172.21.15.102:0/3705952778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56044391fed0 0x560443aa5460 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.363+0000 7fa89e542800 1 -- 172.21.15.102:0/3705952778 >> 172.21.15.102:0/3705952778 conn(0x5604439a6e30 msgr2=0x5604439ab5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:20.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.363+0000 7fa89e542800 1 -- 172.21.15.102:0/3705952778 shutdown_connections 2024-09-13T19:17:20.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.363+0000 7fa89e542800 1 -- 172.21.15.102:0/3705952778 wait complete. 2024-09-13T19:17:20.376 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-13T19:17:20.347805Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:17:20.347787Z', 'tags': [], 'group_ids': []} 2024-09-13T19:17:20.403 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:17:20.407 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2024-09-13T19:17:20.407 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-13T19:17:20.408 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-13T19:17:20.408 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2024-09-13T19:17:20.454 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:17:20.454 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:17:20.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.451+0000 7f286780f800 1 Processor -- start 2024-09-13T19:17:20.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.451+0000 7f286780f800 1 -- start start 2024-09-13T19:17:20.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.452+0000 7f286780f800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5605c917ceb0 0x5605c920c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.452+0000 7f286780f800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5605c90c8b30 con 0x5605c920c6a0 2024-09-13T19:17:20.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.452+0000 7f286780f800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5605c90aa360 con 0x5605c917ceb0 2024-09-13T19:17:20.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.452+0000 7f2862e67640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5605c917ceb0 0x5605c920c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.452+0000 7f2862e67640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5605c917ceb0 0x5605c920c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41514/0 (socket says 172.21.15.102:41514) 2024-09-13T19:17:20.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.452+0000 7f2862e67640 1 -- 172.21.15.102:0/1101416486 learned_addr learned my addr 172.21.15.102:0/1101416486 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:20.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.452+0000 7f2862e67640 1 -- 172.21.15.102:0/1101416486 >> v1:172.21.15.53:6789/0 conn(0x5605c920c6a0 legacy=0x5605c920eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.452+0000 7f2862e67640 1 -- 172.21.15.102:0/1101416486 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605c90d0e00 con 0x5605c917ceb0 2024-09-13T19:17:20.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.454+0000 7f2862e67640 1 --2- 172.21.15.102:0/1101416486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605c917ceb0 0x5605c920c160 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f285400a520 tx=0x7f2854045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0f11674e430cd73 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.454+0000 7f2862666640 1 -- 172.21.15.102:0/1101416486 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2854055070 con 0x5605c917ceb0 2024-09-13T19:17:20.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.454+0000 7f2862666640 1 -- 172.21.15.102:0/1101416486 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28540515b0 con 0x5605c917ceb0 2024-09-13T19:17:20.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.454+0000 7f2862666640 1 -- 172.21.15.102:0/1101416486 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28540518d0 con 0x5605c917ceb0 2024-09-13T19:17:20.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.455+0000 7f286780f800 1 -- 172.21.15.102:0/1101416486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605c917ceb0 msgr2=0x5605c920c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.455+0000 7f286780f800 1 --2- 172.21.15.102:0/1101416486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605c917ceb0 0x5605c920c160 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f285400a520 tx=0x7f2854045ba0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.455+0000 7f286780f800 1 -- 172.21.15.102:0/1101416486 shutdown_connections 2024-09-13T19:17:20.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.455+0000 7f286780f800 1 --2- 172.21.15.102:0/1101416486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605c917ceb0 0x5605c920c160 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.455+0000 7f286780f800 1 -- 172.21.15.102:0/1101416486 >> 172.21.15.102:0/1101416486 conn(0x5605c9203dd0 msgr2=0x5605c92061f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:20.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.455+0000 7f286780f800 1 -- 172.21.15.102:0/1101416486 shutdown_connections 2024-09-13T19:17:20.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.455+0000 7f286780f800 1 -- 172.21.15.102:0/1101416486 wait complete. 2024-09-13T19:17:20.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.469+0000 7f286780f800 1 Processor -- start 2024-09-13T19:17:20.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.469+0000 7f286780f800 1 -- start start 2024-09-13T19:17:20.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.469+0000 7f286780f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605c917ceb0 0x5605c92f88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.469+0000 7f286780f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5605c9155360 con 0x5605c917ceb0 2024-09-13T19:17:20.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.469+0000 7f2862e67640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605c917ceb0 0x5605c92f88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.469+0000 7f2862e67640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605c917ceb0 0x5605c92f88b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41518/0 (socket says 172.21.15.102:41518) 2024-09-13T19:17:20.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.469+0000 7f2862e67640 1 -- 172.21.15.102:0/2044580779 learned_addr learned my addr 172.21.15.102:0/2044580779 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:20.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.470+0000 7f2862e67640 1 -- 172.21.15.102:0/2044580779 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605c90a2bc0 con 0x5605c917ceb0 2024-09-13T19:17:20.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.470+0000 7f2862e67640 1 --2- 172.21.15.102:0/2044580779 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605c917ceb0 0x5605c92f88b0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f2854025da0 tx=0x7f2854051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b0aff0811b0865b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.470+0000 7f2750e09640 1 -- 172.21.15.102:0/2044580779 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2854051950 con 0x5605c917ceb0 2024-09-13T19:17:20.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.470+0000 7f2750e09640 1 -- 172.21.15.102:0/2044580779 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2854051af0 con 0x5605c917ceb0 2024-09-13T19:17:20.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.470+0000 7f2750e09640 1 -- 172.21.15.102:0/2044580779 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2854051dd0 con 0x5605c917ceb0 2024-09-13T19:17:20.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.471+0000 7f286780f800 1 -- 172.21.15.102:0/2044580779 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605c917ceb0 msgr2=0x5605c92f88b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.471+0000 7f286780f800 1 --2- 172.21.15.102:0/2044580779 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605c917ceb0 0x5605c92f88b0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f2854025da0 tx=0x7f2854051000 comp rx=0 tx=0).stop 2024-09-13T19:17:20.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.471+0000 7f286780f800 1 -- 172.21.15.102:0/2044580779 shutdown_connections 2024-09-13T19:17:20.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.471+0000 7f286780f800 1 --2- 172.21.15.102:0/2044580779 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605c917ceb0 0x5605c92f88b0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.471+0000 7f286780f800 1 -- 172.21.15.102:0/2044580779 >> 172.21.15.102:0/2044580779 conn(0x5605c9203dd0 msgr2=0x5605c92f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:20.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.471+0000 7f286780f800 1 -- 172.21.15.102:0/2044580779 shutdown_connections 2024-09-13T19:17:20.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.471+0000 7f286780f800 1 -- 172.21.15.102:0/2044580779 wait complete. 2024-09-13T19:17:20.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.471+0000 7f286780f800 1 Processor -- start 2024-09-13T19:17:20.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.471+0000 7f286780f800 1 -- start start 2024-09-13T19:17:20.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.471+0000 7f286780f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605c917ceb0 0x5605c93000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.471+0000 7f286780f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5605c9210610 con 0x5605c917ceb0 2024-09-13T19:17:20.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.472+0000 7f2862e67640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605c917ceb0 0x5605c93000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.472+0000 7f2862e67640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605c917ceb0 0x5605c93000f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41528/0 (socket says 172.21.15.102:41528) 2024-09-13T19:17:20.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.472+0000 7f2862e67640 1 -- 172.21.15.102:0/3728965980 learned_addr learned my addr 172.21.15.102:0/3728965980 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:20.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.472+0000 7f2862e67640 1 -- 172.21.15.102:0/3728965980 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605c90b6fe0 con 0x5605c917ceb0 2024-09-13T19:17:20.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.472+0000 7f2862e67640 1 --2- 172.21.15.102:0/3728965980 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605c917ceb0 0x5605c93000f0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f2854067040 tx=0x7f2854002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.472+0000 7f274f606640 1 -- 172.21.15.102:0/3728965980 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2854073070 con 0x5605c917ceb0 2024-09-13T19:17:20.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.472+0000 7f274f606640 1 -- 172.21.15.102:0/3728965980 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f285405a450 con 0x5605c917ceb0 2024-09-13T19:17:20.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.472+0000 7f274f606640 1 -- 172.21.15.102:0/3728965980 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f285405a730 con 0x5605c917ceb0 2024-09-13T19:17:20.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.472+0000 7f286780f800 1 -- 172.21.15.102:0/3728965980 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5605c9300630 con 0x5605c917ceb0 2024-09-13T19:17:20.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.472+0000 7f286780f800 1 -- 172.21.15.102:0/3728965980 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605c9300bb0 con 0x5605c917ceb0 2024-09-13T19:17:20.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.473+0000 7f274f606640 1 -- 172.21.15.102:0/3728965980 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2854076070 con 0x5605c917ceb0 2024-09-13T19:17:20.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.473+0000 7f274f606640 1 --2- 172.21.15.102:0/3728965980 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2748036b90 0x7f2748039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.473+0000 7f274f606640 1 -- 172.21.15.102:0/3728965980 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f2854062070 con 0x5605c917ceb0 2024-09-13T19:17:20.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.473+0000 7f285a666640 1 --2- 172.21.15.102:0/3728965980 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2748036b90 0x7f2748039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.474+0000 7f286780f800 1 --2- 172.21.15.102:0/3728965980 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5605c920c6a0 0x5605c9307160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.474+0000 7f286780f800 1 -- 172.21.15.102:0/3728965980 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c93076e0 con 0x5605c920c6a0 2024-09-13T19:17:20.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.474+0000 7f2863668640 1 --2- 172.21.15.102:0/3728965980 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5605c920c6a0 0x5605c9307160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.474+0000 7f285a666640 1 --2- 172.21.15.102:0/3728965980 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2748036b90 0x7f2748039050 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x5605c917c850 tx=0x7f284c001390 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.474+0000 7f2863668640 1 --2- 172.21.15.102:0/3728965980 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5605c920c6a0 0x5605c9307160 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.474+0000 7f2863668640 1 -- 172.21.15.102:0/3728965980 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f285c00a4a0 con 0x5605c920c6a0 2024-09-13T19:17:20.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.474+0000 7f286780f800 1 -- 172.21.15.102:0/3728965980 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c9307fa0 con 0x5605c920c6a0 2024-09-13T19:17:20.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.474+0000 7f2863668640 1 -- 172.21.15.102:0/3728965980 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f285c00a4a0 con 0x5605c920c6a0 2024-09-13T19:17:20.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.474+0000 7f286780f800 1 --2- 172.21.15.102:0/3728965980 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5605c93098b0 0x5605c930bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.474+0000 7f286780f800 1 -- 172.21.15.102:0/3728965980 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c930c4d0 con 0x5605c93098b0 2024-09-13T19:17:20.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.475+0000 7f2862e67640 1 --2- 172.21.15.102:0/3728965980 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5605c93098b0 0x5605c930bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.475+0000 7f2862e67640 1 --2- 172.21.15.102:0/3728965980 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5605c93098b0 0x5605c930bd40 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.475+0000 7f2862e67640 1 -- 172.21.15.102:0/3728965980 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f285407f070 con 0x5605c93098b0 2024-09-13T19:17:20.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.475+0000 7f286780f800 1 -- 172.21.15.102:0/3728965980 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c93087f0 con 0x5605c920c6a0 2024-09-13T19:17:20.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.475+0000 7f2863668640 1 -- 172.21.15.102:0/3728965980 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f285c00a4a0 con 0x5605c920c6a0 2024-09-13T19:17:20.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.475+0000 7f286780f800 1 -- 172.21.15.102:0/3728965980 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c9308bd0 con 0x5605c93098b0 2024-09-13T19:17:20.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.476+0000 7f2862e67640 1 -- 172.21.15.102:0/3728965980 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f285407f070 con 0x5605c93098b0 2024-09-13T19:17:20.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.476+0000 7f286780f800 1 Processor -- start 2024-09-13T19:17:20.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.476+0000 7f286780f800 1 -- start start 2024-09-13T19:17:20.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.476+0000 7f286780f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605c931aeb0 0x5605c931b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.476+0000 7f286780f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5605c90a4580 con 0x5605c931aeb0 2024-09-13T19:17:20.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.477+0000 7f2863668640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605c931aeb0 0x5605c931b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.477+0000 7f2863668640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605c931aeb0 0x5605c931b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41536/0 (socket says 172.21.15.102:41536) 2024-09-13T19:17:20.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.477+0000 7f2863668640 1 -- 172.21.15.102:0/3088377837 learned_addr learned my addr 172.21.15.102:0/3088377837 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:20.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.477+0000 7f2863668640 1 -- 172.21.15.102:0/3088377837 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605c931b810 con 0x5605c931aeb0 2024-09-13T19:17:20.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.477+0000 7f2863668640 1 --2- 172.21.15.102:0/3088377837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605c931aeb0 0x5605c931b2d0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x5605c93011a0 tx=0x7f285c0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.477+0000 7f274ce01640 1 -- 172.21.15.102:0/3088377837 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f285c013640 con 0x5605c931aeb0 2024-09-13T19:17:20.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.477+0000 7f274ce01640 1 -- 172.21.15.102:0/3088377837 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f285c0137e0 con 0x5605c931aeb0 2024-09-13T19:17:20.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.477+0000 7f286780f800 1 -- 172.21.15.102:0/3088377837 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5605c931baa0 con 0x5605c931aeb0 2024-09-13T19:17:20.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.477+0000 7f274ce01640 1 -- 172.21.15.102:0/3088377837 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f285c013ae0 con 0x5605c931aeb0 2024-09-13T19:17:20.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.477+0000 7f286780f800 1 -- 172.21.15.102:0/3088377837 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605c931e780 con 0x5605c931aeb0 2024-09-13T19:17:20.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.478+0000 7f274ce01640 1 -- 172.21.15.102:0/3088377837 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f285c011040 con 0x5605c931aeb0 2024-09-13T19:17:20.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.478+0000 7f274ce01640 1 --2- 172.21.15.102:0/3088377837 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f273c036b40 0x7f273c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.478+0000 7f274ce01640 1 -- 172.21.15.102:0/3088377837 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f285c00e040 con 0x5605c931aeb0 2024-09-13T19:17:20.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.478+0000 7f2862e67640 1 --2- 172.21.15.102:0/3088377837 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f273c036b40 0x7f273c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.479+0000 7f286780f800 1 Processor -- start 2024-09-13T19:17:20.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.479+0000 7f286780f800 1 -- start start 2024-09-13T19:17:20.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.479+0000 7f2862e67640 1 --2- 172.21.15.102:0/3088377837 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f273c036b40 0x7f273c039000 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x5605c9304650 tx=0x7f285406ff00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.479+0000 7f286780f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605c9327bf0 0x5605c9327ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.479+0000 7f286780f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5605c92f8fa0 con 0x5605c9327bf0 2024-09-13T19:17:20.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.479+0000 7f2863668640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605c9327bf0 0x5605c9327ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.479+0000 7f2863668640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605c9327bf0 0x5605c9327ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41542/0 (socket says 172.21.15.102:41542) 2024-09-13T19:17:20.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.479+0000 7f2863668640 1 -- 172.21.15.102:0/88739944 learned_addr learned my addr 172.21.15.102:0/88739944 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:20.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.479+0000 7f2863668640 1 -- 172.21.15.102:0/88739944 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605c9328530 con 0x5605c9327bf0 2024-09-13T19:17:20.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.480+0000 7f2863668640 1 --2- 172.21.15.102:0/88739944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605c9327bf0 0x5605c9327ff0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f285c04ce40 tx=0x7f285c01fed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8df1d71fc8ffec65 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.480+0000 7f27467fc640 1 -- 172.21.15.102:0/88739944 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f285c021960 con 0x5605c9327bf0 2024-09-13T19:17:20.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.480+0000 7f27467fc640 1 -- 172.21.15.102:0/88739944 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f285c04a030 con 0x5605c9327bf0 2024-09-13T19:17:20.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.480+0000 7f27467fc640 1 -- 172.21.15.102:0/88739944 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f285c021440 con 0x5605c9327bf0 2024-09-13T19:17:20.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.480+0000 7f286780f800 1 -- 172.21.15.102:0/88739944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605c9327bf0 msgr2=0x5605c9327ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.480+0000 7f286780f800 1 --2- 172.21.15.102:0/88739944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605c9327bf0 0x5605c9327ff0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f285c04ce40 tx=0x7f285c01fed0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.480+0000 7f286780f800 1 -- 172.21.15.102:0/88739944 shutdown_connections 2024-09-13T19:17:20.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.480+0000 7f286780f800 1 --2- 172.21.15.102:0/88739944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605c9327bf0 0x5605c9327ff0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.480+0000 7f286780f800 1 -- 172.21.15.102:0/88739944 >> 172.21.15.102:0/88739944 conn(0x5605c9323fa0 msgr2=0x5605c93220a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:20.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.480+0000 7f286780f800 1 -- 172.21.15.102:0/88739944 shutdown_connections 2024-09-13T19:17:20.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.480+0000 7f286780f800 1 -- 172.21.15.102:0/88739944 wait complete. 2024-09-13T19:17:20.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.481+0000 7f286780f800 1 Processor -- start 2024-09-13T19:17:20.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.481+0000 7f286780f800 1 -- start start 2024-09-13T19:17:20.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.481+0000 7f286780f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605c9327bf0 0x5605c9209a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.481+0000 7f286780f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5605c9328bd0 con 0x5605c9327bf0 2024-09-13T19:17:20.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.481+0000 7f2863668640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605c9327bf0 0x5605c9209a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.481+0000 7f2863668640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605c9327bf0 0x5605c9209a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41550/0 (socket says 172.21.15.102:41550) 2024-09-13T19:17:20.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.481+0000 7f2863668640 1 -- 172.21.15.102:0/1001755092 learned_addr learned my addr 172.21.15.102:0/1001755092 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:20.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.481+0000 7f2863668640 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605c9208180 con 0x5605c9327bf0 2024-09-13T19:17:20.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.482+0000 7f2863668640 1 --2- 172.21.15.102:0/1001755092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605c9327bf0 0x5605c9209a90 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f285c01ff70 tx=0x7f285c04cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.482+0000 7f2744ff9640 1 -- 172.21.15.102:0/1001755092 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f285c039070 con 0x5605c9327bf0 2024-09-13T19:17:20.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.482+0000 7f2744ff9640 1 -- 172.21.15.102:0/1001755092 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f285c021a90 con 0x5605c9327bf0 2024-09-13T19:17:20.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.482+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5605c9208410 con 0x5605c9327bf0 2024-09-13T19:17:20.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.482+0000 7f2744ff9640 1 -- 172.21.15.102:0/1001755092 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f285c0215b0 con 0x5605c9327bf0 2024-09-13T19:17:20.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.482+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605c92088b0 con 0x5605c9327bf0 2024-09-13T19:17:20.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.483+0000 7f2744ff9640 1 -- 172.21.15.102:0/1001755092 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f285c0400e0 con 0x5605c9327bf0 2024-09-13T19:17:20.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.483+0000 7f2744ff9640 1 --2- 172.21.15.102:0/1001755092 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f272c036af0 0x7f272c038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.483+0000 7f2744ff9640 1 -- 172.21.15.102:0/1001755092 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f285c031070 con 0x5605c9327bf0 2024-09-13T19:17:20.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.483+0000 7f2862e67640 1 --2- 172.21.15.102:0/1001755092 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f272c036af0 0x7f272c038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.484+0000 7f286780f800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.484+0000 7f2862e67640 1 --2- 172.21.15.102:0/1001755092 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f272c036af0 0x7f272c038fb0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f285405ab30 tx=0x7f2854089000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.484+0000 7f286780f800 1 --2- 172.21.15.102:0/1001755092 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5605c933cd30 0x5605c933f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.484+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c933f940 con 0x5605c933cd30 2024-09-13T19:17:20.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.484+0000 7f285a666640 1 --2- 172.21.15.102:0/1001755092 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5605c933cd30 0x5605c933f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.484+0000 7f285a666640 1 --2- 172.21.15.102:0/1001755092 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5605c933cd30 0x5605c933f1f0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.484+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f284c00bdb0 con 0x5605c933cd30 2024-09-13T19:17:20.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.484+0000 7f286780f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:20.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.484+0000 7f286780f800 20 realm 2024-09-13T19:17:20.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.484+0000 7f286780f800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.484+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c933c1a0 con 0x5605c933cd30 2024-09-13T19:17:20.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.484+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f284c00bdb0 con 0x5605c933cd30 2024-09-13T19:17:20.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.484+0000 7f286780f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:20.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.484+0000 7f286780f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:17:20.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.484+0000 7f286780f800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.484+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c9340430 con 0x5605c933cd30 2024-09-13T19:17:20.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.485+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f284c00bdb0 con 0x5605c933cd30 2024-09-13T19:17:20.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.485+0000 7f286780f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:20.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.485+0000 7f286780f800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.485+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c9340d00 con 0x5605c933cd30 2024-09-13T19:17:20.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.485+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f284c00bdb0 con 0x5605c933cd30 2024-09-13T19:17:20.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.485+0000 7f286780f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:17:20.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.485+0000 7f286780f800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.485+0000 7f286780f800 1 --2- 172.21.15.102:0/1001755092 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5605c9341720 0x5605c9343b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.485+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c9344200 con 0x5605c9341720 2024-09-13T19:17:20.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.485+0000 7f2863668640 1 --2- 172.21.15.102:0/1001755092 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5605c9341720 0x5605c9343b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.485+0000 7f2863668640 1 --2- 172.21.15.102:0/1001755092 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5605c9341720 0x5605c9343b10 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.486+0000 7f2863668640 1 -- 172.21.15.102:0/1001755092 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f285c03b030 con 0x5605c9341720 2024-09-13T19:17:20.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.486+0000 7f286780f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:17:20.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.486+0000 7f286780f800 20 searching for the correct realm 2024-09-13T19:17:20.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.486+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c9345b50 con 0x5605c9341720 2024-09-13T19:17:20.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.486+0000 7f2863668640 1 -- 172.21.15.102:0/1001755092 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f285c03b030 con 0x5605c9341720 2024-09-13T19:17:20.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.486+0000 7f2863668640 1 --2- 172.21.15.102:0/1001755092 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f285c058040 0x7f285c03b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.486+0000 7f2863668640 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c9345b50 con 0x7f285c058040 2024-09-13T19:17:20.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.486+0000 7f2862e67640 1 --2- 172.21.15.102:0/1001755092 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f285c058040 0x7f285c03b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.486+0000 7f2862e67640 1 --2- 172.21.15.102:0/1001755092 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f285c058040 0x7f285c03b720 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.486+0000 7f2862e67640 1 -- 172.21.15.102:0/1001755092 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f285407f070 con 0x7f285c058040 2024-09-13T19:17:20.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.487+0000 7f2862e67640 1 --2- 172.21.15.102:0/1001755092 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f2854078070 0x7f2854078450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.487+0000 7f2862e67640 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c9345b50 con 0x7f2854078070 2024-09-13T19:17:20.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.487+0000 7f285a666640 1 --2- 172.21.15.102:0/1001755092 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f2854078070 0x7f2854078450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.487+0000 7f285a666640 1 --2- 172.21.15.102:0/1001755092 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f2854078070 0x7f2854078450 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.487+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284c00bdb0 con 0x7f2854078070 2024-09-13T19:17:20.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.487+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c9345b50 con 0x5605c933cd30 2024-09-13T19:17:20.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.488+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284c00bdb0 con 0x5605c933cd30 2024-09-13T19:17:20.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.488+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c9345b50 con 0x5605c933cd30 2024-09-13T19:17:20.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.488+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284c02a040 con 0x5605c933cd30 2024-09-13T19:17:20.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.488+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c9345b50 con 0x7f2854078070 2024-09-13T19:17:20.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.488+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284c02a040 con 0x7f2854078070 2024-09-13T19:17:20.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.488+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c9345b50 con 0x7f2854078070 2024-09-13T19:17:20.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.488+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284c02a040 con 0x7f2854078070 2024-09-13T19:17:20.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.488+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c9345b50 con 0x7f285c058040 2024-09-13T19:17:20.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.489+0000 7f2862e67640 1 -- 172.21.15.102:0/1001755092 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f285407f070 con 0x7f285c058040 2024-09-13T19:17:20.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.489+0000 7f2862e67640 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c9345b50 con 0x5605c9341720 2024-09-13T19:17:20.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.489+0000 7f2863668640 1 -- 172.21.15.102:0/1001755092 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f285c03b030 con 0x5605c9341720 2024-09-13T19:17:20.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.489+0000 7f2863668640 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c9345b50 con 0x5605c933cd30 2024-09-13T19:17:20.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.489+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284c02a040 con 0x5605c933cd30 2024-09-13T19:17:20.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.489+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c9345b50 con 0x7f285c058040 2024-09-13T19:17:20.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.489+0000 7f2862e67640 1 -- 172.21.15.102:0/1001755092 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f285407f070 con 0x7f285c058040 2024-09-13T19:17:20.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.489+0000 7f2862e67640 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c9345b50 con 0x5605c933cd30 2024-09-13T19:17:20.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.490+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284c02a040 con 0x5605c933cd30 2024-09-13T19:17:20.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.490+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c9345b50 con 0x7f285c058040 2024-09-13T19:17:20.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.490+0000 7f2862e67640 1 -- 172.21.15.102:0/1001755092 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f285407f070 con 0x7f285c058040 2024-09-13T19:17:20.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.490+0000 7f2862e67640 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c9345b50 con 0x5605c9341720 2024-09-13T19:17:20.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.490+0000 7f2863668640 1 -- 172.21.15.102:0/1001755092 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f285c03b030 con 0x5605c9341720 2024-09-13T19:17:20.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.490+0000 7f2863668640 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c9345b50 con 0x5605c9341720 2024-09-13T19:17:20.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.490+0000 7f2863668640 1 -- 172.21.15.102:0/1001755092 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f285c03b030 con 0x5605c9341720 2024-09-13T19:17:20.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.490+0000 7f2863668640 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c9345b50 con 0x7f2854078070 2024-09-13T19:17:20.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.491+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284c02a040 con 0x7f2854078070 2024-09-13T19:17:20.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.491+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c9345b50 con 0x5605c9341720 2024-09-13T19:17:20.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.491+0000 7f2863668640 1 -- 172.21.15.102:0/1001755092 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f285c03b030 con 0x5605c9341720 2024-09-13T19:17:20.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.491+0000 7f2863668640 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c9345b50 con 0x5605c9341720 2024-09-13T19:17:20.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.491+0000 7f2863668640 1 -- 172.21.15.102:0/1001755092 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f285c03b030 con 0x5605c9341720 2024-09-13T19:17:20.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.491+0000 7f2863668640 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c9345b50 con 0x5605c933cd30 2024-09-13T19:17:20.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.491+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284c02a040 con 0x5605c933cd30 2024-09-13T19:17:20.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.491+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c9345b50 con 0x5605c933cd30 2024-09-13T19:17:20.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.492+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f284c02a040 con 0x5605c933cd30 2024-09-13T19:17:20.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.492+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c9345b50 con 0x7f2854078070 2024-09-13T19:17:20.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.492+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284c02a040 con 0x7f2854078070 2024-09-13T19:17:20.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.492+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c9345b50 con 0x5605c9341720 2024-09-13T19:17:20.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.492+0000 7f2863668640 1 -- 172.21.15.102:0/1001755092 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f285c03b030 con 0x5605c9341720 2024-09-13T19:17:20.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.492+0000 7f2863668640 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c9345b50 con 0x7f285c058040 2024-09-13T19:17:20.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.492+0000 7f2862e67640 1 -- 172.21.15.102:0/1001755092 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f285407f070 con 0x7f285c058040 2024-09-13T19:17:20.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.492+0000 7f2862e67640 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c9345b50 con 0x5605c933cd30 2024-09-13T19:17:20.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.493+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284c02a040 con 0x5605c933cd30 2024-09-13T19:17:20.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.493+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c9345b50 con 0x7f285c058040 2024-09-13T19:17:20.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.493+0000 7f2862e67640 1 -- 172.21.15.102:0/1001755092 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f285407f070 con 0x7f285c058040 2024-09-13T19:17:20.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.493+0000 7f2862e67640 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c9345b50 con 0x5605c9341720 2024-09-13T19:17:20.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.493+0000 7f2863668640 1 -- 172.21.15.102:0/1001755092 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f285c03b030 con 0x5605c9341720 2024-09-13T19:17:20.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.493+0000 7f2863668640 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c9345b50 con 0x7f2854078070 2024-09-13T19:17:20.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.493+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284c02a040 con 0x7f2854078070 2024-09-13T19:17:20.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.493+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c9345b50 con 0x7f285c058040 2024-09-13T19:17:20.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.494+0000 7f2862e67640 1 -- 172.21.15.102:0/1001755092 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f285407f070 con 0x7f285c058040 2024-09-13T19:17:20.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.494+0000 7f2862e67640 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c9345b50 con 0x5605c9341720 2024-09-13T19:17:20.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.494+0000 7f2863668640 1 -- 172.21.15.102:0/1001755092 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f285c03b030 con 0x5605c9341720 2024-09-13T19:17:20.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.494+0000 7f2863668640 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c9345b50 con 0x7f2854078070 2024-09-13T19:17:20.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.494+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284c02a040 con 0x7f2854078070 2024-09-13T19:17:20.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.494+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c9345b50 con 0x5605c933cd30 2024-09-13T19:17:20.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.495+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f284c02a040 con 0x5605c933cd30 2024-09-13T19:17:20.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.495+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5605c9345b50 con 0x7f285c058040 2024-09-13T19:17:20.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.495+0000 7f2862e67640 1 -- 172.21.15.102:0/1001755092 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f285407f070 con 0x7f285c058040 2024-09-13T19:17:20.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.495+0000 7f286780f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:17:20.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.495+0000 7f286780f800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:17:20.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.495+0000 7f286780f800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:17:20.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.495+0000 7f286780f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:17:20.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.495+0000 7f286780f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:17:20.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.495+0000 7f286780f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:17:20.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.495+0000 7f286780f800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.495+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c9344bc0 con 0x5605c933cd30 2024-09-13T19:17:20.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.495+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f284c02a040 con 0x5605c933cd30 2024-09-13T19:17:20.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.495+0000 7f286780f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:20.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.495+0000 7f286780f800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.495+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c9345460 con 0x5605c933cd30 2024-09-13T19:17:20.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.495+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f284c02a040 con 0x5605c933cd30 2024-09-13T19:17:20.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.495+0000 7f286780f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:17:20.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.495+0000 7f286780f800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.495+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c9345fd0 con 0x5605c9341720 2024-09-13T19:17:20.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.496+0000 7f2863668640 1 -- 172.21.15.102:0/1001755092 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f285c03b030 con 0x5605c9341720 2024-09-13T19:17:20.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.496+0000 7f286780f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:17:20.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.496+0000 7f286780f800 20 zone default found 2024-09-13T19:17:20.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.496+0000 7f286780f800 4 Realm: () 2024-09-13T19:17:20.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.496+0000 7f286780f800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:17:20.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.496+0000 7f286780f800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:17:20.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.496+0000 7f286780f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:17:20.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.496+0000 7f286780f800 20 zonegroup default 2024-09-13T19:17:20.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.496+0000 7f286780f800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.496+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c9346820 con 0x7f285c058040 2024-09-13T19:17:20.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.496+0000 7f2862e67640 1 -- 172.21.15.102:0/1001755092 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f285407f070 con 0x7f285c058040 2024-09-13T19:17:20.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.496+0000 7f286780f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:20.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.496+0000 7f286780f800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.496+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c93485a0 con 0x5605c9341720 2024-09-13T19:17:20.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.496+0000 7f2863668640 1 -- 172.21.15.102:0/1001755092 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f285c03b030 con 0x5605c9341720 2024-09-13T19:17:20.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.496+0000 7f286780f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:20.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.496+0000 7f286780f800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.496+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c93489d0 con 0x5605c9341720 2024-09-13T19:17:20.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.496+0000 7f2863668640 1 -- 172.21.15.102:0/1001755092 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f285c03b030 con 0x5605c9341720 2024-09-13T19:17:20.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.496+0000 7f286780f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:20.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.496+0000 7f286780f800 20 started sync module instance, tier type = 2024-09-13T19:17:20.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.496+0000 7f286780f800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:17:20.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.496+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c9347a40 con 0x7f285c058040 2024-09-13T19:17:20.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.497+0000 7f2862e67640 1 -- 172.21.15.102:0/1001755092 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(44 notify.0 [create] v36'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f285407f070 con 0x7f285c058040 2024-09-13T19:17:20.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.497+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94582850483600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c9348e30 con 0x7f285c058040 2024-09-13T19:17:20.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.497+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c9349680 con 0x5605c933cd30 2024-09-13T19:17:20.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.498+0000 7f2862e67640 1 -- 172.21.15.102:0/1001755092 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94582850483600] v36'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f285407f070 con 0x7f285c058040 2024-09-13T19:17:20.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.499+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v36'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f284c02a040 con 0x5605c933cd30 2024-09-13T19:17:20.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.499+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94582850490864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c9347f10 con 0x5605c933cd30 2024-09-13T19:17:20.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.499+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c934a600 con 0x5605c9341720 2024-09-13T19:17:20.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.500+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94582850490864] v36'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f284c02a040 con 0x5605c933cd30 2024-09-13T19:17:20.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.500+0000 7f2863668640 1 -- 172.21.15.102:0/1001755092 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v36'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f285c03b030 con 0x5605c9341720 2024-09-13T19:17:20.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.500+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94582850494704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c934a5c0 con 0x5605c9341720 2024-09-13T19:17:20.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.500+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c934b0b0 con 0x7f285c058040 2024-09-13T19:17:20.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.501+0000 7f2863668640 1 -- 172.21.15.102:0/1001755092 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94582850494704] v36'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f285c03b030 con 0x5605c9341720 2024-09-13T19:17:20.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.501+0000 7f2862e67640 1 -- 172.21.15.102:0/1001755092 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(50 notify.3 [create] v36'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f285407f070 con 0x7f285c058040 2024-09-13T19:17:20.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.501+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94582850492960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c934b4a0 con 0x7f285c058040 2024-09-13T19:17:20.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.501+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c934bf10 con 0x5605c933cd30 2024-09-13T19:17:20.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.502+0000 7f2862e67640 1 -- 172.21.15.102:0/1001755092 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94582850492960] v36'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f285407f070 con 0x7f285c058040 2024-09-13T19:17:20.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.502+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v36'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f284c02a040 con 0x5605c933cd30 2024-09-13T19:17:20.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.502+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94582850501088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c934bed0 con 0x5605c933cd30 2024-09-13T19:17:20.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.502+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c934c9c0 con 0x7f2854078070 2024-09-13T19:17:20.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.503+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94582850501088] v36'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f284c02a040 con 0x5605c933cd30 2024-09-13T19:17:20.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.503+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(54 notify.5 [create] v36'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f284c02a040 con 0x7f2854078070 2024-09-13T19:17:20.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.503+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94582850497424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c934c9c0 con 0x7f2854078070 2024-09-13T19:17:20.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.503+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c934d410 con 0x7f2854078070 2024-09-13T19:17:20.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.504+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94582850497424] v36'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f284c02a040 con 0x7f2854078070 2024-09-13T19:17:20.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.505+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(56 notify.6 [create] v36'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f284c02a040 con 0x7f2854078070 2024-09-13T19:17:20.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.505+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94582850503840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c934d3d0 con 0x7f2854078070 2024-09-13T19:17:20.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.505+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c934ddf0 con 0x7f2854078070 2024-09-13T19:17:20.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.506+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94582850503840] v36'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f284c02a040 con 0x7f2854078070 2024-09-13T19:17:20.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.506+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(58 notify.7 [create] v36'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f284c02a040 con 0x7f2854078070 2024-09-13T19:17:20.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.506+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94582850506528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c934d340 con 0x7f2854078070 2024-09-13T19:17:20.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.506+0000 7f286780f800 20 add_watcher() i=0 2024-09-13T19:17:20.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.506+0000 7f286780f800 20 add_watcher() i=1 2024-09-13T19:17:20.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.506+0000 7f286780f800 20 add_watcher() i=2 2024-09-13T19:17:20.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.506+0000 7f286780f800 20 add_watcher() i=3 2024-09-13T19:17:20.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.506+0000 7f286780f800 20 add_watcher() i=4 2024-09-13T19:17:20.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.506+0000 7f286780f800 20 add_watcher() i=5 2024-09-13T19:17:20.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.506+0000 7f286780f800 20 add_watcher() i=6 2024-09-13T19:17:20.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.507+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94582850506528] v36'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f284c02a040 con 0x7f2854078070 2024-09-13T19:17:20.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.507+0000 7f286780f800 20 add_watcher() i=7 2024-09-13T19:17:20.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.507+0000 7f286780f800 2 all 8 watchers are set, enabling cache 2024-09-13T19:17:20.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.507+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c9351290 con 0x5605c933cd30 2024-09-13T19:17:20.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.507+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f284c02a040 con 0x5605c933cd30 2024-09-13T19:17:20.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.507+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94582850510256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c934e720 con 0x5605c933cd30 2024-09-13T19:17:20.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.508+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94582850510256] v36'216 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f284c02a040 con 0x5605c933cd30 2024-09-13T19:17:20.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.508+0000 7f27197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:17:20.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.508+0000 7f286780f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:17:20.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.508+0000 7f286780f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:17:20.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.508+0000 7f286780f800 5 note: GC not initialized 2024-09-13T19:17:20.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.509+0000 7f2693fff640 20 reqs_thread_entry: start 2024-09-13T19:17:20.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.509+0000 7f286780f800 20 init_complete bucket index max shards: 11 2024-09-13T19:17:20.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.509+0000 7f286780f800 20 Filter name: none 2024-09-13T19:17:20.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.509+0000 7f2691ffb640 20 reqs_thread_entry: start 2024-09-13T19:17:20.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.509+0000 7f286780f800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-13T19:17:20.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.509+0000 7f286780f800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.509+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5605c9384680 con 0x7f285c058040 2024-09-13T19:17:20.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.510+0000 7f2862e67640 1 -- 172.21.15.102:0/1001755092 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(62 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f285407f070 con 0x7f285c058040 2024-09-13T19:17:20.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.510+0000 7f286780f800 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T19:17:20.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.510+0000 7f286780f800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-13T19:17:20.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.510+0000 7f286780f800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T19:17:20.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.510+0000 7f286780f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:17:20.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.510+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:63 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c9388a60 con 0x7f2854078070 2024-09-13T19:17:20.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.511+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(63 fud [create,call,writefull 0~206] v36'6 uv5 ondisk = -17 ((17) File exists)) ==== 231+0+0 (crc 0 0 0) 0x7f284c02a040 con 0x7f2854078070 2024-09-13T19:17:20.529 INFO:teuthology.orchestra.run.smithi102.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2024-09-13T19:17:20.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.512+0000 7f27197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:17:20.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.512+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94582850510256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c93823f0 con 0x5605c933cd30 2024-09-13T19:17:20.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.513+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94582850510256] v36'217 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f284c02a040 con 0x5605c933cd30 2024-09-13T19:17:20.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.513+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94582850483600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c93823f0 con 0x7f285c058040 2024-09-13T19:17:20.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.514+0000 7f2862e67640 1 -- 172.21.15.102:0/1001755092 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94582850483600] v36'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f285407f070 con 0x7f285c058040 2024-09-13T19:17:20.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.514+0000 7f286780f800 20 remove_watcher() i=0 2024-09-13T19:17:20.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.514+0000 7f286780f800 2 removed watcher, disabling cache 2024-09-13T19:17:20.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.514+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94582850490864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c93823f0 con 0x5605c933cd30 2024-09-13T19:17:20.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.515+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94582850490864] v36'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f284c02a040 con 0x5605c933cd30 2024-09-13T19:17:20.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.515+0000 7f286780f800 20 remove_watcher() i=1 2024-09-13T19:17:20.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.515+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94582850494704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c93823f0 con 0x5605c9341720 2024-09-13T19:17:20.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.516+0000 7f2863668640 1 -- 172.21.15.102:0/1001755092 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94582850494704] v36'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f285c03b030 con 0x5605c9341720 2024-09-13T19:17:20.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.516+0000 7f286780f800 20 remove_watcher() i=2 2024-09-13T19:17:20.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.516+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94582850492960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c93823f0 con 0x7f285c058040 2024-09-13T19:17:20.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.517+0000 7f2862e67640 1 -- 172.21.15.102:0/1001755092 <== osd.2 v2:172.21.15.102:6816/2238176080 16 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94582850492960] v36'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f285407f070 con 0x7f285c058040 2024-09-13T19:17:20.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.517+0000 7f286780f800 20 remove_watcher() i=3 2024-09-13T19:17:20.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.517+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94582850501088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c93823f0 con 0x5605c933cd30 2024-09-13T19:17:20.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.518+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94582850501088] v36'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f284c02a040 con 0x5605c933cd30 2024-09-13T19:17:20.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.518+0000 7f286780f800 20 remove_watcher() i=4 2024-09-13T19:17:20.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.518+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94582850497424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c93823f0 con 0x7f2854078070 2024-09-13T19:17:20.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.520+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94582850497424] v36'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f284c02a040 con 0x7f2854078070 2024-09-13T19:17:20.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.520+0000 7f286780f800 20 remove_watcher() i=5 2024-09-13T19:17:20.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.520+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94582850503840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c93823f0 con 0x7f2854078070 2024-09-13T19:17:20.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.521+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94582850503840] v36'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f284c02a040 con 0x7f2854078070 2024-09-13T19:17:20.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.521+0000 7f286780f800 20 remove_watcher() i=6 2024-09-13T19:17:20.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.521+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94582850506528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5605c93823f0 con 0x7f2854078070 2024-09-13T19:17:20.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.522+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94582850506528] v36'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f284c02a040 con 0x7f2854078070 2024-09-13T19:17:20.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.522+0000 7f286780f800 20 remove_watcher() i=7 2024-09-13T19:17:20.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.522+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f2854078070 msgr2=0x7f2854078450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.522+0000 7f286780f800 1 --2- 172.21.15.102:0/1001755092 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f2854078070 0x7f2854078450 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.522+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5605c933cd30 msgr2=0x5605c933f1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.522+0000 7f286780f800 1 --2- 172.21.15.102:0/1001755092 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5605c933cd30 0x5605c933f1f0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.522+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f285c058040 msgr2=0x7f285c03b720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.522+0000 7f286780f800 1 --2- 172.21.15.102:0/1001755092 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f285c058040 0x7f285c03b720 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.522+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5605c9341720 msgr2=0x5605c9343b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.522+0000 7f286780f800 1 --2- 172.21.15.102:0/1001755092 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5605c9341720 0x5605c9343b10 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.522+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f272c036af0 msgr2=0x7f272c038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.522+0000 7f286780f800 1 --2- 172.21.15.102:0/1001755092 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f272c036af0 0x7f272c038fb0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f285405ab30 tx=0x7f2854089000 comp rx=0 tx=0).stop 2024-09-13T19:17:20.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.522+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605c9327bf0 msgr2=0x5605c9209a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.522+0000 7f286780f800 1 --2- 172.21.15.102:0/1001755092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605c9327bf0 0x5605c9209a90 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f285c01ff70 tx=0x7f285c04cda0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.522+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 reap_dead start 2024-09-13T19:17:20.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.522+0000 7f285a666640 1 -- 172.21.15.102:0/1001755092 reap_dead start 2024-09-13T19:17:20.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.522+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 shutdown_connections 2024-09-13T19:17:20.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.522+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 >> 172.21.15.102:0/1001755092 conn(0x5605c9323fa0 msgr2=0x5605c9322070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:20.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.522+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 shutdown_connections 2024-09-13T19:17:20.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.522+0000 7f286780f800 1 -- 172.21.15.102:0/1001755092 wait complete. 2024-09-13T19:17:20.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.522+0000 7f286780f800 1 -- 172.21.15.102:0/3088377837 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f273c036b40 msgr2=0x7f273c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.523+0000 7f286780f800 1 --2- 172.21.15.102:0/3088377837 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f273c036b40 0x7f273c039000 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x5605c9304650 tx=0x7f285406ff00 comp rx=0 tx=0).stop 2024-09-13T19:17:20.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.523+0000 7f286780f800 1 -- 172.21.15.102:0/3088377837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605c931aeb0 msgr2=0x5605c931b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.523+0000 7f286780f800 1 --2- 172.21.15.102:0/3088377837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605c931aeb0 0x5605c931b2d0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x5605c93011a0 tx=0x7f285c0167b0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.523+0000 7f286780f800 1 -- 172.21.15.102:0/3088377837 shutdown_connections 2024-09-13T19:17:20.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.523+0000 7f286780f800 1 --2- 172.21.15.102:0/3088377837 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f273c036b40 0x7f273c039000 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.523+0000 7f286780f800 1 --2- 172.21.15.102:0/3088377837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605c931aeb0 0x5605c931b2d0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.523+0000 7f286780f800 1 -- 172.21.15.102:0/3088377837 >> 172.21.15.102:0/3088377837 conn(0x5605c930fe40 msgr2=0x5605c93129c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:20.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.523+0000 7f286780f800 1 -- 172.21.15.102:0/3088377837 shutdown_connections 2024-09-13T19:17:20.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.523+0000 7f286780f800 1 -- 172.21.15.102:0/3088377837 wait complete. 2024-09-13T19:17:20.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.523+0000 7f286780f800 1 -- 172.21.15.102:0/3728965980 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5605c920c6a0 msgr2=0x5605c9307160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.523+0000 7f286780f800 1 --2- 172.21.15.102:0/3728965980 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5605c920c6a0 0x5605c9307160 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.523+0000 7f286780f800 1 -- 172.21.15.102:0/3728965980 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5605c93098b0 msgr2=0x5605c930bd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.523+0000 7f286780f800 1 --2- 172.21.15.102:0/3728965980 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5605c93098b0 0x5605c930bd40 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.523+0000 7f286780f800 1 -- 172.21.15.102:0/3728965980 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2748036b90 msgr2=0x7f2748039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.523+0000 7f286780f800 1 --2- 172.21.15.102:0/3728965980 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2748036b90 0x7f2748039050 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x5605c917c850 tx=0x7f284c001390 comp rx=0 tx=0).stop 2024-09-13T19:17:20.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.523+0000 7f286780f800 1 -- 172.21.15.102:0/3728965980 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605c917ceb0 msgr2=0x5605c93000f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.523+0000 7f286780f800 1 --2- 172.21.15.102:0/3728965980 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605c917ceb0 0x5605c93000f0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f2854067040 tx=0x7f2854002fb0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.523+0000 7f286780f800 1 -- 172.21.15.102:0/3728965980 shutdown_connections 2024-09-13T19:17:20.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.523+0000 7f286780f800 1 --2- 172.21.15.102:0/3728965980 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5605c93098b0 0x5605c930bd40 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.523+0000 7f286780f800 1 --2- 172.21.15.102:0/3728965980 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5605c920c6a0 0x5605c9307160 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.523+0000 7f286780f800 1 --2- 172.21.15.102:0/3728965980 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f2748036b90 0x7f2748039050 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.523+0000 7f286780f800 1 --2- 172.21.15.102:0/3728965980 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5605c917ceb0 0x5605c93000f0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.523+0000 7f286780f800 1 -- 172.21.15.102:0/3728965980 >> 172.21.15.102:0/3728965980 conn(0x5605c9203dd0 msgr2=0x5605c92f2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:20.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.523+0000 7f286780f800 1 -- 172.21.15.102:0/3728965980 shutdown_connections 2024-09-13T19:17:20.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.523+0000 7f286780f800 1 -- 172.21.15.102:0/3728965980 wait complete. 2024-09-13T19:17:20.535 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-13T19:17:20.581 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:17:20.581 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-13T19:17:20.585 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:17:20.586 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2024-09-13T19:17:20.586 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-13T19:17:20.586 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-13T19:17:20.586 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2024-09-13T19:17:20.631 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:17:20.631 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:17:20.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.629+0000 7f4023151800 1 Processor -- start 2024-09-13T19:17:20.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.629+0000 7f4023151800 1 -- start start 2024-09-13T19:17:20.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.629+0000 7f4023151800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x564af1b37650 0x564af1bc61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.629+0000 7f4023151800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564af1a82b30 con 0x564af1bc6720 2024-09-13T19:17:20.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.629+0000 7f4023151800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x564af1a64360 con 0x564af1b37650 2024-09-13T19:17:20.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.629+0000 7f4020c45640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x564af1b37650 0x564af1bc61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.630+0000 7f4020444640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x564af1bc6720 0x564af1bc8b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:50098/0 (socket says 172.21.15.102:50098) 2024-09-13T19:17:20.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.630+0000 7f4020444640 1 -- 172.21.15.102:0/1492670737 learned_addr learned my addr 172.21.15.102:0/1492670737 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:17:20.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.630+0000 7f4020c45640 1 -- 172.21.15.102:0/1492670737 >> v1:172.21.15.53:6789/0 conn(0x564af1bc6720 legacy=0x564af1bc8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.630+0000 7f4020c45640 1 -- 172.21.15.102:0/1492670737 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564af1a8ae00 con 0x564af1b37650 2024-09-13T19:17:20.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.632+0000 7f4020c45640 1 --2- 172.21.15.102:0/1492670737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af1b37650 0x564af1bc61e0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f4018005fd0 tx=0x7f4018045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a141e4f7553946ff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.632+0000 7f401fc43640 1 -- 172.21.15.102:0/1492670737 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4018058530 con 0x564af1b37650 2024-09-13T19:17:20.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.632+0000 7f401fc43640 1 -- 172.21.15.102:0/1492670737 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40180586d0 con 0x564af1b37650 2024-09-13T19:17:20.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.632+0000 7f401fc43640 1 -- 172.21.15.102:0/1492670737 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40180589d0 con 0x564af1b37650 2024-09-13T19:17:20.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.632+0000 7f4023151800 1 -- 172.21.15.102:0/1492670737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af1b37650 msgr2=0x564af1bc61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.632+0000 7f4023151800 1 --2- 172.21.15.102:0/1492670737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af1b37650 0x564af1bc61e0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f4018005fd0 tx=0x7f4018045c30 comp rx=0 tx=0).stop 2024-09-13T19:17:20.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.632+0000 7f4023151800 1 -- 172.21.15.102:0/1492670737 shutdown_connections 2024-09-13T19:17:20.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.632+0000 7f4023151800 1 --2- 172.21.15.102:0/1492670737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af1b37650 0x564af1bc61e0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.632+0000 7f4023151800 1 -- 172.21.15.102:0/1492670737 >> 172.21.15.102:0/1492670737 conn(0x564af1bbddb0 msgr2=0x564af1bc01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:20.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.632+0000 7f4023151800 1 -- 172.21.15.102:0/1492670737 shutdown_connections 2024-09-13T19:17:20.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.632+0000 7f4023151800 1 -- 172.21.15.102:0/1492670737 wait complete. 2024-09-13T19:17:20.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.646+0000 7f4023151800 1 Processor -- start 2024-09-13T19:17:20.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.646+0000 7f4023151800 1 -- start start 2024-09-13T19:17:20.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.646+0000 7f4023151800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af1b37650 0x564af1bc3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.646+0000 7f4023151800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564af1b0f360 con 0x564af1b37650 2024-09-13T19:17:20.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.647+0000 7f4020c45640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af1b37650 0x564af1bc3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.647+0000 7f4020c45640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af1b37650 0x564af1bc3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41580/0 (socket says 172.21.15.102:41580) 2024-09-13T19:17:20.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.647+0000 7f4020c45640 1 -- 172.21.15.102:0/1349373014 learned_addr learned my addr 172.21.15.102:0/1349373014 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:20.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.647+0000 7f4020c45640 1 -- 172.21.15.102:0/1349373014 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564af1a5cbc0 con 0x564af1b37650 2024-09-13T19:17:20.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.647+0000 7f4020c45640 1 --2- 172.21.15.102:0/1349373014 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af1b37650 0x564af1bc3b10 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f401800a3f0 tx=0x7f4018051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4da9aee3c78c4e85 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.647+0000 7f3f0ee0d640 1 -- 172.21.15.102:0/1349373014 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4018058a30 con 0x564af1b37650 2024-09-13T19:17:20.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.647+0000 7f3f0ee0d640 1 -- 172.21.15.102:0/1349373014 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4018068070 con 0x564af1b37650 2024-09-13T19:17:20.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.647+0000 7f3f0ee0d640 1 -- 172.21.15.102:0/1349373014 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4018058d60 con 0x564af1b37650 2024-09-13T19:17:20.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.648+0000 7f4023151800 1 -- 172.21.15.102:0/1349373014 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af1b37650 msgr2=0x564af1bc3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.648+0000 7f4023151800 1 --2- 172.21.15.102:0/1349373014 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af1b37650 0x564af1bc3b10 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f401800a3f0 tx=0x7f4018051000 comp rx=0 tx=0).stop 2024-09-13T19:17:20.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.648+0000 7f4023151800 1 -- 172.21.15.102:0/1349373014 shutdown_connections 2024-09-13T19:17:20.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.648+0000 7f4023151800 1 --2- 172.21.15.102:0/1349373014 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af1b37650 0x564af1bc3b10 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.648+0000 7f4023151800 1 -- 172.21.15.102:0/1349373014 >> 172.21.15.102:0/1349373014 conn(0x564af1bbddb0 msgr2=0x564af1cae240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:20.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.648+0000 7f4023151800 1 -- 172.21.15.102:0/1349373014 shutdown_connections 2024-09-13T19:17:20.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.648+0000 7f4023151800 1 -- 172.21.15.102:0/1349373014 wait complete. 2024-09-13T19:17:20.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.648+0000 7f4023151800 1 Processor -- start 2024-09-13T19:17:20.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.648+0000 7f4023151800 1 -- start start 2024-09-13T19:17:20.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.648+0000 7f4023151800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af1bc6720 0x564af1cbc620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.648+0000 7f4023151800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564af1bca620 con 0x564af1bc6720 2024-09-13T19:17:20.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.649+0000 7f4020c45640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af1bc6720 0x564af1cbc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.649+0000 7f4020c45640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af1bc6720 0x564af1cbc620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41596/0 (socket says 172.21.15.102:41596) 2024-09-13T19:17:20.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.649+0000 7f4020c45640 1 -- 172.21.15.102:0/3684042195 learned_addr learned my addr 172.21.15.102:0/3684042195 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:20.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.649+0000 7f4020c45640 1 -- 172.21.15.102:0/3684042195 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564af1a70fe0 con 0x564af1bc6720 2024-09-13T19:17:20.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.649+0000 7f4020c45640 1 --2- 172.21.15.102:0/3684042195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af1bc6720 0x564af1cbc620 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f4018046130 tx=0x7f4018003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.649+0000 7f3f0d60a640 1 -- 172.21.15.102:0/3684042195 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40180755b0 con 0x564af1bc6720 2024-09-13T19:17:20.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.649+0000 7f3f0d60a640 1 -- 172.21.15.102:0/3684042195 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4018075750 con 0x564af1bc6720 2024-09-13T19:17:20.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.649+0000 7f4023151800 1 -- 172.21.15.102:0/3684042195 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564af1cbcb60 con 0x564af1bc6720 2024-09-13T19:17:20.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.649+0000 7f3f0d60a640 1 -- 172.21.15.102:0/3684042195 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4018075a70 con 0x564af1bc6720 2024-09-13T19:17:20.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.649+0000 7f4023151800 1 -- 172.21.15.102:0/3684042195 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564af1cbd0e0 con 0x564af1bc6720 2024-09-13T19:17:20.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.650+0000 7f3f0d60a640 1 -- 172.21.15.102:0/3684042195 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4018075c10 con 0x564af1bc6720 2024-09-13T19:17:20.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.650+0000 7f3f0d60a640 1 --2- 172.21.15.102:0/3684042195 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3f08036b40 0x7f3f08039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.650+0000 7f3f0d60a640 1 -- 172.21.15.102:0/3684042195 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f4018090c90 con 0x564af1bc6720 2024-09-13T19:17:20.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.651+0000 7f4020444640 1 --2- 172.21.15.102:0/3684042195 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3f08036b40 0x7f3f08039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.651+0000 7f4023151800 1 --2- 172.21.15.102:0/3684042195 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x564af1cc1680 0x564af1cc3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.651+0000 7f4023151800 1 -- 172.21.15.102:0/3684042195 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1cc3fb0 con 0x564af1cc1680 2024-09-13T19:17:20.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.651+0000 7f4021446640 1 --2- 172.21.15.102:0/3684042195 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x564af1cc1680 0x564af1cc3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.651+0000 7f4020444640 1 --2- 172.21.15.102:0/3684042195 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3f08036b40 0x7f3f08039000 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4008000f60 tx=0x7f40080012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.651+0000 7f4021446640 1 --2- 172.21.15.102:0/3684042195 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x564af1cc1680 0x564af1cc3a70 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.651+0000 7f4021446640 1 -- 172.21.15.102:0/3684042195 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40100083e0 con 0x564af1cc1680 2024-09-13T19:17:20.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.651+0000 7f4023151800 1 -- 172.21.15.102:0/3684042195 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1cc0c40 con 0x564af1cc1680 2024-09-13T19:17:20.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.651+0000 7f4021446640 1 -- 172.21.15.102:0/3684042195 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f40100083e0 con 0x564af1cc1680 2024-09-13T19:17:20.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.652+0000 7f4023151800 1 --2- 172.21.15.102:0/3684042195 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x564af1cc62a0 0x564af1cc8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.652+0000 7f4023151800 1 -- 172.21.15.102:0/3684042195 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1cc8d80 con 0x564af1cc62a0 2024-09-13T19:17:20.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.652+0000 7f4020c45640 1 --2- 172.21.15.102:0/3684042195 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x564af1cc62a0 0x564af1cc8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.652+0000 7f4020c45640 1 --2- 172.21.15.102:0/3684042195 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x564af1cc62a0 0x564af1cc8690 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.652+0000 7f4020c45640 1 -- 172.21.15.102:0/3684042195 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4018074d00 con 0x564af1cc62a0 2024-09-13T19:17:20.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.652+0000 7f4023151800 1 -- 172.21.15.102:0/3684042195 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1cc5140 con 0x564af1cc1680 2024-09-13T19:17:20.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.652+0000 7f4021446640 1 -- 172.21.15.102:0/3684042195 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f40100083e0 con 0x564af1cc1680 2024-09-13T19:17:20.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.652+0000 7f4023151800 1 -- 172.21.15.102:0/3684042195 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1cc55e0 con 0x564af1cc62a0 2024-09-13T19:17:20.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.653+0000 7f4020c45640 1 -- 172.21.15.102:0/3684042195 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4018074d00 con 0x564af1cc62a0 2024-09-13T19:17:20.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.653+0000 7f4023151800 1 Processor -- start 2024-09-13T19:17:20.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.653+0000 7f4023151800 1 -- start start 2024-09-13T19:17:20.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.653+0000 7f4023151800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af1cd7700 0x564af1cd7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.653+0000 7f4023151800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564af1a5e580 con 0x564af1cd7700 2024-09-13T19:17:20.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.654+0000 7f4021446640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af1cd7700 0x564af1cd7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.654+0000 7f4021446640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af1cd7700 0x564af1cd7b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41608/0 (socket says 172.21.15.102:41608) 2024-09-13T19:17:20.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.654+0000 7f4021446640 1 -- 172.21.15.102:0/3577296649 learned_addr learned my addr 172.21.15.102:0/3577296649 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:20.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.654+0000 7f4021446640 1 -- 172.21.15.102:0/3577296649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564af1cd8060 con 0x564af1cd7700 2024-09-13T19:17:20.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.654+0000 7f4021446640 1 --2- 172.21.15.102:0/3577296649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af1cd7700 0x564af1cd7b20 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x564af1cbd6d0 tx=0x7f401000beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.654+0000 7f3f067fc640 1 -- 172.21.15.102:0/3577296649 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f401001c020 con 0x564af1cd7700 2024-09-13T19:17:20.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.654+0000 7f3f067fc640 1 -- 172.21.15.102:0/3577296649 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4010007c30 con 0x564af1cd7700 2024-09-13T19:17:20.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.654+0000 7f3f067fc640 1 -- 172.21.15.102:0/3577296649 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4010018440 con 0x564af1cd7700 2024-09-13T19:17:20.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.654+0000 7f4023151800 1 -- 172.21.15.102:0/3577296649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564af1cd82f0 con 0x564af1cd7700 2024-09-13T19:17:20.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.654+0000 7f4023151800 1 -- 172.21.15.102:0/3577296649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564af1cdafd0 con 0x564af1cd7700 2024-09-13T19:17:20.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.655+0000 7f3f067fc640 1 -- 172.21.15.102:0/3577296649 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f401001f020 con 0x564af1cd7700 2024-09-13T19:17:20.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.655+0000 7f3f067fc640 1 --2- 172.21.15.102:0/3577296649 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3ef8036bb0 0x7f3ef8039070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.655+0000 7f3f067fc640 1 -- 172.21.15.102:0/3577296649 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f401004e3e0 con 0x564af1cd7700 2024-09-13T19:17:20.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.655+0000 7f4020c45640 1 --2- 172.21.15.102:0/3577296649 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3ef8036bb0 0x7f3ef8039070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.656+0000 7f4023151800 1 Processor -- start 2024-09-13T19:17:20.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.656+0000 7f4023151800 1 -- start start 2024-09-13T19:17:20.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.656+0000 7f4020c45640 1 --2- 172.21.15.102:0/3577296649 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3ef8036bb0 0x7f3ef8039070 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x564af1cc4850 tx=0x7f4018063480 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.656+0000 7f4023151800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af1ce43d0 0x564af1ce47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.656+0000 7f4023151800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564af1bc20f0 con 0x564af1ce43d0 2024-09-13T19:17:20.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.656+0000 7f4021446640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af1ce43d0 0x564af1ce47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.656+0000 7f4021446640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af1ce43d0 0x564af1ce47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41610/0 (socket says 172.21.15.102:41610) 2024-09-13T19:17:20.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.656+0000 7f4021446640 1 -- 172.21.15.102:0/3839790368 learned_addr learned my addr 172.21.15.102:0/3839790368 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:20.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.656+0000 7f4021446640 1 -- 172.21.15.102:0/3839790368 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564af1ce4d80 con 0x564af1ce43d0 2024-09-13T19:17:20.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.657+0000 7f4021446640 1 --2- 172.21.15.102:0/3839790368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af1ce43d0 0x564af1ce47b0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f401004c690 tx=0x7f4010016630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b9880d78403e2c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.657+0000 7f3ef7fff640 1 -- 172.21.15.102:0/3839790368 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f401004e1a0 con 0x564af1ce43d0 2024-09-13T19:17:20.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.657+0000 7f3ef7fff640 1 -- 172.21.15.102:0/3839790368 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4010021400 con 0x564af1ce43d0 2024-09-13T19:17:20.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.657+0000 7f3ef7fff640 1 -- 172.21.15.102:0/3839790368 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4010018c10 con 0x564af1ce43d0 2024-09-13T19:17:20.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.657+0000 7f4023151800 1 -- 172.21.15.102:0/3839790368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af1ce43d0 msgr2=0x564af1ce47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.657+0000 7f4023151800 1 --2- 172.21.15.102:0/3839790368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af1ce43d0 0x564af1ce47b0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f401004c690 tx=0x7f4010016630 comp rx=0 tx=0).stop 2024-09-13T19:17:20.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.657+0000 7f4023151800 1 -- 172.21.15.102:0/3839790368 shutdown_connections 2024-09-13T19:17:20.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.657+0000 7f4023151800 1 --2- 172.21.15.102:0/3839790368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af1ce43d0 0x564af1ce47b0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.657+0000 7f4023151800 1 -- 172.21.15.102:0/3839790368 >> 172.21.15.102:0/3839790368 conn(0x564af1ce0730 msgr2=0x564af1cde830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:20.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.657+0000 7f4023151800 1 -- 172.21.15.102:0/3839790368 shutdown_connections 2024-09-13T19:17:20.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.657+0000 7f4023151800 1 -- 172.21.15.102:0/3839790368 wait complete. 2024-09-13T19:17:20.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.657+0000 7f4023151800 1 Processor -- start 2024-09-13T19:17:20.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.658+0000 7f4023151800 1 -- start start 2024-09-13T19:17:20.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.658+0000 7f4023151800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af1ce43d0 0x564af1ceb750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.658+0000 7f4023151800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564af1ce5360 con 0x564af1ce43d0 2024-09-13T19:17:20.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.658+0000 7f4021446640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af1ce43d0 0x564af1ceb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.658+0000 7f4021446640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af1ce43d0 0x564af1ceb750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41624/0 (socket says 172.21.15.102:41624) 2024-09-13T19:17:20.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.658+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 learned_addr learned my addr 172.21.15.102:0/1851918305 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:20.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.658+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564af1cebc90 con 0x564af1ce43d0 2024-09-13T19:17:20.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.658+0000 7f4021446640 1 --2- 172.21.15.102:0/1851918305 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af1ce43d0 0x564af1ceb750 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f40100168b0 tx=0x7f401004c5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.658+0000 7f3ef67fc640 1 -- 172.21.15.102:0/1851918305 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4010029c70 con 0x564af1ce43d0 2024-09-13T19:17:20.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.658+0000 7f3ef67fc640 1 -- 172.21.15.102:0/1851918305 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4010029e10 con 0x564af1ce43d0 2024-09-13T19:17:20.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.658+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564af1cebf20 con 0x564af1ce43d0 2024-09-13T19:17:20.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.658+0000 7f3ef67fc640 1 -- 172.21.15.102:0/1851918305 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4010029810 con 0x564af1ce43d0 2024-09-13T19:17:20.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.659+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564af1ceebd0 con 0x564af1ce43d0 2024-09-13T19:17:20.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.659+0000 7f3ef67fc640 1 -- 172.21.15.102:0/1851918305 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4010016040 con 0x564af1ce43d0 2024-09-13T19:17:20.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.660+0000 7f3ef67fc640 1 --2- 172.21.15.102:0/1851918305 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3eec036b40 0x7f3eec039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.660+0000 7f3ef67fc640 1 -- 172.21.15.102:0/1851918305 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f4010033070 con 0x564af1ce43d0 2024-09-13T19:17:20.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.660+0000 7f4020c45640 1 --2- 172.21.15.102:0/1851918305 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3eec036b40 0x7f3eec039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.660+0000 7f4020c45640 1 --2- 172.21.15.102:0/1851918305 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3eec036b40 0x7f3eec039000 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f401808f230 tx=0x7f4018096000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.660+0000 7f4023151800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.660+0000 7f4023151800 1 --2- 172.21.15.102:0/1851918305 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x564af1cf72b0 0x564af1cf9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.660+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1cf9ec0 con 0x564af1cf72b0 2024-09-13T19:17:20.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.660+0000 7f4020444640 1 --2- 172.21.15.102:0/1851918305 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x564af1cf72b0 0x564af1cf9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.661+0000 7f4020444640 1 --2- 172.21.15.102:0/1851918305 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x564af1cf72b0 0x564af1cf9770 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.661+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4008009050 con 0x564af1cf72b0 2024-09-13T19:17:20.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.661+0000 7f4023151800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:20.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.661+0000 7f4023151800 20 realm 2024-09-13T19:17:20.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.661+0000 7f4023151800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.661+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1cf6700 con 0x564af1cf72b0 2024-09-13T19:17:20.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.661+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4008009050 con 0x564af1cf72b0 2024-09-13T19:17:20.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.661+0000 7f4023151800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:20.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.661+0000 7f4023151800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:17:20.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.661+0000 7f4023151800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.661+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1cfa9b0 con 0x564af1cf72b0 2024-09-13T19:17:20.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.661+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4008009050 con 0x564af1cf72b0 2024-09-13T19:17:20.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.661+0000 7f4023151800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:20.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.661+0000 7f4023151800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.661+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1cfb280 con 0x564af1cf72b0 2024-09-13T19:17:20.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.661+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4008009050 con 0x564af1cf72b0 2024-09-13T19:17:20.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.662+0000 7f4023151800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:17:20.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.662+0000 7f4023151800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.662+0000 7f4023151800 1 --2- 172.21.15.102:0/1851918305 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x564af1cfbbc0 0x564af1cfdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.662+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1cfe740 con 0x564af1cfbbc0 2024-09-13T19:17:20.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.662+0000 7f4021446640 1 --2- 172.21.15.102:0/1851918305 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x564af1cfbbc0 0x564af1cfdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.662+0000 7f4021446640 1 --2- 172.21.15.102:0/1851918305 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x564af1cfbbc0 0x564af1cfdfb0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.662+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4010057040 con 0x564af1cfbbc0 2024-09-13T19:17:20.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.662+0000 7f4023151800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:17:20.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.662+0000 7f4023151800 20 searching for the correct realm 2024-09-13T19:17:20.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.662+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564af1d000c0 con 0x564af1cfbbc0 2024-09-13T19:17:20.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.662+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4010057040 con 0x564af1cfbbc0 2024-09-13T19:17:20.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.662+0000 7f4021446640 1 --2- 172.21.15.102:0/1851918305 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f4010021020 0x7f4010045190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.662+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564af1d000c0 con 0x7f4010021020 2024-09-13T19:17:20.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.663+0000 7f4020c45640 1 --2- 172.21.15.102:0/1851918305 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f4010021020 0x7f4010045190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.663+0000 7f4020c45640 1 --2- 172.21.15.102:0/1851918305 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f4010021020 0x7f4010045190 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.663+0000 7f4020c45640 1 -- 172.21.15.102:0/1851918305 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4018074d00 con 0x7f4010021020 2024-09-13T19:17:20.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.663+0000 7f4020c45640 1 --2- 172.21.15.102:0/1851918305 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f401809d040 0x7f4018090390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.663+0000 7f4020c45640 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564af1d000c0 con 0x7f401809d040 2024-09-13T19:17:20.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.663+0000 7f4020444640 1 --2- 172.21.15.102:0/1851918305 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f401809d040 0x7f4018090390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.664+0000 7f4020444640 1 --2- 172.21.15.102:0/1851918305 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f401809d040 0x7f4018090390 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.664+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4008009050 con 0x7f401809d040 2024-09-13T19:17:20.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.664+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564af1d000c0 con 0x564af1cf72b0 2024-09-13T19:17:20.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.664+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4008009050 con 0x564af1cf72b0 2024-09-13T19:17:20.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.664+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564af1d000c0 con 0x564af1cf72b0 2024-09-13T19:17:20.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.664+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4008029040 con 0x564af1cf72b0 2024-09-13T19:17:20.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.664+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564af1d000c0 con 0x7f401809d040 2024-09-13T19:17:20.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.665+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4008029040 con 0x7f401809d040 2024-09-13T19:17:20.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.665+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564af1d000c0 con 0x7f401809d040 2024-09-13T19:17:20.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.665+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4008029040 con 0x7f401809d040 2024-09-13T19:17:20.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.665+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564af1d000c0 con 0x7f4010021020 2024-09-13T19:17:20.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.665+0000 7f4020c45640 1 -- 172.21.15.102:0/1851918305 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4018074d00 con 0x7f4010021020 2024-09-13T19:17:20.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.665+0000 7f4020c45640 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564af1d000c0 con 0x564af1cfbbc0 2024-09-13T19:17:20.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.665+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4010057040 con 0x564af1cfbbc0 2024-09-13T19:17:20.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.665+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564af1d000c0 con 0x564af1cf72b0 2024-09-13T19:17:20.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.666+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4008029040 con 0x564af1cf72b0 2024-09-13T19:17:20.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.666+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564af1d000c0 con 0x7f4010021020 2024-09-13T19:17:20.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.666+0000 7f4020c45640 1 -- 172.21.15.102:0/1851918305 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4018074d00 con 0x7f4010021020 2024-09-13T19:17:20.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.666+0000 7f4020c45640 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564af1d000c0 con 0x564af1cf72b0 2024-09-13T19:17:20.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.666+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4008029040 con 0x564af1cf72b0 2024-09-13T19:17:20.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.666+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564af1d000c0 con 0x7f4010021020 2024-09-13T19:17:20.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.666+0000 7f4020c45640 1 -- 172.21.15.102:0/1851918305 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4018074d00 con 0x7f4010021020 2024-09-13T19:17:20.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.666+0000 7f4020c45640 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564af1d000c0 con 0x564af1cfbbc0 2024-09-13T19:17:20.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.667+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4010057040 con 0x564af1cfbbc0 2024-09-13T19:17:20.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.667+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564af1d000c0 con 0x564af1cfbbc0 2024-09-13T19:17:20.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.667+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4010057040 con 0x564af1cfbbc0 2024-09-13T19:17:20.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.667+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564af1d000c0 con 0x7f401809d040 2024-09-13T19:17:20.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.667+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4008029040 con 0x7f401809d040 2024-09-13T19:17:20.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.667+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564af1d000c0 con 0x564af1cfbbc0 2024-09-13T19:17:20.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.667+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4010057040 con 0x564af1cfbbc0 2024-09-13T19:17:20.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.667+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564af1d000c0 con 0x564af1cfbbc0 2024-09-13T19:17:20.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.668+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4010057040 con 0x564af1cfbbc0 2024-09-13T19:17:20.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.668+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564af1d000c0 con 0x564af1cf72b0 2024-09-13T19:17:20.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.668+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4008029040 con 0x564af1cf72b0 2024-09-13T19:17:20.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.668+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564af1d000c0 con 0x564af1cf72b0 2024-09-13T19:17:20.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.668+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4008029040 con 0x564af1cf72b0 2024-09-13T19:17:20.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.668+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564af1d000c0 con 0x7f401809d040 2024-09-13T19:17:20.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.668+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4008029040 con 0x7f401809d040 2024-09-13T19:17:20.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.668+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564af1d000c0 con 0x564af1cfbbc0 2024-09-13T19:17:20.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.669+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4010064040 con 0x564af1cfbbc0 2024-09-13T19:17:20.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.669+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564af1d000c0 con 0x7f4010021020 2024-09-13T19:17:20.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.669+0000 7f4020c45640 1 -- 172.21.15.102:0/1851918305 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4018074d00 con 0x7f4010021020 2024-09-13T19:17:20.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.669+0000 7f4020c45640 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564af1d000c0 con 0x564af1cf72b0 2024-09-13T19:17:20.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.669+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4008029040 con 0x564af1cf72b0 2024-09-13T19:17:20.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.669+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564af1d000c0 con 0x7f4010021020 2024-09-13T19:17:20.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.669+0000 7f4020c45640 1 -- 172.21.15.102:0/1851918305 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4018074d00 con 0x7f4010021020 2024-09-13T19:17:20.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.669+0000 7f4020c45640 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564af1d000c0 con 0x564af1cfbbc0 2024-09-13T19:17:20.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.670+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4010064040 con 0x564af1cfbbc0 2024-09-13T19:17:20.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.670+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564af1d000c0 con 0x7f401809d040 2024-09-13T19:17:20.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.670+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4008029040 con 0x7f401809d040 2024-09-13T19:17:20.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.670+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564af1d000c0 con 0x7f4010021020 2024-09-13T19:17:20.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.670+0000 7f4020c45640 1 -- 172.21.15.102:0/1851918305 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4018074d00 con 0x7f4010021020 2024-09-13T19:17:20.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.670+0000 7f4020c45640 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564af1d000c0 con 0x564af1cfbbc0 2024-09-13T19:17:20.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.670+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4010064040 con 0x564af1cfbbc0 2024-09-13T19:17:20.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.670+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564af1d000c0 con 0x7f401809d040 2024-09-13T19:17:20.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.671+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4008029040 con 0x7f401809d040 2024-09-13T19:17:20.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.671+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564af1d000c0 con 0x564af1cf72b0 2024-09-13T19:17:20.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.671+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4008029040 con 0x564af1cf72b0 2024-09-13T19:17:20.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.671+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564af1d000c0 con 0x7f4010021020 2024-09-13T19:17:20.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.671+0000 7f4020c45640 1 -- 172.21.15.102:0/1851918305 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4018074d00 con 0x7f4010021020 2024-09-13T19:17:20.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.671+0000 7f4023151800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:17:20.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.671+0000 7f4023151800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:17:20.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.671+0000 7f4023151800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:17:20.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.671+0000 7f4023151800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:17:20.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.671+0000 7f4023151800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:17:20.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.671+0000 7f4023151800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:17:20.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.671+0000 7f4023151800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.671+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1cff000 con 0x564af1cf72b0 2024-09-13T19:17:20.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.672+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4008029040 con 0x564af1cf72b0 2024-09-13T19:17:20.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.672+0000 7f4023151800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:20.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.672+0000 7f4023151800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.672+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1cff3f0 con 0x564af1cf72b0 2024-09-13T19:17:20.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.672+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4008029040 con 0x564af1cf72b0 2024-09-13T19:17:20.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.672+0000 7f4023151800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:17:20.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.672+0000 7f4023151800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.672+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1d00540 con 0x564af1cfbbc0 2024-09-13T19:17:20.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.672+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4010064040 con 0x564af1cfbbc0 2024-09-13T19:17:20.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.672+0000 7f4023151800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:17:20.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.672+0000 7f4023151800 20 zone default found 2024-09-13T19:17:20.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.672+0000 7f4023151800 4 Realm: () 2024-09-13T19:17:20.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.672+0000 7f4023151800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:17:20.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.672+0000 7f4023151800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:17:20.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.672+0000 7f4023151800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:17:20.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.672+0000 7f4023151800 20 zonegroup default 2024-09-13T19:17:20.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.672+0000 7f4023151800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.672+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1d00d90 con 0x7f4010021020 2024-09-13T19:17:20.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.672+0000 7f4020c45640 1 -- 172.21.15.102:0/1851918305 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4018074d00 con 0x7f4010021020 2024-09-13T19:17:20.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.672+0000 7f4023151800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:20.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.672+0000 7f4023151800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.672+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1d02b40 con 0x564af1cfbbc0 2024-09-13T19:17:20.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.673+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4010064040 con 0x564af1cfbbc0 2024-09-13T19:17:20.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.673+0000 7f4023151800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:20.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.673+0000 7f4023151800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.673+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1d02b60 con 0x564af1cfbbc0 2024-09-13T19:17:20.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.673+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4010064040 con 0x564af1cfbbc0 2024-09-13T19:17:20.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.673+0000 7f4023151800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:20.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.673+0000 7f4023151800 20 started sync module instance, tier type = 2024-09-13T19:17:20.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.673+0000 7f4023151800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:17:20.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.673+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d01fb0 con 0x7f4010021020 2024-09-13T19:17:20.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.674+0000 7f4020c45640 1 -- 172.21.15.102:0/1851918305 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(44 notify.0 [create] v36'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4018074d00 con 0x7f4010021020 2024-09-13T19:17:20.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.674+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94879884516096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d03030 con 0x7f4010021020 2024-09-13T19:17:20.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.674+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d03880 con 0x564af1cf72b0 2024-09-13T19:17:20.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.675+0000 7f4020c45640 1 -- 172.21.15.102:0/1851918305 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94879884516096] v36'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4018074d00 con 0x7f4010021020 2024-09-13T19:17:20.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.675+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v36'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4008029040 con 0x564af1cf72b0 2024-09-13T19:17:20.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.675+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94879884518304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d034e0 con 0x564af1cf72b0 2024-09-13T19:17:20.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.675+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d04850 con 0x564af1cfbbc0 2024-09-13T19:17:20.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.677+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94879884518304] v36'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4008029040 con 0x564af1cf72b0 2024-09-13T19:17:20.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.677+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v36'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4010064040 con 0x564af1cfbbc0 2024-09-13T19:17:20.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.677+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94879884526368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d04810 con 0x564af1cfbbc0 2024-09-13T19:17:20.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.677+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d052e0 con 0x7f4010021020 2024-09-13T19:17:20.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.678+0000 7f4020c45640 1 -- 172.21.15.102:0/1851918305 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(50 notify.3 [create] v36'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4018074d00 con 0x7f4010021020 2024-09-13T19:17:20.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.678+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94879884529168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d05b80 con 0x7f4010021020 2024-09-13T19:17:20.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.678+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d06660 con 0x564af1cf72b0 2024-09-13T19:17:20.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.678+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94879884526368] v36'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4010064040 con 0x564af1cfbbc0 2024-09-13T19:17:20.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.679+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v36'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4008029040 con 0x564af1cf72b0 2024-09-13T19:17:20.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.679+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94879884524576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d06620 con 0x564af1cf72b0 2024-09-13T19:17:20.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.679+0000 7f4020c45640 1 -- 172.21.15.102:0/1851918305 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94879884529168] v36'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4018074d00 con 0x7f4010021020 2024-09-13T19:17:20.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.679+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d056f0 con 0x7f401809d040 2024-09-13T19:17:20.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.680+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94879884524576] v36'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4008029040 con 0x564af1cf72b0 2024-09-13T19:17:20.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.680+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(54 notify.5 [create] v36'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4008029040 con 0x7f401809d040 2024-09-13T19:17:20.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.680+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94879884534128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d06590 con 0x7f401809d040 2024-09-13T19:17:20.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.680+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d076c0 con 0x7f401809d040 2024-09-13T19:17:20.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.681+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(56 notify.6 [create] v36'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4008029040 con 0x7f401809d040 2024-09-13T19:17:20.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.681+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94879884538384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d07ae0 con 0x7f401809d040 2024-09-13T19:17:20.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.681+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d084a0 con 0x7f401809d040 2024-09-13T19:17:20.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.681+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94879884534128] v36'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4008029040 con 0x7f401809d040 2024-09-13T19:17:20.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.682+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(58 notify.7 [create] v36'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4008029040 con 0x7f401809d040 2024-09-13T19:17:20.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.682+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94879884536816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d084a0 con 0x7f401809d040 2024-09-13T19:17:20.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.682+0000 7f4023151800 20 add_watcher() i=0 2024-09-13T19:17:20.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.682+0000 7f4023151800 20 add_watcher() i=1 2024-09-13T19:17:20.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.682+0000 7f4023151800 20 add_watcher() i=2 2024-09-13T19:17:20.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.682+0000 7f4023151800 20 add_watcher() i=3 2024-09-13T19:17:20.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.682+0000 7f4023151800 20 add_watcher() i=4 2024-09-13T19:17:20.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.682+0000 7f4023151800 20 add_watcher() i=5 2024-09-13T19:17:20.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.682+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94879884538384] v36'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4008029040 con 0x7f401809d040 2024-09-13T19:17:20.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.682+0000 7f4023151800 20 add_watcher() i=6 2024-09-13T19:17:20.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.684+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94879884536816] v36'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4008029040 con 0x7f401809d040 2024-09-13T19:17:20.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.684+0000 7f4023151800 20 add_watcher() i=7 2024-09-13T19:17:20.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.684+0000 7f4023151800 2 all 8 watchers are set, enabling cache 2024-09-13T19:17:20.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.684+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1d084a0 con 0x564af1cf72b0 2024-09-13T19:17:20.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.684+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4008029040 con 0x564af1cf72b0 2024-09-13T19:17:20.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.684+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94879884541936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d08410 con 0x564af1cf72b0 2024-09-13T19:17:20.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.685+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94879884541936] v36'218 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4008029040 con 0x564af1cf72b0 2024-09-13T19:17:20.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.685+0000 7f3ed6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:17:20.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.685+0000 7f4023151800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:17:20.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.685+0000 7f4023151800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:17:20.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.685+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d13f30 con 0x564af1cf72b0 2024-09-13T19:17:20.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.686+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v36'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4008029040 con 0x564af1cf72b0 2024-09-13T19:17:20.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.686+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d14580 con 0x7f401809d040 2024-09-13T19:17:20.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.687+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v36'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4008029040 con 0x7f401809d040 2024-09-13T19:17:20.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.687+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d149c0 con 0x564af1cfbbc0 2024-09-13T19:17:20.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.688+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v36'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4010064040 con 0x564af1cfbbc0 2024-09-13T19:17:20.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.688+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d14930 con 0x564af1cf72b0 2024-09-13T19:17:20.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.689+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v36'219 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4008029040 con 0x564af1cf72b0 2024-09-13T19:17:20.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.689+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d14ec0 con 0x7f4010021020 2024-09-13T19:17:20.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.690+0000 7f4020c45640 1 -- 172.21.15.102:0/1851918305 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v36'70 uv55 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4018074d00 con 0x7f4010021020 2024-09-13T19:17:20.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.690+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d15370 con 0x564af1cfbbc0 2024-09-13T19:17:20.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.691+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 <== osd.3 v2:172.21.15.102:6800/3096737090 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v36'46 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4010064040 con 0x564af1cfbbc0 2024-09-13T19:17:20.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.691+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d15400 con 0x564af1cf72b0 2024-09-13T19:17:20.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.693+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v36'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4008029040 con 0x564af1cf72b0 2024-09-13T19:17:20.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.693+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d15490 con 0x7f401809d040 2024-09-13T19:17:20.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.694+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(69 gc.7 [create,call,call,call] v36'45 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4008029040 con 0x7f401809d040 2024-09-13T19:17:20.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.694+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d15870 con 0x7f4010021020 2024-09-13T19:17:20.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.695+0000 7f4020c45640 1 -- 172.21.15.102:0/1851918305 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v36'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4018074d00 con 0x7f4010021020 2024-09-13T19:17:20.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.695+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d15870 con 0x564af1cfbbc0 2024-09-13T19:17:20.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.696+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 <== osd.3 v2:172.21.15.102:6800/3096737090 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v36'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4010064040 con 0x564af1cfbbc0 2024-09-13T19:17:20.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.696+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d15870 con 0x7f4010021020 2024-09-13T19:17:20.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.697+0000 7f4020c45640 1 -- 172.21.15.102:0/1851918305 <== osd.2 v2:172.21.15.102:6816/2238176080 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v36'71 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4018074d00 con 0x7f4010021020 2024-09-13T19:17:20.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.697+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d15900 con 0x7f401809d040 2024-09-13T19:17:20.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.698+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v36'30 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4008029040 con 0x7f401809d040 2024-09-13T19:17:20.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.698+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d15900 con 0x7f4010021020 2024-09-13T19:17:20.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.699+0000 7f4020c45640 1 -- 172.21.15.102:0/1851918305 <== osd.2 v2:172.21.15.102:6816/2238176080 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v36'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4018074d00 con 0x7f4010021020 2024-09-13T19:17:20.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.699+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d15990 con 0x7f401809d040 2024-09-13T19:17:20.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.700+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(75 gc.13 [create,call,call,call] v36'51 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4008029040 con 0x7f401809d040 2024-09-13T19:17:20.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.700+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d15990 con 0x564af1cf72b0 2024-09-13T19:17:20.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.701+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v36'220 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4008029040 con 0x564af1cf72b0 2024-09-13T19:17:20.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.701+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d15990 con 0x564af1cfbbc0 2024-09-13T19:17:20.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.703+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 <== osd.3 v2:172.21.15.102:6800/3096737090 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v36'62 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4010064040 con 0x564af1cfbbc0 2024-09-13T19:17:20.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.703+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d15990 con 0x7f4010021020 2024-09-13T19:17:20.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.704+0000 7f4020c45640 1 -- 172.21.15.102:0/1851918305 <== osd.2 v2:172.21.15.102:6816/2238176080 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v36'72 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4018074d00 con 0x7f4010021020 2024-09-13T19:17:20.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.704+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d15990 con 0x564af1cfbbc0 2024-09-13T19:17:20.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.704+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 <== osd.3 v2:172.21.15.102:6800/3096737090 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v36'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4010064040 con 0x564af1cfbbc0 2024-09-13T19:17:20.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.705+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d15990 con 0x564af1cf72b0 2024-09-13T19:17:20.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.706+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v36'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4008029040 con 0x564af1cf72b0 2024-09-13T19:17:20.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.706+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d15900 con 0x564af1cf72b0 2024-09-13T19:17:20.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.707+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v36'221 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4008029040 con 0x564af1cf72b0 2024-09-13T19:17:20.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.707+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d15900 con 0x564af1cfbbc0 2024-09-13T19:17:20.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.708+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 <== osd.3 v2:172.21.15.102:6800/3096737090 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v36'63 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4010064040 con 0x564af1cfbbc0 2024-09-13T19:17:20.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.708+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d15900 con 0x7f4010021020 2024-09-13T19:17:20.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.709+0000 7f4020c45640 1 -- 172.21.15.102:0/1851918305 <== osd.2 v2:172.21.15.102:6816/2238176080 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v36'36 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4018074d00 con 0x7f4010021020 2024-09-13T19:17:20.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.709+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d15900 con 0x564af1cfbbc0 2024-09-13T19:17:20.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.710+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 <== osd.3 v2:172.21.15.102:6800/3096737090 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v36'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4010064040 con 0x564af1cfbbc0 2024-09-13T19:17:20.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.710+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d15900 con 0x564af1cfbbc0 2024-09-13T19:17:20.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.710+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 <== osd.3 v2:172.21.15.102:6800/3096737090 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v36'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4010064040 con 0x564af1cfbbc0 2024-09-13T19:17:20.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.710+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d15900 con 0x564af1cfbbc0 2024-09-13T19:17:20.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.712+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 <== osd.3 v2:172.21.15.102:6800/3096737090 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v36'22 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4010064040 con 0x564af1cfbbc0 2024-09-13T19:17:20.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.712+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d15900 con 0x564af1cfbbc0 2024-09-13T19:17:20.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.712+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 <== osd.3 v2:172.21.15.102:6800/3096737090 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v36'47 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4010064040 con 0x564af1cfbbc0 2024-09-13T19:17:20.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.712+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d15900 con 0x7f401809d040 2024-09-13T19:17:20.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.714+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(88 gc.26 [create,call,call,call] v36'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4008029040 con 0x7f401809d040 2024-09-13T19:17:20.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.714+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d15900 con 0x564af1cfbbc0 2024-09-13T19:17:20.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.715+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 <== osd.3 v2:172.21.15.102:6800/3096737090 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v36'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4010064040 con 0x564af1cfbbc0 2024-09-13T19:17:20.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.715+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d15900 con 0x7f401809d040 2024-09-13T19:17:20.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.716+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(90 gc.28 [create,call,call,call] v36'46 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4008029040 con 0x7f401809d040 2024-09-13T19:17:20.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.716+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d15900 con 0x564af1cfbbc0 2024-09-13T19:17:20.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.717+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 <== osd.3 v2:172.21.15.102:6800/3096737090 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v36'64 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4010064040 con 0x564af1cfbbc0 2024-09-13T19:17:20.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.717+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d15900 con 0x7f401809d040 2024-09-13T19:17:20.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.718+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 20 ==== osd_op_reply(92 gc.30 [create,call,call,call] v36'52 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4008029040 con 0x7f401809d040 2024-09-13T19:17:20.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.718+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d15900 con 0x7f4010021020 2024-09-13T19:17:20.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.719+0000 7f4020c45640 1 -- 172.21.15.102:0/1851918305 <== osd.2 v2:172.21.15.102:6816/2238176080 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v36'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4018074d00 con 0x7f4010021020 2024-09-13T19:17:20.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.720+0000 7f3ed5fe3640 20 reqs_thread_entry: start 2024-09-13T19:17:20.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.720+0000 7f4023151800 20 init_complete bucket index max shards: 11 2024-09-13T19:17:20.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.720+0000 7f4023151800 20 Filter name: none 2024-09-13T19:17:20.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.720+0000 7f3e477fe640 20 reqs_thread_entry: start 2024-09-13T19:17:20.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.720+0000 7f4023151800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-13T19:17:20.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.720+0000 7f4023151800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.720+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1d407e0 con 0x7f4010021020 2024-09-13T19:17:20.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.720+0000 7f4020c45640 1 -- 172.21.15.102:0/1851918305 <== osd.2 v2:172.21.15.102:6816/2238176080 21 ==== osd_op_reply(94 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f4018074d00 con 0x7f4010021020 2024-09-13T19:17:20.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.720+0000 7f4023151800 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T19:17:20.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.720+0000 7f4023151800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-13T19:17:20.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.720+0000 7f4023151800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T19:17:20.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.720+0000 7f4023151800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:17:20.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.720+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:95 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1d430a0 con 0x564af1cf72b0 2024-09-13T19:17:20.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.721+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(95 bud.buckets [call out=184b] v0'0 uv4 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7f4008029040 con 0x564af1cf72b0 2024-09-13T19:17:20.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.721+0000 7f4023151800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:509740b4-c081-4f37-bd6d-df9ca851489b.4237.9 : miss 2024-09-13T19:17:20.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.721+0000 7f4023151800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.721+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:96 8.6 8:601b7b74:root::.bucket.meta.myfoo6%3a509740b4-c081-4f37-bd6d-df9ca851489b.4237.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1d42ef0 con 0x7f401809d040 2024-09-13T19:17:20.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.721+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 21 ==== osd_op_reply(96 .bucket.meta.myfoo6:509740b4-c081-4f37-bd6d-df9ca851489b.4237.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=212b] v0'0 uv3 ondisk = 0) ==== 333+0+656 (crc 0 0 0) 0x7f4008029040 con 0x7f401809d040 2024-09-13T19:17:20.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.721+0000 7f4023151800 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T19:17:20.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.721+0000 7f4023151800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:509740b4-c081-4f37-bd6d-df9ca851489b.4237.9 info.flags=0x17 2024-09-13T19:17:20.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.721+0000 7f4023151800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:509740b4-c081-4f37-bd6d-df9ca851489b.4237.9 to cache LRU end 2024-09-13T19:17:20.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.721+0000 7f4023151800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:17:20.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.721+0000 7f4023151800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-13T19:17:20.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.721+0000 7f4023151800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:509740b4-c081-4f37-bd6d-df9ca851489b.4237.9 2024-09-13T19:17:20.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.721+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:97 4.24 4:2647217c:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1dc0450 con 0x7f401809d040 2024-09-13T19:17:20.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.722+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 22 ==== osd_op_reply(97 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.0 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4008029040 con 0x7f401809d040 2024-09-13T19:17:20.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.722+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:98 4.19 4:989757a2:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1dc0450 con 0x564af1cfbbc0 2024-09-13T19:17:20.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.722+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 <== osd.3 v2:172.21.15.102:6800/3096737090 28 ==== osd_op_reply(98 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4010064040 con 0x564af1cfbbc0 2024-09-13T19:17:20.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.722+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:99 4.10 4:0836b9cc:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1dc0450 con 0x7f4010021020 2024-09-13T19:17:20.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.722+0000 7f4020c45640 1 -- 172.21.15.102:0/1851918305 <== osd.2 v2:172.21.15.102:6816/2238176080 22 ==== osd_op_reply(99 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.2 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4018074d00 con 0x7f4010021020 2024-09-13T19:17:20.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.722+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:100 4.11 4:8b972b0a:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1dc0450 con 0x7f401809d040 2024-09-13T19:17:20.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.723+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 23 ==== osd_op_reply(100 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4008029040 con 0x7f401809d040 2024-09-13T19:17:20.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.723+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:101 4.2b 4:d4752399:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1dc0450 con 0x7f4010021020 2024-09-13T19:17:20.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.723+0000 7f4020c45640 1 -- 172.21.15.102:0/1851918305 <== osd.2 v2:172.21.15.102:6816/2238176080 23 ==== osd_op_reply(101 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4018074d00 con 0x7f4010021020 2024-09-13T19:17:20.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.723+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:102 4.3a 4:5caec590:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1dc03d0 con 0x564af1cfbbc0 2024-09-13T19:17:20.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.723+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 <== osd.3 v2:172.21.15.102:6800/3096737090 29 ==== osd_op_reply(102 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4010064040 con 0x564af1cfbbc0 2024-09-13T19:17:20.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.723+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:103 4.38 4:1c39a408:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1dc03d0 con 0x564af1cf72b0 2024-09-13T19:17:20.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.724+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.1 v2:172.21.15.102:6808/2204418452 28 ==== osd_op_reply(103 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4008029040 con 0x564af1cf72b0 2024-09-13T19:17:20.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.724+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:104 4.35 4:ae835331:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1dc03d0 con 0x564af1cf72b0 2024-09-13T19:17:20.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.724+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.1 v2:172.21.15.102:6808/2204418452 29 ==== osd_op_reply(104 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4008029040 con 0x564af1cf72b0 2024-09-13T19:17:20.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.724+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:105 4.5 4:a026ac9d:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1dc03d0 con 0x564af1cfbbc0 2024-09-13T19:17:20.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.724+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 <== osd.3 v2:172.21.15.102:6800/3096737090 30 ==== osd_op_reply(105 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.8 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4010064040 con 0x564af1cfbbc0 2024-09-13T19:17:20.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.724+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:106 4.4 4:22eb769a:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1dc03d0 con 0x7f401809d040 2024-09-13T19:17:20.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.725+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 24 ==== osd_op_reply(106 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.9 [call out=345b] v0'0 uv7 ondisk = 0) ==== 194+0+345 (crc 0 0 0) 0x7f4008045170 con 0x7f401809d040 2024-09-13T19:17:20.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.725+0000 7f4023151800 10 cls_bucket_list_unordered: got thirteen 2024-09-13T19:17:20.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.725+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:107 4.2e 4:74b87096:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1dc0410 con 0x7f401809d040 2024-09-13T19:17:20.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.725+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 25 ==== osd_op_reply(107 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f4008045170 con 0x7f401809d040 2024-09-13T19:17:20.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.725+0000 7f4023151800 20 get_obj_state: octx=0x7f401806c4f0 obj=myfoo6:thirteen state=0x564af1dbe4f8 s->prefetch_data=0 2024-09-13T19:17:20.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.725+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:108 3.cs0 3:3148eb56:::509740b4-c081-4f37-bd6d-df9ca851489b.4237.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1dbf320 con 0x564af1cfbbc0 2024-09-13T19:17:20.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.726+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 <== osd.3 v2:172.21.15.102:6800/3096737090 31 ==== osd_op_reply(108 509740b4-c081-4f37-bd6d-df9ca851489b.4237.9_thirteen [getxattrs out=820b,stat out=16b] v0'0 uv4 ondisk = 0) ==== 238+0+836 (crc 0 0 0) 0x7f401006d350 con 0x564af1cfbbc0 2024-09-13T19:17:20.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.726+0000 7f4023151800 10 manifest: total_size = 8 2024-09-13T19:17:20.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.726+0000 7f4023151800 20 get_obj_state: setting s->obj_tag to _WfJg_u3OOqK7ADMZ6FlVKS2B4mnRX7b 2024-09-13T19:17:20.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.726+0000 7f4023151800 20 get_obj_state: octx=0x7f401806c4f0 obj=myfoo6:thirteen state=0x564af1dbe4f8 s->prefetch_data=0 2024-09-13T19:17:20.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.726+0000 7f4023151800 20 prepare_atomic_modification: state is not atomic. state=0x564af1dbe4f8 2024-09-13T19:17:20.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.726+0000 7f4023151800 20 bucket index object: :.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.9 2024-09-13T19:17:20.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.726+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:109 4.4 4:22eb769a:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1dbfbb0 con 0x7f401809d040 2024-09-13T19:17:20.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.727+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 26 ==== osd_op_reply(109 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.9 [stat,call,call] v36'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f4008045170 con 0x7f401809d040 2024-09-13T19:17:20.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.727+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:110 3.cs0 3:3148eb56:::509740b4-c081-4f37-bd6d-df9ca851489b.4237.9_thirteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1dbfbb0 con 0x564af1cfbbc0 2024-09-13T19:17:20.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.728+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 <== osd.3 v2:172.21.15.102:6800/3096737090 32 ==== osd_op_reply(110 509740b4-c081-4f37-bd6d-df9ca851489b.4237.9_thirteen [call] v36'5 uv5 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7f401006d350 con 0x564af1cfbbc0 2024-09-13T19:17:20.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.728+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:111 4.4 4:22eb769a:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=264b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d475f0 con 0x7f401809d040 2024-09-13T19:17:20.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.728+0000 7f4023151800 20 list_objects_ordered: starting attempt 1 2024-09-13T19:17:20.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.728+0000 7f4023151800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-13T19:17:20.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.728+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:112 4.24 4:2647217c:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1d475f0 con 0x7f401809d040 2024-09-13T19:17:20.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.728+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:113 4.19 4:989757a2:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1d4b8e0 con 0x564af1cfbbc0 2024-09-13T19:17:20.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.728+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:114 4.10 4:0836b9cc:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1d4e1e0 con 0x7f4010021020 2024-09-13T19:17:20.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.728+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:115 4.11 4:8b972b0a:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1d50b20 con 0x7f401809d040 2024-09-13T19:17:20.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.729+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:116 4.2b 4:d4752399:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1d50b20 con 0x7f4010021020 2024-09-13T19:17:20.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.729+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:117 4.3a 4:5caec590:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1d55930 con 0x564af1cfbbc0 2024-09-13T19:17:20.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.729+0000 7f4020c45640 1 -- 172.21.15.102:0/1851918305 <== osd.2 v2:172.21.15.102:6816/2238176080 24 ==== osd_op_reply(114 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.2 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4018074d00 con 0x7f4010021020 2024-09-13T19:17:20.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.729+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 <== osd.3 v2:172.21.15.102:6800/3096737090 33 ==== osd_op_reply(113 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f401006d350 con 0x564af1cfbbc0 2024-09-13T19:17:20.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.729+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 27 ==== osd_op_reply(115 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4008045170 con 0x7f401809d040 2024-09-13T19:17:20.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.729+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 28 ==== osd_op_reply(112 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.0 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4008045170 con 0x7f401809d040 2024-09-13T19:17:20.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.729+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:118 4.38 4:1c39a408:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1dbddc0 con 0x564af1cf72b0 2024-09-13T19:17:20.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.729+0000 7f4020c45640 1 -- 172.21.15.102:0/1851918305 <== osd.2 v2:172.21.15.102:6816/2238176080 25 ==== osd_op_reply(116 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4018074d00 con 0x7f4010021020 2024-09-13T19:17:20.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.729+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:119 4.35 4:ae835331:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1dbe310 con 0x564af1cf72b0 2024-09-13T19:17:20.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.729+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:120 4.5 4:a026ac9d:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1d51fa0 con 0x564af1cfbbc0 2024-09-13T19:17:20.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.729+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:121 4.4 4:22eb769a:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1d52570 con 0x7f401809d040 2024-09-13T19:17:20.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.729+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:122 4.2e 4:74b87096:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1d57950 con 0x7f401809d040 2024-09-13T19:17:20.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.729+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 <== osd.3 v2:172.21.15.102:6800/3096737090 34 ==== osd_op_reply(117 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f401006d350 con 0x564af1cfbbc0 2024-09-13T19:17:20.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.729+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 <== osd.3 v2:172.21.15.102:6800/3096737090 35 ==== osd_op_reply(120 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.8 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f401006d350 con 0x564af1cfbbc0 2024-09-13T19:17:20.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.730+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.1 v2:172.21.15.102:6808/2204418452 30 ==== osd_op_reply(118 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4008045170 con 0x564af1cf72b0 2024-09-13T19:17:20.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.730+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.1 v2:172.21.15.102:6808/2204418452 31 ==== osd_op_reply(119 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4008045170 con 0x564af1cf72b0 2024-09-13T19:17:20.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.730+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 29 ==== osd_op_reply(111 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.9 [stat,call,call] v36'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f400804b040 con 0x7f401809d040 2024-09-13T19:17:20.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.730+0000 7f3ef77fe640 20 handle_completion(): completion ok for obj=thirteen 2024-09-13T19:17:20.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.730+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 30 ==== osd_op_reply(121 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.9 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f400804b040 con 0x7f401809d040 2024-09-13T19:17:20.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.730+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 31 ==== osd_op_reply(122 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f400804b040 con 0x7f401809d040 2024-09-13T19:17:20.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.730+0000 7f4023151800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-13T19:17:20.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.730+0000 7f4023151800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-13T19:17:20.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.730+0000 7f4023151800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-13T19:17:20.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.730+0000 7f4023151800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-13T19:17:20.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.730+0000 7f4023151800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo6[509740b4-c081-4f37-bd6d-df9ca851489b.4237.9])"; uploads.size()=0; is_truncated=0 2024-09-13T19:17:20.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.730+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:123 4.24 4:2647217c:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1d51fa0 con 0x7f401809d040 2024-09-13T19:17:20.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.730+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:124 4.19 4:989757a2:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1dbe200 con 0x564af1cfbbc0 2024-09-13T19:17:20.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.730+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:125 4.10 4:0836b9cc:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1d51fa0 con 0x7f4010021020 2024-09-13T19:17:20.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.730+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:126 4.11 4:8b972b0a:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1d52a70 con 0x7f401809d040 2024-09-13T19:17:20.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.730+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:127 4.2b 4:d4752399:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1dbe200 con 0x7f4010021020 2024-09-13T19:17:20.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.730+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:128 4.3a 4:5caec590:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1d51fa0 con 0x564af1cfbbc0 2024-09-13T19:17:20.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.730+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:129 4.38 4:1c39a408:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1dbe200 con 0x564af1cf72b0 2024-09-13T19:17:20.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.730+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:130 4.35 4:ae835331:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1d52a70 con 0x564af1cf72b0 2024-09-13T19:17:20.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.730+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:131 4.5 4:a026ac9d:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1d51fa0 con 0x564af1cfbbc0 2024-09-13T19:17:20.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.730+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:132 4.4 4:22eb769a:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1d5c9c0 con 0x7f401809d040 2024-09-13T19:17:20.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.730+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:133 4.2e 4:74b87096:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1d5f730 con 0x7f401809d040 2024-09-13T19:17:20.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.730+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 32 ==== osd_op_reply(123 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.0 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f400804b040 con 0x7f401809d040 2024-09-13T19:17:20.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.730+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 33 ==== osd_op_reply(126 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f400804b040 con 0x7f401809d040 2024-09-13T19:17:20.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.731+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 <== osd.3 v2:172.21.15.102:6800/3096737090 36 ==== osd_op_reply(124 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4010073060 con 0x564af1cfbbc0 2024-09-13T19:17:20.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.731+0000 7f4020c45640 1 -- 172.21.15.102:0/1851918305 <== osd.2 v2:172.21.15.102:6816/2238176080 26 ==== osd_op_reply(125 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.2 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4018074d00 con 0x7f4010021020 2024-09-13T19:17:20.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.731+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 34 ==== osd_op_reply(132 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.9 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f400804b040 con 0x7f401809d040 2024-09-13T19:17:20.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.731+0000 7f4020c45640 1 -- 172.21.15.102:0/1851918305 <== osd.2 v2:172.21.15.102:6816/2238176080 27 ==== osd_op_reply(127 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4018074d00 con 0x7f4010021020 2024-09-13T19:17:20.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.731+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 <== osd.3 v2:172.21.15.102:6800/3096737090 37 ==== osd_op_reply(128 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4010073060 con 0x564af1cfbbc0 2024-09-13T19:17:20.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.731+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 35 ==== osd_op_reply(133 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f400804b040 con 0x7f401809d040 2024-09-13T19:17:20.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.731+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.1 v2:172.21.15.102:6808/2204418452 32 ==== osd_op_reply(129 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f400804b040 con 0x564af1cf72b0 2024-09-13T19:17:20.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.731+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.1 v2:172.21.15.102:6808/2204418452 33 ==== osd_op_reply(130 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f400804b040 con 0x564af1cf72b0 2024-09-13T19:17:20.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.731+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 <== osd.3 v2:172.21.15.102:6800/3096737090 38 ==== osd_op_reply(131 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.8 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4010073060 con 0x564af1cfbbc0 2024-09-13T19:17:20.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.731+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:134 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d51f80 con 0x564af1cf72b0 2024-09-13T19:17:20.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.732+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.1 v2:172.21.15.102:6808/2204418452 34 ==== osd_op_reply(134 bud.buckets [call] v36'5 uv5 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f400804b040 con 0x564af1cf72b0 2024-09-13T19:17:20.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.732+0000 7f4023151800 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-09-13T19:17:20.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.732+0000 7f4023151800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.732+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:135 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1d51f80 con 0x564af1cf72b0 2024-09-13T19:17:20.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.732+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.1 v2:172.21.15.102:6808/2204418452 35 ==== osd_op_reply(135 myfoo6 [call out=48b,read 0~166 out=166b] v0'0 uv17 ondisk = 0) ==== 192+0+214 (crc 0 0 0) 0x7f400804b040 con 0x564af1cf72b0 2024-09-13T19:17:20.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.732+0000 7f4023151800 20 rados_obj.operate() r=0 bl.length=166 2024-09-13T19:17:20.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.732+0000 7f4023151800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x11 2024-09-13T19:17:20.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.732+0000 7f4023151800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-13T19:17:20.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.732+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:136 8.18 8:1944a257:root::myfoo6:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d51f80 con 0x564af1cf72b0 2024-09-13T19:17:20.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.733+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.1 v2:172.21.15.102:6808/2204418452 36 ==== osd_op_reply(136 myfoo6 [call,call,delete] v36'18 uv18 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f400804b040 con 0x564af1cf72b0 2024-09-13T19:17:20.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.733+0000 7f4023151800 10 removing default.rgw.meta+root+myfoo6 from cache 2024-09-13T19:17:20.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.733+0000 7f4023151800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-13T19:17:20.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.733+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94879885289440 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1d51f80 con 0x7f4010021020 2024-09-13T19:17:20.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.733+0000 7f4020c45640 1 -- 172.21.15.102:0/1851918305 <== osd.2 v2:172.21.15.102:6816/2238176080 28 ==== watch-notify(notify (1) cookie 94879884529168 notify 154618822675 ret 0) ==== 192+0+0 (crc 0 0 0) 0x564af1d14580 con 0x7f4010021020 2024-09-13T19:17:20.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.733+0000 7f3ef7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822675 cookie 94879884529168 notifier 4762 bl.length()=150 2024-09-13T19:17:20.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.733+0000 7f4020c45640 1 -- 172.21.15.102:0/1851918305 <== osd.2 v2:172.21.15.102:6816/2238176080 29 ==== osd_op_reply(137 notify.3 [notify cookie 94879885289440 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4018074d00 con 0x7f4010021020 2024-09-13T19:17:20.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.733+0000 7f3ef7fff640 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f3ee4003d60 con 0x7f4010021020 2024-09-13T19:17:20.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.734+0000 7f4020c45640 1 -- 172.21.15.102:0/1851918305 <== osd.2 v2:172.21.15.102:6816/2238176080 30 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4018074d00 con 0x7f4010021020 2024-09-13T19:17:20.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.734+0000 7f4020c45640 1 -- 172.21.15.102:0/1851918305 <== osd.2 v2:172.21.15.102:6816/2238176080 31 ==== watch-notify(notify_complete (2) cookie 94879885289440 notify 154618822675 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f40180af040 con 0x7f4010021020 2024-09-13T19:17:20.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.734+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:139 8.6 8:601b7b74:root::.bucket.meta.myfoo6%3a509740b4-c081-4f37-bd6d-df9ca851489b.4237.9:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d51f80 con 0x7f401809d040 2024-09-13T19:17:20.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.735+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 36 ==== osd_op_reply(139 .bucket.meta.myfoo6:509740b4-c081-4f37-bd6d-df9ca851489b.4237.9 [call,call,delete] v36'4 uv4 ondisk = 0) ==== 291+0+0 (crc 0 0 0) 0x7f400804b040 con 0x7f401809d040 2024-09-13T19:17:20.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.735+0000 7f4023151800 10 removing default.rgw.meta+root+.bucket.meta.myfoo6:509740b4-c081-4f37-bd6d-df9ca851489b.4237.9 from cache 2024-09-13T19:17:20.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.735+0000 7f4023151800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo6:509740b4-c081-4f37-bd6d-df9ca851489b.4237.9, ofs0, ns] 2024-09-13T19:17:20.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.735+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:140 7.9 7:93e5b521:::notify.7:head [notify cookie 94879885289440 in=219b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1d51f80 con 0x7f401809d040 2024-09-13T19:17:20.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.735+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 37 ==== watch-notify(notify (1) cookie 94879884536816 notify 154618822687 ret 0) ==== 249+0+0 (crc 0 0 0) 0x564af1d42400 con 0x7f401809d040 2024-09-13T19:17:20.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.735+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 38 ==== osd_op_reply(140 notify.7 [notify cookie 94879885289440 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f400804b040 con 0x7f401809d040 2024-09-13T19:17:20.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.735+0000 7f3ef7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822687 cookie 94879884536816 notifier 4762 bl.length()=207 2024-09-13T19:17:20.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.735+0000 7f3ef7fff640 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:141 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f3ee4003d60 con 0x7f401809d040 2024-09-13T19:17:20.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.736+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 39 ==== watch-notify(notify_complete (2) cookie 94879885289440 notify 154618822687 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564af1cebf20 con 0x7f401809d040 2024-09-13T19:17:20.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.736+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 40 ==== osd_op_reply(141 notify.7 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f400804b040 con 0x7f401809d040 2024-09-13T19:17:20.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.736+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:142 4.24 4:2647217c:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d5c9c0 con 0x7f401809d040 2024-09-13T19:17:20.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.736+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:143 4.19 4:989757a2:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d42e10 con 0x564af1cfbbc0 2024-09-13T19:17:20.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.736+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:144 4.10 4:0836b9cc:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d52390 con 0x7f4010021020 2024-09-13T19:17:20.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.736+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:145 4.11 4:8b972b0a:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d529f0 con 0x7f401809d040 2024-09-13T19:17:20.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.736+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:146 4.2b 4:d4752399:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d416e0 con 0x7f4010021020 2024-09-13T19:17:20.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.736+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:147 4.3a 4:5caec590:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d41b10 con 0x564af1cfbbc0 2024-09-13T19:17:20.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.736+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:148 4.38 4:1c39a408:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d52390 con 0x564af1cf72b0 2024-09-13T19:17:20.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.736+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:149 4.35 4:ae835331:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d529f0 con 0x564af1cf72b0 2024-09-13T19:17:20.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.736+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:150 4.5 4:a026ac9d:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d416e0 con 0x564af1cfbbc0 2024-09-13T19:17:20.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.737+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:151 4.4 4:22eb769a:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d41b10 con 0x7f401809d040 2024-09-13T19:17:20.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.737+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:152 4.2e 4:74b87096:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d52390 con 0x7f401809d040 2024-09-13T19:17:20.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.737+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 <== osd.3 v2:172.21.15.102:6800/3096737090 39 ==== osd_op_reply(147 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.5 [delete] v36'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f4010073060 con 0x564af1cfbbc0 2024-09-13T19:17:20.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.738+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 <== osd.3 v2:172.21.15.102:6800/3096737090 40 ==== osd_op_reply(143 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.1 [delete] v36'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f4010073060 con 0x564af1cfbbc0 2024-09-13T19:17:20.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.738+0000 7f4020c45640 1 -- 172.21.15.102:0/1851918305 <== osd.2 v2:172.21.15.102:6816/2238176080 32 ==== osd_op_reply(144 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.2 [delete] v36'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f4018074d00 con 0x7f4010021020 2024-09-13T19:17:20.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.738+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.1 v2:172.21.15.102:6808/2204418452 37 ==== osd_op_reply(148 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.6 [delete] v36'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f400804b040 con 0x564af1cf72b0 2024-09-13T19:17:20.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.738+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 41 ==== osd_op_reply(142 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.0 [delete] v36'5 uv5 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f400804b040 con 0x7f401809d040 2024-09-13T19:17:20.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.738+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 42 ==== osd_op_reply(145 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.3 [delete] v36'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f400804b040 con 0x7f401809d040 2024-09-13T19:17:20.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.738+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.1 v2:172.21.15.102:6808/2204418452 38 ==== osd_op_reply(149 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.7 [delete] v36'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f400804b040 con 0x564af1cf72b0 2024-09-13T19:17:20.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.738+0000 7f4020c45640 1 -- 172.21.15.102:0/1851918305 <== osd.2 v2:172.21.15.102:6816/2238176080 33 ==== osd_op_reply(146 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.4 [delete] v36'3 uv3 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f4018074d00 con 0x7f4010021020 2024-09-13T19:17:20.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.738+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 <== osd.3 v2:172.21.15.102:6800/3096737090 41 ==== osd_op_reply(150 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.8 [delete] v36'5 uv5 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f4010073060 con 0x564af1cfbbc0 2024-09-13T19:17:20.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.738+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 43 ==== osd_op_reply(152 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.10 [delete] v36'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f400804b040 con 0x7f401809d040 2024-09-13T19:17:20.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.738+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 44 ==== osd_op_reply(151 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.9.9 [delete] v36'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f400804b040 con 0x7f401809d040 2024-09-13T19:17:20.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.739+0000 7f4023151800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo6/509740b4-c081-4f37-bd6d-df9ca851489b.4237.9 : miss 2024-09-13T19:17:20.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.739+0000 7f4023151800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.739+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:153 6.13 6:c9c600bb:::pubsub..bucket.myfoo6%2f509740b4-c081-4f37-bd6d-df9ca851489b.4237.9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1d529f0 con 0x7f401809d040 2024-09-13T19:17:20.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.739+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 45 ==== osd_op_reply(153 pubsub..bucket.myfoo6/509740b4-c081-4f37-bd6d-df9ca851489b.4237.9 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7f400804b040 con 0x7f401809d040 2024-09-13T19:17:20.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.739+0000 7f4023151800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:20.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.739+0000 7f4023151800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo6/509740b4-c081-4f37-bd6d-df9ca851489b.4237.9 info.flags=0x0 2024-09-13T19:17:20.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.739+0000 7f4023151800 10 adding default.rgw.log++pubsub..bucket.myfoo6/509740b4-c081-4f37-bd6d-df9ca851489b.4237.9 to cache LRU end 2024-09-13T19:17:20.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.739+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:154 6.13 6:c9c600bb:::pubsub..bucket.myfoo6%2f509740b4-c081-4f37-bd6d-df9ca851489b.4237.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1dbfad0 con 0x7f401809d040 2024-09-13T19:17:20.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.740+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 46 ==== osd_op_reply(154 pubsub..bucket.myfoo6/509740b4-c081-4f37-bd6d-df9ca851489b.4237.9 [delete] v36'31 uv29 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7f400804b040 con 0x7f401809d040 2024-09-13T19:17:20.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.740+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:155 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1dbfad0 con 0x564af1cf72b0 2024-09-13T19:17:20.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.741+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.1 v2:172.21.15.102:6808/2204418452 39 ==== osd_op_reply(155 bud.buckets [call] v36'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f400804b040 con 0x564af1cf72b0 2024-09-13T19:17:20.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.741+0000 7f4023151800 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2024-09-13T19:17:20.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.741+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:156 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1dbfad0 con 0x564af1cf72b0 2024-09-13T19:17:20.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.741+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.1 v2:172.21.15.102:6808/2204418452 40 ==== osd_op_reply(156 NX5QOQKC6BH2IDN8HC7A [delete] v36'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f400804b040 con 0x564af1cf72b0 2024-09-13T19:17:20.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.741+0000 7f4023151800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-13T19:17:20.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.741+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:157 7.3 7:c609908c:::notify.5:head [notify cookie 94879885289440 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1d5c950 con 0x7f401809d040 2024-09-13T19:17:20.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.742+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 47 ==== watch-notify(notify (1) cookie 94879884534128 notify 154618822688 ret 0) ==== 212+0+0 (crc 0 0 0) 0x564af1cebf20 con 0x7f401809d040 2024-09-13T19:17:20.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.742+0000 7f3ef77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822688 cookie 94879884534128 notifier 4762 bl.length()=170 2024-09-13T19:17:20.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.742+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 48 ==== osd_op_reply(157 notify.5 [notify cookie 94879885289440 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f400804b040 con 0x7f401809d040 2024-09-13T19:17:20.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.742+0000 7f3ef77fe640 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:158 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f3e54003320 con 0x7f401809d040 2024-09-13T19:17:20.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.742+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 49 ==== watch-notify(notify_complete (2) cookie 94879885289440 notify 154618822688 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564af1d140c0 con 0x7f401809d040 2024-09-13T19:17:20.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.742+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 50 ==== osd_op_reply(158 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f400804b040 con 0x7f401809d040 2024-09-13T19:17:20.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.742+0000 7f4023151800 10 removing email index: 2024-09-13T19:17:20.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.742+0000 7f4023151800 10 removing user buckets index 2024-09-13T19:17:20.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.742+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:159 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1dbfad0 con 0x564af1cf72b0 2024-09-13T19:17:20.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.743+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.1 v2:172.21.15.102:6808/2204418452 41 ==== osd_op_reply(159 bud.buckets [delete] v36'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f400804b040 con 0x564af1cf72b0 2024-09-13T19:17:20.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.743+0000 7f4023151800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2024-09-13T19:17:20.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.743+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94879885289440 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1d5c950 con 0x7f401809d040 2024-09-13T19:17:20.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.744+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 51 ==== watch-notify(notify (1) cookie 94879884538384 notify 154618822689 ret 0) ==== 202+0+0 (crc 0 0 0) 0x564af1d140c0 con 0x7f401809d040 2024-09-13T19:17:20.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.744+0000 7f3ef77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822689 cookie 94879884538384 notifier 4762 bl.length()=160 2024-09-13T19:17:20.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.744+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 52 ==== osd_op_reply(160 notify.6 [notify cookie 94879885289440 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f400804b040 con 0x7f401809d040 2024-09-13T19:17:20.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.744+0000 7f3ef77fe640 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f3e54003320 con 0x7f401809d040 2024-09-13T19:17:20.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.744+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 53 ==== watch-notify(notify_complete (2) cookie 94879885289440 notify 154618822689 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564af1d13ef0 con 0x7f401809d040 2024-09-13T19:17:20.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.744+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 54 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f400804b040 con 0x7f401809d040 2024-09-13T19:17:20.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.744+0000 7f4023151800 10 removing user index: bud 2024-09-13T19:17:20.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.744+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:162 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1dbfad0 con 0x7f4010021020 2024-09-13T19:17:20.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.745+0000 7f4020c45640 1 -- 172.21.15.102:0/1851918305 <== osd.2 v2:172.21.15.102:6816/2238176080 34 ==== osd_op_reply(162 bud [call,call,delete] v36'5 uv5 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f4018074d00 con 0x7f4010021020 2024-09-13T19:17:20.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.745+0000 7f4023151800 10 removing default.rgw.meta+users.uid+bud from cache 2024-09-13T19:17:20.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.745+0000 7f4023151800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-13T19:17:20.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.745+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94879885289440 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564af1d5c950 con 0x7f401809d040 2024-09-13T19:17:20.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.746+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 55 ==== watch-notify(notify (1) cookie 94879884534128 notify 154618822690 ret 0) ==== 194+0+0 (crc 0 0 0) 0x564af1d13ef0 con 0x7f401809d040 2024-09-13T19:17:20.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.746+0000 7f3ef77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822690 cookie 94879884534128 notifier 4762 bl.length()=152 2024-09-13T19:17:20.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.746+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 56 ==== osd_op_reply(163 notify.5 [notify cookie 94879885289440 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f400804b040 con 0x7f401809d040 2024-09-13T19:17:20.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.746+0000 7f3ef77fe640 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f3e540032c0 con 0x7f401809d040 2024-09-13T19:17:20.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.746+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 57 ==== watch-notify(notify_complete (2) cookie 94879885289440 notify 154618822690 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564af1d142d0 con 0x7f401809d040 2024-09-13T19:17:20.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.746+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 58 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f400804b040 con 0x7f401809d040 2024-09-13T19:17:20.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.747+0000 7f3ed6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:17:20.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.747+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94879884541936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1dbe7e0 con 0x564af1cf72b0 2024-09-13T19:17:20.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.748+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.1 v2:172.21.15.102:6808/2204418452 42 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94879884541936] v36'222 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f400804b040 con 0x564af1cf72b0 2024-09-13T19:17:20.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.748+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94879884516096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d07ff0 con 0x7f4010021020 2024-09-13T19:17:20.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.749+0000 7f4020c45640 1 -- 172.21.15.102:0/1851918305 <== osd.2 v2:172.21.15.102:6816/2238176080 35 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94879884516096] v36'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4018074d00 con 0x7f4010021020 2024-09-13T19:17:20.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.749+0000 7f4023151800 20 remove_watcher() i=0 2024-09-13T19:17:20.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.749+0000 7f4023151800 2 removed watcher, disabling cache 2024-09-13T19:17:20.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.749+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94879884518304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d07ff0 con 0x564af1cf72b0 2024-09-13T19:17:20.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.750+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.1 v2:172.21.15.102:6808/2204418452 43 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94879884518304] v36'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f400804b040 con 0x564af1cf72b0 2024-09-13T19:17:20.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.750+0000 7f4023151800 20 remove_watcher() i=1 2024-09-13T19:17:20.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.750+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94879884526368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d07ff0 con 0x564af1cfbbc0 2024-09-13T19:17:20.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.751+0000 7f4021446640 1 -- 172.21.15.102:0/1851918305 <== osd.3 v2:172.21.15.102:6800/3096737090 42 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94879884526368] v36'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4010073060 con 0x564af1cfbbc0 2024-09-13T19:17:20.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.751+0000 7f4023151800 20 remove_watcher() i=2 2024-09-13T19:17:20.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.751+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94879884529168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d04320 con 0x7f4010021020 2024-09-13T19:17:20.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.752+0000 7f4020c45640 1 -- 172.21.15.102:0/1851918305 <== osd.2 v2:172.21.15.102:6816/2238176080 36 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94879884529168] v36'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4018074d00 con 0x7f4010021020 2024-09-13T19:17:20.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.752+0000 7f4023151800 20 remove_watcher() i=3 2024-09-13T19:17:20.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.752+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94879884524576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d04320 con 0x564af1cf72b0 2024-09-13T19:17:20.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.753+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.1 v2:172.21.15.102:6808/2204418452 44 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94879884524576] v36'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f400804b040 con 0x564af1cf72b0 2024-09-13T19:17:20.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.753+0000 7f4023151800 20 remove_watcher() i=4 2024-09-13T19:17:20.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.753+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94879884534128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d03c20 con 0x7f401809d040 2024-09-13T19:17:20.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.754+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 59 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94879884534128] v36'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f400804b040 con 0x7f401809d040 2024-09-13T19:17:20.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.754+0000 7f4023151800 20 remove_watcher() i=5 2024-09-13T19:17:20.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.754+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94879884538384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d04320 con 0x7f401809d040 2024-09-13T19:17:20.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.755+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 60 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94879884538384] v36'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f400804b040 con 0x7f401809d040 2024-09-13T19:17:20.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.755+0000 7f4023151800 20 remove_watcher() i=6 2024-09-13T19:17:20.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.755+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94879884536816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564af1d06170 con 0x7f401809d040 2024-09-13T19:17:20.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.757+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 <== osd.0 v2:172.21.15.53:6800/4021716951 61 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94879884536816] v36'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f400804b040 con 0x7f401809d040 2024-09-13T19:17:20.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.757+0000 7f4023151800 20 remove_watcher() i=7 2024-09-13T19:17:20.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.757+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f401809d040 msgr2=0x7f4018090390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.757+0000 7f4023151800 1 --2- 172.21.15.102:0/1851918305 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f401809d040 0x7f4018090390 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.757+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x564af1cf72b0 msgr2=0x564af1cf9770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.757+0000 7f4023151800 1 --2- 172.21.15.102:0/1851918305 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x564af1cf72b0 0x564af1cf9770 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.757+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f4010021020 msgr2=0x7f4010045190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.757+0000 7f4023151800 1 --2- 172.21.15.102:0/1851918305 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f4010021020 0x7f4010045190 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.757+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x564af1cfbbc0 msgr2=0x564af1cfdfb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.757+0000 7f4023151800 1 --2- 172.21.15.102:0/1851918305 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x564af1cfbbc0 0x564af1cfdfb0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.757+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3eec036b40 msgr2=0x7f3eec039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.757+0000 7f4023151800 1 --2- 172.21.15.102:0/1851918305 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3eec036b40 0x7f3eec039000 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f401808f230 tx=0x7f4018096000 comp rx=0 tx=0).stop 2024-09-13T19:17:20.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.757+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af1ce43d0 msgr2=0x564af1ceb750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.757+0000 7f4020444640 1 -- 172.21.15.102:0/1851918305 reap_dead start 2024-09-13T19:17:20.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.757+0000 7f4023151800 1 --2- 172.21.15.102:0/1851918305 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af1ce43d0 0x564af1ceb750 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f40100168b0 tx=0x7f401004c5f0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.757+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 shutdown_connections 2024-09-13T19:17:20.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.757+0000 7f4023151800 1 --2- 172.21.15.102:0/1851918305 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af1ce43d0 0x564af1ceb750 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.757+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 >> 172.21.15.102:0/1851918305 conn(0x564af1ce0730 msgr2=0x564af1cde800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:20.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.758+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 shutdown_connections 2024-09-13T19:17:20.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.758+0000 7f4023151800 1 -- 172.21.15.102:0/1851918305 wait complete. 2024-09-13T19:17:20.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.758+0000 7f4023151800 1 -- 172.21.15.102:0/3577296649 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3ef8036bb0 msgr2=0x7f3ef8039070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.758+0000 7f4023151800 1 --2- 172.21.15.102:0/3577296649 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3ef8036bb0 0x7f3ef8039070 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x564af1cc4850 tx=0x7f4018063480 comp rx=0 tx=0).stop 2024-09-13T19:17:20.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.758+0000 7f4023151800 1 -- 172.21.15.102:0/3577296649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af1cd7700 msgr2=0x564af1cd7b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.758+0000 7f4023151800 1 --2- 172.21.15.102:0/3577296649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af1cd7700 0x564af1cd7b20 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x564af1cbd6d0 tx=0x7f401000beb0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.758+0000 7f4023151800 1 -- 172.21.15.102:0/3577296649 shutdown_connections 2024-09-13T19:17:20.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.758+0000 7f4023151800 1 --2- 172.21.15.102:0/3577296649 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3ef8036bb0 0x7f3ef8039070 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.758+0000 7f4023151800 1 --2- 172.21.15.102:0/3577296649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af1cd7700 0x564af1cd7b20 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.758+0000 7f4023151800 1 -- 172.21.15.102:0/3577296649 >> 172.21.15.102:0/3577296649 conn(0x564af1ccc690 msgr2=0x564af1ccf210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:20.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.758+0000 7f4023151800 1 -- 172.21.15.102:0/3577296649 shutdown_connections 2024-09-13T19:17:20.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.758+0000 7f4023151800 1 -- 172.21.15.102:0/3577296649 wait complete. 2024-09-13T19:17:20.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.758+0000 7f4023151800 1 -- 172.21.15.102:0/3684042195 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x564af1cc1680 msgr2=0x564af1cc3a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.758+0000 7f4023151800 1 --2- 172.21.15.102:0/3684042195 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x564af1cc1680 0x564af1cc3a70 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.758+0000 7f4023151800 1 -- 172.21.15.102:0/3684042195 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x564af1cc62a0 msgr2=0x564af1cc8690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.758+0000 7f4023151800 1 --2- 172.21.15.102:0/3684042195 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x564af1cc62a0 0x564af1cc8690 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.758+0000 7f4023151800 1 -- 172.21.15.102:0/3684042195 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3f08036b40 msgr2=0x7f3f08039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.758+0000 7f4023151800 1 --2- 172.21.15.102:0/3684042195 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3f08036b40 0x7f3f08039000 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4008000f60 tx=0x7f40080012b0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.758+0000 7f4023151800 1 -- 172.21.15.102:0/3684042195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af1bc6720 msgr2=0x564af1cbc620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.758+0000 7f4023151800 1 --2- 172.21.15.102:0/3684042195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af1bc6720 0x564af1cbc620 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f4018046130 tx=0x7f4018003330 comp rx=0 tx=0).stop 2024-09-13T19:17:20.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.758+0000 7f4023151800 1 -- 172.21.15.102:0/3684042195 shutdown_connections 2024-09-13T19:17:20.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.758+0000 7f4023151800 1 --2- 172.21.15.102:0/3684042195 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x564af1cc62a0 0x564af1cc8690 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.758+0000 7f4023151800 1 --2- 172.21.15.102:0/3684042195 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x564af1cc1680 0x564af1cc3a70 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.758+0000 7f4023151800 1 --2- 172.21.15.102:0/3684042195 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3f08036b40 0x7f3f08039000 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.758+0000 7f4023151800 1 --2- 172.21.15.102:0/3684042195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564af1bc6720 0x564af1cbc620 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.758+0000 7f4023151800 1 -- 172.21.15.102:0/3684042195 >> 172.21.15.102:0/3684042195 conn(0x564af1bbddb0 msgr2=0x564af1cade10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:20.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.759+0000 7f4023151800 1 -- 172.21.15.102:0/3684042195 shutdown_connections 2024-09-13T19:17:20.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.759+0000 7f4023151800 1 -- 172.21.15.102:0/3684042195 wait complete. 2024-09-13T19:17:20.770 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-13T19:17:20.770 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-13T19:17:20.770 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2024-09-13T19:17:20.815 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:17:20.816 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:17:20.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.813+0000 7fdb86a30800 1 Processor -- start 2024-09-13T19:17:20.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.813+0000 7fdb86a30800 1 -- start start 2024-09-13T19:17:20.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.814+0000 7fdb86a30800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5626d280a9e0 0x5626d280ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.814+0000 7fdb86a30800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5626d26cbb30 con 0x5626d280b320 2024-09-13T19:17:20.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.814+0000 7fdb86a30800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5626d26ad360 con 0x5626d280a9e0 2024-09-13T19:17:20.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.814+0000 7fdb81d67640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5626d280a9e0 0x5626d280ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.814+0000 7fdb79566640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5626d280b320 0x5626d2813e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:50106/0 (socket says 172.21.15.102:50106) 2024-09-13T19:17:20.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.814+0000 7fdb79566640 1 -- 172.21.15.102:0/3388830683 learned_addr learned my addr 172.21.15.102:0/3388830683 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:17:20.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.814+0000 7fdb81d67640 1 -- 172.21.15.102:0/3388830683 >> v1:172.21.15.53:6789/0 conn(0x5626d280b320 legacy=0x5626d2813e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.814+0000 7fdb81d67640 1 -- 172.21.15.102:0/3388830683 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626d26d3e00 con 0x5626d280a9e0 2024-09-13T19:17:20.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.816+0000 7fdb81d67640 1 --2- 172.21.15.102:0/3388830683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d280a9e0 0x5626d280ade0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fdb7400a470 tx=0x7fdb74045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be754e4314f7fa91 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.816+0000 7fdb81566640 1 -- 172.21.15.102:0/3388830683 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb74053570 con 0x5626d280a9e0 2024-09-13T19:17:20.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.816+0000 7fdb81566640 1 -- 172.21.15.102:0/3388830683 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb74058070 con 0x5626d280a9e0 2024-09-13T19:17:20.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.816+0000 7fdb81566640 1 -- 172.21.15.102:0/3388830683 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb74053880 con 0x5626d280a9e0 2024-09-13T19:17:20.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.817+0000 7fdb86a30800 1 -- 172.21.15.102:0/3388830683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d280a9e0 msgr2=0x5626d280ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.817+0000 7fdb86a30800 1 --2- 172.21.15.102:0/3388830683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d280a9e0 0x5626d280ade0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fdb7400a470 tx=0x7fdb74045a20 comp rx=0 tx=0).stop 2024-09-13T19:17:20.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.817+0000 7fdb86a30800 1 -- 172.21.15.102:0/3388830683 shutdown_connections 2024-09-13T19:17:20.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.817+0000 7fdb86a30800 1 --2- 172.21.15.102:0/3388830683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d280a9e0 0x5626d280ade0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.817+0000 7fdb86a30800 1 -- 172.21.15.102:0/3388830683 >> 172.21.15.102:0/3388830683 conn(0x5626d2806550 msgr2=0x5626d2808970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:20.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.817+0000 7fdb86a30800 1 -- 172.21.15.102:0/3388830683 shutdown_connections 2024-09-13T19:17:20.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.817+0000 7fdb86a30800 1 -- 172.21.15.102:0/3388830683 wait complete. 2024-09-13T19:17:20.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.831+0000 7fdb86a30800 1 Processor -- start 2024-09-13T19:17:20.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.831+0000 7fdb86a30800 1 -- start start 2024-09-13T19:17:20.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.831+0000 7fdb86a30800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d280a9e0 0x5626d28fda90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.831+0000 7fdb86a30800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5626d2758360 con 0x5626d280a9e0 2024-09-13T19:17:20.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.831+0000 7fdb81d67640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d280a9e0 0x5626d28fda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.831+0000 7fdb81d67640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d280a9e0 0x5626d28fda90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41648/0 (socket says 172.21.15.102:41648) 2024-09-13T19:17:20.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.831+0000 7fdb81d67640 1 -- 172.21.15.102:0/3920904739 learned_addr learned my addr 172.21.15.102:0/3920904739 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:20.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.832+0000 7fdb81d67640 1 -- 172.21.15.102:0/3920904739 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626d26a5bc0 con 0x5626d280a9e0 2024-09-13T19:17:20.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.832+0000 7fdb81d67640 1 --2- 172.21.15.102:0/3920904739 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d280a9e0 0x5626d28fda90 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fdb74025c20 tx=0x7fdb74051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1aee6fe7cc6583a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.832+0000 7fda6fe07640 1 -- 172.21.15.102:0/3920904739 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb7405c580 con 0x5626d280a9e0 2024-09-13T19:17:20.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.832+0000 7fda6fe07640 1 -- 172.21.15.102:0/3920904739 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb74063030 con 0x5626d280a9e0 2024-09-13T19:17:20.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.832+0000 7fda6fe07640 1 -- 172.21.15.102:0/3920904739 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb7405c850 con 0x5626d280a9e0 2024-09-13T19:17:20.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.833+0000 7fdb86a30800 1 -- 172.21.15.102:0/3920904739 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d280a9e0 msgr2=0x5626d28fda90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.833+0000 7fdb86a30800 1 --2- 172.21.15.102:0/3920904739 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d280a9e0 0x5626d28fda90 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fdb74025c20 tx=0x7fdb74051000 comp rx=0 tx=0).stop 2024-09-13T19:17:20.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.833+0000 7fdb86a30800 1 -- 172.21.15.102:0/3920904739 shutdown_connections 2024-09-13T19:17:20.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.833+0000 7fdb86a30800 1 --2- 172.21.15.102:0/3920904739 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d280a9e0 0x5626d28fda90 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.833+0000 7fdb86a30800 1 -- 172.21.15.102:0/3920904739 >> 172.21.15.102:0/3920904739 conn(0x5626d2806550 msgr2=0x5626d28f9450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:20.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.833+0000 7fdb86a30800 1 -- 172.21.15.102:0/3920904739 shutdown_connections 2024-09-13T19:17:20.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.833+0000 7fdb86a30800 1 -- 172.21.15.102:0/3920904739 wait complete. 2024-09-13T19:17:20.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.833+0000 7fdb86a30800 1 Processor -- start 2024-09-13T19:17:20.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.833+0000 7fdb86a30800 1 -- start start 2024-09-13T19:17:20.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.833+0000 7fdb86a30800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d280a9e0 0x5626d2905400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.833+0000 7fdb86a30800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5626d28158a0 con 0x5626d280a9e0 2024-09-13T19:17:20.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.833+0000 7fdb81d67640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d280a9e0 0x5626d2905400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.833+0000 7fdb81d67640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d280a9e0 0x5626d2905400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41664/0 (socket says 172.21.15.102:41664) 2024-09-13T19:17:20.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.833+0000 7fdb81d67640 1 -- 172.21.15.102:0/636662597 learned_addr learned my addr 172.21.15.102:0/636662597 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:20.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.834+0000 7fdb81d67640 1 -- 172.21.15.102:0/636662597 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626d26b9fe0 con 0x5626d280a9e0 2024-09-13T19:17:20.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.834+0000 7fdb81d67640 1 --2- 172.21.15.102:0/636662597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d280a9e0 0x5626d2905400 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x5626d28fe8f0 tx=0x7fdb74002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.834+0000 7fda6e604640 1 -- 172.21.15.102:0/636662597 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb74054af0 con 0x5626d280a9e0 2024-09-13T19:17:20.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.834+0000 7fda6e604640 1 -- 172.21.15.102:0/636662597 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb74054c90 con 0x5626d280a9e0 2024-09-13T19:17:20.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.834+0000 7fdb86a30800 1 -- 172.21.15.102:0/636662597 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5626d2905940 con 0x5626d280a9e0 2024-09-13T19:17:20.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.834+0000 7fda6e604640 1 -- 172.21.15.102:0/636662597 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb74068420 con 0x5626d280a9e0 2024-09-13T19:17:20.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.834+0000 7fdb86a30800 1 -- 172.21.15.102:0/636662597 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626d2905e60 con 0x5626d280a9e0 2024-09-13T19:17:20.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.835+0000 7fda6e604640 1 -- 172.21.15.102:0/636662597 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fdb740685c0 con 0x5626d280a9e0 2024-09-13T19:17:20.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.835+0000 7fda6e604640 1 --2- 172.21.15.102:0/636662597 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fda68036b40 0x7fda68039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.835+0000 7fda6e604640 1 -- 172.21.15.102:0/636662597 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fdb74070030 con 0x5626d280a9e0 2024-09-13T19:17:20.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.835+0000 7fdb79566640 1 --2- 172.21.15.102:0/636662597 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fda68036b40 0x7fda68039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.835+0000 7fdb86a30800 1 --2- 172.21.15.102:0/636662597 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5626d280b320 0x5626d290c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.835+0000 7fdb86a30800 1 -- 172.21.15.102:0/636662597 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d290c9f0 con 0x5626d280b320 2024-09-13T19:17:20.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.835+0000 7fdb82568640 1 --2- 172.21.15.102:0/636662597 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5626d280b320 0x5626d290c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.835+0000 7fdb79566640 1 --2- 172.21.15.102:0/636662597 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fda68036b40 0x7fda68039000 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c000f60 tx=0x7fdb6c0012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.836+0000 7fdb82568640 1 --2- 172.21.15.102:0/636662597 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5626d280b320 0x5626d290c470 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.836+0000 7fdb82568640 1 -- 172.21.15.102:0/636662597 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb7c00a4a0 con 0x5626d280b320 2024-09-13T19:17:20.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.836+0000 7fdb86a30800 1 -- 172.21.15.102:0/636662597 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d2909a40 con 0x5626d280b320 2024-09-13T19:17:20.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.836+0000 7fdb82568640 1 -- 172.21.15.102:0/636662597 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdb7c00a4a0 con 0x5626d280b320 2024-09-13T19:17:20.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.836+0000 7fdb86a30800 1 --2- 172.21.15.102:0/636662597 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5626d290ed40 0x5626d2911130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.836+0000 7fdb86a30800 1 -- 172.21.15.102:0/636662597 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d29117d0 con 0x5626d290ed40 2024-09-13T19:17:20.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.836+0000 7fdb81d67640 1 --2- 172.21.15.102:0/636662597 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5626d290ed40 0x5626d2911130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.836+0000 7fdb81d67640 1 --2- 172.21.15.102:0/636662597 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5626d290ed40 0x5626d2911130 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.837+0000 7fdb81d67640 1 -- 172.21.15.102:0/636662597 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdb74051070 con 0x5626d290ed40 2024-09-13T19:17:20.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.837+0000 7fdb86a30800 1 -- 172.21.15.102:0/636662597 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d290dbb0 con 0x5626d280b320 2024-09-13T19:17:20.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.837+0000 7fdb82568640 1 -- 172.21.15.102:0/636662597 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdb7c00a4a0 con 0x5626d280b320 2024-09-13T19:17:20.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.837+0000 7fdb86a30800 1 -- 172.21.15.102:0/636662597 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d290e090 con 0x5626d290ed40 2024-09-13T19:17:20.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.837+0000 7fdb81d67640 1 -- 172.21.15.102:0/636662597 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdb74051070 con 0x5626d290ed40 2024-09-13T19:17:20.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.838+0000 7fdb86a30800 1 Processor -- start 2024-09-13T19:17:20.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.838+0000 7fdb86a30800 1 -- start start 2024-09-13T19:17:20.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.838+0000 7fdb86a30800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d2920130 0x5626d2920550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.838+0000 7fdb86a30800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5626d26a7580 con 0x5626d2920130 2024-09-13T19:17:20.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.838+0000 7fdb82568640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d2920130 0x5626d2920550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.838+0000 7fdb82568640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d2920130 0x5626d2920550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41674/0 (socket says 172.21.15.102:41674) 2024-09-13T19:17:20.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.838+0000 7fdb82568640 1 -- 172.21.15.102:0/4107797799 learned_addr learned my addr 172.21.15.102:0/4107797799 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:20.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.839+0000 7fdb82568640 1 -- 172.21.15.102:0/4107797799 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626d2920a90 con 0x5626d2920130 2024-09-13T19:17:20.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.839+0000 7fdb82568640 1 --2- 172.21.15.102:0/4107797799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d2920130 0x5626d2920550 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x5626d290cdf0 tx=0x7fdb7c0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.839+0000 7fda677fe640 1 -- 172.21.15.102:0/4107797799 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb7c013640 con 0x5626d2920130 2024-09-13T19:17:20.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.839+0000 7fda677fe640 1 -- 172.21.15.102:0/4107797799 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb7c0137e0 con 0x5626d2920130 2024-09-13T19:17:20.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.839+0000 7fdb86a30800 1 -- 172.21.15.102:0/4107797799 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5626d2920d20 con 0x5626d2920130 2024-09-13T19:17:20.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.839+0000 7fda677fe640 1 -- 172.21.15.102:0/4107797799 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb7c013ae0 con 0x5626d2920130 2024-09-13T19:17:20.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.839+0000 7fdb86a30800 1 -- 172.21.15.102:0/4107797799 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626d2923a00 con 0x5626d2920130 2024-09-13T19:17:20.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.840+0000 7fda677fe640 1 -- 172.21.15.102:0/4107797799 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fdb7c011040 con 0x5626d2920130 2024-09-13T19:17:20.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.840+0000 7fda677fe640 1 --2- 172.21.15.102:0/4107797799 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fda5c036b40 0x7fda5c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.840+0000 7fda677fe640 1 -- 172.21.15.102:0/4107797799 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fdb7c00e040 con 0x5626d2920130 2024-09-13T19:17:20.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.840+0000 7fdb81d67640 1 --2- 172.21.15.102:0/4107797799 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fda5c036b40 0x7fda5c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.840+0000 7fdb86a30800 1 Processor -- start 2024-09-13T19:17:20.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.840+0000 7fdb86a30800 1 -- start start 2024-09-13T19:17:20.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.840+0000 7fdb81d67640 1 --2- 172.21.15.102:0/4107797799 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fda5c036b40 0x7fda5c039000 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x5626d2909960 tx=0x7fdb7408f2c0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.840+0000 7fdb86a30800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d292ce80 0x5626d292d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.840+0000 7fdb86a30800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5626d28fe1e0 con 0x5626d292ce80 2024-09-13T19:17:20.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.841+0000 7fdb82568640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d292ce80 0x5626d292d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.841+0000 7fdb82568640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d292ce80 0x5626d292d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41682/0 (socket says 172.21.15.102:41682) 2024-09-13T19:17:20.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.841+0000 7fdb82568640 1 -- 172.21.15.102:0/769184570 learned_addr learned my addr 172.21.15.102:0/769184570 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:20.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.841+0000 7fdb82568640 1 -- 172.21.15.102:0/769184570 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626d292d850 con 0x5626d292ce80 2024-09-13T19:17:20.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.841+0000 7fdb82568640 1 --2- 172.21.15.102:0/769184570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d292ce80 0x5626d292d280 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c04cdb0 tx=0x7fdb7c020ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4142f3bc204d5c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.841+0000 7fda657fa640 1 -- 172.21.15.102:0/769184570 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb7c02a910 con 0x5626d292ce80 2024-09-13T19:17:20.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.841+0000 7fda657fa640 1 -- 172.21.15.102:0/769184570 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb7c02a3f0 con 0x5626d292ce80 2024-09-13T19:17:20.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.841+0000 7fda657fa640 1 -- 172.21.15.102:0/769184570 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb7c02aab0 con 0x5626d292ce80 2024-09-13T19:17:20.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.842+0000 7fdb86a30800 1 -- 172.21.15.102:0/769184570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d292ce80 msgr2=0x5626d292d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.842+0000 7fdb86a30800 1 --2- 172.21.15.102:0/769184570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d292ce80 0x5626d292d280 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c04cdb0 tx=0x7fdb7c020ea0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.842+0000 7fdb86a30800 1 -- 172.21.15.102:0/769184570 shutdown_connections 2024-09-13T19:17:20.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.842+0000 7fdb86a30800 1 --2- 172.21.15.102:0/769184570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d292ce80 0x5626d292d280 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.842+0000 7fdb86a30800 1 -- 172.21.15.102:0/769184570 >> 172.21.15.102:0/769184570 conn(0x5626d29291e0 msgr2=0x5626d29272e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:20.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.842+0000 7fdb86a30800 1 -- 172.21.15.102:0/769184570 shutdown_connections 2024-09-13T19:17:20.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.842+0000 7fdb86a30800 1 -- 172.21.15.102:0/769184570 wait complete. 2024-09-13T19:17:20.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.842+0000 7fdb86a30800 1 Processor -- start 2024-09-13T19:17:20.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.842+0000 7fdb86a30800 1 -- start start 2024-09-13T19:17:20.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.842+0000 7fdb86a30800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d292ce80 0x5626d2934260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.842+0000 7fdb86a30800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5626d292dec0 con 0x5626d292ce80 2024-09-13T19:17:20.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.843+0000 7fdb82568640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d292ce80 0x5626d2934260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.843+0000 7fdb82568640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d292ce80 0x5626d2934260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:41692/0 (socket says 172.21.15.102:41692) 2024-09-13T19:17:20.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.843+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 learned_addr learned my addr 172.21.15.102:0/89872602 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:17:20.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.843+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626d29347a0 con 0x5626d292ce80 2024-09-13T19:17:20.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.843+0000 7fdb82568640 1 --2- 172.21.15.102:0/89872602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d292ce80 0x5626d2934260 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c023040 tx=0x7fdb7c04cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.843+0000 7fda537fe640 1 -- 172.21.15.102:0/89872602 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb7c0206b0 con 0x5626d292ce80 2024-09-13T19:17:20.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.843+0000 7fda537fe640 1 -- 172.21.15.102:0/89872602 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb7c020850 con 0x5626d292ce80 2024-09-13T19:17:20.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.843+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5626d2934a30 con 0x5626d292ce80 2024-09-13T19:17:20.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.843+0000 7fda537fe640 1 -- 172.21.15.102:0/89872602 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb7c011480 con 0x5626d292ce80 2024-09-13T19:17:20.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.843+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626d29376e0 con 0x5626d292ce80 2024-09-13T19:17:20.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.844+0000 7fda537fe640 1 -- 172.21.15.102:0/89872602 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fdb7c011620 con 0x5626d292ce80 2024-09-13T19:17:20.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.844+0000 7fda537fe640 1 --2- 172.21.15.102:0/89872602 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fda4c036b40 0x7fda4c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.844+0000 7fda537fe640 1 -- 172.21.15.102:0/89872602 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fdb7c04b020 con 0x5626d292ce80 2024-09-13T19:17:20.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.844+0000 7fdb81d67640 1 --2- 172.21.15.102:0/89872602 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fda4c036b40 0x7fda4c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.845+0000 7fdb81d67640 1 --2- 172.21.15.102:0/89872602 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fda4c036b40 0x7fda4c039000 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fdb740813f0 tx=0x7fdb7408a000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.845+0000 7fdb86a30800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.845+0000 7fdb86a30800 1 --2- 172.21.15.102:0/89872602 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5626d293fde0 0x5626d29422a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.845+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d29429f0 con 0x5626d293fde0 2024-09-13T19:17:20.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.845+0000 7fdb79566640 1 --2- 172.21.15.102:0/89872602 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5626d293fde0 0x5626d29422a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.845+0000 7fdb79566640 1 --2- 172.21.15.102:0/89872602 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5626d293fde0 0x5626d29422a0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.845+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb6c009050 con 0x5626d293fde0 2024-09-13T19:17:20.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.846+0000 7fdb86a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:20.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.846+0000 7fdb86a30800 20 realm 2024-09-13T19:17:20.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.846+0000 7fdb86a30800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.846+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d293f230 con 0x5626d293fde0 2024-09-13T19:17:20.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.846+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb6c009050 con 0x5626d293fde0 2024-09-13T19:17:20.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.846+0000 7fdb86a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:20.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.846+0000 7fdb86a30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:17:20.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.846+0000 7fdb86a30800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.846+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d29434e0 con 0x5626d293fde0 2024-09-13T19:17:20.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.846+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb6c009050 con 0x5626d293fde0 2024-09-13T19:17:20.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.846+0000 7fdb86a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:20.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.846+0000 7fdb86a30800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.846+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d2943db0 con 0x5626d293fde0 2024-09-13T19:17:20.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.846+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdb6c009050 con 0x5626d293fde0 2024-09-13T19:17:20.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.846+0000 7fdb86a30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:17:20.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.846+0000 7fdb86a30800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.846+0000 7fdb86a30800 1 --2- 172.21.15.102:0/89872602 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5626d29447d0 0x5626d2946bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.846+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d29472b0 con 0x5626d29447d0 2024-09-13T19:17:20.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.846+0000 7fdb82568640 1 --2- 172.21.15.102:0/89872602 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5626d29447d0 0x5626d2946bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.847+0000 7fdb82568640 1 --2- 172.21.15.102:0/89872602 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5626d29447d0 0x5626d2946bc0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.847+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdb7c032070 con 0x5626d29447d0 2024-09-13T19:17:20.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.847+0000 7fdb86a30800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:17:20.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.847+0000 7fdb86a30800 20 searching for the correct realm 2024-09-13T19:17:20.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.847+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5626d2948c00 con 0x5626d29447d0 2024-09-13T19:17:20.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.847+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb7c032070 con 0x5626d29447d0 2024-09-13T19:17:20.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.847+0000 7fdb82568640 1 --2- 172.21.15.102:0/89872602 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fdb7c035070 0x7fdb7c04e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.847+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5626d2948c00 con 0x7fdb7c035070 2024-09-13T19:17:20.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.847+0000 7fdb81d67640 1 --2- 172.21.15.102:0/89872602 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fdb7c035070 0x7fdb7c04e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.847+0000 7fdb81d67640 1 --2- 172.21.15.102:0/89872602 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fdb7c035070 0x7fdb7c04e3b0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.848+0000 7fdb81d67640 1 -- 172.21.15.102:0/89872602 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb74051070 con 0x7fdb7c035070 2024-09-13T19:17:20.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.848+0000 7fdb81d67640 1 --2- 172.21.15.102:0/89872602 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fdb7405c070 0x7fdb7408f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:17:20.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.848+0000 7fdb81d67640 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5626d2948c00 con 0x7fdb7405c070 2024-09-13T19:17:20.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.848+0000 7fdb79566640 1 --2- 172.21.15.102:0/89872602 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fdb7405c070 0x7fdb7408f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:17:20.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.849+0000 7fdb79566640 1 --2- 172.21.15.102:0/89872602 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fdb7405c070 0x7fdb7408f550 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:17:20.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.849+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb6c009050 con 0x7fdb7405c070 2024-09-13T19:17:20.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.849+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5626d2948c00 con 0x5626d293fde0 2024-09-13T19:17:20.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.849+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb6c009050 con 0x5626d293fde0 2024-09-13T19:17:20.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.849+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5626d2948c00 con 0x5626d293fde0 2024-09-13T19:17:20.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.849+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb6c029040 con 0x5626d293fde0 2024-09-13T19:17:20.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.849+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5626d2948c00 con 0x7fdb7405c070 2024-09-13T19:17:20.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.850+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb6c029040 con 0x7fdb7405c070 2024-09-13T19:17:20.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.850+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5626d2948c00 con 0x7fdb7405c070 2024-09-13T19:17:20.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.850+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb6c029040 con 0x7fdb7405c070 2024-09-13T19:17:20.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.850+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5626d2948c00 con 0x7fdb7c035070 2024-09-13T19:17:20.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.850+0000 7fdb81d67640 1 -- 172.21.15.102:0/89872602 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb74051070 con 0x7fdb7c035070 2024-09-13T19:17:20.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.850+0000 7fdb81d67640 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5626d2948c00 con 0x5626d29447d0 2024-09-13T19:17:20.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.850+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb7c032070 con 0x5626d29447d0 2024-09-13T19:17:20.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.850+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5626d2948c00 con 0x5626d293fde0 2024-09-13T19:17:20.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.850+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb6c029040 con 0x5626d293fde0 2024-09-13T19:17:20.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.850+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5626d2948c00 con 0x7fdb7c035070 2024-09-13T19:17:20.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.851+0000 7fdb81d67640 1 -- 172.21.15.102:0/89872602 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb74051070 con 0x7fdb7c035070 2024-09-13T19:17:20.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.851+0000 7fdb81d67640 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5626d2948c00 con 0x5626d293fde0 2024-09-13T19:17:20.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.851+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb6c029040 con 0x5626d293fde0 2024-09-13T19:17:20.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.851+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5626d2948c00 con 0x7fdb7c035070 2024-09-13T19:17:20.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.851+0000 7fdb81d67640 1 -- 172.21.15.102:0/89872602 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdb74051070 con 0x7fdb7c035070 2024-09-13T19:17:20.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.851+0000 7fdb81d67640 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5626d2948c00 con 0x5626d29447d0 2024-09-13T19:17:20.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.851+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb7c032070 con 0x5626d29447d0 2024-09-13T19:17:20.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.851+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5626d2948c00 con 0x5626d29447d0 2024-09-13T19:17:20.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.852+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdb7c032070 con 0x5626d29447d0 2024-09-13T19:17:20.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.852+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5626d2948c00 con 0x7fdb7405c070 2024-09-13T19:17:20.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.852+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb6c029040 con 0x7fdb7405c070 2024-09-13T19:17:20.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.852+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5626d2948c00 con 0x5626d29447d0 2024-09-13T19:17:20.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.852+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdb7c032070 con 0x5626d29447d0 2024-09-13T19:17:20.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.852+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5626d2948c00 con 0x5626d29447d0 2024-09-13T19:17:20.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.852+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb7c032070 con 0x5626d29447d0 2024-09-13T19:17:20.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.852+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5626d2948c00 con 0x5626d293fde0 2024-09-13T19:17:20.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.853+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb6c029040 con 0x5626d293fde0 2024-09-13T19:17:20.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.853+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5626d2948c00 con 0x5626d293fde0 2024-09-13T19:17:20.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.853+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdb6c029040 con 0x5626d293fde0 2024-09-13T19:17:20.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.853+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5626d2948c00 con 0x7fdb7405c070 2024-09-13T19:17:20.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.853+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb6c029040 con 0x7fdb7405c070 2024-09-13T19:17:20.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.853+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5626d2948c00 con 0x5626d29447d0 2024-09-13T19:17:20.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.853+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb7c032070 con 0x5626d29447d0 2024-09-13T19:17:20.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.853+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5626d2948c00 con 0x7fdb7c035070 2024-09-13T19:17:20.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.854+0000 7fdb81d67640 1 -- 172.21.15.102:0/89872602 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb74051070 con 0x7fdb7c035070 2024-09-13T19:17:20.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.854+0000 7fdb81d67640 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5626d2948c00 con 0x5626d293fde0 2024-09-13T19:17:20.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.854+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb6c029040 con 0x5626d293fde0 2024-09-13T19:17:20.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.854+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5626d2948c00 con 0x7fdb7c035070 2024-09-13T19:17:20.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.854+0000 7fdb81d67640 1 -- 172.21.15.102:0/89872602 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb74051070 con 0x7fdb7c035070 2024-09-13T19:17:20.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.854+0000 7fdb81d67640 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5626d2948c00 con 0x5626d29447d0 2024-09-13T19:17:20.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.854+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb7c032070 con 0x5626d29447d0 2024-09-13T19:17:20.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.854+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5626d2948c00 con 0x7fdb7405c070 2024-09-13T19:17:20.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.855+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb6c029040 con 0x7fdb7405c070 2024-09-13T19:17:20.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.855+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5626d2948c00 con 0x7fdb7c035070 2024-09-13T19:17:20.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.855+0000 7fdb81d67640 1 -- 172.21.15.102:0/89872602 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb74051070 con 0x7fdb7c035070 2024-09-13T19:17:20.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.855+0000 7fdb81d67640 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5626d2948c00 con 0x5626d29447d0 2024-09-13T19:17:20.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.855+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb7c032070 con 0x5626d29447d0 2024-09-13T19:17:20.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.855+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5626d2948c00 con 0x7fdb7405c070 2024-09-13T19:17:20.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.855+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb6c029040 con 0x7fdb7405c070 2024-09-13T19:17:20.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.855+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5626d2948c00 con 0x5626d293fde0 2024-09-13T19:17:20.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.856+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdb6c029040 con 0x5626d293fde0 2024-09-13T19:17:20.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.856+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5626d2948c00 con 0x7fdb7c035070 2024-09-13T19:17:20.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.856+0000 7fdb81d67640 1 -- 172.21.15.102:0/89872602 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb74051070 con 0x7fdb7c035070 2024-09-13T19:17:20.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.856+0000 7fdb86a30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:17:20.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.856+0000 7fdb86a30800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:17:20.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.856+0000 7fdb86a30800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:17:20.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.856+0000 7fdb86a30800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:17:20.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.856+0000 7fdb86a30800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:17:20.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.856+0000 7fdb86a30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:17:20.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.856+0000 7fdb86a30800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.856+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d2947c70 con 0x5626d293fde0 2024-09-13T19:17:20.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.856+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb6c029040 con 0x5626d293fde0 2024-09-13T19:17:20.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.856+0000 7fdb86a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:20.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.856+0000 7fdb86a30800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.856+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d2948510 con 0x5626d293fde0 2024-09-13T19:17:20.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.856+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdb6c029040 con 0x5626d293fde0 2024-09-13T19:17:20.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.856+0000 7fdb86a30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:17:20.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.856+0000 7fdb86a30800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.856+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d2949080 con 0x5626d29447d0 2024-09-13T19:17:20.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.857+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdb7c032070 con 0x5626d29447d0 2024-09-13T19:17:20.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.857+0000 7fdb86a30800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:17:20.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.857+0000 7fdb86a30800 20 zone default found 2024-09-13T19:17:20.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.857+0000 7fdb86a30800 4 Realm: () 2024-09-13T19:17:20.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.857+0000 7fdb86a30800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:17:20.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.857+0000 7fdb86a30800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:17:20.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.857+0000 7fdb86a30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:17:20.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.857+0000 7fdb86a30800 20 zonegroup default 2024-09-13T19:17:20.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.857+0000 7fdb86a30800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.857+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d29498d0 con 0x7fdb7c035070 2024-09-13T19:17:20.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.857+0000 7fdb81d67640 1 -- 172.21.15.102:0/89872602 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdb74051070 con 0x7fdb7c035070 2024-09-13T19:17:20.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.857+0000 7fdb86a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:20.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.857+0000 7fdb86a30800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.857+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d294b650 con 0x5626d29447d0 2024-09-13T19:17:20.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.857+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdb7c032070 con 0x5626d29447d0 2024-09-13T19:17:20.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.857+0000 7fdb86a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:20.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.857+0000 7fdb86a30800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.857+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d294ba60 con 0x5626d29447d0 2024-09-13T19:17:20.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.857+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdb7c032070 con 0x5626d29447d0 2024-09-13T19:17:20.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.857+0000 7fdb86a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:20.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.857+0000 7fdb86a30800 20 started sync module instance, tier type = 2024-09-13T19:17:20.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.857+0000 7fdb86a30800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:17:20.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.858+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d294aaf0 con 0x7fdb7c035070 2024-09-13T19:17:20.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.858+0000 7fdb81d67640 1 -- 172.21.15.102:0/89872602 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(44 notify.0 [create] v36'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb74051070 con 0x7fdb7c035070 2024-09-13T19:17:20.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.859+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94724741705440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d294a750 con 0x7fdb7c035070 2024-09-13T19:17:20.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.859+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d294c8a0 con 0x5626d293fde0 2024-09-13T19:17:20.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.860+0000 7fdb81d67640 1 -- 172.21.15.102:0/89872602 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94724741705440] v36'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb74051070 con 0x7fdb7c035070 2024-09-13T19:17:20.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.860+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v36'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb6c029040 con 0x5626d293fde0 2024-09-13T19:17:20.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.860+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94724741710016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d294d140 con 0x5626d293fde0 2024-09-13T19:17:20.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.860+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d294db00 con 0x5626d29447d0 2024-09-13T19:17:20.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.861+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94724741710016] v36'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb6c029040 con 0x5626d293fde0 2024-09-13T19:17:20.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.861+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v36'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb7c032070 con 0x5626d29447d0 2024-09-13T19:17:20.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.861+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94724741716016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d294d140 con 0x5626d29447d0 2024-09-13T19:17:20.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.861+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d294e580 con 0x7fdb7c035070 2024-09-13T19:17:20.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.862+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94724741716016] v36'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb7c032070 con 0x5626d29447d0 2024-09-13T19:17:20.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.862+0000 7fdb81d67640 1 -- 172.21.15.102:0/89872602 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(50 notify.3 [create] v36'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb74051070 con 0x7fdb7c035070 2024-09-13T19:17:20.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.862+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94724741713040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d294d0b0 con 0x7fdb7c035070 2024-09-13T19:17:20.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.862+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d294f470 con 0x5626d293fde0 2024-09-13T19:17:20.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.863+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v36'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb6c029040 con 0x5626d293fde0 2024-09-13T19:17:20.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.863+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94724741722048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d294f420 con 0x5626d293fde0 2024-09-13T19:17:20.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.863+0000 7fdb81d67640 1 -- 172.21.15.102:0/89872602 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94724741713040] v36'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb74051070 con 0x7fdb7c035070 2024-09-13T19:17:20.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.864+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d294e9e0 con 0x7fdb7405c070 2024-09-13T19:17:20.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.865+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(54 notify.5 [create] v36'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb6c029040 con 0x7fdb7405c070 2024-09-13T19:17:20.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.865+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94724741725920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d294e9e0 con 0x7fdb7405c070 2024-09-13T19:17:20.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.865+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d2950e80 con 0x7fdb7405c070 2024-09-13T19:17:20.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.865+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94724741722048] v36'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb6c029040 con 0x5626d293fde0 2024-09-13T19:17:20.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.866+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(56 notify.6 [create] v36'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb6c029040 con 0x7fdb7405c070 2024-09-13T19:17:20.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.866+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94724741728592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d2950e40 con 0x7fdb7405c070 2024-09-13T19:17:20.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.866+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d2951860 con 0x7fdb7405c070 2024-09-13T19:17:20.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.866+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94724741725920] v36'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb6c029040 con 0x7fdb7405c070 2024-09-13T19:17:20.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.867+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(58 notify.7 [create] v36'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb6c029040 con 0x7fdb7405c070 2024-09-13T19:17:20.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.867+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94724741728592] v36'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb6c029040 con 0x7fdb7405c070 2024-09-13T19:17:20.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.867+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94724741731152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d294f860 con 0x7fdb7405c070 2024-09-13T19:17:20.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.867+0000 7fdb86a30800 20 add_watcher() i=0 2024-09-13T19:17:20.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.867+0000 7fdb86a30800 20 add_watcher() i=1 2024-09-13T19:17:20.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.867+0000 7fdb86a30800 20 add_watcher() i=2 2024-09-13T19:17:20.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.867+0000 7fdb86a30800 20 add_watcher() i=3 2024-09-13T19:17:20.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.867+0000 7fdb86a30800 20 add_watcher() i=4 2024-09-13T19:17:20.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.867+0000 7fdb86a30800 20 add_watcher() i=5 2024-09-13T19:17:20.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.867+0000 7fdb86a30800 20 add_watcher() i=6 2024-09-13T19:17:20.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.867+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94724741731152] v36'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb6c029040 con 0x7fdb7405c070 2024-09-13T19:17:20.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.868+0000 7fdb86a30800 20 add_watcher() i=7 2024-09-13T19:17:20.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.868+0000 7fdb86a30800 2 all 8 watchers are set, enabling cache 2024-09-13T19:17:20.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.868+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d2954850 con 0x5626d293fde0 2024-09-13T19:17:20.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.868+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdb6c029040 con 0x5626d293fde0 2024-09-13T19:17:20.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.868+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94724741726976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d2951cd0 con 0x5626d293fde0 2024-09-13T19:17:20.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.869+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94724741726976] v36'223 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdb6c029040 con 0x5626d293fde0 2024-09-13T19:17:20.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.869+0000 7fda337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:17:20.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.869+0000 7fdb86a30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:17:20.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.869+0000 7fdb86a30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:17:20.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.869+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d295d1b0 con 0x5626d293fde0 2024-09-13T19:17:20.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.870+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v36'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb6c029040 con 0x5626d293fde0 2024-09-13T19:17:20.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.870+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d295d800 con 0x7fdb7405c070 2024-09-13T19:17:20.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.871+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v36'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb6c029040 con 0x7fdb7405c070 2024-09-13T19:17:20.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.871+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d295dc60 con 0x5626d29447d0 2024-09-13T19:17:20.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.872+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v36'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb7c032070 con 0x5626d29447d0 2024-09-13T19:17:20.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.872+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d295db90 con 0x5626d293fde0 2024-09-13T19:17:20.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.873+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v36'224 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb6c029040 con 0x5626d293fde0 2024-09-13T19:17:20.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.873+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d295e140 con 0x7fdb7c035070 2024-09-13T19:17:20.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.874+0000 7fdb81d67640 1 -- 172.21.15.102:0/89872602 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v36'73 uv55 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb74051070 con 0x7fdb7c035070 2024-09-13T19:17:20.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.874+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d295e5f0 con 0x5626d29447d0 2024-09-13T19:17:20.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.875+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 <== osd.3 v2:172.21.15.102:6800/3096737090 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v36'48 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb7c032070 con 0x5626d29447d0 2024-09-13T19:17:20.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.875+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d295e5f0 con 0x5626d293fde0 2024-09-13T19:17:20.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.876+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v36'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb6c029040 con 0x5626d293fde0 2024-09-13T19:17:20.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.876+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d295e5f0 con 0x7fdb7405c070 2024-09-13T19:17:20.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.877+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(69 gc.7 [create,call,call,call] v36'47 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb6c029040 con 0x7fdb7405c070 2024-09-13T19:17:20.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.878+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d295e680 con 0x7fdb7c035070 2024-09-13T19:17:20.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.878+0000 7fdb81d67640 1 -- 172.21.15.102:0/89872602 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v36'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb74051070 con 0x7fdb7c035070 2024-09-13T19:17:20.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.879+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d295ec30 con 0x5626d29447d0 2024-09-13T19:17:20.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.879+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 <== osd.3 v2:172.21.15.102:6800/3096737090 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v36'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdb7c032070 con 0x5626d29447d0 2024-09-13T19:17:20.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.879+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d295ec30 con 0x7fdb7c035070 2024-09-13T19:17:20.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.880+0000 7fdb81d67640 1 -- 172.21.15.102:0/89872602 <== osd.2 v2:172.21.15.102:6816/2238176080 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v36'74 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb74051070 con 0x7fdb7c035070 2024-09-13T19:17:20.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.880+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d295ec30 con 0x7fdb7405c070 2024-09-13T19:17:20.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.882+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v36'32 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb6c029040 con 0x7fdb7405c070 2024-09-13T19:17:20.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.882+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d295ec30 con 0x7fdb7c035070 2024-09-13T19:17:20.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.883+0000 7fdb81d67640 1 -- 172.21.15.102:0/89872602 <== osd.2 v2:172.21.15.102:6816/2238176080 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v36'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb74051070 con 0x7fdb7c035070 2024-09-13T19:17:20.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.883+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d295ec30 con 0x7fdb7405c070 2024-09-13T19:17:20.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.884+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(75 gc.13 [create,call,call,call] v36'53 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb6c029040 con 0x7fdb7405c070 2024-09-13T19:17:20.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.884+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d295ec30 con 0x5626d293fde0 2024-09-13T19:17:20.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.885+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v36'225 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb6c029040 con 0x5626d293fde0 2024-09-13T19:17:20.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.885+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d295ec30 con 0x5626d29447d0 2024-09-13T19:17:20.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.886+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 <== osd.3 v2:172.21.15.102:6800/3096737090 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v36'65 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb7c032070 con 0x5626d29447d0 2024-09-13T19:17:20.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.886+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d295ec30 con 0x7fdb7c035070 2024-09-13T19:17:20.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.887+0000 7fdb81d67640 1 -- 172.21.15.102:0/89872602 <== osd.2 v2:172.21.15.102:6816/2238176080 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v36'75 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb74051070 con 0x7fdb7c035070 2024-09-13T19:17:20.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.887+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d295ec30 con 0x5626d29447d0 2024-09-13T19:17:20.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.888+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 <== osd.3 v2:172.21.15.102:6800/3096737090 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v36'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb7c032070 con 0x5626d29447d0 2024-09-13T19:17:20.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.888+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d295ec30 con 0x5626d293fde0 2024-09-13T19:17:20.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.889+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v36'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb6c029040 con 0x5626d293fde0 2024-09-13T19:17:20.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.889+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d295ec30 con 0x5626d293fde0 2024-09-13T19:17:20.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.890+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v36'226 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb6c029040 con 0x5626d293fde0 2024-09-13T19:17:20.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.890+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d295ec30 con 0x5626d29447d0 2024-09-13T19:17:20.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.891+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 <== osd.3 v2:172.21.15.102:6800/3096737090 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v36'66 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb7c032070 con 0x5626d29447d0 2024-09-13T19:17:20.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.891+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d295ec30 con 0x7fdb7c035070 2024-09-13T19:17:20.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.892+0000 7fdb81d67640 1 -- 172.21.15.102:0/89872602 <== osd.2 v2:172.21.15.102:6816/2238176080 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v36'37 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb74051070 con 0x7fdb7c035070 2024-09-13T19:17:20.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.892+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d295ec30 con 0x5626d29447d0 2024-09-13T19:17:20.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.893+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 <== osd.3 v2:172.21.15.102:6800/3096737090 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v36'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb7c032070 con 0x5626d29447d0 2024-09-13T19:17:20.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.893+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d295ec30 con 0x5626d29447d0 2024-09-13T19:17:20.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.894+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 <== osd.3 v2:172.21.15.102:6800/3096737090 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v36'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb7c032070 con 0x5626d29447d0 2024-09-13T19:17:20.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.894+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d295e140 con 0x5626d29447d0 2024-09-13T19:17:20.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.895+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 <== osd.3 v2:172.21.15.102:6800/3096737090 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v36'23 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb7c032070 con 0x5626d29447d0 2024-09-13T19:17:20.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.895+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d295e140 con 0x5626d29447d0 2024-09-13T19:17:20.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.895+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 <== osd.3 v2:172.21.15.102:6800/3096737090 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v36'49 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb7c032070 con 0x5626d29447d0 2024-09-13T19:17:20.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.896+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d295e140 con 0x7fdb7405c070 2024-09-13T19:17:20.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.897+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(88 gc.26 [create,call,call,call] v36'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb6c029040 con 0x7fdb7405c070 2024-09-13T19:17:20.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.897+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d295e140 con 0x5626d29447d0 2024-09-13T19:17:20.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.898+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 <== osd.3 v2:172.21.15.102:6800/3096737090 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v36'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb7c032070 con 0x5626d29447d0 2024-09-13T19:17:20.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.898+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d295e140 con 0x7fdb7405c070 2024-09-13T19:17:20.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.899+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(90 gc.28 [create,call,call,call] v36'48 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb6c029040 con 0x7fdb7405c070 2024-09-13T19:17:20.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.899+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d295e140 con 0x5626d29447d0 2024-09-13T19:17:20.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.900+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 <== osd.3 v2:172.21.15.102:6800/3096737090 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v36'67 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb7c032070 con 0x5626d29447d0 2024-09-13T19:17:20.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.900+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d295e140 con 0x7fdb7405c070 2024-09-13T19:17:20.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.901+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 20 ==== osd_op_reply(92 gc.30 [create,call,call,call] v36'54 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb6c029040 con 0x7fdb7405c070 2024-09-13T19:17:20.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.901+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d295e140 con 0x7fdb7c035070 2024-09-13T19:17:20.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.902+0000 7fdb81d67640 1 -- 172.21.15.102:0/89872602 <== osd.2 v2:172.21.15.102:6816/2238176080 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v36'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdb74051070 con 0x7fdb7c035070 2024-09-13T19:17:20.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.902+0000 7fda327fc640 20 reqs_thread_entry: start 2024-09-13T19:17:20.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.902+0000 7fdb86a30800 20 init_complete bucket index max shards: 11 2024-09-13T19:17:20.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.902+0000 7fdb86a30800 20 Filter name: none 2024-09-13T19:17:20.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.903+0000 7fd9a3fff640 20 reqs_thread_entry: start 2024-09-13T19:17:20.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.903+0000 7fdb86a30800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T19:17:20.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.903+0000 7fdb86a30800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.903+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d29899a0 con 0x7fdb7405c070 2024-09-13T19:17:20.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.903+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 21 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fdb6c029040 con 0x7fdb7405c070 2024-09-13T19:17:20.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.903+0000 7fdb86a30800 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T19:17:20.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.903+0000 7fdb86a30800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-13T19:17:20.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.903+0000 7fdb86a30800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T19:17:20.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.903+0000 7fdb86a30800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:17:20.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.903+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d298c430 con 0x7fdb7405c070 2024-09-13T19:17:20.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.904+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 22 ==== osd_op_reply(95 fud.buckets [call out=186b] v0'0 uv5 ondisk = 0) ==== 155+0+186 (crc 0 0 0) 0x7fdb6c029040 con 0x7fdb7405c070 2024-09-13T19:17:20.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.904+0000 7fdb86a30800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:509740b4-c081-4f37-bd6d-df9ca851489b.4237.10 : miss 2024-09-13T19:17:20.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.904+0000 7fdb86a30800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.904+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:96 8.11 8:893a7313:root::.bucket.meta.myfoo7%3a509740b4-c081-4f37-bd6d-df9ca851489b.4237.10:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d298c320 con 0x5626d29447d0 2024-09-13T19:17:20.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.904+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 <== osd.3 v2:172.21.15.102:6800/3096737090 28 ==== osd_op_reply(96 .bucket.meta.myfoo7:509740b4-c081-4f37-bd6d-df9ca851489b.4237.10 [call out=48b,stat out=16b,read 0~382 out=382b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 334+0+664 (crc 0 0 0) 0x7fdb7c032070 con 0x5626d29447d0 2024-09-13T19:17:20.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.904+0000 7fdb86a30800 20 rados_obj.operate() r=0 bl.length=382 2024-09-13T19:17:20.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.904+0000 7fdb86a30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:509740b4-c081-4f37-bd6d-df9ca851489b.4237.10 info.flags=0x17 2024-09-13T19:17:20.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.904+0000 7fdb86a30800 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:509740b4-c081-4f37-bd6d-df9ca851489b.4237.10 to cache LRU end 2024-09-13T19:17:20.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.904+0000 7fdb86a30800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:17:20.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.904+0000 7fdb86a30800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:17:20.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.904+0000 7fdb86a30800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:509740b4-c081-4f37-bd6d-df9ca851489b.4237.10 2024-09-13T19:17:20.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.904+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:97 4.d 4:b343f7b9:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d2a097f0 con 0x5626d29447d0 2024-09-13T19:17:20.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.904+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 <== osd.3 v2:172.21.15.102:6800/3096737090 29 ==== osd_op_reply(97 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.0 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fdb7c032070 con 0x5626d29447d0 2024-09-13T19:17:20.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.904+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:98 4.6 4:63765c9d:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d2a097f0 con 0x5626d29447d0 2024-09-13T19:17:20.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.905+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 <== osd.3 v2:172.21.15.102:6800/3096737090 30 ==== osd_op_reply(98 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fdb7c032070 con 0x5626d29447d0 2024-09-13T19:17:20.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.905+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:99 4.2b 4:d44c9bdd:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d2a09810 con 0x7fdb7c035070 2024-09-13T19:17:20.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.905+0000 7fdb81d67640 1 -- 172.21.15.102:0/89872602 <== osd.2 v2:172.21.15.102:6816/2238176080 21 ==== osd_op_reply(99 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.2 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fdb74051070 con 0x7fdb7c035070 2024-09-13T19:17:20.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.905+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:100 4.22 4:44ac2606:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d2a09810 con 0x5626d293fde0 2024-09-13T19:17:20.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.905+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(100 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.3 [call out=85b] v0'0 uv11 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fdb6c029040 con 0x5626d293fde0 2024-09-13T19:17:20.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.905+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:101 4.2f 4:f64c06c7:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d2a09810 con 0x5626d293fde0 2024-09-13T19:17:20.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.906+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.1 v2:172.21.15.102:6808/2204418452 28 ==== osd_op_reply(101 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fdb6c029040 con 0x5626d293fde0 2024-09-13T19:17:20.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.906+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:102 4.3 4:c3b210de:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d2a09810 con 0x5626d293fde0 2024-09-13T19:17:20.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.906+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.1 v2:172.21.15.102:6808/2204418452 29 ==== osd_op_reply(102 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.5 [call out=378b] v0'0 uv5 ondisk = 0) ==== 195+0+378 (crc 0 0 0) 0x7fdb6c029040 con 0x5626d293fde0 2024-09-13T19:17:20.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.906+0000 7fdb86a30800 10 cls_bucket_list_unordered: got fourteen 2024-09-13T19:17:20.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.906+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:103 4.0 4:003ac6a0:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d2a09810 con 0x5626d29447d0 2024-09-13T19:17:20.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.906+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 <== osd.3 v2:172.21.15.102:6800/3096737090 31 ==== osd_op_reply(103 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fdb7c032070 con 0x5626d29447d0 2024-09-13T19:17:20.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.906+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:104 4.23 4:c740bc3c:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d2a09810 con 0x7fdb7405c070 2024-09-13T19:17:20.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.907+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 23 ==== osd_op_reply(104 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fdb6c029040 con 0x7fdb7405c070 2024-09-13T19:17:20.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.907+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:105 4.33 4:cf57a280:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d2a09810 con 0x7fdb7405c070 2024-09-13T19:17:20.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.907+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 24 ==== osd_op_reply(105 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fdb6c029040 con 0x7fdb7405c070 2024-09-13T19:17:20.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.908+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:106 4.2d 4:b7463d2a:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d2a09810 con 0x7fdb7405c070 2024-09-13T19:17:20.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.908+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 25 ==== osd_op_reply(106 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fdb6c045060 con 0x7fdb7405c070 2024-09-13T19:17:20.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.908+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:107 4.1e 4:78230e2e:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d2a09810 con 0x7fdb7405c070 2024-09-13T19:17:20.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.908+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 26 ==== osd_op_reply(107 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7fdb6c045060 con 0x7fdb7405c070 2024-09-13T19:17:20.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.908+0000 7fdb86a30800 20 get_obj_state: octx=0x7fdb740812f0 obj=myfoo7:fourteen state=0x5626d2a07898 s->prefetch_data=0 2024-09-13T19:17:20.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.908+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:108 3.3bs0 3:de03f557:::509740b4-c081-4f37-bd6d-df9ca851489b.4237.10_fourteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d2a086c0 con 0x5626d29447d0 2024-09-13T19:17:20.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.909+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 <== osd.3 v2:172.21.15.102:6800/3096737090 32 ==== osd_op_reply(108 509740b4-c081-4f37-bd6d-df9ca851489b.4237.10_fourteen [getxattrs out=858b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 239+0+874 (crc 0 0 0) 0x7fdb7c032070 con 0x5626d29447d0 2024-09-13T19:17:20.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.909+0000 7fdb86a30800 10 manifest: total_size = 8 2024-09-13T19:17:20.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.909+0000 7fdb86a30800 20 get_obj_state: setting s->obj_tag to 509740b4-c081-4f37-bd6d-df9ca851489b.4237.16655590607223982137 2024-09-13T19:17:20.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.909+0000 7fdb86a30800 20 get_obj_state: octx=0x7fdb740812f0 obj=myfoo7:fourteen state=0x5626d2a07898 s->prefetch_data=0 2024-09-13T19:17:20.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.909+0000 7fdb86a30800 20 prepare_atomic_modification: state is not atomic. state=0x5626d2a07898 2024-09-13T19:17:20.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.909+0000 7fdb86a30800 20 bucket index object: :.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.5 2024-09-13T19:17:20.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.909+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:109 4.3 4:c3b210de:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=188b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d2a09040 con 0x5626d293fde0 2024-09-13T19:17:20.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.910+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.1 v2:172.21.15.102:6808/2204418452 30 ==== osd_op_reply(109 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.5 [stat,call,call] v36'6 uv6 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fdb6c045060 con 0x5626d293fde0 2024-09-13T19:17:20.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.910+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:110 3.3bs0 3:de03f557:::509740b4-c081-4f37-bd6d-df9ca851489b.4237.10_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d2a09040 con 0x5626d29447d0 2024-09-13T19:17:20.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.911+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 <== osd.3 v2:172.21.15.102:6800/3096737090 33 ==== osd_op_reply(110 509740b4-c081-4f37-bd6d-df9ca851489b.4237.10_fourteen [call] v36'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7fdb7c032070 con 0x5626d29447d0 2024-09-13T19:17:20.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.911+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:111 4.3 4:c3b210de:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=265b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d2990ed0 con 0x5626d293fde0 2024-09-13T19:17:20.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.911+0000 7fdb86a30800 20 list_objects_ordered: starting attempt 1 2024-09-13T19:17:20.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.911+0000 7fdb86a30800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-13T19:17:20.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.911+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:112 4.d 4:b343f7b9:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d29927b0 con 0x5626d29447d0 2024-09-13T19:17:20.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.911+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:113 4.6 4:63765c9d:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d29927b0 con 0x5626d29447d0 2024-09-13T19:17:20.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.912+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:114 4.2b 4:d44c9bdd:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d2997580 con 0x7fdb7c035070 2024-09-13T19:17:20.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.912+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:115 4.22 4:44ac2606:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d2997580 con 0x5626d293fde0 2024-09-13T19:17:20.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.912+0000 7fdb81d67640 1 -- 172.21.15.102:0/89872602 <== osd.2 v2:172.21.15.102:6816/2238176080 22 ==== osd_op_reply(114 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.2 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fdb74051070 con 0x7fdb7c035070 2024-09-13T19:17:20.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.912+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 <== osd.3 v2:172.21.15.102:6800/3096737090 34 ==== osd_op_reply(112 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.0 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fdb7c032070 con 0x5626d29447d0 2024-09-13T19:17:20.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.912+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 <== osd.3 v2:172.21.15.102:6800/3096737090 35 ==== osd_op_reply(113 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fdb7c032070 con 0x5626d29447d0 2024-09-13T19:17:20.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.912+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:116 4.2f 4:f64c06c7:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d29927b0 con 0x5626d293fde0 2024-09-13T19:17:20.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.912+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:117 4.3 4:c3b210de:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d29927f0 con 0x5626d293fde0 2024-09-13T19:17:20.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.912+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:118 4.0 4:003ac6a0:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d299a350 con 0x5626d29447d0 2024-09-13T19:17:20.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.912+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.1 v2:172.21.15.102:6808/2204418452 31 ==== osd_op_reply(115 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.3 [call out=85b] v0'0 uv11 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fdb6c045060 con 0x5626d293fde0 2024-09-13T19:17:20.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.912+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:119 4.23 4:c740bc3c:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d299a350 con 0x7fdb7405c070 2024-09-13T19:17:20.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.913+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:120 4.33 4:cf57a280:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d299d060 con 0x7fdb7405c070 2024-09-13T19:17:20.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.913+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.1 v2:172.21.15.102:6808/2204418452 32 ==== osd_op_reply(116 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fdb6c045060 con 0x5626d293fde0 2024-09-13T19:17:20.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.913+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:121 4.2d 4:b7463d2a:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d299fb00 con 0x7fdb7405c070 2024-09-13T19:17:20.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.913+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:122 4.1e 4:78230e2e:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d2991df0 con 0x7fdb7405c070 2024-09-13T19:17:20.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.913+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.1 v2:172.21.15.102:6808/2204418452 33 ==== osd_op_reply(111 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.5 [stat,call,call] v36'7 uv7 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fdb6c045060 con 0x5626d293fde0 2024-09-13T19:17:20.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.913+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 <== osd.3 v2:172.21.15.102:6800/3096737090 36 ==== osd_op_reply(118 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fdb7c032070 con 0x5626d29447d0 2024-09-13T19:17:20.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.913+0000 7fda64ff9640 20 handle_completion(): completion ok for obj=fourteen 2024-09-13T19:17:20.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.913+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 27 ==== osd_op_reply(119 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fdb6c045060 con 0x7fdb7405c070 2024-09-13T19:17:20.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.913+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.1 v2:172.21.15.102:6808/2204418452 34 ==== osd_op_reply(117 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.5 [call out=124b] v0'0 uv7 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7fdb6c045060 con 0x5626d293fde0 2024-09-13T19:17:20.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.913+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 28 ==== osd_op_reply(120 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fdb6c045060 con 0x7fdb7405c070 2024-09-13T19:17:20.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.913+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 29 ==== osd_op_reply(121 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fdb6c045060 con 0x7fdb7405c070 2024-09-13T19:17:20.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.913+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 30 ==== osd_op_reply(122 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7fdb6c045060 con 0x7fdb7405c070 2024-09-13T19:17:20.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.913+0000 7fdb86a30800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-13T19:17:20.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.913+0000 7fdb86a30800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-13T19:17:20.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.913+0000 7fdb86a30800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-13T19:17:20.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.913+0000 7fdb86a30800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-13T19:17:20.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.913+0000 7fdb86a30800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[509740b4-c081-4f37-bd6d-df9ca851489b.4237.10])"; uploads.size()=0; is_truncated=0 2024-09-13T19:17:20.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.913+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:123 4.d 4:b343f7b9:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d299fb00 con 0x5626d29447d0 2024-09-13T19:17:20.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.913+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:124 4.6 4:63765c9d:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d2991800 con 0x5626d29447d0 2024-09-13T19:17:20.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.913+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:125 4.2b 4:d44c9bdd:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d2994d20 con 0x7fdb7c035070 2024-09-13T19:17:20.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.913+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:126 4.22 4:44ac2606:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d2995140 con 0x5626d293fde0 2024-09-13T19:17:20.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.913+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:127 4.2f 4:f64c06c7:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d299fb00 con 0x5626d293fde0 2024-09-13T19:17:20.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.913+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:128 4.3 4:c3b210de:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d2994d20 con 0x5626d293fde0 2024-09-13T19:17:20.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.913+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:129 4.0 4:003ac6a0:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d2999ea0 con 0x5626d29447d0 2024-09-13T19:17:20.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.913+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:130 4.23 4:c740bc3c:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d2991800 con 0x7fdb7405c070 2024-09-13T19:17:20.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.913+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:131 4.33 4:cf57a280:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d29a4990 con 0x7fdb7405c070 2024-09-13T19:17:20.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.913+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:132 4.2d 4:b7463d2a:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d2999ea0 con 0x7fdb7405c070 2024-09-13T19:17:20.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.913+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:133 4.1e 4:78230e2e:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d29a9730 con 0x7fdb7405c070 2024-09-13T19:17:20.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.914+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.1 v2:172.21.15.102:6808/2204418452 35 ==== osd_op_reply(126 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.3 [call out=85b] v0'0 uv11 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fdb6c045060 con 0x5626d293fde0 2024-09-13T19:17:20.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.914+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.1 v2:172.21.15.102:6808/2204418452 36 ==== osd_op_reply(127 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fdb6c045060 con 0x5626d293fde0 2024-09-13T19:17:20.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.914+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.1 v2:172.21.15.102:6808/2204418452 37 ==== osd_op_reply(128 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.5 [call out=124b] v0'0 uv7 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7fdb6c045060 con 0x5626d293fde0 2024-09-13T19:17:20.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.914+0000 7fdb81d67640 1 -- 172.21.15.102:0/89872602 <== osd.2 v2:172.21.15.102:6816/2238176080 23 ==== osd_op_reply(125 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.2 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fdb74051070 con 0x7fdb7c035070 2024-09-13T19:17:20.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.914+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 <== osd.3 v2:172.21.15.102:6800/3096737090 37 ==== osd_op_reply(124 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fdb7c079040 con 0x5626d29447d0 2024-09-13T19:17:20.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.914+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 <== osd.3 v2:172.21.15.102:6800/3096737090 38 ==== osd_op_reply(129 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fdb7c079040 con 0x5626d29447d0 2024-09-13T19:17:20.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.914+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 <== osd.3 v2:172.21.15.102:6800/3096737090 39 ==== osd_op_reply(123 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.0 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fdb7c079040 con 0x5626d29447d0 2024-09-13T19:17:20.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.914+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 31 ==== osd_op_reply(133 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7fdb6c045060 con 0x7fdb7405c070 2024-09-13T19:17:20.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.914+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 32 ==== osd_op_reply(130 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fdb6c045060 con 0x7fdb7405c070 2024-09-13T19:17:20.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.914+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 33 ==== osd_op_reply(131 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fdb6c045060 con 0x7fdb7405c070 2024-09-13T19:17:20.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.914+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 34 ==== osd_op_reply(132 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fdb6c045060 con 0x7fdb7405c070 2024-09-13T19:17:20.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.914+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:134 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d29922a0 con 0x7fdb7405c070 2024-09-13T19:17:20.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.915+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 35 ==== osd_op_reply(134 fud.buckets [call] v36'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fdb6c045060 con 0x7fdb7405c070 2024-09-13T19:17:20.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.915+0000 7fdb86a30800 10 cache get: name=default.rgw.meta+root+myfoo7 : miss 2024-09-13T19:17:20.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.915+0000 7fdb86a30800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.915+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d29922a0 con 0x7fdb7c035070 2024-09-13T19:17:20.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.916+0000 7fdb81d67640 1 -- 172.21.15.102:0/89872602 <== osd.2 v2:172.21.15.102:6816/2238176080 24 ==== osd_op_reply(135 myfoo7 [call out=48b,read 0~168 out=168b] v0'0 uv52 ondisk = 0) ==== 192+0+216 (crc 0 0 0) 0x7fdb74051070 con 0x7fdb7c035070 2024-09-13T19:17:20.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.916+0000 7fdb86a30800 20 rados_obj.operate() r=0 bl.length=168 2024-09-13T19:17:20.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.916+0000 7fdb86a30800 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x11 2024-09-13T19:17:20.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.916+0000 7fdb86a30800 10 adding default.rgw.meta+root+myfoo7 to cache LRU end 2024-09-13T19:17:20.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.916+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:136 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d2994d20 con 0x7fdb7c035070 2024-09-13T19:17:20.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.917+0000 7fdb81d67640 1 -- 172.21.15.102:0/89872602 <== osd.2 v2:172.21.15.102:6816/2238176080 25 ==== osd_op_reply(136 myfoo7 [call,call,delete] v36'53 uv53 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7fdb74051070 con 0x7fdb7c035070 2024-09-13T19:17:20.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.917+0000 7fdb86a30800 10 removing default.rgw.meta+root+myfoo7 from cache 2024-09-13T19:17:20.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.917+0000 7fdb86a30800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2024-09-13T19:17:20.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.917+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94724741995552 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d2992750 con 0x7fdb7c035070 2024-09-13T19:17:20.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.917+0000 7fdb81d67640 1 -- 172.21.15.102:0/89872602 <== osd.2 v2:172.21.15.102:6816/2238176080 26 ==== watch-notify(notify (1) cookie 94724741713040 notify 154618822676 ret 0) ==== 192+0+0 (crc 0 0 0) 0x5626d295cb70 con 0x7fdb7c035070 2024-09-13T19:17:20.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.917+0000 7fda657fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822676 cookie 94724741713040 notifier 4769 bl.length()=150 2024-09-13T19:17:20.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.917+0000 7fdb81d67640 1 -- 172.21.15.102:0/89872602 <== osd.2 v2:172.21.15.102:6816/2238176080 27 ==== osd_op_reply(137 notify.3 [notify cookie 94724741995552 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdb74051070 con 0x7fdb7c035070 2024-09-13T19:17:20.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.917+0000 7fda657fa640 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fda44003d60 con 0x7fdb7c035070 2024-09-13T19:17:20.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.917+0000 7fdb81d67640 1 -- 172.21.15.102:0/89872602 <== osd.2 v2:172.21.15.102:6816/2238176080 28 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb74051070 con 0x7fdb7c035070 2024-09-13T19:17:20.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.917+0000 7fdb81d67640 1 -- 172.21.15.102:0/89872602 <== osd.2 v2:172.21.15.102:6816/2238176080 29 ==== watch-notify(notify_complete (2) cookie 94724741995552 notify 154618822676 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fdb740ac040 con 0x7fdb7c035070 2024-09-13T19:17:20.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.917+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:139 8.11 8:893a7313:root::.bucket.meta.myfoo7%3a509740b4-c081-4f37-bd6d-df9ca851489b.4237.10:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d2994d20 con 0x5626d29447d0 2024-09-13T19:17:20.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.918+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 <== osd.3 v2:172.21.15.102:6800/3096737090 40 ==== osd_op_reply(139 .bucket.meta.myfoo7:509740b4-c081-4f37-bd6d-df9ca851489b.4237.10 [call,call,delete] v36'2 uv2 ondisk = 0) ==== 292+0+0 (crc 0 0 0) 0x7fdb7c079040 con 0x5626d29447d0 2024-09-13T19:17:20.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.918+0000 7fdb86a30800 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:509740b4-c081-4f37-bd6d-df9ca851489b.4237.10 from cache 2024-09-13T19:17:20.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.918+0000 7fdb86a30800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:509740b4-c081-4f37-bd6d-df9ca851489b.4237.10, ofs0, ns] 2024-09-13T19:17:20.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.918+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:140 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94724741995552 in=220b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d29922a0 con 0x7fdb7405c070 2024-09-13T19:17:20.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.919+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 36 ==== watch-notify(notify (1) cookie 94724741728592 notify 154618822691 ret 0) ==== 250+0+0 (crc 0 0 0) 0x5626d295d800 con 0x7fdb7405c070 2024-09-13T19:17:20.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.919+0000 7fda657fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822691 cookie 94724741728592 notifier 4769 bl.length()=208 2024-09-13T19:17:20.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.919+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 37 ==== osd_op_reply(140 notify.6 [notify cookie 94724741995552 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdb6c045060 con 0x7fdb7405c070 2024-09-13T19:17:20.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.919+0000 7fda657fa640 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:141 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fda44003d60 con 0x7fdb7405c070 2024-09-13T19:17:20.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.920+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 38 ==== watch-notify(notify_complete (2) cookie 94724741995552 notify 154618822691 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5626d2934a30 con 0x7fdb7405c070 2024-09-13T19:17:20.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.920+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 39 ==== osd_op_reply(141 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb6c045060 con 0x7fdb7405c070 2024-09-13T19:17:20.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.920+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:142 4.d 4:b343f7b9:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d298c290 con 0x5626d29447d0 2024-09-13T19:17:20.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.920+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:143 4.6 4:63765c9d:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d2992750 con 0x5626d29447d0 2024-09-13T19:17:20.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.920+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:144 4.2b 4:d44c9bdd:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d298aa70 con 0x7fdb7c035070 2024-09-13T19:17:20.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.920+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:145 4.22 4:44ac2606:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d29955c0 con 0x5626d293fde0 2024-09-13T19:17:20.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.920+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:146 4.2f 4:f64c06c7:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d29959a0 con 0x5626d293fde0 2024-09-13T19:17:20.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.920+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:147 4.3 4:c3b210de:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d298aa70 con 0x5626d293fde0 2024-09-13T19:17:20.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.920+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:148 4.0 4:003ac6a0:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d2992750 con 0x5626d29447d0 2024-09-13T19:17:20.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.920+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:149 4.23 4:c740bc3c:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d29955c0 con 0x7fdb7405c070 2024-09-13T19:17:20.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.920+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:150 4.33 4:cf57a280:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d298aa70 con 0x7fdb7405c070 2024-09-13T19:17:20.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.920+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:151 4.2d 4:b7463d2a:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d29959a0 con 0x7fdb7405c070 2024-09-13T19:17:20.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.920+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:152 4.1e 4:78230e2e:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d29931b0 con 0x7fdb7405c070 2024-09-13T19:17:20.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.921+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 <== osd.3 v2:172.21.15.102:6800/3096737090 41 ==== osd_op_reply(143 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.1 [delete] v36'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fdb7c079040 con 0x5626d29447d0 2024-09-13T19:17:20.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.922+0000 7fdb81d67640 1 -- 172.21.15.102:0/89872602 <== osd.2 v2:172.21.15.102:6816/2238176080 30 ==== osd_op_reply(144 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.2 [delete] v36'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fdb74051070 con 0x7fdb7c035070 2024-09-13T19:17:20.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.921+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.1 v2:172.21.15.102:6808/2204418452 38 ==== osd_op_reply(146 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.4 [delete] v36'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fdb6c045060 con 0x5626d293fde0 2024-09-13T19:17:20.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.922+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.1 v2:172.21.15.102:6808/2204418452 39 ==== osd_op_reply(147 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.5 [delete] v36'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fdb6c045060 con 0x5626d293fde0 2024-09-13T19:17:20.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.922+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.1 v2:172.21.15.102:6808/2204418452 40 ==== osd_op_reply(145 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.3 [delete] v36'12 uv12 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fdb6c045060 con 0x5626d293fde0 2024-09-13T19:17:20.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.922+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 <== osd.3 v2:172.21.15.102:6800/3096737090 42 ==== osd_op_reply(148 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.6 [delete] v36'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fdb7c079040 con 0x5626d29447d0 2024-09-13T19:17:20.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.922+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 <== osd.3 v2:172.21.15.102:6800/3096737090 43 ==== osd_op_reply(142 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.0 [delete] v36'5 uv5 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fdb7c079040 con 0x5626d29447d0 2024-09-13T19:17:20.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.922+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 40 ==== osd_op_reply(150 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.8 [delete] v36'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fdb6c045060 con 0x7fdb7405c070 2024-09-13T19:17:20.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.922+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 41 ==== osd_op_reply(152 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.10 [delete] v36'6 uv6 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7fdb6c045060 con 0x7fdb7405c070 2024-09-13T19:17:20.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.922+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 42 ==== osd_op_reply(149 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.7 [delete] v36'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fdb6c045060 con 0x7fdb7405c070 2024-09-13T19:17:20.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.922+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 43 ==== osd_op_reply(151 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.10.9 [delete] v36'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fdb6c045060 con 0x7fdb7405c070 2024-09-13T19:17:20.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.922+0000 7fdb86a30800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/509740b4-c081-4f37-bd6d-df9ca851489b.4237.10 : miss 2024-09-13T19:17:20.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.922+0000 7fdb86a30800 20 rados->read ofs=0 len=0 2024-09-13T19:17:20.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.922+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:153 6.2 6:447751bb:::pubsub..bucket.myfoo7%2f509740b4-c081-4f37-bd6d-df9ca851489b.4237.10:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d29919d0 con 0x5626d29447d0 2024-09-13T19:17:20.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.922+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 <== osd.3 v2:172.21.15.102:6800/3096737090 44 ==== osd_op_reply(153 pubsub..bucket.myfoo7/509740b4-c081-4f37-bd6d-df9ca851489b.4237.10 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7fdb7c079040 con 0x5626d29447d0 2024-09-13T19:17:20.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.922+0000 7fdb86a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:17:20.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.922+0000 7fdb86a30800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/509740b4-c081-4f37-bd6d-df9ca851489b.4237.10 info.flags=0x0 2024-09-13T19:17:20.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.922+0000 7fdb86a30800 10 adding default.rgw.log++pubsub..bucket.myfoo7/509740b4-c081-4f37-bd6d-df9ca851489b.4237.10 to cache LRU end 2024-09-13T19:17:20.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.922+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:154 6.2 6:447751bb:::pubsub..bucket.myfoo7%2f509740b4-c081-4f37-bd6d-df9ca851489b.4237.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d29919d0 con 0x5626d29447d0 2024-09-13T19:17:20.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.924+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 <== osd.3 v2:172.21.15.102:6800/3096737090 45 ==== osd_op_reply(154 pubsub..bucket.myfoo7/509740b4-c081-4f37-bd6d-df9ca851489b.4237.10 [delete] v36'11 uv10 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7fdb7c079040 con 0x5626d29447d0 2024-09-13T19:17:20.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.924+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:155 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=147b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d29919d0 con 0x7fdb7405c070 2024-09-13T19:17:20.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.925+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 44 ==== osd_op_reply(155 fud.buckets [call] v36'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fdb6c045060 con 0x7fdb7405c070 2024-09-13T19:17:20.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.926+0000 7fdb86a30800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-13T19:17:20.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.926+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:156 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d29919d0 con 0x7fdb7405c070 2024-09-13T19:17:20.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.926+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 45 ==== osd_op_reply(156 p5YnriCv1nAtykxBrupQ [delete] v36'12 uv12 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fdb6c045060 con 0x7fdb7405c070 2024-09-13T19:17:20.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.926+0000 7fdb86a30800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T19:17:20.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.926+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:157 7.15 7:a93a5511:::notify.2:head [notify cookie 94724741972624 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d29919d0 con 0x5626d29447d0 2024-09-13T19:17:20.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.927+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 <== osd.3 v2:172.21.15.102:6800/3096737090 46 ==== watch-notify(notify (1) cookie 94724741716016 notify 154618822663 ret 0) ==== 212+0+0 (crc 0 0 0) 0x5626d298b810 con 0x5626d29447d0 2024-09-13T19:17:20.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.927+0000 7fda657fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822663 cookie 94724741716016 notifier 4769 bl.length()=170 2024-09-13T19:17:20.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.927+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 <== osd.3 v2:172.21.15.102:6800/3096737090 47 ==== osd_op_reply(157 notify.2 [notify cookie 94724741972624 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdb7c079040 con 0x5626d29447d0 2024-09-13T19:17:20.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.927+0000 7fda657fa640 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:158 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fda44003d60 con 0x5626d29447d0 2024-09-13T19:17:20.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.927+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 <== osd.3 v2:172.21.15.102:6800/3096737090 48 ==== watch-notify(notify_complete (2) cookie 94724741972624 notify 154618822663 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5626d29347a0 con 0x5626d29447d0 2024-09-13T19:17:20.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.927+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 <== osd.3 v2:172.21.15.102:6800/3096737090 49 ==== osd_op_reply(158 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb7c079040 con 0x5626d29447d0 2024-09-13T19:17:20.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.927+0000 7fdb86a30800 10 removing email index: 2024-09-13T19:17:20.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.927+0000 7fdb86a30800 10 removing user buckets index 2024-09-13T19:17:20.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.927+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:159 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d29919d0 con 0x7fdb7405c070 2024-09-13T19:17:20.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.928+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 46 ==== osd_op_reply(159 fud.buckets [delete] v36'8 uv8 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fdb6c045060 con 0x7fdb7405c070 2024-09-13T19:17:20.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.928+0000 7fdb86a30800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-13T19:17:20.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.928+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94724741972624 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d29919d0 con 0x7fdb7405c070 2024-09-13T19:17:20.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.929+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 47 ==== watch-notify(notify (1) cookie 94724741728592 notify 154618822692 ret 0) ==== 202+0+0 (crc 0 0 0) 0x5626d2934a30 con 0x7fdb7405c070 2024-09-13T19:17:20.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.929+0000 7fda657fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822692 cookie 94724741728592 notifier 4769 bl.length()=160 2024-09-13T19:17:20.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.929+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 48 ==== osd_op_reply(160 notify.6 [notify cookie 94724741972624 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdb6c045060 con 0x7fdb7405c070 2024-09-13T19:17:20.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.929+0000 7fda657fa640 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fda44003d60 con 0x7fdb7405c070 2024-09-13T19:17:20.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.929+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 49 ==== watch-notify(notify_complete (2) cookie 94724741972624 notify 154618822692 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5626d295d380 con 0x7fdb7405c070 2024-09-13T19:17:20.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.929+0000 7fdb86a30800 10 removing user index: fud 2024-09-13T19:17:20.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.929+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 50 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb6c045060 con 0x7fdb7405c070 2024-09-13T19:17:20.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.929+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:162 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d298af70 con 0x7fdb7405c070 2024-09-13T19:17:20.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.930+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 51 ==== osd_op_reply(162 fud [call,call,delete] v36'7 uv7 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fdb6c045060 con 0x7fdb7405c070 2024-09-13T19:17:20.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.930+0000 7fdb86a30800 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-13T19:17:20.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.930+0000 7fdb86a30800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-13T19:17:20.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.930+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94724741972624 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5626d2989f60 con 0x7fdb7405c070 2024-09-13T19:17:20.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.930+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 52 ==== watch-notify(notify (1) cookie 94724741725920 notify 154618822693 ret 0) ==== 194+0+0 (crc 0 0 0) 0x5626d295d380 con 0x7fdb7405c070 2024-09-13T19:17:20.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.930+0000 7fda64ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822693 cookie 94724741725920 notifier 4769 bl.length()=152 2024-09-13T19:17:20.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.930+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 53 ==== osd_op_reply(163 notify.5 [notify cookie 94724741972624 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdb6c045060 con 0x7fdb7405c070 2024-09-13T19:17:20.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.930+0000 7fda64ff9640 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fd9ac0032c0 con 0x7fdb7405c070 2024-09-13T19:17:20.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.931+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 54 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb6c045060 con 0x7fdb7405c070 2024-09-13T19:17:20.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.931+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 55 ==== watch-notify(notify_complete (2) cookie 94724741972624 notify 154618822693 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5626d295d170 con 0x7fdb7405c070 2024-09-13T19:17:20.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.932+0000 7fda337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:17:20.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.932+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94724741726976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d2958b90 con 0x5626d293fde0 2024-09-13T19:17:20.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.933+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.1 v2:172.21.15.102:6808/2204418452 41 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94724741726976] v36'227 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdb6c045060 con 0x5626d293fde0 2024-09-13T19:17:20.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.933+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94724741705440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d2950300 con 0x7fdb7c035070 2024-09-13T19:17:20.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.934+0000 7fdb81d67640 1 -- 172.21.15.102:0/89872602 <== osd.2 v2:172.21.15.102:6816/2238176080 31 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94724741705440] v36'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb74051070 con 0x7fdb7c035070 2024-09-13T19:17:20.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.934+0000 7fdb86a30800 20 remove_watcher() i=0 2024-09-13T19:17:20.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.934+0000 7fdb86a30800 2 removed watcher, disabling cache 2024-09-13T19:17:20.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.934+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94724741710016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d294aee0 con 0x5626d293fde0 2024-09-13T19:17:20.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.935+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.1 v2:172.21.15.102:6808/2204418452 42 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94724741710016] v36'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb6c045060 con 0x5626d293fde0 2024-09-13T19:17:20.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.935+0000 7fdb86a30800 20 remove_watcher() i=1 2024-09-13T19:17:20.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.935+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94724741716016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d294aee0 con 0x5626d29447d0 2024-09-13T19:17:20.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.936+0000 7fdb82568640 1 -- 172.21.15.102:0/89872602 <== osd.3 v2:172.21.15.102:6800/3096737090 50 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94724741716016] v36'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb7c079040 con 0x5626d29447d0 2024-09-13T19:17:20.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.936+0000 7fdb86a30800 20 remove_watcher() i=2 2024-09-13T19:17:20.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.936+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94724741713040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d294aee0 con 0x7fdb7c035070 2024-09-13T19:17:20.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.937+0000 7fdb81d67640 1 -- 172.21.15.102:0/89872602 <== osd.2 v2:172.21.15.102:6816/2238176080 32 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94724741713040] v36'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb74051070 con 0x7fdb7c035070 2024-09-13T19:17:20.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.937+0000 7fdb86a30800 20 remove_watcher() i=3 2024-09-13T19:17:20.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.937+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94724741722048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d294cc40 con 0x5626d293fde0 2024-09-13T19:17:20.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.938+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.1 v2:172.21.15.102:6808/2204418452 43 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94724741722048] v36'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb6c045060 con 0x5626d293fde0 2024-09-13T19:17:20.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.938+0000 7fdb86a30800 20 remove_watcher() i=4 2024-09-13T19:17:20.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.938+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94724741725920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d294efc0 con 0x7fdb7405c070 2024-09-13T19:17:20.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.939+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 56 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94724741725920] v36'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb6c045060 con 0x7fdb7405c070 2024-09-13T19:17:20.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.939+0000 7fdb86a30800 20 remove_watcher() i=5 2024-09-13T19:17:20.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.939+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94724741728592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d294efc0 con 0x7fdb7405c070 2024-09-13T19:17:20.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.940+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 57 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94724741728592] v36'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb6c045060 con 0x7fdb7405c070 2024-09-13T19:17:20.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.940+0000 7fdb86a30800 20 remove_watcher() i=6 2024-09-13T19:17:20.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.940+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94724741731152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5626d2950950 con 0x7fdb7405c070 2024-09-13T19:17:20.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.941+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 <== osd.0 v2:172.21.15.53:6800/4021716951 58 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94724741731152] v36'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb6c045060 con 0x7fdb7405c070 2024-09-13T19:17:20.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.941+0000 7fdb86a30800 20 remove_watcher() i=7 2024-09-13T19:17:20.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.942+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fdb7405c070 msgr2=0x7fdb7408f550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.942+0000 7fdb86a30800 1 --2- 172.21.15.102:0/89872602 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fdb7405c070 0x7fdb7408f550 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.942+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5626d293fde0 msgr2=0x5626d29422a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.942+0000 7fdb86a30800 1 --2- 172.21.15.102:0/89872602 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5626d293fde0 0x5626d29422a0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.942+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fdb7c035070 msgr2=0x7fdb7c04e3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.942+0000 7fdb86a30800 1 --2- 172.21.15.102:0/89872602 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fdb7c035070 0x7fdb7c04e3b0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.942+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5626d29447d0 msgr2=0x5626d2946bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.942+0000 7fdb86a30800 1 --2- 172.21.15.102:0/89872602 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5626d29447d0 0x5626d2946bc0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.942+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fda4c036b40 msgr2=0x7fda4c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.942+0000 7fdb86a30800 1 --2- 172.21.15.102:0/89872602 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fda4c036b40 0x7fda4c039000 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fdb740813f0 tx=0x7fdb7408a000 comp rx=0 tx=0).stop 2024-09-13T19:17:20.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.942+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d292ce80 msgr2=0x5626d2934260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.942+0000 7fdb86a30800 1 --2- 172.21.15.102:0/89872602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d292ce80 0x5626d2934260 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c023040 tx=0x7fdb7c04cd10 comp rx=0 tx=0).stop 2024-09-13T19:17:20.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.942+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 reap_dead start 2024-09-13T19:17:20.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.942+0000 7fdb79566640 1 -- 172.21.15.102:0/89872602 reap_dead start 2024-09-13T19:17:20.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.942+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 shutdown_connections 2024-09-13T19:17:20.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.942+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 >> 172.21.15.102:0/89872602 conn(0x5626d29291e0 msgr2=0x5626d29272b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:20.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.942+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 shutdown_connections 2024-09-13T19:17:20.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.942+0000 7fdb86a30800 1 -- 172.21.15.102:0/89872602 wait complete. 2024-09-13T19:17:20.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.942+0000 7fdb86a30800 1 -- 172.21.15.102:0/4107797799 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fda5c036b40 msgr2=0x7fda5c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.942+0000 7fdb86a30800 1 --2- 172.21.15.102:0/4107797799 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fda5c036b40 0x7fda5c039000 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x5626d2909960 tx=0x7fdb7408f2c0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.942+0000 7fdb86a30800 1 -- 172.21.15.102:0/4107797799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d2920130 msgr2=0x5626d2920550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.942+0000 7fdb86a30800 1 --2- 172.21.15.102:0/4107797799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d2920130 0x5626d2920550 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x5626d290cdf0 tx=0x7fdb7c0167b0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.942+0000 7fdb86a30800 1 -- 172.21.15.102:0/4107797799 shutdown_connections 2024-09-13T19:17:20.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.942+0000 7fdb86a30800 1 --2- 172.21.15.102:0/4107797799 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fda5c036b40 0x7fda5c039000 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.942+0000 7fdb86a30800 1 --2- 172.21.15.102:0/4107797799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d2920130 0x5626d2920550 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.942+0000 7fdb86a30800 1 -- 172.21.15.102:0/4107797799 >> 172.21.15.102:0/4107797799 conn(0x5626d29150c0 msgr2=0x5626d2917c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:20.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.942+0000 7fdb86a30800 1 -- 172.21.15.102:0/4107797799 shutdown_connections 2024-09-13T19:17:20.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.942+0000 7fdb86a30800 1 -- 172.21.15.102:0/4107797799 wait complete. 2024-09-13T19:17:20.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.943+0000 7fdb86a30800 1 -- 172.21.15.102:0/636662597 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5626d280b320 msgr2=0x5626d290c470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.943+0000 7fdb86a30800 1 --2- 172.21.15.102:0/636662597 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5626d280b320 0x5626d290c470 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.943+0000 7fdb86a30800 1 -- 172.21.15.102:0/636662597 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5626d290ed40 msgr2=0x5626d2911130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.943+0000 7fdb86a30800 1 --2- 172.21.15.102:0/636662597 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5626d290ed40 0x5626d2911130 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.943+0000 7fdb86a30800 1 -- 172.21.15.102:0/636662597 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fda68036b40 msgr2=0x7fda68039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.943+0000 7fdb86a30800 1 --2- 172.21.15.102:0/636662597 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fda68036b40 0x7fda68039000 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c000f60 tx=0x7fdb6c0012b0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.943+0000 7fdb86a30800 1 -- 172.21.15.102:0/636662597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d280a9e0 msgr2=0x5626d2905400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:17:20.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.943+0000 7fdb86a30800 1 --2- 172.21.15.102:0/636662597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d280a9e0 0x5626d2905400 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x5626d28fe8f0 tx=0x7fdb74002fb0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.943+0000 7fdb86a30800 1 -- 172.21.15.102:0/636662597 shutdown_connections 2024-09-13T19:17:20.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.943+0000 7fdb86a30800 1 --2- 172.21.15.102:0/636662597 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5626d290ed40 0x5626d2911130 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.943+0000 7fdb86a30800 1 --2- 172.21.15.102:0/636662597 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5626d280b320 0x5626d290c470 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.943+0000 7fdb86a30800 1 --2- 172.21.15.102:0/636662597 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fda68036b40 0x7fda68039000 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.943+0000 7fdb86a30800 1 --2- 172.21.15.102:0/636662597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626d280a9e0 0x5626d2905400 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:17:20.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.943+0000 7fdb86a30800 1 -- 172.21.15.102:0/636662597 >> 172.21.15.102:0/636662597 conn(0x5626d2806550 msgr2=0x5626d28f7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:17:20.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.943+0000 7fdb86a30800 1 -- 172.21.15.102:0/636662597 shutdown_connections 2024-09-13T19:17:20.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:17:20.943+0000 7fdb86a30800 1 -- 172.21.15.102:0/636662597 wait complete. 2024-09-13T19:18:00.962 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2024-09-13T19:18:00.963 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2024-09-13T19:18:00.964 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2024-09-13T19:18:01.014 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:18:01.014 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:18:01.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.012+0000 7fbbb3d3e800 1 Processor -- start 2024-09-13T19:18:01.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.012+0000 7fbbb3d3e800 1 -- start start 2024-09-13T19:18:01.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.012+0000 7fbbb3d3e800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5630f60635b0 0x5630f60f22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.012+0000 7fbbb3d3e800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5630f5faeb30 con 0x5630f60f2810 2024-09-13T19:18:01.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.012+0000 7fbbb3d3e800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5630f5f90360 con 0x5630f60635b0 2024-09-13T19:18:01.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.013+0000 7fbbafa34640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5630f60635b0 0x5630f60f22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.013+0000 7fbbaf233640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5630f60f2810 0x5630f60f4c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:53602/0 (socket says 172.21.15.102:53602) 2024-09-13T19:18:01.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.013+0000 7fbbaf233640 1 -- 172.21.15.102:0/1414754341 learned_addr learned my addr 172.21.15.102:0/1414754341 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:18:01.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.013+0000 7fbbafa34640 1 -- 172.21.15.102:0/1414754341 >> v1:172.21.15.53:6789/0 conn(0x5630f60f2810 legacy=0x5630f60f4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.013+0000 7fbbafa34640 1 -- 172.21.15.102:0/1414754341 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630f5fb6e00 con 0x5630f60635b0 2024-09-13T19:18:01.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.015+0000 7fbbafa34640 1 --2- 172.21.15.102:0/1414754341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630f60635b0 0x5630f60f22d0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fbba0005fd0 tx=0x7fbba0045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40feaae01b0f4e04 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.015+0000 7fbbaea32640 1 -- 172.21.15.102:0/1414754341 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbba0058530 con 0x5630f60635b0 2024-09-13T19:18:01.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.015+0000 7fbbaea32640 1 -- 172.21.15.102:0/1414754341 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbba00586d0 con 0x5630f60635b0 2024-09-13T19:18:01.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.015+0000 7fbbaea32640 1 -- 172.21.15.102:0/1414754341 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbba00589d0 con 0x5630f60635b0 2024-09-13T19:18:01.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.016+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/1414754341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630f60635b0 msgr2=0x5630f60f22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.016+0000 7fbbb3d3e800 1 --2- 172.21.15.102:0/1414754341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630f60635b0 0x5630f60f22d0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fbba0005fd0 tx=0x7fbba0045c30 comp rx=0 tx=0).stop 2024-09-13T19:18:01.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.016+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/1414754341 shutdown_connections 2024-09-13T19:18:01.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.016+0000 7fbbb3d3e800 1 --2- 172.21.15.102:0/1414754341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630f60635b0 0x5630f60f22d0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.016+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/1414754341 >> 172.21.15.102:0/1414754341 conn(0x5630f60e9de0 msgr2=0x5630f60ec200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:01.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.016+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/1414754341 shutdown_connections 2024-09-13T19:18:01.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.016+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/1414754341 wait complete. 2024-09-13T19:18:01.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.031+0000 7fbbb3d3e800 1 Processor -- start 2024-09-13T19:18:01.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.031+0000 7fbbb3d3e800 1 -- start start 2024-09-13T19:18:01.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.031+0000 7fbbb3d3e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630f60635b0 0x5630f61de8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.031+0000 7fbbb3d3e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5630f603b330 con 0x5630f60635b0 2024-09-13T19:18:01.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.032+0000 7fbbafa34640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630f60635b0 0x5630f61de8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.032+0000 7fbbafa34640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630f60635b0 0x5630f61de8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49070/0 (socket says 172.21.15.102:49070) 2024-09-13T19:18:01.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.032+0000 7fbbafa34640 1 -- 172.21.15.102:0/2318535867 learned_addr learned my addr 172.21.15.102:0/2318535867 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:01.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.032+0000 7fbbafa34640 1 -- 172.21.15.102:0/2318535867 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630f5f88bc0 con 0x5630f60635b0 2024-09-13T19:18:01.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.032+0000 7fbbafa34640 1 --2- 172.21.15.102:0/2318535867 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630f60635b0 0x5630f61de8d0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fbba000a3f0 tx=0x7fbba0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec0124f1ce400686 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.032+0000 7fba9de0b640 1 -- 172.21.15.102:0/2318535867 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbba00589b0 con 0x5630f60635b0 2024-09-13T19:18:01.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.033+0000 7fba9de0b640 1 -- 172.21.15.102:0/2318535867 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbba0068070 con 0x5630f60635b0 2024-09-13T19:18:01.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.033+0000 7fba9de0b640 1 -- 172.21.15.102:0/2318535867 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbba0058c80 con 0x5630f60635b0 2024-09-13T19:18:01.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.033+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2318535867 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630f60635b0 msgr2=0x5630f61de8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.033+0000 7fbbb3d3e800 1 --2- 172.21.15.102:0/2318535867 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630f60635b0 0x5630f61de8d0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fbba000a3f0 tx=0x7fbba0051000 comp rx=0 tx=0).stop 2024-09-13T19:18:01.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.033+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2318535867 shutdown_connections 2024-09-13T19:18:01.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.033+0000 7fbbb3d3e800 1 --2- 172.21.15.102:0/2318535867 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630f60635b0 0x5630f61de8d0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.033+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2318535867 >> 172.21.15.102:0/2318535867 conn(0x5630f60e9de0 msgr2=0x5630f61da290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:01.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.033+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2318535867 shutdown_connections 2024-09-13T19:18:01.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.033+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2318535867 wait complete. 2024-09-13T19:18:01.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.034+0000 7fbbb3d3e800 1 Processor -- start 2024-09-13T19:18:01.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.034+0000 7fbbb3d3e800 1 -- start start 2024-09-13T19:18:01.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.034+0000 7fbbb3d3e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630f60f2810 0x5630f61e6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.034+0000 7fbbb3d3e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5630f60f66b0 con 0x5630f60f2810 2024-09-13T19:18:01.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.034+0000 7fbbafa34640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630f60f2810 0x5630f61e6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.034+0000 7fbbafa34640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630f60f2810 0x5630f61e6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49086/0 (socket says 172.21.15.102:49086) 2024-09-13T19:18:01.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.034+0000 7fbbafa34640 1 -- 172.21.15.102:0/631499927 learned_addr learned my addr 172.21.15.102:0/631499927 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:01.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.034+0000 7fbbafa34640 1 -- 172.21.15.102:0/631499927 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630f5f9cfe0 con 0x5630f60f2810 2024-09-13T19:18:01.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.035+0000 7fbbafa34640 1 --2- 172.21.15.102:0/631499927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630f60f2810 0x5630f61e6440 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fbba0065040 tx=0x7fbba0003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.035+0000 7fba97fff640 1 -- 172.21.15.102:0/631499927 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbba0063520 con 0x5630f60f2810 2024-09-13T19:18:01.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.035+0000 7fba97fff640 1 -- 172.21.15.102:0/631499927 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbba00636c0 con 0x5630f60f2810 2024-09-13T19:18:01.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.035+0000 7fba97fff640 1 -- 172.21.15.102:0/631499927 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbba00639a0 con 0x5630f60f2810 2024-09-13T19:18:01.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.035+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/631499927 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5630f61e6980 con 0x5630f60f2810 2024-09-13T19:18:01.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.035+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/631499927 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630f61e6ea0 con 0x5630f60f2810 2024-09-13T19:18:01.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.036+0000 7fba97fff640 1 -- 172.21.15.102:0/631499927 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fbba0074020 con 0x5630f60f2810 2024-09-13T19:18:01.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.036+0000 7fba97fff640 1 --2- 172.21.15.102:0/631499927 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fba98036b40 0x7fba98039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.036+0000 7fba97fff640 1 -- 172.21.15.102:0/631499927 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fbba0090880 con 0x5630f60f2810 2024-09-13T19:18:01.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.036+0000 7fbbaf233640 1 --2- 172.21.15.102:0/631499927 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fba98036b40 0x7fba98039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.036+0000 7fbbb3d3e800 1 --2- 172.21.15.102:0/631499927 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5630f61eb4a0 0x5630f61ed890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.036+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/631499927 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630f61ede10 con 0x5630f61eb4a0 2024-09-13T19:18:01.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.036+0000 7fbbb0235640 1 --2- 172.21.15.102:0/631499927 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5630f61eb4a0 0x5630f61ed890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.036+0000 7fbbaf233640 1 --2- 172.21.15.102:0/631499927 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fba98036b40 0x7fba98039000 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbb98000f60 tx=0x7fbb980012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.037+0000 7fbbb0235640 1 --2- 172.21.15.102:0/631499927 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5630f61eb4a0 0x5630f61ed890 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.037+0000 7fbbb0235640 1 -- 172.21.15.102:0/631499927 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbba80083e0 con 0x5630f61eb4a0 2024-09-13T19:18:01.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.037+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/631499927 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630f61eaa40 con 0x5630f61eb4a0 2024-09-13T19:18:01.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.037+0000 7fbbb0235640 1 -- 172.21.15.102:0/631499927 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbba80083e0 con 0x5630f61eb4a0 2024-09-13T19:18:01.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.037+0000 7fbbb3d3e800 1 --2- 172.21.15.102:0/631499927 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5630f61f0120 0x5630f61f2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.037+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/631499927 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630f61f2be0 con 0x5630f61f0120 2024-09-13T19:18:01.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.037+0000 7fbbafa34640 1 --2- 172.21.15.102:0/631499927 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5630f61f0120 0x5630f61f2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.037+0000 7fbbafa34640 1 --2- 172.21.15.102:0/631499927 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5630f61f0120 0x5630f61f2510 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.038+0000 7fbbafa34640 1 -- 172.21.15.102:0/631499927 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbba006c970 con 0x5630f61f0120 2024-09-13T19:18:01.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.038+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/631499927 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630f61eefc0 con 0x5630f61eb4a0 2024-09-13T19:18:01.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.038+0000 7fbbb0235640 1 -- 172.21.15.102:0/631499927 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbba80083e0 con 0x5630f61eb4a0 2024-09-13T19:18:01.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.038+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/631499927 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630f61ef460 con 0x5630f61f0120 2024-09-13T19:18:01.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.038+0000 7fbbafa34640 1 -- 172.21.15.102:0/631499927 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbba006c970 con 0x5630f61f0120 2024-09-13T19:18:01.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.039+0000 7fbbb3d3e800 1 Processor -- start 2024-09-13T19:18:01.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.039+0000 7fbbb3d3e800 1 -- start start 2024-09-13T19:18:01.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.039+0000 7fbbb3d3e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630f6201530 0x5630f6201950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.039+0000 7fbbb3d3e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5630f5f8a580 con 0x5630f6201530 2024-09-13T19:18:01.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.039+0000 7fbbb0235640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630f6201530 0x5630f6201950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.039+0000 7fbbb0235640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630f6201530 0x5630f6201950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49092/0 (socket says 172.21.15.102:49092) 2024-09-13T19:18:01.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.039+0000 7fbbb0235640 1 -- 172.21.15.102:0/1015534568 learned_addr learned my addr 172.21.15.102:0/1015534568 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:01.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.040+0000 7fbbb0235640 1 -- 172.21.15.102:0/1015534568 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630f6201e90 con 0x5630f6201530 2024-09-13T19:18:01.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.040+0000 7fbbb0235640 1 --2- 172.21.15.102:0/1015534568 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630f6201530 0x5630f6201950 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x5630f61e74f0 tx=0x7fbba800beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.040+0000 7fba957fa640 1 -- 172.21.15.102:0/1015534568 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbba801c020 con 0x5630f6201530 2024-09-13T19:18:01.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.040+0000 7fba957fa640 1 -- 172.21.15.102:0/1015534568 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbba8007cf0 con 0x5630f6201530 2024-09-13T19:18:01.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.040+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/1015534568 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5630f6202120 con 0x5630f6201530 2024-09-13T19:18:01.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.040+0000 7fba957fa640 1 -- 172.21.15.102:0/1015534568 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbba8018440 con 0x5630f6201530 2024-09-13T19:18:01.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.040+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/1015534568 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630f6204e00 con 0x5630f6201530 2024-09-13T19:18:01.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.041+0000 7fba957fa640 1 -- 172.21.15.102:0/1015534568 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fbba801f020 con 0x5630f6201530 2024-09-13T19:18:01.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.041+0000 7fba957fa640 1 --2- 172.21.15.102:0/1015534568 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fba88036b40 0x7fba88039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.041+0000 7fba957fa640 1 -- 172.21.15.102:0/1015534568 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fbba804e300 con 0x5630f6201530 2024-09-13T19:18:01.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.041+0000 7fbbafa34640 1 --2- 172.21.15.102:0/1015534568 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fba88036b40 0x7fba88039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.042+0000 7fbbb3d3e800 1 Processor -- start 2024-09-13T19:18:01.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.042+0000 7fbbb3d3e800 1 -- start start 2024-09-13T19:18:01.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.042+0000 7fbbafa34640 1 --2- 172.21.15.102:0/1015534568 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fba88036b40 0x7fba88039000 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fbba000a3f0 tx=0x7fbba006cf90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.042+0000 7fbbb3d3e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630f620e170 0x5630f620e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.042+0000 7fbbb3d3e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5630f61defc0 con 0x5630f620e170 2024-09-13T19:18:01.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.042+0000 7fbbb0235640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630f620e170 0x5630f620e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.042+0000 7fbbb0235640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630f620e170 0x5630f620e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49098/0 (socket says 172.21.15.102:49098) 2024-09-13T19:18:01.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.042+0000 7fbbb0235640 1 -- 172.21.15.102:0/4075452935 learned_addr learned my addr 172.21.15.102:0/4075452935 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:01.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.043+0000 7fbbb0235640 1 -- 172.21.15.102:0/4075452935 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630f620eb40 con 0x5630f620e170 2024-09-13T19:18:01.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.043+0000 7fbbb0235640 1 --2- 172.21.15.102:0/4075452935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630f620e170 0x5630f620e570 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fbba804c670 tx=0x7fbba8016630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8654a570255c2aa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.043+0000 7fba8effd640 1 -- 172.21.15.102:0/4075452935 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbba8045070 con 0x5630f620e170 2024-09-13T19:18:01.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.043+0000 7fba8effd640 1 -- 172.21.15.102:0/4075452935 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbba8021400 con 0x5630f620e170 2024-09-13T19:18:01.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.043+0000 7fba8effd640 1 -- 172.21.15.102:0/4075452935 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbba8018b90 con 0x5630f620e170 2024-09-13T19:18:01.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.043+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/4075452935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630f620e170 msgr2=0x5630f620e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.043+0000 7fbbb3d3e800 1 --2- 172.21.15.102:0/4075452935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630f620e170 0x5630f620e570 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fbba804c670 tx=0x7fbba8016630 comp rx=0 tx=0).stop 2024-09-13T19:18:01.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.043+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/4075452935 shutdown_connections 2024-09-13T19:18:01.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.043+0000 7fbbb3d3e800 1 --2- 172.21.15.102:0/4075452935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630f620e170 0x5630f620e570 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.043+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/4075452935 >> 172.21.15.102:0/4075452935 conn(0x5630f620a560 msgr2=0x5630f6208660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:01.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.043+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/4075452935 shutdown_connections 2024-09-13T19:18:01.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.044+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/4075452935 wait complete. 2024-09-13T19:18:01.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.044+0000 7fbbb3d3e800 1 Processor -- start 2024-09-13T19:18:01.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.044+0000 7fbbb3d3e800 1 -- start start 2024-09-13T19:18:01.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.044+0000 7fbbb3d3e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630f620e170 0x5630f6215650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.044+0000 7fbbb3d3e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5630f620f180 con 0x5630f620e170 2024-09-13T19:18:01.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.044+0000 7fbbb0235640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630f620e170 0x5630f6215650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.044+0000 7fbbb0235640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630f620e170 0x5630f6215650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49110/0 (socket says 172.21.15.102:49110) 2024-09-13T19:18:01.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.044+0000 7fbbb0235640 1 -- 172.21.15.102:0/2029390040 learned_addr learned my addr 172.21.15.102:0/2029390040 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:01.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.044+0000 7fbbb0235640 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630f6215b90 con 0x5630f620e170 2024-09-13T19:18:01.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.045+0000 7fbbb0235640 1 --2- 172.21.15.102:0/2029390040 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630f620e170 0x5630f6215650 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fbba8043040 tx=0x7fbba804c5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.045+0000 7fba8d7fa640 1 -- 172.21.15.102:0/2029390040 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbba8045070 con 0x5630f620e170 2024-09-13T19:18:01.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.045+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5630f6215e20 con 0x5630f620e170 2024-09-13T19:18:01.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.045+0000 7fba8d7fa640 1 -- 172.21.15.102:0/2029390040 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbba8046040 con 0x5630f620e170 2024-09-13T19:18:01.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.045+0000 7fba8d7fa640 1 -- 172.21.15.102:0/2029390040 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbba803f040 con 0x5630f620e170 2024-09-13T19:18:01.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.045+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630f6218ad0 con 0x5630f620e170 2024-09-13T19:18:01.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.046+0000 7fba8d7fa640 1 -- 172.21.15.102:0/2029390040 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fbba8016040 con 0x5630f620e170 2024-09-13T19:18:01.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.046+0000 7fba8d7fa640 1 --2- 172.21.15.102:0/2029390040 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fba78036b40 0x7fba78039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.046+0000 7fba8d7fa640 1 -- 172.21.15.102:0/2029390040 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fbba80224e0 con 0x5630f620e170 2024-09-13T19:18:01.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.046+0000 7fbbafa34640 1 --2- 172.21.15.102:0/2029390040 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fba78036b40 0x7fba78039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.047+0000 7fbbafa34640 1 --2- 172.21.15.102:0/2029390040 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fba78036b40 0x7fba78039000 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbba0090010 tx=0x7fbba008c000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.047+0000 7fbbb3d3e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:01.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.047+0000 7fbbb3d3e800 1 --2- 172.21.15.102:0/2029390040 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5630f6221100 0x5630f62235c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.047+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630f6223d10 con 0x5630f6221100 2024-09-13T19:18:01.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.047+0000 7fbbaf233640 1 --2- 172.21.15.102:0/2029390040 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5630f6221100 0x5630f62235c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.047+0000 7fbbaf233640 1 --2- 172.21.15.102:0/2029390040 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5630f6221100 0x5630f62235c0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.047+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbb98009050 con 0x5630f6221100 2024-09-13T19:18:01.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.047+0000 7fbbb3d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:01.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.047+0000 7fbbb3d3e800 20 realm 2024-09-13T19:18:01.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.047+0000 7fbbb3d3e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:01.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.047+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630f6220550 con 0x5630f6221100 2024-09-13T19:18:01.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.047+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbb98009050 con 0x5630f6221100 2024-09-13T19:18:01.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.047+0000 7fbbb3d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:01.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.047+0000 7fbbb3d3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:18:01.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.047+0000 7fbbb3d3e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:01.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.047+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630f6224800 con 0x5630f6221100 2024-09-13T19:18:01.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.048+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbb98009050 con 0x5630f6221100 2024-09-13T19:18:01.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.048+0000 7fbbb3d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:01.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.048+0000 7fbbb3d3e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:01.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.048+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630f62250d0 con 0x5630f6221100 2024-09-13T19:18:01.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.048+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbb98009050 con 0x5630f6221100 2024-09-13T19:18:01.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.048+0000 7fbbb3d3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:18:01.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.048+0000 7fbbb3d3e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:01.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.048+0000 7fbbb3d3e800 1 --2- 172.21.15.102:0/2029390040 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5630f6225a10 0x5630f6227e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.048+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630f6228590 con 0x5630f6225a10 2024-09-13T19:18:01.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.048+0000 7fbbb0235640 1 --2- 172.21.15.102:0/2029390040 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5630f6225a10 0x5630f6227e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.048+0000 7fbbb0235640 1 --2- 172.21.15.102:0/2029390040 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5630f6225a10 0x5630f6227e00 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.049+0000 7fbbb0235640 1 -- 172.21.15.102:0/2029390040 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbba803a020 con 0x5630f6225a10 2024-09-13T19:18:01.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.049+0000 7fbbb3d3e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:18:01.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.049+0000 7fbbb3d3e800 20 searching for the correct realm 2024-09-13T19:18:01.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.049+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5630f6229ee0 con 0x5630f6225a10 2024-09-13T19:18:01.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.049+0000 7fbbb0235640 1 -- 172.21.15.102:0/2029390040 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba803a020 con 0x5630f6225a10 2024-09-13T19:18:01.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.049+0000 7fbbb0235640 1 --2- 172.21.15.102:0/2029390040 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fbba8021020 0x7fbba801a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.049+0000 7fbbb0235640 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5630f6229ee0 con 0x7fbba8021020 2024-09-13T19:18:01.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.049+0000 7fbbafa34640 1 --2- 172.21.15.102:0/2029390040 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fbba8021020 0x7fbba801a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.049+0000 7fbbafa34640 1 --2- 172.21.15.102:0/2029390040 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fbba8021020 0x7fbba801a0d0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.050+0000 7fbbafa34640 1 -- 172.21.15.102:0/2029390040 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba006c970 con 0x7fbba8021020 2024-09-13T19:18:01.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.050+0000 7fbbafa34640 1 --2- 172.21.15.102:0/2029390040 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fbba008c070 0x7fbba007e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.050+0000 7fbbafa34640 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5630f6229ee0 con 0x7fbba008c070 2024-09-13T19:18:01.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.050+0000 7fbbaf233640 1 --2- 172.21.15.102:0/2029390040 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fbba008c070 0x7fbba007e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.050+0000 7fbbaf233640 1 --2- 172.21.15.102:0/2029390040 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fbba008c070 0x7fbba007e3a0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.051+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb98009050 con 0x7fbba008c070 2024-09-13T19:18:01.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.051+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5630f6229ee0 con 0x5630f6221100 2024-09-13T19:18:01.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.051+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb98009050 con 0x5630f6221100 2024-09-13T19:18:01.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.051+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5630f6229ee0 con 0x5630f6221100 2024-09-13T19:18:01.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.051+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb98029040 con 0x5630f6221100 2024-09-13T19:18:01.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.051+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5630f6229ee0 con 0x7fbba008c070 2024-09-13T19:18:01.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.052+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb98029040 con 0x7fbba008c070 2024-09-13T19:18:01.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.052+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5630f6229ee0 con 0x7fbba008c070 2024-09-13T19:18:01.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.052+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb98029040 con 0x7fbba008c070 2024-09-13T19:18:01.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.052+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5630f6229ee0 con 0x7fbba8021020 2024-09-13T19:18:01.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.052+0000 7fbbafa34640 1 -- 172.21.15.102:0/2029390040 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba006c970 con 0x7fbba8021020 2024-09-13T19:18:01.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.052+0000 7fbbafa34640 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5630f6229ee0 con 0x5630f6225a10 2024-09-13T19:18:01.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.052+0000 7fbbb0235640 1 -- 172.21.15.102:0/2029390040 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba803a020 con 0x5630f6225a10 2024-09-13T19:18:01.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.052+0000 7fbbb0235640 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5630f6229ee0 con 0x5630f6221100 2024-09-13T19:18:01.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.053+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb98029040 con 0x5630f6221100 2024-09-13T19:18:01.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.053+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5630f6229ee0 con 0x7fbba8021020 2024-09-13T19:18:01.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.053+0000 7fbbafa34640 1 -- 172.21.15.102:0/2029390040 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba006c970 con 0x7fbba8021020 2024-09-13T19:18:01.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.053+0000 7fbbafa34640 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fbba00a9040 con 0x5630f6221100 2024-09-13T19:18:01.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.053+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb98029040 con 0x5630f6221100 2024-09-13T19:18:01.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.053+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fbba00a9040 con 0x7fbba8021020 2024-09-13T19:18:01.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.053+0000 7fbbafa34640 1 -- 172.21.15.102:0/2029390040 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbba006c970 con 0x7fbba8021020 2024-09-13T19:18:01.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.053+0000 7fbbafa34640 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fbba00a9040 con 0x5630f6225a10 2024-09-13T19:18:01.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.054+0000 7fbbb0235640 1 -- 172.21.15.102:0/2029390040 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba803a020 con 0x5630f6225a10 2024-09-13T19:18:01.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.054+0000 7fbbb0235640 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fbba00a9040 con 0x5630f6225a10 2024-09-13T19:18:01.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.054+0000 7fbbb0235640 1 -- 172.21.15.102:0/2029390040 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbba803a020 con 0x5630f6225a10 2024-09-13T19:18:01.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.054+0000 7fbbb0235640 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fbba00a9040 con 0x7fbba008c070 2024-09-13T19:18:01.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.054+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb98029040 con 0x7fbba008c070 2024-09-13T19:18:01.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.054+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fbba00a9040 con 0x5630f6225a10 2024-09-13T19:18:01.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.054+0000 7fbbb0235640 1 -- 172.21.15.102:0/2029390040 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbba803a020 con 0x5630f6225a10 2024-09-13T19:18:01.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.054+0000 7fbbb0235640 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fbba00a9040 con 0x5630f6225a10 2024-09-13T19:18:01.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.055+0000 7fbbb0235640 1 -- 172.21.15.102:0/2029390040 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba803a020 con 0x5630f6225a10 2024-09-13T19:18:01.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.055+0000 7fbbb0235640 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fbba00a9040 con 0x5630f6221100 2024-09-13T19:18:01.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.055+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb98029040 con 0x5630f6221100 2024-09-13T19:18:01.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.055+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fbba00a9040 con 0x5630f6221100 2024-09-13T19:18:01.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.055+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbb98029040 con 0x5630f6221100 2024-09-13T19:18:01.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.055+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fbba00a9040 con 0x7fbba008c070 2024-09-13T19:18:01.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.056+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb98029040 con 0x7fbba008c070 2024-09-13T19:18:01.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.056+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fbba00a9040 con 0x5630f6225a10 2024-09-13T19:18:01.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.056+0000 7fbbb0235640 1 -- 172.21.15.102:0/2029390040 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba803a020 con 0x5630f6225a10 2024-09-13T19:18:01.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.056+0000 7fbbb0235640 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fbba00a9040 con 0x7fbba8021020 2024-09-13T19:18:01.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.056+0000 7fbbafa34640 1 -- 172.21.15.102:0/2029390040 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba006c970 con 0x7fbba8021020 2024-09-13T19:18:01.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.056+0000 7fbbafa34640 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fbba00a9040 con 0x5630f6221100 2024-09-13T19:18:01.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.056+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb98029040 con 0x5630f6221100 2024-09-13T19:18:01.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.056+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fbba00a9040 con 0x7fbba8021020 2024-09-13T19:18:01.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.057+0000 7fbbafa34640 1 -- 172.21.15.102:0/2029390040 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba006c970 con 0x7fbba8021020 2024-09-13T19:18:01.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.057+0000 7fbbafa34640 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fbba00a9040 con 0x5630f6225a10 2024-09-13T19:18:01.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.057+0000 7fbbb0235640 1 -- 172.21.15.102:0/2029390040 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba803a020 con 0x5630f6225a10 2024-09-13T19:18:01.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.057+0000 7fbbb0235640 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fbba00a9040 con 0x7fbba008c070 2024-09-13T19:18:01.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.057+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb98029040 con 0x7fbba008c070 2024-09-13T19:18:01.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.057+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fbba00a9040 con 0x7fbba8021020 2024-09-13T19:18:01.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.058+0000 7fbbafa34640 1 -- 172.21.15.102:0/2029390040 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba006c970 con 0x7fbba8021020 2024-09-13T19:18:01.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.058+0000 7fbbafa34640 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fbba00a9040 con 0x5630f6225a10 2024-09-13T19:18:01.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.058+0000 7fbbb0235640 1 -- 172.21.15.102:0/2029390040 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba803a020 con 0x5630f6225a10 2024-09-13T19:18:01.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.058+0000 7fbbb0235640 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fbba00a9040 con 0x7fbba008c070 2024-09-13T19:18:01.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.058+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb98029040 con 0x7fbba008c070 2024-09-13T19:18:01.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.058+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fbba00a9040 con 0x5630f6221100 2024-09-13T19:18:01.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.059+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbb98029040 con 0x5630f6221100 2024-09-13T19:18:01.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.059+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fbba00a9040 con 0x7fbba8021020 2024-09-13T19:18:01.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.059+0000 7fbbafa34640 1 -- 172.21.15.102:0/2029390040 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba006c970 con 0x7fbba8021020 2024-09-13T19:18:01.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.059+0000 7fbbb3d3e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:18:01.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.059+0000 7fbbb3d3e800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:18:01.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.059+0000 7fbbb3d3e800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:18:01.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.059+0000 7fbbb3d3e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:18:01.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.059+0000 7fbbb3d3e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:18:01.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.059+0000 7fbbb3d3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:18:01.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.059+0000 7fbbb3d3e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:01.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.059+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630f6228f50 con 0x5630f6221100 2024-09-13T19:18:01.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.059+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbb98029040 con 0x5630f6221100 2024-09-13T19:18:01.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.059+0000 7fbbb3d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:01.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.059+0000 7fbbb3d3e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:01.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.059+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630f62297f0 con 0x5630f6221100 2024-09-13T19:18:01.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.059+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbb98029040 con 0x5630f6221100 2024-09-13T19:18:01.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.059+0000 7fbbb3d3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:18:01.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.059+0000 7fbbb3d3e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:01.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.059+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630f622a360 con 0x5630f6225a10 2024-09-13T19:18:01.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.060+0000 7fbbb0235640 1 -- 172.21.15.102:0/2029390040 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbba803a020 con 0x5630f6225a10 2024-09-13T19:18:01.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.060+0000 7fbbb3d3e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:18:01.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.060+0000 7fbbb3d3e800 20 zone default found 2024-09-13T19:18:01.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.060+0000 7fbbb3d3e800 4 Realm: () 2024-09-13T19:18:01.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.060+0000 7fbbb3d3e800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:18:01.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.060+0000 7fbbb3d3e800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:18:01.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.060+0000 7fbbb3d3e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:18:01.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.060+0000 7fbbb3d3e800 20 zonegroup default 2024-09-13T19:18:01.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.060+0000 7fbbb3d3e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:01.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.060+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630f622abb0 con 0x7fbba8021020 2024-09-13T19:18:01.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.060+0000 7fbbafa34640 1 -- 172.21.15.102:0/2029390040 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbba006c970 con 0x7fbba8021020 2024-09-13T19:18:01.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.060+0000 7fbbb3d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:01.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.060+0000 7fbbb3d3e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:01.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.060+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630f622c930 con 0x5630f6225a10 2024-09-13T19:18:01.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.060+0000 7fbbb0235640 1 -- 172.21.15.102:0/2029390040 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbba803a020 con 0x5630f6225a10 2024-09-13T19:18:01.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.060+0000 7fbbb3d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:01.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.060+0000 7fbbb3d3e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:01.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.060+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630f622cd60 con 0x5630f6225a10 2024-09-13T19:18:01.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.060+0000 7fbbb0235640 1 -- 172.21.15.102:0/2029390040 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbba803a020 con 0x5630f6225a10 2024-09-13T19:18:01.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.060+0000 7fbbb3d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:01.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.060+0000 7fbbb3d3e800 20 started sync module instance, tier type = 2024-09-13T19:18:01.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.060+0000 7fbbb3d3e800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:18:01.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.060+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630f622bdd0 con 0x7fbba8021020 2024-09-13T19:18:01.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.062+0000 7fbbafa34640 1 -- 172.21.15.102:0/2029390040 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(44 notify.0 [create] v36'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbba006c970 con 0x7fbba8021020 2024-09-13T19:18:01.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.062+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94768287891952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630f622bdd0 con 0x7fbba8021020 2024-09-13T19:18:01.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.062+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630f622d640 con 0x5630f6221100 2024-09-13T19:18:01.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.063+0000 7fbbafa34640 1 -- 172.21.15.102:0/2029390040 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94768287891952] v36'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbba006c970 con 0x7fbba8021020 2024-09-13T19:18:01.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.063+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v36'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb98029040 con 0x5630f6221100 2024-09-13T19:18:01.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.063+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94768287889696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630f622bd40 con 0x5630f6221100 2024-09-13T19:18:01.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.063+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630f622e340 con 0x5630f6225a10 2024-09-13T19:18:01.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.064+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94768287889696] v36'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb98029040 con 0x5630f6221100 2024-09-13T19:18:01.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.065+0000 7fbbb0235640 1 -- 172.21.15.102:0/2029390040 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v36'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbba803a020 con 0x5630f6225a10 2024-09-13T19:18:01.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.065+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94768287898080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630f622e2b0 con 0x5630f6225a10 2024-09-13T19:18:01.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.065+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630f622ec70 con 0x7fbba8021020 2024-09-13T19:18:01.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.066+0000 7fbbafa34640 1 -- 172.21.15.102:0/2029390040 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(50 notify.3 [create] v36'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbba006c970 con 0x7fbba8021020 2024-09-13T19:18:01.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.066+0000 7fbbb0235640 1 -- 172.21.15.102:0/2029390040 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94768287898080] v36'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbba803a020 con 0x5630f6225a10 2024-09-13T19:18:01.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.066+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94768287901632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630f622f510 con 0x7fbba8021020 2024-09-13T19:18:01.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.066+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630f622de00 con 0x5630f6221100 2024-09-13T19:18:01.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.067+0000 7fbbafa34640 1 -- 172.21.15.102:0/2029390040 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94768287901632] v36'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbba006c970 con 0x7fbba8021020 2024-09-13T19:18:01.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.067+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v36'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb98029040 con 0x5630f6221100 2024-09-13T19:18:01.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.067+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94768287903840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630f622f930 con 0x5630f6221100 2024-09-13T19:18:01.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.067+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630f62301c0 con 0x7fbba008c070 2024-09-13T19:18:01.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.068+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94768287903840] v36'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb98029040 con 0x5630f6221100 2024-09-13T19:18:01.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.068+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(54 notify.5 [create] v36'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb98029040 con 0x7fbba008c070 2024-09-13T19:18:01.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.068+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94768287904896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630f622fd50 con 0x7fbba008c070 2024-09-13T19:18:01.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.068+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630f6230c30 con 0x7fbba008c070 2024-09-13T19:18:01.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.070+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94768287904896] v36'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb98029040 con 0x7fbba008c070 2024-09-13T19:18:01.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.070+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(56 notify.6 [create] v36'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb98029040 con 0x7fbba008c070 2024-09-13T19:18:01.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.070+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94768287909664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630f6230e30 con 0x7fbba008c070 2024-09-13T19:18:01.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.070+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630f6231680 con 0x7fbba008c070 2024-09-13T19:18:01.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.071+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94768287909664] v36'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb98029040 con 0x7fbba008c070 2024-09-13T19:18:01.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.071+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(58 notify.7 [create] v36'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb98029040 con 0x7fbba008c070 2024-09-13T19:18:01.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.071+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94768287911472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630f6231700 con 0x7fbba008c070 2024-09-13T19:18:01.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.071+0000 7fbbb3d3e800 20 add_watcher() i=0 2024-09-13T19:18:01.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.071+0000 7fbbb3d3e800 20 add_watcher() i=1 2024-09-13T19:18:01.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.071+0000 7fbbb3d3e800 20 add_watcher() i=2 2024-09-13T19:18:01.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.071+0000 7fbbb3d3e800 20 add_watcher() i=3 2024-09-13T19:18:01.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.071+0000 7fbbb3d3e800 20 add_watcher() i=4 2024-09-13T19:18:01.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.071+0000 7fbbb3d3e800 20 add_watcher() i=5 2024-09-13T19:18:01.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.071+0000 7fbbb3d3e800 20 add_watcher() i=6 2024-09-13T19:18:01.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.072+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94768287911472] v36'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb98029040 con 0x7fbba008c070 2024-09-13T19:18:01.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.072+0000 7fbbb3d3e800 20 add_watcher() i=7 2024-09-13T19:18:01.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.072+0000 7fbbb3d3e800 2 all 8 watchers are set, enabling cache 2024-09-13T19:18:01.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.072+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630f6234a00 con 0x5630f6221100 2024-09-13T19:18:01.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.072+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbb98029040 con 0x5630f6221100 2024-09-13T19:18:01.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.072+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94768287912896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630f6231c90 con 0x5630f6221100 2024-09-13T19:18:01.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.073+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94768287912896] v36'228 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbb98029040 con 0x5630f6221100 2024-09-13T19:18:01.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.074+0000 7fba65fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:18:01.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.074+0000 7fbbb3d3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:18:01.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.074+0000 7fbbb3d3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:18:01.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.074+0000 7fbbb3d3e800 5 note: GC not initialized 2024-09-13T19:18:01.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.074+0000 7fba64fe1640 20 reqs_thread_entry: start 2024-09-13T19:18:01.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.074+0000 7fbbb3d3e800 20 init_complete bucket index max shards: 11 2024-09-13T19:18:01.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.074+0000 7fbbb3d3e800 20 Filter name: none 2024-09-13T19:18:01.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.074+0000 7fb9de7fc640 20 reqs_thread_entry: start 2024-09-13T19:18:01.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.074+0000 7fbbb3d3e800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:18:01.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.074+0000 7fbbb3d3e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:01.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.074+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5630f6267e70 con 0x5630f6221100 2024-09-13T19:18:01.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.075+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fbb98029040 con 0x5630f6221100 2024-09-13T19:18:01.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.075+0000 7fbbb3d3e800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:18:01.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.075+0000 7fbbb3d3e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:18:01.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.075+0000 7fbbb3d3e800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:18:01.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.075+0000 7fbbb3d3e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:18:01.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.075+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630f626a900 con 0x7fbba008c070 2024-09-13T19:18:01.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.077+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(63 usage.10 [call] v36'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb98029040 con 0x7fbba008c070 2024-09-13T19:18:01.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.077+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:64 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630f626a900 con 0x7fbba008c070 2024-09-13T19:18:01.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.078+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(64 usage.10 [call] v36'34 uv33 ondisk = -61 ((61) No data available)) ==== 152+0+0 (crc 0 0 0) 0x7fbb98029040 con 0x7fbba008c070 2024-09-13T19:18:01.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.079+0000 7fba65fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:18:01.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.079+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94768287912896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630f62340a0 con 0x5630f6221100 2024-09-13T19:18:01.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.079+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94768287912896] v36'229 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbb98029040 con 0x5630f6221100 2024-09-13T19:18:01.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.080+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94768287891952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630f62313c0 con 0x7fbba8021020 2024-09-13T19:18:01.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.081+0000 7fbbafa34640 1 -- 172.21.15.102:0/2029390040 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94768287891952] v36'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbba006c970 con 0x7fbba8021020 2024-09-13T19:18:01.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.081+0000 7fbbb3d3e800 20 remove_watcher() i=0 2024-09-13T19:18:01.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.081+0000 7fbbb3d3e800 2 removed watcher, disabling cache 2024-09-13T19:18:01.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.081+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94768287889696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630f6267a10 con 0x5630f6221100 2024-09-13T19:18:01.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.082+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94768287889696] v36'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb98029040 con 0x5630f6221100 2024-09-13T19:18:01.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.082+0000 7fbbb3d3e800 20 remove_watcher() i=1 2024-09-13T19:18:01.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.082+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94768287898080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630f6267a10 con 0x5630f6225a10 2024-09-13T19:18:01.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.083+0000 7fbbb0235640 1 -- 172.21.15.102:0/2029390040 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94768287898080] v36'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbba803a020 con 0x5630f6225a10 2024-09-13T19:18:01.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.083+0000 7fbbb3d3e800 20 remove_watcher() i=2 2024-09-13T19:18:01.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.083+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94768287901632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630f6267a10 con 0x7fbba8021020 2024-09-13T19:18:01.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.084+0000 7fbbafa34640 1 -- 172.21.15.102:0/2029390040 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94768287901632] v36'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbba006c970 con 0x7fbba8021020 2024-09-13T19:18:01.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.084+0000 7fbbb3d3e800 20 remove_watcher() i=3 2024-09-13T19:18:01.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.084+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94768287903840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630f6267a10 con 0x5630f6221100 2024-09-13T19:18:01.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.085+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94768287903840] v36'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb98029040 con 0x5630f6221100 2024-09-13T19:18:01.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.085+0000 7fbbb3d3e800 20 remove_watcher() i=4 2024-09-13T19:18:01.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.085+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94768287904896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630f6267a10 con 0x7fbba008c070 2024-09-13T19:18:01.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.086+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94768287904896] v36'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb98029040 con 0x7fbba008c070 2024-09-13T19:18:01.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.086+0000 7fbbb3d3e800 20 remove_watcher() i=5 2024-09-13T19:18:01.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.087+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94768287909664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630f6267a10 con 0x7fbba008c070 2024-09-13T19:18:01.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.088+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94768287909664] v36'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb98029040 con 0x7fbba008c070 2024-09-13T19:18:01.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.088+0000 7fbbb3d3e800 20 remove_watcher() i=6 2024-09-13T19:18:01.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.088+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94768287911472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5630f6267a10 con 0x7fbba008c070 2024-09-13T19:18:01.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.089+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94768287911472] v36'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb98029040 con 0x7fbba008c070 2024-09-13T19:18:01.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.089+0000 7fbbb3d3e800 20 remove_watcher() i=7 2024-09-13T19:18:01.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.089+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fbba008c070 msgr2=0x7fbba007e3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.089+0000 7fbbb3d3e800 1 --2- 172.21.15.102:0/2029390040 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fbba008c070 0x7fbba007e3a0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.089+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5630f6221100 msgr2=0x5630f62235c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.089+0000 7fbbb3d3e800 1 --2- 172.21.15.102:0/2029390040 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5630f6221100 0x5630f62235c0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.089+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fbba8021020 msgr2=0x7fbba801a0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.089+0000 7fbbb3d3e800 1 --2- 172.21.15.102:0/2029390040 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fbba8021020 0x7fbba801a0d0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.089+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5630f6225a10 msgr2=0x5630f6227e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.089+0000 7fbbb3d3e800 1 --2- 172.21.15.102:0/2029390040 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5630f6225a10 0x5630f6227e00 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.089+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fba78036b40 msgr2=0x7fba78039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.089+0000 7fbbb3d3e800 1 --2- 172.21.15.102:0/2029390040 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fba78036b40 0x7fba78039000 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbba0090010 tx=0x7fbba008c000 comp rx=0 tx=0).stop 2024-09-13T19:18:01.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.089+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630f620e170 msgr2=0x5630f6215650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.089+0000 7fbbb3d3e800 1 --2- 172.21.15.102:0/2029390040 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630f620e170 0x5630f6215650 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fbba8043040 tx=0x7fbba804c5d0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.089+0000 7fbbaf233640 1 -- 172.21.15.102:0/2029390040 reap_dead start 2024-09-13T19:18:01.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.089+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 shutdown_connections 2024-09-13T19:18:01.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.089+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 >> 172.21.15.102:0/2029390040 conn(0x5630f620a560 msgr2=0x5630f6208630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:01.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.089+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 shutdown_connections 2024-09-13T19:18:01.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.089+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/2029390040 wait complete. 2024-09-13T19:18:01.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.090+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/1015534568 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fba88036b40 msgr2=0x7fba88039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.090+0000 7fbbb3d3e800 1 --2- 172.21.15.102:0/1015534568 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fba88036b40 0x7fba88039000 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fbba000a3f0 tx=0x7fbba006cf90 comp rx=0 tx=0).stop 2024-09-13T19:18:01.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.090+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/1015534568 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630f6201530 msgr2=0x5630f6201950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.090+0000 7fbbb3d3e800 1 --2- 172.21.15.102:0/1015534568 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630f6201530 0x5630f6201950 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x5630f61e74f0 tx=0x7fbba800beb0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.090+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/1015534568 shutdown_connections 2024-09-13T19:18:01.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.090+0000 7fbbb3d3e800 1 --2- 172.21.15.102:0/1015534568 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fba88036b40 0x7fba88039000 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.090+0000 7fbbb3d3e800 1 --2- 172.21.15.102:0/1015534568 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630f6201530 0x5630f6201950 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.090+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/1015534568 >> 172.21.15.102:0/1015534568 conn(0x5630f61f64c0 msgr2=0x5630f61f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:01.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.090+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/1015534568 shutdown_connections 2024-09-13T19:18:01.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.090+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/1015534568 wait complete. 2024-09-13T19:18:01.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.090+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/631499927 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5630f61eb4a0 msgr2=0x5630f61ed890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.090+0000 7fbbb3d3e800 1 --2- 172.21.15.102:0/631499927 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5630f61eb4a0 0x5630f61ed890 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.090+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/631499927 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5630f61f0120 msgr2=0x5630f61f2510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.090+0000 7fbbb3d3e800 1 --2- 172.21.15.102:0/631499927 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5630f61f0120 0x5630f61f2510 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.090+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/631499927 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fba98036b40 msgr2=0x7fba98039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.090+0000 7fbbb3d3e800 1 --2- 172.21.15.102:0/631499927 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fba98036b40 0x7fba98039000 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbb98000f60 tx=0x7fbb980012b0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.090+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/631499927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630f60f2810 msgr2=0x5630f61e6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.090+0000 7fbbb3d3e800 1 --2- 172.21.15.102:0/631499927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630f60f2810 0x5630f61e6440 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fbba0065040 tx=0x7fbba0003330 comp rx=0 tx=0).stop 2024-09-13T19:18:01.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.090+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/631499927 shutdown_connections 2024-09-13T19:18:01.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.090+0000 7fbbb3d3e800 1 --2- 172.21.15.102:0/631499927 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5630f61f0120 0x5630f61f2510 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.090+0000 7fbbb3d3e800 1 --2- 172.21.15.102:0/631499927 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x5630f61eb4a0 0x5630f61ed890 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.090+0000 7fbbb3d3e800 1 --2- 172.21.15.102:0/631499927 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fba98036b40 0x7fba98039000 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.090+0000 7fbbb3d3e800 1 --2- 172.21.15.102:0/631499927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5630f60f2810 0x5630f61e6440 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.090+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/631499927 >> 172.21.15.102:0/631499927 conn(0x5630f60e9de0 msgr2=0x5630f61d8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:01.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.090+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/631499927 shutdown_connections 2024-09-13T19:18:01.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.090+0000 7fbbb3d3e800 1 -- 172.21.15.102:0/631499927 wait complete. 2024-09-13T19:18:01.102 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-13T19:18:01.102 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-13T19:18:01.103 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-13T19:18:01.146 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:18:01.146 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:18:01.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.144+0000 7fd7b6e11800 1 Processor -- start 2024-09-13T19:18:01.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.144+0000 7fd7b6e11800 1 -- start start 2024-09-13T19:18:01.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.144+0000 7fd7b6e11800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x561f5f7368e0 0x561f5f738cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.144+0000 7fd7b6e11800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561f5f5f1b30 con 0x561f5f6a5e10 2024-09-13T19:18:01.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.144+0000 7fd7b6e11800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x561f5f5d3360 con 0x561f5f7368e0 2024-09-13T19:18:01.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.145+0000 7fd7a9c66640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x561f5f7368e0 0x561f5f738cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.145+0000 7fd7b2467640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x561f5f6a5e10 0x561f5f7351c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:53604/0 (socket says 172.21.15.102:53604) 2024-09-13T19:18:01.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.145+0000 7fd7a9c66640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x561f5f7368e0 0x561f5f738cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49118/0 (socket says 172.21.15.102:49118) 2024-09-13T19:18:01.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.145+0000 7fd7b2467640 1 -- 172.21.15.102:0/2895284202 learned_addr learned my addr 172.21.15.102:0/2895284202 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:18:01.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.145+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2895284202 >> v1:172.21.15.53:6789/0 conn(0x561f5f6a5e10 legacy=0x561f5f7351c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.145+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2895284202 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f5f5f9e00 con 0x561f5f7368e0 2024-09-13T19:18:01.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.147+0000 7fd7a9c66640 1 --2- 172.21.15.102:0/2895284202 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f5f7368e0 0x561f5f738cd0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fd79c00a470 tx=0x7fd79c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f629a9d679f9b76 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.147+0000 7fd7b1c66640 1 -- 172.21.15.102:0/2895284202 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd79c053570 con 0x561f5f7368e0 2024-09-13T19:18:01.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.147+0000 7fd7b1c66640 1 -- 172.21.15.102:0/2895284202 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd79c058070 con 0x561f5f7368e0 2024-09-13T19:18:01.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.147+0000 7fd7b1c66640 1 -- 172.21.15.102:0/2895284202 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd79c053880 con 0x561f5f7368e0 2024-09-13T19:18:01.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.147+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2895284202 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f5f7368e0 msgr2=0x561f5f738cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.147+0000 7fd7b6e11800 1 --2- 172.21.15.102:0/2895284202 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f5f7368e0 0x561f5f738cd0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fd79c00a470 tx=0x7fd79c045a20 comp rx=0 tx=0).stop 2024-09-13T19:18:01.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.147+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2895284202 shutdown_connections 2024-09-13T19:18:01.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.147+0000 7fd7b6e11800 1 --2- 172.21.15.102:0/2895284202 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f5f7368e0 0x561f5f738cd0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.147+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2895284202 >> 172.21.15.102:0/2895284202 conn(0x561f5f72cdf0 msgr2=0x561f5f72f210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:01.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.147+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2895284202 shutdown_connections 2024-09-13T19:18:01.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.147+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2895284202 wait complete. 2024-09-13T19:18:01.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.161+0000 7fd7b6e11800 1 Processor -- start 2024-09-13T19:18:01.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.161+0000 7fd7b6e11800 1 -- start start 2024-09-13T19:18:01.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.161+0000 7fd7b6e11800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f5f6a5e10 0x561f5f821840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.161+0000 7fd7b6e11800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561f5f67e330 con 0x561f5f6a5e10 2024-09-13T19:18:01.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.162+0000 7fd7b2467640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f5f6a5e10 0x561f5f821840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.162+0000 7fd7b2467640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f5f6a5e10 0x561f5f821840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49130/0 (socket says 172.21.15.102:49130) 2024-09-13T19:18:01.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.162+0000 7fd7b2467640 1 -- 172.21.15.102:0/3741660506 learned_addr learned my addr 172.21.15.102:0/3741660506 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:01.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.162+0000 7fd7b2467640 1 -- 172.21.15.102:0/3741660506 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f5f5cbbc0 con 0x561f5f6a5e10 2024-09-13T19:18:01.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.162+0000 7fd7b2467640 1 --2- 172.21.15.102:0/3741660506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f5f6a5e10 0x561f5f821840 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fd7a4001d80 tx=0x7fd7a4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91471c6c621c1d6d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.163+0000 7fd6a0608640 1 -- 172.21.15.102:0/3741660506 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7a4013030 con 0x561f5f6a5e10 2024-09-13T19:18:01.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.163+0000 7fd6a0608640 1 -- 172.21.15.102:0/3741660506 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7a400e470 con 0x561f5f6a5e10 2024-09-13T19:18:01.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.163+0000 7fd6a0608640 1 -- 172.21.15.102:0/3741660506 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7a400e810 con 0x561f5f6a5e10 2024-09-13T19:18:01.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.163+0000 7fd7b6e11800 1 -- 172.21.15.102:0/3741660506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f5f6a5e10 msgr2=0x561f5f821840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.163+0000 7fd7b6e11800 1 --2- 172.21.15.102:0/3741660506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f5f6a5e10 0x561f5f821840 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fd7a4001d80 tx=0x7fd7a4001e70 comp rx=0 tx=0).stop 2024-09-13T19:18:01.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.163+0000 7fd7b6e11800 1 -- 172.21.15.102:0/3741660506 shutdown_connections 2024-09-13T19:18:01.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.163+0000 7fd7b6e11800 1 --2- 172.21.15.102:0/3741660506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f5f6a5e10 0x561f5f821840 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.163+0000 7fd7b6e11800 1 -- 172.21.15.102:0/3741660506 >> 172.21.15.102:0/3741660506 conn(0x561f5f72cdf0 msgr2=0x561f5f81d200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:01.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.163+0000 7fd7b6e11800 1 -- 172.21.15.102:0/3741660506 shutdown_connections 2024-09-13T19:18:01.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.163+0000 7fd7b6e11800 1 -- 172.21.15.102:0/3741660506 wait complete. 2024-09-13T19:18:01.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.164+0000 7fd7b6e11800 1 Processor -- start 2024-09-13T19:18:01.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.164+0000 7fd7b6e11800 1 -- start start 2024-09-13T19:18:01.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.164+0000 7fd7b6e11800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f5f6a5e10 0x561f5f732af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.164+0000 7fd7b6e11800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561f5f739600 con 0x561f5f6a5e10 2024-09-13T19:18:01.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.164+0000 7fd7b2467640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f5f6a5e10 0x561f5f732af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.164+0000 7fd7b2467640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f5f6a5e10 0x561f5f732af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49138/0 (socket says 172.21.15.102:49138) 2024-09-13T19:18:01.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.164+0000 7fd7b2467640 1 -- 172.21.15.102:0/548466488 learned_addr learned my addr 172.21.15.102:0/548466488 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:01.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.165+0000 7fd7b2467640 1 -- 172.21.15.102:0/548466488 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f5f5dffe0 con 0x561f5f6a5e10 2024-09-13T19:18:01.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.165+0000 7fd7b2467640 1 --2- 172.21.15.102:0/548466488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f5f6a5e10 0x561f5f732af0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fd7a4004000 tx=0x7fd7a4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.165+0000 7fd69ee05640 1 -- 172.21.15.102:0/548466488 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7a4027070 con 0x561f5f6a5e10 2024-09-13T19:18:01.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.165+0000 7fd69ee05640 1 -- 172.21.15.102:0/548466488 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7a4019900 con 0x561f5f6a5e10 2024-09-13T19:18:01.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.165+0000 7fd7b6e11800 1 -- 172.21.15.102:0/548466488 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561f5f7311e0 con 0x561f5f6a5e10 2024-09-13T19:18:01.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.165+0000 7fd69ee05640 1 -- 172.21.15.102:0/548466488 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7a4019c60 con 0x561f5f6a5e10 2024-09-13T19:18:01.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.165+0000 7fd7b6e11800 1 -- 172.21.15.102:0/548466488 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f5f731700 con 0x561f5f6a5e10 2024-09-13T19:18:01.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.166+0000 7fd69ee05640 1 -- 172.21.15.102:0/548466488 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd7a402a070 con 0x561f5f6a5e10 2024-09-13T19:18:01.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.166+0000 7fd69ee05640 1 --2- 172.21.15.102:0/548466488 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd698036b40 0x7fd698039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.166+0000 7fd69ee05640 1 -- 172.21.15.102:0/548466488 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fd7a401f070 con 0x561f5f6a5e10 2024-09-13T19:18:01.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.166+0000 7fd7a9c66640 1 --2- 172.21.15.102:0/548466488 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd698036b40 0x7fd698039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.166+0000 7fd7b6e11800 1 --2- 172.21.15.102:0/548466488 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x561f5f7368e0 0x561f5f832630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.166+0000 7fd7b6e11800 1 -- 172.21.15.102:0/548466488 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561f5f832b70 con 0x561f5f7368e0 2024-09-13T19:18:01.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.166+0000 7fd7b2c68640 1 --2- 172.21.15.102:0/548466488 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x561f5f7368e0 0x561f5f832630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.167+0000 7fd7a9c66640 1 --2- 172.21.15.102:0/548466488 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd698036b40 0x7fd698039000 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd79c057000 tx=0x7fd79c052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.167+0000 7fd7b2c68640 1 --2- 172.21.15.102:0/548466488 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x561f5f7368e0 0x561f5f832630 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.167+0000 7fd7b2c68640 1 -- 172.21.15.102:0/548466488 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd7ac00a4a0 con 0x561f5f7368e0 2024-09-13T19:18:01.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.167+0000 7fd7b6e11800 1 -- 172.21.15.102:0/548466488 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561f5f8333c0 con 0x561f5f7368e0 2024-09-13T19:18:01.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.167+0000 7fd7b2c68640 1 -- 172.21.15.102:0/548466488 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd7ac00a4a0 con 0x561f5f7368e0 2024-09-13T19:18:01.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.167+0000 7fd7b6e11800 1 --2- 172.21.15.102:0/548466488 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x561f5f834df0 0x561f5f837220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.167+0000 7fd7b6e11800 1 -- 172.21.15.102:0/548466488 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561f5f8379b0 con 0x561f5f834df0 2024-09-13T19:18:01.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.167+0000 7fd7b2467640 1 --2- 172.21.15.102:0/548466488 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x561f5f834df0 0x561f5f837220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.168+0000 7fd7b2467640 1 --2- 172.21.15.102:0/548466488 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x561f5f834df0 0x561f5f837220 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.168+0000 7fd7b2467640 1 -- 172.21.15.102:0/548466488 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd7a4029030 con 0x561f5f834df0 2024-09-13T19:18:01.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.168+0000 7fd7b6e11800 1 -- 172.21.15.102:0/548466488 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561f5f833c10 con 0x561f5f7368e0 2024-09-13T19:18:01.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.168+0000 7fd7b2c68640 1 -- 172.21.15.102:0/548466488 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd7ac00a4a0 con 0x561f5f7368e0 2024-09-13T19:18:01.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.168+0000 7fd7b6e11800 1 -- 172.21.15.102:0/548466488 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561f5f833ff0 con 0x561f5f834df0 2024-09-13T19:18:01.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.169+0000 7fd7b2467640 1 -- 172.21.15.102:0/548466488 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd7a4029030 con 0x561f5f834df0 2024-09-13T19:18:01.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.169+0000 7fd7b6e11800 1 Processor -- start 2024-09-13T19:18:01.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.169+0000 7fd7b6e11800 1 -- start start 2024-09-13T19:18:01.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.169+0000 7fd7b6e11800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f5f846330 0x561f5f846750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.169+0000 7fd7b6e11800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561f5f733030 con 0x561f5f846330 2024-09-13T19:18:01.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.169+0000 7fd7b2c68640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f5f846330 0x561f5f846750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.169+0000 7fd7b2c68640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f5f846330 0x561f5f846750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49154/0 (socket says 172.21.15.102:49154) 2024-09-13T19:18:01.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.169+0000 7fd7b2c68640 1 -- 172.21.15.102:0/1193032688 learned_addr learned my addr 172.21.15.102:0/1193032688 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:01.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.170+0000 7fd7b2c68640 1 -- 172.21.15.102:0/1193032688 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f5f846c90 con 0x561f5f846330 2024-09-13T19:18:01.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.170+0000 7fd7b2c68640 1 --2- 172.21.15.102:0/1193032688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f5f846330 0x561f5f846750 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x561f5f732190 tx=0x7fd7ac0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.170+0000 7fd697fff640 1 -- 172.21.15.102:0/1193032688 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7ac013640 con 0x561f5f846330 2024-09-13T19:18:01.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.170+0000 7fd697fff640 1 -- 172.21.15.102:0/1193032688 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7ac0137e0 con 0x561f5f846330 2024-09-13T19:18:01.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.170+0000 7fd697fff640 1 -- 172.21.15.102:0/1193032688 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7ac013ae0 con 0x561f5f846330 2024-09-13T19:18:01.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.170+0000 7fd7b6e11800 1 -- 172.21.15.102:0/1193032688 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561f5f846f20 con 0x561f5f846330 2024-09-13T19:18:01.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.170+0000 7fd7b6e11800 1 -- 172.21.15.102:0/1193032688 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f5f849c00 con 0x561f5f846330 2024-09-13T19:18:01.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.171+0000 7fd697fff640 1 -- 172.21.15.102:0/1193032688 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd7ac011040 con 0x561f5f846330 2024-09-13T19:18:01.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.171+0000 7fd697fff640 1 --2- 172.21.15.102:0/1193032688 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd68c036b40 0x7fd68c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.171+0000 7fd697fff640 1 -- 172.21.15.102:0/1193032688 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fd7ac00e040 con 0x561f5f846330 2024-09-13T19:18:01.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.171+0000 7fd7b2467640 1 --2- 172.21.15.102:0/1193032688 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd68c036b40 0x7fd68c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.172+0000 7fd7b6e11800 1 Processor -- start 2024-09-13T19:18:01.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.172+0000 7fd7b6e11800 1 -- start start 2024-09-13T19:18:01.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.172+0000 7fd7b2467640 1 --2- 172.21.15.102:0/1193032688 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd68c036b40 0x7fd68c039000 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x561f5f731af0 tx=0x7fd7a402ae80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.172+0000 7fd7b6e11800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f5f853020 0x561f5f853420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.172+0000 7fd7b6e11800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561f5f5cd580 con 0x561f5f853020 2024-09-13T19:18:01.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.172+0000 7fd7b2c68640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f5f853020 0x561f5f853420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.172+0000 7fd7b2c68640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f5f853020 0x561f5f853420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49168/0 (socket says 172.21.15.102:49168) 2024-09-13T19:18:01.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.172+0000 7fd7b2c68640 1 -- 172.21.15.102:0/202370074 learned_addr learned my addr 172.21.15.102:0/202370074 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:01.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.172+0000 7fd7b2c68640 1 -- 172.21.15.102:0/202370074 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f5f8539f0 con 0x561f5f853020 2024-09-13T19:18:01.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.173+0000 7fd7b2c68640 1 --2- 172.21.15.102:0/202370074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f5f853020 0x561f5f853420 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac04cef0 tx=0x7fd7ac029990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe4d2f8901a6af96 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.173+0000 7fd695ffb640 1 -- 172.21.15.102:0/202370074 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7ac0123d0 con 0x561f5f853020 2024-09-13T19:18:01.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.173+0000 7fd695ffb640 1 -- 172.21.15.102:0/202370074 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7ac013c80 con 0x561f5f853020 2024-09-13T19:18:01.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.173+0000 7fd695ffb640 1 -- 172.21.15.102:0/202370074 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7ac012570 con 0x561f5f853020 2024-09-13T19:18:01.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.173+0000 7fd7b6e11800 1 -- 172.21.15.102:0/202370074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f5f853020 msgr2=0x561f5f853420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.173+0000 7fd7b6e11800 1 --2- 172.21.15.102:0/202370074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f5f853020 0x561f5f853420 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac04cef0 tx=0x7fd7ac029990 comp rx=0 tx=0).stop 2024-09-13T19:18:01.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.173+0000 7fd7b6e11800 1 -- 172.21.15.102:0/202370074 shutdown_connections 2024-09-13T19:18:01.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.173+0000 7fd7b6e11800 1 --2- 172.21.15.102:0/202370074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f5f853020 0x561f5f853420 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.173+0000 7fd7b6e11800 1 -- 172.21.15.102:0/202370074 >> 172.21.15.102:0/202370074 conn(0x561f5f84f380 msgr2=0x561f5f84d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:01.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.173+0000 7fd7b6e11800 1 -- 172.21.15.102:0/202370074 shutdown_connections 2024-09-13T19:18:01.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.173+0000 7fd7b6e11800 1 -- 172.21.15.102:0/202370074 wait complete. 2024-09-13T19:18:01.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.173+0000 7fd7b6e11800 1 Processor -- start 2024-09-13T19:18:01.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.174+0000 7fd7b6e11800 1 -- start start 2024-09-13T19:18:01.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.174+0000 7fd7b6e11800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f5f853020 0x561f5f85a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.174+0000 7fd7b6e11800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561f5f853ee0 con 0x561f5f853020 2024-09-13T19:18:01.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.174+0000 7fd7b2c68640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f5f853020 0x561f5f85a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.174+0000 7fd7b2c68640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f5f853020 0x561f5f85a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49174/0 (socket says 172.21.15.102:49174) 2024-09-13T19:18:01.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.174+0000 7fd7b2c68640 1 -- 172.21.15.102:0/2554165748 learned_addr learned my addr 172.21.15.102:0/2554165748 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:01.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.174+0000 7fd7b2c68640 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f5f85a890 con 0x561f5f853020 2024-09-13T19:18:01.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.174+0000 7fd7b2c68640 1 --2- 172.21.15.102:0/2554165748 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f5f853020 0x561f5f85a350 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac029ba0 tx=0x7fd7ac04ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.175+0000 7fd683fff640 1 -- 172.21.15.102:0/2554165748 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7ac01f730 con 0x561f5f853020 2024-09-13T19:18:01.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.175+0000 7fd683fff640 1 -- 172.21.15.102:0/2554165748 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7ac040170 con 0x561f5f853020 2024-09-13T19:18:01.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.175+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561f5f85ab20 con 0x561f5f853020 2024-09-13T19:18:01.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.175+0000 7fd683fff640 1 -- 172.21.15.102:0/2554165748 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7ac040450 con 0x561f5f853020 2024-09-13T19:18:01.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.175+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f5f85d7d0 con 0x561f5f853020 2024-09-13T19:18:01.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.176+0000 7fd683fff640 1 -- 172.21.15.102:0/2554165748 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd7ac0293a0 con 0x561f5f853020 2024-09-13T19:18:01.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.176+0000 7fd683fff640 1 --2- 172.21.15.102:0/2554165748 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd67c036b40 0x7fd67c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.176+0000 7fd7b6e11800 20 rados->read ofs=0 len=0 2024-09-13T19:18:01.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.176+0000 7fd683fff640 1 -- 172.21.15.102:0/2554165748 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fd7ac035d50 con 0x561f5f853020 2024-09-13T19:18:01.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.176+0000 7fd7b2467640 1 --2- 172.21.15.102:0/2554165748 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd67c036b40 0x7fd67c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.176+0000 7fd7b6e11800 1 --2- 172.21.15.102:0/2554165748 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x561f5f865da0 0x561f5f868210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.176+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561f5f868960 con 0x561f5f865da0 2024-09-13T19:18:01.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.176+0000 7fd7a9c66640 1 --2- 172.21.15.102:0/2554165748 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x561f5f865da0 0x561f5f868210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.176+0000 7fd7b2467640 1 --2- 172.21.15.102:0/2554165748 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd67c036b40 0x7fd67c039000 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd7a4016fd0 tx=0x7fd7a4038000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.177+0000 7fd7a9c66640 1 --2- 172.21.15.102:0/2554165748 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x561f5f865da0 0x561f5f868210 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.177+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd79c051070 con 0x561f5f865da0 2024-09-13T19:18:01.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.177+0000 7fd7b6e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:01.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.177+0000 7fd7b6e11800 20 realm 2024-09-13T19:18:01.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.177+0000 7fd7b6e11800 20 rados->read ofs=0 len=0 2024-09-13T19:18:01.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.177+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561f5f868d90 con 0x561f5f865da0 2024-09-13T19:18:01.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.177+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd79c051070 con 0x561f5f865da0 2024-09-13T19:18:01.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.177+0000 7fd7b6e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:01.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.177+0000 7fd7b6e11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:18:01.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.177+0000 7fd7b6e11800 20 rados->read ofs=0 len=0 2024-09-13T19:18:01.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.177+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561f5f869660 con 0x561f5f865da0 2024-09-13T19:18:01.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.177+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd79c051070 con 0x561f5f865da0 2024-09-13T19:18:01.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.177+0000 7fd7b6e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:01.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.177+0000 7fd7b6e11800 20 rados->read ofs=0 len=0 2024-09-13T19:18:01.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.177+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561f5f869a00 con 0x561f5f865da0 2024-09-13T19:18:01.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.177+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd79c051070 con 0x561f5f865da0 2024-09-13T19:18:01.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.178+0000 7fd7b6e11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:18:01.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.178+0000 7fd7b6e11800 20 rados->read ofs=0 len=0 2024-09-13T19:18:01.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.178+0000 7fd7b6e11800 1 --2- 172.21.15.102:0/2554165748 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x561f5f86a760 0x561f5f86cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.178+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561f5f86d090 con 0x561f5f86a760 2024-09-13T19:18:01.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.178+0000 7fd7b2c68640 1 --2- 172.21.15.102:0/2554165748 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x561f5f86a760 0x561f5f86cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.178+0000 7fd7b2c68640 1 --2- 172.21.15.102:0/2554165748 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x561f5f86a760 0x561f5f86cb50 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.178+0000 7fd7b2c68640 1 -- 172.21.15.102:0/2554165748 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd7ac057040 con 0x561f5f86a760 2024-09-13T19:18:01.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.178+0000 7fd7b6e11800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:18:01.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.178+0000 7fd7b6e11800 20 searching for the correct realm 2024-09-13T19:18:01.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.178+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561f5f86ea40 con 0x561f5f86a760 2024-09-13T19:18:01.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.178+0000 7fd7b2c68640 1 -- 172.21.15.102:0/2554165748 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7ac057040 con 0x561f5f86a760 2024-09-13T19:18:01.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.178+0000 7fd7b2c68640 1 --2- 172.21.15.102:0/2554165748 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fd7ac0462e0 0x7fd7ac04b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.178+0000 7fd7b2c68640 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561f5f86ea40 con 0x7fd7ac0462e0 2024-09-13T19:18:01.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.179+0000 7fd7b2467640 1 --2- 172.21.15.102:0/2554165748 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fd7ac0462e0 0x7fd7ac04b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.179+0000 7fd7b2467640 1 --2- 172.21.15.102:0/2554165748 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fd7ac0462e0 0x7fd7ac04b230 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.179+0000 7fd7b2467640 1 -- 172.21.15.102:0/2554165748 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7a4029030 con 0x7fd7ac0462e0 2024-09-13T19:18:01.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.179+0000 7fd7b2467640 1 --2- 172.21.15.102:0/2554165748 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fd7a4059040 0x7fd7a402a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.179+0000 7fd7b2467640 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561f5f86ea40 con 0x7fd7a4059040 2024-09-13T19:18:01.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.179+0000 7fd7a9c66640 1 --2- 172.21.15.102:0/2554165748 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fd7a4059040 0x7fd7a402a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.180+0000 7fd7a9c66640 1 --2- 172.21.15.102:0/2554165748 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fd7a4059040 0x7fd7a402a580 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.180+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd79c051070 con 0x7fd7a4059040 2024-09-13T19:18:01.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.180+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561f5f86ea40 con 0x561f5f865da0 2024-09-13T19:18:01.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.180+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd79c051070 con 0x561f5f865da0 2024-09-13T19:18:01.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.180+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561f5f86ea40 con 0x561f5f865da0 2024-09-13T19:18:01.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.180+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd79c051070 con 0x561f5f865da0 2024-09-13T19:18:01.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.180+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561f5f86ea40 con 0x7fd7a4059040 2024-09-13T19:18:01.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.181+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd79c051070 con 0x7fd7a4059040 2024-09-13T19:18:01.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.181+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561f5f86ea40 con 0x7fd7a4059040 2024-09-13T19:18:01.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.181+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd79c051070 con 0x7fd7a4059040 2024-09-13T19:18:01.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.181+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561f5f86ea40 con 0x7fd7ac0462e0 2024-09-13T19:18:01.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.181+0000 7fd7b2467640 1 -- 172.21.15.102:0/2554165748 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7a4029030 con 0x7fd7ac0462e0 2024-09-13T19:18:01.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.181+0000 7fd7b2467640 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561f5f86ea40 con 0x561f5f86a760 2024-09-13T19:18:01.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.181+0000 7fd7b2c68640 1 -- 172.21.15.102:0/2554165748 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7ac057040 con 0x561f5f86a760 2024-09-13T19:18:01.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.181+0000 7fd7b2c68640 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561f5f86ea40 con 0x561f5f865da0 2024-09-13T19:18:01.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.182+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd79c051070 con 0x561f5f865da0 2024-09-13T19:18:01.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.182+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561f5f86ea40 con 0x7fd7ac0462e0 2024-09-13T19:18:01.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.182+0000 7fd7b2467640 1 -- 172.21.15.102:0/2554165748 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7a4029030 con 0x7fd7ac0462e0 2024-09-13T19:18:01.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.182+0000 7fd7b2467640 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561f5f86ea40 con 0x561f5f865da0 2024-09-13T19:18:01.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.182+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd79c051070 con 0x561f5f865da0 2024-09-13T19:18:01.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.182+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561f5f86ea40 con 0x7fd7ac0462e0 2024-09-13T19:18:01.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.182+0000 7fd7b2467640 1 -- 172.21.15.102:0/2554165748 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd7a4029030 con 0x7fd7ac0462e0 2024-09-13T19:18:01.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.182+0000 7fd7b2467640 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561f5f86ea40 con 0x561f5f86a760 2024-09-13T19:18:01.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.183+0000 7fd7b2c68640 1 -- 172.21.15.102:0/2554165748 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7ac057040 con 0x561f5f86a760 2024-09-13T19:18:01.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.183+0000 7fd7b2c68640 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561f5f86ea40 con 0x561f5f86a760 2024-09-13T19:18:01.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.183+0000 7fd7b2c68640 1 -- 172.21.15.102:0/2554165748 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd7ac057040 con 0x561f5f86a760 2024-09-13T19:18:01.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.183+0000 7fd7b2c68640 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561f5f86ea40 con 0x7fd7a4059040 2024-09-13T19:18:01.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.183+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd79c051070 con 0x7fd7a4059040 2024-09-13T19:18:01.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.183+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561f5f86ea40 con 0x561f5f86a760 2024-09-13T19:18:01.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.183+0000 7fd7b2c68640 1 -- 172.21.15.102:0/2554165748 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd7ac057040 con 0x561f5f86a760 2024-09-13T19:18:01.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.183+0000 7fd7b2c68640 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561f5f86ea40 con 0x561f5f86a760 2024-09-13T19:18:01.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.184+0000 7fd7b2c68640 1 -- 172.21.15.102:0/2554165748 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7ac057040 con 0x561f5f86a760 2024-09-13T19:18:01.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.184+0000 7fd7b2c68640 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561f5f86ea40 con 0x561f5f865da0 2024-09-13T19:18:01.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.184+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd79c051070 con 0x561f5f865da0 2024-09-13T19:18:01.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.184+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561f5f86ea40 con 0x561f5f865da0 2024-09-13T19:18:01.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.184+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd79c051070 con 0x561f5f865da0 2024-09-13T19:18:01.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.184+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561f5f86ea40 con 0x7fd7a4059040 2024-09-13T19:18:01.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.184+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd79c051070 con 0x7fd7a4059040 2024-09-13T19:18:01.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.184+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561f5f86ea40 con 0x561f5f86a760 2024-09-13T19:18:01.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.185+0000 7fd7b2c68640 1 -- 172.21.15.102:0/2554165748 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7ac057040 con 0x561f5f86a760 2024-09-13T19:18:01.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.185+0000 7fd7b2c68640 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561f5f86ea40 con 0x7fd7ac0462e0 2024-09-13T19:18:01.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.185+0000 7fd7b2467640 1 -- 172.21.15.102:0/2554165748 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7a4029030 con 0x7fd7ac0462e0 2024-09-13T19:18:01.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.185+0000 7fd7b2467640 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561f5f86ea40 con 0x561f5f865da0 2024-09-13T19:18:01.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.185+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd79c051070 con 0x561f5f865da0 2024-09-13T19:18:01.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.185+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561f5f86ea40 con 0x7fd7ac0462e0 2024-09-13T19:18:01.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.185+0000 7fd7b2467640 1 -- 172.21.15.102:0/2554165748 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7a4029030 con 0x7fd7ac0462e0 2024-09-13T19:18:01.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.185+0000 7fd7b2467640 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561f5f86ea40 con 0x561f5f86a760 2024-09-13T19:18:01.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.185+0000 7fd7b2c68640 1 -- 172.21.15.102:0/2554165748 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7ac057040 con 0x561f5f86a760 2024-09-13T19:18:01.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.185+0000 7fd7b2c68640 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561f5f86ea40 con 0x7fd7a4059040 2024-09-13T19:18:01.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.186+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd79c051070 con 0x7fd7a4059040 2024-09-13T19:18:01.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.186+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561f5f86ea40 con 0x7fd7ac0462e0 2024-09-13T19:18:01.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.186+0000 7fd7b2467640 1 -- 172.21.15.102:0/2554165748 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7a4029030 con 0x7fd7ac0462e0 2024-09-13T19:18:01.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.186+0000 7fd7b2467640 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561f5f86ea40 con 0x561f5f86a760 2024-09-13T19:18:01.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.187+0000 7fd7b2c68640 1 -- 172.21.15.102:0/2554165748 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7ac057040 con 0x561f5f86a760 2024-09-13T19:18:01.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.187+0000 7fd7b2c68640 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561f5f86ea40 con 0x7fd7a4059040 2024-09-13T19:18:01.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.187+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd79c051070 con 0x7fd7a4059040 2024-09-13T19:18:01.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.187+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561f5f86ea40 con 0x561f5f865da0 2024-09-13T19:18:01.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.187+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd79c051070 con 0x561f5f865da0 2024-09-13T19:18:01.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.187+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fd79c084080 con 0x7fd7ac0462e0 2024-09-13T19:18:01.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.188+0000 7fd7b2467640 1 -- 172.21.15.102:0/2554165748 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7a4029030 con 0x7fd7ac0462e0 2024-09-13T19:18:01.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.188+0000 7fd7b6e11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:18:01.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.188+0000 7fd7b6e11800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:18:01.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.188+0000 7fd7b6e11800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:18:01.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.188+0000 7fd7b6e11800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:18:01.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.188+0000 7fd7b6e11800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:18:01.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.188+0000 7fd7b6e11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:18:01.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.188+0000 7fd7b6e11800 20 rados->read ofs=0 len=0 2024-09-13T19:18:01.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.188+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561f5f86db40 con 0x561f5f865da0 2024-09-13T19:18:01.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.188+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd79c051070 con 0x561f5f865da0 2024-09-13T19:18:01.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.188+0000 7fd7b6e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:01.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.188+0000 7fd7b6e11800 20 rados->read ofs=0 len=0 2024-09-13T19:18:01.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.188+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561f5f86e3e0 con 0x561f5f865da0 2024-09-13T19:18:01.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.188+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd79c051070 con 0x561f5f865da0 2024-09-13T19:18:01.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.188+0000 7fd7b6e11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:18:01.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.188+0000 7fd7b6e11800 20 rados->read ofs=0 len=0 2024-09-13T19:18:01.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.188+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561f5f86d780 con 0x561f5f86a760 2024-09-13T19:18:01.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.188+0000 7fd7b2c68640 1 -- 172.21.15.102:0/2554165748 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd7ac057040 con 0x561f5f86a760 2024-09-13T19:18:01.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.188+0000 7fd7b6e11800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:18:01.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.188+0000 7fd7b6e11800 20 zone default found 2024-09-13T19:18:01.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.188+0000 7fd7b6e11800 4 Realm: () 2024-09-13T19:18:01.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.188+0000 7fd7b6e11800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:18:01.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.188+0000 7fd7b6e11800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:18:01.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.188+0000 7fd7b6e11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:18:01.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.188+0000 7fd7b6e11800 20 zonegroup default 2024-09-13T19:18:01.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.188+0000 7fd7b6e11800 20 rados->read ofs=0 len=0 2024-09-13T19:18:01.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.188+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561f5f86f3c0 con 0x7fd7ac0462e0 2024-09-13T19:18:01.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.189+0000 7fd7b2467640 1 -- 172.21.15.102:0/2554165748 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd7a4029030 con 0x7fd7ac0462e0 2024-09-13T19:18:01.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.189+0000 7fd7b6e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:01.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.189+0000 7fd7b6e11800 20 rados->read ofs=0 len=0 2024-09-13T19:18:01.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.189+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561f5f86f000 con 0x561f5f86a760 2024-09-13T19:18:01.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.189+0000 7fd7b2c68640 1 -- 172.21.15.102:0/2554165748 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd7ac057040 con 0x561f5f86a760 2024-09-13T19:18:01.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.189+0000 7fd7b6e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:01.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.189+0000 7fd7b6e11800 20 rados->read ofs=0 len=0 2024-09-13T19:18:01.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.189+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561f5f871670 con 0x561f5f86a760 2024-09-13T19:18:01.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.189+0000 7fd7b2c68640 1 -- 172.21.15.102:0/2554165748 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd7ac057040 con 0x561f5f86a760 2024-09-13T19:18:01.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.189+0000 7fd7b6e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:01.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.189+0000 7fd7b6e11800 20 started sync module instance, tier type = 2024-09-13T19:18:01.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.189+0000 7fd7b6e11800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:18:01.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.189+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561f5f870a80 con 0x7fd7ac0462e0 2024-09-13T19:18:01.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.190+0000 7fd7b2467640 1 -- 172.21.15.102:0/2554165748 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(44 notify.0 [create] v36'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7a4029030 con 0x7fd7ac0462e0 2024-09-13T19:18:01.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.190+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94692746661536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561f5f871f30 con 0x7fd7ac0462e0 2024-09-13T19:18:01.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.190+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561f5f872780 con 0x561f5f865da0 2024-09-13T19:18:01.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.191+0000 7fd7b2467640 1 -- 172.21.15.102:0/2554165748 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94692746661536] v36'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7a4029030 con 0x7fd7ac0462e0 2024-09-13T19:18:01.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.192+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v36'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd79c051070 con 0x561f5f865da0 2024-09-13T19:18:01.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.192+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94692746664576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561f5f8724d0 con 0x561f5f865da0 2024-09-13T19:18:01.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.192+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561f5f872ff0 con 0x561f5f86a760 2024-09-13T19:18:01.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.193+0000 7fd7b2c68640 1 -- 172.21.15.102:0/2554165748 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v36'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7ac057040 con 0x561f5f86a760 2024-09-13T19:18:01.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.193+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94692746668736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561f5f872fb0 con 0x561f5f86a760 2024-09-13T19:18:01.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.193+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561f5f873fd0 con 0x7fd7ac0462e0 2024-09-13T19:18:01.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.193+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94692746664576] v36'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd79c051070 con 0x561f5f865da0 2024-09-13T19:18:01.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.194+0000 7fd7b2467640 1 -- 172.21.15.102:0/2554165748 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(50 notify.3 [create] v36'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7a4029030 con 0x7fd7ac0462e0 2024-09-13T19:18:01.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.194+0000 7fd7b2c68640 1 -- 172.21.15.102:0/2554165748 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94692746668736] v36'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7ac057040 con 0x561f5f86a760 2024-09-13T19:18:01.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.194+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94692746672864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561f5f873fd0 con 0x7fd7ac0462e0 2024-09-13T19:18:01.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.194+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561f5f874870 con 0x561f5f865da0 2024-09-13T19:18:01.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.195+0000 7fd7b2467640 1 -- 172.21.15.102:0/2554165748 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94692746672864] v36'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7a4029030 con 0x7fd7ac0462e0 2024-09-13T19:18:01.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.195+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v36'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd79c051070 con 0x561f5f865da0 2024-09-13T19:18:01.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.195+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94692746671072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561f5f873fd0 con 0x561f5f865da0 2024-09-13T19:18:01.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.195+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561f5f874fc0 con 0x7fd7a4059040 2024-09-13T19:18:01.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.197+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(54 notify.5 [create] v36'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd79c051070 con 0x7fd7a4059040 2024-09-13T19:18:01.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.197+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94692746676880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561f5f874fc0 con 0x7fd7a4059040 2024-09-13T19:18:01.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.197+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561f5f875fc0 con 0x7fd7a4059040 2024-09-13T19:18:01.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.197+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94692746671072] v36'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd79c051070 con 0x561f5f865da0 2024-09-13T19:18:01.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.198+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94692746676880] v36'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd79c051070 con 0x7fd7a4059040 2024-09-13T19:18:01.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.198+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(56 notify.6 [create] v36'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd79c051070 con 0x7fd7a4059040 2024-09-13T19:18:01.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.198+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94692746681008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561f5f875220 con 0x7fd7a4059040 2024-09-13T19:18:01.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.198+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561f5f876430 con 0x7fd7a4059040 2024-09-13T19:18:01.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.199+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94692746681008] v36'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd79c051070 con 0x7fd7a4059040 2024-09-13T19:18:01.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.199+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(58 notify.7 [create] v36'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd79c051070 con 0x7fd7a4059040 2024-09-13T19:18:01.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.199+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94692746675136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561f5f876430 con 0x7fd7a4059040 2024-09-13T19:18:01.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.199+0000 7fd7b6e11800 20 add_watcher() i=0 2024-09-13T19:18:01.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.199+0000 7fd7b6e11800 20 add_watcher() i=1 2024-09-13T19:18:01.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.199+0000 7fd7b6e11800 20 add_watcher() i=2 2024-09-13T19:18:01.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.199+0000 7fd7b6e11800 20 add_watcher() i=3 2024-09-13T19:18:01.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.199+0000 7fd7b6e11800 20 add_watcher() i=4 2024-09-13T19:18:01.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.199+0000 7fd7b6e11800 20 add_watcher() i=5 2024-09-13T19:18:01.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.199+0000 7fd7b6e11800 20 add_watcher() i=6 2024-09-13T19:18:01.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.200+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94692746675136] v36'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd79c051070 con 0x7fd7a4059040 2024-09-13T19:18:01.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.200+0000 7fd7b6e11800 20 add_watcher() i=7 2024-09-13T19:18:01.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.200+0000 7fd7b6e11800 2 all 8 watchers are set, enabling cache 2024-09-13T19:18:01.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.200+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561f5f879830 con 0x561f5f865da0 2024-09-13T19:18:01.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.200+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd79c051070 con 0x561f5f865da0 2024-09-13T19:18:01.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.200+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94692746682704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561f5f876d50 con 0x561f5f865da0 2024-09-13T19:18:01.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.201+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94692746682704] v36'230 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd79c051070 con 0x561f5f865da0 2024-09-13T19:18:01.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.202+0000 7fd668fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:18:01.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.202+0000 7fd7b6e11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:18:01.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.202+0000 7fd7b6e11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:18:01.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.202+0000 7fd7b6e11800 5 note: GC not initialized 2024-09-13T19:18:01.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.202+0000 7fd5e37fe640 20 reqs_thread_entry: start 2024-09-13T19:18:01.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.202+0000 7fd7b6e11800 20 init_complete bucket index max shards: 11 2024-09-13T19:18:01.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.202+0000 7fd7b6e11800 20 Filter name: none 2024-09-13T19:18:01.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.202+0000 7fd5e17fa640 20 reqs_thread_entry: start 2024-09-13T19:18:01.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.202+0000 7fd7b6e11800 20 rados->read ofs=0 len=0 2024-09-13T19:18:01.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.202+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561f5f8ac730 con 0x561f5f865da0 2024-09-13T19:18:01.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.203+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fd79c051070 con 0x561f5f865da0 2024-09-13T19:18:01.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.203+0000 7fd7b6e11800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:18:01.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.203+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561f5f8adc80 con 0x7fd7a4059040 2024-09-13T19:18:01.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.203+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(63 usage.10 [call out=15b] v0'0 uv33 ondisk = 0) ==== 152+0+15 (crc 0 0 0) 0x7fd79c051070 con 0x7fd7a4059040 2024-09-13T19:18:01.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.204+0000 7fd668fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:18:01.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.204+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94692746682704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561f5f878ce0 con 0x561f5f865da0 2024-09-13T19:18:01.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.205+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94692746682704] v36'231 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd79c051070 con 0x561f5f865da0 2024-09-13T19:18:01.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.205+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94692746661536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561f5f876120 con 0x7fd7ac0462e0 2024-09-13T19:18:01.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.206+0000 7fd7b2467640 1 -- 172.21.15.102:0/2554165748 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94692746661536] v36'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7a4029030 con 0x7fd7ac0462e0 2024-09-13T19:18:01.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.206+0000 7fd7b6e11800 20 remove_watcher() i=0 2024-09-13T19:18:01.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.206+0000 7fd7b6e11800 2 removed watcher, disabling cache 2024-09-13T19:18:01.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.206+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94692746664576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561f5f870ea0 con 0x561f5f865da0 2024-09-13T19:18:01.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.207+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94692746664576] v36'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd79c051070 con 0x561f5f865da0 2024-09-13T19:18:01.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.207+0000 7fd7b6e11800 20 remove_watcher() i=1 2024-09-13T19:18:01.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.207+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94692746668736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561f5f870ea0 con 0x561f5f86a760 2024-09-13T19:18:01.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.209+0000 7fd7b2c68640 1 -- 172.21.15.102:0/2554165748 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94692746668736] v36'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7ac057040 con 0x561f5f86a760 2024-09-13T19:18:01.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.209+0000 7fd7b6e11800 20 remove_watcher() i=2 2024-09-13T19:18:01.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.209+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94692746672864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561f5f870ea0 con 0x7fd7ac0462e0 2024-09-13T19:18:01.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.210+0000 7fd7b2467640 1 -- 172.21.15.102:0/2554165748 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94692746672864] v36'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7a4029030 con 0x7fd7ac0462e0 2024-09-13T19:18:01.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.210+0000 7fd7b6e11800 20 remove_watcher() i=3 2024-09-13T19:18:01.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.210+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94692746671072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561f5f870ea0 con 0x561f5f865da0 2024-09-13T19:18:01.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.211+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94692746671072] v36'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd79c051070 con 0x561f5f865da0 2024-09-13T19:18:01.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.211+0000 7fd7b6e11800 20 remove_watcher() i=4 2024-09-13T19:18:01.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.211+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94692746676880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561f5f8733e0 con 0x7fd7a4059040 2024-09-13T19:18:01.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.212+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94692746676880] v36'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd79c051070 con 0x7fd7a4059040 2024-09-13T19:18:01.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.212+0000 7fd7b6e11800 20 remove_watcher() i=5 2024-09-13T19:18:01.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.212+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94692746681008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561f5f870ea0 con 0x7fd7a4059040 2024-09-13T19:18:01.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.213+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94692746681008] v36'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd79c051070 con 0x7fd7a4059040 2024-09-13T19:18:01.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.213+0000 7fd7b6e11800 20 remove_watcher() i=6 2024-09-13T19:18:01.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.213+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94692746675136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561f5f875ab0 con 0x7fd7a4059040 2024-09-13T19:18:01.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.215+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94692746675136] v36'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd79c051070 con 0x7fd7a4059040 2024-09-13T19:18:01.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.215+0000 7fd7b6e11800 20 remove_watcher() i=7 2024-09-13T19:18:01.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.215+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fd7a4059040 msgr2=0x7fd7a402a580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.215+0000 7fd7b6e11800 1 --2- 172.21.15.102:0/2554165748 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fd7a4059040 0x7fd7a402a580 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.215+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x561f5f865da0 msgr2=0x561f5f868210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.215+0000 7fd7b6e11800 1 --2- 172.21.15.102:0/2554165748 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x561f5f865da0 0x561f5f868210 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.215+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fd7ac0462e0 msgr2=0x7fd7ac04b230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.215+0000 7fd7b6e11800 1 --2- 172.21.15.102:0/2554165748 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fd7ac0462e0 0x7fd7ac04b230 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.215+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x561f5f86a760 msgr2=0x561f5f86cb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.215+0000 7fd7b6e11800 1 --2- 172.21.15.102:0/2554165748 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x561f5f86a760 0x561f5f86cb50 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.215+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd67c036b40 msgr2=0x7fd67c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.215+0000 7fd7b6e11800 1 --2- 172.21.15.102:0/2554165748 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd67c036b40 0x7fd67c039000 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd7a4016fd0 tx=0x7fd7a4038000 comp rx=0 tx=0).stop 2024-09-13T19:18:01.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.215+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f5f853020 msgr2=0x561f5f85a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.215+0000 7fd7b6e11800 1 --2- 172.21.15.102:0/2554165748 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f5f853020 0x561f5f85a350 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac029ba0 tx=0x7fd7ac04ce50 comp rx=0 tx=0).stop 2024-09-13T19:18:01.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.215+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 reap_dead start 2024-09-13T19:18:01.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.215+0000 7fd7a9c66640 1 -- 172.21.15.102:0/2554165748 reap_dead start 2024-09-13T19:18:01.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.215+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 shutdown_connections 2024-09-13T19:18:01.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.215+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 >> 172.21.15.102:0/2554165748 conn(0x561f5f84f380 msgr2=0x561f5f84d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:01.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.215+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 shutdown_connections 2024-09-13T19:18:01.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.215+0000 7fd7b6e11800 1 -- 172.21.15.102:0/2554165748 wait complete. 2024-09-13T19:18:01.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.215+0000 7fd7b6e11800 1 -- 172.21.15.102:0/1193032688 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd68c036b40 msgr2=0x7fd68c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.215+0000 7fd7b6e11800 1 --2- 172.21.15.102:0/1193032688 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd68c036b40 0x7fd68c039000 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x561f5f731af0 tx=0x7fd7a402ae80 comp rx=0 tx=0).stop 2024-09-13T19:18:01.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.215+0000 7fd7b6e11800 1 -- 172.21.15.102:0/1193032688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f5f846330 msgr2=0x561f5f846750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.215+0000 7fd7b6e11800 1 --2- 172.21.15.102:0/1193032688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f5f846330 0x561f5f846750 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x561f5f732190 tx=0x7fd7ac0167b0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.215+0000 7fd7b6e11800 1 -- 172.21.15.102:0/1193032688 shutdown_connections 2024-09-13T19:18:01.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.215+0000 7fd7b6e11800 1 --2- 172.21.15.102:0/1193032688 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd68c036b40 0x7fd68c039000 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.215+0000 7fd7b6e11800 1 --2- 172.21.15.102:0/1193032688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f5f846330 0x561f5f846750 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.215+0000 7fd7b6e11800 1 -- 172.21.15.102:0/1193032688 >> 172.21.15.102:0/1193032688 conn(0x561f5f83b2c0 msgr2=0x561f5f83de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:01.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.216+0000 7fd7b6e11800 1 -- 172.21.15.102:0/1193032688 shutdown_connections 2024-09-13T19:18:01.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.216+0000 7fd7b6e11800 1 -- 172.21.15.102:0/1193032688 wait complete. 2024-09-13T19:18:01.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.216+0000 7fd7b6e11800 1 -- 172.21.15.102:0/548466488 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x561f5f7368e0 msgr2=0x561f5f832630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.216+0000 7fd7b6e11800 1 --2- 172.21.15.102:0/548466488 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x561f5f7368e0 0x561f5f832630 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.216+0000 7fd7b6e11800 1 -- 172.21.15.102:0/548466488 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x561f5f834df0 msgr2=0x561f5f837220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.216+0000 7fd7b6e11800 1 --2- 172.21.15.102:0/548466488 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x561f5f834df0 0x561f5f837220 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.216+0000 7fd7b6e11800 1 -- 172.21.15.102:0/548466488 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd698036b40 msgr2=0x7fd698039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.216+0000 7fd7b6e11800 1 --2- 172.21.15.102:0/548466488 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd698036b40 0x7fd698039000 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd79c057000 tx=0x7fd79c052000 comp rx=0 tx=0).stop 2024-09-13T19:18:01.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.216+0000 7fd7b6e11800 1 -- 172.21.15.102:0/548466488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f5f6a5e10 msgr2=0x561f5f732af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.216+0000 7fd7b6e11800 1 --2- 172.21.15.102:0/548466488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f5f6a5e10 0x561f5f732af0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fd7a4004000 tx=0x7fd7a4000bc0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.216+0000 7fd7b6e11800 1 -- 172.21.15.102:0/548466488 shutdown_connections 2024-09-13T19:18:01.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.216+0000 7fd7b6e11800 1 --2- 172.21.15.102:0/548466488 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x561f5f834df0 0x561f5f837220 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.216+0000 7fd7b6e11800 1 --2- 172.21.15.102:0/548466488 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x561f5f7368e0 0x561f5f832630 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.216+0000 7fd7b6e11800 1 --2- 172.21.15.102:0/548466488 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd698036b40 0x7fd698039000 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.216+0000 7fd7b6e11800 1 --2- 172.21.15.102:0/548466488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561f5f6a5e10 0x561f5f732af0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.216+0000 7fd7b6e11800 1 -- 172.21.15.102:0/548466488 >> 172.21.15.102:0/548466488 conn(0x561f5f72cdf0 msgr2=0x561f5f81bb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:01.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.216+0000 7fd7b6e11800 1 -- 172.21.15.102:0/548466488 shutdown_connections 2024-09-13T19:18:01.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.216+0000 7fd7b6e11800 1 -- 172.21.15.102:0/548466488 wait complete. 2024-09-13T19:18:01.227 INFO:teuthology.orchestra.run.smithi102.stdout:{"entries":[],"summary":[]} 2024-09-13T19:18:01.228 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-13T19:18:01.228 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-13T19:18:01.228 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-13T19:18:01.228 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2024-09-13T19:18:01.273 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:18:01.273 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:18:01.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.271+0000 7ff5fa215800 1 Processor -- start 2024-09-13T19:18:01.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.271+0000 7ff5fa215800 1 -- start start 2024-09-13T19:18:01.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.271+0000 7ff5fa215800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x555d1f94ce10 0x555d1f9de600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.271+0000 7ff5fa215800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555d1f898b30 con 0x555d1f9deb40 2024-09-13T19:18:01.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.271+0000 7ff5fa215800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x555d1f87a360 con 0x555d1f94ce10 2024-09-13T19:18:01.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.271+0000 7ff5f599c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x555d1f94ce10 0x555d1f9de600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.271+0000 7ff5f599c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x555d1f94ce10 0x555d1f9de600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49182/0 (socket says 172.21.15.102:49182) 2024-09-13T19:18:01.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.271+0000 7ff5f599c640 1 -- 172.21.15.102:0/3677941685 learned_addr learned my addr 172.21.15.102:0/3677941685 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:01.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.271+0000 7ff5f519b640 1 --1- 172.21.15.102:0/3677941685 >> v1:172.21.15.53:6789/0 conn(0x555d1f9deb40 0x555d1f9e0f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:53618/0 (socket says 172.21.15.102:53618) 2024-09-13T19:18:01.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.272+0000 7ff5f599c640 1 -- 172.21.15.102:0/3677941685 >> v1:172.21.15.53:6789/0 conn(0x555d1f9deb40 legacy=0x555d1f9e0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.272+0000 7ff5f599c640 1 -- 172.21.15.102:0/3677941685 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d1f8a0e00 con 0x555d1f94ce10 2024-09-13T19:18:01.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.273+0000 7ff5f599c640 1 --2- 172.21.15.102:0/3677941685 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d1f94ce10 0x555d1f9de600 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7ff5f000a520 tx=0x7ff5f0045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a99c5b3909e344a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.274+0000 7ff5f499a640 1 -- 172.21.15.102:0/3677941685 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5f0055070 con 0x555d1f94ce10 2024-09-13T19:18:01.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.274+0000 7ff5f499a640 1 -- 172.21.15.102:0/3677941685 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5f00515b0 con 0x555d1f94ce10 2024-09-13T19:18:01.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.274+0000 7ff5f499a640 1 -- 172.21.15.102:0/3677941685 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5f00518d0 con 0x555d1f94ce10 2024-09-13T19:18:01.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.274+0000 7ff5fa215800 1 -- 172.21.15.102:0/3677941685 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d1f94ce10 msgr2=0x555d1f9de600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.274+0000 7ff5fa215800 1 --2- 172.21.15.102:0/3677941685 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d1f94ce10 0x555d1f9de600 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7ff5f000a520 tx=0x7ff5f0045ba0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.274+0000 7ff5fa215800 1 -- 172.21.15.102:0/3677941685 shutdown_connections 2024-09-13T19:18:01.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.274+0000 7ff5fa215800 1 --2- 172.21.15.102:0/3677941685 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d1f94ce10 0x555d1f9de600 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.274+0000 7ff5fa215800 1 -- 172.21.15.102:0/3677941685 >> 172.21.15.102:0/3677941685 conn(0x555d1f9d3dd0 msgr2=0x555d1f9d61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:01.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.274+0000 7ff5fa215800 1 -- 172.21.15.102:0/3677941685 shutdown_connections 2024-09-13T19:18:01.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.274+0000 7ff5fa215800 1 -- 172.21.15.102:0/3677941685 wait complete. 2024-09-13T19:18:01.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.288+0000 7ff5fa215800 1 Processor -- start 2024-09-13T19:18:01.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.288+0000 7ff5fa215800 1 -- start start 2024-09-13T19:18:01.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.288+0000 7ff5fa215800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d1f94ce10 0x555d1facaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.288+0000 7ff5fa215800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555d1f925360 con 0x555d1f94ce10 2024-09-13T19:18:01.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.288+0000 7ff5f599c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d1f94ce10 0x555d1facaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.288+0000 7ff5f599c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d1f94ce10 0x555d1facaa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49190/0 (socket says 172.21.15.102:49190) 2024-09-13T19:18:01.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.288+0000 7ff5f599c640 1 -- 172.21.15.102:0/1379011876 learned_addr learned my addr 172.21.15.102:0/1379011876 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:01.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.289+0000 7ff5f599c640 1 -- 172.21.15.102:0/1379011876 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d1f872bc0 con 0x555d1f94ce10 2024-09-13T19:18:01.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.289+0000 7ff5f599c640 1 --2- 172.21.15.102:0/1379011876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d1f94ce10 0x555d1facaa80 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0025da0 tx=0x7ff5f0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc6a82d237befaee server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.289+0000 7ff4e3e07640 1 -- 172.21.15.102:0/1379011876 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5f0051950 con 0x555d1f94ce10 2024-09-13T19:18:01.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.289+0000 7ff4e3e07640 1 -- 172.21.15.102:0/1379011876 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5f0051af0 con 0x555d1f94ce10 2024-09-13T19:18:01.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.289+0000 7ff4e3e07640 1 -- 172.21.15.102:0/1379011876 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5f0051dd0 con 0x555d1f94ce10 2024-09-13T19:18:01.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.290+0000 7ff5fa215800 1 -- 172.21.15.102:0/1379011876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d1f94ce10 msgr2=0x555d1facaa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.290+0000 7ff5fa215800 1 --2- 172.21.15.102:0/1379011876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d1f94ce10 0x555d1facaa80 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0025da0 tx=0x7ff5f0051000 comp rx=0 tx=0).stop 2024-09-13T19:18:01.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.290+0000 7ff5fa215800 1 -- 172.21.15.102:0/1379011876 shutdown_connections 2024-09-13T19:18:01.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.290+0000 7ff5fa215800 1 --2- 172.21.15.102:0/1379011876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d1f94ce10 0x555d1facaa80 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.290+0000 7ff5fa215800 1 -- 172.21.15.102:0/1379011876 >> 172.21.15.102:0/1379011876 conn(0x555d1f9d3dd0 msgr2=0x555d1fac6440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:01.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.290+0000 7ff5fa215800 1 -- 172.21.15.102:0/1379011876 shutdown_connections 2024-09-13T19:18:01.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.290+0000 7ff5fa215800 1 -- 172.21.15.102:0/1379011876 wait complete. 2024-09-13T19:18:01.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.290+0000 7ff5fa215800 1 Processor -- start 2024-09-13T19:18:01.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.290+0000 7ff5fa215800 1 -- start start 2024-09-13T19:18:01.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.290+0000 7ff5fa215800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d1f94ce10 0x555d1fad23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.290+0000 7ff5fa215800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555d1f9e2920 con 0x555d1f94ce10 2024-09-13T19:18:01.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.291+0000 7ff5f599c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d1f94ce10 0x555d1fad23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.291+0000 7ff5f599c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d1f94ce10 0x555d1fad23b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49206/0 (socket says 172.21.15.102:49206) 2024-09-13T19:18:01.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.291+0000 7ff5f599c640 1 -- 172.21.15.102:0/2261059812 learned_addr learned my addr 172.21.15.102:0/2261059812 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:01.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.291+0000 7ff5f599c640 1 -- 172.21.15.102:0/2261059812 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d1f886fe0 con 0x555d1f94ce10 2024-09-13T19:18:01.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.291+0000 7ff5f599c640 1 --2- 172.21.15.102:0/2261059812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d1f94ce10 0x555d1fad23b0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0067040 tx=0x7ff5f0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.291+0000 7ff4e2604640 1 -- 172.21.15.102:0/2261059812 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5f0073070 con 0x555d1f94ce10 2024-09-13T19:18:01.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.291+0000 7ff4e2604640 1 -- 172.21.15.102:0/2261059812 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5f005a450 con 0x555d1f94ce10 2024-09-13T19:18:01.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.291+0000 7ff4e2604640 1 -- 172.21.15.102:0/2261059812 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5f005a730 con 0x555d1f94ce10 2024-09-13T19:18:01.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.291+0000 7ff5fa215800 1 -- 172.21.15.102:0/2261059812 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555d1fad28f0 con 0x555d1f94ce10 2024-09-13T19:18:01.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.291+0000 7ff5fa215800 1 -- 172.21.15.102:0/2261059812 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d1fad2e70 con 0x555d1f94ce10 2024-09-13T19:18:01.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.292+0000 7ff4e2604640 1 -- 172.21.15.102:0/2261059812 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff5f0076070 con 0x555d1f94ce10 2024-09-13T19:18:01.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.292+0000 7ff4e2604640 1 --2- 172.21.15.102:0/2261059812 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff4dc036b40 0x7ff4dc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.292+0000 7ff4e2604640 1 -- 172.21.15.102:0/2261059812 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7ff5f0062070 con 0x555d1f94ce10 2024-09-13T19:18:01.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.292+0000 7ff5f519b640 1 --2- 172.21.15.102:0/2261059812 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff4dc036b40 0x7ff4dc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.292+0000 7ff5fa215800 1 --2- 172.21.15.102:0/2261059812 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x555d1f9deb40 0x555d1fad9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.292+0000 7ff5fa215800 1 -- 172.21.15.102:0/2261059812 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fad99a0 con 0x555d1f9deb40 2024-09-13T19:18:01.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.293+0000 7ff5f619d640 1 --2- 172.21.15.102:0/2261059812 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x555d1f9deb40 0x555d1fad9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.293+0000 7ff5f519b640 1 --2- 172.21.15.102:0/2261059812 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff4dc036b40 0x7ff4dc039000 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff5e0000f60 tx=0x7ff5e0001370 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.293+0000 7ff5f619d640 1 --2- 172.21.15.102:0/2261059812 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x555d1f9deb40 0x555d1fad9420 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.293+0000 7ff5f619d640 1 -- 172.21.15.102:0/2261059812 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff5e800a4a0 con 0x555d1f9deb40 2024-09-13T19:18:01.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.293+0000 7ff5fa215800 1 -- 172.21.15.102:0/2261059812 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fad69f0 con 0x555d1f9deb40 2024-09-13T19:18:01.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.293+0000 7ff5f619d640 1 -- 172.21.15.102:0/2261059812 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff5e800a4a0 con 0x555d1f9deb40 2024-09-13T19:18:01.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.293+0000 7ff5fa215800 1 --2- 172.21.15.102:0/2261059812 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x555d1fadbcd0 0x555d1fade0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.293+0000 7ff5fa215800 1 -- 172.21.15.102:0/2261059812 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fade760 con 0x555d1fadbcd0 2024-09-13T19:18:01.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.294+0000 7ff5f599c640 1 --2- 172.21.15.102:0/2261059812 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x555d1fadbcd0 0x555d1fade0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.294+0000 7ff5f599c640 1 --2- 172.21.15.102:0/2261059812 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x555d1fadbcd0 0x555d1fade0c0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.294+0000 7ff5f599c640 1 -- 172.21.15.102:0/2261059812 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff5f0075030 con 0x555d1fadbcd0 2024-09-13T19:18:01.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.294+0000 7ff5fa215800 1 -- 172.21.15.102:0/2261059812 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fadab70 con 0x555d1f9deb40 2024-09-13T19:18:01.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.294+0000 7ff5f619d640 1 -- 172.21.15.102:0/2261059812 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff5e800a4a0 con 0x555d1f9deb40 2024-09-13T19:18:01.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.294+0000 7ff5fa215800 1 -- 172.21.15.102:0/2261059812 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fadb050 con 0x555d1fadbcd0 2024-09-13T19:18:01.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.295+0000 7ff5f599c640 1 -- 172.21.15.102:0/2261059812 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff5f0075030 con 0x555d1fadbcd0 2024-09-13T19:18:01.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.295+0000 7ff5fa215800 1 Processor -- start 2024-09-13T19:18:01.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.295+0000 7ff5fa215800 1 -- start start 2024-09-13T19:18:01.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.295+0000 7ff5fa215800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d1faed060 0x555d1faed480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.295+0000 7ff5fa215800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555d1f874580 con 0x555d1faed060 2024-09-13T19:18:01.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.296+0000 7ff5f619d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d1faed060 0x555d1faed480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.296+0000 7ff5f619d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d1faed060 0x555d1faed480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49218/0 (socket says 172.21.15.102:49218) 2024-09-13T19:18:01.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.296+0000 7ff5f619d640 1 -- 172.21.15.102:0/986261933 learned_addr learned my addr 172.21.15.102:0/986261933 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:01.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.296+0000 7ff5f619d640 1 -- 172.21.15.102:0/986261933 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d1faed9c0 con 0x555d1faed060 2024-09-13T19:18:01.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.296+0000 7ff5f619d640 1 --2- 172.21.15.102:0/986261933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d1faed060 0x555d1faed480 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x555d1fad3460 tx=0x7ff5e80167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.296+0000 7ff4db7fe640 1 -- 172.21.15.102:0/986261933 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5e8013640 con 0x555d1faed060 2024-09-13T19:18:01.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.296+0000 7ff4db7fe640 1 -- 172.21.15.102:0/986261933 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5e80137e0 con 0x555d1faed060 2024-09-13T19:18:01.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.296+0000 7ff5fa215800 1 -- 172.21.15.102:0/986261933 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555d1faedc50 con 0x555d1faed060 2024-09-13T19:18:01.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.296+0000 7ff4db7fe640 1 -- 172.21.15.102:0/986261933 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5e8013ae0 con 0x555d1faed060 2024-09-13T19:18:01.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.296+0000 7ff5fa215800 1 -- 172.21.15.102:0/986261933 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d1faf0930 con 0x555d1faed060 2024-09-13T19:18:01.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.297+0000 7ff4db7fe640 1 -- 172.21.15.102:0/986261933 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff5e8011040 con 0x555d1faed060 2024-09-13T19:18:01.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.297+0000 7ff4db7fe640 1 --2- 172.21.15.102:0/986261933 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff4d0036b40 0x7ff4d0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.297+0000 7ff4db7fe640 1 -- 172.21.15.102:0/986261933 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7ff5e800e040 con 0x555d1faed060 2024-09-13T19:18:01.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.297+0000 7ff5f599c640 1 --2- 172.21.15.102:0/986261933 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff4d0036b40 0x7ff4d0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.298+0000 7ff5fa215800 1 Processor -- start 2024-09-13T19:18:01.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.298+0000 7ff5f599c640 1 --2- 172.21.15.102:0/986261933 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff4d0036b40 0x7ff4d0039000 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff5f008f870 tx=0x7ff5f008f2f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.298+0000 7ff5fa215800 1 -- start start 2024-09-13T19:18:01.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.298+0000 7ff5fa215800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d1faf9d80 0x555d1fafa180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.298+0000 7ff5fa215800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555d1facb170 con 0x555d1faf9d80 2024-09-13T19:18:01.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.298+0000 7ff5f619d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d1faf9d80 0x555d1fafa180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.298+0000 7ff5f619d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d1faf9d80 0x555d1fafa180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49224/0 (socket says 172.21.15.102:49224) 2024-09-13T19:18:01.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.298+0000 7ff5f619d640 1 -- 172.21.15.102:0/2452320314 learned_addr learned my addr 172.21.15.102:0/2452320314 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:01.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.298+0000 7ff5f619d640 1 -- 172.21.15.102:0/2452320314 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d1fafa750 con 0x555d1faf9d80 2024-09-13T19:18:01.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.299+0000 7ff5f619d640 1 --2- 172.21.15.102:0/2452320314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d1faf9d80 0x555d1fafa180 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7ff5e804ce40 tx=0x7ff5e80204e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f94dbf20594ab2c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.299+0000 7ff4d97fa640 1 -- 172.21.15.102:0/2452320314 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5e8021960 con 0x555d1faf9d80 2024-09-13T19:18:01.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.299+0000 7ff4d97fa640 1 -- 172.21.15.102:0/2452320314 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5e804a030 con 0x555d1faf9d80 2024-09-13T19:18:01.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.299+0000 7ff4d97fa640 1 -- 172.21.15.102:0/2452320314 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5e8021440 con 0x555d1faf9d80 2024-09-13T19:18:01.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.299+0000 7ff5fa215800 1 -- 172.21.15.102:0/2452320314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d1faf9d80 msgr2=0x555d1fafa180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.299+0000 7ff5fa215800 1 --2- 172.21.15.102:0/2452320314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d1faf9d80 0x555d1fafa180 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7ff5e804ce40 tx=0x7ff5e80204e0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.299+0000 7ff5fa215800 1 -- 172.21.15.102:0/2452320314 shutdown_connections 2024-09-13T19:18:01.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.299+0000 7ff5fa215800 1 --2- 172.21.15.102:0/2452320314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d1faf9d80 0x555d1fafa180 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.299+0000 7ff5fa215800 1 -- 172.21.15.102:0/2452320314 >> 172.21.15.102:0/2452320314 conn(0x555d1faf60e0 msgr2=0x555d1faf4230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:01.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.299+0000 7ff5fa215800 1 -- 172.21.15.102:0/2452320314 shutdown_connections 2024-09-13T19:18:01.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.299+0000 7ff5fa215800 1 -- 172.21.15.102:0/2452320314 wait complete. 2024-09-13T19:18:01.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.300+0000 7ff5fa215800 1 Processor -- start 2024-09-13T19:18:01.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.300+0000 7ff5fa215800 1 -- start start 2024-09-13T19:18:01.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.300+0000 7ff5fa215800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d1faf9d80 0x555d1fb01230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.300+0000 7ff5fa215800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555d1fafad20 con 0x555d1faf9d80 2024-09-13T19:18:01.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.300+0000 7ff5f619d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d1faf9d80 0x555d1fb01230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.300+0000 7ff5f619d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d1faf9d80 0x555d1fb01230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49230/0 (socket says 172.21.15.102:49230) 2024-09-13T19:18:01.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.300+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 learned_addr learned my addr 172.21.15.102:0/3320689451 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:01.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.300+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d1fb01770 con 0x555d1faf9d80 2024-09-13T19:18:01.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.301+0000 7ff5f619d640 1 --2- 172.21.15.102:0/3320689451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d1faf9d80 0x555d1fb01230 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7ff5e8020520 tx=0x7ff5e804cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.301+0000 7ff4c77fe640 1 -- 172.21.15.102:0/3320689451 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5e8039070 con 0x555d1faf9d80 2024-09-13T19:18:01.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.301+0000 7ff4c77fe640 1 -- 172.21.15.102:0/3320689451 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5e8021a90 con 0x555d1faf9d80 2024-09-13T19:18:01.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.301+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555d1fb01a00 con 0x555d1faf9d80 2024-09-13T19:18:01.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.301+0000 7ff4c77fe640 1 -- 172.21.15.102:0/3320689451 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5e8021570 con 0x555d1faf9d80 2024-09-13T19:18:01.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.301+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d1fb046b0 con 0x555d1faf9d80 2024-09-13T19:18:01.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.301+0000 7ff4c77fe640 1 -- 172.21.15.102:0/3320689451 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff5e80400e0 con 0x555d1faf9d80 2024-09-13T19:18:01.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.302+0000 7ff4c77fe640 1 --2- 172.21.15.102:0/3320689451 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff4c0036b40 0x7ff4c0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.302+0000 7ff4c77fe640 1 -- 172.21.15.102:0/3320689451 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7ff5e8031070 con 0x555d1faf9d80 2024-09-13T19:18:01.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.302+0000 7ff5f599c640 1 --2- 172.21.15.102:0/3320689451 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff4c0036b40 0x7ff4c0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.302+0000 7ff5f599c640 1 --2- 172.21.15.102:0/3320689451 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff4c0036b40 0x7ff4c0039000 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x555d1fad9df0 tx=0x7ff5f008e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.302+0000 7ff5fa215800 20 rados->read ofs=0 len=0 2024-09-13T19:18:01.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.302+0000 7ff5fa215800 1 --2- 172.21.15.102:0/3320689451 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x555d1fb0cd70 0x555d1fb0f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.302+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb0f980 con 0x555d1fb0cd70 2024-09-13T19:18:01.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.303+0000 7ff5f519b640 1 --2- 172.21.15.102:0/3320689451 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x555d1fb0cd70 0x555d1fb0f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.303+0000 7ff5f519b640 1 --2- 172.21.15.102:0/3320689451 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x555d1fb0cd70 0x555d1fb0f230 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.303+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff5e000f610 con 0x555d1fb0cd70 2024-09-13T19:18:01.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.303+0000 7ff5fa215800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:01.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.303+0000 7ff5fa215800 20 realm 2024-09-13T19:18:01.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.303+0000 7ff5fa215800 20 rados->read ofs=0 len=0 2024-09-13T19:18:01.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.303+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb0c1c0 con 0x555d1fb0cd70 2024-09-13T19:18:01.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.303+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff5e000f610 con 0x555d1fb0cd70 2024-09-13T19:18:01.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.303+0000 7ff5fa215800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:01.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.303+0000 7ff5fa215800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:18:01.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.303+0000 7ff5fa215800 20 rados->read ofs=0 len=0 2024-09-13T19:18:01.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.303+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb10470 con 0x555d1fb0cd70 2024-09-13T19:18:01.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.303+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff5e000f610 con 0x555d1fb0cd70 2024-09-13T19:18:01.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.303+0000 7ff5fa215800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:01.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.303+0000 7ff5fa215800 20 rados->read ofs=0 len=0 2024-09-13T19:18:01.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.303+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb10d40 con 0x555d1fb0cd70 2024-09-13T19:18:01.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.304+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff5e000f610 con 0x555d1fb0cd70 2024-09-13T19:18:01.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.304+0000 7ff5fa215800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:18:01.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.304+0000 7ff5fa215800 20 rados->read ofs=0 len=0 2024-09-13T19:18:01.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.304+0000 7ff5fa215800 1 --2- 172.21.15.102:0/3320689451 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x555d1fb11760 0x555d1fb13b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.304+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb14290 con 0x555d1fb11760 2024-09-13T19:18:01.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.304+0000 7ff5f619d640 1 --2- 172.21.15.102:0/3320689451 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x555d1fb11760 0x555d1fb13b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.304+0000 7ff5f619d640 1 --2- 172.21.15.102:0/3320689451 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x555d1fb11760 0x555d1fb13b50 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.304+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff5e803b030 con 0x555d1fb11760 2024-09-13T19:18:01.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.304+0000 7ff5fa215800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:18:01.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.304+0000 7ff5fa215800 20 searching for the correct realm 2024-09-13T19:18:01.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.304+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb15ba0 con 0x555d1fb11760 2024-09-13T19:18:01.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.305+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5e803b030 con 0x555d1fb11760 2024-09-13T19:18:01.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.305+0000 7ff5f619d640 1 --2- 172.21.15.102:0/3320689451 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7ff5e8050a10 0x7ff5e803b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.305+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7ff5e805b040 con 0x7ff5e8050a10 2024-09-13T19:18:01.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.305+0000 7ff5f599c640 1 --2- 172.21.15.102:0/3320689451 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7ff5e8050a10 0x7ff5e803b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.305+0000 7ff5f599c640 1 --2- 172.21.15.102:0/3320689451 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7ff5e8050a10 0x7ff5e803b720 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.305+0000 7ff5f599c640 1 -- 172.21.15.102:0/3320689451 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5f00a8040 con 0x7ff5e8050a10 2024-09-13T19:18:01.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.305+0000 7ff5f599c640 1 --2- 172.21.15.102:0/3320689451 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7ff5f009f040 0x7ff5f005a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.305+0000 7ff5f599c640 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7ff5e805b040 con 0x7ff5f009f040 2024-09-13T19:18:01.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.305+0000 7ff5f519b640 1 --2- 172.21.15.102:0/3320689451 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7ff5f009f040 0x7ff5f005a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.306+0000 7ff5f519b640 1 --2- 172.21.15.102:0/3320689451 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7ff5f009f040 0x7ff5f005a960 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.306+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5e000f610 con 0x7ff5f009f040 2024-09-13T19:18:01.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.306+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7ff5e805b040 con 0x555d1fb0cd70 2024-09-13T19:18:01.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.307+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5e000f610 con 0x555d1fb0cd70 2024-09-13T19:18:01.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.307+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7ff5e805b040 con 0x555d1fb0cd70 2024-09-13T19:18:01.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.307+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5e002b040 con 0x555d1fb0cd70 2024-09-13T19:18:01.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.307+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7ff5e805b040 con 0x7ff5f009f040 2024-09-13T19:18:01.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.307+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5e002b040 con 0x7ff5f009f040 2024-09-13T19:18:01.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.307+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7ff5e805b040 con 0x7ff5f009f040 2024-09-13T19:18:01.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.307+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5e002b040 con 0x7ff5f009f040 2024-09-13T19:18:01.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.307+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7ff5e805b040 con 0x7ff5e8050a10 2024-09-13T19:18:01.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.308+0000 7ff5f599c640 1 -- 172.21.15.102:0/3320689451 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5f00a8040 con 0x7ff5e8050a10 2024-09-13T19:18:01.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.308+0000 7ff5f599c640 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7ff5e805b040 con 0x555d1fb11760 2024-09-13T19:18:01.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.308+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5e803b030 con 0x555d1fb11760 2024-09-13T19:18:01.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.308+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7ff5e805b040 con 0x555d1fb0cd70 2024-09-13T19:18:01.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.308+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5e002b040 con 0x555d1fb0cd70 2024-09-13T19:18:01.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.308+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7ff5e805b040 con 0x7ff5e8050a10 2024-09-13T19:18:01.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.308+0000 7ff5f599c640 1 -- 172.21.15.102:0/3320689451 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5f00a8040 con 0x7ff5e8050a10 2024-09-13T19:18:01.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.308+0000 7ff5f599c640 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7ff5e805b040 con 0x555d1fb0cd70 2024-09-13T19:18:01.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.309+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5e002b040 con 0x555d1fb0cd70 2024-09-13T19:18:01.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.309+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7ff5e805b040 con 0x7ff5e8050a10 2024-09-13T19:18:01.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.309+0000 7ff5f599c640 1 -- 172.21.15.102:0/3320689451 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff5f00a8040 con 0x7ff5e8050a10 2024-09-13T19:18:01.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.309+0000 7ff5f599c640 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7ff5e805b040 con 0x555d1fb11760 2024-09-13T19:18:01.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.309+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5e803b030 con 0x555d1fb11760 2024-09-13T19:18:01.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.309+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7ff5e805b040 con 0x555d1fb11760 2024-09-13T19:18:01.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.309+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff5e803b030 con 0x555d1fb11760 2024-09-13T19:18:01.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.309+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7ff5e805b040 con 0x7ff5f009f040 2024-09-13T19:18:01.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.310+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5e002b040 con 0x7ff5f009f040 2024-09-13T19:18:01.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.310+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7ff5e805b040 con 0x555d1fb11760 2024-09-13T19:18:01.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.310+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff5e803b030 con 0x555d1fb11760 2024-09-13T19:18:01.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.310+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7ff5e805b040 con 0x555d1fb11760 2024-09-13T19:18:01.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.310+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5e803b030 con 0x555d1fb11760 2024-09-13T19:18:01.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.310+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7ff5e805b040 con 0x555d1fb0cd70 2024-09-13T19:18:01.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.310+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5e002b040 con 0x555d1fb0cd70 2024-09-13T19:18:01.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.310+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7ff5e805b040 con 0x555d1fb0cd70 2024-09-13T19:18:01.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.310+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff5e002b040 con 0x555d1fb0cd70 2024-09-13T19:18:01.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.310+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7ff5e805b040 con 0x7ff5f009f040 2024-09-13T19:18:01.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.311+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5e002b040 con 0x7ff5f009f040 2024-09-13T19:18:01.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.311+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7ff5e805b040 con 0x555d1fb11760 2024-09-13T19:18:01.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.311+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5e803b030 con 0x555d1fb11760 2024-09-13T19:18:01.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.311+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7ff5e805b040 con 0x7ff5e8050a10 2024-09-13T19:18:01.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.311+0000 7ff5f599c640 1 -- 172.21.15.102:0/3320689451 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5f00a8040 con 0x7ff5e8050a10 2024-09-13T19:18:01.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.311+0000 7ff5f599c640 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7ff5e805b040 con 0x555d1fb0cd70 2024-09-13T19:18:01.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.311+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5e002b040 con 0x555d1fb0cd70 2024-09-13T19:18:01.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.311+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7ff5e805b040 con 0x7ff5e8050a10 2024-09-13T19:18:01.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.312+0000 7ff5f599c640 1 -- 172.21.15.102:0/3320689451 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5f00a8040 con 0x7ff5e8050a10 2024-09-13T19:18:01.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.312+0000 7ff5f599c640 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7ff5e805b040 con 0x555d1fb11760 2024-09-13T19:18:01.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.312+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5e803b030 con 0x555d1fb11760 2024-09-13T19:18:01.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.312+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7ff5e805b040 con 0x7ff5f009f040 2024-09-13T19:18:01.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.313+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5e002b040 con 0x7ff5f009f040 2024-09-13T19:18:01.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.313+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7ff5e805b040 con 0x7ff5e8050a10 2024-09-13T19:18:01.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.313+0000 7ff5f599c640 1 -- 172.21.15.102:0/3320689451 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5f00a8040 con 0x7ff5e8050a10 2024-09-13T19:18:01.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.313+0000 7ff5f599c640 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7ff5e805b040 con 0x555d1fb11760 2024-09-13T19:18:01.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.313+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5e803b030 con 0x555d1fb11760 2024-09-13T19:18:01.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.313+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7ff5e805b040 con 0x7ff5f009f040 2024-09-13T19:18:01.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.314+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5e002b040 con 0x7ff5f009f040 2024-09-13T19:18:01.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.314+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7ff5e805b040 con 0x555d1fb0cd70 2024-09-13T19:18:01.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.314+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff5e002b040 con 0x555d1fb0cd70 2024-09-13T19:18:01.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.314+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7ff5e805b040 con 0x7ff5e8050a10 2024-09-13T19:18:01.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.314+0000 7ff5f599c640 1 -- 172.21.15.102:0/3320689451 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5f00a8040 con 0x7ff5e8050a10 2024-09-13T19:18:01.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.314+0000 7ff5fa215800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:18:01.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.314+0000 7ff5fa215800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:18:01.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.314+0000 7ff5fa215800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:18:01.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.314+0000 7ff5fa215800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:18:01.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.314+0000 7ff5fa215800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:18:01.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.314+0000 7ff5fa215800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:18:01.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.314+0000 7ff5fa215800 20 rados->read ofs=0 len=0 2024-09-13T19:18:01.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.314+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb15770 con 0x555d1fb0cd70 2024-09-13T19:18:01.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.314+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff5e002b040 con 0x555d1fb0cd70 2024-09-13T19:18:01.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.314+0000 7ff5fa215800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:01.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.314+0000 7ff5fa215800 20 rados->read ofs=0 len=0 2024-09-13T19:18:01.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.314+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb14fe0 con 0x555d1fb0cd70 2024-09-13T19:18:01.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.315+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff5e002b040 con 0x555d1fb0cd70 2024-09-13T19:18:01.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.315+0000 7ff5fa215800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:18:01.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.315+0000 7ff5fa215800 20 rados->read ofs=0 len=0 2024-09-13T19:18:01.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.315+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb16020 con 0x555d1fb11760 2024-09-13T19:18:01.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.315+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff5e803b030 con 0x555d1fb11760 2024-09-13T19:18:01.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.315+0000 7ff5fa215800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:18:01.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.315+0000 7ff5fa215800 20 zone default found 2024-09-13T19:18:01.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.315+0000 7ff5fa215800 4 Realm: () 2024-09-13T19:18:01.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.315+0000 7ff5fa215800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:18:01.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.315+0000 7ff5fa215800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:18:01.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.315+0000 7ff5fa215800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:18:01.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.315+0000 7ff5fa215800 20 zonegroup default 2024-09-13T19:18:01.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.315+0000 7ff5fa215800 20 rados->read ofs=0 len=0 2024-09-13T19:18:01.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.315+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb14c40 con 0x7ff5e8050a10 2024-09-13T19:18:01.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.315+0000 7ff5f599c640 1 -- 172.21.15.102:0/3320689451 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff5f00a8040 con 0x7ff5e8050a10 2024-09-13T19:18:01.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.315+0000 7ff5fa215800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:01.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.315+0000 7ff5fa215800 20 rados->read ofs=0 len=0 2024-09-13T19:18:01.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.315+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb187a0 con 0x555d1fb11760 2024-09-13T19:18:01.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.315+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff5e803b030 con 0x555d1fb11760 2024-09-13T19:18:01.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.315+0000 7ff5fa215800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:01.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.315+0000 7ff5fa215800 20 rados->read ofs=0 len=0 2024-09-13T19:18:01.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.316+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb187a0 con 0x555d1fb11760 2024-09-13T19:18:01.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.316+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff5e803b030 con 0x555d1fb11760 2024-09-13T19:18:01.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.316+0000 7ff5fa215800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:01.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.316+0000 7ff5fa215800 20 started sync module instance, tier type = 2024-09-13T19:18:01.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.316+0000 7ff5fa215800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:18:01.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.316+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb17be0 con 0x7ff5e8050a10 2024-09-13T19:18:01.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.317+0000 7ff5f599c640 1 -- 172.21.15.102:0/3320689451 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(44 notify.0 [create] v36'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5f00a8040 con 0x7ff5e8050a10 2024-09-13T19:18:01.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.317+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93858452045696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb18850 con 0x7ff5e8050a10 2024-09-13T19:18:01.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.317+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb190e0 con 0x555d1fb0cd70 2024-09-13T19:18:01.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.318+0000 7ff5f599c640 1 -- 172.21.15.102:0/3320689451 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93858452045696] v36'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5f00a8040 con 0x7ff5e8050a10 2024-09-13T19:18:01.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.318+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v36'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5e002b040 con 0x555d1fb0cd70 2024-09-13T19:18:01.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.318+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93858452046752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb19980 con 0x555d1fb0cd70 2024-09-13T19:18:01.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.318+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb1a340 con 0x555d1fb11760 2024-09-13T19:18:01.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.319+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93858452046752] v36'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5e002b040 con 0x555d1fb0cd70 2024-09-13T19:18:01.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.319+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v36'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5e803b030 con 0x555d1fb11760 2024-09-13T19:18:01.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.319+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93858452053648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb1a2b0 con 0x555d1fb11760 2024-09-13T19:18:01.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.319+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb1b200 con 0x7ff5e8050a10 2024-09-13T19:18:01.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.321+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93858452053648] v36'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5e803b030 con 0x555d1fb11760 2024-09-13T19:18:01.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.321+0000 7ff5f599c640 1 -- 172.21.15.102:0/3320689451 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(50 notify.3 [create] v36'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5f00a8040 con 0x7ff5e8050a10 2024-09-13T19:18:01.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.321+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93858452057424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb1b5a0 con 0x7ff5e8050a10 2024-09-13T19:18:01.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.321+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb1bfa0 con 0x555d1fb0cd70 2024-09-13T19:18:01.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.322+0000 7ff5f599c640 1 -- 172.21.15.102:0/3320689451 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93858452057424] v36'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5f00a8040 con 0x7ff5e8050a10 2024-09-13T19:18:01.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.323+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v36'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5e002b040 con 0x555d1fb0cd70 2024-09-13T19:18:01.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.323+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93858452055856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb1bf60 con 0x555d1fb0cd70 2024-09-13T19:18:01.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.323+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb1ca30 con 0x7ff5f009f040 2024-09-13T19:18:01.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.324+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93858452055856] v36'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5e002b040 con 0x555d1fb0cd70 2024-09-13T19:18:01.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.324+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(54 notify.5 [create] v36'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5e002b040 con 0x7ff5f009f040 2024-09-13T19:18:01.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.324+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93858452063584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb1bf60 con 0x7ff5f009f040 2024-09-13T19:18:01.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.324+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb1d4a0 con 0x7ff5f009f040 2024-09-13T19:18:01.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.325+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(56 notify.6 [create] v36'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5e002b040 con 0x7ff5f009f040 2024-09-13T19:18:01.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.325+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93858452066288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb1d900 con 0x7ff5f009f040 2024-09-13T19:18:01.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.325+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb1e410 con 0x7ff5f009f040 2024-09-13T19:18:01.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.325+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 93858452063584] v36'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5e002b040 con 0x7ff5f009f040 2024-09-13T19:18:01.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.326+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 93858452066288] v36'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5e002b040 con 0x7ff5f009f040 2024-09-13T19:18:01.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.326+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(58 notify.7 [create] v36'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5e002b040 con 0x7ff5f009f040 2024-09-13T19:18:01.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.326+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93858452070080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb1e3d0 con 0x7ff5f009f040 2024-09-13T19:18:01.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.327+0000 7ff5fa215800 20 add_watcher() i=0 2024-09-13T19:18:01.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.327+0000 7ff5fa215800 20 add_watcher() i=1 2024-09-13T19:18:01.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.327+0000 7ff5fa215800 20 add_watcher() i=2 2024-09-13T19:18:01.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.327+0000 7ff5fa215800 20 add_watcher() i=3 2024-09-13T19:18:01.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.327+0000 7ff5fa215800 20 add_watcher() i=4 2024-09-13T19:18:01.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.327+0000 7ff5fa215800 20 add_watcher() i=5 2024-09-13T19:18:01.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.327+0000 7ff5fa215800 20 add_watcher() i=6 2024-09-13T19:18:01.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.328+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 93858452070080] v36'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5e002b040 con 0x7ff5f009f040 2024-09-13T19:18:01.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.328+0000 7ff5fa215800 20 add_watcher() i=7 2024-09-13T19:18:01.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.328+0000 7ff5fa215800 2 all 8 watchers are set, enabling cache 2024-09-13T19:18:01.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.328+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb1d410 con 0x555d1fb0cd70 2024-09-13T19:18:01.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.328+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff5e002b040 con 0x555d1fb0cd70 2024-09-13T19:18:01.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.328+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93858452060848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb1d410 con 0x555d1fb0cd70 2024-09-13T19:18:01.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.329+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93858452060848] v36'232 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff5e002b040 con 0x555d1fb0cd70 2024-09-13T19:18:01.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.329+0000 7ff4a77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:18:01.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.329+0000 7ff5fa215800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:18:01.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.329+0000 7ff5fa215800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:18:01.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.329+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb29d70 con 0x555d1fb0cd70 2024-09-13T19:18:01.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.330+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v36'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff5e002b040 con 0x555d1fb0cd70 2024-09-13T19:18:01.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.330+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb2a3c0 con 0x7ff5f009f040 2024-09-13T19:18:01.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.332+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v36'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff5e002b040 con 0x7ff5f009f040 2024-09-13T19:18:01.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.332+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb2a800 con 0x555d1fb11760 2024-09-13T19:18:01.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.332+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v36'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff5e803b030 con 0x555d1fb11760 2024-09-13T19:18:01.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.332+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb2a650 con 0x555d1fb0cd70 2024-09-13T19:18:01.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.333+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v36'233 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff5e002b040 con 0x555d1fb0cd70 2024-09-13T19:18:01.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.333+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb2a7c0 con 0x7ff5e8050a10 2024-09-13T19:18:01.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.334+0000 7ff5f599c640 1 -- 172.21.15.102:0/3320689451 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v36'76 uv55 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff5f00a8040 con 0x7ff5e8050a10 2024-09-13T19:18:01.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.334+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb2acc0 con 0x555d1fb11760 2024-09-13T19:18:01.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.335+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v36'50 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff5e803b030 con 0x555d1fb11760 2024-09-13T19:18:01.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.335+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb2acc0 con 0x555d1fb0cd70 2024-09-13T19:18:01.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.336+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v36'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff5e002b040 con 0x555d1fb0cd70 2024-09-13T19:18:01.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.336+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb2acc0 con 0x7ff5f009f040 2024-09-13T19:18:01.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.338+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(69 gc.7 [create,call,call,call] v36'49 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff5e002b040 con 0x7ff5f009f040 2024-09-13T19:18:01.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.338+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb2adf0 con 0x7ff5e8050a10 2024-09-13T19:18:01.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.339+0000 7ff5f599c640 1 -- 172.21.15.102:0/3320689451 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v36'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff5f00a8040 con 0x7ff5e8050a10 2024-09-13T19:18:01.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.339+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb2b250 con 0x555d1fb11760 2024-09-13T19:18:01.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.340+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v36'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff5e803b030 con 0x555d1fb11760 2024-09-13T19:18:01.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.340+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb2b250 con 0x7ff5e8050a10 2024-09-13T19:18:01.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.341+0000 7ff5f599c640 1 -- 172.21.15.102:0/3320689451 <== osd.2 v2:172.21.15.102:6816/2238176080 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v36'77 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5f00a8040 con 0x7ff5e8050a10 2024-09-13T19:18:01.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.341+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb2b250 con 0x7ff5f009f040 2024-09-13T19:18:01.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.342+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v36'35 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5e002b040 con 0x7ff5f009f040 2024-09-13T19:18:01.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.342+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb2b250 con 0x7ff5e8050a10 2024-09-13T19:18:01.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.343+0000 7ff5f599c640 1 -- 172.21.15.102:0/3320689451 <== osd.2 v2:172.21.15.102:6816/2238176080 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v36'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5f00a8040 con 0x7ff5e8050a10 2024-09-13T19:18:01.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.343+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb2b250 con 0x7ff5f009f040 2024-09-13T19:18:01.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.344+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(75 gc.13 [create,call,call,call] v36'55 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5e002b040 con 0x7ff5f009f040 2024-09-13T19:18:01.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.344+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb2b250 con 0x555d1fb0cd70 2024-09-13T19:18:01.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.345+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v36'234 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5e002b040 con 0x555d1fb0cd70 2024-09-13T19:18:01.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.345+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb2b250 con 0x555d1fb11760 2024-09-13T19:18:01.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.347+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v36'68 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5e803b030 con 0x555d1fb11760 2024-09-13T19:18:01.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.347+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb2b250 con 0x7ff5e8050a10 2024-09-13T19:18:01.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.347+0000 7ff5f599c640 1 -- 172.21.15.102:0/3320689451 <== osd.2 v2:172.21.15.102:6816/2238176080 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v36'78 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5f00a8040 con 0x7ff5e8050a10 2024-09-13T19:18:01.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.348+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb2b250 con 0x555d1fb11760 2024-09-13T19:18:01.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.348+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v36'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5e803b030 con 0x555d1fb11760 2024-09-13T19:18:01.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.349+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb2b250 con 0x555d1fb0cd70 2024-09-13T19:18:01.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.350+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v36'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5e002b040 con 0x555d1fb0cd70 2024-09-13T19:18:01.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.350+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb2b250 con 0x555d1fb0cd70 2024-09-13T19:18:01.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.351+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v36'235 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5e002b040 con 0x555d1fb0cd70 2024-09-13T19:18:01.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.351+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb2b250 con 0x555d1fb11760 2024-09-13T19:18:01.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.352+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v36'69 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5e803b030 con 0x555d1fb11760 2024-09-13T19:18:01.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.352+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb2b250 con 0x7ff5e8050a10 2024-09-13T19:18:01.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.353+0000 7ff5f599c640 1 -- 172.21.15.102:0/3320689451 <== osd.2 v2:172.21.15.102:6816/2238176080 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v36'38 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5f00a8040 con 0x7ff5e8050a10 2024-09-13T19:18:01.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.353+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb2b250 con 0x555d1fb11760 2024-09-13T19:18:01.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.354+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v36'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5e803b030 con 0x555d1fb11760 2024-09-13T19:18:01.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.354+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb2b250 con 0x555d1fb11760 2024-09-13T19:18:01.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.354+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v36'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5e803b030 con 0x555d1fb11760 2024-09-13T19:18:01.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.355+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb2b250 con 0x555d1fb11760 2024-09-13T19:18:01.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.355+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v36'24 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5e803b030 con 0x555d1fb11760 2024-09-13T19:18:01.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.355+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb2b250 con 0x555d1fb11760 2024-09-13T19:18:01.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.356+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v36'51 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5e803b030 con 0x555d1fb11760 2024-09-13T19:18:01.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.356+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb2b250 con 0x7ff5f009f040 2024-09-13T19:18:01.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.358+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(88 gc.26 [create,call,call,call] v36'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5e002b040 con 0x7ff5f009f040 2024-09-13T19:18:01.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.358+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb2b250 con 0x555d1fb11760 2024-09-13T19:18:01.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.359+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v36'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5e803b030 con 0x555d1fb11760 2024-09-13T19:18:01.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.359+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb2b250 con 0x7ff5f009f040 2024-09-13T19:18:01.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.360+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(90 gc.28 [create,call,call,call] v36'50 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5e002b040 con 0x7ff5f009f040 2024-09-13T19:18:01.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.360+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb2b250 con 0x555d1fb11760 2024-09-13T19:18:01.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.361+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v36'70 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5e803b030 con 0x555d1fb11760 2024-09-13T19:18:01.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.361+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb2b250 con 0x7ff5f009f040 2024-09-13T19:18:01.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.362+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.0 v2:172.21.15.53:6800/4021716951 20 ==== osd_op_reply(92 gc.30 [create,call,call,call] v36'56 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5e002b040 con 0x7ff5f009f040 2024-09-13T19:18:01.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.362+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb2b250 con 0x7ff5e8050a10 2024-09-13T19:18:01.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.363+0000 7ff5f599c640 1 -- 172.21.15.102:0/3320689451 <== osd.2 v2:172.21.15.102:6816/2238176080 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v36'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5f00a8040 con 0x7ff5e8050a10 2024-09-13T19:18:01.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.363+0000 7ff4a67fc640 20 reqs_thread_entry: start 2024-09-13T19:18:01.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.363+0000 7ff5fa215800 20 init_complete bucket index max shards: 11 2024-09-13T19:18:01.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.363+0000 7ff5fa215800 20 Filter name: none 2024-09-13T19:18:01.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.363+0000 7ff417fff640 20 reqs_thread_entry: start 2024-09-13T19:18:01.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.364+0000 7ff5fa215800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:18:01.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.364+0000 7ff5fa215800 20 rados->read ofs=0 len=0 2024-09-13T19:18:01.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.364+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb562b0 con 0x555d1fb0cd70 2024-09-13T19:18:01.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.364+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff5e002b040 con 0x555d1fb0cd70 2024-09-13T19:18:01.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.364+0000 7ff5fa215800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:18:01.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.364+0000 7ff5fa215800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:18:01.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.364+0000 7ff5fa215800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:18:01.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.364+0000 7ff5fa215800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:18:01.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.364+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb56260 con 0x7ff5e8050a10 2024-09-13T19:18:01.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.364+0000 7ff5f599c640 1 -- 172.21.15.102:0/3320689451 <== osd.2 v2:172.21.15.102:6816/2238176080 21 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv51 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7ff5f00a8040 con 0x7ff5e8050a10 2024-09-13T19:18:01.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.364+0000 7ff5fa215800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.7 : miss 2024-09-13T19:18:01.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.364+0000 7ff5fa215800 20 rados->read ofs=0 len=0 2024-09-13T19:18:01.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.364+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:96 8.1c 8:3f9b1c5d:root::.bucket.meta.myfoo%3a509740b4-c081-4f37-bd6d-df9ca851489b.4237.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb589d0 con 0x555d1fb11760 2024-09-13T19:18:01.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.365+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 28 ==== osd_op_reply(96 .bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.7 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7ff5e803b030 con 0x555d1fb11760 2024-09-13T19:18:01.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.365+0000 7ff5fa215800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:18:01.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.365+0000 7ff5fa215800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.7 info.flags=0x17 2024-09-13T19:18:01.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.365+0000 7ff5fa215800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.7 to cache LRU end 2024-09-13T19:18:01.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.365+0000 7ff5fa215800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:18:01.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.365+0000 7ff5fa215800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:18:01.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.365+0000 7ff5fa215800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.7 2024-09-13T19:18:01.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.365+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:97 4.c 4:301ad357:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fbd60d0 con 0x555d1fb0cd70 2024-09-13T19:18:01.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.365+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.1 v2:172.21.15.102:6808/2204418452 28 ==== osd_op_reply(97 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff5e002b040 con 0x555d1fb0cd70 2024-09-13T19:18:01.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.365+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:98 4.34 4:2e1fe9ca:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fbd6110 con 0x7ff5e8050a10 2024-09-13T19:18:01.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.366+0000 7ff5f599c640 1 -- 172.21.15.102:0/3320689451 <== osd.2 v2:172.21.15.102:6816/2238176080 22 ==== osd_op_reply(98 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff5f00a8040 con 0x7ff5e8050a10 2024-09-13T19:18:01.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.366+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:99 4.d 4:b3034e48:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fbd6110 con 0x555d1fb11760 2024-09-13T19:18:01.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.366+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 29 ==== osd_op_reply(99 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff5e803b030 con 0x555d1fb11760 2024-09-13T19:18:01.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.366+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:100 4.8 4:1372367c:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fbd6110 con 0x7ff5e8050a10 2024-09-13T19:18:01.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.366+0000 7ff5f599c640 1 -- 172.21.15.102:0/3320689451 <== osd.2 v2:172.21.15.102:6816/2238176080 23 ==== osd_op_reply(100 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.3 [call out=85b] v0'0 uv15 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff5f00a8040 con 0x7ff5e8050a10 2024-09-13T19:18:01.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.366+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:101 4.2 4:419cddd9:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fbd6110 con 0x555d1fb0cd70 2024-09-13T19:18:01.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.367+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.1 v2:172.21.15.102:6808/2204418452 29 ==== osd_op_reply(101 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.4 [call out=426b] v0'0 uv11 ondisk = 0) ==== 194+0+426 (crc 0 0 0) 0x7ff5e002b040 con 0x555d1fb0cd70 2024-09-13T19:18:01.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.367+0000 7ff5fa215800 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2024-09-13T19:18:01.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.367+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:102 4.24 4:26b250f9:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fbd6150 con 0x7ff5f009f040 2024-09-13T19:18:01.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.367+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.0 v2:172.21.15.53:6800/4021716951 21 ==== osd_op_reply(102 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff5e002b040 con 0x7ff5f009f040 2024-09-13T19:18:01.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.367+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:103 4.16 4:6bbbc537:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fbd6150 con 0x555d1fb11760 2024-09-13T19:18:01.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.367+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 30 ==== osd_op_reply(103 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff5e803b030 con 0x555d1fb11760 2024-09-13T19:18:01.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.367+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:104 4.15 4:aa97c99e:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fbd6150 con 0x555d1fb11760 2024-09-13T19:18:01.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.368+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 31 ==== osd_op_reply(104 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff5e803b030 con 0x555d1fb11760 2024-09-13T19:18:01.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.368+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:105 4.5 4:a0a6993f:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fbd6150 con 0x555d1fb11760 2024-09-13T19:18:01.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.368+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 32 ==== osd_op_reply(105 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff5e803b030 con 0x555d1fb11760 2024-09-13T19:18:01.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.368+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:106 4.39 4:9f9ccebe:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fbd6110 con 0x555d1fb11760 2024-09-13T19:18:01.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.368+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 33 ==== osd_op_reply(106 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff5e8074060 con 0x555d1fb11760 2024-09-13T19:18:01.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.368+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:107 4.15 4:ab1ca9be:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fbd6110 con 0x555d1fb11760 2024-09-13T19:18:01.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.369+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 34 ==== osd_op_reply(107 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.10 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff5e8074060 con 0x555d1fb11760 2024-09-13T19:18:01.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.369+0000 7ff5fa215800 20 get_obj_state: octx=0x7ff5f000a4d0 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x555d1fbd4158 s->prefetch_data=0 2024-09-13T19:18:01.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.369+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:108 3.18s0 3:18b9ef97:::509740b4-c081-4f37-bd6d-df9ca851489b.4237.7_15f6f8dc036519d7fe15b39338f6e5db:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fbd4fe0 con 0x555d1fb11760 2024-09-13T19:18:01.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.369+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 35 ==== osd_op_reply(108 509740b4-c081-4f37-bd6d-df9ca851489b.4237.7_15f6f8dc036519d7fe15b39338f6e5db [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7ff5e8074060 con 0x555d1fb11760 2024-09-13T19:18:01.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.369+0000 7ff5fa215800 10 manifest: total_size = 6 2024-09-13T19:18:01.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.369+0000 7ff5fa215800 20 get_obj_state: setting s->obj_tag to 509740b4-c081-4f37-bd6d-df9ca851489b.4237.13506434066821330579 2024-09-13T19:18:01.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.369+0000 7ff5fa215800 20 get_obj_state: octx=0x7ff5f000a4d0 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x555d1fbd4158 s->prefetch_data=0 2024-09-13T19:18:01.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.369+0000 7ff5fa215800 20 prepare_atomic_modification: state is not atomic. state=0x555d1fbd4158 2024-09-13T19:18:01.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.369+0000 7ff5fa215800 20 bucket index object: :.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.4 2024-09-13T19:18:01.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.369+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:109 4.2 4:419cddd9:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fbd5a00 con 0x555d1fb0cd70 2024-09-13T19:18:01.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.370+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.1 v2:172.21.15.102:6808/2204418452 30 ==== osd_op_reply(109 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.4 [stat,call,call] v36'12 uv12 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7ff5e002b040 con 0x555d1fb0cd70 2024-09-13T19:18:01.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.370+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:110 3.18s0 3:18b9ef97:::509740b4-c081-4f37-bd6d-df9ca851489b.4237.7_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fbd5a00 con 0x555d1fb11760 2024-09-13T19:18:01.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.372+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 36 ==== osd_op_reply(110 509740b4-c081-4f37-bd6d-df9ca851489b.4237.7_15f6f8dc036519d7fe15b39338f6e5db [call] v36'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7ff5e8074060 con 0x555d1fb11760 2024-09-13T19:18:01.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.372+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:111 4.2 4:419cddd9:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb5d760 con 0x555d1fb0cd70 2024-09-13T19:18:01.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.372+0000 7ff5fa215800 20 list_objects_ordered: starting attempt 1 2024-09-13T19:18:01.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.372+0000 7ff5fa215800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-13T19:18:01.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.372+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:112 4.c 4:301ad357:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb5f100 con 0x555d1fb0cd70 2024-09-13T19:18:01.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.372+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:113 4.34 4:2e1fe9ca:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb5f100 con 0x7ff5e8050a10 2024-09-13T19:18:01.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.372+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:114 4.d 4:b3034e48:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb5f100 con 0x555d1fb11760 2024-09-13T19:18:01.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.372+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:115 4.8 4:1372367c:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb5f100 con 0x7ff5e8050a10 2024-09-13T19:18:01.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.372+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:116 4.2 4:419cddd9:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb68870 con 0x555d1fb0cd70 2024-09-13T19:18:01.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.372+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:117 4.24 4:26b250f9:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb6b490 con 0x7ff5f009f040 2024-09-13T19:18:01.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.372+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:118 4.16 4:6bbbc537:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb6dfa0 con 0x555d1fb11760 2024-09-13T19:18:01.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.372+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:119 4.15 4:aa97c99e:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb70900 con 0x555d1fb11760 2024-09-13T19:18:01.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.372+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:120 4.5 4:a0a6993f:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb73370 con 0x555d1fb11760 2024-09-13T19:18:01.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.372+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:121 4.39 4:9f9ccebe:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb75c60 con 0x555d1fb11760 2024-09-13T19:18:01.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.372+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:122 4.15 4:ab1ca9be:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb78740 con 0x555d1fb11760 2024-09-13T19:18:01.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.373+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.1 v2:172.21.15.102:6808/2204418452 31 ==== osd_op_reply(112 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff5e002b040 con 0x555d1fb0cd70 2024-09-13T19:18:01.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.373+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.0 v2:172.21.15.53:6800/4021716951 22 ==== osd_op_reply(117 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff5e002b040 con 0x7ff5f009f040 2024-09-13T19:18:01.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.373+0000 7ff5f599c640 1 -- 172.21.15.102:0/3320689451 <== osd.2 v2:172.21.15.102:6816/2238176080 24 ==== osd_op_reply(113 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff5f00a8040 con 0x7ff5e8050a10 2024-09-13T19:18:01.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.373+0000 7ff5f599c640 1 -- 172.21.15.102:0/3320689451 <== osd.2 v2:172.21.15.102:6816/2238176080 25 ==== osd_op_reply(115 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.3 [call out=85b] v0'0 uv15 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff5f00a8040 con 0x7ff5e8050a10 2024-09-13T19:18:01.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.373+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 37 ==== osd_op_reply(114 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff5e8074060 con 0x555d1fb11760 2024-09-13T19:18:01.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.373+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 38 ==== osd_op_reply(121 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff5e8074060 con 0x555d1fb11760 2024-09-13T19:18:01.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.373+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 39 ==== osd_op_reply(119 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff5e8074060 con 0x555d1fb11760 2024-09-13T19:18:01.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.373+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 40 ==== osd_op_reply(118 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff5e8074060 con 0x555d1fb11760 2024-09-13T19:18:01.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.373+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 41 ==== osd_op_reply(120 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff5e8074060 con 0x555d1fb11760 2024-09-13T19:18:01.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.373+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 42 ==== osd_op_reply(122 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.10 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff5e8074060 con 0x555d1fb11760 2024-09-13T19:18:01.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.373+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.1 v2:172.21.15.102:6808/2204418452 32 ==== osd_op_reply(111 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.4 [stat,call,call] v36'13 uv13 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7ff5e002b040 con 0x555d1fb0cd70 2024-09-13T19:18:01.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.373+0000 7ff4d8ff9640 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2024-09-13T19:18:01.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.373+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.1 v2:172.21.15.102:6808/2204418452 33 ==== osd_op_reply(116 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.4 [call out=124b] v0'0 uv13 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7ff5e002b040 con 0x555d1fb0cd70 2024-09-13T19:18:01.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.373+0000 7ff5fa215800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-13T19:18:01.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.373+0000 7ff5fa215800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-13T19:18:01.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.373+0000 7ff5fa215800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-13T19:18:01.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.373+0000 7ff5fa215800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-13T19:18:01.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.374+0000 7ff5fa215800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[509740b4-c081-4f37-bd6d-df9ca851489b.4237.7])"; uploads.size()=0; is_truncated=0 2024-09-13T19:18:01.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.374+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:123 4.c 4:301ad357:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb5d760 con 0x555d1fb0cd70 2024-09-13T19:18:01.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.374+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:124 4.34 4:2e1fe9ca:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb6e2a0 con 0x7ff5e8050a10 2024-09-13T19:18:01.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.374+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:125 4.d 4:b3034e48:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb71220 con 0x555d1fb11760 2024-09-13T19:18:01.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.374+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:126 4.8 4:1372367c:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb72ad0 con 0x7ff5e8050a10 2024-09-13T19:18:01.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.374+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:127 4.2 4:419cddd9:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb757b0 con 0x555d1fb0cd70 2024-09-13T19:18:01.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.374+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:128 4.24 4:26b250f9:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb5d760 con 0x7ff5f009f040 2024-09-13T19:18:01.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.374+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:129 4.16 4:6bbbc537:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb6e2a0 con 0x555d1fb11760 2024-09-13T19:18:01.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.374+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:130 4.15 4:aa97c99e:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb71220 con 0x555d1fb11760 2024-09-13T19:18:01.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.374+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:131 4.5 4:a0a6993f:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb72ad0 con 0x555d1fb11760 2024-09-13T19:18:01.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.374+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:132 4.39 4:9f9ccebe:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb6e2a0 con 0x555d1fb11760 2024-09-13T19:18:01.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.374+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:133 4.15 4:ab1ca9be:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb71220 con 0x555d1fb11760 2024-09-13T19:18:01.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.374+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.1 v2:172.21.15.102:6808/2204418452 34 ==== osd_op_reply(123 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff5e002b040 con 0x555d1fb0cd70 2024-09-13T19:18:01.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.374+0000 7ff5f599c640 1 -- 172.21.15.102:0/3320689451 <== osd.2 v2:172.21.15.102:6816/2238176080 26 ==== osd_op_reply(124 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff5f00a8040 con 0x7ff5e8050a10 2024-09-13T19:18:01.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.374+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.1 v2:172.21.15.102:6808/2204418452 35 ==== osd_op_reply(127 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.4 [call out=124b] v0'0 uv13 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7ff5e002b040 con 0x555d1fb0cd70 2024-09-13T19:18:01.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.374+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 43 ==== osd_op_reply(125 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff5e8074060 con 0x555d1fb11760 2024-09-13T19:18:01.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.374+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 44 ==== osd_op_reply(129 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff5e8074060 con 0x555d1fb11760 2024-09-13T19:18:01.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.374+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 45 ==== osd_op_reply(130 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff5e8074060 con 0x555d1fb11760 2024-09-13T19:18:01.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.374+0000 7ff5f599c640 1 -- 172.21.15.102:0/3320689451 <== osd.2 v2:172.21.15.102:6816/2238176080 27 ==== osd_op_reply(126 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.3 [call out=85b] v0'0 uv15 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff5f00a8040 con 0x7ff5e8050a10 2024-09-13T19:18:01.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.374+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.0 v2:172.21.15.53:6800/4021716951 23 ==== osd_op_reply(128 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff5e002b040 con 0x7ff5f009f040 2024-09-13T19:18:01.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.374+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 46 ==== osd_op_reply(131 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff5e8074060 con 0x555d1fb11760 2024-09-13T19:18:01.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.374+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 47 ==== osd_op_reply(132 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff5e8074060 con 0x555d1fb11760 2024-09-13T19:18:01.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.374+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 48 ==== osd_op_reply(133 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.10 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff5e8074060 con 0x555d1fb11760 2024-09-13T19:18:01.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.374+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:134 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb6e210 con 0x7ff5e8050a10 2024-09-13T19:18:01.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.376+0000 7ff5f599c640 1 -- 172.21.15.102:0/3320689451 <== osd.2 v2:172.21.15.102:6816/2238176080 28 ==== osd_op_reply(134 foo.buckets [call] v36'54 uv54 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7ff5f00a8040 con 0x7ff5e8050a10 2024-09-13T19:18:01.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.376+0000 7ff5fa215800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T19:18:01.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.376+0000 7ff5fa215800 20 rados->read ofs=0 len=0 2024-09-13T19:18:01.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.376+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb6e210 con 0x7ff5e8050a10 2024-09-13T19:18:01.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.376+0000 7ff5f599c640 1 -- 172.21.15.102:0/3320689451 <== osd.2 v2:172.21.15.102:6816/2238176080 29 ==== osd_op_reply(135 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv48 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7ff5f00a8040 con 0x7ff5e8050a10 2024-09-13T19:18:01.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.376+0000 7ff5fa215800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:18:01.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.376+0000 7ff5fa215800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T19:18:01.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.376+0000 7ff5fa215800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:18:01.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.376+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:136 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb6e210 con 0x7ff5e8050a10 2024-09-13T19:18:01.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.377+0000 7ff5f599c640 1 -- 172.21.15.102:0/3320689451 <== osd.2 v2:172.21.15.102:6816/2238176080 30 ==== osd_op_reply(136 myfoo [call,call,delete] v36'55 uv55 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7ff5f00a8040 con 0x7ff5e8050a10 2024-09-13T19:18:01.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.377+0000 7ff5fa215800 10 removing default.rgw.meta+root+myfoo from cache 2024-09-13T19:18:01.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.377+0000 7ff5fa215800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T19:18:01.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.377+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:137 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93858452398608 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb70d70 con 0x7ff5f009f040 2024-09-13T19:18:01.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.378+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.0 v2:172.21.15.53:6800/4021716951 24 ==== watch-notify(notify (1) cookie 93858452066288 notify 154618822694 ret 0) ==== 191+0+0 (crc 0 0 0) 0x555d1fb2a3c0 con 0x7ff5f009f040 2024-09-13T19:18:01.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.378+0000 7ff4d97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822694 cookie 93858452066288 notifier 4790 bl.length()=149 2024-09-13T19:18:01.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.378+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.0 v2:172.21.15.53:6800/4021716951 25 ==== osd_op_reply(137 notify.6 [notify cookie 93858452398608 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff5e002b040 con 0x7ff5f009f040 2024-09-13T19:18:01.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.378+0000 7ff4d97fa640 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:138 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7ff4b8003d60 con 0x7ff5f009f040 2024-09-13T19:18:01.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.378+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.0 v2:172.21.15.53:6800/4021716951 26 ==== osd_op_reply(138 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5e002b040 con 0x7ff5f009f040 2024-09-13T19:18:01.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.378+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.0 v2:172.21.15.53:6800/4021716951 27 ==== watch-notify(notify_complete (2) cookie 93858452398608 notify 154618822694 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555d1fb29d30 con 0x7ff5f009f040 2024-09-13T19:18:01.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.378+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:139 8.1c 8:3f9b1c5d:root::.bucket.meta.myfoo%3a509740b4-c081-4f37-bd6d-df9ca851489b.4237.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb6e210 con 0x555d1fb11760 2024-09-13T19:18:01.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.379+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 49 ==== osd_op_reply(139 .bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.7 [call,call,delete] v36'4 uv4 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7ff5e8074060 con 0x555d1fb11760 2024-09-13T19:18:01.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.379+0000 7ff5fa215800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.7 from cache 2024-09-13T19:18:01.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.379+0000 7ff5fa215800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:509740b4-c081-4f37-bd6d-df9ca851489b.4237.7, ofs0, ns] 2024-09-13T19:18:01.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.379+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:140 7.d 7:b4812045:::notify.4:head [notify cookie 93858452418272 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb6e210 con 0x555d1fb0cd70 2024-09-13T19:18:01.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.379+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.1 v2:172.21.15.102:6808/2204418452 36 ==== watch-notify(notify (1) cookie 93858452055856 notify 154618822689 ret 0) ==== 248+0+0 (crc 0 0 0) 0x555d1fb29d30 con 0x555d1fb0cd70 2024-09-13T19:18:01.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.379+0000 7ff4d8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822689 cookie 93858452055856 notifier 4790 bl.length()=206 2024-09-13T19:18:01.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.379+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.1 v2:172.21.15.102:6808/2204418452 37 ==== osd_op_reply(140 notify.4 [notify cookie 93858452418272 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff5e002b040 con 0x555d1fb0cd70 2024-09-13T19:18:01.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.379+0000 7ff4d8ff9640 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:141 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7ff4200032c0 con 0x555d1fb0cd70 2024-09-13T19:18:01.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.380+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.1 v2:172.21.15.102:6808/2204418452 38 ==== watch-notify(notify_complete (2) cookie 93858452418272 notify 154618822689 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555d1fb2a110 con 0x555d1fb0cd70 2024-09-13T19:18:01.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.380+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.1 v2:172.21.15.102:6808/2204418452 39 ==== osd_op_reply(141 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5e002b040 con 0x555d1fb0cd70 2024-09-13T19:18:01.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.380+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:142 4.c 4:301ad357:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb6e210 con 0x555d1fb0cd70 2024-09-13T19:18:01.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.380+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:143 4.34 4:2e1fe9ca:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb70d70 con 0x7ff5e8050a10 2024-09-13T19:18:01.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.380+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:144 4.d 4:b3034e48:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb5d720 con 0x555d1fb11760 2024-09-13T19:18:01.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.380+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:145 4.8 4:1372367c:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb71190 con 0x7ff5e8050a10 2024-09-13T19:18:01.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.380+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:146 4.2 4:419cddd9:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb577f0 con 0x555d1fb0cd70 2024-09-13T19:18:01.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.380+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:147 4.24 4:26b250f9:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb70d70 con 0x7ff5f009f040 2024-09-13T19:18:01.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.380+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:148 4.16 4:6bbbc537:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb6e210 con 0x555d1fb11760 2024-09-13T19:18:01.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.380+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:149 4.15 4:aa97c99e:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb5e0f0 con 0x555d1fb11760 2024-09-13T19:18:01.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.380+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:150 4.5 4:a0a6993f:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb71190 con 0x555d1fb11760 2024-09-13T19:18:01.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.380+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:151 4.39 4:9f9ccebe:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb71610 con 0x555d1fb11760 2024-09-13T19:18:01.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.380+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:152 4.15 4:ab1ca9be:::.dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb577f0 con 0x555d1fb11760 2024-09-13T19:18:01.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.382+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.0 v2:172.21.15.53:6800/4021716951 28 ==== osd_op_reply(147 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.5 [delete] v36'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff5e002b040 con 0x7ff5f009f040 2024-09-13T19:18:01.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.382+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.1 v2:172.21.15.102:6808/2204418452 40 ==== osd_op_reply(146 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.4 [delete] v36'14 uv14 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff5e002b040 con 0x555d1fb0cd70 2024-09-13T19:18:01.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.382+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 50 ==== osd_op_reply(148 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.6 [delete] v36'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff5e8074060 con 0x555d1fb11760 2024-09-13T19:18:01.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.382+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 51 ==== osd_op_reply(144 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.2 [delete] v36'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff5e8074060 con 0x555d1fb11760 2024-09-13T19:18:01.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.382+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 52 ==== osd_op_reply(149 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.7 [delete] v36'5 uv5 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff5e8074060 con 0x555d1fb11760 2024-09-13T19:18:01.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.382+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 53 ==== osd_op_reply(151 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.9 [delete] v36'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff5e8074060 con 0x555d1fb11760 2024-09-13T19:18:01.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.382+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 54 ==== osd_op_reply(152 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.10 [delete] v36'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7ff5e8074060 con 0x555d1fb11760 2024-09-13T19:18:01.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.382+0000 7ff5f599c640 1 -- 172.21.15.102:0/3320689451 <== osd.2 v2:172.21.15.102:6816/2238176080 31 ==== osd_op_reply(143 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.1 [delete] v36'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff5f00a8040 con 0x7ff5e8050a10 2024-09-13T19:18:01.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.382+0000 7ff5f599c640 1 -- 172.21.15.102:0/3320689451 <== osd.2 v2:172.21.15.102:6816/2238176080 32 ==== osd_op_reply(145 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.3 [delete] v36'16 uv16 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff5f00a8040 con 0x7ff5e8050a10 2024-09-13T19:18:01.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.382+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.1 v2:172.21.15.102:6808/2204418452 41 ==== osd_op_reply(142 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.0 [delete] v36'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff5e002b040 con 0x555d1fb0cd70 2024-09-13T19:18:01.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.382+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 55 ==== osd_op_reply(150 .dir.509740b4-c081-4f37-bd6d-df9ca851489b.4237.7.8 [delete] v36'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff5e8074060 con 0x555d1fb11760 2024-09-13T19:18:01.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.382+0000 7ff5fa215800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/509740b4-c081-4f37-bd6d-df9ca851489b.4237.7 : miss 2024-09-13T19:18:01.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.382+0000 7ff5fa215800 20 rados->read ofs=0 len=0 2024-09-13T19:18:01.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.382+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:153 6.1a 6:5a93ff3f:::pubsub..bucket.myfoo%2f509740b4-c081-4f37-bd6d-df9ca851489b.4237.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb582a0 con 0x555d1fb11760 2024-09-13T19:18:01.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.383+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 56 ==== osd_op_reply(153 pubsub..bucket.myfoo/509740b4-c081-4f37-bd6d-df9ca851489b.4237.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7ff5e8074060 con 0x555d1fb11760 2024-09-13T19:18:01.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.383+0000 7ff5fa215800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:01.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.383+0000 7ff5fa215800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/509740b4-c081-4f37-bd6d-df9ca851489b.4237.7 info.flags=0x0 2024-09-13T19:18:01.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.383+0000 7ff5fa215800 10 adding default.rgw.log++pubsub..bucket.myfoo/509740b4-c081-4f37-bd6d-df9ca851489b.4237.7 to cache LRU end 2024-09-13T19:18:01.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.383+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:154 6.1a 6:5a93ff3f:::pubsub..bucket.myfoo%2f509740b4-c081-4f37-bd6d-df9ca851489b.4237.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb582a0 con 0x555d1fb11760 2024-09-13T19:18:01.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.384+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 57 ==== osd_op_reply(154 pubsub..bucket.myfoo/509740b4-c081-4f37-bd6d-df9ca851489b.4237.7 [delete] v36'30 uv28 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7ff5e8074060 con 0x555d1fb11760 2024-09-13T19:18:01.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.384+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:155 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb582a0 con 0x7ff5e8050a10 2024-09-13T19:18:01.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.385+0000 7ff5f599c640 1 -- 172.21.15.102:0/3320689451 <== osd.2 v2:172.21.15.102:6816/2238176080 33 ==== osd_op_reply(155 foo.buckets [call] v36'56 uv56 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7ff5f00a8040 con 0x7ff5e8050a10 2024-09-13T19:18:01.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.385+0000 7ff5fa215800 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2024-09-13T19:18:01.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.385+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:156 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb72ee0 con 0x7ff5f009f040 2024-09-13T19:18:01.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.386+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.0 v2:172.21.15.53:6800/4021716951 29 ==== osd_op_reply(156 9te6NH5mcdcq0Tc5i8i1 [delete] v36'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7ff5e002b040 con 0x7ff5f009f040 2024-09-13T19:18:01.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.386+0000 7ff5fa215800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-13T19:18:01.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.386+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:157 7.e 7:7759931f:::notify.3:head [notify cookie 93858452308640 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb57840 con 0x7ff5e8050a10 2024-09-13T19:18:01.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.386+0000 7ff5f599c640 1 -- 172.21.15.102:0/3320689451 <== osd.2 v2:172.21.15.102:6816/2238176080 34 ==== watch-notify(notify (1) cookie 93858452057424 notify 154618822677 ret 0) ==== 212+0+0 (crc 0 0 0) 0x555d1fb2b610 con 0x7ff5e8050a10 2024-09-13T19:18:01.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.386+0000 7ff4d8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822677 cookie 93858452057424 notifier 4790 bl.length()=170 2024-09-13T19:18:01.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.386+0000 7ff4d8ff9640 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:158 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7ff4200032c0 con 0x7ff5e8050a10 2024-09-13T19:18:01.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.386+0000 7ff5f599c640 1 -- 172.21.15.102:0/3320689451 <== osd.2 v2:172.21.15.102:6816/2238176080 35 ==== osd_op_reply(157 notify.3 [notify cookie 93858452308640 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff5f00a8040 con 0x7ff5e8050a10 2024-09-13T19:18:01.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.386+0000 7ff5f599c640 1 -- 172.21.15.102:0/3320689451 <== osd.2 v2:172.21.15.102:6816/2238176080 36 ==== watch-notify(notify_complete (2) cookie 93858452308640 notify 154618822677 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7ff5f00b5040 con 0x7ff5e8050a10 2024-09-13T19:18:01.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.386+0000 7ff5fa215800 10 removing email index: foo@foo.com 2024-09-13T19:18:01.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.386+0000 7ff5f599c640 1 -- 172.21.15.102:0/3320689451 <== osd.2 v2:172.21.15.102:6816/2238176080 37 ==== osd_op_reply(158 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5f00a8040 con 0x7ff5e8050a10 2024-09-13T19:18:01.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.386+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:159 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb72ee0 con 0x555d1fb0cd70 2024-09-13T19:18:01.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.387+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.1 v2:172.21.15.102:6808/2204418452 42 ==== osd_op_reply(159 foo@foo.com [delete] v36'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7ff5e002b040 con 0x555d1fb0cd70 2024-09-13T19:18:01.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.387+0000 7ff5fa215800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-13T19:18:01.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.387+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:160 7.e 7:7759931f:::notify.3:head [notify cookie 93858452308640 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb57840 con 0x7ff5e8050a10 2024-09-13T19:18:01.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.388+0000 7ff5f599c640 1 -- 172.21.15.102:0/3320689451 <== osd.2 v2:172.21.15.102:6816/2238176080 38 ==== watch-notify(notify (1) cookie 93858452057424 notify 154618822678 ret 0) ==== 204+0+0 (crc 0 0 0) 0x7ff5f00b5040 con 0x7ff5e8050a10 2024-09-13T19:18:01.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.388+0000 7ff4d97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822678 cookie 93858452057424 notifier 4790 bl.length()=162 2024-09-13T19:18:01.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.388+0000 7ff4d97fa640 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:161 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7ff4b8003d60 con 0x7ff5e8050a10 2024-09-13T19:18:01.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.388+0000 7ff5f599c640 1 -- 172.21.15.102:0/3320689451 <== osd.2 v2:172.21.15.102:6816/2238176080 39 ==== osd_op_reply(160 notify.3 [notify cookie 93858452308640 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff5f00a8040 con 0x7ff5e8050a10 2024-09-13T19:18:01.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.388+0000 7ff5f599c640 1 -- 172.21.15.102:0/3320689451 <== osd.2 v2:172.21.15.102:6816/2238176080 40 ==== osd_op_reply(161 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5f00a8040 con 0x7ff5e8050a10 2024-09-13T19:18:01.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.388+0000 7ff5f599c640 1 -- 172.21.15.102:0/3320689451 <== osd.2 v2:172.21.15.102:6816/2238176080 41 ==== watch-notify(notify_complete (2) cookie 93858452308640 notify 154618822678 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555d1fad2e70 con 0x7ff5e8050a10 2024-09-13T19:18:01.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.388+0000 7ff5fa215800 10 removing user buckets index 2024-09-13T19:18:01.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.388+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:162 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb72ee0 con 0x7ff5e8050a10 2024-09-13T19:18:01.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.389+0000 7ff5f599c640 1 -- 172.21.15.102:0/3320689451 <== osd.2 v2:172.21.15.102:6816/2238176080 42 ==== osd_op_reply(162 foo.buckets [delete] v36'57 uv57 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7ff5f00a8040 con 0x7ff5e8050a10 2024-09-13T19:18:01.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.389+0000 7ff5fa215800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2024-09-13T19:18:01.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.389+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 93858452308640 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb72ee0 con 0x7ff5f009f040 2024-09-13T19:18:01.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.390+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.0 v2:172.21.15.53:6800/4021716951 30 ==== watch-notify(notify (1) cookie 93858452063584 notify 154618822695 ret 0) ==== 202+0+0 (crc 0 0 0) 0x555d1fb2a110 con 0x7ff5f009f040 2024-09-13T19:18:01.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.390+0000 7ff4d8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822695 cookie 93858452063584 notifier 4790 bl.length()=160 2024-09-13T19:18:01.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.390+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.0 v2:172.21.15.53:6800/4021716951 31 ==== osd_op_reply(163 notify.5 [notify cookie 93858452308640 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff5e002b040 con 0x7ff5f009f040 2024-09-13T19:18:01.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.390+0000 7ff4d8ff9640 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7ff4200032c0 con 0x7ff5f009f040 2024-09-13T19:18:01.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.390+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.0 v2:172.21.15.53:6800/4021716951 32 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5e002b040 con 0x7ff5f009f040 2024-09-13T19:18:01.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.390+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.0 v2:172.21.15.53:6800/4021716951 33 ==== watch-notify(notify_complete (2) cookie 93858452308640 notify 154618822695 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555d1fb28570 con 0x7ff5f009f040 2024-09-13T19:18:01.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.390+0000 7ff5fa215800 10 removing user index: foo 2024-09-13T19:18:01.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.390+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:165 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb57840 con 0x555d1fb0cd70 2024-09-13T19:18:01.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.391+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.1 v2:172.21.15.102:6808/2204418452 43 ==== osd_op_reply(165 foo [call,call,delete] v36'19 uv19 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7ff5e002b040 con 0x555d1fb0cd70 2024-09-13T19:18:01.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.391+0000 7ff5fa215800 10 removing default.rgw.meta+users.uid+foo from cache 2024-09-13T19:18:01.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.391+0000 7ff5fa215800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T19:18:01.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.391+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:166 7.d 7:b4812045:::notify.4:head [notify cookie 93858452308640 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb72ee0 con 0x555d1fb0cd70 2024-09-13T19:18:01.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.391+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.1 v2:172.21.15.102:6808/2204418452 44 ==== watch-notify(notify (1) cookie 93858452055856 notify 154618822690 ret 0) ==== 194+0+0 (crc 0 0 0) 0x555d1fb28570 con 0x555d1fb0cd70 2024-09-13T19:18:01.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.391+0000 7ff4d97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822690 cookie 93858452055856 notifier 4790 bl.length()=152 2024-09-13T19:18:01.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.391+0000 7ff4d97fa640 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:167 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7ff4b8003d60 con 0x555d1fb0cd70 2024-09-13T19:18:01.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.391+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.1 v2:172.21.15.102:6808/2204418452 45 ==== osd_op_reply(166 notify.4 [notify cookie 93858452308640 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff5e002b040 con 0x555d1fb0cd70 2024-09-13T19:18:01.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.392+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.1 v2:172.21.15.102:6808/2204418452 46 ==== watch-notify(notify_complete (2) cookie 93858452308640 notify 154618822690 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7ff5e0018040 con 0x555d1fb0cd70 2024-09-13T19:18:01.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.392+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.1 v2:172.21.15.102:6808/2204418452 47 ==== osd_op_reply(167 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5e002b040 con 0x555d1fb0cd70 2024-09-13T19:18:01.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.392+0000 7ff4a77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:18:01.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.392+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:168 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93858452060848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb27c20 con 0x555d1fb0cd70 2024-09-13T19:18:01.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.393+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.1 v2:172.21.15.102:6808/2204418452 48 ==== osd_op_reply(168 data_loggenerations_metadata [watch unwatch cookie 93858452060848] v36'236 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff5e002b040 con 0x555d1fb0cd70 2024-09-13T19:18:01.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.394+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:169 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93858452045696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb1bab0 con 0x7ff5e8050a10 2024-09-13T19:18:01.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.394+0000 7ff5f599c640 1 -- 172.21.15.102:0/3320689451 <== osd.2 v2:172.21.15.102:6816/2238176080 43 ==== osd_op_reply(169 notify.0 [watch unwatch cookie 93858452045696] v36'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5f00a8040 con 0x7ff5e8050a10 2024-09-13T19:18:01.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.394+0000 7ff5fa215800 20 remove_watcher() i=0 2024-09-13T19:18:01.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.394+0000 7ff5fa215800 2 removed watcher, disabling cache 2024-09-13T19:18:01.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.395+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:170 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93858452046752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb1bab0 con 0x555d1fb0cd70 2024-09-13T19:18:01.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.396+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.1 v2:172.21.15.102:6808/2204418452 49 ==== osd_op_reply(170 notify.1 [watch unwatch cookie 93858452046752] v36'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5e002b040 con 0x555d1fb0cd70 2024-09-13T19:18:01.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.396+0000 7ff5fa215800 20 remove_watcher() i=1 2024-09-13T19:18:01.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.396+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:171 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93858452053648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb1bab0 con 0x555d1fb11760 2024-09-13T19:18:01.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.397+0000 7ff5f619d640 1 -- 172.21.15.102:0/3320689451 <== osd.3 v2:172.21.15.102:6800/3096737090 58 ==== osd_op_reply(171 notify.2 [watch unwatch cookie 93858452053648] v36'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5e8074060 con 0x555d1fb11760 2024-09-13T19:18:01.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.397+0000 7ff5fa215800 20 remove_watcher() i=2 2024-09-13T19:18:01.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.397+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:172 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93858452057424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb1bab0 con 0x7ff5e8050a10 2024-09-13T19:18:01.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.398+0000 7ff5f599c640 1 -- 172.21.15.102:0/3320689451 <== osd.2 v2:172.21.15.102:6816/2238176080 44 ==== osd_op_reply(172 notify.3 [watch unwatch cookie 93858452057424] v36'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5f00a8040 con 0x7ff5e8050a10 2024-09-13T19:18:01.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.398+0000 7ff5fa215800 20 remove_watcher() i=3 2024-09-13T19:18:01.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.398+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:173 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93858452055856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb1ad50 con 0x555d1fb0cd70 2024-09-13T19:18:01.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.399+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.1 v2:172.21.15.102:6808/2204418452 50 ==== osd_op_reply(173 notify.4 [watch unwatch cookie 93858452055856] v36'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5e002b040 con 0x555d1fb0cd70 2024-09-13T19:18:01.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.399+0000 7ff5fa215800 20 remove_watcher() i=4 2024-09-13T19:18:01.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.399+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:174 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93858452063584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb1bab0 con 0x7ff5f009f040 2024-09-13T19:18:01.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.400+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.0 v2:172.21.15.53:6800/4021716951 34 ==== osd_op_reply(174 notify.5 [watch unwatch cookie 93858452063584] v36'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5e002b040 con 0x7ff5f009f040 2024-09-13T19:18:01.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.400+0000 7ff5fa215800 20 remove_watcher() i=5 2024-09-13T19:18:01.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.400+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:175 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93858452066288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb1a730 con 0x7ff5f009f040 2024-09-13T19:18:01.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.401+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.0 v2:172.21.15.53:6800/4021716951 35 ==== osd_op_reply(175 notify.6 [watch unwatch cookie 93858452066288] v36'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5e002b040 con 0x7ff5f009f040 2024-09-13T19:18:01.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.401+0000 7ff5fa215800 20 remove_watcher() i=6 2024-09-13T19:18:01.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.401+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:176 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93858452070080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555d1fb1c560 con 0x7ff5f009f040 2024-09-13T19:18:01.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.402+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 <== osd.0 v2:172.21.15.53:6800/4021716951 36 ==== osd_op_reply(176 notify.7 [watch unwatch cookie 93858452070080] v36'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5e002b040 con 0x7ff5f009f040 2024-09-13T19:18:01.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.402+0000 7ff5fa215800 20 remove_watcher() i=7 2024-09-13T19:18:01.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.402+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7ff5f009f040 msgr2=0x7ff5f005a960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.402+0000 7ff5fa215800 1 --2- 172.21.15.102:0/3320689451 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7ff5f009f040 0x7ff5f005a960 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.402+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x555d1fb0cd70 msgr2=0x555d1fb0f230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.402+0000 7ff5fa215800 1 --2- 172.21.15.102:0/3320689451 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x555d1fb0cd70 0x555d1fb0f230 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.402+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7ff5e8050a10 msgr2=0x7ff5e803b720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.402+0000 7ff5fa215800 1 --2- 172.21.15.102:0/3320689451 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7ff5e8050a10 0x7ff5e803b720 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.402+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x555d1fb11760 msgr2=0x555d1fb13b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.402+0000 7ff5fa215800 1 --2- 172.21.15.102:0/3320689451 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x555d1fb11760 0x555d1fb13b50 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.403+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff4c0036b40 msgr2=0x7ff4c0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.403+0000 7ff5fa215800 1 --2- 172.21.15.102:0/3320689451 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff4c0036b40 0x7ff4c0039000 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x555d1fad9df0 tx=0x7ff5f008e000 comp rx=0 tx=0).stop 2024-09-13T19:18:01.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.403+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d1faf9d80 msgr2=0x555d1fb01230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.403+0000 7ff5f519b640 1 -- 172.21.15.102:0/3320689451 reap_dead start 2024-09-13T19:18:01.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.403+0000 7ff5fa215800 1 --2- 172.21.15.102:0/3320689451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d1faf9d80 0x555d1fb01230 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7ff5e8020520 tx=0x7ff5e804cda0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.403+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 shutdown_connections 2024-09-13T19:18:01.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.403+0000 7ff5fa215800 1 --2- 172.21.15.102:0/3320689451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d1faf9d80 0x555d1fb01230 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.403+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 >> 172.21.15.102:0/3320689451 conn(0x555d1faf60e0 msgr2=0x555d1faf41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:01.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.403+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 shutdown_connections 2024-09-13T19:18:01.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.403+0000 7ff5fa215800 1 -- 172.21.15.102:0/3320689451 wait complete. 2024-09-13T19:18:01.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.403+0000 7ff5fa215800 1 -- 172.21.15.102:0/986261933 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff4d0036b40 msgr2=0x7ff4d0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.403+0000 7ff5fa215800 1 --2- 172.21.15.102:0/986261933 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff4d0036b40 0x7ff4d0039000 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff5f008f870 tx=0x7ff5f008f2f0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.403+0000 7ff5fa215800 1 -- 172.21.15.102:0/986261933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d1faed060 msgr2=0x555d1faed480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.403+0000 7ff5fa215800 1 --2- 172.21.15.102:0/986261933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d1faed060 0x555d1faed480 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x555d1fad3460 tx=0x7ff5e80167b0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.403+0000 7ff5fa215800 1 -- 172.21.15.102:0/986261933 shutdown_connections 2024-09-13T19:18:01.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.403+0000 7ff5fa215800 1 --2- 172.21.15.102:0/986261933 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff4d0036b40 0x7ff4d0039000 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.403+0000 7ff5fa215800 1 --2- 172.21.15.102:0/986261933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d1faed060 0x555d1faed480 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.403+0000 7ff5fa215800 1 -- 172.21.15.102:0/986261933 >> 172.21.15.102:0/986261933 conn(0x555d1fae1ff0 msgr2=0x555d1fae4b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:01.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.403+0000 7ff5fa215800 1 -- 172.21.15.102:0/986261933 shutdown_connections 2024-09-13T19:18:01.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.403+0000 7ff5fa215800 1 -- 172.21.15.102:0/986261933 wait complete. 2024-09-13T19:18:01.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.403+0000 7ff5fa215800 1 -- 172.21.15.102:0/2261059812 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x555d1f9deb40 msgr2=0x555d1fad9420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.403+0000 7ff5fa215800 1 --2- 172.21.15.102:0/2261059812 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x555d1f9deb40 0x555d1fad9420 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.403+0000 7ff5fa215800 1 -- 172.21.15.102:0/2261059812 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x555d1fadbcd0 msgr2=0x555d1fade0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.403+0000 7ff5fa215800 1 --2- 172.21.15.102:0/2261059812 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x555d1fadbcd0 0x555d1fade0c0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.404+0000 7ff5fa215800 1 -- 172.21.15.102:0/2261059812 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff4dc036b40 msgr2=0x7ff4dc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.404+0000 7ff5fa215800 1 --2- 172.21.15.102:0/2261059812 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff4dc036b40 0x7ff4dc039000 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff5e0000f60 tx=0x7ff5e0001370 comp rx=0 tx=0).stop 2024-09-13T19:18:01.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.404+0000 7ff5fa215800 1 -- 172.21.15.102:0/2261059812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d1f94ce10 msgr2=0x555d1fad23b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.404+0000 7ff5fa215800 1 --2- 172.21.15.102:0/2261059812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d1f94ce10 0x555d1fad23b0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0067040 tx=0x7ff5f0002fb0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.404+0000 7ff5fa215800 1 -- 172.21.15.102:0/2261059812 shutdown_connections 2024-09-13T19:18:01.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.404+0000 7ff5fa215800 1 --2- 172.21.15.102:0/2261059812 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x555d1fadbcd0 0x555d1fade0c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.404+0000 7ff5fa215800 1 --2- 172.21.15.102:0/2261059812 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x555d1f9deb40 0x555d1fad9420 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.404+0000 7ff5fa215800 1 --2- 172.21.15.102:0/2261059812 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff4dc036b40 0x7ff4dc039000 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.404+0000 7ff5fa215800 1 --2- 172.21.15.102:0/2261059812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d1f94ce10 0x555d1fad23b0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.404+0000 7ff5fa215800 1 -- 172.21.15.102:0/2261059812 >> 172.21.15.102:0/2261059812 conn(0x555d1f9d3dd0 msgr2=0x555d1fac4cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:01.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.404+0000 7ff5fa215800 1 -- 172.21.15.102:0/2261059812 shutdown_connections 2024-09-13T19:18:01.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.404+0000 7ff5fa215800 1 -- 172.21.15.102:0/2261059812 wait complete. 2024-09-13T19:18:01.415 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T19:18:01.415 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T19:18:01.415 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T19:18:01.459 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:18:01.459 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:18:01.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.457+0000 7f529772c800 1 Processor -- start 2024-09-13T19:18:01.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.457+0000 7f529772c800 1 -- start start 2024-09-13T19:18:01.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.457+0000 7f529772c800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55a128cc3760 0x55a128cc3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.457+0000 7f529772c800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a128b82b30 con 0x55a128cc40a0 2024-09-13T19:18:01.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.457+0000 7f529772c800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55a128b64360 con 0x55a128cc3760 2024-09-13T19:18:01.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.457+0000 7f529336b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55a128cc3760 0x55a128cc3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.457+0000 7f528ab6a640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55a128cc40a0 0x55a128cc8ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:53624/0 (socket says 172.21.15.102:53624) 2024-09-13T19:18:01.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.457+0000 7f528ab6a640 1 -- 172.21.15.102:0/1250550041 learned_addr learned my addr 172.21.15.102:0/1250550041 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:18:01.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.457+0000 7f529336b640 1 -- 172.21.15.102:0/1250550041 >> v1:172.21.15.53:6789/0 conn(0x55a128cc40a0 legacy=0x55a128cc8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.457+0000 7f529336b640 1 -- 172.21.15.102:0/1250550041 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a128b8ae00 con 0x55a128cc3760 2024-09-13T19:18:01.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.459+0000 7f529336b640 1 --2- 172.21.15.102:0/1250550041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a128cc3760 0x55a128cc3b60 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f528400a470 tx=0x7f5284045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b21dc1e7b6d6474f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.459+0000 7f5292b6a640 1 -- 172.21.15.102:0/1250550041 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5284053570 con 0x55a128cc3760 2024-09-13T19:18:01.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.459+0000 7f5292b6a640 1 -- 172.21.15.102:0/1250550041 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5284058070 con 0x55a128cc3760 2024-09-13T19:18:01.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.459+0000 7f5292b6a640 1 -- 172.21.15.102:0/1250550041 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5284053880 con 0x55a128cc3760 2024-09-13T19:18:01.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.460+0000 7f529772c800 1 -- 172.21.15.102:0/1250550041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a128cc3760 msgr2=0x55a128cc3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.460+0000 7f529772c800 1 --2- 172.21.15.102:0/1250550041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a128cc3760 0x55a128cc3b60 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f528400a470 tx=0x7f5284045a20 comp rx=0 tx=0).stop 2024-09-13T19:18:01.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.460+0000 7f529772c800 1 -- 172.21.15.102:0/1250550041 shutdown_connections 2024-09-13T19:18:01.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.460+0000 7f529772c800 1 --2- 172.21.15.102:0/1250550041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a128cc3760 0x55a128cc3b60 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.460+0000 7f529772c800 1 -- 172.21.15.102:0/1250550041 >> 172.21.15.102:0/1250550041 conn(0x55a128cbeff0 msgr2=0x55a128cc1410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:01.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.460+0000 7f529772c800 1 -- 172.21.15.102:0/1250550041 shutdown_connections 2024-09-13T19:18:01.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.460+0000 7f529772c800 1 -- 172.21.15.102:0/1250550041 wait complete. 2024-09-13T19:18:01.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.474+0000 7f529772c800 1 Processor -- start 2024-09-13T19:18:01.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.474+0000 7f529772c800 1 -- start start 2024-09-13T19:18:01.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.474+0000 7f529772c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a128cc3760 0x55a128db28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.474+0000 7f529772c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a128c0f330 con 0x55a128cc3760 2024-09-13T19:18:01.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.474+0000 7f529336b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a128cc3760 0x55a128db28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.474+0000 7f529336b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a128cc3760 0x55a128db28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49258/0 (socket says 172.21.15.102:49258) 2024-09-13T19:18:01.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.474+0000 7f529336b640 1 -- 172.21.15.102:0/299802406 learned_addr learned my addr 172.21.15.102:0/299802406 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:01.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.475+0000 7f529336b640 1 -- 172.21.15.102:0/299802406 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a128b5cbc0 con 0x55a128cc3760 2024-09-13T19:18:01.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.475+0000 7f529336b640 1 --2- 172.21.15.102:0/299802406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a128cc3760 0x55a128db28a0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f5284025c20 tx=0x7f5284051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32e7173c77b16480 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.475+0000 7f518160a640 1 -- 172.21.15.102:0/299802406 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f528405c580 con 0x55a128cc3760 2024-09-13T19:18:01.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.475+0000 7f518160a640 1 -- 172.21.15.102:0/299802406 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5284063030 con 0x55a128cc3760 2024-09-13T19:18:01.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.475+0000 7f518160a640 1 -- 172.21.15.102:0/299802406 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f528405c850 con 0x55a128cc3760 2024-09-13T19:18:01.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.476+0000 7f529772c800 1 -- 172.21.15.102:0/299802406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a128cc3760 msgr2=0x55a128db28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.476+0000 7f529772c800 1 --2- 172.21.15.102:0/299802406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a128cc3760 0x55a128db28a0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f5284025c20 tx=0x7f5284051000 comp rx=0 tx=0).stop 2024-09-13T19:18:01.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.476+0000 7f529772c800 1 -- 172.21.15.102:0/299802406 shutdown_connections 2024-09-13T19:18:01.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.476+0000 7f529772c800 1 --2- 172.21.15.102:0/299802406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a128cc3760 0x55a128db28a0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.476+0000 7f529772c800 1 -- 172.21.15.102:0/299802406 >> 172.21.15.102:0/299802406 conn(0x55a128cbeff0 msgr2=0x55a128dae260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:01.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.476+0000 7f529772c800 1 -- 172.21.15.102:0/299802406 shutdown_connections 2024-09-13T19:18:01.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.476+0000 7f529772c800 1 -- 172.21.15.102:0/299802406 wait complete. 2024-09-13T19:18:01.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.476+0000 7f529772c800 1 Processor -- start 2024-09-13T19:18:01.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.476+0000 7f529772c800 1 -- start start 2024-09-13T19:18:01.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.476+0000 7f529772c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a128cc3760 0x55a128dba230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.476+0000 7f529772c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a128cca640 con 0x55a128cc3760 2024-09-13T19:18:01.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.476+0000 7f529336b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a128cc3760 0x55a128dba230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.477+0000 7f529336b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a128cc3760 0x55a128dba230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49272/0 (socket says 172.21.15.102:49272) 2024-09-13T19:18:01.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.477+0000 7f529336b640 1 -- 172.21.15.102:0/2151782168 learned_addr learned my addr 172.21.15.102:0/2151782168 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:01.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.477+0000 7f529336b640 1 -- 172.21.15.102:0/2151782168 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a128b70fe0 con 0x55a128cc3760 2024-09-13T19:18:01.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.477+0000 7f529336b640 1 --2- 172.21.15.102:0/2151782168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a128cc3760 0x55a128dba230 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x55a128db3700 tx=0x7f5284002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.477+0000 7f517fe07640 1 -- 172.21.15.102:0/2151782168 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5284054ad0 con 0x55a128cc3760 2024-09-13T19:18:01.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.477+0000 7f517fe07640 1 -- 172.21.15.102:0/2151782168 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5284054c70 con 0x55a128cc3760 2024-09-13T19:18:01.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.477+0000 7f529772c800 1 -- 172.21.15.102:0/2151782168 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a128dba770 con 0x55a128cc3760 2024-09-13T19:18:01.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.477+0000 7f517fe07640 1 -- 172.21.15.102:0/2151782168 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5284068420 con 0x55a128cc3760 2024-09-13T19:18:01.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.477+0000 7f529772c800 1 -- 172.21.15.102:0/2151782168 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a128dbac90 con 0x55a128cc3760 2024-09-13T19:18:01.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.478+0000 7f517fe07640 1 -- 172.21.15.102:0/2151782168 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f52840685c0 con 0x55a128cc3760 2024-09-13T19:18:01.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.478+0000 7f517fe07640 1 --2- 172.21.15.102:0/2151782168 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5178036b40 0x7f5178039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.478+0000 7f517fe07640 1 -- 172.21.15.102:0/2151782168 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f5284070030 con 0x55a128cc3760 2024-09-13T19:18:01.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.478+0000 7f528ab6a640 1 --2- 172.21.15.102:0/2151782168 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5178036b40 0x7f5178039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.478+0000 7f529772c800 1 --2- 172.21.15.102:0/2151782168 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55a128cc40a0 0x55a128dc12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.478+0000 7f529772c800 1 -- 172.21.15.102:0/2151782168 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a128dc1870 con 0x55a128cc40a0 2024-09-13T19:18:01.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.479+0000 7f5293b6c640 1 --2- 172.21.15.102:0/2151782168 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55a128cc40a0 0x55a128dc12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.479+0000 7f528ab6a640 1 --2- 172.21.15.102:0/2151782168 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5178036b40 0x7f5178039000 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f527c000f60 tx=0x7f527c0012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.479+0000 7f5293b6c640 1 --2- 172.21.15.102:0/2151782168 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55a128cc40a0 0x55a128dc12a0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.479+0000 7f5293b6c640 1 -- 172.21.15.102:0/2151782168 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f528c00a4a0 con 0x55a128cc40a0 2024-09-13T19:18:01.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.479+0000 7f529772c800 1 -- 172.21.15.102:0/2151782168 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a128dbe870 con 0x55a128cc40a0 2024-09-13T19:18:01.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.479+0000 7f5293b6c640 1 -- 172.21.15.102:0/2151782168 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f528c00a4a0 con 0x55a128cc40a0 2024-09-13T19:18:01.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.479+0000 7f529772c800 1 --2- 172.21.15.102:0/2151782168 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55a128dc3bd0 0x55a128dc5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.479+0000 7f529772c800 1 -- 172.21.15.102:0/2151782168 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a128dc66b0 con 0x55a128dc3bd0 2024-09-13T19:18:01.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.479+0000 7f529336b640 1 --2- 172.21.15.102:0/2151782168 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55a128dc3bd0 0x55a128dc5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.480+0000 7f529336b640 1 --2- 172.21.15.102:0/2151782168 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55a128dc3bd0 0x55a128dc5fc0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.480+0000 7f529336b640 1 -- 172.21.15.102:0/2151782168 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5284051070 con 0x55a128dc3bd0 2024-09-13T19:18:01.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.480+0000 7f529772c800 1 -- 172.21.15.102:0/2151782168 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a128dc2a70 con 0x55a128cc40a0 2024-09-13T19:18:01.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.480+0000 7f5293b6c640 1 -- 172.21.15.102:0/2151782168 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f528c00a4a0 con 0x55a128cc40a0 2024-09-13T19:18:01.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.480+0000 7f529772c800 1 -- 172.21.15.102:0/2151782168 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a128dc2f10 con 0x55a128dc3bd0 2024-09-13T19:18:01.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.481+0000 7f529336b640 1 -- 172.21.15.102:0/2151782168 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5284051070 con 0x55a128dc3bd0 2024-09-13T19:18:01.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.481+0000 7f529772c800 1 Processor -- start 2024-09-13T19:18:01.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.481+0000 7f529772c800 1 -- start start 2024-09-13T19:18:01.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.481+0000 7f529772c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a128dd5020 0x55a128dd5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.481+0000 7f529772c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a128b5e580 con 0x55a128dd5020 2024-09-13T19:18:01.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.481+0000 7f5293b6c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a128dd5020 0x55a128dd5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.481+0000 7f5293b6c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a128dd5020 0x55a128dd5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49278/0 (socket says 172.21.15.102:49278) 2024-09-13T19:18:01.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.481+0000 7f5293b6c640 1 -- 172.21.15.102:0/3890242190 learned_addr learned my addr 172.21.15.102:0/3890242190 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:01.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.482+0000 7f5293b6c640 1 -- 172.21.15.102:0/3890242190 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a128dd5980 con 0x55a128dd5020 2024-09-13T19:18:01.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.482+0000 7f5293b6c640 1 --2- 172.21.15.102:0/3890242190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a128dd5020 0x55a128dd5440 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x55a128dbb450 tx=0x7f528c0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.482+0000 7f517d602640 1 -- 172.21.15.102:0/3890242190 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f528c013640 con 0x55a128dd5020 2024-09-13T19:18:01.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.482+0000 7f517d602640 1 -- 172.21.15.102:0/3890242190 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f528c0137e0 con 0x55a128dd5020 2024-09-13T19:18:01.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.482+0000 7f529772c800 1 -- 172.21.15.102:0/3890242190 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a128dd5c10 con 0x55a128dd5020 2024-09-13T19:18:01.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.482+0000 7f517d602640 1 -- 172.21.15.102:0/3890242190 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f528c013ae0 con 0x55a128dd5020 2024-09-13T19:18:01.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.482+0000 7f529772c800 1 -- 172.21.15.102:0/3890242190 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a128dd88f0 con 0x55a128dd5020 2024-09-13T19:18:01.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.483+0000 7f517d602640 1 -- 172.21.15.102:0/3890242190 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f528c011040 con 0x55a128dd5020 2024-09-13T19:18:01.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.483+0000 7f517d602640 1 --2- 172.21.15.102:0/3890242190 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f516c036b90 0x7f516c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.483+0000 7f517d602640 1 -- 172.21.15.102:0/3890242190 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f528c00e040 con 0x55a128dd5020 2024-09-13T19:18:01.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.483+0000 7f529336b640 1 --2- 172.21.15.102:0/3890242190 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f516c036b90 0x7f516c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.483+0000 7f529772c800 1 Processor -- start 2024-09-13T19:18:01.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.483+0000 7f529336b640 1 --2- 172.21.15.102:0/3890242190 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f516c036b90 0x7f516c039050 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x55a128dc2a40 tx=0x7f5284060ee0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.484+0000 7f529772c800 1 -- start start 2024-09-13T19:18:01.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.484+0000 7f529772c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a128de1cc0 0x55a128de20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.484+0000 7f529772c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a128db2ff0 con 0x55a128de1cc0 2024-09-13T19:18:01.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.484+0000 7f5293b6c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a128de1cc0 0x55a128de20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.484+0000 7f5293b6c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a128de1cc0 0x55a128de20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49288/0 (socket says 172.21.15.102:49288) 2024-09-13T19:18:01.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.484+0000 7f5293b6c640 1 -- 172.21.15.102:0/2892271976 learned_addr learned my addr 172.21.15.102:0/2892271976 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:01.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.484+0000 7f5293b6c640 1 -- 172.21.15.102:0/2892271976 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a128de2690 con 0x55a128de1cc0 2024-09-13T19:18:01.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.484+0000 7f5293b6c640 1 --2- 172.21.15.102:0/2892271976 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a128de1cc0 0x55a128de20c0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f528c00b010 tx=0x7f528c020460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48d600bb903d7a02 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.484+0000 7f5176ffd640 1 -- 172.21.15.102:0/2892271976 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f528c014c10 con 0x55a128de1cc0 2024-09-13T19:18:01.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.484+0000 7f5176ffd640 1 -- 172.21.15.102:0/2892271976 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f528c02a910 con 0x55a128de1cc0 2024-09-13T19:18:01.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.484+0000 7f5176ffd640 1 -- 172.21.15.102:0/2892271976 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f528c02a3f0 con 0x55a128de1cc0 2024-09-13T19:18:01.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.485+0000 7f529772c800 1 -- 172.21.15.102:0/2892271976 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a128de1cc0 msgr2=0x55a128de20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.485+0000 7f529772c800 1 --2- 172.21.15.102:0/2892271976 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a128de1cc0 0x55a128de20c0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f528c00b010 tx=0x7f528c020460 comp rx=0 tx=0).stop 2024-09-13T19:18:01.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.485+0000 7f529772c800 1 -- 172.21.15.102:0/2892271976 shutdown_connections 2024-09-13T19:18:01.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.485+0000 7f529772c800 1 --2- 172.21.15.102:0/2892271976 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a128de1cc0 0x55a128de20c0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.485+0000 7f529772c800 1 -- 172.21.15.102:0/2892271976 >> 172.21.15.102:0/2892271976 conn(0x55a128dde020 msgr2=0x55a128ddc120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:01.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.485+0000 7f529772c800 1 -- 172.21.15.102:0/2892271976 shutdown_connections 2024-09-13T19:18:01.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.485+0000 7f529772c800 1 -- 172.21.15.102:0/2892271976 wait complete. 2024-09-13T19:18:01.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.485+0000 7f529772c800 1 Processor -- start 2024-09-13T19:18:01.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.485+0000 7f529772c800 1 -- start start 2024-09-13T19:18:01.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.485+0000 7f529772c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a128de1cc0 0x55a128de9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.485+0000 7f529772c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a128de2d00 con 0x55a128de1cc0 2024-09-13T19:18:01.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.486+0000 7f5293b6c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a128de1cc0 0x55a128de9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.486+0000 7f5293b6c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a128de1cc0 0x55a128de9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49292/0 (socket says 172.21.15.102:49292) 2024-09-13T19:18:01.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.486+0000 7f5293b6c640 1 -- 172.21.15.102:0/3843855649 learned_addr learned my addr 172.21.15.102:0/3843855649 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:01.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.486+0000 7f5293b6c640 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a128de9670 con 0x55a128de1cc0 2024-09-13T19:18:01.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.486+0000 7f5293b6c640 1 --2- 172.21.15.102:0/3843855649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a128de1cc0 0x55a128de9130 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f528c03f040 tx=0x7f528c04cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.486+0000 7f51757fa640 1 -- 172.21.15.102:0/3843855649 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f528c02e070 con 0x55a128de1cc0 2024-09-13T19:18:01.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.486+0000 7f51757fa640 1 -- 172.21.15.102:0/3843855649 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f528c04cfa0 con 0x55a128de1cc0 2024-09-13T19:18:01.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.486+0000 7f529772c800 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a128de9900 con 0x55a128de1cc0 2024-09-13T19:18:01.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.486+0000 7f51757fa640 1 -- 172.21.15.102:0/3843855649 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f528c029dd0 con 0x55a128de1cc0 2024-09-13T19:18:01.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.486+0000 7f529772c800 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a128dec5b0 con 0x55a128de1cc0 2024-09-13T19:18:01.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.487+0000 7f51757fa640 1 -- 172.21.15.102:0/3843855649 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f528c039060 con 0x55a128de1cc0 2024-09-13T19:18:01.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.487+0000 7f51757fa640 1 --2- 172.21.15.102:0/3843855649 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f515c036b40 0x7f515c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.487+0000 7f51757fa640 1 -- 172.21.15.102:0/3843855649 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f528c033d10 con 0x55a128de1cc0 2024-09-13T19:18:01.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.487+0000 7f529336b640 1 --2- 172.21.15.102:0/3843855649 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f515c036b40 0x7f515c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.488+0000 7f529772c800 20 rados->read ofs=0 len=0 2024-09-13T19:18:01.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.488+0000 7f529772c800 1 --2- 172.21.15.102:0/3843855649 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55a128df4b60 0x55a128df7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.488+0000 7f529772c800 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a128df7770 con 0x55a128df4b60 2024-09-13T19:18:01.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.488+0000 7f529336b640 1 --2- 172.21.15.102:0/3843855649 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f515c036b40 0x7f515c039000 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f52840547e0 tx=0x7f5284093000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.488+0000 7f528ab6a640 1 --2- 172.21.15.102:0/3843855649 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55a128df4b60 0x55a128df7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.488+0000 7f528ab6a640 1 --2- 172.21.15.102:0/3843855649 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55a128df4b60 0x55a128df7020 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.488+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f527c009050 con 0x55a128df4b60 2024-09-13T19:18:01.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.488+0000 7f529772c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:01.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.488+0000 7f529772c800 20 realm 2024-09-13T19:18:01.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.488+0000 7f529772c800 20 rados->read ofs=0 len=0 2024-09-13T19:18:01.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.488+0000 7f529772c800 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a128df3fb0 con 0x55a128df4b60 2024-09-13T19:18:01.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.489+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f527c009050 con 0x55a128df4b60 2024-09-13T19:18:01.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.489+0000 7f529772c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:01.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.489+0000 7f529772c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:18:01.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.489+0000 7f529772c800 20 rados->read ofs=0 len=0 2024-09-13T19:18:01.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.489+0000 7f529772c800 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a128df8250 con 0x55a128df4b60 2024-09-13T19:18:01.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.489+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f527c009050 con 0x55a128df4b60 2024-09-13T19:18:01.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.489+0000 7f529772c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:01.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.489+0000 7f529772c800 20 rados->read ofs=0 len=0 2024-09-13T19:18:01.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.489+0000 7f529772c800 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a128df8b20 con 0x55a128df4b60 2024-09-13T19:18:01.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.489+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f527c009050 con 0x55a128df4b60 2024-09-13T19:18:01.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.489+0000 7f529772c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:18:01.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.489+0000 7f529772c800 20 rados->read ofs=0 len=0 2024-09-13T19:18:01.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.489+0000 7f529772c800 1 --2- 172.21.15.102:0/3843855649 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55a128df93d0 0x55a128dfb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.489+0000 7f529772c800 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a128dfbf00 con 0x55a128df93d0 2024-09-13T19:18:01.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.489+0000 7f5293b6c640 1 --2- 172.21.15.102:0/3843855649 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55a128df93d0 0x55a128dfb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.489+0000 7f5293b6c640 1 --2- 172.21.15.102:0/3843855649 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55a128df93d0 0x55a128dfb7c0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.490+0000 7f5293b6c640 1 -- 172.21.15.102:0/3843855649 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f528c00a4a0 con 0x55a128df93d0 2024-09-13T19:18:01.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.490+0000 7f529772c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:18:01.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.490+0000 7f529772c800 20 searching for the correct realm 2024-09-13T19:18:01.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.490+0000 7f529772c800 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a128dfd8e0 con 0x55a128df93d0 2024-09-13T19:18:01.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.490+0000 7f5293b6c640 1 -- 172.21.15.102:0/3843855649 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f528c00a4a0 con 0x55a128df93d0 2024-09-13T19:18:01.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.490+0000 7f5293b6c640 1 --2- 172.21.15.102:0/3843855649 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f528c03b070 0x7f528c04b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.490+0000 7f5293b6c640 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a128dfd8e0 con 0x7f528c03b070 2024-09-13T19:18:01.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.490+0000 7f529336b640 1 --2- 172.21.15.102:0/3843855649 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f528c03b070 0x7f528c04b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.490+0000 7f529336b640 1 --2- 172.21.15.102:0/3843855649 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f528c03b070 0x7f528c04b230 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.491+0000 7f529336b640 1 -- 172.21.15.102:0/3843855649 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5284051070 con 0x7f528c03b070 2024-09-13T19:18:01.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.491+0000 7f529336b640 1 --2- 172.21.15.102:0/3843855649 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f528405c070 0x7f5284009640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.491+0000 7f529336b640 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a128dfd8e0 con 0x7f528405c070 2024-09-13T19:18:01.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.491+0000 7f528ab6a640 1 --2- 172.21.15.102:0/3843855649 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f528405c070 0x7f5284009640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.491+0000 7f528ab6a640 1 --2- 172.21.15.102:0/3843855649 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f528405c070 0x7f5284009640 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.491+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f527c009050 con 0x7f528405c070 2024-09-13T19:18:01.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.491+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a128dfd8e0 con 0x55a128df4b60 2024-09-13T19:18:01.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.492+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f527c009050 con 0x55a128df4b60 2024-09-13T19:18:01.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.492+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a128dfd8e0 con 0x55a128df4b60 2024-09-13T19:18:01.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.492+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f527c029040 con 0x55a128df4b60 2024-09-13T19:18:01.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.492+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a128dfd8e0 con 0x7f528405c070 2024-09-13T19:18:01.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.492+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f527c029040 con 0x7f528405c070 2024-09-13T19:18:01.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.492+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a128dfd8e0 con 0x7f528405c070 2024-09-13T19:18:01.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.492+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f527c029040 con 0x7f528405c070 2024-09-13T19:18:01.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.492+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a128dfd8e0 con 0x7f528c03b070 2024-09-13T19:18:01.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.493+0000 7f529336b640 1 -- 172.21.15.102:0/3843855649 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5284051070 con 0x7f528c03b070 2024-09-13T19:18:01.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.493+0000 7f529336b640 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a128dfd8e0 con 0x55a128df93d0 2024-09-13T19:18:01.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.493+0000 7f5293b6c640 1 -- 172.21.15.102:0/3843855649 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f528c00a4a0 con 0x55a128df93d0 2024-09-13T19:18:01.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.493+0000 7f5293b6c640 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a128dfd8e0 con 0x55a128df4b60 2024-09-13T19:18:01.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.493+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f527c029040 con 0x55a128df4b60 2024-09-13T19:18:01.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.493+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a128dfd8e0 con 0x7f528c03b070 2024-09-13T19:18:01.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.493+0000 7f529336b640 1 -- 172.21.15.102:0/3843855649 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5284051070 con 0x7f528c03b070 2024-09-13T19:18:01.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.493+0000 7f529336b640 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a128dfd8e0 con 0x55a128df4b60 2024-09-13T19:18:01.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.494+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f527c029040 con 0x55a128df4b60 2024-09-13T19:18:01.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.494+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a128dfd8e0 con 0x7f528c03b070 2024-09-13T19:18:01.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.494+0000 7f529336b640 1 -- 172.21.15.102:0/3843855649 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5284051070 con 0x7f528c03b070 2024-09-13T19:18:01.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.494+0000 7f529336b640 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a128dfd8e0 con 0x55a128df93d0 2024-09-13T19:18:01.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.494+0000 7f5293b6c640 1 -- 172.21.15.102:0/3843855649 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f528c00a4a0 con 0x55a128df93d0 2024-09-13T19:18:01.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.494+0000 7f5293b6c640 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a128dfd8e0 con 0x55a128df93d0 2024-09-13T19:18:01.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.494+0000 7f5293b6c640 1 -- 172.21.15.102:0/3843855649 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f528c00a4a0 con 0x55a128df93d0 2024-09-13T19:18:01.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.494+0000 7f5293b6c640 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a128dfd8e0 con 0x7f528405c070 2024-09-13T19:18:01.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.495+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f527c029040 con 0x7f528405c070 2024-09-13T19:18:01.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.495+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a128dfd8e0 con 0x55a128df93d0 2024-09-13T19:18:01.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.495+0000 7f5293b6c640 1 -- 172.21.15.102:0/3843855649 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f528c00a4a0 con 0x55a128df93d0 2024-09-13T19:18:01.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.495+0000 7f5293b6c640 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a128dfd8e0 con 0x55a128df93d0 2024-09-13T19:18:01.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.495+0000 7f5293b6c640 1 -- 172.21.15.102:0/3843855649 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f528c00a4a0 con 0x55a128df93d0 2024-09-13T19:18:01.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.495+0000 7f5293b6c640 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a128dfd8e0 con 0x55a128df4b60 2024-09-13T19:18:01.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.495+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f527c029040 con 0x55a128df4b60 2024-09-13T19:18:01.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.495+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a128dfd8e0 con 0x55a128df4b60 2024-09-13T19:18:01.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.496+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f527c029040 con 0x55a128df4b60 2024-09-13T19:18:01.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.496+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a128dfd8e0 con 0x7f528405c070 2024-09-13T19:18:01.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.496+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f527c029040 con 0x7f528405c070 2024-09-13T19:18:01.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.496+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a128dfd8e0 con 0x55a128df93d0 2024-09-13T19:18:01.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.496+0000 7f5293b6c640 1 -- 172.21.15.102:0/3843855649 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f528c00a4a0 con 0x55a128df93d0 2024-09-13T19:18:01.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.496+0000 7f5293b6c640 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a128dfd8e0 con 0x7f528c03b070 2024-09-13T19:18:01.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.496+0000 7f529336b640 1 -- 172.21.15.102:0/3843855649 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5284051070 con 0x7f528c03b070 2024-09-13T19:18:01.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.496+0000 7f529336b640 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a128dfd8e0 con 0x55a128df4b60 2024-09-13T19:18:01.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.497+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f527c029040 con 0x55a128df4b60 2024-09-13T19:18:01.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.497+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a128dfd8e0 con 0x7f528c03b070 2024-09-13T19:18:01.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.497+0000 7f529336b640 1 -- 172.21.15.102:0/3843855649 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5284051070 con 0x7f528c03b070 2024-09-13T19:18:01.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.497+0000 7f529336b640 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a128dfd8e0 con 0x55a128df93d0 2024-09-13T19:18:01.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.497+0000 7f5293b6c640 1 -- 172.21.15.102:0/3843855649 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f528c00a4a0 con 0x55a128df93d0 2024-09-13T19:18:01.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.497+0000 7f5293b6c640 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a128dfd8e0 con 0x7f528405c070 2024-09-13T19:18:01.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.497+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f527c029040 con 0x7f528405c070 2024-09-13T19:18:01.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.497+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a128dfd8e0 con 0x7f528c03b070 2024-09-13T19:18:01.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.498+0000 7f529336b640 1 -- 172.21.15.102:0/3843855649 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5284051070 con 0x7f528c03b070 2024-09-13T19:18:01.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.498+0000 7f529336b640 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a128dfd8e0 con 0x55a128df93d0 2024-09-13T19:18:01.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.498+0000 7f5293b6c640 1 -- 172.21.15.102:0/3843855649 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f528c00a4a0 con 0x55a128df93d0 2024-09-13T19:18:01.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.498+0000 7f5293b6c640 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a128dfd8e0 con 0x7f528405c070 2024-09-13T19:18:01.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.498+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f527c029040 con 0x7f528405c070 2024-09-13T19:18:01.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.498+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a128dfd8e0 con 0x55a128df4b60 2024-09-13T19:18:01.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.498+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f527c029040 con 0x55a128df4b60 2024-09-13T19:18:01.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.498+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a128dfd8e0 con 0x7f528c03b070 2024-09-13T19:18:01.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.499+0000 7f529336b640 1 -- 172.21.15.102:0/3843855649 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5284051070 con 0x7f528c03b070 2024-09-13T19:18:01.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.499+0000 7f529772c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:18:01.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.499+0000 7f529772c800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:18:01.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.499+0000 7f529772c800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:18:01.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.499+0000 7f529772c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:18:01.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.499+0000 7f529772c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:18:01.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.499+0000 7f529772c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:18:01.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.499+0000 7f529772c800 20 rados->read ofs=0 len=0 2024-09-13T19:18:01.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.499+0000 7f529772c800 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a128dfc9b0 con 0x55a128df4b60 2024-09-13T19:18:01.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.499+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f527c029040 con 0x55a128df4b60 2024-09-13T19:18:01.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.499+0000 7f529772c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:01.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.499+0000 7f529772c800 20 rados->read ofs=0 len=0 2024-09-13T19:18:01.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.499+0000 7f529772c800 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a128dfd250 con 0x55a128df4b60 2024-09-13T19:18:01.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.499+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f527c029040 con 0x55a128df4b60 2024-09-13T19:18:01.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.499+0000 7f529772c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:18:01.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.499+0000 7f529772c800 20 rados->read ofs=0 len=0 2024-09-13T19:18:01.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.499+0000 7f529772c800 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a128dfc5f0 con 0x55a128df93d0 2024-09-13T19:18:01.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.499+0000 7f5293b6c640 1 -- 172.21.15.102:0/3843855649 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f528c00a4a0 con 0x55a128df93d0 2024-09-13T19:18:01.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.499+0000 7f529772c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:18:01.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.499+0000 7f529772c800 20 zone default found 2024-09-13T19:18:01.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.499+0000 7f529772c800 4 Realm: () 2024-09-13T19:18:01.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.499+0000 7f529772c800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:18:01.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.499+0000 7f529772c800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:18:01.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.499+0000 7f529772c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:18:01.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.499+0000 7f529772c800 20 zonegroup default 2024-09-13T19:18:01.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.499+0000 7f529772c800 20 rados->read ofs=0 len=0 2024-09-13T19:18:01.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.499+0000 7f529772c800 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a128dfe260 con 0x7f528c03b070 2024-09-13T19:18:01.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.500+0000 7f529336b640 1 -- 172.21.15.102:0/3843855649 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5284051070 con 0x7f528c03b070 2024-09-13T19:18:01.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.500+0000 7f529772c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:01.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.500+0000 7f529772c800 20 rados->read ofs=0 len=0 2024-09-13T19:18:01.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.500+0000 7f529772c800 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a128e00070 con 0x55a128df93d0 2024-09-13T19:18:01.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.500+0000 7f5293b6c640 1 -- 172.21.15.102:0/3843855649 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f528c00a4a0 con 0x55a128df93d0 2024-09-13T19:18:01.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.500+0000 7f529772c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:01.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.500+0000 7f529772c800 20 rados->read ofs=0 len=0 2024-09-13T19:18:01.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.500+0000 7f529772c800 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a128e004b0 con 0x55a128df93d0 2024-09-13T19:18:01.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.500+0000 7f5293b6c640 1 -- 172.21.15.102:0/3843855649 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f528c00a4a0 con 0x55a128df93d0 2024-09-13T19:18:01.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.500+0000 7f529772c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:01.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.500+0000 7f529772c800 20 started sync module instance, tier type = 2024-09-13T19:18:01.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.500+0000 7f529772c800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:18:01.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.500+0000 7f529772c800 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a128dff480 con 0x7f528c03b070 2024-09-13T19:18:01.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.501+0000 7f529336b640 1 -- 172.21.15.102:0/3843855649 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(44 notify.0 [create] v36'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5284051070 con 0x7f528c03b070 2024-09-13T19:18:01.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.501+0000 7f529772c800 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94150663862384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a128dffc90 con 0x7f528c03b070 2024-09-13T19:18:01.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.501+0000 7f529772c800 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a128e013b0 con 0x55a128df4b60 2024-09-13T19:18:01.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.502+0000 7f529336b640 1 -- 172.21.15.102:0/3843855649 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94150663862384] v36'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5284051070 con 0x7f528c03b070 2024-09-13T19:18:01.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.503+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v36'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f527c029040 con 0x55a128df4b60 2024-09-13T19:18:01.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.503+0000 7f529772c800 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94150663866592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a128e01c50 con 0x55a128df4b60 2024-09-13T19:18:01.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.503+0000 7f529772c800 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a128e02610 con 0x55a128df93d0 2024-09-13T19:18:01.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.504+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94150663866592] v36'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f527c029040 con 0x55a128df4b60 2024-09-13T19:18:01.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.504+0000 7f5293b6c640 1 -- 172.21.15.102:0/3843855649 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v36'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f528c00a4a0 con 0x55a128df93d0 2024-09-13T19:18:01.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.504+0000 7f529772c800 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94150663870880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a128e02610 con 0x55a128df93d0 2024-09-13T19:18:01.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.504+0000 7f529772c800 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a128e03050 con 0x7f528c03b070 2024-09-13T19:18:01.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.505+0000 7f5293b6c640 1 -- 172.21.15.102:0/3843855649 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94150663870880] v36'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f528c00a4a0 con 0x55a128df93d0 2024-09-13T19:18:01.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.505+0000 7f529336b640 1 -- 172.21.15.102:0/3843855649 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(50 notify.3 [create] v36'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5284051070 con 0x7f528c03b070 2024-09-13T19:18:01.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.505+0000 7f529772c800 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94150663875360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a128e02610 con 0x7f528c03b070 2024-09-13T19:18:01.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.505+0000 7f529772c800 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a128e03b20 con 0x55a128df4b60 2024-09-13T19:18:01.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.506+0000 7f529336b640 1 -- 172.21.15.102:0/3843855649 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94150663875360] v36'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5284051070 con 0x7f528c03b070 2024-09-13T19:18:01.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.506+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v36'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f527c029040 con 0x55a128df4b60 2024-09-13T19:18:01.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.507+0000 7f529772c800 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94150663878160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a128e02610 con 0x55a128df4b60 2024-09-13T19:18:01.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.507+0000 7f529772c800 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a128e04570 con 0x7f528405c070 2024-09-13T19:18:01.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.508+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94150663878160] v36'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f527c029040 con 0x55a128df4b60 2024-09-13T19:18:01.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.508+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(54 notify.5 [create] v36'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f527c029040 con 0x7f528405c070 2024-09-13T19:18:01.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.508+0000 7f529772c800 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94150663880832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a128e02610 con 0x7f528405c070 2024-09-13T19:18:01.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.508+0000 7f529772c800 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a128e04ff0 con 0x7f528405c070 2024-09-13T19:18:01.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.509+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94150663880832] v36'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f527c029040 con 0x7f528405c070 2024-09-13T19:18:01.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.509+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(56 notify.6 [create] v36'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f527c029040 con 0x7f528405c070 2024-09-13T19:18:01.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.509+0000 7f529772c800 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94150663883520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a128e02610 con 0x7f528405c070 2024-09-13T19:18:01.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.509+0000 7f529772c800 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a128e05a00 con 0x7f528405c070 2024-09-13T19:18:01.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.510+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94150663883520] v36'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f527c029040 con 0x7f528405c070 2024-09-13T19:18:01.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.510+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(58 notify.7 [create] v36'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f527c029040 con 0x7f528405c070 2024-09-13T19:18:01.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.510+0000 7f529772c800 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94150663873344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a128e05a00 con 0x7f528405c070 2024-09-13T19:18:01.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.510+0000 7f529772c800 20 add_watcher() i=0 2024-09-13T19:18:01.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.510+0000 7f529772c800 20 add_watcher() i=1 2024-09-13T19:18:01.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.510+0000 7f529772c800 20 add_watcher() i=2 2024-09-13T19:18:01.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.510+0000 7f529772c800 20 add_watcher() i=3 2024-09-13T19:18:01.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.510+0000 7f529772c800 20 add_watcher() i=4 2024-09-13T19:18:01.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.510+0000 7f529772c800 20 add_watcher() i=5 2024-09-13T19:18:01.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.510+0000 7f529772c800 20 add_watcher() i=6 2024-09-13T19:18:01.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.511+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94150663873344] v36'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f527c029040 con 0x7f528405c070 2024-09-13T19:18:01.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.511+0000 7f529772c800 20 add_watcher() i=7 2024-09-13T19:18:01.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.511+0000 7f529772c800 2 all 8 watchers are set, enabling cache 2024-09-13T19:18:01.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.511+0000 7f529772c800 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a128e08e30 con 0x55a128df4b60 2024-09-13T19:18:01.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.511+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f527c029040 con 0x55a128df4b60 2024-09-13T19:18:01.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.512+0000 7f529772c800 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94150663886624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a128e062f0 con 0x55a128df4b60 2024-09-13T19:18:01.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.513+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94150663886624] v36'237 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f527c029040 con 0x55a128df4b60 2024-09-13T19:18:01.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.513+0000 7f5149fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:18:01.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.513+0000 7f529772c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:18:01.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.513+0000 7f529772c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:18:01.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.513+0000 7f529772c800 5 note: GC not initialized 2024-09-13T19:18:01.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.513+0000 7f5148fe1640 20 reqs_thread_entry: start 2024-09-13T19:18:01.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.513+0000 7f529772c800 20 init_complete bucket index max shards: 11 2024-09-13T19:18:01.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.513+0000 7f529772c800 20 Filter name: none 2024-09-13T19:18:01.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.513+0000 7f50c27fc640 20 reqs_thread_entry: start 2024-09-13T19:18:01.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.513+0000 7f529772c800 20 rados->read ofs=0 len=0 2024-09-13T19:18:01.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.513+0000 7f529772c800 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a128e3bd80 con 0x55a128df4b60 2024-09-13T19:18:01.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.513+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f527c029040 con 0x55a128df4b60 2024-09-13T19:18:01.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.514+0000 7f529772c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:01.525 INFO:teuthology.orchestra.run.smithi102.stderr:could not fetch user info: no user info saved 2024-09-13T19:18:01.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.514+0000 7f5149fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:18:01.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.514+0000 7f529772c800 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94150663886624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a128e3bd40 con 0x55a128df4b60 2024-09-13T19:18:01.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.515+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94150663886624] v36'238 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f527c029040 con 0x55a128df4b60 2024-09-13T19:18:01.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.515+0000 7f529772c800 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94150663862384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a128e39b50 con 0x7f528c03b070 2024-09-13T19:18:01.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.516+0000 7f529336b640 1 -- 172.21.15.102:0/3843855649 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94150663862384] v36'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5284051070 con 0x7f528c03b070 2024-09-13T19:18:01.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.516+0000 7f529772c800 20 remove_watcher() i=0 2024-09-13T19:18:01.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.516+0000 7f529772c800 2 removed watcher, disabling cache 2024-09-13T19:18:01.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.516+0000 7f529772c800 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94150663866592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a128e39b50 con 0x55a128df4b60 2024-09-13T19:18:01.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.517+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94150663866592] v36'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f527c029040 con 0x55a128df4b60 2024-09-13T19:18:01.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.518+0000 7f529772c800 20 remove_watcher() i=1 2024-09-13T19:18:01.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.518+0000 7f529772c800 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94150663870880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a128e39b50 con 0x55a128df93d0 2024-09-13T19:18:01.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.519+0000 7f5293b6c640 1 -- 172.21.15.102:0/3843855649 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94150663870880] v36'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f528c00a4a0 con 0x55a128df93d0 2024-09-13T19:18:01.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.519+0000 7f529772c800 20 remove_watcher() i=2 2024-09-13T19:18:01.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.519+0000 7f529772c800 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94150663875360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a128e39b50 con 0x7f528c03b070 2024-09-13T19:18:01.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.520+0000 7f529336b640 1 -- 172.21.15.102:0/3843855649 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94150663875360] v36'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5284051070 con 0x7f528c03b070 2024-09-13T19:18:01.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.520+0000 7f529772c800 20 remove_watcher() i=3 2024-09-13T19:18:01.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.520+0000 7f529772c800 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94150663878160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a128e39b50 con 0x55a128df4b60 2024-09-13T19:18:01.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.521+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94150663878160] v36'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f527c029040 con 0x55a128df4b60 2024-09-13T19:18:01.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.521+0000 7f529772c800 20 remove_watcher() i=4 2024-09-13T19:18:01.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.521+0000 7f529772c800 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94150663880832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a128e39b50 con 0x7f528405c070 2024-09-13T19:18:01.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.522+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94150663880832] v36'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f527c029040 con 0x7f528405c070 2024-09-13T19:18:01.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.522+0000 7f529772c800 20 remove_watcher() i=5 2024-09-13T19:18:01.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.522+0000 7f529772c800 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94150663883520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a128e39b50 con 0x7f528405c070 2024-09-13T19:18:01.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.523+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94150663883520] v36'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f527c029040 con 0x7f528405c070 2024-09-13T19:18:01.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.523+0000 7f529772c800 20 remove_watcher() i=6 2024-09-13T19:18:01.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.523+0000 7f529772c800 1 -- 172.21.15.102:0/3843855649 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94150663873344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a128e39b50 con 0x7f528405c070 2024-09-13T19:18:01.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.524+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94150663873344] v36'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f527c029040 con 0x7f528405c070 2024-09-13T19:18:01.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.524+0000 7f529772c800 20 remove_watcher() i=7 2024-09-13T19:18:01.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.524+0000 7f529772c800 1 -- 172.21.15.102:0/3843855649 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f528405c070 msgr2=0x7f5284009640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.524+0000 7f529772c800 1 --2- 172.21.15.102:0/3843855649 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f528405c070 0x7f5284009640 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.524+0000 7f529772c800 1 -- 172.21.15.102:0/3843855649 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55a128df4b60 msgr2=0x55a128df7020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.524+0000 7f529772c800 1 --2- 172.21.15.102:0/3843855649 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55a128df4b60 0x55a128df7020 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.524+0000 7f529772c800 1 -- 172.21.15.102:0/3843855649 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f528c03b070 msgr2=0x7f528c04b230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.524+0000 7f529772c800 1 --2- 172.21.15.102:0/3843855649 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f528c03b070 0x7f528c04b230 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.524+0000 7f529772c800 1 -- 172.21.15.102:0/3843855649 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55a128df93d0 msgr2=0x55a128dfb7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.524+0000 7f529772c800 1 --2- 172.21.15.102:0/3843855649 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55a128df93d0 0x55a128dfb7c0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.524+0000 7f529772c800 1 -- 172.21.15.102:0/3843855649 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f515c036b40 msgr2=0x7f515c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.524+0000 7f529772c800 1 --2- 172.21.15.102:0/3843855649 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f515c036b40 0x7f515c039000 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f52840547e0 tx=0x7f5284093000 comp rx=0 tx=0).stop 2024-09-13T19:18:01.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.524+0000 7f529772c800 1 -- 172.21.15.102:0/3843855649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a128de1cc0 msgr2=0x55a128de9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.524+0000 7f528ab6a640 1 -- 172.21.15.102:0/3843855649 reap_dead start 2024-09-13T19:18:01.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.524+0000 7f529772c800 1 --2- 172.21.15.102:0/3843855649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a128de1cc0 0x55a128de9130 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f528c03f040 tx=0x7f528c04cd30 comp rx=0 tx=0).stop 2024-09-13T19:18:01.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.524+0000 7f529772c800 1 -- 172.21.15.102:0/3843855649 shutdown_connections 2024-09-13T19:18:01.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.524+0000 7f529772c800 1 --2- 172.21.15.102:0/3843855649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a128de1cc0 0x55a128de9130 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.524+0000 7f529772c800 1 -- 172.21.15.102:0/3843855649 >> 172.21.15.102:0/3843855649 conn(0x55a128dde020 msgr2=0x55a128ddc0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:01.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.524+0000 7f529772c800 1 -- 172.21.15.102:0/3843855649 shutdown_connections 2024-09-13T19:18:01.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.524+0000 7f529772c800 1 -- 172.21.15.102:0/3843855649 wait complete. 2024-09-13T19:18:01.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.525+0000 7f529772c800 1 -- 172.21.15.102:0/3890242190 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f516c036b90 msgr2=0x7f516c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.525+0000 7f529772c800 1 --2- 172.21.15.102:0/3890242190 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f516c036b90 0x7f516c039050 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x55a128dc2a40 tx=0x7f5284060ee0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.525+0000 7f529772c800 1 -- 172.21.15.102:0/3890242190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a128dd5020 msgr2=0x55a128dd5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.525+0000 7f529772c800 1 --2- 172.21.15.102:0/3890242190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a128dd5020 0x55a128dd5440 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x55a128dbb450 tx=0x7f528c0167b0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.525+0000 7f529772c800 1 -- 172.21.15.102:0/3890242190 shutdown_connections 2024-09-13T19:18:01.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.525+0000 7f529772c800 1 --2- 172.21.15.102:0/3890242190 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f516c036b90 0x7f516c039050 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.525+0000 7f529772c800 1 --2- 172.21.15.102:0/3890242190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a128dd5020 0x55a128dd5440 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.525+0000 7f529772c800 1 -- 172.21.15.102:0/3890242190 >> 172.21.15.102:0/3890242190 conn(0x55a128dc9fb0 msgr2=0x55a128dccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:01.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.525+0000 7f529772c800 1 -- 172.21.15.102:0/3890242190 shutdown_connections 2024-09-13T19:18:01.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.525+0000 7f529772c800 1 -- 172.21.15.102:0/3890242190 wait complete. 2024-09-13T19:18:01.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.525+0000 7f529772c800 1 -- 172.21.15.102:0/2151782168 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55a128cc40a0 msgr2=0x55a128dc12a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.525+0000 7f529772c800 1 --2- 172.21.15.102:0/2151782168 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55a128cc40a0 0x55a128dc12a0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.525+0000 7f529772c800 1 -- 172.21.15.102:0/2151782168 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55a128dc3bd0 msgr2=0x55a128dc5fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.525+0000 7f529772c800 1 --2- 172.21.15.102:0/2151782168 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55a128dc3bd0 0x55a128dc5fc0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.525+0000 7f529772c800 1 -- 172.21.15.102:0/2151782168 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5178036b40 msgr2=0x7f5178039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.525+0000 7f529772c800 1 --2- 172.21.15.102:0/2151782168 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5178036b40 0x7f5178039000 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f527c000f60 tx=0x7f527c0012b0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.525+0000 7f529772c800 1 -- 172.21.15.102:0/2151782168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a128cc3760 msgr2=0x55a128dba230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.525+0000 7f529772c800 1 --2- 172.21.15.102:0/2151782168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a128cc3760 0x55a128dba230 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x55a128db3700 tx=0x7f5284002fb0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.525+0000 7f529772c800 1 -- 172.21.15.102:0/2151782168 shutdown_connections 2024-09-13T19:18:01.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.525+0000 7f529772c800 1 --2- 172.21.15.102:0/2151782168 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55a128dc3bd0 0x55a128dc5fc0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.525+0000 7f529772c800 1 --2- 172.21.15.102:0/2151782168 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55a128cc40a0 0x55a128dc12a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.525+0000 7f529772c800 1 --2- 172.21.15.102:0/2151782168 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5178036b40 0x7f5178039000 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.525+0000 7f529772c800 1 --2- 172.21.15.102:0/2151782168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a128cc3760 0x55a128dba230 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.525+0000 7f529772c800 1 -- 172.21.15.102:0/2151782168 >> 172.21.15.102:0/2151782168 conn(0x55a128cbeff0 msgr2=0x55a128dacad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:01.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.525+0000 7f529772c800 1 -- 172.21.15.102:0/2151782168 shutdown_connections 2024-09-13T19:18:01.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.525+0000 7f529772c800 1 -- 172.21.15.102:0/2151782168 wait complete. 2024-09-13T19:18:01.536 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-13T19:18:01.537 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2024-09-13T19:18:01.537 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2024-09-13T19:18:01.537 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2024-09-13T19:18:01.580 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:18:01.580 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:18:01.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.577+0000 7f6509a2f800 1 Processor -- start 2024-09-13T19:18:01.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.577+0000 7f6509a2f800 1 -- start start 2024-09-13T19:18:01.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.578+0000 7f6509a2f800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55c0c87447a0 0x55c0c87d31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.578+0000 7f6509a2f800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c0c868fb30 con 0x55c0c87d3730 2024-09-13T19:18:01.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.578+0000 7f6509a2f800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55c0c8671360 con 0x55c0c87447a0 2024-09-13T19:18:01.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.578+0000 7f650752a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55c0c87447a0 0x55c0c87d31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.578+0000 7f64fffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55c0c87d3730 0x55c0c87d5b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:53636/0 (socket says 172.21.15.102:53636) 2024-09-13T19:18:01.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.578+0000 7f64fffff640 1 -- 172.21.15.102:0/2156249981 learned_addr learned my addr 172.21.15.102:0/2156249981 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:18:01.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.578+0000 7f650752a640 1 -- 172.21.15.102:0/2156249981 >> v1:172.21.15.53:6789/0 conn(0x55c0c87d3730 legacy=0x55c0c87d5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.578+0000 7f650752a640 1 -- 172.21.15.102:0/2156249981 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0c8697e00 con 0x55c0c87447a0 2024-09-13T19:18:01.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.580+0000 7f650752a640 1 --2- 172.21.15.102:0/2156249981 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c87447a0 0x55c0c87d31f0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f64f800a470 tx=0x7f64f8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=527b06694bd93233 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.580+0000 7f6506d29640 1 -- 172.21.15.102:0/2156249981 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64f8053570 con 0x55c0c87447a0 2024-09-13T19:18:01.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.580+0000 7f6506d29640 1 -- 172.21.15.102:0/2156249981 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64f8058070 con 0x55c0c87447a0 2024-09-13T19:18:01.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.580+0000 7f6506d29640 1 -- 172.21.15.102:0/2156249981 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64f8053880 con 0x55c0c87447a0 2024-09-13T19:18:01.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.581+0000 7f6509a2f800 1 -- 172.21.15.102:0/2156249981 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c87447a0 msgr2=0x55c0c87d31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.581+0000 7f6509a2f800 1 --2- 172.21.15.102:0/2156249981 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c87447a0 0x55c0c87d31f0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f64f800a470 tx=0x7f64f8045a20 comp rx=0 tx=0).stop 2024-09-13T19:18:01.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.581+0000 7f6509a2f800 1 -- 172.21.15.102:0/2156249981 shutdown_connections 2024-09-13T19:18:01.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.581+0000 7f6509a2f800 1 --2- 172.21.15.102:0/2156249981 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c87447a0 0x55c0c87d31f0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.581+0000 7f6509a2f800 1 -- 172.21.15.102:0/2156249981 >> 172.21.15.102:0/2156249981 conn(0x55c0c87cae20 msgr2=0x55c0c87cd240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:01.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.581+0000 7f6509a2f800 1 -- 172.21.15.102:0/2156249981 shutdown_connections 2024-09-13T19:18:01.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.581+0000 7f6509a2f800 1 -- 172.21.15.102:0/2156249981 wait complete. 2024-09-13T19:18:01.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.594+0000 7f6509a2f800 1 Processor -- start 2024-09-13T19:18:01.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.594+0000 7f6509a2f800 1 -- start start 2024-09-13T19:18:01.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.594+0000 7f6509a2f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c87447a0 0x55c0c88bf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.594+0000 7f6509a2f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c0c871c330 con 0x55c0c87447a0 2024-09-13T19:18:01.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.595+0000 7f650752a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c87447a0 0x55c0c88bf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.595+0000 7f650752a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c87447a0 0x55c0c88bf9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49316/0 (socket says 172.21.15.102:49316) 2024-09-13T19:18:01.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.595+0000 7f650752a640 1 -- 172.21.15.102:0/2823684869 learned_addr learned my addr 172.21.15.102:0/2823684869 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:01.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.595+0000 7f650752a640 1 -- 172.21.15.102:0/2823684869 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0c8669bc0 con 0x55c0c87447a0 2024-09-13T19:18:01.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.595+0000 7f650752a640 1 --2- 172.21.15.102:0/2823684869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c87447a0 0x55c0c88bf9b0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f64f8025c20 tx=0x7f64f8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e28e321440c3d2f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.595+0000 7f63f560a640 1 -- 172.21.15.102:0/2823684869 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64f8053ba0 con 0x55c0c87447a0 2024-09-13T19:18:01.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.595+0000 7f63f560a640 1 -- 172.21.15.102:0/2823684869 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64f8063030 con 0x55c0c87447a0 2024-09-13T19:18:01.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.595+0000 7f63f560a640 1 -- 172.21.15.102:0/2823684869 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64f8053440 con 0x55c0c87447a0 2024-09-13T19:18:01.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.596+0000 7f6509a2f800 1 -- 172.21.15.102:0/2823684869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c87447a0 msgr2=0x55c0c88bf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.596+0000 7f6509a2f800 1 --2- 172.21.15.102:0/2823684869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c87447a0 0x55c0c88bf9b0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f64f8025c20 tx=0x7f64f8051000 comp rx=0 tx=0).stop 2024-09-13T19:18:01.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.596+0000 7f6509a2f800 1 -- 172.21.15.102:0/2823684869 shutdown_connections 2024-09-13T19:18:01.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.596+0000 7f6509a2f800 1 --2- 172.21.15.102:0/2823684869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c87447a0 0x55c0c88bf9b0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.596+0000 7f6509a2f800 1 -- 172.21.15.102:0/2823684869 >> 172.21.15.102:0/2823684869 conn(0x55c0c87cae20 msgr2=0x55c0c88bb370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:01.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.596+0000 7f6509a2f800 1 -- 172.21.15.102:0/2823684869 shutdown_connections 2024-09-13T19:18:01.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.596+0000 7f6509a2f800 1 -- 172.21.15.102:0/2823684869 wait complete. 2024-09-13T19:18:01.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.596+0000 7f6509a2f800 1 Processor -- start 2024-09-13T19:18:01.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.596+0000 7f6509a2f800 1 -- start start 2024-09-13T19:18:01.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.597+0000 7f6509a2f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c87447a0 0x55c0c88c7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.597+0000 7f6509a2f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c0c87d76a0 con 0x55c0c87447a0 2024-09-13T19:18:01.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.597+0000 7f650752a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c87447a0 0x55c0c88c7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.597+0000 7f650752a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c87447a0 0x55c0c88c7330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49322/0 (socket says 172.21.15.102:49322) 2024-09-13T19:18:01.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.597+0000 7f650752a640 1 -- 172.21.15.102:0/2042620357 learned_addr learned my addr 172.21.15.102:0/2042620357 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:01.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.597+0000 7f650752a640 1 -- 172.21.15.102:0/2042620357 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0c867dfe0 con 0x55c0c87447a0 2024-09-13T19:18:01.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.597+0000 7f650752a640 1 --2- 172.21.15.102:0/2042620357 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c87447a0 0x55c0c88c7330 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x55c0c88c0810 tx=0x7f64f8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.597+0000 7f63f3e07640 1 -- 172.21.15.102:0/2042620357 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64f8078070 con 0x55c0c87447a0 2024-09-13T19:18:01.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.597+0000 7f63f3e07640 1 -- 172.21.15.102:0/2042620357 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64f8053570 con 0x55c0c87447a0 2024-09-13T19:18:01.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.597+0000 7f63f3e07640 1 -- 172.21.15.102:0/2042620357 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64f8053850 con 0x55c0c87447a0 2024-09-13T19:18:01.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.597+0000 7f6509a2f800 1 -- 172.21.15.102:0/2042620357 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c0c88c7870 con 0x55c0c87447a0 2024-09-13T19:18:01.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.598+0000 7f6509a2f800 1 -- 172.21.15.102:0/2042620357 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0c88c7df0 con 0x55c0c87447a0 2024-09-13T19:18:01.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.598+0000 7f6509a2f800 1 Processor -- start 2024-09-13T19:18:01.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.598+0000 7f6509a2f800 1 -- start start 2024-09-13T19:18:01.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.598+0000 7f6509a2f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c87d0c70 0x55c0c87cf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.598+0000 7f6509a2f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c0c866b580 con 0x55c0c87d0c70 2024-09-13T19:18:01.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.598+0000 7f63f3e07640 1 -- 172.21.15.102:0/2042620357 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f64f807b070 con 0x55c0c87447a0 2024-09-13T19:18:01.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.598+0000 7f63f3e07640 1 --2- 172.21.15.102:0/2042620357 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f63ec036b90 0x7f63ec039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.599+0000 7f63f3e07640 1 -- 172.21.15.102:0/2042620357 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f64f8070070 con 0x55c0c87447a0 2024-09-13T19:18:01.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.599+0000 7f6507d2b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c87d0c70 0x55c0c87cf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.599+0000 7f6507d2b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c87d0c70 0x55c0c87cf1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49336/0 (socket says 172.21.15.102:49336) 2024-09-13T19:18:01.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.599+0000 7f6507d2b640 1 -- 172.21.15.102:0/1516773782 learned_addr learned my addr 172.21.15.102:0/1516773782 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:01.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.599+0000 7f650752a640 1 --2- 172.21.15.102:0/2042620357 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f63ec036b90 0x7f63ec039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.599+0000 7f6507d2b640 1 -- 172.21.15.102:0/1516773782 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0c87cf700 con 0x55c0c87d0c70 2024-09-13T19:18:01.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.599+0000 7f650752a640 1 --2- 172.21.15.102:0/2042620357 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f63ec036b90 0x7f63ec039050 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f64f805d010 tx=0x7f64f8000bc0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.599+0000 7f6507d2b640 1 --2- 172.21.15.102:0/1516773782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c87d0c70 0x55c0c87cf1c0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f650000a430 tx=0x7f650000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=296984c0776f8eec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.599+0000 7f63f1e03640 1 -- 172.21.15.102:0/1516773782 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6500015070 con 0x55c0c87d0c70 2024-09-13T19:18:01.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.599+0000 7f63f1e03640 1 -- 172.21.15.102:0/1516773782 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6500001670 con 0x55c0c87d0c70 2024-09-13T19:18:01.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.599+0000 7f63f1e03640 1 -- 172.21.15.102:0/1516773782 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6500001990 con 0x55c0c87d0c70 2024-09-13T19:18:01.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.600+0000 7f6509a2f800 1 -- 172.21.15.102:0/1516773782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c87d0c70 msgr2=0x55c0c87cf1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.600+0000 7f6509a2f800 1 --2- 172.21.15.102:0/1516773782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c87d0c70 0x55c0c87cf1c0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f650000a430 tx=0x7f650000a8f0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.600+0000 7f6509a2f800 1 -- 172.21.15.102:0/1516773782 shutdown_connections 2024-09-13T19:18:01.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.600+0000 7f6509a2f800 1 --2- 172.21.15.102:0/1516773782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c87d0c70 0x55c0c87cf1c0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.600+0000 7f6509a2f800 1 -- 172.21.15.102:0/1516773782 >> 172.21.15.102:0/1516773782 conn(0x55c0c87d3730 msgr2=0x55c0c88cf840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:01.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.600+0000 7f6509a2f800 1 -- 172.21.15.102:0/1516773782 shutdown_connections 2024-09-13T19:18:01.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.600+0000 7f6509a2f800 1 -- 172.21.15.102:0/1516773782 wait complete. 2024-09-13T19:18:01.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.600+0000 7f6509a2f800 1 Processor -- start 2024-09-13T19:18:01.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.600+0000 7f6509a2f800 1 -- start start 2024-09-13T19:18:01.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.600+0000 7f6509a2f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c87d0c70 0x55c0c88dd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.600+0000 7f6509a2f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c0c87cf9c0 con 0x55c0c87d0c70 2024-09-13T19:18:01.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.601+0000 7f6507d2b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c87d0c70 0x55c0c88dd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.601+0000 7f6507d2b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c87d0c70 0x55c0c88dd7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49348/0 (socket says 172.21.15.102:49348) 2024-09-13T19:18:01.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.601+0000 7f6507d2b640 1 -- 172.21.15.102:0/2765261937 learned_addr learned my addr 172.21.15.102:0/2765261937 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:01.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.601+0000 7f6507d2b640 1 -- 172.21.15.102:0/2765261937 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0c88ddd30 con 0x55c0c87d0c70 2024-09-13T19:18:01.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.601+0000 7f6507d2b640 1 --2- 172.21.15.102:0/2765261937 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c87d0c70 0x55c0c88dd7f0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f650000a930 tx=0x7f6500003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.601+0000 7f63e3fff640 1 -- 172.21.15.102:0/2765261937 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6500020020 con 0x55c0c87d0c70 2024-09-13T19:18:01.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.601+0000 7f63e3fff640 1 -- 172.21.15.102:0/2765261937 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65000108b0 con 0x55c0c87d0c70 2024-09-13T19:18:01.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.601+0000 7f63e3fff640 1 -- 172.21.15.102:0/2765261937 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6500015040 con 0x55c0c87d0c70 2024-09-13T19:18:01.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.601+0000 7f6509a2f800 1 -- 172.21.15.102:0/2765261937 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c0c88ddfc0 con 0x55c0c87d0c70 2024-09-13T19:18:01.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.601+0000 7f6509a2f800 1 -- 172.21.15.102:0/2765261937 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0c88e0c70 con 0x55c0c87d0c70 2024-09-13T19:18:01.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.602+0000 7f63e3fff640 1 -- 172.21.15.102:0/2765261937 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6500023020 con 0x55c0c87d0c70 2024-09-13T19:18:01.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.602+0000 7f63e3fff640 1 --2- 172.21.15.102:0/2765261937 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f63e8036b40 0x7f63e8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.602+0000 7f63e3fff640 1 -- 172.21.15.102:0/2765261937 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f650004c390 con 0x55c0c87d0c70 2024-09-13T19:18:01.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.602+0000 7f64fffff640 1 --2- 172.21.15.102:0/2765261937 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f63e8036b40 0x7f63e8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.602+0000 7f6509a2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:18:01.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.602+0000 7f6509a2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:18:01.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.603+0000 7f64fffff640 1 --2- 172.21.15.102:0/2765261937 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f63e8036b40 0x7f63e8039000 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f64f0000f60 tx=0x7f64f0001230 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.603+0000 7f6509a2f800 1 Processor -- start 2024-09-13T19:18:01.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.603+0000 7f6509a2f800 1 -- start start 2024-09-13T19:18:01.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.603+0000 7f6509a2f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c88f7860 0x55c0c88f7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.603+0000 7f6509a2f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c0c88c0100 con 0x55c0c88f7860 2024-09-13T19:18:01.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.603+0000 7f650752a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c88f7860 0x55c0c88f7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.603+0000 7f650752a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c88f7860 0x55c0c88f7c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49362/0 (socket says 172.21.15.102:49362) 2024-09-13T19:18:01.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.603+0000 7f650752a640 1 -- 172.21.15.102:0/940109518 learned_addr learned my addr 172.21.15.102:0/940109518 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:01.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.604+0000 7f650752a640 1 -- 172.21.15.102:0/940109518 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0c88f8250 con 0x55c0c88f7860 2024-09-13T19:18:01.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.604+0000 7f650752a640 1 --2- 172.21.15.102:0/940109518 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c88f7860 0x55c0c88f7c80 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f64f8054e80 tx=0x7f64f8009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.604+0000 7f6367fff640 1 -- 172.21.15.102:0/940109518 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64f8009c90 con 0x55c0c88f7860 2024-09-13T19:18:01.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.604+0000 7f6367fff640 1 -- 172.21.15.102:0/940109518 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64f8068c70 con 0x55c0c88f7860 2024-09-13T19:18:01.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.604+0000 7f6509a2f800 1 -- 172.21.15.102:0/940109518 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c0c88faea0 con 0x55c0c88f7860 2024-09-13T19:18:01.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.604+0000 7f6367fff640 1 -- 172.21.15.102:0/940109518 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64f8068420 con 0x55c0c88f7860 2024-09-13T19:18:01.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.604+0000 7f6509a2f800 1 -- 172.21.15.102:0/940109518 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0c88fb280 con 0x55c0c88f7860 2024-09-13T19:18:01.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.605+0000 7f6367fff640 1 -- 172.21.15.102:0/940109518 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f64f80685c0 con 0x55c0c88f7860 2024-09-13T19:18:01.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.605+0000 7f6367fff640 1 --2- 172.21.15.102:0/940109518 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6340036b90 0x7f6340039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.605+0000 7f6367fff640 1 -- 172.21.15.102:0/940109518 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f64f809ad50 con 0x55c0c88f7860 2024-09-13T19:18:01.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.605+0000 7f64fffff640 1 --2- 172.21.15.102:0/940109518 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6340036b90 0x7f6340039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.605+0000 7f64fffff640 1 --2- 172.21.15.102:0/940109518 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6340036b90 0x7f6340039050 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f64f0001ed0 tx=0x7f64f000f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.605+0000 7f6365ffb640 20 reqs_thread_entry: start 2024-09-13T19:18:01.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.605+0000 7f6509a2f800 1 --2- 172.21.15.102:0/2042620357 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55c0c89052c0 0x55c0c89076b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.605+0000 7f6509a2f800 1 -- 172.21.15.102:0/2042620357 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c0c8907d80 con 0x55c0c89052c0 2024-09-13T19:18:01.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.606+0000 7f6507d2b640 1 --2- 172.21.15.102:0/2042620357 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55c0c89052c0 0x55c0c89076b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.606+0000 7f6507d2b640 1 --2- 172.21.15.102:0/2042620357 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55c0c89052c0 0x55c0c89076b0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.606+0000 7f6507d2b640 1 -- 172.21.15.102:0/2042620357 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f650000e070 con 0x55c0c89052c0 2024-09-13T19:18:01.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.606+0000 7f6509a2f800 1 --2- 172.21.15.102:0/2042620357 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55c0c8909ba0 0x55c0c890bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.606+0000 7f6509a2f800 1 -- 172.21.15.102:0/2042620357 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:2 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c0c890c5e0 con 0x55c0c8909ba0 2024-09-13T19:18:01.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.606+0000 7f650752a640 1 --2- 172.21.15.102:0/2042620357 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55c0c8909ba0 0x55c0c890bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.606+0000 7f650752a640 1 --2- 172.21.15.102:0/2042620357 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55c0c8909ba0 0x55c0c890bf90 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.607+0000 7f650752a640 1 -- 172.21.15.102:0/2042620357 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(2 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f64f809f020 con 0x55c0c8909ba0 2024-09-13T19:18:01.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.608+0000 7f6509a2f800 1 -- 172.21.15.102:0/2765261937 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f63e8036b40 msgr2=0x7f63e8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.608+0000 7f6509a2f800 1 --2- 172.21.15.102:0/2765261937 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f63e8036b40 0x7f63e8039000 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f64f0000f60 tx=0x7f64f0001230 comp rx=0 tx=0).stop 2024-09-13T19:18:01.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.608+0000 7f6509a2f800 1 -- 172.21.15.102:0/2765261937 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c87d0c70 msgr2=0x55c0c88dd7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.608+0000 7f6509a2f800 1 --2- 172.21.15.102:0/2765261937 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c87d0c70 0x55c0c88dd7f0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f650000a930 tx=0x7f6500003370 comp rx=0 tx=0).stop 2024-09-13T19:18:01.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.608+0000 7f6509a2f800 1 -- 172.21.15.102:0/2765261937 shutdown_connections 2024-09-13T19:18:01.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.608+0000 7f6509a2f800 1 --2- 172.21.15.102:0/2765261937 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f63e8036b40 0x7f63e8039000 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.608+0000 7f6509a2f800 1 --2- 172.21.15.102:0/2765261937 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c87d0c70 0x55c0c88dd7f0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.608+0000 7f6509a2f800 1 -- 172.21.15.102:0/2765261937 >> 172.21.15.102:0/2765261937 conn(0x55c0c87d3730 msgr2=0x55c0c88d2770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:01.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.608+0000 7f6509a2f800 1 -- 172.21.15.102:0/2765261937 shutdown_connections 2024-09-13T19:18:01.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.608+0000 7f6509a2f800 1 -- 172.21.15.102:0/2765261937 wait complete. 2024-09-13T19:18:01.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.608+0000 7f6509a2f800 1 -- 172.21.15.102:0/940109518 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6340036b90 msgr2=0x7f6340039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.608+0000 7f6509a2f800 1 --2- 172.21.15.102:0/940109518 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6340036b90 0x7f6340039050 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f64f0001ed0 tx=0x7f64f000f000 comp rx=0 tx=0).stop 2024-09-13T19:18:01.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.608+0000 7f6509a2f800 1 -- 172.21.15.102:0/940109518 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c88f7860 msgr2=0x55c0c88f7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.608+0000 7f6509a2f800 1 --2- 172.21.15.102:0/940109518 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c88f7860 0x55c0c88f7c80 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f64f8054e80 tx=0x7f64f8009a20 comp rx=0 tx=0).stop 2024-09-13T19:18:01.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.608+0000 7f6509a2f800 1 -- 172.21.15.102:0/940109518 shutdown_connections 2024-09-13T19:18:01.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.608+0000 7f6509a2f800 1 --2- 172.21.15.102:0/940109518 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6340036b90 0x7f6340039050 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.608+0000 7f6509a2f800 1 --2- 172.21.15.102:0/940109518 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c88f7860 0x55c0c88f7c80 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.608+0000 7f6509a2f800 1 -- 172.21.15.102:0/940109518 >> 172.21.15.102:0/940109518 conn(0x55c0c88ec790 msgr2=0x55c0c88ef080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:01.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.608+0000 7f6509a2f800 1 -- 172.21.15.102:0/940109518 shutdown_connections 2024-09-13T19:18:01.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.608+0000 7f6509a2f800 1 -- 172.21.15.102:0/940109518 wait complete. 2024-09-13T19:18:01.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.609+0000 7f6509a2f800 1 -- 172.21.15.102:0/2042620357 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55c0c89052c0 msgr2=0x55c0c89076b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.609+0000 7f6509a2f800 1 --2- 172.21.15.102:0/2042620357 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55c0c89052c0 0x55c0c89076b0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.609+0000 7f6509a2f800 1 -- 172.21.15.102:0/2042620357 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55c0c8909ba0 msgr2=0x55c0c890bf90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.609+0000 7f6509a2f800 1 --2- 172.21.15.102:0/2042620357 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55c0c8909ba0 0x55c0c890bf90 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.609+0000 7f6509a2f800 1 -- 172.21.15.102:0/2042620357 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f63ec036b90 msgr2=0x7f63ec039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.609+0000 7f6509a2f800 1 --2- 172.21.15.102:0/2042620357 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f63ec036b90 0x7f63ec039050 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f64f805d010 tx=0x7f64f8000bc0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.609+0000 7f6509a2f800 1 -- 172.21.15.102:0/2042620357 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c87447a0 msgr2=0x55c0c88c7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.609+0000 7f6509a2f800 1 --2- 172.21.15.102:0/2042620357 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c87447a0 0x55c0c88c7330 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x55c0c88c0810 tx=0x7f64f8002fb0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.609+0000 7f6509a2f800 1 -- 172.21.15.102:0/2042620357 shutdown_connections 2024-09-13T19:18:01.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.609+0000 7f6509a2f800 1 --2- 172.21.15.102:0/2042620357 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55c0c8909ba0 0x55c0c890bf90 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.609+0000 7f6509a2f800 1 --2- 172.21.15.102:0/2042620357 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55c0c89052c0 0x55c0c89076b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.609+0000 7f6509a2f800 1 --2- 172.21.15.102:0/2042620357 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f63ec036b90 0x7f63ec039050 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.609+0000 7f6509a2f800 1 --2- 172.21.15.102:0/2042620357 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c87447a0 0x55c0c88c7330 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.609+0000 7f6509a2f800 1 -- 172.21.15.102:0/2042620357 >> 172.21.15.102:0/2042620357 conn(0x55c0c87cae20 msgr2=0x55c0c88b9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:01.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.609+0000 7f6509a2f800 1 -- 172.21.15.102:0/2042620357 shutdown_connections 2024-09-13T19:18:01.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.609+0000 7f6509a2f800 1 -- 172.21.15.102:0/2042620357 wait complete. 2024-09-13T19:18:01.621 INFO:teuthology.orchestra.run.smithi102.stdout:{"id":"509740b4-c081-4f37-bd6d-df9ca851489b","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-13T19:18:01.621 DEBUG:tasks.util.rgw: json result: {'id': '509740b4-c081-4f37-bd6d-df9ca851489b', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-13T19:18:01.622 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2024-09-13T19:18:01.622 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2024-09-13T19:18:01.622 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2024-09-13T19:18:01.704 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:18:01.704 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:18:01.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.701+0000 7ff1cbc87800 1 Processor -- start 2024-09-13T19:18:01.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.702+0000 7ff1cbc87800 1 -- start start 2024-09-13T19:18:01.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.702+0000 7ff1cbc87800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x559e2fc73980 0x559e2fc75d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.702+0000 7ff1cbc87800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559e2fb2fb30 con 0x559e2fc6f540 2024-09-13T19:18:01.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.702+0000 7ff1cbc87800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x559e2fb11360 con 0x559e2fc73980 2024-09-13T19:18:01.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.702+0000 7ff1c3fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x559e2fc73980 0x559e2fc75d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.702+0000 7ff1c977b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x559e2fc6f540 0x559e2fc6f940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:53638/0 (socket says 172.21.15.102:53638) 2024-09-13T19:18:01.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.702+0000 7ff1c3fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x559e2fc73980 0x559e2fc75d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49366/0 (socket says 172.21.15.102:49366) 2024-09-13T19:18:01.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.702+0000 7ff1c977b640 1 -- 172.21.15.102:0/4237868849 learned_addr learned my addr 172.21.15.102:0/4237868849 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:18:01.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.702+0000 7ff1c3fff640 1 -- 172.21.15.102:0/4237868849 >> v1:172.21.15.53:6789/0 conn(0x559e2fc6f540 legacy=0x559e2fc6f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.702+0000 7ff1c3fff640 1 -- 172.21.15.102:0/4237868849 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e2fb37e00 con 0x559e2fc73980 2024-09-13T19:18:01.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.704+0000 7ff1c3fff640 1 --2- 172.21.15.102:0/4237868849 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e2fc73980 0x559e2fc75d70 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7ff1b400a470 tx=0x7ff1b4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=149208272c62a706 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.704+0000 7ff1c8f7a640 1 -- 172.21.15.102:0/4237868849 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1b4053570 con 0x559e2fc73980 2024-09-13T19:18:01.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.704+0000 7ff1c8f7a640 1 -- 172.21.15.102:0/4237868849 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1b4058070 con 0x559e2fc73980 2024-09-13T19:18:01.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.704+0000 7ff1c8f7a640 1 -- 172.21.15.102:0/4237868849 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1b4053880 con 0x559e2fc73980 2024-09-13T19:18:01.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.705+0000 7ff1cbc87800 1 -- 172.21.15.102:0/4237868849 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e2fc73980 msgr2=0x559e2fc75d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.705+0000 7ff1cbc87800 1 --2- 172.21.15.102:0/4237868849 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e2fc73980 0x559e2fc75d70 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7ff1b400a470 tx=0x7ff1b4045a20 comp rx=0 tx=0).stop 2024-09-13T19:18:01.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.705+0000 7ff1cbc87800 1 -- 172.21.15.102:0/4237868849 shutdown_connections 2024-09-13T19:18:01.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.705+0000 7ff1cbc87800 1 --2- 172.21.15.102:0/4237868849 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e2fc73980 0x559e2fc75d70 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.705+0000 7ff1cbc87800 1 -- 172.21.15.102:0/4237868849 >> 172.21.15.102:0/4237868849 conn(0x559e2fc6add0 msgr2=0x559e2fc6d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:01.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.705+0000 7ff1cbc87800 1 -- 172.21.15.102:0/4237868849 shutdown_connections 2024-09-13T19:18:01.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.705+0000 7ff1cbc87800 1 -- 172.21.15.102:0/4237868849 wait complete. 2024-09-13T19:18:01.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.719+0000 7ff1cbc87800 1 Processor -- start 2024-09-13T19:18:01.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.719+0000 7ff1cbc87800 1 -- start start 2024-09-13T19:18:01.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.719+0000 7ff1cbc87800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e2fc6f540 0x559e2fbe4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.719+0000 7ff1cbc87800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559e2fbbc320 con 0x559e2fc6f540 2024-09-13T19:18:01.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.719+0000 7ff1c977b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e2fc6f540 0x559e2fbe4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.719+0000 7ff1c977b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e2fc6f540 0x559e2fbe4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49374/0 (socket says 172.21.15.102:49374) 2024-09-13T19:18:01.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.719+0000 7ff1c977b640 1 -- 172.21.15.102:0/2102932944 learned_addr learned my addr 172.21.15.102:0/2102932944 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:01.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.719+0000 7ff1c977b640 1 -- 172.21.15.102:0/2102932944 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e2fb09bc0 con 0x559e2fc6f540 2024-09-13T19:18:01.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.720+0000 7ff1c977b640 1 --2- 172.21.15.102:0/2102932944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e2fc6f540 0x559e2fbe4590 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc001e10 tx=0x7ff1bc00b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98b17be775b7af96 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.720+0000 7ff0b7606640 1 -- 172.21.15.102:0/2102932944 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1bc012020 con 0x559e2fc6f540 2024-09-13T19:18:01.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.720+0000 7ff0b7606640 1 -- 172.21.15.102:0/2102932944 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1bc00e5a0 con 0x559e2fc6f540 2024-09-13T19:18:01.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.720+0000 7ff0b7606640 1 -- 172.21.15.102:0/2102932944 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1bc00e8e0 con 0x559e2fc6f540 2024-09-13T19:18:01.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.720+0000 7ff1cbc87800 1 -- 172.21.15.102:0/2102932944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e2fc6f540 msgr2=0x559e2fbe4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.720+0000 7ff1cbc87800 1 --2- 172.21.15.102:0/2102932944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e2fc6f540 0x559e2fbe4590 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc001e10 tx=0x7ff1bc00b780 comp rx=0 tx=0).stop 2024-09-13T19:18:01.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.720+0000 7ff1cbc87800 1 -- 172.21.15.102:0/2102932944 shutdown_connections 2024-09-13T19:18:01.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.721+0000 7ff1cbc87800 1 --2- 172.21.15.102:0/2102932944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e2fc6f540 0x559e2fbe4590 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.721+0000 7ff1cbc87800 1 -- 172.21.15.102:0/2102932944 >> 172.21.15.102:0/2102932944 conn(0x559e2fc6add0 msgr2=0x559e2fd5a130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:01.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.721+0000 7ff1cbc87800 1 -- 172.21.15.102:0/2102932944 shutdown_connections 2024-09-13T19:18:01.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.721+0000 7ff1cbc87800 1 -- 172.21.15.102:0/2102932944 wait complete. 2024-09-13T19:18:01.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.721+0000 7ff1cbc87800 1 Processor -- start 2024-09-13T19:18:01.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.721+0000 7ff1cbc87800 1 -- start start 2024-09-13T19:18:01.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.721+0000 7ff1cbc87800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e2fc6f540 0x559e2fd5fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.721+0000 7ff1cbc87800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559e2fc765b0 con 0x559e2fc6f540 2024-09-13T19:18:01.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.721+0000 7ff1c977b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e2fc6f540 0x559e2fd5fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.721+0000 7ff1c977b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e2fc6f540 0x559e2fd5fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49382/0 (socket says 172.21.15.102:49382) 2024-09-13T19:18:01.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.721+0000 7ff1c977b640 1 -- 172.21.15.102:0/3089915017 learned_addr learned my addr 172.21.15.102:0/3089915017 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:01.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.722+0000 7ff1c977b640 1 -- 172.21.15.102:0/3089915017 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e2fb1dfe0 con 0x559e2fc6f540 2024-09-13T19:18:01.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.722+0000 7ff1c977b640 1 --2- 172.21.15.102:0/3089915017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e2fc6f540 0x559e2fd5fed0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc00b7c0 tx=0x7ff1bc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.722+0000 7ff0b5e03640 1 -- 172.21.15.102:0/3089915017 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1bc012030 con 0x559e2fc6f540 2024-09-13T19:18:01.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.722+0000 7ff0b5e03640 1 -- 172.21.15.102:0/3089915017 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1bc001470 con 0x559e2fc6f540 2024-09-13T19:18:01.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.722+0000 7ff1cbc87800 1 -- 172.21.15.102:0/3089915017 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559e2fd5e5c0 con 0x559e2fc6f540 2024-09-13T19:18:01.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.722+0000 7ff0b5e03640 1 -- 172.21.15.102:0/3089915017 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1bc01a8d0 con 0x559e2fc6f540 2024-09-13T19:18:01.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.722+0000 7ff1cbc87800 1 -- 172.21.15.102:0/3089915017 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e2fd5eae0 con 0x559e2fc6f540 2024-09-13T19:18:01.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.723+0000 7ff1cbc87800 1 Processor -- start 2024-09-13T19:18:01.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.723+0000 7ff1cbc87800 1 -- start start 2024-09-13T19:18:01.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.723+0000 7ff1cbc87800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e2fd761b0 0x559e2fd765b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.723+0000 7ff1cbc87800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559e2fb0b580 con 0x559e2fd761b0 2024-09-13T19:18:01.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.723+0000 7ff0b5e03640 1 -- 172.21.15.102:0/3089915017 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff1bc015020 con 0x559e2fc6f540 2024-09-13T19:18:01.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.723+0000 7ff1c9f7c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e2fd761b0 0x559e2fd765b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.723+0000 7ff1c9f7c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e2fd761b0 0x559e2fd765b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49386/0 (socket says 172.21.15.102:49386) 2024-09-13T19:18:01.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.723+0000 7ff1c9f7c640 1 -- 172.21.15.102:0/3573193820 learned_addr learned my addr 172.21.15.102:0/3573193820 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:01.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.723+0000 7ff0b5e03640 1 --2- 172.21.15.102:0/3089915017 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff0b0036b40 0x7ff0b0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.723+0000 7ff0b5e03640 1 -- 172.21.15.102:0/3089915017 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7ff1bc020030 con 0x559e2fc6f540 2024-09-13T19:18:01.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.723+0000 7ff1c977b640 1 --2- 172.21.15.102:0/3089915017 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff0b0036b40 0x7ff0b0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.723+0000 7ff1c9f7c640 1 -- 172.21.15.102:0/3573193820 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e2fd76af0 con 0x559e2fd761b0 2024-09-13T19:18:01.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.723+0000 7ff1c977b640 1 --2- 172.21.15.102:0/3089915017 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff0b0036b40 0x7ff0b0039000 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc00c010 tx=0x7ff1bc024ec0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.723+0000 7ff1c9f7c640 1 --2- 172.21.15.102:0/3573193820 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e2fd761b0 0x559e2fd765b0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7ff1c400a430 tx=0x7ff1c400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a43e5b6962d8951 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.724+0000 7ff0af7fe640 1 -- 172.21.15.102:0/3573193820 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1c4015070 con 0x559e2fd761b0 2024-09-13T19:18:01.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.724+0000 7ff0af7fe640 1 -- 172.21.15.102:0/3573193820 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1c4001670 con 0x559e2fd761b0 2024-09-13T19:18:01.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.724+0000 7ff0af7fe640 1 -- 172.21.15.102:0/3573193820 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1c4001990 con 0x559e2fd761b0 2024-09-13T19:18:01.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.724+0000 7ff1cbc87800 1 -- 172.21.15.102:0/3573193820 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e2fd761b0 msgr2=0x559e2fd765b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.724+0000 7ff1cbc87800 1 --2- 172.21.15.102:0/3573193820 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e2fd761b0 0x559e2fd765b0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7ff1c400a430 tx=0x7ff1c400a8f0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.724+0000 7ff1cbc87800 1 -- 172.21.15.102:0/3573193820 shutdown_connections 2024-09-13T19:18:01.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.724+0000 7ff1cbc87800 1 --2- 172.21.15.102:0/3573193820 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e2fd761b0 0x559e2fd765b0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.724+0000 7ff1cbc87800 1 -- 172.21.15.102:0/3573193820 >> 172.21.15.102:0/3573193820 conn(0x559e2fc73980 msgr2=0x559e2fd71930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:01.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.724+0000 7ff1cbc87800 1 -- 172.21.15.102:0/3573193820 shutdown_connections 2024-09-13T19:18:01.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.724+0000 7ff1cbc87800 1 -- 172.21.15.102:0/3573193820 wait complete. 2024-09-13T19:18:01.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.724+0000 7ff1cbc87800 1 Processor -- start 2024-09-13T19:18:01.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.725+0000 7ff1cbc87800 1 -- start start 2024-09-13T19:18:01.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.725+0000 7ff1cbc87800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e2fd761b0 0x559e2fd7d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.725+0000 7ff1cbc87800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559e2fd774a0 con 0x559e2fd761b0 2024-09-13T19:18:01.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.725+0000 7ff1c9f7c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e2fd761b0 0x559e2fd7d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.725+0000 7ff1c9f7c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e2fd761b0 0x559e2fd7d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49390/0 (socket says 172.21.15.102:49390) 2024-09-13T19:18:01.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.725+0000 7ff1c9f7c640 1 -- 172.21.15.102:0/1152589720 learned_addr learned my addr 172.21.15.102:0/1152589720 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:01.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.725+0000 7ff1c9f7c640 1 -- 172.21.15.102:0/1152589720 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e2fd7dd00 con 0x559e2fd761b0 2024-09-13T19:18:01.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.725+0000 7ff1c9f7c640 1 --2- 172.21.15.102:0/1152589720 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e2fd761b0 0x559e2fd7d7c0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7ff1c400a930 tx=0x7ff1c4003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.726+0000 7ff0adffb640 1 -- 172.21.15.102:0/1152589720 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1c4020020 con 0x559e2fd761b0 2024-09-13T19:18:01.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.726+0000 7ff0adffb640 1 -- 172.21.15.102:0/1152589720 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1c40108b0 con 0x559e2fd761b0 2024-09-13T19:18:01.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.726+0000 7ff1cbc87800 1 -- 172.21.15.102:0/1152589720 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559e2fd7df90 con 0x559e2fd761b0 2024-09-13T19:18:01.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.726+0000 7ff0adffb640 1 -- 172.21.15.102:0/1152589720 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1c4015040 con 0x559e2fd761b0 2024-09-13T19:18:01.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.726+0000 7ff1cbc87800 1 -- 172.21.15.102:0/1152589720 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e2fd80c40 con 0x559e2fd761b0 2024-09-13T19:18:01.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.726+0000 7ff0adffb640 1 -- 172.21.15.102:0/1152589720 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff1c4023020 con 0x559e2fd761b0 2024-09-13T19:18:01.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.727+0000 7ff0adffb640 1 --2- 172.21.15.102:0/1152589720 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff0a0036b40 0x7ff0a0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.727+0000 7ff0adffb640 1 -- 172.21.15.102:0/1152589720 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7ff1c404c3d0 con 0x559e2fd761b0 2024-09-13T19:18:01.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.727+0000 7ff1c3fff640 1 --2- 172.21.15.102:0/1152589720 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff0a0036b40 0x7ff0a0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.727+0000 7ff1cbc87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:18:01.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.727+0000 7ff1cbc87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:18:01.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.727+0000 7ff1c3fff640 1 --2- 172.21.15.102:0/1152589720 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff0a0036b40 0x7ff0a0039000 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4057000 tx=0x7ff1b4052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.727+0000 7ff1cbc87800 1 Processor -- start 2024-09-13T19:18:01.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.727+0000 7ff1cbc87800 1 -- start start 2024-09-13T19:18:01.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.728+0000 7ff1cbc87800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e2fd977d0 0x559e2fd97bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.728+0000 7ff1cbc87800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559e2fd62750 con 0x559e2fd977d0 2024-09-13T19:18:01.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.728+0000 7ff1c977b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e2fd977d0 0x559e2fd97bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.728+0000 7ff1c977b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e2fd977d0 0x559e2fd97bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49406/0 (socket says 172.21.15.102:49406) 2024-09-13T19:18:01.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.728+0000 7ff1c977b640 1 -- 172.21.15.102:0/4115467621 learned_addr learned my addr 172.21.15.102:0/4115467621 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:01.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.728+0000 7ff1c977b640 1 -- 172.21.15.102:0/4115467621 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e2fd981c0 con 0x559e2fd977d0 2024-09-13T19:18:01.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.728+0000 7ff1c977b640 1 --2- 172.21.15.102:0/4115467621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e2fd977d0 0x559e2fd97bf0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc04aec0 tx=0x7ff1bc0169b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.729+0000 7ff08dfe3640 1 -- 172.21.15.102:0/4115467621 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1bc04a070 con 0x559e2fd977d0 2024-09-13T19:18:01.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.729+0000 7ff08dfe3640 1 -- 172.21.15.102:0/4115467621 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1bc02d960 con 0x559e2fd977d0 2024-09-13T19:18:01.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.729+0000 7ff1cbc87800 1 -- 172.21.15.102:0/4115467621 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559e2fd9ae10 con 0x559e2fd977d0 2024-09-13T19:18:01.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.729+0000 7ff08dfe3640 1 -- 172.21.15.102:0/4115467621 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1bc017c50 con 0x559e2fd977d0 2024-09-13T19:18:01.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.729+0000 7ff1cbc87800 1 -- 172.21.15.102:0/4115467621 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e2fd9b1f0 con 0x559e2fd977d0 2024-09-13T19:18:01.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.729+0000 7ff08dfe3640 1 -- 172.21.15.102:0/4115467621 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff1bc01ac50 con 0x559e2fd977d0 2024-09-13T19:18:01.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.730+0000 7ff08dfe3640 1 --2- 172.21.15.102:0/4115467621 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff00c036af0 0x7ff00c038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.730+0000 7ff08dfe3640 1 -- 172.21.15.102:0/4115467621 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7ff1bc042070 con 0x559e2fd977d0 2024-09-13T19:18:01.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.730+0000 7ff1c3fff640 1 --2- 172.21.15.102:0/4115467621 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff00c036af0 0x7ff00c038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.730+0000 7ff0077fe640 20 reqs_thread_entry: start 2024-09-13T19:18:01.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.730+0000 7ff1cbc87800 1 --2- 172.21.15.102:0/3089915017 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x559e2fda51d0 0x559e2fda75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.730+0000 7ff1cbc87800 1 -- 172.21.15.102:0/3089915017 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559e2fda7c60 con 0x559e2fda51d0 2024-09-13T19:18:01.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.730+0000 7ff1c3fff640 1 --2- 172.21.15.102:0/4115467621 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff00c036af0 0x7ff00c038fb0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x559e2fc70340 tx=0x7ff1b4005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.730+0000 7ff1c9f7c640 1 --2- 172.21.15.102:0/3089915017 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x559e2fda51d0 0x559e2fda75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.730+0000 7ff1c9f7c640 1 --2- 172.21.15.102:0/3089915017 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x559e2fda51d0 0x559e2fda75e0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.731+0000 7ff1c9f7c640 1 -- 172.21.15.102:0/3089915017 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1c400e070 con 0x559e2fda51d0 2024-09-13T19:18:01.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.731+0000 7ff1cbc87800 1 -- 172.21.15.102:0/3089915017 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559e2fda8540 con 0x559e2fda51d0 2024-09-13T19:18:01.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.731+0000 7ff1c9f7c640 1 -- 172.21.15.102:0/3089915017 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff1c400e070 con 0x559e2fda51d0 2024-09-13T19:18:01.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.731+0000 7ff1cbc87800 1 --2- 172.21.15.102:0/3089915017 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x559e2fda9e50 0x559e2fdac2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.731+0000 7ff1cbc87800 1 -- 172.21.15.102:0/3089915017 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559e2fdac990 con 0x559e2fda9e50 2024-09-13T19:18:01.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.731+0000 7ff1c977b640 1 --2- 172.21.15.102:0/3089915017 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x559e2fda9e50 0x559e2fdac2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.731+0000 7ff1c977b640 1 --2- 172.21.15.102:0/3089915017 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x559e2fda9e50 0x559e2fdac2a0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.732+0000 7ff1c977b640 1 -- 172.21.15.102:0/3089915017 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff1bc02dd70 con 0x559e2fda9e50 2024-09-13T19:18:01.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.732+0000 7ff1cbc87800 1 -- 172.21.15.102:0/3089915017 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559e2fdb9ad0 con 0x559e2fda51d0 2024-09-13T19:18:01.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.732+0000 7ff1c9f7c640 1 -- 172.21.15.102:0/3089915017 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1c400e070 con 0x559e2fda51d0 2024-09-13T19:18:01.743 INFO:teuthology.orchestra.run.smithi102.stderr:NOTICE: set zone's realm_id= 2024-09-13T19:18:01.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.732+0000 7ff1cbc87800 1 -- 172.21.15.102:0/3089915017 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559e2fdb0e90 con 0x559e2fda9e50 2024-09-13T19:18:01.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.732+0000 7ff1c977b640 1 -- 172.21.15.102:0/3089915017 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1bc02dd70 con 0x559e2fda9e50 2024-09-13T19:18:01.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.732+0000 7ff1c977b640 1 --2- 172.21.15.102:0/3089915017 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7ff1bc017050 0x7ff1bc055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.732+0000 7ff1c977b640 1 -- 172.21.15.102:0/3089915017 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559e2fdb0e90 con 0x7ff1bc017050 2024-09-13T19:18:01.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.732+0000 7ff1c3fff640 1 --2- 172.21.15.102:0/3089915017 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7ff1bc017050 0x7ff1bc055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.733+0000 7ff1c3fff640 1 --2- 172.21.15.102:0/3089915017 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7ff1bc017050 0x7ff1bc055990 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.733+0000 7ff1c3fff640 1 -- 172.21.15.102:0/3089915017 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1b4051070 con 0x7ff1bc017050 2024-09-13T19:18:01.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.733+0000 7ff1c3fff640 1 --2- 172.21.15.102:0/3089915017 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7ff1b4078040 0x7ff1b405f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.733+0000 7ff1c3fff640 1 -- 172.21.15.102:0/3089915017 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559e2fdb0e90 con 0x7ff1b4078040 2024-09-13T19:18:01.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.733+0000 7ff1c9f7c640 1 --2- 172.21.15.102:0/3089915017 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7ff1b4078040 0x7ff1b405f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.734+0000 7ff1c9f7c640 1 --2- 172.21.15.102:0/3089915017 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7ff1b4078040 0x7ff1b405f420 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.734+0000 7ff1c9f7c640 1 -- 172.21.15.102:0/3089915017 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1c400e070 con 0x7ff1b4078040 2024-09-13T19:18:01.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.734+0000 7ff1c9f7c640 1 -- 172.21.15.102:0/3089915017 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559e2fdb0e90 con 0x559e2fda51d0 2024-09-13T19:18:01.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.734+0000 7ff1c9f7c640 1 -- 172.21.15.102:0/3089915017 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1c400e070 con 0x559e2fda51d0 2024-09-13T19:18:01.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.734+0000 7ff1c9f7c640 1 -- 172.21.15.102:0/3089915017 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559e2fdb0e90 con 0x559e2fda51d0 2024-09-13T19:18:01.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.734+0000 7ff1c9f7c640 1 -- 172.21.15.102:0/3089915017 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1c400e070 con 0x559e2fda51d0 2024-09-13T19:18:01.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.734+0000 7ff1c9f7c640 1 -- 172.21.15.102:0/3089915017 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559e2fdb0e90 con 0x7ff1b4078040 2024-09-13T19:18:01.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.735+0000 7ff1c9f7c640 1 -- 172.21.15.102:0/3089915017 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1c400e070 con 0x7ff1b4078040 2024-09-13T19:18:01.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.735+0000 7ff1c9f7c640 1 -- 172.21.15.102:0/3089915017 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559e2fdb0e90 con 0x7ff1b4078040 2024-09-13T19:18:01.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.735+0000 7ff1c9f7c640 1 -- 172.21.15.102:0/3089915017 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1c400e070 con 0x7ff1b4078040 2024-09-13T19:18:01.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.735+0000 7ff1c9f7c640 1 -- 172.21.15.102:0/3089915017 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559e2fdb0e90 con 0x7ff1bc017050 2024-09-13T19:18:01.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.735+0000 7ff1c3fff640 1 -- 172.21.15.102:0/3089915017 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1b4051070 con 0x7ff1bc017050 2024-09-13T19:18:01.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.735+0000 7ff1c3fff640 1 -- 172.21.15.102:0/3089915017 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559e2fdb0e90 con 0x559e2fda9e50 2024-09-13T19:18:01.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.736+0000 7ff1c977b640 1 -- 172.21.15.102:0/3089915017 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1bc02dd70 con 0x559e2fda9e50 2024-09-13T19:18:01.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.736+0000 7ff1c977b640 1 -- 172.21.15.102:0/3089915017 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559e2fdb0e90 con 0x559e2fda51d0 2024-09-13T19:18:01.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.736+0000 7ff1c9f7c640 1 -- 172.21.15.102:0/3089915017 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1c400e070 con 0x559e2fda51d0 2024-09-13T19:18:01.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.736+0000 7ff1c9f7c640 1 -- 172.21.15.102:0/3089915017 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559e2fdb0e90 con 0x7ff1bc017050 2024-09-13T19:18:01.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.736+0000 7ff1c3fff640 1 -- 172.21.15.102:0/3089915017 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1b4051070 con 0x7ff1bc017050 2024-09-13T19:18:01.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.736+0000 7ff1c3fff640 1 -- 172.21.15.102:0/3089915017 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559e2fdb0e90 con 0x559e2fda51d0 2024-09-13T19:18:01.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.736+0000 7ff1c9f7c640 1 -- 172.21.15.102:0/3089915017 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1c400e070 con 0x559e2fda51d0 2024-09-13T19:18:01.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.736+0000 7ff1c9f7c640 1 -- 172.21.15.102:0/3089915017 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559e2fdb0e90 con 0x7ff1bc017050 2024-09-13T19:18:01.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.737+0000 7ff1c3fff640 1 -- 172.21.15.102:0/3089915017 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(17 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff1b4051070 con 0x7ff1bc017050 2024-09-13T19:18:01.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.737+0000 7ff1c3fff640 1 -- 172.21.15.102:0/3089915017 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559e2fdb0e90 con 0x559e2fda9e50 2024-09-13T19:18:01.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.737+0000 7ff1c977b640 1 -- 172.21.15.102:0/3089915017 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(18 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1bc02dd70 con 0x559e2fda9e50 2024-09-13T19:18:01.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.737+0000 7ff1c977b640 1 -- 172.21.15.102:0/3089915017 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559e2fdb0e90 con 0x559e2fda9e50 2024-09-13T19:18:01.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.737+0000 7ff1c977b640 1 -- 172.21.15.102:0/3089915017 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(19 [pgnls start_epoch 36 out=107b] v34'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff1bc02dd70 con 0x559e2fda9e50 2024-09-13T19:18:01.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.737+0000 7ff1c977b640 1 -- 172.21.15.102:0/3089915017 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559e2fdb0e90 con 0x7ff1b4078040 2024-09-13T19:18:01.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.738+0000 7ff1c9f7c640 1 -- 172.21.15.102:0/3089915017 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1c400e070 con 0x7ff1b4078040 2024-09-13T19:18:01.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.738+0000 7ff1c9f7c640 1 -- 172.21.15.102:0/3089915017 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559e2fdb0e90 con 0x559e2fda9e50 2024-09-13T19:18:01.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.738+0000 7ff1c977b640 1 -- 172.21.15.102:0/3089915017 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(21 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff1bc02dd70 con 0x559e2fda9e50 2024-09-13T19:18:01.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.738+0000 7ff1c977b640 1 -- 172.21.15.102:0/3089915017 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559e2fdb0e90 con 0x559e2fda9e50 2024-09-13T19:18:01.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.738+0000 7ff1c977b640 1 -- 172.21.15.102:0/3089915017 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1bc02dd70 con 0x559e2fda9e50 2024-09-13T19:18:01.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.738+0000 7ff1c977b640 1 -- 172.21.15.102:0/3089915017 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559e2fdb0e90 con 0x559e2fda51d0 2024-09-13T19:18:01.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.738+0000 7ff1c9f7c640 1 -- 172.21.15.102:0/3089915017 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1c400e070 con 0x559e2fda51d0 2024-09-13T19:18:01.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.738+0000 7ff1c9f7c640 1 -- 172.21.15.102:0/3089915017 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559e2fdb0e90 con 0x559e2fda51d0 2024-09-13T19:18:01.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.738+0000 7ff1c9f7c640 1 -- 172.21.15.102:0/3089915017 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=74b] v27'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff1c400e070 con 0x559e2fda51d0 2024-09-13T19:18:01.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.738+0000 7ff1c9f7c640 1 -- 172.21.15.102:0/3089915017 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559e2fdb0e90 con 0x7ff1b4078040 2024-09-13T19:18:01.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.739+0000 7ff1c9f7c640 1 -- 172.21.15.102:0/3089915017 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(25 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1c400e070 con 0x7ff1b4078040 2024-09-13T19:18:01.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.739+0000 7ff1c9f7c640 1 -- 172.21.15.102:0/3089915017 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559e2fdb0e90 con 0x559e2fda9e50 2024-09-13T19:18:01.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.739+0000 7ff1c977b640 1 -- 172.21.15.102:0/3089915017 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1bc02dd70 con 0x559e2fda9e50 2024-09-13T19:18:01.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.739+0000 7ff1c977b640 1 -- 172.21.15.102:0/3089915017 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559e2fdb0e90 con 0x7ff1bc017050 2024-09-13T19:18:01.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.739+0000 7ff1c3fff640 1 -- 172.21.15.102:0/3089915017 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1b4051070 con 0x7ff1bc017050 2024-09-13T19:18:01.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.739+0000 7ff1c3fff640 1 -- 172.21.15.102:0/3089915017 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559e2fdb0e90 con 0x559e2fda51d0 2024-09-13T19:18:01.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.739+0000 7ff1c9f7c640 1 -- 172.21.15.102:0/3089915017 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1c400e070 con 0x559e2fda51d0 2024-09-13T19:18:01.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.739+0000 7ff1c9f7c640 1 -- 172.21.15.102:0/3089915017 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559e2fdb0e90 con 0x7ff1bc017050 2024-09-13T19:18:01.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.740+0000 7ff1c3fff640 1 -- 172.21.15.102:0/3089915017 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1b4051070 con 0x7ff1bc017050 2024-09-13T19:18:01.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.740+0000 7ff1c3fff640 1 -- 172.21.15.102:0/3089915017 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559e2fdb0e90 con 0x559e2fda9e50 2024-09-13T19:18:01.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.740+0000 7ff1c977b640 1 -- 172.21.15.102:0/3089915017 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1bc02dd70 con 0x559e2fda9e50 2024-09-13T19:18:01.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.740+0000 7ff1c977b640 1 -- 172.21.15.102:0/3089915017 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559e2fdb0e90 con 0x7ff1b4078040 2024-09-13T19:18:01.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.740+0000 7ff1c9f7c640 1 -- 172.21.15.102:0/3089915017 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1c400e070 con 0x7ff1b4078040 2024-09-13T19:18:01.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.740+0000 7ff1c9f7c640 1 -- 172.21.15.102:0/3089915017 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559e2fdb0e90 con 0x7ff1bc017050 2024-09-13T19:18:01.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.740+0000 7ff1c3fff640 1 -- 172.21.15.102:0/3089915017 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1b4051070 con 0x7ff1bc017050 2024-09-13T19:18:01.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.740+0000 7ff1c3fff640 1 -- 172.21.15.102:0/3089915017 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559e2fdb0e90 con 0x559e2fda9e50 2024-09-13T19:18:01.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.741+0000 7ff1c977b640 1 -- 172.21.15.102:0/3089915017 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1bc02dd70 con 0x559e2fda9e50 2024-09-13T19:18:01.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.741+0000 7ff1c977b640 1 -- 172.21.15.102:0/3089915017 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559e2fdb0e90 con 0x7ff1b4078040 2024-09-13T19:18:01.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.741+0000 7ff1c9f7c640 1 -- 172.21.15.102:0/3089915017 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1c400e070 con 0x7ff1b4078040 2024-09-13T19:18:01.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.741+0000 7ff1c9f7c640 1 -- 172.21.15.102:0/3089915017 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559e2fdb0e90 con 0x559e2fda51d0 2024-09-13T19:18:01.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.741+0000 7ff1c9f7c640 1 -- 172.21.15.102:0/3089915017 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(35 [pgnls start_epoch 36 out=115b] v27'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff1c400e070 con 0x559e2fda51d0 2024-09-13T19:18:01.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.741+0000 7ff1c9f7c640 1 -- 172.21.15.102:0/3089915017 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559e2fdb0e90 con 0x7ff1bc017050 2024-09-13T19:18:01.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.742+0000 7ff1c3fff640 1 -- 172.21.15.102:0/3089915017 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(36 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1b4051070 con 0x7ff1bc017050 2024-09-13T19:18:01.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.742+0000 7ff1cbc87800 1 -- 172.21.15.102:0/3089915017 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559e2fdb3940 con 0x559e2fda51d0 2024-09-13T19:18:01.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.742+0000 7ff1c9f7c640 1 -- 172.21.15.102:0/3089915017 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff1c400e070 con 0x559e2fda51d0 2024-09-13T19:18:01.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.742+0000 7ff1cbc87800 1 -- 172.21.15.102:0/3089915017 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:38 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559e2fdb79a0 con 0x559e2fda9e50 2024-09-13T19:18:01.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.742+0000 7ff1c977b640 1 -- 172.21.15.102:0/3089915017 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(38 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff1bc02dd70 con 0x559e2fda9e50 2024-09-13T19:18:01.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.742+0000 7ff1cbc87800 1 -- 172.21.15.102:0/3089915017 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:39 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [create,call version.set in=58b,writefull 0~1155 in=1155b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559e2fda9160 con 0x559e2fda9e50 2024-09-13T19:18:01.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.743+0000 7ff1c977b640 1 -- 172.21.15.102:0/3089915017 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(39 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [create,call,writefull 0~1155] v36'3 uv3 ondisk = 0) ==== 274+0+0 (crc 0 0 0) 0x7ff1bc02dd70 con 0x559e2fda9e50 2024-09-13T19:18:01.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.743+0000 7ff1cbc87800 1 -- 172.21.15.102:0/3089915017 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559e2fdb6320 con 0x559e2fda51d0 2024-09-13T19:18:01.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.745+0000 7ff1c9f7c640 1 -- 172.21.15.102:0/3089915017 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v36'3 uv3 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7ff1c400e070 con 0x559e2fda51d0 2024-09-13T19:18:01.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.745+0000 7ff1cbc87800 1 -- 172.21.15.102:0/3089915017 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559e2fdb3dc0 con 0x559e2fda51d0 2024-09-13T19:18:01.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.746+0000 7ff1c9f7c640 1 -- 172.21.15.102:0/3089915017 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v36'2 uv1 ondisk = -17 ((17) File exists)) ==== 199+0+0 (crc 0 0 0) 0x7ff1c400e070 con 0x559e2fda51d0 2024-09-13T19:18:01.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.747+0000 7ff1cbc87800 1 -- 172.21.15.102:0/1152589720 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff0a0036b40 msgr2=0x7ff0a0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.747+0000 7ff1cbc87800 1 --2- 172.21.15.102:0/1152589720 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff0a0036b40 0x7ff0a0039000 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4057000 tx=0x7ff1b4052000 comp rx=0 tx=0).stop 2024-09-13T19:18:01.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.747+0000 7ff1cbc87800 1 -- 172.21.15.102:0/1152589720 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e2fd761b0 msgr2=0x559e2fd7d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.747+0000 7ff1cbc87800 1 --2- 172.21.15.102:0/1152589720 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e2fd761b0 0x559e2fd7d7c0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7ff1c400a930 tx=0x7ff1c4003370 comp rx=0 tx=0).stop 2024-09-13T19:18:01.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.747+0000 7ff1cbc87800 1 -- 172.21.15.102:0/1152589720 shutdown_connections 2024-09-13T19:18:01.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.747+0000 7ff1cbc87800 1 --2- 172.21.15.102:0/1152589720 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff0a0036b40 0x7ff0a0039000 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.747+0000 7ff1cbc87800 1 --2- 172.21.15.102:0/1152589720 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e2fd761b0 0x559e2fd7d7c0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.747+0000 7ff1cbc87800 1 -- 172.21.15.102:0/1152589720 >> 172.21.15.102:0/1152589720 conn(0x559e2fc73980 msgr2=0x559e2fd71500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:01.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.747+0000 7ff1cbc87800 1 -- 172.21.15.102:0/1152589720 shutdown_connections 2024-09-13T19:18:01.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.747+0000 7ff1cbc87800 1 -- 172.21.15.102:0/1152589720 wait complete. 2024-09-13T19:18:01.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.747+0000 7ff1cbc87800 1 -- 172.21.15.102:0/4115467621 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff00c036af0 msgr2=0x7ff00c038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.747+0000 7ff1cbc87800 1 --2- 172.21.15.102:0/4115467621 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff00c036af0 0x7ff00c038fb0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x559e2fc70340 tx=0x7ff1b4005a00 comp rx=0 tx=0).stop 2024-09-13T19:18:01.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.747+0000 7ff1cbc87800 1 -- 172.21.15.102:0/4115467621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e2fd977d0 msgr2=0x559e2fd97bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.747+0000 7ff1cbc87800 1 --2- 172.21.15.102:0/4115467621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e2fd977d0 0x559e2fd97bf0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc04aec0 tx=0x7ff1bc0169b0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.747+0000 7ff1cbc87800 1 -- 172.21.15.102:0/4115467621 shutdown_connections 2024-09-13T19:18:01.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.747+0000 7ff1cbc87800 1 --2- 172.21.15.102:0/4115467621 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff00c036af0 0x7ff00c038fb0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.747+0000 7ff1cbc87800 1 --2- 172.21.15.102:0/4115467621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e2fd977d0 0x559e2fd97bf0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.747+0000 7ff1cbc87800 1 -- 172.21.15.102:0/4115467621 >> 172.21.15.102:0/4115467621 conn(0x559e2fd8c730 msgr2=0x559e2fd8eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:01.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.747+0000 7ff1cbc87800 1 -- 172.21.15.102:0/4115467621 shutdown_connections 2024-09-13T19:18:01.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.747+0000 7ff1cbc87800 1 -- 172.21.15.102:0/4115467621 wait complete. 2024-09-13T19:18:01.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.747+0000 7ff1cbc87800 1 -- 172.21.15.102:0/3089915017 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7ff1b4078040 msgr2=0x7ff1b405f420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.747+0000 7ff1cbc87800 1 --2- 172.21.15.102:0/3089915017 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7ff1b4078040 0x7ff1b405f420 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.747+0000 7ff1cbc87800 1 -- 172.21.15.102:0/3089915017 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x559e2fda51d0 msgr2=0x559e2fda75e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.747+0000 7ff1cbc87800 1 --2- 172.21.15.102:0/3089915017 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x559e2fda51d0 0x559e2fda75e0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.747+0000 7ff1cbc87800 1 -- 172.21.15.102:0/3089915017 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7ff1bc017050 msgr2=0x7ff1bc055990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.747+0000 7ff1cbc87800 1 --2- 172.21.15.102:0/3089915017 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7ff1bc017050 0x7ff1bc055990 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.748+0000 7ff1cbc87800 1 -- 172.21.15.102:0/3089915017 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x559e2fda9e50 msgr2=0x559e2fdac2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.748+0000 7ff1cbc87800 1 --2- 172.21.15.102:0/3089915017 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x559e2fda9e50 0x559e2fdac2a0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.748+0000 7ff1cbc87800 1 -- 172.21.15.102:0/3089915017 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff0b0036b40 msgr2=0x7ff0b0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.748+0000 7ff1cbc87800 1 --2- 172.21.15.102:0/3089915017 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff0b0036b40 0x7ff0b0039000 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc00c010 tx=0x7ff1bc024ec0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.748+0000 7ff1c9f7c640 1 -- 172.21.15.102:0/3089915017 reap_dead start 2024-09-13T19:18:01.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.748+0000 7ff1cbc87800 1 -- 172.21.15.102:0/3089915017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e2fc6f540 msgr2=0x559e2fd5fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.748+0000 7ff1cbc87800 1 --2- 172.21.15.102:0/3089915017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e2fc6f540 0x559e2fd5fed0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc00b7c0 tx=0x7ff1bc000ed0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.748+0000 7ff1cbc87800 1 -- 172.21.15.102:0/3089915017 shutdown_connections 2024-09-13T19:18:01.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.748+0000 7ff1cbc87800 1 --2- 172.21.15.102:0/3089915017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e2fc6f540 0x559e2fd5fed0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.748+0000 7ff1cbc87800 1 -- 172.21.15.102:0/3089915017 >> 172.21.15.102:0/3089915017 conn(0x559e2fc6add0 msgr2=0x559e2fd589c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:01.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.748+0000 7ff1cbc87800 1 -- 172.21.15.102:0/3089915017 shutdown_connections 2024-09-13T19:18:01.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.748+0000 7ff1cbc87800 1 -- 172.21.15.102:0/3089915017 wait complete. 2024-09-13T19:18:01.759 INFO:teuthology.orchestra.run.smithi102.stdout:{"id":"509740b4-c081-4f37-bd6d-df9ca851489b","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-13T19:18:01.760 DEBUG:tasks.util.rgw: json result: {'id': '509740b4-c081-4f37-bd6d-df9ca851489b', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-13T19:18:01.760 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2024-09-13T19:18:01.760 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2024-09-13T19:18:01.760 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2024-09-13T19:18:01.842 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:18:01.842 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:18:01.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.840+0000 7f03a0742800 1 Processor -- start 2024-09-13T19:18:01.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.840+0000 7f03a0742800 1 -- start start 2024-09-13T19:18:01.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.840+0000 7f03a0742800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x563cafbbf8f0 0x563cafbc1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.840+0000 7f03a0742800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563cafa7bb30 con 0x563cafbbb4b0 2024-09-13T19:18:01.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.840+0000 7f03a0742800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x563cafa5d360 con 0x563cafbbf8f0 2024-09-13T19:18:01.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.840+0000 7f0393fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x563cafbbf8f0 0x563cafbc1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.840+0000 7f039c497640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x563cafbbb4b0 0x563cafbbb8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:53642/0 (socket says 172.21.15.102:53642) 2024-09-13T19:18:01.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.840+0000 7f039c497640 1 -- 172.21.15.102:0/349309305 learned_addr learned my addr 172.21.15.102:0/349309305 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:18:01.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.840+0000 7f0393fff640 1 --2- 172.21.15.102:0/349309305 >> v2:172.21.15.53:3300/0 conn(0x563cafbbf8f0 0x563cafbc1ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49418/0 (socket says 172.21.15.102:49418) 2024-09-13T19:18:01.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.841+0000 7f0393fff640 1 -- 172.21.15.102:0/349309305 >> v1:172.21.15.53:6789/0 conn(0x563cafbbb4b0 legacy=0x563cafbbb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.841+0000 7f0393fff640 1 -- 172.21.15.102:0/349309305 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cafa83e00 con 0x563cafbbf8f0 2024-09-13T19:18:01.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.843+0000 7f0393fff640 1 --2- 172.21.15.102:0/349309305 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563cafbbf8f0 0x563cafbc1ce0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f038400a470 tx=0x7f0384045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea55f85cbaf4e2be server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.843+0000 7f039bc96640 1 -- 172.21.15.102:0/349309305 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0384053570 con 0x563cafbbf8f0 2024-09-13T19:18:01.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.843+0000 7f039bc96640 1 -- 172.21.15.102:0/349309305 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0384058070 con 0x563cafbbf8f0 2024-09-13T19:18:01.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.843+0000 7f039bc96640 1 -- 172.21.15.102:0/349309305 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0384053880 con 0x563cafbbf8f0 2024-09-13T19:18:01.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.843+0000 7f03a0742800 1 -- 172.21.15.102:0/349309305 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563cafbbf8f0 msgr2=0x563cafbc1ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.843+0000 7f03a0742800 1 --2- 172.21.15.102:0/349309305 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563cafbbf8f0 0x563cafbc1ce0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f038400a470 tx=0x7f0384045a20 comp rx=0 tx=0).stop 2024-09-13T19:18:01.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.843+0000 7f03a0742800 1 -- 172.21.15.102:0/349309305 shutdown_connections 2024-09-13T19:18:01.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.843+0000 7f03a0742800 1 --2- 172.21.15.102:0/349309305 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563cafbbf8f0 0x563cafbc1ce0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.843+0000 7f03a0742800 1 -- 172.21.15.102:0/349309305 >> 172.21.15.102:0/349309305 conn(0x563cafbb6de0 msgr2=0x563cafbb9200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:01.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.843+0000 7f03a0742800 1 -- 172.21.15.102:0/349309305 shutdown_connections 2024-09-13T19:18:01.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.843+0000 7f03a0742800 1 -- 172.21.15.102:0/349309305 wait complete. 2024-09-13T19:18:01.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.857+0000 7f03a0742800 1 Processor -- start 2024-09-13T19:18:01.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.857+0000 7f03a0742800 1 -- start start 2024-09-13T19:18:01.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.857+0000 7f03a0742800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563cafbbb4b0 0x563cafcaa740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.857+0000 7f03a0742800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563cafb08320 con 0x563cafbbb4b0 2024-09-13T19:18:01.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.858+0000 7f039c497640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563cafbbb4b0 0x563cafcaa740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.858+0000 7f039c497640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563cafbbb4b0 0x563cafcaa740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49434/0 (socket says 172.21.15.102:49434) 2024-09-13T19:18:01.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.858+0000 7f039c497640 1 -- 172.21.15.102:0/2421027845 learned_addr learned my addr 172.21.15.102:0/2421027845 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:01.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.858+0000 7f039c497640 1 -- 172.21.15.102:0/2421027845 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cafa55bc0 con 0x563cafbbb4b0 2024-09-13T19:18:01.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.858+0000 7f039c497640 1 --2- 172.21.15.102:0/2421027845 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563cafbbb4b0 0x563cafcaa740 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f038c001e10 tx=0x7f038c00b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d1183c83d80c576 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.858+0000 7f028a60c640 1 -- 172.21.15.102:0/2421027845 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f038c012020 con 0x563cafbbb4b0 2024-09-13T19:18:01.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.858+0000 7f028a60c640 1 -- 172.21.15.102:0/2421027845 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f038c00e5a0 con 0x563cafbbb4b0 2024-09-13T19:18:01.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.858+0000 7f028a60c640 1 -- 172.21.15.102:0/2421027845 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f038c00e8e0 con 0x563cafbbb4b0 2024-09-13T19:18:01.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.859+0000 7f03a0742800 1 -- 172.21.15.102:0/2421027845 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563cafbbb4b0 msgr2=0x563cafcaa740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.859+0000 7f03a0742800 1 --2- 172.21.15.102:0/2421027845 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563cafbbb4b0 0x563cafcaa740 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f038c001e10 tx=0x7f038c00b780 comp rx=0 tx=0).stop 2024-09-13T19:18:01.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.859+0000 7f03a0742800 1 -- 172.21.15.102:0/2421027845 shutdown_connections 2024-09-13T19:18:01.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.859+0000 7f03a0742800 1 --2- 172.21.15.102:0/2421027845 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563cafbbb4b0 0x563cafcaa740 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.859+0000 7f03a0742800 1 -- 172.21.15.102:0/2421027845 >> 172.21.15.102:0/2421027845 conn(0x563cafbb6de0 msgr2=0x563cafca6100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:01.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.859+0000 7f03a0742800 1 -- 172.21.15.102:0/2421027845 shutdown_connections 2024-09-13T19:18:01.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.859+0000 7f03a0742800 1 -- 172.21.15.102:0/2421027845 wait complete. 2024-09-13T19:18:01.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.859+0000 7f03a0742800 1 Processor -- start 2024-09-13T19:18:01.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.859+0000 7f03a0742800 1 -- start start 2024-09-13T19:18:01.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.860+0000 7f03a0742800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563cafbbb4b0 0x563cafcb2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.860+0000 7f03a0742800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563cafbc2520 con 0x563cafbbb4b0 2024-09-13T19:18:01.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.860+0000 7f039c497640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563cafbbb4b0 0x563cafcb2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.860+0000 7f039c497640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563cafbbb4b0 0x563cafcb2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49440/0 (socket says 172.21.15.102:49440) 2024-09-13T19:18:01.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.860+0000 7f039c497640 1 -- 172.21.15.102:0/758408163 learned_addr learned my addr 172.21.15.102:0/758408163 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:01.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.860+0000 7f039c497640 1 -- 172.21.15.102:0/758408163 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cafa69fe0 con 0x563cafbbb4b0 2024-09-13T19:18:01.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.860+0000 7f039c497640 1 --2- 172.21.15.102:0/758408163 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563cafbbb4b0 0x563cafcb2120 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f038c00b7c0 tx=0x7f038c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.861+0000 7f0288e09640 1 -- 172.21.15.102:0/758408163 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f038c012030 con 0x563cafbbb4b0 2024-09-13T19:18:01.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.861+0000 7f0288e09640 1 -- 172.21.15.102:0/758408163 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f038c001470 con 0x563cafbbb4b0 2024-09-13T19:18:01.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.861+0000 7f03a0742800 1 -- 172.21.15.102:0/758408163 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563cafcb2660 con 0x563cafbbb4b0 2024-09-13T19:18:01.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.861+0000 7f0288e09640 1 -- 172.21.15.102:0/758408163 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f038c01a8d0 con 0x563cafbbb4b0 2024-09-13T19:18:01.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.861+0000 7f03a0742800 1 -- 172.21.15.102:0/758408163 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563cafcb2b80 con 0x563cafbbb4b0 2024-09-13T19:18:01.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.861+0000 7f03a0742800 1 Processor -- start 2024-09-13T19:18:01.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.861+0000 7f03a0742800 1 -- start start 2024-09-13T19:18:01.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.862+0000 7f03a0742800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563cafcbeec0 0x563cafcbf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.862+0000 7f03a0742800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563cafa57580 con 0x563cafcbeec0 2024-09-13T19:18:01.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.862+0000 7f0288e09640 1 -- 172.21.15.102:0/758408163 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f038c015020 con 0x563cafbbb4b0 2024-09-13T19:18:01.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.862+0000 7f0288e09640 1 --2- 172.21.15.102:0/758408163 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0284036b90 0x7f0284039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.862+0000 7f039cc98640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563cafcbeec0 0x563cafcbf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.862+0000 7f039cc98640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563cafcbeec0 0x563cafcbf2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49446/0 (socket says 172.21.15.102:49446) 2024-09-13T19:18:01.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.862+0000 7f039cc98640 1 -- 172.21.15.102:0/1247541264 learned_addr learned my addr 172.21.15.102:0/1247541264 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:01.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.862+0000 7f0288e09640 1 -- 172.21.15.102:0/758408163 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f038c020030 con 0x563cafbbb4b0 2024-09-13T19:18:01.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.862+0000 7f039c497640 1 --2- 172.21.15.102:0/758408163 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0284036b90 0x7f0284039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.862+0000 7f039cc98640 1 -- 172.21.15.102:0/1247541264 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cafcbf800 con 0x563cafcbeec0 2024-09-13T19:18:01.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.862+0000 7f039c497640 1 --2- 172.21.15.102:0/758408163 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0284036b90 0x7f0284039050 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f038c000fd0 tx=0x7f038c016e90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.862+0000 7f039cc98640 1 --2- 172.21.15.102:0/1247541264 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563cafcbeec0 0x563cafcbf2c0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f039400a430 tx=0x7f039400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db181c84ab93beac server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.863+0000 7f02827fc640 1 -- 172.21.15.102:0/1247541264 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0394015070 con 0x563cafcbeec0 2024-09-13T19:18:01.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.863+0000 7f02827fc640 1 -- 172.21.15.102:0/1247541264 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0394001670 con 0x563cafcbeec0 2024-09-13T19:18:01.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.863+0000 7f02827fc640 1 -- 172.21.15.102:0/1247541264 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0394001990 con 0x563cafcbeec0 2024-09-13T19:18:01.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.863+0000 7f03a0742800 1 -- 172.21.15.102:0/1247541264 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563cafcbeec0 msgr2=0x563cafcbf2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.863+0000 7f03a0742800 1 --2- 172.21.15.102:0/1247541264 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563cafcbeec0 0x563cafcbf2c0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f039400a430 tx=0x7f039400a8f0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.863+0000 7f03a0742800 1 -- 172.21.15.102:0/1247541264 shutdown_connections 2024-09-13T19:18:01.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.863+0000 7f03a0742800 1 --2- 172.21.15.102:0/1247541264 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563cafcbeec0 0x563cafcbf2c0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.863+0000 7f03a0742800 1 -- 172.21.15.102:0/1247541264 >> 172.21.15.102:0/1247541264 conn(0x563cafbbf8f0 msgr2=0x563cafcba640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:01.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.863+0000 7f03a0742800 1 -- 172.21.15.102:0/1247541264 shutdown_connections 2024-09-13T19:18:01.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.863+0000 7f03a0742800 1 -- 172.21.15.102:0/1247541264 wait complete. 2024-09-13T19:18:01.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.863+0000 7f03a0742800 1 Processor -- start 2024-09-13T19:18:01.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.863+0000 7f03a0742800 1 -- start start 2024-09-13T19:18:01.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.863+0000 7f03a0742800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563cafcbeec0 0x563cafb2fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.863+0000 7f03a0742800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563cafcc01b0 con 0x563cafcbeec0 2024-09-13T19:18:01.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.864+0000 7f039cc98640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563cafcbeec0 0x563cafb2fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.864+0000 7f039cc98640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563cafcbeec0 0x563cafb2fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49456/0 (socket says 172.21.15.102:49456) 2024-09-13T19:18:01.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.864+0000 7f039cc98640 1 -- 172.21.15.102:0/3116628649 learned_addr learned my addr 172.21.15.102:0/3116628649 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:01.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.864+0000 7f039cc98640 1 -- 172.21.15.102:0/3116628649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cafcc7f80 con 0x563cafcbeec0 2024-09-13T19:18:01.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.864+0000 7f039cc98640 1 --2- 172.21.15.102:0/3116628649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563cafcbeec0 0x563cafb2fd90 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f0394013040 tx=0x7f0394003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.864+0000 7f0280ff9640 1 -- 172.21.15.102:0/3116628649 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0394020020 con 0x563cafcbeec0 2024-09-13T19:18:01.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.864+0000 7f0280ff9640 1 -- 172.21.15.102:0/3116628649 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03940108e0 con 0x563cafcbeec0 2024-09-13T19:18:01.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.864+0000 7f0280ff9640 1 -- 172.21.15.102:0/3116628649 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0394015040 con 0x563cafcbeec0 2024-09-13T19:18:01.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.864+0000 7f03a0742800 1 -- 172.21.15.102:0/3116628649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563cafccc590 con 0x563cafcbeec0 2024-09-13T19:18:01.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.864+0000 7f03a0742800 1 -- 172.21.15.102:0/3116628649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563cafccca30 con 0x563cafcbeec0 2024-09-13T19:18:01.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.865+0000 7f0280ff9640 1 -- 172.21.15.102:0/3116628649 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0394023020 con 0x563cafcbeec0 2024-09-13T19:18:01.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.865+0000 7f0280ff9640 1 --2- 172.21.15.102:0/3116628649 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0274036b40 0x7f0274039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.865+0000 7f0280ff9640 1 -- 172.21.15.102:0/3116628649 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f039404c3e0 con 0x563cafcbeec0 2024-09-13T19:18:01.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.866+0000 7f0393fff640 1 --2- 172.21.15.102:0/3116628649 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0274036b40 0x7f0274039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.866+0000 7f03a0742800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:18:01.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.866+0000 7f03a0742800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:18:01.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.866+0000 7f03a0742800 1 Processor -- start 2024-09-13T19:18:01.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.866+0000 7f0393fff640 1 --2- 172.21.15.102:0/3116628649 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0274036b40 0x7f0274039000 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0384057000 tx=0x7f0384052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.866+0000 7f03a0742800 1 -- start start 2024-09-13T19:18:01.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.866+0000 7f03a0742800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563cafce36c0 0x563cafce3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.866+0000 7f03a0742800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563cafcaaef0 con 0x563cafce36c0 2024-09-13T19:18:01.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.866+0000 7f039c497640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563cafce36c0 0x563cafce3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.867+0000 7f039c497640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563cafce36c0 0x563cafce3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49458/0 (socket says 172.21.15.102:49458) 2024-09-13T19:18:01.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.867+0000 7f039c497640 1 -- 172.21.15.102:0/2530288882 learned_addr learned my addr 172.21.15.102:0/2530288882 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:01.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.867+0000 7f039c497640 1 -- 172.21.15.102:0/2530288882 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cafce40b0 con 0x563cafce36c0 2024-09-13T19:18:01.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.867+0000 7f039c497640 1 --2- 172.21.15.102:0/2530288882 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563cafce36c0 0x563cafce3ae0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f038c00bcd0 tx=0x7f038c0169b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.867+0000 7f02617e2640 1 -- 172.21.15.102:0/2530288882 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f038c04a070 con 0x563cafce36c0 2024-09-13T19:18:01.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.867+0000 7f02617e2640 1 -- 172.21.15.102:0/2530288882 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f038c024610 con 0x563cafce36c0 2024-09-13T19:18:01.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.867+0000 7f03a0742800 1 -- 172.21.15.102:0/2530288882 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563cafce6d00 con 0x563cafce36c0 2024-09-13T19:18:01.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.867+0000 7f02617e2640 1 -- 172.21.15.102:0/2530288882 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f038c017c50 con 0x563cafce36c0 2024-09-13T19:18:01.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.867+0000 7f03a0742800 1 -- 172.21.15.102:0/2530288882 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563cafce70e0 con 0x563cafce36c0 2024-09-13T19:18:01.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.868+0000 7f02617e2640 1 -- 172.21.15.102:0/2530288882 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f038c02d960 con 0x563cafce36c0 2024-09-13T19:18:01.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.868+0000 7f02617e2640 1 --2- 172.21.15.102:0/2530288882 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f01d4036b40 0x7f01d4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.868+0000 7f02617e2640 1 -- 172.21.15.102:0/2530288882 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f038c042070 con 0x563cafce36c0 2024-09-13T19:18:01.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.868+0000 7f0393fff640 1 --2- 172.21.15.102:0/2530288882 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f01d4036b40 0x7f01d4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.869+0000 7f025affd640 20 reqs_thread_entry: start 2024-09-13T19:18:01.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.869+0000 7f0393fff640 1 --2- 172.21.15.102:0/2530288882 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f01d4036b40 0x7f01d4039000 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x563cafbbc2b0 tx=0x7f0384005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.869+0000 7f03a0742800 1 --2- 172.21.15.102:0/758408163 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563cafcf10c0 0x563cafcf34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.869+0000 7f03a0742800 1 -- 172.21.15.102:0/758408163 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563cafcf3b80 con 0x563cafcf10c0 2024-09-13T19:18:01.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.869+0000 7f039cc98640 1 --2- 172.21.15.102:0/758408163 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563cafcf10c0 0x563cafcf34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.869+0000 7f039cc98640 1 --2- 172.21.15.102:0/758408163 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563cafcf10c0 0x563cafcf34d0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.869+0000 7f039cc98640 1 -- 172.21.15.102:0/758408163 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f039400e070 con 0x563cafcf10c0 2024-09-13T19:18:01.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.869+0000 7f03a0742800 1 -- 172.21.15.102:0/758408163 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563cafcf4460 con 0x563cafcf10c0 2024-09-13T19:18:01.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.870+0000 7f039cc98640 1 -- 172.21.15.102:0/758408163 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f039400e070 con 0x563cafcf10c0 2024-09-13T19:18:01.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.870+0000 7f03a0742800 1 --2- 172.21.15.102:0/758408163 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563cafcf5d70 0x563cafcf81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.870+0000 7f03a0742800 1 -- 172.21.15.102:0/758408163 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563cafcf88d0 con 0x563cafcf5d70 2024-09-13T19:18:01.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.870+0000 7f039c497640 1 --2- 172.21.15.102:0/758408163 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563cafcf5d70 0x563cafcf81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.870+0000 7f039c497640 1 --2- 172.21.15.102:0/758408163 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563cafcf5d70 0x563cafcf81e0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.870+0000 7f039c497640 1 -- 172.21.15.102:0/758408163 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f038c04cac0 con 0x563cafcf5d70 2024-09-13T19:18:01.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.871+0000 7f03a0742800 1 -- 172.21.15.102:0/3116628649 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0274036b40 msgr2=0x7f0274039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.871+0000 7f03a0742800 1 --2- 172.21.15.102:0/3116628649 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0274036b40 0x7f0274039000 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0384057000 tx=0x7f0384052000 comp rx=0 tx=0).stop 2024-09-13T19:18:01.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.871+0000 7f03a0742800 1 -- 172.21.15.102:0/3116628649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563cafcbeec0 msgr2=0x563cafb2fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.871+0000 7f03a0742800 1 --2- 172.21.15.102:0/3116628649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563cafcbeec0 0x563cafb2fd90 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f0394013040 tx=0x7f0394003370 comp rx=0 tx=0).stop 2024-09-13T19:18:01.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.871+0000 7f03a0742800 1 -- 172.21.15.102:0/3116628649 shutdown_connections 2024-09-13T19:18:01.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.871+0000 7f03a0742800 1 --2- 172.21.15.102:0/3116628649 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0274036b40 0x7f0274039000 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.871+0000 7f03a0742800 1 --2- 172.21.15.102:0/3116628649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563cafcbeec0 0x563cafb2fd90 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.871+0000 7f03a0742800 1 -- 172.21.15.102:0/3116628649 >> 172.21.15.102:0/3116628649 conn(0x563cafbbf8f0 msgr2=0x563cafcba210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:01.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.871+0000 7f03a0742800 1 -- 172.21.15.102:0/3116628649 shutdown_connections 2024-09-13T19:18:01.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.871+0000 7f03a0742800 1 -- 172.21.15.102:0/3116628649 wait complete. 2024-09-13T19:18:01.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.871+0000 7f03a0742800 1 -- 172.21.15.102:0/2530288882 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f01d4036b40 msgr2=0x7f01d4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.871+0000 7f03a0742800 1 --2- 172.21.15.102:0/2530288882 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f01d4036b40 0x7f01d4039000 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x563cafbbc2b0 tx=0x7f0384005a00 comp rx=0 tx=0).stop 2024-09-13T19:18:01.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.871+0000 7f03a0742800 1 -- 172.21.15.102:0/2530288882 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563cafce36c0 msgr2=0x563cafce3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.871+0000 7f03a0742800 1 --2- 172.21.15.102:0/2530288882 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563cafce36c0 0x563cafce3ae0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f038c00bcd0 tx=0x7f038c0169b0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.871+0000 7f03a0742800 1 -- 172.21.15.102:0/2530288882 shutdown_connections 2024-09-13T19:18:01.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.871+0000 7f03a0742800 1 --2- 172.21.15.102:0/2530288882 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f01d4036b40 0x7f01d4039000 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.871+0000 7f03a0742800 1 --2- 172.21.15.102:0/2530288882 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563cafce36c0 0x563cafce3ae0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.872+0000 7f03a0742800 1 -- 172.21.15.102:0/2530288882 >> 172.21.15.102:0/2530288882 conn(0x563cafcd85f0 msgr2=0x563cafcdaee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:01.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.872+0000 7f03a0742800 1 -- 172.21.15.102:0/2530288882 shutdown_connections 2024-09-13T19:18:01.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.872+0000 7f03a0742800 1 -- 172.21.15.102:0/2530288882 wait complete. 2024-09-13T19:18:01.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.872+0000 7f03a0742800 1 -- 172.21.15.102:0/758408163 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563cafcf10c0 msgr2=0x563cafcf34d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.872+0000 7f03a0742800 1 --2- 172.21.15.102:0/758408163 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563cafcf10c0 0x563cafcf34d0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.872+0000 7f03a0742800 1 -- 172.21.15.102:0/758408163 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563cafcf5d70 msgr2=0x563cafcf81e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.872+0000 7f03a0742800 1 --2- 172.21.15.102:0/758408163 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563cafcf5d70 0x563cafcf81e0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.872+0000 7f03a0742800 1 -- 172.21.15.102:0/758408163 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0284036b90 msgr2=0x7f0284039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.872+0000 7f03a0742800 1 --2- 172.21.15.102:0/758408163 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0284036b90 0x7f0284039050 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f038c000fd0 tx=0x7f038c016e90 comp rx=0 tx=0).stop 2024-09-13T19:18:01.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.872+0000 7f03a0742800 1 -- 172.21.15.102:0/758408163 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563cafbbb4b0 msgr2=0x563cafcb2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.872+0000 7f03a0742800 1 --2- 172.21.15.102:0/758408163 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563cafbbb4b0 0x563cafcb2120 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f038c00b7c0 tx=0x7f038c000ed0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.872+0000 7f03a0742800 1 -- 172.21.15.102:0/758408163 shutdown_connections 2024-09-13T19:18:01.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.872+0000 7f03a0742800 1 --2- 172.21.15.102:0/758408163 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563cafcf5d70 0x563cafcf81e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.872+0000 7f03a0742800 1 --2- 172.21.15.102:0/758408163 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563cafcf10c0 0x563cafcf34d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.872+0000 7f03a0742800 1 --2- 172.21.15.102:0/758408163 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0284036b90 0x7f0284039050 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.872+0000 7f03a0742800 1 --2- 172.21.15.102:0/758408163 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563cafbbb4b0 0x563cafcb2120 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.872+0000 7f03a0742800 1 -- 172.21.15.102:0/758408163 >> 172.21.15.102:0/758408163 conn(0x563cafbb6de0 msgr2=0x563cafca49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:01.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.872+0000 7f03a0742800 1 -- 172.21.15.102:0/758408163 shutdown_connections 2024-09-13T19:18:01.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.872+0000 7f03a0742800 1 -- 172.21.15.102:0/758408163 wait complete. 2024-09-13T19:18:01.884 INFO:teuthology.orchestra.run.smithi102.stdout:{"id":"509740b4-c081-4f37-bd6d-df9ca851489b","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-13T19:18:01.884 DEBUG:tasks.util.rgw: json result: {'id': '509740b4-c081-4f37-bd6d-df9ca851489b', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-13T19:18:01.884 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-13T19:18:01.884 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-13T19:18:01.885 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-13T19:18:01.970 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:18:01.970 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:18:01.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.968+0000 7f3649b28800 1 Processor -- start 2024-09-13T19:18:01.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.968+0000 7f3649b28800 1 -- start start 2024-09-13T19:18:01.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.968+0000 7f3649b28800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x556162c145e0 0x556162c149e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.968+0000 7f3649b28800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556162ad4b30 con 0x556162c14f20 2024-09-13T19:18:01.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.968+0000 7f3649b28800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x556162ab6360 con 0x556162c145e0 2024-09-13T19:18:01.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.968+0000 7f36458b3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x556162c145e0 0x556162c149e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.968+0000 7f36458b3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x556162c145e0 0x556162c149e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49460/0 (socket says 172.21.15.102:49460) 2024-09-13T19:18:01.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.968+0000 7f36450b2640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x556162c14f20 0x556162c19aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:53656/0 (socket says 172.21.15.102:53656) 2024-09-13T19:18:01.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.968+0000 7f36458b3640 1 -- 172.21.15.102:0/1697689307 learned_addr learned my addr 172.21.15.102:0/1697689307 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:01.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.969+0000 7f36458b3640 1 -- 172.21.15.102:0/1697689307 >> v1:172.21.15.53:6789/0 conn(0x556162c14f20 legacy=0x556162c19aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.969+0000 7f36458b3640 1 -- 172.21.15.102:0/1697689307 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556162adce00 con 0x556162c145e0 2024-09-13T19:18:01.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.970+0000 7f36458b3640 1 --2- 172.21.15.102:0/1697689307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556162c145e0 0x556162c149e0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f363800a520 tx=0x7f3638045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f1b6410022084c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.971+0000 7f36448b1640 1 -- 172.21.15.102:0/1697689307 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3638055070 con 0x556162c145e0 2024-09-13T19:18:01.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.971+0000 7f36448b1640 1 -- 172.21.15.102:0/1697689307 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36380515b0 con 0x556162c145e0 2024-09-13T19:18:01.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.971+0000 7f36448b1640 1 -- 172.21.15.102:0/1697689307 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36380518d0 con 0x556162c145e0 2024-09-13T19:18:01.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.971+0000 7f3649b28800 1 -- 172.21.15.102:0/1697689307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556162c145e0 msgr2=0x556162c149e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.971+0000 7f3649b28800 1 --2- 172.21.15.102:0/1697689307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556162c145e0 0x556162c149e0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f363800a520 tx=0x7f3638045ba0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.971+0000 7f3649b28800 1 -- 172.21.15.102:0/1697689307 shutdown_connections 2024-09-13T19:18:01.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.971+0000 7f3649b28800 1 --2- 172.21.15.102:0/1697689307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556162c145e0 0x556162c149e0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.971+0000 7f3649b28800 1 -- 172.21.15.102:0/1697689307 >> 172.21.15.102:0/1697689307 conn(0x556162c0fe90 msgr2=0x556162c122b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:01.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.971+0000 7f3649b28800 1 -- 172.21.15.102:0/1697689307 shutdown_connections 2024-09-13T19:18:01.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.971+0000 7f3649b28800 1 -- 172.21.15.102:0/1697689307 wait complete. 2024-09-13T19:18:01.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.985+0000 7f3649b28800 1 Processor -- start 2024-09-13T19:18:01.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.985+0000 7f3649b28800 1 -- start start 2024-09-13T19:18:01.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.985+0000 7f3649b28800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556162c145e0 0x556162d03870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.985+0000 7f3649b28800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556162b61350 con 0x556162c145e0 2024-09-13T19:18:01.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.985+0000 7f36458b3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556162c145e0 0x556162d03870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.985+0000 7f36458b3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556162c145e0 0x556162d03870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49464/0 (socket says 172.21.15.102:49464) 2024-09-13T19:18:01.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.985+0000 7f36458b3640 1 -- 172.21.15.102:0/2104380421 learned_addr learned my addr 172.21.15.102:0/2104380421 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:01.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.986+0000 7f36458b3640 1 -- 172.21.15.102:0/2104380421 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556162aaebc0 con 0x556162c145e0 2024-09-13T19:18:01.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.986+0000 7f36458b3640 1 --2- 172.21.15.102:0/2104380421 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556162c145e0 0x556162d03870 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f3638025da0 tx=0x7f3638051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dc97cb93714afd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.986+0000 7f3533e07640 1 -- 172.21.15.102:0/2104380421 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3638051950 con 0x556162c145e0 2024-09-13T19:18:01.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.986+0000 7f3533e07640 1 -- 172.21.15.102:0/2104380421 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3638051af0 con 0x556162c145e0 2024-09-13T19:18:01.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.986+0000 7f3533e07640 1 -- 172.21.15.102:0/2104380421 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3638051dd0 con 0x556162c145e0 2024-09-13T19:18:01.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.987+0000 7f3649b28800 1 -- 172.21.15.102:0/2104380421 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556162c145e0 msgr2=0x556162d03870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.987+0000 7f3649b28800 1 --2- 172.21.15.102:0/2104380421 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556162c145e0 0x556162d03870 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f3638025da0 tx=0x7f3638051000 comp rx=0 tx=0).stop 2024-09-13T19:18:01.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.987+0000 7f3649b28800 1 -- 172.21.15.102:0/2104380421 shutdown_connections 2024-09-13T19:18:01.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.987+0000 7f3649b28800 1 --2- 172.21.15.102:0/2104380421 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556162c145e0 0x556162d03870 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.987+0000 7f3649b28800 1 -- 172.21.15.102:0/2104380421 >> 172.21.15.102:0/2104380421 conn(0x556162c0fe90 msgr2=0x556162cff230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:01.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.987+0000 7f3649b28800 1 -- 172.21.15.102:0/2104380421 shutdown_connections 2024-09-13T19:18:01.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.987+0000 7f3649b28800 1 -- 172.21.15.102:0/2104380421 wait complete. 2024-09-13T19:18:01.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.987+0000 7f3649b28800 1 Processor -- start 2024-09-13T19:18:01.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.987+0000 7f3649b28800 1 -- start start 2024-09-13T19:18:01.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.987+0000 7f3649b28800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556162c145e0 0x556162b896f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.987+0000 7f3649b28800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556162c1b600 con 0x556162c145e0 2024-09-13T19:18:01.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.988+0000 7f36458b3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556162c145e0 0x556162b896f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.988+0000 7f36458b3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556162c145e0 0x556162b896f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49474/0 (socket says 172.21.15.102:49474) 2024-09-13T19:18:01.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.988+0000 7f36458b3640 1 -- 172.21.15.102:0/3118468716 learned_addr learned my addr 172.21.15.102:0/3118468716 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:01.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.988+0000 7f36458b3640 1 -- 172.21.15.102:0/3118468716 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556162ac2fe0 con 0x556162c145e0 2024-09-13T19:18:01.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.989+0000 7f36458b3640 1 --2- 172.21.15.102:0/3118468716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556162c145e0 0x556162b896f0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f3638067040 tx=0x7f3638002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.989+0000 7f3532604640 1 -- 172.21.15.102:0/3118468716 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3638073070 con 0x556162c145e0 2024-09-13T19:18:01.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.989+0000 7f3532604640 1 -- 172.21.15.102:0/3118468716 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f363805a450 con 0x556162c145e0 2024-09-13T19:18:01.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.989+0000 7f3649b28800 1 -- 172.21.15.102:0/3118468716 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556162d0cce0 con 0x556162c145e0 2024-09-13T19:18:01.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.989+0000 7f3532604640 1 -- 172.21.15.102:0/3118468716 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f363805a730 con 0x556162c145e0 2024-09-13T19:18:01.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.989+0000 7f3649b28800 1 -- 172.21.15.102:0/3118468716 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556162d116a0 con 0x556162c145e0 2024-09-13T19:18:01.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.989+0000 7f3649b28800 1 Processor -- start 2024-09-13T19:18:01.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.990+0000 7f3649b28800 1 -- start start 2024-09-13T19:18:01.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.990+0000 7f3649b28800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556162d1b240 0x556162d1b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.990+0000 7f3649b28800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556162ab0580 con 0x556162d1b240 2024-09-13T19:18:01.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.990+0000 7f3532604640 1 -- 172.21.15.102:0/3118468716 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3638076070 con 0x556162c145e0 2024-09-13T19:18:01.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.990+0000 7f3532604640 1 --2- 172.21.15.102:0/3118468716 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f352c036b90 0x7f352c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.990+0000 7f36460b4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556162d1b240 0x556162d1b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.990+0000 7f3532604640 1 -- 172.21.15.102:0/3118468716 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f3638062070 con 0x556162c145e0 2024-09-13T19:18:01.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.990+0000 7f36460b4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556162d1b240 0x556162d1b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49488/0 (socket says 172.21.15.102:49488) 2024-09-13T19:18:01.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.990+0000 7f36460b4640 1 -- 172.21.15.102:0/2536806984 learned_addr learned my addr 172.21.15.102:0/2536806984 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:01.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.990+0000 7f36458b3640 1 --2- 172.21.15.102:0/3118468716 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f352c036b90 0x7f352c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.990+0000 7f36460b4640 1 -- 172.21.15.102:0/2536806984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556162d1bb80 con 0x556162d1b240 2024-09-13T19:18:01.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.990+0000 7f36458b3640 1 --2- 172.21.15.102:0/3118468716 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f352c036b90 0x7f352c039050 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3638064930 tx=0x7f3638064a20 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.991+0000 7f36460b4640 1 --2- 172.21.15.102:0/2536806984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556162d1b240 0x556162d1b640 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f364000a430 tx=0x7f364000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de33e03b46c0b81d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.991+0000 7f352bfff640 1 -- 172.21.15.102:0/2536806984 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3640015070 con 0x556162d1b240 2024-09-13T19:18:01.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.991+0000 7f352bfff640 1 -- 172.21.15.102:0/2536806984 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3640001670 con 0x556162d1b240 2024-09-13T19:18:01.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.991+0000 7f352bfff640 1 -- 172.21.15.102:0/2536806984 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3640001990 con 0x556162d1b240 2024-09-13T19:18:01.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.991+0000 7f3649b28800 1 -- 172.21.15.102:0/2536806984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556162d1b240 msgr2=0x556162d1b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:01.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.991+0000 7f3649b28800 1 --2- 172.21.15.102:0/2536806984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556162d1b240 0x556162d1b640 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f364000a430 tx=0x7f364000a8f0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.991+0000 7f3649b28800 1 -- 172.21.15.102:0/2536806984 shutdown_connections 2024-09-13T19:18:01.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.991+0000 7f3649b28800 1 --2- 172.21.15.102:0/2536806984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556162d1b240 0x556162d1b640 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:01.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.991+0000 7f3649b28800 1 -- 172.21.15.102:0/2536806984 >> 172.21.15.102:0/2536806984 conn(0x556162c14f20 msgr2=0x556162d169c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:01.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.991+0000 7f3649b28800 1 -- 172.21.15.102:0/2536806984 shutdown_connections 2024-09-13T19:18:01.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.991+0000 7f3649b28800 1 -- 172.21.15.102:0/2536806984 wait complete. 2024-09-13T19:18:01.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.991+0000 7f3649b28800 1 Processor -- start 2024-09-13T19:18:01.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.992+0000 7f3649b28800 1 -- start start 2024-09-13T19:18:01.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.992+0000 7f3649b28800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556162d1b240 0x556162d227e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:01.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.992+0000 7f3649b28800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556162d1c530 con 0x556162d1b240 2024-09-13T19:18:01.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.992+0000 7f36460b4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556162d1b240 0x556162d227e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:01.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.992+0000 7f36460b4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556162d1b240 0x556162d227e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49490/0 (socket says 172.21.15.102:49490) 2024-09-13T19:18:01.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.992+0000 7f36460b4640 1 -- 172.21.15.102:0/4109115463 learned_addr learned my addr 172.21.15.102:0/4109115463 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:01.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.992+0000 7f36460b4640 1 -- 172.21.15.102:0/4109115463 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556162d22d20 con 0x556162d1b240 2024-09-13T19:18:01.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.992+0000 7f36460b4640 1 --2- 172.21.15.102:0/4109115463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556162d1b240 0x556162d227e0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f364000a930 tx=0x7f3640003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:01.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.993+0000 7f352a7fc640 1 -- 172.21.15.102:0/4109115463 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3640020020 con 0x556162d1b240 2024-09-13T19:18:01.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.993+0000 7f352a7fc640 1 -- 172.21.15.102:0/4109115463 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36400108b0 con 0x556162d1b240 2024-09-13T19:18:01.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.993+0000 7f3649b28800 1 -- 172.21.15.102:0/4109115463 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556162d22fb0 con 0x556162d1b240 2024-09-13T19:18:01.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.993+0000 7f352a7fc640 1 -- 172.21.15.102:0/4109115463 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3640015040 con 0x556162d1b240 2024-09-13T19:18:01.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.993+0000 7f3649b28800 1 -- 172.21.15.102:0/4109115463 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556162d25c60 con 0x556162d1b240 2024-09-13T19:18:02.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.993+0000 7f352a7fc640 1 -- 172.21.15.102:0/4109115463 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3640023020 con 0x556162d1b240 2024-09-13T19:18:02.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.994+0000 7f3649b28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:18:02.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.994+0000 7f3649b28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:18:02.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.994+0000 7f352a7fc640 1 --2- 172.21.15.102:0/4109115463 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3520036b40 0x7f3520039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.994+0000 7f352a7fc640 1 -- 172.21.15.102:0/4109115463 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f364004c3d0 con 0x556162d1b240 2024-09-13T19:18:02.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.994+0000 7f36450b2640 1 --2- 172.21.15.102:0/4109115463 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3520036b40 0x7f3520039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.994+0000 7f3649b28800 1 Processor -- start 2024-09-13T19:18:02.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.994+0000 7f3649b28800 1 -- start start 2024-09-13T19:18:02.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.994+0000 7f36450b2640 1 --2- 172.21.15.102:0/4109115463 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3520036b40 0x7f3520039000 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f363c000f60 tx=0x7f363c0012f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.994+0000 7f3649b28800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556162d3c870 0x556162d3cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.994+0000 7f3649b28800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556162d03f60 con 0x556162d3c870 2024-09-13T19:18:02.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.995+0000 7f36458b3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556162d3c870 0x556162d3cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.995+0000 7f36458b3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556162d3c870 0x556162d3cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49506/0 (socket says 172.21.15.102:49506) 2024-09-13T19:18:02.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.995+0000 7f36458b3640 1 -- 172.21.15.102:0/2196077567 learned_addr learned my addr 172.21.15.102:0/2196077567 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:02.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.995+0000 7f36458b3640 1 -- 172.21.15.102:0/2196077567 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556162d3d260 con 0x556162d3c870 2024-09-13T19:18:02.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.995+0000 7f36458b3640 1 --2- 172.21.15.102:0/2196077567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556162d3c870 0x556162d3cc90 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f3638081730 tx=0x7f363808f550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.995+0000 7f350a7e4640 1 -- 172.21.15.102:0/2196077567 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f363807d040 con 0x556162d3c870 2024-09-13T19:18:02.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.995+0000 7f350a7e4640 1 -- 172.21.15.102:0/2196077567 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f363809a070 con 0x556162d3c870 2024-09-13T19:18:02.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.995+0000 7f3649b28800 1 -- 172.21.15.102:0/2196077567 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556162d3feb0 con 0x556162d3c870 2024-09-13T19:18:02.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.995+0000 7f350a7e4640 1 -- 172.21.15.102:0/2196077567 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36380813a0 con 0x556162d3c870 2024-09-13T19:18:02.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.996+0000 7f3649b28800 1 -- 172.21.15.102:0/2196077567 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556162d40290 con 0x556162d3c870 2024-09-13T19:18:02.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.996+0000 7f350a7e4640 1 -- 172.21.15.102:0/2196077567 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f363808d040 con 0x556162d3c870 2024-09-13T19:18:02.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.996+0000 7f350a7e4640 1 --2- 172.21.15.102:0/2196077567 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3488036b40 0x7f3488039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.996+0000 7f350a7e4640 1 -- 172.21.15.102:0/2196077567 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f36380a0d70 con 0x556162d3c870 2024-09-13T19:18:02.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.997+0000 7f36450b2640 1 --2- 172.21.15.102:0/2196077567 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3488036b40 0x7f3488039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.997+0000 7f347bfff640 20 reqs_thread_entry: start 2024-09-13T19:18:02.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.997+0000 7f36450b2640 1 --2- 172.21.15.102:0/2196077567 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3488036b40 0x7f3488039000 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f363c001ed0 tx=0x7f363c00f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.997+0000 7f3649b28800 1 --2- 172.21.15.102:0/3118468716 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x556162d4a270 0x556162d4c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.997+0000 7f3649b28800 1 -- 172.21.15.102:0/3118468716 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556162d4cd90 con 0x556162d4a270 2024-09-13T19:18:02.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.997+0000 7f36460b4640 1 --2- 172.21.15.102:0/3118468716 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x556162d4a270 0x556162d4c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.997+0000 7f36460b4640 1 --2- 172.21.15.102:0/3118468716 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x556162d4a270 0x556162d4c6c0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.998+0000 7f36460b4640 1 -- 172.21.15.102:0/3118468716 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f364000e070 con 0x556162d4a270 2024-09-13T19:18:02.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.998+0000 7f3649b28800 1 --2- 172.21.15.102:0/3118468716 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x556162d4eb60 0x556162d50f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.998+0000 7f3649b28800 1 -- 172.21.15.102:0/3118468716 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:2 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556162d515a0 con 0x556162d4eb60 2024-09-13T19:18:02.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.998+0000 7f36458b3640 1 --2- 172.21.15.102:0/3118468716 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x556162d4eb60 0x556162d50f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.998+0000 7f36458b3640 1 --2- 172.21.15.102:0/3118468716 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x556162d4eb60 0x556162d50f50 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.998+0000 7f36458b3640 1 -- 172.21.15.102:0/3118468716 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(2 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f3638075030 con 0x556162d4eb60 2024-09-13T19:18:02.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:01.998+0000 7f3649b28800 1 -- 172.21.15.102:0/3118468716 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556162d4e200 con 0x556162d4eb60 2024-09-13T19:18:02.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.000+0000 7f36458b3640 1 -- 172.21.15.102:0/3118468716 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [stat,call,call,writefull 0~993] v36'4 uv4 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f3638075030 con 0x556162d4eb60 2024-09-13T19:18:02.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.000+0000 7f3649b28800 1 -- 172.21.15.102:0/4109115463 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3520036b40 msgr2=0x7f3520039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.000+0000 7f3649b28800 1 --2- 172.21.15.102:0/4109115463 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3520036b40 0x7f3520039000 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f363c000f60 tx=0x7f363c0012f0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.000+0000 7f3649b28800 1 -- 172.21.15.102:0/4109115463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556162d1b240 msgr2=0x556162d227e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.000+0000 7f3649b28800 1 --2- 172.21.15.102:0/4109115463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556162d1b240 0x556162d227e0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f364000a930 tx=0x7f3640003370 comp rx=0 tx=0).stop 2024-09-13T19:18:02.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.001+0000 7f3649b28800 1 -- 172.21.15.102:0/4109115463 shutdown_connections 2024-09-13T19:18:02.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.001+0000 7f3649b28800 1 --2- 172.21.15.102:0/4109115463 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3520036b40 0x7f3520039000 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.001+0000 7f3649b28800 1 --2- 172.21.15.102:0/4109115463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556162d1b240 0x556162d227e0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.001+0000 7f3649b28800 1 -- 172.21.15.102:0/4109115463 >> 172.21.15.102:0/4109115463 conn(0x556162c14f20 msgr2=0x556162d16590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:02.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.001+0000 7f3649b28800 1 -- 172.21.15.102:0/4109115463 shutdown_connections 2024-09-13T19:18:02.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.001+0000 7f3649b28800 1 -- 172.21.15.102:0/4109115463 wait complete. 2024-09-13T19:18:02.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.001+0000 7f3649b28800 1 -- 172.21.15.102:0/2196077567 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3488036b40 msgr2=0x7f3488039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.001+0000 7f3649b28800 1 --2- 172.21.15.102:0/2196077567 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3488036b40 0x7f3488039000 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f363c001ed0 tx=0x7f363c00f000 comp rx=0 tx=0).stop 2024-09-13T19:18:02.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.001+0000 7f3649b28800 1 -- 172.21.15.102:0/2196077567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556162d3c870 msgr2=0x556162d3cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.001+0000 7f3649b28800 1 --2- 172.21.15.102:0/2196077567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556162d3c870 0x556162d3cc90 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f3638081730 tx=0x7f363808f550 comp rx=0 tx=0).stop 2024-09-13T19:18:02.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.001+0000 7f3649b28800 1 -- 172.21.15.102:0/2196077567 shutdown_connections 2024-09-13T19:18:02.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.001+0000 7f3649b28800 1 --2- 172.21.15.102:0/2196077567 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3488036b40 0x7f3488039000 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.001+0000 7f3649b28800 1 --2- 172.21.15.102:0/2196077567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556162d3c870 0x556162d3cc90 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.001+0000 7f3649b28800 1 -- 172.21.15.102:0/2196077567 >> 172.21.15.102:0/2196077567 conn(0x556162d31860 msgr2=0x556162d34150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:02.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.001+0000 7f3649b28800 1 -- 172.21.15.102:0/2196077567 shutdown_connections 2024-09-13T19:18:02.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.001+0000 7f3649b28800 1 -- 172.21.15.102:0/2196077567 wait complete. 2024-09-13T19:18:02.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.001+0000 7f3649b28800 1 -- 172.21.15.102:0/3118468716 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x556162d4a270 msgr2=0x556162d4c6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.001+0000 7f3649b28800 1 --2- 172.21.15.102:0/3118468716 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x556162d4a270 0x556162d4c6c0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.001+0000 7f3649b28800 1 -- 172.21.15.102:0/3118468716 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x556162d4eb60 msgr2=0x556162d50f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.001+0000 7f3649b28800 1 --2- 172.21.15.102:0/3118468716 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x556162d4eb60 0x556162d50f50 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.001+0000 7f3649b28800 1 -- 172.21.15.102:0/3118468716 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f352c036b90 msgr2=0x7f352c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.001+0000 7f3649b28800 1 --2- 172.21.15.102:0/3118468716 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f352c036b90 0x7f352c039050 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3638064930 tx=0x7f3638064a20 comp rx=0 tx=0).stop 2024-09-13T19:18:02.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.001+0000 7f3649b28800 1 -- 172.21.15.102:0/3118468716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556162c145e0 msgr2=0x556162b896f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.001+0000 7f3649b28800 1 --2- 172.21.15.102:0/3118468716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556162c145e0 0x556162b896f0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f3638067040 tx=0x7f3638002fb0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.001+0000 7f3649b28800 1 -- 172.21.15.102:0/3118468716 shutdown_connections 2024-09-13T19:18:02.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.001+0000 7f3649b28800 1 --2- 172.21.15.102:0/3118468716 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x556162d4eb60 0x556162d50f50 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.001+0000 7f3649b28800 1 --2- 172.21.15.102:0/3118468716 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x556162d4a270 0x556162d4c6c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.001+0000 7f3649b28800 1 --2- 172.21.15.102:0/3118468716 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f352c036b90 0x7f352c039050 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.001+0000 7f3649b28800 1 --2- 172.21.15.102:0/3118468716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556162c145e0 0x556162b896f0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.001+0000 7f3649b28800 1 -- 172.21.15.102:0/3118468716 >> 172.21.15.102:0/3118468716 conn(0x556162c0fe90 msgr2=0x556162cfdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:02.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.002+0000 7f3649b28800 1 -- 172.21.15.102:0/3118468716 shutdown_connections 2024-09-13T19:18:02.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.002+0000 7f3649b28800 1 -- 172.21.15.102:0/3118468716 wait complete. 2024-09-13T19:18:02.013 INFO:teuthology.orchestra.run.smithi102.stdout:{"id":"509740b4-c081-4f37-bd6d-df9ca851489b","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-13T19:18:02.013 DEBUG:tasks.util.rgw: json result: {'id': '509740b4-c081-4f37-bd6d-df9ca851489b', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-13T19:18:02.013 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2024-09-13T19:18:02.013 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2024-09-13T19:18:02.013 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2024-09-13T19:18:02.055 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:18:02.056 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:18:02.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.053+0000 7f8ff520f800 1 Processor -- start 2024-09-13T19:18:02.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.053+0000 7f8ff520f800 1 -- start start 2024-09-13T19:18:02.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.053+0000 7f8ff520f800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56201e4fe580 0x56201e4fcd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.053+0000 7f8ff520f800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56201e447b30 con 0x56201e4fe980 2024-09-13T19:18:02.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.053+0000 7f8ff520f800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x56201e429360 con 0x56201e4fe580 2024-09-13T19:18:02.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.054+0000 7f8ff2d03640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56201e4fe580 0x56201e4fcd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.054+0000 7f8ff2502640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x56201e4fe980 0x56201e4fd370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:53666/0 (socket says 172.21.15.102:53666) 2024-09-13T19:18:02.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.054+0000 7f8ff2502640 1 -- 172.21.15.102:0/1633484940 learned_addr learned my addr 172.21.15.102:0/1633484940 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:18:02.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.054+0000 7f8ff1d01640 1 -- 172.21.15.102:0/1633484940 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2093216435 0 0) 0x56201e447b30 con 0x56201e4fe980 2024-09-13T19:18:02.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.054+0000 7f8ff1d01640 1 -- 172.21.15.102:0/1633484940 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8fe0001e10 con 0x56201e4fe980 2024-09-13T19:18:02.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.054+0000 7f8ff2d03640 1 -- 172.21.15.102:0/1633484940 >> v1:172.21.15.53:6789/0 conn(0x56201e4fe980 legacy=0x56201e4fd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.054+0000 7f8ff2d03640 1 -- 172.21.15.102:0/1633484940 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56201e44fe00 con 0x56201e4fe580 2024-09-13T19:18:02.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.056+0000 7f8ff2d03640 1 --2- 172.21.15.102:0/1633484940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56201e4fe580 0x56201e4fcd60 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f8fec005fd0 tx=0x7f8fec045b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70d0a2ffdfb9d9f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.056+0000 7f8ff1d01640 1 -- 172.21.15.102:0/1633484940 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fec055070 con 0x56201e4fe580 2024-09-13T19:18:02.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.056+0000 7f8ff1d01640 1 -- 172.21.15.102:0/1633484940 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fec051540 con 0x56201e4fe580 2024-09-13T19:18:02.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.056+0000 7f8ff1d01640 1 -- 172.21.15.102:0/1633484940 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fec051840 con 0x56201e4fe580 2024-09-13T19:18:02.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.057+0000 7f8ff520f800 1 -- 172.21.15.102:0/1633484940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56201e4fe580 msgr2=0x56201e4fcd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.057+0000 7f8ff520f800 1 --2- 172.21.15.102:0/1633484940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56201e4fe580 0x56201e4fcd60 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f8fec005fd0 tx=0x7f8fec045b30 comp rx=0 tx=0).stop 2024-09-13T19:18:02.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.057+0000 7f8ff520f800 1 -- 172.21.15.102:0/1633484940 shutdown_connections 2024-09-13T19:18:02.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.057+0000 7f8ff520f800 1 --2- 172.21.15.102:0/1633484940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56201e4fe580 0x56201e4fcd60 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.057+0000 7f8ff520f800 1 -- 172.21.15.102:0/1633484940 >> 172.21.15.102:0/1633484940 conn(0x56201e583fe0 msgr2=0x56201e586400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:02.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.057+0000 7f8ff520f800 1 -- 172.21.15.102:0/1633484940 shutdown_connections 2024-09-13T19:18:02.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.057+0000 7f8ff520f800 1 -- 172.21.15.102:0/1633484940 wait complete. 2024-09-13T19:18:02.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.071+0000 7f8ff520f800 1 Processor -- start 2024-09-13T19:18:02.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.071+0000 7f8ff520f800 1 -- start start 2024-09-13T19:18:02.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.071+0000 7f8ff520f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56201e4fe580 0x56201e679880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.071+0000 7f8ff520f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56201e4d4320 con 0x56201e4fe580 2024-09-13T19:18:02.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.071+0000 7f8ff2d03640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56201e4fe580 0x56201e679880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.071+0000 7f8ff2d03640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56201e4fe580 0x56201e679880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49516/0 (socket says 172.21.15.102:49516) 2024-09-13T19:18:02.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.071+0000 7f8ff2d03640 1 -- 172.21.15.102:0/3985305709 learned_addr learned my addr 172.21.15.102:0/3985305709 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:02.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.072+0000 7f8ff2d03640 1 -- 172.21.15.102:0/3985305709 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56201e421bc0 con 0x56201e4fe580 2024-09-13T19:18:02.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.072+0000 7f8ff2d03640 1 --2- 172.21.15.102:0/3985305709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56201e4fe580 0x56201e679880 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f8fec000f80 tx=0x7f8fec051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f98f5e8c00d6ca97 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.072+0000 7f8ee0e09640 1 -- 172.21.15.102:0/3985305709 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fec055040 con 0x56201e4fe580 2024-09-13T19:18:02.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.072+0000 7f8ee0e09640 1 -- 172.21.15.102:0/3985305709 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fec051a00 con 0x56201e4fe580 2024-09-13T19:18:02.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.072+0000 7f8ee0e09640 1 -- 172.21.15.102:0/3985305709 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fec051ce0 con 0x56201e4fe580 2024-09-13T19:18:02.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.073+0000 7f8ff520f800 1 -- 172.21.15.102:0/3985305709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56201e4fe580 msgr2=0x56201e679880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.073+0000 7f8ff520f800 1 --2- 172.21.15.102:0/3985305709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56201e4fe580 0x56201e679880 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f8fec000f80 tx=0x7f8fec051000 comp rx=0 tx=0).stop 2024-09-13T19:18:02.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.073+0000 7f8ff520f800 1 -- 172.21.15.102:0/3985305709 shutdown_connections 2024-09-13T19:18:02.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.073+0000 7f8ff520f800 1 --2- 172.21.15.102:0/3985305709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56201e4fe580 0x56201e679880 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.073+0000 7f8ff520f800 1 -- 172.21.15.102:0/3985305709 >> 172.21.15.102:0/3985305709 conn(0x56201e583fe0 msgr2=0x56201e675240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:02.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.073+0000 7f8ff520f800 1 -- 172.21.15.102:0/3985305709 shutdown_connections 2024-09-13T19:18:02.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.073+0000 7f8ff520f800 1 -- 172.21.15.102:0/3985305709 wait complete. 2024-09-13T19:18:02.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.073+0000 7f8ff520f800 1 Processor -- start 2024-09-13T19:18:02.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.073+0000 7f8ff520f800 1 -- start start 2024-09-13T19:18:02.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.073+0000 7f8ff520f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56201e4fe580 0x56201e681150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.073+0000 7f8ff520f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56201e591990 con 0x56201e4fe580 2024-09-13T19:18:02.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.073+0000 7f8ff2d03640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56201e4fe580 0x56201e681150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.073+0000 7f8ff2d03640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56201e4fe580 0x56201e681150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49518/0 (socket says 172.21.15.102:49518) 2024-09-13T19:18:02.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.073+0000 7f8ff2d03640 1 -- 172.21.15.102:0/59773854 learned_addr learned my addr 172.21.15.102:0/59773854 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:02.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.074+0000 7f8ff2d03640 1 -- 172.21.15.102:0/59773854 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56201e435fe0 con 0x56201e4fe580 2024-09-13T19:18:02.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.074+0000 7f8ff2d03640 1 --2- 172.21.15.102:0/59773854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56201e4fe580 0x56201e681150 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f8fec025960 tx=0x7f8fec003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.074+0000 7f8edf606640 1 -- 172.21.15.102:0/59773854 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fec071020 con 0x56201e4fe580 2024-09-13T19:18:02.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.074+0000 7f8edf606640 1 -- 172.21.15.102:0/59773854 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fec05a8c0 con 0x56201e4fe580 2024-09-13T19:18:02.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.074+0000 7f8ff520f800 1 -- 172.21.15.102:0/59773854 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56201e681690 con 0x56201e4fe580 2024-09-13T19:18:02.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.074+0000 7f8edf606640 1 -- 172.21.15.102:0/59773854 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fec055030 con 0x56201e4fe580 2024-09-13T19:18:02.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.074+0000 7f8ff520f800 1 -- 172.21.15.102:0/59773854 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56201e681bb0 con 0x56201e4fe580 2024-09-13T19:18:02.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.075+0000 7f8ff520f800 1 Processor -- start 2024-09-13T19:18:02.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.075+0000 7f8ff520f800 1 -- start start 2024-09-13T19:18:02.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.075+0000 7f8ff520f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56201e68e2e0 0x56201e68e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.075+0000 7f8ff520f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56201e423580 con 0x56201e68e2e0 2024-09-13T19:18:02.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.075+0000 7f8edf606640 1 -- 172.21.15.102:0/59773854 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8fec074020 con 0x56201e4fe580 2024-09-13T19:18:02.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.075+0000 7f8edf606640 1 --2- 172.21.15.102:0/59773854 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8ed8036b90 0x7f8ed8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.075+0000 7f8edf606640 1 -- 172.21.15.102:0/59773854 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f8fec06a040 con 0x56201e4fe580 2024-09-13T19:18:02.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.075+0000 7f8ff3504640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56201e68e2e0 0x56201e68e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.075+0000 7f8ff3504640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56201e68e2e0 0x56201e68e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49522/0 (socket says 172.21.15.102:49522) 2024-09-13T19:18:02.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.075+0000 7f8ff3504640 1 -- 172.21.15.102:0/3552916464 learned_addr learned my addr 172.21.15.102:0/3552916464 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:02.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.075+0000 7f8ff2d03640 1 --2- 172.21.15.102:0/59773854 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8ed8036b90 0x7f8ed8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.076+0000 7f8ff3504640 1 -- 172.21.15.102:0/3552916464 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56201e68ec20 con 0x56201e68e2e0 2024-09-13T19:18:02.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.076+0000 7f8ff2d03640 1 --2- 172.21.15.102:0/59773854 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8ed8036b90 0x7f8ed8039050 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8fec01b820 tx=0x7f8fec063f90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.076+0000 7f8ff3504640 1 --2- 172.21.15.102:0/3552916464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56201e68e2e0 0x56201e68e6e0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f8fe400a400 tx=0x7f8fe400a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc81332bda8bc164 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.076+0000 7f8edd602640 1 -- 172.21.15.102:0/3552916464 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fe40087e0 con 0x56201e68e2e0 2024-09-13T19:18:02.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.076+0000 7f8edd602640 1 -- 172.21.15.102:0/3552916464 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fe40089a0 con 0x56201e68e2e0 2024-09-13T19:18:02.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.076+0000 7f8edd602640 1 -- 172.21.15.102:0/3552916464 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fe4008d00 con 0x56201e68e2e0 2024-09-13T19:18:02.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.076+0000 7f8ff520f800 1 -- 172.21.15.102:0/3552916464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56201e68e2e0 msgr2=0x56201e68e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.076+0000 7f8ff520f800 1 --2- 172.21.15.102:0/3552916464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56201e68e2e0 0x56201e68e6e0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f8fe400a400 tx=0x7f8fe400a8c0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.077+0000 7f8ff520f800 1 -- 172.21.15.102:0/3552916464 shutdown_connections 2024-09-13T19:18:02.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.077+0000 7f8ff520f800 1 --2- 172.21.15.102:0/3552916464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56201e68e2e0 0x56201e68e6e0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.077+0000 7f8ff520f800 1 -- 172.21.15.102:0/3552916464 >> 172.21.15.102:0/3552916464 conn(0x56201e689650 msgr2=0x56201e68c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:02.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.077+0000 7f8ff520f800 1 -- 172.21.15.102:0/3552916464 shutdown_connections 2024-09-13T19:18:02.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.077+0000 7f8ff520f800 1 -- 172.21.15.102:0/3552916464 wait complete. 2024-09-13T19:18:02.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.077+0000 7f8ff520f800 1 Processor -- start 2024-09-13T19:18:02.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.077+0000 7f8ff520f800 1 -- start start 2024-09-13T19:18:02.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.077+0000 7f8ff520f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56201e68e2e0 0x56201e6958f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.077+0000 7f8ff520f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56201e68f5d0 con 0x56201e68e2e0 2024-09-13T19:18:02.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.077+0000 7f8ff3504640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56201e68e2e0 0x56201e6958f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.077+0000 7f8ff3504640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56201e68e2e0 0x56201e6958f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49524/0 (socket says 172.21.15.102:49524) 2024-09-13T19:18:02.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.077+0000 7f8ff3504640 1 -- 172.21.15.102:0/528156870 learned_addr learned my addr 172.21.15.102:0/528156870 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:02.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.078+0000 7f8ff3504640 1 -- 172.21.15.102:0/528156870 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56201e695e30 con 0x56201e68e2e0 2024-09-13T19:18:02.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.078+0000 7f8ff3504640 1 --2- 172.21.15.102:0/528156870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56201e68e2e0 0x56201e6958f0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f8fe400c010 tx=0x7f8fe4002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.078+0000 7f8ed77fe640 1 -- 172.21.15.102:0/528156870 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fe4022020 con 0x56201e68e2e0 2024-09-13T19:18:02.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.078+0000 7f8ed77fe640 1 -- 172.21.15.102:0/528156870 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fe4019040 con 0x56201e68e2e0 2024-09-13T19:18:02.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.078+0000 7f8ed77fe640 1 -- 172.21.15.102:0/528156870 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fe4013a70 con 0x56201e68e2e0 2024-09-13T19:18:02.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.078+0000 7f8ff520f800 1 -- 172.21.15.102:0/528156870 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56201e6960c0 con 0x56201e68e2e0 2024-09-13T19:18:02.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.078+0000 7f8ff520f800 1 -- 172.21.15.102:0/528156870 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56201e698d70 con 0x56201e68e2e0 2024-09-13T19:18:02.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.079+0000 7f8ed77fe640 1 -- 172.21.15.102:0/528156870 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8fe4025020 con 0x56201e68e2e0 2024-09-13T19:18:02.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.079+0000 7f8ed77fe640 1 --2- 172.21.15.102:0/528156870 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8ecc036b40 0x7f8ecc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.079+0000 7f8ed77fe640 1 -- 172.21.15.102:0/528156870 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f8fe404c820 con 0x56201e68e2e0 2024-09-13T19:18:02.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.079+0000 7f8ff2502640 1 --2- 172.21.15.102:0/528156870 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8ecc036b40 0x7f8ecc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.079+0000 7f8ff520f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:18:02.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.079+0000 7f8ff520f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:18:02.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.079+0000 7f8ff520f800 1 Processor -- start 2024-09-13T19:18:02.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.080+0000 7f8ff2502640 1 --2- 172.21.15.102:0/528156870 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8ecc036b40 0x7f8ecc039000 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc000f60 tx=0x7f8fdc0010a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.080+0000 7f8ff520f800 1 -- start start 2024-09-13T19:18:02.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.080+0000 7f8ff520f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56201e6ab440 0x56201e6ab860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.080+0000 7f8ff520f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56201e679f70 con 0x56201e6ab440 2024-09-13T19:18:02.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.080+0000 7f8ff2d03640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56201e6ab440 0x56201e6ab860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.080+0000 7f8ff2d03640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56201e6ab440 0x56201e6ab860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49534/0 (socket says 172.21.15.102:49534) 2024-09-13T19:18:02.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.080+0000 7f8ff2d03640 1 -- 172.21.15.102:0/842325446 learned_addr learned my addr 172.21.15.102:0/842325446 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:02.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.080+0000 7f8ff2d03640 1 -- 172.21.15.102:0/842325446 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56201e6abe30 con 0x56201e6ab440 2024-09-13T19:18:02.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.081+0000 7f8ff2d03640 1 --2- 172.21.15.102:0/842325446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56201e6ab440 0x56201e6ab860 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f8fec000f80 tx=0x7f8fec075dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.081+0000 7f8eb7fe7640 1 -- 172.21.15.102:0/842325446 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fec06cc20 con 0x56201e6ab440 2024-09-13T19:18:02.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.081+0000 7f8eb7fe7640 1 -- 172.21.15.102:0/842325446 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fec095070 con 0x56201e6ab440 2024-09-13T19:18:02.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.081+0000 7f8ff520f800 1 -- 172.21.15.102:0/842325446 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56201e6aea80 con 0x56201e6ab440 2024-09-13T19:18:02.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.081+0000 7f8eb7fe7640 1 -- 172.21.15.102:0/842325446 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fec0755a0 con 0x56201e6ab440 2024-09-13T19:18:02.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.081+0000 7f8ff520f800 1 -- 172.21.15.102:0/842325446 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56201e6aee60 con 0x56201e6ab440 2024-09-13T19:18:02.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.082+0000 7f8eb7fe7640 1 -- 172.21.15.102:0/842325446 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8fec089040 con 0x56201e6ab440 2024-09-13T19:18:02.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.082+0000 7f8eb7fe7640 1 --2- 172.21.15.102:0/842325446 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8e30036b40 0x7f8e30039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.082+0000 7f8eb7fe7640 1 -- 172.21.15.102:0/842325446 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f8fec061070 con 0x56201e6ab440 2024-09-13T19:18:02.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.082+0000 7f8ff2502640 1 --2- 172.21.15.102:0/842325446 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8e30036b40 0x7f8e30039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.082+0000 7f8eb5fe3640 20 reqs_thread_entry: start 2024-09-13T19:18:02.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.082+0000 7f8ff2502640 1 --2- 172.21.15.102:0/842325446 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8e30036b40 0x7f8e30039000 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc011fd0 tx=0x7f8fdc017000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.082+0000 7f8ff520f800 1 --2- 172.21.15.102:0/59773854 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56201e6b8e40 0x56201e6bb230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.082+0000 7f8ff520f800 1 -- 172.21.15.102:0/59773854 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56201e6bb890 con 0x56201e6b8e40 2024-09-13T19:18:02.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.083+0000 7f8ff3504640 1 --2- 172.21.15.102:0/59773854 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56201e6b8e40 0x56201e6bb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.083+0000 7f8ff3504640 1 --2- 172.21.15.102:0/59773854 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56201e6b8e40 0x56201e6bb230 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.083+0000 7f8ff3504640 1 -- 172.21.15.102:0/59773854 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8fe401ecc0 con 0x56201e6b8e40 2024-09-13T19:18:02.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.083+0000 7f8ff520f800 1 -- 172.21.15.102:0/59773854 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56201e6bc150 con 0x56201e6b8e40 2024-09-13T19:18:02.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.083+0000 7f8ff3504640 1 -- 172.21.15.102:0/59773854 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8fe401ecc0 con 0x56201e6b8e40 2024-09-13T19:18:02.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.083+0000 7f8ff520f800 1 --2- 172.21.15.102:0/59773854 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56201e6bda60 0x56201e6bfef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.083+0000 7f8ff520f800 1 -- 172.21.15.102:0/59773854 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56201e6c05b0 con 0x56201e6bda60 2024-09-13T19:18:02.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.083+0000 7f8ff2d03640 1 --2- 172.21.15.102:0/59773854 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56201e6bda60 0x56201e6bfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.084+0000 7f8ff2d03640 1 --2- 172.21.15.102:0/59773854 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56201e6bda60 0x56201e6bfef0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.084+0000 7f8ff2d03640 1 -- 172.21.15.102:0/59773854 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8fec057030 con 0x56201e6bda60 2024-09-13T19:18:02.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.085+0000 7f8ff520f800 1 -- 172.21.15.102:0/528156870 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8ecc036b40 msgr2=0x7f8ecc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.085+0000 7f8ff520f800 1 --2- 172.21.15.102:0/528156870 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8ecc036b40 0x7f8ecc039000 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc000f60 tx=0x7f8fdc0010a0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.085+0000 7f8ff520f800 1 -- 172.21.15.102:0/528156870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56201e68e2e0 msgr2=0x56201e6958f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.085+0000 7f8ff520f800 1 --2- 172.21.15.102:0/528156870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56201e68e2e0 0x56201e6958f0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f8fe400c010 tx=0x7f8fe4002ff0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.085+0000 7f8ff520f800 1 -- 172.21.15.102:0/528156870 shutdown_connections 2024-09-13T19:18:02.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.085+0000 7f8ff520f800 1 --2- 172.21.15.102:0/528156870 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8ecc036b40 0x7f8ecc039000 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.085+0000 7f8ff520f800 1 --2- 172.21.15.102:0/528156870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56201e68e2e0 0x56201e6958f0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.085+0000 7f8ff520f800 1 -- 172.21.15.102:0/528156870 >> 172.21.15.102:0/528156870 conn(0x56201e689650 msgr2=0x56201e687b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:02.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.085+0000 7f8ff520f800 1 -- 172.21.15.102:0/528156870 shutdown_connections 2024-09-13T19:18:02.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.085+0000 7f8ff520f800 1 -- 172.21.15.102:0/528156870 wait complete. 2024-09-13T19:18:02.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.085+0000 7f8ff520f800 1 -- 172.21.15.102:0/842325446 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8e30036b40 msgr2=0x7f8e30039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.085+0000 7f8ff520f800 1 --2- 172.21.15.102:0/842325446 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8e30036b40 0x7f8e30039000 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc011fd0 tx=0x7f8fdc017000 comp rx=0 tx=0).stop 2024-09-13T19:18:02.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.085+0000 7f8ff520f800 1 -- 172.21.15.102:0/842325446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56201e6ab440 msgr2=0x56201e6ab860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.085+0000 7f8ff520f800 1 --2- 172.21.15.102:0/842325446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56201e6ab440 0x56201e6ab860 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f8fec000f80 tx=0x7f8fec075dd0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.085+0000 7f8ff520f800 1 -- 172.21.15.102:0/842325446 shutdown_connections 2024-09-13T19:18:02.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.085+0000 7f8ff520f800 1 --2- 172.21.15.102:0/842325446 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8e30036b40 0x7f8e30039000 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.085+0000 7f8ff520f800 1 --2- 172.21.15.102:0/842325446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56201e6ab440 0x56201e6ab860 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.085+0000 7f8ff520f800 1 -- 172.21.15.102:0/842325446 >> 172.21.15.102:0/842325446 conn(0x56201e58aad0 msgr2=0x56201e58b310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:02.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.085+0000 7f8ff520f800 1 -- 172.21.15.102:0/842325446 shutdown_connections 2024-09-13T19:18:02.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.085+0000 7f8ff520f800 1 -- 172.21.15.102:0/842325446 wait complete. 2024-09-13T19:18:02.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.085+0000 7f8ff520f800 1 -- 172.21.15.102:0/59773854 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56201e6b8e40 msgr2=0x56201e6bb230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.085+0000 7f8ff520f800 1 --2- 172.21.15.102:0/59773854 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56201e6b8e40 0x56201e6bb230 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.085+0000 7f8ff520f800 1 -- 172.21.15.102:0/59773854 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56201e6bda60 msgr2=0x56201e6bfef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.085+0000 7f8ff520f800 1 --2- 172.21.15.102:0/59773854 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56201e6bda60 0x56201e6bfef0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.086+0000 7f8ff520f800 1 -- 172.21.15.102:0/59773854 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8ed8036b90 msgr2=0x7f8ed8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.086+0000 7f8ff520f800 1 --2- 172.21.15.102:0/59773854 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8ed8036b90 0x7f8ed8039050 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8fec01b820 tx=0x7f8fec063f90 comp rx=0 tx=0).stop 2024-09-13T19:18:02.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.086+0000 7f8ff520f800 1 -- 172.21.15.102:0/59773854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56201e4fe580 msgr2=0x56201e681150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.086+0000 7f8ff520f800 1 --2- 172.21.15.102:0/59773854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56201e4fe580 0x56201e681150 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f8fec025960 tx=0x7f8fec003330 comp rx=0 tx=0).stop 2024-09-13T19:18:02.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.086+0000 7f8ff520f800 1 -- 172.21.15.102:0/59773854 shutdown_connections 2024-09-13T19:18:02.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.086+0000 7f8ff520f800 1 --2- 172.21.15.102:0/59773854 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x56201e6bda60 0x56201e6bfef0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.086+0000 7f8ff520f800 1 --2- 172.21.15.102:0/59773854 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56201e6b8e40 0x56201e6bb230 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.086+0000 7f8ff520f800 1 --2- 172.21.15.102:0/59773854 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8ed8036b90 0x7f8ed8039050 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.086+0000 7f8ff520f800 1 --2- 172.21.15.102:0/59773854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56201e4fe580 0x56201e681150 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.086+0000 7f8ff520f800 1 -- 172.21.15.102:0/59773854 >> 172.21.15.102:0/59773854 conn(0x56201e583fe0 msgr2=0x56201e673ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:02.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.086+0000 7f8ff520f800 1 -- 172.21.15.102:0/59773854 shutdown_connections 2024-09-13T19:18:02.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.086+0000 7f8ff520f800 1 -- 172.21.15.102:0/59773854 wait complete. 2024-09-13T19:18:02.098 INFO:teuthology.orchestra.run.smithi102.stdout:{"id":"f767d22e-a5e7-4349-a797-2de84f67e90b","name":"default","api_name":"default","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"509740b4-c081-4f37-bd6d-df9ca851489b","zones":[{"id":"509740b4-c081-4f37-bd6d-df9ca851489b","name":"default","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]} 2024-09-13T19:18:02.099 DEBUG:tasks.util.rgw: json result: {'id': 'f767d22e-a5e7-4349-a797-2de84f67e90b', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': '509740b4-c081-4f37-bd6d-df9ca851489b', 'zones': [{'id': '509740b4-c081-4f37-bd6d-df9ca851489b', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['notification_v2', 'resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['notification_v2', 'resharding']} 2024-09-13T19:18:02.101 INFO:teuthology.run_tasks:Running task radosgw-admin-rest... 2024-09-13T19:18:02.138 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-13T19:18:02.138 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-13T19:18:02.138 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid ada --display-name 'Ms. Admin User' --access-key MH1WC2XQ1S8UISFDZC8W --secret dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG --max-buckets 0 --caps 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write' 2024-09-13T19:18:02.193 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:18:02.193 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:18:02.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.190+0000 7f8555524800 1 Processor -- start 2024-09-13T19:18:02.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.191+0000 7f8555524800 1 -- start start 2024-09-13T19:18:02.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.191+0000 7f8555524800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x557766771660 0x557766802630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.191+0000 7f8555524800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5577666bcb30 con 0x557766802b70 2024-09-13T19:18:02.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.191+0000 7f8555524800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55776669e360 con 0x557766771660 2024-09-13T19:18:02.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.191+0000 7f8551216640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x557766771660 0x557766802630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.191+0000 7f8548a15640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x557766802b70 0x557766804f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:53676/0 (socket says 172.21.15.102:53676) 2024-09-13T19:18:02.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.191+0000 7f8548a15640 1 -- 172.21.15.102:0/3433833675 learned_addr learned my addr 172.21.15.102:0/3433833675 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:18:02.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.191+0000 7f8551216640 1 --2- 172.21.15.102:0/3433833675 >> v2:172.21.15.53:3300/0 conn(0x557766771660 0x557766802630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49542/0 (socket says 172.21.15.102:49542) 2024-09-13T19:18:02.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.191+0000 7f8551216640 1 -- 172.21.15.102:0/3433833675 >> v1:172.21.15.53:6789/0 conn(0x557766802b70 legacy=0x557766804f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.191+0000 7f8551216640 1 -- 172.21.15.102:0/3433833675 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577666c4e00 con 0x557766771660 2024-09-13T19:18:02.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.193+0000 7f8551216640 1 --2- 172.21.15.102:0/3433833675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557766771660 0x557766802630 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f854400a470 tx=0x7f8544045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91462d7be791fa67 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.193+0000 7f8550a15640 1 -- 172.21.15.102:0/3433833675 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8544053570 con 0x557766771660 2024-09-13T19:18:02.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.193+0000 7f8550a15640 1 -- 172.21.15.102:0/3433833675 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8544058070 con 0x557766771660 2024-09-13T19:18:02.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.193+0000 7f8550a15640 1 -- 172.21.15.102:0/3433833675 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8544053880 con 0x557766771660 2024-09-13T19:18:02.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.194+0000 7f8555524800 1 -- 172.21.15.102:0/3433833675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557766771660 msgr2=0x557766802630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.194+0000 7f8555524800 1 --2- 172.21.15.102:0/3433833675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557766771660 0x557766802630 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f854400a470 tx=0x7f8544045a20 comp rx=0 tx=0).stop 2024-09-13T19:18:02.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.194+0000 7f8555524800 1 -- 172.21.15.102:0/3433833675 shutdown_connections 2024-09-13T19:18:02.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.194+0000 7f8555524800 1 --2- 172.21.15.102:0/3433833675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557766771660 0x557766802630 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.194+0000 7f8555524800 1 -- 172.21.15.102:0/3433833675 >> 172.21.15.102:0/3433833675 conn(0x5577667f7de0 msgr2=0x5577667fa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:02.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.194+0000 7f8555524800 1 -- 172.21.15.102:0/3433833675 shutdown_connections 2024-09-13T19:18:02.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.194+0000 7f8555524800 1 -- 172.21.15.102:0/3433833675 wait complete. 2024-09-13T19:18:02.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.207+0000 7f8555524800 1 Processor -- start 2024-09-13T19:18:02.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.208+0000 7f8555524800 1 -- start start 2024-09-13T19:18:02.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.208+0000 7f8555524800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557766771660 0x5577668eec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.208+0000 7f8555524800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557766749450 con 0x557766771660 2024-09-13T19:18:02.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.208+0000 7f8551216640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557766771660 0x5577668eec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.208+0000 7f8551216640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557766771660 0x5577668eec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49556/0 (socket says 172.21.15.102:49556) 2024-09-13T19:18:02.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.208+0000 7f8551216640 1 -- 172.21.15.102:0/634079225 learned_addr learned my addr 172.21.15.102:0/634079225 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:02.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.208+0000 7f8551216640 1 -- 172.21.15.102:0/634079225 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557766696bc0 con 0x557766771660 2024-09-13T19:18:02.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.209+0000 7f8551216640 1 --2- 172.21.15.102:0/634079225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557766771660 0x5577668eec20 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f8544025c20 tx=0x7f8544051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5e73971873f0acc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.209+0000 7f843f606640 1 -- 172.21.15.102:0/634079225 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f854405c580 con 0x557766771660 2024-09-13T19:18:02.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.209+0000 7f843f606640 1 -- 172.21.15.102:0/634079225 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8544063030 con 0x557766771660 2024-09-13T19:18:02.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.209+0000 7f843f606640 1 -- 172.21.15.102:0/634079225 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f854405c850 con 0x557766771660 2024-09-13T19:18:02.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.210+0000 7f8555524800 1 -- 172.21.15.102:0/634079225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557766771660 msgr2=0x5577668eec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.210+0000 7f8555524800 1 --2- 172.21.15.102:0/634079225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557766771660 0x5577668eec20 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f8544025c20 tx=0x7f8544051000 comp rx=0 tx=0).stop 2024-09-13T19:18:02.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.210+0000 7f8555524800 1 -- 172.21.15.102:0/634079225 shutdown_connections 2024-09-13T19:18:02.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.210+0000 7f8555524800 1 --2- 172.21.15.102:0/634079225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557766771660 0x5577668eec20 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.210+0000 7f8555524800 1 -- 172.21.15.102:0/634079225 >> 172.21.15.102:0/634079225 conn(0x5577667f7de0 msgr2=0x5577668ea5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:02.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.210+0000 7f8555524800 1 -- 172.21.15.102:0/634079225 shutdown_connections 2024-09-13T19:18:02.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.210+0000 7f8555524800 1 -- 172.21.15.102:0/634079225 wait complete. 2024-09-13T19:18:02.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.210+0000 7f8555524800 1 Processor -- start 2024-09-13T19:18:02.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.210+0000 7f8555524800 1 -- start start 2024-09-13T19:18:02.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.210+0000 7f8555524800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557766771660 0x5577668f6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.210+0000 7f8555524800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557766806950 con 0x557766771660 2024-09-13T19:18:02.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.210+0000 7f8551216640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557766771660 0x5577668f6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.210+0000 7f8551216640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557766771660 0x5577668f6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49566/0 (socket says 172.21.15.102:49566) 2024-09-13T19:18:02.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.210+0000 7f8551216640 1 -- 172.21.15.102:0/3018068266 learned_addr learned my addr 172.21.15.102:0/3018068266 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:02.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.211+0000 7f8551216640 1 -- 172.21.15.102:0/3018068266 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577666aafe0 con 0x557766771660 2024-09-13T19:18:02.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.211+0000 7f8551216640 1 --2- 172.21.15.102:0/3018068266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557766771660 0x5577668f6580 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f854400a330 tx=0x7f8544002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.211+0000 7f843de03640 1 -- 172.21.15.102:0/3018068266 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f854406c030 con 0x557766771660 2024-09-13T19:18:02.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.211+0000 7f843de03640 1 -- 172.21.15.102:0/3018068266 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f854405c580 con 0x557766771660 2024-09-13T19:18:02.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.211+0000 7f8555524800 1 -- 172.21.15.102:0/3018068266 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5577668f6ac0 con 0x557766771660 2024-09-13T19:18:02.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.211+0000 7f843de03640 1 -- 172.21.15.102:0/3018068266 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f854405c860 con 0x557766771660 2024-09-13T19:18:02.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.211+0000 7f8555524800 1 -- 172.21.15.102:0/3018068266 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577668f7040 con 0x557766771660 2024-09-13T19:18:02.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.212+0000 7f843de03640 1 -- 172.21.15.102:0/3018068266 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8544053440 con 0x557766771660 2024-09-13T19:18:02.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.212+0000 7f843de03640 1 --2- 172.21.15.102:0/3018068266 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8438036b40 0x7f8438039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.212+0000 7f843de03640 1 -- 172.21.15.102:0/3018068266 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f8544070020 con 0x557766771660 2024-09-13T19:18:02.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.212+0000 7f8548a15640 1 --2- 172.21.15.102:0/3018068266 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8438036b40 0x7f8438039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.212+0000 7f8555524800 1 --2- 172.21.15.102:0/3018068266 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557766802b70 0x5577668fd650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.212+0000 7f8555524800 1 -- 172.21.15.102:0/3018068266 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5577668fdb90 con 0x557766802b70 2024-09-13T19:18:02.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.213+0000 7f8551a17640 1 --2- 172.21.15.102:0/3018068266 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557766802b70 0x5577668fd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.213+0000 7f8548a15640 1 --2- 172.21.15.102:0/3018068266 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8438036b40 0x7f8438039000 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f853c000f60 tx=0x7f853c0012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.213+0000 7f8551a17640 1 --2- 172.21.15.102:0/3018068266 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557766802b70 0x5577668fd650 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.213+0000 7f8551a17640 1 -- 172.21.15.102:0/3018068266 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f854c00a4a0 con 0x557766802b70 2024-09-13T19:18:02.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.213+0000 7f8555524800 1 -- 172.21.15.102:0/3018068266 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5577668fac20 con 0x557766802b70 2024-09-13T19:18:02.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.213+0000 7f8551a17640 1 -- 172.21.15.102:0/3018068266 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f854c00a4a0 con 0x557766802b70 2024-09-13T19:18:02.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.213+0000 7f8555524800 1 --2- 172.21.15.102:0/3018068266 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5577668ffef0 0x5577669022e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.213+0000 7f8555524800 1 -- 172.21.15.102:0/3018068266 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557766902980 con 0x5577668ffef0 2024-09-13T19:18:02.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.214+0000 7f8551216640 1 --2- 172.21.15.102:0/3018068266 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5577668ffef0 0x5577669022e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.214+0000 7f8551216640 1 --2- 172.21.15.102:0/3018068266 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5577668ffef0 0x5577669022e0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.214+0000 7f8551216640 1 -- 172.21.15.102:0/3018068266 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f854407b070 con 0x5577668ffef0 2024-09-13T19:18:02.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.214+0000 7f8555524800 1 -- 172.21.15.102:0/3018068266 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5577668fed90 con 0x557766802b70 2024-09-13T19:18:02.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.214+0000 7f8551a17640 1 -- 172.21.15.102:0/3018068266 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f854c00a4a0 con 0x557766802b70 2024-09-13T19:18:02.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.214+0000 7f8555524800 1 -- 172.21.15.102:0/3018068266 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5577668ff270 con 0x5577668ffef0 2024-09-13T19:18:02.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.215+0000 7f8551216640 1 -- 172.21.15.102:0/3018068266 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f854407b070 con 0x5577668ffef0 2024-09-13T19:18:02.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.215+0000 7f8555524800 1 Processor -- start 2024-09-13T19:18:02.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.215+0000 7f8555524800 1 -- start start 2024-09-13T19:18:02.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.215+0000 7f8555524800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5577669112a0 0x5577669116c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.215+0000 7f8555524800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557766698580 con 0x5577669112a0 2024-09-13T19:18:02.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.215+0000 7f8551a17640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5577669112a0 0x5577669116c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.216+0000 7f8551a17640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5577669112a0 0x5577669116c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49580/0 (socket says 172.21.15.102:49580) 2024-09-13T19:18:02.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.216+0000 7f8551a17640 1 -- 172.21.15.102:0/1106198802 learned_addr learned my addr 172.21.15.102:0/1106198802 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:02.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.216+0000 7f8551a17640 1 -- 172.21.15.102:0/1106198802 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557766911c00 con 0x5577669112a0 2024-09-13T19:18:02.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.216+0000 7f8551a17640 1 --2- 172.21.15.102:0/1106198802 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5577669112a0 0x5577669116c0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x5577668fdf50 tx=0x7f854c0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.216+0000 7f8436ffd640 1 -- 172.21.15.102:0/1106198802 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f854c013640 con 0x5577669112a0 2024-09-13T19:18:02.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.216+0000 7f8436ffd640 1 -- 172.21.15.102:0/1106198802 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f854c0137e0 con 0x5577669112a0 2024-09-13T19:18:02.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.216+0000 7f8555524800 1 -- 172.21.15.102:0/1106198802 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557766911e90 con 0x5577669112a0 2024-09-13T19:18:02.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.216+0000 7f8436ffd640 1 -- 172.21.15.102:0/1106198802 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f854c013ae0 con 0x5577669112a0 2024-09-13T19:18:02.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.216+0000 7f8555524800 1 -- 172.21.15.102:0/1106198802 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557766914b70 con 0x5577669112a0 2024-09-13T19:18:02.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.217+0000 7f8436ffd640 1 -- 172.21.15.102:0/1106198802 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f854c011040 con 0x5577669112a0 2024-09-13T19:18:02.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.217+0000 7f8436ffd640 1 --2- 172.21.15.102:0/1106198802 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8428036b40 0x7f8428039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.217+0000 7f8436ffd640 1 -- 172.21.15.102:0/1106198802 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f854c00e040 con 0x5577669112a0 2024-09-13T19:18:02.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.217+0000 7f8551216640 1 --2- 172.21.15.102:0/1106198802 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8428036b40 0x7f8428039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.217+0000 7f8555524800 1 Processor -- start 2024-09-13T19:18:02.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.218+0000 7f8555524800 1 -- start start 2024-09-13T19:18:02.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.218+0000 7f8551216640 1 --2- 172.21.15.102:0/1106198802 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8428036b40 0x7f8428039000 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x5577668fab40 tx=0x7f8544008310 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.218+0000 7f8555524800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55776691dff0 0x55776691e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.218+0000 7f8555524800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5577668ef370 con 0x55776691dff0 2024-09-13T19:18:02.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.218+0000 7f8551a17640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55776691dff0 0x55776691e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.218+0000 7f8551a17640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55776691dff0 0x55776691e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49588/0 (socket says 172.21.15.102:49588) 2024-09-13T19:18:02.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.218+0000 7f8551a17640 1 -- 172.21.15.102:0/4144973736 learned_addr learned my addr 172.21.15.102:0/4144973736 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:02.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.218+0000 7f8551a17640 1 -- 172.21.15.102:0/4144973736 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55776691e9c0 con 0x55776691dff0 2024-09-13T19:18:02.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.218+0000 7f8551a17640 1 --2- 172.21.15.102:0/4144973736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55776691dff0 0x55776691e3f0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f854c04cde0 tx=0x7f854c020f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcdcd674199770b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.219+0000 7f8434ff9640 1 -- 172.21.15.102:0/4144973736 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f854c014c70 con 0x55776691dff0 2024-09-13T19:18:02.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.219+0000 7f8434ff9640 1 -- 172.21.15.102:0/4144973736 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f854c04e040 con 0x55776691dff0 2024-09-13T19:18:02.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.219+0000 7f8434ff9640 1 -- 172.21.15.102:0/4144973736 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f854c02a910 con 0x55776691dff0 2024-09-13T19:18:02.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.219+0000 7f8555524800 1 -- 172.21.15.102:0/4144973736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55776691dff0 msgr2=0x55776691e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.219+0000 7f8555524800 1 --2- 172.21.15.102:0/4144973736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55776691dff0 0x55776691e3f0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f854c04cde0 tx=0x7f854c020f60 comp rx=0 tx=0).stop 2024-09-13T19:18:02.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.219+0000 7f8555524800 1 -- 172.21.15.102:0/4144973736 shutdown_connections 2024-09-13T19:18:02.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.219+0000 7f8555524800 1 --2- 172.21.15.102:0/4144973736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55776691dff0 0x55776691e3f0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.219+0000 7f8555524800 1 -- 172.21.15.102:0/4144973736 >> 172.21.15.102:0/4144973736 conn(0x55776691a350 msgr2=0x557766918450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:02.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.219+0000 7f8555524800 1 -- 172.21.15.102:0/4144973736 shutdown_connections 2024-09-13T19:18:02.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.219+0000 7f8555524800 1 -- 172.21.15.102:0/4144973736 wait complete. 2024-09-13T19:18:02.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.219+0000 7f8555524800 1 Processor -- start 2024-09-13T19:18:02.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.219+0000 7f8555524800 1 -- start start 2024-09-13T19:18:02.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.219+0000 7f8555524800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55776691dff0 0x557766925420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.220+0000 7f8555524800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55776691f030 con 0x55776691dff0 2024-09-13T19:18:02.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.220+0000 7f8551a17640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55776691dff0 0x557766925420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.220+0000 7f8551a17640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55776691dff0 0x557766925420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49600/0 (socket says 172.21.15.102:49600) 2024-09-13T19:18:02.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.220+0000 7f8551a17640 1 -- 172.21.15.102:0/1037684427 learned_addr learned my addr 172.21.15.102:0/1037684427 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:02.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.220+0000 7f8551a17640 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557766925960 con 0x55776691dff0 2024-09-13T19:18:02.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.220+0000 7f8551a17640 1 --2- 172.21.15.102:0/1037684427 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55776691dff0 0x557766925420 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f854c020fa0 tx=0x7f854c04cd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.220+0000 7f8426ffd640 1 -- 172.21.15.102:0/1037684427 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f854c01ce20 con 0x55776691dff0 2024-09-13T19:18:02.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.220+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557766925bf0 con 0x55776691dff0 2024-09-13T19:18:02.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.220+0000 7f8426ffd640 1 -- 172.21.15.102:0/1037684427 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f854c038070 con 0x55776691dff0 2024-09-13T19:18:02.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.220+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557766925bf0 con 0x55776691dff0 2024-09-13T19:18:02.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.220+0000 7f8426ffd640 1 -- 172.21.15.102:0/1037684427 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f854c040260 con 0x55776691dff0 2024-09-13T19:18:02.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.221+0000 7f8426ffd640 1 -- 172.21.15.102:0/1037684427 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f854c020580 con 0x55776691dff0 2024-09-13T19:18:02.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.222+0000 7f8426ffd640 1 --2- 172.21.15.102:0/1037684427 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f841c036b40 0x7f841c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.222+0000 7f8426ffd640 1 -- 172.21.15.102:0/1037684427 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f854c053ab0 con 0x55776691dff0 2024-09-13T19:18:02.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.222+0000 7f8551216640 1 --2- 172.21.15.102:0/1037684427 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f841c036b40 0x7f841c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.222+0000 7f8551216640 1 --2- 172.21.15.102:0/1037684427 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f841c036b40 0x7f841c039000 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x5577668fe010 tx=0x7f8544087000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.222+0000 7f8555524800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.222+0000 7f8555524800 1 --2- 172.21.15.102:0/1037684427 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557766930d60 0x557766933220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.222+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557766933970 con 0x557766930d60 2024-09-13T19:18:02.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.222+0000 7f8548a15640 1 --2- 172.21.15.102:0/1037684427 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557766930d60 0x557766933220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.223+0000 7f8548a15640 1 --2- 172.21.15.102:0/1037684427 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557766930d60 0x557766933220 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.223+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f853c009050 con 0x557766930d60 2024-09-13T19:18:02.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.223+0000 7f8555524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:02.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.223+0000 7f8555524800 20 realm 2024-09-13T19:18:02.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.223+0000 7f8555524800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.223+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5577669301b0 con 0x557766930d60 2024-09-13T19:18:02.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.223+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f853c009050 con 0x557766930d60 2024-09-13T19:18:02.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.223+0000 7f8555524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:02.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.223+0000 7f8555524800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:18:02.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.223+0000 7f8555524800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.223+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557766934460 con 0x557766930d60 2024-09-13T19:18:02.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.223+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f853c009050 con 0x557766930d60 2024-09-13T19:18:02.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.223+0000 7f8555524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:02.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.223+0000 7f8555524800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.223+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557766934d30 con 0x557766930d60 2024-09-13T19:18:02.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.223+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f853c009050 con 0x557766930d60 2024-09-13T19:18:02.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.224+0000 7f8555524800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:18:02.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.224+0000 7f8555524800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.224+0000 7f8555524800 1 --2- 172.21.15.102:0/1037684427 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x557766935670 0x557766937a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.224+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5577669381f0 con 0x557766935670 2024-09-13T19:18:02.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.224+0000 7f8551a17640 1 --2- 172.21.15.102:0/1037684427 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x557766935670 0x557766937a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.224+0000 7f8551a17640 1 --2- 172.21.15.102:0/1037684427 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x557766935670 0x557766937a60 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.224+0000 7f8551a17640 1 -- 172.21.15.102:0/1037684427 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f854c00a4a0 con 0x557766935670 2024-09-13T19:18:02.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.224+0000 7f8555524800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:18:02.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.224+0000 7f8555524800 20 searching for the correct realm 2024-09-13T19:18:02.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.224+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557766939b20 con 0x557766935670 2024-09-13T19:18:02.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.224+0000 7f8551a17640 1 -- 172.21.15.102:0/1037684427 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f854c00a4a0 con 0x557766935670 2024-09-13T19:18:02.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.224+0000 7f8551a17640 1 --2- 172.21.15.102:0/1037684427 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f854c04b2b0 0x7f854c01f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.224+0000 7f8551a17640 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557766939b20 con 0x7f854c04b2b0 2024-09-13T19:18:02.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.225+0000 7f8551216640 1 --2- 172.21.15.102:0/1037684427 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f854c04b2b0 0x7f854c01f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.225+0000 7f8551216640 1 --2- 172.21.15.102:0/1037684427 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f854c04b2b0 0x7f854c01f340 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.225+0000 7f8551216640 1 -- 172.21.15.102:0/1037684427 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f854407b070 con 0x7f854c04b2b0 2024-09-13T19:18:02.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.225+0000 7f8551216640 1 --2- 172.21.15.102:0/1037684427 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f854405c070 0x7f854408d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.225+0000 7f8551216640 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557766939b20 con 0x7f854405c070 2024-09-13T19:18:02.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.226+0000 7f8548a15640 1 --2- 172.21.15.102:0/1037684427 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f854405c070 0x7f854408d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.226+0000 7f8548a15640 1 --2- 172.21.15.102:0/1037684427 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f854405c070 0x7f854408d450 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.226+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f853c009050 con 0x7f854405c070 2024-09-13T19:18:02.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.226+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557766939b20 con 0x557766930d60 2024-09-13T19:18:02.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.227+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f853c009050 con 0x557766930d60 2024-09-13T19:18:02.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.227+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557766939b20 con 0x557766930d60 2024-09-13T19:18:02.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.227+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f853c029040 con 0x557766930d60 2024-09-13T19:18:02.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.227+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557766939b20 con 0x7f854405c070 2024-09-13T19:18:02.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.227+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f853c029040 con 0x7f854405c070 2024-09-13T19:18:02.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.227+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557766939b20 con 0x7f854405c070 2024-09-13T19:18:02.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.227+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f853c029040 con 0x7f854405c070 2024-09-13T19:18:02.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.227+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557766939b20 con 0x7f854c04b2b0 2024-09-13T19:18:02.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.228+0000 7f8551216640 1 -- 172.21.15.102:0/1037684427 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f854407b070 con 0x7f854c04b2b0 2024-09-13T19:18:02.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.228+0000 7f8551216640 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557766939b20 con 0x557766935670 2024-09-13T19:18:02.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.228+0000 7f8551a17640 1 -- 172.21.15.102:0/1037684427 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f854c00a4a0 con 0x557766935670 2024-09-13T19:18:02.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.228+0000 7f8551a17640 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557766939b20 con 0x557766930d60 2024-09-13T19:18:02.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.228+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f853c029040 con 0x557766930d60 2024-09-13T19:18:02.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.228+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557766939b20 con 0x7f854c04b2b0 2024-09-13T19:18:02.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.228+0000 7f8551216640 1 -- 172.21.15.102:0/1037684427 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f854407b070 con 0x7f854c04b2b0 2024-09-13T19:18:02.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.228+0000 7f8551216640 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557766939b20 con 0x557766930d60 2024-09-13T19:18:02.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.229+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f853c029040 con 0x557766930d60 2024-09-13T19:18:02.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.229+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557766939b20 con 0x7f854c04b2b0 2024-09-13T19:18:02.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.229+0000 7f8551216640 1 -- 172.21.15.102:0/1037684427 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f854407b070 con 0x7f854c04b2b0 2024-09-13T19:18:02.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.229+0000 7f8551216640 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557766939b20 con 0x557766935670 2024-09-13T19:18:02.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.229+0000 7f8551a17640 1 -- 172.21.15.102:0/1037684427 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f854c00a4a0 con 0x557766935670 2024-09-13T19:18:02.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.229+0000 7f8551a17640 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557766939b20 con 0x557766935670 2024-09-13T19:18:02.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.229+0000 7f8551a17640 1 -- 172.21.15.102:0/1037684427 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f854c00a4a0 con 0x557766935670 2024-09-13T19:18:02.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.229+0000 7f8551a17640 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557766939b20 con 0x7f854405c070 2024-09-13T19:18:02.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.230+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f853c029040 con 0x7f854405c070 2024-09-13T19:18:02.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.230+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557766939b20 con 0x557766935670 2024-09-13T19:18:02.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.230+0000 7f8551a17640 1 -- 172.21.15.102:0/1037684427 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f854c00a4a0 con 0x557766935670 2024-09-13T19:18:02.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.230+0000 7f8551a17640 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557766939b20 con 0x557766935670 2024-09-13T19:18:02.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.230+0000 7f8551a17640 1 -- 172.21.15.102:0/1037684427 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f854c00a4a0 con 0x557766935670 2024-09-13T19:18:02.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.230+0000 7f8551a17640 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557766939b20 con 0x557766930d60 2024-09-13T19:18:02.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.230+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f853c029040 con 0x557766930d60 2024-09-13T19:18:02.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.230+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557766939b20 con 0x557766930d60 2024-09-13T19:18:02.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.231+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f853c029040 con 0x557766930d60 2024-09-13T19:18:02.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.231+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557766939b20 con 0x7f854405c070 2024-09-13T19:18:02.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.231+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f853c029040 con 0x7f854405c070 2024-09-13T19:18:02.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.231+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557766939b20 con 0x557766935670 2024-09-13T19:18:02.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.231+0000 7f8551a17640 1 -- 172.21.15.102:0/1037684427 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f854c00a4a0 con 0x557766935670 2024-09-13T19:18:02.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.231+0000 7f8551a17640 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557766939b20 con 0x7f854c04b2b0 2024-09-13T19:18:02.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.231+0000 7f8551216640 1 -- 172.21.15.102:0/1037684427 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f854407b070 con 0x7f854c04b2b0 2024-09-13T19:18:02.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.231+0000 7f8551216640 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557766939b20 con 0x557766930d60 2024-09-13T19:18:02.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.232+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f853c029040 con 0x557766930d60 2024-09-13T19:18:02.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.232+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557766939b20 con 0x7f854c04b2b0 2024-09-13T19:18:02.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.232+0000 7f8551216640 1 -- 172.21.15.102:0/1037684427 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f854407b070 con 0x7f854c04b2b0 2024-09-13T19:18:02.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.232+0000 7f8551216640 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557766939b20 con 0x557766935670 2024-09-13T19:18:02.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.232+0000 7f8551a17640 1 -- 172.21.15.102:0/1037684427 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f854c00a4a0 con 0x557766935670 2024-09-13T19:18:02.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.232+0000 7f8551a17640 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557766939b20 con 0x7f854405c070 2024-09-13T19:18:02.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.232+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f853c029040 con 0x7f854405c070 2024-09-13T19:18:02.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.233+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557766939b20 con 0x7f854c04b2b0 2024-09-13T19:18:02.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.233+0000 7f8551216640 1 -- 172.21.15.102:0/1037684427 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f854407b070 con 0x7f854c04b2b0 2024-09-13T19:18:02.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.233+0000 7f8551216640 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557766939b20 con 0x557766935670 2024-09-13T19:18:02.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.233+0000 7f8551a17640 1 -- 172.21.15.102:0/1037684427 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f854c00a4a0 con 0x557766935670 2024-09-13T19:18:02.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.233+0000 7f8551a17640 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557766939b20 con 0x7f854405c070 2024-09-13T19:18:02.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.233+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f853c029040 con 0x7f854405c070 2024-09-13T19:18:02.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.233+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557766939b20 con 0x557766930d60 2024-09-13T19:18:02.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.234+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v36'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f853c029040 con 0x557766930d60 2024-09-13T19:18:02.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.234+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557766939b20 con 0x7f854c04b2b0 2024-09-13T19:18:02.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.234+0000 7f8551216640 1 -- 172.21.15.102:0/1037684427 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f854407b070 con 0x7f854c04b2b0 2024-09-13T19:18:02.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.234+0000 7f8555524800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:18:02.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.234+0000 7f8555524800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:18:02.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.234+0000 7f8555524800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:18:02.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.234+0000 7f8555524800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:18:02.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.234+0000 7f8555524800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:18:02.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.234+0000 7f8555524800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:18:02.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.234+0000 7f8555524800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.234+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557766938bb0 con 0x557766930d60 2024-09-13T19:18:02.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.234+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f853c029040 con 0x557766930d60 2024-09-13T19:18:02.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.234+0000 7f8555524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:02.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.234+0000 7f8555524800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.234+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557766939450 con 0x557766930d60 2024-09-13T19:18:02.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.234+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f853c029040 con 0x557766930d60 2024-09-13T19:18:02.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.234+0000 7f8555524800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:18:02.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.234+0000 7f8555524800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.234+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557766939fa0 con 0x557766935670 2024-09-13T19:18:02.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.234+0000 7f8551a17640 1 -- 172.21.15.102:0/1037684427 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f854c00a4a0 con 0x557766935670 2024-09-13T19:18:02.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.235+0000 7f8555524800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:18:02.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.235+0000 7f8555524800 20 zone default found 2024-09-13T19:18:02.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.235+0000 7f8555524800 4 Realm: () 2024-09-13T19:18:02.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.235+0000 7f8555524800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:18:02.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.235+0000 7f8555524800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:18:02.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.235+0000 7f8555524800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:18:02.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.235+0000 7f8555524800 20 zonegroup default 2024-09-13T19:18:02.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.235+0000 7f8555524800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.235+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55776693a7f0 con 0x7f854c04b2b0 2024-09-13T19:18:02.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.235+0000 7f8551216640 1 -- 172.21.15.102:0/1037684427 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f854407b070 con 0x7f854c04b2b0 2024-09-13T19:18:02.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.235+0000 7f8555524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:02.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.235+0000 7f8555524800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.235+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55776693c570 con 0x557766935670 2024-09-13T19:18:02.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.235+0000 7f8551a17640 1 -- 172.21.15.102:0/1037684427 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f854c00a4a0 con 0x557766935670 2024-09-13T19:18:02.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.235+0000 7f8555524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:02.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.235+0000 7f8555524800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.235+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55776693c9d0 con 0x557766935670 2024-09-13T19:18:02.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.235+0000 7f8551a17640 1 -- 172.21.15.102:0/1037684427 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f854c00a4a0 con 0x557766935670 2024-09-13T19:18:02.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.235+0000 7f8555524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:02.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.235+0000 7f8555524800 20 started sync module instance, tier type = 2024-09-13T19:18:02.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.235+0000 7f8555524800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:18:02.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.235+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55776693ba10 con 0x7f854c04b2b0 2024-09-13T19:18:02.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.236+0000 7f8551216640 1 -- 172.21.15.102:0/1037684427 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(44 notify.0 [create] v36'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f854407b070 con 0x7f854c04b2b0 2024-09-13T19:18:02.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.236+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93971310427648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55776693d2c0 con 0x7f854c04b2b0 2024-09-13T19:18:02.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.236+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55776693db10 con 0x557766930d60 2024-09-13T19:18:02.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.237+0000 7f8551216640 1 -- 172.21.15.102:0/1037684427 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93971310427648] v36'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f854407b070 con 0x7f854c04b2b0 2024-09-13T19:18:02.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.238+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v36'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f853c029040 con 0x557766930d60 2024-09-13T19:18:02.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.238+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93971310431760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55776693deb0 con 0x557766930d60 2024-09-13T19:18:02.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.238+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55776693e700 con 0x557766935670 2024-09-13T19:18:02.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.239+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93971310431760] v36'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f853c029040 con 0x557766930d60 2024-09-13T19:18:02.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.239+0000 7f8551a17640 1 -- 172.21.15.102:0/1037684427 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v36'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f854c00a4a0 con 0x557766935670 2024-09-13T19:18:02.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.239+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93971310436016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55776693e780 con 0x557766935670 2024-09-13T19:18:02.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.239+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55776693f140 con 0x7f854c04b2b0 2024-09-13T19:18:02.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.240+0000 7f8551a17640 1 -- 172.21.15.102:0/1037684427 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93971310436016] v36'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f854c00a4a0 con 0x557766935670 2024-09-13T19:18:02.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.241+0000 7f8551216640 1 -- 172.21.15.102:0/1037684427 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(50 notify.3 [create] v36'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f854407b070 con 0x7f854c04b2b0 2024-09-13T19:18:02.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.241+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93971310437072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55776693f140 con 0x7f854c04b2b0 2024-09-13T19:18:02.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.241+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55776693fbc0 con 0x557766930d60 2024-09-13T19:18:02.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.242+0000 7f8551216640 1 -- 172.21.15.102:0/1037684427 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93971310437072] v36'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f854407b070 con 0x7f854c04b2b0 2024-09-13T19:18:02.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.242+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v36'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f853c029040 con 0x557766930d60 2024-09-13T19:18:02.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.242+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93971310442192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55776693f140 con 0x557766930d60 2024-09-13T19:18:02.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.242+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557766940660 con 0x7f854405c070 2024-09-13T19:18:02.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.243+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(54 notify.5 [create] v36'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f853c029040 con 0x7f854405c070 2024-09-13T19:18:02.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.243+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93971310444880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557766940b50 con 0x7f854405c070 2024-09-13T19:18:02.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.243+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93971310442192] v36'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f853c029040 con 0x557766930d60 2024-09-13T19:18:02.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.243+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557766941650 con 0x7f854405c070 2024-09-13T19:18:02.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.244+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(56 notify.6 [create] v36'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f853c029040 con 0x7f854405c070 2024-09-13T19:18:02.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.244+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93971310439648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557766941610 con 0x7f854405c070 2024-09-13T19:18:02.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.244+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557766942010 con 0x7f854405c070 2024-09-13T19:18:02.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.244+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 93971310444880] v36'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f853c029040 con 0x7f854405c070 2024-09-13T19:18:02.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.245+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(58 notify.7 [create] v36'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f853c029040 con 0x7f854405c070 2024-09-13T19:18:02.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.245+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 93971310439648] v36'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f853c029040 con 0x7f854405c070 2024-09-13T19:18:02.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.245+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93971310446112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557766941fd0 con 0x7f854405c070 2024-09-13T19:18:02.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.245+0000 7f8555524800 20 add_watcher() i=0 2024-09-13T19:18:02.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.245+0000 7f8555524800 20 add_watcher() i=1 2024-09-13T19:18:02.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.245+0000 7f8555524800 20 add_watcher() i=2 2024-09-13T19:18:02.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.245+0000 7f8555524800 20 add_watcher() i=3 2024-09-13T19:18:02.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.245+0000 7f8555524800 20 add_watcher() i=4 2024-09-13T19:18:02.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.245+0000 7f8555524800 20 add_watcher() i=5 2024-09-13T19:18:02.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.246+0000 7f8555524800 20 add_watcher() i=6 2024-09-13T19:18:02.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.246+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 93971310446112] v36'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f853c029040 con 0x7f854405c070 2024-09-13T19:18:02.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.246+0000 7f8555524800 20 add_watcher() i=7 2024-09-13T19:18:02.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.246+0000 7f8555524800 2 all 8 watchers are set, enabling cache 2024-09-13T19:18:02.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.247+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557766945000 con 0x557766930d60 2024-09-13T19:18:02.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.247+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f853c029040 con 0x557766930d60 2024-09-13T19:18:02.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.247+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93971310451488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557766942420 con 0x557766930d60 2024-09-13T19:18:02.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.248+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93971310451488] v36'239 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f853c029040 con 0x557766930d60 2024-09-13T19:18:02.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.248+0000 7f84077e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:18:02.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.248+0000 7f8555524800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:18:02.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.248+0000 7f8555524800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:18:02.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.248+0000 7f8555524800 5 note: GC not initialized 2024-09-13T19:18:02.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.248+0000 7f84067e4640 20 reqs_thread_entry: start 2024-09-13T19:18:02.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.249+0000 7f8555524800 20 init_complete bucket index max shards: 11 2024-09-13T19:18:02.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.249+0000 7f8555524800 20 Filter name: none 2024-09-13T19:18:02.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.249+0000 7f8377fff640 20 reqs_thread_entry: start 2024-09-13T19:18:02.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.249+0000 7f8555524800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T19:18:02.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.249+0000 7f8555524800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.249+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5577669783f0 con 0x7f854405c070 2024-09-13T19:18:02.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.249+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(62 ada [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f853c029040 con 0x7f854405c070 2024-09-13T19:18:02.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.249+0000 7f8555524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:02.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.249+0000 7f8555524800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x0 2024-09-13T19:18:02.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.249+0000 7f8555524800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:18:02.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.249+0000 7f8555524800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : miss 2024-09-13T19:18:02.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.249+0000 7f8555524800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.249+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:63 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557766976a30 con 0x557766930d60 2024-09-13T19:18:02.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.250+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(63 MH1WC2XQ1S8UISFDZC8W [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f853c029040 con 0x557766930d60 2024-09-13T19:18:02.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.250+0000 7f8555524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:02.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.250+0000 7f8555524800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x0 2024-09-13T19:18:02.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.250+0000 7f8555524800 10 adding default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-13T19:18:02.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.250+0000 7f8555524800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-13T19:18:02.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.250+0000 7f8555524800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-13T19:18:02.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.250+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:64 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557766977370 con 0x7f854405c070 2024-09-13T19:18:02.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.251+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(64 ada [delete,create,call,writefull 0~473] v36'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f853c029040 con 0x7f854405c070 2024-09-13T19:18:02.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.251+0000 7f8555524800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:18:02.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.251+0000 7f8555524800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:18:02.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.251+0000 7f8555524800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T19:18:02.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.251+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 93971310669344 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55776697bed0 con 0x557766930d60 2024-09-13T19:18:02.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.251+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== watch-notify(notify (1) cookie 93971310442192 notify 154618822691 ret 0) ==== 691+0+0 (crc 0 0 0) 0x557766977710 con 0x557766930d60 2024-09-13T19:18:02.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.251+0000 7f8434ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822691 cookie 93971310442192 notifier 4839 bl.length()=649 2024-09-13T19:18:02.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.251+0000 7f8434ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:18:02.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.251+0000 7f8434ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:18:02.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.251+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(65 notify.4 [notify cookie 93971310669344 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f853c029040 con 0x557766930d60 2024-09-13T19:18:02.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.251+0000 7f8434ff9640 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f8414003ea0 con 0x557766930d60 2024-09-13T19:18:02.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.252+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f853c029040 con 0x557766930d60 2024-09-13T19:18:02.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.252+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== watch-notify(notify_complete (2) cookie 93971310669344 notify 154618822691 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557766978010 con 0x557766930d60 2024-09-13T19:18:02.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.252+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:67 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557766976dd0 con 0x557766930d60 2024-09-13T19:18:02.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.253+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== osd_op_reply(67 MH1WC2XQ1S8UISFDZC8W [delete,create,writefull 0~7] v36'20 uv20 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f853c029040 con 0x557766930d60 2024-09-13T19:18:02.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.253+0000 7f8555524800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-13T19:18:02.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.253+0000 7f8555524800 10 moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-13T19:18:02.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.253+0000 7f8555524800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W, ofs0, ns] 2024-09-13T19:18:02.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.253+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 93971310669264 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55776697c2e0 con 0x557766935670 2024-09-13T19:18:02.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.253+0000 7f8551a17640 1 -- 172.21.15.102:0/1037684427 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== watch-notify(notify (1) cookie 93971310436016 notify 154618822664 ret 0) ==== 219+0+0 (crc 0 0 0) 0x557766925960 con 0x557766935670 2024-09-13T19:18:02.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.253+0000 7f8427fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822664 cookie 93971310436016 notifier 4839 bl.length()=177 2024-09-13T19:18:02.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.253+0000 7f8427fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-13T19:18:02.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.253+0000 7f8427fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-13T19:18:02.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.253+0000 7f8551a17640 1 -- 172.21.15.102:0/1037684427 <== osd.3 v2:172.21.15.102:6800/3096737090 17 ==== osd_op_reply(68 notify.2 [notify cookie 93971310669264 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f854c00a4a0 con 0x557766935670 2024-09-13T19:18:02.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.253+0000 7f8427fff640 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f8384003400 con 0x557766935670 2024-09-13T19:18:02.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.253+0000 7f8551a17640 1 -- 172.21.15.102:0/1037684427 <== osd.3 v2:172.21.15.102:6800/3096737090 18 ==== watch-notify(notify_complete (2) cookie 93971310669264 notify 154618822664 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f854c065020 con 0x557766935670 2024-09-13T19:18:02.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.253+0000 7f8551a17640 1 -- 172.21.15.102:0/1037684427 <== osd.3 v2:172.21.15.102:6800/3096737090 19 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f854c00a4a0 con 0x557766935670 2024-09-13T19:18:02.266 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T19:18:02.251000Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:18:02.250985Z","tags":[],"group_ids":[]} 2024-09-13T19:18:02.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.254+0000 7f84077e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:18:02.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.254+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93971310451488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5577669760b0 con 0x557766930d60 2024-09-13T19:18:02.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.255+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93971310451488] v36'240 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f853c029040 con 0x557766930d60 2024-09-13T19:18:02.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.255+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93971310427648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5577669760b0 con 0x7f854c04b2b0 2024-09-13T19:18:02.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.256+0000 7f8551216640 1 -- 172.21.15.102:0/1037684427 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93971310427648] v36'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f854407b070 con 0x7f854c04b2b0 2024-09-13T19:18:02.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.256+0000 7f8555524800 20 remove_watcher() i=0 2024-09-13T19:18:02.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.256+0000 7f8555524800 2 removed watcher, disabling cache 2024-09-13T19:18:02.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.256+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93971310431760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5577669760b0 con 0x557766930d60 2024-09-13T19:18:02.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.257+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 <== osd.1 v2:172.21.15.102:6808/2204418452 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93971310431760] v36'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f853c029040 con 0x557766930d60 2024-09-13T19:18:02.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.257+0000 7f8555524800 20 remove_watcher() i=1 2024-09-13T19:18:02.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.257+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93971310436016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5577669760b0 con 0x557766935670 2024-09-13T19:18:02.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.259+0000 7f8551a17640 1 -- 172.21.15.102:0/1037684427 <== osd.3 v2:172.21.15.102:6800/3096737090 20 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93971310436016] v36'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f854c00a4a0 con 0x557766935670 2024-09-13T19:18:02.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.259+0000 7f8555524800 20 remove_watcher() i=2 2024-09-13T19:18:02.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.259+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93971310437072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5577669760b0 con 0x7f854c04b2b0 2024-09-13T19:18:02.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.260+0000 7f8551216640 1 -- 172.21.15.102:0/1037684427 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93971310437072] v36'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f854407b070 con 0x7f854c04b2b0 2024-09-13T19:18:02.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.260+0000 7f8555524800 20 remove_watcher() i=3 2024-09-13T19:18:02.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.260+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93971310442192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5577669760b0 con 0x557766930d60 2024-09-13T19:18:02.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.261+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 <== osd.1 v2:172.21.15.102:6808/2204418452 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93971310442192] v36'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f853c029040 con 0x557766930d60 2024-09-13T19:18:02.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.261+0000 7f8555524800 20 remove_watcher() i=4 2024-09-13T19:18:02.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.261+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93971310444880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5577669760b0 con 0x7f854405c070 2024-09-13T19:18:02.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.262+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93971310444880] v36'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f853c029040 con 0x7f854405c070 2024-09-13T19:18:02.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.262+0000 7f8555524800 20 remove_watcher() i=5 2024-09-13T19:18:02.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.262+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93971310439648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5577669760b0 con 0x7f854405c070 2024-09-13T19:18:02.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.263+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93971310439648] v36'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f853c029040 con 0x7f854405c070 2024-09-13T19:18:02.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.263+0000 7f8555524800 20 remove_watcher() i=6 2024-09-13T19:18:02.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.263+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93971310446112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5577669760b0 con 0x7f854405c070 2024-09-13T19:18:02.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.264+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93971310446112] v36'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f853c029040 con 0x7f854405c070 2024-09-13T19:18:02.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.264+0000 7f8555524800 20 remove_watcher() i=7 2024-09-13T19:18:02.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.264+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f854405c070 msgr2=0x7f854408d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.264+0000 7f8555524800 1 --2- 172.21.15.102:0/1037684427 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f854405c070 0x7f854408d450 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.264+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557766930d60 msgr2=0x557766933220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.264+0000 7f8555524800 1 --2- 172.21.15.102:0/1037684427 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557766930d60 0x557766933220 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.264+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f854c04b2b0 msgr2=0x7f854c01f340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.264+0000 7f8555524800 1 --2- 172.21.15.102:0/1037684427 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f854c04b2b0 0x7f854c01f340 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.264+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x557766935670 msgr2=0x557766937a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.264+0000 7f8555524800 1 --2- 172.21.15.102:0/1037684427 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x557766935670 0x557766937a60 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.264+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f841c036b40 msgr2=0x7f841c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.264+0000 7f8555524800 1 --2- 172.21.15.102:0/1037684427 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f841c036b40 0x7f841c039000 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x5577668fe010 tx=0x7f8544087000 comp rx=0 tx=0).stop 2024-09-13T19:18:02.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.264+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55776691dff0 msgr2=0x557766925420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.264+0000 7f8548a15640 1 -- 172.21.15.102:0/1037684427 reap_dead start 2024-09-13T19:18:02.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.264+0000 7f8555524800 1 --2- 172.21.15.102:0/1037684427 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55776691dff0 0x557766925420 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f854c020fa0 tx=0x7f854c04cd40 comp rx=0 tx=0).stop 2024-09-13T19:18:02.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.264+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 shutdown_connections 2024-09-13T19:18:02.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.264+0000 7f8555524800 1 --2- 172.21.15.102:0/1037684427 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55776691dff0 0x557766925420 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.264+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 >> 172.21.15.102:0/1037684427 conn(0x55776691a350 msgr2=0x557766918420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:02.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.265+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 shutdown_connections 2024-09-13T19:18:02.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.265+0000 7f8555524800 1 -- 172.21.15.102:0/1037684427 wait complete. 2024-09-13T19:18:02.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.265+0000 7f8555524800 1 -- 172.21.15.102:0/1106198802 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8428036b40 msgr2=0x7f8428039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.265+0000 7f8555524800 1 --2- 172.21.15.102:0/1106198802 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8428036b40 0x7f8428039000 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x5577668fab40 tx=0x7f8544008310 comp rx=0 tx=0).stop 2024-09-13T19:18:02.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.265+0000 7f8555524800 1 -- 172.21.15.102:0/1106198802 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5577669112a0 msgr2=0x5577669116c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.265+0000 7f8555524800 1 --2- 172.21.15.102:0/1106198802 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5577669112a0 0x5577669116c0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x5577668fdf50 tx=0x7f854c0167b0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.265+0000 7f8555524800 1 -- 172.21.15.102:0/1106198802 shutdown_connections 2024-09-13T19:18:02.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.265+0000 7f8555524800 1 --2- 172.21.15.102:0/1106198802 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8428036b40 0x7f8428039000 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.265+0000 7f8555524800 1 --2- 172.21.15.102:0/1106198802 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5577669112a0 0x5577669116c0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.265+0000 7f8555524800 1 -- 172.21.15.102:0/1106198802 >> 172.21.15.102:0/1106198802 conn(0x557766906230 msgr2=0x557766908db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:02.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.265+0000 7f8555524800 1 -- 172.21.15.102:0/1106198802 shutdown_connections 2024-09-13T19:18:02.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.265+0000 7f8555524800 1 -- 172.21.15.102:0/1106198802 wait complete. 2024-09-13T19:18:02.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.265+0000 7f8555524800 1 -- 172.21.15.102:0/3018068266 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557766802b70 msgr2=0x5577668fd650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.265+0000 7f8555524800 1 --2- 172.21.15.102:0/3018068266 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557766802b70 0x5577668fd650 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.265+0000 7f8555524800 1 -- 172.21.15.102:0/3018068266 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5577668ffef0 msgr2=0x5577669022e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.265+0000 7f8555524800 1 --2- 172.21.15.102:0/3018068266 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5577668ffef0 0x5577669022e0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.265+0000 7f8555524800 1 -- 172.21.15.102:0/3018068266 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8438036b40 msgr2=0x7f8438039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.265+0000 7f8555524800 1 --2- 172.21.15.102:0/3018068266 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8438036b40 0x7f8438039000 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f853c000f60 tx=0x7f853c0012b0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.265+0000 7f8555524800 1 -- 172.21.15.102:0/3018068266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557766771660 msgr2=0x5577668f6580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.265+0000 7f8555524800 1 --2- 172.21.15.102:0/3018068266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557766771660 0x5577668f6580 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f854400a330 tx=0x7f8544002fb0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.265+0000 7f8555524800 1 -- 172.21.15.102:0/3018068266 shutdown_connections 2024-09-13T19:18:02.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.265+0000 7f8555524800 1 --2- 172.21.15.102:0/3018068266 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5577668ffef0 0x5577669022e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.265+0000 7f8555524800 1 --2- 172.21.15.102:0/3018068266 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557766802b70 0x5577668fd650 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.265+0000 7f8555524800 1 --2- 172.21.15.102:0/3018068266 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8438036b40 0x7f8438039000 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.265+0000 7f8555524800 1 --2- 172.21.15.102:0/3018068266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557766771660 0x5577668f6580 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.265+0000 7f8555524800 1 -- 172.21.15.102:0/3018068266 >> 172.21.15.102:0/3018068266 conn(0x5577667f7de0 msgr2=0x5577668e8e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:02.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.265+0000 7f8555524800 1 -- 172.21.15.102:0/3018068266 shutdown_connections 2024-09-13T19:18:02.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.265+0000 7f8555524800 1 -- 172.21.15.102:0/3018068266 wait complete. 2024-09-13T19:18:02.277 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:18:02.251000Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:18:02.250985Z', 'tags': [], 'group_ids': []} 2024-09-13T19:18:02.277 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:18:02.251000Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:18:02.250985Z', 'tags': [], 'group_ids': []} 2024-09-13T19:18:02.277 ERROR:root:0 2024-09-13T19:18:02.279 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:18:02.293 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx000009eb309397d7b8572-0066e48fea-4237-default', 'HostId': '4237-default-default'} 2024-09-13T19:18:02.293 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'foo', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '4'} 2024-09-13T19:18:02.312 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:18:02.312 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 0} 2024-09-13T19:18:02.332 INFO:tasks.radosgw_admin_rest: json result: {'keys': [], 'truncated': True, 'count': 0, 'marker': '8:1e6ca5ed:users.uid::foo:head'} 2024-09-13T19:18:02.333 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1} 2024-09-13T19:18:02.356 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['foo'], 'truncated': True, 'count': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-13T19:18:02.357 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-13T19:18:02.373 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['ada'], 'truncated': False, 'count': 1} 2024-09-13T19:18:02.373 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:18:02.403 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:18:02.404 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'access-key': '9te6NH5mcdcq0Tc5i8i1', 'uid': 'uid_not_exist'} 2024-09-13T19:18:02.416 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:18:02.416 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T19:18:02.416 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T19:18:02.416 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write' 2024-09-13T19:18:02.462 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:18:02.462 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:18:02.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.460+0000 7fe2cf33e800 1 Processor -- start 2024-09-13T19:18:02.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.460+0000 7fe2cf33e800 1 -- start start 2024-09-13T19:18:02.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.461+0000 7fe2cf33e800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x559ec1db05b0 0x559ec1daed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.461+0000 7fe2cf33e800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559ec1cf9b30 con 0x559ec1db09b0 2024-09-13T19:18:02.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.461+0000 7fe2cf33e800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x559ec1cdb360 con 0x559ec1db05b0 2024-09-13T19:18:02.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.461+0000 7fe2cb03b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x559ec1db05b0 0x559ec1daed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.461+0000 7fe2ca83a640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x559ec1db09b0 0x559ec1daf3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:53688/0 (socket says 172.21.15.102:53688) 2024-09-13T19:18:02.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.461+0000 7fe2ca83a640 1 -- 172.21.15.102:0/2908935838 learned_addr learned my addr 172.21.15.102:0/2908935838 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:18:02.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.461+0000 7fe2ca039640 1 -- 172.21.15.102:0/2908935838 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1449328698 0 0) 0x559ec1cf9b30 con 0x559ec1db09b0 2024-09-13T19:18:02.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.461+0000 7fe2ca039640 1 -- 172.21.15.102:0/2908935838 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2b4001e10 con 0x559ec1db09b0 2024-09-13T19:18:02.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.461+0000 7fe2cb03b640 1 -- 172.21.15.102:0/2908935838 >> v1:172.21.15.53:6789/0 conn(0x559ec1db09b0 legacy=0x559ec1daf3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.461+0000 7fe2cb03b640 1 -- 172.21.15.102:0/2908935838 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ec1d01e00 con 0x559ec1db05b0 2024-09-13T19:18:02.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.463+0000 7fe2cb03b640 1 --2- 172.21.15.102:0/2908935838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ec1db05b0 0x559ec1daed90 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc00a470 tx=0x7fe2bc045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e0bbb6e104ece73 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.463+0000 7fe2ca039640 1 -- 172.21.15.102:0/2908935838 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2bc059070 con 0x559ec1db05b0 2024-09-13T19:18:02.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.463+0000 7fe2ca039640 1 -- 172.21.15.102:0/2908935838 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2bc054570 con 0x559ec1db05b0 2024-09-13T19:18:02.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.463+0000 7fe2ca039640 1 -- 172.21.15.102:0/2908935838 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2bc054870 con 0x559ec1db05b0 2024-09-13T19:18:02.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.464+0000 7fe2cf33e800 1 -- 172.21.15.102:0/2908935838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ec1db05b0 msgr2=0x559ec1daed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.464+0000 7fe2cf33e800 1 --2- 172.21.15.102:0/2908935838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ec1db05b0 0x559ec1daed90 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc00a470 tx=0x7fe2bc045920 comp rx=0 tx=0).stop 2024-09-13T19:18:02.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.464+0000 7fe2cf33e800 1 -- 172.21.15.102:0/2908935838 shutdown_connections 2024-09-13T19:18:02.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.464+0000 7fe2cf33e800 1 --2- 172.21.15.102:0/2908935838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ec1db05b0 0x559ec1daed90 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.464+0000 7fe2cf33e800 1 -- 172.21.15.102:0/2908935838 >> 172.21.15.102:0/2908935838 conn(0x559ec1e35fe0 msgr2=0x559ec1e38400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:02.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.464+0000 7fe2cf33e800 1 -- 172.21.15.102:0/2908935838 shutdown_connections 2024-09-13T19:18:02.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.464+0000 7fe2cf33e800 1 -- 172.21.15.102:0/2908935838 wait complete. 2024-09-13T19:18:02.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.477+0000 7fe2cf33e800 1 Processor -- start 2024-09-13T19:18:02.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.478+0000 7fe2cf33e800 1 -- start start 2024-09-13T19:18:02.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.478+0000 7fe2cf33e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ec1db05b0 0x559ec1f2b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.478+0000 7fe2cf33e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559ec1d86360 con 0x559ec1db05b0 2024-09-13T19:18:02.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.478+0000 7fe2cb03b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ec1db05b0 0x559ec1f2b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.478+0000 7fe2cb03b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ec1db05b0 0x559ec1f2b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49618/0 (socket says 172.21.15.102:49618) 2024-09-13T19:18:02.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.478+0000 7fe2cb03b640 1 -- 172.21.15.102:0/2205430972 learned_addr learned my addr 172.21.15.102:0/2205430972 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:02.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.478+0000 7fe2cb03b640 1 -- 172.21.15.102:0/2205430972 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ec1cd3bc0 con 0x559ec1db05b0 2024-09-13T19:18:02.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.479+0000 7fe2cb03b640 1 --2- 172.21.15.102:0/2205430972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ec1db05b0 0x559ec1f2b940 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc025b20 tx=0x7fe2bc04e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c7e8e701f7a33e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.479+0000 7fe1b960a640 1 -- 172.21.15.102:0/2205430972 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2bc062070 con 0x559ec1db05b0 2024-09-13T19:18:02.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.479+0000 7fe1b960a640 1 -- 172.21.15.102:0/2205430972 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2bc00a170 con 0x559ec1db05b0 2024-09-13T19:18:02.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.479+0000 7fe1b960a640 1 -- 172.21.15.102:0/2205430972 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2bc059040 con 0x559ec1db05b0 2024-09-13T19:18:02.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.479+0000 7fe2cf33e800 1 -- 172.21.15.102:0/2205430972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ec1db05b0 msgr2=0x559ec1f2b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.479+0000 7fe2cf33e800 1 --2- 172.21.15.102:0/2205430972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ec1db05b0 0x559ec1f2b940 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc025b20 tx=0x7fe2bc04e000 comp rx=0 tx=0).stop 2024-09-13T19:18:02.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.479+0000 7fe2cf33e800 1 -- 172.21.15.102:0/2205430972 shutdown_connections 2024-09-13T19:18:02.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.479+0000 7fe2cf33e800 1 --2- 172.21.15.102:0/2205430972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ec1db05b0 0x559ec1f2b940 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.479+0000 7fe2cf33e800 1 -- 172.21.15.102:0/2205430972 >> 172.21.15.102:0/2205430972 conn(0x559ec1e35fe0 msgr2=0x559ec1f27300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:02.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.480+0000 7fe2cf33e800 1 -- 172.21.15.102:0/2205430972 shutdown_connections 2024-09-13T19:18:02.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.480+0000 7fe2cf33e800 1 -- 172.21.15.102:0/2205430972 wait complete. 2024-09-13T19:18:02.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.480+0000 7fe2cf33e800 1 Processor -- start 2024-09-13T19:18:02.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.480+0000 7fe2cf33e800 1 -- start start 2024-09-13T19:18:02.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.480+0000 7fe2cf33e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ec1db05b0 0x559ec1f33380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.480+0000 7fe2cf33e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559ec1e43950 con 0x559ec1db05b0 2024-09-13T19:18:02.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.480+0000 7fe2cb03b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ec1db05b0 0x559ec1f33380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.480+0000 7fe2cb03b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ec1db05b0 0x559ec1f33380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49620/0 (socket says 172.21.15.102:49620) 2024-09-13T19:18:02.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.480+0000 7fe2cb03b640 1 -- 172.21.15.102:0/1429697257 learned_addr learned my addr 172.21.15.102:0/1429697257 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:02.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.481+0000 7fe2cb03b640 1 -- 172.21.15.102:0/1429697257 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ec1ce7fe0 con 0x559ec1db05b0 2024-09-13T19:18:02.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.481+0000 7fe2cb03b640 1 --2- 172.21.15.102:0/1429697257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ec1db05b0 0x559ec1f33380 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc045960 tx=0x7fe2bc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.481+0000 7fe1b7e07640 1 -- 172.21.15.102:0/1429697257 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2bc06c070 con 0x559ec1db05b0 2024-09-13T19:18:02.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.481+0000 7fe1b7e07640 1 -- 172.21.15.102:0/1429697257 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2bc054bf0 con 0x559ec1db05b0 2024-09-13T19:18:02.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.481+0000 7fe2cf33e800 1 -- 172.21.15.102:0/1429697257 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559ec1f338c0 con 0x559ec1db05b0 2024-09-13T19:18:02.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.481+0000 7fe1b7e07640 1 -- 172.21.15.102:0/1429697257 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2bc062070 con 0x559ec1db05b0 2024-09-13T19:18:02.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.481+0000 7fe2cf33e800 1 -- 172.21.15.102:0/1429697257 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ec1f33de0 con 0x559ec1db05b0 2024-09-13T19:18:02.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.482+0000 7fe1b7e07640 1 -- 172.21.15.102:0/1429697257 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe2bc065040 con 0x559ec1db05b0 2024-09-13T19:18:02.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.482+0000 7fe1b7e07640 1 --2- 172.21.15.102:0/1429697257 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe1b0036b90 0x7fe1b0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.482+0000 7fe1b7e07640 1 -- 172.21.15.102:0/1429697257 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fe2bc08f340 con 0x559ec1db05b0 2024-09-13T19:18:02.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.482+0000 7fe2ca83a640 1 --2- 172.21.15.102:0/1429697257 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe1b0036b90 0x7fe1b0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.482+0000 7fe2cf33e800 1 --2- 172.21.15.102:0/1429697257 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x559ec1f383e0 0x559ec1f3a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.482+0000 7fe2cf33e800 1 -- 172.21.15.102:0/1429697257 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f3ad10 con 0x559ec1f383e0 2024-09-13T19:18:02.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.483+0000 7fe2cb83c640 1 --2- 172.21.15.102:0/1429697257 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x559ec1f383e0 0x559ec1f3a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.483+0000 7fe2ca83a640 1 --2- 172.21.15.102:0/1429697257 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe1b0036b90 0x7fe1b0039050 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe2c0000f60 tx=0x7fe2c00010a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.483+0000 7fe2cb83c640 1 --2- 172.21.15.102:0/1429697257 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x559ec1f383e0 0x559ec1f3a7d0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.483+0000 7fe2cb83c640 1 -- 172.21.15.102:0/1429697257 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe2c400a4a0 con 0x559ec1f383e0 2024-09-13T19:18:02.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.483+0000 7fe2cf33e800 1 -- 172.21.15.102:0/1429697257 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f379a0 con 0x559ec1f383e0 2024-09-13T19:18:02.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.483+0000 7fe2cb83c640 1 -- 172.21.15.102:0/1429697257 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe2c400a4a0 con 0x559ec1f383e0 2024-09-13T19:18:02.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.483+0000 7fe2cf33e800 1 --2- 172.21.15.102:0/1429697257 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x559ec1f3d000 0x559ec1f3f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.483+0000 7fe2cf33e800 1 -- 172.21.15.102:0/1429697257 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f3fa90 con 0x559ec1f3d000 2024-09-13T19:18:02.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.484+0000 7fe2cb03b640 1 --2- 172.21.15.102:0/1429697257 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x559ec1f3d000 0x559ec1f3f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.484+0000 7fe2cb03b640 1 --2- 172.21.15.102:0/1429697257 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x559ec1f3d000 0x559ec1f3f3f0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.484+0000 7fe2cb03b640 1 -- 172.21.15.102:0/1429697257 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe2bc05c040 con 0x559ec1f3d000 2024-09-13T19:18:02.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.484+0000 7fe2cf33e800 1 -- 172.21.15.102:0/1429697257 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f3bea0 con 0x559ec1f383e0 2024-09-13T19:18:02.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.484+0000 7fe2cb83c640 1 -- 172.21.15.102:0/1429697257 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe2c400a4a0 con 0x559ec1f383e0 2024-09-13T19:18:02.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.484+0000 7fe2cf33e800 1 -- 172.21.15.102:0/1429697257 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f3c380 con 0x559ec1f3d000 2024-09-13T19:18:02.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.485+0000 7fe2cb03b640 1 -- 172.21.15.102:0/1429697257 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe2bc05c040 con 0x559ec1f3d000 2024-09-13T19:18:02.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.485+0000 7fe2cf33e800 1 Processor -- start 2024-09-13T19:18:02.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.485+0000 7fe2cf33e800 1 -- start start 2024-09-13T19:18:02.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.485+0000 7fe2cf33e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ec1f4e370 0x559ec1f4e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.485+0000 7fe2cf33e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559ec1cd5580 con 0x559ec1f4e370 2024-09-13T19:18:02.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.485+0000 7fe2cb83c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ec1f4e370 0x559ec1f4e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.485+0000 7fe2cb83c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ec1f4e370 0x559ec1f4e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49626/0 (socket says 172.21.15.102:49626) 2024-09-13T19:18:02.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.485+0000 7fe2cb83c640 1 -- 172.21.15.102:0/2194023973 learned_addr learned my addr 172.21.15.102:0/2194023973 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:02.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.486+0000 7fe2cb83c640 1 -- 172.21.15.102:0/2194023973 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ec1f4ecd0 con 0x559ec1f4e370 2024-09-13T19:18:02.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.486+0000 7fe2cb83c640 1 --2- 172.21.15.102:0/2194023973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ec1f4e370 0x559ec1f4e790 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x559ec1f3b0d0 tx=0x7fe2c40167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.486+0000 7fe1b5602640 1 -- 172.21.15.102:0/2194023973 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2c4013640 con 0x559ec1f4e370 2024-09-13T19:18:02.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.486+0000 7fe1b5602640 1 -- 172.21.15.102:0/2194023973 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2c40137e0 con 0x559ec1f4e370 2024-09-13T19:18:02.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.486+0000 7fe2cf33e800 1 -- 172.21.15.102:0/2194023973 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559ec1f4ef60 con 0x559ec1f4e370 2024-09-13T19:18:02.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.486+0000 7fe1b5602640 1 -- 172.21.15.102:0/2194023973 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2c4013ae0 con 0x559ec1f4e370 2024-09-13T19:18:02.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.486+0000 7fe2cf33e800 1 -- 172.21.15.102:0/2194023973 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ec1f51c40 con 0x559ec1f4e370 2024-09-13T19:18:02.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.487+0000 7fe1b5602640 1 -- 172.21.15.102:0/2194023973 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe2c4011040 con 0x559ec1f4e370 2024-09-13T19:18:02.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.487+0000 7fe1b5602640 1 --2- 172.21.15.102:0/2194023973 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe1a4036b40 0x7fe1a4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.487+0000 7fe1b5602640 1 -- 172.21.15.102:0/2194023973 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fe2c400e040 con 0x559ec1f4e370 2024-09-13T19:18:02.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.487+0000 7fe2cb03b640 1 --2- 172.21.15.102:0/2194023973 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe1a4036b40 0x7fe1a4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.488+0000 7fe2cf33e800 1 Processor -- start 2024-09-13T19:18:02.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.488+0000 7fe2cf33e800 1 -- start start 2024-09-13T19:18:02.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.488+0000 7fe2cb03b640 1 --2- 172.21.15.102:0/2194023973 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe1a4036b40 0x7fe1a4039000 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc08d740 tx=0x7fe2bc08d610 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.488+0000 7fe2cf33e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ec1f5b030 0x559ec1f5b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.488+0000 7fe2cf33e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559ec1f2c030 con 0x559ec1f5b030 2024-09-13T19:18:02.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.488+0000 7fe2cb83c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ec1f5b030 0x559ec1f5b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.488+0000 7fe2cb83c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ec1f5b030 0x559ec1f5b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49628/0 (socket says 172.21.15.102:49628) 2024-09-13T19:18:02.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.488+0000 7fe2cb83c640 1 -- 172.21.15.102:0/1622372176 learned_addr learned my addr 172.21.15.102:0/1622372176 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:02.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.488+0000 7fe2cb83c640 1 -- 172.21.15.102:0/1622372176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ec1f5ba00 con 0x559ec1f5b030 2024-09-13T19:18:02.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.489+0000 7fe2cb83c640 1 --2- 172.21.15.102:0/1622372176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ec1f5b030 0x559ec1f5b430 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fe2c400b010 tx=0x7fe2c4020f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e99833c7e882118f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.489+0000 7fe1aeffd640 1 -- 172.21.15.102:0/1622372176 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2c4014c70 con 0x559ec1f5b030 2024-09-13T19:18:02.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.489+0000 7fe1aeffd640 1 -- 172.21.15.102:0/1622372176 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2c404e040 con 0x559ec1f5b030 2024-09-13T19:18:02.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.489+0000 7fe1aeffd640 1 -- 172.21.15.102:0/1622372176 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2c402a910 con 0x559ec1f5b030 2024-09-13T19:18:02.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.489+0000 7fe2cf33e800 1 -- 172.21.15.102:0/1622372176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ec1f5b030 msgr2=0x559ec1f5b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.489+0000 7fe2cf33e800 1 --2- 172.21.15.102:0/1622372176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ec1f5b030 0x559ec1f5b430 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fe2c400b010 tx=0x7fe2c4020f60 comp rx=0 tx=0).stop 2024-09-13T19:18:02.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.489+0000 7fe2cf33e800 1 -- 172.21.15.102:0/1622372176 shutdown_connections 2024-09-13T19:18:02.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.489+0000 7fe2cf33e800 1 --2- 172.21.15.102:0/1622372176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ec1f5b030 0x559ec1f5b430 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.489+0000 7fe2cf33e800 1 -- 172.21.15.102:0/1622372176 >> 172.21.15.102:0/1622372176 conn(0x559ec1f57420 msgr2=0x559ec1f55520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:02.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.489+0000 7fe2cf33e800 1 -- 172.21.15.102:0/1622372176 shutdown_connections 2024-09-13T19:18:02.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.489+0000 7fe2cf33e800 1 -- 172.21.15.102:0/1622372176 wait complete. 2024-09-13T19:18:02.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.490+0000 7fe2cf33e800 1 Processor -- start 2024-09-13T19:18:02.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.490+0000 7fe2cf33e800 1 -- start start 2024-09-13T19:18:02.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.490+0000 7fe2cf33e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ec1f5b030 0x559ec1f62500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.490+0000 7fe2cf33e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559ec1f5c040 con 0x559ec1f5b030 2024-09-13T19:18:02.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.490+0000 7fe2cb83c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ec1f5b030 0x559ec1f62500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.490+0000 7fe2cb83c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ec1f5b030 0x559ec1f62500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49630/0 (socket says 172.21.15.102:49630) 2024-09-13T19:18:02.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.490+0000 7fe2cb83c640 1 -- 172.21.15.102:0/421669407 learned_addr learned my addr 172.21.15.102:0/421669407 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:02.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.490+0000 7fe2cb83c640 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ec1f62a40 con 0x559ec1f5b030 2024-09-13T19:18:02.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.490+0000 7fe2cb83c640 1 --2- 172.21.15.102:0/421669407 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ec1f5b030 0x559ec1f62500 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fe2c400a100 tx=0x7fe2c404cd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.491+0000 7fe1ad7fa640 1 -- 172.21.15.102:0/421669407 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2c4039070 con 0x559ec1f5b030 2024-09-13T19:18:02.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.491+0000 7fe1ad7fa640 1 -- 172.21.15.102:0/421669407 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2c401ce20 con 0x559ec1f5b030 2024-09-13T19:18:02.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.491+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559ec1f62cd0 con 0x559ec1f5b030 2024-09-13T19:18:02.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.491+0000 7fe1ad7fa640 1 -- 172.21.15.102:0/421669407 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2c4040260 con 0x559ec1f5b030 2024-09-13T19:18:02.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.491+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ec1f62cd0 con 0x559ec1f5b030 2024-09-13T19:18:02.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.491+0000 7fe1ad7fa640 1 -- 172.21.15.102:0/421669407 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe2c403c070 con 0x559ec1f5b030 2024-09-13T19:18:02.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.492+0000 7fe1ad7fa640 1 --2- 172.21.15.102:0/421669407 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe194036b40 0x7fe194039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.492+0000 7fe1ad7fa640 1 -- 172.21.15.102:0/421669407 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fe2c4035d60 con 0x559ec1f5b030 2024-09-13T19:18:02.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.492+0000 7fe2cb03b640 1 --2- 172.21.15.102:0/421669407 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe194036b40 0x7fe194039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.492+0000 7fe2cb03b640 1 --2- 172.21.15.102:0/421669407 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe194036b40 0x7fe194039000 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc054540 tx=0x7fe2bc080000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.492+0000 7fe2cf33e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.492+0000 7fe2cf33e800 1 --2- 172.21.15.102:0/421669407 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x559ec1f6de80 0x559ec1f70340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.492+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f70a90 con 0x559ec1f6de80 2024-09-13T19:18:02.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.492+0000 7fe2ca83a640 1 --2- 172.21.15.102:0/421669407 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x559ec1f6de80 0x559ec1f70340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.493+0000 7fe2ca83a640 1 --2- 172.21.15.102:0/421669407 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x559ec1f6de80 0x559ec1f70340 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.493+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe2c0009050 con 0x559ec1f6de80 2024-09-13T19:18:02.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.493+0000 7fe2cf33e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:02.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.493+0000 7fe2cf33e800 20 realm 2024-09-13T19:18:02.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.493+0000 7fe2cf33e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.493+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f6d2d0 con 0x559ec1f6de80 2024-09-13T19:18:02.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.493+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe2c0009050 con 0x559ec1f6de80 2024-09-13T19:18:02.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.493+0000 7fe2cf33e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:02.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.493+0000 7fe2cf33e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:18:02.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.493+0000 7fe2cf33e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.493+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f71580 con 0x559ec1f6de80 2024-09-13T19:18:02.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.493+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe2c0009050 con 0x559ec1f6de80 2024-09-13T19:18:02.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.493+0000 7fe2cf33e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:02.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.493+0000 7fe2cf33e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.493+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f71e50 con 0x559ec1f6de80 2024-09-13T19:18:02.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.494+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe2c0009050 con 0x559ec1f6de80 2024-09-13T19:18:02.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.494+0000 7fe2cf33e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:18:02.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.494+0000 7fe2cf33e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.494+0000 7fe2cf33e800 1 --2- 172.21.15.102:0/421669407 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x559ec1f72870 0x559ec1f74c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.494+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f75350 con 0x559ec1f72870 2024-09-13T19:18:02.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.494+0000 7fe2cb83c640 1 --2- 172.21.15.102:0/421669407 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x559ec1f72870 0x559ec1f74c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.494+0000 7fe2cb83c640 1 --2- 172.21.15.102:0/421669407 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x559ec1f72870 0x559ec1f74c60 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.494+0000 7fe2cb83c640 1 -- 172.21.15.102:0/421669407 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe2c403b030 con 0x559ec1f72870 2024-09-13T19:18:02.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.494+0000 7fe2cf33e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:18:02.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.494+0000 7fe2cf33e800 20 searching for the correct realm 2024-09-13T19:18:02.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.494+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f76ca0 con 0x559ec1f72870 2024-09-13T19:18:02.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.494+0000 7fe2cb83c640 1 -- 172.21.15.102:0/421669407 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c403b030 con 0x559ec1f72870 2024-09-13T19:18:02.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.494+0000 7fe2cb83c640 1 --2- 172.21.15.102:0/421669407 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fe2c4034070 0x7fe2c404b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.494+0000 7fe2cb83c640 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f76ca0 con 0x7fe2c4034070 2024-09-13T19:18:02.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.495+0000 7fe2cb03b640 1 --2- 172.21.15.102:0/421669407 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fe2c4034070 0x7fe2c404b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.495+0000 7fe2cb03b640 1 --2- 172.21.15.102:0/421669407 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fe2c4034070 0x7fe2c404b6f0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.495+0000 7fe2cb03b640 1 -- 172.21.15.102:0/421669407 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2bc05c040 con 0x7fe2c4034070 2024-09-13T19:18:02.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.495+0000 7fe2cb03b640 1 --2- 172.21.15.102:0/421669407 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fe2bc09c040 0x7fe2bc06f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.495+0000 7fe2cb03b640 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f76ca0 con 0x7fe2bc09c040 2024-09-13T19:18:02.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.495+0000 7fe2ca83a640 1 --2- 172.21.15.102:0/421669407 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fe2bc09c040 0x7fe2bc06f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.496+0000 7fe2ca83a640 1 --2- 172.21.15.102:0/421669407 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fe2bc09c040 0x7fe2bc06f590 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.496+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c0009050 con 0x7fe2bc09c040 2024-09-13T19:18:02.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.496+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f76ca0 con 0x559ec1f6de80 2024-09-13T19:18:02.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.496+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c0009050 con 0x559ec1f6de80 2024-09-13T19:18:02.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.496+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f76ca0 con 0x559ec1f6de80 2024-09-13T19:18:02.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.497+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c0029040 con 0x559ec1f6de80 2024-09-13T19:18:02.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.497+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f76ca0 con 0x7fe2bc09c040 2024-09-13T19:18:02.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.497+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c0029040 con 0x7fe2bc09c040 2024-09-13T19:18:02.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.497+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f76ca0 con 0x7fe2bc09c040 2024-09-13T19:18:02.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.497+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c0029040 con 0x7fe2bc09c040 2024-09-13T19:18:02.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.497+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f76ca0 con 0x7fe2c4034070 2024-09-13T19:18:02.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.497+0000 7fe2cb03b640 1 -- 172.21.15.102:0/421669407 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2bc05c040 con 0x7fe2c4034070 2024-09-13T19:18:02.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.497+0000 7fe2cb03b640 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f76ca0 con 0x559ec1f72870 2024-09-13T19:18:02.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.498+0000 7fe2cb83c640 1 -- 172.21.15.102:0/421669407 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c403b030 con 0x559ec1f72870 2024-09-13T19:18:02.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.498+0000 7fe2cb83c640 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f76ca0 con 0x559ec1f6de80 2024-09-13T19:18:02.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.498+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c0029040 con 0x559ec1f6de80 2024-09-13T19:18:02.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.498+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f76ca0 con 0x7fe2c4034070 2024-09-13T19:18:02.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.498+0000 7fe2cb03b640 1 -- 172.21.15.102:0/421669407 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2bc05c040 con 0x7fe2c4034070 2024-09-13T19:18:02.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.498+0000 7fe2cb03b640 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f76ca0 con 0x559ec1f6de80 2024-09-13T19:18:02.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.498+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c0029040 con 0x559ec1f6de80 2024-09-13T19:18:02.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.498+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f76ca0 con 0x7fe2c4034070 2024-09-13T19:18:02.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.499+0000 7fe2cb03b640 1 -- 172.21.15.102:0/421669407 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe2bc05c040 con 0x7fe2c4034070 2024-09-13T19:18:02.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.499+0000 7fe2cb03b640 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f76ca0 con 0x559ec1f72870 2024-09-13T19:18:02.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.499+0000 7fe2cb83c640 1 -- 172.21.15.102:0/421669407 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c403b030 con 0x559ec1f72870 2024-09-13T19:18:02.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.499+0000 7fe2cb83c640 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f76ca0 con 0x559ec1f72870 2024-09-13T19:18:02.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.499+0000 7fe2cb83c640 1 -- 172.21.15.102:0/421669407 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe2c403b030 con 0x559ec1f72870 2024-09-13T19:18:02.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.499+0000 7fe2cb83c640 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f76ca0 con 0x7fe2bc09c040 2024-09-13T19:18:02.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.499+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c0029040 con 0x7fe2bc09c040 2024-09-13T19:18:02.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.499+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f76ca0 con 0x559ec1f72870 2024-09-13T19:18:02.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.500+0000 7fe2cb83c640 1 -- 172.21.15.102:0/421669407 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe2c403b030 con 0x559ec1f72870 2024-09-13T19:18:02.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.500+0000 7fe2cb83c640 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f76ca0 con 0x559ec1f72870 2024-09-13T19:18:02.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.500+0000 7fe2cb83c640 1 -- 172.21.15.102:0/421669407 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c403b030 con 0x559ec1f72870 2024-09-13T19:18:02.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.500+0000 7fe2cb83c640 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f76ca0 con 0x559ec1f6de80 2024-09-13T19:18:02.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.500+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c0029040 con 0x559ec1f6de80 2024-09-13T19:18:02.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.500+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f76ca0 con 0x559ec1f6de80 2024-09-13T19:18:02.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.500+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe2c0029040 con 0x559ec1f6de80 2024-09-13T19:18:02.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.500+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f76ca0 con 0x7fe2bc09c040 2024-09-13T19:18:02.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.501+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c0029040 con 0x7fe2bc09c040 2024-09-13T19:18:02.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.501+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f76ca0 con 0x559ec1f72870 2024-09-13T19:18:02.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.501+0000 7fe2cb83c640 1 -- 172.21.15.102:0/421669407 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c403b030 con 0x559ec1f72870 2024-09-13T19:18:02.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.501+0000 7fe2cb83c640 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f76ca0 con 0x7fe2c4034070 2024-09-13T19:18:02.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.501+0000 7fe2cb03b640 1 -- 172.21.15.102:0/421669407 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2bc05c040 con 0x7fe2c4034070 2024-09-13T19:18:02.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.501+0000 7fe2cb03b640 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f76ca0 con 0x559ec1f6de80 2024-09-13T19:18:02.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.502+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c0029040 con 0x559ec1f6de80 2024-09-13T19:18:02.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.502+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f76ca0 con 0x7fe2c4034070 2024-09-13T19:18:02.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.502+0000 7fe2cb03b640 1 -- 172.21.15.102:0/421669407 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2bc0a9040 con 0x7fe2c4034070 2024-09-13T19:18:02.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.502+0000 7fe2cb03b640 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f76ca0 con 0x559ec1f72870 2024-09-13T19:18:02.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.502+0000 7fe2cb83c640 1 -- 172.21.15.102:0/421669407 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c403b030 con 0x559ec1f72870 2024-09-13T19:18:02.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.502+0000 7fe2cb83c640 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f76ca0 con 0x7fe2bc09c040 2024-09-13T19:18:02.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.503+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c0029040 con 0x7fe2bc09c040 2024-09-13T19:18:02.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.503+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f76ca0 con 0x7fe2c4034070 2024-09-13T19:18:02.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.503+0000 7fe2cb03b640 1 -- 172.21.15.102:0/421669407 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2bc0a9040 con 0x7fe2c4034070 2024-09-13T19:18:02.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.503+0000 7fe2cb03b640 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f76ca0 con 0x559ec1f72870 2024-09-13T19:18:02.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.503+0000 7fe2cb83c640 1 -- 172.21.15.102:0/421669407 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c403b030 con 0x559ec1f72870 2024-09-13T19:18:02.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.503+0000 7fe2cb83c640 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f76ca0 con 0x7fe2bc09c040 2024-09-13T19:18:02.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.503+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2c0029040 con 0x7fe2bc09c040 2024-09-13T19:18:02.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.503+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f76ca0 con 0x559ec1f6de80 2024-09-13T19:18:02.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.504+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v36'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe2c0029040 con 0x559ec1f6de80 2024-09-13T19:18:02.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.504+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f76ca0 con 0x7fe2c4034070 2024-09-13T19:18:02.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.504+0000 7fe2cb03b640 1 -- 172.21.15.102:0/421669407 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2bc0a9040 con 0x7fe2c4034070 2024-09-13T19:18:02.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.504+0000 7fe2cf33e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:18:02.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.504+0000 7fe2cf33e800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:18:02.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.504+0000 7fe2cf33e800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:18:02.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.504+0000 7fe2cf33e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:18:02.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.504+0000 7fe2cf33e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:18:02.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.504+0000 7fe2cf33e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:18:02.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.504+0000 7fe2cf33e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.504+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f75d40 con 0x559ec1f6de80 2024-09-13T19:18:02.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.504+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe2c0029040 con 0x559ec1f6de80 2024-09-13T19:18:02.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.504+0000 7fe2cf33e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:02.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.504+0000 7fe2cf33e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.504+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f765e0 con 0x559ec1f6de80 2024-09-13T19:18:02.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.504+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe2c0029040 con 0x559ec1f6de80 2024-09-13T19:18:02.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.504+0000 7fe2cf33e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:18:02.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.504+0000 7fe2cf33e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.504+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f77120 con 0x559ec1f72870 2024-09-13T19:18:02.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.505+0000 7fe2cb83c640 1 -- 172.21.15.102:0/421669407 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe2c403b030 con 0x559ec1f72870 2024-09-13T19:18:02.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.505+0000 7fe2cf33e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:18:02.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.505+0000 7fe2cf33e800 20 zone default found 2024-09-13T19:18:02.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.505+0000 7fe2cf33e800 4 Realm: () 2024-09-13T19:18:02.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.505+0000 7fe2cf33e800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:18:02.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.505+0000 7fe2cf33e800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:18:02.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.505+0000 7fe2cf33e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:18:02.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.505+0000 7fe2cf33e800 20 zonegroup default 2024-09-13T19:18:02.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.505+0000 7fe2cf33e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.505+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f76230 con 0x7fe2c4034070 2024-09-13T19:18:02.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.505+0000 7fe2cb03b640 1 -- 172.21.15.102:0/421669407 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe2bc0a9040 con 0x7fe2c4034070 2024-09-13T19:18:02.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.505+0000 7fe2cf33e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:02.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.505+0000 7fe2cf33e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.505+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f798a0 con 0x559ec1f72870 2024-09-13T19:18:02.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.505+0000 7fe2cb83c640 1 -- 172.21.15.102:0/421669407 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe2c403b030 con 0x559ec1f72870 2024-09-13T19:18:02.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.505+0000 7fe2cf33e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:02.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.505+0000 7fe2cf33e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.505+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f79c40 con 0x559ec1f72870 2024-09-13T19:18:02.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.506+0000 7fe2cb83c640 1 -- 172.21.15.102:0/421669407 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe2c403b030 con 0x559ec1f72870 2024-09-13T19:18:02.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.506+0000 7fe2cf33e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:02.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.506+0000 7fe2cf33e800 20 started sync module instance, tier type = 2024-09-13T19:18:02.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.506+0000 7fe2cf33e800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:18:02.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.506+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f78ce0 con 0x7fe2c4034070 2024-09-13T19:18:02.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.507+0000 7fe2cb03b640 1 -- 172.21.15.102:0/421669407 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(44 notify.0 [create] v36'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2bc0a9040 con 0x7fe2c4034070 2024-09-13T19:18:02.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.507+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94140347420800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f794a0 con 0x7fe2c4034070 2024-09-13T19:18:02.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.507+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f7a940 con 0x559ec1f6de80 2024-09-13T19:18:02.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.508+0000 7fe2cb03b640 1 -- 172.21.15.102:0/421669407 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94140347420800] v36'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2bc0a9040 con 0x7fe2c4034070 2024-09-13T19:18:02.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.508+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v36'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c0029040 con 0x559ec1f6de80 2024-09-13T19:18:02.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.508+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94140347425248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f7b1e0 con 0x559ec1f6de80 2024-09-13T19:18:02.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.508+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f7bba0 con 0x559ec1f72870 2024-09-13T19:18:02.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.509+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94140347425248] v36'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c0029040 con 0x559ec1f6de80 2024-09-13T19:18:02.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.509+0000 7fe2cb83c640 1 -- 172.21.15.102:0/421669407 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v36'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c403b030 con 0x559ec1f72870 2024-09-13T19:18:02.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.509+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94140347428624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f7bba0 con 0x559ec1f72870 2024-09-13T19:18:02.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.509+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f7c5a0 con 0x7fe2c4034070 2024-09-13T19:18:02.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.510+0000 7fe2cb03b640 1 -- 172.21.15.102:0/421669407 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(50 notify.3 [create] v36'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2bc0a9040 con 0x7fe2c4034070 2024-09-13T19:18:02.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.510+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94140347433136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f7cdf0 con 0x7fe2c4034070 2024-09-13T19:18:02.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.510+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f7d8e0 con 0x559ec1f6de80 2024-09-13T19:18:02.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.511+0000 7fe2cb83c640 1 -- 172.21.15.102:0/421669407 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94140347428624] v36'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c403b030 con 0x559ec1f72870 2024-09-13T19:18:02.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.511+0000 7fe2cb03b640 1 -- 172.21.15.102:0/421669407 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94140347433136] v36'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2bc0a9040 con 0x7fe2c4034070 2024-09-13T19:18:02.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.512+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v36'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c0029040 con 0x559ec1f6de80 2024-09-13T19:18:02.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.512+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94140347438000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f7c940 con 0x559ec1f6de80 2024-09-13T19:18:02.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.512+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f7e1b0 con 0x7fe2bc09c040 2024-09-13T19:18:02.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.513+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(54 notify.5 [create] v36'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c0029040 con 0x7fe2bc09c040 2024-09-13T19:18:02.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.513+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94140347440384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f7e5d0 con 0x7fe2bc09c040 2024-09-13T19:18:02.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.513+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f7ee20 con 0x7fe2bc09c040 2024-09-13T19:18:02.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.513+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94140347438000] v36'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c0029040 con 0x559ec1f6de80 2024-09-13T19:18:02.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.514+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94140347440384] v36'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c0029040 con 0x7fe2bc09c040 2024-09-13T19:18:02.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.514+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(56 notify.6 [create] v36'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c0029040 con 0x7fe2bc09c040 2024-09-13T19:18:02.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.514+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94140347430640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f7e7b0 con 0x7fe2bc09c040 2024-09-13T19:18:02.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.514+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f7f270 con 0x7fe2bc09c040 2024-09-13T19:18:02.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.515+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94140347430640] v36'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c0029040 con 0x7fe2bc09c040 2024-09-13T19:18:02.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.515+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(58 notify.7 [create] v36'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c0029040 con 0x7fe2bc09c040 2024-09-13T19:18:02.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.515+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94140347444640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f7f270 con 0x7fe2bc09c040 2024-09-13T19:18:02.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.515+0000 7fe2cf33e800 20 add_watcher() i=0 2024-09-13T19:18:02.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.515+0000 7fe2cf33e800 20 add_watcher() i=1 2024-09-13T19:18:02.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.515+0000 7fe2cf33e800 20 add_watcher() i=2 2024-09-13T19:18:02.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.515+0000 7fe2cf33e800 20 add_watcher() i=3 2024-09-13T19:18:02.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.515+0000 7fe2cf33e800 20 add_watcher() i=4 2024-09-13T19:18:02.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.515+0000 7fe2cf33e800 20 add_watcher() i=5 2024-09-13T19:18:02.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.515+0000 7fe2cf33e800 20 add_watcher() i=6 2024-09-13T19:18:02.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.516+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94140347444640] v36'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c0029040 con 0x7fe2bc09c040 2024-09-13T19:18:02.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.516+0000 7fe2cf33e800 20 add_watcher() i=7 2024-09-13T19:18:02.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.516+0000 7fe2cf33e800 2 all 8 watchers are set, enabling cache 2024-09-13T19:18:02.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.516+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f826a0 con 0x559ec1f6de80 2024-09-13T19:18:02.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.516+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe2c0029040 con 0x559ec1f6de80 2024-09-13T19:18:02.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.517+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94140347441920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559ec1f7fbc0 con 0x559ec1f6de80 2024-09-13T19:18:02.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.517+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94140347441920] v36'241 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe2c0029040 con 0x559ec1f6de80 2024-09-13T19:18:02.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.518+0000 7fe181fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:18:02.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.518+0000 7fe2cf33e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:18:02.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.518+0000 7fe2cf33e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:18:02.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.518+0000 7fe2cf33e800 5 note: GC not initialized 2024-09-13T19:18:02.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.518+0000 7fe180fe1640 20 reqs_thread_entry: start 2024-09-13T19:18:02.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.518+0000 7fe2cf33e800 20 init_complete bucket index max shards: 11 2024-09-13T19:18:02.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.518+0000 7fe2cf33e800 20 Filter name: none 2024-09-13T19:18:02.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.518+0000 7fe0fa7fc640 20 reqs_thread_entry: start 2024-09-13T19:18:02.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.518+0000 7fe2cf33e800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T19:18:02.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.518+0000 7fe2cf33e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.518+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559ec1fb5b40 con 0x7fe2bc09c040 2024-09-13T19:18:02.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.519+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7fe2c0029040 con 0x7fe2bc09c040 2024-09-13T19:18:02.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.519+0000 7fe2cf33e800 20 rados_obj.operate() r=0 bl.length=473 2024-09-13T19:18:02.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.519+0000 7fe2cf33e800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T19:18:02.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.519+0000 7fe2cf33e800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:18:02.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.519+0000 7fe2cf33e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:18:02.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.519+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559ec1fbc510 con 0x7fe2bc09c040 2024-09-13T19:18:02.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.521+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v36'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fe2c0029040 con 0x7fe2bc09c040 2024-09-13T19:18:02.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.521+0000 7fe2cf33e800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:18:02.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.521+0000 7fe2cf33e800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:18:02.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.521+0000 7fe2cf33e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T19:18:02.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.521+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94140347694800 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559ec1fb7b50 con 0x559ec1f6de80 2024-09-13T19:18:02.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.521+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== watch-notify(notify (1) cookie 94140347438000 notify 154618822693 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7fe2b4001e10 con 0x559ec1f6de80 2024-09-13T19:18:02.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.521+0000 7fe1aeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822693 cookie 94140347438000 notifier 4846 bl.length()=636 2024-09-13T19:18:02.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.521+0000 7fe1aeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:18:02.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.521+0000 7fe1aeffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:18:02.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.521+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(64 notify.4 [notify cookie 94140347694800 out=8b] v0'0 uv243 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe2c0029040 con 0x559ec1f6de80 2024-09-13T19:18:02.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.521+0000 7fe1aeffd640 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fe190003ea0 con 0x559ec1f6de80 2024-09-13T19:18:02.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.521+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c0029040 con 0x559ec1f6de80 2024-09-13T19:18:02.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.521+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== watch-notify(notify_complete (2) cookie 94140347694800 notify 154618822693 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fe2c002da30 con 0x559ec1f6de80 2024-09-13T19:18:02.536 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T19:18:02.251000Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:18:02.250985Z","tags":[],"group_ids":[]} 2024-09-13T19:18:02.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.522+0000 7fe181fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:18:02.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.522+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94140347441920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559ec1fb3880 con 0x559ec1f6de80 2024-09-13T19:18:02.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.523+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94140347441920] v36'242 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe2c0029040 con 0x559ec1f6de80 2024-09-13T19:18:02.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.523+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94140347420800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559ec1fb3880 con 0x7fe2c4034070 2024-09-13T19:18:02.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.524+0000 7fe2cb03b640 1 -- 172.21.15.102:0/421669407 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94140347420800] v36'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2bc0a9040 con 0x7fe2c4034070 2024-09-13T19:18:02.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.524+0000 7fe2cf33e800 20 remove_watcher() i=0 2024-09-13T19:18:02.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.524+0000 7fe2cf33e800 2 removed watcher, disabling cache 2024-09-13T19:18:02.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.524+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94140347425248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559ec1fb3880 con 0x559ec1f6de80 2024-09-13T19:18:02.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.526+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94140347425248] v36'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c0029040 con 0x559ec1f6de80 2024-09-13T19:18:02.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.526+0000 7fe2cf33e800 20 remove_watcher() i=1 2024-09-13T19:18:02.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.526+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94140347428624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559ec1fb3880 con 0x559ec1f72870 2024-09-13T19:18:02.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.527+0000 7fe2cb83c640 1 -- 172.21.15.102:0/421669407 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94140347428624] v36'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c403b030 con 0x559ec1f72870 2024-09-13T19:18:02.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.527+0000 7fe2cf33e800 20 remove_watcher() i=2 2024-09-13T19:18:02.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.527+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94140347433136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559ec1fb3880 con 0x7fe2c4034070 2024-09-13T19:18:02.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.528+0000 7fe2cb03b640 1 -- 172.21.15.102:0/421669407 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94140347433136] v36'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2bc0a9040 con 0x7fe2c4034070 2024-09-13T19:18:02.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.528+0000 7fe2cf33e800 20 remove_watcher() i=3 2024-09-13T19:18:02.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.528+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94140347438000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559ec1fb3880 con 0x559ec1f6de80 2024-09-13T19:18:02.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.529+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94140347438000] v36'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c0029040 con 0x559ec1f6de80 2024-09-13T19:18:02.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.529+0000 7fe2cf33e800 20 remove_watcher() i=4 2024-09-13T19:18:02.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.529+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94140347440384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559ec1fb3880 con 0x7fe2bc09c040 2024-09-13T19:18:02.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.530+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94140347440384] v36'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c0029040 con 0x7fe2bc09c040 2024-09-13T19:18:02.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.530+0000 7fe2cf33e800 20 remove_watcher() i=5 2024-09-13T19:18:02.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.530+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94140347430640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559ec1fb3880 con 0x7fe2bc09c040 2024-09-13T19:18:02.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.531+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94140347430640] v36'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c0029040 con 0x7fe2bc09c040 2024-09-13T19:18:02.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.531+0000 7fe2cf33e800 20 remove_watcher() i=6 2024-09-13T19:18:02.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.531+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94140347444640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x559ec1fb3880 con 0x7fe2bc09c040 2024-09-13T19:18:02.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.532+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94140347444640] v36'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2c0029040 con 0x7fe2bc09c040 2024-09-13T19:18:02.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.532+0000 7fe2cf33e800 20 remove_watcher() i=7 2024-09-13T19:18:02.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.532+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fe2bc09c040 msgr2=0x7fe2bc06f590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.532+0000 7fe2cf33e800 1 --2- 172.21.15.102:0/421669407 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fe2bc09c040 0x7fe2bc06f590 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.532+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x559ec1f6de80 msgr2=0x559ec1f70340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.532+0000 7fe2cf33e800 1 --2- 172.21.15.102:0/421669407 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x559ec1f6de80 0x559ec1f70340 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.532+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fe2c4034070 msgr2=0x7fe2c404b6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.532+0000 7fe2cf33e800 1 --2- 172.21.15.102:0/421669407 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fe2c4034070 0x7fe2c404b6f0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.533+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x559ec1f72870 msgr2=0x559ec1f74c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.533+0000 7fe2cf33e800 1 --2- 172.21.15.102:0/421669407 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x559ec1f72870 0x559ec1f74c60 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.533+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe194036b40 msgr2=0x7fe194039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.533+0000 7fe2cf33e800 1 --2- 172.21.15.102:0/421669407 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe194036b40 0x7fe194039000 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc054540 tx=0x7fe2bc080000 comp rx=0 tx=0).stop 2024-09-13T19:18:02.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.533+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ec1f5b030 msgr2=0x559ec1f62500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.533+0000 7fe2cf33e800 1 --2- 172.21.15.102:0/421669407 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ec1f5b030 0x559ec1f62500 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fe2c400a100 tx=0x7fe2c404cd40 comp rx=0 tx=0).stop 2024-09-13T19:18:02.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.533+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 reap_dead start 2024-09-13T19:18:02.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.533+0000 7fe2ca83a640 1 -- 172.21.15.102:0/421669407 reap_dead start 2024-09-13T19:18:02.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.533+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 shutdown_connections 2024-09-13T19:18:02.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.533+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 >> 172.21.15.102:0/421669407 conn(0x559ec1f57420 msgr2=0x559ec1f554f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:02.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.533+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 shutdown_connections 2024-09-13T19:18:02.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.533+0000 7fe2cf33e800 1 -- 172.21.15.102:0/421669407 wait complete. 2024-09-13T19:18:02.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.533+0000 7fe2cf33e800 1 -- 172.21.15.102:0/2194023973 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe1a4036b40 msgr2=0x7fe1a4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.533+0000 7fe2cf33e800 1 --2- 172.21.15.102:0/2194023973 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe1a4036b40 0x7fe1a4039000 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc08d740 tx=0x7fe2bc08d610 comp rx=0 tx=0).stop 2024-09-13T19:18:02.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.533+0000 7fe2cf33e800 1 -- 172.21.15.102:0/2194023973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ec1f4e370 msgr2=0x559ec1f4e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.533+0000 7fe2cf33e800 1 --2- 172.21.15.102:0/2194023973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ec1f4e370 0x559ec1f4e790 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x559ec1f3b0d0 tx=0x7fe2c40167b0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.533+0000 7fe2cf33e800 1 -- 172.21.15.102:0/2194023973 shutdown_connections 2024-09-13T19:18:02.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.533+0000 7fe2cf33e800 1 --2- 172.21.15.102:0/2194023973 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe1a4036b40 0x7fe1a4039000 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.533+0000 7fe2cf33e800 1 --2- 172.21.15.102:0/2194023973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ec1f4e370 0x559ec1f4e790 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.533+0000 7fe2cf33e800 1 -- 172.21.15.102:0/2194023973 >> 172.21.15.102:0/2194023973 conn(0x559ec1f43300 msgr2=0x559ec1f45e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:02.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.533+0000 7fe2cf33e800 1 -- 172.21.15.102:0/2194023973 shutdown_connections 2024-09-13T19:18:02.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.533+0000 7fe2cf33e800 1 -- 172.21.15.102:0/2194023973 wait complete. 2024-09-13T19:18:02.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.533+0000 7fe2cf33e800 1 -- 172.21.15.102:0/1429697257 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x559ec1f383e0 msgr2=0x559ec1f3a7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.533+0000 7fe2cf33e800 1 --2- 172.21.15.102:0/1429697257 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x559ec1f383e0 0x559ec1f3a7d0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.533+0000 7fe2cf33e800 1 -- 172.21.15.102:0/1429697257 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x559ec1f3d000 msgr2=0x559ec1f3f3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.533+0000 7fe2cf33e800 1 --2- 172.21.15.102:0/1429697257 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x559ec1f3d000 0x559ec1f3f3f0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.534+0000 7fe2cf33e800 1 -- 172.21.15.102:0/1429697257 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe1b0036b90 msgr2=0x7fe1b0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.534+0000 7fe2cf33e800 1 --2- 172.21.15.102:0/1429697257 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe1b0036b90 0x7fe1b0039050 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe2c0000f60 tx=0x7fe2c00010a0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.534+0000 7fe2cf33e800 1 -- 172.21.15.102:0/1429697257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ec1db05b0 msgr2=0x559ec1f33380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.534+0000 7fe2cf33e800 1 --2- 172.21.15.102:0/1429697257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ec1db05b0 0x559ec1f33380 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc045960 tx=0x7fe2bc002fb0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.534+0000 7fe2cf33e800 1 -- 172.21.15.102:0/1429697257 shutdown_connections 2024-09-13T19:18:02.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.534+0000 7fe2cf33e800 1 --2- 172.21.15.102:0/1429697257 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x559ec1f3d000 0x559ec1f3f3f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.534+0000 7fe2cf33e800 1 --2- 172.21.15.102:0/1429697257 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x559ec1f383e0 0x559ec1f3a7d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.534+0000 7fe2cf33e800 1 --2- 172.21.15.102:0/1429697257 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe1b0036b90 0x7fe1b0039050 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.534+0000 7fe2cf33e800 1 --2- 172.21.15.102:0/1429697257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ec1db05b0 0x559ec1f33380 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.534+0000 7fe2cf33e800 1 -- 172.21.15.102:0/1429697257 >> 172.21.15.102:0/1429697257 conn(0x559ec1e35fe0 msgr2=0x559ec1f25b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:02.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.534+0000 7fe2cf33e800 1 -- 172.21.15.102:0/1429697257 shutdown_connections 2024-09-13T19:18:02.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.534+0000 7fe2cf33e800 1 -- 172.21.15.102:0/1429697257 wait complete. 2024-09-13T19:18:02.548 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:18:02.251000Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:18:02.250985Z', 'tags': [], 'group_ids': []} 2024-09-13T19:18:02.549 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:18:02.251000Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:18:02.250985Z', 'tags': [], 'group_ids': []} 2024-09-13T19:18:02.549 ERROR:root:0 2024-09-13T19:18:02.549 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-13T19:18:02.549 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-13T19:18:02.549 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid system_user --display-name 'System User' --access-key system_akey --secret system_skey --caps user-info-without-keys=read --system 2024-09-13T19:18:02.602 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:18:02.602 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:18:02.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.600+0000 7f693092a800 1 Processor -- start 2024-09-13T19:18:02.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.600+0000 7f693092a800 1 -- start start 2024-09-13T19:18:02.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.600+0000 7f693092a800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55ed4387a740 0x55ed4387ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.600+0000 7f693092a800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ed43739b30 con 0x55ed4387b080 2024-09-13T19:18:02.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.600+0000 7f693092a800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55ed4371b360 con 0x55ed4387a740 2024-09-13T19:18:02.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.601+0000 7f692c621640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55ed4387a740 0x55ed4387ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.601+0000 7f692c621640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55ed4387a740 0x55ed4387ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49636/0 (socket says 172.21.15.102:49636) 2024-09-13T19:18:02.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.601+0000 7f6923e20640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55ed4387b080 0x55ed4387fac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:53700/0 (socket says 172.21.15.102:53700) 2024-09-13T19:18:02.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.601+0000 7f692c621640 1 -- 172.21.15.102:0/2480801428 learned_addr learned my addr 172.21.15.102:0/2480801428 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:02.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.601+0000 7f692c621640 1 -- 172.21.15.102:0/2480801428 >> v1:172.21.15.53:6789/0 conn(0x55ed4387b080 legacy=0x55ed4387fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.601+0000 7f692c621640 1 -- 172.21.15.102:0/2480801428 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed43741e00 con 0x55ed4387a740 2024-09-13T19:18:02.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.603+0000 7f692c621640 1 --2- 172.21.15.102:0/2480801428 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed4387a740 0x55ed4387ab40 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f691c00a520 tx=0x7f691c045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66e174ef9c040d81 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.603+0000 7f692be20640 1 -- 172.21.15.102:0/2480801428 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f691c055070 con 0x55ed4387a740 2024-09-13T19:18:02.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.603+0000 7f692be20640 1 -- 172.21.15.102:0/2480801428 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f691c0515b0 con 0x55ed4387a740 2024-09-13T19:18:02.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.603+0000 7f692be20640 1 -- 172.21.15.102:0/2480801428 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f691c0518d0 con 0x55ed4387a740 2024-09-13T19:18:02.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.603+0000 7f693092a800 1 -- 172.21.15.102:0/2480801428 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed4387a740 msgr2=0x55ed4387ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.603+0000 7f693092a800 1 --2- 172.21.15.102:0/2480801428 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed4387a740 0x55ed4387ab40 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f691c00a520 tx=0x7f691c045ba0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.603+0000 7f693092a800 1 -- 172.21.15.102:0/2480801428 shutdown_connections 2024-09-13T19:18:02.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.603+0000 7f693092a800 1 --2- 172.21.15.102:0/2480801428 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed4387a740 0x55ed4387ab40 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.603+0000 7f693092a800 1 -- 172.21.15.102:0/2480801428 >> 172.21.15.102:0/2480801428 conn(0x55ed43876010 msgr2=0x55ed43878430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:02.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.603+0000 7f693092a800 1 -- 172.21.15.102:0/2480801428 shutdown_connections 2024-09-13T19:18:02.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.604+0000 7f693092a800 1 -- 172.21.15.102:0/2480801428 wait complete. 2024-09-13T19:18:02.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.617+0000 7f693092a800 1 Processor -- start 2024-09-13T19:18:02.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.617+0000 7f693092a800 1 -- start start 2024-09-13T19:18:02.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.617+0000 7f693092a800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed4387a740 0x55ed437f0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.618+0000 7f693092a800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ed437c6450 con 0x55ed4387a740 2024-09-13T19:18:02.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.618+0000 7f692c621640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed4387a740 0x55ed437f0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.618+0000 7f692c621640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed4387a740 0x55ed437f0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49646/0 (socket says 172.21.15.102:49646) 2024-09-13T19:18:02.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.618+0000 7f692c621640 1 -- 172.21.15.102:0/2231283962 learned_addr learned my addr 172.21.15.102:0/2231283962 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:02.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.618+0000 7f692c621640 1 -- 172.21.15.102:0/2231283962 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed43713bc0 con 0x55ed4387a740 2024-09-13T19:18:02.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.618+0000 7f692c621640 1 --2- 172.21.15.102:0/2231283962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed4387a740 0x55ed437f0710 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f691c025da0 tx=0x7f691c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29ec450e05a2ce59 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.618+0000 7f681a60c640 1 -- 172.21.15.102:0/2231283962 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f691c051950 con 0x55ed4387a740 2024-09-13T19:18:02.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.619+0000 7f681a60c640 1 -- 172.21.15.102:0/2231283962 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f691c051af0 con 0x55ed4387a740 2024-09-13T19:18:02.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.619+0000 7f681a60c640 1 -- 172.21.15.102:0/2231283962 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f691c051dd0 con 0x55ed4387a740 2024-09-13T19:18:02.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.619+0000 7f693092a800 1 -- 172.21.15.102:0/2231283962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed4387a740 msgr2=0x55ed437f0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.619+0000 7f693092a800 1 --2- 172.21.15.102:0/2231283962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed4387a740 0x55ed437f0710 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f691c025da0 tx=0x7f691c051000 comp rx=0 tx=0).stop 2024-09-13T19:18:02.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.619+0000 7f693092a800 1 -- 172.21.15.102:0/2231283962 shutdown_connections 2024-09-13T19:18:02.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.619+0000 7f693092a800 1 --2- 172.21.15.102:0/2231283962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed4387a740 0x55ed437f0710 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.619+0000 7f693092a800 1 -- 172.21.15.102:0/2231283962 >> 172.21.15.102:0/2231283962 conn(0x55ed43876010 msgr2=0x55ed439652f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:02.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.619+0000 7f693092a800 1 -- 172.21.15.102:0/2231283962 shutdown_connections 2024-09-13T19:18:02.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.619+0000 7f693092a800 1 -- 172.21.15.102:0/2231283962 wait complete. 2024-09-13T19:18:02.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.620+0000 7f693092a800 1 Processor -- start 2024-09-13T19:18:02.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.620+0000 7f693092a800 1 -- start start 2024-09-13T19:18:02.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.620+0000 7f693092a800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed4387a740 0x55ed43973390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.620+0000 7f693092a800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ed43881620 con 0x55ed4387a740 2024-09-13T19:18:02.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.620+0000 7f692c621640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed4387a740 0x55ed43973390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.620+0000 7f692c621640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed4387a740 0x55ed43973390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49660/0 (socket says 172.21.15.102:49660) 2024-09-13T19:18:02.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.620+0000 7f692c621640 1 -- 172.21.15.102:0/986912746 learned_addr learned my addr 172.21.15.102:0/986912746 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:02.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.620+0000 7f692c621640 1 -- 172.21.15.102:0/986912746 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed43727fe0 con 0x55ed4387a740 2024-09-13T19:18:02.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.621+0000 7f692c621640 1 --2- 172.21.15.102:0/986912746 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed4387a740 0x55ed43973390 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f691c067040 tx=0x7f691c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.621+0000 7f6818e09640 1 -- 172.21.15.102:0/986912746 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f691c073070 con 0x55ed4387a740 2024-09-13T19:18:02.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.621+0000 7f6818e09640 1 -- 172.21.15.102:0/986912746 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f691c05a450 con 0x55ed4387a740 2024-09-13T19:18:02.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.621+0000 7f693092a800 1 -- 172.21.15.102:0/986912746 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ed439738d0 con 0x55ed4387a740 2024-09-13T19:18:02.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.621+0000 7f6818e09640 1 -- 172.21.15.102:0/986912746 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f691c05a730 con 0x55ed4387a740 2024-09-13T19:18:02.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.621+0000 7f693092a800 1 -- 172.21.15.102:0/986912746 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed43973e50 con 0x55ed4387a740 2024-09-13T19:18:02.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.622+0000 7f6818e09640 1 -- 172.21.15.102:0/986912746 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f691c076070 con 0x55ed4387a740 2024-09-13T19:18:02.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.622+0000 7f6818e09640 1 --2- 172.21.15.102:0/986912746 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6814036b90 0x7f6814039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.622+0000 7f6818e09640 1 -- 172.21.15.102:0/986912746 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f691c062070 con 0x55ed4387a740 2024-09-13T19:18:02.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.622+0000 7f6923e20640 1 --2- 172.21.15.102:0/986912746 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6814036b90 0x7f6814039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.622+0000 7f693092a800 1 --2- 172.21.15.102:0/986912746 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55ed4387b080 0x55ed4397a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.622+0000 7f693092a800 1 -- 172.21.15.102:0/986912746 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed4397a940 con 0x55ed4387b080 2024-09-13T19:18:02.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.622+0000 7f692ce22640 1 --2- 172.21.15.102:0/986912746 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55ed4387b080 0x55ed4397a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.622+0000 7f6923e20640 1 --2- 172.21.15.102:0/986912746 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6814036b90 0x7f6814039050 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6914001e40 tx=0x7f69140013a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.622+0000 7f692ce22640 1 --2- 172.21.15.102:0/986912746 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55ed4387b080 0x55ed4397a400 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.623+0000 7f692ce22640 1 -- 172.21.15.102:0/986912746 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f692400a4a0 con 0x55ed4387b080 2024-09-13T19:18:02.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.623+0000 7f693092a800 1 -- 172.21.15.102:0/986912746 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed4397b220 con 0x55ed4387b080 2024-09-13T19:18:02.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.623+0000 7f692ce22640 1 -- 172.21.15.102:0/986912746 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f692400a4a0 con 0x55ed4387b080 2024-09-13T19:18:02.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.623+0000 7f693092a800 1 --2- 172.21.15.102:0/986912746 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55ed4397cb30 0x55ed4397efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.623+0000 7f693092a800 1 -- 172.21.15.102:0/986912746 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed4397f760 con 0x55ed4397cb30 2024-09-13T19:18:02.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.623+0000 7f692c621640 1 --2- 172.21.15.102:0/986912746 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55ed4397cb30 0x55ed4397efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.623+0000 7f692c621640 1 --2- 172.21.15.102:0/986912746 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55ed4397cb30 0x55ed4397efd0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.624+0000 7f692c621640 1 -- 172.21.15.102:0/986912746 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f691c075030 con 0x55ed4397cb30 2024-09-13T19:18:02.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.624+0000 7f693092a800 1 -- 172.21.15.102:0/986912746 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed4397ba70 con 0x55ed4387b080 2024-09-13T19:18:02.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.624+0000 7f692ce22640 1 -- 172.21.15.102:0/986912746 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f692400a4a0 con 0x55ed4387b080 2024-09-13T19:18:02.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.624+0000 7f693092a800 1 -- 172.21.15.102:0/986912746 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed4397be50 con 0x55ed4397cb30 2024-09-13T19:18:02.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.624+0000 7f692c621640 1 -- 172.21.15.102:0/986912746 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f691c075030 con 0x55ed4397cb30 2024-09-13T19:18:02.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.625+0000 7f693092a800 1 Processor -- start 2024-09-13T19:18:02.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.625+0000 7f693092a800 1 -- start start 2024-09-13T19:18:02.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.625+0000 7f693092a800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed4398e120 0x55ed4398e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.625+0000 7f693092a800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ed43715580 con 0x55ed4398e120 2024-09-13T19:18:02.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.625+0000 7f692ce22640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed4398e120 0x55ed4398e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.625+0000 7f692ce22640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed4398e120 0x55ed4398e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49674/0 (socket says 172.21.15.102:49674) 2024-09-13T19:18:02.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.625+0000 7f692ce22640 1 -- 172.21.15.102:0/3429200255 learned_addr learned my addr 172.21.15.102:0/3429200255 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:02.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.626+0000 7f692ce22640 1 -- 172.21.15.102:0/3429200255 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed4398ea80 con 0x55ed4398e120 2024-09-13T19:18:02.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.626+0000 7f692ce22640 1 --2- 172.21.15.102:0/3429200255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed4398e120 0x55ed4398e540 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x55ed439741b0 tx=0x7f69240167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.626+0000 7f6811ffb640 1 -- 172.21.15.102:0/3429200255 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6924013640 con 0x55ed4398e120 2024-09-13T19:18:02.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.626+0000 7f6811ffb640 1 -- 172.21.15.102:0/3429200255 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69240137e0 con 0x55ed4398e120 2024-09-13T19:18:02.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.626+0000 7f693092a800 1 -- 172.21.15.102:0/3429200255 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ed4398ed10 con 0x55ed4398e120 2024-09-13T19:18:02.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.626+0000 7f6811ffb640 1 -- 172.21.15.102:0/3429200255 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6924013ae0 con 0x55ed4398e120 2024-09-13T19:18:02.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.626+0000 7f693092a800 1 -- 172.21.15.102:0/3429200255 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed439919f0 con 0x55ed4398e120 2024-09-13T19:18:02.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.627+0000 7f6811ffb640 1 -- 172.21.15.102:0/3429200255 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6924011040 con 0x55ed4398e120 2024-09-13T19:18:02.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.627+0000 7f6811ffb640 1 --2- 172.21.15.102:0/3429200255 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6804036b90 0x7f6804039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.627+0000 7f6811ffb640 1 -- 172.21.15.102:0/3429200255 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f692400e040 con 0x55ed4398e120 2024-09-13T19:18:02.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.627+0000 7f692c621640 1 --2- 172.21.15.102:0/3429200255 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6804036b90 0x7f6804039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.627+0000 7f693092a800 1 Processor -- start 2024-09-13T19:18:02.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.627+0000 7f693092a800 1 -- start start 2024-09-13T19:18:02.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.627+0000 7f692c621640 1 --2- 172.21.15.102:0/3429200255 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6804036b90 0x7f6804039050 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x55ed43977b30 tx=0x7f691c08f550 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.628+0000 7f693092a800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed4399ae20 0x55ed4399b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.628+0000 7f693092a800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ed437eecf0 con 0x55ed4399ae20 2024-09-13T19:18:02.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.628+0000 7f692ce22640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed4399ae20 0x55ed4399b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.628+0000 7f692ce22640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed4399ae20 0x55ed4399b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49688/0 (socket says 172.21.15.102:49688) 2024-09-13T19:18:02.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.628+0000 7f692ce22640 1 -- 172.21.15.102:0/2135698002 learned_addr learned my addr 172.21.15.102:0/2135698002 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:02.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.628+0000 7f692ce22640 1 -- 172.21.15.102:0/2135698002 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed4399b7f0 con 0x55ed4399ae20 2024-09-13T19:18:02.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.628+0000 7f692ce22640 1 --2- 172.21.15.102:0/2135698002 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed4399ae20 0x55ed4399b220 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f6924016cd0 tx=0x7f6924020e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c49d30c1c5667699 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.628+0000 7f680b7fe640 1 -- 172.21.15.102:0/2135698002 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6924021440 con 0x55ed4399ae20 2024-09-13T19:18:02.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.628+0000 7f680b7fe640 1 -- 172.21.15.102:0/2135698002 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f692404a030 con 0x55ed4399ae20 2024-09-13T19:18:02.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.628+0000 7f680b7fe640 1 -- 172.21.15.102:0/2135698002 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f692401f340 con 0x55ed4399ae20 2024-09-13T19:18:02.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.629+0000 7f693092a800 1 -- 172.21.15.102:0/2135698002 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed4399ae20 msgr2=0x55ed4399b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.629+0000 7f693092a800 1 --2- 172.21.15.102:0/2135698002 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed4399ae20 0x55ed4399b220 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f6924016cd0 tx=0x7f6924020e60 comp rx=0 tx=0).stop 2024-09-13T19:18:02.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.629+0000 7f693092a800 1 -- 172.21.15.102:0/2135698002 shutdown_connections 2024-09-13T19:18:02.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.629+0000 7f693092a800 1 --2- 172.21.15.102:0/2135698002 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed4399ae20 0x55ed4399b220 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.629+0000 7f693092a800 1 -- 172.21.15.102:0/2135698002 >> 172.21.15.102:0/2135698002 conn(0x55ed43997180 msgr2=0x55ed43995280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:02.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.629+0000 7f693092a800 1 -- 172.21.15.102:0/2135698002 shutdown_connections 2024-09-13T19:18:02.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.629+0000 7f693092a800 1 -- 172.21.15.102:0/2135698002 wait complete. 2024-09-13T19:18:02.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.629+0000 7f693092a800 1 Processor -- start 2024-09-13T19:18:02.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.629+0000 7f693092a800 1 -- start start 2024-09-13T19:18:02.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.629+0000 7f693092a800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed4399ae20 0x55ed439a2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.629+0000 7f693092a800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ed4399be60 con 0x55ed4399ae20 2024-09-13T19:18:02.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.630+0000 7f692ce22640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed4399ae20 0x55ed439a2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.630+0000 7f692ce22640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed4399ae20 0x55ed439a2290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49700/0 (socket says 172.21.15.102:49700) 2024-09-13T19:18:02.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.630+0000 7f692ce22640 1 -- 172.21.15.102:0/861759576 learned_addr learned my addr 172.21.15.102:0/861759576 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:02.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.630+0000 7f692ce22640 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed439a27d0 con 0x55ed4399ae20 2024-09-13T19:18:02.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.630+0000 7f692ce22640 1 --2- 172.21.15.102:0/861759576 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed4399ae20 0x55ed439a2290 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f6924013fd0 tx=0x7f692404cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.630+0000 7f6809ffb640 1 -- 172.21.15.102:0/861759576 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f692401f6c0 con 0x55ed4399ae20 2024-09-13T19:18:02.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.630+0000 7f6809ffb640 1 -- 172.21.15.102:0/861759576 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f692401f860 con 0x55ed4399ae20 2024-09-13T19:18:02.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.630+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ed439a2a60 con 0x55ed4399ae20 2024-09-13T19:18:02.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.630+0000 7f6809ffb640 1 -- 172.21.15.102:0/861759576 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69240205b0 con 0x55ed4399ae20 2024-09-13T19:18:02.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.630+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed439a5710 con 0x55ed4399ae20 2024-09-13T19:18:02.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.631+0000 7f6809ffb640 1 -- 172.21.15.102:0/861759576 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f692403a020 con 0x55ed4399ae20 2024-09-13T19:18:02.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.631+0000 7f6809ffb640 1 --2- 172.21.15.102:0/861759576 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f67fc036b40 0x7f67fc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.631+0000 7f6809ffb640 1 -- 172.21.15.102:0/861759576 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f6924038020 con 0x55ed4399ae20 2024-09-13T19:18:02.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.632+0000 7f692c621640 1 --2- 172.21.15.102:0/861759576 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f67fc036b40 0x7f67fc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.632+0000 7f692c621640 1 --2- 172.21.15.102:0/861759576 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f67fc036b40 0x7f67fc039000 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f691c005a60 tx=0x7f691c08c000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.632+0000 7f693092a800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.632+0000 7f693092a800 1 --2- 172.21.15.102:0/861759576 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55ed439add80 0x55ed439b0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.632+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed439b0990 con 0x55ed439add80 2024-09-13T19:18:02.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.632+0000 7f6923e20640 1 --2- 172.21.15.102:0/861759576 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55ed439add80 0x55ed439b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.632+0000 7f6923e20640 1 --2- 172.21.15.102:0/861759576 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55ed439add80 0x55ed439b0240 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.633+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f691400f670 con 0x55ed439add80 2024-09-13T19:18:02.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.633+0000 7f693092a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:02.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.633+0000 7f693092a800 20 realm 2024-09-13T19:18:02.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.633+0000 7f693092a800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.633+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed439ad1d0 con 0x55ed439add80 2024-09-13T19:18:02.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.633+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f691400f670 con 0x55ed439add80 2024-09-13T19:18:02.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.633+0000 7f693092a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:02.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.633+0000 7f693092a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:18:02.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.633+0000 7f693092a800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.633+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed439b1480 con 0x55ed439add80 2024-09-13T19:18:02.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.633+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f691400f670 con 0x55ed439add80 2024-09-13T19:18:02.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.633+0000 7f693092a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:02.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.633+0000 7f693092a800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.633+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed439b1d50 con 0x55ed439add80 2024-09-13T19:18:02.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.633+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f691400f670 con 0x55ed439add80 2024-09-13T19:18:02.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.633+0000 7f693092a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:18:02.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.633+0000 7f693092a800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.633+0000 7f693092a800 1 --2- 172.21.15.102:0/861759576 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55ed439b2650 0x55ed439b4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.633+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed439b5210 con 0x55ed439b2650 2024-09-13T19:18:02.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.634+0000 7f692ce22640 1 --2- 172.21.15.102:0/861759576 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55ed439b2650 0x55ed439b4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.634+0000 7f692ce22640 1 --2- 172.21.15.102:0/861759576 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55ed439b2650 0x55ed439b4a80 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.634+0000 7f692ce22640 1 -- 172.21.15.102:0/861759576 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f692400a4a0 con 0x55ed439b2650 2024-09-13T19:18:02.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.634+0000 7f693092a800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:18:02.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.634+0000 7f693092a800 20 searching for the correct realm 2024-09-13T19:18:02.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.634+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed439b6b60 con 0x55ed439b2650 2024-09-13T19:18:02.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.634+0000 7f692ce22640 1 -- 172.21.15.102:0/861759576 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f692400a4a0 con 0x55ed439b2650 2024-09-13T19:18:02.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.634+0000 7f692ce22640 1 --2- 172.21.15.102:0/861759576 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f692402bc20 0x7f6924033470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.634+0000 7f692ce22640 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed439b6b60 con 0x7f692402bc20 2024-09-13T19:18:02.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.634+0000 7f692c621640 1 --2- 172.21.15.102:0/861759576 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f692402bc20 0x7f6924033470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.635+0000 7f692c621640 1 --2- 172.21.15.102:0/861759576 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f692402bc20 0x7f6924033470 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.635+0000 7f692c621640 1 -- 172.21.15.102:0/861759576 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f691c075030 con 0x7f692402bc20 2024-09-13T19:18:02.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.635+0000 7f692c621640 1 --2- 172.21.15.102:0/861759576 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f691c0a0070 0x7f691c04f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.635+0000 7f692c621640 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed439b6b60 con 0x7f691c0a0070 2024-09-13T19:18:02.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.635+0000 7f6923e20640 1 --2- 172.21.15.102:0/861759576 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f691c0a0070 0x7f691c04f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.636+0000 7f6923e20640 1 --2- 172.21.15.102:0/861759576 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f691c0a0070 0x7f691c04f360 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.636+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f691400f670 con 0x7f691c0a0070 2024-09-13T19:18:02.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.636+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed439b6b60 con 0x55ed439add80 2024-09-13T19:18:02.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.636+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f691400f670 con 0x55ed439add80 2024-09-13T19:18:02.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.636+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed439b6b60 con 0x55ed439add80 2024-09-13T19:18:02.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.636+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f691402b040 con 0x55ed439add80 2024-09-13T19:18:02.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.636+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed439b6b60 con 0x7f691c0a0070 2024-09-13T19:18:02.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.637+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f691402b040 con 0x7f691c0a0070 2024-09-13T19:18:02.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.637+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed439b6b60 con 0x7f691c0a0070 2024-09-13T19:18:02.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.637+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f691402b040 con 0x7f691c0a0070 2024-09-13T19:18:02.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.637+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed439b6b60 con 0x7f692402bc20 2024-09-13T19:18:02.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.637+0000 7f692c621640 1 -- 172.21.15.102:0/861759576 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f691c075030 con 0x7f692402bc20 2024-09-13T19:18:02.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.637+0000 7f692c621640 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed439b6b60 con 0x55ed439b2650 2024-09-13T19:18:02.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.637+0000 7f692ce22640 1 -- 172.21.15.102:0/861759576 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f692400a4a0 con 0x55ed439b2650 2024-09-13T19:18:02.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.637+0000 7f692ce22640 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed439b6b60 con 0x55ed439add80 2024-09-13T19:18:02.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.638+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f691402b040 con 0x55ed439add80 2024-09-13T19:18:02.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.638+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed439b6b60 con 0x7f692402bc20 2024-09-13T19:18:02.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.638+0000 7f692c621640 1 -- 172.21.15.102:0/861759576 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f691c0af040 con 0x7f692402bc20 2024-09-13T19:18:02.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.638+0000 7f692c621640 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed439b6b60 con 0x55ed439add80 2024-09-13T19:18:02.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.638+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f691402b040 con 0x55ed439add80 2024-09-13T19:18:02.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.638+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed439b6b60 con 0x7f692402bc20 2024-09-13T19:18:02.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.638+0000 7f692c621640 1 -- 172.21.15.102:0/861759576 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f691c0af040 con 0x7f692402bc20 2024-09-13T19:18:02.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.638+0000 7f692c621640 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed439b6b60 con 0x55ed439b2650 2024-09-13T19:18:02.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.638+0000 7f692ce22640 1 -- 172.21.15.102:0/861759576 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f692400a4a0 con 0x55ed439b2650 2024-09-13T19:18:02.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.638+0000 7f692ce22640 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed439b6b60 con 0x55ed439b2650 2024-09-13T19:18:02.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.639+0000 7f692ce22640 1 -- 172.21.15.102:0/861759576 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f692400a4a0 con 0x55ed439b2650 2024-09-13T19:18:02.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.639+0000 7f692ce22640 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed439b6b60 con 0x7f691c0a0070 2024-09-13T19:18:02.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.639+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f691402b040 con 0x7f691c0a0070 2024-09-13T19:18:02.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.639+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed439b6b60 con 0x55ed439b2650 2024-09-13T19:18:02.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.639+0000 7f692ce22640 1 -- 172.21.15.102:0/861759576 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f692400a4a0 con 0x55ed439b2650 2024-09-13T19:18:02.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.639+0000 7f692ce22640 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed439b6b60 con 0x55ed439b2650 2024-09-13T19:18:02.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.639+0000 7f692ce22640 1 -- 172.21.15.102:0/861759576 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f692400a4a0 con 0x55ed439b2650 2024-09-13T19:18:02.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.639+0000 7f692ce22640 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed439b6b60 con 0x55ed439add80 2024-09-13T19:18:02.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.640+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f691402b040 con 0x55ed439add80 2024-09-13T19:18:02.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.640+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed439b6b60 con 0x55ed439add80 2024-09-13T19:18:02.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.640+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f691402b040 con 0x55ed439add80 2024-09-13T19:18:02.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.640+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed439b6b60 con 0x7f691c0a0070 2024-09-13T19:18:02.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.640+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f691402b040 con 0x7f691c0a0070 2024-09-13T19:18:02.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.640+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed439b6b60 con 0x55ed439b2650 2024-09-13T19:18:02.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.640+0000 7f692ce22640 1 -- 172.21.15.102:0/861759576 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f692400a4a0 con 0x55ed439b2650 2024-09-13T19:18:02.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.640+0000 7f692ce22640 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed439b6b60 con 0x7f692402bc20 2024-09-13T19:18:02.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.641+0000 7f692c621640 1 -- 172.21.15.102:0/861759576 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f691c0af040 con 0x7f692402bc20 2024-09-13T19:18:02.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.641+0000 7f692c621640 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed439b6b60 con 0x55ed439add80 2024-09-13T19:18:02.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.641+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f691402b040 con 0x55ed439add80 2024-09-13T19:18:02.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.641+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed439b6b60 con 0x7f692402bc20 2024-09-13T19:18:02.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.641+0000 7f692c621640 1 -- 172.21.15.102:0/861759576 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f691c0af040 con 0x7f692402bc20 2024-09-13T19:18:02.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.641+0000 7f692c621640 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed439b6b60 con 0x55ed439b2650 2024-09-13T19:18:02.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.641+0000 7f692ce22640 1 -- 172.21.15.102:0/861759576 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f692400a4a0 con 0x55ed439b2650 2024-09-13T19:18:02.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.641+0000 7f692ce22640 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed439b6b60 con 0x7f691c0a0070 2024-09-13T19:18:02.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.642+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f691402b040 con 0x7f691c0a0070 2024-09-13T19:18:02.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.642+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed439b6b60 con 0x7f692402bc20 2024-09-13T19:18:02.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.642+0000 7f692c621640 1 -- 172.21.15.102:0/861759576 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f691c0af040 con 0x7f692402bc20 2024-09-13T19:18:02.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.642+0000 7f692c621640 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed439b6b60 con 0x55ed439b2650 2024-09-13T19:18:02.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.642+0000 7f692ce22640 1 -- 172.21.15.102:0/861759576 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f692400a4a0 con 0x55ed439b2650 2024-09-13T19:18:02.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.642+0000 7f692ce22640 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed439b6b60 con 0x7f691c0a0070 2024-09-13T19:18:02.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.642+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f691402b040 con 0x7f691c0a0070 2024-09-13T19:18:02.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.642+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed439b6b60 con 0x55ed439add80 2024-09-13T19:18:02.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.643+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v36'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f691402b040 con 0x55ed439add80 2024-09-13T19:18:02.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.643+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed439b6b60 con 0x7f692402bc20 2024-09-13T19:18:02.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.643+0000 7f692c621640 1 -- 172.21.15.102:0/861759576 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f691c0af040 con 0x7f692402bc20 2024-09-13T19:18:02.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.643+0000 7f693092a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:18:02.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.643+0000 7f693092a800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:18:02.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.643+0000 7f693092a800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:18:02.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.643+0000 7f693092a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:18:02.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.643+0000 7f693092a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:18:02.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.643+0000 7f693092a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:18:02.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.643+0000 7f693092a800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.643+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed439b5bd0 con 0x55ed439add80 2024-09-13T19:18:02.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.643+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f691402b040 con 0x55ed439add80 2024-09-13T19:18:02.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.643+0000 7f693092a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:02.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.643+0000 7f693092a800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.643+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed439b6470 con 0x55ed439add80 2024-09-13T19:18:02.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.643+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f691402b040 con 0x55ed439add80 2024-09-13T19:18:02.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.643+0000 7f693092a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:18:02.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.643+0000 7f693092a800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.643+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed439b6fe0 con 0x55ed439b2650 2024-09-13T19:18:02.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.644+0000 7f692ce22640 1 -- 172.21.15.102:0/861759576 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f692400a4a0 con 0x55ed439b2650 2024-09-13T19:18:02.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.644+0000 7f693092a800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:18:02.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.644+0000 7f693092a800 20 zone default found 2024-09-13T19:18:02.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.644+0000 7f693092a800 4 Realm: () 2024-09-13T19:18:02.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.644+0000 7f693092a800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:18:02.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.644+0000 7f693092a800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:18:02.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.644+0000 7f693092a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:18:02.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.644+0000 7f693092a800 20 zonegroup default 2024-09-13T19:18:02.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.644+0000 7f693092a800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.644+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed439b7830 con 0x7f692402bc20 2024-09-13T19:18:02.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.644+0000 7f692c621640 1 -- 172.21.15.102:0/861759576 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f691c0af040 con 0x7f692402bc20 2024-09-13T19:18:02.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.644+0000 7f693092a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:02.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.644+0000 7f693092a800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.644+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed439b95b0 con 0x55ed439b2650 2024-09-13T19:18:02.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.644+0000 7f692ce22640 1 -- 172.21.15.102:0/861759576 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f692400a4a0 con 0x55ed439b2650 2024-09-13T19:18:02.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.644+0000 7f693092a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:02.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.644+0000 7f693092a800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.644+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed439b9a30 con 0x55ed439b2650 2024-09-13T19:18:02.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.644+0000 7f692ce22640 1 -- 172.21.15.102:0/861759576 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f692400a4a0 con 0x55ed439b2650 2024-09-13T19:18:02.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.644+0000 7f693092a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:02.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.644+0000 7f693092a800 20 started sync module instance, tier type = 2024-09-13T19:18:02.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.644+0000 7f693092a800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:18:02.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.644+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed439b8a50 con 0x7f692402bc20 2024-09-13T19:18:02.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.645+0000 7f692c621640 1 -- 172.21.15.102:0/861759576 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(44 notify.0 [create] v36'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f691c0af040 con 0x7f692402bc20 2024-09-13T19:18:02.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.645+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94477529878080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed439ba340 con 0x7f692402bc20 2024-09-13T19:18:02.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.645+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed439bab90 con 0x55ed439add80 2024-09-13T19:18:02.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.647+0000 7f692c621640 1 -- 172.21.15.102:0/861759576 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94477529878080] v36'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f691c0af040 con 0x7f692402bc20 2024-09-13T19:18:02.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.647+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v36'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f691402b040 con 0x55ed439add80 2024-09-13T19:18:02.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.647+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94477529884384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed439baf70 con 0x55ed439add80 2024-09-13T19:18:02.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.647+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed439bba60 con 0x55ed439b2650 2024-09-13T19:18:02.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.648+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94477529884384] v36'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f691402b040 con 0x55ed439add80 2024-09-13T19:18:02.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.648+0000 7f692ce22640 1 -- 172.21.15.102:0/861759576 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v36'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f692400a4a0 con 0x55ed439b2650 2024-09-13T19:18:02.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.648+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94477529888048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed439bba20 con 0x55ed439b2650 2024-09-13T19:18:02.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.648+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed439bc4f0 con 0x7f692402bc20 2024-09-13T19:18:02.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.649+0000 7f692ce22640 1 -- 172.21.15.102:0/861759576 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94477529888048] v36'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f692400a4a0 con 0x55ed439b2650 2024-09-13T19:18:02.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.650+0000 7f692c621640 1 -- 172.21.15.102:0/861759576 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(50 notify.3 [create] v36'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f691c0af040 con 0x7f692402bc20 2024-09-13T19:18:02.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.650+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94477529890752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed439bc4b0 con 0x7f692402bc20 2024-09-13T19:18:02.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.650+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed439bcf80 con 0x55ed439add80 2024-09-13T19:18:02.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.651+0000 7f692c621640 1 -- 172.21.15.102:0/861759576 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94477529890752] v36'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f691c0af040 con 0x7f692402bc20 2024-09-13T19:18:02.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.651+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v36'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f691402b040 con 0x55ed439add80 2024-09-13T19:18:02.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.652+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94477529893456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed439bcf40 con 0x55ed439add80 2024-09-13T19:18:02.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.652+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed439bd9e0 con 0x7f691c0a0070 2024-09-13T19:18:02.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.653+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(54 notify.5 [create] v36'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f691402b040 con 0x7f691c0a0070 2024-09-13T19:18:02.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.653+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94477529896160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed439bd9e0 con 0x7f691c0a0070 2024-09-13T19:18:02.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.653+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed439be9c0 con 0x7f691c0a0070 2024-09-13T19:18:02.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.653+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94477529893456] v36'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f691402b040 con 0x55ed439add80 2024-09-13T19:18:02.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.654+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94477529896160] v36'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f691402b040 con 0x7f691c0a0070 2024-09-13T19:18:02.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.654+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(56 notify.6 [create] v36'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f691402b040 con 0x7f691c0a0070 2024-09-13T19:18:02.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.654+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94477529900240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed439be9c0 con 0x7f691c0a0070 2024-09-13T19:18:02.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.654+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed439bee10 con 0x7f691c0a0070 2024-09-13T19:18:02.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.655+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94477529900240] v36'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f691402b040 con 0x7f691c0a0070 2024-09-13T19:18:02.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.655+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(58 notify.7 [create] v36'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f691402b040 con 0x7f691c0a0070 2024-09-13T19:18:02.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.655+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94477529898384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed439bedd0 con 0x7f691c0a0070 2024-09-13T19:18:02.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.655+0000 7f693092a800 20 add_watcher() i=0 2024-09-13T19:18:02.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.655+0000 7f693092a800 20 add_watcher() i=1 2024-09-13T19:18:02.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.655+0000 7f693092a800 20 add_watcher() i=2 2024-09-13T19:18:02.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.655+0000 7f693092a800 20 add_watcher() i=3 2024-09-13T19:18:02.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.655+0000 7f693092a800 20 add_watcher() i=4 2024-09-13T19:18:02.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.655+0000 7f693092a800 20 add_watcher() i=5 2024-09-13T19:18:02.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.655+0000 7f693092a800 20 add_watcher() i=6 2024-09-13T19:18:02.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.656+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94477529898384] v36'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f691402b040 con 0x7f691c0a0070 2024-09-13T19:18:02.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.656+0000 7f693092a800 20 add_watcher() i=7 2024-09-13T19:18:02.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.656+0000 7f693092a800 2 all 8 watchers are set, enabling cache 2024-09-13T19:18:02.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.656+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed439c2230 con 0x55ed439add80 2024-09-13T19:18:02.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.656+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f691402b040 con 0x55ed439add80 2024-09-13T19:18:02.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.656+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94477529882256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed439bf720 con 0x55ed439add80 2024-09-13T19:18:02.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.657+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94477529882256] v36'243 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f691402b040 con 0x55ed439add80 2024-09-13T19:18:02.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.657+0000 7f67e27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:18:02.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.657+0000 7f693092a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:18:02.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.657+0000 7f693092a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:18:02.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.658+0000 7f693092a800 5 note: GC not initialized 2024-09-13T19:18:02.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.658+0000 7f67e17e2640 20 reqs_thread_entry: start 2024-09-13T19:18:02.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.658+0000 7f693092a800 20 init_complete bucket index max shards: 11 2024-09-13T19:18:02.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.658+0000 7f693092a800 20 Filter name: none 2024-09-13T19:18:02.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.658+0000 7f6752ffd640 20 reqs_thread_entry: start 2024-09-13T19:18:02.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.658+0000 7f693092a800 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-13T19:18:02.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.658+0000 7f693092a800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.658+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:62 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed439f5680 con 0x7f691c0a0070 2024-09-13T19:18:02.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.659+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(62 system_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 239+0+0 (crc 0 0 0) 0x7f691402b040 con 0x7f691c0a0070 2024-09-13T19:18:02.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.659+0000 7f693092a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:02.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.659+0000 7f693092a800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x0 2024-09-13T19:18:02.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.659+0000 7f693092a800 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-13T19:18:02.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.659+0000 7f693092a800 10 cache get: name=default.rgw.meta+users.keys+system_akey : miss 2024-09-13T19:18:02.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.659+0000 7f693092a800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.659+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:63 8.0 8:01223cbf:users.keys::system_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed439f3cc0 con 0x55ed439b2650 2024-09-13T19:18:02.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.659+0000 7f692ce22640 1 -- 172.21.15.102:0/861759576 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(63 system_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f692400a4a0 con 0x55ed439b2650 2024-09-13T19:18:02.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.659+0000 7f693092a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:02.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.659+0000 7f693092a800 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x0 2024-09-13T19:18:02.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.659+0000 7f693092a800 10 adding default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-13T19:18:02.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.659+0000 7f693092a800 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-13T19:18:02.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.659+0000 7f693092a800 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-13T19:18:02.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.659+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:64 8.1e 8:78ce4db0:users.uid::system_user:head [delete,create,call version.set in=58b,writefull 0~349 in=349b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed439f4560 con 0x7f691c0a0070 2024-09-13T19:18:02.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.660+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(64 system_user [delete,create,call,writefull 0~349] v36'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f691402b040 con 0x7f691c0a0070 2024-09-13T19:18:02.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.660+0000 7f693092a800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-13T19:18:02.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.660+0000 7f693092a800 10 moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-13T19:18:02.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.660+0000 7f693092a800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-13T19:18:02.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.660+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94477530120368 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed439f9120 con 0x7f692402bc20 2024-09-13T19:18:02.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.661+0000 7f692c621640 1 -- 172.21.15.102:0/861759576 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== watch-notify(notify (1) cookie 94477529878080 notify 154618822681 ret 0) ==== 575+0+0 (crc 0 0 0) 0x7f691c0bb040 con 0x7f692402bc20 2024-09-13T19:18:02.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.661+0000 7f680b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822681 cookie 94477529878080 notifier 4853 bl.length()=533 2024-09-13T19:18:02.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.661+0000 7f692c621640 1 -- 172.21.15.102:0/861759576 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(65 notify.0 [notify cookie 94477530120368 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f691c0af040 con 0x7f692402bc20 2024-09-13T19:18:02.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.661+0000 7f680b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-13T19:18:02.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.661+0000 7f680b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-13T19:18:02.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.661+0000 7f680b7fe640 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f67f0003ea0 con 0x7f692402bc20 2024-09-13T19:18:02.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.661+0000 7f692c621640 1 -- 172.21.15.102:0/861759576 <== osd.2 v2:172.21.15.102:6816/2238176080 16 ==== osd_op_reply(66 notify.0 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f691c0af040 con 0x7f692402bc20 2024-09-13T19:18:02.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.661+0000 7f692c621640 1 -- 172.21.15.102:0/861759576 <== osd.2 v2:172.21.15.102:6816/2238176080 17 ==== watch-notify(notify_complete (2) cookie 94477530120368 notify 154618822681 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f691c09a070 con 0x7f692402bc20 2024-09-13T19:18:02.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.661+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:67 8.0 8:01223cbf:users.keys::system_akey:head [delete,create,writefull 0~15 in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed439f40b0 con 0x55ed439b2650 2024-09-13T19:18:02.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.662+0000 7f692ce22640 1 -- 172.21.15.102:0/861759576 <== osd.3 v2:172.21.15.102:6800/3096737090 17 ==== osd_op_reply(67 system_akey [delete,create,writefull 0~15] v36'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f692400a4a0 con 0x55ed439b2650 2024-09-13T19:18:02.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.662+0000 7f693092a800 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-13T19:18:02.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.662+0000 7f693092a800 10 moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-13T19:18:02.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.662+0000 7f693092a800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-13T19:18:02.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.662+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify cookie 94477530120368 in=188b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed439f9120 con 0x55ed439add80 2024-09-13T19:18:02.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.662+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== watch-notify(notify (1) cookie 94477529884384 notify 154618822694 ret 0) ==== 218+0+0 (crc 0 0 0) 0x55ed439f4900 con 0x55ed439add80 2024-09-13T19:18:02.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.662+0000 7f680b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822694 cookie 94477529884384 notifier 4853 bl.length()=176 2024-09-13T19:18:02.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.662+0000 7f680b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-13T19:18:02.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.662+0000 7f680b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-13T19:18:02.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.662+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(68 notify.1 [notify cookie 94477530120368 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f691402b040 con 0x55ed439add80 2024-09-13T19:18:02.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.662+0000 7f680b7fe640 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f67f0003ea0 con 0x55ed439add80 2024-09-13T19:18:02.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.663+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(69 notify.1 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f691402b040 con 0x55ed439add80 2024-09-13T19:18:02.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.663+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== watch-notify(notify_complete (2) cookie 94477530120368 notify 154618822694 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ed439f50d0 con 0x55ed439add80 2024-09-13T19:18:02.687 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"system_user","display_name":"System User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"system_user","access_key":"system_akey","secret_key":"system_skey","active":true,"create_date":"2024-09-13T19:18:02.660462Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","system":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:18:02.660454Z","tags":[],"group_ids":[]} 2024-09-13T19:18:02.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.664+0000 7f67e27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:18:02.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.664+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94477529882256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed439f33c0 con 0x55ed439add80 2024-09-13T19:18:02.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.664+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94477529882256] v36'244 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f691402b040 con 0x55ed439add80 2024-09-13T19:18:02.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.665+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94477529878080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed439f33c0 con 0x7f692402bc20 2024-09-13T19:18:02.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.665+0000 7f692c621640 1 -- 172.21.15.102:0/861759576 <== osd.2 v2:172.21.15.102:6816/2238176080 18 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94477529878080] v36'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f691c0af040 con 0x7f692402bc20 2024-09-13T19:18:02.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.665+0000 7f693092a800 20 remove_watcher() i=0 2024-09-13T19:18:02.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.665+0000 7f693092a800 2 removed watcher, disabling cache 2024-09-13T19:18:02.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.666+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94477529884384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed439f33c0 con 0x55ed439add80 2024-09-13T19:18:02.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.667+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94477529884384] v36'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f691402b040 con 0x55ed439add80 2024-09-13T19:18:02.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.667+0000 7f693092a800 20 remove_watcher() i=1 2024-09-13T19:18:02.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.667+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94477529888048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed439f33c0 con 0x55ed439b2650 2024-09-13T19:18:02.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.668+0000 7f692ce22640 1 -- 172.21.15.102:0/861759576 <== osd.3 v2:172.21.15.102:6800/3096737090 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94477529888048] v36'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f692400a4a0 con 0x55ed439b2650 2024-09-13T19:18:02.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.668+0000 7f693092a800 20 remove_watcher() i=2 2024-09-13T19:18:02.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.668+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94477529890752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed439f33c0 con 0x7f692402bc20 2024-09-13T19:18:02.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.669+0000 7f692c621640 1 -- 172.21.15.102:0/861759576 <== osd.2 v2:172.21.15.102:6816/2238176080 19 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94477529890752] v36'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f691c0af040 con 0x7f692402bc20 2024-09-13T19:18:02.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.669+0000 7f693092a800 20 remove_watcher() i=3 2024-09-13T19:18:02.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.669+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94477529893456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed439f33c0 con 0x55ed439add80 2024-09-13T19:18:02.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.670+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94477529893456] v36'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f691402b040 con 0x55ed439add80 2024-09-13T19:18:02.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.670+0000 7f693092a800 20 remove_watcher() i=4 2024-09-13T19:18:02.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.670+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94477529896160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed439f33c0 con 0x7f691c0a0070 2024-09-13T19:18:02.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.671+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94477529896160] v36'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f691402b040 con 0x7f691c0a0070 2024-09-13T19:18:02.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.671+0000 7f693092a800 20 remove_watcher() i=5 2024-09-13T19:18:02.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.671+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94477529900240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed439f33c0 con 0x7f691c0a0070 2024-09-13T19:18:02.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.672+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94477529900240] v36'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f691402b040 con 0x7f691c0a0070 2024-09-13T19:18:02.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.672+0000 7f693092a800 20 remove_watcher() i=6 2024-09-13T19:18:02.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.672+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94477529898384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed439f33c0 con 0x7f691c0a0070 2024-09-13T19:18:02.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.673+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94477529898384] v36'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f691402b040 con 0x7f691c0a0070 2024-09-13T19:18:02.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.673+0000 7f693092a800 20 remove_watcher() i=7 2024-09-13T19:18:02.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.673+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f691c0a0070 msgr2=0x7f691c04f360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.673+0000 7f693092a800 1 --2- 172.21.15.102:0/861759576 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f691c0a0070 0x7f691c04f360 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.673+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55ed439add80 msgr2=0x55ed439b0240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.673+0000 7f693092a800 1 --2- 172.21.15.102:0/861759576 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55ed439add80 0x55ed439b0240 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.673+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f692402bc20 msgr2=0x7f6924033470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.673+0000 7f693092a800 1 --2- 172.21.15.102:0/861759576 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f692402bc20 0x7f6924033470 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.674+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55ed439b2650 msgr2=0x55ed439b4a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.674+0000 7f693092a800 1 --2- 172.21.15.102:0/861759576 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55ed439b2650 0x55ed439b4a80 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.674+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f67fc036b40 msgr2=0x7f67fc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.674+0000 7f693092a800 1 --2- 172.21.15.102:0/861759576 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f67fc036b40 0x7f67fc039000 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f691c005a60 tx=0x7f691c08c000 comp rx=0 tx=0).stop 2024-09-13T19:18:02.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.674+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed4399ae20 msgr2=0x55ed439a2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.674+0000 7f6923e20640 1 -- 172.21.15.102:0/861759576 reap_dead start 2024-09-13T19:18:02.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.674+0000 7f693092a800 1 --2- 172.21.15.102:0/861759576 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed4399ae20 0x55ed439a2290 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f6924013fd0 tx=0x7f692404cc90 comp rx=0 tx=0).stop 2024-09-13T19:18:02.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.674+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 shutdown_connections 2024-09-13T19:18:02.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.674+0000 7f693092a800 1 --2- 172.21.15.102:0/861759576 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed4399ae20 0x55ed439a2290 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.674+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 >> 172.21.15.102:0/861759576 conn(0x55ed43997180 msgr2=0x55ed43995250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:02.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.674+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 shutdown_connections 2024-09-13T19:18:02.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.674+0000 7f693092a800 1 -- 172.21.15.102:0/861759576 wait complete. 2024-09-13T19:18:02.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.674+0000 7f693092a800 1 -- 172.21.15.102:0/3429200255 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6804036b90 msgr2=0x7f6804039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.674+0000 7f693092a800 1 --2- 172.21.15.102:0/3429200255 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6804036b90 0x7f6804039050 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x55ed43977b30 tx=0x7f691c08f550 comp rx=0 tx=0).stop 2024-09-13T19:18:02.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.674+0000 7f693092a800 1 -- 172.21.15.102:0/3429200255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed4398e120 msgr2=0x55ed4398e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.674+0000 7f693092a800 1 --2- 172.21.15.102:0/3429200255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed4398e120 0x55ed4398e540 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x55ed439741b0 tx=0x7f69240167b0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.674+0000 7f693092a800 1 -- 172.21.15.102:0/3429200255 shutdown_connections 2024-09-13T19:18:02.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.674+0000 7f693092a800 1 --2- 172.21.15.102:0/3429200255 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6804036b90 0x7f6804039050 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.674+0000 7f693092a800 1 --2- 172.21.15.102:0/3429200255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed4398e120 0x55ed4398e540 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.674+0000 7f693092a800 1 -- 172.21.15.102:0/3429200255 >> 172.21.15.102:0/3429200255 conn(0x55ed439830b0 msgr2=0x55ed43985c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:02.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.674+0000 7f693092a800 1 -- 172.21.15.102:0/3429200255 shutdown_connections 2024-09-13T19:18:02.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.674+0000 7f693092a800 1 -- 172.21.15.102:0/3429200255 wait complete. 2024-09-13T19:18:02.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.674+0000 7f693092a800 1 -- 172.21.15.102:0/986912746 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55ed4387b080 msgr2=0x55ed4397a400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.674+0000 7f693092a800 1 --2- 172.21.15.102:0/986912746 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55ed4387b080 0x55ed4397a400 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.674+0000 7f693092a800 1 -- 172.21.15.102:0/986912746 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55ed4397cb30 msgr2=0x55ed4397efd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.674+0000 7f693092a800 1 --2- 172.21.15.102:0/986912746 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55ed4397cb30 0x55ed4397efd0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.675+0000 7f693092a800 1 -- 172.21.15.102:0/986912746 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6814036b90 msgr2=0x7f6814039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.675+0000 7f693092a800 1 --2- 172.21.15.102:0/986912746 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6814036b90 0x7f6814039050 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6914001e40 tx=0x7f69140013a0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.675+0000 7f693092a800 1 -- 172.21.15.102:0/986912746 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed4387a740 msgr2=0x55ed43973390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.675+0000 7f693092a800 1 --2- 172.21.15.102:0/986912746 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed4387a740 0x55ed43973390 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f691c067040 tx=0x7f691c002fb0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.675+0000 7f693092a800 1 -- 172.21.15.102:0/986912746 shutdown_connections 2024-09-13T19:18:02.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.675+0000 7f693092a800 1 --2- 172.21.15.102:0/986912746 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55ed4397cb30 0x55ed4397efd0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.675+0000 7f693092a800 1 --2- 172.21.15.102:0/986912746 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55ed4387b080 0x55ed4397a400 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.675+0000 7f693092a800 1 --2- 172.21.15.102:0/986912746 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6814036b90 0x7f6814039050 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.675+0000 7f693092a800 1 --2- 172.21.15.102:0/986912746 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed4387a740 0x55ed43973390 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.675+0000 7f693092a800 1 -- 172.21.15.102:0/986912746 >> 172.21.15.102:0/986912746 conn(0x55ed43876010 msgr2=0x55ed437ef220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:02.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.675+0000 7f693092a800 1 -- 172.21.15.102:0/986912746 shutdown_connections 2024-09-13T19:18:02.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.675+0000 7f693092a800 1 -- 172.21.15.102:0/986912746 wait complete. 2024-09-13T19:18:02.699 DEBUG:tasks.util.rgw: json result: {'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-13T19:18:02.660462Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:18:02.660454Z', 'tags': [], 'group_ids': []} 2024-09-13T19:18:02.699 ERROR:root:{'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-13T19:18:02.660462Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:18:02.660454Z', 'tags': [], 'group_ids': []} 2024-09-13T19:18:02.699 ERROR:root:0 2024-09-13T19:18:02.700 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:18:02.711 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:18:02.712 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'system_user'] 2024-09-13T19:18:02.712 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'system_user'] 2024-09-13T19:18:02.712 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid system_user 2024-09-13T19:18:02.756 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:18:02.756 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:18:02.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.754+0000 7fec4bd19800 1 Processor -- start 2024-09-13T19:18:02.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.754+0000 7fec4bd19800 1 -- start start 2024-09-13T19:18:02.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.754+0000 7fec4bd19800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55ed49c9e900 0x55ed49ca0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.754+0000 7fec4bd19800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ed49b5ab30 con 0x55ed49c9a4c0 2024-09-13T19:18:02.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.754+0000 7fec4bd19800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55ed49b3c360 con 0x55ed49c9e900 2024-09-13T19:18:02.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.754+0000 7fec4900c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55ed49c9e900 0x55ed49ca0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.754+0000 7fec4900c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55ed49c9e900 0x55ed49ca0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49714/0 (socket says 172.21.15.102:49714) 2024-09-13T19:18:02.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.754+0000 7fec4980d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55ed49c9a4c0 0x55ed49c9a8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:53712/0 (socket says 172.21.15.102:53712) 2024-09-13T19:18:02.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.754+0000 7fec4900c640 1 -- 172.21.15.102:0/1133226994 learned_addr learned my addr 172.21.15.102:0/1133226994 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:02.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.755+0000 7fec4900c640 1 -- 172.21.15.102:0/1133226994 >> v1:172.21.15.53:6789/0 conn(0x55ed49c9a4c0 legacy=0x55ed49c9a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.755+0000 7fec4900c640 1 -- 172.21.15.102:0/1133226994 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed49b62e00 con 0x55ed49c9e900 2024-09-13T19:18:02.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.755+0000 7fec4880b640 1 -- 172.21.15.102:0/1133226994 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1546105942 0 0) 0x55ed49b5ab30 con 0x55ed49c9a4c0 2024-09-13T19:18:02.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.756+0000 7fec4900c640 1 --2- 172.21.15.102:0/1133226994 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed49c9e900 0x55ed49ca0cf0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fec4000a520 tx=0x7fec40045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3c650a0529a325 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.757+0000 7fec4880b640 1 -- 172.21.15.102:0/1133226994 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec40055070 con 0x55ed49c9e900 2024-09-13T19:18:02.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.757+0000 7fec4880b640 1 -- 172.21.15.102:0/1133226994 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec400515b0 con 0x55ed49c9e900 2024-09-13T19:18:02.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.757+0000 7fec4880b640 1 -- 172.21.15.102:0/1133226994 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec400518d0 con 0x55ed49c9e900 2024-09-13T19:18:02.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.757+0000 7fec4bd19800 1 -- 172.21.15.102:0/1133226994 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed49c9e900 msgr2=0x55ed49ca0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.757+0000 7fec4bd19800 1 --2- 172.21.15.102:0/1133226994 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed49c9e900 0x55ed49ca0cf0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fec4000a520 tx=0x7fec40045ba0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.757+0000 7fec4bd19800 1 -- 172.21.15.102:0/1133226994 shutdown_connections 2024-09-13T19:18:02.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.757+0000 7fec4bd19800 1 --2- 172.21.15.102:0/1133226994 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed49c9e900 0x55ed49ca0cf0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.757+0000 7fec4bd19800 1 -- 172.21.15.102:0/1133226994 >> 172.21.15.102:0/1133226994 conn(0x55ed49c95df0 msgr2=0x55ed49c98210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:02.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.757+0000 7fec4bd19800 1 -- 172.21.15.102:0/1133226994 shutdown_connections 2024-09-13T19:18:02.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.757+0000 7fec4bd19800 1 -- 172.21.15.102:0/1133226994 wait complete. 2024-09-13T19:18:02.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.771+0000 7fec4bd19800 1 Processor -- start 2024-09-13T19:18:02.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.771+0000 7fec4bd19800 1 -- start start 2024-09-13T19:18:02.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.771+0000 7fec4bd19800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed49c9a4c0 0x55ed49c0ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.771+0000 7fec4bd19800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ed49be7330 con 0x55ed49c9a4c0 2024-09-13T19:18:02.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.772+0000 7fec4980d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed49c9a4c0 0x55ed49c0ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.772+0000 7fec4980d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed49c9a4c0 0x55ed49c0ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49724/0 (socket says 172.21.15.102:49724) 2024-09-13T19:18:02.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.772+0000 7fec4980d640 1 -- 172.21.15.102:0/784745853 learned_addr learned my addr 172.21.15.102:0/784745853 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:02.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.772+0000 7fec4980d640 1 -- 172.21.15.102:0/784745853 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed49b34bc0 con 0x55ed49c9a4c0 2024-09-13T19:18:02.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.772+0000 7fec4980d640 1 --2- 172.21.15.102:0/784745853 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed49c9a4c0 0x55ed49c0ed80 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fec3c00b240 tx=0x7fec3c00b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c677d33aafd326a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.772+0000 7feb37e07640 1 -- 172.21.15.102:0/784745853 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec3c008070 con 0x55ed49c9a4c0 2024-09-13T19:18:02.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.772+0000 7feb37e07640 1 -- 172.21.15.102:0/784745853 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec3c00d500 con 0x55ed49c9a4c0 2024-09-13T19:18:02.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.772+0000 7feb37e07640 1 -- 172.21.15.102:0/784745853 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec3c00d860 con 0x55ed49c9a4c0 2024-09-13T19:18:02.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.773+0000 7fec4bd19800 1 -- 172.21.15.102:0/784745853 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed49c9a4c0 msgr2=0x55ed49c0ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.773+0000 7fec4bd19800 1 --2- 172.21.15.102:0/784745853 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed49c9a4c0 0x55ed49c0ed80 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fec3c00b240 tx=0x7fec3c00b700 comp rx=0 tx=0).stop 2024-09-13T19:18:02.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.773+0000 7fec4bd19800 1 -- 172.21.15.102:0/784745853 shutdown_connections 2024-09-13T19:18:02.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.773+0000 7fec4bd19800 1 --2- 172.21.15.102:0/784745853 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed49c9a4c0 0x55ed49c0ed80 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.773+0000 7fec4bd19800 1 -- 172.21.15.102:0/784745853 >> 172.21.15.102:0/784745853 conn(0x55ed49c95df0 msgr2=0x55ed49d84f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:02.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.773+0000 7fec4bd19800 1 -- 172.21.15.102:0/784745853 shutdown_connections 2024-09-13T19:18:02.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.773+0000 7fec4bd19800 1 -- 172.21.15.102:0/784745853 wait complete. 2024-09-13T19:18:02.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.773+0000 7fec4bd19800 1 Processor -- start 2024-09-13T19:18:02.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.773+0000 7fec4bd19800 1 -- start start 2024-09-13T19:18:02.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.774+0000 7fec4bd19800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed49c9a4c0 0x55ed49d92080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.774+0000 7fec4bd19800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ed49ca1530 con 0x55ed49c9a4c0 2024-09-13T19:18:02.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.774+0000 7fec4980d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed49c9a4c0 0x55ed49d92080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.774+0000 7fec4980d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed49c9a4c0 0x55ed49d92080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49740/0 (socket says 172.21.15.102:49740) 2024-09-13T19:18:02.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.774+0000 7fec4980d640 1 -- 172.21.15.102:0/2881226971 learned_addr learned my addr 172.21.15.102:0/2881226971 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:02.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.774+0000 7fec4980d640 1 -- 172.21.15.102:0/2881226971 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed49b48fe0 con 0x55ed49c9a4c0 2024-09-13T19:18:02.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.774+0000 7fec4980d640 1 --2- 172.21.15.102:0/2881226971 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed49c9a4c0 0x55ed49d92080 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fec3c000f60 tx=0x7fec3c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.775+0000 7feb36604640 1 -- 172.21.15.102:0/2881226971 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec3c019870 con 0x55ed49c9a4c0 2024-09-13T19:18:02.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.775+0000 7feb36604640 1 -- 172.21.15.102:0/2881226971 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec3c019a10 con 0x55ed49c9a4c0 2024-09-13T19:18:02.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.775+0000 7fec4bd19800 1 -- 172.21.15.102:0/2881226971 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ed49d925c0 con 0x55ed49c9a4c0 2024-09-13T19:18:02.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.775+0000 7feb36604640 1 -- 172.21.15.102:0/2881226971 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec3c019d10 con 0x55ed49c9a4c0 2024-09-13T19:18:02.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.775+0000 7fec4bd19800 1 -- 172.21.15.102:0/2881226971 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed49d92ae0 con 0x55ed49c9a4c0 2024-09-13T19:18:02.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.776+0000 7feb36604640 1 -- 172.21.15.102:0/2881226971 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fec3c017040 con 0x55ed49c9a4c0 2024-09-13T19:18:02.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.776+0000 7feb36604640 1 --2- 172.21.15.102:0/2881226971 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7feb30036b90 0x7feb30039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.776+0000 7feb36604640 1 -- 172.21.15.102:0/2881226971 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fec3c015020 con 0x55ed49c9a4c0 2024-09-13T19:18:02.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.776+0000 7fec4900c640 1 --2- 172.21.15.102:0/2881226971 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7feb30036b90 0x7feb30039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.776+0000 7fec4bd19800 1 --2- 172.21.15.102:0/2881226971 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55ed49c9e900 0x55ed49d990f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.776+0000 7fec4bd19800 1 -- 172.21.15.102:0/2881226971 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed49d99630 con 0x55ed49c9e900 2024-09-13T19:18:02.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.776+0000 7fec4a00e640 1 --2- 172.21.15.102:0/2881226971 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55ed49c9e900 0x55ed49d990f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.776+0000 7fec4900c640 1 --2- 172.21.15.102:0/2881226971 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7feb30036b90 0x7feb30039050 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fec40057000 tx=0x7fec40052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.776+0000 7fec4a00e640 1 --2- 172.21.15.102:0/2881226971 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55ed49c9e900 0x55ed49d990f0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.777+0000 7fec4a00e640 1 -- 172.21.15.102:0/2881226971 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec4400a4a0 con 0x55ed49c9e900 2024-09-13T19:18:02.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.777+0000 7fec4bd19800 1 -- 172.21.15.102:0/2881226971 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed49d966c0 con 0x55ed49c9e900 2024-09-13T19:18:02.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.777+0000 7fec4a00e640 1 -- 172.21.15.102:0/2881226971 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fec4400a4a0 con 0x55ed49c9e900 2024-09-13T19:18:02.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.777+0000 7fec4bd19800 1 --2- 172.21.15.102:0/2881226971 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55ed49d9b920 0x55ed49d9dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.777+0000 7fec4bd19800 1 -- 172.21.15.102:0/2881226971 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed49d9e3b0 con 0x55ed49d9b920 2024-09-13T19:18:02.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.777+0000 7fec4980d640 1 --2- 172.21.15.102:0/2881226971 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55ed49d9b920 0x55ed49d9dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.777+0000 7fec4980d640 1 --2- 172.21.15.102:0/2881226971 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55ed49d9b920 0x55ed49d9dd10 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.778+0000 7fec4980d640 1 -- 172.21.15.102:0/2881226971 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fec3c02d070 con 0x55ed49d9b920 2024-09-13T19:18:02.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.778+0000 7fec4bd19800 1 -- 172.21.15.102:0/2881226971 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed49d9a7c0 con 0x55ed49c9e900 2024-09-13T19:18:02.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.778+0000 7fec4a00e640 1 -- 172.21.15.102:0/2881226971 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fec4400a4a0 con 0x55ed49c9e900 2024-09-13T19:18:02.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.778+0000 7fec4bd19800 1 -- 172.21.15.102:0/2881226971 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed49d9aca0 con 0x55ed49d9b920 2024-09-13T19:18:02.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.778+0000 7fec4980d640 1 -- 172.21.15.102:0/2881226971 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fec3c02d070 con 0x55ed49d9b920 2024-09-13T19:18:02.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.778+0000 7fec4bd19800 1 Processor -- start 2024-09-13T19:18:02.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.779+0000 7fec4bd19800 1 -- start start 2024-09-13T19:18:02.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.779+0000 7fec4bd19800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed49d8ad40 0x55ed49d89390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.779+0000 7fec4bd19800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ed49b36580 con 0x55ed49d8ad40 2024-09-13T19:18:02.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.779+0000 7fec4a00e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed49d8ad40 0x55ed49d89390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.779+0000 7fec4a00e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed49d8ad40 0x55ed49d89390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49752/0 (socket says 172.21.15.102:49752) 2024-09-13T19:18:02.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.779+0000 7fec4a00e640 1 -- 172.21.15.102:0/2637676886 learned_addr learned my addr 172.21.15.102:0/2637676886 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:02.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.779+0000 7fec4a00e640 1 -- 172.21.15.102:0/2637676886 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed49d8b160 con 0x55ed49d8ad40 2024-09-13T19:18:02.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.779+0000 7fec4a00e640 1 --2- 172.21.15.102:0/2637676886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed49d8ad40 0x55ed49d89390 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x55ed49d93130 tx=0x7fec440167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.780+0000 7feb2f7fe640 1 -- 172.21.15.102:0/2637676886 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec44013640 con 0x55ed49d8ad40 2024-09-13T19:18:02.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.780+0000 7feb2f7fe640 1 -- 172.21.15.102:0/2637676886 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec440137e0 con 0x55ed49d8ad40 2024-09-13T19:18:02.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.780+0000 7fec4bd19800 1 -- 172.21.15.102:0/2637676886 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ed49d89990 con 0x55ed49d8ad40 2024-09-13T19:18:02.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.780+0000 7feb2f7fe640 1 -- 172.21.15.102:0/2637676886 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec44013ac0 con 0x55ed49d8ad40 2024-09-13T19:18:02.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.780+0000 7fec4bd19800 1 -- 172.21.15.102:0/2637676886 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed49d89e90 con 0x55ed49d8ad40 2024-09-13T19:18:02.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.780+0000 7feb2f7fe640 1 -- 172.21.15.102:0/2637676886 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fec44011040 con 0x55ed49d8ad40 2024-09-13T19:18:02.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.781+0000 7feb2f7fe640 1 --2- 172.21.15.102:0/2637676886 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7feb24036b40 0x7feb24039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.781+0000 7feb2f7fe640 1 -- 172.21.15.102:0/2637676886 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fec4400e040 con 0x55ed49d8ad40 2024-09-13T19:18:02.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.781+0000 7fec4980d640 1 --2- 172.21.15.102:0/2637676886 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7feb24036b40 0x7feb24039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.781+0000 7fec4bd19800 1 Processor -- start 2024-09-13T19:18:02.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.781+0000 7fec4980d640 1 --2- 172.21.15.102:0/2637676886 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7feb24036b40 0x7feb24039000 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x55ed49d965e0 tx=0x7fec3c04b670 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.781+0000 7fec4bd19800 1 -- start start 2024-09-13T19:18:02.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.781+0000 7fec4bd19800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed49dbbcb0 0x55ed49dbc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.781+0000 7fec4bd19800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ed49d8d540 con 0x55ed49dbbcb0 2024-09-13T19:18:02.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.782+0000 7fec4a00e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed49dbbcb0 0x55ed49dbc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.782+0000 7fec4a00e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed49dbbcb0 0x55ed49dbc0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49754/0 (socket says 172.21.15.102:49754) 2024-09-13T19:18:02.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.782+0000 7fec4a00e640 1 -- 172.21.15.102:0/1629489115 learned_addr learned my addr 172.21.15.102:0/1629489115 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:02.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.782+0000 7fec4a00e640 1 -- 172.21.15.102:0/1629489115 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed49dbc680 con 0x55ed49dbbcb0 2024-09-13T19:18:02.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.782+0000 7fec4a00e640 1 --2- 172.21.15.102:0/1629489115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed49dbbcb0 0x55ed49dbc0b0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fec44005a10 tx=0x7fec44020e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dc833c54e5dca43 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.782+0000 7feb2d7fa640 1 -- 172.21.15.102:0/1629489115 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec44021440 con 0x55ed49dbbcb0 2024-09-13T19:18:02.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.782+0000 7feb2d7fa640 1 -- 172.21.15.102:0/1629489115 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec4401f340 con 0x55ed49dbbcb0 2024-09-13T19:18:02.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.782+0000 7feb2d7fa640 1 -- 172.21.15.102:0/1629489115 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec440215e0 con 0x55ed49dbbcb0 2024-09-13T19:18:02.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.783+0000 7fec4bd19800 1 -- 172.21.15.102:0/1629489115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed49dbbcb0 msgr2=0x55ed49dbc0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.783+0000 7fec4bd19800 1 --2- 172.21.15.102:0/1629489115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed49dbbcb0 0x55ed49dbc0b0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fec44005a10 tx=0x7fec44020e60 comp rx=0 tx=0).stop 2024-09-13T19:18:02.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.783+0000 7fec4bd19800 1 -- 172.21.15.102:0/1629489115 shutdown_connections 2024-09-13T19:18:02.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.783+0000 7fec4bd19800 1 --2- 172.21.15.102:0/1629489115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed49dbbcb0 0x55ed49dbc0b0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.783+0000 7fec4bd19800 1 -- 172.21.15.102:0/1629489115 >> 172.21.15.102:0/1629489115 conn(0x55ed49db8010 msgr2=0x55ed49db6110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:02.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.783+0000 7fec4bd19800 1 -- 172.21.15.102:0/1629489115 shutdown_connections 2024-09-13T19:18:02.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.783+0000 7fec4bd19800 1 -- 172.21.15.102:0/1629489115 wait complete. 2024-09-13T19:18:02.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.783+0000 7fec4bd19800 1 Processor -- start 2024-09-13T19:18:02.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.783+0000 7fec4bd19800 1 -- start start 2024-09-13T19:18:02.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.783+0000 7fec4bd19800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed49dbbcb0 0x55ed49dc3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.783+0000 7fec4bd19800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ed49dbccf0 con 0x55ed49dbbcb0 2024-09-13T19:18:02.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.783+0000 7fec4a00e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed49dbbcb0 0x55ed49dc3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.783+0000 7fec4a00e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed49dbbcb0 0x55ed49dc3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49760/0 (socket says 172.21.15.102:49760) 2024-09-13T19:18:02.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.783+0000 7fec4a00e640 1 -- 172.21.15.102:0/947504174 learned_addr learned my addr 172.21.15.102:0/947504174 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:02.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.784+0000 7fec4a00e640 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed49dc36c0 con 0x55ed49dbbcb0 2024-09-13T19:18:02.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.784+0000 7fec4a00e640 1 --2- 172.21.15.102:0/947504174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed49dbbcb0 0x55ed49dc3180 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fec44012fd0 tx=0x7fec4404cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.784+0000 7feb1b7fe640 1 -- 172.21.15.102:0/947504174 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec4403a070 con 0x55ed49dbbcb0 2024-09-13T19:18:02.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.784+0000 7feb1b7fe640 1 -- 172.21.15.102:0/947504174 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec440400d0 con 0x55ed49dbbcb0 2024-09-13T19:18:02.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.784+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ed49dc3950 con 0x55ed49dbbcb0 2024-09-13T19:18:02.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.784+0000 7feb1b7fe640 1 -- 172.21.15.102:0/947504174 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec440403b0 con 0x55ed49dbbcb0 2024-09-13T19:18:02.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.784+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed49dc6600 con 0x55ed49dbbcb0 2024-09-13T19:18:02.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.785+0000 7feb1b7fe640 1 -- 172.21.15.102:0/947504174 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fec440205b0 con 0x55ed49dbbcb0 2024-09-13T19:18:02.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.785+0000 7feb1b7fe640 1 --2- 172.21.15.102:0/947504174 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7feb14036b40 0x7feb14039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.785+0000 7feb1b7fe640 1 -- 172.21.15.102:0/947504174 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fec44036d90 con 0x55ed49dbbcb0 2024-09-13T19:18:02.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.785+0000 7fec4980d640 1 --2- 172.21.15.102:0/947504174 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7feb14036b40 0x7feb14039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.785+0000 7fec4980d640 1 --2- 172.21.15.102:0/947504174 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7feb14036b40 0x7feb14039000 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fec3c04b7a0 tx=0x7fec3c034000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.786+0000 7fec4bd19800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.786+0000 7fec4bd19800 1 --2- 172.21.15.102:0/947504174 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55ed49dcec30 0x55ed49dd10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.786+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed49dd1840 con 0x55ed49dcec30 2024-09-13T19:18:02.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.786+0000 7fec4900c640 1 --2- 172.21.15.102:0/947504174 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55ed49dcec30 0x55ed49dd10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.786+0000 7fec4900c640 1 --2- 172.21.15.102:0/947504174 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55ed49dcec30 0x55ed49dd10f0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.786+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec40057030 con 0x55ed49dcec30 2024-09-13T19:18:02.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.786+0000 7fec4bd19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:02.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.786+0000 7fec4bd19800 20 realm 2024-09-13T19:18:02.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.786+0000 7fec4bd19800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.786+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed49dd1c70 con 0x55ed49dcec30 2024-09-13T19:18:02.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.786+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec40057030 con 0x55ed49dcec30 2024-09-13T19:18:02.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.787+0000 7fec4bd19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:02.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.787+0000 7fec4bd19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:18:02.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.787+0000 7fec4bd19800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.787+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed49dd2540 con 0x55ed49dcec30 2024-09-13T19:18:02.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.787+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec40057030 con 0x55ed49dcec30 2024-09-13T19:18:02.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.787+0000 7fec4bd19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:02.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.787+0000 7fec4bd19800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.787+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed49dd28e0 con 0x55ed49dcec30 2024-09-13T19:18:02.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.787+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fec40057030 con 0x55ed49dcec30 2024-09-13T19:18:02.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.787+0000 7fec4bd19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:18:02.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.787+0000 7fec4bd19800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.787+0000 7fec4bd19800 1 --2- 172.21.15.102:0/947504174 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55ed49dd3640 0x55ed49dd5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.787+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed49dd6040 con 0x55ed49dd3640 2024-09-13T19:18:02.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.787+0000 7fec4a00e640 1 --2- 172.21.15.102:0/947504174 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55ed49dd3640 0x55ed49dd5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.787+0000 7fec4a00e640 1 --2- 172.21.15.102:0/947504174 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55ed49dd3640 0x55ed49dd5a30 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.788+0000 7fec4a00e640 1 -- 172.21.15.102:0/947504174 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fec44055070 con 0x55ed49dd3640 2024-09-13T19:18:02.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.788+0000 7fec4bd19800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:18:02.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.788+0000 7fec4bd19800 20 searching for the correct realm 2024-09-13T19:18:02.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.788+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed49dd7930 con 0x55ed49dd3640 2024-09-13T19:18:02.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.788+0000 7fec4a00e640 1 -- 172.21.15.102:0/947504174 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec44055070 con 0x55ed49dd3640 2024-09-13T19:18:02.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.788+0000 7fec4a00e640 1 --2- 172.21.15.102:0/947504174 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fec4404ec20 0x7fec440230c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.788+0000 7fec4a00e640 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed49dd7930 con 0x7fec4404ec20 2024-09-13T19:18:02.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.788+0000 7fec4980d640 1 --2- 172.21.15.102:0/947504174 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fec4404ec20 0x7fec440230c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.788+0000 7fec4980d640 1 --2- 172.21.15.102:0/947504174 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fec4404ec20 0x7fec440230c0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.789+0000 7fec4980d640 1 -- 172.21.15.102:0/947504174 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec3c03a040 con 0x7fec4404ec20 2024-09-13T19:18:02.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.789+0000 7fec4980d640 1 --2- 172.21.15.102:0/947504174 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fec3c04b820 0x7fec3c01c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.789+0000 7fec4980d640 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed49dd7930 con 0x7fec3c04b820 2024-09-13T19:18:02.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.789+0000 7fec4900c640 1 --2- 172.21.15.102:0/947504174 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fec3c04b820 0x7fec3c01c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.789+0000 7fec4900c640 1 --2- 172.21.15.102:0/947504174 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fec3c04b820 0x7fec3c01c5e0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.790+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec40057030 con 0x7fec3c04b820 2024-09-13T19:18:02.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.790+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed49dd7930 con 0x55ed49dcec30 2024-09-13T19:18:02.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.790+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec40057030 con 0x55ed49dcec30 2024-09-13T19:18:02.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.790+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed49dd7930 con 0x55ed49dcec30 2024-09-13T19:18:02.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.790+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec40057030 con 0x55ed49dcec30 2024-09-13T19:18:02.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.790+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed49dd7930 con 0x7fec3c04b820 2024-09-13T19:18:02.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.790+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec40057030 con 0x7fec3c04b820 2024-09-13T19:18:02.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.790+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed49dd7930 con 0x7fec3c04b820 2024-09-13T19:18:02.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.791+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec40057030 con 0x7fec3c04b820 2024-09-13T19:18:02.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.791+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed49dd7930 con 0x7fec4404ec20 2024-09-13T19:18:02.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.791+0000 7fec4980d640 1 -- 172.21.15.102:0/947504174 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec3c03a040 con 0x7fec4404ec20 2024-09-13T19:18:02.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.791+0000 7fec4980d640 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed49dd7930 con 0x55ed49dd3640 2024-09-13T19:18:02.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.791+0000 7fec4a00e640 1 -- 172.21.15.102:0/947504174 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec44055070 con 0x55ed49dd3640 2024-09-13T19:18:02.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.791+0000 7fec4a00e640 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed49dd7930 con 0x55ed49dcec30 2024-09-13T19:18:02.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.791+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec40057030 con 0x55ed49dcec30 2024-09-13T19:18:02.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.791+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed49dd7930 con 0x7fec4404ec20 2024-09-13T19:18:02.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.792+0000 7fec4980d640 1 -- 172.21.15.102:0/947504174 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec3c03a040 con 0x7fec4404ec20 2024-09-13T19:18:02.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.792+0000 7fec4980d640 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed49dd7930 con 0x55ed49dcec30 2024-09-13T19:18:02.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.792+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec40057030 con 0x55ed49dcec30 2024-09-13T19:18:02.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.792+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed49dd7930 con 0x7fec4404ec20 2024-09-13T19:18:02.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.792+0000 7fec4980d640 1 -- 172.21.15.102:0/947504174 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fec3c03a040 con 0x7fec4404ec20 2024-09-13T19:18:02.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.792+0000 7fec4980d640 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fec3c05a060 con 0x55ed49dd3640 2024-09-13T19:18:02.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.792+0000 7fec4a00e640 1 -- 172.21.15.102:0/947504174 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec44055070 con 0x55ed49dd3640 2024-09-13T19:18:02.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.792+0000 7fec4a00e640 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fec3c05a060 con 0x55ed49dd3640 2024-09-13T19:18:02.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.793+0000 7fec4a00e640 1 -- 172.21.15.102:0/947504174 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fec44055070 con 0x55ed49dd3640 2024-09-13T19:18:02.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.793+0000 7fec4a00e640 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fec3c05a060 con 0x7fec3c04b820 2024-09-13T19:18:02.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.793+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec40057030 con 0x7fec3c04b820 2024-09-13T19:18:02.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.793+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fec3c05a060 con 0x55ed49dd3640 2024-09-13T19:18:02.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.793+0000 7fec4a00e640 1 -- 172.21.15.102:0/947504174 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fec44055070 con 0x55ed49dd3640 2024-09-13T19:18:02.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.793+0000 7fec4a00e640 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fec3c05a060 con 0x55ed49dd3640 2024-09-13T19:18:02.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.793+0000 7fec4a00e640 1 -- 172.21.15.102:0/947504174 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec44055070 con 0x55ed49dd3640 2024-09-13T19:18:02.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.793+0000 7fec4a00e640 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fec3c05a060 con 0x55ed49dcec30 2024-09-13T19:18:02.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.794+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec40057030 con 0x55ed49dcec30 2024-09-13T19:18:02.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.794+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fec3c05a060 con 0x55ed49dcec30 2024-09-13T19:18:02.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.794+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fec40057030 con 0x55ed49dcec30 2024-09-13T19:18:02.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.794+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fec3c05a060 con 0x7fec3c04b820 2024-09-13T19:18:02.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.794+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec40057030 con 0x7fec3c04b820 2024-09-13T19:18:02.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.794+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fec3c05a060 con 0x55ed49dd3640 2024-09-13T19:18:02.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.794+0000 7fec4a00e640 1 -- 172.21.15.102:0/947504174 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec44055070 con 0x55ed49dd3640 2024-09-13T19:18:02.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.794+0000 7fec4a00e640 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fec3c05a060 con 0x7fec4404ec20 2024-09-13T19:18:02.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.795+0000 7fec4980d640 1 -- 172.21.15.102:0/947504174 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec3c03a040 con 0x7fec4404ec20 2024-09-13T19:18:02.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.795+0000 7fec4980d640 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fec3c05a060 con 0x55ed49dcec30 2024-09-13T19:18:02.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.795+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec40057030 con 0x55ed49dcec30 2024-09-13T19:18:02.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.795+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fec3c05a060 con 0x7fec4404ec20 2024-09-13T19:18:02.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.795+0000 7fec4980d640 1 -- 172.21.15.102:0/947504174 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec3c03a040 con 0x7fec4404ec20 2024-09-13T19:18:02.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.795+0000 7fec4980d640 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fec3c05a060 con 0x55ed49dd3640 2024-09-13T19:18:02.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.795+0000 7fec4a00e640 1 -- 172.21.15.102:0/947504174 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec44055070 con 0x55ed49dd3640 2024-09-13T19:18:02.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.795+0000 7fec4a00e640 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fec3c05a060 con 0x7fec3c04b820 2024-09-13T19:18:02.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.796+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec40057030 con 0x7fec3c04b820 2024-09-13T19:18:02.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.796+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fec3c05a060 con 0x7fec4404ec20 2024-09-13T19:18:02.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.796+0000 7fec4980d640 1 -- 172.21.15.102:0/947504174 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec3c03a040 con 0x7fec4404ec20 2024-09-13T19:18:02.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.796+0000 7fec4980d640 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fec3c05a060 con 0x55ed49dd3640 2024-09-13T19:18:02.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.796+0000 7fec4a00e640 1 -- 172.21.15.102:0/947504174 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec44055070 con 0x55ed49dd3640 2024-09-13T19:18:02.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.796+0000 7fec4a00e640 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fec3c05a060 con 0x7fec3c04b820 2024-09-13T19:18:02.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.796+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec40057030 con 0x7fec3c04b820 2024-09-13T19:18:02.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.796+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fec3c05a060 con 0x55ed49dcec30 2024-09-13T19:18:02.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.797+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v36'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fec40057030 con 0x55ed49dcec30 2024-09-13T19:18:02.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.797+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fec3c05a060 con 0x7fec4404ec20 2024-09-13T19:18:02.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.797+0000 7fec4980d640 1 -- 172.21.15.102:0/947504174 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec3c03a040 con 0x7fec4404ec20 2024-09-13T19:18:02.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.797+0000 7fec4bd19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:18:02.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.797+0000 7fec4bd19800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:18:02.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.797+0000 7fec4bd19800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:18:02.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.797+0000 7fec4bd19800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:18:02.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.797+0000 7fec4bd19800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:18:02.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.797+0000 7fec4bd19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:18:02.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.797+0000 7fec4bd19800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.797+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed49dd7550 con 0x55ed49dcec30 2024-09-13T19:18:02.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.797+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec40057030 con 0x55ed49dcec30 2024-09-13T19:18:02.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.797+0000 7fec4bd19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:02.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.797+0000 7fec4bd19800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.797+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed49dd6d90 con 0x55ed49dcec30 2024-09-13T19:18:02.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.797+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fec4007e040 con 0x55ed49dcec30 2024-09-13T19:18:02.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.797+0000 7fec4bd19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:18:02.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.797+0000 7fec4bd19800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.797+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed49dd7db0 con 0x55ed49dd3640 2024-09-13T19:18:02.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.798+0000 7fec4a00e640 1 -- 172.21.15.102:0/947504174 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fec44055070 con 0x55ed49dd3640 2024-09-13T19:18:02.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.798+0000 7fec4bd19800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:18:02.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.798+0000 7fec4bd19800 20 zone default found 2024-09-13T19:18:02.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.798+0000 7fec4bd19800 4 Realm: () 2024-09-13T19:18:02.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.798+0000 7fec4bd19800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:18:02.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.798+0000 7fec4bd19800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:18:02.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.798+0000 7fec4bd19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:18:02.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.798+0000 7fec4bd19800 20 zonegroup default 2024-09-13T19:18:02.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.798+0000 7fec4bd19800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.798+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed49dd8600 con 0x7fec4404ec20 2024-09-13T19:18:02.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.798+0000 7fec4980d640 1 -- 172.21.15.102:0/947504174 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fec3c03a040 con 0x7fec4404ec20 2024-09-13T19:18:02.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.798+0000 7fec4bd19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:02.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.798+0000 7fec4bd19800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.798+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed49dda380 con 0x55ed49dd3640 2024-09-13T19:18:02.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.798+0000 7fec4a00e640 1 -- 172.21.15.102:0/947504174 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fec44055070 con 0x55ed49dd3640 2024-09-13T19:18:02.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.798+0000 7fec4bd19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:02.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.798+0000 7fec4bd19800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.798+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed49dda810 con 0x55ed49dd3640 2024-09-13T19:18:02.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.798+0000 7fec4a00e640 1 -- 172.21.15.102:0/947504174 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fec44055070 con 0x55ed49dd3640 2024-09-13T19:18:02.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.798+0000 7fec4bd19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:02.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.798+0000 7fec4bd19800 20 started sync module instance, tier type = 2024-09-13T19:18:02.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.798+0000 7fec4bd19800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:18:02.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.799+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49dd9820 con 0x7fec4404ec20 2024-09-13T19:18:02.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.800+0000 7fec4980d640 1 -- 172.21.15.102:0/947504174 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(44 notify.0 [create] v36'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec3c03a040 con 0x7fec4404ec20 2024-09-13T19:18:02.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.800+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94477634870288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49ddb100 con 0x7fec4404ec20 2024-09-13T19:18:02.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.800+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49ddb950 con 0x55ed49dcec30 2024-09-13T19:18:02.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.801+0000 7fec4980d640 1 -- 172.21.15.102:0/947504174 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94477634870288] v36'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec3c03a040 con 0x7fec4404ec20 2024-09-13T19:18:02.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.801+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v36'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec4007e040 con 0x55ed49dcec30 2024-09-13T19:18:02.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.801+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94477634876576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49ddbd30 con 0x55ed49dcec30 2024-09-13T19:18:02.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.801+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49ddc830 con 0x55ed49dd3640 2024-09-13T19:18:02.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.802+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94477634876576] v36'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec4007e040 con 0x55ed49dcec30 2024-09-13T19:18:02.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.802+0000 7fec4a00e640 1 -- 172.21.15.102:0/947504174 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v36'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec44055070 con 0x55ed49dd3640 2024-09-13T19:18:02.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.802+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94477634880288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49ddc7f0 con 0x55ed49dd3640 2024-09-13T19:18:02.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.802+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49ddd2e0 con 0x7fec4404ec20 2024-09-13T19:18:02.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.803+0000 7fec4980d640 1 -- 172.21.15.102:0/947504174 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(50 notify.3 [create] v36'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec3c03a040 con 0x7fec4404ec20 2024-09-13T19:18:02.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.803+0000 7fec4a00e640 1 -- 172.21.15.102:0/947504174 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94477634880288] v36'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec44055070 con 0x55ed49dd3640 2024-09-13T19:18:02.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.803+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94477634883008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49ddd2e0 con 0x7fec4404ec20 2024-09-13T19:18:02.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.803+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49ddac90 con 0x55ed49dcec30 2024-09-13T19:18:02.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.804+0000 7fec4980d640 1 -- 172.21.15.102:0/947504174 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94477634883008] v36'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec3c03a040 con 0x7fec4404ec20 2024-09-13T19:18:02.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.804+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v36'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec4007e040 con 0x55ed49dcec30 2024-09-13T19:18:02.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.804+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94477634885328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49ddd2e0 con 0x55ed49dcec30 2024-09-13T19:18:02.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.804+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49dde870 con 0x7fec3c04b820 2024-09-13T19:18:02.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.806+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(54 notify.5 [create] v36'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec4007e040 con 0x7fec3c04b820 2024-09-13T19:18:02.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.806+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94477634885328] v36'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec4007e040 con 0x55ed49dcec30 2024-09-13T19:18:02.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.806+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94477634888640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49ddecd0 con 0x7fec3c04b820 2024-09-13T19:18:02.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.806+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49dddda0 con 0x7fec3c04b820 2024-09-13T19:18:02.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.807+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94477634888640] v36'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec4007e040 con 0x7fec3c04b820 2024-09-13T19:18:02.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.807+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(56 notify.6 [create] v36'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec4007e040 con 0x7fec3c04b820 2024-09-13T19:18:02.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.807+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94477634887072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49ddf2c0 con 0x7fec3c04b820 2024-09-13T19:18:02.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.807+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49ddfc80 con 0x7fec3c04b820 2024-09-13T19:18:02.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.808+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94477634887072] v36'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec4007e040 con 0x7fec3c04b820 2024-09-13T19:18:02.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.808+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(58 notify.7 [create] v36'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec4007e040 con 0x7fec3c04b820 2024-09-13T19:18:02.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.808+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94477634889696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49ddfc80 con 0x7fec3c04b820 2024-09-13T19:18:02.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.808+0000 7fec4bd19800 20 add_watcher() i=0 2024-09-13T19:18:02.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.808+0000 7fec4bd19800 20 add_watcher() i=1 2024-09-13T19:18:02.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.808+0000 7fec4bd19800 20 add_watcher() i=2 2024-09-13T19:18:02.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.808+0000 7fec4bd19800 20 add_watcher() i=3 2024-09-13T19:18:02.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.808+0000 7fec4bd19800 20 add_watcher() i=4 2024-09-13T19:18:02.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.808+0000 7fec4bd19800 20 add_watcher() i=5 2024-09-13T19:18:02.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.808+0000 7fec4bd19800 20 add_watcher() i=6 2024-09-13T19:18:02.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.809+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94477634889696] v36'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec4007e040 con 0x7fec3c04b820 2024-09-13T19:18:02.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.809+0000 7fec4bd19800 20 add_watcher() i=7 2024-09-13T19:18:02.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.809+0000 7fec4bd19800 2 all 8 watchers are set, enabling cache 2024-09-13T19:18:02.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.809+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed49de30b0 con 0x55ed49dcec30 2024-09-13T19:18:02.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.809+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fec4007e040 con 0x55ed49dcec30 2024-09-13T19:18:02.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.809+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94477634894240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49de05d0 con 0x55ed49dcec30 2024-09-13T19:18:02.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.810+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94477634894240] v36'245 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fec4007e040 con 0x55ed49dcec30 2024-09-13T19:18:02.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.810+0000 7feafb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:18:02.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.810+0000 7fec4bd19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:18:02.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.810+0000 7fec4bd19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:18:02.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.811+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49de2ec0 con 0x55ed49dcec30 2024-09-13T19:18:02.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.812+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v36'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fec4007e040 con 0x55ed49dcec30 2024-09-13T19:18:02.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.812+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49dec200 con 0x7fec3c04b820 2024-09-13T19:18:02.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.813+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v36'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fec4007e040 con 0x7fec3c04b820 2024-09-13T19:18:02.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.813+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49dec770 con 0x55ed49dd3640 2024-09-13T19:18:02.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.814+0000 7fec4a00e640 1 -- 172.21.15.102:0/947504174 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v36'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fec44055070 con 0x55ed49dd3640 2024-09-13T19:18:02.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.814+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49dec800 con 0x55ed49dcec30 2024-09-13T19:18:02.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.815+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v36'246 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fec4007e040 con 0x55ed49dcec30 2024-09-13T19:18:02.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.815+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49deccb0 con 0x7fec4404ec20 2024-09-13T19:18:02.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.816+0000 7fec4980d640 1 -- 172.21.15.102:0/947504174 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v36'79 uv55 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fec3c03a040 con 0x7fec4404ec20 2024-09-13T19:18:02.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.816+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49ded220 con 0x55ed49dd3640 2024-09-13T19:18:02.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.817+0000 7fec4a00e640 1 -- 172.21.15.102:0/947504174 <== osd.3 v2:172.21.15.102:6800/3096737090 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v36'52 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fec44055070 con 0x55ed49dd3640 2024-09-13T19:18:02.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.817+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49ded220 con 0x55ed49dcec30 2024-09-13T19:18:02.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.818+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v36'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fec4007e040 con 0x55ed49dcec30 2024-09-13T19:18:02.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.818+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49ded220 con 0x7fec3c04b820 2024-09-13T19:18:02.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.820+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(69 gc.7 [create,call,call,call] v36'51 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fec4007e040 con 0x7fec3c04b820 2024-09-13T19:18:02.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.820+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49ded2b0 con 0x7fec4404ec20 2024-09-13T19:18:02.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.821+0000 7fec4980d640 1 -- 172.21.15.102:0/947504174 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v36'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fec3c03a040 con 0x7fec4404ec20 2024-09-13T19:18:02.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.821+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49ded760 con 0x55ed49dd3640 2024-09-13T19:18:02.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.822+0000 7fec4a00e640 1 -- 172.21.15.102:0/947504174 <== osd.3 v2:172.21.15.102:6800/3096737090 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v36'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fec44055070 con 0x55ed49dd3640 2024-09-13T19:18:02.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.822+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49ded760 con 0x7fec4404ec20 2024-09-13T19:18:02.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.823+0000 7fec4980d640 1 -- 172.21.15.102:0/947504174 <== osd.2 v2:172.21.15.102:6816/2238176080 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v36'80 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fec3c03a040 con 0x7fec4404ec20 2024-09-13T19:18:02.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.823+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49ded760 con 0x7fec3c04b820 2024-09-13T19:18:02.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.824+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v36'36 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fec4007e040 con 0x7fec3c04b820 2024-09-13T19:18:02.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.824+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49ded760 con 0x7fec4404ec20 2024-09-13T19:18:02.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.825+0000 7fec4980d640 1 -- 172.21.15.102:0/947504174 <== osd.2 v2:172.21.15.102:6816/2238176080 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v36'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fec3c03a040 con 0x7fec4404ec20 2024-09-13T19:18:02.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.825+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49ded760 con 0x7fec3c04b820 2024-09-13T19:18:02.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.826+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(75 gc.13 [create,call,call,call] v36'57 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fec4007e040 con 0x7fec3c04b820 2024-09-13T19:18:02.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.826+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49ded760 con 0x55ed49dcec30 2024-09-13T19:18:02.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.827+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v36'247 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fec4007e040 con 0x55ed49dcec30 2024-09-13T19:18:02.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.827+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49ded760 con 0x55ed49dd3640 2024-09-13T19:18:02.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.828+0000 7fec4a00e640 1 -- 172.21.15.102:0/947504174 <== osd.3 v2:172.21.15.102:6800/3096737090 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v36'71 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fec44055070 con 0x55ed49dd3640 2024-09-13T19:18:02.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.828+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49ded760 con 0x7fec4404ec20 2024-09-13T19:18:02.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.829+0000 7fec4980d640 1 -- 172.21.15.102:0/947504174 <== osd.2 v2:172.21.15.102:6816/2238176080 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v36'81 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fec3c03a040 con 0x7fec4404ec20 2024-09-13T19:18:02.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.829+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49ded760 con 0x55ed49dd3640 2024-09-13T19:18:02.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.830+0000 7fec4a00e640 1 -- 172.21.15.102:0/947504174 <== osd.3 v2:172.21.15.102:6800/3096737090 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v36'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fec44055070 con 0x55ed49dd3640 2024-09-13T19:18:02.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.830+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49ded760 con 0x55ed49dcec30 2024-09-13T19:18:02.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.831+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v36'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fec4007e040 con 0x55ed49dcec30 2024-09-13T19:18:02.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.831+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49ded760 con 0x55ed49dcec30 2024-09-13T19:18:02.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.832+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v36'248 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fec4007e040 con 0x55ed49dcec30 2024-09-13T19:18:02.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.832+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49ded760 con 0x55ed49dd3640 2024-09-13T19:18:02.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.833+0000 7fec4a00e640 1 -- 172.21.15.102:0/947504174 <== osd.3 v2:172.21.15.102:6800/3096737090 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v36'72 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fec44055070 con 0x55ed49dd3640 2024-09-13T19:18:02.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.833+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49ded760 con 0x7fec4404ec20 2024-09-13T19:18:02.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.834+0000 7fec4980d640 1 -- 172.21.15.102:0/947504174 <== osd.2 v2:172.21.15.102:6816/2238176080 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v36'39 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fec3c03a040 con 0x7fec4404ec20 2024-09-13T19:18:02.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.834+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49ded760 con 0x55ed49dd3640 2024-09-13T19:18:02.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.835+0000 7fec4a00e640 1 -- 172.21.15.102:0/947504174 <== osd.3 v2:172.21.15.102:6800/3096737090 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v36'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fec44055070 con 0x55ed49dd3640 2024-09-13T19:18:02.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.835+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49ded760 con 0x55ed49dd3640 2024-09-13T19:18:02.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.836+0000 7fec4a00e640 1 -- 172.21.15.102:0/947504174 <== osd.3 v2:172.21.15.102:6800/3096737090 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v36'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fec44055070 con 0x55ed49dd3640 2024-09-13T19:18:02.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.836+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49ded760 con 0x55ed49dd3640 2024-09-13T19:18:02.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.837+0000 7fec4a00e640 1 -- 172.21.15.102:0/947504174 <== osd.3 v2:172.21.15.102:6800/3096737090 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v36'25 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fec44055070 con 0x55ed49dd3640 2024-09-13T19:18:02.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.837+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49ded760 con 0x55ed49dd3640 2024-09-13T19:18:02.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.838+0000 7fec4a00e640 1 -- 172.21.15.102:0/947504174 <== osd.3 v2:172.21.15.102:6800/3096737090 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v36'53 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fec44055070 con 0x55ed49dd3640 2024-09-13T19:18:02.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.838+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49ded760 con 0x7fec3c04b820 2024-09-13T19:18:02.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.839+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(88 gc.26 [create,call,call,call] v36'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fec4007e040 con 0x7fec3c04b820 2024-09-13T19:18:02.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.839+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49ded760 con 0x55ed49dd3640 2024-09-13T19:18:02.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.840+0000 7fec4a00e640 1 -- 172.21.15.102:0/947504174 <== osd.3 v2:172.21.15.102:6800/3096737090 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v36'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fec44055070 con 0x55ed49dd3640 2024-09-13T19:18:02.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.840+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49ded760 con 0x7fec3c04b820 2024-09-13T19:18:02.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.841+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(90 gc.28 [create,call,call,call] v36'52 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fec4007e040 con 0x7fec3c04b820 2024-09-13T19:18:02.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.841+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49ded760 con 0x55ed49dd3640 2024-09-13T19:18:02.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.842+0000 7fec4a00e640 1 -- 172.21.15.102:0/947504174 <== osd.3 v2:172.21.15.102:6800/3096737090 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v36'73 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fec44055070 con 0x55ed49dd3640 2024-09-13T19:18:02.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.843+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49ded760 con 0x7fec3c04b820 2024-09-13T19:18:02.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.844+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.0 v2:172.21.15.53:6800/4021716951 20 ==== osd_op_reply(92 gc.30 [create,call,call,call] v36'58 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fec4007e040 con 0x7fec3c04b820 2024-09-13T19:18:02.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.844+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49ded760 con 0x7fec4404ec20 2024-09-13T19:18:02.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.845+0000 7fec4980d640 1 -- 172.21.15.102:0/947504174 <== osd.2 v2:172.21.15.102:6816/2238176080 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v36'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fec3c03a040 con 0x7fec4404ec20 2024-09-13T19:18:02.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.845+0000 7feafa7fc640 20 reqs_thread_entry: start 2024-09-13T19:18:02.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.846+0000 7fec4bd19800 20 init_complete bucket index max shards: 11 2024-09-13T19:18:02.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.846+0000 7fec4bd19800 20 Filter name: none 2024-09-13T19:18:02.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.846+0000 7fea6bfff640 20 reqs_thread_entry: start 2024-09-13T19:18:02.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.846+0000 7fec4bd19800 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-13T19:18:02.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.846+0000 7fec4bd19800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.846+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:94 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed49e187c0 con 0x7fec3c04b820 2024-09-13T19:18:02.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.846+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.0 v2:172.21.15.53:6800/4021716951 21 ==== osd_op_reply(94 system_user [call out=48b,read 0~349 out=349b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 239+0+472 (crc 0 0 0) 0x7fec4007e040 con 0x7fec3c04b820 2024-09-13T19:18:02.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.846+0000 7fec4bd19800 20 rados_obj.operate() r=0 bl.length=349 2024-09-13T19:18:02.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.846+0000 7fec4bd19800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x13 2024-09-13T19:18:02.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.846+0000 7fec4bd19800 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-13T19:18:02.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.846+0000 7fec4bd19800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:18:02.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.846+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:95 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed49e18710 con 0x7fec3c04b820 2024-09-13T19:18:02.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.847+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.0 v2:172.21.15.53:6800/4021716951 22 ==== osd_op_reply(95 system_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7fec4007e040 con 0x7fec3c04b820 2024-09-13T19:18:02.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.847+0000 7fec4bd19800 10 removing key index: system_akey 2024-09-13T19:18:02.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.847+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:96 8.0 8:01223cbf:users.keys::system_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49e18710 con 0x55ed49dd3640 2024-09-13T19:18:02.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.847+0000 7fec4a00e640 1 -- 172.21.15.102:0/947504174 <== osd.3 v2:172.21.15.102:6800/3096737090 28 ==== osd_op_reply(96 system_akey [delete] v36'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fec44055070 con 0x55ed49dd3640 2024-09-13T19:18:02.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.848+0000 7fec4bd19800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-13T19:18:02.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.848+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [notify cookie 94477635127056 in=173b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed49e1b2e0 con 0x55ed49dcec30 2024-09-13T19:18:02.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.848+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== watch-notify(notify (1) cookie 94477634876576 notify 154618822695 ret 0) ==== 203+0+0 (crc 0 0 0) 0x55ed49dec200 con 0x55ed49dcec30 2024-09-13T19:18:02.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.848+0000 7feb2d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822695 cookie 94477634876576 notifier 4860 bl.length()=161 2024-09-13T19:18:02.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.848+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.1 v2:172.21.15.102:6808/2204418452 28 ==== osd_op_reply(97 notify.1 [notify cookie 94477635127056 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fec4007e040 con 0x55ed49dcec30 2024-09-13T19:18:02.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.848+0000 7feb2d7fa640 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7feb0c003d60 con 0x55ed49dcec30 2024-09-13T19:18:02.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.848+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.1 v2:172.21.15.102:6808/2204418452 29 ==== osd_op_reply(98 notify.1 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec4007e040 con 0x55ed49dcec30 2024-09-13T19:18:02.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.848+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.1 v2:172.21.15.102:6808/2204418452 30 ==== watch-notify(notify_complete (2) cookie 94477635127056 notify 154618822695 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ed49dec3d0 con 0x55ed49dcec30 2024-09-13T19:18:02.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.848+0000 7fec4bd19800 10 removing email index: 2024-09-13T19:18:02.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.848+0000 7fec4bd19800 10 removing user buckets index 2024-09-13T19:18:02.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.848+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:99 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49e1b260 con 0x7fec3c04b820 2024-09-13T19:18:02.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.850+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.0 v2:172.21.15.53:6800/4021716951 23 ==== osd_op_reply(99 system_user.buckets [delete] v36'2 uv1 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7fec4007e040 con 0x7fec3c04b820 2024-09-13T19:18:02.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.850+0000 7fec4bd19800 10 removing user index: system_user 2024-09-13T19:18:02.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.850+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:100 8.1e 8:78ce4db0:users.uid::system_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49e1b220 con 0x7fec3c04b820 2024-09-13T19:18:02.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.851+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.0 v2:172.21.15.53:6800/4021716951 24 ==== osd_op_reply(100 system_user [call,call,delete] v36'3 uv3 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7fec4007e040 con 0x7fec3c04b820 2024-09-13T19:18:02.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.851+0000 7fec4bd19800 10 removing default.rgw.meta+users.uid+system_user from cache 2024-09-13T19:18:02.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.851+0000 7fec4bd19800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-13T19:18:02.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.851+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94477635136832 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed49e1b160 con 0x7fec4404ec20 2024-09-13T19:18:02.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.851+0000 7fec4980d640 1 -- 172.21.15.102:0/947504174 <== osd.2 v2:172.21.15.102:6816/2238176080 21 ==== watch-notify(notify (1) cookie 94477634870288 notify 154618822682 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55ed49dec800 con 0x7fec4404ec20 2024-09-13T19:18:02.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.851+0000 7feb2cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822682 cookie 94477634870288 notifier 4860 bl.length()=160 2024-09-13T19:18:02.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.851+0000 7fec4980d640 1 -- 172.21.15.102:0/947504174 <== osd.2 v2:172.21.15.102:6816/2238176080 22 ==== osd_op_reply(101 notify.0 [notify cookie 94477635136832 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fec3c03a040 con 0x7fec4404ec20 2024-09-13T19:18:02.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.851+0000 7feb2cff9640 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fea740032c0 con 0x7fec4404ec20 2024-09-13T19:18:02.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.851+0000 7fec4980d640 1 -- 172.21.15.102:0/947504174 <== osd.2 v2:172.21.15.102:6816/2238176080 23 ==== osd_op_reply(102 notify.0 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec3c03a040 con 0x7fec4404ec20 2024-09-13T19:18:02.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.851+0000 7fec4980d640 1 -- 172.21.15.102:0/947504174 <== osd.2 v2:172.21.15.102:6816/2238176080 24 ==== watch-notify(notify_complete (2) cookie 94477635136832 notify 154618822682 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ed49ded050 con 0x7fec4404ec20 2024-09-13T19:18:02.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.852+0000 7feafb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:18:02.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.852+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94477634894240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49deb200 con 0x55ed49dcec30 2024-09-13T19:18:02.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.853+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.1 v2:172.21.15.102:6808/2204418452 31 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94477634894240] v36'249 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fec4007e040 con 0x55ed49dcec30 2024-09-13T19:18:02.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.853+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94477634870288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49deb200 con 0x7fec4404ec20 2024-09-13T19:18:02.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.854+0000 7fec4980d640 1 -- 172.21.15.102:0/947504174 <== osd.2 v2:172.21.15.102:6816/2238176080 25 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94477634870288] v36'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec3c03a040 con 0x7fec4404ec20 2024-09-13T19:18:02.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.854+0000 7fec4bd19800 20 remove_watcher() i=0 2024-09-13T19:18:02.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.854+0000 7fec4bd19800 2 removed watcher, disabling cache 2024-09-13T19:18:02.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.854+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94477634876576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49dd9c10 con 0x55ed49dcec30 2024-09-13T19:18:02.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.855+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.1 v2:172.21.15.102:6808/2204418452 32 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94477634876576] v36'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec4007e040 con 0x55ed49dcec30 2024-09-13T19:18:02.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.855+0000 7fec4bd19800 20 remove_watcher() i=1 2024-09-13T19:18:02.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.855+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94477634880288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49e1b100 con 0x55ed49dd3640 2024-09-13T19:18:02.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.856+0000 7fec4a00e640 1 -- 172.21.15.102:0/947504174 <== osd.3 v2:172.21.15.102:6800/3096737090 29 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94477634880288] v36'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec44055070 con 0x55ed49dd3640 2024-09-13T19:18:02.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.856+0000 7fec4bd19800 20 remove_watcher() i=2 2024-09-13T19:18:02.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.856+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94477634883008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49ddc320 con 0x7fec4404ec20 2024-09-13T19:18:02.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.857+0000 7fec4980d640 1 -- 172.21.15.102:0/947504174 <== osd.2 v2:172.21.15.102:6816/2238176080 26 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94477634883008] v36'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec3c03a040 con 0x7fec4404ec20 2024-09-13T19:18:02.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.857+0000 7fec4bd19800 20 remove_watcher() i=3 2024-09-13T19:18:02.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.857+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94477634885328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49ddcdc0 con 0x55ed49dcec30 2024-09-13T19:18:02.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.859+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.1 v2:172.21.15.102:6808/2204418452 33 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94477634885328] v36'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec4007e040 con 0x55ed49dcec30 2024-09-13T19:18:02.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.859+0000 7fec4bd19800 20 remove_watcher() i=4 2024-09-13T19:18:02.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.859+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94477634888640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49ddc320 con 0x7fec3c04b820 2024-09-13T19:18:02.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.860+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.0 v2:172.21.15.53:6800/4021716951 25 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94477634888640] v36'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec4007e040 con 0x7fec3c04b820 2024-09-13T19:18:02.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.860+0000 7fec4bd19800 20 remove_watcher() i=5 2024-09-13T19:18:02.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.860+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94477634887072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49ddd6d0 con 0x7fec3c04b820 2024-09-13T19:18:02.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.861+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.0 v2:172.21.15.53:6800/4021716951 26 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94477634887072] v36'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec4007e040 con 0x7fec3c04b820 2024-09-13T19:18:02.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.861+0000 7fec4bd19800 20 remove_watcher() i=6 2024-09-13T19:18:02.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.861+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94477634889696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed49ddcdc0 con 0x7fec3c04b820 2024-09-13T19:18:02.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.862+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 <== osd.0 v2:172.21.15.53:6800/4021716951 27 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94477634889696] v36'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec4007e040 con 0x7fec3c04b820 2024-09-13T19:18:02.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.862+0000 7fec4bd19800 20 remove_watcher() i=7 2024-09-13T19:18:02.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.862+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fec3c04b820 msgr2=0x7fec3c01c5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.862+0000 7fec4bd19800 1 --2- 172.21.15.102:0/947504174 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fec3c04b820 0x7fec3c01c5e0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.862+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55ed49dcec30 msgr2=0x55ed49dd10f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.862+0000 7fec4bd19800 1 --2- 172.21.15.102:0/947504174 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55ed49dcec30 0x55ed49dd10f0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.862+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fec4404ec20 msgr2=0x7fec440230c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.862+0000 7fec4bd19800 1 --2- 172.21.15.102:0/947504174 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fec4404ec20 0x7fec440230c0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.862+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55ed49dd3640 msgr2=0x55ed49dd5a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.862+0000 7fec4bd19800 1 --2- 172.21.15.102:0/947504174 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55ed49dd3640 0x55ed49dd5a30 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.862+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7feb14036b40 msgr2=0x7feb14039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.862+0000 7fec4bd19800 1 --2- 172.21.15.102:0/947504174 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7feb14036b40 0x7feb14039000 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fec3c04b7a0 tx=0x7fec3c034000 comp rx=0 tx=0).stop 2024-09-13T19:18:02.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.862+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed49dbbcb0 msgr2=0x55ed49dc3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.862+0000 7fec4900c640 1 -- 172.21.15.102:0/947504174 reap_dead start 2024-09-13T19:18:02.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.862+0000 7fec4bd19800 1 --2- 172.21.15.102:0/947504174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed49dbbcb0 0x55ed49dc3180 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fec44012fd0 tx=0x7fec4404cd10 comp rx=0 tx=0).stop 2024-09-13T19:18:02.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.862+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 shutdown_connections 2024-09-13T19:18:02.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.862+0000 7fec4bd19800 1 --2- 172.21.15.102:0/947504174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed49dbbcb0 0x55ed49dc3180 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.862+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 >> 172.21.15.102:0/947504174 conn(0x55ed49db8010 msgr2=0x55ed49db60e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:02.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.862+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 shutdown_connections 2024-09-13T19:18:02.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.862+0000 7fec4bd19800 1 -- 172.21.15.102:0/947504174 wait complete. 2024-09-13T19:18:02.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.863+0000 7fec4bd19800 1 -- 172.21.15.102:0/2637676886 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7feb24036b40 msgr2=0x7feb24039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.863+0000 7fec4bd19800 1 --2- 172.21.15.102:0/2637676886 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7feb24036b40 0x7feb24039000 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x55ed49d965e0 tx=0x7fec3c04b670 comp rx=0 tx=0).stop 2024-09-13T19:18:02.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.863+0000 7fec4bd19800 1 -- 172.21.15.102:0/2637676886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed49d8ad40 msgr2=0x55ed49d89390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.863+0000 7fec4bd19800 1 --2- 172.21.15.102:0/2637676886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed49d8ad40 0x55ed49d89390 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x55ed49d93130 tx=0x7fec440167b0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.863+0000 7fec4bd19800 1 -- 172.21.15.102:0/2637676886 shutdown_connections 2024-09-13T19:18:02.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.863+0000 7fec4bd19800 1 --2- 172.21.15.102:0/2637676886 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7feb24036b40 0x7feb24039000 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.863+0000 7fec4bd19800 1 --2- 172.21.15.102:0/2637676886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed49d8ad40 0x55ed49d89390 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.863+0000 7fec4bd19800 1 -- 172.21.15.102:0/2637676886 >> 172.21.15.102:0/2637676886 conn(0x55ed49da1cf0 msgr2=0x55ed49da4870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:02.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.863+0000 7fec4bd19800 1 -- 172.21.15.102:0/2637676886 shutdown_connections 2024-09-13T19:18:02.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.863+0000 7fec4bd19800 1 -- 172.21.15.102:0/2637676886 wait complete. 2024-09-13T19:18:02.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.863+0000 7fec4bd19800 1 -- 172.21.15.102:0/2881226971 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55ed49c9e900 msgr2=0x55ed49d990f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.863+0000 7fec4bd19800 1 --2- 172.21.15.102:0/2881226971 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55ed49c9e900 0x55ed49d990f0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.863+0000 7fec4bd19800 1 -- 172.21.15.102:0/2881226971 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55ed49d9b920 msgr2=0x55ed49d9dd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.863+0000 7fec4bd19800 1 --2- 172.21.15.102:0/2881226971 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55ed49d9b920 0x55ed49d9dd10 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.863+0000 7fec4bd19800 1 -- 172.21.15.102:0/2881226971 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7feb30036b90 msgr2=0x7feb30039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.863+0000 7fec4bd19800 1 --2- 172.21.15.102:0/2881226971 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7feb30036b90 0x7feb30039050 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fec40057000 tx=0x7fec40052000 comp rx=0 tx=0).stop 2024-09-13T19:18:02.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.863+0000 7fec4bd19800 1 -- 172.21.15.102:0/2881226971 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed49c9a4c0 msgr2=0x55ed49d92080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.863+0000 7fec4bd19800 1 --2- 172.21.15.102:0/2881226971 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed49c9a4c0 0x55ed49d92080 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fec3c000f60 tx=0x7fec3c000ed0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.863+0000 7fec4bd19800 1 -- 172.21.15.102:0/2881226971 shutdown_connections 2024-09-13T19:18:02.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.863+0000 7fec4bd19800 1 --2- 172.21.15.102:0/2881226971 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55ed49d9b920 0x55ed49d9dd10 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.863+0000 7fec4bd19800 1 --2- 172.21.15.102:0/2881226971 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55ed49c9e900 0x55ed49d990f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.863+0000 7fec4bd19800 1 --2- 172.21.15.102:0/2881226971 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7feb30036b90 0x7feb30039050 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.863+0000 7fec4bd19800 1 --2- 172.21.15.102:0/2881226971 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ed49c9a4c0 0x55ed49d92080 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.863+0000 7fec4bd19800 1 -- 172.21.15.102:0/2881226971 >> 172.21.15.102:0/2881226971 conn(0x55ed49c95df0 msgr2=0x55ed49d83870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:02.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.863+0000 7fec4bd19800 1 -- 172.21.15.102:0/2881226971 shutdown_connections 2024-09-13T19:18:02.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.863+0000 7fec4bd19800 1 -- 172.21.15.102:0/2881226971 wait complete. 2024-09-13T19:18:02.875 ERROR:root:None 2024-09-13T19:18:02.875 ERROR:root:0 2024-09-13T19:18:02.875 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-13T19:18:02.875 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-13T19:18:02.875 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid a_user --display-name 'True Admin User' --access-key true_admin_akey --secret true_admin_skey --caps user-info-without-keys=read --admin 2024-09-13T19:18:02.928 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:18:02.928 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:18:02.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.926+0000 7fc7c2a0f800 1 Processor -- start 2024-09-13T19:18:02.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.926+0000 7fc7c2a0f800 1 -- start start 2024-09-13T19:18:02.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.926+0000 7fc7c2a0f800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x563373aad8b0 0x563373aafcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.926+0000 7fc7c2a0f800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563373968b30 con 0x563373a1cee0 2024-09-13T19:18:02.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.926+0000 7fc7c2a0f800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x56337394a360 con 0x563373aad8b0 2024-09-13T19:18:02.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.926+0000 7fc7bfd09640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x563373aad8b0 0x563373aafcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.926+0000 7fc7c050a640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x563373a1cee0 0x563373aac190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:53722/0 (socket says 172.21.15.102:53722) 2024-09-13T19:18:02.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.926+0000 7fc7c050a640 1 -- 172.21.15.102:0/2290752535 learned_addr learned my addr 172.21.15.102:0/2290752535 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:18:02.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.927+0000 7fc7bfd09640 1 -- 172.21.15.102:0/2290752535 >> v1:172.21.15.53:6789/0 conn(0x563373a1cee0 legacy=0x563373aac190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.927+0000 7fc7bf508640 1 -- 172.21.15.102:0/2290752535 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1426877369 0 0) 0x563373968b30 con 0x563373a1cee0 2024-09-13T19:18:02.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.927+0000 7fc7bfd09640 1 -- 172.21.15.102:0/2290752535 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563373970e00 con 0x563373aad8b0 2024-09-13T19:18:02.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.928+0000 7fc7bfd09640 1 --2- 172.21.15.102:0/2290752535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563373aad8b0 0x563373aafcc0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fc7a800a470 tx=0x7fc7a8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dd55be74db8c3c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.929+0000 7fc7bf508640 1 -- 172.21.15.102:0/2290752535 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7a8053570 con 0x563373aad8b0 2024-09-13T19:18:02.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.929+0000 7fc7bf508640 1 -- 172.21.15.102:0/2290752535 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7a8058070 con 0x563373aad8b0 2024-09-13T19:18:02.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.929+0000 7fc7bf508640 1 -- 172.21.15.102:0/2290752535 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7a8053880 con 0x563373aad8b0 2024-09-13T19:18:02.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.929+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/2290752535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563373aad8b0 msgr2=0x563373aafcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.929+0000 7fc7c2a0f800 1 --2- 172.21.15.102:0/2290752535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563373aad8b0 0x563373aafcc0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fc7a800a470 tx=0x7fc7a8045a20 comp rx=0 tx=0).stop 2024-09-13T19:18:02.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.929+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/2290752535 shutdown_connections 2024-09-13T19:18:02.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.929+0000 7fc7c2a0f800 1 --2- 172.21.15.102:0/2290752535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563373aad8b0 0x563373aafcc0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.929+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/2290752535 >> 172.21.15.102:0/2290752535 conn(0x563373aa3e00 msgr2=0x563373aa6220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:02.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.929+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/2290752535 shutdown_connections 2024-09-13T19:18:02.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.929+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/2290752535 wait complete. 2024-09-13T19:18:02.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.943+0000 7fc7c2a0f800 1 Processor -- start 2024-09-13T19:18:02.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.943+0000 7fc7c2a0f800 1 -- start start 2024-09-13T19:18:02.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.943+0000 7fc7c2a0f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563373a1cee0 0x563373aa9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.943+0000 7fc7c2a0f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5633739f5450 con 0x563373a1cee0 2024-09-13T19:18:02.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.943+0000 7fc7c050a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563373a1cee0 0x563373aa9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.943+0000 7fc7c050a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563373a1cee0 0x563373aa9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49790/0 (socket says 172.21.15.102:49790) 2024-09-13T19:18:02.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.943+0000 7fc7c050a640 1 -- 172.21.15.102:0/3649196675 learned_addr learned my addr 172.21.15.102:0/3649196675 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:02.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.944+0000 7fc7c050a640 1 -- 172.21.15.102:0/3649196675 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563373942bc0 con 0x563373a1cee0 2024-09-13T19:18:02.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.944+0000 7fc7c050a640 1 --2- 172.21.15.102:0/3649196675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563373a1cee0 0x563373aa9ac0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8001660 tx=0x7fc7b8001b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d39f133d92e1722 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.944+0000 7fc6ae60c640 1 -- 172.21.15.102:0/3649196675 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7b8003450 con 0x563373a1cee0 2024-09-13T19:18:02.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.944+0000 7fc6ae60c640 1 -- 172.21.15.102:0/3649196675 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7b8003610 con 0x563373a1cee0 2024-09-13T19:18:02.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.944+0000 7fc6ae60c640 1 -- 172.21.15.102:0/3649196675 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7b80039b0 con 0x563373a1cee0 2024-09-13T19:18:02.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.945+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3649196675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563373a1cee0 msgr2=0x563373aa9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.945+0000 7fc7c2a0f800 1 --2- 172.21.15.102:0/3649196675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563373a1cee0 0x563373aa9ac0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8001660 tx=0x7fc7b8001b20 comp rx=0 tx=0).stop 2024-09-13T19:18:02.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.945+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3649196675 shutdown_connections 2024-09-13T19:18:02.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.945+0000 7fc7c2a0f800 1 --2- 172.21.15.102:0/3649196675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563373a1cee0 0x563373aa9ac0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.945+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3649196675 >> 172.21.15.102:0/3649196675 conn(0x563373aa3e00 msgr2=0x563373b94110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:02.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.945+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3649196675 shutdown_connections 2024-09-13T19:18:02.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.945+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3649196675 wait complete. 2024-09-13T19:18:02.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.945+0000 7fc7c2a0f800 1 Processor -- start 2024-09-13T19:18:02.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.945+0000 7fc7c2a0f800 1 -- start start 2024-09-13T19:18:02.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.945+0000 7fc7c2a0f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563373a1cee0 0x563373ba2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.945+0000 7fc7c2a0f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563373ab0640 con 0x563373a1cee0 2024-09-13T19:18:02.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.946+0000 7fc7c050a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563373a1cee0 0x563373ba2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.946+0000 7fc7c050a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563373a1cee0 0x563373ba2310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49804/0 (socket says 172.21.15.102:49804) 2024-09-13T19:18:02.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.946+0000 7fc7c050a640 1 -- 172.21.15.102:0/2313230098 learned_addr learned my addr 172.21.15.102:0/2313230098 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:02.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.946+0000 7fc7c050a640 1 -- 172.21.15.102:0/2313230098 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563373956fe0 con 0x563373a1cee0 2024-09-13T19:18:02.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.946+0000 7fc7c050a640 1 --2- 172.21.15.102:0/2313230098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563373a1cee0 0x563373ba2310 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x563373aa91c0 tx=0x7fc7b8001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.947+0000 7fc6ace09640 1 -- 172.21.15.102:0/2313230098 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7b8025070 con 0x563373a1cee0 2024-09-13T19:18:02.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.947+0000 7fc6ace09640 1 -- 172.21.15.102:0/2313230098 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7b8019040 con 0x563373a1cee0 2024-09-13T19:18:02.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.947+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/2313230098 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563373ba2850 con 0x563373a1cee0 2024-09-13T19:18:02.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.947+0000 7fc6ace09640 1 -- 172.21.15.102:0/2313230098 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7b8013950 con 0x563373a1cee0 2024-09-13T19:18:02.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.947+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/2313230098 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563373ba2dd0 con 0x563373a1cee0 2024-09-13T19:18:02.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.947+0000 7fc6ace09640 1 -- 172.21.15.102:0/2313230098 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc7b8010070 con 0x563373a1cee0 2024-09-13T19:18:02.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.948+0000 7fc6ace09640 1 --2- 172.21.15.102:0/2313230098 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc6a8036b90 0x7fc6a8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.948+0000 7fc6ace09640 1 -- 172.21.15.102:0/2313230098 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fc7b804c1c0 con 0x563373a1cee0 2024-09-13T19:18:02.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.948+0000 7fc7bfd09640 1 --2- 172.21.15.102:0/2313230098 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc6a8036b90 0x7fc6a8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.948+0000 7fc7c2a0f800 1 --2- 172.21.15.102:0/2313230098 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563373aad8b0 0x563373ba9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.948+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/2313230098 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563373ba9900 con 0x563373aad8b0 2024-09-13T19:18:02.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.948+0000 7fc7c0d0b640 1 --2- 172.21.15.102:0/2313230098 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563373aad8b0 0x563373ba9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.948+0000 7fc7bfd09640 1 --2- 172.21.15.102:0/2313230098 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc6a8036b90 0x7fc6a8039050 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc7a8057000 tx=0x7fc7a8052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.948+0000 7fc7c0d0b640 1 --2- 172.21.15.102:0/2313230098 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563373aad8b0 0x563373ba9380 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.949+0000 7fc7c0d0b640 1 -- 172.21.15.102:0/2313230098 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7b00083e0 con 0x563373aad8b0 2024-09-13T19:18:02.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.949+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/2313230098 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563373ba6930 con 0x563373aad8b0 2024-09-13T19:18:02.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.949+0000 7fc7c0d0b640 1 -- 172.21.15.102:0/2313230098 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc7b00083e0 con 0x563373aad8b0 2024-09-13T19:18:02.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.949+0000 7fc7c2a0f800 1 --2- 172.21.15.102:0/2313230098 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563373babc10 0x563373bae000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.949+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/2313230098 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563373bae6f0 con 0x563373babc10 2024-09-13T19:18:02.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.949+0000 7fc7c050a640 1 --2- 172.21.15.102:0/2313230098 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563373babc10 0x563373bae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.949+0000 7fc7c050a640 1 --2- 172.21.15.102:0/2313230098 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563373babc10 0x563373bae000 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.950+0000 7fc7c050a640 1 -- 172.21.15.102:0/2313230098 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc7b800f030 con 0x563373babc10 2024-09-13T19:18:02.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.950+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/2313230098 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563373baaa80 con 0x563373aad8b0 2024-09-13T19:18:02.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.950+0000 7fc7c0d0b640 1 -- 172.21.15.102:0/2313230098 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc7b00083e0 con 0x563373aad8b0 2024-09-13T19:18:02.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.950+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/2313230098 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563373baaf30 con 0x563373babc10 2024-09-13T19:18:02.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.950+0000 7fc7c050a640 1 -- 172.21.15.102:0/2313230098 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc7b800f030 con 0x563373babc10 2024-09-13T19:18:02.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.950+0000 7fc7c2a0f800 1 Processor -- start 2024-09-13T19:18:02.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.951+0000 7fc7c2a0f800 1 -- start start 2024-09-13T19:18:02.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.951+0000 7fc7c2a0f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563373bbd070 0x563373bbd490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.951+0000 7fc7c2a0f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563373944580 con 0x563373bbd070 2024-09-13T19:18:02.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.951+0000 7fc7c0d0b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563373bbd070 0x563373bbd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.951+0000 7fc7c0d0b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563373bbd070 0x563373bbd490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49816/0 (socket says 172.21.15.102:49816) 2024-09-13T19:18:02.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.951+0000 7fc7c0d0b640 1 -- 172.21.15.102:0/378941655 learned_addr learned my addr 172.21.15.102:0/378941655 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:02.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.951+0000 7fc7c0d0b640 1 -- 172.21.15.102:0/378941655 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563373bbd9d0 con 0x563373bbd070 2024-09-13T19:18:02.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.951+0000 7fc7c0d0b640 1 --2- 172.21.15.102:0/378941655 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563373bbd070 0x563373bbd490 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x563373ba3710 tx=0x7fc7b000beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.952+0000 7fc6a5ffb640 1 -- 172.21.15.102:0/378941655 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7b001c020 con 0x563373bbd070 2024-09-13T19:18:02.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.952+0000 7fc6a5ffb640 1 -- 172.21.15.102:0/378941655 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7b0007c30 con 0x563373bbd070 2024-09-13T19:18:02.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.952+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/378941655 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563373bbdc60 con 0x563373bbd070 2024-09-13T19:18:02.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.952+0000 7fc6a5ffb640 1 -- 172.21.15.102:0/378941655 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7b0018440 con 0x563373bbd070 2024-09-13T19:18:02.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.952+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/378941655 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563373bc0940 con 0x563373bbd070 2024-09-13T19:18:02.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.952+0000 7fc6a5ffb640 1 -- 172.21.15.102:0/378941655 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc7b001f020 con 0x563373bbd070 2024-09-13T19:18:02.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.953+0000 7fc6a5ffb640 1 --2- 172.21.15.102:0/378941655 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc698036b90 0x7fc698039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.953+0000 7fc6a5ffb640 1 -- 172.21.15.102:0/378941655 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fc7b004e370 con 0x563373bbd070 2024-09-13T19:18:02.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.953+0000 7fc7c050a640 1 --2- 172.21.15.102:0/378941655 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc698036b90 0x7fc698039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.953+0000 7fc7c2a0f800 1 Processor -- start 2024-09-13T19:18:02.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.953+0000 7fc7c050a640 1 --2- 172.21.15.102:0/378941655 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc698036b90 0x7fc698039050 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc7b804a760 tx=0x7fc7b8040040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.953+0000 7fc7c2a0f800 1 -- start start 2024-09-13T19:18:02.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.953+0000 7fc7c2a0f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563373bc9d00 0x563373bca100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.953+0000 7fc7c2a0f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563373aa8130 con 0x563373bc9d00 2024-09-13T19:18:02.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.953+0000 7fc7c0d0b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563373bc9d00 0x563373bca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.953+0000 7fc7c0d0b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563373bc9d00 0x563373bca100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49826/0 (socket says 172.21.15.102:49826) 2024-09-13T19:18:02.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.953+0000 7fc7c0d0b640 1 -- 172.21.15.102:0/3786745755 learned_addr learned my addr 172.21.15.102:0/3786745755 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:02.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.954+0000 7fc7c0d0b640 1 -- 172.21.15.102:0/3786745755 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563373bca6d0 con 0x563373bc9d00 2024-09-13T19:18:02.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.954+0000 7fc7c0d0b640 1 --2- 172.21.15.102:0/3786745755 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563373bc9d00 0x563373bca100 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fc7b004c5f0 tx=0x7fc7b004c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acd52b458ac5d110 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.954+0000 7fc69f7fe640 1 -- 172.21.15.102:0/3786745755 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7b0045070 con 0x563373bc9d00 2024-09-13T19:18:02.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.954+0000 7fc69f7fe640 1 -- 172.21.15.102:0/3786745755 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7b0021400 con 0x563373bc9d00 2024-09-13T19:18:02.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.954+0000 7fc69f7fe640 1 -- 172.21.15.102:0/3786745755 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7b0018b40 con 0x563373bc9d00 2024-09-13T19:18:02.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.954+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3786745755 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563373bc9d00 msgr2=0x563373bca100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:02.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.954+0000 7fc7c2a0f800 1 --2- 172.21.15.102:0/3786745755 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563373bc9d00 0x563373bca100 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fc7b004c5f0 tx=0x7fc7b004c7f0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.954+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3786745755 shutdown_connections 2024-09-13T19:18:02.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.954+0000 7fc7c2a0f800 1 --2- 172.21.15.102:0/3786745755 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563373bc9d00 0x563373bca100 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:02.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.954+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3786745755 >> 172.21.15.102:0/3786745755 conn(0x563373bc6060 msgr2=0x563373bc4160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:02.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.954+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3786745755 shutdown_connections 2024-09-13T19:18:02.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.955+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3786745755 wait complete. 2024-09-13T19:18:02.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.955+0000 7fc7c2a0f800 1 Processor -- start 2024-09-13T19:18:02.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.955+0000 7fc7c2a0f800 1 -- start start 2024-09-13T19:18:02.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.955+0000 7fc7c2a0f800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563373bc9d00 0x563373bd1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.955+0000 7fc7c2a0f800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563373bcad40 con 0x563373bc9d00 2024-09-13T19:18:02.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.955+0000 7fc7c0d0b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563373bc9d00 0x563373bd1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.955+0000 7fc7c0d0b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563373bc9d00 0x563373bd1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49828/0 (socket says 172.21.15.102:49828) 2024-09-13T19:18:02.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.955+0000 7fc7c0d0b640 1 -- 172.21.15.102:0/3312579501 learned_addr learned my addr 172.21.15.102:0/3312579501 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:02.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.955+0000 7fc7c0d0b640 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563373bd16b0 con 0x563373bc9d00 2024-09-13T19:18:02.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.956+0000 7fc7c0d0b640 1 --2- 172.21.15.102:0/3312579501 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563373bc9d00 0x563373bd1170 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0043040 tx=0x7fc7b004c580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.956+0000 7fc69dffb640 1 -- 172.21.15.102:0/3312579501 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7b0045030 con 0x563373bc9d00 2024-09-13T19:18:02.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.956+0000 7fc69dffb640 1 -- 172.21.15.102:0/3312579501 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7b0029c70 con 0x563373bc9d00 2024-09-13T19:18:02.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.956+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563373bd1940 con 0x563373bc9d00 2024-09-13T19:18:02.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.956+0000 7fc69dffb640 1 -- 172.21.15.102:0/3312579501 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7b003f040 con 0x563373bc9d00 2024-09-13T19:18:02.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.956+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563373bd45f0 con 0x563373bc9d00 2024-09-13T19:18:02.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.957+0000 7fc69dffb640 1 -- 172.21.15.102:0/3312579501 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc7b0016040 con 0x563373bc9d00 2024-09-13T19:18:02.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.957+0000 7fc69dffb640 1 --2- 172.21.15.102:0/3312579501 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc690036af0 0x7fc690038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.957+0000 7fc69dffb640 1 -- 172.21.15.102:0/3312579501 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fc7b0046070 con 0x563373bc9d00 2024-09-13T19:18:02.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.957+0000 7fc7c050a640 1 --2- 172.21.15.102:0/3312579501 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc690036af0 0x7fc690038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.957+0000 7fc7c050a640 1 --2- 172.21.15.102:0/3312579501 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc690036af0 0x7fc690038fb0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8002070 tx=0x7fc7b8031000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.957+0000 7fc7c2a0f800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.957+0000 7fc7c2a0f800 1 --2- 172.21.15.102:0/3312579501 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563373bdcc60 0x563373bdf120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.957+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563373bdf870 con 0x563373bdcc60 2024-09-13T19:18:02.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.957+0000 7fc7bfd09640 1 --2- 172.21.15.102:0/3312579501 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563373bdcc60 0x563373bdf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.958+0000 7fc7bfd09640 1 --2- 172.21.15.102:0/3312579501 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563373bdcc60 0x563373bdf120 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.958+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7a8051070 con 0x563373bdcc60 2024-09-13T19:18:02.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.958+0000 7fc7c2a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:02.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.958+0000 7fc7c2a0f800 20 realm 2024-09-13T19:18:02.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.958+0000 7fc7c2a0f800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.958+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563373bdfca0 con 0x563373bdcc60 2024-09-13T19:18:02.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.958+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7a8051070 con 0x563373bdcc60 2024-09-13T19:18:02.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.958+0000 7fc7c2a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:02.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.958+0000 7fc7c2a0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:18:02.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.958+0000 7fc7c2a0f800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.958+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563373be0570 con 0x563373bdcc60 2024-09-13T19:18:02.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.958+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7a8051070 con 0x563373bdcc60 2024-09-13T19:18:02.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.958+0000 7fc7c2a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:02.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.958+0000 7fc7c2a0f800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.958+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563373be0910 con 0x563373bdcc60 2024-09-13T19:18:02.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.959+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc7a8051070 con 0x563373bdcc60 2024-09-13T19:18:02.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.959+0000 7fc7c2a0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:18:02.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.959+0000 7fc7c2a0f800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.959+0000 7fc7c2a0f800 1 --2- 172.21.15.102:0/3312579501 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563373be1670 0x563373be3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.959+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563373be4070 con 0x563373be1670 2024-09-13T19:18:02.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.959+0000 7fc7c0d0b640 1 --2- 172.21.15.102:0/3312579501 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563373be1670 0x563373be3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.959+0000 7fc7c0d0b640 1 --2- 172.21.15.102:0/3312579501 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563373be1670 0x563373be3a60 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.959+0000 7fc7c0d0b640 1 -- 172.21.15.102:0/3312579501 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc7b003b020 con 0x563373be1670 2024-09-13T19:18:02.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.959+0000 7fc7c2a0f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:18:02.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.959+0000 7fc7c2a0f800 20 searching for the correct realm 2024-09-13T19:18:02.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.959+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563373be5930 con 0x563373be1670 2024-09-13T19:18:02.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.960+0000 7fc7c0d0b640 1 -- 172.21.15.102:0/3312579501 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b003b020 con 0x563373be1670 2024-09-13T19:18:02.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.960+0000 7fc7c0d0b640 1 --2- 172.21.15.102:0/3312579501 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fc7b0021020 0x7fc7b0024120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.960+0000 7fc7c0d0b640 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563373be5930 con 0x7fc7b0021020 2024-09-13T19:18:02.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.960+0000 7fc7c050a640 1 --2- 172.21.15.102:0/3312579501 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fc7b0021020 0x7fc7b0024120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.960+0000 7fc7c050a640 1 --2- 172.21.15.102:0/3312579501 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fc7b0021020 0x7fc7b0024120 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.960+0000 7fc7c050a640 1 -- 172.21.15.102:0/3312579501 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b803d070 con 0x7fc7b0021020 2024-09-13T19:18:02.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.960+0000 7fc7c050a640 1 --2- 172.21.15.102:0/3312579501 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fc7b80123c0 0x7fc7b801d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:02.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.960+0000 7fc7c050a640 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563373be5930 con 0x7fc7b80123c0 2024-09-13T19:18:02.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.960+0000 7fc7bfd09640 1 --2- 172.21.15.102:0/3312579501 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fc7b80123c0 0x7fc7b801d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:02.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.961+0000 7fc7bfd09640 1 --2- 172.21.15.102:0/3312579501 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fc7b80123c0 0x7fc7b801d380 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:02.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.961+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7a8051070 con 0x7fc7b80123c0 2024-09-13T19:18:02.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.961+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563373be5930 con 0x563373bdcc60 2024-09-13T19:18:02.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.961+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7a8051070 con 0x563373bdcc60 2024-09-13T19:18:02.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.961+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563373be5930 con 0x563373bdcc60 2024-09-13T19:18:02.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.962+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7a8051070 con 0x563373bdcc60 2024-09-13T19:18:02.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.962+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563373be5930 con 0x7fc7b80123c0 2024-09-13T19:18:02.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.962+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7a8051070 con 0x7fc7b80123c0 2024-09-13T19:18:02.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.962+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563373be5930 con 0x7fc7b80123c0 2024-09-13T19:18:02.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.962+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7a8051070 con 0x7fc7b80123c0 2024-09-13T19:18:02.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.962+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563373be5930 con 0x7fc7b0021020 2024-09-13T19:18:02.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.962+0000 7fc7c050a640 1 -- 172.21.15.102:0/3312579501 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b803d070 con 0x7fc7b0021020 2024-09-13T19:18:02.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.962+0000 7fc7c050a640 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563373be5930 con 0x563373be1670 2024-09-13T19:18:02.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.963+0000 7fc7c0d0b640 1 -- 172.21.15.102:0/3312579501 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b003b020 con 0x563373be1670 2024-09-13T19:18:02.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.963+0000 7fc7c0d0b640 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563373be5930 con 0x563373bdcc60 2024-09-13T19:18:02.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.963+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7a8051070 con 0x563373bdcc60 2024-09-13T19:18:02.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.963+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563373be5930 con 0x7fc7b0021020 2024-09-13T19:18:02.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.963+0000 7fc7c050a640 1 -- 172.21.15.102:0/3312579501 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b803d070 con 0x7fc7b0021020 2024-09-13T19:18:02.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.963+0000 7fc7c050a640 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563373be5930 con 0x563373bdcc60 2024-09-13T19:18:02.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.963+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7a8051070 con 0x563373bdcc60 2024-09-13T19:18:02.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.963+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563373be5930 con 0x7fc7b0021020 2024-09-13T19:18:02.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.964+0000 7fc7c050a640 1 -- 172.21.15.102:0/3312579501 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc7b803d070 con 0x7fc7b0021020 2024-09-13T19:18:02.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.964+0000 7fc7c050a640 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc7b8059060 con 0x563373be1670 2024-09-13T19:18:02.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.964+0000 7fc7c0d0b640 1 -- 172.21.15.102:0/3312579501 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b003b020 con 0x563373be1670 2024-09-13T19:18:02.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.964+0000 7fc7c0d0b640 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc7b8059060 con 0x563373be1670 2024-09-13T19:18:02.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.964+0000 7fc7c0d0b640 1 -- 172.21.15.102:0/3312579501 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc7b003b020 con 0x563373be1670 2024-09-13T19:18:02.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.964+0000 7fc7c0d0b640 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc7b8059060 con 0x7fc7b80123c0 2024-09-13T19:18:02.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.964+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7a8051070 con 0x7fc7b80123c0 2024-09-13T19:18:02.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.964+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc7b8059060 con 0x563373be1670 2024-09-13T19:18:02.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.965+0000 7fc7c0d0b640 1 -- 172.21.15.102:0/3312579501 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc7b003b020 con 0x563373be1670 2024-09-13T19:18:02.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.965+0000 7fc7c0d0b640 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc7b8059060 con 0x563373be1670 2024-09-13T19:18:02.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.965+0000 7fc7c0d0b640 1 -- 172.21.15.102:0/3312579501 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b003b020 con 0x563373be1670 2024-09-13T19:18:02.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.965+0000 7fc7c0d0b640 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc7b8059060 con 0x563373bdcc60 2024-09-13T19:18:02.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.965+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7a8051070 con 0x563373bdcc60 2024-09-13T19:18:02.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.965+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc7b8059060 con 0x563373bdcc60 2024-09-13T19:18:02.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.965+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc7a8051070 con 0x563373bdcc60 2024-09-13T19:18:02.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.965+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc7b8059060 con 0x7fc7b80123c0 2024-09-13T19:18:02.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.966+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7a8051070 con 0x7fc7b80123c0 2024-09-13T19:18:02.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.966+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc7b8059060 con 0x563373be1670 2024-09-13T19:18:02.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.966+0000 7fc7c0d0b640 1 -- 172.21.15.102:0/3312579501 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b003b020 con 0x563373be1670 2024-09-13T19:18:02.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.966+0000 7fc7c0d0b640 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc7b8059060 con 0x7fc7b0021020 2024-09-13T19:18:02.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.966+0000 7fc7c050a640 1 -- 172.21.15.102:0/3312579501 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b803d070 con 0x7fc7b0021020 2024-09-13T19:18:02.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.966+0000 7fc7c050a640 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc7b8059060 con 0x563373bdcc60 2024-09-13T19:18:02.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.966+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7a8051070 con 0x563373bdcc60 2024-09-13T19:18:02.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.966+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc7b8059060 con 0x7fc7b0021020 2024-09-13T19:18:02.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.966+0000 7fc7c050a640 1 -- 172.21.15.102:0/3312579501 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b803d070 con 0x7fc7b0021020 2024-09-13T19:18:02.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.966+0000 7fc7c050a640 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc7b8059060 con 0x563373be1670 2024-09-13T19:18:02.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.967+0000 7fc7c0d0b640 1 -- 172.21.15.102:0/3312579501 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b003b020 con 0x563373be1670 2024-09-13T19:18:02.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.967+0000 7fc7c0d0b640 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc7b8059060 con 0x7fc7b80123c0 2024-09-13T19:18:02.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.967+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7a8051070 con 0x7fc7b80123c0 2024-09-13T19:18:02.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.967+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc7b8059060 con 0x7fc7b0021020 2024-09-13T19:18:02.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.967+0000 7fc7c050a640 1 -- 172.21.15.102:0/3312579501 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b803d070 con 0x7fc7b0021020 2024-09-13T19:18:02.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.967+0000 7fc7c050a640 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc7b8059060 con 0x563373be1670 2024-09-13T19:18:02.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.967+0000 7fc7c0d0b640 1 -- 172.21.15.102:0/3312579501 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b003b020 con 0x563373be1670 2024-09-13T19:18:02.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.967+0000 7fc7c0d0b640 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc7b8059060 con 0x7fc7b80123c0 2024-09-13T19:18:02.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.968+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7a8051070 con 0x7fc7b80123c0 2024-09-13T19:18:02.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.968+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc7b8059060 con 0x563373bdcc60 2024-09-13T19:18:02.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.968+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v36'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc7a8051070 con 0x563373bdcc60 2024-09-13T19:18:02.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.968+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7fc7a8083080 con 0x7fc7b0021020 2024-09-13T19:18:02.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.968+0000 7fc7c050a640 1 -- 172.21.15.102:0/3312579501 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b803d070 con 0x7fc7b0021020 2024-09-13T19:18:02.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.968+0000 7fc7c2a0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:18:02.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.968+0000 7fc7c2a0f800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:18:02.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.968+0000 7fc7c2a0f800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:18:02.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.968+0000 7fc7c2a0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:18:02.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.968+0000 7fc7c2a0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:18:02.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.968+0000 7fc7c2a0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:18:02.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.968+0000 7fc7c2a0f800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.968+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563373be49f0 con 0x563373bdcc60 2024-09-13T19:18:02.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.969+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7a8051070 con 0x563373bdcc60 2024-09-13T19:18:02.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.969+0000 7fc7c2a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:02.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.969+0000 7fc7c2a0f800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.969+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563373be5290 con 0x563373bdcc60 2024-09-13T19:18:02.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.969+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc7a8051070 con 0x563373bdcc60 2024-09-13T19:18:02.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.969+0000 7fc7c2a0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:18:02.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.969+0000 7fc7c2a0f800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.969+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563373be5db0 con 0x563373be1670 2024-09-13T19:18:02.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.969+0000 7fc7c0d0b640 1 -- 172.21.15.102:0/3312579501 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc7b003b020 con 0x563373be1670 2024-09-13T19:18:02.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.969+0000 7fc7c2a0f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:18:02.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.969+0000 7fc7c2a0f800 20 zone default found 2024-09-13T19:18:02.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.969+0000 7fc7c2a0f800 4 Realm: () 2024-09-13T19:18:02.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.969+0000 7fc7c2a0f800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:18:02.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.969+0000 7fc7c2a0f800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:18:02.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.969+0000 7fc7c2a0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:18:02.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.969+0000 7fc7c2a0f800 20 zonegroup default 2024-09-13T19:18:02.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.969+0000 7fc7c2a0f800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.969+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563373be6600 con 0x7fc7b0021020 2024-09-13T19:18:02.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.969+0000 7fc7c050a640 1 -- 172.21.15.102:0/3312579501 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc7b803d070 con 0x7fc7b0021020 2024-09-13T19:18:02.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.969+0000 7fc7c2a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:02.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.969+0000 7fc7c2a0f800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.969+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563373be83b0 con 0x563373be1670 2024-09-13T19:18:02.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.970+0000 7fc7c0d0b640 1 -- 172.21.15.102:0/3312579501 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc7b003b020 con 0x563373be1670 2024-09-13T19:18:02.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.970+0000 7fc7c2a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:02.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.970+0000 7fc7c2a0f800 20 rados->read ofs=0 len=0 2024-09-13T19:18:02.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.970+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563373be8840 con 0x563373be1670 2024-09-13T19:18:02.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.970+0000 7fc7c0d0b640 1 -- 172.21.15.102:0/3312579501 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc7b003b020 con 0x563373be1670 2024-09-13T19:18:02.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.970+0000 7fc7c2a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:02.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.970+0000 7fc7c2a0f800 20 started sync module instance, tier type = 2024-09-13T19:18:02.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.970+0000 7fc7c2a0f800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:18:02.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.970+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563373be7820 con 0x7fc7b0021020 2024-09-13T19:18:02.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.971+0000 7fc7c050a640 1 -- 172.21.15.102:0/3312579501 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(44 notify.0 [create] v36'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b803d070 con 0x7fc7b0021020 2024-09-13T19:18:02.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.971+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94778985182064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563373be8c80 con 0x7fc7b0021020 2024-09-13T19:18:02.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.971+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563373be94d0 con 0x563373bdcc60 2024-09-13T19:18:02.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.972+0000 7fc7c050a640 1 -- 172.21.15.102:0/3312579501 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94778985182064] v36'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b803d070 con 0x7fc7b0021020 2024-09-13T19:18:02.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.973+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v36'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7a8051070 con 0x563373bdcc60 2024-09-13T19:18:02.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.973+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94778985188480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563373be9550 con 0x563373bdcc60 2024-09-13T19:18:02.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.973+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563373be9da0 con 0x563373be1670 2024-09-13T19:18:02.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.974+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94778985188480] v36'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7a8051070 con 0x563373bdcc60 2024-09-13T19:18:02.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.974+0000 7fc7c0d0b640 1 -- 172.21.15.102:0/3312579501 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v36'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b003b020 con 0x563373be1670 2024-09-13T19:18:02.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.974+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94778985190016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563373be9cd0 con 0x563373be1670 2024-09-13T19:18:02.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.974+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563373bea7f0 con 0x7fc7b0021020 2024-09-13T19:18:02.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.975+0000 7fc7c050a640 1 -- 172.21.15.102:0/3312579501 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(50 notify.3 [create] v36'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b803d070 con 0x7fc7b0021020 2024-09-13T19:18:02.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.975+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94778985194240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563373bea7e0 con 0x7fc7b0021020 2024-09-13T19:18:02.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.975+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563373beb800 con 0x563373bdcc60 2024-09-13T19:18:02.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.975+0000 7fc7c0d0b640 1 -- 172.21.15.102:0/3312579501 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94778985190016] v36'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b003b020 con 0x563373be1670 2024-09-13T19:18:02.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.976+0000 7fc7c050a640 1 -- 172.21.15.102:0/3312579501 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94778985194240] v36'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b803d070 con 0x7fc7b0021020 2024-09-13T19:18:03.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.976+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v36'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7a8051070 con 0x563373bdcc60 2024-09-13T19:18:03.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.976+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94778985196560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563373beb800 con 0x563373bdcc60 2024-09-13T19:18:03.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.976+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563373bec0a0 con 0x7fc7b80123c0 2024-09-13T19:18:03.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.977+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(54 notify.5 [create] v36'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7a8051070 con 0x7fc7b80123c0 2024-09-13T19:18:03.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.977+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94778985200624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563373bec4c0 con 0x7fc7b80123c0 2024-09-13T19:18:03.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.977+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563373becd50 con 0x7fc7b80123c0 2024-09-13T19:18:03.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.977+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94778985196560] v36'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7a8051070 con 0x563373bdcc60 2024-09-13T19:18:03.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.978+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94778985200624] v36'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7a8051070 con 0x7fc7b80123c0 2024-09-13T19:18:03.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.978+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(56 notify.6 [create] v36'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7a8051070 con 0x7fc7b80123c0 2024-09-13T19:18:03.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.978+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94778985198352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563373bec520 con 0x7fc7b80123c0 2024-09-13T19:18:03.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.978+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563373bed3e0 con 0x7fc7b80123c0 2024-09-13T19:18:03.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.980+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94778985198352] v36'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7a8051070 con 0x7fc7b80123c0 2024-09-13T19:18:03.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.980+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(58 notify.7 [create] v36'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7a8051070 con 0x7fc7b80123c0 2024-09-13T19:18:03.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.980+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94778985201680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563373bed3e0 con 0x7fc7b80123c0 2024-09-13T19:18:03.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.980+0000 7fc7c2a0f800 20 add_watcher() i=0 2024-09-13T19:18:03.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.980+0000 7fc7c2a0f800 20 add_watcher() i=1 2024-09-13T19:18:03.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.980+0000 7fc7c2a0f800 20 add_watcher() i=2 2024-09-13T19:18:03.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.980+0000 7fc7c2a0f800 20 add_watcher() i=3 2024-09-13T19:18:03.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.980+0000 7fc7c2a0f800 20 add_watcher() i=4 2024-09-13T19:18:03.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.980+0000 7fc7c2a0f800 20 add_watcher() i=5 2024-09-13T19:18:03.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.980+0000 7fc7c2a0f800 20 add_watcher() i=6 2024-09-13T19:18:03.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.981+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94778985201680] v36'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7a8051070 con 0x7fc7b80123c0 2024-09-13T19:18:03.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.981+0000 7fc7c2a0f800 20 add_watcher() i=7 2024-09-13T19:18:03.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.981+0000 7fc7c2a0f800 2 all 8 watchers are set, enabling cache 2024-09-13T19:18:03.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.981+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563373bf0550 con 0x563373bdcc60 2024-09-13T19:18:03.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.981+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc7a8051070 con 0x563373bdcc60 2024-09-13T19:18:03.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.981+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94778985205552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563373bed800 con 0x563373bdcc60 2024-09-13T19:18:03.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.982+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94778985205552] v36'250 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc7a8051070 con 0x563373bdcc60 2024-09-13T19:18:03.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.982+0000 7fc6767e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:18:03.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.982+0000 7fc7c2a0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:18:03.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.982+0000 7fc7c2a0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:18:03.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.982+0000 7fc7c2a0f800 5 note: GC not initialized 2024-09-13T19:18:03.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.982+0000 7fc6757e2640 20 reqs_thread_entry: start 2024-09-13T19:18:03.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.982+0000 7fc7c2a0f800 20 init_complete bucket index max shards: 11 2024-09-13T19:18:03.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.983+0000 7fc7c2a0f800 20 Filter name: none 2024-09-13T19:18:03.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.983+0000 7fc5e6ffd640 20 reqs_thread_entry: start 2024-09-13T19:18:03.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.983+0000 7fc7c2a0f800 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-13T19:18:03.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.983+0000 7fc7c2a0f800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.983+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:62 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563373c239c0 con 0x563373be1670 2024-09-13T19:18:03.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.983+0000 7fc7c0d0b640 1 -- 172.21.15.102:0/3312579501 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(62 a_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 234+0+0 (crc 0 0 0) 0x7fc7b003b020 con 0x563373be1670 2024-09-13T19:18:03.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.983+0000 7fc7c2a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:03.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.983+0000 7fc7c2a0f800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x0 2024-09-13T19:18:03.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.983+0000 7fc7c2a0f800 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-13T19:18:03.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.983+0000 7fc7c2a0f800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : miss 2024-09-13T19:18:03.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.983+0000 7fc7c2a0f800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.983+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:63 8.15 8:afe09604:users.keys::true_admin_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563373c22000 con 0x563373be1670 2024-09-13T19:18:03.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.983+0000 7fc7c0d0b640 1 -- 172.21.15.102:0/3312579501 <== osd.3 v2:172.21.15.102:6800/3096737090 17 ==== osd_op_reply(63 true_admin_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 201+0+0 (crc 0 0 0) 0x7fc7b003b020 con 0x563373be1670 2024-09-13T19:18:03.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.983+0000 7fc7c2a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:03.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.983+0000 7fc7c2a0f800 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x0 2024-09-13T19:18:03.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.983+0000 7fc7c2a0f800 10 adding default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-13T19:18:03.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.983+0000 7fc7c2a0f800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-13T19:18:03.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.983+0000 7fc7c2a0f800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-13T19:18:03.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.983+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:64 8.14 8:2efb937b:users.uid::a_user:head [delete,create,call version.set in=58b,writefull 0~363 in=363b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563373c228a0 con 0x563373be1670 2024-09-13T19:18:03.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.984+0000 7fc7c0d0b640 1 -- 172.21.15.102:0/3312579501 <== osd.3 v2:172.21.15.102:6800/3096737090 18 ==== osd_op_reply(64 a_user [delete,create,call,writefull 0~363] v36'1 uv1 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7fc7b003b020 con 0x563373be1670 2024-09-13T19:18:03.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.984+0000 7fc7c2a0f800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-13T19:18:03.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.984+0000 7fc7c2a0f800 10 moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-13T19:18:03.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.984+0000 7fc7c2a0f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-13T19:18:03.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.984+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [notify cookie 94778985423856 in=554b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563373c26fb0 con 0x563373be1670 2024-09-13T19:18:03.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.984+0000 7fc7c0d0b640 1 -- 172.21.15.102:0/3312579501 <== osd.3 v2:172.21.15.102:6800/3096737090 19 ==== watch-notify(notify (1) cookie 94778985190016 notify 154618822665 ret 0) ==== 584+0+0 (crc 0 0 0) 0x563373c23410 con 0x563373be1670 2024-09-13T19:18:03.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.985+0000 7fc69f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822665 cookie 94778985190016 notifier 4867 bl.length()=542 2024-09-13T19:18:03.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.985+0000 7fc69f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-13T19:18:03.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.985+0000 7fc69f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-13T19:18:03.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.985+0000 7fc7c0d0b640 1 -- 172.21.15.102:0/3312579501 <== osd.3 v2:172.21.15.102:6800/3096737090 20 ==== osd_op_reply(65 notify.2 [notify cookie 94778985423856 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc7b003b020 con 0x563373be1670 2024-09-13T19:18:03.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.985+0000 7fc69f7fe640 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fc684003ea0 con 0x563373be1670 2024-09-13T19:18:03.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.985+0000 7fc7c0d0b640 1 -- 172.21.15.102:0/3312579501 <== osd.3 v2:172.21.15.102:6800/3096737090 21 ==== osd_op_reply(66 notify.2 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b003b020 con 0x563373be1670 2024-09-13T19:18:03.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.985+0000 7fc7c0d0b640 1 -- 172.21.15.102:0/3312579501 <== osd.3 v2:172.21.15.102:6800/3096737090 22 ==== watch-notify(notify_complete (2) cookie 94778985423856 notify 154618822665 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563373bd16b0 con 0x563373be1670 2024-09-13T19:18:03.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.985+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:67 8.15 8:afe09604:users.keys::true_admin_akey:head [delete,create,writefull 0~10 in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563373c22850 con 0x563373be1670 2024-09-13T19:18:03.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.986+0000 7fc7c0d0b640 1 -- 172.21.15.102:0/3312579501 <== osd.3 v2:172.21.15.102:6800/3096737090 23 ==== osd_op_reply(67 true_admin_akey [delete,create,writefull 0~10] v36'3 uv3 ondisk = 0) ==== 243+0+0 (crc 0 0 0) 0x7fc7b003b020 con 0x563373be1670 2024-09-13T19:18:03.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.986+0000 7fc7c2a0f800 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-13T19:18:03.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.986+0000 7fc7c2a0f800 10 moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-13T19:18:03.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.986+0000 7fc7c2a0f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-13T19:18:03.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.986+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94778985423776 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563373c26fb0 con 0x7fc7b80123c0 2024-09-13T19:18:03.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.987+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== watch-notify(notify (1) cookie 94778985200624 notify 154618822696 ret 0) ==== 217+0+0 (crc 0 0 0) 0x563373970e00 con 0x7fc7b80123c0 2024-09-13T19:18:03.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.987+0000 7fc69f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822696 cookie 94778985200624 notifier 4867 bl.length()=175 2024-09-13T19:18:03.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.987+0000 7fc69f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-13T19:18:03.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.987+0000 7fc69f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-13T19:18:03.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.987+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(68 notify.5 [notify cookie 94778985423776 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc7a8051070 con 0x7fc7b80123c0 2024-09-13T19:18:03.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.987+0000 7fc69f7fe640 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fc684003ea0 con 0x7fc7b80123c0 2024-09-13T19:18:03.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.987+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== watch-notify(notify_complete (2) cookie 94778985423776 notify 154618822696 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc7a807a4f0 con 0x7fc7b80123c0 2024-09-13T19:18:03.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.987+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7a8051070 con 0x7fc7b80123c0 2024-09-13T19:18:03.007 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"a_user","display_name":"True Admin User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"a_user","access_key":"true_admin_akey","secret_key":"true_admin_skey","active":true,"create_date":"2024-09-13T19:18:02.984693Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","admin":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:18:02.984680Z","tags":[],"group_ids":[]} 2024-09-13T19:18:03.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.988+0000 7fc6767e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:18:03.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.988+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94778985205552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563373c216e0 con 0x563373bdcc60 2024-09-13T19:18:03.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.989+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94778985205552] v36'251 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc7a8051070 con 0x563373bdcc60 2024-09-13T19:18:03.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.989+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94778985182064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563373c216e0 con 0x7fc7b0021020 2024-09-13T19:18:03.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.990+0000 7fc7c050a640 1 -- 172.21.15.102:0/3312579501 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94778985182064] v36'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b803d070 con 0x7fc7b0021020 2024-09-13T19:18:03.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.990+0000 7fc7c2a0f800 20 remove_watcher() i=0 2024-09-13T19:18:03.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.990+0000 7fc7c2a0f800 2 removed watcher, disabling cache 2024-09-13T19:18:03.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.990+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94778985188480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563373c216e0 con 0x563373bdcc60 2024-09-13T19:18:03.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.991+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94778985188480] v36'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7a8051070 con 0x563373bdcc60 2024-09-13T19:18:03.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.991+0000 7fc7c2a0f800 20 remove_watcher() i=1 2024-09-13T19:18:03.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.991+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94778985190016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563373c216e0 con 0x563373be1670 2024-09-13T19:18:03.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.992+0000 7fc7c0d0b640 1 -- 172.21.15.102:0/3312579501 <== osd.3 v2:172.21.15.102:6800/3096737090 24 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94778985190016] v36'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b003b020 con 0x563373be1670 2024-09-13T19:18:03.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.992+0000 7fc7c2a0f800 20 remove_watcher() i=2 2024-09-13T19:18:03.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.992+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94778985194240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563373c216e0 con 0x7fc7b0021020 2024-09-13T19:18:03.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.993+0000 7fc7c050a640 1 -- 172.21.15.102:0/3312579501 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94778985194240] v36'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b803d070 con 0x7fc7b0021020 2024-09-13T19:18:03.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.993+0000 7fc7c2a0f800 20 remove_watcher() i=3 2024-09-13T19:18:03.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.993+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94778985196560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563373c216e0 con 0x563373bdcc60 2024-09-13T19:18:03.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.994+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94778985196560] v36'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7a8051070 con 0x563373bdcc60 2024-09-13T19:18:03.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.994+0000 7fc7c2a0f800 20 remove_watcher() i=4 2024-09-13T19:18:03.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.994+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94778985200624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563373c216e0 con 0x7fc7b80123c0 2024-09-13T19:18:03.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.995+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94778985200624] v36'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7a8051070 con 0x7fc7b80123c0 2024-09-13T19:18:03.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.995+0000 7fc7c2a0f800 20 remove_watcher() i=5 2024-09-13T19:18:03.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.995+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94778985198352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563373c216e0 con 0x7fc7b80123c0 2024-09-13T19:18:03.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.996+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94778985198352] v36'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7a8051070 con 0x7fc7b80123c0 2024-09-13T19:18:03.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.996+0000 7fc7c2a0f800 20 remove_watcher() i=6 2024-09-13T19:18:03.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.996+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94778985201680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563373c216e0 con 0x7fc7b80123c0 2024-09-13T19:18:03.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.997+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 <== osd.0 v2:172.21.15.53:6800/4021716951 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94778985201680] v36'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7a8051070 con 0x7fc7b80123c0 2024-09-13T19:18:03.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.997+0000 7fc7c2a0f800 20 remove_watcher() i=7 2024-09-13T19:18:03.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.998+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fc7b80123c0 msgr2=0x7fc7b801d380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.998+0000 7fc7c2a0f800 1 --2- 172.21.15.102:0/3312579501 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fc7b80123c0 0x7fc7b801d380 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.998+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563373bdcc60 msgr2=0x563373bdf120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.998+0000 7fc7c2a0f800 1 --2- 172.21.15.102:0/3312579501 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563373bdcc60 0x563373bdf120 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.998+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fc7b0021020 msgr2=0x7fc7b0024120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.998+0000 7fc7c2a0f800 1 --2- 172.21.15.102:0/3312579501 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fc7b0021020 0x7fc7b0024120 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.998+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563373be1670 msgr2=0x563373be3a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.998+0000 7fc7c2a0f800 1 --2- 172.21.15.102:0/3312579501 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563373be1670 0x563373be3a60 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.998+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc690036af0 msgr2=0x7fc690038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.998+0000 7fc7c2a0f800 1 --2- 172.21.15.102:0/3312579501 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc690036af0 0x7fc690038fb0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8002070 tx=0x7fc7b8031000 comp rx=0 tx=0).stop 2024-09-13T19:18:03.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.998+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563373bc9d00 msgr2=0x563373bd1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.998+0000 7fc7c2a0f800 1 --2- 172.21.15.102:0/3312579501 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563373bc9d00 0x563373bd1170 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0043040 tx=0x7fc7b004c580 comp rx=0 tx=0).stop 2024-09-13T19:18:03.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.998+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 reap_dead start 2024-09-13T19:18:03.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.998+0000 7fc7bfd09640 1 -- 172.21.15.102:0/3312579501 reap_dead start 2024-09-13T19:18:03.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.998+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 shutdown_connections 2024-09-13T19:18:03.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.998+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 >> 172.21.15.102:0/3312579501 conn(0x563373bc6060 msgr2=0x563373bc4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:03.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.998+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 shutdown_connections 2024-09-13T19:18:03.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.998+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/3312579501 wait complete. 2024-09-13T19:18:03.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.998+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/378941655 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc698036b90 msgr2=0x7fc698039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.998+0000 7fc7c2a0f800 1 --2- 172.21.15.102:0/378941655 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc698036b90 0x7fc698039050 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc7b804a760 tx=0x7fc7b8040040 comp rx=0 tx=0).stop 2024-09-13T19:18:03.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.998+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/378941655 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563373bbd070 msgr2=0x563373bbd490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.998+0000 7fc7c2a0f800 1 --2- 172.21.15.102:0/378941655 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563373bbd070 0x563373bbd490 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x563373ba3710 tx=0x7fc7b000beb0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.998+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/378941655 shutdown_connections 2024-09-13T19:18:03.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.998+0000 7fc7c2a0f800 1 --2- 172.21.15.102:0/378941655 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc698036b90 0x7fc698039050 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.998+0000 7fc7c2a0f800 1 --2- 172.21.15.102:0/378941655 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563373bbd070 0x563373bbd490 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.998+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/378941655 >> 172.21.15.102:0/378941655 conn(0x563373bb2000 msgr2=0x563373bb4b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:03.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.998+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/378941655 shutdown_connections 2024-09-13T19:18:03.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.998+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/378941655 wait complete. 2024-09-13T19:18:03.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.999+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/2313230098 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563373aad8b0 msgr2=0x563373ba9380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.999+0000 7fc7c2a0f800 1 --2- 172.21.15.102:0/2313230098 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563373aad8b0 0x563373ba9380 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.999+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/2313230098 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563373babc10 msgr2=0x563373bae000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.999+0000 7fc7c2a0f800 1 --2- 172.21.15.102:0/2313230098 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563373babc10 0x563373bae000 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.999+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/2313230098 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc6a8036b90 msgr2=0x7fc6a8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.999+0000 7fc7c2a0f800 1 --2- 172.21.15.102:0/2313230098 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc6a8036b90 0x7fc6a8039050 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc7a8057000 tx=0x7fc7a8052000 comp rx=0 tx=0).stop 2024-09-13T19:18:03.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.999+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/2313230098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563373a1cee0 msgr2=0x563373ba2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.999+0000 7fc7c2a0f800 1 --2- 172.21.15.102:0/2313230098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563373a1cee0 0x563373ba2310 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x563373aa91c0 tx=0x7fc7b8001250 comp rx=0 tx=0).stop 2024-09-13T19:18:03.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.999+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/2313230098 shutdown_connections 2024-09-13T19:18:03.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.999+0000 7fc7c2a0f800 1 --2- 172.21.15.102:0/2313230098 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x563373babc10 0x563373bae000 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.999+0000 7fc7c2a0f800 1 --2- 172.21.15.102:0/2313230098 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x563373aad8b0 0x563373ba9380 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.999+0000 7fc7c2a0f800 1 --2- 172.21.15.102:0/2313230098 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc6a8036b90 0x7fc6a8039050 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.999+0000 7fc7c2a0f800 1 --2- 172.21.15.102:0/2313230098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563373a1cee0 0x563373ba2310 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.999+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/2313230098 >> 172.21.15.102:0/2313230098 conn(0x563373aa3e00 msgr2=0x563373b93ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:03.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.999+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/2313230098 shutdown_connections 2024-09-13T19:18:03.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:02.999+0000 7fc7c2a0f800 1 -- 172.21.15.102:0/2313230098 wait complete. 2024-09-13T19:18:03.022 DEBUG:tasks.util.rgw: json result: {'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-13T19:18:02.984693Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:18:02.984680Z', 'tags': [], 'group_ids': []} 2024-09-13T19:18:03.023 ERROR:root:{'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-13T19:18:02.984693Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:18:02.984680Z', 'tags': [], 'group_ids': []} 2024-09-13T19:18:03.023 ERROR:root:0 2024-09-13T19:18:03.023 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:18:03.037 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:18:03.037 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'a_user'] 2024-09-13T19:18:03.037 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'a_user'] 2024-09-13T19:18:03.037 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid a_user 2024-09-13T19:18:03.081 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:18:03.082 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:18:03.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.079+0000 7f9293121800 1 Processor -- start 2024-09-13T19:18:03.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.079+0000 7f9293121800 1 -- start start 2024-09-13T19:18:03.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.079+0000 7f9293121800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55a8dd039630 0x55a8dd0c8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.079+0000 7f9293121800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a8dcf84b30 con 0x55a8dd0c8790 2024-09-13T19:18:03.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.079+0000 7f9293121800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55a8dcf66360 con 0x55a8dd039630 2024-09-13T19:18:03.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.080+0000 7f928eeac640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55a8dd039630 0x55a8dd0c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.080+0000 7f928e6ab640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55a8dd0c8790 0x55a8dd0cab80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:53736/0 (socket says 172.21.15.102:53736) 2024-09-13T19:18:03.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.080+0000 7f928eeac640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55a8dd039630 0x55a8dd0c8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49836/0 (socket says 172.21.15.102:49836) 2024-09-13T19:18:03.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.080+0000 7f928e6ab640 1 -- 172.21.15.102:0/2469165159 learned_addr learned my addr 172.21.15.102:0/2469165159 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:18:03.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.080+0000 7f928eeac640 1 -- 172.21.15.102:0/2469165159 >> v1:172.21.15.53:6789/0 conn(0x55a8dd0c8790 legacy=0x55a8dd0cab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.080+0000 7f928deaa640 1 -- 172.21.15.102:0/2469165159 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2750458840 0 0) 0x55a8dcf84b30 con 0x55a8dd0c8790 2024-09-13T19:18:03.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.080+0000 7f928eeac640 1 -- 172.21.15.102:0/2469165159 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8dcf8ce00 con 0x55a8dd039630 2024-09-13T19:18:03.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.082+0000 7f928eeac640 1 --2- 172.21.15.102:0/2469165159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8dd039630 0x55a8dd0c8250 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f9280005fd0 tx=0x7f9280045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aaa56343f5ada37 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.082+0000 7f928deaa640 1 -- 172.21.15.102:0/2469165159 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9280058530 con 0x55a8dd039630 2024-09-13T19:18:03.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.082+0000 7f928deaa640 1 -- 172.21.15.102:0/2469165159 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92800586d0 con 0x55a8dd039630 2024-09-13T19:18:03.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.082+0000 7f928deaa640 1 -- 172.21.15.102:0/2469165159 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92800589d0 con 0x55a8dd039630 2024-09-13T19:18:03.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.083+0000 7f9293121800 1 -- 172.21.15.102:0/2469165159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8dd039630 msgr2=0x55a8dd0c8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.083+0000 7f9293121800 1 --2- 172.21.15.102:0/2469165159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8dd039630 0x55a8dd0c8250 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f9280005fd0 tx=0x7f9280045c30 comp rx=0 tx=0).stop 2024-09-13T19:18:03.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.083+0000 7f9293121800 1 -- 172.21.15.102:0/2469165159 shutdown_connections 2024-09-13T19:18:03.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.083+0000 7f9293121800 1 --2- 172.21.15.102:0/2469165159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8dd039630 0x55a8dd0c8250 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.083+0000 7f9293121800 1 -- 172.21.15.102:0/2469165159 >> 172.21.15.102:0/2469165159 conn(0x55a8dd0bfde0 msgr2=0x55a8dd0c2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:03.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.083+0000 7f9293121800 1 -- 172.21.15.102:0/2469165159 shutdown_connections 2024-09-13T19:18:03.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.083+0000 7f9293121800 1 -- 172.21.15.102:0/2469165159 wait complete. 2024-09-13T19:18:03.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.096+0000 7f9293121800 1 Processor -- start 2024-09-13T19:18:03.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.096+0000 7f9293121800 1 -- start start 2024-09-13T19:18:03.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.096+0000 7f9293121800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8dd039630 0x55a8dd1b46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.096+0000 7f9293121800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a8dd011330 con 0x55a8dd039630 2024-09-13T19:18:03.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.097+0000 7f928eeac640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8dd039630 0x55a8dd1b46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.097+0000 7f928eeac640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8dd039630 0x55a8dd1b46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49850/0 (socket says 172.21.15.102:49850) 2024-09-13T19:18:03.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.097+0000 7f928eeac640 1 -- 172.21.15.102:0/2688927594 learned_addr learned my addr 172.21.15.102:0/2688927594 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:03.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.097+0000 7f928eeac640 1 -- 172.21.15.102:0/2688927594 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8dcf5ebc0 con 0x55a8dd039630 2024-09-13T19:18:03.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.097+0000 7f928eeac640 1 --2- 172.21.15.102:0/2688927594 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8dd039630 0x55a8dd1b46e0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f928000a3f0 tx=0x7f9280051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e01a989fe3cd749d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.098+0000 7f917ce09640 1 -- 172.21.15.102:0/2688927594 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9280068070 con 0x55a8dd039630 2024-09-13T19:18:03.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.098+0000 7f917ce09640 1 -- 172.21.15.102:0/2688927594 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9280058880 con 0x55a8dd039630 2024-09-13T19:18:03.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.098+0000 7f917ce09640 1 -- 172.21.15.102:0/2688927594 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9280058b60 con 0x55a8dd039630 2024-09-13T19:18:03.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.098+0000 7f9293121800 1 -- 172.21.15.102:0/2688927594 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8dd039630 msgr2=0x55a8dd1b46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.098+0000 7f9293121800 1 --2- 172.21.15.102:0/2688927594 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8dd039630 0x55a8dd1b46e0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f928000a3f0 tx=0x7f9280051000 comp rx=0 tx=0).stop 2024-09-13T19:18:03.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.098+0000 7f9293121800 1 -- 172.21.15.102:0/2688927594 shutdown_connections 2024-09-13T19:18:03.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.098+0000 7f9293121800 1 --2- 172.21.15.102:0/2688927594 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8dd039630 0x55a8dd1b46e0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.098+0000 7f9293121800 1 -- 172.21.15.102:0/2688927594 >> 172.21.15.102:0/2688927594 conn(0x55a8dd0bfde0 msgr2=0x55a8dd1b00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:03.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.098+0000 7f9293121800 1 -- 172.21.15.102:0/2688927594 shutdown_connections 2024-09-13T19:18:03.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.098+0000 7f9293121800 1 -- 172.21.15.102:0/2688927594 wait complete. 2024-09-13T19:18:03.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.099+0000 7f9293121800 1 Processor -- start 2024-09-13T19:18:03.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.099+0000 7f9293121800 1 -- start start 2024-09-13T19:18:03.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.099+0000 7f9293121800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8dd039630 0x55a8dd1bbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.099+0000 7f9293121800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a8dd0cc690 con 0x55a8dd039630 2024-09-13T19:18:03.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.099+0000 7f928eeac640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8dd039630 0x55a8dd1bbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.099+0000 7f928eeac640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8dd039630 0x55a8dd1bbfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49852/0 (socket says 172.21.15.102:49852) 2024-09-13T19:18:03.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.099+0000 7f928eeac640 1 -- 172.21.15.102:0/1003803162 learned_addr learned my addr 172.21.15.102:0/1003803162 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:03.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.099+0000 7f928eeac640 1 -- 172.21.15.102:0/1003803162 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8dcf72fe0 con 0x55a8dd039630 2024-09-13T19:18:03.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.100+0000 7f928eeac640 1 --2- 172.21.15.102:0/1003803162 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8dd039630 0x55a8dd1bbfb0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f9280066040 tx=0x7f9280003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.100+0000 7f917b606640 1 -- 172.21.15.102:0/1003803162 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9280071070 con 0x55a8dd039630 2024-09-13T19:18:03.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.100+0000 7f917b606640 1 -- 172.21.15.102:0/1003803162 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9280063780 con 0x55a8dd039630 2024-09-13T19:18:03.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.100+0000 7f9293121800 1 -- 172.21.15.102:0/1003803162 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a8dd1bc4f0 con 0x55a8dd039630 2024-09-13T19:18:03.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.100+0000 7f917b606640 1 -- 172.21.15.102:0/1003803162 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9280068040 con 0x55a8dd039630 2024-09-13T19:18:03.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.100+0000 7f9293121800 1 -- 172.21.15.102:0/1003803162 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8dd1bca10 con 0x55a8dd039630 2024-09-13T19:18:03.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.101+0000 7f917b606640 1 -- 172.21.15.102:0/1003803162 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9280074070 con 0x55a8dd039630 2024-09-13T19:18:03.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.101+0000 7f917b606640 1 --2- 172.21.15.102:0/1003803162 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9174036b90 0x7f9174039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.101+0000 7f917b606640 1 -- 172.21.15.102:0/1003803162 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f928008f9a0 con 0x55a8dd039630 2024-09-13T19:18:03.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.101+0000 7f928e6ab640 1 --2- 172.21.15.102:0/1003803162 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9174036b90 0x7f9174039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.101+0000 7f9293121800 1 --2- 172.21.15.102:0/1003803162 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55a8dd0c8790 0x55a8dd1c3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.101+0000 7f9293121800 1 -- 172.21.15.102:0/1003803162 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd1c3640 con 0x55a8dd0c8790 2024-09-13T19:18:03.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.101+0000 7f928f6ad640 1 --2- 172.21.15.102:0/1003803162 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55a8dd0c8790 0x55a8dd1c3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.101+0000 7f928e6ab640 1 --2- 172.21.15.102:0/1003803162 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9174036b90 0x7f9174039050 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9284000c00 tx=0x7f92840013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.101+0000 7f928f6ad640 1 --2- 172.21.15.102:0/1003803162 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55a8dd0c8790 0x55a8dd1c3020 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.102+0000 7f928f6ad640 1 -- 172.21.15.102:0/1003803162 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f92880083e0 con 0x55a8dd0c8790 2024-09-13T19:18:03.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.102+0000 7f9293121800 1 -- 172.21.15.102:0/1003803162 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd1c05b0 con 0x55a8dd0c8790 2024-09-13T19:18:03.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.102+0000 7f928f6ad640 1 -- 172.21.15.102:0/1003803162 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f92880083e0 con 0x55a8dd0c8790 2024-09-13T19:18:03.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.102+0000 7f9293121800 1 --2- 172.21.15.102:0/1003803162 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55a8dd1c59a0 0x55a8dd1c7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.102+0000 7f9293121800 1 -- 172.21.15.102:0/1003803162 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd1c8430 con 0x55a8dd1c59a0 2024-09-13T19:18:03.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.102+0000 7f928eeac640 1 --2- 172.21.15.102:0/1003803162 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55a8dd1c59a0 0x55a8dd1c7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.102+0000 7f928eeac640 1 --2- 172.21.15.102:0/1003803162 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55a8dd1c59a0 0x55a8dd1c7d90 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.103+0000 7f928eeac640 1 -- 172.21.15.102:0/1003803162 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9280073030 con 0x55a8dd1c59a0 2024-09-13T19:18:03.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.103+0000 7f9293121800 1 -- 172.21.15.102:0/1003803162 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd1c4840 con 0x55a8dd0c8790 2024-09-13T19:18:03.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.103+0000 7f928f6ad640 1 -- 172.21.15.102:0/1003803162 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f92880083e0 con 0x55a8dd0c8790 2024-09-13T19:18:03.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.103+0000 7f9293121800 1 -- 172.21.15.102:0/1003803162 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd1c4ce0 con 0x55a8dd1c59a0 2024-09-13T19:18:03.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.103+0000 7f928eeac640 1 -- 172.21.15.102:0/1003803162 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9280073030 con 0x55a8dd1c59a0 2024-09-13T19:18:03.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.104+0000 7f9293121800 1 Processor -- start 2024-09-13T19:18:03.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.104+0000 7f9293121800 1 -- start start 2024-09-13T19:18:03.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.104+0000 7f9293121800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8dd0c5c20 0x55a8dd0c4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.104+0000 7f9293121800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a8dcf60580 con 0x55a8dd0c5c20 2024-09-13T19:18:03.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.104+0000 7f928f6ad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8dd0c5c20 0x55a8dd0c4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.104+0000 7f928f6ad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8dd0c5c20 0x55a8dd0c4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49860/0 (socket says 172.21.15.102:49860) 2024-09-13T19:18:03.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.104+0000 7f928f6ad640 1 -- 172.21.15.102:0/4276870300 learned_addr learned my addr 172.21.15.102:0/4276870300 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:03.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.104+0000 7f928f6ad640 1 -- 172.21.15.102:0/4276870300 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8dd0c6040 con 0x55a8dd0c5c20 2024-09-13T19:18:03.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.105+0000 7f928f6ad640 1 --2- 172.21.15.102:0/4276870300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8dd0c5c20 0x55a8dd0c4270 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x55a8dd1bd1d0 tx=0x7f928800beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.105+0000 7f9178e01640 1 -- 172.21.15.102:0/4276870300 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f928801c020 con 0x55a8dd0c5c20 2024-09-13T19:18:03.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.105+0000 7f9178e01640 1 -- 172.21.15.102:0/4276870300 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9288007c30 con 0x55a8dd0c5c20 2024-09-13T19:18:03.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.105+0000 7f9178e01640 1 -- 172.21.15.102:0/4276870300 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9288018440 con 0x55a8dd0c5c20 2024-09-13T19:18:03.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.105+0000 7f9293121800 1 -- 172.21.15.102:0/4276870300 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a8dd0c4870 con 0x55a8dd0c5c20 2024-09-13T19:18:03.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.105+0000 7f9293121800 1 -- 172.21.15.102:0/4276870300 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8dd0c4d70 con 0x55a8dd0c5c20 2024-09-13T19:18:03.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.106+0000 7f9178e01640 1 -- 172.21.15.102:0/4276870300 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f928801f020 con 0x55a8dd0c5c20 2024-09-13T19:18:03.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.106+0000 7f9178e01640 1 --2- 172.21.15.102:0/4276870300 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9168036b90 0x7f9168039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.106+0000 7f9178e01640 1 -- 172.21.15.102:0/4276870300 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f928804e350 con 0x55a8dd0c5c20 2024-09-13T19:18:03.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.106+0000 7f928eeac640 1 --2- 172.21.15.102:0/4276870300 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9168036b90 0x7f9168039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.106+0000 7f9293121800 1 Processor -- start 2024-09-13T19:18:03.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.106+0000 7f928eeac640 1 --2- 172.21.15.102:0/4276870300 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9168036b90 0x7f9168039050 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x55a8dd1c3f50 tx=0x7f928004ff90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.106+0000 7f9293121800 1 -- start start 2024-09-13T19:18:03.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.106+0000 7f9293121800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8dd1e5c70 0x55a8dd1e6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.106+0000 7f9293121800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a8dd1b4dd0 con 0x55a8dd1e5c70 2024-09-13T19:18:03.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.107+0000 7f928f6ad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8dd1e5c70 0x55a8dd1e6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.107+0000 7f928f6ad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8dd1e5c70 0x55a8dd1e6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49864/0 (socket says 172.21.15.102:49864) 2024-09-13T19:18:03.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.107+0000 7f928f6ad640 1 -- 172.21.15.102:0/3615908457 learned_addr learned my addr 172.21.15.102:0/3615908457 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:03.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.107+0000 7f928f6ad640 1 -- 172.21.15.102:0/3615908457 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8dd1e6640 con 0x55a8dd1e5c70 2024-09-13T19:18:03.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.107+0000 7f928f6ad640 1 --2- 172.21.15.102:0/3615908457 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8dd1e5c70 0x55a8dd1e6070 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f928804c600 tx=0x7f9288016640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36f8fa9d4c37c5b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.107+0000 7f91727fc640 1 -- 172.21.15.102:0/3615908457 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9288045070 con 0x55a8dd1e5c70 2024-09-13T19:18:03.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.107+0000 7f91727fc640 1 -- 172.21.15.102:0/3615908457 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92880187c0 con 0x55a8dd1e5c70 2024-09-13T19:18:03.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.107+0000 7f91727fc640 1 -- 172.21.15.102:0/3615908457 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9288021400 con 0x55a8dd1e5c70 2024-09-13T19:18:03.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.108+0000 7f9293121800 1 -- 172.21.15.102:0/3615908457 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8dd1e5c70 msgr2=0x55a8dd1e6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.108+0000 7f9293121800 1 --2- 172.21.15.102:0/3615908457 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8dd1e5c70 0x55a8dd1e6070 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f928804c600 tx=0x7f9288016640 comp rx=0 tx=0).stop 2024-09-13T19:18:03.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.108+0000 7f9293121800 1 -- 172.21.15.102:0/3615908457 shutdown_connections 2024-09-13T19:18:03.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.108+0000 7f9293121800 1 --2- 172.21.15.102:0/3615908457 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8dd1e5c70 0x55a8dd1e6070 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.108+0000 7f9293121800 1 -- 172.21.15.102:0/3615908457 >> 172.21.15.102:0/3615908457 conn(0x55a8dd1e2010 msgr2=0x55a8dd1e0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:03.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.108+0000 7f9293121800 1 -- 172.21.15.102:0/3615908457 shutdown_connections 2024-09-13T19:18:03.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.108+0000 7f9293121800 1 -- 172.21.15.102:0/3615908457 wait complete. 2024-09-13T19:18:03.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.108+0000 7f9293121800 1 Processor -- start 2024-09-13T19:18:03.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.108+0000 7f9293121800 1 -- start start 2024-09-13T19:18:03.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.108+0000 7f9293121800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8dd1e5c70 0x55a8dd1ed0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.108+0000 7f9293121800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a8dd1e6c60 con 0x55a8dd1e5c70 2024-09-13T19:18:03.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.108+0000 7f928f6ad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8dd1e5c70 0x55a8dd1ed0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.108+0000 7f928f6ad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8dd1e5c70 0x55a8dd1ed0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49868/0 (socket says 172.21.15.102:49868) 2024-09-13T19:18:03.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.108+0000 7f928f6ad640 1 -- 172.21.15.102:0/1362337586 learned_addr learned my addr 172.21.15.102:0/1362337586 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:03.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.109+0000 7f928f6ad640 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8dd1ed620 con 0x55a8dd1e5c70 2024-09-13T19:18:03.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.109+0000 7f928f6ad640 1 --2- 172.21.15.102:0/1362337586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8dd1e5c70 0x55a8dd1ed0e0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f9288043040 tx=0x7f928804c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.109+0000 7f9170ff9640 1 -- 172.21.15.102:0/1362337586 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9288045030 con 0x55a8dd1e5c70 2024-09-13T19:18:03.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.109+0000 7f9170ff9640 1 -- 172.21.15.102:0/1362337586 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f928804e130 con 0x55a8dd1e5c70 2024-09-13T19:18:03.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.109+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a8dd1ed8b0 con 0x55a8dd1e5c70 2024-09-13T19:18:03.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.109+0000 7f9170ff9640 1 -- 172.21.15.102:0/1362337586 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f928803fe60 con 0x55a8dd1e5c70 2024-09-13T19:18:03.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.109+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8dd1f0560 con 0x55a8dd1e5c70 2024-09-13T19:18:03.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.110+0000 7f9170ff9640 1 -- 172.21.15.102:0/1362337586 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9288016040 con 0x55a8dd1e5c70 2024-09-13T19:18:03.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.110+0000 7f9170ff9640 1 --2- 172.21.15.102:0/1362337586 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9158036af0 0x7f9158038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.110+0000 7f9170ff9640 1 -- 172.21.15.102:0/1362337586 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f9288046070 con 0x55a8dd1e5c70 2024-09-13T19:18:03.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.110+0000 7f928eeac640 1 --2- 172.21.15.102:0/1362337586 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9158036af0 0x7f9158038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.110+0000 7f928eeac640 1 --2- 172.21.15.102:0/1362337586 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9158036af0 0x7f9158038fb0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f928008f010 tx=0x7f9280085000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.111+0000 7f9293121800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.111+0000 7f9293121800 1 --2- 172.21.15.102:0/1362337586 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55a8dd1f8c20 0x55a8dd1fb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.111+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd1fb830 con 0x55a8dd1f8c20 2024-09-13T19:18:03.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.111+0000 7f928e6ab640 1 --2- 172.21.15.102:0/1362337586 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55a8dd1f8c20 0x55a8dd1fb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.111+0000 7f928e6ab640 1 --2- 172.21.15.102:0/1362337586 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55a8dd1f8c20 0x55a8dd1fb0e0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.111+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f928400f5f0 con 0x55a8dd1f8c20 2024-09-13T19:18:03.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.111+0000 7f9293121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:03.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.111+0000 7f9293121800 20 realm 2024-09-13T19:18:03.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.111+0000 7f9293121800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.111+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd1f8070 con 0x55a8dd1f8c20 2024-09-13T19:18:03.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.112+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f928400f5f0 con 0x55a8dd1f8c20 2024-09-13T19:18:03.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.112+0000 7f9293121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:03.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.112+0000 7f9293121800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:18:03.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.112+0000 7f9293121800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.112+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd1fc320 con 0x55a8dd1f8c20 2024-09-13T19:18:03.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.112+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f928400f5f0 con 0x55a8dd1f8c20 2024-09-13T19:18:03.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.112+0000 7f9293121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:03.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.112+0000 7f9293121800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.112+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd1fcbf0 con 0x55a8dd1f8c20 2024-09-13T19:18:03.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.112+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f928400f5f0 con 0x55a8dd1f8c20 2024-09-13T19:18:03.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.112+0000 7f9293121800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:18:03.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.112+0000 7f9293121800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.112+0000 7f9293121800 1 --2- 172.21.15.102:0/1362337586 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55a8dd1fd610 0x55a8dd1ffa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.112+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd200170 con 0x55a8dd1fd610 2024-09-13T19:18:03.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.112+0000 7f928f6ad640 1 --2- 172.21.15.102:0/1362337586 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55a8dd1fd610 0x55a8dd1ffa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.112+0000 7f928f6ad640 1 --2- 172.21.15.102:0/1362337586 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55a8dd1fd610 0x55a8dd1ffa00 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.113+0000 7f928f6ad640 1 -- 172.21.15.102:0/1362337586 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9288028070 con 0x55a8dd1fd610 2024-09-13T19:18:03.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.113+0000 7f9293121800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:18:03.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.113+0000 7f9293121800 20 searching for the correct realm 2024-09-13T19:18:03.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.113+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd201ac0 con 0x55a8dd1fd610 2024-09-13T19:18:03.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.113+0000 7f928f6ad640 1 -- 172.21.15.102:0/1362337586 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9288028070 con 0x55a8dd1fd610 2024-09-13T19:18:03.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.113+0000 7f928f6ad640 1 --2- 172.21.15.102:0/1362337586 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f9288021020 0x7f9288028780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.113+0000 7f928f6ad640 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd201ac0 con 0x7f9288021020 2024-09-13T19:18:03.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.113+0000 7f928eeac640 1 --2- 172.21.15.102:0/1362337586 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f9288021020 0x7f9288028780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.113+0000 7f928eeac640 1 --2- 172.21.15.102:0/1362337586 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f9288021020 0x7f9288028780 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.114+0000 7f928eeac640 1 -- 172.21.15.102:0/1362337586 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9280084040 con 0x7f9288021020 2024-09-13T19:18:03.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.114+0000 7f928eeac640 1 --2- 172.21.15.102:0/1362337586 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f9280076060 0x7f928006b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.114+0000 7f928eeac640 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd201ac0 con 0x7f9280076060 2024-09-13T19:18:03.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.114+0000 7f928e6ab640 1 --2- 172.21.15.102:0/1362337586 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f9280076060 0x7f928006b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.114+0000 7f928e6ab640 1 --2- 172.21.15.102:0/1362337586 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f9280076060 0x7f928006b350 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.115+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f928400f5f0 con 0x7f9280076060 2024-09-13T19:18:03.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.115+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd201ac0 con 0x55a8dd1f8c20 2024-09-13T19:18:03.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.115+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f928400f5f0 con 0x55a8dd1f8c20 2024-09-13T19:18:03.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.115+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd201ac0 con 0x55a8dd1f8c20 2024-09-13T19:18:03.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.115+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f928402b040 con 0x55a8dd1f8c20 2024-09-13T19:18:03.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.116+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd201ac0 con 0x7f9280076060 2024-09-13T19:18:03.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.116+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f928402b040 con 0x7f9280076060 2024-09-13T19:18:03.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.116+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd201ac0 con 0x7f9280076060 2024-09-13T19:18:03.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.116+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f928402b040 con 0x7f9280076060 2024-09-13T19:18:03.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.116+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd201ac0 con 0x7f9288021020 2024-09-13T19:18:03.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.116+0000 7f928eeac640 1 -- 172.21.15.102:0/1362337586 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9280084040 con 0x7f9288021020 2024-09-13T19:18:03.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.116+0000 7f928eeac640 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd201ac0 con 0x55a8dd1fd610 2024-09-13T19:18:03.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.116+0000 7f928f6ad640 1 -- 172.21.15.102:0/1362337586 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f928805d040 con 0x55a8dd1fd610 2024-09-13T19:18:03.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.117+0000 7f928f6ad640 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd201ac0 con 0x55a8dd1f8c20 2024-09-13T19:18:03.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.117+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f928402b040 con 0x55a8dd1f8c20 2024-09-13T19:18:03.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.117+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd201ac0 con 0x7f9288021020 2024-09-13T19:18:03.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.117+0000 7f928eeac640 1 -- 172.21.15.102:0/1362337586 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9280084040 con 0x7f9288021020 2024-09-13T19:18:03.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.117+0000 7f928eeac640 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd201ac0 con 0x55a8dd1f8c20 2024-09-13T19:18:03.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.117+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f928402b040 con 0x55a8dd1f8c20 2024-09-13T19:18:03.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.117+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd201ac0 con 0x7f9288021020 2024-09-13T19:18:03.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.117+0000 7f928eeac640 1 -- 172.21.15.102:0/1362337586 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9280084040 con 0x7f9288021020 2024-09-13T19:18:03.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.117+0000 7f928eeac640 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd201ac0 con 0x55a8dd1fd610 2024-09-13T19:18:03.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.118+0000 7f928f6ad640 1 -- 172.21.15.102:0/1362337586 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f928805d040 con 0x55a8dd1fd610 2024-09-13T19:18:03.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.118+0000 7f928f6ad640 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd201ac0 con 0x55a8dd1fd610 2024-09-13T19:18:03.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.118+0000 7f928f6ad640 1 -- 172.21.15.102:0/1362337586 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f928805d040 con 0x55a8dd1fd610 2024-09-13T19:18:03.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.118+0000 7f928f6ad640 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd201ac0 con 0x7f9280076060 2024-09-13T19:18:03.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.118+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f928402b040 con 0x7f9280076060 2024-09-13T19:18:03.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.118+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd201ac0 con 0x55a8dd1fd610 2024-09-13T19:18:03.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.119+0000 7f928f6ad640 1 -- 172.21.15.102:0/1362337586 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f928805d040 con 0x55a8dd1fd610 2024-09-13T19:18:03.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.119+0000 7f928f6ad640 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd201ac0 con 0x55a8dd1fd610 2024-09-13T19:18:03.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.119+0000 7f928f6ad640 1 -- 172.21.15.102:0/1362337586 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f928805d040 con 0x55a8dd1fd610 2024-09-13T19:18:03.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.119+0000 7f928f6ad640 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd201ac0 con 0x55a8dd1f8c20 2024-09-13T19:18:03.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.119+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f928402b040 con 0x55a8dd1f8c20 2024-09-13T19:18:03.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.119+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd201ac0 con 0x55a8dd1f8c20 2024-09-13T19:18:03.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.119+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f928402b040 con 0x55a8dd1f8c20 2024-09-13T19:18:03.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.119+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd201ac0 con 0x7f9280076060 2024-09-13T19:18:03.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.120+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f928402b040 con 0x7f9280076060 2024-09-13T19:18:03.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.120+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd201ac0 con 0x55a8dd1fd610 2024-09-13T19:18:03.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.120+0000 7f928f6ad640 1 -- 172.21.15.102:0/1362337586 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f928805d040 con 0x55a8dd1fd610 2024-09-13T19:18:03.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.120+0000 7f928f6ad640 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd201ac0 con 0x7f9288021020 2024-09-13T19:18:03.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.120+0000 7f928eeac640 1 -- 172.21.15.102:0/1362337586 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9280084040 con 0x7f9288021020 2024-09-13T19:18:03.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.120+0000 7f928eeac640 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd201ac0 con 0x55a8dd1f8c20 2024-09-13T19:18:03.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.120+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f928402b040 con 0x55a8dd1f8c20 2024-09-13T19:18:03.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.120+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd201ac0 con 0x7f9288021020 2024-09-13T19:18:03.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.121+0000 7f928eeac640 1 -- 172.21.15.102:0/1362337586 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9280084040 con 0x7f9288021020 2024-09-13T19:18:03.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.121+0000 7f928eeac640 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd201ac0 con 0x55a8dd1fd610 2024-09-13T19:18:03.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.121+0000 7f928f6ad640 1 -- 172.21.15.102:0/1362337586 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f928805d040 con 0x55a8dd1fd610 2024-09-13T19:18:03.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.121+0000 7f928f6ad640 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd201ac0 con 0x7f9280076060 2024-09-13T19:18:03.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.121+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f928402b040 con 0x7f9280076060 2024-09-13T19:18:03.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.121+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd201ac0 con 0x7f9288021020 2024-09-13T19:18:03.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.121+0000 7f928eeac640 1 -- 172.21.15.102:0/1362337586 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9280084040 con 0x7f9288021020 2024-09-13T19:18:03.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.121+0000 7f928eeac640 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd201ac0 con 0x55a8dd1fd610 2024-09-13T19:18:03.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.122+0000 7f928f6ad640 1 -- 172.21.15.102:0/1362337586 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f928805d040 con 0x55a8dd1fd610 2024-09-13T19:18:03.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.122+0000 7f928f6ad640 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f9288069040 con 0x7f9280076060 2024-09-13T19:18:03.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.122+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f928402b040 con 0x7f9280076060 2024-09-13T19:18:03.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.122+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f9288069040 con 0x55a8dd1f8c20 2024-09-13T19:18:03.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.122+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v36'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f928402b040 con 0x55a8dd1f8c20 2024-09-13T19:18:03.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.122+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f9288069040 con 0x7f9288021020 2024-09-13T19:18:03.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.122+0000 7f928eeac640 1 -- 172.21.15.102:0/1362337586 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9280084040 con 0x7f9288021020 2024-09-13T19:18:03.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.122+0000 7f9293121800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:18:03.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.122+0000 7f9293121800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:18:03.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.122+0000 7f9293121800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:18:03.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.122+0000 7f9293121800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:18:03.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.122+0000 7f9293121800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:18:03.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.122+0000 7f9293121800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:18:03.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.122+0000 7f9293121800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.122+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd200b30 con 0x55a8dd1f8c20 2024-09-13T19:18:03.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.123+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f928402b040 con 0x55a8dd1f8c20 2024-09-13T19:18:03.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.123+0000 7f9293121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:03.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.123+0000 7f9293121800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.123+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd2013d0 con 0x55a8dd1f8c20 2024-09-13T19:18:03.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.123+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f928402b040 con 0x55a8dd1f8c20 2024-09-13T19:18:03.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.123+0000 7f9293121800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:18:03.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.123+0000 7f9293121800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.123+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd201f40 con 0x55a8dd1fd610 2024-09-13T19:18:03.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.123+0000 7f928f6ad640 1 -- 172.21.15.102:0/1362337586 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f928805d040 con 0x55a8dd1fd610 2024-09-13T19:18:03.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.123+0000 7f9293121800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:18:03.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.123+0000 7f9293121800 20 zone default found 2024-09-13T19:18:03.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.123+0000 7f9293121800 4 Realm: () 2024-09-13T19:18:03.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.123+0000 7f9293121800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:18:03.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.123+0000 7f9293121800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:18:03.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.123+0000 7f9293121800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:18:03.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.123+0000 7f9293121800 20 zonegroup default 2024-09-13T19:18:03.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.123+0000 7f9293121800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.123+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd202330 con 0x7f9288021020 2024-09-13T19:18:03.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.124+0000 7f928eeac640 1 -- 172.21.15.102:0/1362337586 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9280084040 con 0x7f9288021020 2024-09-13T19:18:03.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.124+0000 7f9293121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:03.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.124+0000 7f9293121800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.124+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd204600 con 0x55a8dd1fd610 2024-09-13T19:18:03.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.124+0000 7f928f6ad640 1 -- 172.21.15.102:0/1362337586 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f928805d040 con 0x55a8dd1fd610 2024-09-13T19:18:03.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.124+0000 7f9293121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:03.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.124+0000 7f9293121800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.124+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd204600 con 0x55a8dd1fd610 2024-09-13T19:18:03.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.124+0000 7f928f6ad640 1 -- 172.21.15.102:0/1362337586 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f928805d040 con 0x55a8dd1fd610 2024-09-13T19:18:03.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.124+0000 7f9293121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:03.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.124+0000 7f9293121800 20 started sync module instance, tier type = 2024-09-13T19:18:03.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.124+0000 7f9293121800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:18:03.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.124+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd203a40 con 0x7f9288021020 2024-09-13T19:18:03.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.125+0000 7f928eeac640 1 -- 172.21.15.102:0/1362337586 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(44 notify.0 [create] v36'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9280084040 con 0x7f9288021020 2024-09-13T19:18:03.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.125+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94183752744416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd2046b0 con 0x7f9288021020 2024-09-13T19:18:03.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.125+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd204f60 con 0x55a8dd1f8c20 2024-09-13T19:18:03.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.126+0000 7f928eeac640 1 -- 172.21.15.102:0/1362337586 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94183752744416] v36'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9280084040 con 0x7f9288021020 2024-09-13T19:18:03.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.126+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v36'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f928402b040 con 0x55a8dd1f8c20 2024-09-13T19:18:03.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.126+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94183752745472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd205800 con 0x55a8dd1f8c20 2024-09-13T19:18:03.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.126+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd2061c0 con 0x55a8dd1fd610 2024-09-13T19:18:03.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.127+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94183752745472] v36'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f928402b040 con 0x55a8dd1f8c20 2024-09-13T19:18:03.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.128+0000 7f928f6ad640 1 -- 172.21.15.102:0/1362337586 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v36'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f928805d040 con 0x55a8dd1fd610 2024-09-13T19:18:03.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.128+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94183752750384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd2061c0 con 0x55a8dd1fd610 2024-09-13T19:18:03.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.128+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd206c00 con 0x7f9288021020 2024-09-13T19:18:03.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.129+0000 7f928f6ad640 1 -- 172.21.15.102:0/1362337586 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94183752750384] v36'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f928805d040 con 0x55a8dd1fd610 2024-09-13T19:18:03.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.129+0000 7f928eeac640 1 -- 172.21.15.102:0/1362337586 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(50 notify.3 [create] v36'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9280084040 con 0x7f9288021020 2024-09-13T19:18:03.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.129+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94183752754896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd2061c0 con 0x7f9288021020 2024-09-13T19:18:03.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.129+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd207680 con 0x55a8dd1f8c20 2024-09-13T19:18:03.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.130+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v36'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f928402b040 con 0x55a8dd1f8c20 2024-09-13T19:18:03.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.130+0000 7f928eeac640 1 -- 172.21.15.102:0/1362337586 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94183752754896] v36'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9280084040 con 0x7f9288021020 2024-09-13T19:18:03.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.130+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94183752757648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd207680 con 0x55a8dd1f8c20 2024-09-13T19:18:03.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.130+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd205d10 con 0x7f9280076060 2024-09-13T19:18:03.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.131+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(54 notify.5 [create] v36'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f928402b040 con 0x7f9280076060 2024-09-13T19:18:03.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.131+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94183752761712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd205d10 con 0x7f9280076060 2024-09-13T19:18:03.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.131+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd209100 con 0x7f9280076060 2024-09-13T19:18:03.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.131+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94183752757648] v36'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f928402b040 con 0x55a8dd1f8c20 2024-09-13T19:18:03.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.132+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94183752761712] v36'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f928402b040 con 0x7f9280076060 2024-09-13T19:18:03.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.132+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(56 notify.6 [create] v36'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f928402b040 con 0x7f9280076060 2024-09-13T19:18:03.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.132+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94183752762768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd209100 con 0x7f9280076060 2024-09-13T19:18:03.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.132+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd2099a0 con 0x7f9280076060 2024-09-13T19:18:03.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.133+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94183752762768] v36'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f928402b040 con 0x7f9280076060 2024-09-13T19:18:03.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.133+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(58 notify.7 [create] v36'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f928402b040 con 0x7f9280076060 2024-09-13T19:18:03.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.133+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94183752764384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd209100 con 0x7f9280076060 2024-09-13T19:18:03.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.133+0000 7f9293121800 20 add_watcher() i=0 2024-09-13T19:18:03.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.133+0000 7f9293121800 20 add_watcher() i=1 2024-09-13T19:18:03.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.133+0000 7f9293121800 20 add_watcher() i=2 2024-09-13T19:18:03.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.133+0000 7f9293121800 20 add_watcher() i=3 2024-09-13T19:18:03.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.133+0000 7f9293121800 20 add_watcher() i=4 2024-09-13T19:18:03.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.133+0000 7f9293121800 20 add_watcher() i=5 2024-09-13T19:18:03.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.133+0000 7f9293121800 20 add_watcher() i=6 2024-09-13T19:18:03.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.134+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94183752764384] v36'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f928402b040 con 0x7f9280076060 2024-09-13T19:18:03.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.134+0000 7f9293121800 20 add_watcher() i=7 2024-09-13T19:18:03.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.134+0000 7f9293121800 2 all 8 watchers are set, enabling cache 2024-09-13T19:18:03.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.134+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd20c9d0 con 0x55a8dd1f8c20 2024-09-13T19:18:03.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.135+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f928402b040 con 0x55a8dd1f8c20 2024-09-13T19:18:03.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.135+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94183752766704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd209e30 con 0x55a8dd1f8c20 2024-09-13T19:18:03.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.136+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94183752766704] v36'252 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f928402b040 con 0x55a8dd1f8c20 2024-09-13T19:18:03.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.136+0000 7f91457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:18:03.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.136+0000 7f9293121800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:18:03.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.136+0000 7f9293121800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:18:03.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.136+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd215440 con 0x55a8dd1f8c20 2024-09-13T19:18:03.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.137+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v36'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f928402b040 con 0x55a8dd1f8c20 2024-09-13T19:18:03.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.137+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd215a90 con 0x7f9280076060 2024-09-13T19:18:03.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.138+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v36'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f928402b040 con 0x7f9280076060 2024-09-13T19:18:03.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.138+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd215ed0 con 0x55a8dd1fd610 2024-09-13T19:18:03.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.139+0000 7f928f6ad640 1 -- 172.21.15.102:0/1362337586 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v36'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f928805d040 con 0x55a8dd1fd610 2024-09-13T19:18:03.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.139+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd215e20 con 0x55a8dd1f8c20 2024-09-13T19:18:03.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.140+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v36'253 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f928402b040 con 0x55a8dd1f8c20 2024-09-13T19:18:03.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.140+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd216390 con 0x7f9288021020 2024-09-13T19:18:03.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.141+0000 7f928eeac640 1 -- 172.21.15.102:0/1362337586 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v36'82 uv55 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9280084040 con 0x7f9288021020 2024-09-13T19:18:03.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.141+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd216840 con 0x55a8dd1fd610 2024-09-13T19:18:03.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.142+0000 7f928f6ad640 1 -- 172.21.15.102:0/1362337586 <== osd.3 v2:172.21.15.102:6800/3096737090 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v36'54 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f928805d040 con 0x55a8dd1fd610 2024-09-13T19:18:03.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.142+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd216840 con 0x55a8dd1f8c20 2024-09-13T19:18:03.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.144+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v36'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f928402b040 con 0x55a8dd1f8c20 2024-09-13T19:18:03.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.144+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd2166d0 con 0x7f9280076060 2024-09-13T19:18:03.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.145+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(69 gc.7 [create,call,call,call] v36'53 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f928402b040 con 0x7f9280076060 2024-09-13T19:18:03.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.145+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd2167c0 con 0x7f9288021020 2024-09-13T19:18:03.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.146+0000 7f928eeac640 1 -- 172.21.15.102:0/1362337586 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v36'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9280084040 con 0x7f9288021020 2024-09-13T19:18:03.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.146+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd2167c0 con 0x55a8dd1fd610 2024-09-13T19:18:03.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.147+0000 7f928f6ad640 1 -- 172.21.15.102:0/1362337586 <== osd.3 v2:172.21.15.102:6800/3096737090 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v36'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f928805d040 con 0x55a8dd1fd610 2024-09-13T19:18:03.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.147+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd216d00 con 0x7f9288021020 2024-09-13T19:18:03.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.148+0000 7f928eeac640 1 -- 172.21.15.102:0/1362337586 <== osd.2 v2:172.21.15.102:6816/2238176080 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v36'83 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9280084040 con 0x7f9288021020 2024-09-13T19:18:03.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.148+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd216d00 con 0x7f9280076060 2024-09-13T19:18:03.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.149+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v36'37 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f928402b040 con 0x7f9280076060 2024-09-13T19:18:03.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.149+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd216d00 con 0x7f9288021020 2024-09-13T19:18:03.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.149+0000 7f928eeac640 1 -- 172.21.15.102:0/1362337586 <== osd.2 v2:172.21.15.102:6816/2238176080 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v36'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9280084040 con 0x7f9288021020 2024-09-13T19:18:03.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.149+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd216d00 con 0x7f9280076060 2024-09-13T19:18:03.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.151+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(75 gc.13 [create,call,call,call] v36'59 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f928402b040 con 0x7f9280076060 2024-09-13T19:18:03.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.151+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd216d00 con 0x55a8dd1f8c20 2024-09-13T19:18:03.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.152+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v36'254 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f928402b040 con 0x55a8dd1f8c20 2024-09-13T19:18:03.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.152+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd216d00 con 0x55a8dd1fd610 2024-09-13T19:18:03.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.153+0000 7f928f6ad640 1 -- 172.21.15.102:0/1362337586 <== osd.3 v2:172.21.15.102:6800/3096737090 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v36'74 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f928805d040 con 0x55a8dd1fd610 2024-09-13T19:18:03.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.153+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd216d00 con 0x7f9288021020 2024-09-13T19:18:03.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.154+0000 7f928eeac640 1 -- 172.21.15.102:0/1362337586 <== osd.2 v2:172.21.15.102:6816/2238176080 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v36'84 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9280084040 con 0x7f9288021020 2024-09-13T19:18:03.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.154+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd217100 con 0x55a8dd1fd610 2024-09-13T19:18:03.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.154+0000 7f928f6ad640 1 -- 172.21.15.102:0/1362337586 <== osd.3 v2:172.21.15.102:6800/3096737090 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v36'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f928805d040 con 0x55a8dd1fd610 2024-09-13T19:18:03.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.154+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd217100 con 0x55a8dd1f8c20 2024-09-13T19:18:03.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.156+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v36'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f928402b040 con 0x55a8dd1f8c20 2024-09-13T19:18:03.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.156+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd217100 con 0x55a8dd1f8c20 2024-09-13T19:18:03.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.157+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v36'255 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f928402b040 con 0x55a8dd1f8c20 2024-09-13T19:18:03.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.157+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd217100 con 0x55a8dd1fd610 2024-09-13T19:18:03.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.158+0000 7f928f6ad640 1 -- 172.21.15.102:0/1362337586 <== osd.3 v2:172.21.15.102:6800/3096737090 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v36'75 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f928805d040 con 0x55a8dd1fd610 2024-09-13T19:18:03.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.158+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd217100 con 0x7f9288021020 2024-09-13T19:18:03.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.159+0000 7f928eeac640 1 -- 172.21.15.102:0/1362337586 <== osd.2 v2:172.21.15.102:6816/2238176080 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v36'40 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9280084040 con 0x7f9288021020 2024-09-13T19:18:03.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.159+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd217100 con 0x55a8dd1fd610 2024-09-13T19:18:03.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.159+0000 7f928f6ad640 1 -- 172.21.15.102:0/1362337586 <== osd.3 v2:172.21.15.102:6800/3096737090 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v36'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f928805d040 con 0x55a8dd1fd610 2024-09-13T19:18:03.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.159+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd217100 con 0x55a8dd1fd610 2024-09-13T19:18:03.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.160+0000 7f928f6ad640 1 -- 172.21.15.102:0/1362337586 <== osd.3 v2:172.21.15.102:6800/3096737090 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v36'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f928805d040 con 0x55a8dd1fd610 2024-09-13T19:18:03.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.161+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd217100 con 0x55a8dd1fd610 2024-09-13T19:18:03.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.161+0000 7f928f6ad640 1 -- 172.21.15.102:0/1362337586 <== osd.3 v2:172.21.15.102:6800/3096737090 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v36'26 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f928805d040 con 0x55a8dd1fd610 2024-09-13T19:18:03.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.161+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd217100 con 0x55a8dd1fd610 2024-09-13T19:18:03.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.162+0000 7f928f6ad640 1 -- 172.21.15.102:0/1362337586 <== osd.3 v2:172.21.15.102:6800/3096737090 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v36'55 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f928805d040 con 0x55a8dd1fd610 2024-09-13T19:18:03.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.162+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd217100 con 0x7f9280076060 2024-09-13T19:18:03.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.164+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(88 gc.26 [create,call,call,call] v36'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f928402b040 con 0x7f9280076060 2024-09-13T19:18:03.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.164+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd217100 con 0x55a8dd1fd610 2024-09-13T19:18:03.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.165+0000 7f928f6ad640 1 -- 172.21.15.102:0/1362337586 <== osd.3 v2:172.21.15.102:6800/3096737090 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v36'32 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f928805d040 con 0x55a8dd1fd610 2024-09-13T19:18:03.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.165+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd217100 con 0x7f9280076060 2024-09-13T19:18:03.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.166+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(90 gc.28 [create,call,call,call] v36'54 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f928402b040 con 0x7f9280076060 2024-09-13T19:18:03.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.166+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd217100 con 0x55a8dd1fd610 2024-09-13T19:18:03.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.167+0000 7f928f6ad640 1 -- 172.21.15.102:0/1362337586 <== osd.3 v2:172.21.15.102:6800/3096737090 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v36'76 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f928805d040 con 0x55a8dd1fd610 2024-09-13T19:18:03.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.167+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd217100 con 0x7f9280076060 2024-09-13T19:18:03.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.168+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.0 v2:172.21.15.53:6800/4021716951 20 ==== osd_op_reply(92 gc.30 [create,call,call,call] v36'60 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f928402b040 con 0x7f9280076060 2024-09-13T19:18:03.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.168+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd217100 con 0x7f9288021020 2024-09-13T19:18:03.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.169+0000 7f928eeac640 1 -- 172.21.15.102:0/1362337586 <== osd.2 v2:172.21.15.102:6816/2238176080 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v36'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9280084040 con 0x7f9288021020 2024-09-13T19:18:03.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.169+0000 7f90bffff640 20 reqs_thread_entry: start 2024-09-13T19:18:03.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.169+0000 7f9293121800 20 init_complete bucket index max shards: 11 2024-09-13T19:18:03.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.169+0000 7f9293121800 20 Filter name: none 2024-09-13T19:18:03.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.169+0000 7f90bdffb640 20 reqs_thread_entry: start 2024-09-13T19:18:03.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.169+0000 7f9293121800 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-13T19:18:03.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.169+0000 7f9293121800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.169+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:94 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd241c40 con 0x55a8dd1fd610 2024-09-13T19:18:03.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.170+0000 7f928f6ad640 1 -- 172.21.15.102:0/1362337586 <== osd.3 v2:172.21.15.102:6800/3096737090 28 ==== osd_op_reply(94 a_user [call out=48b,read 0~363 out=363b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 234+0+486 (crc 0 0 0) 0x7f928805d040 con 0x55a8dd1fd610 2024-09-13T19:18:03.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.170+0000 7f9293121800 20 rados_obj.operate() r=0 bl.length=363 2024-09-13T19:18:03.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.170+0000 7f9293121800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x13 2024-09-13T19:18:03.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.170+0000 7f9293121800 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-13T19:18:03.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.170+0000 7f9293121800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:18:03.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.170+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:95 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd2446d0 con 0x55a8dd1fd610 2024-09-13T19:18:03.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.170+0000 7f928f6ad640 1 -- 172.21.15.102:0/1362337586 <== osd.3 v2:172.21.15.102:6800/3096737090 29 ==== osd_op_reply(95 a_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f928805d040 con 0x55a8dd1fd610 2024-09-13T19:18:03.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.170+0000 7f9293121800 10 removing key index: true_admin_akey 2024-09-13T19:18:03.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.170+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:96 8.15 8:afe09604:users.keys::true_admin_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd2426b0 con 0x55a8dd1fd610 2024-09-13T19:18:03.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.171+0000 7f928f6ad640 1 -- 172.21.15.102:0/1362337586 <== osd.3 v2:172.21.15.102:6800/3096737090 30 ==== osd_op_reply(96 true_admin_akey [delete] v36'4 uv4 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f928806d040 con 0x55a8dd1fd610 2024-09-13T19:18:03.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.171+0000 7f9293121800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-13T19:18:03.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.171+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify cookie 94183753003456 in=177b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd244c00 con 0x7f9280076060 2024-09-13T19:18:03.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.171+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.0 v2:172.21.15.53:6800/4021716951 21 ==== watch-notify(notify (1) cookie 94183752761712 notify 154618822697 ret 0) ==== 207+0+0 (crc 0 0 0) 0x55a8dd215000 con 0x7f9280076060 2024-09-13T19:18:03.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.171+0000 7f91727fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822697 cookie 94183752761712 notifier 4874 bl.length()=165 2024-09-13T19:18:03.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.171+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.0 v2:172.21.15.53:6800/4021716951 22 ==== osd_op_reply(97 notify.5 [notify cookie 94183753003456 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f928402b040 con 0x7f9280076060 2024-09-13T19:18:03.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.171+0000 7f91727fc640 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f9154003d60 con 0x7f9280076060 2024-09-13T19:18:03.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.172+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.0 v2:172.21.15.53:6800/4021716951 23 ==== osd_op_reply(98 notify.5 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f928402b040 con 0x7f9280076060 2024-09-13T19:18:03.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.172+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.0 v2:172.21.15.53:6800/4021716951 24 ==== watch-notify(notify_complete (2) cookie 94183753003456 notify 154618822697 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a8dd1ed8b0 con 0x7f9280076060 2024-09-13T19:18:03.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.172+0000 7f9293121800 10 removing email index: 2024-09-13T19:18:03.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.172+0000 7f9293121800 10 removing user buckets index 2024-09-13T19:18:03.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.172+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:99 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd2421b0 con 0x55a8dd1fd610 2024-09-13T19:18:03.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.173+0000 7f928f6ad640 1 -- 172.21.15.102:0/1362337586 <== osd.3 v2:172.21.15.102:6800/3096737090 31 ==== osd_op_reply(99 a_user.buckets [delete] v36'3 uv2 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f928806d040 con 0x55a8dd1fd610 2024-09-13T19:18:03.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.173+0000 7f9293121800 10 removing user index: a_user 2024-09-13T19:18:03.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.173+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:100 8.14 8:2efb937b:users.uid::a_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd246b80 con 0x55a8dd1fd610 2024-09-13T19:18:03.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.174+0000 7f928f6ad640 1 -- 172.21.15.102:0/1362337586 <== osd.3 v2:172.21.15.102:6800/3096737090 32 ==== osd_op_reply(100 a_user [call,call,delete] v36'2 uv2 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f928806d040 con 0x55a8dd1fd610 2024-09-13T19:18:03.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.174+0000 7f9293121800 10 removing default.rgw.meta+users.uid+a_user from cache 2024-09-13T19:18:03.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.174+0000 7f9293121800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-13T19:18:03.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.174+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [notify cookie 94183753008720 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd243670 con 0x55a8dd1fd610 2024-09-13T19:18:03.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.174+0000 7f928f6ad640 1 -- 172.21.15.102:0/1362337586 <== osd.3 v2:172.21.15.102:6800/3096737090 33 ==== watch-notify(notify (1) cookie 94183752750384 notify 154618822666 ret 0) ==== 197+0+0 (crc 0 0 0) 0x55a8dd215e20 con 0x55a8dd1fd610 2024-09-13T19:18:03.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.174+0000 7f91727fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822666 cookie 94183752750384 notifier 4874 bl.length()=155 2024-09-13T19:18:03.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.174+0000 7f91727fc640 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:102 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f9154003d60 con 0x55a8dd1fd610 2024-09-13T19:18:03.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.174+0000 7f928f6ad640 1 -- 172.21.15.102:0/1362337586 <== osd.3 v2:172.21.15.102:6800/3096737090 34 ==== osd_op_reply(101 notify.2 [notify cookie 94183753008720 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f928806d040 con 0x55a8dd1fd610 2024-09-13T19:18:03.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.174+0000 7f928f6ad640 1 -- 172.21.15.102:0/1362337586 <== osd.3 v2:172.21.15.102:6800/3096737090 35 ==== watch-notify(notify_complete (2) cookie 94183753008720 notify 154618822666 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a8dd1ed620 con 0x55a8dd1fd610 2024-09-13T19:18:03.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.174+0000 7f928f6ad640 1 -- 172.21.15.102:0/1362337586 <== osd.3 v2:172.21.15.102:6800/3096737090 36 ==== osd_op_reply(102 notify.2 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f928806d040 con 0x55a8dd1fd610 2024-09-13T19:18:03.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.175+0000 7f91457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:18:03.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.175+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94183752766704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd212e60 con 0x55a8dd1f8c20 2024-09-13T19:18:03.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.176+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94183752766704] v36'256 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f928402b040 con 0x55a8dd1f8c20 2024-09-13T19:18:03.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.176+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94183752744416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd2094a0 con 0x7f9288021020 2024-09-13T19:18:03.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.177+0000 7f928eeac640 1 -- 172.21.15.102:0/1362337586 <== osd.2 v2:172.21.15.102:6816/2238176080 21 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94183752744416] v36'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9280084040 con 0x7f9288021020 2024-09-13T19:18:03.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.177+0000 7f9293121800 20 remove_watcher() i=0 2024-09-13T19:18:03.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.177+0000 7f9293121800 2 removed watcher, disabling cache 2024-09-13T19:18:03.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.177+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94183752745472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd203de0 con 0x55a8dd1f8c20 2024-09-13T19:18:03.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.178+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.1 v2:172.21.15.102:6808/2204418452 28 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94183752745472] v36'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f928402b040 con 0x55a8dd1f8c20 2024-09-13T19:18:03.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.178+0000 7f9293121800 20 remove_watcher() i=1 2024-09-13T19:18:03.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.178+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94183752750384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd2094a0 con 0x55a8dd1fd610 2024-09-13T19:18:03.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.179+0000 7f928f6ad640 1 -- 172.21.15.102:0/1362337586 <== osd.3 v2:172.21.15.102:6800/3096737090 37 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94183752750384] v36'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f928806d040 con 0x55a8dd1fd610 2024-09-13T19:18:03.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.179+0000 7f9293121800 20 remove_watcher() i=2 2024-09-13T19:18:03.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.179+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94183752754896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd205530 con 0x7f9288021020 2024-09-13T19:18:03.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.180+0000 7f928eeac640 1 -- 172.21.15.102:0/1362337586 <== osd.2 v2:172.21.15.102:6816/2238176080 22 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94183752754896] v36'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9280084040 con 0x7f9288021020 2024-09-13T19:18:03.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.180+0000 7f9293121800 20 remove_watcher() i=3 2024-09-13T19:18:03.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.180+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94183752757648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd205530 con 0x55a8dd1f8c20 2024-09-13T19:18:03.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.181+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.1 v2:172.21.15.102:6808/2204418452 29 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94183752757648] v36'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f928402b040 con 0x55a8dd1f8c20 2024-09-13T19:18:03.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.181+0000 7f9293121800 20 remove_watcher() i=4 2024-09-13T19:18:03.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.181+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94183752761712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd205530 con 0x7f9280076060 2024-09-13T19:18:03.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.182+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.0 v2:172.21.15.53:6800/4021716951 25 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94183752761712] v36'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f928402b040 con 0x7f9280076060 2024-09-13T19:18:03.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.182+0000 7f9293121800 20 remove_watcher() i=5 2024-09-13T19:18:03.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.182+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94183752762768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd208170 con 0x7f9280076060 2024-09-13T19:18:03.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.184+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.0 v2:172.21.15.53:6800/4021716951 26 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94183752762768] v36'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f928402b040 con 0x7f9280076060 2024-09-13T19:18:03.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.184+0000 7f9293121800 20 remove_watcher() i=6 2024-09-13T19:18:03.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.184+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94183752764384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a8dd205530 con 0x7f9280076060 2024-09-13T19:18:03.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.185+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 <== osd.0 v2:172.21.15.53:6800/4021716951 27 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94183752764384] v36'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f928402b040 con 0x7f9280076060 2024-09-13T19:18:03.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.185+0000 7f9293121800 20 remove_watcher() i=7 2024-09-13T19:18:03.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.185+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f9280076060 msgr2=0x7f928006b350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.185+0000 7f9293121800 1 --2- 172.21.15.102:0/1362337586 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f9280076060 0x7f928006b350 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.185+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55a8dd1f8c20 msgr2=0x55a8dd1fb0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.185+0000 7f9293121800 1 --2- 172.21.15.102:0/1362337586 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55a8dd1f8c20 0x55a8dd1fb0e0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.185+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f9288021020 msgr2=0x7f9288028780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.185+0000 7f9293121800 1 --2- 172.21.15.102:0/1362337586 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f9288021020 0x7f9288028780 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.185+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55a8dd1fd610 msgr2=0x55a8dd1ffa00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.185+0000 7f9293121800 1 --2- 172.21.15.102:0/1362337586 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55a8dd1fd610 0x55a8dd1ffa00 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.185+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9158036af0 msgr2=0x7f9158038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.185+0000 7f9293121800 1 --2- 172.21.15.102:0/1362337586 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9158036af0 0x7f9158038fb0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f928008f010 tx=0x7f9280085000 comp rx=0 tx=0).stop 2024-09-13T19:18:03.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.185+0000 7f928e6ab640 1 -- 172.21.15.102:0/1362337586 reap_dead start 2024-09-13T19:18:03.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.185+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8dd1e5c70 msgr2=0x55a8dd1ed0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.185+0000 7f9293121800 1 --2- 172.21.15.102:0/1362337586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8dd1e5c70 0x55a8dd1ed0e0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f9288043040 tx=0x7f928804c560 comp rx=0 tx=0).stop 2024-09-13T19:18:03.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.185+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 shutdown_connections 2024-09-13T19:18:03.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.185+0000 7f9293121800 1 --2- 172.21.15.102:0/1362337586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8dd1e5c70 0x55a8dd1ed0e0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.185+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 >> 172.21.15.102:0/1362337586 conn(0x55a8dd1e2010 msgr2=0x55a8dd1e00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:03.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.185+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 shutdown_connections 2024-09-13T19:18:03.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.185+0000 7f9293121800 1 -- 172.21.15.102:0/1362337586 wait complete. 2024-09-13T19:18:03.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.185+0000 7f9293121800 1 -- 172.21.15.102:0/4276870300 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9168036b90 msgr2=0x7f9168039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.185+0000 7f9293121800 1 --2- 172.21.15.102:0/4276870300 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9168036b90 0x7f9168039050 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x55a8dd1c3f50 tx=0x7f928004ff90 comp rx=0 tx=0).stop 2024-09-13T19:18:03.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.185+0000 7f9293121800 1 -- 172.21.15.102:0/4276870300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8dd0c5c20 msgr2=0x55a8dd0c4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.185+0000 7f9293121800 1 --2- 172.21.15.102:0/4276870300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8dd0c5c20 0x55a8dd0c4270 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x55a8dd1bd1d0 tx=0x7f928800beb0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.185+0000 7f9293121800 1 -- 172.21.15.102:0/4276870300 shutdown_connections 2024-09-13T19:18:03.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.185+0000 7f9293121800 1 --2- 172.21.15.102:0/4276870300 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9168036b90 0x7f9168039050 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.185+0000 7f9293121800 1 --2- 172.21.15.102:0/4276870300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8dd0c5c20 0x55a8dd0c4270 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.185+0000 7f9293121800 1 -- 172.21.15.102:0/4276870300 >> 172.21.15.102:0/4276870300 conn(0x55a8dd1cbd50 msgr2=0x55a8dd1ce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:03.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.185+0000 7f9293121800 1 -- 172.21.15.102:0/4276870300 shutdown_connections 2024-09-13T19:18:03.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.185+0000 7f9293121800 1 -- 172.21.15.102:0/4276870300 wait complete. 2024-09-13T19:18:03.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.186+0000 7f9293121800 1 -- 172.21.15.102:0/1003803162 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55a8dd0c8790 msgr2=0x55a8dd1c3020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.186+0000 7f9293121800 1 --2- 172.21.15.102:0/1003803162 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55a8dd0c8790 0x55a8dd1c3020 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.186+0000 7f9293121800 1 -- 172.21.15.102:0/1003803162 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55a8dd1c59a0 msgr2=0x55a8dd1c7d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.186+0000 7f9293121800 1 --2- 172.21.15.102:0/1003803162 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55a8dd1c59a0 0x55a8dd1c7d90 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.186+0000 7f9293121800 1 -- 172.21.15.102:0/1003803162 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9174036b90 msgr2=0x7f9174039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.186+0000 7f9293121800 1 --2- 172.21.15.102:0/1003803162 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9174036b90 0x7f9174039050 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9284000c00 tx=0x7f92840013b0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.186+0000 7f9293121800 1 -- 172.21.15.102:0/1003803162 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8dd039630 msgr2=0x55a8dd1bbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.186+0000 7f9293121800 1 --2- 172.21.15.102:0/1003803162 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8dd039630 0x55a8dd1bbfb0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f9280066040 tx=0x7f9280003330 comp rx=0 tx=0).stop 2024-09-13T19:18:03.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.186+0000 7f9293121800 1 -- 172.21.15.102:0/1003803162 shutdown_connections 2024-09-13T19:18:03.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.186+0000 7f9293121800 1 --2- 172.21.15.102:0/1003803162 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55a8dd1c59a0 0x55a8dd1c7d90 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.186+0000 7f9293121800 1 --2- 172.21.15.102:0/1003803162 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55a8dd0c8790 0x55a8dd1c3020 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.186+0000 7f9293121800 1 --2- 172.21.15.102:0/1003803162 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f9174036b90 0x7f9174039050 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.186+0000 7f9293121800 1 --2- 172.21.15.102:0/1003803162 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8dd039630 0x55a8dd1bbfb0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.186+0000 7f9293121800 1 -- 172.21.15.102:0/1003803162 >> 172.21.15.102:0/1003803162 conn(0x55a8dd0bfde0 msgr2=0x55a8dd1ae910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:03.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.186+0000 7f9293121800 1 -- 172.21.15.102:0/1003803162 shutdown_connections 2024-09-13T19:18:03.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.186+0000 7f9293121800 1 -- 172.21.15.102:0/1003803162 wait complete. 2024-09-13T19:18:03.219 ERROR:root:None 2024-09-13T19:18:03.219 ERROR:root:0 2024-09-13T19:18:03.219 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-13T19:18:03.219 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-13T19:18:03.219 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=read 2024-09-13T19:18:03.266 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:18:03.266 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:18:03.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.263+0000 7f8540726800 1 Processor -- start 2024-09-13T19:18:03.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.264+0000 7f8540726800 1 -- start start 2024-09-13T19:18:03.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.264+0000 7f8540726800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x564ef973e900 0x564ef9740cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.264+0000 7f8540726800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564ef95f9b30 con 0x564ef96ae650 2024-09-13T19:18:03.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.264+0000 7f8540726800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x564ef95db360 con 0x564ef973e900 2024-09-13T19:18:03.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.264+0000 7f8533fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x564ef973e900 0x564ef9740cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.264+0000 7f853c3bf640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x564ef96ae650 0x564ef973d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:53746/0 (socket says 172.21.15.102:53746) 2024-09-13T19:18:03.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.264+0000 7f853c3bf640 1 -- 172.21.15.102:0/3095091399 learned_addr learned my addr 172.21.15.102:0/3095091399 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:18:03.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.264+0000 7f8533fff640 1 -- 172.21.15.102:0/3095091399 >> v1:172.21.15.53:6789/0 conn(0x564ef96ae650 legacy=0x564ef973d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.264+0000 7f8533fff640 1 -- 172.21.15.102:0/3095091399 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ef9601e00 con 0x564ef973e900 2024-09-13T19:18:03.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.266+0000 7f8533fff640 1 --2- 172.21.15.102:0/3095091399 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ef973e900 0x564ef9740cf0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f852400a470 tx=0x7f8524045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eea541238c2dabf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.266+0000 7f853bbbe640 1 -- 172.21.15.102:0/3095091399 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8524053570 con 0x564ef973e900 2024-09-13T19:18:03.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.266+0000 7f853bbbe640 1 -- 172.21.15.102:0/3095091399 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8524058070 con 0x564ef973e900 2024-09-13T19:18:03.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.266+0000 7f853bbbe640 1 -- 172.21.15.102:0/3095091399 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8524053880 con 0x564ef973e900 2024-09-13T19:18:03.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.267+0000 7f8540726800 1 -- 172.21.15.102:0/3095091399 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ef973e900 msgr2=0x564ef9740cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.267+0000 7f8540726800 1 --2- 172.21.15.102:0/3095091399 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ef973e900 0x564ef9740cf0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f852400a470 tx=0x7f8524045a20 comp rx=0 tx=0).stop 2024-09-13T19:18:03.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.267+0000 7f8540726800 1 -- 172.21.15.102:0/3095091399 shutdown_connections 2024-09-13T19:18:03.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.267+0000 7f8540726800 1 --2- 172.21.15.102:0/3095091399 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ef973e900 0x564ef9740cf0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.267+0000 7f8540726800 1 -- 172.21.15.102:0/3095091399 >> 172.21.15.102:0/3095091399 conn(0x564ef9734db0 msgr2=0x564ef97371d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:03.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.267+0000 7f8540726800 1 -- 172.21.15.102:0/3095091399 shutdown_connections 2024-09-13T19:18:03.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.267+0000 7f8540726800 1 -- 172.21.15.102:0/3095091399 wait complete. 2024-09-13T19:18:03.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.281+0000 7f8540726800 1 Processor -- start 2024-09-13T19:18:03.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.281+0000 7f8540726800 1 -- start start 2024-09-13T19:18:03.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.281+0000 7f8540726800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ef96ae650 0x564ef98298c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.281+0000 7f8540726800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564ef9686360 con 0x564ef96ae650 2024-09-13T19:18:03.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.281+0000 7f853c3bf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ef96ae650 0x564ef98298c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.281+0000 7f853c3bf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ef96ae650 0x564ef98298c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49890/0 (socket says 172.21.15.102:49890) 2024-09-13T19:18:03.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.281+0000 7f853c3bf640 1 -- 172.21.15.102:0/447574081 learned_addr learned my addr 172.21.15.102:0/447574081 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:03.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.282+0000 7f853c3bf640 1 -- 172.21.15.102:0/447574081 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ef95d3bc0 con 0x564ef96ae650 2024-09-13T19:18:03.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.282+0000 7f853c3bf640 1 --2- 172.21.15.102:0/447574081 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ef96ae650 0x564ef98298c0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f852c001e10 tx=0x7f852c00b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffd21536f3991f71 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.282+0000 7f842a60c640 1 -- 172.21.15.102:0/447574081 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f852c012020 con 0x564ef96ae650 2024-09-13T19:18:03.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.282+0000 7f842a60c640 1 -- 172.21.15.102:0/447574081 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f852c00e5a0 con 0x564ef96ae650 2024-09-13T19:18:03.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.282+0000 7f842a60c640 1 -- 172.21.15.102:0/447574081 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f852c00e8e0 con 0x564ef96ae650 2024-09-13T19:18:03.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.283+0000 7f8540726800 1 -- 172.21.15.102:0/447574081 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ef96ae650 msgr2=0x564ef98298c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.283+0000 7f8540726800 1 --2- 172.21.15.102:0/447574081 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ef96ae650 0x564ef98298c0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f852c001e10 tx=0x7f852c00b780 comp rx=0 tx=0).stop 2024-09-13T19:18:03.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.283+0000 7f8540726800 1 -- 172.21.15.102:0/447574081 shutdown_connections 2024-09-13T19:18:03.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.283+0000 7f8540726800 1 --2- 172.21.15.102:0/447574081 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ef96ae650 0x564ef98298c0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.283+0000 7f8540726800 1 -- 172.21.15.102:0/447574081 >> 172.21.15.102:0/447574081 conn(0x564ef9734db0 msgr2=0x564ef9825280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:03.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.283+0000 7f8540726800 1 -- 172.21.15.102:0/447574081 shutdown_connections 2024-09-13T19:18:03.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.283+0000 7f8540726800 1 -- 172.21.15.102:0/447574081 wait complete. 2024-09-13T19:18:03.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.283+0000 7f8540726800 1 Processor -- start 2024-09-13T19:18:03.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.283+0000 7f8540726800 1 -- start start 2024-09-13T19:18:03.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.283+0000 7f8540726800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ef96ae650 0x564ef973ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.283+0000 7f8540726800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564ef9741620 con 0x564ef96ae650 2024-09-13T19:18:03.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.283+0000 7f853c3bf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ef96ae650 0x564ef973ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.283+0000 7f853c3bf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ef96ae650 0x564ef973ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49902/0 (socket says 172.21.15.102:49902) 2024-09-13T19:18:03.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.283+0000 7f853c3bf640 1 -- 172.21.15.102:0/314647098 learned_addr learned my addr 172.21.15.102:0/314647098 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:03.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.284+0000 7f853c3bf640 1 -- 172.21.15.102:0/314647098 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ef95e7fe0 con 0x564ef96ae650 2024-09-13T19:18:03.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.284+0000 7f853c3bf640 1 --2- 172.21.15.102:0/314647098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ef96ae650 0x564ef973ab10 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f852c00b7c0 tx=0x7f852c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.284+0000 7f8428e09640 1 -- 172.21.15.102:0/314647098 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f852c012030 con 0x564ef96ae650 2024-09-13T19:18:03.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.284+0000 7f8428e09640 1 -- 172.21.15.102:0/314647098 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f852c001470 con 0x564ef96ae650 2024-09-13T19:18:03.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.284+0000 7f8540726800 1 -- 172.21.15.102:0/314647098 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564ef9739200 con 0x564ef96ae650 2024-09-13T19:18:03.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.284+0000 7f8428e09640 1 -- 172.21.15.102:0/314647098 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f852c01a8d0 con 0x564ef96ae650 2024-09-13T19:18:03.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.284+0000 7f8540726800 1 -- 172.21.15.102:0/314647098 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ef9739720 con 0x564ef96ae650 2024-09-13T19:18:03.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.285+0000 7f8428e09640 1 -- 172.21.15.102:0/314647098 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f852c015020 con 0x564ef96ae650 2024-09-13T19:18:03.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.285+0000 7f8428e09640 1 --2- 172.21.15.102:0/314647098 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8424036b90 0x7f8424039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.285+0000 7f8428e09640 1 -- 172.21.15.102:0/314647098 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f852c020030 con 0x564ef96ae650 2024-09-13T19:18:03.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.285+0000 7f8533fff640 1 --2- 172.21.15.102:0/314647098 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8424036b90 0x7f8424039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.285+0000 7f8540726800 1 --2- 172.21.15.102:0/314647098 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x564ef973e900 0x564ef983a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.285+0000 7f8540726800 1 -- 172.21.15.102:0/314647098 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564ef983abd0 con 0x564ef973e900 2024-09-13T19:18:03.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.285+0000 7f853cbc0640 1 --2- 172.21.15.102:0/314647098 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x564ef973e900 0x564ef983a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.286+0000 7f8533fff640 1 --2- 172.21.15.102:0/314647098 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8424036b90 0x7f8424039050 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8524057000 tx=0x7f8524052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.286+0000 7f853cbc0640 1 --2- 172.21.15.102:0/314647098 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x564ef973e900 0x564ef983a690 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.286+0000 7f853cbc0640 1 -- 172.21.15.102:0/314647098 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f853400a4a0 con 0x564ef973e900 2024-09-13T19:18:03.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.286+0000 7f8540726800 1 -- 172.21.15.102:0/314647098 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564ef983b420 con 0x564ef973e900 2024-09-13T19:18:03.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.286+0000 7f853cbc0640 1 -- 172.21.15.102:0/314647098 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f853400a4a0 con 0x564ef973e900 2024-09-13T19:18:03.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.286+0000 7f8540726800 1 --2- 172.21.15.102:0/314647098 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x564ef983cd70 0x564ef983f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.286+0000 7f8540726800 1 -- 172.21.15.102:0/314647098 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564ef983f9a0 con 0x564ef983cd70 2024-09-13T19:18:03.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.286+0000 7f853c3bf640 1 --2- 172.21.15.102:0/314647098 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x564ef983cd70 0x564ef983f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.287+0000 7f853c3bf640 1 --2- 172.21.15.102:0/314647098 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x564ef983cd70 0x564ef983f210 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.287+0000 7f853c3bf640 1 -- 172.21.15.102:0/314647098 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f852c02dcf0 con 0x564ef983cd70 2024-09-13T19:18:03.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.287+0000 7f8540726800 1 -- 172.21.15.102:0/314647098 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564ef983bc70 con 0x564ef973e900 2024-09-13T19:18:03.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.287+0000 7f853cbc0640 1 -- 172.21.15.102:0/314647098 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f853400a4a0 con 0x564ef973e900 2024-09-13T19:18:03.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.287+0000 7f8540726800 1 -- 172.21.15.102:0/314647098 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564ef983c050 con 0x564ef983cd70 2024-09-13T19:18:03.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.288+0000 7f853c3bf640 1 -- 172.21.15.102:0/314647098 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f852c02dcf0 con 0x564ef983cd70 2024-09-13T19:18:03.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.288+0000 7f8540726800 1 Processor -- start 2024-09-13T19:18:03.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.288+0000 7f8540726800 1 -- start start 2024-09-13T19:18:03.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.288+0000 7f8540726800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ef984e320 0x564ef984e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.288+0000 7f8540726800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564ef973b050 con 0x564ef984e320 2024-09-13T19:18:03.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.288+0000 7f853cbc0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ef984e320 0x564ef984e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.288+0000 7f853cbc0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ef984e320 0x564ef984e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49904/0 (socket says 172.21.15.102:49904) 2024-09-13T19:18:03.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.288+0000 7f853cbc0640 1 -- 172.21.15.102:0/608914029 learned_addr learned my addr 172.21.15.102:0/608914029 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:03.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.289+0000 7f853cbc0640 1 -- 172.21.15.102:0/608914029 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ef984ec80 con 0x564ef984e320 2024-09-13T19:18:03.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.289+0000 7f853cbc0640 1 --2- 172.21.15.102:0/608914029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ef984e320 0x564ef984e740 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x564ef973a150 tx=0x7f85340167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.289+0000 7f8421ffb640 1 -- 172.21.15.102:0/608914029 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8534013640 con 0x564ef984e320 2024-09-13T19:18:03.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.289+0000 7f8421ffb640 1 -- 172.21.15.102:0/608914029 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85340137e0 con 0x564ef984e320 2024-09-13T19:18:03.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.289+0000 7f8421ffb640 1 -- 172.21.15.102:0/608914029 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8534013ae0 con 0x564ef984e320 2024-09-13T19:18:03.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.289+0000 7f8540726800 1 -- 172.21.15.102:0/608914029 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564ef984ef10 con 0x564ef984e320 2024-09-13T19:18:03.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.289+0000 7f8540726800 1 -- 172.21.15.102:0/608914029 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ef9851bf0 con 0x564ef984e320 2024-09-13T19:18:03.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.290+0000 7f8421ffb640 1 -- 172.21.15.102:0/608914029 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8534011040 con 0x564ef984e320 2024-09-13T19:18:03.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.290+0000 7f8421ffb640 1 --2- 172.21.15.102:0/608914029 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8414036b40 0x7f8414039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.290+0000 7f8421ffb640 1 -- 172.21.15.102:0/608914029 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f853400e040 con 0x564ef984e320 2024-09-13T19:18:03.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.290+0000 7f853c3bf640 1 --2- 172.21.15.102:0/608914029 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8414036b40 0x7f8414039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.290+0000 7f8540726800 1 Processor -- start 2024-09-13T19:18:03.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.290+0000 7f853c3bf640 1 --2- 172.21.15.102:0/608914029 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8414036b40 0x7f8414039000 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x564ef9739b10 tx=0x7f852c04b030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.290+0000 7f8540726800 1 -- start start 2024-09-13T19:18:03.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.291+0000 7f8540726800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ef985b070 0x564ef985b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.291+0000 7f8540726800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564ef95d5580 con 0x564ef985b070 2024-09-13T19:18:03.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.291+0000 7f853cbc0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ef985b070 0x564ef985b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.291+0000 7f853cbc0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ef985b070 0x564ef985b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49906/0 (socket says 172.21.15.102:49906) 2024-09-13T19:18:03.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.291+0000 7f853cbc0640 1 -- 172.21.15.102:0/1059023611 learned_addr learned my addr 172.21.15.102:0/1059023611 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:03.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.291+0000 7f853cbc0640 1 -- 172.21.15.102:0/1059023611 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ef985ba40 con 0x564ef985b070 2024-09-13T19:18:03.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.291+0000 7f853cbc0640 1 --2- 172.21.15.102:0/1059023611 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ef985b070 0x564ef985b470 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f853404cde0 tx=0x7f8534020f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8f808af2427c047 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.291+0000 7f84137fe640 1 -- 172.21.15.102:0/1059023611 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8534014c70 con 0x564ef985b070 2024-09-13T19:18:03.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.291+0000 7f84137fe640 1 -- 172.21.15.102:0/1059023611 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f853401cd50 con 0x564ef985b070 2024-09-13T19:18:03.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.291+0000 7f84137fe640 1 -- 172.21.15.102:0/1059023611 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f853402aa60 con 0x564ef985b070 2024-09-13T19:18:03.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.292+0000 7f8540726800 1 -- 172.21.15.102:0/1059023611 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ef985b070 msgr2=0x564ef985b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.292+0000 7f8540726800 1 --2- 172.21.15.102:0/1059023611 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ef985b070 0x564ef985b470 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f853404cde0 tx=0x7f8534020f60 comp rx=0 tx=0).stop 2024-09-13T19:18:03.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.292+0000 7f8540726800 1 -- 172.21.15.102:0/1059023611 shutdown_connections 2024-09-13T19:18:03.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.292+0000 7f8540726800 1 --2- 172.21.15.102:0/1059023611 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ef985b070 0x564ef985b470 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.292+0000 7f8540726800 1 -- 172.21.15.102:0/1059023611 >> 172.21.15.102:0/1059023611 conn(0x564ef98573d0 msgr2=0x564ef98554d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:03.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.292+0000 7f8540726800 1 -- 172.21.15.102:0/1059023611 shutdown_connections 2024-09-13T19:18:03.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.292+0000 7f8540726800 1 -- 172.21.15.102:0/1059023611 wait complete. 2024-09-13T19:18:03.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.292+0000 7f8540726800 1 Processor -- start 2024-09-13T19:18:03.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.292+0000 7f8540726800 1 -- start start 2024-09-13T19:18:03.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.292+0000 7f8540726800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ef985b070 0x564ef98623a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.292+0000 7f8540726800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564ef985bf30 con 0x564ef985b070 2024-09-13T19:18:03.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.293+0000 7f853cbc0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ef985b070 0x564ef98623a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.293+0000 7f853cbc0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ef985b070 0x564ef98623a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49914/0 (socket says 172.21.15.102:49914) 2024-09-13T19:18:03.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.293+0000 7f853cbc0640 1 -- 172.21.15.102:0/575891991 learned_addr learned my addr 172.21.15.102:0/575891991 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:03.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.293+0000 7f853cbc0640 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ef98628e0 con 0x564ef985b070 2024-09-13T19:18:03.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.293+0000 7f853cbc0640 1 --2- 172.21.15.102:0/575891991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ef985b070 0x564ef98623a0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f853404cce0 tx=0x7f853404cd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.293+0000 7f8411ffb640 1 -- 172.21.15.102:0/575891991 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8534038020 con 0x564ef985b070 2024-09-13T19:18:03.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.293+0000 7f8411ffb640 1 -- 172.21.15.102:0/575891991 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8534040130 con 0x564ef985b070 2024-09-13T19:18:03.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.293+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564ef9862b70 con 0x564ef985b070 2024-09-13T19:18:03.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.293+0000 7f8411ffb640 1 -- 172.21.15.102:0/575891991 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8534040430 con 0x564ef985b070 2024-09-13T19:18:03.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.293+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ef9862b70 con 0x564ef985b070 2024-09-13T19:18:03.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.294+0000 7f8411ffb640 1 -- 172.21.15.102:0/575891991 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f853403b070 con 0x564ef985b070 2024-09-13T19:18:03.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.294+0000 7f8411ffb640 1 --2- 172.21.15.102:0/575891991 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8404036aa0 0x7f8404038f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.294+0000 7f8411ffb640 1 -- 172.21.15.102:0/575891991 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f8534035d60 con 0x564ef985b070 2024-09-13T19:18:03.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.294+0000 7f853c3bf640 1 --2- 172.21.15.102:0/575891991 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8404036aa0 0x7f8404038f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.295+0000 7f853c3bf640 1 --2- 172.21.15.102:0/575891991 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8404036aa0 0x7f8404038f60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f852c01a6f0 tx=0x7f852c035000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.295+0000 7f8540726800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.295+0000 7f8540726800 1 --2- 172.21.15.102:0/575891991 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x564ef986dc90 0x564ef9870150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.295+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564ef98708a0 con 0x564ef986dc90 2024-09-13T19:18:03.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.295+0000 7f8533fff640 1 --2- 172.21.15.102:0/575891991 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x564ef986dc90 0x564ef9870150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.295+0000 7f8533fff640 1 --2- 172.21.15.102:0/575891991 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x564ef986dc90 0x564ef9870150 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.296+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8524051070 con 0x564ef986dc90 2024-09-13T19:18:03.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.296+0000 7f8540726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:03.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.296+0000 7f8540726800 20 realm 2024-09-13T19:18:03.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.296+0000 7f8540726800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.296+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564ef9870cd0 con 0x564ef986dc90 2024-09-13T19:18:03.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.296+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8524051070 con 0x564ef986dc90 2024-09-13T19:18:03.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.296+0000 7f8540726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:03.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.296+0000 7f8540726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:18:03.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.296+0000 7f8540726800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.296+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564ef98715a0 con 0x564ef986dc90 2024-09-13T19:18:03.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.296+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8524051070 con 0x564ef986dc90 2024-09-13T19:18:03.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.296+0000 7f8540726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:03.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.296+0000 7f8540726800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.296+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564ef9871940 con 0x564ef986dc90 2024-09-13T19:18:03.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.296+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8524051070 con 0x564ef986dc90 2024-09-13T19:18:03.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.296+0000 7f8540726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:18:03.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.296+0000 7f8540726800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.296+0000 7f8540726800 1 --2- 172.21.15.102:0/575891991 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x564ef98726a0 0x564ef9874a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.296+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564ef98750a0 con 0x564ef98726a0 2024-09-13T19:18:03.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.296+0000 7f853cbc0640 1 --2- 172.21.15.102:0/575891991 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x564ef98726a0 0x564ef9874a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.297+0000 7f853cbc0640 1 --2- 172.21.15.102:0/575891991 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x564ef98726a0 0x564ef9874a90 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.297+0000 7f853cbc0640 1 -- 172.21.15.102:0/575891991 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f853403a030 con 0x564ef98726a0 2024-09-13T19:18:03.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.297+0000 7f8540726800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:18:03.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.297+0000 7f8540726800 20 searching for the correct realm 2024-09-13T19:18:03.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.297+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564ef98769b0 con 0x564ef98726a0 2024-09-13T19:18:03.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.297+0000 7f853cbc0640 1 -- 172.21.15.102:0/575891991 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f853403a030 con 0x564ef98726a0 2024-09-13T19:18:03.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.297+0000 7f853cbc0640 1 --2- 172.21.15.102:0/575891991 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f8534034070 0x7f8534036070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.297+0000 7f853cbc0640 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564ef98769b0 con 0x7f8534034070 2024-09-13T19:18:03.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.297+0000 7f853c3bf640 1 --2- 172.21.15.102:0/575891991 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f8534034070 0x7f8534036070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.297+0000 7f853c3bf640 1 --2- 172.21.15.102:0/575891991 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f8534034070 0x7f8534036070 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.298+0000 7f853c3bf640 1 -- 172.21.15.102:0/575891991 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f852c02dcf0 con 0x7f8534034070 2024-09-13T19:18:03.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.298+0000 7f853c3bf640 1 --2- 172.21.15.102:0/575891991 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f852c058040 0x7f852c0405b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.298+0000 7f853c3bf640 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564ef98769b0 con 0x7f852c058040 2024-09-13T19:18:03.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.298+0000 7f8533fff640 1 --2- 172.21.15.102:0/575891991 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f852c058040 0x7f852c0405b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.298+0000 7f8533fff640 1 --2- 172.21.15.102:0/575891991 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f852c058040 0x7f852c0405b0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.299+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8524051070 con 0x7f852c058040 2024-09-13T19:18:03.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.299+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564ef98769b0 con 0x564ef986dc90 2024-09-13T19:18:03.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.299+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8524051070 con 0x564ef986dc90 2024-09-13T19:18:03.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.299+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564ef98769b0 con 0x564ef986dc90 2024-09-13T19:18:03.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.299+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8524051070 con 0x564ef986dc90 2024-09-13T19:18:03.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.299+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564ef98769b0 con 0x7f852c058040 2024-09-13T19:18:03.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.299+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8524051070 con 0x7f852c058040 2024-09-13T19:18:03.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.299+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564ef98769b0 con 0x7f852c058040 2024-09-13T19:18:03.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.300+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8524051070 con 0x7f852c058040 2024-09-13T19:18:03.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.300+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564ef98769b0 con 0x7f8534034070 2024-09-13T19:18:03.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.300+0000 7f853c3bf640 1 -- 172.21.15.102:0/575891991 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f852c02dcf0 con 0x7f8534034070 2024-09-13T19:18:03.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.300+0000 7f853c3bf640 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564ef98769b0 con 0x564ef98726a0 2024-09-13T19:18:03.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.300+0000 7f853cbc0640 1 -- 172.21.15.102:0/575891991 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f853403a030 con 0x564ef98726a0 2024-09-13T19:18:03.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.300+0000 7f853cbc0640 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564ef98769b0 con 0x564ef986dc90 2024-09-13T19:18:03.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.300+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8524051070 con 0x564ef986dc90 2024-09-13T19:18:03.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.300+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564ef98769b0 con 0x7f8534034070 2024-09-13T19:18:03.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.300+0000 7f853c3bf640 1 -- 172.21.15.102:0/575891991 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f852c02dcf0 con 0x7f8534034070 2024-09-13T19:18:03.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.300+0000 7f853c3bf640 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564ef98769b0 con 0x564ef986dc90 2024-09-13T19:18:03.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.301+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8524051070 con 0x564ef986dc90 2024-09-13T19:18:03.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.301+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564ef98769b0 con 0x7f8534034070 2024-09-13T19:18:03.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.301+0000 7f853c3bf640 1 -- 172.21.15.102:0/575891991 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f852c02dcf0 con 0x7f8534034070 2024-09-13T19:18:03.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.301+0000 7f853c3bf640 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564ef98769b0 con 0x564ef98726a0 2024-09-13T19:18:03.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.301+0000 7f853cbc0640 1 -- 172.21.15.102:0/575891991 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f853403a030 con 0x564ef98726a0 2024-09-13T19:18:03.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.301+0000 7f853cbc0640 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564ef98769b0 con 0x564ef98726a0 2024-09-13T19:18:03.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.301+0000 7f853cbc0640 1 -- 172.21.15.102:0/575891991 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f853403a030 con 0x564ef98726a0 2024-09-13T19:18:03.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.301+0000 7f853cbc0640 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564ef98769b0 con 0x7f852c058040 2024-09-13T19:18:03.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.302+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8524051070 con 0x7f852c058040 2024-09-13T19:18:03.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.302+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564ef98769b0 con 0x564ef98726a0 2024-09-13T19:18:03.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.302+0000 7f853cbc0640 1 -- 172.21.15.102:0/575891991 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f853403a030 con 0x564ef98726a0 2024-09-13T19:18:03.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.302+0000 7f853cbc0640 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564ef98769b0 con 0x564ef98726a0 2024-09-13T19:18:03.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.302+0000 7f853cbc0640 1 -- 172.21.15.102:0/575891991 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f853403a030 con 0x564ef98726a0 2024-09-13T19:18:03.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.302+0000 7f853cbc0640 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564ef98769b0 con 0x564ef986dc90 2024-09-13T19:18:03.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.302+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8524051070 con 0x564ef986dc90 2024-09-13T19:18:03.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.302+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564ef98769b0 con 0x564ef986dc90 2024-09-13T19:18:03.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.303+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8524051070 con 0x564ef986dc90 2024-09-13T19:18:03.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.303+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564ef98769b0 con 0x7f852c058040 2024-09-13T19:18:03.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.303+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8524051070 con 0x7f852c058040 2024-09-13T19:18:03.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.303+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564ef98769b0 con 0x564ef98726a0 2024-09-13T19:18:03.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.303+0000 7f853cbc0640 1 -- 172.21.15.102:0/575891991 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f853403a030 con 0x564ef98726a0 2024-09-13T19:18:03.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.303+0000 7f853cbc0640 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564ef98769b0 con 0x7f8534034070 2024-09-13T19:18:03.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.303+0000 7f853c3bf640 1 -- 172.21.15.102:0/575891991 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f852c02dcf0 con 0x7f8534034070 2024-09-13T19:18:03.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.303+0000 7f853c3bf640 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564ef98769b0 con 0x564ef986dc90 2024-09-13T19:18:03.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.304+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8524051070 con 0x564ef986dc90 2024-09-13T19:18:03.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.304+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564ef98769b0 con 0x7f8534034070 2024-09-13T19:18:03.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.304+0000 7f853c3bf640 1 -- 172.21.15.102:0/575891991 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f852c02dcf0 con 0x7f8534034070 2024-09-13T19:18:03.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.304+0000 7f853c3bf640 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564ef98769b0 con 0x564ef98726a0 2024-09-13T19:18:03.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.304+0000 7f853cbc0640 1 -- 172.21.15.102:0/575891991 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f853403a030 con 0x564ef98726a0 2024-09-13T19:18:03.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.304+0000 7f853cbc0640 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564ef98769b0 con 0x7f852c058040 2024-09-13T19:18:03.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.304+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8524051070 con 0x7f852c058040 2024-09-13T19:18:03.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.304+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564ef98769b0 con 0x7f8534034070 2024-09-13T19:18:03.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.305+0000 7f853c3bf640 1 -- 172.21.15.102:0/575891991 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f852c02dcf0 con 0x7f8534034070 2024-09-13T19:18:03.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.305+0000 7f853c3bf640 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564ef98769b0 con 0x564ef98726a0 2024-09-13T19:18:03.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.305+0000 7f853cbc0640 1 -- 172.21.15.102:0/575891991 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f853403a030 con 0x564ef98726a0 2024-09-13T19:18:03.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.305+0000 7f853cbc0640 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564ef98769b0 con 0x7f852c058040 2024-09-13T19:18:03.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.305+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8524051070 con 0x7f852c058040 2024-09-13T19:18:03.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.305+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564ef98769b0 con 0x564ef986dc90 2024-09-13T19:18:03.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.305+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v36'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8524051070 con 0x564ef986dc90 2024-09-13T19:18:03.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.305+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f8524083080 con 0x7f8534034070 2024-09-13T19:18:03.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.306+0000 7f853c3bf640 1 -- 172.21.15.102:0/575891991 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f852c02dcf0 con 0x7f8534034070 2024-09-13T19:18:03.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.306+0000 7f8540726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:18:03.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.306+0000 7f8540726800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:18:03.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.306+0000 7f8540726800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:18:03.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.306+0000 7f8540726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:18:03.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.306+0000 7f8540726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:18:03.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.306+0000 7f8540726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:18:03.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.306+0000 7f8540726800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.306+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564ef98758f0 con 0x564ef986dc90 2024-09-13T19:18:03.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.306+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8524051070 con 0x564ef986dc90 2024-09-13T19:18:03.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.306+0000 7f8540726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:03.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.306+0000 7f8540726800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.306+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564ef9875ce0 con 0x564ef986dc90 2024-09-13T19:18:03.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.306+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8524051070 con 0x564ef986dc90 2024-09-13T19:18:03.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.306+0000 7f8540726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:18:03.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.306+0000 7f8540726800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.306+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564ef9876e30 con 0x564ef98726a0 2024-09-13T19:18:03.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.306+0000 7f853cbc0640 1 -- 172.21.15.102:0/575891991 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f853403a030 con 0x564ef98726a0 2024-09-13T19:18:03.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.306+0000 7f8540726800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:18:03.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.306+0000 7f8540726800 20 zone default found 2024-09-13T19:18:03.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.306+0000 7f8540726800 4 Realm: () 2024-09-13T19:18:03.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.306+0000 7f8540726800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:18:03.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.306+0000 7f8540726800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:18:03.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.306+0000 7f8540726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:18:03.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.306+0000 7f8540726800 20 zonegroup default 2024-09-13T19:18:03.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.306+0000 7f8540726800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.306+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564ef9877680 con 0x7f8534034070 2024-09-13T19:18:03.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.307+0000 7f853c3bf640 1 -- 172.21.15.102:0/575891991 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f852c02dcf0 con 0x7f8534034070 2024-09-13T19:18:03.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.307+0000 7f8540726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:03.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.307+0000 7f8540726800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.307+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564ef9879400 con 0x564ef98726a0 2024-09-13T19:18:03.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.307+0000 7f853cbc0640 1 -- 172.21.15.102:0/575891991 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f853403a030 con 0x564ef98726a0 2024-09-13T19:18:03.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.307+0000 7f8540726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:03.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.307+0000 7f8540726800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.307+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564ef9879870 con 0x564ef98726a0 2024-09-13T19:18:03.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.307+0000 7f853cbc0640 1 -- 172.21.15.102:0/575891991 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f853403a030 con 0x564ef98726a0 2024-09-13T19:18:03.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.307+0000 7f8540726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:03.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.307+0000 7f8540726800 20 started sync module instance, tier type = 2024-09-13T19:18:03.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.307+0000 7f8540726800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:18:03.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.307+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564ef98788a0 con 0x7f8534034070 2024-09-13T19:18:03.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.308+0000 7f853c3bf640 1 -- 172.21.15.102:0/575891991 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(44 notify.0 [create] v36'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f852c02dcf0 con 0x7f8534034070 2024-09-13T19:18:03.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.308+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94897193847952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564ef987a160 con 0x7f8534034070 2024-09-13T19:18:03.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.308+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564ef987a9b0 con 0x564ef986dc90 2024-09-13T19:18:03.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.309+0000 7f853c3bf640 1 -- 172.21.15.102:0/575891991 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94897193847952] v36'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f852c02dcf0 con 0x7f8534034070 2024-09-13T19:18:03.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.310+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v36'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8524051070 con 0x564ef986dc90 2024-09-13T19:18:03.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.310+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94897193852080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564ef987a9f0 con 0x564ef986dc90 2024-09-13T19:18:03.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.310+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564ef987b500 con 0x564ef98726a0 2024-09-13T19:18:03.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.311+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94897193852080] v36'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8524051070 con 0x564ef986dc90 2024-09-13T19:18:03.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.311+0000 7f853cbc0640 1 -- 172.21.15.102:0/575891991 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v36'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f853403a030 con 0x564ef98726a0 2024-09-13T19:18:03.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.311+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94897193856944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564ef987b4c0 con 0x564ef98726a0 2024-09-13T19:18:03.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.311+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564ef987bf90 con 0x7f8534034070 2024-09-13T19:18:03.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.312+0000 7f853cbc0640 1 -- 172.21.15.102:0/575891991 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94897193856944] v36'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f853403a030 con 0x564ef98726a0 2024-09-13T19:18:03.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.312+0000 7f853c3bf640 1 -- 172.21.15.102:0/575891991 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(50 notify.3 [create] v36'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f852c02dcf0 con 0x7f8534034070 2024-09-13T19:18:03.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.312+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94897193859680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564ef987c380 con 0x7f8534034070 2024-09-13T19:18:03.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.312+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564ef987cde0 con 0x564ef986dc90 2024-09-13T19:18:03.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.313+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v36'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8524051070 con 0x564ef986dc90 2024-09-13T19:18:03.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.313+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94897193863360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564ef987cde0 con 0x564ef986dc90 2024-09-13T19:18:03.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.313+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564ef987dda0 con 0x7f852c058040 2024-09-13T19:18:03.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.313+0000 7f853c3bf640 1 -- 172.21.15.102:0/575891991 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94897193859680] v36'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f852c02dcf0 con 0x7f8534034070 2024-09-13T19:18:03.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.314+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94897193863360] v36'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8524051070 con 0x564ef986dc90 2024-09-13T19:18:03.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.314+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(54 notify.5 [create] v36'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8524051070 con 0x7f852c058040 2024-09-13T19:18:03.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.314+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94897193865680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564ef987dd60 con 0x7f852c058040 2024-09-13T19:18:03.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.314+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564ef987e640 con 0x7f852c058040 2024-09-13T19:18:03.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.315+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94897193865680] v36'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8524051070 con 0x7f852c058040 2024-09-13T19:18:03.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.315+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(56 notify.6 [create] v36'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8524051070 con 0x7f852c058040 2024-09-13T19:18:03.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.315+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94897193867376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564ef987e210 con 0x7f852c058040 2024-09-13T19:18:03.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.315+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564ef987ec70 con 0x7f852c058040 2024-09-13T19:18:03.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.316+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(58 notify.7 [create] v36'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8524051070 con 0x7f852c058040 2024-09-13T19:18:03.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.316+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94897193867376] v36'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8524051070 con 0x7f852c058040 2024-09-13T19:18:03.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.316+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94897193871136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564ef987f0e0 con 0x7f852c058040 2024-09-13T19:18:03.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.316+0000 7f8540726800 20 add_watcher() i=0 2024-09-13T19:18:03.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.316+0000 7f8540726800 20 add_watcher() i=1 2024-09-13T19:18:03.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.316+0000 7f8540726800 20 add_watcher() i=2 2024-09-13T19:18:03.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.316+0000 7f8540726800 20 add_watcher() i=3 2024-09-13T19:18:03.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.316+0000 7f8540726800 20 add_watcher() i=4 2024-09-13T19:18:03.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.316+0000 7f8540726800 20 add_watcher() i=5 2024-09-13T19:18:03.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.316+0000 7f8540726800 20 add_watcher() i=6 2024-09-13T19:18:03.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.317+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94897193871136] v36'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8524051070 con 0x7f852c058040 2024-09-13T19:18:03.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.317+0000 7f8540726800 20 add_watcher() i=7 2024-09-13T19:18:03.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.317+0000 7f8540726800 2 all 8 watchers are set, enabling cache 2024-09-13T19:18:03.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.317+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564ef987f0e0 con 0x564ef986dc90 2024-09-13T19:18:03.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.318+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8524051070 con 0x564ef986dc90 2024-09-13T19:18:03.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.318+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94897193872432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564ef987f080 con 0x564ef986dc90 2024-09-13T19:18:03.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.319+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94897193872432] v36'257 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8524051070 con 0x564ef986dc90 2024-09-13T19:18:03.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.319+0000 7f83f2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:18:03.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.319+0000 7f8540726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:18:03.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.319+0000 7f8540726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:18:03.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.319+0000 7f8540726800 5 note: GC not initialized 2024-09-13T19:18:03.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.319+0000 7f83f1fdb640 20 reqs_thread_entry: start 2024-09-13T19:18:03.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.319+0000 7f8540726800 20 init_complete bucket index max shards: 11 2024-09-13T19:18:03.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.319+0000 7f8540726800 20 Filter name: none 2024-09-13T19:18:03.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.319+0000 7f83637fe640 20 reqs_thread_entry: start 2024-09-13T19:18:03.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.320+0000 7f8540726800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T19:18:03.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.320+0000 7f8540726800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.320+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564ef98b54d0 con 0x7f852c058040 2024-09-13T19:18:03.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.320+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f8524051070 con 0x7f852c058040 2024-09-13T19:18:03.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.320+0000 7f8540726800 20 rados_obj.operate() r=0 bl.length=460 2024-09-13T19:18:03.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.320+0000 7f8540726800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T19:18:03.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.320+0000 7f8540726800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:18:03.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.320+0000 7f8540726800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:18:03.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.320+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564ef98bbbb0 con 0x7f852c058040 2024-09-13T19:18:03.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.321+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v36'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f8524051070 con 0x7f852c058040 2024-09-13T19:18:03.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.322+0000 7f8540726800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:18:03.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.322+0000 7f8540726800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:18:03.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.322+0000 7f8540726800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T19:18:03.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.322+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94897194120560 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564ef98b71f0 con 0x564ef986dc90 2024-09-13T19:18:03.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.322+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== watch-notify(notify (1) cookie 94897193863360 notify 154618822696 ret 0) ==== 708+0+0 (crc 0 0 0) 0x564ef9601e00 con 0x564ef986dc90 2024-09-13T19:18:03.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.322+0000 7f84137fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822696 cookie 94897193863360 notifier 4881 bl.length()=666 2024-09-13T19:18:03.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.322+0000 7f84137fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:18:03.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.322+0000 7f84137fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:18:03.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.322+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(64 notify.4 [notify cookie 94897194120560 out=8b] v0'0 uv258 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8524051070 con 0x564ef986dc90 2024-09-13T19:18:03.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.322+0000 7f84137fe640 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f8408003ea0 con 0x564ef986dc90 2024-09-13T19:18:03.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.322+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== watch-notify(notify_complete (2) cookie 94897194120560 notify 154618822696 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f852407a5c0 con 0x564ef986dc90 2024-09-13T19:18:03.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.322+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8524051070 con 0x564ef986dc90 2024-09-13T19:18:03.372 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T19:18:02.251000Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"read"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:18:02.250985Z","tags":[],"group_ids":[]} 2024-09-13T19:18:03.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.323+0000 7f83f2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:18:03.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.323+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94897193872432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564ef98b31f0 con 0x564ef986dc90 2024-09-13T19:18:03.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.324+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94897193872432] v36'258 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8524051070 con 0x564ef986dc90 2024-09-13T19:18:03.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.324+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94897193847952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564ef98b31f0 con 0x7f8534034070 2024-09-13T19:18:03.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.325+0000 7f853c3bf640 1 -- 172.21.15.102:0/575891991 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94897193847952] v36'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f852c02dcf0 con 0x7f8534034070 2024-09-13T19:18:03.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.325+0000 7f8540726800 20 remove_watcher() i=0 2024-09-13T19:18:03.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.325+0000 7f8540726800 2 removed watcher, disabling cache 2024-09-13T19:18:03.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.325+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94897193852080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564ef98b31f0 con 0x564ef986dc90 2024-09-13T19:18:03.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.326+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94897193852080] v36'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8524051070 con 0x564ef986dc90 2024-09-13T19:18:03.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.326+0000 7f8540726800 20 remove_watcher() i=1 2024-09-13T19:18:03.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.326+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94897193856944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564ef98b31f0 con 0x564ef98726a0 2024-09-13T19:18:03.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.327+0000 7f853cbc0640 1 -- 172.21.15.102:0/575891991 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94897193856944] v36'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f853403a030 con 0x564ef98726a0 2024-09-13T19:18:03.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.327+0000 7f8540726800 20 remove_watcher() i=2 2024-09-13T19:18:03.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.327+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94897193859680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564ef98b31f0 con 0x7f8534034070 2024-09-13T19:18:03.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.328+0000 7f853c3bf640 1 -- 172.21.15.102:0/575891991 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94897193859680] v36'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f852c02dcf0 con 0x7f8534034070 2024-09-13T19:18:03.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.328+0000 7f8540726800 20 remove_watcher() i=3 2024-09-13T19:18:03.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.328+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94897193863360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564ef98b31f0 con 0x564ef986dc90 2024-09-13T19:18:03.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.329+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94897193863360] v36'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8524051070 con 0x564ef986dc90 2024-09-13T19:18:03.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.329+0000 7f8540726800 20 remove_watcher() i=4 2024-09-13T19:18:03.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.329+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94897193865680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564ef98b31f0 con 0x7f852c058040 2024-09-13T19:18:03.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.330+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94897193865680] v36'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8524051070 con 0x7f852c058040 2024-09-13T19:18:03.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.330+0000 7f8540726800 20 remove_watcher() i=5 2024-09-13T19:18:03.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.330+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94897193867376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564ef98b31f0 con 0x7f852c058040 2024-09-13T19:18:03.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.331+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94897193867376] v36'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8524051070 con 0x7f852c058040 2024-09-13T19:18:03.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.331+0000 7f8540726800 20 remove_watcher() i=6 2024-09-13T19:18:03.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.331+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94897193871136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564ef98b31f0 con 0x7f852c058040 2024-09-13T19:18:03.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.332+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94897193871136] v36'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8524051070 con 0x7f852c058040 2024-09-13T19:18:03.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.332+0000 7f8540726800 20 remove_watcher() i=7 2024-09-13T19:18:03.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.332+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f852c058040 msgr2=0x7f852c0405b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.332+0000 7f8540726800 1 --2- 172.21.15.102:0/575891991 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f852c058040 0x7f852c0405b0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.332+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x564ef986dc90 msgr2=0x564ef9870150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.332+0000 7f8540726800 1 --2- 172.21.15.102:0/575891991 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x564ef986dc90 0x564ef9870150 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.332+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f8534034070 msgr2=0x7f8534036070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.332+0000 7f8540726800 1 --2- 172.21.15.102:0/575891991 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f8534034070 0x7f8534036070 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.332+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x564ef98726a0 msgr2=0x564ef9874a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.332+0000 7f8540726800 1 --2- 172.21.15.102:0/575891991 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x564ef98726a0 0x564ef9874a90 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.332+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8404036aa0 msgr2=0x7f8404038f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.333+0000 7f8540726800 1 --2- 172.21.15.102:0/575891991 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8404036aa0 0x7f8404038f60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f852c01a6f0 tx=0x7f852c035000 comp rx=0 tx=0).stop 2024-09-13T19:18:03.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.333+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ef985b070 msgr2=0x564ef98623a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.333+0000 7f8540726800 1 --2- 172.21.15.102:0/575891991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ef985b070 0x564ef98623a0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f853404cce0 tx=0x7f853404cd40 comp rx=0 tx=0).stop 2024-09-13T19:18:03.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.333+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 reap_dead start 2024-09-13T19:18:03.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.333+0000 7f8533fff640 1 -- 172.21.15.102:0/575891991 reap_dead start 2024-09-13T19:18:03.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.333+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 shutdown_connections 2024-09-13T19:18:03.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.333+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 >> 172.21.15.102:0/575891991 conn(0x564ef98573d0 msgr2=0x564ef98554a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:03.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.333+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 shutdown_connections 2024-09-13T19:18:03.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.333+0000 7f8540726800 1 -- 172.21.15.102:0/575891991 wait complete. 2024-09-13T19:18:03.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.333+0000 7f8540726800 1 -- 172.21.15.102:0/608914029 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8414036b40 msgr2=0x7f8414039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.333+0000 7f8540726800 1 --2- 172.21.15.102:0/608914029 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8414036b40 0x7f8414039000 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x564ef9739b10 tx=0x7f852c04b030 comp rx=0 tx=0).stop 2024-09-13T19:18:03.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.333+0000 7f8540726800 1 -- 172.21.15.102:0/608914029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ef984e320 msgr2=0x564ef984e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.333+0000 7f8540726800 1 --2- 172.21.15.102:0/608914029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ef984e320 0x564ef984e740 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x564ef973a150 tx=0x7f85340167b0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.333+0000 7f8540726800 1 -- 172.21.15.102:0/608914029 shutdown_connections 2024-09-13T19:18:03.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.333+0000 7f8540726800 1 --2- 172.21.15.102:0/608914029 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8414036b40 0x7f8414039000 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.333+0000 7f8540726800 1 --2- 172.21.15.102:0/608914029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ef984e320 0x564ef984e740 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.333+0000 7f8540726800 1 -- 172.21.15.102:0/608914029 >> 172.21.15.102:0/608914029 conn(0x564ef98432b0 msgr2=0x564ef9845e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:03.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.333+0000 7f8540726800 1 -- 172.21.15.102:0/608914029 shutdown_connections 2024-09-13T19:18:03.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.333+0000 7f8540726800 1 -- 172.21.15.102:0/608914029 wait complete. 2024-09-13T19:18:03.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.333+0000 7f8540726800 1 -- 172.21.15.102:0/314647098 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x564ef973e900 msgr2=0x564ef983a690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.333+0000 7f8540726800 1 --2- 172.21.15.102:0/314647098 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x564ef973e900 0x564ef983a690 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.333+0000 7f8540726800 1 -- 172.21.15.102:0/314647098 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x564ef983cd70 msgr2=0x564ef983f210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.333+0000 7f8540726800 1 --2- 172.21.15.102:0/314647098 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x564ef983cd70 0x564ef983f210 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.333+0000 7f8540726800 1 -- 172.21.15.102:0/314647098 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8424036b90 msgr2=0x7f8424039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.333+0000 7f8540726800 1 --2- 172.21.15.102:0/314647098 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8424036b90 0x7f8424039050 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8524057000 tx=0x7f8524052000 comp rx=0 tx=0).stop 2024-09-13T19:18:03.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.333+0000 7f8540726800 1 -- 172.21.15.102:0/314647098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ef96ae650 msgr2=0x564ef973ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.333+0000 7f8540726800 1 --2- 172.21.15.102:0/314647098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ef96ae650 0x564ef973ab10 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f852c00b7c0 tx=0x7f852c000ed0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.333+0000 7f8540726800 1 -- 172.21.15.102:0/314647098 shutdown_connections 2024-09-13T19:18:03.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.334+0000 7f8540726800 1 --2- 172.21.15.102:0/314647098 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x564ef983cd70 0x564ef983f210 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.334+0000 7f8540726800 1 --2- 172.21.15.102:0/314647098 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x564ef973e900 0x564ef983a690 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.334+0000 7f8540726800 1 --2- 172.21.15.102:0/314647098 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f8424036b90 0x7f8424039050 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.334+0000 7f8540726800 1 --2- 172.21.15.102:0/314647098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ef96ae650 0x564ef973ab10 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.334+0000 7f8540726800 1 -- 172.21.15.102:0/314647098 >> 172.21.15.102:0/314647098 conn(0x564ef9734db0 msgr2=0x564ef9823b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:03.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.334+0000 7f8540726800 1 -- 172.21.15.102:0/314647098 shutdown_connections 2024-09-13T19:18:03.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.334+0000 7f8540726800 1 -- 172.21.15.102:0/314647098 wait complete. 2024-09-13T19:18:03.389 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:18:02.251000Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:18:02.250985Z', 'tags': [], 'group_ids': []} 2024-09-13T19:18:03.390 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:18:02.251000Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:18:02.250985Z', 'tags': [], 'group_ids': []} 2024-09-13T19:18:03.390 ERROR:root:0 2024-09-13T19:18:03.390 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:18:03.407 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:18:03.407 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-13T19:18:03.407 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-13T19:18:03.408 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'user-info-without-keys=*' 2024-09-13T19:18:03.477 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:18:03.478 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:18:03.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.475+0000 7fca8ff3e800 1 Processor -- start 2024-09-13T19:18:03.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.475+0000 7fca8ff3e800 1 -- start start 2024-09-13T19:18:03.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.475+0000 7fca8ff3e800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55678b10f920 0x55678b111d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.475+0000 7fca8ff3e800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55678afcbb30 con 0x55678b10b4e0 2024-09-13T19:18:03.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.475+0000 7fca8ff3e800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55678afad360 con 0x55678b10f920 2024-09-13T19:18:03.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.475+0000 7fca8b433640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55678b10f920 0x55678b111d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.475+0000 7fca8bc34640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55678b10b4e0 0x55678b10b8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:53758/0 (socket says 172.21.15.102:53758) 2024-09-13T19:18:03.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.475+0000 7fca8bc34640 1 -- 172.21.15.102:0/3324437096 learned_addr learned my addr 172.21.15.102:0/3324437096 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:18:03.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.476+0000 7fca8ac32640 1 -- 172.21.15.102:0/3324437096 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1507158658 0 0) 0x55678afcbb30 con 0x55678b10b4e0 2024-09-13T19:18:03.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.476+0000 7fca8ac32640 1 -- 172.21.15.102:0/3324437096 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca78001e10 con 0x55678b10b4e0 2024-09-13T19:18:03.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.476+0000 7fca8b433640 1 -- 172.21.15.102:0/3324437096 >> v1:172.21.15.53:6789/0 conn(0x55678b10b4e0 legacy=0x55678b10b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.476+0000 7fca8b433640 1 -- 172.21.15.102:0/3324437096 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55678afd3e00 con 0x55678b10f920 2024-09-13T19:18:03.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.478+0000 7fca8b433640 1 --2- 172.21.15.102:0/3324437096 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55678b10f920 0x55678b111d10 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fca7400a470 tx=0x7fca74045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b65acf74ae6b9f10 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.478+0000 7fca8ac32640 1 -- 172.21.15.102:0/3324437096 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca74059070 con 0x55678b10f920 2024-09-13T19:18:03.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.478+0000 7fca8ac32640 1 -- 172.21.15.102:0/3324437096 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca74054570 con 0x55678b10f920 2024-09-13T19:18:03.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.478+0000 7fca8ac32640 1 -- 172.21.15.102:0/3324437096 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca74054870 con 0x55678b10f920 2024-09-13T19:18:03.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.478+0000 7fca8ff3e800 1 -- 172.21.15.102:0/3324437096 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55678b10f920 msgr2=0x55678b111d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.478+0000 7fca8ff3e800 1 --2- 172.21.15.102:0/3324437096 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55678b10f920 0x55678b111d10 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fca7400a470 tx=0x7fca74045920 comp rx=0 tx=0).stop 2024-09-13T19:18:03.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.478+0000 7fca8ff3e800 1 -- 172.21.15.102:0/3324437096 shutdown_connections 2024-09-13T19:18:03.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.478+0000 7fca8ff3e800 1 --2- 172.21.15.102:0/3324437096 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55678b10f920 0x55678b111d10 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.478+0000 7fca8ff3e800 1 -- 172.21.15.102:0/3324437096 >> 172.21.15.102:0/3324437096 conn(0x55678b106dd0 msgr2=0x55678b1091f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:03.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.478+0000 7fca8ff3e800 1 -- 172.21.15.102:0/3324437096 shutdown_connections 2024-09-13T19:18:03.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.478+0000 7fca8ff3e800 1 -- 172.21.15.102:0/3324437096 wait complete. 2024-09-13T19:18:03.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.492+0000 7fca8ff3e800 1 Processor -- start 2024-09-13T19:18:03.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.492+0000 7fca8ff3e800 1 -- start start 2024-09-13T19:18:03.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.492+0000 7fca8ff3e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55678b10b4e0 0x55678b07fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.492+0000 7fca8ff3e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55678b058360 con 0x55678b10b4e0 2024-09-13T19:18:03.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.493+0000 7fca8bc34640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55678b10b4e0 0x55678b07fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.493+0000 7fca8bc34640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55678b10b4e0 0x55678b07fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49930/0 (socket says 172.21.15.102:49930) 2024-09-13T19:18:03.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.493+0000 7fca8bc34640 1 -- 172.21.15.102:0/3283480953 learned_addr learned my addr 172.21.15.102:0/3283480953 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:03.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.493+0000 7fca8bc34640 1 -- 172.21.15.102:0/3283480953 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55678afa5bc0 con 0x55678b10b4e0 2024-09-13T19:18:03.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.493+0000 7fca8bc34640 1 --2- 172.21.15.102:0/3283480953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55678b10b4e0 0x55678b07fda0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fca84001680 tx=0x7fca84001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fbd0990888a6989 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.493+0000 7fc979e0b640 1 -- 172.21.15.102:0/3283480953 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca84016070 con 0x55678b10b4e0 2024-09-13T19:18:03.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.493+0000 7fc979e0b640 1 -- 172.21.15.102:0/3283480953 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca84004520 con 0x55678b10b4e0 2024-09-13T19:18:03.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.493+0000 7fc979e0b640 1 -- 172.21.15.102:0/3283480953 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca84004880 con 0x55678b10b4e0 2024-09-13T19:18:03.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.494+0000 7fca8ff3e800 1 -- 172.21.15.102:0/3283480953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55678b10b4e0 msgr2=0x55678b07fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.494+0000 7fca8ff3e800 1 --2- 172.21.15.102:0/3283480953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55678b10b4e0 0x55678b07fda0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fca84001680 tx=0x7fca84001b40 comp rx=0 tx=0).stop 2024-09-13T19:18:03.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.494+0000 7fca8ff3e800 1 -- 172.21.15.102:0/3283480953 shutdown_connections 2024-09-13T19:18:03.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.494+0000 7fca8ff3e800 1 --2- 172.21.15.102:0/3283480953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55678b10b4e0 0x55678b07fda0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.494+0000 7fca8ff3e800 1 -- 172.21.15.102:0/3283480953 >> 172.21.15.102:0/3283480953 conn(0x55678b106dd0 msgr2=0x55678b1f5fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:03.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.494+0000 7fca8ff3e800 1 -- 172.21.15.102:0/3283480953 shutdown_connections 2024-09-13T19:18:03.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.494+0000 7fca8ff3e800 1 -- 172.21.15.102:0/3283480953 wait complete. 2024-09-13T19:18:03.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.494+0000 7fca8ff3e800 1 Processor -- start 2024-09-13T19:18:03.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.494+0000 7fca8ff3e800 1 -- start start 2024-09-13T19:18:03.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.495+0000 7fca8ff3e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55678b10b4e0 0x55678b1fbd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.495+0000 7fca8ff3e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55678b112550 con 0x55678b10b4e0 2024-09-13T19:18:03.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.495+0000 7fca8bc34640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55678b10b4e0 0x55678b1fbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.495+0000 7fca8bc34640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55678b10b4e0 0x55678b1fbd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49944/0 (socket says 172.21.15.102:49944) 2024-09-13T19:18:03.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.495+0000 7fca8bc34640 1 -- 172.21.15.102:0/2364725702 learned_addr learned my addr 172.21.15.102:0/2364725702 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:03.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.495+0000 7fca8bc34640 1 -- 172.21.15.102:0/2364725702 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55678afb9fe0 con 0x55678b10b4e0 2024-09-13T19:18:03.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.495+0000 7fca8bc34640 1 --2- 172.21.15.102:0/2364725702 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55678b10b4e0 0x55678b1fbd80 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fca84014040 tx=0x7fca84001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.496+0000 7fc973fff640 1 -- 172.21.15.102:0/2364725702 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca84021020 con 0x55678b10b4e0 2024-09-13T19:18:03.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.496+0000 7fc973fff640 1 -- 172.21.15.102:0/2364725702 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca84011530 con 0x55678b10b4e0 2024-09-13T19:18:03.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.496+0000 7fca8ff3e800 1 -- 172.21.15.102:0/2364725702 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55678b1fa470 con 0x55678b10b4e0 2024-09-13T19:18:03.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.496+0000 7fc973fff640 1 -- 172.21.15.102:0/2364725702 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca84016040 con 0x55678b10b4e0 2024-09-13T19:18:03.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.496+0000 7fca8ff3e800 1 -- 172.21.15.102:0/2364725702 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55678b1fa930 con 0x55678b10b4e0 2024-09-13T19:18:03.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.496+0000 7fc973fff640 1 -- 172.21.15.102:0/2364725702 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fca84024020 con 0x55678b10b4e0 2024-09-13T19:18:03.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.497+0000 7fc973fff640 1 --2- 172.21.15.102:0/2364725702 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc974036b90 0x7fc974039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.497+0000 7fc973fff640 1 -- 172.21.15.102:0/2364725702 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fca8404c100 con 0x55678b10b4e0 2024-09-13T19:18:03.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.497+0000 7fca8b433640 1 --2- 172.21.15.102:0/2364725702 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc974036b90 0x7fc974039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.497+0000 7fca8ff3e800 1 --2- 172.21.15.102:0/2364725702 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55678b10f920 0x55678b20c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.497+0000 7fca8ff3e800 1 -- 172.21.15.102:0/2364725702 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55678b20ca90 con 0x55678b10f920 2024-09-13T19:18:03.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.497+0000 7fca8c435640 1 --2- 172.21.15.102:0/2364725702 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55678b10f920 0x55678b20c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.497+0000 7fca8b433640 1 --2- 172.21.15.102:0/2364725702 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc974036b90 0x7fc974039050 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x55678b10c2e0 tx=0x7fca74050000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.497+0000 7fca8c435640 1 --2- 172.21.15.102:0/2364725702 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55678b10f920 0x55678b20c550 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.497+0000 7fca8c435640 1 -- 172.21.15.102:0/2364725702 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca7c0083e0 con 0x55678b10f920 2024-09-13T19:18:03.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.497+0000 7fca8ff3e800 1 -- 172.21.15.102:0/2364725702 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55678b20d2e0 con 0x55678b10f920 2024-09-13T19:18:03.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.498+0000 7fca8c435640 1 -- 172.21.15.102:0/2364725702 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fca7c0083e0 con 0x55678b10f920 2024-09-13T19:18:03.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.498+0000 7fca8ff3e800 1 --2- 172.21.15.102:0/2364725702 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55678b20ebf0 0x55678b211080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.498+0000 7fca8ff3e800 1 -- 172.21.15.102:0/2364725702 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55678b211810 con 0x55678b20ebf0 2024-09-13T19:18:03.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.498+0000 7fca8bc34640 1 --2- 172.21.15.102:0/2364725702 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55678b20ebf0 0x55678b211080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.498+0000 7fca8bc34640 1 --2- 172.21.15.102:0/2364725702 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55678b20ebf0 0x55678b211080 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.498+0000 7fca8bc34640 1 -- 172.21.15.102:0/2364725702 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fca8400f070 con 0x55678b20ebf0 2024-09-13T19:18:03.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.498+0000 7fca8ff3e800 1 -- 172.21.15.102:0/2364725702 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55678b20db30 con 0x55678b10f920 2024-09-13T19:18:03.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.499+0000 7fca8c435640 1 -- 172.21.15.102:0/2364725702 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fca7c0083e0 con 0x55678b10f920 2024-09-13T19:18:03.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.499+0000 7fca8ff3e800 1 -- 172.21.15.102:0/2364725702 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55678b20ded0 con 0x55678b20ebf0 2024-09-13T19:18:03.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.499+0000 7fca8bc34640 1 -- 172.21.15.102:0/2364725702 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fca8400f070 con 0x55678b20ebf0 2024-09-13T19:18:03.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.499+0000 7fca8ff3e800 1 Processor -- start 2024-09-13T19:18:03.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.499+0000 7fca8ff3e800 1 -- start start 2024-09-13T19:18:03.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.499+0000 7fca8ff3e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55678b220190 0x55678b2205b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.499+0000 7fca8ff3e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55678b1fc2c0 con 0x55678b220190 2024-09-13T19:18:03.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.500+0000 7fca8c435640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55678b220190 0x55678b2205b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.500+0000 7fca8c435640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55678b220190 0x55678b2205b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49958/0 (socket says 172.21.15.102:49958) 2024-09-13T19:18:03.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.500+0000 7fca8c435640 1 -- 172.21.15.102:0/2972357077 learned_addr learned my addr 172.21.15.102:0/2972357077 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:03.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.500+0000 7fca8c435640 1 -- 172.21.15.102:0/2972357077 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55678b220af0 con 0x55678b220190 2024-09-13T19:18:03.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.500+0000 7fca8c435640 1 --2- 172.21.15.102:0/2972357077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55678b220190 0x55678b2205b0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x55678b1fbac0 tx=0x7fca7c00beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.501+0000 7fc9717fa640 1 -- 172.21.15.102:0/2972357077 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca7c01c020 con 0x55678b220190 2024-09-13T19:18:03.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.501+0000 7fca8ff3e800 1 -- 172.21.15.102:0/2972357077 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55678b220d80 con 0x55678b220190 2024-09-13T19:18:03.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.501+0000 7fc9717fa640 1 -- 172.21.15.102:0/2972357077 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca7c007c30 con 0x55678b220190 2024-09-13T19:18:03.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.501+0000 7fca8ff3e800 1 -- 172.21.15.102:0/2972357077 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55678b223a60 con 0x55678b220190 2024-09-13T19:18:03.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.501+0000 7fc9717fa640 1 -- 172.21.15.102:0/2972357077 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca7c018440 con 0x55678b220190 2024-09-13T19:18:03.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.501+0000 7fc9717fa640 1 -- 172.21.15.102:0/2972357077 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fca7c01f020 con 0x55678b220190 2024-09-13T19:18:03.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.502+0000 7fc9717fa640 1 --2- 172.21.15.102:0/2972357077 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc964036b40 0x7fc964039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.502+0000 7fc9717fa640 1 -- 172.21.15.102:0/2972357077 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fca7c04e090 con 0x55678b220190 2024-09-13T19:18:03.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.502+0000 7fca8bc34640 1 --2- 172.21.15.102:0/2972357077 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc964036b40 0x7fc964039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.502+0000 7fca8ff3e800 1 Processor -- start 2024-09-13T19:18:03.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.502+0000 7fca8ff3e800 1 -- start start 2024-09-13T19:18:03.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.502+0000 7fca8bc34640 1 --2- 172.21.15.102:0/2972357077 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc964036b40 0x7fc964039000 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x55678b1132f0 tx=0x7fca8404a310 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.502+0000 7fca8ff3e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55678b22cf30 0x55678b22d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.502+0000 7fca8ff3e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55678afa7580 con 0x55678b22cf30 2024-09-13T19:18:03.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.503+0000 7fca8c435640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55678b22cf30 0x55678b22d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.503+0000 7fca8c435640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55678b22cf30 0x55678b22d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49968/0 (socket says 172.21.15.102:49968) 2024-09-13T19:18:03.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.503+0000 7fca8c435640 1 -- 172.21.15.102:0/3293410221 learned_addr learned my addr 172.21.15.102:0/3293410221 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:03.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.503+0000 7fca8c435640 1 -- 172.21.15.102:0/3293410221 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55678b22d900 con 0x55678b22cf30 2024-09-13T19:18:03.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.503+0000 7fca8c435640 1 --2- 172.21.15.102:0/3293410221 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55678b22cf30 0x55678b22d330 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fca7c008900 tx=0x7fca7c04c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91c926cf9303c790 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.503+0000 7fc96affd640 1 -- 172.21.15.102:0/3293410221 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca7c028c20 con 0x55678b22cf30 2024-09-13T19:18:03.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.503+0000 7fc96affd640 1 -- 172.21.15.102:0/3293410221 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca7c049040 con 0x55678b22cf30 2024-09-13T19:18:03.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.503+0000 7fc96affd640 1 -- 172.21.15.102:0/3293410221 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca7c0203b0 con 0x55678b22cf30 2024-09-13T19:18:03.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.504+0000 7fca8ff3e800 1 -- 172.21.15.102:0/3293410221 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55678b22cf30 msgr2=0x55678b22d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.504+0000 7fca8ff3e800 1 --2- 172.21.15.102:0/3293410221 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55678b22cf30 0x55678b22d330 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fca7c008900 tx=0x7fca7c04c510 comp rx=0 tx=0).stop 2024-09-13T19:18:03.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.504+0000 7fca8ff3e800 1 -- 172.21.15.102:0/3293410221 shutdown_connections 2024-09-13T19:18:03.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.504+0000 7fca8ff3e800 1 --2- 172.21.15.102:0/3293410221 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55678b22cf30 0x55678b22d330 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.504+0000 7fca8ff3e800 1 -- 172.21.15.102:0/3293410221 >> 172.21.15.102:0/3293410221 conn(0x55678b229290 msgr2=0x55678b227390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:03.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.504+0000 7fca8ff3e800 1 -- 172.21.15.102:0/3293410221 shutdown_connections 2024-09-13T19:18:03.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.504+0000 7fca8ff3e800 1 -- 172.21.15.102:0/3293410221 wait complete. 2024-09-13T19:18:03.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.504+0000 7fca8ff3e800 1 Processor -- start 2024-09-13T19:18:03.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.504+0000 7fca8ff3e800 1 -- start start 2024-09-13T19:18:03.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.504+0000 7fca8ff3e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55678b22cf30 0x55678b234260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.504+0000 7fca8ff3e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55678b22dcd0 con 0x55678b22cf30 2024-09-13T19:18:03.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.505+0000 7fca8c435640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55678b22cf30 0x55678b234260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.505+0000 7fca8c435640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55678b22cf30 0x55678b234260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49984/0 (socket says 172.21.15.102:49984) 2024-09-13T19:18:03.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.505+0000 7fca8c435640 1 -- 172.21.15.102:0/1391376005 learned_addr learned my addr 172.21.15.102:0/1391376005 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:03.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.505+0000 7fca8c435640 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55678b2347a0 con 0x55678b22cf30 2024-09-13T19:18:03.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.505+0000 7fca8c435640 1 --2- 172.21.15.102:0/1391376005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55678b22cf30 0x55678b234260 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fca7c0158b0 tx=0x7fca7c04c2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.505+0000 7fc9697fa640 1 -- 172.21.15.102:0/1391376005 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca7c038070 con 0x55678b22cf30 2024-09-13T19:18:03.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.505+0000 7fc9697fa640 1 -- 172.21.15.102:0/1391376005 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca7c028690 con 0x55678b22cf30 2024-09-13T19:18:03.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.505+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55678b234a30 con 0x55678b22cf30 2024-09-13T19:18:03.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.505+0000 7fc9697fa640 1 -- 172.21.15.102:0/1391376005 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca7c0289b0 con 0x55678b22cf30 2024-09-13T19:18:03.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.505+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55678b2376e0 con 0x55678b22cf30 2024-09-13T19:18:03.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.506+0000 7fc9697fa640 1 -- 172.21.15.102:0/1391376005 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fca7c03b070 con 0x55678b22cf30 2024-09-13T19:18:03.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.506+0000 7fc9697fa640 1 --2- 172.21.15.102:0/1391376005 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc954036af0 0x7fc954038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.506+0000 7fc9697fa640 1 -- 172.21.15.102:0/1391376005 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fca7c030070 con 0x55678b22cf30 2024-09-13T19:18:03.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.506+0000 7fca8bc34640 1 --2- 172.21.15.102:0/1391376005 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc954036af0 0x7fc954038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.507+0000 7fca8bc34640 1 --2- 172.21.15.102:0/1391376005 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc954036af0 0x7fc954038fb0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fca8402dfd0 tx=0x7fca84033000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.507+0000 7fca8ff3e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.507+0000 7fca8ff3e800 1 --2- 172.21.15.102:0/1391376005 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55678b23fd00 0x55678b2421c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.507+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55678b242910 con 0x55678b23fd00 2024-09-13T19:18:03.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.507+0000 7fca8b433640 1 --2- 172.21.15.102:0/1391376005 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55678b23fd00 0x55678b2421c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.507+0000 7fca8b433640 1 --2- 172.21.15.102:0/1391376005 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55678b23fd00 0x55678b2421c0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.507+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca7405c040 con 0x55678b23fd00 2024-09-13T19:18:03.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.507+0000 7fca8ff3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:03.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.507+0000 7fca8ff3e800 20 realm 2024-09-13T19:18:03.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.508+0000 7fca8ff3e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.508+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55678b242d40 con 0x55678b23fd00 2024-09-13T19:18:03.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.508+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca7405c040 con 0x55678b23fd00 2024-09-13T19:18:03.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.508+0000 7fca8ff3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:03.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.508+0000 7fca8ff3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:18:03.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.508+0000 7fca8ff3e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.508+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55678b243610 con 0x55678b23fd00 2024-09-13T19:18:03.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.508+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca7405c040 con 0x55678b23fd00 2024-09-13T19:18:03.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.508+0000 7fca8ff3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:03.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.508+0000 7fca8ff3e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.508+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55678b2439b0 con 0x55678b23fd00 2024-09-13T19:18:03.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.508+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fca7405c040 con 0x55678b23fd00 2024-09-13T19:18:03.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.508+0000 7fca8ff3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:18:03.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.508+0000 7fca8ff3e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.508+0000 7fca8ff3e800 1 --2- 172.21.15.102:0/1391376005 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55678b244710 0x55678b246b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.508+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55678b247150 con 0x55678b244710 2024-09-13T19:18:03.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.508+0000 7fca8c435640 1 --2- 172.21.15.102:0/1391376005 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55678b244710 0x55678b246b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.509+0000 7fca8c435640 1 --2- 172.21.15.102:0/1391376005 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55678b244710 0x55678b246b00 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.509+0000 7fca8c435640 1 -- 172.21.15.102:0/1391376005 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fca7c03a030 con 0x55678b244710 2024-09-13T19:18:03.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.509+0000 7fca8ff3e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:18:03.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.509+0000 7fca8ff3e800 20 searching for the correct realm 2024-09-13T19:18:03.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.509+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55678b248a80 con 0x55678b244710 2024-09-13T19:18:03.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.509+0000 7fca8c435640 1 -- 172.21.15.102:0/1391376005 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca7c03a030 con 0x55678b244710 2024-09-13T19:18:03.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.509+0000 7fca8c435640 1 --2- 172.21.15.102:0/1391376005 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fca7c05a040 0x7fca7c03d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.509+0000 7fca8c435640 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55678b248a80 con 0x7fca7c05a040 2024-09-13T19:18:03.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.509+0000 7fca8bc34640 1 --2- 172.21.15.102:0/1391376005 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fca7c05a040 0x7fca7c03d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.510+0000 7fca8bc34640 1 --2- 172.21.15.102:0/1391376005 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fca7c05a040 0x7fca7c03d890 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.510+0000 7fca8bc34640 1 -- 172.21.15.102:0/1391376005 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca8400f070 con 0x7fca7c05a040 2024-09-13T19:18:03.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.510+0000 7fca8bc34640 1 --2- 172.21.15.102:0/1391376005 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fca84026020 0x7fca8402d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.510+0000 7fca8bc34640 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55678b248a80 con 0x7fca84026020 2024-09-13T19:18:03.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.510+0000 7fca8b433640 1 --2- 172.21.15.102:0/1391376005 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fca84026020 0x7fca8402d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.511+0000 7fca8b433640 1 --2- 172.21.15.102:0/1391376005 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fca84026020 0x7fca8402d300 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.511+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca7405c040 con 0x7fca84026020 2024-09-13T19:18:03.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.511+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55678b248a80 con 0x55678b23fd00 2024-09-13T19:18:03.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.511+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca7405c040 con 0x55678b23fd00 2024-09-13T19:18:03.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.511+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55678b248a80 con 0x55678b23fd00 2024-09-13T19:18:03.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.511+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca7405c040 con 0x55678b23fd00 2024-09-13T19:18:03.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.511+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55678b248a80 con 0x7fca84026020 2024-09-13T19:18:03.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.512+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca7405c040 con 0x7fca84026020 2024-09-13T19:18:03.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.512+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55678b248a80 con 0x7fca84026020 2024-09-13T19:18:03.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.512+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca7405c040 con 0x7fca84026020 2024-09-13T19:18:03.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.512+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55678b248a80 con 0x7fca7c05a040 2024-09-13T19:18:03.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.512+0000 7fca8bc34640 1 -- 172.21.15.102:0/1391376005 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca8400f070 con 0x7fca7c05a040 2024-09-13T19:18:03.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.512+0000 7fca8bc34640 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55678b248a80 con 0x55678b244710 2024-09-13T19:18:03.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.512+0000 7fca8c435640 1 -- 172.21.15.102:0/1391376005 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca7c03a030 con 0x55678b244710 2024-09-13T19:18:03.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.512+0000 7fca8c435640 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55678b248a80 con 0x55678b23fd00 2024-09-13T19:18:03.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.513+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca7405c040 con 0x55678b23fd00 2024-09-13T19:18:03.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.513+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55678b248a80 con 0x7fca7c05a040 2024-09-13T19:18:03.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.513+0000 7fca8bc34640 1 -- 172.21.15.102:0/1391376005 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca8400f070 con 0x7fca7c05a040 2024-09-13T19:18:03.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.513+0000 7fca8bc34640 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55678b248a80 con 0x55678b23fd00 2024-09-13T19:18:03.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.513+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca7405c040 con 0x55678b23fd00 2024-09-13T19:18:03.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.513+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55678b248a80 con 0x7fca7c05a040 2024-09-13T19:18:03.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.513+0000 7fca8bc34640 1 -- 172.21.15.102:0/1391376005 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fca8400f070 con 0x7fca7c05a040 2024-09-13T19:18:03.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.513+0000 7fca8bc34640 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55678b248a80 con 0x55678b244710 2024-09-13T19:18:03.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.513+0000 7fca8c435640 1 -- 172.21.15.102:0/1391376005 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca7c03a030 con 0x55678b244710 2024-09-13T19:18:03.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.513+0000 7fca8c435640 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55678b248a80 con 0x55678b244710 2024-09-13T19:18:03.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.514+0000 7fca8c435640 1 -- 172.21.15.102:0/1391376005 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fca7c03a030 con 0x55678b244710 2024-09-13T19:18:03.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.514+0000 7fca8c435640 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55678b248a80 con 0x7fca84026020 2024-09-13T19:18:03.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.514+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca7405c040 con 0x7fca84026020 2024-09-13T19:18:03.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.514+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55678b248a80 con 0x55678b244710 2024-09-13T19:18:03.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.514+0000 7fca8c435640 1 -- 172.21.15.102:0/1391376005 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fca7c03a030 con 0x55678b244710 2024-09-13T19:18:03.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.514+0000 7fca8c435640 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55678b248a80 con 0x55678b244710 2024-09-13T19:18:03.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.514+0000 7fca8c435640 1 -- 172.21.15.102:0/1391376005 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca7c03a030 con 0x55678b244710 2024-09-13T19:18:03.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.514+0000 7fca8c435640 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55678b248a80 con 0x55678b23fd00 2024-09-13T19:18:03.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.515+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca7405c040 con 0x55678b23fd00 2024-09-13T19:18:03.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.515+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55678b248a80 con 0x55678b23fd00 2024-09-13T19:18:03.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.515+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fca7405c040 con 0x55678b23fd00 2024-09-13T19:18:03.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.515+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55678b248a80 con 0x7fca84026020 2024-09-13T19:18:03.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.515+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca7405c040 con 0x7fca84026020 2024-09-13T19:18:03.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.515+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55678b248a80 con 0x55678b244710 2024-09-13T19:18:03.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.516+0000 7fca8c435640 1 -- 172.21.15.102:0/1391376005 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca7c069040 con 0x55678b244710 2024-09-13T19:18:03.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.516+0000 7fca8c435640 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55678b248a80 con 0x7fca7c05a040 2024-09-13T19:18:03.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.516+0000 7fca8bc34640 1 -- 172.21.15.102:0/1391376005 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca8400f070 con 0x7fca7c05a040 2024-09-13T19:18:03.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.516+0000 7fca8bc34640 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55678b248a80 con 0x55678b23fd00 2024-09-13T19:18:03.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.516+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca7405c040 con 0x55678b23fd00 2024-09-13T19:18:03.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.516+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55678b248a80 con 0x7fca7c05a040 2024-09-13T19:18:03.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.516+0000 7fca8bc34640 1 -- 172.21.15.102:0/1391376005 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca8400f070 con 0x7fca7c05a040 2024-09-13T19:18:03.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.516+0000 7fca8bc34640 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55678b248a80 con 0x55678b244710 2024-09-13T19:18:03.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.517+0000 7fca8c435640 1 -- 172.21.15.102:0/1391376005 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca7c069040 con 0x55678b244710 2024-09-13T19:18:03.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.517+0000 7fca8c435640 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55678b248a80 con 0x7fca84026020 2024-09-13T19:18:03.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.517+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca7405c040 con 0x7fca84026020 2024-09-13T19:18:03.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.517+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55678b248a80 con 0x7fca7c05a040 2024-09-13T19:18:03.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.517+0000 7fca8bc34640 1 -- 172.21.15.102:0/1391376005 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca8400f070 con 0x7fca7c05a040 2024-09-13T19:18:03.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.517+0000 7fca8bc34640 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55678b248a80 con 0x55678b244710 2024-09-13T19:18:03.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.517+0000 7fca8c435640 1 -- 172.21.15.102:0/1391376005 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca7c069040 con 0x55678b244710 2024-09-13T19:18:03.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.517+0000 7fca8c435640 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55678b248a80 con 0x7fca84026020 2024-09-13T19:18:03.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.518+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca7405c040 con 0x7fca84026020 2024-09-13T19:18:03.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.518+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55678b248a80 con 0x55678b23fd00 2024-09-13T19:18:03.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.518+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v36'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fca7405c040 con 0x55678b23fd00 2024-09-13T19:18:03.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.518+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55678b248a80 con 0x7fca7c05a040 2024-09-13T19:18:03.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.518+0000 7fca8bc34640 1 -- 172.21.15.102:0/1391376005 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca8400f070 con 0x7fca7c05a040 2024-09-13T19:18:03.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.518+0000 7fca8ff3e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:18:03.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.518+0000 7fca8ff3e800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:18:03.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.518+0000 7fca8ff3e800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:18:03.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.518+0000 7fca8ff3e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:18:03.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.518+0000 7fca8ff3e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:18:03.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.518+0000 7fca8ff3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:18:03.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.518+0000 7fca8ff3e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.518+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55678b247b40 con 0x55678b23fd00 2024-09-13T19:18:03.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.518+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca7405c040 con 0x55678b23fd00 2024-09-13T19:18:03.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.518+0000 7fca8ff3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:03.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.518+0000 7fca8ff3e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.518+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55678b2483e0 con 0x55678b23fd00 2024-09-13T19:18:03.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.519+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fca7405c040 con 0x55678b23fd00 2024-09-13T19:18:03.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.519+0000 7fca8ff3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:18:03.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.519+0000 7fca8ff3e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.519+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55678b248f00 con 0x55678b244710 2024-09-13T19:18:03.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.519+0000 7fca8c435640 1 -- 172.21.15.102:0/1391376005 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fca7c069040 con 0x55678b244710 2024-09-13T19:18:03.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.519+0000 7fca8ff3e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:18:03.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.519+0000 7fca8ff3e800 20 zone default found 2024-09-13T19:18:03.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.519+0000 7fca8ff3e800 4 Realm: () 2024-09-13T19:18:03.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.519+0000 7fca8ff3e800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:18:03.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.519+0000 7fca8ff3e800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:18:03.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.519+0000 7fca8ff3e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:18:03.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.519+0000 7fca8ff3e800 20 zonegroup default 2024-09-13T19:18:03.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.519+0000 7fca8ff3e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.519+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55678b249750 con 0x7fca7c05a040 2024-09-13T19:18:03.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.519+0000 7fca8bc34640 1 -- 172.21.15.102:0/1391376005 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fca8400f070 con 0x7fca7c05a040 2024-09-13T19:18:03.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.519+0000 7fca8ff3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:03.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.519+0000 7fca8ff3e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.519+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55678b24b4d0 con 0x55678b244710 2024-09-13T19:18:03.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.519+0000 7fca8c435640 1 -- 172.21.15.102:0/1391376005 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fca7c069040 con 0x55678b244710 2024-09-13T19:18:03.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.519+0000 7fca8ff3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:03.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.519+0000 7fca8ff3e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.519+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55678b24b8e0 con 0x55678b244710 2024-09-13T19:18:03.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.520+0000 7fca8c435640 1 -- 172.21.15.102:0/1391376005 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fca7c069040 con 0x55678b244710 2024-09-13T19:18:03.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.520+0000 7fca8ff3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:03.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.520+0000 7fca8ff3e800 20 started sync module instance, tier type = 2024-09-13T19:18:03.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.520+0000 7fca8ff3e800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:18:03.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.520+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55678b24a970 con 0x7fca7c05a040 2024-09-13T19:18:03.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.521+0000 7fca8bc34640 1 -- 172.21.15.102:0/1391376005 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(44 notify.0 [create] v36'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca8400f070 con 0x7fca7c05a040 2024-09-13T19:18:03.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.521+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93903204426944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55678b24b8e0 con 0x7fca7c05a040 2024-09-13T19:18:03.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.521+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55678b24c130 con 0x55678b23fd00 2024-09-13T19:18:03.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.522+0000 7fca8bc34640 1 -- 172.21.15.102:0/1391376005 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93903204426944] v36'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca8400f070 con 0x7fca7c05a040 2024-09-13T19:18:03.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.522+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v36'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca7405c040 con 0x55678b23fd00 2024-09-13T19:18:03.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.522+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93903204433024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55678b24c550 con 0x55678b23fd00 2024-09-13T19:18:03.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.522+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55678b24cf10 con 0x55678b244710 2024-09-13T19:18:03.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.523+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93903204433024] v36'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca7405c040 con 0x55678b23fd00 2024-09-13T19:18:03.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.523+0000 7fca8c435640 1 -- 172.21.15.102:0/1391376005 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v36'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca7c069040 con 0x55678b244710 2024-09-13T19:18:03.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.523+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93903204434560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55678b24cf10 con 0x55678b244710 2024-09-13T19:18:03.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.523+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55678b24d930 con 0x7fca7c05a040 2024-09-13T19:18:03.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.524+0000 7fca8bc34640 1 -- 172.21.15.102:0/1391376005 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(50 notify.3 [create] v36'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca8400f070 con 0x7fca7c05a040 2024-09-13T19:18:03.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.524+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93903204439072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55678b24e1d0 con 0x7fca7c05a040 2024-09-13T19:18:03.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.524+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55678b24ecb0 con 0x55678b23fd00 2024-09-13T19:18:03.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.524+0000 7fca8c435640 1 -- 172.21.15.102:0/1391376005 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93903204434560] v36'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca7c069040 con 0x55678b244710 2024-09-13T19:18:03.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.525+0000 7fca8bc34640 1 -- 172.21.15.102:0/1391376005 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93903204439072] v36'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca8400f070 con 0x7fca7c05a040 2024-09-13T19:18:03.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.525+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v36'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca7405c040 con 0x55678b23fd00 2024-09-13T19:18:03.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.526+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93903204444096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55678b24dd20 con 0x55678b23fd00 2024-09-13T19:18:03.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.526+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55678b24f550 con 0x7fca84026020 2024-09-13T19:18:03.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.527+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(54 notify.5 [create] v36'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca7405c040 con 0x7fca84026020 2024-09-13T19:18:03.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.527+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93903204446368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55678b24f970 con 0x7fca84026020 2024-09-13T19:18:03.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.527+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55678b2501c0 con 0x7fca84026020 2024-09-13T19:18:03.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.527+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93903204444096] v36'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca7405c040 con 0x55678b23fd00 2024-09-13T19:18:03.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.528+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 93903204446368] v36'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca7405c040 con 0x7fca84026020 2024-09-13T19:18:03.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.528+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(56 notify.6 [create] v36'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca7405c040 con 0x7fca84026020 2024-09-13T19:18:03.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.528+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93903204447424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55678b24fd90 con 0x7fca84026020 2024-09-13T19:18:03.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.528+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55678b250640 con 0x7fca84026020 2024-09-13T19:18:03.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.529+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 93903204447424] v36'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca7405c040 con 0x7fca84026020 2024-09-13T19:18:03.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.529+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(58 notify.7 [create] v36'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca7405c040 con 0x7fca84026020 2024-09-13T19:18:03.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.529+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93903204448480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55678b250820 con 0x7fca84026020 2024-09-13T19:18:03.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.529+0000 7fca8ff3e800 20 add_watcher() i=0 2024-09-13T19:18:03.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.529+0000 7fca8ff3e800 20 add_watcher() i=1 2024-09-13T19:18:03.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.529+0000 7fca8ff3e800 20 add_watcher() i=2 2024-09-13T19:18:03.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.529+0000 7fca8ff3e800 20 add_watcher() i=3 2024-09-13T19:18:03.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.529+0000 7fca8ff3e800 20 add_watcher() i=4 2024-09-13T19:18:03.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.529+0000 7fca8ff3e800 20 add_watcher() i=5 2024-09-13T19:18:03.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.529+0000 7fca8ff3e800 20 add_watcher() i=6 2024-09-13T19:18:03.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.530+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 93903204448480] v36'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca7405c040 con 0x7fca84026020 2024-09-13T19:18:03.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.530+0000 7fca8ff3e800 20 add_watcher() i=7 2024-09-13T19:18:03.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.530+0000 7fca8ff3e800 2 all 8 watchers are set, enabling cache 2024-09-13T19:18:03.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.530+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55678b253bf0 con 0x55678b23fd00 2024-09-13T19:18:03.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.530+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fca7405c040 con 0x55678b23fd00 2024-09-13T19:18:03.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.530+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93903204452112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55678b250fe0 con 0x55678b23fd00 2024-09-13T19:18:03.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.531+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93903204452112] v36'259 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fca7405c040 con 0x55678b23fd00 2024-09-13T19:18:03.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.531+0000 7fc941fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:18:03.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.532+0000 7fca8ff3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:18:03.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.532+0000 7fca8ff3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:18:03.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.532+0000 7fca8ff3e800 5 note: GC not initialized 2024-09-13T19:18:03.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.532+0000 7fc940fe1640 20 reqs_thread_entry: start 2024-09-13T19:18:03.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.532+0000 7fca8ff3e800 20 init_complete bucket index max shards: 11 2024-09-13T19:18:03.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.532+0000 7fca8ff3e800 20 Filter name: none 2024-09-13T19:18:03.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.532+0000 7fc8ba7fc640 20 reqs_thread_entry: start 2024-09-13T19:18:03.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.532+0000 7fca8ff3e800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T19:18:03.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.532+0000 7fca8ff3e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.532+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55678b286ec0 con 0x7fca84026020 2024-09-13T19:18:03.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.533+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7fca7405c040 con 0x7fca84026020 2024-09-13T19:18:03.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.533+0000 7fca8ff3e800 20 rados_obj.operate() r=0 bl.length=490 2024-09-13T19:18:03.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.533+0000 7fca8ff3e800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T19:18:03.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.533+0000 7fca8ff3e800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:18:03.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.533+0000 7fca8ff3e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:18:03.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.533+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55678b28d690 con 0x7fca84026020 2024-09-13T19:18:03.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.534+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v36'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fca7405c040 con 0x7fca84026020 2024-09-13T19:18:03.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.534+0000 7fca8ff3e800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:18:03.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.534+0000 7fca8ff3e800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:18:03.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.534+0000 7fca8ff3e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T19:18:03.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.534+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93903204700240 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55678b288cd0 con 0x55678b23fd00 2024-09-13T19:18:03.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.535+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== watch-notify(notify (1) cookie 93903204444096 notify 154618822697 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7fca74075040 con 0x55678b23fd00 2024-09-13T19:18:03.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.535+0000 7fc96affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822697 cookie 93903204444096 notifier 4888 bl.length()=666 2024-09-13T19:18:03.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.535+0000 7fc96affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:18:03.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.535+0000 7fc96affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:18:03.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.535+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(64 notify.4 [notify cookie 93903204700240 out=8b] v0'0 uv261 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fca7405c040 con 0x55678b23fd00 2024-09-13T19:18:03.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.535+0000 7fc96affd640 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fc950003ea0 con 0x55678b23fd00 2024-09-13T19:18:03.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.535+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca7405c040 con 0x55678b23fd00 2024-09-13T19:18:03.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.535+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== watch-notify(notify_complete (2) cookie 93903204700240 notify 154618822697 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fca74068040 con 0x55678b23fd00 2024-09-13T19:18:03.566 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T19:18:02.251000Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:18:02.250985Z","tags":[],"group_ids":[]} 2024-09-13T19:18:03.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.536+0000 7fc941fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:18:03.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.536+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93903204452112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55678b284c00 con 0x55678b23fd00 2024-09-13T19:18:03.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.537+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93903204452112] v36'260 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fca7405c040 con 0x55678b23fd00 2024-09-13T19:18:03.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.537+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93903204426944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55678b284c00 con 0x7fca7c05a040 2024-09-13T19:18:03.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.538+0000 7fca8bc34640 1 -- 172.21.15.102:0/1391376005 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93903204426944] v36'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca8400f070 con 0x7fca7c05a040 2024-09-13T19:18:03.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.538+0000 7fca8ff3e800 20 remove_watcher() i=0 2024-09-13T19:18:03.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.538+0000 7fca8ff3e800 2 removed watcher, disabling cache 2024-09-13T19:18:03.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.538+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93903204433024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55678b284c00 con 0x55678b23fd00 2024-09-13T19:18:03.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.539+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93903204433024] v36'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca7405c040 con 0x55678b23fd00 2024-09-13T19:18:03.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.539+0000 7fca8ff3e800 20 remove_watcher() i=1 2024-09-13T19:18:03.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.539+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93903204434560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55678b284c00 con 0x55678b244710 2024-09-13T19:18:03.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.540+0000 7fca8c435640 1 -- 172.21.15.102:0/1391376005 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93903204434560] v36'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca7c069040 con 0x55678b244710 2024-09-13T19:18:03.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.540+0000 7fca8ff3e800 20 remove_watcher() i=2 2024-09-13T19:18:03.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.540+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93903204439072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55678b284c00 con 0x7fca7c05a040 2024-09-13T19:18:03.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.541+0000 7fca8bc34640 1 -- 172.21.15.102:0/1391376005 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93903204439072] v36'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca8400f070 con 0x7fca7c05a040 2024-09-13T19:18:03.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.541+0000 7fca8ff3e800 20 remove_watcher() i=3 2024-09-13T19:18:03.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.541+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93903204444096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55678b284c00 con 0x55678b23fd00 2024-09-13T19:18:03.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.543+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93903204444096] v36'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca7405c040 con 0x55678b23fd00 2024-09-13T19:18:03.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.543+0000 7fca8ff3e800 20 remove_watcher() i=4 2024-09-13T19:18:03.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.543+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93903204446368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55678b284c00 con 0x7fca84026020 2024-09-13T19:18:03.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.544+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93903204446368] v36'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca7405c040 con 0x7fca84026020 2024-09-13T19:18:03.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.544+0000 7fca8ff3e800 20 remove_watcher() i=5 2024-09-13T19:18:03.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.544+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93903204447424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55678b284c00 con 0x7fca84026020 2024-09-13T19:18:03.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.545+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93903204447424] v36'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca7405c040 con 0x7fca84026020 2024-09-13T19:18:03.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.545+0000 7fca8ff3e800 20 remove_watcher() i=6 2024-09-13T19:18:03.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.545+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93903204448480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55678b284c00 con 0x7fca84026020 2024-09-13T19:18:03.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.546+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93903204448480] v36'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca7405c040 con 0x7fca84026020 2024-09-13T19:18:03.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.546+0000 7fca8ff3e800 20 remove_watcher() i=7 2024-09-13T19:18:03.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.546+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fca84026020 msgr2=0x7fca8402d300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.546+0000 7fca8ff3e800 1 --2- 172.21.15.102:0/1391376005 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fca84026020 0x7fca8402d300 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.546+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55678b23fd00 msgr2=0x55678b2421c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.546+0000 7fca8ff3e800 1 --2- 172.21.15.102:0/1391376005 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55678b23fd00 0x55678b2421c0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.546+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fca7c05a040 msgr2=0x7fca7c03d890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.546+0000 7fca8ff3e800 1 --2- 172.21.15.102:0/1391376005 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fca7c05a040 0x7fca7c03d890 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.546+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55678b244710 msgr2=0x55678b246b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.546+0000 7fca8ff3e800 1 --2- 172.21.15.102:0/1391376005 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55678b244710 0x55678b246b00 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.546+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc954036af0 msgr2=0x7fc954038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.546+0000 7fca8ff3e800 1 --2- 172.21.15.102:0/1391376005 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc954036af0 0x7fc954038fb0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fca8402dfd0 tx=0x7fca84033000 comp rx=0 tx=0).stop 2024-09-13T19:18:03.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.546+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55678b22cf30 msgr2=0x55678b234260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.546+0000 7fca8ff3e800 1 --2- 172.21.15.102:0/1391376005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55678b22cf30 0x55678b234260 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fca7c0158b0 tx=0x7fca7c04c2a0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.546+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 reap_dead start 2024-09-13T19:18:03.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.546+0000 7fca8b433640 1 -- 172.21.15.102:0/1391376005 reap_dead start 2024-09-13T19:18:03.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.546+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 shutdown_connections 2024-09-13T19:18:03.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.546+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 >> 172.21.15.102:0/1391376005 conn(0x55678b229290 msgr2=0x55678b227360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:03.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.546+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 shutdown_connections 2024-09-13T19:18:03.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.546+0000 7fca8ff3e800 1 -- 172.21.15.102:0/1391376005 wait complete. 2024-09-13T19:18:03.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.547+0000 7fca8ff3e800 1 -- 172.21.15.102:0/2972357077 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc964036b40 msgr2=0x7fc964039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.547+0000 7fca8ff3e800 1 --2- 172.21.15.102:0/2972357077 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc964036b40 0x7fc964039000 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x55678b1132f0 tx=0x7fca8404a310 comp rx=0 tx=0).stop 2024-09-13T19:18:03.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.547+0000 7fca8ff3e800 1 -- 172.21.15.102:0/2972357077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55678b220190 msgr2=0x55678b2205b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.547+0000 7fca8ff3e800 1 --2- 172.21.15.102:0/2972357077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55678b220190 0x55678b2205b0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x55678b1fbac0 tx=0x7fca7c00beb0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.547+0000 7fca8ff3e800 1 -- 172.21.15.102:0/2972357077 shutdown_connections 2024-09-13T19:18:03.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.547+0000 7fca8ff3e800 1 --2- 172.21.15.102:0/2972357077 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc964036b40 0x7fc964039000 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.547+0000 7fca8ff3e800 1 --2- 172.21.15.102:0/2972357077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55678b220190 0x55678b2205b0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.547+0000 7fca8ff3e800 1 -- 172.21.15.102:0/2972357077 >> 172.21.15.102:0/2972357077 conn(0x55678b215120 msgr2=0x55678b217ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:03.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.547+0000 7fca8ff3e800 1 -- 172.21.15.102:0/2972357077 shutdown_connections 2024-09-13T19:18:03.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.547+0000 7fca8ff3e800 1 -- 172.21.15.102:0/2972357077 wait complete. 2024-09-13T19:18:03.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.547+0000 7fca8ff3e800 1 -- 172.21.15.102:0/2364725702 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55678b10f920 msgr2=0x55678b20c550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.547+0000 7fca8ff3e800 1 --2- 172.21.15.102:0/2364725702 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55678b10f920 0x55678b20c550 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.547+0000 7fca8ff3e800 1 -- 172.21.15.102:0/2364725702 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55678b20ebf0 msgr2=0x55678b211080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.547+0000 7fca8ff3e800 1 --2- 172.21.15.102:0/2364725702 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55678b20ebf0 0x55678b211080 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.547+0000 7fca8ff3e800 1 -- 172.21.15.102:0/2364725702 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc974036b90 msgr2=0x7fc974039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.547+0000 7fca8ff3e800 1 --2- 172.21.15.102:0/2364725702 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc974036b90 0x7fc974039050 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x55678b10c2e0 tx=0x7fca74050000 comp rx=0 tx=0).stop 2024-09-13T19:18:03.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.547+0000 7fca8ff3e800 1 -- 172.21.15.102:0/2364725702 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55678b10b4e0 msgr2=0x55678b1fbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.547+0000 7fca8ff3e800 1 --2- 172.21.15.102:0/2364725702 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55678b10b4e0 0x55678b1fbd80 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fca84014040 tx=0x7fca84001250 comp rx=0 tx=0).stop 2024-09-13T19:18:03.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.547+0000 7fca8ff3e800 1 -- 172.21.15.102:0/2364725702 shutdown_connections 2024-09-13T19:18:03.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.547+0000 7fca8ff3e800 1 --2- 172.21.15.102:0/2364725702 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55678b20ebf0 0x55678b211080 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.547+0000 7fca8ff3e800 1 --2- 172.21.15.102:0/2364725702 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55678b10f920 0x55678b20c550 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.547+0000 7fca8ff3e800 1 --2- 172.21.15.102:0/2364725702 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fc974036b90 0x7fc974039050 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.547+0000 7fca8ff3e800 1 --2- 172.21.15.102:0/2364725702 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55678b10b4e0 0x55678b1fbd80 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.547+0000 7fca8ff3e800 1 -- 172.21.15.102:0/2364725702 >> 172.21.15.102:0/2364725702 conn(0x55678b106dd0 msgr2=0x55678b1f48d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:03.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.547+0000 7fca8ff3e800 1 -- 172.21.15.102:0/2364725702 shutdown_connections 2024-09-13T19:18:03.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.547+0000 7fca8ff3e800 1 -- 172.21.15.102:0/2364725702 wait complete. 2024-09-13T19:18:03.576 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:18:02.251000Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:18:02.250985Z', 'tags': [], 'group_ids': []} 2024-09-13T19:18:03.577 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:18:02.251000Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:18:02.250985Z', 'tags': [], 'group_ids': []} 2024-09-13T19:18:03.577 ERROR:root:0 2024-09-13T19:18:03.577 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:18:03.593 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:18:03.593 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T19:18:03.593 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T19:18:03.593 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-13T19:18:03.642 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:18:03.642 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:18:03.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.639+0000 7f01b3410800 1 Processor -- start 2024-09-13T19:18:03.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.639+0000 7f01b3410800 1 -- start start 2024-09-13T19:18:03.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.640+0000 7f01b3410800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x564c2bb2ad20 0x564c2bb2d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.640+0000 7f01b3410800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564c2b9e3b30 con 0x564c2ba97e10 2024-09-13T19:18:03.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.640+0000 7f01b3410800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x564c2b9c5360 con 0x564c2bb2ad20 2024-09-13T19:18:03.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.640+0000 7f01ae2f6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x564c2bb2ad20 0x564c2bb2d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.640+0000 7f01ae2f6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x564c2bb2ad20 0x564c2bb2d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:49996/0 (socket says 172.21.15.102:49996) 2024-09-13T19:18:03.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.640+0000 7f01aeaf7640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x564c2ba97e10 0x564c2bb29600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:53774/0 (socket says 172.21.15.102:53774) 2024-09-13T19:18:03.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.640+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3448008470 learned_addr learned my addr 172.21.15.102:0/3448008470 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:03.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.640+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3448008470 >> v1:172.21.15.53:6789/0 conn(0x564c2ba97e10 legacy=0x564c2bb29600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.640+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3448008470 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c2b9ebe00 con 0x564c2bb2ad20 2024-09-13T19:18:03.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.642+0000 7f01ae2f6640 1 --2- 172.21.15.102:0/3448008470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c2bb2ad20 0x564c2bb2d110 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f01a400a520 tx=0x7f01a4045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c5a0b4ac5d1109a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.642+0000 7f01adaf5640 1 -- 172.21.15.102:0/3448008470 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a4055070 con 0x564c2bb2ad20 2024-09-13T19:18:03.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.642+0000 7f01adaf5640 1 -- 172.21.15.102:0/3448008470 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01a40515b0 con 0x564c2bb2ad20 2024-09-13T19:18:03.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.642+0000 7f01adaf5640 1 -- 172.21.15.102:0/3448008470 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a40518d0 con 0x564c2bb2ad20 2024-09-13T19:18:03.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.643+0000 7f01b3410800 1 -- 172.21.15.102:0/3448008470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c2bb2ad20 msgr2=0x564c2bb2d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.643+0000 7f01b3410800 1 --2- 172.21.15.102:0/3448008470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c2bb2ad20 0x564c2bb2d110 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f01a400a520 tx=0x7f01a4045ba0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.643+0000 7f01b3410800 1 -- 172.21.15.102:0/3448008470 shutdown_connections 2024-09-13T19:18:03.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.643+0000 7f01b3410800 1 --2- 172.21.15.102:0/3448008470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c2bb2ad20 0x564c2bb2d110 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.643+0000 7f01b3410800 1 -- 172.21.15.102:0/3448008470 >> 172.21.15.102:0/3448008470 conn(0x564c2bb1edd0 msgr2=0x564c2bb211f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:03.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.643+0000 7f01b3410800 1 -- 172.21.15.102:0/3448008470 shutdown_connections 2024-09-13T19:18:03.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.643+0000 7f01b3410800 1 -- 172.21.15.102:0/3448008470 wait complete. 2024-09-13T19:18:03.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.657+0000 7f01b3410800 1 Processor -- start 2024-09-13T19:18:03.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.657+0000 7f01b3410800 1 -- start start 2024-09-13T19:18:03.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.657+0000 7f01b3410800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c2ba97e10 0x564c2bc15b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.657+0000 7f01b3410800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564c2ba70360 con 0x564c2ba97e10 2024-09-13T19:18:03.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.657+0000 7f01aeaf7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c2ba97e10 0x564c2bc15b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.657+0000 7f01aeaf7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c2ba97e10 0x564c2bc15b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:50004/0 (socket says 172.21.15.102:50004) 2024-09-13T19:18:03.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.657+0000 7f01aeaf7640 1 -- 172.21.15.102:0/1153968910 learned_addr learned my addr 172.21.15.102:0/1153968910 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:03.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.657+0000 7f01aeaf7640 1 -- 172.21.15.102:0/1153968910 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c2b9bdbc0 con 0x564c2ba97e10 2024-09-13T19:18:03.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.658+0000 7f01aeaf7640 1 --2- 172.21.15.102:0/1153968910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c2ba97e10 0x564c2bc15b00 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f01a000b230 tx=0x7f01a000b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95f3d5f01ef80cbb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.658+0000 7f009ce09640 1 -- 172.21.15.102:0/1153968910 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a000e5c0 con 0x564c2ba97e10 2024-09-13T19:18:03.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.658+0000 7f009ce09640 1 -- 172.21.15.102:0/1153968910 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01a0006070 con 0x564c2ba97e10 2024-09-13T19:18:03.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.658+0000 7f009ce09640 1 -- 172.21.15.102:0/1153968910 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a000e890 con 0x564c2ba97e10 2024-09-13T19:18:03.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.659+0000 7f01b3410800 1 -- 172.21.15.102:0/1153968910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c2ba97e10 msgr2=0x564c2bc15b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.659+0000 7f01b3410800 1 --2- 172.21.15.102:0/1153968910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c2ba97e10 0x564c2bc15b00 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f01a000b230 tx=0x7f01a000b6f0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.659+0000 7f01b3410800 1 -- 172.21.15.102:0/1153968910 shutdown_connections 2024-09-13T19:18:03.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.659+0000 7f01b3410800 1 --2- 172.21.15.102:0/1153968910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c2ba97e10 0x564c2bc15b00 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.659+0000 7f01b3410800 1 -- 172.21.15.102:0/1153968910 >> 172.21.15.102:0/1153968910 conn(0x564c2bb1edd0 msgr2=0x564c2bc114c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:03.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.659+0000 7f01b3410800 1 -- 172.21.15.102:0/1153968910 shutdown_connections 2024-09-13T19:18:03.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.659+0000 7f01b3410800 1 -- 172.21.15.102:0/1153968910 wait complete. 2024-09-13T19:18:03.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.659+0000 7f01b3410800 1 Processor -- start 2024-09-13T19:18:03.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.659+0000 7f01b3410800 1 -- start start 2024-09-13T19:18:03.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.659+0000 7f01b3410800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c2ba97e10 0x564c2bc1d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.659+0000 7f01b3410800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564c2bb2d920 con 0x564c2ba97e10 2024-09-13T19:18:03.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.659+0000 7f01aeaf7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c2ba97e10 0x564c2bc1d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.659+0000 7f01aeaf7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c2ba97e10 0x564c2bc1d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:50010/0 (socket says 172.21.15.102:50010) 2024-09-13T19:18:03.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.659+0000 7f01aeaf7640 1 -- 172.21.15.102:0/2681613459 learned_addr learned my addr 172.21.15.102:0/2681613459 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:03.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.660+0000 7f01aeaf7640 1 -- 172.21.15.102:0/2681613459 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c2b9d1fe0 con 0x564c2ba97e10 2024-09-13T19:18:03.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.660+0000 7f01aeaf7640 1 --2- 172.21.15.102:0/2681613459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c2ba97e10 0x564c2bc1d510 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f01a0000fd0 tx=0x7f01a0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.660+0000 7f009b606640 1 -- 172.21.15.102:0/2681613459 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a000f8d0 con 0x564c2ba97e10 2024-09-13T19:18:03.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.660+0000 7f009b606640 1 -- 172.21.15.102:0/2681613459 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01a000fa90 con 0x564c2ba97e10 2024-09-13T19:18:03.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.660+0000 7f01b3410800 1 -- 172.21.15.102:0/2681613459 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564c2bc1da50 con 0x564c2ba97e10 2024-09-13T19:18:03.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.660+0000 7f009b606640 1 -- 172.21.15.102:0/2681613459 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a000fdb0 con 0x564c2ba97e10 2024-09-13T19:18:03.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.660+0000 7f01b3410800 1 -- 172.21.15.102:0/2681613459 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c2bc1df70 con 0x564c2ba97e10 2024-09-13T19:18:03.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.661+0000 7f009b606640 1 -- 172.21.15.102:0/2681613459 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f01a0017070 con 0x564c2ba97e10 2024-09-13T19:18:03.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.661+0000 7f009b606640 1 --2- 172.21.15.102:0/2681613459 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0094036b40 0x7f0094039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.661+0000 7f009b606640 1 -- 172.21.15.102:0/2681613459 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f01a0015020 con 0x564c2ba97e10 2024-09-13T19:18:03.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.661+0000 7f01ae2f6640 1 --2- 172.21.15.102:0/2681613459 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0094036b40 0x7f0094039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.661+0000 7f01b3410800 1 --2- 172.21.15.102:0/2681613459 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x564c2bb2ad20 0x564c2bc24580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.661+0000 7f01b3410800 1 -- 172.21.15.102:0/2681613459 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc24b00 con 0x564c2bb2ad20 2024-09-13T19:18:03.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.661+0000 7f01af2f8640 1 --2- 172.21.15.102:0/2681613459 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x564c2bb2ad20 0x564c2bc24580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.662+0000 7f01ae2f6640 1 --2- 172.21.15.102:0/2681613459 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0094036b40 0x7f0094039000 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f01a4057000 tx=0x7f01a4052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.662+0000 7f01af2f8640 1 --2- 172.21.15.102:0/2681613459 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x564c2bb2ad20 0x564c2bc24580 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.662+0000 7f01af2f8640 1 -- 172.21.15.102:0/2681613459 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01a800a4a0 con 0x564c2bb2ad20 2024-09-13T19:18:03.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.662+0000 7f01b3410800 1 -- 172.21.15.102:0/2681613459 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc21b50 con 0x564c2bb2ad20 2024-09-13T19:18:03.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.662+0000 7f01af2f8640 1 -- 172.21.15.102:0/2681613459 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f01a800a4a0 con 0x564c2bb2ad20 2024-09-13T19:18:03.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.662+0000 7f01b3410800 1 --2- 172.21.15.102:0/2681613459 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x564c2bc26e30 0x564c2bc29220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.662+0000 7f01b3410800 1 -- 172.21.15.102:0/2681613459 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc298c0 con 0x564c2bc26e30 2024-09-13T19:18:03.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.662+0000 7f01aeaf7640 1 --2- 172.21.15.102:0/2681613459 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x564c2bc26e30 0x564c2bc29220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.663+0000 7f01aeaf7640 1 --2- 172.21.15.102:0/2681613459 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x564c2bc26e30 0x564c2bc29220 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.663+0000 7f01aeaf7640 1 -- 172.21.15.102:0/2681613459 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f01a002e070 con 0x564c2bc26e30 2024-09-13T19:18:03.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.663+0000 7f01b3410800 1 -- 172.21.15.102:0/2681613459 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc25cd0 con 0x564c2bb2ad20 2024-09-13T19:18:03.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.663+0000 7f01af2f8640 1 -- 172.21.15.102:0/2681613459 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f01a800a4a0 con 0x564c2bb2ad20 2024-09-13T19:18:03.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.663+0000 7f01b3410800 1 -- 172.21.15.102:0/2681613459 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc261b0 con 0x564c2bc26e30 2024-09-13T19:18:03.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.664+0000 7f01aeaf7640 1 -- 172.21.15.102:0/2681613459 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f01a002e070 con 0x564c2bc26e30 2024-09-13T19:18:03.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.664+0000 7f01b3410800 1 Processor -- start 2024-09-13T19:18:03.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.664+0000 7f01b3410800 1 -- start start 2024-09-13T19:18:03.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.664+0000 7f01b3410800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c2bc38270 0x564c2bc38690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.664+0000 7f01b3410800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564c2b9bf580 con 0x564c2bc38270 2024-09-13T19:18:03.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.664+0000 7f01af2f8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c2bc38270 0x564c2bc38690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.664+0000 7f01af2f8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c2bc38270 0x564c2bc38690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:50022/0 (socket says 172.21.15.102:50022) 2024-09-13T19:18:03.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.664+0000 7f01af2f8640 1 -- 172.21.15.102:0/2531930210 learned_addr learned my addr 172.21.15.102:0/2531930210 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:03.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.665+0000 7f01af2f8640 1 -- 172.21.15.102:0/2531930210 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c2bc38bd0 con 0x564c2bc38270 2024-09-13T19:18:03.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.665+0000 7f01af2f8640 1 --2- 172.21.15.102:0/2531930210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c2bc38270 0x564c2bc38690 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x564c2bc1e5c0 tx=0x7f01a80167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.665+0000 7f0098e01640 1 -- 172.21.15.102:0/2531930210 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a8013640 con 0x564c2bc38270 2024-09-13T19:18:03.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.665+0000 7f0098e01640 1 -- 172.21.15.102:0/2531930210 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01a80137e0 con 0x564c2bc38270 2024-09-13T19:18:03.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.665+0000 7f0098e01640 1 -- 172.21.15.102:0/2531930210 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a8013ae0 con 0x564c2bc38270 2024-09-13T19:18:03.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.665+0000 7f01b3410800 1 -- 172.21.15.102:0/2531930210 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564c2bc38e60 con 0x564c2bc38270 2024-09-13T19:18:03.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.665+0000 7f01b3410800 1 -- 172.21.15.102:0/2531930210 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c2bc3bb40 con 0x564c2bc38270 2024-09-13T19:18:03.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.666+0000 7f0098e01640 1 -- 172.21.15.102:0/2531930210 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f01a8011040 con 0x564c2bc38270 2024-09-13T19:18:03.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.666+0000 7f0098e01640 1 --2- 172.21.15.102:0/2531930210 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0088036b90 0x7f0088039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.666+0000 7f0098e01640 1 -- 172.21.15.102:0/2531930210 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f01a800e040 con 0x564c2bc38270 2024-09-13T19:18:03.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.666+0000 7f01aeaf7640 1 --2- 172.21.15.102:0/2531930210 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0088036b90 0x7f0088039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.666+0000 7f01b3410800 1 Processor -- start 2024-09-13T19:18:03.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.666+0000 7f01b3410800 1 -- start start 2024-09-13T19:18:03.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.666+0000 7f01aeaf7640 1 --2- 172.21.15.102:0/2531930210 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0088036b90 0x7f0088039050 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x564c2bc21a70 tx=0x7f01a00173c0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.667+0000 7f01b3410800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c2bc44f30 0x564c2bc45330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.667+0000 7f01b3410800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564c2bc162b0 con 0x564c2bc44f30 2024-09-13T19:18:03.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.667+0000 7f01af2f8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c2bc44f30 0x564c2bc45330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.667+0000 7f01af2f8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c2bc44f30 0x564c2bc45330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:50032/0 (socket says 172.21.15.102:50032) 2024-09-13T19:18:03.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.667+0000 7f01af2f8640 1 -- 172.21.15.102:0/4117207266 learned_addr learned my addr 172.21.15.102:0/4117207266 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:03.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.667+0000 7f01af2f8640 1 -- 172.21.15.102:0/4117207266 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c2bc45900 con 0x564c2bc44f30 2024-09-13T19:18:03.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.667+0000 7f01af2f8640 1 --2- 172.21.15.102:0/4117207266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c2bc44f30 0x564c2bc45330 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f01a800afb0 tx=0x7f01a801fcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eb1f7c8513e90c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.667+0000 7f00927fc640 1 -- 172.21.15.102:0/4117207266 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a8021ae0 con 0x564c2bc44f30 2024-09-13T19:18:03.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.667+0000 7f00927fc640 1 -- 172.21.15.102:0/4117207266 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01a801f340 con 0x564c2bc44f30 2024-09-13T19:18:03.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.667+0000 7f00927fc640 1 -- 172.21.15.102:0/4117207266 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a8014cc0 con 0x564c2bc44f30 2024-09-13T19:18:03.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.668+0000 7f01b3410800 1 -- 172.21.15.102:0/4117207266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c2bc44f30 msgr2=0x564c2bc45330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.668+0000 7f01b3410800 1 --2- 172.21.15.102:0/4117207266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c2bc44f30 0x564c2bc45330 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f01a800afb0 tx=0x7f01a801fcc0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.668+0000 7f01b3410800 1 -- 172.21.15.102:0/4117207266 shutdown_connections 2024-09-13T19:18:03.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.668+0000 7f01b3410800 1 --2- 172.21.15.102:0/4117207266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c2bc44f30 0x564c2bc45330 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.668+0000 7f01b3410800 1 -- 172.21.15.102:0/4117207266 >> 172.21.15.102:0/4117207266 conn(0x564c2bc41290 msgr2=0x564c2bc3f390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:03.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.668+0000 7f01b3410800 1 -- 172.21.15.102:0/4117207266 shutdown_connections 2024-09-13T19:18:03.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.668+0000 7f01b3410800 1 -- 172.21.15.102:0/4117207266 wait complete. 2024-09-13T19:18:03.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.668+0000 7f01b3410800 1 Processor -- start 2024-09-13T19:18:03.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.668+0000 7f01b3410800 1 -- start start 2024-09-13T19:18:03.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.668+0000 7f01b3410800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c2bc44f30 0x564c2bc4c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.668+0000 7f01b3410800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564c2bc45f70 con 0x564c2bc44f30 2024-09-13T19:18:03.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.668+0000 7f01af2f8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c2bc44f30 0x564c2bc4c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.668+0000 7f01af2f8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c2bc44f30 0x564c2bc4c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:50034/0 (socket says 172.21.15.102:50034) 2024-09-13T19:18:03.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.668+0000 7f01af2f8640 1 -- 172.21.15.102:0/3082888965 learned_addr learned my addr 172.21.15.102:0/3082888965 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:03.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.669+0000 7f01af2f8640 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c2bc4c8e0 con 0x564c2bc44f30 2024-09-13T19:18:03.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.669+0000 7f01af2f8640 1 --2- 172.21.15.102:0/3082888965 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c2bc44f30 0x564c2bc4c3a0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f01a8021040 tx=0x7f01a800a7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.669+0000 7f0090ff9640 1 -- 172.21.15.102:0/3082888965 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a8039070 con 0x564c2bc44f30 2024-09-13T19:18:03.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.669+0000 7f0090ff9640 1 -- 172.21.15.102:0/3082888965 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01a8021ae0 con 0x564c2bc44f30 2024-09-13T19:18:03.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.669+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564c2bc4cb70 con 0x564c2bc44f30 2024-09-13T19:18:03.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.669+0000 7f0090ff9640 1 -- 172.21.15.102:0/3082888965 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a8013e60 con 0x564c2bc44f30 2024-09-13T19:18:03.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.669+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c2bc4f820 con 0x564c2bc44f30 2024-09-13T19:18:03.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.670+0000 7f0090ff9640 1 -- 172.21.15.102:0/3082888965 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f01a804ebe0 con 0x564c2bc44f30 2024-09-13T19:18:03.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.670+0000 7f0090ff9640 1 --2- 172.21.15.102:0/3082888965 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0078036b40 0x7f0078039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.670+0000 7f0090ff9640 1 -- 172.21.15.102:0/3082888965 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f01a8052a60 con 0x564c2bc44f30 2024-09-13T19:18:03.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.670+0000 7f01aeaf7640 1 --2- 172.21.15.102:0/3082888965 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0078036b40 0x7f0078039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.670+0000 7f01aeaf7640 1 --2- 172.21.15.102:0/3082888965 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0078036b40 0x7f0078039000 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f01a00176e0 tx=0x7f01a0042000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.671+0000 7f01b3410800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.671+0000 7f01b3410800 1 --2- 172.21.15.102:0/3082888965 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x564c2bc57e30 0x564c2bc5a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.671+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc5aa40 con 0x564c2bc57e30 2024-09-13T19:18:03.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.671+0000 7f01ae2f6640 1 --2- 172.21.15.102:0/3082888965 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x564c2bc57e30 0x564c2bc5a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.671+0000 7f01ae2f6640 1 --2- 172.21.15.102:0/3082888965 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x564c2bc57e30 0x564c2bc5a2f0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.671+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01a4057030 con 0x564c2bc57e30 2024-09-13T19:18:03.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.671+0000 7f01b3410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:03.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.671+0000 7f01b3410800 20 realm 2024-09-13T19:18:03.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.671+0000 7f01b3410800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.671+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc5ae70 con 0x564c2bc57e30 2024-09-13T19:18:03.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.672+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01a4057030 con 0x564c2bc57e30 2024-09-13T19:18:03.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.672+0000 7f01b3410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:03.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.672+0000 7f01b3410800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:18:03.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.672+0000 7f01b3410800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.672+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc5b740 con 0x564c2bc57e30 2024-09-13T19:18:03.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.672+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01a4057030 con 0x564c2bc57e30 2024-09-13T19:18:03.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.672+0000 7f01b3410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:03.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.672+0000 7f01b3410800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.672+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc5bae0 con 0x564c2bc57e30 2024-09-13T19:18:03.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.672+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f01a4057030 con 0x564c2bc57e30 2024-09-13T19:18:03.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.672+0000 7f01b3410800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:18:03.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.672+0000 7f01b3410800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.672+0000 7f01b3410800 1 --2- 172.21.15.102:0/3082888965 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x564c2bc5c840 0x564c2bc5ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.672+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc5f240 con 0x564c2bc5c840 2024-09-13T19:18:03.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.672+0000 7f01af2f8640 1 --2- 172.21.15.102:0/3082888965 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x564c2bc5c840 0x564c2bc5ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.672+0000 7f01af2f8640 1 --2- 172.21.15.102:0/3082888965 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x564c2bc5c840 0x564c2bc5ec30 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.673+0000 7f01af2f8640 1 -- 172.21.15.102:0/3082888965 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f01a803b030 con 0x564c2bc5c840 2024-09-13T19:18:03.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.673+0000 7f01b3410800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:18:03.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.673+0000 7f01b3410800 20 searching for the correct realm 2024-09-13T19:18:03.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.673+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc60b50 con 0x564c2bc5c840 2024-09-13T19:18:03.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.673+0000 7f01af2f8640 1 -- 172.21.15.102:0/3082888965 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a803b030 con 0x564c2bc5c840 2024-09-13T19:18:03.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.673+0000 7f01af2f8640 1 --2- 172.21.15.102:0/3082888965 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f01a8036080 0x7f01a804f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.673+0000 7f01af2f8640 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc60b50 con 0x7f01a8036080 2024-09-13T19:18:03.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.673+0000 7f01aeaf7640 1 --2- 172.21.15.102:0/3082888965 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f01a8036080 0x7f01a804f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.673+0000 7f01aeaf7640 1 --2- 172.21.15.102:0/3082888965 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f01a8036080 0x7f01a804f790 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.674+0000 7f01aeaf7640 1 -- 172.21.15.102:0/3082888965 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a002e070 con 0x7f01a8036080 2024-09-13T19:18:03.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.674+0000 7f01aeaf7640 1 --2- 172.21.15.102:0/3082888965 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f01a000f070 0x7f01a001c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.674+0000 7f01aeaf7640 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc60b50 con 0x7f01a000f070 2024-09-13T19:18:03.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.674+0000 7f01ae2f6640 1 --2- 172.21.15.102:0/3082888965 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f01a000f070 0x7f01a001c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.674+0000 7f01ae2f6640 1 --2- 172.21.15.102:0/3082888965 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f01a000f070 0x7f01a001c620 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.674+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a4057030 con 0x7f01a000f070 2024-09-13T19:18:03.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.674+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc60b50 con 0x564c2bc57e30 2024-09-13T19:18:03.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.675+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a4057030 con 0x564c2bc57e30 2024-09-13T19:18:03.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.675+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc60b50 con 0x564c2bc57e30 2024-09-13T19:18:03.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.675+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a4057030 con 0x564c2bc57e30 2024-09-13T19:18:03.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.675+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc60b50 con 0x7f01a000f070 2024-09-13T19:18:03.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.675+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a4057030 con 0x7f01a000f070 2024-09-13T19:18:03.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.675+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc60b50 con 0x7f01a000f070 2024-09-13T19:18:03.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.675+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a4057030 con 0x7f01a000f070 2024-09-13T19:18:03.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.675+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc60b50 con 0x7f01a8036080 2024-09-13T19:18:03.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.676+0000 7f01aeaf7640 1 -- 172.21.15.102:0/3082888965 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a002e070 con 0x7f01a8036080 2024-09-13T19:18:03.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.676+0000 7f01aeaf7640 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc60b50 con 0x564c2bc5c840 2024-09-13T19:18:03.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.676+0000 7f01af2f8640 1 -- 172.21.15.102:0/3082888965 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a803b030 con 0x564c2bc5c840 2024-09-13T19:18:03.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.676+0000 7f01af2f8640 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc60b50 con 0x564c2bc57e30 2024-09-13T19:18:03.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.676+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a4057030 con 0x564c2bc57e30 2024-09-13T19:18:03.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.676+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc60b50 con 0x7f01a8036080 2024-09-13T19:18:03.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.676+0000 7f01aeaf7640 1 -- 172.21.15.102:0/3082888965 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a002e070 con 0x7f01a8036080 2024-09-13T19:18:03.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.676+0000 7f01aeaf7640 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc60b50 con 0x564c2bc57e30 2024-09-13T19:18:03.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.677+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a4057030 con 0x564c2bc57e30 2024-09-13T19:18:03.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.677+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc60b50 con 0x7f01a8036080 2024-09-13T19:18:03.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.677+0000 7f01aeaf7640 1 -- 172.21.15.102:0/3082888965 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f01a002e070 con 0x7f01a8036080 2024-09-13T19:18:03.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.677+0000 7f01aeaf7640 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc60b50 con 0x564c2bc5c840 2024-09-13T19:18:03.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.677+0000 7f01af2f8640 1 -- 172.21.15.102:0/3082888965 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a803b030 con 0x564c2bc5c840 2024-09-13T19:18:03.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.677+0000 7f01af2f8640 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc60b50 con 0x564c2bc5c840 2024-09-13T19:18:03.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.677+0000 7f01af2f8640 1 -- 172.21.15.102:0/3082888965 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f01a803b030 con 0x564c2bc5c840 2024-09-13T19:18:03.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.677+0000 7f01af2f8640 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc60b50 con 0x7f01a000f070 2024-09-13T19:18:03.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.678+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a4057030 con 0x7f01a000f070 2024-09-13T19:18:03.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.678+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc60b50 con 0x564c2bc5c840 2024-09-13T19:18:03.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.678+0000 7f01af2f8640 1 -- 172.21.15.102:0/3082888965 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f01a803b030 con 0x564c2bc5c840 2024-09-13T19:18:03.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.678+0000 7f01af2f8640 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc60b50 con 0x564c2bc5c840 2024-09-13T19:18:03.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.678+0000 7f01af2f8640 1 -- 172.21.15.102:0/3082888965 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a803b030 con 0x564c2bc5c840 2024-09-13T19:18:03.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.678+0000 7f01af2f8640 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc60b50 con 0x564c2bc57e30 2024-09-13T19:18:03.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.678+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a4057030 con 0x564c2bc57e30 2024-09-13T19:18:03.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.678+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc60b50 con 0x564c2bc57e30 2024-09-13T19:18:03.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.678+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f01a4057030 con 0x564c2bc57e30 2024-09-13T19:18:03.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.678+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc60b50 con 0x7f01a000f070 2024-09-13T19:18:03.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.679+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a4057030 con 0x7f01a000f070 2024-09-13T19:18:03.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.679+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc60b50 con 0x564c2bc5c840 2024-09-13T19:18:03.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.679+0000 7f01af2f8640 1 -- 172.21.15.102:0/3082888965 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a803b030 con 0x564c2bc5c840 2024-09-13T19:18:03.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.679+0000 7f01af2f8640 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc60b50 con 0x7f01a8036080 2024-09-13T19:18:03.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.679+0000 7f01aeaf7640 1 -- 172.21.15.102:0/3082888965 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a002e070 con 0x7f01a8036080 2024-09-13T19:18:03.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.679+0000 7f01aeaf7640 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc60b50 con 0x564c2bc57e30 2024-09-13T19:18:03.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.679+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a4057030 con 0x564c2bc57e30 2024-09-13T19:18:03.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.679+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc60b50 con 0x7f01a8036080 2024-09-13T19:18:03.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.679+0000 7f01aeaf7640 1 -- 172.21.15.102:0/3082888965 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a002e070 con 0x7f01a8036080 2024-09-13T19:18:03.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.680+0000 7f01aeaf7640 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc60b50 con 0x564c2bc5c840 2024-09-13T19:18:03.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.680+0000 7f01af2f8640 1 -- 172.21.15.102:0/3082888965 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a803b030 con 0x564c2bc5c840 2024-09-13T19:18:03.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.680+0000 7f01af2f8640 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc60b50 con 0x7f01a000f070 2024-09-13T19:18:03.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.680+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a4057030 con 0x7f01a000f070 2024-09-13T19:18:03.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.680+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc60b50 con 0x7f01a8036080 2024-09-13T19:18:03.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.680+0000 7f01aeaf7640 1 -- 172.21.15.102:0/3082888965 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a002e070 con 0x7f01a8036080 2024-09-13T19:18:03.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.680+0000 7f01aeaf7640 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc60b50 con 0x564c2bc5c840 2024-09-13T19:18:03.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.680+0000 7f01af2f8640 1 -- 172.21.15.102:0/3082888965 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a803b030 con 0x564c2bc5c840 2024-09-13T19:18:03.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.680+0000 7f01af2f8640 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc60b50 con 0x7f01a000f070 2024-09-13T19:18:03.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.681+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a4057030 con 0x7f01a000f070 2024-09-13T19:18:03.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.681+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc60b50 con 0x564c2bc57e30 2024-09-13T19:18:03.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.681+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v36'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f01a4057030 con 0x564c2bc57e30 2024-09-13T19:18:03.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.681+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc60b50 con 0x7f01a8036080 2024-09-13T19:18:03.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.681+0000 7f01aeaf7640 1 -- 172.21.15.102:0/3082888965 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a002e070 con 0x7f01a8036080 2024-09-13T19:18:03.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.681+0000 7f01b3410800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:18:03.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.681+0000 7f01b3410800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:18:03.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.681+0000 7f01b3410800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:18:03.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.681+0000 7f01b3410800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:18:03.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.681+0000 7f01b3410800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:18:03.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.681+0000 7f01b3410800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:18:03.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.681+0000 7f01b3410800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.681+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc60720 con 0x564c2bc57e30 2024-09-13T19:18:03.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.681+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01a4057030 con 0x564c2bc57e30 2024-09-13T19:18:03.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.681+0000 7f01b3410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:03.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.681+0000 7f01b3410800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.681+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc5ff90 con 0x564c2bc57e30 2024-09-13T19:18:03.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.682+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f01a4057030 con 0x564c2bc57e30 2024-09-13T19:18:03.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.682+0000 7f01b3410800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:18:03.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.682+0000 7f01b3410800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.682+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc60fd0 con 0x564c2bc5c840 2024-09-13T19:18:03.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.682+0000 7f01af2f8640 1 -- 172.21.15.102:0/3082888965 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f01a803b030 con 0x564c2bc5c840 2024-09-13T19:18:03.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.682+0000 7f01b3410800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:18:03.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.682+0000 7f01b3410800 20 zone default found 2024-09-13T19:18:03.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.682+0000 7f01b3410800 4 Realm: () 2024-09-13T19:18:03.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.682+0000 7f01b3410800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:18:03.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.682+0000 7f01b3410800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:18:03.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.682+0000 7f01b3410800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:18:03.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.682+0000 7f01b3410800 20 zonegroup default 2024-09-13T19:18:03.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.682+0000 7f01b3410800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.682+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc5fbc0 con 0x7f01a8036080 2024-09-13T19:18:03.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.682+0000 7f01aeaf7640 1 -- 172.21.15.102:0/3082888965 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f01a002e070 con 0x7f01a8036080 2024-09-13T19:18:03.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.682+0000 7f01b3410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:03.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.682+0000 7f01b3410800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.682+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc63730 con 0x564c2bc5c840 2024-09-13T19:18:03.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.682+0000 7f01af2f8640 1 -- 172.21.15.102:0/3082888965 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f01a803b030 con 0x564c2bc5c840 2024-09-13T19:18:03.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.682+0000 7f01b3410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:03.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.682+0000 7f01b3410800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.682+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc63ad0 con 0x564c2bc5c840 2024-09-13T19:18:03.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.683+0000 7f01af2f8640 1 -- 172.21.15.102:0/3082888965 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f01a803b030 con 0x564c2bc5c840 2024-09-13T19:18:03.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.683+0000 7f01b3410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:03.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.683+0000 7f01b3410800 20 started sync module instance, tier type = 2024-09-13T19:18:03.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.683+0000 7f01b3410800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:18:03.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.683+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc62b70 con 0x7f01a8036080 2024-09-13T19:18:03.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.684+0000 7f01aeaf7640 1 -- 172.21.15.102:0/3082888965 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(44 notify.0 [create] v36'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a002e070 con 0x7f01a8036080 2024-09-13T19:18:03.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.684+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94885151911824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc64320 con 0x7f01a8036080 2024-09-13T19:18:03.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.684+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc64b70 con 0x564c2bc57e30 2024-09-13T19:18:03.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.685+0000 7f01aeaf7640 1 -- 172.21.15.102:0/3082888965 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94885151911824] v36'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a002e070 con 0x7f01a8036080 2024-09-13T19:18:03.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.685+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v36'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a4057030 con 0x564c2bc57e30 2024-09-13T19:18:03.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.685+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94885151917760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc64f10 con 0x564c2bc57e30 2024-09-13T19:18:03.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.685+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc659e0 con 0x564c2bc5c840 2024-09-13T19:18:03.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.686+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94885151917760] v36'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a4057030 con 0x564c2bc57e30 2024-09-13T19:18:03.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.686+0000 7f01af2f8640 1 -- 172.21.15.102:0/3082888965 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v36'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a803b030 con 0x564c2bc5c840 2024-09-13T19:18:03.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.686+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94885151921360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc65e00 con 0x564c2bc5c840 2024-09-13T19:18:03.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.686+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc66820 con 0x7f01a8036080 2024-09-13T19:18:03.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.687+0000 7f01af2f8640 1 -- 172.21.15.102:0/3082888965 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94885151921360] v36'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a803b030 con 0x564c2bc5c840 2024-09-13T19:18:03.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.687+0000 7f01aeaf7640 1 -- 172.21.15.102:0/3082888965 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(50 notify.3 [create] v36'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a002e070 con 0x7f01a8036080 2024-09-13T19:18:03.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.687+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94885151925008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc667e0 con 0x7f01a8036080 2024-09-13T19:18:03.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.687+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc672b0 con 0x564c2bc57e30 2024-09-13T19:18:03.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.689+0000 7f01aeaf7640 1 -- 172.21.15.102:0/3082888965 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94885151925008] v36'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a002e070 con 0x7f01a8036080 2024-09-13T19:18:03.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.689+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v36'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a4057030 con 0x564c2bc57e30 2024-09-13T19:18:03.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.689+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94885151927776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc672b0 con 0x564c2bc57e30 2024-09-13T19:18:03.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.689+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc67d40 con 0x7f01a000f070 2024-09-13T19:18:03.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.690+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(54 notify.5 [create] v36'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a4057030 con 0x7f01a000f070 2024-09-13T19:18:03.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.690+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94885151930384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc67d40 con 0x7f01a000f070 2024-09-13T19:18:03.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.690+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94885151927776] v36'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a4057030 con 0x564c2bc57e30 2024-09-13T19:18:03.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.690+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc68830 con 0x7f01a000f070 2024-09-13T19:18:03.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.691+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94885151930384] v36'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a4057030 con 0x7f01a000f070 2024-09-13T19:18:03.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.691+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(56 notify.6 [create] v36'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a4057030 con 0x7f01a000f070 2024-09-13T19:18:03.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.691+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94885151915632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc68830 con 0x7f01a000f070 2024-09-13T19:18:03.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.691+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc691f0 con 0x7f01a000f070 2024-09-13T19:18:03.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.692+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(58 notify.7 [create] v36'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a4057030 con 0x7f01a000f070 2024-09-13T19:18:03.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.692+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94885151935808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc69650 con 0x7f01a000f070 2024-09-13T19:18:03.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.692+0000 7f01b3410800 20 add_watcher() i=0 2024-09-13T19:18:03.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.692+0000 7f01b3410800 20 add_watcher() i=1 2024-09-13T19:18:03.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.692+0000 7f01b3410800 20 add_watcher() i=2 2024-09-13T19:18:03.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.692+0000 7f01b3410800 20 add_watcher() i=3 2024-09-13T19:18:03.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.692+0000 7f01b3410800 20 add_watcher() i=4 2024-09-13T19:18:03.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.692+0000 7f01b3410800 20 add_watcher() i=5 2024-09-13T19:18:03.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.692+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94885151915632] v36'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a4057030 con 0x7f01a000f070 2024-09-13T19:18:03.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.692+0000 7f01b3410800 20 add_watcher() i=6 2024-09-13T19:18:03.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.693+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94885151935808] v36'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a4057030 con 0x7f01a000f070 2024-09-13T19:18:03.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.693+0000 7f01b3410800 20 add_watcher() i=7 2024-09-13T19:18:03.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.693+0000 7f01b3410800 2 all 8 watchers are set, enabling cache 2024-09-13T19:18:03.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.693+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc68130 con 0x564c2bc57e30 2024-09-13T19:18:03.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.694+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f01a4057030 con 0x564c2bc57e30 2024-09-13T19:18:03.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.694+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94885151936864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc68130 con 0x564c2bc57e30 2024-09-13T19:18:03.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.695+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94885151936864] v36'261 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f01a4057030 con 0x564c2bc57e30 2024-09-13T19:18:03.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.695+0000 7f00657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:18:03.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.695+0000 7f01b3410800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:18:03.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.695+0000 7f01b3410800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:18:03.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.695+0000 7f01b3410800 5 note: GC not initialized 2024-09-13T19:18:03.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.695+0000 7effdffff640 20 reqs_thread_entry: start 2024-09-13T19:18:03.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.695+0000 7f01b3410800 20 init_complete bucket index max shards: 11 2024-09-13T19:18:03.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.695+0000 7f01b3410800 20 Filter name: none 2024-09-13T19:18:03.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.695+0000 7effddffb640 20 reqs_thread_entry: start 2024-09-13T19:18:03.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.695+0000 7f01b3410800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T19:18:03.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.695+0000 7f01b3410800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.695+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc9faa0 con 0x7f01a000f070 2024-09-13T19:18:03.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.696+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f01a4057030 con 0x7f01a000f070 2024-09-13T19:18:03.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.696+0000 7f01b3410800 20 rados_obj.operate() r=0 bl.length=490 2024-09-13T19:18:03.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.696+0000 7f01b3410800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T19:18:03.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.696+0000 7f01b3410800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:18:03.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.696+0000 7f01b3410800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:18:03.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.696+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~503 in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564c2bca61e0 con 0x7f01a000f070 2024-09-13T19:18:03.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.697+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~503] v36'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f01a4057030 con 0x7f01a000f070 2024-09-13T19:18:03.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.697+0000 7f01b3410800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:18:03.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.697+0000 7f01b3410800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:18:03.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.697+0000 7f01b3410800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T19:18:03.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.697+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94885152185248 in=691b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564c2bca1800 con 0x564c2bc57e30 2024-09-13T19:18:03.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.697+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== watch-notify(notify (1) cookie 94885151927776 notify 154618822698 ret 0) ==== 721+0+0 (crc 0 0 0) 0x564c2b9ebe00 con 0x564c2bc57e30 2024-09-13T19:18:03.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.697+0000 7f00927fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822698 cookie 94885151927776 notifier 4895 bl.length()=679 2024-09-13T19:18:03.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.697+0000 7f00927fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:18:03.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.697+0000 7f00927fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:18:03.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.697+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(64 notify.4 [notify cookie 94885152185248 out=8b] v0'0 uv264 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f01a4057030 con 0x564c2bc57e30 2024-09-13T19:18:03.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.697+0000 7f00927fc640 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f0074003ea0 con 0x564c2bc57e30 2024-09-13T19:18:03.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.698+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a4057030 con 0x564c2bc57e30 2024-09-13T19:18:03.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.698+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== watch-notify(notify_complete (2) cookie 94885152185248 notify 154618822698 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f01a405ba70 con 0x564c2bc57e30 2024-09-13T19:18:03.720 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T19:18:02.251000Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:18:02.250985Z","tags":[],"group_ids":[]} 2024-09-13T19:18:03.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.699+0000 7f00657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:18:03.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.699+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94885151936864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc9d7c0 con 0x564c2bc57e30 2024-09-13T19:18:03.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.700+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94885151936864] v36'262 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f01a4057030 con 0x564c2bc57e30 2024-09-13T19:18:03.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.700+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94885151911824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc9d7c0 con 0x7f01a8036080 2024-09-13T19:18:03.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.701+0000 7f01aeaf7640 1 -- 172.21.15.102:0/3082888965 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94885151911824] v36'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a002e070 con 0x7f01a8036080 2024-09-13T19:18:03.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.701+0000 7f01b3410800 20 remove_watcher() i=0 2024-09-13T19:18:03.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.701+0000 7f01b3410800 2 removed watcher, disabling cache 2024-09-13T19:18:03.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.701+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94885151917760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc9d7c0 con 0x564c2bc57e30 2024-09-13T19:18:03.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.702+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94885151917760] v36'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a4057030 con 0x564c2bc57e30 2024-09-13T19:18:03.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.702+0000 7f01b3410800 20 remove_watcher() i=1 2024-09-13T19:18:03.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.702+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94885151921360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc9d7c0 con 0x564c2bc5c840 2024-09-13T19:18:03.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.703+0000 7f01af2f8640 1 -- 172.21.15.102:0/3082888965 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94885151921360] v36'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a803b030 con 0x564c2bc5c840 2024-09-13T19:18:03.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.703+0000 7f01b3410800 20 remove_watcher() i=2 2024-09-13T19:18:03.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.703+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94885151925008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc9d7c0 con 0x7f01a8036080 2024-09-13T19:18:03.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.704+0000 7f01aeaf7640 1 -- 172.21.15.102:0/3082888965 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94885151925008] v36'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a002e070 con 0x7f01a8036080 2024-09-13T19:18:03.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.704+0000 7f01b3410800 20 remove_watcher() i=3 2024-09-13T19:18:03.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.704+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94885151927776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc9d7c0 con 0x564c2bc57e30 2024-09-13T19:18:03.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.705+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94885151927776] v36'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a4057030 con 0x564c2bc57e30 2024-09-13T19:18:03.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.705+0000 7f01b3410800 20 remove_watcher() i=4 2024-09-13T19:18:03.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.705+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94885151930384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc9d7c0 con 0x7f01a000f070 2024-09-13T19:18:03.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.706+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94885151930384] v36'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a4057030 con 0x7f01a000f070 2024-09-13T19:18:03.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.706+0000 7f01b3410800 20 remove_watcher() i=5 2024-09-13T19:18:03.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.706+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94885151915632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc9d7c0 con 0x7f01a000f070 2024-09-13T19:18:03.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.707+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94885151915632] v36'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a4057030 con 0x7f01a000f070 2024-09-13T19:18:03.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.707+0000 7f01b3410800 20 remove_watcher() i=6 2024-09-13T19:18:03.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.707+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94885151935808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564c2bc9d7c0 con 0x7f01a000f070 2024-09-13T19:18:03.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.708+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94885151935808] v36'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a4057030 con 0x7f01a000f070 2024-09-13T19:18:03.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.708+0000 7f01b3410800 20 remove_watcher() i=7 2024-09-13T19:18:03.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.708+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f01a000f070 msgr2=0x7f01a001c620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.708+0000 7f01b3410800 1 --2- 172.21.15.102:0/3082888965 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f01a000f070 0x7f01a001c620 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.708+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x564c2bc57e30 msgr2=0x564c2bc5a2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.708+0000 7f01b3410800 1 --2- 172.21.15.102:0/3082888965 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x564c2bc57e30 0x564c2bc5a2f0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.708+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f01a8036080 msgr2=0x7f01a804f790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.708+0000 7f01b3410800 1 --2- 172.21.15.102:0/3082888965 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f01a8036080 0x7f01a804f790 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.708+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x564c2bc5c840 msgr2=0x564c2bc5ec30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.708+0000 7f01b3410800 1 --2- 172.21.15.102:0/3082888965 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x564c2bc5c840 0x564c2bc5ec30 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.709+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0078036b40 msgr2=0x7f0078039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.709+0000 7f01b3410800 1 --2- 172.21.15.102:0/3082888965 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0078036b40 0x7f0078039000 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f01a00176e0 tx=0x7f01a0042000 comp rx=0 tx=0).stop 2024-09-13T19:18:03.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.709+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c2bc44f30 msgr2=0x564c2bc4c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.709+0000 7f01b3410800 1 --2- 172.21.15.102:0/3082888965 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c2bc44f30 0x564c2bc4c3a0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f01a8021040 tx=0x7f01a800a7e0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.709+0000 7f01ae2f6640 1 -- 172.21.15.102:0/3082888965 reap_dead start 2024-09-13T19:18:03.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.709+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 shutdown_connections 2024-09-13T19:18:03.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.709+0000 7f01b3410800 1 --2- 172.21.15.102:0/3082888965 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c2bc44f30 0x564c2bc4c3a0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.709+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 >> 172.21.15.102:0/3082888965 conn(0x564c2bc41290 msgr2=0x564c2bc3f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:03.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.709+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 shutdown_connections 2024-09-13T19:18:03.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.709+0000 7f01b3410800 1 -- 172.21.15.102:0/3082888965 wait complete. 2024-09-13T19:18:03.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.709+0000 7f01b3410800 1 -- 172.21.15.102:0/2531930210 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0088036b90 msgr2=0x7f0088039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.709+0000 7f01b3410800 1 --2- 172.21.15.102:0/2531930210 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0088036b90 0x7f0088039050 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x564c2bc21a70 tx=0x7f01a00173c0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.709+0000 7f01b3410800 1 -- 172.21.15.102:0/2531930210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c2bc38270 msgr2=0x564c2bc38690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.709+0000 7f01b3410800 1 --2- 172.21.15.102:0/2531930210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c2bc38270 0x564c2bc38690 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x564c2bc1e5c0 tx=0x7f01a80167b0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.709+0000 7f01b3410800 1 -- 172.21.15.102:0/2531930210 shutdown_connections 2024-09-13T19:18:03.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.709+0000 7f01b3410800 1 --2- 172.21.15.102:0/2531930210 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0088036b90 0x7f0088039050 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.709+0000 7f01b3410800 1 --2- 172.21.15.102:0/2531930210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c2bc38270 0x564c2bc38690 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.709+0000 7f01b3410800 1 -- 172.21.15.102:0/2531930210 >> 172.21.15.102:0/2531930210 conn(0x564c2bc2d200 msgr2=0x564c2bc2fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:03.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.709+0000 7f01b3410800 1 -- 172.21.15.102:0/2531930210 shutdown_connections 2024-09-13T19:18:03.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.709+0000 7f01b3410800 1 -- 172.21.15.102:0/2531930210 wait complete. 2024-09-13T19:18:03.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.709+0000 7f01b3410800 1 -- 172.21.15.102:0/2681613459 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x564c2bb2ad20 msgr2=0x564c2bc24580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.709+0000 7f01b3410800 1 --2- 172.21.15.102:0/2681613459 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x564c2bb2ad20 0x564c2bc24580 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.709+0000 7f01b3410800 1 -- 172.21.15.102:0/2681613459 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x564c2bc26e30 msgr2=0x564c2bc29220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.709+0000 7f01b3410800 1 --2- 172.21.15.102:0/2681613459 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x564c2bc26e30 0x564c2bc29220 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.710+0000 7f01b3410800 1 -- 172.21.15.102:0/2681613459 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0094036b40 msgr2=0x7f0094039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.710+0000 7f01b3410800 1 --2- 172.21.15.102:0/2681613459 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0094036b40 0x7f0094039000 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f01a4057000 tx=0x7f01a4052000 comp rx=0 tx=0).stop 2024-09-13T19:18:03.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.710+0000 7f01b3410800 1 -- 172.21.15.102:0/2681613459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c2ba97e10 msgr2=0x564c2bc1d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.710+0000 7f01b3410800 1 --2- 172.21.15.102:0/2681613459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c2ba97e10 0x564c2bc1d510 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f01a0000fd0 tx=0x7f01a0000ed0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.710+0000 7f01b3410800 1 -- 172.21.15.102:0/2681613459 shutdown_connections 2024-09-13T19:18:03.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.710+0000 7f01b3410800 1 --2- 172.21.15.102:0/2681613459 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x564c2bc26e30 0x564c2bc29220 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.710+0000 7f01b3410800 1 --2- 172.21.15.102:0/2681613459 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x564c2bb2ad20 0x564c2bc24580 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.710+0000 7f01b3410800 1 --2- 172.21.15.102:0/2681613459 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0094036b40 0x7f0094039000 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.710+0000 7f01b3410800 1 --2- 172.21.15.102:0/2681613459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c2ba97e10 0x564c2bc1d510 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.710+0000 7f01b3410800 1 -- 172.21.15.102:0/2681613459 >> 172.21.15.102:0/2681613459 conn(0x564c2bb1edd0 msgr2=0x564c2bc0fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:03.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.710+0000 7f01b3410800 1 -- 172.21.15.102:0/2681613459 shutdown_connections 2024-09-13T19:18:03.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.710+0000 7f01b3410800 1 -- 172.21.15.102:0/2681613459 wait complete. 2024-09-13T19:18:03.733 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:18:02.251000Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:18:02.250985Z', 'tags': [], 'group_ids': []} 2024-09-13T19:18:03.733 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:18:02.251000Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:18:02.250985Z', 'tags': [], 'group_ids': []} 2024-09-13T19:18:03.733 ERROR:root:0 2024-09-13T19:18:03.733 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:18:03.746 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:18:03.746 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-13T19:18:03.746 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-13T19:18:03.747 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write; user-info-without-keys=*' 2024-09-13T19:18:03.793 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:18:03.793 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:18:03.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.791+0000 7f77e1f2c800 1 Processor -- start 2024-09-13T19:18:03.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.791+0000 7f77e1f2c800 1 -- start start 2024-09-13T19:18:03.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.791+0000 7f77e1f2c800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x562738fef920 0x562738ff1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.791+0000 7f77e1f2c800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562738eabb30 con 0x562738feb4e0 2024-09-13T19:18:03.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.791+0000 7f77e1f2c800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x562738e8d360 con 0x562738fef920 2024-09-13T19:18:03.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.791+0000 7f77d54b6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x562738fef920 0x562738ff1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.791+0000 7f77ddcb7640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x562738feb4e0 0x562738feb8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:53788/0 (socket says 172.21.15.102:53788) 2024-09-13T19:18:03.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.791+0000 7f77ddcb7640 1 -- 172.21.15.102:0/2724738241 learned_addr learned my addr 172.21.15.102:0/2724738241 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:18:03.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.791+0000 7f77d54b6640 1 -- 172.21.15.102:0/2724738241 >> v1:172.21.15.53:6789/0 conn(0x562738feb4e0 legacy=0x562738feb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.791+0000 7f77d54b6640 1 -- 172.21.15.102:0/2724738241 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562738eb3e00 con 0x562738fef920 2024-09-13T19:18:03.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.793+0000 7f77d54b6640 1 --2- 172.21.15.102:0/2724738241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562738fef920 0x562738ff1d10 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f77c800a470 tx=0x7f77c8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53f06d0a4b4d413c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.793+0000 7f77dd4b6640 1 -- 172.21.15.102:0/2724738241 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77c8053570 con 0x562738fef920 2024-09-13T19:18:03.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.793+0000 7f77dd4b6640 1 -- 172.21.15.102:0/2724738241 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77c8058070 con 0x562738fef920 2024-09-13T19:18:03.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.793+0000 7f77dd4b6640 1 -- 172.21.15.102:0/2724738241 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77c8053880 con 0x562738fef920 2024-09-13T19:18:03.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.794+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2724738241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562738fef920 msgr2=0x562738ff1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.794+0000 7f77e1f2c800 1 --2- 172.21.15.102:0/2724738241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562738fef920 0x562738ff1d10 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f77c800a470 tx=0x7f77c8045a20 comp rx=0 tx=0).stop 2024-09-13T19:18:03.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.794+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2724738241 shutdown_connections 2024-09-13T19:18:03.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.794+0000 7f77e1f2c800 1 --2- 172.21.15.102:0/2724738241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562738fef920 0x562738ff1d10 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.794+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2724738241 >> 172.21.15.102:0/2724738241 conn(0x562738fe6dd0 msgr2=0x562738fe91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:03.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.794+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2724738241 shutdown_connections 2024-09-13T19:18:03.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.794+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2724738241 wait complete. 2024-09-13T19:18:03.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.808+0000 7f77e1f2c800 1 Processor -- start 2024-09-13T19:18:03.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.808+0000 7f77e1f2c800 1 -- start start 2024-09-13T19:18:03.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.808+0000 7f77e1f2c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562738feb4e0 0x562738f5fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.808+0000 7f77e1f2c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562738f38360 con 0x562738feb4e0 2024-09-13T19:18:03.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.808+0000 7f77ddcb7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562738feb4e0 0x562738f5fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.808+0000 7f77ddcb7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562738feb4e0 0x562738f5fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:50058/0 (socket says 172.21.15.102:50058) 2024-09-13T19:18:03.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.808+0000 7f77ddcb7640 1 -- 172.21.15.102:0/4244979144 learned_addr learned my addr 172.21.15.102:0/4244979144 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:03.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.809+0000 7f77ddcb7640 1 -- 172.21.15.102:0/4244979144 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562738e85bc0 con 0x562738feb4e0 2024-09-13T19:18:03.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.809+0000 7f77ddcb7640 1 --2- 172.21.15.102:0/4244979144 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562738feb4e0 0x562738f5fda0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f77d0001e10 tx=0x7f77d000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f52feef867280af8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.809+0000 7f76cbe07640 1 -- 172.21.15.102:0/4244979144 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77d0012020 con 0x562738feb4e0 2024-09-13T19:18:03.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.809+0000 7f76cbe07640 1 -- 172.21.15.102:0/4244979144 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77d000e5a0 con 0x562738feb4e0 2024-09-13T19:18:03.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.809+0000 7f76cbe07640 1 -- 172.21.15.102:0/4244979144 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77d000e8e0 con 0x562738feb4e0 2024-09-13T19:18:03.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.810+0000 7f77e1f2c800 1 -- 172.21.15.102:0/4244979144 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562738feb4e0 msgr2=0x562738f5fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.810+0000 7f77e1f2c800 1 --2- 172.21.15.102:0/4244979144 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562738feb4e0 0x562738f5fda0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f77d0001e10 tx=0x7f77d000b780 comp rx=0 tx=0).stop 2024-09-13T19:18:03.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.810+0000 7f77e1f2c800 1 -- 172.21.15.102:0/4244979144 shutdown_connections 2024-09-13T19:18:03.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.810+0000 7f77e1f2c800 1 --2- 172.21.15.102:0/4244979144 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562738feb4e0 0x562738f5fda0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.810+0000 7f77e1f2c800 1 -- 172.21.15.102:0/4244979144 >> 172.21.15.102:0/4244979144 conn(0x562738fe6dd0 msgr2=0x5627390d61c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:03.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.810+0000 7f77e1f2c800 1 -- 172.21.15.102:0/4244979144 shutdown_connections 2024-09-13T19:18:03.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.810+0000 7f77e1f2c800 1 -- 172.21.15.102:0/4244979144 wait complete. 2024-09-13T19:18:03.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.810+0000 7f77e1f2c800 1 Processor -- start 2024-09-13T19:18:03.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.810+0000 7f77e1f2c800 1 -- start start 2024-09-13T19:18:03.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.810+0000 7f77e1f2c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562738feb4e0 0x5627390e3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.810+0000 7f77e1f2c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562738ff2550 con 0x562738feb4e0 2024-09-13T19:18:03.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.811+0000 7f77ddcb7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562738feb4e0 0x5627390e3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.811+0000 7f77ddcb7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562738feb4e0 0x5627390e3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:50074/0 (socket says 172.21.15.102:50074) 2024-09-13T19:18:03.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.811+0000 7f77ddcb7640 1 -- 172.21.15.102:0/1650284874 learned_addr learned my addr 172.21.15.102:0/1650284874 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:03.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.811+0000 7f77ddcb7640 1 -- 172.21.15.102:0/1650284874 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562738e99fe0 con 0x562738feb4e0 2024-09-13T19:18:03.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.811+0000 7f77ddcb7640 1 --2- 172.21.15.102:0/1650284874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562738feb4e0 0x5627390e3310 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f77d000b7c0 tx=0x7f77d0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.811+0000 7f76ca604640 1 -- 172.21.15.102:0/1650284874 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77d0012030 con 0x562738feb4e0 2024-09-13T19:18:03.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.811+0000 7f76ca604640 1 -- 172.21.15.102:0/1650284874 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77d0001470 con 0x562738feb4e0 2024-09-13T19:18:03.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.811+0000 7f77e1f2c800 1 -- 172.21.15.102:0/1650284874 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5627390e3850 con 0x562738feb4e0 2024-09-13T19:18:03.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.811+0000 7f76ca604640 1 -- 172.21.15.102:0/1650284874 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77d001a8d0 con 0x562738feb4e0 2024-09-13T19:18:03.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.811+0000 7f77e1f2c800 1 -- 172.21.15.102:0/1650284874 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627390e3d70 con 0x562738feb4e0 2024-09-13T19:18:03.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.812+0000 7f76ca604640 1 -- 172.21.15.102:0/1650284874 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f77d0015020 con 0x562738feb4e0 2024-09-13T19:18:03.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.812+0000 7f76ca604640 1 --2- 172.21.15.102:0/1650284874 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f76c4036b40 0x7f76c4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.812+0000 7f76ca604640 1 -- 172.21.15.102:0/1650284874 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f77d0020030 con 0x562738feb4e0 2024-09-13T19:18:03.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.812+0000 7f77d54b6640 1 --2- 172.21.15.102:0/1650284874 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f76c4036b40 0x7f76c4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.812+0000 7f77e1f2c800 1 --2- 172.21.15.102:0/1650284874 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x562738fef920 0x5627390ea380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.812+0000 7f77e1f2c800 1 -- 172.21.15.102:0/1650284874 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5627390ea950 con 0x562738fef920 2024-09-13T19:18:03.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.813+0000 7f77de4b8640 1 --2- 172.21.15.102:0/1650284874 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x562738fef920 0x5627390ea380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.813+0000 7f77d54b6640 1 --2- 172.21.15.102:0/1650284874 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f76c4036b40 0x7f76c4039000 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f77c8057000 tx=0x7f77c8052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.813+0000 7f77de4b8640 1 --2- 172.21.15.102:0/1650284874 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x562738fef920 0x5627390ea380 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.813+0000 7f77de4b8640 1 -- 172.21.15.102:0/1650284874 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f77d800a4a0 con 0x562738fef920 2024-09-13T19:18:03.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.813+0000 7f77e1f2c800 1 -- 172.21.15.102:0/1650284874 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5627390e7930 con 0x562738fef920 2024-09-13T19:18:03.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.813+0000 7f77de4b8640 1 -- 172.21.15.102:0/1650284874 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f77d800a4a0 con 0x562738fef920 2024-09-13T19:18:03.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.813+0000 7f77e1f2c800 1 --2- 172.21.15.102:0/1650284874 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5627390ecc60 0x5627390ef050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.813+0000 7f77e1f2c800 1 -- 172.21.15.102:0/1650284874 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5627390ef6f0 con 0x5627390ecc60 2024-09-13T19:18:03.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.813+0000 7f77ddcb7640 1 --2- 172.21.15.102:0/1650284874 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5627390ecc60 0x5627390ef050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.814+0000 7f77ddcb7640 1 --2- 172.21.15.102:0/1650284874 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5627390ecc60 0x5627390ef050 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.814+0000 7f77ddcb7640 1 -- 172.21.15.102:0/1650284874 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f77d002dcf0 con 0x5627390ecc60 2024-09-13T19:18:03.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.814+0000 7f77e1f2c800 1 -- 172.21.15.102:0/1650284874 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5627390ebb00 con 0x562738fef920 2024-09-13T19:18:03.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.814+0000 7f77de4b8640 1 -- 172.21.15.102:0/1650284874 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f77d800a4a0 con 0x562738fef920 2024-09-13T19:18:03.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.814+0000 7f77e1f2c800 1 -- 172.21.15.102:0/1650284874 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5627390ebfe0 con 0x5627390ecc60 2024-09-13T19:18:03.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.815+0000 7f77ddcb7640 1 -- 172.21.15.102:0/1650284874 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f77d002dcf0 con 0x5627390ecc60 2024-09-13T19:18:03.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.815+0000 7f77e1f2c800 1 Processor -- start 2024-09-13T19:18:03.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.815+0000 7f77e1f2c800 1 -- start start 2024-09-13T19:18:03.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.815+0000 7f77e1f2c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627390fe080 0x5627390fe4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.815+0000 7f77e1f2c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562738e87580 con 0x5627390fe080 2024-09-13T19:18:03.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.815+0000 7f77de4b8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627390fe080 0x5627390fe4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.815+0000 7f77de4b8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627390fe080 0x5627390fe4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:50086/0 (socket says 172.21.15.102:50086) 2024-09-13T19:18:03.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.815+0000 7f77de4b8640 1 -- 172.21.15.102:0/3943278956 learned_addr learned my addr 172.21.15.102:0/3943278956 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:03.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.815+0000 7f77de4b8640 1 -- 172.21.15.102:0/3943278956 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627390fe9e0 con 0x5627390fe080 2024-09-13T19:18:03.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.816+0000 7f77de4b8640 1 --2- 172.21.15.102:0/3943278956 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627390fe080 0x5627390fe4a0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x5627390e43c0 tx=0x7f77d80167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.816+0000 7f76c37fe640 1 -- 172.21.15.102:0/3943278956 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77d8013640 con 0x5627390fe080 2024-09-13T19:18:03.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.816+0000 7f76c37fe640 1 -- 172.21.15.102:0/3943278956 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77d80137e0 con 0x5627390fe080 2024-09-13T19:18:03.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.816+0000 7f77e1f2c800 1 -- 172.21.15.102:0/3943278956 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5627390fec70 con 0x5627390fe080 2024-09-13T19:18:03.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.816+0000 7f76c37fe640 1 -- 172.21.15.102:0/3943278956 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77d8013ae0 con 0x5627390fe080 2024-09-13T19:18:03.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.816+0000 7f77e1f2c800 1 -- 172.21.15.102:0/3943278956 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562739101950 con 0x5627390fe080 2024-09-13T19:18:03.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.817+0000 7f76c37fe640 1 -- 172.21.15.102:0/3943278956 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f77d8011040 con 0x5627390fe080 2024-09-13T19:18:03.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.817+0000 7f76c37fe640 1 --2- 172.21.15.102:0/3943278956 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f76b8036b90 0x7f76b8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.817+0000 7f76c37fe640 1 -- 172.21.15.102:0/3943278956 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f77d800e040 con 0x5627390fe080 2024-09-13T19:18:03.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.817+0000 7f77ddcb7640 1 --2- 172.21.15.102:0/3943278956 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f76b8036b90 0x7f76b8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.817+0000 7f77e1f2c800 1 Processor -- start 2024-09-13T19:18:03.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.817+0000 7f77e1f2c800 1 -- start start 2024-09-13T19:18:03.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.817+0000 7f77ddcb7640 1 --2- 172.21.15.102:0/3943278956 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f76b8036b90 0x7f76b8039050 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x5627390e7870 tx=0x7f77d000e530 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.817+0000 7f77e1f2c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627390db860 0x5627390dbc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.817+0000 7f77e1f2c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5627390de7e0 con 0x5627390db860 2024-09-13T19:18:03.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.818+0000 7f77de4b8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627390db860 0x5627390dbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.818+0000 7f77de4b8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627390db860 0x5627390dbc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:50092/0 (socket says 172.21.15.102:50092) 2024-09-13T19:18:03.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.818+0000 7f77de4b8640 1 -- 172.21.15.102:0/2117441195 learned_addr learned my addr 172.21.15.102:0/2117441195 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:03.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.818+0000 7f77de4b8640 1 -- 172.21.15.102:0/2117441195 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627390dc230 con 0x5627390db860 2024-09-13T19:18:03.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.818+0000 7f77de4b8640 1 --2- 172.21.15.102:0/2117441195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627390db860 0x5627390dbc60 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f77d804cde0 tx=0x7f77d80203a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f69241399dab162d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.818+0000 7f76c17fa640 1 -- 172.21.15.102:0/2117441195 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77d8012c00 con 0x5627390db860 2024-09-13T19:18:03.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.818+0000 7f76c17fa640 1 -- 172.21.15.102:0/2117441195 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77d8021960 con 0x5627390db860 2024-09-13T19:18:03.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.818+0000 7f76c17fa640 1 -- 172.21.15.102:0/2117441195 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77d8021440 con 0x5627390db860 2024-09-13T19:18:03.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.819+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2117441195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627390db860 msgr2=0x5627390dbc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.819+0000 7f77e1f2c800 1 --2- 172.21.15.102:0/2117441195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627390db860 0x5627390dbc60 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f77d804cde0 tx=0x7f77d80203a0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.819+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2117441195 shutdown_connections 2024-09-13T19:18:03.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.819+0000 7f77e1f2c800 1 --2- 172.21.15.102:0/2117441195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627390db860 0x5627390dbc60 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.819+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2117441195 >> 172.21.15.102:0/2117441195 conn(0x562739107100 msgr2=0x562739105200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:03.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.819+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2117441195 shutdown_connections 2024-09-13T19:18:03.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.819+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2117441195 wait complete. 2024-09-13T19:18:03.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.819+0000 7f77e1f2c800 1 Processor -- start 2024-09-13T19:18:03.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.819+0000 7f77e1f2c800 1 -- start start 2024-09-13T19:18:03.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.819+0000 7f77e1f2c800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627390db860 0x562739114440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.819+0000 7f77e1f2c800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5627390da590 con 0x5627390db860 2024-09-13T19:18:03.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.819+0000 7f77de4b8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627390db860 0x562739114440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.819+0000 7f77de4b8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627390db860 0x562739114440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:50094/0 (socket says 172.21.15.102:50094) 2024-09-13T19:18:03.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.819+0000 7f77de4b8640 1 -- 172.21.15.102:0/2239678015 learned_addr learned my addr 172.21.15.102:0/2239678015 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:03.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.820+0000 7f77de4b8640 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562739114980 con 0x5627390db860 2024-09-13T19:18:03.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.820+0000 7f77de4b8640 1 --2- 172.21.15.102:0/2239678015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627390db860 0x562739114440 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f77d803d040 tx=0x7f77d804cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.820+0000 7f76af7fe640 1 -- 172.21.15.102:0/2239678015 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77d803a070 con 0x5627390db860 2024-09-13T19:18:03.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.820+0000 7f76af7fe640 1 -- 172.21.15.102:0/2239678015 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77d8014df0 con 0x5627390db860 2024-09-13T19:18:03.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.820+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562739114c10 con 0x5627390db860 2024-09-13T19:18:03.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.820+0000 7f76af7fe640 1 -- 172.21.15.102:0/2239678015 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77d8021570 con 0x5627390db860 2024-09-13T19:18:03.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.820+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627391178c0 con 0x5627390db860 2024-09-13T19:18:03.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.821+0000 7f76af7fe640 1 -- 172.21.15.102:0/2239678015 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f77d801f6c0 con 0x5627390db860 2024-09-13T19:18:03.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.821+0000 7f76af7fe640 1 --2- 172.21.15.102:0/2239678015 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f76a8036b40 0x7f76a8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.821+0000 7f76af7fe640 1 -- 172.21.15.102:0/2239678015 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f77d8047050 con 0x5627390db860 2024-09-13T19:18:03.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.821+0000 7f77ddcb7640 1 --2- 172.21.15.102:0/2239678015 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f76a8036b40 0x7f76a8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.821+0000 7f77ddcb7640 1 --2- 172.21.15.102:0/2239678015 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f76a8036b40 0x7f76a8039000 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f77d0000fd0 tx=0x7f77d004cf90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.822+0000 7f77e1f2c800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.822+0000 7f77e1f2c800 1 --2- 172.21.15.102:0/2239678015 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56273911ff00 0x5627391223c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.822+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562739122b10 con 0x56273911ff00 2024-09-13T19:18:03.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.822+0000 7f77d54b6640 1 --2- 172.21.15.102:0/2239678015 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56273911ff00 0x5627391223c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.822+0000 7f77d54b6640 1 --2- 172.21.15.102:0/2239678015 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56273911ff00 0x5627391223c0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.823+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f77c8051070 con 0x56273911ff00 2024-09-13T19:18:03.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.823+0000 7f77e1f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:03.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.823+0000 7f77e1f2c800 20 realm 2024-09-13T19:18:03.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.823+0000 7f77e1f2c800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.823+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562739122f40 con 0x56273911ff00 2024-09-13T19:18:03.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.823+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f77c8051070 con 0x56273911ff00 2024-09-13T19:18:03.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.823+0000 7f77e1f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:03.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.823+0000 7f77e1f2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:18:03.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.823+0000 7f77e1f2c800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.823+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562739123810 con 0x56273911ff00 2024-09-13T19:18:03.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.823+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f77c8051070 con 0x56273911ff00 2024-09-13T19:18:03.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.823+0000 7f77e1f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:03.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.823+0000 7f77e1f2c800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.823+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562739123bb0 con 0x56273911ff00 2024-09-13T19:18:03.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.823+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f77c8051070 con 0x56273911ff00 2024-09-13T19:18:03.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.823+0000 7f77e1f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:18:03.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.823+0000 7f77e1f2c800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.823+0000 7f77e1f2c800 1 --2- 172.21.15.102:0/2239678015 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x562739124910 0x562739126d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.823+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562739127310 con 0x562739124910 2024-09-13T19:18:03.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.823+0000 7f77de4b8640 1 --2- 172.21.15.102:0/2239678015 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x562739124910 0x562739126d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.824+0000 7f77de4b8640 1 --2- 172.21.15.102:0/2239678015 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x562739124910 0x562739126d00 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.824+0000 7f77de4b8640 1 -- 172.21.15.102:0/2239678015 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f77d8055070 con 0x562739124910 2024-09-13T19:18:03.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.824+0000 7f77e1f2c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:18:03.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.824+0000 7f77e1f2c800 20 searching for the correct realm 2024-09-13T19:18:03.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.824+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562739128c20 con 0x562739124910 2024-09-13T19:18:03.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.824+0000 7f77de4b8640 1 -- 172.21.15.102:0/2239678015 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77d8055070 con 0x562739124910 2024-09-13T19:18:03.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.824+0000 7f77de4b8640 1 --2- 172.21.15.102:0/2239678015 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f77d8040670 0x7f77d8020790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.824+0000 7f77de4b8640 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562739128c20 con 0x7f77d8040670 2024-09-13T19:18:03.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.824+0000 7f77ddcb7640 1 --2- 172.21.15.102:0/2239678015 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f77d8040670 0x7f77d8020790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.825+0000 7f77ddcb7640 1 --2- 172.21.15.102:0/2239678015 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f77d8040670 0x7f77d8020790 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.825+0000 7f77ddcb7640 1 -- 172.21.15.102:0/2239678015 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77d002dcf0 con 0x7f77d8040670 2024-09-13T19:18:03.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.825+0000 7f77ddcb7640 1 --2- 172.21.15.102:0/2239678015 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f77d0017050 0x7f77d002d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.825+0000 7f77ddcb7640 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562739128c20 con 0x7f77d0017050 2024-09-13T19:18:03.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.825+0000 7f77d54b6640 1 --2- 172.21.15.102:0/2239678015 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f77d0017050 0x7f77d002d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.826+0000 7f77d54b6640 1 --2- 172.21.15.102:0/2239678015 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f77d0017050 0x7f77d002d3f0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.826+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77c8051070 con 0x7f77d0017050 2024-09-13T19:18:03.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.826+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562739128c20 con 0x56273911ff00 2024-09-13T19:18:03.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.826+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77c8051070 con 0x56273911ff00 2024-09-13T19:18:03.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.826+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562739128c20 con 0x56273911ff00 2024-09-13T19:18:03.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.826+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77c8051070 con 0x56273911ff00 2024-09-13T19:18:03.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.826+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562739128c20 con 0x7f77d0017050 2024-09-13T19:18:03.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.827+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77c8051070 con 0x7f77d0017050 2024-09-13T19:18:03.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.827+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562739128c20 con 0x7f77d0017050 2024-09-13T19:18:03.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.827+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77c8051070 con 0x7f77d0017050 2024-09-13T19:18:03.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.827+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562739128c20 con 0x7f77d8040670 2024-09-13T19:18:03.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.827+0000 7f77ddcb7640 1 -- 172.21.15.102:0/2239678015 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77d002dcf0 con 0x7f77d8040670 2024-09-13T19:18:03.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.827+0000 7f77ddcb7640 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562739128c20 con 0x562739124910 2024-09-13T19:18:03.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.828+0000 7f77de4b8640 1 -- 172.21.15.102:0/2239678015 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77d8055070 con 0x562739124910 2024-09-13T19:18:03.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.828+0000 7f77de4b8640 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562739128c20 con 0x56273911ff00 2024-09-13T19:18:03.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.828+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77c8051070 con 0x56273911ff00 2024-09-13T19:18:03.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.828+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562739128c20 con 0x7f77d8040670 2024-09-13T19:18:03.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.828+0000 7f77ddcb7640 1 -- 172.21.15.102:0/2239678015 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77d002dcf0 con 0x7f77d8040670 2024-09-13T19:18:03.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.828+0000 7f77ddcb7640 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562739128c20 con 0x56273911ff00 2024-09-13T19:18:03.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.828+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77c8051070 con 0x56273911ff00 2024-09-13T19:18:03.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.828+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562739128c20 con 0x7f77d8040670 2024-09-13T19:18:03.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.828+0000 7f77ddcb7640 1 -- 172.21.15.102:0/2239678015 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f77d002dcf0 con 0x7f77d8040670 2024-09-13T19:18:03.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.828+0000 7f77ddcb7640 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562739128c20 con 0x562739124910 2024-09-13T19:18:03.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.829+0000 7f77de4b8640 1 -- 172.21.15.102:0/2239678015 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77d8055070 con 0x562739124910 2024-09-13T19:18:03.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.829+0000 7f77de4b8640 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562739128c20 con 0x562739124910 2024-09-13T19:18:03.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.829+0000 7f77de4b8640 1 -- 172.21.15.102:0/2239678015 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f77d8055070 con 0x562739124910 2024-09-13T19:18:03.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.829+0000 7f77de4b8640 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562739128c20 con 0x7f77d0017050 2024-09-13T19:18:03.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.829+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77c8051070 con 0x7f77d0017050 2024-09-13T19:18:03.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.829+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562739128c20 con 0x562739124910 2024-09-13T19:18:03.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.829+0000 7f77de4b8640 1 -- 172.21.15.102:0/2239678015 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f77d8055070 con 0x562739124910 2024-09-13T19:18:03.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.829+0000 7f77de4b8640 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562739128c20 con 0x562739124910 2024-09-13T19:18:03.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.830+0000 7f77de4b8640 1 -- 172.21.15.102:0/2239678015 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77d8055070 con 0x562739124910 2024-09-13T19:18:03.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.830+0000 7f77de4b8640 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562739128c20 con 0x56273911ff00 2024-09-13T19:18:03.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.830+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77c8051070 con 0x56273911ff00 2024-09-13T19:18:03.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.830+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562739128c20 con 0x56273911ff00 2024-09-13T19:18:03.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.830+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f77c8051070 con 0x56273911ff00 2024-09-13T19:18:03.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.830+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562739128c20 con 0x7f77d0017050 2024-09-13T19:18:03.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.830+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77c8051070 con 0x7f77d0017050 2024-09-13T19:18:03.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.830+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562739128c20 con 0x562739124910 2024-09-13T19:18:03.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.831+0000 7f77de4b8640 1 -- 172.21.15.102:0/2239678015 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77d8055070 con 0x562739124910 2024-09-13T19:18:03.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.831+0000 7f77de4b8640 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562739128c20 con 0x7f77d8040670 2024-09-13T19:18:03.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.831+0000 7f77ddcb7640 1 -- 172.21.15.102:0/2239678015 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77d002dcf0 con 0x7f77d8040670 2024-09-13T19:18:03.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.831+0000 7f77ddcb7640 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562739128c20 con 0x56273911ff00 2024-09-13T19:18:03.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.831+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77c8051070 con 0x56273911ff00 2024-09-13T19:18:03.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.831+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562739128c20 con 0x7f77d8040670 2024-09-13T19:18:03.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.831+0000 7f77ddcb7640 1 -- 172.21.15.102:0/2239678015 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77d002dcf0 con 0x7f77d8040670 2024-09-13T19:18:03.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.831+0000 7f77ddcb7640 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562739128c20 con 0x562739124910 2024-09-13T19:18:03.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.832+0000 7f77de4b8640 1 -- 172.21.15.102:0/2239678015 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77d8055070 con 0x562739124910 2024-09-13T19:18:03.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.832+0000 7f77de4b8640 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562739128c20 con 0x7f77d0017050 2024-09-13T19:18:03.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.832+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77c8051070 con 0x7f77d0017050 2024-09-13T19:18:03.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.832+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562739128c20 con 0x7f77d8040670 2024-09-13T19:18:03.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.832+0000 7f77ddcb7640 1 -- 172.21.15.102:0/2239678015 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77d002dcf0 con 0x7f77d8040670 2024-09-13T19:18:03.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.832+0000 7f77ddcb7640 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562739128c20 con 0x562739124910 2024-09-13T19:18:03.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.832+0000 7f77de4b8640 1 -- 172.21.15.102:0/2239678015 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77d8055070 con 0x562739124910 2024-09-13T19:18:03.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.832+0000 7f77de4b8640 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562739128c20 con 0x7f77d0017050 2024-09-13T19:18:03.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.833+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77c8051070 con 0x7f77d0017050 2024-09-13T19:18:03.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.833+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562739128c20 con 0x56273911ff00 2024-09-13T19:18:03.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.833+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v36'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f77c8051070 con 0x56273911ff00 2024-09-13T19:18:03.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.833+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f77c8083080 con 0x7f77d8040670 2024-09-13T19:18:03.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.833+0000 7f77ddcb7640 1 -- 172.21.15.102:0/2239678015 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77d002dcf0 con 0x7f77d8040670 2024-09-13T19:18:03.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.833+0000 7f77e1f2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:18:03.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.833+0000 7f77e1f2c800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:18:03.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.833+0000 7f77e1f2c800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:18:03.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.833+0000 7f77e1f2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:18:03.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.833+0000 7f77e1f2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:18:03.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.833+0000 7f77e1f2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:18:03.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.833+0000 7f77e1f2c800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.833+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5627391287f0 con 0x56273911ff00 2024-09-13T19:18:03.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.833+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f77c8051070 con 0x56273911ff00 2024-09-13T19:18:03.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.833+0000 7f77e1f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:03.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.833+0000 7f77e1f2c800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.833+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562739128060 con 0x56273911ff00 2024-09-13T19:18:03.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.833+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f77c8051070 con 0x56273911ff00 2024-09-13T19:18:03.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.833+0000 7f77e1f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:18:03.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.834+0000 7f77e1f2c800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.834+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5627391290a0 con 0x562739124910 2024-09-13T19:18:03.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.834+0000 7f77de4b8640 1 -- 172.21.15.102:0/2239678015 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f77d8055070 con 0x562739124910 2024-09-13T19:18:03.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.834+0000 7f77e1f2c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:18:03.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.834+0000 7f77e1f2c800 20 zone default found 2024-09-13T19:18:03.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.834+0000 7f77e1f2c800 4 Realm: () 2024-09-13T19:18:03.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.834+0000 7f77e1f2c800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:18:03.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.834+0000 7f77e1f2c800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:18:03.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.834+0000 7f77e1f2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:18:03.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.834+0000 7f77e1f2c800 20 zonegroup default 2024-09-13T19:18:03.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.834+0000 7f77e1f2c800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.834+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5627391298f0 con 0x7f77d8040670 2024-09-13T19:18:03.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.834+0000 7f77ddcb7640 1 -- 172.21.15.102:0/2239678015 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f77d002dcf0 con 0x7f77d8040670 2024-09-13T19:18:03.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.834+0000 7f77e1f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:03.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.834+0000 7f77e1f2c800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.834+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56273912b670 con 0x562739124910 2024-09-13T19:18:03.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.834+0000 7f77de4b8640 1 -- 172.21.15.102:0/2239678015 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f77d8055070 con 0x562739124910 2024-09-13T19:18:03.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.834+0000 7f77e1f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:03.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.834+0000 7f77e1f2c800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.834+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56273912bac0 con 0x562739124910 2024-09-13T19:18:03.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.835+0000 7f77de4b8640 1 -- 172.21.15.102:0/2239678015 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f77d8055070 con 0x562739124910 2024-09-13T19:18:03.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.835+0000 7f77e1f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:03.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.835+0000 7f77e1f2c800 20 started sync module instance, tier type = 2024-09-13T19:18:03.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.835+0000 7f77e1f2c800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:18:03.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.835+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56273912ab10 con 0x7f77d8040670 2024-09-13T19:18:03.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.836+0000 7f77ddcb7640 1 -- 172.21.15.102:0/2239678015 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(44 notify.0 [create] v36'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77d002dcf0 con 0x7f77d8040670 2024-09-13T19:18:03.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.836+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94726461239040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56273912a770 con 0x7f77d8040670 2024-09-13T19:18:03.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.836+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56273912c8c0 con 0x56273911ff00 2024-09-13T19:18:03.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.837+0000 7f77ddcb7640 1 -- 172.21.15.102:0/2239678015 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94726461239040] v36'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77d002dcf0 con 0x7f77d8040670 2024-09-13T19:18:03.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.837+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v36'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77c8051070 con 0x56273911ff00 2024-09-13T19:18:03.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.837+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94726461243648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56273912d160 con 0x56273911ff00 2024-09-13T19:18:03.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.837+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56273912db20 con 0x562739124910 2024-09-13T19:18:03.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.838+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94726461243648] v36'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77c8051070 con 0x56273911ff00 2024-09-13T19:18:03.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.838+0000 7f77de4b8640 1 -- 172.21.15.102:0/2239678015 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v36'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77d8055070 con 0x562739124910 2024-09-13T19:18:03.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.838+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94726461247120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56273912db20 con 0x562739124910 2024-09-13T19:18:03.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.838+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56273912e520 con 0x7f77d8040670 2024-09-13T19:18:03.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.839+0000 7f77de4b8640 1 -- 172.21.15.102:0/2239678015 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94726461247120] v36'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77d8055070 con 0x562739124910 2024-09-13T19:18:03.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.839+0000 7f77ddcb7640 1 -- 172.21.15.102:0/2239678015 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(50 notify.3 [create] v36'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77d002dcf0 con 0x7f77d8040670 2024-09-13T19:18:03.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.839+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94726461251632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56273912db20 con 0x7f77d8040670 2024-09-13T19:18:03.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.839+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56273912efa0 con 0x56273911ff00 2024-09-13T19:18:03.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.840+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v36'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77c8051070 con 0x56273911ff00 2024-09-13T19:18:03.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.840+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94726461254320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56273912f460 con 0x56273911ff00 2024-09-13T19:18:03.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.840+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56273912ff80 con 0x7f77d0017050 2024-09-13T19:18:03.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.840+0000 7f77ddcb7640 1 -- 172.21.15.102:0/2239678015 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94726461251632] v36'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77d002dcf0 con 0x7f77d8040670 2024-09-13T19:18:03.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.841+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(54 notify.5 [create] v36'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77c8051070 con 0x7f77d0017050 2024-09-13T19:18:03.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.841+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94726461258320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56273912ff40 con 0x7f77d0017050 2024-09-13T19:18:03.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.841+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562739130a30 con 0x7f77d0017050 2024-09-13T19:18:03.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.842+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94726461254320] v36'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77c8051070 con 0x56273911ff00 2024-09-13T19:18:03.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.842+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94726461258320] v36'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77c8051070 con 0x7f77d0017050 2024-09-13T19:18:03.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.843+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(56 notify.6 [create] v36'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77c8051070 con 0x7f77d0017050 2024-09-13T19:18:03.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.843+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94726461249136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56273912eed0 con 0x7f77d0017050 2024-09-13T19:18:03.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.843+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562739130ee0 con 0x7f77d0017050 2024-09-13T19:18:03.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.844+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94726461249136] v36'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77c8051070 con 0x7f77d0017050 2024-09-13T19:18:03.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.844+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(58 notify.7 [create] v36'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77c8051070 con 0x7f77d0017050 2024-09-13T19:18:03.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.844+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94726461261120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562739130ee0 con 0x7f77d0017050 2024-09-13T19:18:03.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.844+0000 7f77e1f2c800 20 add_watcher() i=0 2024-09-13T19:18:03.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.844+0000 7f77e1f2c800 20 add_watcher() i=1 2024-09-13T19:18:03.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.844+0000 7f77e1f2c800 20 add_watcher() i=2 2024-09-13T19:18:03.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.844+0000 7f77e1f2c800 20 add_watcher() i=3 2024-09-13T19:18:03.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.844+0000 7f77e1f2c800 20 add_watcher() i=4 2024-09-13T19:18:03.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.844+0000 7f77e1f2c800 20 add_watcher() i=5 2024-09-13T19:18:03.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.844+0000 7f77e1f2c800 20 add_watcher() i=6 2024-09-13T19:18:03.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.845+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94726461261120] v36'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77c8051070 con 0x7f77d0017050 2024-09-13T19:18:03.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.845+0000 7f77e1f2c800 20 add_watcher() i=7 2024-09-13T19:18:03.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.845+0000 7f77e1f2c800 2 all 8 watchers are set, enabling cache 2024-09-13T19:18:03.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.845+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5627391342e0 con 0x56273911ff00 2024-09-13T19:18:03.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.845+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f77c8051070 con 0x56273911ff00 2024-09-13T19:18:03.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.845+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94726461262848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562739131830 con 0x56273911ff00 2024-09-13T19:18:03.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.846+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94726461262848] v36'263 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f77c8051070 con 0x56273911ff00 2024-09-13T19:18:03.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.846+0000 7f768f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:18:03.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.846+0000 7f77e1f2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:18:03.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.846+0000 7f77e1f2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:18:03.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.846+0000 7f77e1f2c800 5 note: GC not initialized 2024-09-13T19:18:03.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.846+0000 7f768e7fc640 20 reqs_thread_entry: start 2024-09-13T19:18:03.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.847+0000 7f77e1f2c800 20 init_complete bucket index max shards: 11 2024-09-13T19:18:03.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.847+0000 7f77e1f2c800 20 Filter name: none 2024-09-13T19:18:03.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.847+0000 7f75fffff640 20 reqs_thread_entry: start 2024-09-13T19:18:03.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.847+0000 7f77e1f2c800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T19:18:03.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.847+0000 7f77e1f2c800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.847+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562739167700 con 0x7f77d0017050 2024-09-13T19:18:03.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.847+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(62 ada [call out=48b,read 0~503 out=503b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+626 (crc 0 0 0) 0x7f77c8051070 con 0x7f77d0017050 2024-09-13T19:18:03.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.847+0000 7f77e1f2c800 20 rados_obj.operate() r=0 bl.length=503 2024-09-13T19:18:03.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.847+0000 7f77e1f2c800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T19:18:03.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.847+0000 7f77e1f2c800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:18:03.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.847+0000 7f77e1f2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:18:03.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.847+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56273916e0d0 con 0x7f77d0017050 2024-09-13T19:18:03.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.848+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v36'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f77c8051070 con 0x7f77d0017050 2024-09-13T19:18:03.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.848+0000 7f77e1f2c800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:18:03.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.848+0000 7f77e1f2c800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:18:03.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.848+0000 7f77e1f2c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T19:18:03.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.849+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94726461512512 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5627391697e0 con 0x56273911ff00 2024-09-13T19:18:03.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.849+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== watch-notify(notify (1) cookie 94726461254320 notify 154618822699 ret 0) ==== 678+0+0 (crc 0 0 0) 0x562738eb3e00 con 0x56273911ff00 2024-09-13T19:18:03.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.849+0000 7f76c17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822699 cookie 94726461254320 notifier 4902 bl.length()=636 2024-09-13T19:18:03.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.849+0000 7f76c17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:18:03.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.849+0000 7f76c17fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:18:03.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.849+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(64 notify.4 [notify cookie 94726461512512 out=8b] v0'0 uv267 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f77c8051070 con 0x56273911ff00 2024-09-13T19:18:03.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.849+0000 7f76c17fa640 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f76a0003ea0 con 0x56273911ff00 2024-09-13T19:18:03.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.849+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77c8051070 con 0x56273911ff00 2024-09-13T19:18:03.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.849+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== watch-notify(notify_complete (2) cookie 94726461512512 notify 154618822699 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f77c807a8d0 con 0x56273911ff00 2024-09-13T19:18:03.863 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T19:18:02.251000Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:18:02.250985Z","tags":[],"group_ids":[]} 2024-09-13T19:18:03.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.850+0000 7f768f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:18:03.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.850+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94726461262848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562739165410 con 0x56273911ff00 2024-09-13T19:18:03.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.851+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94726461262848] v36'264 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f77c8051070 con 0x56273911ff00 2024-09-13T19:18:03.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.851+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94726461239040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562739165410 con 0x7f77d8040670 2024-09-13T19:18:03.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.852+0000 7f77ddcb7640 1 -- 172.21.15.102:0/2239678015 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94726461239040] v36'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77d002dcf0 con 0x7f77d8040670 2024-09-13T19:18:03.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.852+0000 7f77e1f2c800 20 remove_watcher() i=0 2024-09-13T19:18:03.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.852+0000 7f77e1f2c800 2 removed watcher, disabling cache 2024-09-13T19:18:03.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.852+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94726461243648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562739165410 con 0x56273911ff00 2024-09-13T19:18:03.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.853+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94726461243648] v36'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77c8051070 con 0x56273911ff00 2024-09-13T19:18:03.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.853+0000 7f77e1f2c800 20 remove_watcher() i=1 2024-09-13T19:18:03.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.853+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94726461247120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562739165410 con 0x562739124910 2024-09-13T19:18:03.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.855+0000 7f77de4b8640 1 -- 172.21.15.102:0/2239678015 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94726461247120] v36'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77d8055070 con 0x562739124910 2024-09-13T19:18:03.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.855+0000 7f77e1f2c800 20 remove_watcher() i=2 2024-09-13T19:18:03.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.855+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94726461251632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562739165410 con 0x7f77d8040670 2024-09-13T19:18:03.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.856+0000 7f77ddcb7640 1 -- 172.21.15.102:0/2239678015 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94726461251632] v36'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77d002dcf0 con 0x7f77d8040670 2024-09-13T19:18:03.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.856+0000 7f77e1f2c800 20 remove_watcher() i=3 2024-09-13T19:18:03.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.856+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94726461254320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562739165410 con 0x56273911ff00 2024-09-13T19:18:03.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.857+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94726461254320] v36'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77c8051070 con 0x56273911ff00 2024-09-13T19:18:03.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.857+0000 7f77e1f2c800 20 remove_watcher() i=4 2024-09-13T19:18:03.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.857+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94726461258320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562739165410 con 0x7f77d0017050 2024-09-13T19:18:03.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.858+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94726461258320] v36'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77c8051070 con 0x7f77d0017050 2024-09-13T19:18:03.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.858+0000 7f77e1f2c800 20 remove_watcher() i=5 2024-09-13T19:18:03.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.858+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94726461249136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562739165410 con 0x7f77d0017050 2024-09-13T19:18:03.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.859+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94726461249136] v36'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77c8051070 con 0x7f77d0017050 2024-09-13T19:18:03.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.859+0000 7f77e1f2c800 20 remove_watcher() i=6 2024-09-13T19:18:03.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.859+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94726461261120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562739165410 con 0x7f77d0017050 2024-09-13T19:18:03.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.860+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94726461261120] v36'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77c8051070 con 0x7f77d0017050 2024-09-13T19:18:03.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.860+0000 7f77e1f2c800 20 remove_watcher() i=7 2024-09-13T19:18:03.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.860+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f77d0017050 msgr2=0x7f77d002d3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.860+0000 7f77e1f2c800 1 --2- 172.21.15.102:0/2239678015 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f77d0017050 0x7f77d002d3f0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.860+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56273911ff00 msgr2=0x5627391223c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.860+0000 7f77e1f2c800 1 --2- 172.21.15.102:0/2239678015 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x56273911ff00 0x5627391223c0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.860+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f77d8040670 msgr2=0x7f77d8020790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.860+0000 7f77e1f2c800 1 --2- 172.21.15.102:0/2239678015 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f77d8040670 0x7f77d8020790 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.860+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x562739124910 msgr2=0x562739126d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.860+0000 7f77e1f2c800 1 --2- 172.21.15.102:0/2239678015 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x562739124910 0x562739126d00 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.860+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f76a8036b40 msgr2=0x7f76a8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.860+0000 7f77e1f2c800 1 --2- 172.21.15.102:0/2239678015 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f76a8036b40 0x7f76a8039000 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f77d0000fd0 tx=0x7f77d004cf90 comp rx=0 tx=0).stop 2024-09-13T19:18:03.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.860+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627390db860 msgr2=0x562739114440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.860+0000 7f77d54b6640 1 -- 172.21.15.102:0/2239678015 reap_dead start 2024-09-13T19:18:03.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.860+0000 7f77e1f2c800 1 --2- 172.21.15.102:0/2239678015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627390db860 0x562739114440 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f77d803d040 tx=0x7f77d804cd70 comp rx=0 tx=0).stop 2024-09-13T19:18:03.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.860+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 shutdown_connections 2024-09-13T19:18:03.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.860+0000 7f77e1f2c800 1 --2- 172.21.15.102:0/2239678015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627390db860 0x562739114440 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.860+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 >> 172.21.15.102:0/2239678015 conn(0x562739107100 msgr2=0x5627391051d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:03.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.860+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 shutdown_connections 2024-09-13T19:18:03.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.860+0000 7f77e1f2c800 1 -- 172.21.15.102:0/2239678015 wait complete. 2024-09-13T19:18:03.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.861+0000 7f77e1f2c800 1 -- 172.21.15.102:0/3943278956 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f76b8036b90 msgr2=0x7f76b8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.861+0000 7f77e1f2c800 1 --2- 172.21.15.102:0/3943278956 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f76b8036b90 0x7f76b8039050 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x5627390e7870 tx=0x7f77d000e530 comp rx=0 tx=0).stop 2024-09-13T19:18:03.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.861+0000 7f77e1f2c800 1 -- 172.21.15.102:0/3943278956 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627390fe080 msgr2=0x5627390fe4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.861+0000 7f77e1f2c800 1 --2- 172.21.15.102:0/3943278956 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627390fe080 0x5627390fe4a0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x5627390e43c0 tx=0x7f77d80167b0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.861+0000 7f77e1f2c800 1 -- 172.21.15.102:0/3943278956 shutdown_connections 2024-09-13T19:18:03.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.861+0000 7f77e1f2c800 1 --2- 172.21.15.102:0/3943278956 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f76b8036b90 0x7f76b8039050 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.861+0000 7f77e1f2c800 1 --2- 172.21.15.102:0/3943278956 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627390fe080 0x5627390fe4a0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.861+0000 7f77e1f2c800 1 -- 172.21.15.102:0/3943278956 >> 172.21.15.102:0/3943278956 conn(0x5627390f3010 msgr2=0x5627390f5b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:03.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.861+0000 7f77e1f2c800 1 -- 172.21.15.102:0/3943278956 shutdown_connections 2024-09-13T19:18:03.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.861+0000 7f77e1f2c800 1 -- 172.21.15.102:0/3943278956 wait complete. 2024-09-13T19:18:03.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.861+0000 7f77e1f2c800 1 -- 172.21.15.102:0/1650284874 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x562738fef920 msgr2=0x5627390ea380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.861+0000 7f77e1f2c800 1 --2- 172.21.15.102:0/1650284874 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x562738fef920 0x5627390ea380 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.861+0000 7f77e1f2c800 1 -- 172.21.15.102:0/1650284874 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5627390ecc60 msgr2=0x5627390ef050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.861+0000 7f77e1f2c800 1 --2- 172.21.15.102:0/1650284874 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5627390ecc60 0x5627390ef050 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.861+0000 7f77e1f2c800 1 -- 172.21.15.102:0/1650284874 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f76c4036b40 msgr2=0x7f76c4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.861+0000 7f77e1f2c800 1 --2- 172.21.15.102:0/1650284874 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f76c4036b40 0x7f76c4039000 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f77c8057000 tx=0x7f77c8052000 comp rx=0 tx=0).stop 2024-09-13T19:18:03.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.861+0000 7f77e1f2c800 1 -- 172.21.15.102:0/1650284874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562738feb4e0 msgr2=0x5627390e3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.861+0000 7f77e1f2c800 1 --2- 172.21.15.102:0/1650284874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562738feb4e0 0x5627390e3310 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f77d000b7c0 tx=0x7f77d0000ed0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.861+0000 7f77e1f2c800 1 -- 172.21.15.102:0/1650284874 shutdown_connections 2024-09-13T19:18:03.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.861+0000 7f77e1f2c800 1 --2- 172.21.15.102:0/1650284874 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x5627390ecc60 0x5627390ef050 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.861+0000 7f77e1f2c800 1 --2- 172.21.15.102:0/1650284874 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x562738fef920 0x5627390ea380 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.861+0000 7f77e1f2c800 1 --2- 172.21.15.102:0/1650284874 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f76c4036b40 0x7f76c4039000 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.861+0000 7f77e1f2c800 1 --2- 172.21.15.102:0/1650284874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562738feb4e0 0x5627390e3310 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.861+0000 7f77e1f2c800 1 -- 172.21.15.102:0/1650284874 >> 172.21.15.102:0/1650284874 conn(0x562738fe6dd0 msgr2=0x5627390d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:03.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.861+0000 7f77e1f2c800 1 -- 172.21.15.102:0/1650284874 shutdown_connections 2024-09-13T19:18:03.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.861+0000 7f77e1f2c800 1 -- 172.21.15.102:0/1650284874 wait complete. 2024-09-13T19:18:03.874 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:18:02.251000Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:18:02.250985Z', 'tags': [], 'group_ids': []} 2024-09-13T19:18:03.874 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:18:02.251000Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:18:02.250985Z', 'tags': [], 'group_ids': []} 2024-09-13T19:18:03.874 ERROR:root:0 2024-09-13T19:18:03.874 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-13T19:18:03.875 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-13T19:18:03.875 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=write 2024-09-13T19:18:03.925 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:18:03.925 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:18:03.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.923+0000 7f37d3922800 1 Processor -- start 2024-09-13T19:18:03.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.923+0000 7f37d3922800 1 -- start start 2024-09-13T19:18:03.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.923+0000 7f37d3922800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55dd02238710 0x55dd02238b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.923+0000 7f37d3922800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55dd020f7b30 con 0x55dd02239050 2024-09-13T19:18:03.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.923+0000 7f37d3922800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55dd020d9360 con 0x55dd02238710 2024-09-13T19:18:03.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.923+0000 7f37cf616640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55dd02238710 0x55dd02238b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.923+0000 7f37cf616640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55dd02238710 0x55dd02238b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:50106/0 (socket says 172.21.15.102:50106) 2024-09-13T19:18:03.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.923+0000 7f37cf616640 1 -- 172.21.15.102:0/2541831531 learned_addr learned my addr 172.21.15.102:0/2541831531 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:03.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.923+0000 7f37c7fff640 1 --1- 172.21.15.102:0/2541831531 >> v1:172.21.15.53:6789/0 conn(0x55dd02239050 0x55dd0223da90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:53798/0 (socket says 172.21.15.102:53798) 2024-09-13T19:18:03.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.923+0000 7f37cf616640 1 -- 172.21.15.102:0/2541831531 >> v1:172.21.15.53:6789/0 conn(0x55dd02239050 legacy=0x55dd0223da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.924+0000 7f37cf616640 1 -- 172.21.15.102:0/2541831531 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd020ffe00 con 0x55dd02238710 2024-09-13T19:18:03.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.925+0000 7f37cf616640 1 --2- 172.21.15.102:0/2541831531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd02238710 0x55dd02238b10 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f37c000a520 tx=0x7f37c0045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1f358227673e532 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.925+0000 7f37cee15640 1 -- 172.21.15.102:0/2541831531 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37c0055070 con 0x55dd02238710 2024-09-13T19:18:03.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.925+0000 7f37cee15640 1 -- 172.21.15.102:0/2541831531 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37c00515b0 con 0x55dd02238710 2024-09-13T19:18:03.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.925+0000 7f37cee15640 1 -- 172.21.15.102:0/2541831531 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37c00518d0 con 0x55dd02238710 2024-09-13T19:18:03.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.926+0000 7f37d3922800 1 -- 172.21.15.102:0/2541831531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd02238710 msgr2=0x55dd02238b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.926+0000 7f37d3922800 1 --2- 172.21.15.102:0/2541831531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd02238710 0x55dd02238b10 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f37c000a520 tx=0x7f37c0045ba0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.926+0000 7f37d3922800 1 -- 172.21.15.102:0/2541831531 shutdown_connections 2024-09-13T19:18:03.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.926+0000 7f37d3922800 1 --2- 172.21.15.102:0/2541831531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd02238710 0x55dd02238b10 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.926+0000 7f37d3922800 1 -- 172.21.15.102:0/2541831531 >> 172.21.15.102:0/2541831531 conn(0x55dd02233fe0 msgr2=0x55dd02236400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:03.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.926+0000 7f37d3922800 1 -- 172.21.15.102:0/2541831531 shutdown_connections 2024-09-13T19:18:03.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.926+0000 7f37d3922800 1 -- 172.21.15.102:0/2541831531 wait complete. 2024-09-13T19:18:03.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.940+0000 7f37d3922800 1 Processor -- start 2024-09-13T19:18:03.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.940+0000 7f37d3922800 1 -- start start 2024-09-13T19:18:03.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.940+0000 7f37d3922800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd02238710 0x55dd02327900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.940+0000 7f37d3922800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55dd02184360 con 0x55dd02238710 2024-09-13T19:18:03.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.941+0000 7f37cf616640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd02238710 0x55dd02327900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.941+0000 7f37cf616640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd02238710 0x55dd02327900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:50108/0 (socket says 172.21.15.102:50108) 2024-09-13T19:18:03.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.941+0000 7f37cf616640 1 -- 172.21.15.102:0/3511331294 learned_addr learned my addr 172.21.15.102:0/3511331294 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:03.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.941+0000 7f37cf616640 1 -- 172.21.15.102:0/3511331294 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd020d1bc0 con 0x55dd02238710 2024-09-13T19:18:03.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.941+0000 7f37cf616640 1 --2- 172.21.15.102:0/3511331294 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd02238710 0x55dd02327900 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f37c0025da0 tx=0x7f37c0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d0b69ebdc8113b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.941+0000 7f36bd60a640 1 -- 172.21.15.102:0/3511331294 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37c0051950 con 0x55dd02238710 2024-09-13T19:18:03.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.941+0000 7f36bd60a640 1 -- 172.21.15.102:0/3511331294 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37c0051af0 con 0x55dd02238710 2024-09-13T19:18:03.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.941+0000 7f36bd60a640 1 -- 172.21.15.102:0/3511331294 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37c0051dd0 con 0x55dd02238710 2024-09-13T19:18:03.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.942+0000 7f37d3922800 1 -- 172.21.15.102:0/3511331294 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd02238710 msgr2=0x55dd02327900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.942+0000 7f37d3922800 1 --2- 172.21.15.102:0/3511331294 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd02238710 0x55dd02327900 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f37c0025da0 tx=0x7f37c0051000 comp rx=0 tx=0).stop 2024-09-13T19:18:03.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.942+0000 7f37d3922800 1 -- 172.21.15.102:0/3511331294 shutdown_connections 2024-09-13T19:18:03.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.942+0000 7f37d3922800 1 --2- 172.21.15.102:0/3511331294 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd02238710 0x55dd02327900 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.942+0000 7f37d3922800 1 -- 172.21.15.102:0/3511331294 >> 172.21.15.102:0/3511331294 conn(0x55dd02233fe0 msgr2=0x55dd023232c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:03.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.942+0000 7f37d3922800 1 -- 172.21.15.102:0/3511331294 shutdown_connections 2024-09-13T19:18:03.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.942+0000 7f37d3922800 1 -- 172.21.15.102:0/3511331294 wait complete. 2024-09-13T19:18:03.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.942+0000 7f37d3922800 1 Processor -- start 2024-09-13T19:18:03.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.943+0000 7f37d3922800 1 -- start start 2024-09-13T19:18:03.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.943+0000 7f37d3922800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd02238710 0x55dd0232f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.943+0000 7f37d3922800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55dd0223f5f0 con 0x55dd02238710 2024-09-13T19:18:03.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.943+0000 7f37cf616640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd02238710 0x55dd0232f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.943+0000 7f37cf616640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd02238710 0x55dd0232f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:50122/0 (socket says 172.21.15.102:50122) 2024-09-13T19:18:03.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.943+0000 7f37cf616640 1 -- 172.21.15.102:0/2473404677 learned_addr learned my addr 172.21.15.102:0/2473404677 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:03.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.943+0000 7f37cf616640 1 -- 172.21.15.102:0/2473404677 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd020e5fe0 con 0x55dd02238710 2024-09-13T19:18:03.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.943+0000 7f37cf616640 1 --2- 172.21.15.102:0/2473404677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd02238710 0x55dd0232f160 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f37c0067040 tx=0x7f37c0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.944+0000 7f36bbe07640 1 -- 172.21.15.102:0/2473404677 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37c0073070 con 0x55dd02238710 2024-09-13T19:18:03.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.944+0000 7f36bbe07640 1 -- 172.21.15.102:0/2473404677 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37c005a450 con 0x55dd02238710 2024-09-13T19:18:03.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.944+0000 7f37d3922800 1 -- 172.21.15.102:0/2473404677 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dd0232f6a0 con 0x55dd02238710 2024-09-13T19:18:03.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.944+0000 7f36bbe07640 1 -- 172.21.15.102:0/2473404677 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37c005a730 con 0x55dd02238710 2024-09-13T19:18:03.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.944+0000 7f37d3922800 1 -- 172.21.15.102:0/2473404677 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd0232fc20 con 0x55dd02238710 2024-09-13T19:18:03.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.944+0000 7f36bbe07640 1 -- 172.21.15.102:0/2473404677 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f37c0076070 con 0x55dd02238710 2024-09-13T19:18:03.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.945+0000 7f36bbe07640 1 --2- 172.21.15.102:0/2473404677 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f36b4036b40 0x7f36b4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.945+0000 7f36bbe07640 1 -- 172.21.15.102:0/2473404677 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f37c0062070 con 0x55dd02238710 2024-09-13T19:18:03.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.945+0000 7f37c7fff640 1 --2- 172.21.15.102:0/2473404677 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f36b4036b40 0x7f36b4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.945+0000 7f37d3922800 1 --2- 172.21.15.102:0/2473404677 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55dd02239050 0x55dd023361d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.945+0000 7f37d3922800 1 -- 172.21.15.102:0/2473404677 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55dd02336750 con 0x55dd02239050 2024-09-13T19:18:03.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.945+0000 7f37cfe17640 1 --2- 172.21.15.102:0/2473404677 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55dd02239050 0x55dd023361d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.945+0000 7f37c7fff640 1 --2- 172.21.15.102:0/2473404677 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f36b4036b40 0x7f36b4039000 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f37b8000f60 tx=0x7f37b8001370 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.945+0000 7f37cfe17640 1 --2- 172.21.15.102:0/2473404677 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55dd02239050 0x55dd023361d0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.945+0000 7f37cfe17640 1 -- 172.21.15.102:0/2473404677 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37c800a4a0 con 0x55dd02239050 2024-09-13T19:18:03.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.946+0000 7f37d3922800 1 -- 172.21.15.102:0/2473404677 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55dd023337a0 con 0x55dd02239050 2024-09-13T19:18:03.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.946+0000 7f37cfe17640 1 -- 172.21.15.102:0/2473404677 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f37c800a4a0 con 0x55dd02239050 2024-09-13T19:18:03.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.946+0000 7f37d3922800 1 --2- 172.21.15.102:0/2473404677 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55dd02338a80 0x55dd0233ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.946+0000 7f37d3922800 1 -- 172.21.15.102:0/2473404677 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55dd0233b560 con 0x55dd02338a80 2024-09-13T19:18:03.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.946+0000 7f37cf616640 1 --2- 172.21.15.102:0/2473404677 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55dd02338a80 0x55dd0233ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.946+0000 7f37cf616640 1 --2- 172.21.15.102:0/2473404677 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55dd02338a80 0x55dd0233ae70 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.946+0000 7f37cf616640 1 -- 172.21.15.102:0/2473404677 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f37c007f070 con 0x55dd02338a80 2024-09-13T19:18:03.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.946+0000 7f37d3922800 1 -- 172.21.15.102:0/2473404677 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55dd02337920 con 0x55dd02239050 2024-09-13T19:18:03.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.947+0000 7f37cfe17640 1 -- 172.21.15.102:0/2473404677 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f37c800a4a0 con 0x55dd02239050 2024-09-13T19:18:03.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.947+0000 7f37d3922800 1 -- 172.21.15.102:0/2473404677 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55dd02337e00 con 0x55dd02338a80 2024-09-13T19:18:03.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.947+0000 7f37cf616640 1 -- 172.21.15.102:0/2473404677 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f37c007f070 con 0x55dd02338a80 2024-09-13T19:18:03.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.947+0000 7f37d3922800 1 Processor -- start 2024-09-13T19:18:03.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.947+0000 7f37d3922800 1 -- start start 2024-09-13T19:18:03.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.947+0000 7f37d3922800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd021ae760 0x55dd021acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.947+0000 7f37d3922800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55dd020d3580 con 0x55dd021ae760 2024-09-13T19:18:03.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.948+0000 7f37cfe17640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd021ae760 0x55dd021acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.948+0000 7f37cfe17640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd021ae760 0x55dd021acdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:50124/0 (socket says 172.21.15.102:50124) 2024-09-13T19:18:03.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.948+0000 7f37cfe17640 1 -- 172.21.15.102:0/3326897262 learned_addr learned my addr 172.21.15.102:0/3326897262 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:03.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.948+0000 7f37cfe17640 1 -- 172.21.15.102:0/3326897262 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd021aeb80 con 0x55dd021ae760 2024-09-13T19:18:03.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.948+0000 7f37cfe17640 1 --2- 172.21.15.102:0/3326897262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd021ae760 0x55dd021acdb0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x55dd02336b30 tx=0x7f37c80163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.948+0000 7f36b9602640 1 -- 172.21.15.102:0/3326897262 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37c8013450 con 0x55dd021ae760 2024-09-13T19:18:03.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.948+0000 7f36b9602640 1 -- 172.21.15.102:0/3326897262 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37c80135f0 con 0x55dd021ae760 2024-09-13T19:18:03.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.948+0000 7f37d3922800 1 -- 172.21.15.102:0/3326897262 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dd021ad3b0 con 0x55dd021ae760 2024-09-13T19:18:03.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.948+0000 7f36b9602640 1 -- 172.21.15.102:0/3326897262 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37c80138d0 con 0x55dd021ae760 2024-09-13T19:18:03.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.949+0000 7f37d3922800 1 -- 172.21.15.102:0/3326897262 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd021ad8b0 con 0x55dd021ae760 2024-09-13T19:18:03.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.949+0000 7f36b9602640 1 -- 172.21.15.102:0/3326897262 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f37c8011040 con 0x55dd021ae760 2024-09-13T19:18:03.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.949+0000 7f36b9602640 1 --2- 172.21.15.102:0/3326897262 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f36a8036b40 0x7f36a8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.949+0000 7f36b9602640 1 -- 172.21.15.102:0/3326897262 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f37c800e040 con 0x55dd021ae760 2024-09-13T19:18:03.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.949+0000 7f37cf616640 1 --2- 172.21.15.102:0/3326897262 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f36a8036b40 0x7f36a8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.950+0000 7f37d3922800 1 Processor -- start 2024-09-13T19:18:03.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.950+0000 7f37d3922800 1 -- start start 2024-09-13T19:18:03.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.950+0000 7f37cf616640 1 --2- 172.21.15.102:0/3326897262 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f36a8036b40 0x7f36a8039000 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x55dd02337030 tx=0x7f37c008f220 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.950+0000 7f37d3922800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd02358de0 0x55dd023591e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.950+0000 7f37d3922800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55dd02327ff0 con 0x55dd02358de0 2024-09-13T19:18:03.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.950+0000 7f37cfe17640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd02358de0 0x55dd023591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.950+0000 7f37cfe17640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd02358de0 0x55dd023591e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:50130/0 (socket says 172.21.15.102:50130) 2024-09-13T19:18:03.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.950+0000 7f37cfe17640 1 -- 172.21.15.102:0/3370282601 learned_addr learned my addr 172.21.15.102:0/3370282601 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:03.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.950+0000 7f37cfe17640 1 -- 172.21.15.102:0/3370282601 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd023597b0 con 0x55dd02358de0 2024-09-13T19:18:03.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.951+0000 7f37cfe17640 1 --2- 172.21.15.102:0/3370282601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd02358de0 0x55dd023591e0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f37c8016fd0 tx=0x7f37c8014ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bedc20a3d0582c5f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.951+0000 7f36b2ffd640 1 -- 172.21.15.102:0/3370282601 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37c804a070 con 0x55dd02358de0 2024-09-13T19:18:03.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.951+0000 7f36b2ffd640 1 -- 172.21.15.102:0/3370282601 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37c8014bd0 con 0x55dd02358de0 2024-09-13T19:18:03.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.951+0000 7f36b2ffd640 1 -- 172.21.15.102:0/3370282601 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37c802a980 con 0x55dd02358de0 2024-09-13T19:18:03.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.951+0000 7f37d3922800 1 -- 172.21.15.102:0/3370282601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd02358de0 msgr2=0x55dd023591e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:03.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.951+0000 7f37d3922800 1 --2- 172.21.15.102:0/3370282601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd02358de0 0x55dd023591e0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f37c8016fd0 tx=0x7f37c8014ef0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.951+0000 7f37d3922800 1 -- 172.21.15.102:0/3370282601 shutdown_connections 2024-09-13T19:18:03.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.951+0000 7f37d3922800 1 --2- 172.21.15.102:0/3370282601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd02358de0 0x55dd023591e0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:03.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.951+0000 7f37d3922800 1 -- 172.21.15.102:0/3370282601 >> 172.21.15.102:0/3370282601 conn(0x55dd02355140 msgr2=0x55dd02353240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:03.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.951+0000 7f37d3922800 1 -- 172.21.15.102:0/3370282601 shutdown_connections 2024-09-13T19:18:03.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.951+0000 7f37d3922800 1 -- 172.21.15.102:0/3370282601 wait complete. 2024-09-13T19:18:03.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.951+0000 7f37d3922800 1 Processor -- start 2024-09-13T19:18:03.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.952+0000 7f37d3922800 1 -- start start 2024-09-13T19:18:03.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.952+0000 7f37d3922800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd02358de0 0x55dd02360240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.952+0000 7f37d3922800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55dd02359e20 con 0x55dd02358de0 2024-09-13T19:18:03.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.952+0000 7f37cfe17640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd02358de0 0x55dd02360240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.952+0000 7f37cfe17640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd02358de0 0x55dd02360240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:50140/0 (socket says 172.21.15.102:50140) 2024-09-13T19:18:03.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.952+0000 7f37cfe17640 1 -- 172.21.15.102:0/751841863 learned_addr learned my addr 172.21.15.102:0/751841863 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:03.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.952+0000 7f37cfe17640 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd02360780 con 0x55dd02358de0 2024-09-13T19:18:03.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.952+0000 7f37cfe17640 1 --2- 172.21.15.102:0/751841863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd02358de0 0x55dd02360240 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x55dd02353db0 tx=0x7f37c804cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.953+0000 7f36b17fa640 1 -- 172.21.15.102:0/751841863 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37c802aab0 con 0x55dd02358de0 2024-09-13T19:18:03.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.953+0000 7f36b17fa640 1 -- 172.21.15.102:0/751841863 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37c80143c0 con 0x55dd02358de0 2024-09-13T19:18:03.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.953+0000 7f36b17fa640 1 -- 172.21.15.102:0/751841863 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37c80146e0 con 0x55dd02358de0 2024-09-13T19:18:03.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.953+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dd02360a10 con 0x55dd02358de0 2024-09-13T19:18:03.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.953+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd023636c0 con 0x55dd02358de0 2024-09-13T19:18:03.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.953+0000 7f36b17fa640 1 -- 172.21.15.102:0/751841863 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f37c8014880 con 0x55dd02358de0 2024-09-13T19:18:03.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.953+0000 7f36b17fa640 1 --2- 172.21.15.102:0/751841863 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3698036b40 0x7f3698039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.954+0000 7f36b17fa640 1 -- 172.21.15.102:0/751841863 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f37c804f4a0 con 0x55dd02358de0 2024-09-13T19:18:03.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.954+0000 7f37cf616640 1 --2- 172.21.15.102:0/751841863 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3698036b40 0x7f3698039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.954+0000 7f37cf616640 1 --2- 172.21.15.102:0/751841863 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3698036b40 0x7f3698039000 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f37c005ab80 tx=0x7f37c0087000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.954+0000 7f37d3922800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.954+0000 7f37d3922800 1 --2- 172.21.15.102:0/751841863 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55dd0236bd70 0x55dd0236e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.954+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55dd0236e980 con 0x55dd0236bd70 2024-09-13T19:18:03.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.954+0000 7f37c7fff640 1 --2- 172.21.15.102:0/751841863 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55dd0236bd70 0x55dd0236e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.955+0000 7f37c7fff640 1 --2- 172.21.15.102:0/751841863 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55dd0236bd70 0x55dd0236e230 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.955+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37b800f610 con 0x55dd0236bd70 2024-09-13T19:18:03.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.955+0000 7f37d3922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:03.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.955+0000 7f37d3922800 20 realm 2024-09-13T19:18:03.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.955+0000 7f37d3922800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.955+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55dd0236b1c0 con 0x55dd0236bd70 2024-09-13T19:18:03.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.955+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37b800f610 con 0x55dd0236bd70 2024-09-13T19:18:03.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.955+0000 7f37d3922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:03.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.955+0000 7f37d3922800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:18:03.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.955+0000 7f37d3922800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.955+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55dd0236f470 con 0x55dd0236bd70 2024-09-13T19:18:03.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.955+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37b800f610 con 0x55dd0236bd70 2024-09-13T19:18:03.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.955+0000 7f37d3922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:03.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.955+0000 7f37d3922800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.955+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55dd0236fd40 con 0x55dd0236bd70 2024-09-13T19:18:03.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.955+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f37b800f610 con 0x55dd0236bd70 2024-09-13T19:18:03.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.955+0000 7f37d3922800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:18:03.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.955+0000 7f37d3922800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.955+0000 7f37d3922800 1 --2- 172.21.15.102:0/751841863 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55dd02370760 0x55dd02372b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.956+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55dd02373240 con 0x55dd02370760 2024-09-13T19:18:03.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.956+0000 7f37cfe17640 1 --2- 172.21.15.102:0/751841863 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55dd02370760 0x55dd02372b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.956+0000 7f37cfe17640 1 --2- 172.21.15.102:0/751841863 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55dd02370760 0x55dd02372b50 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.956+0000 7f37cfe17640 1 -- 172.21.15.102:0/751841863 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f37c8027020 con 0x55dd02370760 2024-09-13T19:18:03.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.956+0000 7f37d3922800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:18:03.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.956+0000 7f37d3922800 20 searching for the correct realm 2024-09-13T19:18:03.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.956+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dd02374b90 con 0x55dd02370760 2024-09-13T19:18:03.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.956+0000 7f37cfe17640 1 -- 172.21.15.102:0/751841863 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c8027020 con 0x55dd02370760 2024-09-13T19:18:03.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.956+0000 7f37cfe17640 1 --2- 172.21.15.102:0/751841863 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f37c8013070 0x7f37c803c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.956+0000 7f37cfe17640 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dd02374b90 con 0x7f37c8013070 2024-09-13T19:18:03.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.957+0000 7f37cf616640 1 --2- 172.21.15.102:0/751841863 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f37c8013070 0x7f37c803c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.957+0000 7f37cf616640 1 --2- 172.21.15.102:0/751841863 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f37c8013070 0x7f37c803c520 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.957+0000 7f37cf616640 1 -- 172.21.15.102:0/751841863 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c007f070 con 0x7f37c8013070 2024-09-13T19:18:03.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.957+0000 7f37cf616640 1 --2- 172.21.15.102:0/751841863 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f37c00a7040 0x7f37c008f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:03.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.957+0000 7f37cf616640 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dd02374b90 con 0x7f37c00a7040 2024-09-13T19:18:03.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.957+0000 7f37c7fff640 1 --2- 172.21.15.102:0/751841863 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f37c00a7040 0x7f37c008f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:03.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.958+0000 7f37c7fff640 1 --2- 172.21.15.102:0/751841863 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f37c00a7040 0x7f37c008f640 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:03.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.958+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b800f610 con 0x7f37c00a7040 2024-09-13T19:18:03.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.958+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dd02374b90 con 0x55dd0236bd70 2024-09-13T19:18:03.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.958+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b800f610 con 0x55dd0236bd70 2024-09-13T19:18:03.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.958+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dd02374b90 con 0x55dd0236bd70 2024-09-13T19:18:03.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.958+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b802b040 con 0x55dd0236bd70 2024-09-13T19:18:03.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.958+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dd02374b90 con 0x7f37c00a7040 2024-09-13T19:18:03.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.959+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b802b040 con 0x7f37c00a7040 2024-09-13T19:18:03.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.959+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dd02374b90 con 0x7f37c00a7040 2024-09-13T19:18:03.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.959+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b802b040 con 0x7f37c00a7040 2024-09-13T19:18:03.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.959+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dd02374b90 con 0x7f37c8013070 2024-09-13T19:18:03.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.959+0000 7f37cf616640 1 -- 172.21.15.102:0/751841863 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c007f070 con 0x7f37c8013070 2024-09-13T19:18:03.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.959+0000 7f37cf616640 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dd02374b90 con 0x55dd02370760 2024-09-13T19:18:03.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.959+0000 7f37cfe17640 1 -- 172.21.15.102:0/751841863 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c8027020 con 0x55dd02370760 2024-09-13T19:18:03.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.959+0000 7f37cfe17640 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dd02374b90 con 0x55dd0236bd70 2024-09-13T19:18:03.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.960+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b802b040 con 0x55dd0236bd70 2024-09-13T19:18:03.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.960+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dd02374b90 con 0x7f37c8013070 2024-09-13T19:18:03.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.960+0000 7f37cf616640 1 -- 172.21.15.102:0/751841863 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c007f070 con 0x7f37c8013070 2024-09-13T19:18:03.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.960+0000 7f37cf616640 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dd02374b90 con 0x55dd0236bd70 2024-09-13T19:18:03.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.960+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b802b040 con 0x55dd0236bd70 2024-09-13T19:18:03.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.960+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dd02374b90 con 0x7f37c8013070 2024-09-13T19:18:03.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.960+0000 7f37cf616640 1 -- 172.21.15.102:0/751841863 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f37c007f070 con 0x7f37c8013070 2024-09-13T19:18:03.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.960+0000 7f37cf616640 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dd02374b90 con 0x55dd02370760 2024-09-13T19:18:03.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.961+0000 7f37cfe17640 1 -- 172.21.15.102:0/751841863 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c8027020 con 0x55dd02370760 2024-09-13T19:18:03.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.961+0000 7f37cfe17640 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dd02374b90 con 0x55dd02370760 2024-09-13T19:18:03.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.961+0000 7f37cfe17640 1 -- 172.21.15.102:0/751841863 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f37c8027020 con 0x55dd02370760 2024-09-13T19:18:03.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.961+0000 7f37cfe17640 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dd02374b90 con 0x7f37c00a7040 2024-09-13T19:18:03.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.961+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b802b040 con 0x7f37c00a7040 2024-09-13T19:18:03.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.961+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dd02374b90 con 0x55dd02370760 2024-09-13T19:18:03.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.962+0000 7f37cfe17640 1 -- 172.21.15.102:0/751841863 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f37c8027020 con 0x55dd02370760 2024-09-13T19:18:03.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.962+0000 7f37cfe17640 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dd02374b90 con 0x55dd02370760 2024-09-13T19:18:03.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.962+0000 7f37cfe17640 1 -- 172.21.15.102:0/751841863 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c8027020 con 0x55dd02370760 2024-09-13T19:18:03.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.962+0000 7f37cfe17640 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dd02374b90 con 0x55dd0236bd70 2024-09-13T19:18:03.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.962+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b802b040 con 0x55dd0236bd70 2024-09-13T19:18:03.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.962+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dd02374b90 con 0x55dd0236bd70 2024-09-13T19:18:03.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.962+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f37b802b040 con 0x55dd0236bd70 2024-09-13T19:18:03.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.962+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dd02374b90 con 0x7f37c00a7040 2024-09-13T19:18:03.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.963+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b802b040 con 0x7f37c00a7040 2024-09-13T19:18:03.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.963+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dd02374b90 con 0x55dd02370760 2024-09-13T19:18:03.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.963+0000 7f37cfe17640 1 -- 172.21.15.102:0/751841863 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c8027020 con 0x55dd02370760 2024-09-13T19:18:03.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.963+0000 7f37cfe17640 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dd02374b90 con 0x7f37c8013070 2024-09-13T19:18:03.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.963+0000 7f37cf616640 1 -- 172.21.15.102:0/751841863 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c007f070 con 0x7f37c8013070 2024-09-13T19:18:03.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.963+0000 7f37cf616640 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dd02374b90 con 0x55dd0236bd70 2024-09-13T19:18:03.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.963+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b802b040 con 0x55dd0236bd70 2024-09-13T19:18:03.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.963+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dd02374b90 con 0x7f37c8013070 2024-09-13T19:18:03.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.963+0000 7f37cf616640 1 -- 172.21.15.102:0/751841863 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c007f070 con 0x7f37c8013070 2024-09-13T19:18:03.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.964+0000 7f37cf616640 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dd02374b90 con 0x55dd02370760 2024-09-13T19:18:03.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.964+0000 7f37cfe17640 1 -- 172.21.15.102:0/751841863 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c8027020 con 0x55dd02370760 2024-09-13T19:18:03.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.964+0000 7f37cfe17640 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dd02374b90 con 0x7f37c00a7040 2024-09-13T19:18:03.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.964+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b802b040 con 0x7f37c00a7040 2024-09-13T19:18:03.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.964+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dd02374b90 con 0x7f37c8013070 2024-09-13T19:18:03.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.964+0000 7f37cf616640 1 -- 172.21.15.102:0/751841863 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c007f070 con 0x7f37c8013070 2024-09-13T19:18:03.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.964+0000 7f37cf616640 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dd02374b90 con 0x55dd02370760 2024-09-13T19:18:03.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.964+0000 7f37cfe17640 1 -- 172.21.15.102:0/751841863 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c8027020 con 0x55dd02370760 2024-09-13T19:18:03.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.964+0000 7f37cfe17640 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dd02374b90 con 0x7f37c00a7040 2024-09-13T19:18:03.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.965+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37b802b040 con 0x7f37c00a7040 2024-09-13T19:18:03.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.965+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dd02374b90 con 0x55dd0236bd70 2024-09-13T19:18:03.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.965+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v36'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f37b802b040 con 0x55dd0236bd70 2024-09-13T19:18:03.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.965+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55dd02374b90 con 0x7f37c8013070 2024-09-13T19:18:03.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.965+0000 7f37cf616640 1 -- 172.21.15.102:0/751841863 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c007f070 con 0x7f37c8013070 2024-09-13T19:18:03.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.965+0000 7f37d3922800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:18:03.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.965+0000 7f37d3922800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:18:03.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.965+0000 7f37d3922800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:18:03.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.965+0000 7f37d3922800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:18:03.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.965+0000 7f37d3922800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:18:03.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.965+0000 7f37d3922800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:18:03.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.965+0000 7f37d3922800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.965+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55dd02373c30 con 0x55dd0236bd70 2024-09-13T19:18:03.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.965+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37b802b040 con 0x55dd0236bd70 2024-09-13T19:18:03.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.965+0000 7f37d3922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:03.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.965+0000 7f37d3922800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.965+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55dd023744d0 con 0x55dd0236bd70 2024-09-13T19:18:03.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.966+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f37b802b040 con 0x55dd0236bd70 2024-09-13T19:18:03.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.966+0000 7f37d3922800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:18:03.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.966+0000 7f37d3922800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.966+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55dd02375010 con 0x55dd02370760 2024-09-13T19:18:03.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.966+0000 7f37cfe17640 1 -- 172.21.15.102:0/751841863 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f37c8027020 con 0x55dd02370760 2024-09-13T19:18:03.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.966+0000 7f37d3922800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:18:03.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.966+0000 7f37d3922800 20 zone default found 2024-09-13T19:18:03.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.966+0000 7f37d3922800 4 Realm: () 2024-09-13T19:18:03.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.966+0000 7f37d3922800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:18:03.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.966+0000 7f37d3922800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:18:03.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.966+0000 7f37d3922800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:18:03.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.966+0000 7f37d3922800 20 zonegroup default 2024-09-13T19:18:03.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.966+0000 7f37d3922800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.966+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55dd02375860 con 0x7f37c8013070 2024-09-13T19:18:03.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.966+0000 7f37cf616640 1 -- 172.21.15.102:0/751841863 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f37c007f070 con 0x7f37c8013070 2024-09-13T19:18:03.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.966+0000 7f37d3922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:03.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.966+0000 7f37d3922800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.966+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55dd023775e0 con 0x55dd02370760 2024-09-13T19:18:03.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.966+0000 7f37cfe17640 1 -- 172.21.15.102:0/751841863 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f37c8027020 con 0x55dd02370760 2024-09-13T19:18:03.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.967+0000 7f37d3922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:03.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.967+0000 7f37d3922800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.967+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55dd02377a70 con 0x55dd02370760 2024-09-13T19:18:03.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.967+0000 7f37cfe17640 1 -- 172.21.15.102:0/751841863 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f37c8027020 con 0x55dd02370760 2024-09-13T19:18:03.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.967+0000 7f37d3922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:03.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.967+0000 7f37d3922800 20 started sync module instance, tier type = 2024-09-13T19:18:03.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.967+0000 7f37d3922800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:18:03.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.967+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dd02376a80 con 0x7f37c8013070 2024-09-13T19:18:03.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.968+0000 7f37cf616640 1 -- 172.21.15.102:0/751841863 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(44 notify.0 [create] v36'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c007f070 con 0x7f37c8013070 2024-09-13T19:18:03.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.968+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94407713320608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dd02378350 con 0x7f37c8013070 2024-09-13T19:18:03.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.968+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dd02378ba0 con 0x55dd0236bd70 2024-09-13T19:18:03.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.969+0000 7f37cf616640 1 -- 172.21.15.102:0/751841863 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94407713320608] v36'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c007f070 con 0x7f37c8013070 2024-09-13T19:18:03.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.969+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v36'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b802b040 con 0x55dd0236bd70 2024-09-13T19:18:03.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.969+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94407713326832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dd02378f80 con 0x55dd0236bd70 2024-09-13T19:18:03.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.969+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dd02379a70 con 0x55dd02370760 2024-09-13T19:18:03.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.970+0000 7f37cfe17640 1 -- 172.21.15.102:0/751841863 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v36'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c8027020 con 0x55dd02370760 2024-09-13T19:18:03.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.970+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94407713330496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dd02379a30 con 0x55dd02370760 2024-09-13T19:18:03.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.970+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dd0237aa50 con 0x7f37c8013070 2024-09-13T19:18:03.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.970+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94407713326832] v36'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b802b040 con 0x55dd0236bd70 2024-09-13T19:18:03.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.971+0000 7f37cfe17640 1 -- 172.21.15.102:0/751841863 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94407713330496] v36'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c8027020 con 0x55dd02370760 2024-09-13T19:18:03.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.971+0000 7f37cf616640 1 -- 172.21.15.102:0/751841863 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(50 notify.3 [create] v36'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c007f070 con 0x7f37c8013070 2024-09-13T19:18:03.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.971+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94407713332832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dd0237aa50 con 0x7f37c8013070 2024-09-13T19:18:03.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.972+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dd0237b2f0 con 0x55dd0236bd70 2024-09-13T19:18:03.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.973+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v36'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b802b040 con 0x55dd0236bd70 2024-09-13T19:18:03.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.973+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94407713336896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dd0237b710 con 0x55dd0236bd70 2024-09-13T19:18:03.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.973+0000 7f37cf616640 1 -- 172.21.15.102:0/751841863 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94407713332832] v36'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c007f070 con 0x7f37c8013070 2024-09-13T19:18:03.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.973+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dd0237a560 con 0x7f37c00a7040 2024-09-13T19:18:03.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.974+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(54 notify.5 [create] v36'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b802b040 con 0x7f37c00a7040 2024-09-13T19:18:03.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.974+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94407713339152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dd0237bfe0 con 0x7f37c00a7040 2024-09-13T19:18:03.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.974+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dd0237c9e0 con 0x7f37c00a7040 2024-09-13T19:18:03.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.974+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94407713336896] v36'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b802b040 con 0x55dd0236bd70 2024-09-13T19:18:03.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.975+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94407713339152] v36'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b802b040 con 0x7f37c00a7040 2024-09-13T19:18:03.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.975+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(56 notify.6 [create] v36'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b802b040 con 0x7f37c00a7040 2024-09-13T19:18:03.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.975+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94407713337952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dd0237bb30 con 0x7f37c00a7040 2024-09-13T19:18:03.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.975+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dd0237d070 con 0x7f37c00a7040 2024-09-13T19:18:03.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.976+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94407713337952] v36'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b802b040 con 0x7f37c00a7040 2024-09-13T19:18:03.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.976+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(58 notify.7 [create] v36'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b802b040 con 0x7f37c00a7040 2024-09-13T19:18:03.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.976+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94407713342704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dd0237d070 con 0x7f37c00a7040 2024-09-13T19:18:03.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.976+0000 7f37d3922800 20 add_watcher() i=0 2024-09-13T19:18:03.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.976+0000 7f37d3922800 20 add_watcher() i=1 2024-09-13T19:18:03.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.976+0000 7f37d3922800 20 add_watcher() i=2 2024-09-13T19:18:03.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.976+0000 7f37d3922800 20 add_watcher() i=3 2024-09-13T19:18:03.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.976+0000 7f37d3922800 20 add_watcher() i=4 2024-09-13T19:18:03.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.976+0000 7f37d3922800 20 add_watcher() i=5 2024-09-13T19:18:03.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.976+0000 7f37d3922800 20 add_watcher() i=6 2024-09-13T19:18:03.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.977+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94407713342704] v36'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b802b040 con 0x7f37c00a7040 2024-09-13T19:18:03.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.977+0000 7f37d3922800 20 add_watcher() i=7 2024-09-13T19:18:03.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.977+0000 7f37d3922800 2 all 8 watchers are set, enabling cache 2024-09-13T19:18:03.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.977+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55dd02380200 con 0x55dd0236bd70 2024-09-13T19:18:03.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.977+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f37b802b040 con 0x55dd0236bd70 2024-09-13T19:18:03.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.977+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94407713344448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dd0237d490 con 0x55dd0236bd70 2024-09-13T19:18:03.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.978+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94407713344448] v36'265 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f37b802b040 con 0x55dd0236bd70 2024-09-13T19:18:03.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.979+0000 7f3685fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:18:03.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.979+0000 7f37d3922800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:18:03.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.979+0000 7f37d3922800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:18:03.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.979+0000 7f37d3922800 5 note: GC not initialized 2024-09-13T19:18:03.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.979+0000 7f3684fe1640 20 reqs_thread_entry: start 2024-09-13T19:18:03.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.979+0000 7f37d3922800 20 init_complete bucket index max shards: 11 2024-09-13T19:18:03.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.979+0000 7f37d3922800 20 Filter name: none 2024-09-13T19:18:03.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.979+0000 7f35fe7fc640 20 reqs_thread_entry: start 2024-09-13T19:18:03.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.979+0000 7f37d3922800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T19:18:03.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.979+0000 7f37d3922800 20 rados->read ofs=0 len=0 2024-09-13T19:18:03.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.979+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55dd023b36c0 con 0x7f37c00a7040 2024-09-13T19:18:03.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.980+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f37b802b040 con 0x7f37c00a7040 2024-09-13T19:18:03.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.980+0000 7f37d3922800 20 rados_obj.operate() r=0 bl.length=460 2024-09-13T19:18:03.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.980+0000 7f37d3922800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T19:18:03.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.980+0000 7f37d3922800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:18:03.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.980+0000 7f37d3922800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:18:03.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.980+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dd023b9d80 con 0x7f37c00a7040 2024-09-13T19:18:03.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.982+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v36'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f37b802b040 con 0x7f37c00a7040 2024-09-13T19:18:03.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.982+0000 7f37d3922800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:18:03.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.982+0000 7f37d3922800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:18:03.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.982+0000 7f37d3922800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T19:18:03.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.982+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94407713593152 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55dd023b53e0 con 0x55dd0236bd70 2024-09-13T19:18:03.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.983+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== watch-notify(notify (1) cookie 94407713336896 notify 154618822700 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7f37b8018040 con 0x55dd0236bd70 2024-09-13T19:18:03.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.983+0000 7f36b2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822700 cookie 94407713336896 notifier 4909 bl.length()=666 2024-09-13T19:18:03.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.983+0000 7f36b2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:18:03.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.983+0000 7f36b2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:18:03.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.983+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(64 notify.4 [notify cookie 94407713593152 out=8b] v0'0 uv270 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f37b802b040 con 0x55dd0236bd70 2024-09-13T19:18:03.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.983+0000 7f36b2ffd640 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f3694003ea0 con 0x55dd0236bd70 2024-09-13T19:18:03.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.983+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b802b040 con 0x55dd0236bd70 2024-09-13T19:18:03.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.983+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== watch-notify(notify_complete (2) cookie 94407713593152 notify 154618822700 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f37b8009050 con 0x55dd0236bd70 2024-09-13T19:18:03.995 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T19:18:02.251000Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"write"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:18:02.250985Z","tags":[],"group_ids":[]} 2024-09-13T19:18:04.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.984+0000 7f3685fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:18:04.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.984+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94407713344448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dd023b1440 con 0x55dd0236bd70 2024-09-13T19:18:04.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.985+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94407713344448] v36'266 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f37b802b040 con 0x55dd0236bd70 2024-09-13T19:18:04.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.985+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94407713320608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dd023b1440 con 0x7f37c8013070 2024-09-13T19:18:04.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.986+0000 7f37cf616640 1 -- 172.21.15.102:0/751841863 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94407713320608] v36'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c007f070 con 0x7f37c8013070 2024-09-13T19:18:04.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.986+0000 7f37d3922800 20 remove_watcher() i=0 2024-09-13T19:18:04.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.986+0000 7f37d3922800 2 removed watcher, disabling cache 2024-09-13T19:18:04.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.986+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94407713326832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dd023b1440 con 0x55dd0236bd70 2024-09-13T19:18:04.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.987+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94407713326832] v36'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b802b040 con 0x55dd0236bd70 2024-09-13T19:18:04.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.987+0000 7f37d3922800 20 remove_watcher() i=1 2024-09-13T19:18:04.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.987+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94407713330496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dd023b1440 con 0x55dd02370760 2024-09-13T19:18:04.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.988+0000 7f37cfe17640 1 -- 172.21.15.102:0/751841863 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94407713330496] v36'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c8027020 con 0x55dd02370760 2024-09-13T19:18:04.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.988+0000 7f37d3922800 20 remove_watcher() i=2 2024-09-13T19:18:04.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.988+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94407713332832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dd023b1440 con 0x7f37c8013070 2024-09-13T19:18:04.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.989+0000 7f37cf616640 1 -- 172.21.15.102:0/751841863 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94407713332832] v36'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c007f070 con 0x7f37c8013070 2024-09-13T19:18:04.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.989+0000 7f37d3922800 20 remove_watcher() i=3 2024-09-13T19:18:04.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.989+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94407713336896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dd023b1440 con 0x55dd0236bd70 2024-09-13T19:18:04.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.990+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94407713336896] v36'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b802b040 con 0x55dd0236bd70 2024-09-13T19:18:04.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.990+0000 7f37d3922800 20 remove_watcher() i=4 2024-09-13T19:18:04.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.990+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94407713339152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dd023b1440 con 0x7f37c00a7040 2024-09-13T19:18:04.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.991+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94407713339152] v36'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b802b040 con 0x7f37c00a7040 2024-09-13T19:18:04.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.991+0000 7f37d3922800 20 remove_watcher() i=5 2024-09-13T19:18:04.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.991+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94407713337952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dd023b1440 con 0x7f37c00a7040 2024-09-13T19:18:04.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.992+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94407713337952] v36'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b802b040 con 0x7f37c00a7040 2024-09-13T19:18:04.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.992+0000 7f37d3922800 20 remove_watcher() i=6 2024-09-13T19:18:04.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.992+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94407713342704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55dd023b1440 con 0x7f37c00a7040 2024-09-13T19:18:04.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.993+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94407713342704] v36'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37b802b040 con 0x7f37c00a7040 2024-09-13T19:18:04.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.993+0000 7f37d3922800 20 remove_watcher() i=7 2024-09-13T19:18:04.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.993+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f37c00a7040 msgr2=0x7f37c008f640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.993+0000 7f37d3922800 1 --2- 172.21.15.102:0/751841863 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f37c00a7040 0x7f37c008f640 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.993+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55dd0236bd70 msgr2=0x55dd0236e230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.993+0000 7f37d3922800 1 --2- 172.21.15.102:0/751841863 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55dd0236bd70 0x55dd0236e230 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.993+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f37c8013070 msgr2=0x7f37c803c520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.993+0000 7f37d3922800 1 --2- 172.21.15.102:0/751841863 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f37c8013070 0x7f37c803c520 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.993+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55dd02370760 msgr2=0x55dd02372b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.993+0000 7f37d3922800 1 --2- 172.21.15.102:0/751841863 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55dd02370760 0x55dd02372b50 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.994+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3698036b40 msgr2=0x7f3698039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.994+0000 7f37d3922800 1 --2- 172.21.15.102:0/751841863 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f3698036b40 0x7f3698039000 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f37c005ab80 tx=0x7f37c0087000 comp rx=0 tx=0).stop 2024-09-13T19:18:04.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.994+0000 7f37c7fff640 1 -- 172.21.15.102:0/751841863 reap_dead start 2024-09-13T19:18:04.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.994+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd02358de0 msgr2=0x55dd02360240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.994+0000 7f37d3922800 1 --2- 172.21.15.102:0/751841863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd02358de0 0x55dd02360240 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x55dd02353db0 tx=0x7f37c804cd80 comp rx=0 tx=0).stop 2024-09-13T19:18:04.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.994+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 shutdown_connections 2024-09-13T19:18:04.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.994+0000 7f37d3922800 1 --2- 172.21.15.102:0/751841863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd02358de0 0x55dd02360240 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.994+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 >> 172.21.15.102:0/751841863 conn(0x55dd02355140 msgr2=0x55dd02353210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:04.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.994+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 shutdown_connections 2024-09-13T19:18:04.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.994+0000 7f37d3922800 1 -- 172.21.15.102:0/751841863 wait complete. 2024-09-13T19:18:04.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.994+0000 7f37d3922800 1 -- 172.21.15.102:0/3326897262 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f36a8036b40 msgr2=0x7f36a8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.994+0000 7f37d3922800 1 --2- 172.21.15.102:0/3326897262 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f36a8036b40 0x7f36a8039000 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x55dd02337030 tx=0x7f37c008f220 comp rx=0 tx=0).stop 2024-09-13T19:18:04.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.994+0000 7f37d3922800 1 -- 172.21.15.102:0/3326897262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd021ae760 msgr2=0x55dd021acdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.994+0000 7f37d3922800 1 --2- 172.21.15.102:0/3326897262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd021ae760 0x55dd021acdb0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x55dd02336b30 tx=0x7f37c80163e0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.994+0000 7f37d3922800 1 -- 172.21.15.102:0/3326897262 shutdown_connections 2024-09-13T19:18:04.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.994+0000 7f37d3922800 1 --2- 172.21.15.102:0/3326897262 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f36a8036b40 0x7f36a8039000 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.994+0000 7f37d3922800 1 --2- 172.21.15.102:0/3326897262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd021ae760 0x55dd021acdb0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.994+0000 7f37d3922800 1 -- 172.21.15.102:0/3326897262 >> 172.21.15.102:0/3326897262 conn(0x55dd0233ee80 msgr2=0x55dd02341a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:04.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.994+0000 7f37d3922800 1 -- 172.21.15.102:0/3326897262 shutdown_connections 2024-09-13T19:18:04.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.994+0000 7f37d3922800 1 -- 172.21.15.102:0/3326897262 wait complete. 2024-09-13T19:18:04.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.994+0000 7f37d3922800 1 -- 172.21.15.102:0/2473404677 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55dd02239050 msgr2=0x55dd023361d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.994+0000 7f37d3922800 1 --2- 172.21.15.102:0/2473404677 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55dd02239050 0x55dd023361d0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.994+0000 7f37d3922800 1 -- 172.21.15.102:0/2473404677 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55dd02338a80 msgr2=0x55dd0233ae70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.994+0000 7f37d3922800 1 --2- 172.21.15.102:0/2473404677 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55dd02338a80 0x55dd0233ae70 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.995+0000 7f37d3922800 1 -- 172.21.15.102:0/2473404677 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f36b4036b40 msgr2=0x7f36b4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.995+0000 7f37d3922800 1 --2- 172.21.15.102:0/2473404677 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f36b4036b40 0x7f36b4039000 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f37b8000f60 tx=0x7f37b8001370 comp rx=0 tx=0).stop 2024-09-13T19:18:04.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.995+0000 7f37d3922800 1 -- 172.21.15.102:0/2473404677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd02238710 msgr2=0x55dd0232f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.995+0000 7f37d3922800 1 --2- 172.21.15.102:0/2473404677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd02238710 0x55dd0232f160 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f37c0067040 tx=0x7f37c0002fb0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.995+0000 7f37d3922800 1 -- 172.21.15.102:0/2473404677 shutdown_connections 2024-09-13T19:18:04.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.995+0000 7f37d3922800 1 --2- 172.21.15.102:0/2473404677 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55dd02338a80 0x55dd0233ae70 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.995+0000 7f37d3922800 1 --2- 172.21.15.102:0/2473404677 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55dd02239050 0x55dd023361d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.995+0000 7f37d3922800 1 --2- 172.21.15.102:0/2473404677 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f36b4036b40 0x7f36b4039000 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.995+0000 7f37d3922800 1 --2- 172.21.15.102:0/2473404677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd02238710 0x55dd0232f160 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.995+0000 7f37d3922800 1 -- 172.21.15.102:0/2473404677 >> 172.21.15.102:0/2473404677 conn(0x55dd02233fe0 msgr2=0x55dd02321b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:04.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.995+0000 7f37d3922800 1 -- 172.21.15.102:0/2473404677 shutdown_connections 2024-09-13T19:18:04.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:03.995+0000 7f37d3922800 1 -- 172.21.15.102:0/2473404677 wait complete. 2024-09-13T19:18:04.007 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:18:02.251000Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:18:02.250985Z', 'tags': [], 'group_ids': []} 2024-09-13T19:18:04.007 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:18:02.251000Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:18:02.250985Z', 'tags': [], 'group_ids': []} 2024-09-13T19:18:04.007 ERROR:root:0 2024-09-13T19:18:04.007 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:18:04.019 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'AccessDenied', 'Message': '', 'RequestId': 'tx000007c9f41c384b1d515-0066e48fec-4237-default', 'HostId': '4237-default-default'} 2024-09-13T19:18:04.020 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-13T19:18:04.020 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-13T19:18:04.020 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps user-info-without-keys=write 2024-09-13T19:18:04.066 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:18:04.067 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:18:04.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.064+0000 7f31f860e800 1 Processor -- start 2024-09-13T19:18:04.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.064+0000 7f31f860e800 1 -- start start 2024-09-13T19:18:04.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.064+0000 7f31f860e800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x560e36877d40 0x560e3687a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:04.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.064+0000 7f31f860e800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560e36730b30 con 0x560e367e5610 2024-09-13T19:18:04.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.064+0000 7f31f860e800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x560e36712360 con 0x560e36877d40 2024-09-13T19:18:04.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.065+0000 7f31f34c0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x560e36877d40 0x560e3687a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:04.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.065+0000 7f31f34c0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x560e36877d40 0x560e3687a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:50152/0 (socket says 172.21.15.102:50152) 2024-09-13T19:18:04.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.065+0000 7f31f34c0640 1 -- 172.21.15.102:0/1837551858 learned_addr learned my addr 172.21.15.102:0/1837551858 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:04.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.065+0000 7f31f3cc1640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x560e367e5610 0x560e36876620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:53802/0 (socket says 172.21.15.102:53802) 2024-09-13T19:18:04.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.065+0000 7f31f34c0640 1 -- 172.21.15.102:0/1837551858 >> v1:172.21.15.53:6789/0 conn(0x560e367e5610 legacy=0x560e36876620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.065+0000 7f31f34c0640 1 -- 172.21.15.102:0/1837551858 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e36738e00 con 0x560e36877d40 2024-09-13T19:18:04.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.067+0000 7f31f34c0640 1 --2- 172.21.15.102:0/1837551858 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e36877d40 0x560e3687a130 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f31e800a520 tx=0x7f31e8045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1328d4116e7dabd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:04.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.067+0000 7f31f2cbf640 1 -- 172.21.15.102:0/1837551858 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31e8055070 con 0x560e36877d40 2024-09-13T19:18:04.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.067+0000 7f31f2cbf640 1 -- 172.21.15.102:0/1837551858 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31e80515b0 con 0x560e36877d40 2024-09-13T19:18:04.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.067+0000 7f31f2cbf640 1 -- 172.21.15.102:0/1837551858 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31e80518d0 con 0x560e36877d40 2024-09-13T19:18:04.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.067+0000 7f31f860e800 1 -- 172.21.15.102:0/1837551858 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e36877d40 msgr2=0x560e3687a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.067+0000 7f31f860e800 1 --2- 172.21.15.102:0/1837551858 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e36877d40 0x560e3687a130 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f31e800a520 tx=0x7f31e8045ba0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.067+0000 7f31f860e800 1 -- 172.21.15.102:0/1837551858 shutdown_connections 2024-09-13T19:18:04.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.067+0000 7f31f860e800 1 --2- 172.21.15.102:0/1837551858 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e36877d40 0x560e3687a130 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.067+0000 7f31f860e800 1 -- 172.21.15.102:0/1837551858 >> 172.21.15.102:0/1837551858 conn(0x560e3686bdb0 msgr2=0x560e3686e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:04.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.067+0000 7f31f860e800 1 -- 172.21.15.102:0/1837551858 shutdown_connections 2024-09-13T19:18:04.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.067+0000 7f31f860e800 1 -- 172.21.15.102:0/1837551858 wait complete. 2024-09-13T19:18:04.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.081+0000 7f31f860e800 1 Processor -- start 2024-09-13T19:18:04.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.081+0000 7f31f860e800 1 -- start start 2024-09-13T19:18:04.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.082+0000 7f31f860e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e367e5610 0x560e36962ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:04.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.082+0000 7f31f860e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560e367bd360 con 0x560e367e5610 2024-09-13T19:18:04.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.082+0000 7f31f3cc1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e367e5610 0x560e36962ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:04.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.082+0000 7f31f3cc1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e367e5610 0x560e36962ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:50156/0 (socket says 172.21.15.102:50156) 2024-09-13T19:18:04.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.082+0000 7f31f3cc1640 1 -- 172.21.15.102:0/816241604 learned_addr learned my addr 172.21.15.102:0/816241604 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:04.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.082+0000 7f31f3cc1640 1 -- 172.21.15.102:0/816241604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e3670abc0 con 0x560e367e5610 2024-09-13T19:18:04.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.082+0000 7f31f3cc1640 1 --2- 172.21.15.102:0/816241604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e367e5610 0x560e36962ae0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f31e4001650 tx=0x7f31e4001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c10a5f879be54a2b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:04.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.082+0000 7f30e1e0b640 1 -- 172.21.15.102:0/816241604 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31e4013420 con 0x560e367e5610 2024-09-13T19:18:04.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.083+0000 7f30e1e0b640 1 -- 172.21.15.102:0/816241604 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31e40135c0 con 0x560e367e5610 2024-09-13T19:18:04.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.083+0000 7f30e1e0b640 1 -- 172.21.15.102:0/816241604 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31e40138c0 con 0x560e367e5610 2024-09-13T19:18:04.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.083+0000 7f31f860e800 1 -- 172.21.15.102:0/816241604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e367e5610 msgr2=0x560e36962ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.083+0000 7f31f860e800 1 --2- 172.21.15.102:0/816241604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e367e5610 0x560e36962ae0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f31e4001650 tx=0x7f31e4001b10 comp rx=0 tx=0).stop 2024-09-13T19:18:04.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.083+0000 7f31f860e800 1 -- 172.21.15.102:0/816241604 shutdown_connections 2024-09-13T19:18:04.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.083+0000 7f31f860e800 1 --2- 172.21.15.102:0/816241604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e367e5610 0x560e36962ae0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.083+0000 7f31f860e800 1 -- 172.21.15.102:0/816241604 >> 172.21.15.102:0/816241604 conn(0x560e3686bdb0 msgr2=0x560e3695e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:04.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.084+0000 7f31f860e800 1 -- 172.21.15.102:0/816241604 shutdown_connections 2024-09-13T19:18:04.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.084+0000 7f31f860e800 1 -- 172.21.15.102:0/816241604 wait complete. 2024-09-13T19:18:04.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.084+0000 7f31f860e800 1 Processor -- start 2024-09-13T19:18:04.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.084+0000 7f31f860e800 1 -- start start 2024-09-13T19:18:04.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.084+0000 7f31f860e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e367e5610 0x560e3696a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:04.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.084+0000 7f31f860e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560e3687a910 con 0x560e367e5610 2024-09-13T19:18:04.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.084+0000 7f31f3cc1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e367e5610 0x560e3696a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:04.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.084+0000 7f31f3cc1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e367e5610 0x560e3696a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:50166/0 (socket says 172.21.15.102:50166) 2024-09-13T19:18:04.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.084+0000 7f31f3cc1640 1 -- 172.21.15.102:0/813816475 learned_addr learned my addr 172.21.15.102:0/813816475 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:04.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.084+0000 7f31f3cc1640 1 -- 172.21.15.102:0/813816475 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e3671efe0 con 0x560e367e5610 2024-09-13T19:18:04.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.085+0000 7f31f3cc1640 1 --2- 172.21.15.102:0/813816475 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e367e5610 0x560e3696a4f0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x560e36963940 tx=0x7f31e4001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:04.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.085+0000 7f30dbfff640 1 -- 172.21.15.102:0/813816475 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31e4022020 con 0x560e367e5610 2024-09-13T19:18:04.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.085+0000 7f30dbfff640 1 -- 172.21.15.102:0/813816475 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31e4006830 con 0x560e367e5610 2024-09-13T19:18:04.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.085+0000 7f31f860e800 1 -- 172.21.15.102:0/813816475 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560e3696aa30 con 0x560e367e5610 2024-09-13T19:18:04.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.085+0000 7f30dbfff640 1 -- 172.21.15.102:0/813816475 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31e4004b30 con 0x560e367e5610 2024-09-13T19:18:04.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.085+0000 7f31f860e800 1 -- 172.21.15.102:0/813816475 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e3696af50 con 0x560e367e5610 2024-09-13T19:18:04.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.086+0000 7f30dbfff640 1 -- 172.21.15.102:0/813816475 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f31e4025020 con 0x560e367e5610 2024-09-13T19:18:04.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.086+0000 7f30dbfff640 1 --2- 172.21.15.102:0/813816475 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f30dc036b40 0x7f30dc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:04.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.086+0000 7f30dbfff640 1 -- 172.21.15.102:0/813816475 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f31e4018030 con 0x560e367e5610 2024-09-13T19:18:04.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.086+0000 7f31f34c0640 1 --2- 172.21.15.102:0/813816475 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f30dc036b40 0x7f30dc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:04.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.086+0000 7f31f860e800 1 --2- 172.21.15.102:0/813816475 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x560e36877d40 0x560e36971560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:04.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.086+0000 7f31f860e800 1 -- 172.21.15.102:0/813816475 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560e36971ae0 con 0x560e36877d40 2024-09-13T19:18:04.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.086+0000 7f31f44c2640 1 --2- 172.21.15.102:0/813816475 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x560e36877d40 0x560e36971560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:04.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.086+0000 7f31f34c0640 1 --2- 172.21.15.102:0/813816475 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f30dc036b40 0x7f30dc039000 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f31e8057000 tx=0x7f31e8052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:04.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.086+0000 7f31f44c2640 1 --2- 172.21.15.102:0/813816475 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x560e36877d40 0x560e36971560 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:04.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.087+0000 7f31f44c2640 1 -- 172.21.15.102:0/813816475 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f31ec0083e0 con 0x560e36877d40 2024-09-13T19:18:04.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.087+0000 7f31f860e800 1 -- 172.21.15.102:0/813816475 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560e3696eb10 con 0x560e36877d40 2024-09-13T19:18:04.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.087+0000 7f31f44c2640 1 -- 172.21.15.102:0/813816475 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f31ec0083e0 con 0x560e36877d40 2024-09-13T19:18:04.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.087+0000 7f31f860e800 1 --2- 172.21.15.102:0/813816475 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x560e36973df0 0x560e369761e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:04.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.087+0000 7f31f860e800 1 -- 172.21.15.102:0/813816475 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560e369768d0 con 0x560e36973df0 2024-09-13T19:18:04.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.087+0000 7f31f3cc1640 1 --2- 172.21.15.102:0/813816475 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x560e36973df0 0x560e369761e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:04.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.088+0000 7f31f3cc1640 1 --2- 172.21.15.102:0/813816475 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x560e36973df0 0x560e369761e0 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:04.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.088+0000 7f31f3cc1640 1 -- 172.21.15.102:0/813816475 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f31e401b070 con 0x560e36973df0 2024-09-13T19:18:04.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.088+0000 7f31f860e800 1 -- 172.21.15.102:0/813816475 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560e36972c90 con 0x560e36877d40 2024-09-13T19:18:04.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.088+0000 7f31f44c2640 1 -- 172.21.15.102:0/813816475 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f31ec0083e0 con 0x560e36877d40 2024-09-13T19:18:04.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.088+0000 7f31f860e800 1 -- 172.21.15.102:0/813816475 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560e36973130 con 0x560e36973df0 2024-09-13T19:18:04.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.088+0000 7f31f3cc1640 1 -- 172.21.15.102:0/813816475 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f31e401b070 con 0x560e36973df0 2024-09-13T19:18:04.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.089+0000 7f31f860e800 1 Processor -- start 2024-09-13T19:18:04.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.089+0000 7f31f860e800 1 -- start start 2024-09-13T19:18:04.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.089+0000 7f31f860e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e36985210 0x560e36985630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:04.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.089+0000 7f31f860e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560e3670c580 con 0x560e36985210 2024-09-13T19:18:04.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.089+0000 7f31f44c2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e36985210 0x560e36985630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:04.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.089+0000 7f31f44c2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e36985210 0x560e36985630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:50170/0 (socket says 172.21.15.102:50170) 2024-09-13T19:18:04.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.089+0000 7f31f44c2640 1 -- 172.21.15.102:0/1048707888 learned_addr learned my addr 172.21.15.102:0/1048707888 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:04.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.090+0000 7f31f44c2640 1 -- 172.21.15.102:0/1048707888 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e36985b70 con 0x560e36985210 2024-09-13T19:18:04.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.090+0000 7f31f44c2640 1 --2- 172.21.15.102:0/1048707888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e36985210 0x560e36985630 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x560e3696b5a0 tx=0x7f31ec00beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:04.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.090+0000 7f30d97fa640 1 -- 172.21.15.102:0/1048707888 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31ec01c020 con 0x560e36985210 2024-09-13T19:18:04.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.090+0000 7f30d97fa640 1 -- 172.21.15.102:0/1048707888 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31ec007cf0 con 0x560e36985210 2024-09-13T19:18:04.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.090+0000 7f30d97fa640 1 -- 172.21.15.102:0/1048707888 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31ec018440 con 0x560e36985210 2024-09-13T19:18:04.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.090+0000 7f31f860e800 1 -- 172.21.15.102:0/1048707888 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560e36985e00 con 0x560e36985210 2024-09-13T19:18:04.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.090+0000 7f31f860e800 1 -- 172.21.15.102:0/1048707888 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e36988ae0 con 0x560e36985210 2024-09-13T19:18:04.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.091+0000 7f30d97fa640 1 -- 172.21.15.102:0/1048707888 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f31ec01f020 con 0x560e36985210 2024-09-13T19:18:04.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.091+0000 7f30d97fa640 1 --2- 172.21.15.102:0/1048707888 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f30cc036c00 0x7f30cc0390c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:04.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.091+0000 7f30d97fa640 1 -- 172.21.15.102:0/1048707888 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f31ec04e330 con 0x560e36985210 2024-09-13T19:18:04.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.091+0000 7f31f3cc1640 1 --2- 172.21.15.102:0/1048707888 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f30cc036c00 0x7f30cc0390c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:04.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.091+0000 7f31f860e800 1 Processor -- start 2024-09-13T19:18:04.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.091+0000 7f31f860e800 1 -- start start 2024-09-13T19:18:04.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.091+0000 7f31f3cc1640 1 --2- 172.21.15.102:0/1048707888 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f30cc036c00 0x7f30cc0390c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f31e404b030 tx=0x7f31e4012f90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:04.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.091+0000 7f31f860e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e36991ee0 0x560e369922e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:04.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.091+0000 7f31f860e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560e36963290 con 0x560e36991ee0 2024-09-13T19:18:04.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.092+0000 7f31f44c2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e36991ee0 0x560e369922e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:04.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.092+0000 7f31f44c2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e36991ee0 0x560e369922e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:50180/0 (socket says 172.21.15.102:50180) 2024-09-13T19:18:04.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.092+0000 7f31f44c2640 1 -- 172.21.15.102:0/3817890128 learned_addr learned my addr 172.21.15.102:0/3817890128 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:04.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.092+0000 7f31f44c2640 1 -- 172.21.15.102:0/3817890128 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e369928b0 con 0x560e36991ee0 2024-09-13T19:18:04.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.092+0000 7f31f44c2640 1 --2- 172.21.15.102:0/3817890128 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e36991ee0 0x560e369922e0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f31ec04c5f0 tx=0x7f31ec04c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a38996a2addd6769 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:04.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.092+0000 7f30d2ffd640 1 -- 172.21.15.102:0/3817890128 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31ec045070 con 0x560e36991ee0 2024-09-13T19:18:04.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.092+0000 7f30d2ffd640 1 -- 172.21.15.102:0/3817890128 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31ec0187c0 con 0x560e36991ee0 2024-09-13T19:18:04.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.092+0000 7f30d2ffd640 1 -- 172.21.15.102:0/3817890128 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31ec021550 con 0x560e36991ee0 2024-09-13T19:18:04.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.093+0000 7f31f860e800 1 -- 172.21.15.102:0/3817890128 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e36991ee0 msgr2=0x560e369922e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.093+0000 7f31f860e800 1 --2- 172.21.15.102:0/3817890128 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e36991ee0 0x560e369922e0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f31ec04c5f0 tx=0x7f31ec04c8a0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.093+0000 7f31f860e800 1 -- 172.21.15.102:0/3817890128 shutdown_connections 2024-09-13T19:18:04.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.093+0000 7f31f860e800 1 --2- 172.21.15.102:0/3817890128 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e36991ee0 0x560e369922e0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.093+0000 7f31f860e800 1 -- 172.21.15.102:0/3817890128 >> 172.21.15.102:0/3817890128 conn(0x560e3698e240 msgr2=0x560e3698c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:04.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.093+0000 7f31f860e800 1 -- 172.21.15.102:0/3817890128 shutdown_connections 2024-09-13T19:18:04.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.093+0000 7f31f860e800 1 -- 172.21.15.102:0/3817890128 wait complete. 2024-09-13T19:18:04.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.093+0000 7f31f860e800 1 Processor -- start 2024-09-13T19:18:04.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.093+0000 7f31f860e800 1 -- start start 2024-09-13T19:18:04.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.093+0000 7f31f860e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e36991ee0 0x560e36999390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:04.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.093+0000 7f31f860e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560e36992f20 con 0x560e36991ee0 2024-09-13T19:18:04.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.093+0000 7f31f44c2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e36991ee0 0x560e36999390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:04.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.093+0000 7f31f44c2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e36991ee0 0x560e36999390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:50184/0 (socket says 172.21.15.102:50184) 2024-09-13T19:18:04.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.093+0000 7f31f44c2640 1 -- 172.21.15.102:0/1373211482 learned_addr learned my addr 172.21.15.102:0/1373211482 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:04.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.094+0000 7f31f44c2640 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e369998d0 con 0x560e36991ee0 2024-09-13T19:18:04.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.094+0000 7f31f44c2640 1 --2- 172.21.15.102:0/1373211482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e36991ee0 0x560e36999390 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f31ec016680 tx=0x7f31ec04c580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:04.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.094+0000 7f30d17fa640 1 -- 172.21.15.102:0/1373211482 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31ec03f030 con 0x560e36991ee0 2024-09-13T19:18:04.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.094+0000 7f30d17fa640 1 -- 172.21.15.102:0/1373211482 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31ec04b210 con 0x560e36991ee0 2024-09-13T19:18:04.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.094+0000 7f30d17fa640 1 -- 172.21.15.102:0/1373211482 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31ec045040 con 0x560e36991ee0 2024-09-13T19:18:04.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.094+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560e36999b60 con 0x560e36991ee0 2024-09-13T19:18:04.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.094+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e3699c810 con 0x560e36991ee0 2024-09-13T19:18:04.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.095+0000 7f30d17fa640 1 -- 172.21.15.102:0/1373211482 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f31ec016040 con 0x560e36991ee0 2024-09-13T19:18:04.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.095+0000 7f30d17fa640 1 --2- 172.21.15.102:0/1373211482 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f30bc036b90 0x7f30bc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:04.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.095+0000 7f30d17fa640 1 -- 172.21.15.102:0/1373211482 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f31ec031030 con 0x560e36991ee0 2024-09-13T19:18:04.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.095+0000 7f31f3cc1640 1 --2- 172.21.15.102:0/1373211482 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f30bc036b90 0x7f30bc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:04.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.095+0000 7f31f3cc1640 1 --2- 172.21.15.102:0/1373211482 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f30bc036b90 0x7f30bc039050 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f31e401ea80 tx=0x7f31e4034040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:04.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.096+0000 7f31f860e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:04.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.096+0000 7f31f860e800 1 --2- 172.21.15.102:0/1373211482 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x560e369a4e20 0x560e369a72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:04.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.096+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560e369a7a30 con 0x560e369a4e20 2024-09-13T19:18:04.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.096+0000 7f31f34c0640 1 --2- 172.21.15.102:0/1373211482 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x560e369a4e20 0x560e369a72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:04.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.096+0000 7f31f34c0640 1 --2- 172.21.15.102:0/1373211482 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x560e369a4e20 0x560e369a72e0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:04.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.096+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f31e8057030 con 0x560e369a4e20 2024-09-13T19:18:04.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.096+0000 7f31f860e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:04.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.096+0000 7f31f860e800 20 realm 2024-09-13T19:18:04.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.096+0000 7f31f860e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:04.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.096+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560e369a7e60 con 0x560e369a4e20 2024-09-13T19:18:04.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.096+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f31e8057030 con 0x560e369a4e20 2024-09-13T19:18:04.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.096+0000 7f31f860e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:04.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.096+0000 7f31f860e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:18:04.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.096+0000 7f31f860e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:04.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.096+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560e369a8730 con 0x560e369a4e20 2024-09-13T19:18:04.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.097+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f31e8057030 con 0x560e369a4e20 2024-09-13T19:18:04.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.097+0000 7f31f860e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:04.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.097+0000 7f31f860e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:04.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.097+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560e369a8ad0 con 0x560e369a4e20 2024-09-13T19:18:04.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.097+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f31e8057030 con 0x560e369a4e20 2024-09-13T19:18:04.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.097+0000 7f31f860e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:18:04.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.097+0000 7f31f860e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:04.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.097+0000 7f31f860e800 1 --2- 172.21.15.102:0/1373211482 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x560e369a9830 0x560e369abc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:04.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.097+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560e369ac230 con 0x560e369a9830 2024-09-13T19:18:04.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.097+0000 7f31f44c2640 1 --2- 172.21.15.102:0/1373211482 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x560e369a9830 0x560e369abc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:04.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.097+0000 7f31f44c2640 1 --2- 172.21.15.102:0/1373211482 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x560e369a9830 0x560e369abc20 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:04.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.098+0000 7f31f44c2640 1 -- 172.21.15.102:0/1373211482 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f31ec028070 con 0x560e369a9830 2024-09-13T19:18:04.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.098+0000 7f31f860e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:18:04.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.098+0000 7f31f860e800 20 searching for the correct realm 2024-09-13T19:18:04.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.098+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560e369adb40 con 0x560e369a9830 2024-09-13T19:18:04.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.098+0000 7f31f44c2640 1 -- 172.21.15.102:0/1373211482 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31ec028070 con 0x560e369a9830 2024-09-13T19:18:04.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.098+0000 7f31f44c2640 1 --2- 172.21.15.102:0/1373211482 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f31ec05b040 0x7f31ec0478b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:04.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.098+0000 7f31f44c2640 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560e369adb40 con 0x7f31ec05b040 2024-09-13T19:18:04.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.098+0000 7f31f3cc1640 1 --2- 172.21.15.102:0/1373211482 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f31ec05b040 0x7f31ec0478b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:04.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.098+0000 7f31f3cc1640 1 --2- 172.21.15.102:0/1373211482 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f31ec05b040 0x7f31ec0478b0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:04.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.098+0000 7f31f3cc1640 1 -- 172.21.15.102:0/1373211482 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31e401b070 con 0x7f31ec05b040 2024-09-13T19:18:04.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.098+0000 7f31f3cc1640 1 --2- 172.21.15.102:0/1373211482 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f31e4027020 0x7f31e4026ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:04.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.099+0000 7f31f3cc1640 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560e369adb40 con 0x7f31e4027020 2024-09-13T19:18:04.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.099+0000 7f31f34c0640 1 --2- 172.21.15.102:0/1373211482 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f31e4027020 0x7f31e4026ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:04.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.099+0000 7f31f34c0640 1 --2- 172.21.15.102:0/1373211482 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f31e4027020 0x7f31e4026ae0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:04.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.100+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31e8057030 con 0x7f31e4027020 2024-09-13T19:18:04.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.100+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560e369adb40 con 0x560e369a4e20 2024-09-13T19:18:04.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.100+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31e8057030 con 0x560e369a4e20 2024-09-13T19:18:04.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.100+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560e369adb40 con 0x560e369a4e20 2024-09-13T19:18:04.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.100+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31e8057030 con 0x560e369a4e20 2024-09-13T19:18:04.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.100+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560e369adb40 con 0x7f31e4027020 2024-09-13T19:18:04.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.100+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31e8057030 con 0x7f31e4027020 2024-09-13T19:18:04.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.100+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560e369adb40 con 0x7f31e4027020 2024-09-13T19:18:04.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.101+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31e8057030 con 0x7f31e4027020 2024-09-13T19:18:04.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.101+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560e369adb40 con 0x7f31ec05b040 2024-09-13T19:18:04.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.101+0000 7f31f3cc1640 1 -- 172.21.15.102:0/1373211482 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31e401b070 con 0x7f31ec05b040 2024-09-13T19:18:04.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.101+0000 7f31f3cc1640 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560e369adb40 con 0x560e369a9830 2024-09-13T19:18:04.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.101+0000 7f31f44c2640 1 -- 172.21.15.102:0/1373211482 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31ec028070 con 0x560e369a9830 2024-09-13T19:18:04.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.101+0000 7f31f44c2640 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560e369adb40 con 0x560e369a4e20 2024-09-13T19:18:04.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.101+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31e8057030 con 0x560e369a4e20 2024-09-13T19:18:04.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.101+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560e369adb40 con 0x7f31ec05b040 2024-09-13T19:18:04.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.102+0000 7f31f3cc1640 1 -- 172.21.15.102:0/1373211482 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31e401b070 con 0x7f31ec05b040 2024-09-13T19:18:04.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.102+0000 7f31f3cc1640 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560e369adb40 con 0x560e369a4e20 2024-09-13T19:18:04.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.102+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31e8057030 con 0x560e369a4e20 2024-09-13T19:18:04.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.102+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560e369adb40 con 0x7f31ec05b040 2024-09-13T19:18:04.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.102+0000 7f31f3cc1640 1 -- 172.21.15.102:0/1373211482 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f31e401b070 con 0x7f31ec05b040 2024-09-13T19:18:04.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.102+0000 7f31f3cc1640 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560e369adb40 con 0x560e369a9830 2024-09-13T19:18:04.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.102+0000 7f31f44c2640 1 -- 172.21.15.102:0/1373211482 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31ec028070 con 0x560e369a9830 2024-09-13T19:18:04.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.102+0000 7f31f44c2640 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560e369adb40 con 0x560e369a9830 2024-09-13T19:18:04.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.102+0000 7f31f44c2640 1 -- 172.21.15.102:0/1373211482 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f31ec028070 con 0x560e369a9830 2024-09-13T19:18:04.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.102+0000 7f31f44c2640 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560e369adb40 con 0x7f31e4027020 2024-09-13T19:18:04.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.103+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31e8057030 con 0x7f31e4027020 2024-09-13T19:18:04.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.103+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560e369adb40 con 0x560e369a9830 2024-09-13T19:18:04.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.103+0000 7f31f44c2640 1 -- 172.21.15.102:0/1373211482 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f31ec028070 con 0x560e369a9830 2024-09-13T19:18:04.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.103+0000 7f31f44c2640 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560e369adb40 con 0x560e369a9830 2024-09-13T19:18:04.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.103+0000 7f31f44c2640 1 -- 172.21.15.102:0/1373211482 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31ec028070 con 0x560e369a9830 2024-09-13T19:18:04.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.103+0000 7f31f44c2640 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560e369adb40 con 0x560e369a4e20 2024-09-13T19:18:04.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.103+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31e8057030 con 0x560e369a4e20 2024-09-13T19:18:04.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.103+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560e369adb40 con 0x560e369a4e20 2024-09-13T19:18:04.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.104+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f31e8057030 con 0x560e369a4e20 2024-09-13T19:18:04.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.104+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560e369adb40 con 0x7f31e4027020 2024-09-13T19:18:04.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.104+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31e8057030 con 0x7f31e4027020 2024-09-13T19:18:04.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.104+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560e369adb40 con 0x560e369a9830 2024-09-13T19:18:04.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.104+0000 7f31f44c2640 1 -- 172.21.15.102:0/1373211482 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31ec06c040 con 0x560e369a9830 2024-09-13T19:18:04.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.104+0000 7f31f44c2640 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560e369adb40 con 0x7f31ec05b040 2024-09-13T19:18:04.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.104+0000 7f31f3cc1640 1 -- 172.21.15.102:0/1373211482 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31e401b070 con 0x7f31ec05b040 2024-09-13T19:18:04.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.104+0000 7f31f3cc1640 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560e369adb40 con 0x560e369a4e20 2024-09-13T19:18:04.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.105+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31e8057030 con 0x560e369a4e20 2024-09-13T19:18:04.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.105+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560e369adb40 con 0x7f31ec05b040 2024-09-13T19:18:04.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.105+0000 7f31f3cc1640 1 -- 172.21.15.102:0/1373211482 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31e401b070 con 0x7f31ec05b040 2024-09-13T19:18:04.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.105+0000 7f31f3cc1640 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560e369adb40 con 0x560e369a9830 2024-09-13T19:18:04.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.105+0000 7f31f44c2640 1 -- 172.21.15.102:0/1373211482 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31ec06c040 con 0x560e369a9830 2024-09-13T19:18:04.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.105+0000 7f31f44c2640 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560e369adb40 con 0x7f31e4027020 2024-09-13T19:18:04.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.105+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31e8057030 con 0x7f31e4027020 2024-09-13T19:18:04.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.105+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560e369adb40 con 0x7f31ec05b040 2024-09-13T19:18:04.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.105+0000 7f31f3cc1640 1 -- 172.21.15.102:0/1373211482 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31e401b070 con 0x7f31ec05b040 2024-09-13T19:18:04.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.106+0000 7f31f3cc1640 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560e369adb40 con 0x560e369a9830 2024-09-13T19:18:04.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.106+0000 7f31f44c2640 1 -- 172.21.15.102:0/1373211482 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31ec06c040 con 0x560e369a9830 2024-09-13T19:18:04.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.106+0000 7f31f44c2640 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560e369adb40 con 0x7f31e4027020 2024-09-13T19:18:04.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.106+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31e8057030 con 0x7f31e4027020 2024-09-13T19:18:04.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.106+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560e369adb40 con 0x560e369a4e20 2024-09-13T19:18:04.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.106+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v36'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f31e8057030 con 0x560e369a4e20 2024-09-13T19:18:04.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.106+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560e369adb40 con 0x7f31ec05b040 2024-09-13T19:18:04.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.107+0000 7f31f3cc1640 1 -- 172.21.15.102:0/1373211482 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31e401b070 con 0x7f31ec05b040 2024-09-13T19:18:04.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.107+0000 7f31f860e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:18:04.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.107+0000 7f31f860e800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:18:04.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.107+0000 7f31f860e800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:18:04.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.107+0000 7f31f860e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:18:04.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.107+0000 7f31f860e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:18:04.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.107+0000 7f31f860e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:18:04.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.107+0000 7f31f860e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:04.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.107+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560e369ad710 con 0x560e369a4e20 2024-09-13T19:18:04.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.107+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f31e8057030 con 0x560e369a4e20 2024-09-13T19:18:04.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.107+0000 7f31f860e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:04.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.107+0000 7f31f860e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:04.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.107+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560e369acf80 con 0x560e369a4e20 2024-09-13T19:18:04.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.107+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f31e8057030 con 0x560e369a4e20 2024-09-13T19:18:04.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.107+0000 7f31f860e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:18:04.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.107+0000 7f31f860e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:04.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.107+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560e369adfc0 con 0x560e369a9830 2024-09-13T19:18:04.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.107+0000 7f31f44c2640 1 -- 172.21.15.102:0/1373211482 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f31ec06c040 con 0x560e369a9830 2024-09-13T19:18:04.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.107+0000 7f31f860e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:18:04.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.107+0000 7f31f860e800 20 zone default found 2024-09-13T19:18:04.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.107+0000 7f31f860e800 4 Realm: () 2024-09-13T19:18:04.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.107+0000 7f31f860e800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:18:04.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.107+0000 7f31f860e800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:18:04.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.107+0000 7f31f860e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:18:04.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.107+0000 7f31f860e800 20 zonegroup default 2024-09-13T19:18:04.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.107+0000 7f31f860e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:04.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.107+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560e369ae810 con 0x7f31ec05b040 2024-09-13T19:18:04.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.108+0000 7f31f3cc1640 1 -- 172.21.15.102:0/1373211482 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f31e401b070 con 0x7f31ec05b040 2024-09-13T19:18:04.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.108+0000 7f31f860e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:04.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.108+0000 7f31f860e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:04.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.108+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560e369b0590 con 0x560e369a9830 2024-09-13T19:18:04.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.108+0000 7f31f44c2640 1 -- 172.21.15.102:0/1373211482 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f31ec06c040 con 0x560e369a9830 2024-09-13T19:18:04.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.108+0000 7f31f860e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:04.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.108+0000 7f31f860e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:04.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.108+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560e369b0a20 con 0x560e369a9830 2024-09-13T19:18:04.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.108+0000 7f31f44c2640 1 -- 172.21.15.102:0/1373211482 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f31ec06c040 con 0x560e369a9830 2024-09-13T19:18:04.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.108+0000 7f31f860e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:04.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.108+0000 7f31f860e800 20 started sync module instance, tier type = 2024-09-13T19:18:04.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.108+0000 7f31f860e800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:18:04.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.108+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560e369afa30 con 0x7f31ec05b040 2024-09-13T19:18:04.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.109+0000 7f31f3cc1640 1 -- 172.21.15.102:0/1373211482 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(44 notify.0 [create] v36'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31e401b070 con 0x7f31ec05b040 2024-09-13T19:18:04.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.109+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94619045655936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560e369b0e80 con 0x7f31ec05b040 2024-09-13T19:18:04.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.109+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560e369b16d0 con 0x560e369a4e20 2024-09-13T19:18:04.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.110+0000 7f31f3cc1640 1 -- 172.21.15.102:0/1373211482 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94619045655936] v36'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31e401b070 con 0x7f31ec05b040 2024-09-13T19:18:04.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.111+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v36'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31e8057030 con 0x560e369a4e20 2024-09-13T19:18:04.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.111+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94619045658144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560e369b1a70 con 0x560e369a4e20 2024-09-13T19:18:04.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.111+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560e369b22c0 con 0x560e369a9830 2024-09-13T19:18:04.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.112+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94619045658144] v36'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31e8057030 con 0x560e369a4e20 2024-09-13T19:18:04.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.112+0000 7f31f44c2640 1 -- 172.21.15.102:0/1373211482 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v36'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31ec06c040 con 0x560e369a9830 2024-09-13T19:18:04.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.112+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94619045666320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560e369b2230 con 0x560e369a9830 2024-09-13T19:18:04.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.112+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560e369b3180 con 0x7f31ec05b040 2024-09-13T19:18:04.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.113+0000 7f31f44c2640 1 -- 172.21.15.102:0/1373211482 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94619045666320] v36'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31ec06c040 con 0x560e369a9830 2024-09-13T19:18:04.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.113+0000 7f31f3cc1640 1 -- 172.21.15.102:0/1373211482 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(50 notify.3 [create] v36'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31e401b070 con 0x7f31ec05b040 2024-09-13T19:18:04.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.113+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94619045668528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560e369b3180 con 0x7f31ec05b040 2024-09-13T19:18:04.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.113+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560e369b3c40 con 0x560e369a4e20 2024-09-13T19:18:04.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.114+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v36'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31e8057030 con 0x560e369a4e20 2024-09-13T19:18:04.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.114+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94619045672720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560e369b3c00 con 0x560e369a4e20 2024-09-13T19:18:04.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.114+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560e369b4c20 con 0x7f31e4027020 2024-09-13T19:18:04.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.114+0000 7f31f3cc1640 1 -- 172.21.15.102:0/1373211482 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94619045668528] v36'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31e401b070 con 0x7f31ec05b040 2024-09-13T19:18:04.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.115+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(54 notify.5 [create] v36'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31e8057030 con 0x7f31e4027020 2024-09-13T19:18:04.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.115+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94619045676848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560e369b4c20 con 0x7f31e4027020 2024-09-13T19:18:04.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.115+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560e369b5690 con 0x7f31e4027020 2024-09-13T19:18:04.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.115+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94619045672720] v36'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31e8057030 con 0x560e369a4e20 2024-09-13T19:18:04.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.116+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94619045676848] v36'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31e8057030 con 0x7f31e4027020 2024-09-13T19:18:04.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.116+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(56 notify.6 [create] v36'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31e8057030 con 0x7f31e4027020 2024-09-13T19:18:04.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.116+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94619045670096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560e369b4030 con 0x7f31e4027020 2024-09-13T19:18:04.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.116+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560e369b5b00 con 0x7f31e4027020 2024-09-13T19:18:04.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.117+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94619045670096] v36'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31e8057030 con 0x7f31e4027020 2024-09-13T19:18:04.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.117+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(58 notify.7 [create] v36'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31e8057030 con 0x7f31e4027020 2024-09-13T19:18:04.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.117+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94619045679488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560e369b5b00 con 0x7f31e4027020 2024-09-13T19:18:04.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.117+0000 7f31f860e800 20 add_watcher() i=0 2024-09-13T19:18:04.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.117+0000 7f31f860e800 20 add_watcher() i=1 2024-09-13T19:18:04.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.117+0000 7f31f860e800 20 add_watcher() i=2 2024-09-13T19:18:04.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.117+0000 7f31f860e800 20 add_watcher() i=3 2024-09-13T19:18:04.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.117+0000 7f31f860e800 20 add_watcher() i=4 2024-09-13T19:18:04.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.117+0000 7f31f860e800 20 add_watcher() i=5 2024-09-13T19:18:04.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.117+0000 7f31f860e800 20 add_watcher() i=6 2024-09-13T19:18:04.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.118+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94619045679488] v36'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31e8057030 con 0x7f31e4027020 2024-09-13T19:18:04.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.118+0000 7f31f860e800 20 add_watcher() i=7 2024-09-13T19:18:04.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.118+0000 7f31f860e800 2 all 8 watchers are set, enabling cache 2024-09-13T19:18:04.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.118+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560e369b8f30 con 0x560e369a4e20 2024-09-13T19:18:04.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.119+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f31e8057030 con 0x560e369a4e20 2024-09-13T19:18:04.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.119+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94619045681184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560e369b6480 con 0x560e369a4e20 2024-09-13T19:18:04.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.120+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94619045681184] v36'267 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f31e8057030 con 0x560e369a4e20 2024-09-13T19:18:04.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.120+0000 7f30a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:18:04.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.120+0000 7f31f860e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:18:04.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.120+0000 7f31f860e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:18:04.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.120+0000 7f31f860e800 5 note: GC not initialized 2024-09-13T19:18:04.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.120+0000 7f30a8fe1640 20 reqs_thread_entry: start 2024-09-13T19:18:04.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.120+0000 7f31f860e800 20 init_complete bucket index max shards: 11 2024-09-13T19:18:04.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.120+0000 7f31f860e800 20 Filter name: none 2024-09-13T19:18:04.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.120+0000 7f30227fc640 20 reqs_thread_entry: start 2024-09-13T19:18:04.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.120+0000 7f31f860e800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T19:18:04.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.120+0000 7f31f860e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:04.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.120+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560e369ec320 con 0x7f31e4027020 2024-09-13T19:18:04.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.121+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f31e8057030 con 0x7f31e4027020 2024-09-13T19:18:04.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.121+0000 7f31f860e800 20 rados_obj.operate() r=0 bl.length=490 2024-09-13T19:18:04.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.121+0000 7f31f860e800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T19:18:04.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.121+0000 7f31f860e800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:18:04.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.121+0000 7f31f860e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:18:04.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.121+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560e369f2a10 con 0x7f31e4027020 2024-09-13T19:18:04.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.122+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v36'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f31e8057030 con 0x7f31e4027020 2024-09-13T19:18:04.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.122+0000 7f31f860e800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:18:04.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.122+0000 7f31f860e800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:18:04.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.122+0000 7f31f860e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T19:18:04.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.122+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94619045930112 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560e369ee100 con 0x560e369a4e20 2024-09-13T19:18:04.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.123+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== watch-notify(notify (1) cookie 94619045672720 notify 154618822701 ret 0) ==== 678+0+0 (crc 0 0 0) 0x560e36738e00 con 0x560e369a4e20 2024-09-13T19:18:04.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.123+0000 7f30d2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822701 cookie 94619045672720 notifier 4916 bl.length()=636 2024-09-13T19:18:04.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.123+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(64 notify.4 [notify cookie 94619045930112 out=8b] v0'0 uv273 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f31e8057030 con 0x560e369a4e20 2024-09-13T19:18:04.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.123+0000 7f30d2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:18:04.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.123+0000 7f30d2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:18:04.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.123+0000 7f30d2ffd640 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f30b8003ea0 con 0x560e369a4e20 2024-09-13T19:18:04.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.123+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31e8057030 con 0x560e369a4e20 2024-09-13T19:18:04.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.123+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== watch-notify(notify_complete (2) cookie 94619045930112 notify 154618822701 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f31e805ba70 con 0x560e369a4e20 2024-09-13T19:18:04.136 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T19:18:02.251000Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:18:02.250985Z","tags":[],"group_ids":[]} 2024-09-13T19:18:04.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.124+0000 7f30a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:18:04.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.124+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94619045681184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560e369ea040 con 0x560e369a4e20 2024-09-13T19:18:04.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.125+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94619045681184] v36'268 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f31e8057030 con 0x560e369a4e20 2024-09-13T19:18:04.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.125+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94619045655936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560e369ea040 con 0x7f31ec05b040 2024-09-13T19:18:04.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.126+0000 7f31f3cc1640 1 -- 172.21.15.102:0/1373211482 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94619045655936] v36'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31e401b070 con 0x7f31ec05b040 2024-09-13T19:18:04.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.126+0000 7f31f860e800 20 remove_watcher() i=0 2024-09-13T19:18:04.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.126+0000 7f31f860e800 2 removed watcher, disabling cache 2024-09-13T19:18:04.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.126+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94619045658144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560e369ea040 con 0x560e369a4e20 2024-09-13T19:18:04.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.127+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94619045658144] v36'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31e8057030 con 0x560e369a4e20 2024-09-13T19:18:04.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.127+0000 7f31f860e800 20 remove_watcher() i=1 2024-09-13T19:18:04.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.127+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94619045666320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560e369ea040 con 0x560e369a9830 2024-09-13T19:18:04.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.128+0000 7f31f44c2640 1 -- 172.21.15.102:0/1373211482 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94619045666320] v36'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31ec06c040 con 0x560e369a9830 2024-09-13T19:18:04.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.128+0000 7f31f860e800 20 remove_watcher() i=2 2024-09-13T19:18:04.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.128+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94619045668528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560e369ea040 con 0x7f31ec05b040 2024-09-13T19:18:04.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.129+0000 7f31f3cc1640 1 -- 172.21.15.102:0/1373211482 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94619045668528] v36'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31e401b070 con 0x7f31ec05b040 2024-09-13T19:18:04.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.129+0000 7f31f860e800 20 remove_watcher() i=3 2024-09-13T19:18:04.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.129+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94619045672720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560e369ea040 con 0x560e369a4e20 2024-09-13T19:18:04.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.130+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94619045672720] v36'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31e8057030 con 0x560e369a4e20 2024-09-13T19:18:04.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.130+0000 7f31f860e800 20 remove_watcher() i=4 2024-09-13T19:18:04.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.130+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94619045676848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560e369ea040 con 0x7f31e4027020 2024-09-13T19:18:04.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.131+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94619045676848] v36'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31e8057030 con 0x7f31e4027020 2024-09-13T19:18:04.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.131+0000 7f31f860e800 20 remove_watcher() i=5 2024-09-13T19:18:04.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.131+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94619045670096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560e369ea040 con 0x7f31e4027020 2024-09-13T19:18:04.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.132+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94619045670096] v36'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31e8057030 con 0x7f31e4027020 2024-09-13T19:18:04.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.132+0000 7f31f860e800 20 remove_watcher() i=6 2024-09-13T19:18:04.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.132+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94619045679488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560e369ea040 con 0x7f31e4027020 2024-09-13T19:18:04.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.133+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94619045679488] v36'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31e8057030 con 0x7f31e4027020 2024-09-13T19:18:04.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.133+0000 7f31f860e800 20 remove_watcher() i=7 2024-09-13T19:18:04.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.133+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f31e4027020 msgr2=0x7f31e4026ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.133+0000 7f31f860e800 1 --2- 172.21.15.102:0/1373211482 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f31e4027020 0x7f31e4026ae0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.133+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x560e369a4e20 msgr2=0x560e369a72e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.133+0000 7f31f860e800 1 --2- 172.21.15.102:0/1373211482 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x560e369a4e20 0x560e369a72e0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.133+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f31ec05b040 msgr2=0x7f31ec0478b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.133+0000 7f31f860e800 1 --2- 172.21.15.102:0/1373211482 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f31ec05b040 0x7f31ec0478b0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.133+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x560e369a9830 msgr2=0x560e369abc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.133+0000 7f31f860e800 1 --2- 172.21.15.102:0/1373211482 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x560e369a9830 0x560e369abc20 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.134+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f30bc036b90 msgr2=0x7f30bc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.134+0000 7f31f860e800 1 --2- 172.21.15.102:0/1373211482 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f30bc036b90 0x7f30bc039050 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f31e401ea80 tx=0x7f31e4034040 comp rx=0 tx=0).stop 2024-09-13T19:18:04.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.134+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e36991ee0 msgr2=0x560e36999390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.134+0000 7f31f860e800 1 --2- 172.21.15.102:0/1373211482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e36991ee0 0x560e36999390 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f31ec016680 tx=0x7f31ec04c580 comp rx=0 tx=0).stop 2024-09-13T19:18:04.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.134+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 reap_dead start 2024-09-13T19:18:04.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.134+0000 7f31f34c0640 1 -- 172.21.15.102:0/1373211482 reap_dead start 2024-09-13T19:18:04.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.134+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 shutdown_connections 2024-09-13T19:18:04.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.134+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 >> 172.21.15.102:0/1373211482 conn(0x560e3698e240 msgr2=0x560e3698c310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:04.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.134+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 shutdown_connections 2024-09-13T19:18:04.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.134+0000 7f31f860e800 1 -- 172.21.15.102:0/1373211482 wait complete. 2024-09-13T19:18:04.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.134+0000 7f31f860e800 1 -- 172.21.15.102:0/1048707888 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f30cc036c00 msgr2=0x7f30cc0390c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.134+0000 7f31f860e800 1 --2- 172.21.15.102:0/1048707888 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f30cc036c00 0x7f30cc0390c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f31e404b030 tx=0x7f31e4012f90 comp rx=0 tx=0).stop 2024-09-13T19:18:04.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.134+0000 7f31f860e800 1 -- 172.21.15.102:0/1048707888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e36985210 msgr2=0x560e36985630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.134+0000 7f31f860e800 1 --2- 172.21.15.102:0/1048707888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e36985210 0x560e36985630 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x560e3696b5a0 tx=0x7f31ec00beb0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.134+0000 7f31f860e800 1 -- 172.21.15.102:0/1048707888 shutdown_connections 2024-09-13T19:18:04.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.134+0000 7f31f860e800 1 --2- 172.21.15.102:0/1048707888 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f30cc036c00 0x7f30cc0390c0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.134+0000 7f31f860e800 1 --2- 172.21.15.102:0/1048707888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e36985210 0x560e36985630 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.134+0000 7f31f860e800 1 -- 172.21.15.102:0/1048707888 >> 172.21.15.102:0/1048707888 conn(0x560e3697a1a0 msgr2=0x560e3697cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:04.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.134+0000 7f31f860e800 1 -- 172.21.15.102:0/1048707888 shutdown_connections 2024-09-13T19:18:04.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.134+0000 7f31f860e800 1 -- 172.21.15.102:0/1048707888 wait complete. 2024-09-13T19:18:04.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.134+0000 7f31f860e800 1 -- 172.21.15.102:0/813816475 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x560e36877d40 msgr2=0x560e36971560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.134+0000 7f31f860e800 1 --2- 172.21.15.102:0/813816475 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x560e36877d40 0x560e36971560 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.134+0000 7f31f860e800 1 -- 172.21.15.102:0/813816475 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x560e36973df0 msgr2=0x560e369761e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.134+0000 7f31f860e800 1 --2- 172.21.15.102:0/813816475 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x560e36973df0 0x560e369761e0 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.134+0000 7f31f860e800 1 -- 172.21.15.102:0/813816475 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f30dc036b40 msgr2=0x7f30dc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.134+0000 7f31f860e800 1 --2- 172.21.15.102:0/813816475 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f30dc036b40 0x7f30dc039000 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f31e8057000 tx=0x7f31e8052000 comp rx=0 tx=0).stop 2024-09-13T19:18:04.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.134+0000 7f31f860e800 1 -- 172.21.15.102:0/813816475 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e367e5610 msgr2=0x560e3696a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.134+0000 7f31f860e800 1 --2- 172.21.15.102:0/813816475 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e367e5610 0x560e3696a4f0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x560e36963940 tx=0x7f31e4001250 comp rx=0 tx=0).stop 2024-09-13T19:18:04.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.135+0000 7f31f860e800 1 -- 172.21.15.102:0/813816475 shutdown_connections 2024-09-13T19:18:04.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.135+0000 7f31f860e800 1 --2- 172.21.15.102:0/813816475 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x560e36973df0 0x560e369761e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.135+0000 7f31f860e800 1 --2- 172.21.15.102:0/813816475 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x560e36877d40 0x560e36971560 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.135+0000 7f31f860e800 1 --2- 172.21.15.102:0/813816475 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f30dc036b40 0x7f30dc039000 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.135+0000 7f31f860e800 1 --2- 172.21.15.102:0/813816475 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e367e5610 0x560e3696a4f0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.135+0000 7f31f860e800 1 -- 172.21.15.102:0/813816475 >> 172.21.15.102:0/813816475 conn(0x560e3686bdb0 msgr2=0x560e3695cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:04.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.135+0000 7f31f860e800 1 -- 172.21.15.102:0/813816475 shutdown_connections 2024-09-13T19:18:04.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.135+0000 7f31f860e800 1 -- 172.21.15.102:0/813816475 wait complete. 2024-09-13T19:18:04.148 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:18:02.251000Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:18:02.250985Z', 'tags': [], 'group_ids': []} 2024-09-13T19:18:04.148 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:18:02.251000Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:18:02.250985Z', 'tags': [], 'group_ids': []} 2024-09-13T19:18:04.148 ERROR:root:0 2024-09-13T19:18:04.148 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T19:18:04.148 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T19:18:04.148 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-13T19:18:04.194 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:18:04.195 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:18:04.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.192+0000 7f6bf4119800 1 Processor -- start 2024-09-13T19:18:04.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.192+0000 7f6bf4119800 1 -- start start 2024-09-13T19:18:04.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.192+0000 7f6bf4119800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x557970f29d40 0x557970f2c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:04.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.192+0000 7f6bf4119800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557970de2b30 con 0x557970e97610 2024-09-13T19:18:04.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.192+0000 7f6bf4119800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x557970dc4360 con 0x557970f29d40 2024-09-13T19:18:04.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.193+0000 7f6bf140c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x557970f29d40 0x557970f2c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:04.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.193+0000 7f6bf140c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x557970f29d40 0x557970f2c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:50188/0 (socket says 172.21.15.102:50188) 2024-09-13T19:18:04.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.193+0000 7f6bf140c640 1 -- 172.21.15.102:0/2374426702 learned_addr learned my addr 172.21.15.102:0/2374426702 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:04.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.193+0000 7f6bf0c0b640 1 -- 172.21.15.102:0/2374426702 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 990163389 0 0) 0x557970de2b30 con 0x557970e97610 2024-09-13T19:18:04.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.193+0000 7f6bf0c0b640 1 -- 172.21.15.102:0/2374426702 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6bdc001e10 con 0x557970e97610 2024-09-13T19:18:04.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.193+0000 7f6bf140c640 1 -- 172.21.15.102:0/2374426702 >> v1:172.21.15.53:6789/0 conn(0x557970e97610 legacy=0x557970f28620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.193+0000 7f6bf140c640 1 -- 172.21.15.102:0/2374426702 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557970deae00 con 0x557970f29d40 2024-09-13T19:18:04.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.195+0000 7f6bf140c640 1 --2- 172.21.15.102:0/2374426702 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557970f29d40 0x557970f2c130 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f6be800a520 tx=0x7f6be8045aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69e7bfd63429aabc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:04.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.195+0000 7f6bf0c0b640 1 -- 172.21.15.102:0/2374426702 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6be8056020 con 0x557970f29d40 2024-09-13T19:18:04.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.195+0000 7f6bf0c0b640 1 -- 172.21.15.102:0/2374426702 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6be8052550 con 0x557970f29d40 2024-09-13T19:18:04.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.195+0000 7f6bf0c0b640 1 -- 172.21.15.102:0/2374426702 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6be8052870 con 0x557970f29d40 2024-09-13T19:18:04.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.195+0000 7f6bf4119800 1 -- 172.21.15.102:0/2374426702 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557970f29d40 msgr2=0x557970f2c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.195+0000 7f6bf4119800 1 --2- 172.21.15.102:0/2374426702 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557970f29d40 0x557970f2c130 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f6be800a520 tx=0x7f6be8045aa0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.195+0000 7f6bf4119800 1 -- 172.21.15.102:0/2374426702 shutdown_connections 2024-09-13T19:18:04.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.195+0000 7f6bf4119800 1 --2- 172.21.15.102:0/2374426702 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557970f29d40 0x557970f2c130 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.195+0000 7f6bf4119800 1 -- 172.21.15.102:0/2374426702 >> 172.21.15.102:0/2374426702 conn(0x557970f1ddb0 msgr2=0x557970f201d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:04.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.195+0000 7f6bf4119800 1 -- 172.21.15.102:0/2374426702 shutdown_connections 2024-09-13T19:18:04.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.196+0000 7f6bf4119800 1 -- 172.21.15.102:0/2374426702 wait complete. 2024-09-13T19:18:04.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.209+0000 7f6bf4119800 1 Processor -- start 2024-09-13T19:18:04.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.209+0000 7f6bf4119800 1 -- start start 2024-09-13T19:18:04.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.210+0000 7f6bf4119800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557970e97610 0x5579710148d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:04.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.210+0000 7f6bf4119800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557970e6f360 con 0x557970e97610 2024-09-13T19:18:04.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.210+0000 7f6bf1c0d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557970e97610 0x5579710148d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:04.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.210+0000 7f6bf1c0d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557970e97610 0x5579710148d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:50200/0 (socket says 172.21.15.102:50200) 2024-09-13T19:18:04.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.210+0000 7f6bf1c0d640 1 -- 172.21.15.102:0/4088729177 learned_addr learned my addr 172.21.15.102:0/4088729177 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:04.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.210+0000 7f6bf1c0d640 1 -- 172.21.15.102:0/4088729177 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557970dbcbc0 con 0x557970e97610 2024-09-13T19:18:04.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.210+0000 7f6bf1c0d640 1 --2- 172.21.15.102:0/4088729177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557970e97610 0x5579710148d0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f6be4001d80 tx=0x7f6be4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25deaf6f66252d3a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:04.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.211+0000 7f6adfe07640 1 -- 172.21.15.102:0/4088729177 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6be400f400 con 0x557970e97610 2024-09-13T19:18:04.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.211+0000 7f6adfe07640 1 -- 172.21.15.102:0/4088729177 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6be400f5a0 con 0x557970e97610 2024-09-13T19:18:04.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.211+0000 7f6adfe07640 1 -- 172.21.15.102:0/4088729177 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6be400f8e0 con 0x557970e97610 2024-09-13T19:18:04.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.211+0000 7f6bf4119800 1 -- 172.21.15.102:0/4088729177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557970e97610 msgr2=0x5579710148d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.211+0000 7f6bf4119800 1 --2- 172.21.15.102:0/4088729177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557970e97610 0x5579710148d0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f6be4001d80 tx=0x7f6be4001e70 comp rx=0 tx=0).stop 2024-09-13T19:18:04.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.211+0000 7f6bf4119800 1 -- 172.21.15.102:0/4088729177 shutdown_connections 2024-09-13T19:18:04.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.211+0000 7f6bf4119800 1 --2- 172.21.15.102:0/4088729177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557970e97610 0x5579710148d0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.211+0000 7f6bf4119800 1 -- 172.21.15.102:0/4088729177 >> 172.21.15.102:0/4088729177 conn(0x557970f1ddb0 msgr2=0x557971010290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:04.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.211+0000 7f6bf4119800 1 -- 172.21.15.102:0/4088729177 shutdown_connections 2024-09-13T19:18:04.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.211+0000 7f6bf4119800 1 -- 172.21.15.102:0/4088729177 wait complete. 2024-09-13T19:18:04.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.212+0000 7f6bf4119800 1 Processor -- start 2024-09-13T19:18:04.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.212+0000 7f6bf4119800 1 -- start start 2024-09-13T19:18:04.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.212+0000 7f6bf4119800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557970e97610 0x55797101c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:04.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.212+0000 7f6bf4119800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557970f2c910 con 0x557970e97610 2024-09-13T19:18:04.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.212+0000 7f6bf1c0d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557970e97610 0x55797101c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:04.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.212+0000 7f6bf1c0d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557970e97610 0x55797101c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:50212/0 (socket says 172.21.15.102:50212) 2024-09-13T19:18:04.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.212+0000 7f6bf1c0d640 1 -- 172.21.15.102:0/2432877259 learned_addr learned my addr 172.21.15.102:0/2432877259 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:04.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.212+0000 7f6bf1c0d640 1 -- 172.21.15.102:0/2432877259 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557970dd0fe0 con 0x557970e97610 2024-09-13T19:18:04.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.213+0000 7f6bf1c0d640 1 --2- 172.21.15.102:0/2432877259 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557970e97610 0x55797101c2f0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f6be4001d80 tx=0x7f6be4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:04.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.213+0000 7f6ade604640 1 -- 172.21.15.102:0/2432877259 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6be401a690 con 0x557970e97610 2024-09-13T19:18:04.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.213+0000 7f6ade604640 1 -- 172.21.15.102:0/2432877259 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6be401a830 con 0x557970e97610 2024-09-13T19:18:04.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.213+0000 7f6bf4119800 1 -- 172.21.15.102:0/2432877259 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55797101c830 con 0x557970e97610 2024-09-13T19:18:04.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.213+0000 7f6ade604640 1 -- 172.21.15.102:0/2432877259 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6be401ab30 con 0x557970e97610 2024-09-13T19:18:04.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.213+0000 7f6bf4119800 1 -- 172.21.15.102:0/2432877259 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55797101cdb0 con 0x557970e97610 2024-09-13T19:18:04.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.213+0000 7f6ade604640 1 -- 172.21.15.102:0/2432877259 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6be4017070 con 0x557970e97610 2024-09-13T19:18:04.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.214+0000 7f6ade604640 1 --2- 172.21.15.102:0/2432877259 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6ad8036b40 0x7f6ad8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:04.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.214+0000 7f6ade604640 1 -- 172.21.15.102:0/2432877259 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f6be4015020 con 0x557970e97610 2024-09-13T19:18:04.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.214+0000 7f6bf140c640 1 --2- 172.21.15.102:0/2432877259 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6ad8036b40 0x7f6ad8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:04.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.214+0000 7f6bf4119800 1 --2- 172.21.15.102:0/2432877259 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557970f29d40 0x557971023360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:04.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.214+0000 7f6bf4119800 1 -- 172.21.15.102:0/2432877259 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5579710238e0 con 0x557970f29d40 2024-09-13T19:18:04.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.214+0000 7f6bf240e640 1 --2- 172.21.15.102:0/2432877259 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557970f29d40 0x557971023360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:04.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.214+0000 7f6bf140c640 1 --2- 172.21.15.102:0/2432877259 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6ad8036b40 0x7f6ad8039000 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6be8057000 tx=0x7f6be8052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:04.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.214+0000 7f6bf240e640 1 --2- 172.21.15.102:0/2432877259 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557970f29d40 0x557971023360 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:04.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.215+0000 7f6bf240e640 1 -- 172.21.15.102:0/2432877259 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6bec00a4a0 con 0x557970f29d40 2024-09-13T19:18:04.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.215+0000 7f6bf4119800 1 -- 172.21.15.102:0/2432877259 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557971020930 con 0x557970f29d40 2024-09-13T19:18:04.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.215+0000 7f6bf240e640 1 -- 172.21.15.102:0/2432877259 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6bec00a4a0 con 0x557970f29d40 2024-09-13T19:18:04.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.215+0000 7f6bf4119800 1 --2- 172.21.15.102:0/2432877259 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x557971025c30 0x557971028020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:04.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.215+0000 7f6bf4119800 1 -- 172.21.15.102:0/2432877259 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557971028710 con 0x557971025c30 2024-09-13T19:18:04.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.215+0000 7f6bf1c0d640 1 --2- 172.21.15.102:0/2432877259 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x557971025c30 0x557971028020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:04.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.215+0000 7f6bf1c0d640 1 --2- 172.21.15.102:0/2432877259 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x557971025c30 0x557971028020 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:04.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.216+0000 7f6bf1c0d640 1 -- 172.21.15.102:0/2432877259 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6be402e070 con 0x557971025c30 2024-09-13T19:18:04.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.216+0000 7f6bf4119800 1 -- 172.21.15.102:0/2432877259 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557971024ad0 con 0x557970f29d40 2024-09-13T19:18:04.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.216+0000 7f6bf240e640 1 -- 172.21.15.102:0/2432877259 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6bec00a4a0 con 0x557970f29d40 2024-09-13T19:18:04.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.216+0000 7f6bf4119800 1 -- 172.21.15.102:0/2432877259 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557971024f70 con 0x557971025c30 2024-09-13T19:18:04.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.216+0000 7f6bf1c0d640 1 -- 172.21.15.102:0/2432877259 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6be402e070 con 0x557971025c30 2024-09-13T19:18:04.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.216+0000 7f6bf4119800 1 Processor -- start 2024-09-13T19:18:04.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.217+0000 7f6bf4119800 1 -- start start 2024-09-13T19:18:04.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.217+0000 7f6bf4119800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579710370a0 0x5579710374c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:04.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.217+0000 7f6bf4119800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557970dbe580 con 0x5579710370a0 2024-09-13T19:18:04.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.217+0000 7f6bf240e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579710370a0 0x5579710374c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:04.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.217+0000 7f6bf240e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579710370a0 0x5579710374c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:50222/0 (socket says 172.21.15.102:50222) 2024-09-13T19:18:04.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.217+0000 7f6bf240e640 1 -- 172.21.15.102:0/3942792351 learned_addr learned my addr 172.21.15.102:0/3942792351 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:04.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.217+0000 7f6bf240e640 1 -- 172.21.15.102:0/3942792351 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557971037a00 con 0x5579710370a0 2024-09-13T19:18:04.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.218+0000 7f6bf240e640 1 --2- 172.21.15.102:0/3942792351 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579710370a0 0x5579710374c0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x55797101d6f0 tx=0x7f6bec0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:04.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.218+0000 7f6ad77fe640 1 -- 172.21.15.102:0/3942792351 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bec013640 con 0x5579710370a0 2024-09-13T19:18:04.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.218+0000 7f6ad77fe640 1 -- 172.21.15.102:0/3942792351 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bec0137e0 con 0x5579710370a0 2024-09-13T19:18:04.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.218+0000 7f6bf4119800 1 -- 172.21.15.102:0/3942792351 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557971037c90 con 0x5579710370a0 2024-09-13T19:18:04.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.218+0000 7f6ad77fe640 1 -- 172.21.15.102:0/3942792351 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bec013ae0 con 0x5579710370a0 2024-09-13T19:18:04.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.218+0000 7f6bf4119800 1 -- 172.21.15.102:0/3942792351 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55797103a970 con 0x5579710370a0 2024-09-13T19:18:04.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.219+0000 7f6ad77fe640 1 -- 172.21.15.102:0/3942792351 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6bec011040 con 0x5579710370a0 2024-09-13T19:18:04.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.219+0000 7f6ad77fe640 1 --2- 172.21.15.102:0/3942792351 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6acc036b90 0x7f6acc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:04.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.219+0000 7f6ad77fe640 1 -- 172.21.15.102:0/3942792351 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f6bec00e040 con 0x5579710370a0 2024-09-13T19:18:04.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.219+0000 7f6bf1c0d640 1 --2- 172.21.15.102:0/3942792351 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6acc036b90 0x7f6acc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:04.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.219+0000 7f6bf4119800 1 Processor -- start 2024-09-13T19:18:04.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.219+0000 7f6bf4119800 1 -- start start 2024-09-13T19:18:04.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.219+0000 7f6bf1c0d640 1 --2- 172.21.15.102:0/3942792351 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6acc036b90 0x7f6acc039050 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x557971024aa0 tx=0x7f6be404b0e0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:04.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.219+0000 7f6bf4119800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557971043d40 0x557971044140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:04.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.219+0000 7f6bf4119800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557971015080 con 0x557971043d40 2024-09-13T19:18:04.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.219+0000 7f6bf240e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557971043d40 0x557971044140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:04.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.220+0000 7f6bf240e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557971043d40 0x557971044140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:50238/0 (socket says 172.21.15.102:50238) 2024-09-13T19:18:04.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.220+0000 7f6bf240e640 1 -- 172.21.15.102:0/3560965277 learned_addr learned my addr 172.21.15.102:0/3560965277 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:04.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.220+0000 7f6bf240e640 1 -- 172.21.15.102:0/3560965277 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557971044710 con 0x557971043d40 2024-09-13T19:18:04.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.220+0000 7f6bf240e640 1 --2- 172.21.15.102:0/3560965277 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557971043d40 0x557971044140 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f6bec016cd0 tx=0x7f6bec01fee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d71c19e78f6d5a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:04.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.220+0000 7f6ad57fa640 1 -- 172.21.15.102:0/3560965277 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bec0460d0 con 0x557971043d40 2024-09-13T19:18:04.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.220+0000 7f6ad57fa640 1 -- 172.21.15.102:0/3560965277 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bec02a910 con 0x557971043d40 2024-09-13T19:18:04.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.220+0000 7f6ad57fa640 1 -- 172.21.15.102:0/3560965277 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bec02a3f0 con 0x557971043d40 2024-09-13T19:18:04.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.220+0000 7f6bf4119800 1 -- 172.21.15.102:0/3560965277 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557971043d40 msgr2=0x557971044140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.220+0000 7f6bf4119800 1 --2- 172.21.15.102:0/3560965277 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557971043d40 0x557971044140 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f6bec016cd0 tx=0x7f6bec01fee0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.220+0000 7f6bf4119800 1 -- 172.21.15.102:0/3560965277 shutdown_connections 2024-09-13T19:18:04.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.220+0000 7f6bf4119800 1 --2- 172.21.15.102:0/3560965277 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557971043d40 0x557971044140 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.220+0000 7f6bf4119800 1 -- 172.21.15.102:0/3560965277 >> 172.21.15.102:0/3560965277 conn(0x5579710400a0 msgr2=0x55797103e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:04.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.221+0000 7f6bf4119800 1 -- 172.21.15.102:0/3560965277 shutdown_connections 2024-09-13T19:18:04.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.221+0000 7f6bf4119800 1 -- 172.21.15.102:0/3560965277 wait complete. 2024-09-13T19:18:04.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.221+0000 7f6bf4119800 1 Processor -- start 2024-09-13T19:18:04.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.221+0000 7f6bf4119800 1 -- start start 2024-09-13T19:18:04.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.221+0000 7f6bf4119800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557971043d40 0x55797104b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:04.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.221+0000 7f6bf4119800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x557971044d80 con 0x557971043d40 2024-09-13T19:18:04.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.221+0000 7f6bf240e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557971043d40 0x55797104b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:04.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.221+0000 7f6bf240e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557971043d40 0x55797104b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:50240/0 (socket says 172.21.15.102:50240) 2024-09-13T19:18:04.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.221+0000 7f6bf240e640 1 -- 172.21.15.102:0/876319723 learned_addr learned my addr 172.21.15.102:0/876319723 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:04.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.221+0000 7f6bf240e640 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55797104b730 con 0x557971043d40 2024-09-13T19:18:04.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.222+0000 7f6bf240e640 1 --2- 172.21.15.102:0/876319723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557971043d40 0x55797104b1f0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f6bec01ff70 tx=0x7f6bec04cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:04.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.222+0000 7f6ac37fe640 1 -- 172.21.15.102:0/876319723 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bec036020 con 0x557971043d40 2024-09-13T19:18:04.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.222+0000 7f6ac37fe640 1 -- 172.21.15.102:0/876319723 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bec029ca0 con 0x557971043d40 2024-09-13T19:18:04.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.222+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55797104b9c0 con 0x557971043d40 2024-09-13T19:18:04.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.222+0000 7f6ac37fe640 1 -- 172.21.15.102:0/876319723 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bec02e040 con 0x557971043d40 2024-09-13T19:18:04.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.222+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55797104e670 con 0x557971043d40 2024-09-13T19:18:04.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.222+0000 7f6ac37fe640 1 -- 172.21.15.102:0/876319723 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6bec039020 con 0x557971043d40 2024-09-13T19:18:04.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.223+0000 7f6ac37fe640 1 --2- 172.21.15.102:0/876319723 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6abc036b40 0x7f6abc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:04.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.223+0000 7f6ac37fe640 1 -- 172.21.15.102:0/876319723 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f6bec03cd10 con 0x557971043d40 2024-09-13T19:18:04.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.223+0000 7f6bf1c0d640 1 --2- 172.21.15.102:0/876319723 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6abc036b40 0x7f6abc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:04.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.223+0000 7f6bf1c0d640 1 --2- 172.21.15.102:0/876319723 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6abc036b40 0x7f6abc039000 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f6be400bfe0 tx=0x7f6be4031000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:04.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.223+0000 7f6bf4119800 20 rados->read ofs=0 len=0 2024-09-13T19:18:04.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.223+0000 7f6bf4119800 1 --2- 172.21.15.102:0/876319723 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557971056cf0 0x5579710591b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:04.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.223+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557971059900 con 0x557971056cf0 2024-09-13T19:18:04.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.223+0000 7f6bf140c640 1 --2- 172.21.15.102:0/876319723 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557971056cf0 0x5579710591b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:04.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.224+0000 7f6bf140c640 1 --2- 172.21.15.102:0/876319723 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557971056cf0 0x5579710591b0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:04.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.224+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6be8050050 con 0x557971056cf0 2024-09-13T19:18:04.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.224+0000 7f6bf4119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:04.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.224+0000 7f6bf4119800 20 realm 2024-09-13T19:18:04.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.224+0000 7f6bf4119800 20 rados->read ofs=0 len=0 2024-09-13T19:18:04.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.224+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557971059d30 con 0x557971056cf0 2024-09-13T19:18:04.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.224+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6be8050050 con 0x557971056cf0 2024-09-13T19:18:04.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.224+0000 7f6bf4119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:04.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.224+0000 7f6bf4119800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:18:04.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.224+0000 7f6bf4119800 20 rados->read ofs=0 len=0 2024-09-13T19:18:04.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.224+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55797105a600 con 0x557971056cf0 2024-09-13T19:18:04.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.224+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6be8050050 con 0x557971056cf0 2024-09-13T19:18:04.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.224+0000 7f6bf4119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:04.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.224+0000 7f6bf4119800 20 rados->read ofs=0 len=0 2024-09-13T19:18:04.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.224+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55797105a9a0 con 0x557971056cf0 2024-09-13T19:18:04.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.225+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6be8050050 con 0x557971056cf0 2024-09-13T19:18:04.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.225+0000 7f6bf4119800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:18:04.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.225+0000 7f6bf4119800 20 rados->read ofs=0 len=0 2024-09-13T19:18:04.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.225+0000 7f6bf4119800 1 --2- 172.21.15.102:0/876319723 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55797105b700 0x55797105daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:04.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.225+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55797105e100 con 0x55797105b700 2024-09-13T19:18:04.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.225+0000 7f6bf240e640 1 --2- 172.21.15.102:0/876319723 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55797105b700 0x55797105daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:04.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.225+0000 7f6bf240e640 1 --2- 172.21.15.102:0/876319723 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55797105b700 0x55797105daf0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:04.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.225+0000 7f6bf240e640 1 -- 172.21.15.102:0/876319723 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6bec00a4a0 con 0x55797105b700 2024-09-13T19:18:04.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.225+0000 7f6bf4119800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:18:04.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.225+0000 7f6bf4119800 20 searching for the correct realm 2024-09-13T19:18:04.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.225+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55797105fa10 con 0x55797105b700 2024-09-13T19:18:04.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.226+0000 7f6bf240e640 1 -- 172.21.15.102:0/876319723 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bec00a4a0 con 0x55797105b700 2024-09-13T19:18:04.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.226+0000 7f6bf240e640 1 --2- 172.21.15.102:0/876319723 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f6bec03b020 0x7f6bec040610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:04.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.226+0000 7f6bf240e640 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55797105fa10 con 0x7f6bec03b020 2024-09-13T19:18:04.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.226+0000 7f6bf1c0d640 1 --2- 172.21.15.102:0/876319723 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f6bec03b020 0x7f6bec040610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:04.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.226+0000 7f6bf1c0d640 1 --2- 172.21.15.102:0/876319723 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f6bec03b020 0x7f6bec040610 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:04.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.226+0000 7f6bf1c0d640 1 -- 172.21.15.102:0/876319723 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6be402e070 con 0x7f6bec03b020 2024-09-13T19:18:04.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.226+0000 7f6bf1c0d640 1 --2- 172.21.15.102:0/876319723 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f6be4058040 0x7f6be403f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:04.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.226+0000 7f6bf1c0d640 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55797105fa10 con 0x7f6be4058040 2024-09-13T19:18:04.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.226+0000 7f6bf140c640 1 --2- 172.21.15.102:0/876319723 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f6be4058040 0x7f6be403f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:04.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.227+0000 7f6bf140c640 1 --2- 172.21.15.102:0/876319723 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f6be4058040 0x7f6be403f650 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:04.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.227+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6be8050050 con 0x7f6be4058040 2024-09-13T19:18:04.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.227+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55797105fa10 con 0x557971056cf0 2024-09-13T19:18:04.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.227+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6be8050050 con 0x557971056cf0 2024-09-13T19:18:04.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.227+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55797105fa10 con 0x557971056cf0 2024-09-13T19:18:04.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.227+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6be8050050 con 0x557971056cf0 2024-09-13T19:18:04.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.227+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55797105fa10 con 0x7f6be4058040 2024-09-13T19:18:04.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.228+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6be8050050 con 0x7f6be4058040 2024-09-13T19:18:04.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.228+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55797105fa10 con 0x7f6be4058040 2024-09-13T19:18:04.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.228+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6be8050050 con 0x7f6be4058040 2024-09-13T19:18:04.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.228+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55797105fa10 con 0x7f6bec03b020 2024-09-13T19:18:04.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.228+0000 7f6bf1c0d640 1 -- 172.21.15.102:0/876319723 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6be402e070 con 0x7f6bec03b020 2024-09-13T19:18:04.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.228+0000 7f6bf1c0d640 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55797105fa10 con 0x55797105b700 2024-09-13T19:18:04.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.228+0000 7f6bf240e640 1 -- 172.21.15.102:0/876319723 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bec00a4a0 con 0x55797105b700 2024-09-13T19:18:04.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.228+0000 7f6bf240e640 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55797105fa10 con 0x557971056cf0 2024-09-13T19:18:04.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.229+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6be8050050 con 0x557971056cf0 2024-09-13T19:18:04.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.229+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55797105fa10 con 0x7f6bec03b020 2024-09-13T19:18:04.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.229+0000 7f6bf1c0d640 1 -- 172.21.15.102:0/876319723 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6be402e070 con 0x7f6bec03b020 2024-09-13T19:18:04.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.229+0000 7f6bf1c0d640 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55797105fa10 con 0x557971056cf0 2024-09-13T19:18:04.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.229+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6be8050050 con 0x557971056cf0 2024-09-13T19:18:04.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.229+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55797105fa10 con 0x7f6bec03b020 2024-09-13T19:18:04.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.229+0000 7f6bf1c0d640 1 -- 172.21.15.102:0/876319723 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6be402e070 con 0x7f6bec03b020 2024-09-13T19:18:04.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.229+0000 7f6bf1c0d640 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55797105fa10 con 0x55797105b700 2024-09-13T19:18:04.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.229+0000 7f6bf240e640 1 -- 172.21.15.102:0/876319723 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bec00a4a0 con 0x55797105b700 2024-09-13T19:18:04.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.230+0000 7f6bf240e640 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55797105fa10 con 0x55797105b700 2024-09-13T19:18:04.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.230+0000 7f6bf240e640 1 -- 172.21.15.102:0/876319723 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6bec00a4a0 con 0x55797105b700 2024-09-13T19:18:04.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.230+0000 7f6bf240e640 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55797105fa10 con 0x7f6be4058040 2024-09-13T19:18:04.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.230+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6be8050050 con 0x7f6be4058040 2024-09-13T19:18:04.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.230+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55797105fa10 con 0x55797105b700 2024-09-13T19:18:04.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.230+0000 7f6bf240e640 1 -- 172.21.15.102:0/876319723 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6bec00a4a0 con 0x55797105b700 2024-09-13T19:18:04.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.230+0000 7f6bf240e640 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55797105fa10 con 0x55797105b700 2024-09-13T19:18:04.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.230+0000 7f6bf240e640 1 -- 172.21.15.102:0/876319723 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bec00a4a0 con 0x55797105b700 2024-09-13T19:18:04.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.230+0000 7f6bf240e640 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55797105fa10 con 0x557971056cf0 2024-09-13T19:18:04.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.231+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6be8050050 con 0x557971056cf0 2024-09-13T19:18:04.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.231+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55797105fa10 con 0x557971056cf0 2024-09-13T19:18:04.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.231+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6be8050050 con 0x557971056cf0 2024-09-13T19:18:04.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.231+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55797105fa10 con 0x7f6be4058040 2024-09-13T19:18:04.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.231+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6be8050050 con 0x7f6be4058040 2024-09-13T19:18:04.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.231+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55797105fa10 con 0x55797105b700 2024-09-13T19:18:04.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.231+0000 7f6bf240e640 1 -- 172.21.15.102:0/876319723 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bec00a4a0 con 0x55797105b700 2024-09-13T19:18:04.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.231+0000 7f6bf240e640 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55797105fa10 con 0x7f6bec03b020 2024-09-13T19:18:04.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.232+0000 7f6bf1c0d640 1 -- 172.21.15.102:0/876319723 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6be402e070 con 0x7f6bec03b020 2024-09-13T19:18:04.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.232+0000 7f6bf1c0d640 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55797105fa10 con 0x557971056cf0 2024-09-13T19:18:04.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.232+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6be8050050 con 0x557971056cf0 2024-09-13T19:18:04.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.232+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55797105fa10 con 0x7f6bec03b020 2024-09-13T19:18:04.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.232+0000 7f6bf1c0d640 1 -- 172.21.15.102:0/876319723 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6be402e070 con 0x7f6bec03b020 2024-09-13T19:18:04.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.232+0000 7f6bf1c0d640 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55797105fa10 con 0x55797105b700 2024-09-13T19:18:04.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.232+0000 7f6bf240e640 1 -- 172.21.15.102:0/876319723 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bec00a4a0 con 0x55797105b700 2024-09-13T19:18:04.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.232+0000 7f6bf240e640 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55797105fa10 con 0x7f6be4058040 2024-09-13T19:18:04.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.233+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6be8050050 con 0x7f6be4058040 2024-09-13T19:18:04.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.233+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55797105fa10 con 0x7f6bec03b020 2024-09-13T19:18:04.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.233+0000 7f6bf1c0d640 1 -- 172.21.15.102:0/876319723 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6be402e070 con 0x7f6bec03b020 2024-09-13T19:18:04.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.233+0000 7f6bf1c0d640 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55797105fa10 con 0x55797105b700 2024-09-13T19:18:04.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.233+0000 7f6bf240e640 1 -- 172.21.15.102:0/876319723 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bec00a4a0 con 0x55797105b700 2024-09-13T19:18:04.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.233+0000 7f6bf240e640 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55797105fa10 con 0x7f6be4058040 2024-09-13T19:18:04.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.233+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6be8050050 con 0x7f6be4058040 2024-09-13T19:18:04.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.233+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55797105fa10 con 0x557971056cf0 2024-09-13T19:18:04.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.234+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v36'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6be8050050 con 0x557971056cf0 2024-09-13T19:18:04.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.234+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55797105fa10 con 0x7f6bec03b020 2024-09-13T19:18:04.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.234+0000 7f6bf1c0d640 1 -- 172.21.15.102:0/876319723 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6be402e070 con 0x7f6bec03b020 2024-09-13T19:18:04.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.234+0000 7f6bf4119800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:18:04.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.234+0000 7f6bf4119800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:18:04.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.234+0000 7f6bf4119800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:18:04.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.234+0000 7f6bf4119800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:18:04.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.234+0000 7f6bf4119800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:18:04.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.234+0000 7f6bf4119800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:18:04.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.234+0000 7f6bf4119800 20 rados->read ofs=0 len=0 2024-09-13T19:18:04.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.234+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55797105f5e0 con 0x557971056cf0 2024-09-13T19:18:04.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.234+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6be8050050 con 0x557971056cf0 2024-09-13T19:18:04.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.234+0000 7f6bf4119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:04.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.234+0000 7f6bf4119800 20 rados->read ofs=0 len=0 2024-09-13T19:18:04.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.234+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55797105ee50 con 0x557971056cf0 2024-09-13T19:18:04.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.234+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6be807e040 con 0x557971056cf0 2024-09-13T19:18:04.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.234+0000 7f6bf4119800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:18:04.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.234+0000 7f6bf4119800 20 rados->read ofs=0 len=0 2024-09-13T19:18:04.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.234+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55797105fe90 con 0x55797105b700 2024-09-13T19:18:04.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.235+0000 7f6bf240e640 1 -- 172.21.15.102:0/876319723 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6bec00a4a0 con 0x55797105b700 2024-09-13T19:18:04.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.235+0000 7f6bf4119800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:18:04.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.235+0000 7f6bf4119800 20 zone default found 2024-09-13T19:18:04.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.235+0000 7f6bf4119800 4 Realm: () 2024-09-13T19:18:04.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.235+0000 7f6bf4119800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:18:04.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.235+0000 7f6bf4119800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:18:04.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.235+0000 7f6bf4119800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:18:04.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.235+0000 7f6bf4119800 20 zonegroup default 2024-09-13T19:18:04.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.235+0000 7f6bf4119800 20 rados->read ofs=0 len=0 2024-09-13T19:18:04.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.235+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55797105ea80 con 0x7f6bec03b020 2024-09-13T19:18:04.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.235+0000 7f6bf1c0d640 1 -- 172.21.15.102:0/876319723 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6be402e070 con 0x7f6bec03b020 2024-09-13T19:18:04.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.235+0000 7f6bf4119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:04.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.235+0000 7f6bf4119800 20 rados->read ofs=0 len=0 2024-09-13T19:18:04.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.235+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5579710625f0 con 0x55797105b700 2024-09-13T19:18:04.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.235+0000 7f6bf240e640 1 -- 172.21.15.102:0/876319723 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6bec00a4a0 con 0x55797105b700 2024-09-13T19:18:04.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.235+0000 7f6bf4119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:04.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.235+0000 7f6bf4119800 20 rados->read ofs=0 len=0 2024-09-13T19:18:04.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.235+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557971062990 con 0x55797105b700 2024-09-13T19:18:04.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.235+0000 7f6bf240e640 1 -- 172.21.15.102:0/876319723 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6bec00a4a0 con 0x55797105b700 2024-09-13T19:18:04.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.235+0000 7f6bf4119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:04.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.235+0000 7f6bf4119800 20 started sync module instance, tier type = 2024-09-13T19:18:04.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.235+0000 7f6bf4119800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:18:04.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.235+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557971061a80 con 0x7f6bec03b020 2024-09-13T19:18:04.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.236+0000 7f6bf1c0d640 1 -- 172.21.15.102:0/876319723 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(44 notify.0 [create] v36'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6be402e070 con 0x7f6bec03b020 2024-09-13T19:18:04.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.236+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93980075630192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5579710631e0 con 0x7f6bec03b020 2024-09-13T19:18:04.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.236+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557971063a30 con 0x557971056cf0 2024-09-13T19:18:04.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.237+0000 7f6bf1c0d640 1 -- 172.21.15.102:0/876319723 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93980075630192] v36'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6be402e070 con 0x7f6bec03b020 2024-09-13T19:18:04.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.238+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v36'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6be807e040 con 0x557971056cf0 2024-09-13T19:18:04.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.238+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93980075636096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557971063dd0 con 0x557971056cf0 2024-09-13T19:18:04.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.238+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557971064890 con 0x55797105b700 2024-09-13T19:18:04.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.239+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93980075636096] v36'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6be807e040 con 0x557971056cf0 2024-09-13T19:18:04.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.239+0000 7f6bf240e640 1 -- 172.21.15.102:0/876319723 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v36'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bec00a4a0 con 0x55797105b700 2024-09-13T19:18:04.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.239+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93980075639648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557971064c80 con 0x55797105b700 2024-09-13T19:18:04.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.239+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5579710656a0 con 0x7f6bec03b020 2024-09-13T19:18:04.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.240+0000 7f6bf240e640 1 -- 172.21.15.102:0/876319723 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93980075639648] v36'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bec00a4a0 con 0x55797105b700 2024-09-13T19:18:04.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.240+0000 7f6bf1c0d640 1 -- 172.21.15.102:0/876319723 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(50 notify.3 [create] v36'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6be402e070 con 0x7f6bec03b020 2024-09-13T19:18:04.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.240+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93980075643280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557971065a90 con 0x7f6bec03b020 2024-09-13T19:18:04.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.240+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5579710664d0 con 0x557971056cf0 2024-09-13T19:18:04.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.241+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v36'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6be807e040 con 0x557971056cf0 2024-09-13T19:18:04.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.241+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93980075646880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5579710664d0 con 0x557971056cf0 2024-09-13T19:18:04.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.241+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5579710674d0 con 0x7f6be4058040 2024-09-13T19:18:04.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.241+0000 7f6bf1c0d640 1 -- 172.21.15.102:0/876319723 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93980075643280] v36'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6be402e070 con 0x7f6bec03b020 2024-09-13T19:18:04.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.243+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93980075646880] v36'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6be807e040 con 0x557971056cf0 2024-09-13T19:18:04.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.243+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(54 notify.5 [create] v36'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6be807e040 con 0x7f6be4058040 2024-09-13T19:18:04.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.243+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93980075651008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557971067490 con 0x7f6be4058040 2024-09-13T19:18:04.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.243+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557971067d70 con 0x7f6be4058040 2024-09-13T19:18:04.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.244+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 93980075651008] v36'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6be807e040 con 0x7f6be4058040 2024-09-13T19:18:04.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.244+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(56 notify.6 [create] v36'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6be807e040 con 0x7f6be4058040 2024-09-13T19:18:04.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.244+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93980075633968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557971067940 con 0x7f6be4058040 2024-09-13T19:18:04.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.244+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557971068380 con 0x7f6be4058040 2024-09-13T19:18:04.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.245+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 93980075633968] v36'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6be807e040 con 0x7f6be4058040 2024-09-13T19:18:04.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.245+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(58 notify.7 [create] v36'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6be807e040 con 0x7f6be4058040 2024-09-13T19:18:04.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.245+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93980075654784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557971067940 con 0x7f6be4058040 2024-09-13T19:18:04.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.245+0000 7f6bf4119800 20 add_watcher() i=0 2024-09-13T19:18:04.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.245+0000 7f6bf4119800 20 add_watcher() i=1 2024-09-13T19:18:04.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.245+0000 7f6bf4119800 20 add_watcher() i=2 2024-09-13T19:18:04.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.245+0000 7f6bf4119800 20 add_watcher() i=3 2024-09-13T19:18:04.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.245+0000 7f6bf4119800 20 add_watcher() i=4 2024-09-13T19:18:04.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.245+0000 7f6bf4119800 20 add_watcher() i=5 2024-09-13T19:18:04.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.245+0000 7f6bf4119800 20 add_watcher() i=6 2024-09-13T19:18:04.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.246+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 93980075654784] v36'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6be807e040 con 0x7f6be4058040 2024-09-13T19:18:04.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.246+0000 7f6bf4119800 20 add_watcher() i=7 2024-09-13T19:18:04.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.246+0000 7f6bf4119800 2 all 8 watchers are set, enabling cache 2024-09-13T19:18:04.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.246+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55797106b800 con 0x557971056cf0 2024-09-13T19:18:04.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.246+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6be807e040 con 0x557971056cf0 2024-09-13T19:18:04.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.246+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93980075652704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557971068cc0 con 0x557971056cf0 2024-09-13T19:18:04.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.247+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93980075652704] v36'269 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6be807e040 con 0x557971056cf0 2024-09-13T19:18:04.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.248+0000 7f6aa37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:18:04.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.248+0000 7f6bf4119800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:18:04.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.248+0000 7f6bf4119800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:18:04.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.248+0000 7f6bf4119800 5 note: GC not initialized 2024-09-13T19:18:04.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.248+0000 7f6aa27fc640 20 reqs_thread_entry: start 2024-09-13T19:18:04.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.248+0000 7f6bf4119800 20 init_complete bucket index max shards: 11 2024-09-13T19:18:04.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.248+0000 7f6bf4119800 20 Filter name: none 2024-09-13T19:18:04.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.248+0000 7f6a13fff640 20 reqs_thread_entry: start 2024-09-13T19:18:04.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.248+0000 7f6bf4119800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T19:18:04.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.248+0000 7f6bf4119800 20 rados->read ofs=0 len=0 2024-09-13T19:18:04.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.248+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55797109ebc0 con 0x7f6be4058040 2024-09-13T19:18:04.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.249+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f6be807e040 con 0x7f6be4058040 2024-09-13T19:18:04.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.249+0000 7f6bf4119800 20 rados_obj.operate() r=0 bl.length=460 2024-09-13T19:18:04.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.249+0000 7f6bf4119800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T19:18:04.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.249+0000 7f6bf4119800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:18:04.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.249+0000 7f6bf4119800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:18:04.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.249+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5579710a5270 con 0x7f6be4058040 2024-09-13T19:18:04.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.250+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v36'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f6be807e040 con 0x7f6be4058040 2024-09-13T19:18:04.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.250+0000 7f6bf4119800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:18:04.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.250+0000 7f6bf4119800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:18:04.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.250+0000 7f6bf4119800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T19:18:04.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.250+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93980075904048 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5579710a08b0 con 0x557971056cf0 2024-09-13T19:18:04.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.251+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== watch-notify(notify (1) cookie 93980075646880 notify 154618822702 ret 0) ==== 691+0+0 (crc 0 0 0) 0x557970deae00 con 0x557971056cf0 2024-09-13T19:18:04.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.251+0000 7f6ad57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822702 cookie 93980075646880 notifier 4923 bl.length()=649 2024-09-13T19:18:04.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.251+0000 7f6ad57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:18:04.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.251+0000 7f6ad57fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:18:04.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.251+0000 7f6ad57fa640 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f6ab4003ea0 con 0x557971056cf0 2024-09-13T19:18:04.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.251+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(64 notify.4 [notify cookie 93980075904048 out=8b] v0'0 uv276 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6be807e040 con 0x557971056cf0 2024-09-13T19:18:04.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.251+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6be807e040 con 0x557971056cf0 2024-09-13T19:18:04.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.251+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== watch-notify(notify_complete (2) cookie 93980075904048 notify 154618822702 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6be805c760 con 0x557971056cf0 2024-09-13T19:18:04.266 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T19:18:02.251000Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:18:02.250985Z","tags":[],"group_ids":[]} 2024-09-13T19:18:04.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.252+0000 7f6aa37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:18:04.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.252+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93980075652704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5579710a1070 con 0x557971056cf0 2024-09-13T19:18:04.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.253+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93980075652704] v36'270 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6be807e040 con 0x557971056cf0 2024-09-13T19:18:04.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.253+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93980075630192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5579710a1070 con 0x7f6bec03b020 2024-09-13T19:18:04.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.254+0000 7f6bf1c0d640 1 -- 172.21.15.102:0/876319723 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93980075630192] v36'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6be402e070 con 0x7f6bec03b020 2024-09-13T19:18:04.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.254+0000 7f6bf4119800 20 remove_watcher() i=0 2024-09-13T19:18:04.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.254+0000 7f6bf4119800 2 removed watcher, disabling cache 2024-09-13T19:18:04.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.254+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93980075636096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5579710a1070 con 0x557971056cf0 2024-09-13T19:18:04.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.255+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93980075636096] v36'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6be807e040 con 0x557971056cf0 2024-09-13T19:18:04.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.255+0000 7f6bf4119800 20 remove_watcher() i=1 2024-09-13T19:18:04.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.255+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93980075639648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5579710a1070 con 0x55797105b700 2024-09-13T19:18:04.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.256+0000 7f6bf240e640 1 -- 172.21.15.102:0/876319723 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93980075639648] v36'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bec00a4a0 con 0x55797105b700 2024-09-13T19:18:04.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.257+0000 7f6bf4119800 20 remove_watcher() i=2 2024-09-13T19:18:04.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.257+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93980075643280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5579710a1070 con 0x7f6bec03b020 2024-09-13T19:18:04.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.257+0000 7f6bf1c0d640 1 -- 172.21.15.102:0/876319723 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93980075643280] v36'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6be402e070 con 0x7f6bec03b020 2024-09-13T19:18:04.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.257+0000 7f6bf4119800 20 remove_watcher() i=3 2024-09-13T19:18:04.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.257+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93980075646880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5579710a1070 con 0x557971056cf0 2024-09-13T19:18:04.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.259+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93980075646880] v36'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6be807e040 con 0x557971056cf0 2024-09-13T19:18:04.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.259+0000 7f6bf4119800 20 remove_watcher() i=4 2024-09-13T19:18:04.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.259+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93980075651008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5579710a1070 con 0x7f6be4058040 2024-09-13T19:18:04.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.260+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93980075651008] v36'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6be807e040 con 0x7f6be4058040 2024-09-13T19:18:04.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.260+0000 7f6bf4119800 20 remove_watcher() i=5 2024-09-13T19:18:04.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.260+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93980075633968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55797109c900 con 0x7f6be4058040 2024-09-13T19:18:04.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.261+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93980075633968] v36'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6be807e040 con 0x7f6be4058040 2024-09-13T19:18:04.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.261+0000 7f6bf4119800 20 remove_watcher() i=6 2024-09-13T19:18:04.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.261+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93980075654784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55797109c900 con 0x7f6be4058040 2024-09-13T19:18:04.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.262+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93980075654784] v36'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6be807e040 con 0x7f6be4058040 2024-09-13T19:18:04.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.262+0000 7f6bf4119800 20 remove_watcher() i=7 2024-09-13T19:18:04.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.262+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f6be4058040 msgr2=0x7f6be403f650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.262+0000 7f6bf4119800 1 --2- 172.21.15.102:0/876319723 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f6be4058040 0x7f6be403f650 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.262+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557971056cf0 msgr2=0x5579710591b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.262+0000 7f6bf4119800 1 --2- 172.21.15.102:0/876319723 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557971056cf0 0x5579710591b0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.262+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f6bec03b020 msgr2=0x7f6bec040610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.262+0000 7f6bf4119800 1 --2- 172.21.15.102:0/876319723 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f6bec03b020 0x7f6bec040610 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.262+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55797105b700 msgr2=0x55797105daf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.262+0000 7f6bf4119800 1 --2- 172.21.15.102:0/876319723 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55797105b700 0x55797105daf0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.262+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6abc036b40 msgr2=0x7f6abc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.262+0000 7f6bf4119800 1 --2- 172.21.15.102:0/876319723 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6abc036b40 0x7f6abc039000 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f6be400bfe0 tx=0x7f6be4031000 comp rx=0 tx=0).stop 2024-09-13T19:18:04.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.262+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557971043d40 msgr2=0x55797104b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.262+0000 7f6bf4119800 1 --2- 172.21.15.102:0/876319723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557971043d40 0x55797104b1f0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f6bec01ff70 tx=0x7f6bec04cd10 comp rx=0 tx=0).stop 2024-09-13T19:18:04.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.262+0000 7f6bf140c640 1 -- 172.21.15.102:0/876319723 reap_dead start 2024-09-13T19:18:04.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.262+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 shutdown_connections 2024-09-13T19:18:04.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.262+0000 7f6bf4119800 1 --2- 172.21.15.102:0/876319723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557971043d40 0x55797104b1f0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.262+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 >> 172.21.15.102:0/876319723 conn(0x5579710400a0 msgr2=0x55797103e170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:04.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.262+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 shutdown_connections 2024-09-13T19:18:04.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.262+0000 7f6bf4119800 1 -- 172.21.15.102:0/876319723 wait complete. 2024-09-13T19:18:04.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.262+0000 7f6bf4119800 1 -- 172.21.15.102:0/3942792351 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6acc036b90 msgr2=0x7f6acc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.262+0000 7f6bf4119800 1 --2- 172.21.15.102:0/3942792351 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6acc036b90 0x7f6acc039050 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x557971024aa0 tx=0x7f6be404b0e0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.262+0000 7f6bf4119800 1 -- 172.21.15.102:0/3942792351 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579710370a0 msgr2=0x5579710374c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.262+0000 7f6bf4119800 1 --2- 172.21.15.102:0/3942792351 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579710370a0 0x5579710374c0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x55797101d6f0 tx=0x7f6bec0167b0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.262+0000 7f6bf4119800 1 -- 172.21.15.102:0/3942792351 shutdown_connections 2024-09-13T19:18:04.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.262+0000 7f6bf4119800 1 --2- 172.21.15.102:0/3942792351 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6acc036b90 0x7f6acc039050 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.262+0000 7f6bf4119800 1 --2- 172.21.15.102:0/3942792351 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579710370a0 0x5579710374c0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.262+0000 7f6bf4119800 1 -- 172.21.15.102:0/3942792351 >> 172.21.15.102:0/3942792351 conn(0x55797102c030 msgr2=0x55797102ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:04.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.263+0000 7f6bf4119800 1 -- 172.21.15.102:0/3942792351 shutdown_connections 2024-09-13T19:18:04.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.263+0000 7f6bf4119800 1 -- 172.21.15.102:0/3942792351 wait complete. 2024-09-13T19:18:04.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.263+0000 7f6bf4119800 1 -- 172.21.15.102:0/2432877259 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557970f29d40 msgr2=0x557971023360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.263+0000 7f6bf4119800 1 --2- 172.21.15.102:0/2432877259 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557970f29d40 0x557971023360 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.263+0000 7f6bf4119800 1 -- 172.21.15.102:0/2432877259 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x557971025c30 msgr2=0x557971028020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.263+0000 7f6bf4119800 1 --2- 172.21.15.102:0/2432877259 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x557971025c30 0x557971028020 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.263+0000 7f6bf4119800 1 -- 172.21.15.102:0/2432877259 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6ad8036b40 msgr2=0x7f6ad8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.263+0000 7f6bf4119800 1 --2- 172.21.15.102:0/2432877259 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6ad8036b40 0x7f6ad8039000 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6be8057000 tx=0x7f6be8052000 comp rx=0 tx=0).stop 2024-09-13T19:18:04.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.263+0000 7f6bf4119800 1 -- 172.21.15.102:0/2432877259 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557970e97610 msgr2=0x55797101c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.263+0000 7f6bf4119800 1 --2- 172.21.15.102:0/2432877259 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557970e97610 0x55797101c2f0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f6be4001d80 tx=0x7f6be4000ed0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.263+0000 7f6bf4119800 1 -- 172.21.15.102:0/2432877259 shutdown_connections 2024-09-13T19:18:04.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.263+0000 7f6bf4119800 1 --2- 172.21.15.102:0/2432877259 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x557971025c30 0x557971028020 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.263+0000 7f6bf4119800 1 --2- 172.21.15.102:0/2432877259 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x557970f29d40 0x557971023360 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.263+0000 7f6bf4119800 1 --2- 172.21.15.102:0/2432877259 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f6ad8036b40 0x7f6ad8039000 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.263+0000 7f6bf4119800 1 --2- 172.21.15.102:0/2432877259 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557970e97610 0x55797101c2f0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.263+0000 7f6bf4119800 1 -- 172.21.15.102:0/2432877259 >> 172.21.15.102:0/2432877259 conn(0x557970f1ddb0 msgr2=0x55797100eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:04.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.263+0000 7f6bf4119800 1 -- 172.21.15.102:0/2432877259 shutdown_connections 2024-09-13T19:18:04.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.263+0000 7f6bf4119800 1 -- 172.21.15.102:0/2432877259 wait complete. 2024-09-13T19:18:04.277 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:18:02.251000Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:18:02.250985Z', 'tags': [], 'group_ids': []} 2024-09-13T19:18:04.277 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:18:02.251000Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:18:02.250985Z', 'tags': [], 'group_ids': []} 2024-09-13T19:18:04.278 ERROR:root:0 2024-09-13T19:18:04.278 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T19:18:04.278 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T19:18:04.278 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-13T19:18:04.324 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:18:04.324 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:18:04.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.322+0000 7fa7fcb3e800 1 Processor -- start 2024-09-13T19:18:04.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.322+0000 7fa7fcb3e800 1 -- start start 2024-09-13T19:18:04.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.322+0000 7fa7fcb3e800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55eca1074d20 0x55eca1077110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:04.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.322+0000 7fa7fcb3e800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55eca0f2db30 con 0x55eca0fe2630 2024-09-13T19:18:04.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.322+0000 7fa7fcb3e800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55eca0f0f360 con 0x55eca1074d20 2024-09-13T19:18:04.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.322+0000 7fa7f3fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55eca1074d20 0x55eca1077110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:04.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.323+0000 7fa7f3fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55eca1074d20 0x55eca1077110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:50250/0 (socket says 172.21.15.102:50250) 2024-09-13T19:18:04.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.323+0000 7fa7f3fff640 1 -- 172.21.15.102:0/1802646130 learned_addr learned my addr 172.21.15.102:0/1802646130 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:04.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.323+0000 7fa7f3fff640 1 -- 172.21.15.102:0/1802646130 >> v1:172.21.15.53:6789/0 conn(0x55eca0fe2630 legacy=0x55eca1073600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.323+0000 7fa7f37fe640 1 -- 172.21.15.102:0/1802646130 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3395343294 0 0) 0x55eca0f2db30 con 0x55eca0fe2630 2024-09-13T19:18:04.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.323+0000 7fa7f3fff640 1 -- 172.21.15.102:0/1802646130 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eca0f35e00 con 0x55eca1074d20 2024-09-13T19:18:04.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.325+0000 7fa7f3fff640 1 --2- 172.21.15.102:0/1802646130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca1074d20 0x55eca1077110 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fa7e400a520 tx=0x7fa7e4045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e17bd4eb8bc3c800 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:04.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.325+0000 7fa7f37fe640 1 -- 172.21.15.102:0/1802646130 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7e4055070 con 0x55eca1074d20 2024-09-13T19:18:04.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.325+0000 7fa7f37fe640 1 -- 172.21.15.102:0/1802646130 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7e40515b0 con 0x55eca1074d20 2024-09-13T19:18:04.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.325+0000 7fa7f37fe640 1 -- 172.21.15.102:0/1802646130 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7e40518d0 con 0x55eca1074d20 2024-09-13T19:18:04.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.325+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/1802646130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca1074d20 msgr2=0x55eca1077110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.325+0000 7fa7fcb3e800 1 --2- 172.21.15.102:0/1802646130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca1074d20 0x55eca1077110 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fa7e400a520 tx=0x7fa7e4045ba0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.325+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/1802646130 shutdown_connections 2024-09-13T19:18:04.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.325+0000 7fa7fcb3e800 1 --2- 172.21.15.102:0/1802646130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca1074d20 0x55eca1077110 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.325+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/1802646130 >> 172.21.15.102:0/1802646130 conn(0x55eca1068db0 msgr2=0x55eca106b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:04.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.325+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/1802646130 shutdown_connections 2024-09-13T19:18:04.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.325+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/1802646130 wait complete. 2024-09-13T19:18:04.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.339+0000 7fa7fcb3e800 1 Processor -- start 2024-09-13T19:18:04.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.339+0000 7fa7fcb3e800 1 -- start start 2024-09-13T19:18:04.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.339+0000 7fa7fcb3e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca0fe2630 0x55eca115f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:04.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.339+0000 7fa7fcb3e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55eca0fba360 con 0x55eca0fe2630 2024-09-13T19:18:04.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.340+0000 7fa7f883b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca0fe2630 0x55eca115f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:04.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.340+0000 7fa7f883b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca0fe2630 0x55eca115f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:50266/0 (socket says 172.21.15.102:50266) 2024-09-13T19:18:04.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.340+0000 7fa7f883b640 1 -- 172.21.15.102:0/2853249476 learned_addr learned my addr 172.21.15.102:0/2853249476 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:04.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.340+0000 7fa7f883b640 1 -- 172.21.15.102:0/2853249476 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eca0f07bc0 con 0x55eca0fe2630 2024-09-13T19:18:04.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.340+0000 7fa7f883b640 1 --2- 172.21.15.102:0/2853249476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca0fe2630 0x55eca115f880 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec001e30 tx=0x7fa7ec00b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=438f45b4d816cf92 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:04.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.340+0000 7fa6e6e05640 1 -- 172.21.15.102:0/2853249476 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7ec016070 con 0x55eca0fe2630 2024-09-13T19:18:04.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.340+0000 7fa6e6e05640 1 -- 172.21.15.102:0/2853249476 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7ec00d4b0 con 0x55eca0fe2630 2024-09-13T19:18:04.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.340+0000 7fa6e6e05640 1 -- 172.21.15.102:0/2853249476 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7ec00d810 con 0x55eca0fe2630 2024-09-13T19:18:04.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.341+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/2853249476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca0fe2630 msgr2=0x55eca115f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.341+0000 7fa7fcb3e800 1 --2- 172.21.15.102:0/2853249476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca0fe2630 0x55eca115f880 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec001e30 tx=0x7fa7ec00b650 comp rx=0 tx=0).stop 2024-09-13T19:18:04.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.341+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/2853249476 shutdown_connections 2024-09-13T19:18:04.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.341+0000 7fa7fcb3e800 1 --2- 172.21.15.102:0/2853249476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca0fe2630 0x55eca115f880 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.341+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/2853249476 >> 172.21.15.102:0/2853249476 conn(0x55eca1068db0 msgr2=0x55eca115b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:04.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.341+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/2853249476 shutdown_connections 2024-09-13T19:18:04.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.341+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/2853249476 wait complete. 2024-09-13T19:18:04.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.341+0000 7fa7fcb3e800 1 Processor -- start 2024-09-13T19:18:04.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.341+0000 7fa7fcb3e800 1 -- start start 2024-09-13T19:18:04.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.341+0000 7fa7fcb3e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca0fe2630 0x55eca1167380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:04.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.341+0000 7fa7fcb3e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55eca1077920 con 0x55eca0fe2630 2024-09-13T19:18:04.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.342+0000 7fa7f883b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca0fe2630 0x55eca1167380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:04.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.342+0000 7fa7f883b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca0fe2630 0x55eca1167380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:50276/0 (socket says 172.21.15.102:50276) 2024-09-13T19:18:04.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.342+0000 7fa7f883b640 1 -- 172.21.15.102:0/1252052929 learned_addr learned my addr 172.21.15.102:0/1252052929 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:04.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.342+0000 7fa7f883b640 1 -- 172.21.15.102:0/1252052929 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eca0f1bfe0 con 0x55eca0fe2630 2024-09-13T19:18:04.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.342+0000 7fa7f883b640 1 --2- 172.21.15.102:0/1252052929 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca0fe2630 0x55eca1167380 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec00b690 tx=0x7fa7ec000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:04.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.342+0000 7fa6e5602640 1 -- 172.21.15.102:0/1252052929 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7ec016030 con 0x55eca0fe2630 2024-09-13T19:18:04.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.342+0000 7fa6e5602640 1 -- 172.21.15.102:0/1252052929 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7ec017040 con 0x55eca0fe2630 2024-09-13T19:18:04.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.342+0000 7fa6e5602640 1 -- 172.21.15.102:0/1252052929 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7ec0108b0 con 0x55eca0fe2630 2024-09-13T19:18:04.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.342+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/1252052929 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eca11678c0 con 0x55eca0fe2630 2024-09-13T19:18:04.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.342+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/1252052929 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eca1167de0 con 0x55eca0fe2630 2024-09-13T19:18:04.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.343+0000 7fa6e5602640 1 -- 172.21.15.102:0/1252052929 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa7ec026020 con 0x55eca0fe2630 2024-09-13T19:18:04.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.343+0000 7fa6e5602640 1 --2- 172.21.15.102:0/1252052929 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa6e0036b90 0x7fa6e0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:04.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.343+0000 7fa6e5602640 1 -- 172.21.15.102:0/1252052929 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fa7ec024020 con 0x55eca0fe2630 2024-09-13T19:18:04.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.344+0000 7fa7f3fff640 1 --2- 172.21.15.102:0/1252052929 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa6e0036b90 0x7fa6e0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:04.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.344+0000 7fa7fcb3e800 1 --2- 172.21.15.102:0/1252052929 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55eca1074d20 0x55eca116e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:04.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.344+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/1252052929 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55eca116e970 con 0x55eca1074d20 2024-09-13T19:18:04.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.344+0000 7fa7f903c640 1 --2- 172.21.15.102:0/1252052929 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55eca1074d20 0x55eca116e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:04.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.344+0000 7fa7f3fff640 1 --2- 172.21.15.102:0/1252052929 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa6e0036b90 0x7fa6e0039050 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4057000 tx=0x7fa7e4052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:04.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.344+0000 7fa7f903c640 1 --2- 172.21.15.102:0/1252052929 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55eca1074d20 0x55eca116e3f0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:04.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.344+0000 7fa7f903c640 1 -- 172.21.15.102:0/1252052929 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa7f400a4a0 con 0x55eca1074d20 2024-09-13T19:18:04.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.344+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/1252052929 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55eca116b9c0 con 0x55eca1074d20 2024-09-13T19:18:04.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.345+0000 7fa7f903c640 1 -- 172.21.15.102:0/1252052929 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa7f400a4a0 con 0x55eca1074d20 2024-09-13T19:18:04.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.345+0000 7fa7fcb3e800 1 --2- 172.21.15.102:0/1252052929 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55eca1170cc0 0x55eca11730b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:04.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.345+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/1252052929 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55eca11737a0 con 0x55eca1170cc0 2024-09-13T19:18:04.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.345+0000 7fa7f883b640 1 --2- 172.21.15.102:0/1252052929 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55eca1170cc0 0x55eca11730b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:04.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.345+0000 7fa7f883b640 1 --2- 172.21.15.102:0/1252052929 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55eca1170cc0 0x55eca11730b0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:04.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.345+0000 7fa7f883b640 1 -- 172.21.15.102:0/1252052929 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa7ec028930 con 0x55eca1170cc0 2024-09-13T19:18:04.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.345+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/1252052929 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55eca116fb60 con 0x55eca1074d20 2024-09-13T19:18:04.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.345+0000 7fa7f903c640 1 -- 172.21.15.102:0/1252052929 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa7f400a4a0 con 0x55eca1074d20 2024-09-13T19:18:04.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.346+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/1252052929 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55eca1170040 con 0x55eca1170cc0 2024-09-13T19:18:04.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.346+0000 7fa7f883b640 1 -- 172.21.15.102:0/1252052929 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa7ec028930 con 0x55eca1170cc0 2024-09-13T19:18:04.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.346+0000 7fa7fcb3e800 1 Processor -- start 2024-09-13T19:18:04.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.346+0000 7fa7fcb3e800 1 -- start start 2024-09-13T19:18:04.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.346+0000 7fa7fcb3e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca1182190 0x55eca11825b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:04.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.346+0000 7fa7fcb3e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55eca0f09580 con 0x55eca1182190 2024-09-13T19:18:04.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.347+0000 7fa7f903c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca1182190 0x55eca11825b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:04.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.347+0000 7fa7f903c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca1182190 0x55eca11825b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:50290/0 (socket says 172.21.15.102:50290) 2024-09-13T19:18:04.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.347+0000 7fa7f903c640 1 -- 172.21.15.102:0/1144700718 learned_addr learned my addr 172.21.15.102:0/1144700718 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:04.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.347+0000 7fa7f903c640 1 -- 172.21.15.102:0/1144700718 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eca1182af0 con 0x55eca1182190 2024-09-13T19:18:04.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.347+0000 7fa7f903c640 1 --2- 172.21.15.102:0/1144700718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca1182190 0x55eca11825b0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x55eca1168780 tx=0x7fa7f40163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:04.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.347+0000 7fa6de7fc640 1 -- 172.21.15.102:0/1144700718 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7f4013450 con 0x55eca1182190 2024-09-13T19:18:04.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.347+0000 7fa6de7fc640 1 -- 172.21.15.102:0/1144700718 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7f40135f0 con 0x55eca1182190 2024-09-13T19:18:04.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.347+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/1144700718 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eca1182d80 con 0x55eca1182190 2024-09-13T19:18:04.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.347+0000 7fa6de7fc640 1 -- 172.21.15.102:0/1144700718 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7f4013910 con 0x55eca1182190 2024-09-13T19:18:04.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.347+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/1144700718 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eca1185a60 con 0x55eca1182190 2024-09-13T19:18:04.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.348+0000 7fa6de7fc640 1 -- 172.21.15.102:0/1144700718 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa7f4011040 con 0x55eca1182190 2024-09-13T19:18:04.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.348+0000 7fa6de7fc640 1 --2- 172.21.15.102:0/1144700718 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa6d0036b90 0x7fa6d0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:04.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.348+0000 7fa6de7fc640 1 -- 172.21.15.102:0/1144700718 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fa7f400e040 con 0x55eca1182190 2024-09-13T19:18:04.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.348+0000 7fa7f883b640 1 --2- 172.21.15.102:0/1144700718 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa6d0036b90 0x7fa6d0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:04.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.348+0000 7fa7fcb3e800 1 Processor -- start 2024-09-13T19:18:04.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.348+0000 7fa7f883b640 1 --2- 172.21.15.102:0/1144700718 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa6d0036b90 0x7fa6d0039050 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x55eca116f270 tx=0x7fa7ec00ff90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:04.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.348+0000 7fa7fcb3e800 1 -- start start 2024-09-13T19:18:04.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.349+0000 7fa7fcb3e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca118eee0 0x55eca118f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:04.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.349+0000 7fa7fcb3e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55eca1160030 con 0x55eca118eee0 2024-09-13T19:18:04.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.349+0000 7fa7f903c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca118eee0 0x55eca118f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:04.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.349+0000 7fa7f903c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca118eee0 0x55eca118f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:50298/0 (socket says 172.21.15.102:50298) 2024-09-13T19:18:04.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.349+0000 7fa7f903c640 1 -- 172.21.15.102:0/87677410 learned_addr learned my addr 172.21.15.102:0/87677410 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:04.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.349+0000 7fa7f903c640 1 -- 172.21.15.102:0/87677410 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eca118f8b0 con 0x55eca118eee0 2024-09-13T19:18:04.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.349+0000 7fa7f903c640 1 --2- 172.21.15.102:0/87677410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca118eee0 0x55eca118f2e0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fa7f404cdc0 tx=0x7fa7f404cfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a325b087f23d1234 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:04.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.349+0000 7fa6cffff640 1 -- 172.21.15.102:0/87677410 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7f402a440 con 0x55eca118eee0 2024-09-13T19:18:04.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.349+0000 7fa6cffff640 1 -- 172.21.15.102:0/87677410 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7f401f390 con 0x55eca118eee0 2024-09-13T19:18:04.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.349+0000 7fa6cffff640 1 -- 172.21.15.102:0/87677410 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7f402a5e0 con 0x55eca118eee0 2024-09-13T19:18:04.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.350+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/87677410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca118eee0 msgr2=0x55eca118f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.350+0000 7fa7fcb3e800 1 --2- 172.21.15.102:0/87677410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca118eee0 0x55eca118f2e0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fa7f404cdc0 tx=0x7fa7f404cfc0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.350+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/87677410 shutdown_connections 2024-09-13T19:18:04.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.350+0000 7fa7fcb3e800 1 --2- 172.21.15.102:0/87677410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca118eee0 0x55eca118f2e0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.350+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/87677410 >> 172.21.15.102:0/87677410 conn(0x55eca118b240 msgr2=0x55eca1189340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:04.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.350+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/87677410 shutdown_connections 2024-09-13T19:18:04.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.350+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/87677410 wait complete. 2024-09-13T19:18:04.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.350+0000 7fa7fcb3e800 1 Processor -- start 2024-09-13T19:18:04.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.350+0000 7fa7fcb3e800 1 -- start start 2024-09-13T19:18:04.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.350+0000 7fa7fcb3e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca118eee0 0x55eca11963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:04.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.350+0000 7fa7fcb3e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55eca118ff20 con 0x55eca118eee0 2024-09-13T19:18:04.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.350+0000 7fa7f903c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca118eee0 0x55eca11963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:04.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.350+0000 7fa7f903c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca118eee0 0x55eca11963a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:50314/0 (socket says 172.21.15.102:50314) 2024-09-13T19:18:04.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.350+0000 7fa7f903c640 1 -- 172.21.15.102:0/3933820954 learned_addr learned my addr 172.21.15.102:0/3933820954 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:18:04.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.351+0000 7fa7f903c640 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eca11968e0 con 0x55eca118eee0 2024-09-13T19:18:04.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.351+0000 7fa7f903c640 1 --2- 172.21.15.102:0/3933820954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca118eee0 0x55eca11963a0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4005a80 tx=0x7fa7f404cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:04.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.351+0000 7fa6ce7fc640 1 -- 172.21.15.102:0/3933820954 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7f403a020 con 0x55eca118eee0 2024-09-13T19:18:04.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.351+0000 7fa6ce7fc640 1 -- 172.21.15.102:0/3933820954 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7f401f710 con 0x55eca118eee0 2024-09-13T19:18:04.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.351+0000 7fa6ce7fc640 1 -- 172.21.15.102:0/3933820954 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7f401fa30 con 0x55eca118eee0 2024-09-13T19:18:04.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.351+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eca1196b70 con 0x55eca118eee0 2024-09-13T19:18:04.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.351+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eca1199820 con 0x55eca118eee0 2024-09-13T19:18:04.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.352+0000 7fa6ce7fc640 1 -- 172.21.15.102:0/3933820954 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa7f403d020 con 0x55eca118eee0 2024-09-13T19:18:04.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.352+0000 7fa6ce7fc640 1 --2- 172.21.15.102:0/3933820954 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa6c4036d30 0x7fa6c40391f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:04.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.352+0000 7fa6ce7fc640 1 -- 172.21.15.102:0/3933820954 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fa7f404e050 con 0x55eca118eee0 2024-09-13T19:18:04.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.352+0000 7fa7f883b640 1 --2- 172.21.15.102:0/3933820954 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa6c4036d30 0x7fa6c40391f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:04.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.353+0000 7fa7f883b640 1 --2- 172.21.15.102:0/3933820954 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa6c4036d30 0x7fa6c40391f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec028c40 tx=0x7fa7ec046000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:04.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.353+0000 7fa7fcb3e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:04.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.353+0000 7fa7fcb3e800 1 --2- 172.21.15.102:0/3933820954 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55eca11a1ee0 0x55eca11a43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:04.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.353+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55eca11a4af0 con 0x55eca11a1ee0 2024-09-13T19:18:04.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.353+0000 7fa7f3fff640 1 --2- 172.21.15.102:0/3933820954 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55eca11a1ee0 0x55eca11a43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:04.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.353+0000 7fa7f3fff640 1 --2- 172.21.15.102:0/3933820954 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55eca11a1ee0 0x55eca11a43a0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:04.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.353+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa7e4057030 con 0x55eca11a1ee0 2024-09-13T19:18:04.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.353+0000 7fa7fcb3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:04.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.353+0000 7fa7fcb3e800 20 realm 2024-09-13T19:18:04.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.353+0000 7fa7fcb3e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:04.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.353+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55eca11a4f20 con 0x55eca11a1ee0 2024-09-13T19:18:04.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.353+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa7e4057030 con 0x55eca11a1ee0 2024-09-13T19:18:04.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.354+0000 7fa7fcb3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:04.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.354+0000 7fa7fcb3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:18:04.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.354+0000 7fa7fcb3e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:04.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.354+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55eca11a57f0 con 0x55eca11a1ee0 2024-09-13T19:18:04.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.354+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa7e4057030 con 0x55eca11a1ee0 2024-09-13T19:18:04.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.354+0000 7fa7fcb3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:04.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.354+0000 7fa7fcb3e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:04.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.354+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55eca11a5b90 con 0x55eca11a1ee0 2024-09-13T19:18:04.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.354+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa7e4057030 con 0x55eca11a1ee0 2024-09-13T19:18:04.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.354+0000 7fa7fcb3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:18:04.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.354+0000 7fa7fcb3e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:04.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.354+0000 7fa7fcb3e800 1 --2- 172.21.15.102:0/3933820954 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55eca11a68f0 0x55eca11a8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:04.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.354+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55eca11a92f0 con 0x55eca11a68f0 2024-09-13T19:18:04.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.354+0000 7fa7f903c640 1 --2- 172.21.15.102:0/3933820954 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55eca11a68f0 0x55eca11a8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:04.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.354+0000 7fa7f903c640 1 --2- 172.21.15.102:0/3933820954 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55eca11a68f0 0x55eca11a8ce0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:04.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.355+0000 7fa7f903c640 1 -- 172.21.15.102:0/3933820954 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa7f4032040 con 0x55eca11a68f0 2024-09-13T19:18:04.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.355+0000 7fa7fcb3e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:18:04.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.355+0000 7fa7fcb3e800 20 searching for the correct realm 2024-09-13T19:18:04.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.355+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eca11aabe0 con 0x55eca11a68f0 2024-09-13T19:18:04.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.355+0000 7fa7f903c640 1 -- 172.21.15.102:0/3933820954 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f4032040 con 0x55eca11a68f0 2024-09-13T19:18:04.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.355+0000 7fa7f903c640 1 --2- 172.21.15.102:0/3933820954 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fa7f4058040 0x7fa7f4040040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:04.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.355+0000 7fa7f903c640 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eca11aabe0 con 0x7fa7f4058040 2024-09-13T19:18:04.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.355+0000 7fa7f883b640 1 --2- 172.21.15.102:0/3933820954 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fa7f4058040 0x7fa7f4040040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:04.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.355+0000 7fa7f883b640 1 --2- 172.21.15.102:0/3933820954 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fa7f4058040 0x7fa7f4040040 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:04.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.356+0000 7fa7f883b640 1 -- 172.21.15.102:0/3933820954 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7ec028930 con 0x7fa7f4058040 2024-09-13T19:18:04.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.356+0000 7fa7f883b640 1 --2- 172.21.15.102:0/3933820954 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fa7ec00f3a0 0x7fa7ec043bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:18:04.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.356+0000 7fa7f883b640 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eca11aabe0 con 0x7fa7ec00f3a0 2024-09-13T19:18:04.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.356+0000 7fa7f3fff640 1 --2- 172.21.15.102:0/3933820954 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fa7ec00f3a0 0x7fa7ec043bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:18:04.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.356+0000 7fa7f3fff640 1 --2- 172.21.15.102:0/3933820954 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fa7ec00f3a0 0x7fa7ec043bb0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:18:04.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.356+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7e4057030 con 0x7fa7ec00f3a0 2024-09-13T19:18:04.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.356+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eca11aabe0 con 0x55eca11a1ee0 2024-09-13T19:18:04.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.357+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7e4057030 con 0x55eca11a1ee0 2024-09-13T19:18:04.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.357+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eca11aabe0 con 0x55eca11a1ee0 2024-09-13T19:18:04.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.357+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7e4057030 con 0x55eca11a1ee0 2024-09-13T19:18:04.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.357+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eca11aabe0 con 0x7fa7ec00f3a0 2024-09-13T19:18:04.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.357+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7e4057030 con 0x7fa7ec00f3a0 2024-09-13T19:18:04.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.357+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eca11aabe0 con 0x7fa7ec00f3a0 2024-09-13T19:18:04.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.357+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7e4057030 con 0x7fa7ec00f3a0 2024-09-13T19:18:04.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.357+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eca11aabe0 con 0x7fa7f4058040 2024-09-13T19:18:04.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.358+0000 7fa7f883b640 1 -- 172.21.15.102:0/3933820954 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7ec028930 con 0x7fa7f4058040 2024-09-13T19:18:04.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.358+0000 7fa7f883b640 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eca11aabe0 con 0x55eca11a68f0 2024-09-13T19:18:04.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.358+0000 7fa7f903c640 1 -- 172.21.15.102:0/3933820954 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f4032040 con 0x55eca11a68f0 2024-09-13T19:18:04.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.358+0000 7fa7f903c640 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eca11aabe0 con 0x55eca11a1ee0 2024-09-13T19:18:04.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.358+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7e4057030 con 0x55eca11a1ee0 2024-09-13T19:18:04.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.358+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eca11aabe0 con 0x7fa7f4058040 2024-09-13T19:18:04.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.358+0000 7fa7f883b640 1 -- 172.21.15.102:0/3933820954 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7ec028930 con 0x7fa7f4058040 2024-09-13T19:18:04.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.358+0000 7fa7f883b640 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eca11aabe0 con 0x55eca11a1ee0 2024-09-13T19:18:04.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.359+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7e4057030 con 0x55eca11a1ee0 2024-09-13T19:18:04.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.359+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eca11aabe0 con 0x7fa7f4058040 2024-09-13T19:18:04.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.359+0000 7fa7f883b640 1 -- 172.21.15.102:0/3933820954 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa7ec028930 con 0x7fa7f4058040 2024-09-13T19:18:04.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.359+0000 7fa7f883b640 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eca11aabe0 con 0x55eca11a68f0 2024-09-13T19:18:04.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.359+0000 7fa7f903c640 1 -- 172.21.15.102:0/3933820954 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f4032040 con 0x55eca11a68f0 2024-09-13T19:18:04.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.359+0000 7fa7f903c640 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eca11aabe0 con 0x55eca11a68f0 2024-09-13T19:18:04.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.359+0000 7fa7f903c640 1 -- 172.21.15.102:0/3933820954 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa7f4032040 con 0x55eca11a68f0 2024-09-13T19:18:04.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.359+0000 7fa7f903c640 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eca11aabe0 con 0x7fa7ec00f3a0 2024-09-13T19:18:04.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.359+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7e4057030 con 0x7fa7ec00f3a0 2024-09-13T19:18:04.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.359+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eca11aabe0 con 0x55eca11a68f0 2024-09-13T19:18:04.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.360+0000 7fa7f903c640 1 -- 172.21.15.102:0/3933820954 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa7f4032040 con 0x55eca11a68f0 2024-09-13T19:18:04.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.360+0000 7fa7f903c640 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eca11aabe0 con 0x55eca11a68f0 2024-09-13T19:18:04.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.360+0000 7fa7f903c640 1 -- 172.21.15.102:0/3933820954 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f4032040 con 0x55eca11a68f0 2024-09-13T19:18:04.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.360+0000 7fa7f903c640 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eca11aabe0 con 0x55eca11a1ee0 2024-09-13T19:18:04.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.360+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7e4057030 con 0x55eca11a1ee0 2024-09-13T19:18:04.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.360+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eca11aabe0 con 0x55eca11a1ee0 2024-09-13T19:18:04.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.360+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa7e4057030 con 0x55eca11a1ee0 2024-09-13T19:18:04.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.360+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eca11aabe0 con 0x7fa7ec00f3a0 2024-09-13T19:18:04.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.361+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7e4057030 con 0x7fa7ec00f3a0 2024-09-13T19:18:04.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.361+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eca11aabe0 con 0x55eca11a68f0 2024-09-13T19:18:04.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.361+0000 7fa7f903c640 1 -- 172.21.15.102:0/3933820954 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f4032040 con 0x55eca11a68f0 2024-09-13T19:18:04.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.361+0000 7fa7f903c640 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eca11aabe0 con 0x7fa7f4058040 2024-09-13T19:18:04.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.361+0000 7fa7f883b640 1 -- 172.21.15.102:0/3933820954 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7ec028930 con 0x7fa7f4058040 2024-09-13T19:18:04.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.361+0000 7fa7f883b640 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eca11aabe0 con 0x55eca11a1ee0 2024-09-13T19:18:04.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.361+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7e4057030 con 0x55eca11a1ee0 2024-09-13T19:18:04.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.361+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eca11aabe0 con 0x7fa7f4058040 2024-09-13T19:18:04.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.362+0000 7fa7f883b640 1 -- 172.21.15.102:0/3933820954 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7ec028930 con 0x7fa7f4058040 2024-09-13T19:18:04.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.362+0000 7fa7f883b640 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eca11aabe0 con 0x55eca11a68f0 2024-09-13T19:18:04.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.362+0000 7fa7f903c640 1 -- 172.21.15.102:0/3933820954 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f4032040 con 0x55eca11a68f0 2024-09-13T19:18:04.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.362+0000 7fa7f903c640 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eca11aabe0 con 0x7fa7ec00f3a0 2024-09-13T19:18:04.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.362+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7e4057030 con 0x7fa7ec00f3a0 2024-09-13T19:18:04.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.362+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eca11aabe0 con 0x7fa7f4058040 2024-09-13T19:18:04.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.362+0000 7fa7f883b640 1 -- 172.21.15.102:0/3933820954 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7ec028930 con 0x7fa7f4058040 2024-09-13T19:18:04.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.362+0000 7fa7f883b640 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eca11aabe0 con 0x55eca11a68f0 2024-09-13T19:18:04.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.363+0000 7fa7f903c640 1 -- 172.21.15.102:0/3933820954 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f4032040 con 0x55eca11a68f0 2024-09-13T19:18:04.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.363+0000 7fa7f903c640 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eca11aabe0 con 0x7fa7ec00f3a0 2024-09-13T19:18:04.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.363+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7e4057030 con 0x7fa7ec00f3a0 2024-09-13T19:18:04.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.363+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eca11aabe0 con 0x55eca11a1ee0 2024-09-13T19:18:04.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.363+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v36'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa7e4057030 con 0x55eca11a1ee0 2024-09-13T19:18:04.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.363+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55eca11aabe0 con 0x7fa7f4058040 2024-09-13T19:18:04.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.363+0000 7fa7f883b640 1 -- 172.21.15.102:0/3933820954 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7ec028930 con 0x7fa7f4058040 2024-09-13T19:18:04.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.363+0000 7fa7fcb3e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:18:04.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.363+0000 7fa7fcb3e800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:18:04.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.363+0000 7fa7fcb3e800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:18:04.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.363+0000 7fa7fcb3e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:18:04.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.363+0000 7fa7fcb3e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:18:04.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.363+0000 7fa7fcb3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:18:04.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.363+0000 7fa7fcb3e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:04.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.363+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55eca11aa7d0 con 0x55eca11a1ee0 2024-09-13T19:18:04.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.364+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa7e4057030 con 0x55eca11a1ee0 2024-09-13T19:18:04.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.364+0000 7fa7fcb3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:04.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.364+0000 7fa7fcb3e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:04.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.364+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55eca11aa040 con 0x55eca11a1ee0 2024-09-13T19:18:04.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.364+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa7e407e040 con 0x55eca11a1ee0 2024-09-13T19:18:04.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.364+0000 7fa7fcb3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:18:04.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.364+0000 7fa7fcb3e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:04.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.364+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55eca11ab060 con 0x55eca11a68f0 2024-09-13T19:18:04.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.364+0000 7fa7f903c640 1 -- 172.21.15.102:0/3933820954 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa7f4032040 con 0x55eca11a68f0 2024-09-13T19:18:04.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.364+0000 7fa7fcb3e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:18:04.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.364+0000 7fa7fcb3e800 20 zone default found 2024-09-13T19:18:04.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.364+0000 7fa7fcb3e800 4 Realm: () 2024-09-13T19:18:04.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.364+0000 7fa7fcb3e800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:18:04.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.364+0000 7fa7fcb3e800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:18:04.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.364+0000 7fa7fcb3e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:18:04.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.364+0000 7fa7fcb3e800 20 zonegroup default 2024-09-13T19:18:04.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.364+0000 7fa7fcb3e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:04.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.364+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55eca11ab8b0 con 0x7fa7f4058040 2024-09-13T19:18:04.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.364+0000 7fa7f883b640 1 -- 172.21.15.102:0/3933820954 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa7ec028930 con 0x7fa7f4058040 2024-09-13T19:18:04.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.364+0000 7fa7fcb3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:04.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.364+0000 7fa7fcb3e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:04.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.364+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55eca11ad660 con 0x55eca11a68f0 2024-09-13T19:18:04.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.365+0000 7fa7f903c640 1 -- 172.21.15.102:0/3933820954 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa7f4032040 con 0x55eca11a68f0 2024-09-13T19:18:04.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.365+0000 7fa7fcb3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:04.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.365+0000 7fa7fcb3e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:04.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.365+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55eca11adac0 con 0x55eca11a68f0 2024-09-13T19:18:04.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.365+0000 7fa7f903c640 1 -- 172.21.15.102:0/3933820954 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa7f4032040 con 0x55eca11a68f0 2024-09-13T19:18:04.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.365+0000 7fa7fcb3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:18:04.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.365+0000 7fa7fcb3e800 20 started sync module instance, tier type = 2024-09-13T19:18:04.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.365+0000 7fa7fcb3e800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:18:04.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.365+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eca11acad0 con 0x7fa7f4058040 2024-09-13T19:18:04.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.366+0000 7fa7f883b640 1 -- 172.21.15.102:0/3933820954 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(44 notify.0 [create] v36'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7ec028930 con 0x7fa7f4058040 2024-09-13T19:18:04.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.366+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94474803531728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eca11acad0 con 0x7fa7f4058040 2024-09-13T19:18:04.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.366+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eca11ae570 con 0x55eca11a1ee0 2024-09-13T19:18:04.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.369+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v36'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7e407e040 con 0x55eca11a1ee0 2024-09-13T19:18:04.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.369+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94474803536064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eca11aedc0 con 0x55eca11a1ee0 2024-09-13T19:18:04.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.369+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eca11af880 con 0x55eca11a68f0 2024-09-13T19:18:04.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.369+0000 7fa7f883b640 1 -- 172.21.15.102:0/3933820954 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94474803531728] v36'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7ec028930 con 0x7fa7f4058040 2024-09-13T19:18:04.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.370+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94474803536064] v36'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7e407e040 con 0x55eca11a1ee0 2024-09-13T19:18:04.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.370+0000 7fa7f903c640 1 -- 172.21.15.102:0/3933820954 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v36'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7f4032040 con 0x55eca11a68f0 2024-09-13T19:18:04.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.370+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94474803538192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eca11ac620 con 0x55eca11a68f0 2024-09-13T19:18:04.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.370+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eca11b0160 con 0x7fa7f4058040 2024-09-13T19:18:04.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.371+0000 7fa7f903c640 1 -- 172.21.15.102:0/3933820954 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94474803538192] v36'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7f4032040 con 0x55eca11a68f0 2024-09-13T19:18:04.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.371+0000 7fa7f883b640 1 -- 172.21.15.102:0/3933820954 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(50 notify.3 [create] v36'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7ec028930 con 0x7fa7f4058040 2024-09-13T19:18:04.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.371+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94474803540816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eca11b0120 con 0x7fa7f4058040 2024-09-13T19:18:04.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.371+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eca11b0c10 con 0x55eca11a1ee0 2024-09-13T19:18:04.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.372+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v36'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7e407e040 con 0x55eca11a1ee0 2024-09-13T19:18:04.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.372+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94474803545888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eca11b0c10 con 0x55eca11a1ee0 2024-09-13T19:18:04.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.372+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eca11b1bc0 con 0x7fa7ec00f3a0 2024-09-13T19:18:04.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.372+0000 7fa7f883b640 1 -- 172.21.15.102:0/3933820954 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94474803540816] v36'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7ec028930 con 0x7fa7f4058040 2024-09-13T19:18:04.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.373+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94474803545888] v36'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7e407e040 con 0x55eca11a1ee0 2024-09-13T19:18:04.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.373+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(54 notify.5 [create] v36'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7e407e040 con 0x7fa7ec00f3a0 2024-09-13T19:18:04.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.373+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94474803548208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eca11b1bc0 con 0x7fa7ec00f3a0 2024-09-13T19:18:04.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.373+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eca11b2490 con 0x7fa7ec00f3a0 2024-09-13T19:18:04.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.376+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94474803548208] v36'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7e407e040 con 0x7fa7ec00f3a0 2024-09-13T19:18:04.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.376+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(56 notify.6 [create] v36'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7e407e040 con 0x7fa7ec00f3a0 2024-09-13T19:18:04.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.376+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94474803549904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eca11b1bc0 con 0x7fa7ec00f3a0 2024-09-13T19:18:04.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.376+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eca11b2ab0 con 0x7fa7ec00f3a0 2024-09-13T19:18:04.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.377+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(58 notify.7 [create] v36'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7e407e040 con 0x7fa7ec00f3a0 2024-09-13T19:18:04.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.377+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94474803549904] v36'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7e407e040 con 0x7fa7ec00f3a0 2024-09-13T19:18:04.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.377+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94474803553792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eca11b2a20 con 0x7fa7ec00f3a0 2024-09-13T19:18:04.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.377+0000 7fa7fcb3e800 20 add_watcher() i=0 2024-09-13T19:18:04.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.377+0000 7fa7fcb3e800 20 add_watcher() i=1 2024-09-13T19:18:04.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.377+0000 7fa7fcb3e800 20 add_watcher() i=2 2024-09-13T19:18:04.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.377+0000 7fa7fcb3e800 20 add_watcher() i=3 2024-09-13T19:18:04.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.377+0000 7fa7fcb3e800 20 add_watcher() i=4 2024-09-13T19:18:04.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.377+0000 7fa7fcb3e800 20 add_watcher() i=5 2024-09-13T19:18:04.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.377+0000 7fa7fcb3e800 20 add_watcher() i=6 2024-09-13T19:18:04.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.378+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94474803553792] v36'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7e407e040 con 0x7fa7ec00f3a0 2024-09-13T19:18:04.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.378+0000 7fa7fcb3e800 20 add_watcher() i=7 2024-09-13T19:18:04.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.378+0000 7fa7fcb3e800 2 all 8 watchers are set, enabling cache 2024-09-13T19:18:04.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.378+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55eca11b5eb0 con 0x55eca11a1ee0 2024-09-13T19:18:04.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.378+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa7e407e040 con 0x55eca11a1ee0 2024-09-13T19:18:04.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.378+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94474803551872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eca11b3370 con 0x55eca11a1ee0 2024-09-13T19:18:04.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.379+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94474803551872] v36'271 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa7e407e040 con 0x55eca11a1ee0 2024-09-13T19:18:04.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.379+0000 7fa6af7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:18:04.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.380+0000 7fa7fcb3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:18:04.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.380+0000 7fa7fcb3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:18:04.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.380+0000 7fa7fcb3e800 5 note: GC not initialized 2024-09-13T19:18:04.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.380+0000 7fa6ae7e4640 20 reqs_thread_entry: start 2024-09-13T19:18:04.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.380+0000 7fa7fcb3e800 20 init_complete bucket index max shards: 11 2024-09-13T19:18:04.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.380+0000 7fa7fcb3e800 20 Filter name: none 2024-09-13T19:18:04.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.380+0000 7fa6a77fe640 20 reqs_thread_entry: start 2024-09-13T19:18:04.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.380+0000 7fa7fcb3e800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T19:18:04.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.380+0000 7fa7fcb3e800 20 rados->read ofs=0 len=0 2024-09-13T19:18:04.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.380+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55eca11e9330 con 0x7fa7ec00f3a0 2024-09-13T19:18:04.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.381+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7fa7e407e040 con 0x7fa7ec00f3a0 2024-09-13T19:18:04.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.381+0000 7fa7fcb3e800 20 rados_obj.operate() r=0 bl.length=473 2024-09-13T19:18:04.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.381+0000 7fa7fcb3e800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T19:18:04.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.381+0000 7fa7fcb3e800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:18:04.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.381+0000 7fa7fcb3e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:18:04.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.381+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eca11efc70 con 0x7fa7ec00f3a0 2024-09-13T19:18:04.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.382+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v36'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fa7e407e040 con 0x7fa7ec00f3a0 2024-09-13T19:18:04.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.382+0000 7fa7fcb3e800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:18:04.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.382+0000 7fa7fcb3e800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:18:04.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.382+0000 7fa7fcb3e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T19:18:04.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.382+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94474803803696 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55eca11eb2f0 con 0x55eca11a1ee0 2024-09-13T19:18:04.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.382+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== watch-notify(notify (1) cookie 94474803545888 notify 154618822703 ret 0) ==== 691+0+0 (crc 0 0 0) 0x55eca0f35e00 con 0x55eca11a1ee0 2024-09-13T19:18:04.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.382+0000 7fa6cffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822703 cookie 94474803545888 notifier 4930 bl.length()=649 2024-09-13T19:18:04.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.382+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(64 notify.4 [notify cookie 94474803803696 out=8b] v0'0 uv279 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa7e407e040 con 0x55eca11a1ee0 2024-09-13T19:18:04.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.382+0000 7fa6cffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:18:04.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.382+0000 7fa6cffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:18:04.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.382+0000 7fa6cffff640 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fa6bc003ea0 con 0x55eca11a1ee0 2024-09-13T19:18:04.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.383+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== watch-notify(notify_complete (2) cookie 94474803803696 notify 154618822703 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa7e4086440 con 0x55eca11a1ee0 2024-09-13T19:18:04.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.383+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7e407e040 con 0x55eca11a1ee0 2024-09-13T19:18:04.398 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T19:18:02.251000Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:18:02.250985Z","tags":[],"group_ids":[]} 2024-09-13T19:18:04.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.384+0000 7fa6af7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:18:04.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.384+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94474803551872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eca11eeed0 con 0x55eca11a1ee0 2024-09-13T19:18:04.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.385+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94474803551872] v36'272 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa7e407e040 con 0x55eca11a1ee0 2024-09-13T19:18:04.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.385+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94474803531728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eca11eeed0 con 0x7fa7f4058040 2024-09-13T19:18:04.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.386+0000 7fa7f883b640 1 -- 172.21.15.102:0/3933820954 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94474803531728] v36'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7ec028930 con 0x7fa7f4058040 2024-09-13T19:18:04.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.386+0000 7fa7fcb3e800 20 remove_watcher() i=0 2024-09-13T19:18:04.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.386+0000 7fa7fcb3e800 2 removed watcher, disabling cache 2024-09-13T19:18:04.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.386+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94474803536064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eca11eeed0 con 0x55eca11a1ee0 2024-09-13T19:18:04.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.387+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94474803536064] v36'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7e407e040 con 0x55eca11a1ee0 2024-09-13T19:18:04.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.387+0000 7fa7fcb3e800 20 remove_watcher() i=1 2024-09-13T19:18:04.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.387+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94474803538192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eca11eeed0 con 0x55eca11a68f0 2024-09-13T19:18:04.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.388+0000 7fa7f903c640 1 -- 172.21.15.102:0/3933820954 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94474803538192] v36'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7f4032040 con 0x55eca11a68f0 2024-09-13T19:18:04.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.388+0000 7fa7fcb3e800 20 remove_watcher() i=2 2024-09-13T19:18:04.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.388+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94474803540816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eca11eeed0 con 0x7fa7f4058040 2024-09-13T19:18:04.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.389+0000 7fa7f883b640 1 -- 172.21.15.102:0/3933820954 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94474803540816] v36'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7ec028930 con 0x7fa7f4058040 2024-09-13T19:18:04.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.389+0000 7fa7fcb3e800 20 remove_watcher() i=3 2024-09-13T19:18:04.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.389+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94474803545888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eca11eeed0 con 0x55eca11a1ee0 2024-09-13T19:18:04.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.390+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94474803545888] v36'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7e407e040 con 0x55eca11a1ee0 2024-09-13T19:18:04.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.390+0000 7fa7fcb3e800 20 remove_watcher() i=4 2024-09-13T19:18:04.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.390+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94474803548208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eca11e7050 con 0x7fa7ec00f3a0 2024-09-13T19:18:04.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.391+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94474803548208] v36'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7e407e040 con 0x7fa7ec00f3a0 2024-09-13T19:18:04.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.391+0000 7fa7fcb3e800 20 remove_watcher() i=5 2024-09-13T19:18:04.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.391+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94474803549904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eca11e7050 con 0x7fa7ec00f3a0 2024-09-13T19:18:04.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.392+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94474803549904] v36'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7e407e040 con 0x7fa7ec00f3a0 2024-09-13T19:18:04.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.392+0000 7fa7fcb3e800 20 remove_watcher() i=6 2024-09-13T19:18:04.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.392+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94474803553792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55eca11e7050 con 0x7fa7ec00f3a0 2024-09-13T19:18:04.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.393+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94474803553792] v36'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7e407e040 con 0x7fa7ec00f3a0 2024-09-13T19:18:04.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.393+0000 7fa7fcb3e800 20 remove_watcher() i=7 2024-09-13T19:18:04.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.393+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fa7ec00f3a0 msgr2=0x7fa7ec043bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.393+0000 7fa7fcb3e800 1 --2- 172.21.15.102:0/3933820954 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fa7ec00f3a0 0x7fa7ec043bb0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.393+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55eca11a1ee0 msgr2=0x55eca11a43a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.393+0000 7fa7fcb3e800 1 --2- 172.21.15.102:0/3933820954 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55eca11a1ee0 0x55eca11a43a0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.393+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fa7f4058040 msgr2=0x7fa7f4040040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.393+0000 7fa7fcb3e800 1 --2- 172.21.15.102:0/3933820954 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7fa7f4058040 0x7fa7f4040040 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.393+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55eca11a68f0 msgr2=0x55eca11a8ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.393+0000 7fa7fcb3e800 1 --2- 172.21.15.102:0/3933820954 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55eca11a68f0 0x55eca11a8ce0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.393+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa6c4036d30 msgr2=0x7fa6c40391f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.393+0000 7fa7fcb3e800 1 --2- 172.21.15.102:0/3933820954 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa6c4036d30 0x7fa6c40391f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec028c40 tx=0x7fa7ec046000 comp rx=0 tx=0).stop 2024-09-13T19:18:04.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.393+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca118eee0 msgr2=0x55eca11963a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.393+0000 7fa7f3fff640 1 -- 172.21.15.102:0/3933820954 reap_dead start 2024-09-13T19:18:04.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.393+0000 7fa7fcb3e800 1 --2- 172.21.15.102:0/3933820954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca118eee0 0x55eca11963a0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4005a80 tx=0x7fa7f404cd50 comp rx=0 tx=0).stop 2024-09-13T19:18:04.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.393+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 shutdown_connections 2024-09-13T19:18:04.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.393+0000 7fa7fcb3e800 1 --2- 172.21.15.102:0/3933820954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca118eee0 0x55eca11963a0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.393+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 >> 172.21.15.102:0/3933820954 conn(0x55eca118b240 msgr2=0x55eca1189310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:04.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.393+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 shutdown_connections 2024-09-13T19:18:04.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.393+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/3933820954 wait complete. 2024-09-13T19:18:04.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.394+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/1144700718 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa6d0036b90 msgr2=0x7fa6d0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.394+0000 7fa7fcb3e800 1 --2- 172.21.15.102:0/1144700718 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa6d0036b90 0x7fa6d0039050 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x55eca116f270 tx=0x7fa7ec00ff90 comp rx=0 tx=0).stop 2024-09-13T19:18:04.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.394+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/1144700718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca1182190 msgr2=0x55eca11825b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.394+0000 7fa7fcb3e800 1 --2- 172.21.15.102:0/1144700718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca1182190 0x55eca11825b0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x55eca1168780 tx=0x7fa7f40163e0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.394+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/1144700718 shutdown_connections 2024-09-13T19:18:04.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.394+0000 7fa7fcb3e800 1 --2- 172.21.15.102:0/1144700718 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa6d0036b90 0x7fa6d0039050 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.394+0000 7fa7fcb3e800 1 --2- 172.21.15.102:0/1144700718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca1182190 0x55eca11825b0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.394+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/1144700718 >> 172.21.15.102:0/1144700718 conn(0x55eca1177120 msgr2=0x55eca1179ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:04.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.394+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/1144700718 shutdown_connections 2024-09-13T19:18:04.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.394+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/1144700718 wait complete. 2024-09-13T19:18:04.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.394+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/1252052929 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55eca1074d20 msgr2=0x55eca116e3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.394+0000 7fa7fcb3e800 1 --2- 172.21.15.102:0/1252052929 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55eca1074d20 0x55eca116e3f0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.394+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/1252052929 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55eca1170cc0 msgr2=0x55eca11730b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.394+0000 7fa7fcb3e800 1 --2- 172.21.15.102:0/1252052929 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55eca1170cc0 0x55eca11730b0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.394+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/1252052929 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa6e0036b90 msgr2=0x7fa6e0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.394+0000 7fa7fcb3e800 1 --2- 172.21.15.102:0/1252052929 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa6e0036b90 0x7fa6e0039050 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4057000 tx=0x7fa7e4052000 comp rx=0 tx=0).stop 2024-09-13T19:18:04.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.394+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/1252052929 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca0fe2630 msgr2=0x55eca1167380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:18:04.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.394+0000 7fa7fcb3e800 1 --2- 172.21.15.102:0/1252052929 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca0fe2630 0x55eca1167380 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec00b690 tx=0x7fa7ec000ed0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.394+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/1252052929 shutdown_connections 2024-09-13T19:18:04.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.394+0000 7fa7fcb3e800 1 --2- 172.21.15.102:0/1252052929 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55eca1170cc0 0x55eca11730b0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.394+0000 7fa7fcb3e800 1 --2- 172.21.15.102:0/1252052929 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55eca1074d20 0x55eca116e3f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.394+0000 7fa7fcb3e800 1 --2- 172.21.15.102:0/1252052929 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa6e0036b90 0x7fa6e0039050 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.394+0000 7fa7fcb3e800 1 --2- 172.21.15.102:0/1252052929 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca0fe2630 0x55eca1167380 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:18:04.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.394+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/1252052929 >> 172.21.15.102:0/1252052929 conn(0x55eca1068db0 msgr2=0x55eca1159b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:18:04.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.394+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/1252052929 shutdown_connections 2024-09-13T19:18:04.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:18:04.394+0000 7fa7fcb3e800 1 -- 172.21.15.102:0/1252052929 wait complete. 2024-09-13T19:18:04.412 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:18:02.251000Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:18:02.250985Z', 'tags': [], 'group_ids': []} 2024-09-13T19:18:04.413 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:18:02.251000Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:18:02.250985Z', 'tags': [], 'group_ids': []} 2024-09-13T19:18:04.413 ERROR:root:0 2024-09-13T19:18:04.413 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-13T19:18:04.429 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:18:04.429 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:18:04.442 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:18:04.442 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-13T19:18:04.456 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:18:04.457 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:18:04.468 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:18:04.469 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'create'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'} 2024-09-13T19:18:04.484 INFO:tasks.radosgw_admin_rest: json result: [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}] 2024-09-13T19:18:04.485 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:18:04.496 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:18:04.496 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ'} 2024-09-13T19:18:04.511 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T19:18:04.512 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:18:04.523 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:18:04.523 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo1', 'secret-key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'key-type': 'swift'} 2024-09-13T19:18:04.539 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}] 2024-09-13T19:18:04.539 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:18:04.550 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:18:04.551 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo2', 'secret-key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'key-type': 'swift'} 2024-09-13T19:18:04.566 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}] 2024-09-13T19:18:04.566 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:18:04.578 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:18:04.578 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'subuser': 'foo:foo1', 'key-type': 'swift'} 2024-09-13T19:18:04.593 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T19:18:04.593 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:18:04.605 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:18:04.605 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo1'} 2024-09-13T19:18:04.618 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T19:18:04.619 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:18:04.630 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:18:04.630 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo2', 'key-type': 'swift', '{purge-keys': True} 2024-09-13T19:18:04.646 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T19:18:04.647 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:18:04.659 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:18:04.659 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-13T19:18:04.672 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-13T19:18:04.673 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-13T19:18:04.685 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-13T19:18:04.705 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-13T19:18:04.717 INFO:tasks.radosgw_admin_rest: json result: ['myfoo'] 2024-09-13T19:18:04.717 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-13T19:18:04.729 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'f767d22e-a5e7-4349-a797-2de84f67e90b', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '509740b4-c081-4f37-bd6d-df9ca851489b.4237.11', 'marker': '509740b4-c081-4f37-bd6d-df9ca851489b.4237.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T19:18:04.697851Z', 'creation_time': '2024-09-13T19:18:04.695180Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-13T19:18:04.729 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-13T19:18:04.742 INFO:tasks.radosgw_admin_rest: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'f767d22e-a5e7-4349-a797-2de84f67e90b', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '509740b4-c081-4f37-bd6d-df9ca851489b.4237.11', 'marker': '509740b4-c081-4f37-bd6d-df9ca851489b.4237.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T19:18:04.697851Z', 'creation_time': '2024-09-13T19:18:04.695180Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-09-13T19:18:04.746 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-13T19:18:04.759 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'f767d22e-a5e7-4349-a797-2de84f67e90b', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '509740b4-c081-4f37-bd6d-df9ca851489b.4237.11', 'marker': '509740b4-c081-4f37-bd6d-df9ca851489b.4237.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T19:18:04.697851Z', 'creation_time': '2024-09-13T19:18:04.695180Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-13T19:18:04.761 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'doesnotexist'} 2024-09-13T19:18:04.773 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchBucket', 'Message': '', 'RequestId': 'tx00000aad1c2923735b09b-0066e48fec-4237-default', 'HostId': '4237-default-default'} 2024-09-13T19:18:04.778 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'unlink'] {'uid': 'foo', 'bucket': 'myfoo'} 2024-09-13T19:18:04.793 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T19:18:04.794 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'fud', 'display-name': 'Fud', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'max-buckets': '1'} 2024-09-13T19:18:04.810 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:18:04.819 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'fud', 'bucket': 'myfoo', 'bucket-id': '509740b4-c081-4f37-bd6d-df9ca851489b.4237.11'} 2024-09-13T19:18:04.837 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T19:18:04.886 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'foo', 'bucket': 'myfoo', 'bucket-id': '509740b4-c081-4f37-bd6d-df9ca851489b.4237.11'} 2024-09-13T19:18:04.906 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T19:18:04.907 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'fud'} 2024-09-13T19:18:04.924 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T19:18:04.940 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['object', 'rm'] {'bucket': 'myfoo', 'object': 'four'} 2024-09-13T19:18:04.956 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T19:18:04.957 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-13T19:18:04.969 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'f767d22e-a5e7-4349-a797-2de84f67e90b', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '509740b4-c081-4f37-bd6d-df9ca851489b.4237.11', 'marker': '509740b4-c081-4f37-bd6d-df9ca851489b.4237.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T19:18:04.899020Z', 'creation_time': '2024-09-13T19:18:04.695180Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-13T19:19:05.017 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'categories': 'delete_obj'} 2024-09-13T19:19:05.044 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'anonymous', 'categories': []}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'bar', 'categories': []}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'bud', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}, {'bucket': 'useless-bucket', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'fud', 'categories': []}, {'bucket': 'myfoo7', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'fud', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'bar', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'bud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}}, {'user': 'fud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}]} 2024-09-13T19:19:05.044 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] None 2024-09-13T19:19:05.134 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'fud', 'categories': [{'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 0, 'ops': 1, 'successful_ops': 0}]}, {'bucket': 'myfoo7', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 8, 'ops': 2, 'successful_ops': 2}}, {'user': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 16, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10}}, {'user': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 8, 'ops': 2, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 242, 'bytes_received': 8, 'ops': 5, 'successful_ops': 4}}]} 2024-09-13T19:19:05.135 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-13T19:19:05.148 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10}}]} 2024-09-13T19:19:05.148 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'create_bucket'} 2024-09-13T19:19:05.161 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'useless-bucket', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}}]} 2024-09-13T19:19:05.161 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'put_obj'} 2024-09-13T19:19:05.173 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}}]} 2024-09-13T19:19:05.174 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_obj'} 2024-09-13T19:19:05.186 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}, {'bucket': 'useless-bucket', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}}]} 2024-09-13T19:19:05.186 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_bucket'} 2024-09-13T19:19:05.199 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': []}, {'bucket': 'useless-bucket', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}]} 2024-09-13T19:19:05.199 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'trim'] {'uid': 'foo'} 2024-09-13T19:19:05.213 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T19:19:05.213 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-13T19:19:05.226 INFO:tasks.radosgw_admin_rest: json result: {'entries': [], 'summary': []} 2024-09-13T19:19:05.226 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-13T19:19:05.244 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:19:05.256 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-13T19:19:05.273 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:19:05.555 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-13T19:19:05.567 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx00000a8c1fffa0e13a68e-0066e49029-4237-default', 'HostId': '4237-default-default'} 2024-09-13T19:19:05.665 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-13T19:19:05.677 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [], 'grant_map': [{'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-13T19:19:05.682 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-13T19:19:05.694 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [{'group': 1, 'acl': 1}], 'grant_map': [{'id': '', 'grant': {'type': {'type': 2}, 'group': 1, 'permission': {'flags': 1}}}, {'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-13T19:19:05.809 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'rm'] {'bucket': 'myfoo', 'purge-objects': True} 2024-09-13T19:19:05.859 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T19:19:05.859 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'add'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-13T19:19:05.873 INFO:tasks.radosgw_admin_rest: json result: [{'type': 'usage', 'perm': 'read'}] 2024-09-13T19:19:05.873 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'rm'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-13T19:19:05.887 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-13T19:19:05.903 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-13T19:19:05.917 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx000005f605056daf52693-0066e49029-4237-default', 'HostId': '4237-default-default'} 2024-09-13T19:19:05.942 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo', 'purge-data': True} 2024-09-13T19:19:05.980 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T19:19:05.981 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:19:05.993 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx0000070532de58889704c-0066e49029-4237-default', 'HostId': '4237-default-default'} 2024-09-13T19:19:05.993 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['info', ''] None 2024-09-13T19:19:06.006 INFO:tasks.radosgw_admin_rest: json result: {'info': {'storage_backends': [{'name': 'rados', 'cluster_id': '69e598bd-9014-4d1e-9444-0be214085a05'}]}} 2024-09-13T19:19:06.006 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'ratelimit_user', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '1000'} 2024-09-13T19:19:06.024 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'ratelimit_user', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'ratelimit_user', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:19:06.024 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-13T19:19:06.036 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-13T19:19:06.037 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring'} 2024-09-13T19:19:06.049 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx0000023b86aab31e4fe5d-0066e4902a-4237-default', 'HostId': '4237-default-default'} 2024-09-13T19:19:06.049 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user'} 2024-09-13T19:19:06.061 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000006bf3a090df9853e3-0066e4902a-4237-default', 'HostId': '4237-default-default'} 2024-09-13T19:19:06.071 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-13T19:19:06.083 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-13T19:19:06.083 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring'} 2024-09-13T19:19:06.095 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx000002f2438c629866ee2-0066e4902a-4237-default', 'HostId': '4237-default-default'} 2024-09-13T19:19:06.096 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket'} 2024-09-13T19:19:06.108 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx0000012bafa7d183ab3fe-0066e4902a-4237-default', 'HostId': '4237-default-default'} 2024-09-13T19:19:06.108 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'global': 'true'} 2024-09-13T19:19:06.120 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'anonymous_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-13T19:19:06.120 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring', 'enabled': 'true'} 2024-09-13T19:19:06.133 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000346bbac247b63cca-0066e4902a-4237-default', 'HostId': '4237-default-default'} 2024-09-13T19:19:06.133 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user'} 2024-09-13T19:19:06.146 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000920823966092ae56-0066e4902a-4237-default', 'HostId': '4237-default-default'} 2024-09-13T19:19:06.147 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring', 'enabled': 'true'} 2024-09-13T19:19:06.159 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000b6afd1934713d7b7-0066e4902a-4237-default', 'HostId': '4237-default-default'} 2024-09-13T19:19:06.159 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'enabled': 'true'} 2024-09-13T19:19:06.171 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000000b9edbd8a66ba3a6-0066e4902a-4237-default', 'HostId': '4237-default-default'} 2024-09-13T19:19:06.171 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user', 'enabled': 'true', 'max-read-bytes': '2'} 2024-09-13T19:19:06.189 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T19:19:06.189 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-13T19:19:06.201 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 2, 'max_write_bytes': 0, 'enabled': True}} 2024-09-13T19:19:06.201 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket', 'enabled': 'true', 'max-write-bytes': '2'} 2024-09-13T19:19:06.214 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T19:19:06.215 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-13T19:19:06.226 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 2, 'enabled': True}} 2024-09-13T19:19:06.226 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'global': 'true', 'enabled': 'true'} 2024-09-13T19:19:06.243 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T19:19:06.248 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-13T19:19:06.260 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-13T19:19:06.260 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T19:19:06.261 INFO:tasks.rgw.client.0.smithi102.stdout:2024-09-13T19:19:06.258+0000 7f57106bd640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 36254) UID: 0 2024-09-13T19:19:06.261 INFO:tasks.rgw.client.0.smithi102.stdout:2024-09-13T19:19:06.258+0000 7f571662f880 -1 shutting down 2024-09-13T19:19:12.362 INFO:tasks.rgw.client.0:Stopped 2024-09-13T19:19:12.362 DEBUG:teuthology.orchestra.run.smithi102:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-13T19:19:12.381 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f /etc/ceph/vault-root-token 2024-09-13T19:19:12.392 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-09-13T19:19:12.450 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-13T19:19:12.518 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-13T19:19:12.518 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-13T19:19:12.519 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-13T19:19:12.608 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:19:12.608 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:19:12.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.604+0000 7f47cde0e800 1 Processor -- start 2024-09-13T19:19:12.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.604+0000 7f47cde0e800 1 -- start start 2024-09-13T19:19:12.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.604+0000 7f47cde0e800 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55e91dfe84c0 0x55e91dfe88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:12.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.604+0000 7f47cde0e800 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e91dea8b30 con 0x55e91dfe8e00 2024-09-13T19:19:12.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.604+0000 7f47cde0e800 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55e91de8a360 con 0x55e91dfe84c0 2024-09-13T19:19:12.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.604+0000 7f47c951a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55e91dfe84c0 0x55e91dfe88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:12.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.604+0000 7f47c3fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55e91dfe8e00 0x55e91dfed980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.102:54368/0 (socket says 172.21.15.102:54368) 2024-09-13T19:19:12.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.604+0000 7f47c951a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55e91dfe84c0 0x55e91dfe88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:50954/0 (socket says 172.21.15.102:50954) 2024-09-13T19:19:12.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.604+0000 7f47c3fff640 1 -- 172.21.15.102:0/378361963 learned_addr learned my addr 172.21.15.102:0/378361963 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T19:19:12.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.605+0000 7f47c951a640 1 -- 172.21.15.102:0/378361963 >> v1:172.21.15.53:6789/0 conn(0x55e91dfe8e00 legacy=0x55e91dfed980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:12.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.605+0000 7f47c951a640 1 -- 172.21.15.102:0/378361963 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e91deb0e00 con 0x55e91dfe84c0 2024-09-13T19:19:12.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.607+0000 7f47c951a640 1 --2- 172.21.15.102:0/378361963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e91dfe84c0 0x55e91dfe88c0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f47bc00a600 tx=0x7f47bc047cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=470b5cdd59cf3e5a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:12.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.607+0000 7f47c8d19640 1 -- 172.21.15.102:0/378361963 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47bc056070 con 0x55e91dfe84c0 2024-09-13T19:19:12.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.607+0000 7f47c8d19640 1 -- 172.21.15.102:0/378361963 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47bc00a200 con 0x55e91dfe84c0 2024-09-13T19:19:12.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.607+0000 7f47c8d19640 1 -- 172.21.15.102:0/378361963 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47bc008590 con 0x55e91dfe84c0 2024-09-13T19:19:12.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.607+0000 7f47cde0e800 1 -- 172.21.15.102:0/378361963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e91dfe84c0 msgr2=0x55e91dfe88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:12.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.607+0000 7f47cde0e800 1 --2- 172.21.15.102:0/378361963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e91dfe84c0 0x55e91dfe88c0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f47bc00a600 tx=0x7f47bc047cb0 comp rx=0 tx=0).stop 2024-09-13T19:19:12.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.607+0000 7f47cde0e800 1 -- 172.21.15.102:0/378361963 shutdown_connections 2024-09-13T19:19:12.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.607+0000 7f47cde0e800 1 --2- 172.21.15.102:0/378361963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e91dfe84c0 0x55e91dfe88c0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:12.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.608+0000 7f47cde0e800 1 -- 172.21.15.102:0/378361963 >> 172.21.15.102:0/378361963 conn(0x55e91dfe3df0 msgr2=0x55e91dfe6210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:19:12.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.608+0000 7f47cde0e800 1 -- 172.21.15.102:0/378361963 shutdown_connections 2024-09-13T19:19:12.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.608+0000 7f47cde0e800 1 -- 172.21.15.102:0/378361963 wait complete. 2024-09-13T19:19:12.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.622+0000 7f47cde0e800 1 Processor -- start 2024-09-13T19:19:12.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.623+0000 7f47cde0e800 1 -- start start 2024-09-13T19:19:12.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.623+0000 7f47cde0e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e91dfe84c0 0x55e91e0d6670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:12.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.623+0000 7f47cde0e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e91df35330 con 0x55e91dfe84c0 2024-09-13T19:19:12.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.623+0000 7f47c951a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e91dfe84c0 0x55e91e0d6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:12.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.623+0000 7f47c951a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e91dfe84c0 0x55e91e0d6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:50958/0 (socket says 172.21.15.102:50958) 2024-09-13T19:19:12.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.623+0000 7f47c951a640 1 -- 172.21.15.102:0/961534938 learned_addr learned my addr 172.21.15.102:0/961534938 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:19:12.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.623+0000 7f47c951a640 1 -- 172.21.15.102:0/961534938 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e91de82bc0 con 0x55e91dfe84c0 2024-09-13T19:19:12.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.624+0000 7f47c951a640 1 --2- 172.21.15.102:0/961534938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e91dfe84c0 0x55e91e0d6670 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f47bc027ae0 tx=0x7f47bc053000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ebebe7ade9e5e85 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:12.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.624+0000 7f46b7606640 1 -- 172.21.15.102:0/961534938 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47bc008780 con 0x55e91dfe84c0 2024-09-13T19:19:12.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.624+0000 7f46b7606640 1 -- 172.21.15.102:0/961534938 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47bc008920 con 0x55e91dfe84c0 2024-09-13T19:19:12.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.624+0000 7f46b7606640 1 -- 172.21.15.102:0/961534938 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47bc008c00 con 0x55e91dfe84c0 2024-09-13T19:19:12.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.624+0000 7f47cde0e800 1 -- 172.21.15.102:0/961534938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e91dfe84c0 msgr2=0x55e91e0d6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:12.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.624+0000 7f47cde0e800 1 --2- 172.21.15.102:0/961534938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e91dfe84c0 0x55e91e0d6670 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f47bc027ae0 tx=0x7f47bc053000 comp rx=0 tx=0).stop 2024-09-13T19:19:12.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.625+0000 7f47cde0e800 1 -- 172.21.15.102:0/961534938 shutdown_connections 2024-09-13T19:19:12.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.625+0000 7f47cde0e800 1 --2- 172.21.15.102:0/961534938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e91dfe84c0 0x55e91e0d6670 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:12.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.625+0000 7f47cde0e800 1 -- 172.21.15.102:0/961534938 >> 172.21.15.102:0/961534938 conn(0x55e91dfe3df0 msgr2=0x55e91e0d2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:19:12.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.625+0000 7f47cde0e800 1 -- 172.21.15.102:0/961534938 shutdown_connections 2024-09-13T19:19:12.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.625+0000 7f47cde0e800 1 -- 172.21.15.102:0/961534938 wait complete. 2024-09-13T19:19:12.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.625+0000 7f47cde0e800 1 Processor -- start 2024-09-13T19:19:12.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.625+0000 7f47cde0e800 1 -- start start 2024-09-13T19:19:12.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.625+0000 7f47cde0e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e91dfe84c0 0x55e91e0e2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:12.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.625+0000 7f47cde0e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e91dfef4e0 con 0x55e91dfe84c0 2024-09-13T19:19:12.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.625+0000 7f47c951a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e91dfe84c0 0x55e91e0e2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:12.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.625+0000 7f47c951a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e91dfe84c0 0x55e91e0e2390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:50966/0 (socket says 172.21.15.102:50966) 2024-09-13T19:19:12.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.625+0000 7f47c951a640 1 -- 172.21.15.102:0/1133886273 learned_addr learned my addr 172.21.15.102:0/1133886273 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:19:12.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.626+0000 7f47c951a640 1 -- 172.21.15.102:0/1133886273 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e91de96fe0 con 0x55e91dfe84c0 2024-09-13T19:19:12.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.626+0000 7f47c951a640 1 --2- 172.21.15.102:0/1133886273 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e91dfe84c0 0x55e91e0e2390 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f47bc047cf0 tx=0x7f47bc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:12.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.626+0000 7f46b5e03640 1 -- 172.21.15.102:0/1133886273 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47bc0515a0 con 0x55e91dfe84c0 2024-09-13T19:19:12.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.626+0000 7f46b5e03640 1 -- 172.21.15.102:0/1133886273 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47bc051740 con 0x55e91dfe84c0 2024-09-13T19:19:12.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.626+0000 7f47cde0e800 1 -- 172.21.15.102:0/1133886273 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e91e0e28d0 con 0x55e91dfe84c0 2024-09-13T19:19:12.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.626+0000 7f46b5e03640 1 -- 172.21.15.102:0/1133886273 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47bc051a40 con 0x55e91dfe84c0 2024-09-13T19:19:12.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.626+0000 7f47cde0e800 1 -- 172.21.15.102:0/1133886273 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e91e0e2e50 con 0x55e91dfe84c0 2024-09-13T19:19:12.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.627+0000 7f46b5e03640 1 -- 172.21.15.102:0/1133886273 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f47bc059070 con 0x55e91dfe84c0 2024-09-13T19:19:12.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.627+0000 7f46b5e03640 1 --2- 172.21.15.102:0/1133886273 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f46b0036b40 0x7f46b0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:12.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.627+0000 7f46b5e03640 1 -- 172.21.15.102:0/1133886273 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f47bc062070 con 0x55e91dfe84c0 2024-09-13T19:19:12.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.627+0000 7f47c3fff640 1 --2- 172.21.15.102:0/1133886273 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f46b0036b40 0x7f46b0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:12.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.627+0000 7f47cde0e800 1 --2- 172.21.15.102:0/1133886273 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e91dfe8e00 0x55e91e0e9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:12.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.627+0000 7f47cde0e800 1 -- 172.21.15.102:0/1133886273 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e0e99d0 con 0x55e91dfe8e00 2024-09-13T19:19:12.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.628+0000 7f47c9d1b640 1 --2- 172.21.15.102:0/1133886273 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e91dfe8e00 0x55e91e0e9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:12.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.628+0000 7f47c3fff640 1 --2- 172.21.15.102:0/1133886273 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f46b0036b40 0x7f46b0039000 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f47b4000f60 tx=0x7f47b40012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:12.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.628+0000 7f47c9d1b640 1 --2- 172.21.15.102:0/1133886273 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e91dfe8e00 0x55e91e0e9400 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:12.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.628+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1133886273 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91dfe8e00 2024-09-13T19:19:12.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.628+0000 7f47cde0e800 1 -- 172.21.15.102:0/1133886273 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e0e69d0 con 0x55e91dfe8e00 2024-09-13T19:19:12.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.628+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1133886273 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91dfe8e00 2024-09-13T19:19:12.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.628+0000 7f47cde0e800 1 --2- 172.21.15.102:0/1133886273 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e91e0ebd20 0x55e91e0ee110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:12.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.629+0000 7f47cde0e800 1 -- 172.21.15.102:0/1133886273 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:3 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e0ee7b0 con 0x55e91e0ebd20 2024-09-13T19:19:12.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.629+0000 7f47c951a640 1 --2- 172.21.15.102:0/1133886273 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e91e0ebd20 0x55e91e0ee110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:12.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.629+0000 7f47c951a640 1 --2- 172.21.15.102:0/1133886273 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e91e0ebd20 0x55e91e0ee110 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:12.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.629+0000 7f47c951a640 1 -- 172.21.15.102:0/1133886273 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(3 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f47bc058030 con 0x55e91e0ebd20 2024-09-13T19:19:12.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.629+0000 7f47cde0e800 1 -- 172.21.15.102:0/1133886273 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e0eab00 con 0x55e91dfe8e00 2024-09-13T19:19:12.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.630+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1133886273 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91dfe8e00 2024-09-13T19:19:12.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.630+0000 7f47cde0e800 1 -- 172.21.15.102:0/1133886273 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e0eafe0 con 0x55e91e0ebd20 2024-09-13T19:19:12.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.630+0000 7f47c951a640 1 -- 172.21.15.102:0/1133886273 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(5 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f47bc058030 con 0x55e91e0ebd20 2024-09-13T19:19:12.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.630+0000 7f47cde0e800 1 Processor -- start 2024-09-13T19:19:12.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.630+0000 7f47cde0e800 1 -- start start 2024-09-13T19:19:12.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.630+0000 7f47cde0e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e91e0fd0b0 0x55e91e0fd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:12.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.631+0000 7f47cde0e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e91de84580 con 0x55e91e0fd0b0 2024-09-13T19:19:12.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.631+0000 7f47c9d1b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e91e0fd0b0 0x55e91e0fd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:12.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.631+0000 7f47c9d1b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e91e0fd0b0 0x55e91e0fd4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:50970/0 (socket says 172.21.15.102:50970) 2024-09-13T19:19:12.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.631+0000 7f47c9d1b640 1 -- 172.21.15.102:0/186051944 learned_addr learned my addr 172.21.15.102:0/186051944 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:19:12.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.631+0000 7f47c9d1b640 1 -- 172.21.15.102:0/186051944 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e91e0fda10 con 0x55e91e0fd0b0 2024-09-13T19:19:12.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.632+0000 7f47c9d1b640 1 --2- 172.21.15.102:0/186051944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e91e0fd0b0 0x55e91e0fd4d0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x55e91e0e35b0 tx=0x7f47c40167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:12.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.632+0000 7f46aeffd640 1 -- 172.21.15.102:0/186051944 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47c4013640 con 0x55e91e0fd0b0 2024-09-13T19:19:12.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.632+0000 7f46aeffd640 1 -- 172.21.15.102:0/186051944 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47c40137e0 con 0x55e91e0fd0b0 2024-09-13T19:19:12.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.632+0000 7f46aeffd640 1 -- 172.21.15.102:0/186051944 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47c4013ac0 con 0x55e91e0fd0b0 2024-09-13T19:19:12.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.632+0000 7f47cde0e800 1 -- 172.21.15.102:0/186051944 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e91e0fdca0 con 0x55e91e0fd0b0 2024-09-13T19:19:12.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.632+0000 7f47cde0e800 1 -- 172.21.15.102:0/186051944 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e91e100980 con 0x55e91e0fd0b0 2024-09-13T19:19:12.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.633+0000 7f46aeffd640 1 -- 172.21.15.102:0/186051944 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f47c4011040 con 0x55e91e0fd0b0 2024-09-13T19:19:12.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.633+0000 7f46aeffd640 1 --2- 172.21.15.102:0/186051944 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f46a0036b90 0x7f46a0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:12.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.633+0000 7f46aeffd640 1 -- 172.21.15.102:0/186051944 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f47c400e040 con 0x55e91e0fd0b0 2024-09-13T19:19:12.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.633+0000 7f47c951a640 1 --2- 172.21.15.102:0/186051944 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f46a0036b90 0x7f46a0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:12.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.633+0000 7f47cde0e800 1 Processor -- start 2024-09-13T19:19:12.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.634+0000 7f47c951a640 1 --2- 172.21.15.102:0/186051944 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f46a0036b90 0x7f46a0039050 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x55e91e0e68f0 tx=0x7f47bc077ca0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:12.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.634+0000 7f47cde0e800 1 -- start start 2024-09-13T19:19:12.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.634+0000 7f47cde0e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e91e109db0 0x55e91e10a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:12.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.634+0000 7f47cde0e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e91e0d6d60 con 0x55e91e109db0 2024-09-13T19:19:12.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.634+0000 7f47c9d1b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e91e109db0 0x55e91e10a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:12.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.634+0000 7f47c9d1b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e91e109db0 0x55e91e10a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:50976/0 (socket says 172.21.15.102:50976) 2024-09-13T19:19:12.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.634+0000 7f47c9d1b640 1 -- 172.21.15.102:0/4063836300 learned_addr learned my addr 172.21.15.102:0/4063836300 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:19:12.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.634+0000 7f47c9d1b640 1 -- 172.21.15.102:0/4063836300 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e91e10a780 con 0x55e91e109db0 2024-09-13T19:19:12.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.635+0000 7f47c9d1b640 1 --2- 172.21.15.102:0/4063836300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e91e109db0 0x55e91e10a1b0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f47c4005a10 tx=0x7f47c4012f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0c70d64d5680540 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:12.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.635+0000 7f46acff9640 1 -- 172.21.15.102:0/4063836300 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47c4021440 con 0x55e91e109db0 2024-09-13T19:19:12.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.635+0000 7f46acff9640 1 -- 172.21.15.102:0/4063836300 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47c4020c50 con 0x55e91e109db0 2024-09-13T19:19:12.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.635+0000 7f46acff9640 1 -- 172.21.15.102:0/4063836300 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47c40215e0 con 0x55e91e109db0 2024-09-13T19:19:12.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.635+0000 7f47cde0e800 1 -- 172.21.15.102:0/4063836300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e91e109db0 msgr2=0x55e91e10a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:12.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.635+0000 7f47cde0e800 1 --2- 172.21.15.102:0/4063836300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e91e109db0 0x55e91e10a1b0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f47c4005a10 tx=0x7f47c4012f20 comp rx=0 tx=0).stop 2024-09-13T19:19:12.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.635+0000 7f47cde0e800 1 -- 172.21.15.102:0/4063836300 shutdown_connections 2024-09-13T19:19:12.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.635+0000 7f47cde0e800 1 --2- 172.21.15.102:0/4063836300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e91e109db0 0x55e91e10a1b0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:12.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.635+0000 7f47cde0e800 1 -- 172.21.15.102:0/4063836300 >> 172.21.15.102:0/4063836300 conn(0x55e91e106110 msgr2=0x55e91e104210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:19:12.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.635+0000 7f47cde0e800 1 -- 172.21.15.102:0/4063836300 shutdown_connections 2024-09-13T19:19:12.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.635+0000 7f47cde0e800 1 -- 172.21.15.102:0/4063836300 wait complete. 2024-09-13T19:19:12.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.636+0000 7f47cde0e800 1 Processor -- start 2024-09-13T19:19:12.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.636+0000 7f47cde0e800 1 -- start start 2024-09-13T19:19:12.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.636+0000 7f47cde0e800 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e91e109db0 0x55e91e111220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:12.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.636+0000 7f47cde0e800 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e91e10adf0 con 0x55e91e109db0 2024-09-13T19:19:12.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.636+0000 7f47c9d1b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e91e109db0 0x55e91e111220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:12.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.636+0000 7f47c9d1b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e91e109db0 0x55e91e111220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.102:50980/0 (socket says 172.21.15.102:50980) 2024-09-13T19:19:12.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.636+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 learned_addr learned my addr 172.21.15.102:0/1068830894 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T19:19:12.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.636+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e91e111760 con 0x55e91e109db0 2024-09-13T19:19:12.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.636+0000 7f47c9d1b640 1 --2- 172.21.15.102:0/1068830894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e91e109db0 0x55e91e111220 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f47c400b010 tx=0x7f47c404ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:12.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.637+0000 7f469effd640 1 -- 172.21.15.102:0/1068830894 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47c401f470 con 0x55e91e109db0 2024-09-13T19:19:12.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.637+0000 7f469effd640 1 -- 172.21.15.102:0/1068830894 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47c401f610 con 0x55e91e109db0 2024-09-13T19:19:12.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.637+0000 7f469effd640 1 -- 172.21.15.102:0/1068830894 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47c40204d0 con 0x55e91e109db0 2024-09-13T19:19:12.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.637+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e91e1119f0 con 0x55e91e109db0 2024-09-13T19:19:12.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.637+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e91e1119f0 con 0x55e91e109db0 2024-09-13T19:19:12.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.637+0000 7f469effd640 1 -- 172.21.15.102:0/1068830894 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f47c403b020 con 0x55e91e109db0 2024-09-13T19:19:12.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.638+0000 7f469effd640 1 --2- 172.21.15.102:0/1068830894 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4694036b40 0x7f4694039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:12.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.638+0000 7f469effd640 1 -- 172.21.15.102:0/1068830894 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f47c4039020 con 0x55e91e109db0 2024-09-13T19:19:12.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.638+0000 7f47c951a640 1 --2- 172.21.15.102:0/1068830894 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4694036b40 0x7f4694039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:12.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.638+0000 7f47c951a640 1 --2- 172.21.15.102:0/1068830894 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4694036b40 0x7f4694039000 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f47bc077ff0 tx=0x7f47bc085000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:12.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.638+0000 7f47cde0e800 20 rados->read ofs=0 len=0 2024-09-13T19:19:12.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.638+0000 7f47cde0e800 1 --2- 172.21.15.102:0/1068830894 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e91e11cb40 0x55e91e11f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:12.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.638+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e11f750 con 0x55e91e11cb40 2024-09-13T19:19:12.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.639+0000 7f47c3fff640 1 --2- 172.21.15.102:0/1068830894 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e91e11cb40 0x55e91e11f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:12.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.639+0000 7f47c3fff640 1 --2- 172.21.15.102:0/1068830894 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e91e11cb40 0x55e91e11f000 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:12.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.639+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f47b4009050 con 0x55e91e11cb40 2024-09-13T19:19:12.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.639+0000 7f47cde0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:19:12.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.639+0000 7f47cde0e800 20 realm 2024-09-13T19:19:12.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.639+0000 7f47cde0e800 20 rados->read ofs=0 len=0 2024-09-13T19:19:12.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.639+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e11bf90 con 0x55e91e11cb40 2024-09-13T19:19:12.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.639+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f47b4009050 con 0x55e91e11cb40 2024-09-13T19:19:12.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.639+0000 7f47cde0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:19:12.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.639+0000 7f47cde0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:19:12.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.639+0000 7f47cde0e800 20 rados->read ofs=0 len=0 2024-09-13T19:19:12.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.639+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e120240 con 0x55e91e11cb40 2024-09-13T19:19:12.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.640+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f47b4009050 con 0x55e91e11cb40 2024-09-13T19:19:12.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.640+0000 7f47cde0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:19:12.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.640+0000 7f47cde0e800 20 rados->read ofs=0 len=0 2024-09-13T19:19:12.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.640+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e120b10 con 0x55e91e11cb40 2024-09-13T19:19:12.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.640+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f47b4009050 con 0x55e91e11cb40 2024-09-13T19:19:12.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.640+0000 7f47cde0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:19:12.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.640+0000 7f47cde0e800 20 rados->read ofs=0 len=0 2024-09-13T19:19:12.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.640+0000 7f47cde0e800 1 --2- 172.21.15.102:0/1068830894 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e91e121450 0x55e91e123840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:12.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.640+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:5 5.e 5:71aff70a:::zone_info.509740b4-c081-4f37-bd6d-df9ca851489b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e123fd0 con 0x55e91e121450 2024-09-13T19:19:12.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.640+0000 7f47c9d1b640 1 --2- 172.21.15.102:0/1068830894 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e91e121450 0x55e91e123840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:12.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.640+0000 7f47c9d1b640 1 --2- 172.21.15.102:0/1068830894 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e91e121450 0x55e91e123840 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:12.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.641+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== osd_op_reply(5 zone_info.509740b4-c081-4f37-bd6d-df9ca851489b [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.641+0000 7f47cde0e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:19:12.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.641+0000 7f47cde0e800 20 searching for the correct realm 2024-09-13T19:19:12.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.641+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e91e125920 con 0x55e91e121450 2024-09-13T19:19:12.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.641+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.641+0000 7f47c9d1b640 1 --2- 172.21.15.102:0/1068830894 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f47c4034070 0x7f47c401a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:12.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.641+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e91e125920 con 0x7f47c4034070 2024-09-13T19:19:12.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.641+0000 7f47c951a640 1 --2- 172.21.15.102:0/1068830894 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f47c4034070 0x7f47c401a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:12.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.641+0000 7f47c951a640 1 --2- 172.21.15.102:0/1068830894 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f47c4034070 0x7f47c401a0b0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:12.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.642+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.642+0000 7f47c951a640 1 --2- 172.21.15.102:0/1068830894 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f47bc05b070 0x7f47bc0065b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:12.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.642+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e91e125920 con 0x7f47bc05b070 2024-09-13T19:19:12.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.642+0000 7f47c3fff640 1 --2- 172.21.15.102:0/1068830894 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f47bc05b070 0x7f47bc0065b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:12.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.642+0000 7f47c3fff640 1 --2- 172.21.15.102:0/1068830894 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f47bc05b070 0x7f47bc0065b0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:12.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.643+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47b4009050 con 0x7f47bc05b070 2024-09-13T19:19:12.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.643+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e91e125920 con 0x55e91e11cb40 2024-09-13T19:19:12.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.643+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47b4009050 con 0x55e91e11cb40 2024-09-13T19:19:12.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.643+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e91e125920 con 0x55e91e11cb40 2024-09-13T19:19:12.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.643+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.643+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e91e125920 con 0x7f47bc05b070 2024-09-13T19:19:12.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.643+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.643+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e91e125920 con 0x7f47bc05b070 2024-09-13T19:19:12.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.644+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.644+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e91e125920 con 0x7f47c4034070 2024-09-13T19:19:12.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.644+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.644+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e91e125920 con 0x55e91e121450 2024-09-13T19:19:12.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.644+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.644+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e91e125920 con 0x55e91e11cb40 2024-09-13T19:19:12.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.644+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.644+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e91e125920 con 0x7f47c4034070 2024-09-13T19:19:12.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.645+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 3 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.645+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e91e125920 con 0x55e91e11cb40 2024-09-13T19:19:12.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.645+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.645+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e91e125920 con 0x7f47c4034070 2024-09-13T19:19:12.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.645+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 4 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v27'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.645+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e91e125920 con 0x55e91e121450 2024-09-13T19:19:12.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.645+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.645+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e91e125920 con 0x55e91e121450 2024-09-13T19:19:12.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.646+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.646+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e91e125920 con 0x7f47bc05b070 2024-09-13T19:19:12.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.646+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.646+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e91e125920 con 0x55e91e121450 2024-09-13T19:19:12.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.646+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=112b] v27'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.646+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e91e125920 con 0x55e91e121450 2024-09-13T19:19:12.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.647+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.647+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e91e125920 con 0x55e91e11cb40 2024-09-13T19:19:12.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.647+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.647+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e91e125920 con 0x55e91e11cb40 2024-09-13T19:19:12.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.647+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.647+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e91e125920 con 0x7f47bc05b070 2024-09-13T19:19:12.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.647+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.647+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e91e125920 con 0x55e91e121450 2024-09-13T19:19:12.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.648+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.648+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e91e125920 con 0x7f47c4034070 2024-09-13T19:19:12.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.648+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.648+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e91e125920 con 0x55e91e11cb40 2024-09-13T19:19:12.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.648+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.648+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e91e125920 con 0x7f47c4034070 2024-09-13T19:19:12.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.648+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=82b] v36'1 uv1 ondisk = 1) ==== 144+0+82 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.648+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e91e125920 con 0x55e91e121450 2024-09-13T19:19:12.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.649+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.649+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e91e125920 con 0x7f47bc05b070 2024-09-13T19:19:12.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.649+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.649+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e91e125920 con 0x7f47c4034070 2024-09-13T19:19:12.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.649+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.649+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e91e125920 con 0x55e91e121450 2024-09-13T19:19:12.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.650+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.650+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e91e125920 con 0x7f47bc05b070 2024-09-13T19:19:12.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.650+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.650+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e91e125920 con 0x55e91e11cb40 2024-09-13T19:19:12.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.650+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v36'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.650+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e91e125920 con 0x7f47c4034070 2024-09-13T19:19:12.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.650+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.650+0000 7f47cde0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:19:12.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.650+0000 7f47cde0e800 20 RGWRados::pool_iterate: got zone_info.509740b4-c081-4f37-bd6d-df9ca851489b 2024-09-13T19:19:12.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.650+0000 7f47cde0e800 20 RGWRados::pool_iterate: got zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b 2024-09-13T19:19:12.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.650+0000 7f47cde0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:19:12.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.650+0000 7f47cde0e800 20 RGWRados::pool_iterate: got period_config.default 2024-09-13T19:19:12.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.650+0000 7f47cde0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:19:12.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.650+0000 7f47cde0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:19:12.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.651+0000 7f47cde0e800 20 rados->read ofs=0 len=0 2024-09-13T19:19:12.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.651+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e1249c0 con 0x55e91e11cb40 2024-09-13T19:19:12.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.651+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.651+0000 7f47cde0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:19:12.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.651+0000 7f47cde0e800 20 rados->read ofs=0 len=0 2024-09-13T19:19:12.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.651+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e125260 con 0x55e91e11cb40 2024-09-13T19:19:12.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.651+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.651+0000 7f47cde0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:19:12.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.651+0000 7f47cde0e800 20 rados->read ofs=0 len=0 2024-09-13T19:19:12.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.651+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:40 5.1 5:85e5adc7:::zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e125da0 con 0x55e91e121450 2024-09-13T19:19:12.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.651+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 11 ==== osd_op_reply(40 zonegroup_info.f767d22e-a5e7-4349-a797-2de84f67e90b [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.651+0000 7f47cde0e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:19:12.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.651+0000 7f47cde0e800 20 zone default found 2024-09-13T19:19:12.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.651+0000 7f47cde0e800 4 Realm: () 2024-09-13T19:19:12.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.651+0000 7f47cde0e800 4 ZoneGroup: default (f767d22e-a5e7-4349-a797-2de84f67e90b) 2024-09-13T19:19:12.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.651+0000 7f47cde0e800 4 Zone: default (509740b4-c081-4f37-bd6d-df9ca851489b) 2024-09-13T19:19:12.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.651+0000 7f47cde0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:19:12.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.651+0000 7f47cde0e800 20 zonegroup default 2024-09-13T19:19:12.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.651+0000 7f47cde0e800 20 rados->read ofs=0 len=0 2024-09-13T19:19:12.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.651+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e1265f0 con 0x7f47c4034070 2024-09-13T19:19:12.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.652+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 9 ==== osd_op_reply(41 period_config.default [read 0~187 out=187b] v0'0 uv1 ondisk = 0) ==== 165+0+187 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.652+0000 7f47cde0e800 20 rados_obj.operate() r=0 bl.length=187 2024-09-13T19:19:12.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.652+0000 7f47cde0e800 20 rados->read ofs=0 len=0 2024-09-13T19:19:12.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.652+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e126230 con 0x55e91e121450 2024-09-13T19:19:12.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.652+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.652+0000 7f47cde0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:19:12.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.652+0000 7f47cde0e800 20 rados->read ofs=0 len=0 2024-09-13T19:19:12.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.652+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e1288a0 con 0x55e91e121450 2024-09-13T19:19:12.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.652+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.652+0000 7f47cde0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:19:12.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.652+0000 7f47cde0e800 20 started sync module instance, tier type = 2024-09-13T19:19:12.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.652+0000 7f47cde0e800 20 started zone id=509740b4-c081-4f37-bd6d-df9ca851489b (name=default) with tier type = 2024-09-13T19:19:12.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.652+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e127cb0 con 0x7f47c4034070 2024-09-13T19:19:12.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.653+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 10 ==== osd_op_reply(44 notify.0 [create] v36'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.653+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94459720269984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e1291e0 con 0x7f47c4034070 2024-09-13T19:19:12.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.653+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e129a30 con 0x55e91e11cb40 2024-09-13T19:19:12.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.654+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94459720269984] v36'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.655+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 15 ==== osd_op_reply(46 notify.1 [create] v36'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.655+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94459720275328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e129dd0 con 0x55e91e11cb40 2024-09-13T19:19:12.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.655+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e12a7f0 con 0x55e91e121450 2024-09-13T19:19:12.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.656+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94459720275328] v36'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.656+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 14 ==== osd_op_reply(48 notify.2 [create] v36'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.656+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94459720278752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e12a7b0 con 0x55e91e121450 2024-09-13T19:19:12.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.656+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e12b280 con 0x7f47c4034070 2024-09-13T19:19:12.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.657+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 12 ==== osd_op_reply(50 notify.3 [create] v36'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.657+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94459720281520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e12b280 con 0x7f47c4034070 2024-09-13T19:19:12.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.657+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94459720278752] v36'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.657+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e128d70 con 0x55e91e11cb40 2024-09-13T19:19:12.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.658+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94459720281520] v36'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.659+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 17 ==== osd_op_reply(52 notify.4 [create] v36'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.659+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94459720283760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e128d70 con 0x55e91e11cb40 2024-09-13T19:19:12.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.659+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e12c7e0 con 0x7f47bc05b070 2024-09-13T19:19:12.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.660+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 8 ==== osd_op_reply(54 notify.5 [create] v36'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.660+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94459720287024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e12c7b0 con 0x7f47bc05b070 2024-09-13T19:19:12.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.660+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e12d7d0 con 0x7f47bc05b070 2024-09-13T19:19:12.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.660+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94459720283760] v36'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.661+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 9 ==== osd_op_reply(55 notify.5 [watch watch cookie 94459720287024] v36'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.661+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 10 ==== osd_op_reply(56 notify.6 [create] v36'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.661+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94459720289232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e12bd10 con 0x7f47bc05b070 2024-09-13T19:19:12.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.661+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e12dc40 con 0x7f47bc05b070 2024-09-13T19:19:12.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.662+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 11 ==== osd_op_reply(57 notify.6 [watch watch cookie 94459720289232] v36'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.662+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 12 ==== osd_op_reply(58 notify.7 [create] v36'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.662+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94459720290976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e12dc40 con 0x7f47bc05b070 2024-09-13T19:19:12.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.662+0000 7f47cde0e800 20 add_watcher() i=0 2024-09-13T19:19:12.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.662+0000 7f47cde0e800 20 add_watcher() i=1 2024-09-13T19:19:12.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.662+0000 7f47cde0e800 20 add_watcher() i=2 2024-09-13T19:19:12.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.662+0000 7f47cde0e800 20 add_watcher() i=3 2024-09-13T19:19:12.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.662+0000 7f47cde0e800 20 add_watcher() i=4 2024-09-13T19:19:12.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.662+0000 7f47cde0e800 20 add_watcher() i=5 2024-09-13T19:19:12.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.662+0000 7f47cde0e800 20 add_watcher() i=6 2024-09-13T19:19:12.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.663+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 13 ==== osd_op_reply(59 notify.7 [watch watch cookie 94459720290976] v36'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.663+0000 7f47cde0e800 20 add_watcher() i=7 2024-09-13T19:19:12.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.663+0000 7f47cde0e800 2 all 8 watchers are set, enabling cache 2024-09-13T19:19:12.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.663+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e131070 con 0x55e91e11cb40 2024-09-13T19:19:12.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.664+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.664+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94459720292704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e12e5c0 con 0x55e91e11cb40 2024-09-13T19:19:12.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.665+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94459720292704] v36'275 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.665+0000 7f467f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:19:12.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.665+0000 7f47cde0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:19:12.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.665+0000 7f47cde0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:19:12.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.665+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e139a20 con 0x55e91e11cb40 2024-09-13T19:19:12.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.666+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v36'38 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.666+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e13a0f0 con 0x7f47bc05b070 2024-09-13T19:19:12.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.667+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 14 ==== osd_op_reply(63 gc.1 [create,call,call,call] v36'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.667+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e13a510 con 0x55e91e121450 2024-09-13T19:19:12.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.668+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v36'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.668+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e13a460 con 0x55e91e11cb40 2024-09-13T19:19:12.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.669+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v36'276 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.669+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e13aa10 con 0x7f47c4034070 2024-09-13T19:19:12.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.670+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v36'85 uv55 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.670+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e13aec0 con 0x55e91e121450 2024-09-13T19:19:12.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.671+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v36'56 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.671+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e13aec0 con 0x55e91e11cb40 2024-09-13T19:19:12.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.672+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v36'34 uv33 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.672+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e13aec0 con 0x7f47bc05b070 2024-09-13T19:19:12.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.674+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 15 ==== osd_op_reply(69 gc.7 [create,call,call,call] v36'55 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.674+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e13af50 con 0x7f47c4034070 2024-09-13T19:19:12.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.675+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v36'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.675+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e13afe0 con 0x55e91e121450 2024-09-13T19:19:12.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.676+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v36'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.676+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e13b0a0 con 0x7f47c4034070 2024-09-13T19:19:12.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.677+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v36'86 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.677+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e13b180 con 0x7f47bc05b070 2024-09-13T19:19:12.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.678+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v36'42 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.678+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e13b180 con 0x7f47c4034070 2024-09-13T19:19:12.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.679+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v36'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.679+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e13b180 con 0x7f47bc05b070 2024-09-13T19:19:12.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.680+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 17 ==== osd_op_reply(75 gc.13 [create,call,call,call] v36'62 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.680+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e13b180 con 0x55e91e11cb40 2024-09-13T19:19:12.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.681+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v36'277 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.681+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e13b180 con 0x55e91e121450 2024-09-13T19:19:12.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.683+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v36'77 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.683+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e13b180 con 0x7f47c4034070 2024-09-13T19:19:12.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.684+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v36'87 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.684+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e13b180 con 0x55e91e121450 2024-09-13T19:19:12.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.685+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v36'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.685+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e13b180 con 0x55e91e11cb40 2024-09-13T19:19:12.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.686+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v36'40 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.686+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e13b180 con 0x55e91e11cb40 2024-09-13T19:19:12.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.687+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v36'278 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.687+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e13b180 con 0x55e91e121450 2024-09-13T19:19:12.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.688+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v36'78 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.688+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e13b180 con 0x7f47c4034070 2024-09-13T19:19:12.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.689+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v36'42 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.689+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e13b180 con 0x55e91e121450 2024-09-13T19:19:12.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.690+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v36'34 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.690+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e13b180 con 0x55e91e121450 2024-09-13T19:19:12.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.691+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v36'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.691+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e13b180 con 0x55e91e121450 2024-09-13T19:19:12.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.692+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v36'27 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.692+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e13b180 con 0x55e91e121450 2024-09-13T19:19:12.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.693+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v36'57 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.693+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e13b180 con 0x7f47bc05b070 2024-09-13T19:19:12.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.694+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 18 ==== osd_op_reply(88 gc.26 [create,call,call,call] v36'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.694+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e13b180 con 0x55e91e121450 2024-09-13T19:19:12.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.695+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v36'34 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.695+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e13b180 con 0x7f47bc05b070 2024-09-13T19:19:12.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.696+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 19 ==== osd_op_reply(90 gc.28 [create,call,call,call] v36'56 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.696+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e13b180 con 0x55e91e121450 2024-09-13T19:19:12.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.697+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v36'79 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.697+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e13b180 con 0x7f47bc05b070 2024-09-13T19:19:12.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.698+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 20 ==== osd_op_reply(92 gc.30 [create,call,call,call] v36'63 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.698+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e13b180 con 0x7f47c4034070 2024-09-13T19:19:12.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.699+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v36'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.700+0000 7f467e7e4640 20 reqs_thread_entry: start 2024-09-13T19:19:12.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.700+0000 7f47cde0e800 20 init_complete bucket index max shards: 11 2024-09-13T19:19:12.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.700+0000 7f47cde0e800 20 Filter name: none 2024-09-13T19:19:12.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.700+0000 7f45effff640 20 reqs_thread_entry: start 2024-09-13T19:19:12.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.700+0000 7f47cde0e800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-13T19:19:12.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.700+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:94 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.701+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 28 ==== osd_op_reply(94 gc.9 [call] v36'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.701+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:95 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.701+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 29 ==== osd_op_reply(95 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.701+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.701+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:96 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e166410 con 0x55e91e121450 2024-09-13T19:19:12.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.701+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 30 ==== osd_op_reply(96 gc.9 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.701+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:97 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.702+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 31 ==== osd_op_reply(97 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.702+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:19:12.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.702+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:98 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.702+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 32 ==== osd_op_reply(98 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.702+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.702+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:99 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.703+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 33 ==== osd_op_reply(99 gc.9 [call] v36'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.703+0000 7f47cde0e800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-13T19:19:12.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.703+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:100 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47c4034070 2024-09-13T19:19:12.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.704+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 21 ==== osd_op_reply(100 gc.10 [call] v36'88 uv88 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.704+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:101 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47c4034070 2024-09-13T19:19:12.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.704+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 22 ==== osd_op_reply(101 gc.10 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.704+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.704+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:102 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e166410 con 0x7f47c4034070 2024-09-13T19:19:12.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.704+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 23 ==== osd_op_reply(102 gc.10 [call out=24b] v0'0 uv88 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.704+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:103 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47c4034070 2024-09-13T19:19:12.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.704+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 24 ==== osd_op_reply(103 gc.10 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.704+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:19:12.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.704+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:104 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47c4034070 2024-09-13T19:19:12.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.705+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 25 ==== osd_op_reply(104 gc.10 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.705+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.705+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:105 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47c4034070 2024-09-13T19:19:12.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.705+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 26 ==== osd_op_reply(105 gc.10 [call] v36'89 uv89 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.706+0000 7f47cde0e800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-13T19:19:12.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.706+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:106 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47bc05b070 2024-09-13T19:19:12.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.707+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 21 ==== osd_op_reply(106 gc.11 [call] v36'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.707+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:107 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47bc05b070 2024-09-13T19:19:12.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.707+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 22 ==== osd_op_reply(107 gc.11 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.707+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.707+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:108 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e166410 con 0x7f47bc05b070 2024-09-13T19:19:12.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.707+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 23 ==== osd_op_reply(108 gc.11 [call out=24b] v0'0 uv43 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.707+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:109 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47bc05b070 2024-09-13T19:19:12.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.708+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 24 ==== osd_op_reply(109 gc.11 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.708+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:19:12.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.708+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:110 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47bc05b070 2024-09-13T19:19:12.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.708+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 25 ==== osd_op_reply(110 gc.11 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.708+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.708+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:111 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47bc05b070 2024-09-13T19:19:12.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.709+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 26 ==== osd_op_reply(111 gc.11 [call] v36'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.709+0000 7f47cde0e800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-13T19:19:12.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.709+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:112 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47c4034070 2024-09-13T19:19:12.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.710+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 27 ==== osd_op_reply(112 gc.12 [call] v36'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.710+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:113 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47c4034070 2024-09-13T19:19:12.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.710+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 28 ==== osd_op_reply(113 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.710+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.710+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:114 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e166410 con 0x7f47c4034070 2024-09-13T19:19:12.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.710+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 29 ==== osd_op_reply(114 gc.12 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.710+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:115 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47c4034070 2024-09-13T19:19:12.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.710+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 30 ==== osd_op_reply(115 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.710+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:19:12.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.710+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:116 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47c4034070 2024-09-13T19:19:12.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.711+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 31 ==== osd_op_reply(116 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.711+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.711+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:117 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47c4034070 2024-09-13T19:19:12.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.711+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 32 ==== osd_op_reply(117 gc.12 [call] v36'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.711+0000 7f47cde0e800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-13T19:19:12.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.711+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:118 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47bc05b070 2024-09-13T19:19:12.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.713+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 27 ==== osd_op_reply(118 gc.13 [call] v36'64 uv64 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.713+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:119 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47bc05b070 2024-09-13T19:19:12.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.713+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 28 ==== osd_op_reply(119 gc.13 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.713+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.713+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:120 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e166410 con 0x7f47bc05b070 2024-09-13T19:19:12.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.713+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 29 ==== osd_op_reply(120 gc.13 [call out=24b] v0'0 uv64 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.713+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:121 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47bc05b070 2024-09-13T19:19:12.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.714+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 30 ==== osd_op_reply(121 gc.13 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.714+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:19:12.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.714+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:122 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47bc05b070 2024-09-13T19:19:12.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.714+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 31 ==== osd_op_reply(122 gc.13 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.714+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.714+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:123 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47bc05b070 2024-09-13T19:19:12.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.715+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 32 ==== osd_op_reply(123 gc.13 [call] v36'65 uv65 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.715+0000 7f47cde0e800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-13T19:19:12.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.715+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:124 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e11cb40 2024-09-13T19:19:12.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.716+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 27 ==== osd_op_reply(124 gc.14 [call] v36'279 uv279 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.716+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:125 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e11cb40 2024-09-13T19:19:12.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.716+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 28 ==== osd_op_reply(125 gc.14 [call out=15b] v0'0 uv279 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.716+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.716+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:126 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e166410 con 0x55e91e11cb40 2024-09-13T19:19:12.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.717+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 29 ==== osd_op_reply(126 gc.14 [call out=24b] v0'0 uv279 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.717+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:127 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e11cb40 2024-09-13T19:19:12.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.717+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 30 ==== osd_op_reply(127 gc.14 [call out=15b] v0'0 uv279 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.717+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:19:12.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.717+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:128 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e11cb40 2024-09-13T19:19:12.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.717+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 31 ==== osd_op_reply(128 gc.14 [call out=15b] v0'0 uv279 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.717+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.717+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:129 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e11cb40 2024-09-13T19:19:12.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.718+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 32 ==== osd_op_reply(129 gc.14 [call] v36'280 uv280 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.718+0000 7f47cde0e800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-13T19:19:12.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.718+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:130 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.719+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 34 ==== osd_op_reply(130 gc.15 [call] v36'80 uv80 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.719+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:131 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.719+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 35 ==== osd_op_reply(131 gc.15 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.719+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.719+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:132 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e166410 con 0x55e91e121450 2024-09-13T19:19:12.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.720+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 36 ==== osd_op_reply(132 gc.15 [call out=24b] v0'0 uv80 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.720+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:133 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.720+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 37 ==== osd_op_reply(133 gc.15 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.720+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:19:12.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.720+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:134 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.720+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 38 ==== osd_op_reply(134 gc.15 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.720+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.720+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:135 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.721+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 39 ==== osd_op_reply(135 gc.15 [call] v36'81 uv81 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.721+0000 7f47cde0e800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-13T19:19:12.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.721+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:136 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47c4034070 2024-09-13T19:19:12.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.723+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 33 ==== osd_op_reply(136 gc.16 [call] v36'90 uv90 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.723+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:137 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47c4034070 2024-09-13T19:19:12.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.723+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 34 ==== osd_op_reply(137 gc.16 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.723+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.723+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:138 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e166410 con 0x7f47c4034070 2024-09-13T19:19:12.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.723+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 35 ==== osd_op_reply(138 gc.16 [call out=24b] v0'0 uv90 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.723+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:139 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47c4034070 2024-09-13T19:19:12.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.723+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 36 ==== osd_op_reply(139 gc.16 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.723+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:19:12.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.723+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:140 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47c4034070 2024-09-13T19:19:12.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.724+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 37 ==== osd_op_reply(140 gc.16 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.724+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.724+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:141 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47c4034070 2024-09-13T19:19:12.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.724+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 38 ==== osd_op_reply(141 gc.16 [call] v36'91 uv91 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.724+0000 7f47cde0e800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-13T19:19:12.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.725+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:142 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.725+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 40 ==== osd_op_reply(142 gc.17 [call] v36'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.725+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:143 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.726+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 41 ==== osd_op_reply(143 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.726+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.726+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:144 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e166410 con 0x55e91e121450 2024-09-13T19:19:12.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.726+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 42 ==== osd_op_reply(144 gc.17 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.726+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.726+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 43 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.726+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:19:12.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.726+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.726+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 44 ==== osd_op_reply(146 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.726+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.726+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.727+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 45 ==== osd_op_reply(147 gc.17 [call] v36'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.727+0000 7f47cde0e800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-13T19:19:12.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.727+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e11cb40 2024-09-13T19:19:12.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.729+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 33 ==== osd_op_reply(148 gc.18 [call] v36'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.729+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e11cb40 2024-09-13T19:19:12.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.729+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 34 ==== osd_op_reply(149 gc.18 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.729+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.729+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e166410 con 0x55e91e11cb40 2024-09-13T19:19:12.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.729+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 35 ==== osd_op_reply(150 gc.18 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.729+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:151 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e11cb40 2024-09-13T19:19:12.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.729+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 36 ==== osd_op_reply(151 gc.18 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.729+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:19:12.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.729+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:152 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e11cb40 2024-09-13T19:19:12.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.729+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 37 ==== osd_op_reply(152 gc.18 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.729+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.729+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:153 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e11cb40 2024-09-13T19:19:12.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.730+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 38 ==== osd_op_reply(153 gc.18 [call] v36'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.730+0000 7f47cde0e800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-13T19:19:12.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.730+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:154 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e11cb40 2024-09-13T19:19:12.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.731+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 39 ==== osd_op_reply(154 gc.19 [call] v36'281 uv281 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.731+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:155 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e11cb40 2024-09-13T19:19:12.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.732+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 40 ==== osd_op_reply(155 gc.19 [call out=15b] v0'0 uv281 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.732+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.732+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:156 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e166410 con 0x55e91e11cb40 2024-09-13T19:19:12.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.732+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 41 ==== osd_op_reply(156 gc.19 [call out=24b] v0'0 uv281 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.732+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:157 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e11cb40 2024-09-13T19:19:12.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.732+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 42 ==== osd_op_reply(157 gc.19 [call out=15b] v0'0 uv281 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.732+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:19:12.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.732+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:158 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e11cb40 2024-09-13T19:19:12.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.732+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 43 ==== osd_op_reply(158 gc.19 [call out=15b] v0'0 uv281 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.732+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.732+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:159 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e11cb40 2024-09-13T19:19:12.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.733+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 44 ==== osd_op_reply(159 gc.19 [call] v36'282 uv282 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.733+0000 7f47cde0e800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-13T19:19:12.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.733+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:160 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.734+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 46 ==== osd_op_reply(160 gc.20 [call] v36'82 uv82 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.734+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:161 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.735+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 47 ==== osd_op_reply(161 gc.20 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.735+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.735+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:162 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e166410 con 0x55e91e121450 2024-09-13T19:19:12.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.735+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 48 ==== osd_op_reply(162 gc.20 [call out=24b] v0'0 uv82 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.735+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:163 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.735+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 49 ==== osd_op_reply(163 gc.20 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.735+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:19:12.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.735+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:164 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.736+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 50 ==== osd_op_reply(164 gc.20 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.736+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.736+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:165 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.737+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 51 ==== osd_op_reply(165 gc.20 [call] v36'83 uv83 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.737+0000 7f47cde0e800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-13T19:19:12.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.737+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:166 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47c4034070 2024-09-13T19:19:12.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.738+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 39 ==== osd_op_reply(166 gc.21 [call] v36'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.738+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:167 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47c4034070 2024-09-13T19:19:12.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.738+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 40 ==== osd_op_reply(167 gc.21 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.738+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.738+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:168 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e166410 con 0x7f47c4034070 2024-09-13T19:19:12.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.738+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 41 ==== osd_op_reply(168 gc.21 [call out=24b] v0'0 uv43 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.738+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:169 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47c4034070 2024-09-13T19:19:12.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.739+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 42 ==== osd_op_reply(169 gc.21 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.739+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:19:12.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.739+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:170 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47c4034070 2024-09-13T19:19:12.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.739+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 43 ==== osd_op_reply(170 gc.21 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.739+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.739+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:171 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47c4034070 2024-09-13T19:19:12.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.740+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 44 ==== osd_op_reply(171 gc.21 [call] v36'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.740+0000 7f47cde0e800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-13T19:19:12.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.740+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:172 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.741+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 52 ==== osd_op_reply(172 gc.22 [call] v36'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.741+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:173 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.741+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 53 ==== osd_op_reply(173 gc.22 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.741+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.741+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:174 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e166410 con 0x55e91e121450 2024-09-13T19:19:12.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.741+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 54 ==== osd_op_reply(174 gc.22 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.741+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:175 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.741+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 55 ==== osd_op_reply(175 gc.22 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.742+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:19:12.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.742+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:176 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.742+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 56 ==== osd_op_reply(176 gc.22 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.742+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.742+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:177 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.743+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 57 ==== osd_op_reply(177 gc.22 [call] v36'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.743+0000 7f47cde0e800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-13T19:19:12.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.743+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:178 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.744+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 58 ==== osd_op_reply(178 gc.23 [call] v36'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.744+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:179 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.744+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 59 ==== osd_op_reply(179 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.744+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.744+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:180 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e166410 con 0x55e91e121450 2024-09-13T19:19:12.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.744+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 60 ==== osd_op_reply(180 gc.23 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.744+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:181 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.744+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 61 ==== osd_op_reply(181 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.744+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:19:12.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.744+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:182 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.745+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 62 ==== osd_op_reply(182 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.745+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.745+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:183 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.745+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 63 ==== osd_op_reply(183 gc.23 [call] v36'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.746+0000 7f47cde0e800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-13T19:19:12.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.746+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:184 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.746+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 64 ==== osd_op_reply(184 gc.24 [call] v36'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.746+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:185 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.747+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 65 ==== osd_op_reply(185 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.747+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.747+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:186 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e166410 con 0x55e91e121450 2024-09-13T19:19:12.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.747+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 66 ==== osd_op_reply(186 gc.24 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.747+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:187 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.747+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 67 ==== osd_op_reply(187 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.747+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:19:12.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.747+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:188 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.747+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 68 ==== osd_op_reply(188 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.747+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.747+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:189 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.748+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 69 ==== osd_op_reply(189 gc.24 [call] v36'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.748+0000 7f47cde0e800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-13T19:19:12.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.748+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:190 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.749+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 70 ==== osd_op_reply(190 gc.25 [call] v36'58 uv58 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.749+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:191 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.749+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 71 ==== osd_op_reply(191 gc.25 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.749+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.749+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:192 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e166410 con 0x55e91e121450 2024-09-13T19:19:12.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.750+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 72 ==== osd_op_reply(192 gc.25 [call out=24b] v0'0 uv58 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.750+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:193 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.750+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 73 ==== osd_op_reply(193 gc.25 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.750+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:19:12.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.750+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:194 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.750+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 74 ==== osd_op_reply(194 gc.25 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.750+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.750+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:195 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.751+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 75 ==== osd_op_reply(195 gc.25 [call] v36'59 uv59 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.751+0000 7f47cde0e800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-13T19:19:12.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.751+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:196 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47bc05b070 2024-09-13T19:19:12.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.752+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 33 ==== osd_op_reply(196 gc.26 [call] v36'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.752+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:197 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47bc05b070 2024-09-13T19:19:12.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.753+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 34 ==== osd_op_reply(197 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.753+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.753+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:198 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e166410 con 0x7f47bc05b070 2024-09-13T19:19:12.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.753+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 35 ==== osd_op_reply(198 gc.26 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.753+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:199 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47bc05b070 2024-09-13T19:19:12.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.753+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 36 ==== osd_op_reply(199 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.753+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:19:12.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.753+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:200 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47bc05b070 2024-09-13T19:19:12.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.754+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 37 ==== osd_op_reply(200 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.754+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.754+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:201 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47bc05b070 2024-09-13T19:19:12.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.755+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 38 ==== osd_op_reply(201 gc.26 [call] v36'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.755+0000 7f47cde0e800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-13T19:19:12.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.755+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:202 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.756+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 76 ==== osd_op_reply(202 gc.27 [call] v36'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.756+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:203 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.756+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 77 ==== osd_op_reply(203 gc.27 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.756+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.756+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:204 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e166410 con 0x55e91e121450 2024-09-13T19:19:12.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.756+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 78 ==== osd_op_reply(204 gc.27 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.756+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:205 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.756+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 79 ==== osd_op_reply(205 gc.27 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.757+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:19:12.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.757+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:206 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.757+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 80 ==== osd_op_reply(206 gc.27 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.757+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.757+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:207 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.757+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 81 ==== osd_op_reply(207 gc.27 [call] v36'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.757+0000 7f47cde0e800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-13T19:19:12.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.758+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:208 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47bc05b070 2024-09-13T19:19:12.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.759+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 39 ==== osd_op_reply(208 gc.28 [call] v36'57 uv57 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.759+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:209 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47bc05b070 2024-09-13T19:19:12.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.759+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 40 ==== osd_op_reply(209 gc.28 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.759+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.759+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:210 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e166410 con 0x7f47bc05b070 2024-09-13T19:19:12.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.759+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 41 ==== osd_op_reply(210 gc.28 [call out=24b] v0'0 uv57 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.759+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:211 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47bc05b070 2024-09-13T19:19:12.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.760+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 42 ==== osd_op_reply(211 gc.28 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.760+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:19:12.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.760+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:212 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47bc05b070 2024-09-13T19:19:12.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.760+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 43 ==== osd_op_reply(212 gc.28 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.760+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.760+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:213 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47bc05b070 2024-09-13T19:19:12.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.761+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 44 ==== osd_op_reply(213 gc.28 [call] v36'58 uv58 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.761+0000 7f47cde0e800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-13T19:19:12.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.761+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:214 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.762+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 82 ==== osd_op_reply(214 gc.29 [call] v36'84 uv84 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.762+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:215 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.762+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 83 ==== osd_op_reply(215 gc.29 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.762+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.762+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:216 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e166410 con 0x55e91e121450 2024-09-13T19:19:12.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.763+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 84 ==== osd_op_reply(216 gc.29 [call out=24b] v0'0 uv84 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.763+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:217 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.763+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 85 ==== osd_op_reply(217 gc.29 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.763+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:19:12.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.763+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:218 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.763+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 86 ==== osd_op_reply(218 gc.29 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.763+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.763+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:219 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.764+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 87 ==== osd_op_reply(219 gc.29 [call] v36'85 uv85 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.764+0000 7f47cde0e800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-13T19:19:12.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.764+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:220 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47bc05b070 2024-09-13T19:19:12.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.765+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 45 ==== osd_op_reply(220 gc.30 [call] v36'66 uv66 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.765+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:221 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47bc05b070 2024-09-13T19:19:12.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.765+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 46 ==== osd_op_reply(221 gc.30 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.765+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.765+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:222 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e166410 con 0x7f47bc05b070 2024-09-13T19:19:12.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.766+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 47 ==== osd_op_reply(222 gc.30 [call out=24b] v0'0 uv66 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.766+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:223 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47bc05b070 2024-09-13T19:19:12.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.766+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 48 ==== osd_op_reply(223 gc.30 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.766+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:19:12.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.766+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:224 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47bc05b070 2024-09-13T19:19:12.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.766+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 49 ==== osd_op_reply(224 gc.30 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.766+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.766+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:225 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47bc05b070 2024-09-13T19:19:12.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.767+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 50 ==== osd_op_reply(225 gc.30 [call] v36'67 uv67 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.767+0000 7f47cde0e800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-13T19:19:12.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.767+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:226 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47c4034070 2024-09-13T19:19:12.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.769+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 45 ==== osd_op_reply(226 gc.31 [call] v36'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.769+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:227 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47c4034070 2024-09-13T19:19:12.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.769+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 46 ==== osd_op_reply(227 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.769+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.769+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:228 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e166410 con 0x7f47c4034070 2024-09-13T19:19:12.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.769+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 47 ==== osd_op_reply(228 gc.31 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.769+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:229 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47c4034070 2024-09-13T19:19:12.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.769+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 48 ==== osd_op_reply(229 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.769+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:19:12.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.769+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:230 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47c4034070 2024-09-13T19:19:12.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.770+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 49 ==== osd_op_reply(230 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.770+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.770+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:231 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47c4034070 2024-09-13T19:19:12.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.771+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 50 ==== osd_op_reply(231 gc.31 [call] v36'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.771+0000 7f47cde0e800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-13T19:19:12.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.771+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:232 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e11cb40 2024-09-13T19:19:12.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.772+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 45 ==== osd_op_reply(232 gc.0 [call] v36'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.772+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:233 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e11cb40 2024-09-13T19:19:12.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.772+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 46 ==== osd_op_reply(233 gc.0 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.772+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.772+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:234 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e166410 con 0x55e91e11cb40 2024-09-13T19:19:12.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.772+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 47 ==== osd_op_reply(234 gc.0 [call out=24b] v0'0 uv39 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.772+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:235 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e11cb40 2024-09-13T19:19:12.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.772+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 48 ==== osd_op_reply(235 gc.0 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.772+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:19:12.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.772+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:236 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e11cb40 2024-09-13T19:19:12.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.772+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 49 ==== osd_op_reply(236 gc.0 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.773+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.773+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:237 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e11cb40 2024-09-13T19:19:12.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.773+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 50 ==== osd_op_reply(237 gc.0 [call] v36'40 uv40 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.773+0000 7f47cde0e800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-13T19:19:12.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.773+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:238 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47bc05b070 2024-09-13T19:19:12.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.775+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 51 ==== osd_op_reply(238 gc.1 [call] v36'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.775+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:239 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47bc05b070 2024-09-13T19:19:12.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.775+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 52 ==== osd_op_reply(239 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.775+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.775+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:240 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e166410 con 0x7f47bc05b070 2024-09-13T19:19:12.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.775+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 53 ==== osd_op_reply(240 gc.1 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.775+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:241 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47bc05b070 2024-09-13T19:19:12.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.775+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 54 ==== osd_op_reply(241 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.775+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:19:12.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.775+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:242 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47bc05b070 2024-09-13T19:19:12.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.776+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 55 ==== osd_op_reply(242 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.776+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.776+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:243 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47bc05b070 2024-09-13T19:19:12.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.777+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 56 ==== osd_op_reply(243 gc.1 [call] v36'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.777+0000 7f47cde0e800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-13T19:19:12.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.777+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:244 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.778+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 88 ==== osd_op_reply(244 gc.2 [call] v36'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.778+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:245 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.778+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 89 ==== osd_op_reply(245 gc.2 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.778+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.778+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:246 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e166410 con 0x55e91e121450 2024-09-13T19:19:12.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.778+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 90 ==== osd_op_reply(246 gc.2 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.778+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:247 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.778+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 91 ==== osd_op_reply(247 gc.2 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.778+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:19:12.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.778+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:248 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.779+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 92 ==== osd_op_reply(248 gc.2 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.779+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.779+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:249 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.779+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 93 ==== osd_op_reply(249 gc.2 [call] v36'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.780+0000 7f47cde0e800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-13T19:19:12.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.780+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:250 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e11cb40 2024-09-13T19:19:12.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.780+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 51 ==== osd_op_reply(250 gc.3 [call] v36'283 uv283 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.781+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:251 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e11cb40 2024-09-13T19:19:12.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.781+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 52 ==== osd_op_reply(251 gc.3 [call out=15b] v0'0 uv283 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.781+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.781+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:252 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e166410 con 0x55e91e11cb40 2024-09-13T19:19:12.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.781+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 53 ==== osd_op_reply(252 gc.3 [call out=24b] v0'0 uv283 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.781+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:253 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e11cb40 2024-09-13T19:19:12.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.781+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 54 ==== osd_op_reply(253 gc.3 [call out=15b] v0'0 uv283 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.781+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:19:12.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.781+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:254 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e11cb40 2024-09-13T19:19:12.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.782+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 55 ==== osd_op_reply(254 gc.3 [call out=15b] v0'0 uv283 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.782+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.782+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:255 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e11cb40 2024-09-13T19:19:12.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.782+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 56 ==== osd_op_reply(255 gc.3 [call] v36'284 uv284 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.782+0000 7f47cde0e800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-13T19:19:12.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.782+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:256 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47c4034070 2024-09-13T19:19:12.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.783+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 51 ==== osd_op_reply(256 gc.4 [call] v36'92 uv92 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.783+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:257 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47c4034070 2024-09-13T19:19:12.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.784+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 52 ==== osd_op_reply(257 gc.4 [call out=15b] v0'0 uv92 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.784+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.784+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:258 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e166410 con 0x7f47c4034070 2024-09-13T19:19:12.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.784+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 53 ==== osd_op_reply(258 gc.4 [call out=24b] v0'0 uv92 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.784+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:259 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47c4034070 2024-09-13T19:19:12.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.784+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 54 ==== osd_op_reply(259 gc.4 [call out=15b] v0'0 uv92 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.784+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:19:12.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.784+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:260 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47c4034070 2024-09-13T19:19:12.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.784+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 55 ==== osd_op_reply(260 gc.4 [call out=15b] v0'0 uv92 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.784+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.784+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:261 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x7f47c4034070 2024-09-13T19:19:12.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.785+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 56 ==== osd_op_reply(261 gc.4 [call] v36'93 uv93 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.785+0000 7f47cde0e800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-13T19:19:12.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.785+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:262 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.786+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 94 ==== osd_op_reply(262 gc.5 [call] v36'60 uv60 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.786+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:263 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.786+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 95 ==== osd_op_reply(263 gc.5 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.786+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.786+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:264 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e166410 con 0x55e91e121450 2024-09-13T19:19:12.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.787+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 96 ==== osd_op_reply(264 gc.5 [call out=24b] v0'0 uv60 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.787+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:265 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.787+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 97 ==== osd_op_reply(265 gc.5 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.787+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:19:12.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.787+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:266 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.787+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 98 ==== osd_op_reply(266 gc.5 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.787+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.787+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:267 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e121450 2024-09-13T19:19:12.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.788+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 99 ==== osd_op_reply(267 gc.5 [call] v36'61 uv61 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.788+0000 7f47cde0e800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-13T19:19:12.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.788+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:268 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e11cb40 2024-09-13T19:19:12.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.789+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 57 ==== osd_op_reply(268 gc.6 [call] v36'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.789+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:269 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e11cb40 2024-09-13T19:19:12.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.790+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 58 ==== osd_op_reply(269 gc.6 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.790+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.790+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:270 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e166410 con 0x55e91e11cb40 2024-09-13T19:19:12.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.790+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 59 ==== osd_op_reply(270 gc.6 [call out=24b] v0'0 uv35 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.790+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:271 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e11cb40 2024-09-13T19:19:12.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.790+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 60 ==== osd_op_reply(271 gc.6 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.790+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:19:12.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.790+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:272 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167420 con 0x55e91e11cb40 2024-09-13T19:19:12.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.790+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 61 ==== osd_op_reply(272 gc.6 [call out=1716b] v0'0 uv35 ondisk = 0) ==== 148+0+1716 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.790+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-13T19:19:12.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.790+0000 7f47cde0e800 20 garbage collection: RGWGC::process iterating over entry tag='509740b4-c081-4f37-bd6d-df9ca851489b.4237.16612257187725449075', time=2024-09-13T19:19:20.550067+0000, chain.objs.size()=7 2024-09-13T19:19:12.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.790+0000 7f47cde0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:509740b4-c081-4f37-bd6d-df9ca851489b.4237.11__shadow_.KW-26HU7N0kP9rTLpUhhD93ATauY_6f_1 2024-09-13T19:19:12.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.790+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:273 3.38s0 3:1ec66596:::509740b4-c081-4f37-bd6d-df9ca851489b.4237.11__shadow_.KW-26HU7N0kP9rTLpUhhD93ATauY_6f_1:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e167b00 con 0x7f47bc05b070 2024-09-13T19:19:12.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.790+0000 7f47cde0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:509740b4-c081-4f37-bd6d-df9ca851489b.4237.11__shadow_.KW-26HU7N0kP9rTLpUhhD93ATauY_6f_2 2024-09-13T19:19:12.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.790+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:274 3.28s0 3:16ea53e1:::509740b4-c081-4f37-bd6d-df9ca851489b.4237.11__shadow_.KW-26HU7N0kP9rTLpUhhD93ATauY_6f_2:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e16a710 con 0x55e91e121450 2024-09-13T19:19:12.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.790+0000 7f47cde0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:509740b4-c081-4f37-bd6d-df9ca851489b.4237.11__shadow_.KW-26HU7N0kP9rTLpUhhD93ATauY_6f_3 2024-09-13T19:19:12.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.790+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:275 3.cs0 3:32c40c78:::509740b4-c081-4f37-bd6d-df9ca851489b.4237.11__shadow_.KW-26HU7N0kP9rTLpUhhD93ATauY_6f_3:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e16d110 con 0x55e91e121450 2024-09-13T19:19:12.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.790+0000 7f47cde0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:509740b4-c081-4f37-bd6d-df9ca851489b.4237.11__shadow_.KW-26HU7N0kP9rTLpUhhD93ATauY_6f_4 2024-09-13T19:19:12.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.790+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:276 3.3bs0 3:de83a9fd:::509740b4-c081-4f37-bd6d-df9ca851489b.4237.11__shadow_.KW-26HU7N0kP9rTLpUhhD93ATauY_6f_4:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e16f980 con 0x55e91e121450 2024-09-13T19:19:12.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.790+0000 7f47cde0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:509740b4-c081-4f37-bd6d-df9ca851489b.4237.11__shadow_.KW-26HU7N0kP9rTLpUhhD93ATauY_6f_5 2024-09-13T19:19:12.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.790+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:277 3.39s0 3:9c458887:::509740b4-c081-4f37-bd6d-df9ca851489b.4237.11__shadow_.KW-26HU7N0kP9rTLpUhhD93ATauY_6f_5:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e1721f0 con 0x55e91e121450 2024-09-13T19:19:12.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.790+0000 7f47cde0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:509740b4-c081-4f37-bd6d-df9ca851489b.4237.11__shadow_.KW-26HU7N0kP9rTLpUhhD93ATauY_6f_6 2024-09-13T19:19:12.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.791+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:278 3.37s0 3:efe02cb0:::509740b4-c081-4f37-bd6d-df9ca851489b.4237.11__shadow_.KW-26HU7N0kP9rTLpUhhD93ATauY_6f_6:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e16f980 con 0x55e91e11cb40 2024-09-13T19:19:12.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.791+0000 7f47cde0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:509740b4-c081-4f37-bd6d-df9ca851489b.4237.11__shadow_.KW-26HU7N0kP9rTLpUhhD93ATauY_6f_7 2024-09-13T19:19:12.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.791+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:279 3.27s0 3:e478063f:::509740b4-c081-4f37-bd6d-df9ca851489b.4237.11__shadow_.KW-26HU7N0kP9rTLpUhhD93ATauY_6f_7:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e176fe0 con 0x7f47bc05b070 2024-09-13T19:19:12.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.792+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 100 ==== osd_op_reply(276 509740b4-c081-4f37-bd6d-df9ca851489b.4237.11__shadow_.KW-26HU7N0kP9rTLpUhhD93ATauY_6f_4 [call] v36'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.792+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 57 ==== osd_op_reply(273 509740b4-c081-4f37-bd6d-df9ca851489b.4237.11__shadow_.KW-26HU7N0kP9rTLpUhhD93ATauY_6f_1 [call] v36'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.795+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 101 ==== osd_op_reply(274 509740b4-c081-4f37-bd6d-df9ca851489b.4237.11__shadow_.KW-26HU7N0kP9rTLpUhhD93ATauY_6f_2 [call] v36'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.795+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 102 ==== osd_op_reply(275 509740b4-c081-4f37-bd6d-df9ca851489b.4237.11__shadow_.KW-26HU7N0kP9rTLpUhhD93ATauY_6f_3 [call] v36'7 uv7 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.795+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 103 ==== osd_op_reply(277 509740b4-c081-4f37-bd6d-df9ca851489b.4237.11__shadow_.KW-26HU7N0kP9rTLpUhhD93ATauY_6f_5 [call] v36'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.798+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 62 ==== osd_op_reply(278 509740b4-c081-4f37-bd6d-df9ca851489b.4237.11__shadow_.KW-26HU7N0kP9rTLpUhhD93ATauY_6f_6 [call] v36'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.798+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 58 ==== osd_op_reply(279 509740b4-c081-4f37-bd6d-df9ca851489b.4237.11__shadow_.KW-26HU7N0kP9rTLpUhhD93ATauY_6f_7 [call] v36'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.798+0000 7f47cde0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-13T19:19:12.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.798+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:280 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e165570 con 0x55e91e11cb40 2024-09-13T19:19:12.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.804+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 63 ==== osd_op_reply(280 gc.6 [call] v36'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.804+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:281 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e165570 con 0x55e91e11cb40 2024-09-13T19:19:12.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.806+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 64 ==== osd_op_reply(281 gc.6 [call] v36'37 uv37 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.806+0000 7f47cde0e800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-13T19:19:12.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.806+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:282 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e165570 con 0x7f47bc05b070 2024-09-13T19:19:12.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.808+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 59 ==== osd_op_reply(282 gc.7 [call] v36'59 uv59 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.808+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:283 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e165570 con 0x7f47bc05b070 2024-09-13T19:19:12.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.808+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 60 ==== osd_op_reply(283 gc.7 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.808+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.808+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:284 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e16c100 con 0x7f47bc05b070 2024-09-13T19:19:12.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.809+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 61 ==== osd_op_reply(284 gc.7 [call out=24b] v0'0 uv59 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.809+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:285 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e165570 con 0x7f47bc05b070 2024-09-13T19:19:12.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.809+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 62 ==== osd_op_reply(285 gc.7 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.809+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:19:12.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.809+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:286 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e165570 con 0x7f47bc05b070 2024-09-13T19:19:12.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.810+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 63 ==== osd_op_reply(286 gc.7 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.810+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.810+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:287 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e165570 con 0x7f47bc05b070 2024-09-13T19:19:12.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.811+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 64 ==== osd_op_reply(287 gc.7 [call] v36'60 uv60 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.811+0000 7f47cde0e800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-13T19:19:12.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.811+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:288 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e16abf0 con 0x7f47c4034070 2024-09-13T19:19:12.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.812+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 57 ==== osd_op_reply(288 gc.8 [call] v36'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.812+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:289 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e16abf0 con 0x7f47c4034070 2024-09-13T19:19:12.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.812+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 58 ==== osd_op_reply(289 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.812+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.812+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:290 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e16abf0 con 0x7f47c4034070 2024-09-13T19:19:12.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.812+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 59 ==== osd_op_reply(290 gc.8 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.812+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:291 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e16abf0 con 0x7f47c4034070 2024-09-13T19:19:12.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.813+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 60 ==== osd_op_reply(291 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.813+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:19:12.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.813+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:292 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e91e16abf0 con 0x7f47c4034070 2024-09-13T19:19:12.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.813+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 61 ==== osd_op_reply(292 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.813+0000 7f47cde0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:19:12.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.813+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:293 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e16abf0 con 0x7f47c4034070 2024-09-13T19:19:12.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.814+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 62 ==== osd_op_reply(293 gc.8 [call] v36'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.815+0000 7f467f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:19:12.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.815+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94459720292704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e1383d0 con 0x55e91e11cb40 2024-09-13T19:19:12.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.816+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 65 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94459720292704] v36'285 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.816+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94459720269984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e12d930 con 0x7f47c4034070 2024-09-13T19:19:12.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.817+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 63 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94459720269984] v36'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.817+0000 7f47cde0e800 20 remove_watcher() i=0 2024-09-13T19:19:12.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.817+0000 7f47cde0e800 2 removed watcher, disabling cache 2024-09-13T19:19:12.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.817+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94459720275328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e1280a0 con 0x55e91e11cb40 2024-09-13T19:19:12.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.818+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 66 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94459720275328] v36'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.818+0000 7f47cde0e800 20 remove_watcher() i=1 2024-09-13T19:19:12.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.818+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94459720278752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e1280a0 con 0x55e91e121450 2024-09-13T19:19:12.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.819+0000 7f47c9d1b640 1 -- 172.21.15.102:0/1068830894 <== osd.3 v2:172.21.15.102:6800/3096737090 104 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94459720278752] v36'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x55e91e121450 2024-09-13T19:19:12.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.819+0000 7f47cde0e800 20 remove_watcher() i=2 2024-09-13T19:19:12.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.819+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94459720281520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e1280a0 con 0x7f47c4034070 2024-09-13T19:19:12.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.820+0000 7f47c951a640 1 -- 172.21.15.102:0/1068830894 <== osd.2 v2:172.21.15.102:6816/2238176080 64 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94459720281520] v36'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47bc058030 con 0x7f47c4034070 2024-09-13T19:19:12.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.820+0000 7f47cde0e800 20 remove_watcher() i=3 2024-09-13T19:19:12.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.820+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94459720283760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e1280a0 con 0x55e91e11cb40 2024-09-13T19:19:12.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.821+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.1 v2:172.21.15.102:6808/2204418452 67 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94459720283760] v36'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x55e91e11cb40 2024-09-13T19:19:12.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.821+0000 7f47cde0e800 20 remove_watcher() i=4 2024-09-13T19:19:12.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.821+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94459720287024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e12b670 con 0x7f47bc05b070 2024-09-13T19:19:12.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.823+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 65 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94459720287024] v36'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.823+0000 7f47cde0e800 20 remove_watcher() i=5 2024-09-13T19:19:12.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.823+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94459720289232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e1280a0 con 0x7f47bc05b070 2024-09-13T19:19:12.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.824+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 66 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94459720289232] v36'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.824+0000 7f47cde0e800 20 remove_watcher() i=6 2024-09-13T19:19:12.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.824+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94459720290976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e91e12c330 con 0x7f47bc05b070 2024-09-13T19:19:12.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.825+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 <== osd.0 v2:172.21.15.53:6800/4021716951 67 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94459720290976] v36'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47b4029040 con 0x7f47bc05b070 2024-09-13T19:19:12.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.825+0000 7f47cde0e800 20 remove_watcher() i=7 2024-09-13T19:19:12.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.825+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f47bc05b070 msgr2=0x7f47bc0065b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:12.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.825+0000 7f47cde0e800 1 --2- 172.21.15.102:0/1068830894 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7f47bc05b070 0x7f47bc0065b0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:12.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.825+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e91e11cb40 msgr2=0x55e91e11f000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:12.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.825+0000 7f47cde0e800 1 --2- 172.21.15.102:0/1068830894 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e91e11cb40 0x55e91e11f000 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:12.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.825+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f47c4034070 msgr2=0x7f47c401a0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:12.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.825+0000 7f47cde0e800 1 --2- 172.21.15.102:0/1068830894 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7f47c4034070 0x7f47c401a0b0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:12.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.825+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e91e121450 msgr2=0x55e91e123840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:12.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.825+0000 7f47cde0e800 1 --2- 172.21.15.102:0/1068830894 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e91e121450 0x55e91e123840 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:12.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.825+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4694036b40 msgr2=0x7f4694039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:12.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.825+0000 7f47cde0e800 1 --2- 172.21.15.102:0/1068830894 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f4694036b40 0x7f4694039000 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f47bc077ff0 tx=0x7f47bc085000 comp rx=0 tx=0).stop 2024-09-13T19:19:12.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.825+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e91e109db0 msgr2=0x55e91e111220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:12.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.825+0000 7f47c3fff640 1 -- 172.21.15.102:0/1068830894 reap_dead start 2024-09-13T19:19:12.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.825+0000 7f47cde0e800 1 --2- 172.21.15.102:0/1068830894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e91e109db0 0x55e91e111220 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f47c400b010 tx=0x7f47c404ccc0 comp rx=0 tx=0).stop 2024-09-13T19:19:12.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.825+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 shutdown_connections 2024-09-13T19:19:12.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.825+0000 7f47cde0e800 1 --2- 172.21.15.102:0/1068830894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e91e109db0 0x55e91e111220 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:12.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.825+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 >> 172.21.15.102:0/1068830894 conn(0x55e91e106110 msgr2=0x55e91e1041e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:19:12.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.825+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 shutdown_connections 2024-09-13T19:19:12.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.825+0000 7f47cde0e800 1 -- 172.21.15.102:0/1068830894 wait complete. 2024-09-13T19:19:12.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.826+0000 7f47cde0e800 1 -- 172.21.15.102:0/186051944 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f46a0036b90 msgr2=0x7f46a0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:12.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.826+0000 7f47cde0e800 1 --2- 172.21.15.102:0/186051944 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f46a0036b90 0x7f46a0039050 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x55e91e0e68f0 tx=0x7f47bc077ca0 comp rx=0 tx=0).stop 2024-09-13T19:19:12.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.826+0000 7f47cde0e800 1 -- 172.21.15.102:0/186051944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e91e0fd0b0 msgr2=0x55e91e0fd4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:12.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.826+0000 7f47cde0e800 1 --2- 172.21.15.102:0/186051944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e91e0fd0b0 0x55e91e0fd4d0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x55e91e0e35b0 tx=0x7f47c40167b0 comp rx=0 tx=0).stop 2024-09-13T19:19:12.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.826+0000 7f47cde0e800 1 -- 172.21.15.102:0/186051944 shutdown_connections 2024-09-13T19:19:12.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.826+0000 7f47cde0e800 1 --2- 172.21.15.102:0/186051944 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f46a0036b90 0x7f46a0039050 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:12.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.826+0000 7f47cde0e800 1 --2- 172.21.15.102:0/186051944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e91e0fd0b0 0x55e91e0fd4d0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:12.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.826+0000 7f47cde0e800 1 -- 172.21.15.102:0/186051944 >> 172.21.15.102:0/186051944 conn(0x55e91e0f2040 msgr2=0x55e91e0f4bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:19:12.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.826+0000 7f47cde0e800 1 -- 172.21.15.102:0/186051944 shutdown_connections 2024-09-13T19:19:12.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.826+0000 7f47cde0e800 1 -- 172.21.15.102:0/186051944 wait complete. 2024-09-13T19:19:12.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.826+0000 7f47cde0e800 1 -- 172.21.15.102:0/1133886273 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e91dfe8e00 msgr2=0x55e91e0e9400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:12.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.826+0000 7f47cde0e800 1 --2- 172.21.15.102:0/1133886273 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e91dfe8e00 0x55e91e0e9400 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:12.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.826+0000 7f47cde0e800 1 -- 172.21.15.102:0/1133886273 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e91e0ebd20 msgr2=0x55e91e0ee110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:12.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.826+0000 7f47cde0e800 1 --2- 172.21.15.102:0/1133886273 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e91e0ebd20 0x55e91e0ee110 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:12.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.826+0000 7f47cde0e800 1 -- 172.21.15.102:0/1133886273 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f46b0036b40 msgr2=0x7f46b0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:12.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.826+0000 7f47cde0e800 1 --2- 172.21.15.102:0/1133886273 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f46b0036b40 0x7f46b0039000 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f47b4000f60 tx=0x7f47b40012b0 comp rx=0 tx=0).stop 2024-09-13T19:19:12.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.826+0000 7f47cde0e800 1 -- 172.21.15.102:0/1133886273 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e91dfe84c0 msgr2=0x55e91e0e2390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:12.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.826+0000 7f47cde0e800 1 --2- 172.21.15.102:0/1133886273 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e91dfe84c0 0x55e91e0e2390 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f47bc047cf0 tx=0x7f47bc002fb0 comp rx=0 tx=0).stop 2024-09-13T19:19:12.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.826+0000 7f47cde0e800 1 -- 172.21.15.102:0/1133886273 shutdown_connections 2024-09-13T19:19:12.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.826+0000 7f47cde0e800 1 --2- 172.21.15.102:0/1133886273 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x55e91e0ebd20 0x55e91e0ee110 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:12.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.826+0000 7f47cde0e800 1 --2- 172.21.15.102:0/1133886273 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x55e91dfe8e00 0x55e91e0e9400 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:12.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.826+0000 7f47cde0e800 1 --2- 172.21.15.102:0/1133886273 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f46b0036b40 0x7f46b0039000 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:12.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.826+0000 7f47cde0e800 1 --2- 172.21.15.102:0/1133886273 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e91dfe84c0 0x55e91e0e2390 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:12.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.826+0000 7f47cde0e800 1 -- 172.21.15.102:0/1133886273 >> 172.21.15.102:0/1133886273 conn(0x55e91dfe3df0 msgr2=0x55e91e0d08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:19:12.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.826+0000 7f47cde0e800 1 -- 172.21.15.102:0/1133886273 shutdown_connections 2024-09-13T19:19:12.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T19:19:12.826+0000 7f47cde0e800 1 -- 172.21.15.102:0/1133886273 wait complete. 2024-09-13T19:19:12.838 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-13T19:19:12.846 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T19:19:12.846 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T19:19:12.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:12.946+0000 7f02e4cd7640 1 Processor -- start 2024-09-13T19:19:12.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:12.946+0000 7f02e4cd7640 1 -- start start 2024-09-13T19:19:12.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:12.947+0000 7f02e4cd7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f02e012f9d0 0x7f02e0131dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:12.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:12.947+0000 7f02e4cd7640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02e0071f70 con 0x7f02e012cca0 2024-09-13T19:19:12.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:12.947+0000 7f02e4cd7640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f02e006e350 con 0x7f02e012f9d0 2024-09-13T19:19:12.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:12.947+0000 7f02ddd9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f02e012f9d0 0x7f02e0131dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:12.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:12.947+0000 7f02de59c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f02e012cca0 0x7f02e012d080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59830/0 (socket says 172.21.15.53:59830) 2024-09-13T19:19:12.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:12.947+0000 7f02de59c640 1 -- 172.21.15.53:0/2668837277 learned_addr learned my addr 172.21.15.53:0/2668837277 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T19:19:12.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:12.947+0000 7f02ddd9b640 1 -- 172.21.15.53:0/2668837277 >> v1:172.21.15.53:6789/0 conn(0x7f02e012cca0 legacy=0x7f02e012d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:12.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:12.947+0000 7f02ddd9b640 1 -- 172.21.15.53:0/2668837277 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02e00715c0 con 0x7f02e012f9d0 2024-09-13T19:19:12.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:12.948+0000 7f02ddd9b640 1 --2- 172.21.15.53:0/2668837277 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02e012f9d0 0x7f02e0131dc0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f02d4009720 tx=0x7f02d402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9014085be6141fa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:12.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:12.948+0000 7f02dd59a640 1 -- 172.21.15.53:0/2668837277 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02d4037070 con 0x7f02e012f9d0 2024-09-13T19:19:12.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:12.948+0000 7f02dd59a640 1 -- 172.21.15.53:0/2668837277 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02d402ad90 con 0x7f02e012f9d0 2024-09-13T19:19:12.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:12.948+0000 7f02dd59a640 1 -- 172.21.15.53:0/2668837277 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02d4032590 con 0x7f02e012f9d0 2024-09-13T19:19:12.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:12.949+0000 7f02e4cd7640 1 -- 172.21.15.53:0/2668837277 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02e012f9d0 msgr2=0x7f02e0131dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:12.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:12.949+0000 7f02e4cd7640 1 --2- 172.21.15.53:0/2668837277 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02e012f9d0 0x7f02e0131dc0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f02d4009720 tx=0x7f02d402a110 comp rx=0 tx=0).stop 2024-09-13T19:19:12.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:12.949+0000 7f02e4cd7640 1 -- 172.21.15.53:0/2668837277 shutdown_connections 2024-09-13T19:19:12.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:12.949+0000 7f02e4cd7640 1 --2- 172.21.15.53:0/2668837277 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02e012f9d0 0x7f02e0131dc0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:12.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:12.949+0000 7f02e4cd7640 1 -- 172.21.15.53:0/2668837277 >> 172.21.15.53:0/2668837277 conn(0x7f02e009a890 msgr2=0x7f02e009aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:19:12.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:12.949+0000 7f02e4cd7640 1 -- 172.21.15.53:0/2668837277 shutdown_connections 2024-09-13T19:19:12.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:12.949+0000 7f02e4cd7640 1 -- 172.21.15.53:0/2668837277 wait complete. 2024-09-13T19:19:12.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:12.950+0000 7f02e4cd7640 1 Processor -- start 2024-09-13T19:19:12.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:12.950+0000 7f02e4cd7640 1 -- start start 2024-09-13T19:19:12.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:12.950+0000 7f02e4cd7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02e012cca0 0x7f02e01258b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:12.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:12.950+0000 7f02e4cd7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f02e012ca50 con 0x7f02e012cca0 2024-09-13T19:19:12.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:12.950+0000 7f02de59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02e012cca0 0x7f02e01258b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:12.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:12.950+0000 7f02de59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02e012cca0 0x7f02e01258b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35882/0 (socket says 172.21.15.53:35882) 2024-09-13T19:19:12.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:12.950+0000 7f02de59c640 1 -- 172.21.15.53:0/659028752 learned_addr learned my addr 172.21.15.53:0/659028752 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:19:12.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:12.951+0000 7f02de59c640 1 -- 172.21.15.53:0/659028752 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02e0123af0 con 0x7f02e012cca0 2024-09-13T19:19:12.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:12.951+0000 7f02de59c640 1 --2- 172.21.15.53:0/659028752 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02e012cca0 0x7f02e01258b0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f02d000c480 tx=0x7f02d000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:12.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:12.951+0000 7f02ceffd640 1 -- 172.21.15.53:0/659028752 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02d0017070 con 0x7f02e012cca0 2024-09-13T19:19:12.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:12.951+0000 7f02ceffd640 1 -- 172.21.15.53:0/659028752 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02d0005c10 con 0x7f02e012cca0 2024-09-13T19:19:12.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:12.951+0000 7f02e4cd7640 1 -- 172.21.15.53:0/659028752 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02e0126db0 con 0x7f02e012cca0 2024-09-13T19:19:12.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:12.951+0000 7f02ceffd640 1 -- 172.21.15.53:0/659028752 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02d00070d0 con 0x7f02e012cca0 2024-09-13T19:19:12.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:12.951+0000 7f02e4cd7640 1 -- 172.21.15.53:0/659028752 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02e0125df0 con 0x7f02e012cca0 2024-09-13T19:19:12.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:12.952+0000 7f02ceffd640 1 -- 172.21.15.53:0/659028752 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f02d001a070 con 0x7f02e012cca0 2024-09-13T19:19:12.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:12.952+0000 7f02e4cd7640 1 -- 172.21.15.53:0/659028752 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02e0073120 con 0x7f02e012cca0 2024-09-13T19:19:12.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:12.952+0000 7f02ceffd640 1 --2- 172.21.15.53:0/659028752 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f02c00382a0 0x7f02c003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:12.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:12.952+0000 7f02ceffd640 1 -- 172.21.15.53:0/659028752 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f02d004af90 con 0x7f02e012cca0 2024-09-13T19:19:12.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:12.953+0000 7f02ddd9b640 1 --2- 172.21.15.53:0/659028752 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f02c00382a0 0x7f02c003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:12.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:12.953+0000 7f02ddd9b640 1 --2- 172.21.15.53:0/659028752 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f02c00382a0 0x7f02c003a760 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f02d4009720 tx=0x7f02d402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:12.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:12.957+0000 7f02ceffd640 1 -- 172.21.15.53:0/659028752 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f02e0073120 con 0x7f02e012cca0 2024-09-13T19:19:13.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.128+0000 7f02e4cd7640 1 -- 172.21.15.53:0/659028752 --> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f02e0124af0 con 0x7f02c00382a0 2024-09-13T19:19:13.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.145+0000 7f02ceffd640 1 -- 172.21.15.53:0/659028752 <== mgr.4098 v2:172.21.15.102:6824/4283826432 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665892 (secure 0 0 0) 0x7f02e0124af0 con 0x7f02c00382a0 2024-09-13T19:19:13.158 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:19:13.165 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T19:19:13.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.149+0000 7f02e4cd7640 1 -- 172.21.15.53:0/659028752 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f02c00382a0 msgr2=0x7f02c003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:13.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.149+0000 7f02e4cd7640 1 --2- 172.21.15.53:0/659028752 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f02c00382a0 0x7f02c003a760 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f02d4009720 tx=0x7f02d402e000 comp rx=0 tx=0).stop 2024-09-13T19:19:13.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.149+0000 7f02e4cd7640 1 -- 172.21.15.53:0/659028752 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02e012cca0 msgr2=0x7f02e01258b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:13.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.149+0000 7f02e4cd7640 1 --2- 172.21.15.53:0/659028752 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02e012cca0 0x7f02e01258b0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f02d000c480 tx=0x7f02d000c940 comp rx=0 tx=0).stop 2024-09-13T19:19:13.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.149+0000 7f02e4cd7640 1 -- 172.21.15.53:0/659028752 shutdown_connections 2024-09-13T19:19:13.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.149+0000 7f02e4cd7640 1 --2- 172.21.15.53:0/659028752 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f02c00382a0 0x7f02c003a760 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:13.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.149+0000 7f02e4cd7640 1 --2- 172.21.15.53:0/659028752 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02e012cca0 0x7f02e01258b0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:13.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.149+0000 7f02e4cd7640 1 -- 172.21.15.53:0/659028752 >> 172.21.15.53:0/659028752 conn(0x7f02e009a890 msgr2=0x7f02e0097ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:19:13.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.150+0000 7f02e4cd7640 1 -- 172.21.15.53:0/659028752 shutdown_connections 2024-09-13T19:19:13.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.150+0000 7f02e4cd7640 1 -- 172.21.15.53:0/659028752 wait complete. 2024-09-13T19:19:13.169 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":141,"stamp":"2024-09-13T19:19:12.968387+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412809,"num_objects":229,"num_object_clones":0,"num_object_copies":465,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":4867,"num_read_kb":4444,"num_write":2106,"num_write_kb":61374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4479,"ondisk_log_size":4479,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":178012,"kb_used_data":40796,"kb_used_omap":6,"kb_used_meta":137145,"kb_avail":377309348,"statfs":{"total":386547056640,"available":386364772352,"internally_reserved":0,"allocated":41775104,"data_stored":40530870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":140437271},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25811688,"num_objects":9,"num_object_clones":0,"num_object_copies":25,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":452,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003373"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.986470+0000","last_change":"2024-09-13T19:15:55.897703+0000","last_active":"2024-09-13T19:16:31.986470+0000","last_peered":"2024-09-13T19:16:31.986470+0000","last_clean":"2024-09-13T19:16:31.986470+0000","last_became_active":"2024-09-13T19:15:55.897392+0000","last_became_peered":"2024-09-13T19:15:55.897392+0000","last_unstale":"2024-09-13T19:16:31.986470+0000","last_undegraded":"2024-09-13T19:16:31.986470+0000","last_fullsized":"2024-09-13T19:16:31.986470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:06:25.645854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"36'8","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.962167+0000","last_change":"2024-09-13T19:15:57.889239+0000","last_active":"2024-09-13T19:19:05.962167+0000","last_peered":"2024-09-13T19:19:05.962167+0000","last_clean":"2024-09-13T19:19:05.962167+0000","last_became_active":"2024-09-13T19:15:57.888352+0000","last_became_peered":"2024-09-13T19:15:57.888352+0000","last_unstale":"2024-09-13T19:19:05.962167+0000","last_undegraded":"2024-09-13T19:19:05.962167+0000","last_fullsized":"2024-09-13T19:19:05.962167+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:44.850376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"34'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.986216+0000","last_change":"2024-09-13T19:15:55.896090+0000","last_active":"2024-09-13T19:16:31.986216+0000","last_peered":"2024-09-13T19:16:31.986216+0000","last_clean":"2024-09-13T19:16:31.986216+0000","last_became_active":"2024-09-13T19:15:55.894768+0000","last_became_peered":"2024-09-13T19:15:55.894768+0000","last_unstale":"2024-09-13T19:16:31.986216+0000","last_undegraded":"2024-09-13T19:16:31.986216+0000","last_fullsized":"2024-09-13T19:16:31.986216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:42.707424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"36'6","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.063780+0000","last_change":"2024-09-13T19:15:57.895729+0000","last_active":"2024-09-13T19:19:06.063780+0000","last_peered":"2024-09-13T19:19:06.063780+0000","last_clean":"2024-09-13T19:19:06.063780+0000","last_became_active":"2024-09-13T19:15:57.895424+0000","last_became_peered":"2024-09-13T19:15:57.895424+0000","last_unstale":"2024-09-13T19:19:06.063780+0000","last_undegraded":"2024-09-13T19:19:06.063780+0000","last_fullsized":"2024-09-13T19:19:06.063780+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:13:56.189818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985541+0000","last_change":"2024-09-13T19:15:55.900265+0000","last_active":"2024-09-13T19:16:31.985541+0000","last_peered":"2024-09-13T19:16:31.985541+0000","last_clean":"2024-09-13T19:16:31.985541+0000","last_became_active":"2024-09-13T19:15:55.899965+0000","last_became_peered":"2024-09-13T19:15:55.899965+0000","last_unstale":"2024-09-13T19:16:31.985541+0000","last_undegraded":"2024-09-13T19:16:31.985541+0000","last_fullsized":"2024-09-13T19:16:31.985541+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:21.434261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"36'13","reported_seq":70,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.930148+0000","last_change":"2024-09-13T19:15:57.895266+0000","last_active":"2024-09-13T19:19:05.930148+0000","last_peered":"2024-09-13T19:19:05.930148+0000","last_clean":"2024-09-13T19:19:05.930148+0000","last_became_active":"2024-09-13T19:15:57.894955+0000","last_became_peered":"2024-09-13T19:15:57.894955+0000","last_unstale":"2024-09-13T19:19:05.930148+0000","last_undegraded":"2024-09-13T19:19:05.930148+0000","last_fullsized":"2024-09-13T19:19:05.930148+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:00.565048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985385+0000","last_change":"2024-09-13T19:15:55.890339+0000","last_active":"2024-09-13T19:16:31.985385+0000","last_peered":"2024-09-13T19:16:31.985385+0000","last_clean":"2024-09-13T19:16:31.985385+0000","last_became_active":"2024-09-13T19:15:55.889830+0000","last_became_peered":"2024-09-13T19:15:55.889830+0000","last_unstale":"2024-09-13T19:16:31.985385+0000","last_undegraded":"2024-09-13T19:16:31.985385+0000","last_fullsized":"2024-09-13T19:16:31.985385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:24.740012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"36'4","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.699868+0000","last_change":"2024-09-13T19:15:57.895013+0000","last_active":"2024-09-13T19:19:05.699868+0000","last_peered":"2024-09-13T19:19:05.699868+0000","last_clean":"2024-09-13T19:19:05.699868+0000","last_became_active":"2024-09-13T19:15:57.894733+0000","last_became_peered":"2024-09-13T19:15:57.894733+0000","last_unstale":"2024-09-13T19:19:05.699868+0000","last_undegraded":"2024-09-13T19:19:05.699868+0000","last_fullsized":"2024-09-13T19:19:05.699868+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:55:38.336831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"36'3","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:28.944247+0000","last_change":"2024-09-13T19:15:55.895687+0000","last_active":"2024-09-13T19:18:28.944247+0000","last_peered":"2024-09-13T19:18:28.944247+0000","last_clean":"2024-09-13T19:18:28.944247+0000","last_became_active":"2024-09-13T19:15:55.895362+0000","last_became_peered":"2024-09-13T19:15:55.895362+0000","last_unstale":"2024-09-13T19:18:28.944247+0000","last_undegraded":"2024-09-13T19:18:28.944247+0000","last_fullsized":"2024-09-13T19:18:28.944247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:12.815210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"36'8","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.594848+0000","last_change":"2024-09-13T19:15:57.889968+0000","last_active":"2024-09-13T19:19:05.594848+0000","last_peered":"2024-09-13T19:19:05.594848+0000","last_clean":"2024-09-13T19:19:05.594848+0000","last_became_active":"2024-09-13T19:15:57.889664+0000","last_became_peered":"2024-09-13T19:15:57.889664+0000","last_unstale":"2024-09-13T19:19:05.594848+0000","last_undegraded":"2024-09-13T19:19:05.594848+0000","last_fullsized":"2024-09-13T19:19:05.594848+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:07.656555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.836502+0000","last_change":"2024-09-13T19:15:55.890058+0000","last_active":"2024-09-13T19:19:05.836502+0000","last_peered":"2024-09-13T19:19:05.836502+0000","last_clean":"2024-09-13T19:19:05.836502+0000","last_became_active":"2024-09-13T19:15:55.889485+0000","last_became_peered":"2024-09-13T19:15:55.889485+0000","last_unstale":"2024-09-13T19:19:05.836502+0000","last_undegraded":"2024-09-13T19:19:05.836502+0000","last_fullsized":"2024-09-13T19:19:05.836502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:05:45.706743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"36'2","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:37.740715+0000","last_change":"2024-09-13T19:15:57.901409+0000","last_active":"2024-09-13T19:16:37.740715+0000","last_peered":"2024-09-13T19:16:37.740715+0000","last_clean":"2024-09-13T19:16:37.740715+0000","last_became_active":"2024-09-13T19:15:57.900785+0000","last_became_peered":"2024-09-13T19:15:57.900785+0000","last_unstale":"2024-09-13T19:16:37.740715+0000","last_undegraded":"2024-09-13T19:16:37.740715+0000","last_fullsized":"2024-09-13T19:16:37.740715+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:37.144718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"36'1","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:28.944154+0000","last_change":"2024-09-13T19:15:55.898268+0000","last_active":"2024-09-13T19:18:28.944154+0000","last_peered":"2024-09-13T19:18:28.944154+0000","last_clean":"2024-09-13T19:18:28.944154+0000","last_became_active":"2024-09-13T19:15:55.897381+0000","last_became_peered":"2024-09-13T19:15:55.897381+0000","last_unstale":"2024-09-13T19:18:28.944154+0000","last_undegraded":"2024-09-13T19:18:28.944154+0000","last_fullsized":"2024-09-13T19:18:28.944154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:08:10.316406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"36'16","reported_seq":90,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.842428+0000","last_change":"2024-09-13T19:15:57.893695+0000","last_active":"2024-09-13T19:19:05.842428+0000","last_peered":"2024-09-13T19:19:05.842428+0000","last_clean":"2024-09-13T19:19:05.842428+0000","last_became_active":"2024-09-13T19:15:57.893408+0000","last_became_peered":"2024-09-13T19:15:57.893408+0000","last_unstale":"2024-09-13T19:19:05.842428+0000","last_undegraded":"2024-09-13T19:19:05.842428+0000","last_fullsized":"2024-09-13T19:19:05.842428+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:37.777072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"36'1","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:26.939076+0000","last_change":"2024-09-13T19:15:55.901574+0000","last_active":"2024-09-13T19:18:26.939076+0000","last_peered":"2024-09-13T19:18:26.939076+0000","last_clean":"2024-09-13T19:18:26.939076+0000","last_became_active":"2024-09-13T19:15:55.901190+0000","last_became_peered":"2024-09-13T19:15:55.901190+0000","last_unstale":"2024-09-13T19:18:26.939076+0000","last_undegraded":"2024-09-13T19:18:26.939076+0000","last_fullsized":"2024-09-13T19:18:26.939076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:48:45.584149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"36'16","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.842549+0000","last_change":"2024-09-13T19:15:57.898655+0000","last_active":"2024-09-13T19:19:05.842549+0000","last_peered":"2024-09-13T19:19:05.842549+0000","last_clean":"2024-09-13T19:19:05.842549+0000","last_became_active":"2024-09-13T19:15:57.898325+0000","last_became_peered":"2024-09-13T19:15:57.898325+0000","last_unstale":"2024-09-13T19:19:05.842549+0000","last_undegraded":"2024-09-13T19:19:05.842549+0000","last_fullsized":"2024-09-13T19:19:05.842549+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:29.689654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":52,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"36'4","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.842445+0000","last_change":"2024-09-13T19:15:57.890027+0000","last_active":"2024-09-13T19:19:05.842445+0000","last_peered":"2024-09-13T19:19:05.842445+0000","last_clean":"2024-09-13T19:19:05.842445+0000","last_became_active":"2024-09-13T19:15:57.887144+0000","last_became_peered":"2024-09-13T19:15:57.887144+0000","last_unstale":"2024-09-13T19:19:05.842445+0000","last_undegraded":"2024-09-13T19:19:05.842445+0000","last_fullsized":"2024-09-13T19:19:05.842445+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:55.470024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"36'1","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:23.943012+0000","last_change":"2024-09-13T19:15:55.896889+0000","last_active":"2024-09-13T19:18:23.943012+0000","last_peered":"2024-09-13T19:18:23.943012+0000","last_clean":"2024-09-13T19:18:23.943012+0000","last_became_active":"2024-09-13T19:15:55.895552+0000","last_became_peered":"2024-09-13T19:15:55.895552+0000","last_unstale":"2024-09-13T19:18:23.943012+0000","last_undegraded":"2024-09-13T19:18:23.943012+0000","last_fullsized":"2024-09-13T19:18:23.943012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:11.960376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"36'8","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.961901+0000","last_change":"2024-09-13T19:15:57.889071+0000","last_active":"2024-09-13T19:19:05.961901+0000","last_peered":"2024-09-13T19:19:05.961901+0000","last_clean":"2024-09-13T19:19:05.961901+0000","last_became_active":"2024-09-13T19:15:57.886511+0000","last_became_peered":"2024-09-13T19:15:57.886511+0000","last_unstale":"2024-09-13T19:19:05.961901+0000","last_undegraded":"2024-09-13T19:19:05.961901+0000","last_fullsized":"2024-09-13T19:19:05.961901+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:29.689654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.989246+0000","last_change":"2024-09-13T19:15:55.898694+0000","last_active":"2024-09-13T19:16:31.989246+0000","last_peered":"2024-09-13T19:16:31.989246+0000","last_clean":"2024-09-13T19:16:31.989246+0000","last_became_active":"2024-09-13T19:15:55.896952+0000","last_became_peered":"2024-09-13T19:15:55.896952+0000","last_unstale":"2024-09-13T19:16:31.989246+0000","last_undegraded":"2024-09-13T19:16:31.989246+0000","last_fullsized":"2024-09-13T19:16:31.989246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:07.205939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"36'8","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.961849+0000","last_change":"2024-09-13T19:15:57.891691+0000","last_active":"2024-09-13T19:19:05.961849+0000","last_peered":"2024-09-13T19:19:05.961849+0000","last_clean":"2024-09-13T19:19:05.961849+0000","last_became_active":"2024-09-13T19:15:57.891411+0000","last_became_peered":"2024-09-13T19:15:57.891411+0000","last_unstale":"2024-09-13T19:19:05.961849+0000","last_undegraded":"2024-09-13T19:19:05.961849+0000","last_fullsized":"2024-09-13T19:19:05.961849+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:00.474958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"36'2","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:37.184808+0000","last_change":"2024-09-13T19:15:55.896710+0000","last_active":"2024-09-13T19:16:37.184808+0000","last_peered":"2024-09-13T19:16:37.184808+0000","last_clean":"2024-09-13T19:16:37.184808+0000","last_became_active":"2024-09-13T19:15:55.895453+0000","last_became_peered":"2024-09-13T19:15:55.895453+0000","last_unstale":"2024-09-13T19:16:37.184808+0000","last_undegraded":"2024-09-13T19:16:37.184808+0000","last_fullsized":"2024-09-13T19:16:37.184808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:02.236650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"36'8","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.700241+0000","last_change":"2024-09-13T19:15:57.896559+0000","last_active":"2024-09-13T19:19:05.700241+0000","last_peered":"2024-09-13T19:19:05.700241+0000","last_clean":"2024-09-13T19:19:05.700241+0000","last_became_active":"2024-09-13T19:15:57.896208+0000","last_became_peered":"2024-09-13T19:15:57.896208+0000","last_unstale":"2024-09-13T19:19:05.700241+0000","last_undegraded":"2024-09-13T19:19:05.700241+0000","last_fullsized":"2024-09-13T19:19:05.700241+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:17.061411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:04.776815+0000","last_change":"2024-09-13T19:15:55.892927+0000","last_active":"2024-09-13T19:18:04.776815+0000","last_peered":"2024-09-13T19:18:04.776815+0000","last_clean":"2024-09-13T19:18:04.776815+0000","last_became_active":"2024-09-13T19:15:55.892616+0000","last_became_peered":"2024-09-13T19:15:55.892616+0000","last_unstale":"2024-09-13T19:18:04.776815+0000","last_undegraded":"2024-09-13T19:18:04.776815+0000","last_fullsized":"2024-09-13T19:18:04.776815+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:43:49.825167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"36'2","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:01.383748+0000","last_change":"2024-09-13T19:15:57.897850+0000","last_active":"2024-09-13T19:18:01.383748+0000","last_peered":"2024-09-13T19:18:01.383748+0000","last_clean":"2024-09-13T19:18:01.383748+0000","last_became_active":"2024-09-13T19:15:57.897566+0000","last_became_peered":"2024-09-13T19:15:57.897566+0000","last_unstale":"2024-09-13T19:18:01.383748+0000","last_undegraded":"2024-09-13T19:18:01.383748+0000","last_fullsized":"2024-09-13T19:18:01.383748+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:28:00.527551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984851+0000","last_change":"2024-09-13T19:15:55.894579+0000","last_active":"2024-09-13T19:16:31.984851+0000","last_peered":"2024-09-13T19:16:31.984851+0000","last_clean":"2024-09-13T19:16:31.984851+0000","last_became_active":"2024-09-13T19:15:55.893594+0000","last_became_peered":"2024-09-13T19:15:55.893594+0000","last_unstale":"2024-09-13T19:16:31.984851+0000","last_undegraded":"2024-09-13T19:16:31.984851+0000","last_fullsized":"2024-09-13T19:16:31.984851+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:00.650641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"36'6","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.842241+0000","last_change":"2024-09-13T19:15:57.890303+0000","last_active":"2024-09-13T19:19:05.842241+0000","last_peered":"2024-09-13T19:19:05.842241+0000","last_clean":"2024-09-13T19:19:05.842241+0000","last_became_active":"2024-09-13T19:15:57.889901+0000","last_became_peered":"2024-09-13T19:15:57.889901+0000","last_unstale":"2024-09-13T19:19:05.842241+0000","last_undegraded":"2024-09-13T19:19:05.842241+0000","last_fullsized":"2024-09-13T19:19:05.842241+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:15.189353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.982141+0000","last_change":"2024-09-13T19:15:55.899097+0000","last_active":"2024-09-13T19:16:31.982141+0000","last_peered":"2024-09-13T19:16:31.982141+0000","last_clean":"2024-09-13T19:16:31.982141+0000","last_became_active":"2024-09-13T19:15:55.898679+0000","last_became_peered":"2024-09-13T19:15:55.898679+0000","last_unstale":"2024-09-13T19:16:31.982141+0000","last_undegraded":"2024-09-13T19:16:31.982141+0000","last_fullsized":"2024-09-13T19:16:31.982141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:27:38.213575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"36'35","reported_seq":99,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.884618+0000","last_change":"2024-09-13T19:16:05.921753+0000","last_active":"2024-09-13T19:19:05.884618+0000","last_peered":"2024-09-13T19:19:05.884618+0000","last_clean":"2024-09-13T19:19:05.884618+0000","last_became_active":"2024-09-13T19:16:05.921156+0000","last_became_peered":"2024-09-13T19:16:05.921156+0000","last_unstale":"2024-09-13T19:19:05.884618+0000","last_undegraded":"2024-09-13T19:19:05.884618+0000","last_fullsized":"2024-09-13T19:19:05.884618+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:05.248200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"36'6","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.601363+0000","last_change":"2024-09-13T19:15:57.897717+0000","last_active":"2024-09-13T19:19:05.601363+0000","last_peered":"2024-09-13T19:19:05.601363+0000","last_clean":"2024-09-13T19:19:05.601363+0000","last_became_active":"2024-09-13T19:15:57.895870+0000","last_became_peered":"2024-09-13T19:15:57.895870+0000","last_unstale":"2024-09-13T19:19:05.601363+0000","last_undegraded":"2024-09-13T19:19:05.601363+0000","last_fullsized":"2024-09-13T19:19:05.601363+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:18.507963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.981961+0000","last_change":"2024-09-13T19:15:55.895213+0000","last_active":"2024-09-13T19:16:31.981961+0000","last_peered":"2024-09-13T19:16:31.981961+0000","last_clean":"2024-09-13T19:16:31.981961+0000","last_became_active":"2024-09-13T19:15:55.894099+0000","last_became_peered":"2024-09-13T19:15:55.894099+0000","last_unstale":"2024-09-13T19:16:31.981961+0000","last_undegraded":"2024-09-13T19:16:31.981961+0000","last_fullsized":"2024-09-13T19:16:31.981961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:27:58.520969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985712+0000","last_change":"2024-09-13T19:15:59.896913+0000","last_active":"2024-09-13T19:16:31.985712+0000","last_peered":"2024-09-13T19:16:31.985712+0000","last_clean":"2024-09-13T19:16:31.985712+0000","last_became_active":"2024-09-13T19:15:59.896648+0000","last_became_peered":"2024-09-13T19:15:59.896648+0000","last_unstale":"2024-09-13T19:16:31.985712+0000","last_undegraded":"2024-09-13T19:16:31.985712+0000","last_fullsized":"2024-09-13T19:16:31.985712+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:46.250392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"36'30","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.155817+0000","last_change":"2024-09-13T19:16:01.907027+0000","last_active":"2024-09-13T19:18:03.155817+0000","last_peered":"2024-09-13T19:18:03.155817+0000","last_clean":"2024-09-13T19:18:03.155817+0000","last_became_active":"2024-09-13T19:16:01.906675+0000","last_became_peered":"2024-09-13T19:16:01.906675+0000","last_unstale":"2024-09-13T19:18:03.155817+0000","last_undegraded":"2024-09-13T19:18:03.155817+0000","last_fullsized":"2024-09-13T19:18:03.155817+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:45.278694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.990499+0000","last_change":"2024-09-13T19:16:03.914490+0000","last_active":"2024-09-13T19:16:31.990499+0000","last_peered":"2024-09-13T19:16:31.990499+0000","last_clean":"2024-09-13T19:16:31.990499+0000","last_became_active":"2024-09-13T19:16:03.914111+0000","last_became_peered":"2024-09-13T19:16:03.914111+0000","last_unstale":"2024-09-13T19:16:31.990499+0000","last_undegraded":"2024-09-13T19:16:31.990499+0000","last_fullsized":"2024-09-13T19:16:31.990499+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:15.864837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"36'7","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:20.744686+0000","last_change":"2024-09-13T19:16:05.925198+0000","last_active":"2024-09-13T19:17:20.744686+0000","last_peered":"2024-09-13T19:17:20.744686+0000","last_clean":"2024-09-13T19:17:20.744686+0000","last_became_active":"2024-09-13T19:16:05.924829+0000","last_became_peered":"2024-09-13T19:16:05.924829+0000","last_unstale":"2024-09-13T19:17:20.744686+0000","last_undegraded":"2024-09-13T19:17:20.744686+0000","last_fullsized":"2024-09-13T19:17:20.744686+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:34:08.741130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"36'10","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.920422+0000","last_change":"2024-09-13T19:15:57.898414+0000","last_active":"2024-09-13T19:19:05.920422+0000","last_peered":"2024-09-13T19:19:05.920422+0000","last_clean":"2024-09-13T19:19:05.920422+0000","last_became_active":"2024-09-13T19:15:57.897928+0000","last_became_peered":"2024-09-13T19:15:57.897928+0000","last_unstale":"2024-09-13T19:19:05.920422+0000","last_undegraded":"2024-09-13T19:19:05.920422+0000","last_fullsized":"2024-09-13T19:19:05.920422+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:32.186245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985358+0000","last_change":"2024-09-13T19:15:55.892255+0000","last_active":"2024-09-13T19:16:31.985358+0000","last_peered":"2024-09-13T19:16:31.985358+0000","last_clean":"2024-09-13T19:16:31.985358+0000","last_became_active":"2024-09-13T19:15:55.891934+0000","last_became_peered":"2024-09-13T19:15:55.891934+0000","last_unstale":"2024-09-13T19:16:31.985358+0000","last_undegraded":"2024-09-13T19:16:31.985358+0000","last_fullsized":"2024-09-13T19:16:31.985358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:14:40.566289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984081+0000","last_change":"2024-09-13T19:15:59.892496+0000","last_active":"2024-09-13T19:16:31.984081+0000","last_peered":"2024-09-13T19:16:31.984081+0000","last_clean":"2024-09-13T19:16:31.984081+0000","last_became_active":"2024-09-13T19:15:59.892230+0000","last_became_peered":"2024-09-13T19:15:59.892230+0000","last_unstale":"2024-09-13T19:16:31.984081+0000","last_undegraded":"2024-09-13T19:16:31.984081+0000","last_fullsized":"2024-09-13T19:16:31.984081+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:58.175054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"36'8","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:38.373021+0000","last_change":"2024-09-13T19:16:01.903662+0000","last_active":"2024-09-13T19:16:38.373021+0000","last_peered":"2024-09-13T19:16:38.373021+0000","last_clean":"2024-09-13T19:16:38.373021+0000","last_became_active":"2024-09-13T19:16:01.903371+0000","last_became_peered":"2024-09-13T19:16:01.903371+0000","last_unstale":"2024-09-13T19:16:38.373021+0000","last_undegraded":"2024-09-13T19:16:38.373021+0000","last_fullsized":"2024-09-13T19:16:38.373021+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:53.296370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.988897+0000","last_change":"2024-09-13T19:16:03.915815+0000","last_active":"2024-09-13T19:16:31.988897+0000","last_peered":"2024-09-13T19:16:31.988897+0000","last_clean":"2024-09-13T19:16:31.988897+0000","last_became_active":"2024-09-13T19:16:03.915538+0000","last_became_peered":"2024-09-13T19:16:03.915538+0000","last_unstale":"2024-09-13T19:16:31.988897+0000","last_undegraded":"2024-09-13T19:16:31.988897+0000","last_fullsized":"2024-09-13T19:16:31.988897+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:54:45.306953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"34'2","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.983505+0000","last_change":"2024-09-13T19:16:05.911958+0000","last_active":"2024-09-13T19:16:31.983505+0000","last_peered":"2024-09-13T19:16:31.983505+0000","last_clean":"2024-09-13T19:16:31.983505+0000","last_became_active":"2024-09-13T19:16:05.911683+0000","last_became_peered":"2024-09-13T19:16:05.911683+0000","last_unstale":"2024-09-13T19:16:31.983505+0000","last_undegraded":"2024-09-13T19:16:31.983505+0000","last_fullsized":"2024-09-13T19:16:31.983505+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:54:45.632821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"36'4","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.919899+0000","last_change":"2024-09-13T19:15:57.897213+0000","last_active":"2024-09-13T19:19:05.919899+0000","last_peered":"2024-09-13T19:19:05.919899+0000","last_clean":"2024-09-13T19:19:05.919899+0000","last_became_active":"2024-09-13T19:15:57.896965+0000","last_became_peered":"2024-09-13T19:15:57.896965+0000","last_unstale":"2024-09-13T19:19:05.919899+0000","last_undegraded":"2024-09-13T19:19:05.919899+0000","last_fullsized":"2024-09-13T19:19:05.919899+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:07:02.179917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.830677+0000","last_change":"2024-09-13T19:15:55.899327+0000","last_active":"2024-09-13T19:19:05.830677+0000","last_peered":"2024-09-13T19:19:05.830677+0000","last_clean":"2024-09-13T19:19:05.830677+0000","last_became_active":"2024-09-13T19:15:55.895444+0000","last_became_peered":"2024-09-13T19:15:55.895444+0000","last_unstale":"2024-09-13T19:19:05.830677+0000","last_undegraded":"2024-09-13T19:19:05.830677+0000","last_fullsized":"2024-09-13T19:19:05.830677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:01:17.850573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.986459+0000","last_change":"2024-09-13T19:15:59.895805+0000","last_active":"2024-09-13T19:16:31.986459+0000","last_peered":"2024-09-13T19:16:31.986459+0000","last_clean":"2024-09-13T19:16:31.986459+0000","last_became_active":"2024-09-13T19:15:59.895332+0000","last_became_peered":"2024-09-13T19:15:59.895332+0000","last_unstale":"2024-09-13T19:16:31.986459+0000","last_undegraded":"2024-09-13T19:16:31.986459+0000","last_fullsized":"2024-09-13T19:16:31.986459+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:50.391526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"34'10","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985590+0000","last_change":"2024-09-13T19:16:01.905730+0000","last_active":"2024-09-13T19:16:31.985590+0000","last_peered":"2024-09-13T19:16:31.985590+0000","last_clean":"2024-09-13T19:16:31.985590+0000","last_became_active":"2024-09-13T19:16:01.905457+0000","last_became_peered":"2024-09-13T19:16:01.905457+0000","last_unstale":"2024-09-13T19:16:31.985590+0000","last_undegraded":"2024-09-13T19:16:31.985590+0000","last_fullsized":"2024-09-13T19:16:31.985590+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:49.792682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"36'282","reported_seq":381,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:04.973465+0000","last_change":"2024-09-13T19:16:03.917127+0000","last_active":"2024-09-13T19:19:04.973465+0000","last_peered":"2024-09-13T19:19:04.973465+0000","last_clean":"2024-09-13T19:19:04.973465+0000","last_became_active":"2024-09-13T19:16:03.916853+0000","last_became_peered":"2024-09-13T19:16:03.916853+0000","last_unstale":"2024-09-13T19:19:04.973465+0000","last_undegraded":"2024-09-13T19:19:04.973465+0000","last_fullsized":"2024-09-13T19:19:04.973465+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:35:56.150634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"36'2","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.897376+0000","last_change":"2024-09-13T19:16:05.912480+0000","last_active":"2024-09-13T19:19:05.897376+0000","last_peered":"2024-09-13T19:19:05.897376+0000","last_clean":"2024-09-13T19:19:05.897376+0000","last_became_active":"2024-09-13T19:16:05.912191+0000","last_became_peered":"2024-09-13T19:16:05.912191+0000","last_unstale":"2024-09-13T19:19:05.897376+0000","last_undegraded":"2024-09-13T19:19:05.897376+0000","last_fullsized":"2024-09-13T19:19:05.897376+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:58.001697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"36'4","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.920393+0000","last_change":"2024-09-13T19:15:57.890567+0000","last_active":"2024-09-13T19:19:05.920393+0000","last_peered":"2024-09-13T19:19:05.920393+0000","last_clean":"2024-09-13T19:19:05.920393+0000","last_became_active":"2024-09-13T19:15:57.890015+0000","last_became_peered":"2024-09-13T19:15:57.890015+0000","last_unstale":"2024-09-13T19:19:05.920393+0000","last_undegraded":"2024-09-13T19:19:05.920393+0000","last_fullsized":"2024-09-13T19:19:05.920393+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:12.703558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.988304+0000","last_change":"2024-09-13T19:15:55.894913+0000","last_active":"2024-09-13T19:16:31.988304+0000","last_peered":"2024-09-13T19:16:31.988304+0000","last_clean":"2024-09-13T19:16:31.988304+0000","last_became_active":"2024-09-13T19:15:55.894380+0000","last_became_peered":"2024-09-13T19:15:55.894380+0000","last_unstale":"2024-09-13T19:16:31.988304+0000","last_undegraded":"2024-09-13T19:16:31.988304+0000","last_fullsized":"2024-09-13T19:16:31.988304+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:50:15.856299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984719+0000","last_change":"2024-09-13T19:15:59.897351+0000","last_active":"2024-09-13T19:16:31.984719+0000","last_peered":"2024-09-13T19:16:31.984719+0000","last_clean":"2024-09-13T19:16:31.984719+0000","last_became_active":"2024-09-13T19:15:59.896572+0000","last_became_peered":"2024-09-13T19:15:59.896572+0000","last_unstale":"2024-09-13T19:16:31.984719+0000","last_undegraded":"2024-09-13T19:16:31.984719+0000","last_fullsized":"2024-09-13T19:16:31.984719+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:59.226392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"36'30","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.150792+0000","last_change":"2024-09-13T19:16:01.906742+0000","last_active":"2024-09-13T19:18:03.150792+0000","last_peered":"2024-09-13T19:18:03.150792+0000","last_clean":"2024-09-13T19:18:03.150792+0000","last_became_active":"2024-09-13T19:16:01.906471+0000","last_became_peered":"2024-09-13T19:16:01.906471+0000","last_unstale":"2024-09-13T19:18:03.150792+0000","last_undegraded":"2024-09-13T19:18:03.150792+0000","last_fullsized":"2024-09-13T19:18:03.150792+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:06.655467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"36'282","reported_seq":410,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.964999+0000","last_change":"2024-09-13T19:16:03.909320+0000","last_active":"2024-09-13T19:19:05.964999+0000","last_peered":"2024-09-13T19:19:05.964999+0000","last_clean":"2024-09-13T19:19:05.964999+0000","last_became_active":"2024-09-13T19:16:03.909046+0000","last_became_peered":"2024-09-13T19:16:03.909046+0000","last_unstale":"2024-09-13T19:19:05.964999+0000","last_undegraded":"2024-09-13T19:19:05.964999+0000","last_fullsized":"2024-09-13T19:19:05.964999+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:17.180563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"36'16","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:01.383779+0000","last_change":"2024-09-13T19:16:31.997893+0000","last_active":"2024-09-13T19:18:01.383779+0000","last_peered":"2024-09-13T19:18:01.383779+0000","last_clean":"2024-09-13T19:18:01.383779+0000","last_became_active":"2024-09-13T19:16:31.991055+0000","last_became_peered":"2024-09-13T19:16:31.991055+0000","last_unstale":"2024-09-13T19:18:01.383779+0000","last_undegraded":"2024-09-13T19:18:01.383779+0000","last_fullsized":"2024-09-13T19:18:01.383779+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:44.244007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":73,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.986838+0000","last_change":"2024-09-13T19:15:55.893934+0000","last_active":"2024-09-13T19:16:31.986838+0000","last_peered":"2024-09-13T19:16:31.986838+0000","last_clean":"2024-09-13T19:16:31.986838+0000","last_became_active":"2024-09-13T19:15:55.893544+0000","last_became_peered":"2024-09-13T19:15:55.893544+0000","last_unstale":"2024-09-13T19:16:31.986838+0000","last_undegraded":"2024-09-13T19:16:31.986838+0000","last_fullsized":"2024-09-13T19:16:31.986838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:18:40.262875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.990140+0000","last_change":"2024-09-13T19:15:59.897690+0000","last_active":"2024-09-13T19:16:31.990140+0000","last_peered":"2024-09-13T19:16:31.990140+0000","last_clean":"2024-09-13T19:16:31.990140+0000","last_became_active":"2024-09-13T19:15:59.897435+0000","last_became_peered":"2024-09-13T19:15:59.897435+0000","last_unstale":"2024-09-13T19:16:31.990140+0000","last_undegraded":"2024-09-13T19:16:31.990140+0000","last_fullsized":"2024-09-13T19:16:31.990140+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:59:16.566449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"36'41","reported_seq":88,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:05.014107+0000","last_change":"2024-09-13T19:16:01.904848+0000","last_active":"2024-09-13T19:18:05.014107+0000","last_peered":"2024-09-13T19:18:05.014107+0000","last_clean":"2024-09-13T19:18:05.014107+0000","last_became_active":"2024-09-13T19:16:01.904454+0000","last_became_peered":"2024-09-13T19:16:01.904454+0000","last_unstale":"2024-09-13T19:18:05.014107+0000","last_undegraded":"2024-09-13T19:18:05.014107+0000","last_fullsized":"2024-09-13T19:18:05.014107+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:57.161122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984623+0000","last_change":"2024-09-13T19:16:03.912757+0000","last_active":"2024-09-13T19:16:31.984623+0000","last_peered":"2024-09-13T19:16:31.984623+0000","last_clean":"2024-09-13T19:16:31.984623+0000","last_became_active":"2024-09-13T19:16:03.912383+0000","last_became_peered":"2024-09-13T19:16:03.912383+0000","last_unstale":"2024-09-13T19:16:31.984623+0000","last_undegraded":"2024-09-13T19:16:31.984623+0000","last_fullsized":"2024-09-13T19:16:31.984623+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:51:11.448119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"36'5","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:20.746478+0000","last_change":"2024-09-13T19:16:05.919436+0000","last_active":"2024-09-13T19:17:20.746478+0000","last_peered":"2024-09-13T19:17:20.746478+0000","last_clean":"2024-09-13T19:17:20.746478+0000","last_became_active":"2024-09-13T19:16:05.919154+0000","last_became_peered":"2024-09-13T19:16:05.919154+0000","last_unstale":"2024-09-13T19:17:20.746478+0000","last_undegraded":"2024-09-13T19:17:20.746478+0000","last_fullsized":"2024-09-13T19:17:20.746478+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:37.455541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"36'3","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.929721+0000","last_change":"2024-09-13T19:15:57.890834+0000","last_active":"2024-09-13T19:19:05.929721+0000","last_peered":"2024-09-13T19:19:05.929721+0000","last_clean":"2024-09-13T19:19:05.929721+0000","last_became_active":"2024-09-13T19:15:57.890345+0000","last_became_peered":"2024-09-13T19:15:57.890345+0000","last_unstale":"2024-09-13T19:19:05.929721+0000","last_undegraded":"2024-09-13T19:19:05.929721+0000","last_fullsized":"2024-09-13T19:19:05.929721+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:57:17.627397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.833713+0000","last_change":"2024-09-13T19:15:55.891871+0000","last_active":"2024-09-13T19:19:05.833713+0000","last_peered":"2024-09-13T19:19:05.833713+0000","last_clean":"2024-09-13T19:19:05.833713+0000","last_became_active":"2024-09-13T19:15:55.891250+0000","last_became_peered":"2024-09-13T19:15:55.891250+0000","last_unstale":"2024-09-13T19:19:05.833713+0000","last_undegraded":"2024-09-13T19:19:05.833713+0000","last_fullsized":"2024-09-13T19:19:05.833713+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:28:19.256515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.983694+0000","last_change":"2024-09-13T19:15:59.891252+0000","last_active":"2024-09-13T19:16:31.983694+0000","last_peered":"2024-09-13T19:16:31.983694+0000","last_clean":"2024-09-13T19:16:31.983694+0000","last_became_active":"2024-09-13T19:15:59.891028+0000","last_became_peered":"2024-09-13T19:15:59.891028+0000","last_unstale":"2024-09-13T19:16:31.983694+0000","last_undegraded":"2024-09-13T19:16:31.983694+0000","last_fullsized":"2024-09-13T19:16:31.983694+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:30:01.518005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"36'30","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.140570+0000","last_change":"2024-09-13T19:16:01.904850+0000","last_active":"2024-09-13T19:18:03.140570+0000","last_peered":"2024-09-13T19:18:03.140570+0000","last_clean":"2024-09-13T19:18:03.140570+0000","last_became_active":"2024-09-13T19:16:01.904534+0000","last_became_peered":"2024-09-13T19:16:01.904534+0000","last_unstale":"2024-09-13T19:18:03.140570+0000","last_undegraded":"2024-09-13T19:18:03.140570+0000","last_fullsized":"2024-09-13T19:18:03.140570+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:00.451745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.983684+0000","last_change":"2024-09-13T19:16:03.914154+0000","last_active":"2024-09-13T19:16:31.983684+0000","last_peered":"2024-09-13T19:16:31.983684+0000","last_clean":"2024-09-13T19:16:31.983684+0000","last_became_active":"2024-09-13T19:16:03.913829+0000","last_became_peered":"2024-09-13T19:16:03.913829+0000","last_unstale":"2024-09-13T19:16:31.983684+0000","last_undegraded":"2024-09-13T19:16:31.983684+0000","last_fullsized":"2024-09-13T19:16:31.983684+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:43:05.803759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"36'3","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:15.156823+0000","last_change":"2024-09-13T19:16:05.913878+0000","last_active":"2024-09-13T19:17:15.156823+0000","last_peered":"2024-09-13T19:17:15.156823+0000","last_clean":"2024-09-13T19:17:15.156823+0000","last_became_active":"2024-09-13T19:16:05.913578+0000","last_became_peered":"2024-09-13T19:16:05.913578+0000","last_unstale":"2024-09-13T19:17:15.156823+0000","last_undegraded":"2024-09-13T19:17:15.156823+0000","last_fullsized":"2024-09-13T19:17:15.156823+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:39.890039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.986992+0000","last_change":"2024-09-13T19:15:57.898011+0000","last_active":"2024-09-13T19:16:31.986992+0000","last_peered":"2024-09-13T19:16:31.986992+0000","last_clean":"2024-09-13T19:16:31.986992+0000","last_became_active":"2024-09-13T19:15:57.897468+0000","last_became_peered":"2024-09-13T19:15:57.897468+0000","last_unstale":"2024-09-13T19:16:31.986992+0000","last_undegraded":"2024-09-13T19:16:31.986992+0000","last_fullsized":"2024-09-13T19:16:31.986992+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:27:40.220158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985332+0000","last_change":"2024-09-13T19:15:55.893786+0000","last_active":"2024-09-13T19:16:31.985332+0000","last_peered":"2024-09-13T19:16:31.985332+0000","last_clean":"2024-09-13T19:16:31.985332+0000","last_became_active":"2024-09-13T19:15:55.893489+0000","last_became_peered":"2024-09-13T19:15:55.893489+0000","last_unstale":"2024-09-13T19:16:31.985332+0000","last_undegraded":"2024-09-13T19:16:31.985332+0000","last_fullsized":"2024-09-13T19:16:31.985332+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:43.870700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985334+0000","last_change":"2024-09-13T19:15:59.895668+0000","last_active":"2024-09-13T19:16:31.985334+0000","last_peered":"2024-09-13T19:16:31.985334+0000","last_clean":"2024-09-13T19:16:31.985334+0000","last_became_active":"2024-09-13T19:15:59.895291+0000","last_became_peered":"2024-09-13T19:15:59.895291+0000","last_unstale":"2024-09-13T19:16:31.985334+0000","last_undegraded":"2024-09-13T19:16:31.985334+0000","last_fullsized":"2024-09-13T19:16:31.985334+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:26.583265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"36'36","reported_seq":81,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.161853+0000","last_change":"2024-09-13T19:16:01.896793+0000","last_active":"2024-09-13T19:18:03.161853+0000","last_peered":"2024-09-13T19:18:03.161853+0000","last_clean":"2024-09-13T19:18:03.161853+0000","last_became_active":"2024-09-13T19:16:01.896507+0000","last_became_peered":"2024-09-13T19:16:01.896507+0000","last_unstale":"2024-09-13T19:18:03.161853+0000","last_undegraded":"2024-09-13T19:18:03.161853+0000","last_fullsized":"2024-09-13T19:18:03.161853+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:36.387463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"36'282","reported_seq":375,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.241587+0000","last_change":"2024-09-13T19:16:03.911636+0000","last_active":"2024-09-13T19:19:06.241587+0000","last_peered":"2024-09-13T19:19:06.241587+0000","last_clean":"2024-09-13T19:19:06.241587+0000","last_became_active":"2024-09-13T19:16:03.910504+0000","last_became_peered":"2024-09-13T19:16:03.910504+0000","last_unstale":"2024-09-13T19:19:06.241587+0000","last_undegraded":"2024-09-13T19:19:06.241587+0000","last_fullsized":"2024-09-13T19:19:06.241587+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:47.820382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"36'4","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:20.736275+0000","last_change":"2024-09-13T19:16:05.913148+0000","last_active":"2024-09-13T19:17:20.736275+0000","last_peered":"2024-09-13T19:17:20.736275+0000","last_clean":"2024-09-13T19:17:20.736275+0000","last_became_active":"2024-09-13T19:16:05.912881+0000","last_became_peered":"2024-09-13T19:16:05.912881+0000","last_unstale":"2024-09-13T19:17:20.736275+0000","last_undegraded":"2024-09-13T19:17:20.736275+0000","last_fullsized":"2024-09-13T19:17:20.736275+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:52:47.776691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"36'4","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.696199+0000","last_change":"2024-09-13T19:15:57.884610+0000","last_active":"2024-09-13T19:19:05.696199+0000","last_peered":"2024-09-13T19:19:05.696199+0000","last_clean":"2024-09-13T19:19:05.696199+0000","last_became_active":"2024-09-13T19:15:57.883675+0000","last_became_peered":"2024-09-13T19:15:57.883675+0000","last_unstale":"2024-09-13T19:19:05.696199+0000","last_undegraded":"2024-09-13T19:19:05.696199+0000","last_fullsized":"2024-09-13T19:19:05.696199+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:14.821792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"36'6","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:13.941865+0000","last_change":"2024-09-13T19:15:55.892801+0000","last_active":"2024-09-13T19:18:13.941865+0000","last_peered":"2024-09-13T19:18:13.941865+0000","last_clean":"2024-09-13T19:18:13.941865+0000","last_became_active":"2024-09-13T19:15:55.891882+0000","last_became_peered":"2024-09-13T19:15:55.891882+0000","last_unstale":"2024-09-13T19:18:13.941865+0000","last_undegraded":"2024-09-13T19:18:13.941865+0000","last_fullsized":"2024-09-13T19:18:13.941865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:04.866489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":15,"num_write_kb":4722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:33.926996+0000","last_change":"2024-09-13T19:16:31.992973+0000","last_active":"2024-09-13T19:16:33.926996+0000","last_peered":"2024-09-13T19:16:33.926996+0000","last_clean":"2024-09-13T19:16:33.926996+0000","last_became_active":"2024-09-13T19:16:31.992122+0000","last_became_peered":"2024-09-13T19:16:31.992122+0000","last_unstale":"2024-09-13T19:16:33.926996+0000","last_undegraded":"2024-09-13T19:16:33.926996+0000","last_fullsized":"2024-09-13T19:16:33.926996+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:17.756694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"36'55","reported_seq":111,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.163816+0000","last_change":"2024-09-13T19:16:01.906341+0000","last_active":"2024-09-13T19:18:03.163816+0000","last_peered":"2024-09-13T19:18:03.163816+0000","last_clean":"2024-09-13T19:18:03.163816+0000","last_became_active":"2024-09-13T19:16:01.906031+0000","last_became_peered":"2024-09-13T19:16:01.906031+0000","last_unstale":"2024-09-13T19:18:03.163816+0000","last_undegraded":"2024-09-13T19:18:03.163816+0000","last_fullsized":"2024-09-13T19:18:03.163816+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:10:29.683024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.983190+0000","last_change":"2024-09-13T19:16:03.908434+0000","last_active":"2024-09-13T19:16:31.983190+0000","last_peered":"2024-09-13T19:16:31.983190+0000","last_clean":"2024-09-13T19:16:31.983190+0000","last_became_active":"2024-09-13T19:16:03.908134+0000","last_became_peered":"2024-09-13T19:16:03.908134+0000","last_unstale":"2024-09-13T19:16:31.983190+0000","last_undegraded":"2024-09-13T19:16:31.983190+0000","last_fullsized":"2024-09-13T19:16:31.983190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:49:37.071802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"36'18","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.183081+0000","last_change":"2024-09-13T19:16:05.915102+0000","last_active":"2024-09-13T19:19:06.183081+0000","last_peered":"2024-09-13T19:19:06.183081+0000","last_clean":"2024-09-13T19:19:06.183081+0000","last_became_active":"2024-09-13T19:16:05.914853+0000","last_became_peered":"2024-09-13T19:16:05.914853+0000","last_unstale":"2024-09-13T19:19:06.183081+0000","last_undegraded":"2024-09-13T19:19:06.183081+0000","last_fullsized":"2024-09-13T19:19:06.183081+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:59.082750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"36'6","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.700154+0000","last_change":"2024-09-13T19:15:57.903310+0000","last_active":"2024-09-13T19:19:05.700154+0000","last_peered":"2024-09-13T19:19:05.700154+0000","last_clean":"2024-09-13T19:19:05.700154+0000","last_became_active":"2024-09-13T19:15:57.902955+0000","last_became_peered":"2024-09-13T19:15:57.902955+0000","last_unstale":"2024-09-13T19:19:05.700154+0000","last_undegraded":"2024-09-13T19:19:05.700154+0000","last_fullsized":"2024-09-13T19:19:05.700154+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:45.877283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984439+0000","last_change":"2024-09-13T19:15:55.891315+0000","last_active":"2024-09-13T19:16:31.984439+0000","last_peered":"2024-09-13T19:16:31.984439+0000","last_clean":"2024-09-13T19:16:31.984439+0000","last_became_active":"2024-09-13T19:15:55.890805+0000","last_became_peered":"2024-09-13T19:15:55.890805+0000","last_unstale":"2024-09-13T19:16:31.984439+0000","last_undegraded":"2024-09-13T19:16:31.984439+0000","last_fullsized":"2024-09-13T19:16:31.984439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:20.126050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.987047+0000","last_change":"2024-09-13T19:15:59.898184+0000","last_active":"2024-09-13T19:16:31.987047+0000","last_peered":"2024-09-13T19:16:31.987047+0000","last_clean":"2024-09-13T19:16:31.987047+0000","last_became_active":"2024-09-13T19:15:59.897884+0000","last_became_peered":"2024-09-13T19:15:59.897884+0000","last_unstale":"2024-09-13T19:16:31.987047+0000","last_undegraded":"2024-09-13T19:16:31.987047+0000","last_fullsized":"2024-09-13T19:16:31.987047+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:34.869944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"36'33","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:18.942178+0000","last_change":"2024-09-13T19:16:01.903021+0000","last_active":"2024-09-13T19:18:18.942178+0000","last_peered":"2024-09-13T19:18:18.942178+0000","last_clean":"2024-09-13T19:18:18.942178+0000","last_became_active":"2024-09-13T19:16:01.902657+0000","last_became_peered":"2024-09-13T19:16:01.902657+0000","last_unstale":"2024-09-13T19:18:18.942178+0000","last_undegraded":"2024-09-13T19:18:18.942178+0000","last_fullsized":"2024-09-13T19:18:18.942178+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:41.157697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5807,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":27,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984486+0000","last_change":"2024-09-13T19:16:03.915798+0000","last_active":"2024-09-13T19:16:31.984486+0000","last_peered":"2024-09-13T19:16:31.984486+0000","last_clean":"2024-09-13T19:16:31.984486+0000","last_became_active":"2024-09-13T19:16:03.915499+0000","last_became_peered":"2024-09-13T19:16:03.915499+0000","last_unstale":"2024-09-13T19:16:31.984486+0000","last_undegraded":"2024-09-13T19:16:31.984486+0000","last_fullsized":"2024-09-13T19:16:31.984486+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:32.988972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"36'3","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:08.940888+0000","last_change":"2024-09-13T19:16:05.920534+0000","last_active":"2024-09-13T19:18:08.940888+0000","last_peered":"2024-09-13T19:18:08.940888+0000","last_clean":"2024-09-13T19:18:08.940888+0000","last_became_active":"2024-09-13T19:16:05.920239+0000","last_became_peered":"2024-09-13T19:16:05.920239+0000","last_unstale":"2024-09-13T19:18:08.940888+0000","last_undegraded":"2024-09-13T19:18:08.940888+0000","last_fullsized":"2024-09-13T19:18:08.940888+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:56.959074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"36'8","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.920365+0000","last_change":"2024-09-13T19:15:57.901642+0000","last_active":"2024-09-13T19:19:05.920365+0000","last_peered":"2024-09-13T19:19:05.920365+0000","last_clean":"2024-09-13T19:19:05.920365+0000","last_became_active":"2024-09-13T19:15:57.901131+0000","last_became_peered":"2024-09-13T19:15:57.901131+0000","last_unstale":"2024-09-13T19:19:05.920365+0000","last_undegraded":"2024-09-13T19:19:05.920365+0000","last_fullsized":"2024-09-13T19:19:05.920365+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:14:23.651972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.982818+0000","last_change":"2024-09-13T19:15:55.900444+0000","last_active":"2024-09-13T19:16:31.982818+0000","last_peered":"2024-09-13T19:16:31.982818+0000","last_clean":"2024-09-13T19:16:31.982818+0000","last_became_active":"2024-09-13T19:15:55.900143+0000","last_became_peered":"2024-09-13T19:15:55.900143+0000","last_unstale":"2024-09-13T19:16:31.982818+0000","last_undegraded":"2024-09-13T19:16:31.982818+0000","last_fullsized":"2024-09-13T19:16:31.982818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:35.770490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984163+0000","last_change":"2024-09-13T19:15:59.895249+0000","last_active":"2024-09-13T19:16:31.984163+0000","last_peered":"2024-09-13T19:16:31.984163+0000","last_clean":"2024-09-13T19:16:31.984163+0000","last_became_active":"2024-09-13T19:15:59.894793+0000","last_became_peered":"2024-09-13T19:15:59.894793+0000","last_unstale":"2024-09-13T19:16:31.984163+0000","last_undegraded":"2024-09-13T19:16:31.984163+0000","last_fullsized":"2024-09-13T19:16:31.984163+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:00:58.200294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"36'36","reported_seq":81,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.170094+0000","last_change":"2024-09-13T19:16:01.898005+0000","last_active":"2024-09-13T19:18:03.170094+0000","last_peered":"2024-09-13T19:18:03.170094+0000","last_clean":"2024-09-13T19:18:03.170094+0000","last_became_active":"2024-09-13T19:16:01.897733+0000","last_became_peered":"2024-09-13T19:16:01.897733+0000","last_unstale":"2024-09-13T19:18:03.170094+0000","last_undegraded":"2024-09-13T19:18:03.170094+0000","last_fullsized":"2024-09-13T19:18:03.170094+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:59:18.573044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"36'282","reported_seq":409,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.187004+0000","last_change":"2024-09-13T19:16:03.916031+0000","last_active":"2024-09-13T19:19:06.187004+0000","last_peered":"2024-09-13T19:19:06.187004+0000","last_clean":"2024-09-13T19:19:06.187004+0000","last_became_active":"2024-09-13T19:16:03.915589+0000","last_became_peered":"2024-09-13T19:16:03.915589+0000","last_unstale":"2024-09-13T19:19:06.187004+0000","last_undegraded":"2024-09-13T19:19:06.187004+0000","last_fullsized":"2024-09-13T19:19:06.187004+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:43.165549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"36'12","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:11.936636+0000","last_change":"2024-09-13T19:16:05.912837+0000","last_active":"2024-09-13T19:18:11.936636+0000","last_peered":"2024-09-13T19:18:11.936636+0000","last_clean":"2024-09-13T19:18:11.936636+0000","last_became_active":"2024-09-13T19:16:05.912339+0000","last_became_peered":"2024-09-13T19:16:05.912339+0000","last_unstale":"2024-09-13T19:18:11.936636+0000","last_undegraded":"2024-09-13T19:18:11.936636+0000","last_fullsized":"2024-09-13T19:18:11.936636+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:59.279329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"36'6","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:38.868840+0000","last_change":"2024-09-13T19:15:57.900840+0000","last_active":"2024-09-13T19:16:38.868840+0000","last_peered":"2024-09-13T19:16:38.868840+0000","last_clean":"2024-09-13T19:16:38.868840+0000","last_became_active":"2024-09-13T19:15:57.900560+0000","last_became_peered":"2024-09-13T19:15:57.900560+0000","last_unstale":"2024-09-13T19:16:38.868840+0000","last_undegraded":"2024-09-13T19:16:38.868840+0000","last_fullsized":"2024-09-13T19:16:38.868840+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:00.474958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.982771+0000","last_change":"2024-09-13T19:15:55.897670+0000","last_active":"2024-09-13T19:16:31.982771+0000","last_peered":"2024-09-13T19:16:31.982771+0000","last_clean":"2024-09-13T19:16:31.982771+0000","last_became_active":"2024-09-13T19:15:55.895799+0000","last_became_peered":"2024-09-13T19:15:55.895799+0000","last_unstale":"2024-09-13T19:16:31.982771+0000","last_undegraded":"2024-09-13T19:16:31.982771+0000","last_fullsized":"2024-09-13T19:16:31.982771+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:36.836879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'3","reported_seq":413,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:04.365221+0000","last_change":"2024-09-13T19:15:59.894637+0000","last_active":"2024-09-13T19:18:04.365221+0000","last_peered":"2024-09-13T19:18:04.365221+0000","last_clean":"2024-09-13T19:18:04.365221+0000","last_became_active":"2024-09-13T19:15:59.894303+0000","last_became_peered":"2024-09-13T19:15:59.894303+0000","last_unstale":"2024-09-13T19:18:04.365221+0000","last_undegraded":"2024-09-13T19:18:04.365221+0000","last_fullsized":"2024-09-13T19:18:04.365221+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:57.476409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"34'10","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.983512+0000","last_change":"2024-09-13T19:16:01.906838+0000","last_active":"2024-09-13T19:16:31.983512+0000","last_peered":"2024-09-13T19:16:31.983512+0000","last_clean":"2024-09-13T19:16:31.983512+0000","last_became_active":"2024-09-13T19:16:01.906490+0000","last_became_peered":"2024-09-13T19:16:01.906490+0000","last_unstale":"2024-09-13T19:16:31.983512+0000","last_undegraded":"2024-09-13T19:16:31.983512+0000","last_fullsized":"2024-09-13T19:16:31.983512+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:37.861718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"36'282","reported_seq":499,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.068344+0000","last_change":"2024-09-13T19:16:03.905840+0000","last_active":"2024-09-13T19:19:06.068344+0000","last_peered":"2024-09-13T19:19:06.068344+0000","last_clean":"2024-09-13T19:19:06.068344+0000","last_became_active":"2024-09-13T19:16:03.905523+0000","last_became_peered":"2024-09-13T19:16:03.905523+0000","last_unstale":"2024-09-13T19:19:06.068344+0000","last_undegraded":"2024-09-13T19:19:06.068344+0000","last_fullsized":"2024-09-13T19:19:06.068344+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:24.576600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"36'4","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:04.643906+0000","last_change":"2024-09-13T19:16:05.910975+0000","last_active":"2024-09-13T19:18:04.643906+0000","last_peered":"2024-09-13T19:18:04.643906+0000","last_clean":"2024-09-13T19:18:04.643906+0000","last_became_active":"2024-09-13T19:16:05.910656+0000","last_became_peered":"2024-09-13T19:16:05.910656+0000","last_unstale":"2024-09-13T19:18:04.643906+0000","last_undegraded":"2024-09-13T19:18:04.643906+0000","last_fullsized":"2024-09-13T19:18:04.643906+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:04:51.033264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"36'3","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:13.941421+0000","last_change":"2024-09-13T19:15:57.904037+0000","last_active":"2024-09-13T19:18:13.941421+0000","last_peered":"2024-09-13T19:18:13.941421+0000","last_clean":"2024-09-13T19:18:13.941421+0000","last_became_active":"2024-09-13T19:15:57.903761+0000","last_became_peered":"2024-09-13T19:15:57.903761+0000","last_unstale":"2024-09-13T19:18:13.941421+0000","last_undegraded":"2024-09-13T19:18:13.941421+0000","last_fullsized":"2024-09-13T19:18:13.941421+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:35:04.649421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.981607+0000","last_change":"2024-09-13T19:15:55.900225+0000","last_active":"2024-09-13T19:16:31.981607+0000","last_peered":"2024-09-13T19:16:31.981607+0000","last_clean":"2024-09-13T19:16:31.981607+0000","last_became_active":"2024-09-13T19:15:55.899919+0000","last_became_peered":"2024-09-13T19:15:55.899919+0000","last_unstale":"2024-09-13T19:16:31.981607+0000","last_undegraded":"2024-09-13T19:16:31.981607+0000","last_fullsized":"2024-09-13T19:16:31.981607+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:05.080518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"36'4","reported_seq":226,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:04.355954+0000","last_change":"2024-09-13T19:15:59.897278+0000","last_active":"2024-09-13T19:18:04.355954+0000","last_peered":"2024-09-13T19:18:04.355954+0000","last_clean":"2024-09-13T19:18:04.355954+0000","last_became_active":"2024-09-13T19:15:59.896081+0000","last_became_peered":"2024-09-13T19:15:59.896081+0000","last_unstale":"2024-09-13T19:18:04.355954+0000","last_undegraded":"2024-09-13T19:18:04.355954+0000","last_fullsized":"2024-09-13T19:18:04.355954+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:24:49.015447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"36'39","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.157144+0000","last_change":"2024-09-13T19:16:01.902853+0000","last_active":"2024-09-13T19:18:03.157144+0000","last_peered":"2024-09-13T19:18:03.157144+0000","last_clean":"2024-09-13T19:18:03.157144+0000","last_became_active":"2024-09-13T19:16:01.902532+0000","last_became_peered":"2024-09-13T19:16:01.902532+0000","last_unstale":"2024-09-13T19:18:03.157144+0000","last_undegraded":"2024-09-13T19:18:03.157144+0000","last_fullsized":"2024-09-13T19:18:03.157144+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:31:43.981533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985458+0000","last_change":"2024-09-13T19:16:03.913346+0000","last_active":"2024-09-13T19:16:31.985458+0000","last_peered":"2024-09-13T19:16:31.985458+0000","last_clean":"2024-09-13T19:16:31.985458+0000","last_became_active":"2024-09-13T19:16:03.913019+0000","last_became_peered":"2024-09-13T19:16:03.913019+0000","last_unstale":"2024-09-13T19:16:31.985458+0000","last_undegraded":"2024-09-13T19:16:31.985458+0000","last_fullsized":"2024-09-13T19:16:31.985458+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:24.528793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"36'8","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.020235+0000","last_change":"2024-09-13T19:16:05.911657+0000","last_active":"2024-09-13T19:19:06.020235+0000","last_peered":"2024-09-13T19:19:06.020235+0000","last_clean":"2024-09-13T19:19:06.020235+0000","last_became_active":"2024-09-13T19:16:05.911364+0000","last_became_peered":"2024-09-13T19:16:05.911364+0000","last_unstale":"2024-09-13T19:19:06.020235+0000","last_undegraded":"2024-09-13T19:19:06.020235+0000","last_fullsized":"2024-09-13T19:19:06.020235+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:04.570906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"36'13","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.969400+0000","last_change":"2024-09-13T19:15:57.901609+0000","last_active":"2024-09-13T19:19:05.969400+0000","last_peered":"2024-09-13T19:19:05.969400+0000","last_clean":"2024-09-13T19:19:05.969400+0000","last_became_active":"2024-09-13T19:15:57.900905+0000","last_became_peered":"2024-09-13T19:15:57.900905+0000","last_unstale":"2024-09-13T19:19:05.969400+0000","last_undegraded":"2024-09-13T19:19:05.969400+0000","last_fullsized":"2024-09-13T19:19:05.969400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:12:06.491226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":205,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.988269+0000","last_change":"2024-09-13T19:15:41.170734+0000","last_active":"2024-09-13T19:16:31.988269+0000","last_peered":"2024-09-13T19:16:31.988269+0000","last_clean":"2024-09-13T19:16:31.988269+0000","last_became_active":"2024-09-13T19:15:41.169707+0000","last_became_peered":"2024-09-13T19:15:41.169707+0000","last_unstale":"2024-09-13T19:16:31.988269+0000","last_undegraded":"2024-09-13T19:16:31.988269+0000","last_fullsized":"2024-09-13T19:16:31.988269+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:39.557965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:39.557965+0000","last_clean_scrub_stamp":"2024-09-13T19:15:39.557965+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:40:20.817136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.982316+0000","last_change":"2024-09-13T19:15:46.580815+0000","last_active":"2024-09-13T19:16:31.982316+0000","last_peered":"2024-09-13T19:16:31.982316+0000","last_clean":"2024-09-13T19:16:31.982316+0000","last_became_active":"2024-09-13T19:15:44.577382+0000","last_became_peered":"2024-09-13T19:15:44.577382+0000","last_unstale":"2024-09-13T19:16:31.982316+0000","last_undegraded":"2024-09-13T19:16:31.982316+0000","last_fullsized":"2024-09-13T19:16:31.982316+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:47.750191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047916199999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.981982+0000","last_change":"2024-09-13T19:15:55.900746+0000","last_active":"2024-09-13T19:16:31.981982+0000","last_peered":"2024-09-13T19:16:31.981982+0000","last_clean":"2024-09-13T19:16:31.981982+0000","last_became_active":"2024-09-13T19:15:55.899672+0000","last_became_peered":"2024-09-13T19:15:55.899672+0000","last_unstale":"2024-09-13T19:16:31.981982+0000","last_undegraded":"2024-09-13T19:16:31.981982+0000","last_fullsized":"2024-09-13T19:16:31.981982+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:57:15.620815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.991398+0000","last_change":"2024-09-13T19:15:59.891901+0000","last_active":"2024-09-13T19:16:31.991398+0000","last_peered":"2024-09-13T19:16:31.991398+0000","last_clean":"2024-09-13T19:16:31.991398+0000","last_became_active":"2024-09-13T19:15:59.891615+0000","last_became_peered":"2024-09-13T19:15:59.891615+0000","last_unstale":"2024-09-13T19:16:31.991398+0000","last_undegraded":"2024-09-13T19:16:31.991398+0000","last_fullsized":"2024-09-13T19:16:31.991398+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:37.130876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"36'76","reported_seq":145,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.167978+0000","last_change":"2024-09-13T19:16:01.905525+0000","last_active":"2024-09-13T19:18:03.167978+0000","last_peered":"2024-09-13T19:18:03.167978+0000","last_clean":"2024-09-13T19:18:03.167978+0000","last_became_active":"2024-09-13T19:16:01.905085+0000","last_became_peered":"2024-09-13T19:16:01.905085+0000","last_unstale":"2024-09-13T19:18:03.167978+0000","last_undegraded":"2024-09-13T19:18:03.167978+0000","last_fullsized":"2024-09-13T19:18:03.167978+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:13:47.049154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985422+0000","last_change":"2024-09-13T19:16:03.914155+0000","last_active":"2024-09-13T19:16:31.985422+0000","last_peered":"2024-09-13T19:16:31.985422+0000","last_clean":"2024-09-13T19:16:31.985422+0000","last_became_active":"2024-09-13T19:16:03.913802+0000","last_became_peered":"2024-09-13T19:16:03.913802+0000","last_unstale":"2024-09-13T19:16:31.985422+0000","last_undegraded":"2024-09-13T19:16:31.985422+0000","last_fullsized":"2024-09-13T19:16:31.985422+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:22.123364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"36'89","reported_seq":187,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.972680+0000","last_change":"2024-09-13T19:16:05.911930+0000","last_active":"2024-09-13T19:19:05.972680+0000","last_peered":"2024-09-13T19:19:05.972680+0000","last_clean":"2024-09-13T19:19:05.972680+0000","last_became_active":"2024-09-13T19:16:05.911595+0000","last_became_peered":"2024-09-13T19:16:05.911595+0000","last_unstale":"2024-09-13T19:19:05.972680+0000","last_undegraded":"2024-09-13T19:19:05.972680+0000","last_fullsized":"2024-09-13T19:19:05.972680+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:14:31.680165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":289,"num_read_kb":269,"num_write":182,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"36'4","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:20.922687+0000","last_change":"2024-09-13T19:15:57.897546+0000","last_active":"2024-09-13T19:17:20.922687+0000","last_peered":"2024-09-13T19:17:20.922687+0000","last_clean":"2024-09-13T19:17:20.922687+0000","last_became_active":"2024-09-13T19:15:57.897307+0000","last_became_peered":"2024-09-13T19:15:57.897307+0000","last_unstale":"2024-09-13T19:17:20.922687+0000","last_undegraded":"2024-09-13T19:17:20.922687+0000","last_fullsized":"2024-09-13T19:17:20.922687+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:49.283391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.981198+0000","last_change":"2024-09-13T19:15:46.581436+0000","last_active":"2024-09-13T19:16:31.981198+0000","last_peered":"2024-09-13T19:16:31.981198+0000","last_clean":"2024-09-13T19:16:31.981198+0000","last_became_active":"2024-09-13T19:15:44.576304+0000","last_became_peered":"2024-09-13T19:15:44.576304+0000","last_unstale":"2024-09-13T19:16:31.981198+0000","last_undegraded":"2024-09-13T19:16:31.981198+0000","last_fullsized":"2024-09-13T19:16:31.981198+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:57.538288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011332060000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"36'4","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:38.347356+0000","last_change":"2024-09-13T19:15:55.891911+0000","last_active":"2024-09-13T19:16:38.347356+0000","last_peered":"2024-09-13T19:16:38.347356+0000","last_clean":"2024-09-13T19:16:38.347356+0000","last_became_active":"2024-09-13T19:15:55.891377+0000","last_became_peered":"2024-09-13T19:15:55.891377+0000","last_unstale":"2024-09-13T19:16:38.347356+0000","last_undegraded":"2024-09-13T19:16:38.347356+0000","last_fullsized":"2024-09-13T19:16:38.347356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:12.598004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985654+0000","last_change":"2024-09-13T19:15:59.896527+0000","last_active":"2024-09-13T19:16:31.985654+0000","last_peered":"2024-09-13T19:16:31.985654+0000","last_clean":"2024-09-13T19:16:31.985654+0000","last_became_active":"2024-09-13T19:15:59.896248+0000","last_became_peered":"2024-09-13T19:15:59.896248+0000","last_unstale":"2024-09-13T19:16:31.985654+0000","last_undegraded":"2024-09-13T19:16:31.985654+0000","last_fullsized":"2024-09-13T19:16:31.985654+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:49.569002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"36'274","reported_seq":477,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.855714+0000","last_change":"2024-09-13T19:16:01.907411+0000","last_active":"2024-09-13T19:19:05.855714+0000","last_peered":"2024-09-13T19:19:05.855714+0000","last_clean":"2024-09-13T19:19:05.855714+0000","last_became_active":"2024-09-13T19:16:01.907024+0000","last_became_peered":"2024-09-13T19:16:01.907024+0000","last_unstale":"2024-09-13T19:19:05.855714+0000","last_undegraded":"2024-09-13T19:19:05.855714+0000","last_fullsized":"2024-09-13T19:19:05.855714+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:22.520942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.982628+0000","last_change":"2024-09-13T19:16:03.916021+0000","last_active":"2024-09-13T19:16:31.982628+0000","last_peered":"2024-09-13T19:16:31.982628+0000","last_clean":"2024-09-13T19:16:31.982628+0000","last_became_active":"2024-09-13T19:16:03.915712+0000","last_became_peered":"2024-09-13T19:16:03.915712+0000","last_unstale":"2024-09-13T19:16:31.982628+0000","last_undegraded":"2024-09-13T19:16:31.982628+0000","last_fullsized":"2024-09-13T19:16:31.982628+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:48.381454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"36'3","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:20.742805+0000","last_change":"2024-09-13T19:16:05.917279+0000","last_active":"2024-09-13T19:17:20.742805+0000","last_peered":"2024-09-13T19:17:20.742805+0000","last_clean":"2024-09-13T19:17:20.742805+0000","last_became_active":"2024-09-13T19:16:05.916999+0000","last_became_peered":"2024-09-13T19:16:05.916999+0000","last_unstale":"2024-09-13T19:17:20.742805+0000","last_undegraded":"2024-09-13T19:17:20.742805+0000","last_fullsized":"2024-09-13T19:17:20.742805+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:56:17.231660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.986198+0000","last_change":"2024-09-13T19:15:57.890320+0000","last_active":"2024-09-13T19:16:31.986198+0000","last_peered":"2024-09-13T19:16:31.986198+0000","last_clean":"2024-09-13T19:16:31.986198+0000","last_became_active":"2024-09-13T19:15:57.889885+0000","last_became_peered":"2024-09-13T19:15:57.889885+0000","last_unstale":"2024-09-13T19:16:31.986198+0000","last_undegraded":"2024-09-13T19:16:31.986198+0000","last_fullsized":"2024-09-13T19:16:31.986198+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:45:51.717296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.983888+0000","last_change":"2024-09-13T19:15:47.256565+0000","last_active":"2024-09-13T19:16:31.983888+0000","last_peered":"2024-09-13T19:16:31.983888+0000","last_clean":"2024-09-13T19:16:31.983888+0000","last_became_active":"2024-09-13T19:15:44.575483+0000","last_became_peered":"2024-09-13T19:15:44.575483+0000","last_unstale":"2024-09-13T19:16:31.983888+0000","last_undegraded":"2024-09-13T19:16:31.983888+0000","last_fullsized":"2024-09-13T19:16:31.983888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:05:11.992289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036796000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"36'6","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:38.361020+0000","last_change":"2024-09-13T19:15:55.892997+0000","last_active":"2024-09-13T19:16:38.361020+0000","last_peered":"2024-09-13T19:16:38.361020+0000","last_clean":"2024-09-13T19:16:38.361020+0000","last_became_active":"2024-09-13T19:15:55.892629+0000","last_became_peered":"2024-09-13T19:15:55.892629+0000","last_unstale":"2024-09-13T19:16:38.361020+0000","last_undegraded":"2024-09-13T19:16:38.361020+0000","last_fullsized":"2024-09-13T19:16:38.361020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:35:23.726304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"27'1","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.986613+0000","last_change":"2024-09-13T19:15:59.892045+0000","last_active":"2024-09-13T19:16:31.986613+0000","last_peered":"2024-09-13T19:16:31.986613+0000","last_clean":"2024-09-13T19:16:31.986613+0000","last_became_active":"2024-09-13T19:15:59.891588+0000","last_became_peered":"2024-09-13T19:15:59.891588+0000","last_unstale":"2024-09-13T19:16:31.986613+0000","last_undegraded":"2024-09-13T19:16:31.986613+0000","last_fullsized":"2024-09-13T19:16:31.986613+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:31:11.012170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'16","reported_seq":84,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:04.973539+0000","last_change":"2024-09-13T19:16:01.904560+0000","last_active":"2024-09-13T19:19:04.973539+0000","last_peered":"2024-09-13T19:19:04.973539+0000","last_clean":"2024-09-13T19:19:04.973539+0000","last_became_active":"2024-09-13T19:16:01.903947+0000","last_became_peered":"2024-09-13T19:16:01.903947+0000","last_unstale":"2024-09-13T19:19:04.973539+0000","last_undegraded":"2024-09-13T19:19:04.973539+0000","last_fullsized":"2024-09-13T19:19:04.973539+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:50.008512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984720+0000","last_change":"2024-09-13T19:16:03.911563+0000","last_active":"2024-09-13T19:16:31.984720+0000","last_peered":"2024-09-13T19:16:31.984720+0000","last_clean":"2024-09-13T19:16:31.984720+0000","last_became_active":"2024-09-13T19:16:03.910776+0000","last_became_peered":"2024-09-13T19:16:03.910776+0000","last_unstale":"2024-09-13T19:16:31.984720+0000","last_undegraded":"2024-09-13T19:16:31.984720+0000","last_fullsized":"2024-09-13T19:16:31.984720+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:23:18.198813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"36'2","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.612807+0000","last_change":"2024-09-13T19:16:05.920464+0000","last_active":"2024-09-13T19:19:05.612807+0000","last_peered":"2024-09-13T19:19:05.612807+0000","last_clean":"2024-09-13T19:19:05.612807+0000","last_became_active":"2024-09-13T19:16:05.920191+0000","last_became_peered":"2024-09-13T19:16:05.920191+0000","last_unstale":"2024-09-13T19:19:05.612807+0000","last_undegraded":"2024-09-13T19:19:05.612807+0000","last_fullsized":"2024-09-13T19:19:05.612807+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:52:02.982809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"36'12","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:05.005403+0000","last_change":"2024-09-13T19:15:57.886935+0000","last_active":"2024-09-13T19:18:05.005403+0000","last_peered":"2024-09-13T19:18:05.005403+0000","last_clean":"2024-09-13T19:18:05.005403+0000","last_became_active":"2024-09-13T19:15:57.886273+0000","last_became_peered":"2024-09-13T19:15:57.886273+0000","last_unstale":"2024-09-13T19:18:05.005403+0000","last_undegraded":"2024-09-13T19:18:05.005403+0000","last_fullsized":"2024-09-13T19:18:05.005403+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:58.238081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":44,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.981722+0000","last_change":"2024-09-13T19:15:46.581526+0000","last_active":"2024-09-13T19:16:31.981722+0000","last_peered":"2024-09-13T19:16:31.981722+0000","last_clean":"2024-09-13T19:16:31.981722+0000","last_became_active":"2024-09-13T19:15:44.576052+0000","last_became_peered":"2024-09-13T19:15:44.576052+0000","last_unstale":"2024-09-13T19:16:31.981722+0000","last_undegraded":"2024-09-13T19:16:31.981722+0000","last_fullsized":"2024-09-13T19:16:31.981722+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:33.633045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012221599999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.824572+0000","last_change":"2024-09-13T19:15:55.892933+0000","last_active":"2024-09-13T19:19:05.824572+0000","last_peered":"2024-09-13T19:19:05.824572+0000","last_clean":"2024-09-13T19:19:05.824572+0000","last_became_active":"2024-09-13T19:15:55.892636+0000","last_became_peered":"2024-09-13T19:15:55.892636+0000","last_unstale":"2024-09-13T19:19:05.824572+0000","last_undegraded":"2024-09-13T19:19:05.824572+0000","last_fullsized":"2024-09-13T19:19:05.824572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:50:15.856299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985127+0000","last_change":"2024-09-13T19:15:59.896602+0000","last_active":"2024-09-13T19:16:31.985127+0000","last_peered":"2024-09-13T19:16:31.985127+0000","last_clean":"2024-09-13T19:16:31.985127+0000","last_became_active":"2024-09-13T19:15:59.896248+0000","last_became_peered":"2024-09-13T19:15:59.896248+0000","last_unstale":"2024-09-13T19:16:31.985127+0000","last_undegraded":"2024-09-13T19:16:31.985127+0000","last_fullsized":"2024-09-13T19:16:31.985127+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:09:14.547740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'13","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.032597+0000","last_change":"2024-09-13T19:16:01.905842+0000","last_active":"2024-09-13T19:19:05.032597+0000","last_peered":"2024-09-13T19:19:05.032597+0000","last_clean":"2024-09-13T19:19:05.032597+0000","last_became_active":"2024-09-13T19:16:01.905280+0000","last_became_peered":"2024-09-13T19:16:01.905280+0000","last_unstale":"2024-09-13T19:19:05.032597+0000","last_undegraded":"2024-09-13T19:19:05.032597+0000","last_fullsized":"2024-09-13T19:19:05.032597+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:18:18.978521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984723+0000","last_change":"2024-09-13T19:16:03.916612+0000","last_active":"2024-09-13T19:16:31.984723+0000","last_peered":"2024-09-13T19:16:31.984723+0000","last_clean":"2024-09-13T19:16:31.984723+0000","last_became_active":"2024-09-13T19:16:03.916344+0000","last_became_peered":"2024-09-13T19:16:03.916344+0000","last_unstale":"2024-09-13T19:16:31.984723+0000","last_undegraded":"2024-09-13T19:16:31.984723+0000","last_fullsized":"2024-09-13T19:16:31.984723+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:58.688605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"36'4","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:04.590724+0000","last_change":"2024-09-13T19:16:05.919765+0000","last_active":"2024-09-13T19:18:04.590724+0000","last_peered":"2024-09-13T19:18:04.590724+0000","last_clean":"2024-09-13T19:18:04.590724+0000","last_became_active":"2024-09-13T19:16:05.919156+0000","last_became_peered":"2024-09-13T19:16:05.919156+0000","last_unstale":"2024-09-13T19:18:04.590724+0000","last_undegraded":"2024-09-13T19:18:04.590724+0000","last_fullsized":"2024-09-13T19:18:04.590724+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:55.590810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"36'18","reported_seq":69,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:05.012582+0000","last_change":"2024-09-13T19:15:57.903146+0000","last_active":"2024-09-13T19:18:05.012582+0000","last_peered":"2024-09-13T19:18:05.012582+0000","last_clean":"2024-09-13T19:18:05.012582+0000","last_became_active":"2024-09-13T19:15:57.902819+0000","last_became_peered":"2024-09-13T19:15:57.902819+0000","last_unstale":"2024-09-13T19:18:05.012582+0000","last_undegraded":"2024-09-13T19:18:05.012582+0000","last_fullsized":"2024-09-13T19:18:05.012582+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:50.793368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":50,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.986102+0000","last_change":"2024-09-13T19:15:55.893781+0000","last_active":"2024-09-13T19:16:31.986102+0000","last_peered":"2024-09-13T19:16:31.986102+0000","last_clean":"2024-09-13T19:16:31.986102+0000","last_became_active":"2024-09-13T19:15:55.893468+0000","last_became_peered":"2024-09-13T19:15:55.893468+0000","last_unstale":"2024-09-13T19:16:31.986102+0000","last_undegraded":"2024-09-13T19:16:31.986102+0000","last_fullsized":"2024-09-13T19:16:31.986102+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:06:44.577134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984402+0000","last_change":"2024-09-13T19:15:46.583117+0000","last_active":"2024-09-13T19:16:31.984402+0000","last_peered":"2024-09-13T19:16:31.984402+0000","last_clean":"2024-09-13T19:16:31.984402+0000","last_became_active":"2024-09-13T19:15:44.575726+0000","last_became_peered":"2024-09-13T19:15:44.575726+0000","last_unstale":"2024-09-13T19:16:31.984402+0000","last_undegraded":"2024-09-13T19:16:31.984402+0000","last_fullsized":"2024-09-13T19:16:31.984402+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:27.090413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041430200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"36'1","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:38.944809+0000","last_change":"2024-09-13T19:16:31.990974+0000","last_active":"2024-09-13T19:18:38.944809+0000","last_peered":"2024-09-13T19:18:38.944809+0000","last_clean":"2024-09-13T19:18:38.944809+0000","last_became_active":"2024-09-13T19:16:31.990669+0000","last_became_peered":"2024-09-13T19:16:31.990669+0000","last_unstale":"2024-09-13T19:18:38.944809+0000","last_undegraded":"2024-09-13T19:18:38.944809+0000","last_fullsized":"2024-09-13T19:18:38.944809+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:49:36.858038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"36'61","reported_seq":120,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.169086+0000","last_change":"2024-09-13T19:16:01.902406+0000","last_active":"2024-09-13T19:18:03.169086+0000","last_peered":"2024-09-13T19:18:03.169086+0000","last_clean":"2024-09-13T19:18:03.169086+0000","last_became_active":"2024-09-13T19:16:01.902095+0000","last_became_peered":"2024-09-13T19:16:01.902095+0000","last_unstale":"2024-09-13T19:18:03.169086+0000","last_undegraded":"2024-09-13T19:18:03.169086+0000","last_fullsized":"2024-09-13T19:18:03.169086+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:52.393641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.986023+0000","last_change":"2024-09-13T19:16:03.910134+0000","last_active":"2024-09-13T19:16:31.986023+0000","last_peered":"2024-09-13T19:16:31.986023+0000","last_clean":"2024-09-13T19:16:31.986023+0000","last_became_active":"2024-09-13T19:16:03.909803+0000","last_became_peered":"2024-09-13T19:16:03.909803+0000","last_unstale":"2024-09-13T19:16:31.986023+0000","last_undegraded":"2024-09-13T19:16:31.986023+0000","last_fullsized":"2024-09-13T19:16:31.986023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:14:02.210649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"36'11","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:05.008743+0000","last_change":"2024-09-13T19:16:05.915976+0000","last_active":"2024-09-13T19:18:05.008743+0000","last_peered":"2024-09-13T19:18:05.008743+0000","last_clean":"2024-09-13T19:18:05.008743+0000","last_became_active":"2024-09-13T19:16:05.915672+0000","last_became_peered":"2024-09-13T19:16:05.915672+0000","last_unstale":"2024-09-13T19:18:05.008743+0000","last_undegraded":"2024-09-13T19:18:05.008743+0000","last_fullsized":"2024-09-13T19:18:05.008743+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:55.714578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"36'10","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:05.005754+0000","last_change":"2024-09-13T19:15:57.903282+0000","last_active":"2024-09-13T19:18:05.005754+0000","last_peered":"2024-09-13T19:18:05.005754+0000","last_clean":"2024-09-13T19:18:05.005754+0000","last_became_active":"2024-09-13T19:15:57.902793+0000","last_became_peered":"2024-09-13T19:15:57.902793+0000","last_unstale":"2024-09-13T19:18:05.005754+0000","last_undegraded":"2024-09-13T19:18:05.005754+0000","last_fullsized":"2024-09-13T19:18:05.005754+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:43:25.003517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984951+0000","last_change":"2024-09-13T19:15:55.895728+0000","last_active":"2024-09-13T19:16:31.984951+0000","last_peered":"2024-09-13T19:16:31.984951+0000","last_clean":"2024-09-13T19:16:31.984951+0000","last_became_active":"2024-09-13T19:15:55.894340+0000","last_became_peered":"2024-09-13T19:15:55.894340+0000","last_unstale":"2024-09-13T19:16:31.984951+0000","last_undegraded":"2024-09-13T19:16:31.984951+0000","last_fullsized":"2024-09-13T19:16:31.984951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:13:59.182464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984808+0000","last_change":"2024-09-13T19:15:46.581685+0000","last_active":"2024-09-13T19:16:31.984808+0000","last_peered":"2024-09-13T19:16:31.984808+0000","last_clean":"2024-09-13T19:16:31.984808+0000","last_became_active":"2024-09-13T19:15:44.576006+0000","last_became_peered":"2024-09-13T19:15:44.576006+0000","last_unstale":"2024-09-13T19:16:31.984808+0000","last_undegraded":"2024-09-13T19:16:31.984808+0000","last_fullsized":"2024-09-13T19:16:31.984808+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:52:37.043288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013309299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.981613+0000","last_change":"2024-09-13T19:15:59.895062+0000","last_active":"2024-09-13T19:16:31.981613+0000","last_peered":"2024-09-13T19:16:31.981613+0000","last_clean":"2024-09-13T19:16:31.981613+0000","last_became_active":"2024-09-13T19:15:59.894761+0000","last_became_peered":"2024-09-13T19:15:59.894761+0000","last_unstale":"2024-09-13T19:16:31.981613+0000","last_undegraded":"2024-09-13T19:16:31.981613+0000","last_fullsized":"2024-09-13T19:16:31.981613+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:04.423400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'14","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.990533+0000","last_change":"2024-09-13T19:16:01.907701+0000","last_active":"2024-09-13T19:16:31.990533+0000","last_peered":"2024-09-13T19:16:31.990533+0000","last_clean":"2024-09-13T19:16:31.990533+0000","last_became_active":"2024-09-13T19:16:01.907419+0000","last_became_peered":"2024-09-13T19:16:01.907419+0000","last_unstale":"2024-09-13T19:16:31.990533+0000","last_undegraded":"2024-09-13T19:16:31.990533+0000","last_fullsized":"2024-09-13T19:16:31.990533+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:12:10.504205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"36'282","reported_seq":346,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:04.973517+0000","last_change":"2024-09-13T19:16:03.908228+0000","last_active":"2024-09-13T19:19:04.973517+0000","last_peered":"2024-09-13T19:19:04.973517+0000","last_clean":"2024-09-13T19:19:04.973517+0000","last_became_active":"2024-09-13T19:16:03.907957+0000","last_became_peered":"2024-09-13T19:16:03.907957+0000","last_unstale":"2024-09-13T19:19:04.973517+0000","last_undegraded":"2024-09-13T19:19:04.973517+0000","last_fullsized":"2024-09-13T19:19:04.973517+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:35.448179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"34'2","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.983260+0000","last_change":"2024-09-13T19:16:05.924834+0000","last_active":"2024-09-13T19:16:31.983260+0000","last_peered":"2024-09-13T19:16:31.983260+0000","last_clean":"2024-09-13T19:16:31.983260+0000","last_became_active":"2024-09-13T19:16:05.924162+0000","last_became_peered":"2024-09-13T19:16:05.924162+0000","last_unstale":"2024-09-13T19:16:31.983260+0000","last_undegraded":"2024-09-13T19:16:31.983260+0000","last_fullsized":"2024-09-13T19:16:31.983260+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:00.770168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"36'6","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.969496+0000","last_change":"2024-09-13T19:15:57.897089+0000","last_active":"2024-09-13T19:19:05.969496+0000","last_peered":"2024-09-13T19:19:05.969496+0000","last_clean":"2024-09-13T19:19:05.969496+0000","last_became_active":"2024-09-13T19:15:57.896078+0000","last_became_peered":"2024-09-13T19:15:57.896078+0000","last_unstale":"2024-09-13T19:19:05.969496+0000","last_undegraded":"2024-09-13T19:19:05.969496+0000","last_fullsized":"2024-09-13T19:19:05.969496+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:10.200427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985502+0000","last_change":"2024-09-13T19:15:55.895594+0000","last_active":"2024-09-13T19:16:31.985502+0000","last_peered":"2024-09-13T19:16:31.985502+0000","last_clean":"2024-09-13T19:16:31.985502+0000","last_became_active":"2024-09-13T19:15:55.895282+0000","last_became_peered":"2024-09-13T19:15:55.895282+0000","last_unstale":"2024-09-13T19:16:31.985502+0000","last_undegraded":"2024-09-13T19:16:31.985502+0000","last_fullsized":"2024-09-13T19:16:31.985502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:13.182770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985921+0000","last_change":"2024-09-13T19:15:46.583177+0000","last_active":"2024-09-13T19:16:31.985921+0000","last_peered":"2024-09-13T19:16:31.985921+0000","last_clean":"2024-09-13T19:16:31.985921+0000","last_became_active":"2024-09-13T19:15:44.574967+0000","last_became_peered":"2024-09-13T19:15:44.574967+0000","last_unstale":"2024-09-13T19:16:31.985921+0000","last_undegraded":"2024-09-13T19:16:31.985921+0000","last_fullsized":"2024-09-13T19:16:31.985921+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:20:13.639706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049330999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"27'1","reported_seq":218,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:04.347176+0000","last_change":"2024-09-13T19:15:59.895363+0000","last_active":"2024-09-13T19:18:04.347176+0000","last_peered":"2024-09-13T19:18:04.347176+0000","last_clean":"2024-09-13T19:18:04.347176+0000","last_became_active":"2024-09-13T19:15:59.894966+0000","last_became_peered":"2024-09-13T19:15:59.894966+0000","last_unstale":"2024-09-13T19:18:04.347176+0000","last_undegraded":"2024-09-13T19:18:04.347176+0000","last_fullsized":"2024-09-13T19:18:04.347176+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:45.317531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"36'11","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:20.925826+0000","last_change":"2024-09-13T19:16:01.903652+0000","last_active":"2024-09-13T19:17:20.925826+0000","last_peered":"2024-09-13T19:17:20.925826+0000","last_clean":"2024-09-13T19:17:20.925826+0000","last_became_active":"2024-09-13T19:16:01.902739+0000","last_became_peered":"2024-09-13T19:16:01.902739+0000","last_unstale":"2024-09-13T19:17:20.925826+0000","last_undegraded":"2024-09-13T19:17:20.925826+0000","last_fullsized":"2024-09-13T19:17:20.925826+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:51:13.428618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"36'282","reported_seq":417,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.183631+0000","last_change":"2024-09-13T19:16:03.909318+0000","last_active":"2024-09-13T19:19:06.183631+0000","last_peered":"2024-09-13T19:19:06.183631+0000","last_clean":"2024-09-13T19:19:06.183631+0000","last_became_active":"2024-09-13T19:16:03.909038+0000","last_became_peered":"2024-09-13T19:16:03.909038+0000","last_unstale":"2024-09-13T19:19:06.183631+0000","last_undegraded":"2024-09-13T19:19:06.183631+0000","last_fullsized":"2024-09-13T19:19:06.183631+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:32.924238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'3","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.990000+0000","last_change":"2024-09-13T19:16:05.924059+0000","last_active":"2024-09-13T19:16:31.990000+0000","last_peered":"2024-09-13T19:16:31.990000+0000","last_clean":"2024-09-13T19:16:31.990000+0000","last_became_active":"2024-09-13T19:16:05.923739+0000","last_became_peered":"2024-09-13T19:16:05.923739+0000","last_unstale":"2024-09-13T19:16:31.990000+0000","last_undegraded":"2024-09-13T19:16:31.990000+0000","last_fullsized":"2024-09-13T19:16:31.990000+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:49.018736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"36'6","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.962120+0000","last_change":"2024-09-13T19:15:57.897999+0000","last_active":"2024-09-13T19:19:05.962120+0000","last_peered":"2024-09-13T19:19:05.962120+0000","last_clean":"2024-09-13T19:19:05.962120+0000","last_became_active":"2024-09-13T19:15:57.897727+0000","last_became_peered":"2024-09-13T19:15:57.897727+0000","last_unstale":"2024-09-13T19:19:05.962120+0000","last_undegraded":"2024-09-13T19:19:05.962120+0000","last_fullsized":"2024-09-13T19:19:05.962120+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:38.843461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.989964+0000","last_change":"2024-09-13T19:15:55.895727+0000","last_active":"2024-09-13T19:16:31.989964+0000","last_peered":"2024-09-13T19:16:31.989964+0000","last_clean":"2024-09-13T19:16:31.989964+0000","last_became_active":"2024-09-13T19:15:55.895394+0000","last_became_peered":"2024-09-13T19:15:55.895394+0000","last_unstale":"2024-09-13T19:16:31.989964+0000","last_undegraded":"2024-09-13T19:16:31.989964+0000","last_fullsized":"2024-09-13T19:16:31.989964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:06:25.645854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984574+0000","last_change":"2024-09-13T19:15:46.581172+0000","last_active":"2024-09-13T19:16:31.984574+0000","last_peered":"2024-09-13T19:16:31.984574+0000","last_clean":"2024-09-13T19:16:31.984574+0000","last_became_active":"2024-09-13T19:15:44.607248+0000","last_became_peered":"2024-09-13T19:15:44.607248+0000","last_unstale":"2024-09-13T19:16:31.984574+0000","last_undegraded":"2024-09-13T19:16:31.984574+0000","last_fullsized":"2024-09-13T19:16:31.984574+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:09:50.029342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086245899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.994102+0000","last_change":"2024-09-13T19:16:31.993085+0000","last_active":"2024-09-13T19:16:31.994102+0000","last_peered":"2024-09-13T19:16:31.994102+0000","last_clean":"2024-09-13T19:16:31.994102+0000","last_became_active":"2024-09-13T19:16:31.992752+0000","last_became_peered":"2024-09-13T19:16:31.992752+0000","last_unstale":"2024-09-13T19:16:31.994102+0000","last_undegraded":"2024-09-13T19:16:31.994102+0000","last_fullsized":"2024-09-13T19:16:31.994102+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:31:25.664984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"36'84","reported_seq":156,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.154948+0000","last_change":"2024-09-13T19:16:01.906627+0000","last_active":"2024-09-13T19:18:03.154948+0000","last_peered":"2024-09-13T19:18:03.154948+0000","last_clean":"2024-09-13T19:18:03.154948+0000","last_became_active":"2024-09-13T19:16:01.906317+0000","last_became_peered":"2024-09-13T19:16:01.906317+0000","last_unstale":"2024-09-13T19:18:03.154948+0000","last_undegraded":"2024-09-13T19:18:03.154948+0000","last_fullsized":"2024-09-13T19:18:03.154948+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:31.838003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":81,"num_read_kb":82,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984273+0000","last_change":"2024-09-13T19:16:03.910414+0000","last_active":"2024-09-13T19:16:31.984273+0000","last_peered":"2024-09-13T19:16:31.984273+0000","last_clean":"2024-09-13T19:16:31.984273+0000","last_became_active":"2024-09-13T19:16:03.909941+0000","last_became_peered":"2024-09-13T19:16:03.909941+0000","last_unstale":"2024-09-13T19:16:31.984273+0000","last_undegraded":"2024-09-13T19:16:31.984273+0000","last_fullsized":"2024-09-13T19:16:31.984273+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:24.874734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.989013+0000","last_change":"2024-09-13T19:16:05.911849+0000","last_active":"2024-09-13T19:16:31.989013+0000","last_peered":"2024-09-13T19:16:31.989013+0000","last_clean":"2024-09-13T19:16:31.989013+0000","last_became_active":"2024-09-13T19:16:05.911465+0000","last_became_peered":"2024-09-13T19:16:05.911465+0000","last_unstale":"2024-09-13T19:16:31.989013+0000","last_undegraded":"2024-09-13T19:16:31.989013+0000","last_fullsized":"2024-09-13T19:16:31.989013+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:53:28.959608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985196+0000","last_change":"2024-09-13T19:16:05.917443+0000","last_active":"2024-09-13T19:16:31.985196+0000","last_peered":"2024-09-13T19:16:31.985196+0000","last_clean":"2024-09-13T19:16:31.985196+0000","last_became_active":"2024-09-13T19:16:05.917156+0000","last_became_peered":"2024-09-13T19:16:05.917156+0000","last_unstale":"2024-09-13T19:16:31.985196+0000","last_undegraded":"2024-09-13T19:16:31.985196+0000","last_fullsized":"2024-09-13T19:16:31.985196+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:54:47.314314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"36'8","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.700214+0000","last_change":"2024-09-13T19:15:57.899020+0000","last_active":"2024-09-13T19:19:05.700214+0000","last_peered":"2024-09-13T19:19:05.700214+0000","last_clean":"2024-09-13T19:19:05.700214+0000","last_became_active":"2024-09-13T19:15:57.898761+0000","last_became_peered":"2024-09-13T19:15:57.898761+0000","last_unstale":"2024-09-13T19:19:05.700214+0000","last_undegraded":"2024-09-13T19:19:05.700214+0000","last_fullsized":"2024-09-13T19:19:05.700214+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:01:19.857155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.982961+0000","last_change":"2024-09-13T19:15:55.898265+0000","last_active":"2024-09-13T19:16:31.982961+0000","last_peered":"2024-09-13T19:16:31.982961+0000","last_clean":"2024-09-13T19:16:31.982961+0000","last_became_active":"2024-09-13T19:15:55.892518+0000","last_became_peered":"2024-09-13T19:15:55.892518+0000","last_unstale":"2024-09-13T19:16:31.982961+0000","last_undegraded":"2024-09-13T19:16:31.982961+0000","last_fullsized":"2024-09-13T19:16:31.982961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:48.786786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.991243+0000","last_change":"2024-09-13T19:15:59.894006+0000","last_active":"2024-09-13T19:16:31.991243+0000","last_peered":"2024-09-13T19:16:31.991243+0000","last_clean":"2024-09-13T19:16:31.991243+0000","last_became_active":"2024-09-13T19:15:59.892690+0000","last_became_peered":"2024-09-13T19:15:59.892690+0000","last_unstale":"2024-09-13T19:16:31.991243+0000","last_undegraded":"2024-09-13T19:16:31.991243+0000","last_fullsized":"2024-09-13T19:16:31.991243+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:09.953397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"36'33","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:23.943430+0000","last_change":"2024-09-13T19:16:01.904994+0000","last_active":"2024-09-13T19:18:23.943430+0000","last_peered":"2024-09-13T19:18:23.943430+0000","last_clean":"2024-09-13T19:18:23.943430+0000","last_became_active":"2024-09-13T19:16:01.904684+0000","last_became_peered":"2024-09-13T19:16:01.904684+0000","last_unstale":"2024-09-13T19:18:23.943430+0000","last_undegraded":"2024-09-13T19:18:23.943430+0000","last_fullsized":"2024-09-13T19:18:23.943430+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:07.994368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.982387+0000","last_change":"2024-09-13T19:16:03.912531+0000","last_active":"2024-09-13T19:16:31.982387+0000","last_peered":"2024-09-13T19:16:31.982387+0000","last_clean":"2024-09-13T19:16:31.982387+0000","last_became_active":"2024-09-13T19:16:03.912244+0000","last_became_peered":"2024-09-13T19:16:03.912244+0000","last_unstale":"2024-09-13T19:16:31.982387+0000","last_undegraded":"2024-09-13T19:16:31.982387+0000","last_fullsized":"2024-09-13T19:16:31.982387+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:47:14.892797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"36'3","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:02.851990+0000","last_change":"2024-09-13T19:16:05.921280+0000","last_active":"2024-09-13T19:18:02.851990+0000","last_peered":"2024-09-13T19:18:02.851990+0000","last_clean":"2024-09-13T19:18:02.851990+0000","last_became_active":"2024-09-13T19:16:05.920951+0000","last_became_peered":"2024-09-13T19:16:05.920951+0000","last_unstale":"2024-09-13T19:18:02.851990+0000","last_undegraded":"2024-09-13T19:18:02.851990+0000","last_fullsized":"2024-09-13T19:18:02.851990+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:21.035521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"36'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.592256+0000","last_change":"2024-09-13T19:15:57.902138+0000","last_active":"2024-09-13T19:19:05.592256+0000","last_peered":"2024-09-13T19:19:05.592256+0000","last_clean":"2024-09-13T19:19:05.592256+0000","last_became_active":"2024-09-13T19:15:57.901732+0000","last_became_peered":"2024-09-13T19:15:57.901732+0000","last_unstale":"2024-09-13T19:19:05.592256+0000","last_undegraded":"2024-09-13T19:19:05.592256+0000","last_fullsized":"2024-09-13T19:19:05.592256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:23.440843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"36'4","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:38.357818+0000","last_change":"2024-09-13T19:15:55.894585+0000","last_active":"2024-09-13T19:16:38.357818+0000","last_peered":"2024-09-13T19:16:38.357818+0000","last_clean":"2024-09-13T19:16:38.357818+0000","last_became_active":"2024-09-13T19:15:55.894279+0000","last_became_peered":"2024-09-13T19:15:55.894279+0000","last_unstale":"2024-09-13T19:16:38.357818+0000","last_undegraded":"2024-09-13T19:16:38.357818+0000","last_fullsized":"2024-09-13T19:16:38.357818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:37.997344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.982888+0000","last_change":"2024-09-13T19:15:59.895645+0000","last_active":"2024-09-13T19:16:31.982888+0000","last_peered":"2024-09-13T19:16:31.982888+0000","last_clean":"2024-09-13T19:16:31.982888+0000","last_became_active":"2024-09-13T19:15:59.895325+0000","last_became_peered":"2024-09-13T19:15:59.895325+0000","last_unstale":"2024-09-13T19:16:31.982888+0000","last_undegraded":"2024-09-13T19:16:31.982888+0000","last_fullsized":"2024-09-13T19:16:31.982888+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:17.756694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"36'5","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.036888+0000","last_change":"2024-09-13T19:16:01.901632+0000","last_active":"2024-09-13T19:19:05.036888+0000","last_peered":"2024-09-13T19:19:05.036888+0000","last_clean":"2024-09-13T19:19:05.036888+0000","last_became_active":"2024-09-13T19:16:01.901250+0000","last_became_peered":"2024-09-13T19:16:01.901250+0000","last_unstale":"2024-09-13T19:19:05.036888+0000","last_undegraded":"2024-09-13T19:19:05.036888+0000","last_fullsized":"2024-09-13T19:19:05.036888+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:51.022673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984245+0000","last_change":"2024-09-13T19:16:03.913428+0000","last_active":"2024-09-13T19:16:31.984245+0000","last_peered":"2024-09-13T19:16:31.984245+0000","last_clean":"2024-09-13T19:16:31.984245+0000","last_became_active":"2024-09-13T19:16:03.913053+0000","last_became_peered":"2024-09-13T19:16:03.913053+0000","last_unstale":"2024-09-13T19:16:31.984245+0000","last_undegraded":"2024-09-13T19:16:31.984245+0000","last_fullsized":"2024-09-13T19:16:31.984245+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:16.591819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"36'2","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.701436+0000","last_change":"2024-09-13T19:16:05.912786+0000","last_active":"2024-09-13T19:19:05.701436+0000","last_peered":"2024-09-13T19:19:05.701436+0000","last_clean":"2024-09-13T19:19:05.701436+0000","last_became_active":"2024-09-13T19:16:05.912428+0000","last_became_peered":"2024-09-13T19:16:05.912428+0000","last_unstale":"2024-09-13T19:19:05.701436+0000","last_undegraded":"2024-09-13T19:19:05.701436+0000","last_fullsized":"2024-09-13T19:19:05.701436+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:59.991034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"36'7","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.968817+0000","last_change":"2024-09-13T19:15:57.896825+0000","last_active":"2024-09-13T19:19:05.968817+0000","last_peered":"2024-09-13T19:19:05.968817+0000","last_clean":"2024-09-13T19:19:05.968817+0000","last_became_active":"2024-09-13T19:15:57.896463+0000","last_became_peered":"2024-09-13T19:15:57.896463+0000","last_unstale":"2024-09-13T19:19:05.968817+0000","last_undegraded":"2024-09-13T19:19:05.968817+0000","last_fullsized":"2024-09-13T19:19:05.968817+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:26.337812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"36'2","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:37.182663+0000","last_change":"2024-09-13T19:15:55.888440+0000","last_active":"2024-09-13T19:16:37.182663+0000","last_peered":"2024-09-13T19:16:37.182663+0000","last_clean":"2024-09-13T19:16:37.182663+0000","last_became_active":"2024-09-13T19:15:55.888108+0000","last_became_peered":"2024-09-13T19:15:55.888108+0000","last_unstale":"2024-09-13T19:16:37.182663+0000","last_undegraded":"2024-09-13T19:16:37.182663+0000","last_fullsized":"2024-09-13T19:16:37.182663+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:04:11.428321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985263+0000","last_change":"2024-09-13T19:15:59.893154+0000","last_active":"2024-09-13T19:16:31.985263+0000","last_peered":"2024-09-13T19:16:31.985263+0000","last_clean":"2024-09-13T19:16:31.985263+0000","last_became_active":"2024-09-13T19:15:59.892842+0000","last_became_peered":"2024-09-13T19:15:59.892842+0000","last_unstale":"2024-09-13T19:16:31.985263+0000","last_undegraded":"2024-09-13T19:16:31.985263+0000","last_fullsized":"2024-09-13T19:16:31.985263+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:16.726485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"36'41","reported_seq":100,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.224131+0000","last_change":"2024-09-13T19:16:01.903266+0000","last_active":"2024-09-13T19:19:05.224131+0000","last_peered":"2024-09-13T19:19:05.224131+0000","last_clean":"2024-09-13T19:19:05.224131+0000","last_became_active":"2024-09-13T19:16:01.902991+0000","last_became_peered":"2024-09-13T19:16:01.902991+0000","last_unstale":"2024-09-13T19:19:05.224131+0000","last_undegraded":"2024-09-13T19:19:05.224131+0000","last_fullsized":"2024-09-13T19:19:05.224131+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:42.038997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.988447+0000","last_change":"2024-09-13T19:16:03.912257+0000","last_active":"2024-09-13T19:16:31.988447+0000","last_peered":"2024-09-13T19:16:31.988447+0000","last_clean":"2024-09-13T19:16:31.988447+0000","last_became_active":"2024-09-13T19:16:03.911917+0000","last_became_peered":"2024-09-13T19:16:03.911917+0000","last_unstale":"2024-09-13T19:16:31.988447+0000","last_undegraded":"2024-09-13T19:16:31.988447+0000","last_fullsized":"2024-09-13T19:16:31.988447+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:23.564311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"36'4","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:01.380390+0000","last_change":"2024-09-13T19:16:05.924382+0000","last_active":"2024-09-13T19:18:01.380390+0000","last_peered":"2024-09-13T19:18:01.380390+0000","last_clean":"2024-09-13T19:18:01.380390+0000","last_became_active":"2024-09-13T19:16:05.923368+0000","last_became_peered":"2024-09-13T19:16:05.923368+0000","last_unstale":"2024-09-13T19:18:01.380390+0000","last_undegraded":"2024-09-13T19:18:01.380390+0000","last_fullsized":"2024-09-13T19:18:01.380390+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:03.139035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"36'16","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.842276+0000","last_change":"2024-09-13T19:16:31.999453+0000","last_active":"2024-09-13T19:19:05.842276+0000","last_peered":"2024-09-13T19:19:05.842276+0000","last_clean":"2024-09-13T19:19:05.842276+0000","last_became_active":"2024-09-13T19:16:31.991993+0000","last_became_peered":"2024-09-13T19:16:31.991993+0000","last_unstale":"2024-09-13T19:19:05.842276+0000","last_undegraded":"2024-09-13T19:19:05.842276+0000","last_fullsized":"2024-09-13T19:19:05.842276+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:24:47.009062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"36'2","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:37.182603+0000","last_change":"2024-09-13T19:15:55.892008+0000","last_active":"2024-09-13T19:16:37.182603+0000","last_peered":"2024-09-13T19:16:37.182603+0000","last_clean":"2024-09-13T19:16:37.182603+0000","last_became_active":"2024-09-13T19:15:55.891711+0000","last_became_peered":"2024-09-13T19:15:55.891711+0000","last_unstale":"2024-09-13T19:16:37.182603+0000","last_undegraded":"2024-09-13T19:16:37.182603+0000","last_fullsized":"2024-09-13T19:16:37.182603+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:18:40.262875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.981334+0000","last_change":"2024-09-13T19:15:59.891859+0000","last_active":"2024-09-13T19:16:31.981334+0000","last_peered":"2024-09-13T19:16:31.981334+0000","last_clean":"2024-09-13T19:16:31.981334+0000","last_became_active":"2024-09-13T19:15:59.891581+0000","last_became_peered":"2024-09-13T19:15:59.891581+0000","last_unstale":"2024-09-13T19:16:31.981334+0000","last_undegraded":"2024-09-13T19:16:31.981334+0000","last_fullsized":"2024-09-13T19:16:31.981334+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:49:36.858038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"36'30","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.147034+0000","last_change":"2024-09-13T19:16:01.899778+0000","last_active":"2024-09-13T19:18:03.147034+0000","last_peered":"2024-09-13T19:18:03.147034+0000","last_clean":"2024-09-13T19:18:03.147034+0000","last_became_active":"2024-09-13T19:16:01.899438+0000","last_became_peered":"2024-09-13T19:16:01.899438+0000","last_unstale":"2024-09-13T19:18:03.147034+0000","last_undegraded":"2024-09-13T19:18:03.147034+0000","last_fullsized":"2024-09-13T19:18:03.147034+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:39.137471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.986072+0000","last_change":"2024-09-13T19:16:03.910613+0000","last_active":"2024-09-13T19:16:31.986072+0000","last_peered":"2024-09-13T19:16:31.986072+0000","last_clean":"2024-09-13T19:16:31.986072+0000","last_became_active":"2024-09-13T19:16:03.910319+0000","last_became_peered":"2024-09-13T19:16:03.910319+0000","last_unstale":"2024-09-13T19:16:31.986072+0000","last_undegraded":"2024-09-13T19:16:31.986072+0000","last_fullsized":"2024-09-13T19:16:31.986072+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:55:44.357662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"36'10","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.842277+0000","last_change":"2024-09-13T19:15:57.897487+0000","last_active":"2024-09-13T19:19:05.842277+0000","last_peered":"2024-09-13T19:19:05.842277+0000","last_clean":"2024-09-13T19:19:05.842277+0000","last_became_active":"2024-09-13T19:15:57.897232+0000","last_became_peered":"2024-09-13T19:15:57.897232+0000","last_unstale":"2024-09-13T19:19:05.842277+0000","last_undegraded":"2024-09-13T19:19:05.842277+0000","last_fullsized":"2024-09-13T19:19:05.842277+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:57:32.169161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:01.372999+0000","last_change":"2024-09-13T19:15:55.901992+0000","last_active":"2024-09-13T19:18:01.372999+0000","last_peered":"2024-09-13T19:18:01.372999+0000","last_clean":"2024-09-13T19:18:01.372999+0000","last_became_active":"2024-09-13T19:15:55.901257+0000","last_became_peered":"2024-09-13T19:15:55.901257+0000","last_unstale":"2024-09-13T19:18:01.372999+0000","last_undegraded":"2024-09-13T19:18:01.372999+0000","last_fullsized":"2024-09-13T19:18:01.372999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:05:52.991944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.986502+0000","last_change":"2024-09-13T19:15:59.896674+0000","last_active":"2024-09-13T19:16:31.986502+0000","last_peered":"2024-09-13T19:16:31.986502+0000","last_clean":"2024-09-13T19:16:31.986502+0000","last_became_active":"2024-09-13T19:15:59.896339+0000","last_became_peered":"2024-09-13T19:15:59.896339+0000","last_unstale":"2024-09-13T19:16:31.986502+0000","last_undegraded":"2024-09-13T19:16:31.986502+0000","last_fullsized":"2024-09-13T19:16:31.986502+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:25.993976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"36'54","reported_seq":110,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.166975+0000","last_change":"2024-09-13T19:16:01.901418+0000","last_active":"2024-09-13T19:18:03.166975+0000","last_peered":"2024-09-13T19:18:03.166975+0000","last_clean":"2024-09-13T19:18:03.166975+0000","last_became_active":"2024-09-13T19:16:01.901092+0000","last_became_peered":"2024-09-13T19:16:01.901092+0000","last_unstale":"2024-09-13T19:18:03.166975+0000","last_undegraded":"2024-09-13T19:18:03.166975+0000","last_fullsized":"2024-09-13T19:18:03.166975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:39:03.339805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984142+0000","last_change":"2024-09-13T19:16:03.910823+0000","last_active":"2024-09-13T19:16:31.984142+0000","last_peered":"2024-09-13T19:16:31.984142+0000","last_clean":"2024-09-13T19:16:31.984142+0000","last_became_active":"2024-09-13T19:16:03.910305+0000","last_became_peered":"2024-09-13T19:16:03.910305+0000","last_unstale":"2024-09-13T19:16:31.984142+0000","last_undegraded":"2024-09-13T19:16:31.984142+0000","last_fullsized":"2024-09-13T19:16:31.984142+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:34:06.206573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"36'22","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.267841+0000","last_change":"2024-09-13T19:16:05.913081+0000","last_active":"2024-09-13T19:19:05.267841+0000","last_peered":"2024-09-13T19:19:05.267841+0000","last_clean":"2024-09-13T19:19:05.267841+0000","last_became_active":"2024-09-13T19:16:05.912675+0000","last_became_peered":"2024-09-13T19:16:05.912675+0000","last_unstale":"2024-09-13T19:19:05.267841+0000","last_undegraded":"2024-09-13T19:19:05.267841+0000","last_fullsized":"2024-09-13T19:19:05.267841+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:51:50.650591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"36'6","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:20.923362+0000","last_change":"2024-09-13T19:15:57.890233+0000","last_active":"2024-09-13T19:17:20.923362+0000","last_peered":"2024-09-13T19:17:20.923362+0000","last_clean":"2024-09-13T19:17:20.923362+0000","last_became_active":"2024-09-13T19:15:57.889921+0000","last_became_peered":"2024-09-13T19:15:57.889921+0000","last_unstale":"2024-09-13T19:17:20.923362+0000","last_undegraded":"2024-09-13T19:17:20.923362+0000","last_fullsized":"2024-09-13T19:17:20.923362+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:45.927205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.989729+0000","last_change":"2024-09-13T19:15:55.895671+0000","last_active":"2024-09-13T19:16:31.989729+0000","last_peered":"2024-09-13T19:16:31.989729+0000","last_clean":"2024-09-13T19:16:31.989729+0000","last_became_active":"2024-09-13T19:15:55.895344+0000","last_became_peered":"2024-09-13T19:15:55.895344+0000","last_unstale":"2024-09-13T19:16:31.989729+0000","last_undegraded":"2024-09-13T19:16:31.989729+0000","last_fullsized":"2024-09-13T19:16:31.989729+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:21.381003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.986359+0000","last_change":"2024-09-13T19:15:59.888500+0000","last_active":"2024-09-13T19:16:31.986359+0000","last_peered":"2024-09-13T19:16:31.986359+0000","last_clean":"2024-09-13T19:16:31.986359+0000","last_became_active":"2024-09-13T19:15:59.888213+0000","last_became_peered":"2024-09-13T19:15:59.888213+0000","last_unstale":"2024-09-13T19:16:31.986359+0000","last_undegraded":"2024-09-13T19:16:31.986359+0000","last_fullsized":"2024-09-13T19:16:31.986359+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:46.856761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"36'36","reported_seq":81,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.148094+0000","last_change":"2024-09-13T19:16:01.908414+0000","last_active":"2024-09-13T19:18:03.148094+0000","last_peered":"2024-09-13T19:18:03.148094+0000","last_clean":"2024-09-13T19:18:03.148094+0000","last_became_active":"2024-09-13T19:16:01.908116+0000","last_became_peered":"2024-09-13T19:16:01.908116+0000","last_unstale":"2024-09-13T19:18:03.148094+0000","last_undegraded":"2024-09-13T19:18:03.148094+0000","last_fullsized":"2024-09-13T19:18:03.148094+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:09.064613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.989465+0000","last_change":"2024-09-13T19:16:03.914462+0000","last_active":"2024-09-13T19:16:31.989465+0000","last_peered":"2024-09-13T19:16:31.989465+0000","last_clean":"2024-09-13T19:16:31.989465+0000","last_became_active":"2024-09-13T19:16:03.914179+0000","last_became_peered":"2024-09-13T19:16:03.914179+0000","last_unstale":"2024-09-13T19:16:31.989465+0000","last_undegraded":"2024-09-13T19:16:31.989465+0000","last_fullsized":"2024-09-13T19:16:31.989465+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:53:26.952246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"34'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.981447+0000","last_change":"2024-09-13T19:16:05.917077+0000","last_active":"2024-09-13T19:16:31.981447+0000","last_peered":"2024-09-13T19:16:31.981447+0000","last_clean":"2024-09-13T19:16:31.981447+0000","last_became_active":"2024-09-13T19:16:05.916822+0000","last_became_peered":"2024-09-13T19:16:05.916822+0000","last_unstale":"2024-09-13T19:16:31.981447+0000","last_undegraded":"2024-09-13T19:16:31.981447+0000","last_fullsized":"2024-09-13T19:16:31.981447+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:48.822908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"36'22","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.922897+0000","last_change":"2024-09-13T19:15:57.902395+0000","last_active":"2024-09-13T19:19:05.922897+0000","last_peered":"2024-09-13T19:19:05.922897+0000","last_clean":"2024-09-13T19:19:05.922897+0000","last_became_active":"2024-09-13T19:15:57.901330+0000","last_became_peered":"2024-09-13T19:15:57.901330+0000","last_unstale":"2024-09-13T19:19:05.922897+0000","last_undegraded":"2024-09-13T19:19:05.922897+0000","last_fullsized":"2024-09-13T19:19:05.922897+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:28.096605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":60,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.988565+0000","last_change":"2024-09-13T19:15:55.896540+0000","last_active":"2024-09-13T19:16:31.988565+0000","last_peered":"2024-09-13T19:16:31.988565+0000","last_clean":"2024-09-13T19:16:31.988565+0000","last_became_active":"2024-09-13T19:15:55.896196+0000","last_became_peered":"2024-09-13T19:15:55.896196+0000","last_unstale":"2024-09-13T19:16:31.988565+0000","last_undegraded":"2024-09-13T19:16:31.988565+0000","last_fullsized":"2024-09-13T19:16:31.988565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:14:40.566289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984960+0000","last_change":"2024-09-13T19:15:59.891464+0000","last_active":"2024-09-13T19:16:31.984960+0000","last_peered":"2024-09-13T19:16:31.984960+0000","last_clean":"2024-09-13T19:16:31.984960+0000","last_became_active":"2024-09-13T19:15:59.891131+0000","last_became_peered":"2024-09-13T19:15:59.891131+0000","last_unstale":"2024-09-13T19:16:31.984960+0000","last_undegraded":"2024-09-13T19:16:31.984960+0000","last_fullsized":"2024-09-13T19:16:31.984960+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:17.195737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"36'32","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.165035+0000","last_change":"2024-09-13T19:16:01.902629+0000","last_active":"2024-09-13T19:18:03.165035+0000","last_peered":"2024-09-13T19:18:03.165035+0000","last_clean":"2024-09-13T19:18:03.165035+0000","last_became_active":"2024-09-13T19:16:01.902251+0000","last_became_peered":"2024-09-13T19:16:01.902251+0000","last_unstale":"2024-09-13T19:18:03.165035+0000","last_undegraded":"2024-09-13T19:18:03.165035+0000","last_fullsized":"2024-09-13T19:18:03.165035+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:41.211074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985247+0000","last_change":"2024-09-13T19:16:03.915520+0000","last_active":"2024-09-13T19:16:31.985247+0000","last_peered":"2024-09-13T19:16:31.985247+0000","last_clean":"2024-09-13T19:16:31.985247+0000","last_became_active":"2024-09-13T19:16:03.915225+0000","last_became_peered":"2024-09-13T19:16:03.915225+0000","last_unstale":"2024-09-13T19:16:31.985247+0000","last_undegraded":"2024-09-13T19:16:31.985247+0000","last_fullsized":"2024-09-13T19:16:31.985247+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:09:47.134188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"36'5","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:05.007010+0000","last_change":"2024-09-13T19:16:05.925066+0000","last_active":"2024-09-13T19:18:05.007010+0000","last_peered":"2024-09-13T19:18:05.007010+0000","last_clean":"2024-09-13T19:18:05.007010+0000","last_became_active":"2024-09-13T19:16:05.923235+0000","last_became_peered":"2024-09-13T19:16:05.923235+0000","last_unstale":"2024-09-13T19:18:05.007010+0000","last_undegraded":"2024-09-13T19:18:05.007010+0000","last_fullsized":"2024-09-13T19:18:05.007010+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:34:27.801710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"36'8","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.920257+0000","last_change":"2024-09-13T19:15:57.886598+0000","last_active":"2024-09-13T19:19:05.920257+0000","last_peered":"2024-09-13T19:19:05.920257+0000","last_clean":"2024-09-13T19:19:05.920257+0000","last_became_active":"2024-09-13T19:15:57.886263+0000","last_became_peered":"2024-09-13T19:15:57.886263+0000","last_unstale":"2024-09-13T19:19:05.920257+0000","last_undegraded":"2024-09-13T19:19:05.920257+0000","last_fullsized":"2024-09-13T19:19:05.920257+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:45:55.706532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.982036+0000","last_change":"2024-09-13T19:15:55.894466+0000","last_active":"2024-09-13T19:16:31.982036+0000","last_peered":"2024-09-13T19:16:31.982036+0000","last_clean":"2024-09-13T19:16:31.982036+0000","last_became_active":"2024-09-13T19:15:55.893629+0000","last_became_peered":"2024-09-13T19:15:55.893629+0000","last_unstale":"2024-09-13T19:16:31.982036+0000","last_undegraded":"2024-09-13T19:16:31.982036+0000","last_fullsized":"2024-09-13T19:16:31.982036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:23.425081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.991439+0000","last_change":"2024-09-13T19:15:59.892732+0000","last_active":"2024-09-13T19:16:31.991439+0000","last_peered":"2024-09-13T19:16:31.991439+0000","last_clean":"2024-09-13T19:16:31.991439+0000","last_became_active":"2024-09-13T19:15:59.892445+0000","last_became_peered":"2024-09-13T19:15:59.892445+0000","last_unstale":"2024-09-13T19:16:31.991439+0000","last_undegraded":"2024-09-13T19:16:31.991439+0000","last_fullsized":"2024-09-13T19:16:31.991439+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:13.561243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'11","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.983279+0000","last_change":"2024-09-13T19:16:01.906065+0000","last_active":"2024-09-13T19:16:31.983279+0000","last_peered":"2024-09-13T19:16:31.983279+0000","last_clean":"2024-09-13T19:16:31.983279+0000","last_became_active":"2024-09-13T19:16:01.905553+0000","last_became_peered":"2024-09-13T19:16:01.905553+0000","last_unstale":"2024-09-13T19:16:31.983279+0000","last_undegraded":"2024-09-13T19:16:31.983279+0000","last_fullsized":"2024-09-13T19:16:31.983279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:31.722728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"36'282","reported_seq":366,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:04.973463+0000","last_change":"2024-09-13T19:16:03.913513+0000","last_active":"2024-09-13T19:19:04.973463+0000","last_peered":"2024-09-13T19:19:04.973463+0000","last_clean":"2024-09-13T19:19:04.973463+0000","last_became_active":"2024-09-13T19:16:03.913170+0000","last_became_peered":"2024-09-13T19:16:03.913170+0000","last_unstale":"2024-09-13T19:19:04.973463+0000","last_undegraded":"2024-09-13T19:19:04.973463+0000","last_fullsized":"2024-09-13T19:19:04.973463+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:38.207076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"36'4","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.925551+0000","last_change":"2024-09-13T19:16:05.920004+0000","last_active":"2024-09-13T19:19:05.925551+0000","last_peered":"2024-09-13T19:19:05.925551+0000","last_clean":"2024-09-13T19:19:05.925551+0000","last_became_active":"2024-09-13T19:16:05.918050+0000","last_became_peered":"2024-09-13T19:16:05.918050+0000","last_unstale":"2024-09-13T19:19:05.925551+0000","last_undegraded":"2024-09-13T19:19:05.925551+0000","last_fullsized":"2024-09-13T19:19:05.925551+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:16.813767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"36'9","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.601503+0000","last_change":"2024-09-13T19:15:57.885999+0000","last_active":"2024-09-13T19:19:05.601503+0000","last_peered":"2024-09-13T19:19:05.601503+0000","last_clean":"2024-09-13T19:19:05.601503+0000","last_became_active":"2024-09-13T19:15:57.885711+0000","last_became_peered":"2024-09-13T19:15:57.885711+0000","last_unstale":"2024-09-13T19:19:05.601503+0000","last_undegraded":"2024-09-13T19:19:05.601503+0000","last_fullsized":"2024-09-13T19:19:05.601503+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:08:12.322988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.827523+0000","last_change":"2024-09-13T19:15:55.891066+0000","last_active":"2024-09-13T19:19:05.827523+0000","last_peered":"2024-09-13T19:19:05.827523+0000","last_clean":"2024-09-13T19:19:05.827523+0000","last_became_active":"2024-09-13T19:15:55.890670+0000","last_became_peered":"2024-09-13T19:15:55.890670+0000","last_unstale":"2024-09-13T19:19:05.827523+0000","last_undegraded":"2024-09-13T19:19:05.827523+0000","last_fullsized":"2024-09-13T19:19:05.827523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:05:45.706743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.989358+0000","last_change":"2024-09-13T19:15:59.894250+0000","last_active":"2024-09-13T19:16:31.989358+0000","last_peered":"2024-09-13T19:16:31.989358+0000","last_clean":"2024-09-13T19:16:31.989358+0000","last_became_active":"2024-09-13T19:15:59.893905+0000","last_became_peered":"2024-09-13T19:15:59.893905+0000","last_unstale":"2024-09-13T19:16:31.989358+0000","last_undegraded":"2024-09-13T19:16:31.989358+0000","last_fullsized":"2024-09-13T19:16:31.989358+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:47.786088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"36'37","reported_seq":82,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:28.943545+0000","last_change":"2024-09-13T19:16:01.903680+0000","last_active":"2024-09-13T19:18:28.943545+0000","last_peered":"2024-09-13T19:18:28.943545+0000","last_clean":"2024-09-13T19:18:28.943545+0000","last_became_active":"2024-09-13T19:16:01.903395+0000","last_became_peered":"2024-09-13T19:16:01.903395+0000","last_unstale":"2024-09-13T19:18:28.943545+0000","last_undegraded":"2024-09-13T19:18:28.943545+0000","last_fullsized":"2024-09-13T19:18:28.943545+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:36.199224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.982986+0000","last_change":"2024-09-13T19:16:03.911108+0000","last_active":"2024-09-13T19:16:31.982986+0000","last_peered":"2024-09-13T19:16:31.982986+0000","last_clean":"2024-09-13T19:16:31.982986+0000","last_became_active":"2024-09-13T19:16:03.910550+0000","last_became_peered":"2024-09-13T19:16:03.910550+0000","last_unstale":"2024-09-13T19:16:31.982986+0000","last_undegraded":"2024-09-13T19:16:31.982986+0000","last_fullsized":"2024-09-13T19:16:31.982986+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:40.236729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"36'2","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.066047+0000","last_change":"2024-09-13T19:16:05.913865+0000","last_active":"2024-09-13T19:19:06.066047+0000","last_peered":"2024-09-13T19:19:06.066047+0000","last_clean":"2024-09-13T19:19:06.066047+0000","last_became_active":"2024-09-13T19:16:05.913598+0000","last_became_peered":"2024-09-13T19:16:05.913598+0000","last_unstale":"2024-09-13T19:19:06.066047+0000","last_undegraded":"2024-09-13T19:19:06.066047+0000","last_fullsized":"2024-09-13T19:19:06.066047+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:52:26.855754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985584+0000","last_change":"2024-09-13T19:15:57.884460+0000","last_active":"2024-09-13T19:16:31.985584+0000","last_peered":"2024-09-13T19:16:31.985584+0000","last_clean":"2024-09-13T19:16:31.985584+0000","last_became_active":"2024-09-13T19:15:57.883463+0000","last_became_peered":"2024-09-13T19:15:57.883463+0000","last_unstale":"2024-09-13T19:16:31.985584+0000","last_undegraded":"2024-09-13T19:16:31.985584+0000","last_fullsized":"2024-09-13T19:16:31.985584+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:25.431664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985018+0000","last_change":"2024-09-13T19:15:55.900188+0000","last_active":"2024-09-13T19:16:31.985018+0000","last_peered":"2024-09-13T19:16:31.985018+0000","last_clean":"2024-09-13T19:16:31.985018+0000","last_became_active":"2024-09-13T19:15:55.899847+0000","last_became_peered":"2024-09-13T19:15:55.899847+0000","last_unstale":"2024-09-13T19:16:31.985018+0000","last_undegraded":"2024-09-13T19:16:31.985018+0000","last_fullsized":"2024-09-13T19:16:31.985018+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:58.468375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.988573+0000","last_change":"2024-09-13T19:15:59.895828+0000","last_active":"2024-09-13T19:16:31.988573+0000","last_peered":"2024-09-13T19:16:31.988573+0000","last_clean":"2024-09-13T19:16:31.988573+0000","last_became_active":"2024-09-13T19:15:59.895512+0000","last_became_peered":"2024-09-13T19:15:59.895512+0000","last_unstale":"2024-09-13T19:16:31.988573+0000","last_undegraded":"2024-09-13T19:16:31.988573+0000","last_fullsized":"2024-09-13T19:16:31.988573+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:25.447228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"36'30","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.139542+0000","last_change":"2024-09-13T19:16:01.902662+0000","last_active":"2024-09-13T19:18:03.139542+0000","last_peered":"2024-09-13T19:18:03.139542+0000","last_clean":"2024-09-13T19:18:03.139542+0000","last_became_active":"2024-09-13T19:16:01.902285+0000","last_became_peered":"2024-09-13T19:16:01.902285+0000","last_unstale":"2024-09-13T19:18:03.139542+0000","last_undegraded":"2024-09-13T19:18:03.139542+0000","last_fullsized":"2024-09-13T19:18:03.139542+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:09:04.500386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.981123+0000","last_change":"2024-09-13T19:16:03.911855+0000","last_active":"2024-09-13T19:16:31.981123+0000","last_peered":"2024-09-13T19:16:31.981123+0000","last_clean":"2024-09-13T19:16:31.981123+0000","last_became_active":"2024-09-13T19:16:03.911587+0000","last_became_peered":"2024-09-13T19:16:03.911587+0000","last_unstale":"2024-09-13T19:16:31.981123+0000","last_undegraded":"2024-09-13T19:16:31.981123+0000","last_fullsized":"2024-09-13T19:16:31.981123+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:01.426149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.982828+0000","last_change":"2024-09-13T19:16:05.923352+0000","last_active":"2024-09-13T19:16:31.982828+0000","last_peered":"2024-09-13T19:16:31.982828+0000","last_clean":"2024-09-13T19:16:31.982828+0000","last_became_active":"2024-09-13T19:16:05.923014+0000","last_became_peered":"2024-09-13T19:16:05.923014+0000","last_unstale":"2024-09-13T19:16:31.982828+0000","last_undegraded":"2024-09-13T19:16:31.982828+0000","last_fullsized":"2024-09-13T19:16:31.982828+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:13:48.786297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"36'4","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:20.738989+0000","last_change":"2024-09-13T19:15:57.896578+0000","last_active":"2024-09-13T19:17:20.738989+0000","last_peered":"2024-09-13T19:17:20.738989+0000","last_clean":"2024-09-13T19:17:20.738989+0000","last_became_active":"2024-09-13T19:15:57.896310+0000","last_became_peered":"2024-09-13T19:15:57.896310+0000","last_unstale":"2024-09-13T19:17:20.738989+0000","last_undegraded":"2024-09-13T19:17:20.738989+0000","last_fullsized":"2024-09-13T19:17:20.738989+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:34:00.185743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985981+0000","last_change":"2024-09-13T19:15:55.895484+0000","last_active":"2024-09-13T19:16:31.985981+0000","last_peered":"2024-09-13T19:16:31.985981+0000","last_clean":"2024-09-13T19:16:31.985981+0000","last_became_active":"2024-09-13T19:15:55.893600+0000","last_became_peered":"2024-09-13T19:15:55.893600+0000","last_unstale":"2024-09-13T19:16:31.985981+0000","last_undegraded":"2024-09-13T19:16:31.985981+0000","last_fullsized":"2024-09-13T19:16:31.985981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:48.542373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.990846+0000","last_change":"2024-09-13T19:15:59.896873+0000","last_active":"2024-09-13T19:16:31.990846+0000","last_peered":"2024-09-13T19:16:31.990846+0000","last_clean":"2024-09-13T19:16:31.990846+0000","last_became_active":"2024-09-13T19:15:59.896518+0000","last_became_peered":"2024-09-13T19:15:59.896518+0000","last_unstale":"2024-09-13T19:16:31.990846+0000","last_undegraded":"2024-09-13T19:16:31.990846+0000","last_fullsized":"2024-09-13T19:16:31.990846+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:12.206811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"36'26","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.162759+0000","last_change":"2024-09-13T19:16:01.903010+0000","last_active":"2024-09-13T19:18:03.162759+0000","last_peered":"2024-09-13T19:18:03.162759+0000","last_clean":"2024-09-13T19:18:03.162759+0000","last_became_active":"2024-09-13T19:16:01.902699+0000","last_became_peered":"2024-09-13T19:16:01.902699+0000","last_unstale":"2024-09-13T19:18:03.162759+0000","last_undegraded":"2024-09-13T19:18:03.162759+0000","last_fullsized":"2024-09-13T19:18:03.162759+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:52.846038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.981606+0000","last_change":"2024-09-13T19:16:03.913624+0000","last_active":"2024-09-13T19:16:31.981606+0000","last_peered":"2024-09-13T19:16:31.981606+0000","last_clean":"2024-09-13T19:16:31.981606+0000","last_became_active":"2024-09-13T19:16:03.913228+0000","last_became_peered":"2024-09-13T19:16:03.913228+0000","last_unstale":"2024-09-13T19:16:31.981606+0000","last_undegraded":"2024-09-13T19:16:31.981606+0000","last_fullsized":"2024-09-13T19:16:31.981606+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:44:11.841765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"36'4","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.172465+0000","last_change":"2024-09-13T19:16:05.925781+0000","last_active":"2024-09-13T19:18:03.172465+0000","last_peered":"2024-09-13T19:18:03.172465+0000","last_clean":"2024-09-13T19:18:03.172465+0000","last_became_active":"2024-09-13T19:16:05.925519+0000","last_became_peered":"2024-09-13T19:16:05.925519+0000","last_unstale":"2024-09-13T19:18:03.172465+0000","last_undegraded":"2024-09-13T19:18:03.172465+0000","last_fullsized":"2024-09-13T19:18:03.172465+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:36.528746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"36'5","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.930007+0000","last_change":"2024-09-13T19:15:57.886387+0000","last_active":"2024-09-13T19:19:05.930007+0000","last_peered":"2024-09-13T19:19:05.930007+0000","last_clean":"2024-09-13T19:19:05.930007+0000","last_became_active":"2024-09-13T19:15:57.885993+0000","last_became_peered":"2024-09-13T19:15:57.885993+0000","last_unstale":"2024-09-13T19:19:05.930007+0000","last_undegraded":"2024-09-13T19:19:05.930007+0000","last_fullsized":"2024-09-13T19:19:05.930007+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:07.087101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.990648+0000","last_change":"2024-09-13T19:15:55.895882+0000","last_active":"2024-09-13T19:16:31.990648+0000","last_peered":"2024-09-13T19:16:31.990648+0000","last_clean":"2024-09-13T19:16:31.990648+0000","last_became_active":"2024-09-13T19:15:55.895040+0000","last_became_peered":"2024-09-13T19:15:55.895040+0000","last_unstale":"2024-09-13T19:16:31.990648+0000","last_undegraded":"2024-09-13T19:16:31.990648+0000","last_fullsized":"2024-09-13T19:16:31.990648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:24.740012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"36'2","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:01.747242+0000","last_change":"2024-09-13T19:15:59.897872+0000","last_active":"2024-09-13T19:18:01.747242+0000","last_peered":"2024-09-13T19:18:01.747242+0000","last_clean":"2024-09-13T19:18:01.747242+0000","last_became_active":"2024-09-13T19:15:59.897609+0000","last_became_peered":"2024-09-13T19:15:59.897609+0000","last_unstale":"2024-09-13T19:18:01.747242+0000","last_undegraded":"2024-09-13T19:18:01.747242+0000","last_fullsized":"2024-09-13T19:18:01.747242+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:51.446526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"36'33","reported_seq":77,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.037728+0000","last_change":"2024-09-13T19:16:01.902324+0000","last_active":"2024-09-13T19:19:05.037728+0000","last_peered":"2024-09-13T19:19:05.037728+0000","last_clean":"2024-09-13T19:19:05.037728+0000","last_became_active":"2024-09-13T19:16:01.902042+0000","last_became_peered":"2024-09-13T19:16:01.902042+0000","last_unstale":"2024-09-13T19:19:05.037728+0000","last_undegraded":"2024-09-13T19:19:05.037728+0000","last_fullsized":"2024-09-13T19:19:05.037728+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:30:13.522406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984100+0000","last_change":"2024-09-13T19:16:03.911392+0000","last_active":"2024-09-13T19:16:31.984100+0000","last_peered":"2024-09-13T19:16:31.984100+0000","last_clean":"2024-09-13T19:16:31.984100+0000","last_became_active":"2024-09-13T19:16:03.911052+0000","last_became_peered":"2024-09-13T19:16:03.911052+0000","last_unstale":"2024-09-13T19:16:31.984100+0000","last_undegraded":"2024-09-13T19:16:31.984100+0000","last_fullsized":"2024-09-13T19:16:31.984100+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:04.781550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"36'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.174978+0000","last_change":"2024-09-13T19:16:05.924212+0000","last_active":"2024-09-13T19:18:03.174978+0000","last_peered":"2024-09-13T19:18:03.174978+0000","last_clean":"2024-09-13T19:18:03.174978+0000","last_became_active":"2024-09-13T19:16:05.922822+0000","last_became_peered":"2024-09-13T19:16:05.922822+0000","last_unstale":"2024-09-13T19:18:03.174978+0000","last_undegraded":"2024-09-13T19:18:03.174978+0000","last_fullsized":"2024-09-13T19:18:03.174978+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:17:25.804534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"36'1","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:08.940484+0000","last_change":"2024-09-13T19:15:57.903389+0000","last_active":"2024-09-13T19:18:08.940484+0000","last_peered":"2024-09-13T19:18:08.940484+0000","last_clean":"2024-09-13T19:18:08.940484+0000","last_became_active":"2024-09-13T19:15:57.902883+0000","last_became_peered":"2024-09-13T19:15:57.902883+0000","last_unstale":"2024-09-13T19:18:08.940484+0000","last_undegraded":"2024-09-13T19:18:08.940484+0000","last_fullsized":"2024-09-13T19:18:08.940484+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:01:22.545027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.957154+0000","last_change":"2024-09-13T19:15:55.899096+0000","last_active":"2024-09-13T19:19:05.957154+0000","last_peered":"2024-09-13T19:19:05.957154+0000","last_clean":"2024-09-13T19:19:05.957154+0000","last_became_active":"2024-09-13T19:15:55.898653+0000","last_became_peered":"2024-09-13T19:15:55.898653+0000","last_unstale":"2024-09-13T19:19:05.957154+0000","last_undegraded":"2024-09-13T19:19:05.957154+0000","last_fullsized":"2024-09-13T19:19:05.957154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:40.072036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"36'8","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.696064+0000","last_change":"2024-09-13T19:15:57.886714+0000","last_active":"2024-09-13T19:19:05.696064+0000","last_peered":"2024-09-13T19:19:05.696064+0000","last_clean":"2024-09-13T19:19:05.696064+0000","last_became_active":"2024-09-13T19:15:57.886330+0000","last_became_peered":"2024-09-13T19:15:57.886330+0000","last_unstale":"2024-09-13T19:19:05.696064+0000","last_undegraded":"2024-09-13T19:19:05.696064+0000","last_fullsized":"2024-09-13T19:19:05.696064+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:30.441032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:04.951690+0000","last_change":"2024-09-13T19:15:55.891290+0000","last_active":"2024-09-13T19:18:04.951690+0000","last_peered":"2024-09-13T19:18:04.951690+0000","last_clean":"2024-09-13T19:18:04.951690+0000","last_became_active":"2024-09-13T19:15:55.890821+0000","last_became_peered":"2024-09-13T19:15:55.890821+0000","last_unstale":"2024-09-13T19:18:04.951690+0000","last_undegraded":"2024-09-13T19:18:04.951690+0000","last_fullsized":"2024-09-13T19:18:04.951690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:08:38.168335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"36'2","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:38.101539+0000","last_change":"2024-09-13T19:15:57.898663+0000","last_active":"2024-09-13T19:16:38.101539+0000","last_peered":"2024-09-13T19:16:38.101539+0000","last_clean":"2024-09-13T19:16:38.101539+0000","last_became_active":"2024-09-13T19:15:57.898295+0000","last_became_peered":"2024-09-13T19:15:57.898295+0000","last_unstale":"2024-09-13T19:16:38.101539+0000","last_undegraded":"2024-09-13T19:16:38.101539+0000","last_fullsized":"2024-09-13T19:16:38.101539+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:31:39.968554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.981947+0000","last_change":"2024-09-13T19:15:55.893929+0000","last_active":"2024-09-13T19:16:31.981947+0000","last_peered":"2024-09-13T19:16:31.981947+0000","last_clean":"2024-09-13T19:16:31.981947+0000","last_became_active":"2024-09-13T19:15:55.893191+0000","last_became_peered":"2024-09-13T19:15:55.893191+0000","last_unstale":"2024-09-13T19:16:31.981947+0000","last_undegraded":"2024-09-13T19:16:31.981947+0000","last_fullsized":"2024-09-13T19:16:31.981947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:27.683071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"36'6","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:01.383171+0000","last_change":"2024-09-13T19:15:57.887458+0000","last_active":"2024-09-13T19:18:01.383171+0000","last_peered":"2024-09-13T19:18:01.383171+0000","last_clean":"2024-09-13T19:18:01.383171+0000","last_became_active":"2024-09-13T19:15:57.886670+0000","last_became_peered":"2024-09-13T19:15:57.886670+0000","last_unstale":"2024-09-13T19:18:01.383171+0000","last_undegraded":"2024-09-13T19:18:01.383171+0000","last_fullsized":"2024-09-13T19:18:01.383171+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:59:56.951236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984646+0000","last_change":"2024-09-13T19:15:55.894421+0000","last_active":"2024-09-13T19:16:31.984646+0000","last_peered":"2024-09-13T19:16:31.984646+0000","last_clean":"2024-09-13T19:16:31.984646+0000","last_became_active":"2024-09-13T19:15:55.893569+0000","last_became_peered":"2024-09-13T19:15:55.893569+0000","last_unstale":"2024-09-13T19:16:31.984646+0000","last_undegraded":"2024-09-13T19:16:31.984646+0000","last_fullsized":"2024-09-13T19:16:31.984646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:12.839590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"36'6","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:20.923363+0000","last_change":"2024-09-13T19:15:57.896837+0000","last_active":"2024-09-13T19:17:20.923363+0000","last_peered":"2024-09-13T19:17:20.923363+0000","last_clean":"2024-09-13T19:17:20.923363+0000","last_became_active":"2024-09-13T19:15:57.896487+0000","last_became_peered":"2024-09-13T19:15:57.896487+0000","last_unstale":"2024-09-13T19:17:20.923363+0000","last_undegraded":"2024-09-13T19:17:20.923363+0000","last_fullsized":"2024-09-13T19:17:20.923363+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:50:35.823934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985084+0000","last_change":"2024-09-13T19:15:55.892917+0000","last_active":"2024-09-13T19:16:31.985084+0000","last_peered":"2024-09-13T19:16:31.985084+0000","last_clean":"2024-09-13T19:16:31.985084+0000","last_became_active":"2024-09-13T19:15:55.892026+0000","last_became_peered":"2024-09-13T19:15:55.892026+0000","last_unstale":"2024-09-13T19:16:31.985084+0000","last_undegraded":"2024-09-13T19:16:31.985084+0000","last_fullsized":"2024-09-13T19:16:31.985084+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:35.843439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"36'16","reported_seq":79,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.968515+0000","last_change":"2024-09-13T19:15:57.903134+0000","last_active":"2024-09-13T19:19:05.968515+0000","last_peered":"2024-09-13T19:19:05.968515+0000","last_clean":"2024-09-13T19:19:05.968515+0000","last_became_active":"2024-09-13T19:15:57.902841+0000","last_became_peered":"2024-09-13T19:15:57.902841+0000","last_unstale":"2024-09-13T19:19:05.968515+0000","last_undegraded":"2024-09-13T19:19:05.968515+0000","last_fullsized":"2024-09-13T19:19:05.968515+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:28:00.527551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":56,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"36'2","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:37.182812+0000","last_change":"2024-09-13T19:15:55.897004+0000","last_active":"2024-09-13T19:16:37.182812+0000","last_peered":"2024-09-13T19:16:37.182812+0000","last_clean":"2024-09-13T19:16:37.182812+0000","last_became_active":"2024-09-13T19:15:55.896490+0000","last_became_peered":"2024-09-13T19:15:55.896490+0000","last_unstale":"2024-09-13T19:16:37.182812+0000","last_undegraded":"2024-09-13T19:16:37.182812+0000","last_fullsized":"2024-09-13T19:16:37.182812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:37.997344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"36'6","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.842512+0000","last_change":"2024-09-13T19:15:57.888143+0000","last_active":"2024-09-13T19:19:05.842512+0000","last_peered":"2024-09-13T19:19:05.842512+0000","last_clean":"2024-09-13T19:19:05.842512+0000","last_became_active":"2024-09-13T19:15:57.887810+0000","last_became_peered":"2024-09-13T19:15:57.887810+0000","last_unstale":"2024-09-13T19:19:05.842512+0000","last_undegraded":"2024-09-13T19:19:05.842512+0000","last_fullsized":"2024-09-13T19:19:05.842512+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:32.469582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.989052+0000","last_change":"2024-09-13T19:15:55.892243+0000","last_active":"2024-09-13T19:16:31.989052+0000","last_peered":"2024-09-13T19:16:31.989052+0000","last_clean":"2024-09-13T19:16:31.989052+0000","last_became_active":"2024-09-13T19:15:55.891422+0000","last_became_peered":"2024-09-13T19:15:55.891422+0000","last_unstale":"2024-09-13T19:16:31.989052+0000","last_undegraded":"2024-09-13T19:16:31.989052+0000","last_fullsized":"2024-09-13T19:16:31.989052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:02.236650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"36'2","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.696175+0000","last_change":"2024-09-13T19:15:57.891037+0000","last_active":"2024-09-13T19:19:05.696175+0000","last_peered":"2024-09-13T19:19:05.696175+0000","last_clean":"2024-09-13T19:19:05.696175+0000","last_became_active":"2024-09-13T19:15:57.890491+0000","last_became_peered":"2024-09-13T19:15:57.890491+0000","last_unstale":"2024-09-13T19:19:05.696175+0000","last_undegraded":"2024-09-13T19:19:05.696175+0000","last_fullsized":"2024-09-13T19:19:05.696175+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:31:09.005785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"36'3","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:06.935961+0000","last_change":"2024-09-13T19:15:55.892364+0000","last_active":"2024-09-13T19:18:06.935961+0000","last_peered":"2024-09-13T19:18:06.935961+0000","last_clean":"2024-09-13T19:18:06.935961+0000","last_became_active":"2024-09-13T19:15:55.891860+0000","last_became_peered":"2024-09-13T19:15:55.891860+0000","last_unstale":"2024-09-13T19:18:06.935961+0000","last_undegraded":"2024-09-13T19:18:06.935961+0000","last_fullsized":"2024-09-13T19:18:06.935961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:50.200323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"36'6","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.842250+0000","last_change":"2024-09-13T19:15:57.892359+0000","last_active":"2024-09-13T19:19:05.842250+0000","last_peered":"2024-09-13T19:19:05.842250+0000","last_clean":"2024-09-13T19:19:05.842250+0000","last_became_active":"2024-09-13T19:15:57.892073+0000","last_became_peered":"2024-09-13T19:15:57.892073+0000","last_unstale":"2024-09-13T19:19:05.842250+0000","last_undegraded":"2024-09-13T19:19:05.842250+0000","last_fullsized":"2024-09-13T19:19:05.842250+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:35.680347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"36'3","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.546064+0000","last_change":"2024-09-13T19:15:55.897908+0000","last_active":"2024-09-13T19:19:05.546064+0000","last_peered":"2024-09-13T19:19:05.546064+0000","last_clean":"2024-09-13T19:19:05.546064+0000","last_became_active":"2024-09-13T19:15:55.895911+0000","last_became_peered":"2024-09-13T19:15:55.895911+0000","last_unstale":"2024-09-13T19:19:05.546064+0000","last_undegraded":"2024-09-13T19:19:05.546064+0000","last_fullsized":"2024-09-13T19:19:05.546064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:13.474342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"36'6","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:20.739628+0000","last_change":"2024-09-13T19:16:31.995370+0000","last_active":"2024-09-13T19:17:20.739628+0000","last_peered":"2024-09-13T19:17:20.739628+0000","last_clean":"2024-09-13T19:17:20.739628+0000","last_became_active":"2024-09-13T19:16:31.993403+0000","last_became_peered":"2024-09-13T19:16:31.993403+0000","last_unstale":"2024-09-13T19:17:20.739628+0000","last_undegraded":"2024-09-13T19:17:20.739628+0000","last_fullsized":"2024-09-13T19:17:20.739628+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:02:35.322551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:38.353948+0000","last_change":"2024-09-13T19:15:55.896003+0000","last_active":"2024-09-13T19:16:38.353948+0000","last_peered":"2024-09-13T19:16:38.353948+0000","last_clean":"2024-09-13T19:16:38.353948+0000","last_became_active":"2024-09-13T19:15:55.894607+0000","last_became_peered":"2024-09-13T19:15:55.894607+0000","last_unstale":"2024-09-13T19:16:38.353948+0000","last_undegraded":"2024-09-13T19:16:38.353948+0000","last_fullsized":"2024-09-13T19:16:38.353948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:23.607524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"36'2","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:20.923380+0000","last_change":"2024-09-13T19:15:57.901296+0000","last_active":"2024-09-13T19:17:20.923380+0000","last_peered":"2024-09-13T19:17:20.923380+0000","last_clean":"2024-09-13T19:17:20.923380+0000","last_became_active":"2024-09-13T19:15:57.900902+0000","last_became_peered":"2024-09-13T19:15:57.900902+0000","last_unstale":"2024-09-13T19:17:20.923380+0000","last_undegraded":"2024-09-13T19:17:20.923380+0000","last_fullsized":"2024-09-13T19:17:20.923380+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:33:43.956584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.988865+0000","last_change":"2024-09-13T19:15:55.906203+0000","last_active":"2024-09-13T19:16:31.988865+0000","last_peered":"2024-09-13T19:16:31.988865+0000","last_clean":"2024-09-13T19:16:31.988865+0000","last_became_active":"2024-09-13T19:15:55.905867+0000","last_became_peered":"2024-09-13T19:15:55.905867+0000","last_unstale":"2024-09-13T19:16:31.988865+0000","last_undegraded":"2024-09-13T19:16:31.988865+0000","last_fullsized":"2024-09-13T19:16:31.988865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:40.072036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.991480+0000","last_change":"2024-09-13T19:15:57.889883+0000","last_active":"2024-09-13T19:16:31.991480+0000","last_peered":"2024-09-13T19:16:31.991480+0000","last_clean":"2024-09-13T19:16:31.991480+0000","last_became_active":"2024-09-13T19:15:57.889606+0000","last_became_peered":"2024-09-13T19:15:57.889606+0000","last_unstale":"2024-09-13T19:16:31.991480+0000","last_undegraded":"2024-09-13T19:16:31.991480+0000","last_fullsized":"2024-09-13T19:16:31.991480+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:14.720100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:37.717588+0000","last_change":"2024-09-13T19:15:55.896394+0000","last_active":"2024-09-13T19:16:37.717588+0000","last_peered":"2024-09-13T19:16:37.717588+0000","last_clean":"2024-09-13T19:16:37.717588+0000","last_became_active":"2024-09-13T19:15:55.896086+0000","last_became_peered":"2024-09-13T19:15:55.896086+0000","last_unstale":"2024-09-13T19:16:37.717588+0000","last_undegraded":"2024-09-13T19:16:37.717588+0000","last_fullsized":"2024-09-13T19:16:37.717588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:07.205939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"36'12","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.842313+0000","last_change":"2024-09-13T19:16:31.992315+0000","last_active":"2024-09-13T19:19:05.842313+0000","last_peered":"2024-09-13T19:19:05.842313+0000","last_clean":"2024-09-13T19:19:05.842313+0000","last_became_active":"2024-09-13T19:16:31.991965+0000","last_became_peered":"2024-09-13T19:16:31.991965+0000","last_unstale":"2024-09-13T19:19:05.842313+0000","last_undegraded":"2024-09-13T19:19:05.842313+0000","last_fullsized":"2024-09-13T19:19:05.842313+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:43.311146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.983154+0000","last_change":"2024-09-13T19:15:55.894925+0000","last_active":"2024-09-13T19:16:31.983154+0000","last_peered":"2024-09-13T19:16:31.983154+0000","last_clean":"2024-09-13T19:16:31.983154+0000","last_became_active":"2024-09-13T19:15:55.894634+0000","last_became_peered":"2024-09-13T19:15:55.894634+0000","last_unstale":"2024-09-13T19:16:31.983154+0000","last_undegraded":"2024-09-13T19:16:31.983154+0000","last_fullsized":"2024-09-13T19:16:31.983154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:43:22.996934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"36'4","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:38.370554+0000","last_change":"2024-09-13T19:15:57.892811+0000","last_active":"2024-09-13T19:16:38.370554+0000","last_peered":"2024-09-13T19:16:38.370554+0000","last_clean":"2024-09-13T19:16:38.370554+0000","last_became_active":"2024-09-13T19:15:57.892558+0000","last_became_peered":"2024-09-13T19:15:57.892558+0000","last_unstale":"2024-09-13T19:16:38.370554+0000","last_undegraded":"2024-09-13T19:16:38.370554+0000","last_fullsized":"2024-09-13T19:16:38.370554+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:32.863560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:04.817098+0000","last_change":"2024-09-13T19:15:55.894980+0000","last_active":"2024-09-13T19:18:04.817098+0000","last_peered":"2024-09-13T19:18:04.817098+0000","last_clean":"2024-09-13T19:18:04.817098+0000","last_became_active":"2024-09-13T19:15:55.894667+0000","last_became_peered":"2024-09-13T19:15:55.894667+0000","last_unstale":"2024-09-13T19:18:04.817098+0000","last_undegraded":"2024-09-13T19:18:04.817098+0000","last_fullsized":"2024-09-13T19:18:04.817098+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:05.649972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"36'17","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.601852+0000","last_change":"2024-09-13T19:15:57.896510+0000","last_active":"2024-09-13T19:19:05.601852+0000","last_peered":"2024-09-13T19:19:05.601852+0000","last_clean":"2024-09-13T19:19:05.601852+0000","last_became_active":"2024-09-13T19:15:57.896200+0000","last_became_peered":"2024-09-13T19:15:57.896200+0000","last_unstale":"2024-09-13T19:19:05.601852+0000","last_undegraded":"2024-09-13T19:19:05.601852+0000","last_fullsized":"2024-09-13T19:19:05.601852+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:10.570988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":50,"num_read_kb":42,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.575188+0000","last_change":"2024-09-13T19:15:55.899411+0000","last_active":"2024-09-13T19:19:05.575188+0000","last_peered":"2024-09-13T19:19:05.575188+0000","last_clean":"2024-09-13T19:19:05.575188+0000","last_became_active":"2024-09-13T19:15:55.899104+0000","last_became_peered":"2024-09-13T19:15:55.899104+0000","last_unstale":"2024-09-13T19:19:05.575188+0000","last_undegraded":"2024-09-13T19:19:05.575188+0000","last_fullsized":"2024-09-13T19:19:05.575188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:11.960376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"36'12","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.919823+0000","last_change":"2024-09-13T19:15:57.890188+0000","last_active":"2024-09-13T19:19:05.919823+0000","last_peered":"2024-09-13T19:19:05.919823+0000","last_clean":"2024-09-13T19:19:05.919823+0000","last_became_active":"2024-09-13T19:15:57.889781+0000","last_became_peered":"2024-09-13T19:15:57.889781+0000","last_unstale":"2024-09-13T19:19:05.919823+0000","last_undegraded":"2024-09-13T19:19:05.919823+0000","last_fullsized":"2024-09-13T19:19:05.919823+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:25.431664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984819+0000","last_change":"2024-09-13T19:15:55.898914+0000","last_active":"2024-09-13T19:16:31.984819+0000","last_peered":"2024-09-13T19:16:31.984819+0000","last_clean":"2024-09-13T19:16:31.984819+0000","last_became_active":"2024-09-13T19:15:55.898627+0000","last_became_peered":"2024-09-13T19:15:55.898627+0000","last_unstale":"2024-09-13T19:16:31.984819+0000","last_undegraded":"2024-09-13T19:16:31.984819+0000","last_fullsized":"2024-09-13T19:16:31.984819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:12.713518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.981855+0000","last_change":"2024-09-13T19:15:55.899524+0000","last_active":"2024-09-13T19:16:31.981855+0000","last_peered":"2024-09-13T19:16:31.981855+0000","last_clean":"2024-09-13T19:16:31.981855+0000","last_became_active":"2024-09-13T19:15:55.899225+0000","last_became_peered":"2024-09-13T19:15:55.899225+0000","last_unstale":"2024-09-13T19:16:31.981855+0000","last_undegraded":"2024-09-13T19:16:31.981855+0000","last_fullsized":"2024-09-13T19:16:31.981855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:53:11.602684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"36'6","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.695792+0000","last_change":"2024-09-13T19:15:57.890646+0000","last_active":"2024-09-13T19:19:05.695792+0000","last_peered":"2024-09-13T19:19:05.695792+0000","last_clean":"2024-09-13T19:19:05.695792+0000","last_became_active":"2024-09-13T19:15:57.890325+0000","last_became_peered":"2024-09-13T19:15:57.890325+0000","last_unstale":"2024-09-13T19:19:05.695792+0000","last_undegraded":"2024-09-13T19:19:05.695792+0000","last_fullsized":"2024-09-13T19:19:05.695792+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:52:40.259021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.983543+0000","last_change":"2024-09-13T19:15:55.895990+0000","last_active":"2024-09-13T19:16:31.983543+0000","last_peered":"2024-09-13T19:16:31.983543+0000","last_clean":"2024-09-13T19:16:31.983543+0000","last_became_active":"2024-09-13T19:15:55.894485+0000","last_became_peered":"2024-09-13T19:15:55.894485+0000","last_unstale":"2024-09-13T19:16:31.983543+0000","last_undegraded":"2024-09-13T19:16:31.983543+0000","last_fullsized":"2024-09-13T19:16:31.983543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:15.987813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"36'8","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.594537+0000","last_change":"2024-09-13T19:15:57.902376+0000","last_active":"2024-09-13T19:19:05.594537+0000","last_peered":"2024-09-13T19:19:05.594537+0000","last_clean":"2024-09-13T19:19:05.594537+0000","last_became_active":"2024-09-13T19:15:57.902123+0000","last_became_peered":"2024-09-13T19:15:57.902123+0000","last_unstale":"2024-09-13T19:19:05.594537+0000","last_undegraded":"2024-09-13T19:19:05.594537+0000","last_fullsized":"2024-09-13T19:19:05.594537+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:06.873072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1595,"num_read_kb":1485,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38719488,"data_stored":38719488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640303,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48124,"kb_used_data":12780,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323716,"statfs":{"total":96636764160,"available":96587485184,"internally_reserved":0,"allocated":13086720,"data_stored":12741536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640302,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51068,"kb_used_data":11564,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94320772,"statfs":{"total":96636764160,"available":96584470528,"internally_reserved":0,"allocated":11841536,"data_stored":11556210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640302,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40784,"kb_used_data":5440,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94331056,"statfs":{"total":96636764160,"available":96595001344,"internally_reserved":0,"allocated":5570560,"data_stored":5265629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705711,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38036,"kb_used_data":11012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94333804,"statfs":{"total":96636764160,"available":96597815296,"internally_reserved":0,"allocated":11276288,"data_stored":10967495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10809344,"data_stored":10809344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4517888,"data_stored":4517888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":10809344,"data_stored":10809344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T19:19:13.181 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T19:19:13.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.303+0000 7f6625ab7640 1 Processor -- start 2024-09-13T19:19:13.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.303+0000 7f6625ab7640 1 -- start start 2024-09-13T19:19:13.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.303+0000 7f6625ab7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f662012cca0 0x7f662012d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:13.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.303+0000 7f6625ab7640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f662012d5c0 con 0x7f66201290e0 2024-09-13T19:19:13.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.303+0000 7f6625ab7640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f662006e350 con 0x7f662012cca0 2024-09-13T19:19:13.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.303+0000 7f661f7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f662012cca0 0x7f662012d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:13.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.303+0000 7f661effd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f66201290e0 0x7f6620129530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59834/0 (socket says 172.21.15.53:59834) 2024-09-13T19:19:13.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.303+0000 7f661effd640 1 -- 172.21.15.53:0/76749189 learned_addr learned my addr 172.21.15.53:0/76749189 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T19:19:13.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.303+0000 7f661f7fe640 1 -- 172.21.15.53:0/76749189 >> v1:172.21.15.53:6789/0 conn(0x7f66201290e0 legacy=0x7f6620129530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:13.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.304+0000 7f661f7fe640 1 -- 172.21.15.53:0/76749189 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6620071f70 con 0x7f662012cca0 2024-09-13T19:19:13.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.304+0000 7f661f7fe640 1 --2- 172.21.15.53:0/76749189 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f662012cca0 0x7f662012d080 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f6610009720 tx=0x7f661002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45f750b5c7cb8354 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:13.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.304+0000 7f661e7fc640 1 -- 172.21.15.53:0/76749189 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6610037070 con 0x7f662012cca0 2024-09-13T19:19:13.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.304+0000 7f661e7fc640 1 -- 172.21.15.53:0/76749189 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f661002ad90 con 0x7f662012cca0 2024-09-13T19:19:13.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.304+0000 7f661e7fc640 1 -- 172.21.15.53:0/76749189 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6610032590 con 0x7f662012cca0 2024-09-13T19:19:13.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.305+0000 7f6625ab7640 1 -- 172.21.15.53:0/76749189 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f662012cca0 msgr2=0x7f662012d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:13.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.305+0000 7f6625ab7640 1 --2- 172.21.15.53:0/76749189 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f662012cca0 0x7f662012d080 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f6610009720 tx=0x7f661002a110 comp rx=0 tx=0).stop 2024-09-13T19:19:13.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.305+0000 7f6625ab7640 1 -- 172.21.15.53:0/76749189 shutdown_connections 2024-09-13T19:19:13.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.305+0000 7f6625ab7640 1 --2- 172.21.15.53:0/76749189 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f662012cca0 0x7f662012d080 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:13.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.305+0000 7f6625ab7640 1 -- 172.21.15.53:0/76749189 >> 172.21.15.53:0/76749189 conn(0x7f662009a890 msgr2=0x7f662009aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:19:13.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.305+0000 7f6625ab7640 1 -- 172.21.15.53:0/76749189 shutdown_connections 2024-09-13T19:19:13.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.305+0000 7f6625ab7640 1 -- 172.21.15.53:0/76749189 wait complete. 2024-09-13T19:19:13.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.306+0000 7f6625ab7640 1 Processor -- start 2024-09-13T19:19:13.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.306+0000 7f6625ab7640 1 -- start start 2024-09-13T19:19:13.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.306+0000 7f6625ab7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66201290e0 0x7f66201c37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:13.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.306+0000 7f6625ab7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6620070e60 con 0x7f66201290e0 2024-09-13T19:19:13.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.306+0000 7f661f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66201290e0 0x7f66201c37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:13.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.306+0000 7f661f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66201290e0 0x7f66201c37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35896/0 (socket says 172.21.15.53:35896) 2024-09-13T19:19:13.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.306+0000 7f661f7fe640 1 -- 172.21.15.53:0/2515437483 learned_addr learned my addr 172.21.15.53:0/2515437483 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:19:13.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.307+0000 7f661f7fe640 1 -- 172.21.15.53:0/2515437483 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66200700f0 con 0x7f66201290e0 2024-09-13T19:19:13.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.307+0000 7f661f7fe640 1 --2- 172.21.15.53:0/2515437483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66201290e0 0x7f66201c37b0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f6610000c00 tx=0x7f66100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:13.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.307+0000 7f6607fff640 1 -- 172.21.15.53:0/2515437483 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6610037040 con 0x7f66201290e0 2024-09-13T19:19:13.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.307+0000 7f6607fff640 1 -- 172.21.15.53:0/2515437483 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6610042070 con 0x7f66201290e0 2024-09-13T19:19:13.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.307+0000 7f6625ab7640 1 -- 172.21.15.53:0/2515437483 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66200709d0 con 0x7f66201290e0 2024-09-13T19:19:13.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.307+0000 7f6607fff640 1 -- 172.21.15.53:0/2515437483 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f661003d6e0 con 0x7f66201290e0 2024-09-13T19:19:13.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.307+0000 7f6625ab7640 1 -- 172.21.15.53:0/2515437483 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66201c3cf0 con 0x7f66201290e0 2024-09-13T19:19:13.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.308+0000 7f6607fff640 1 -- 172.21.15.53:0/2515437483 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f661003d880 con 0x7f66201290e0 2024-09-13T19:19:13.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.308+0000 7f6625ab7640 1 -- 172.21.15.53:0/2515437483 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6620126db0 con 0x7f66201290e0 2024-09-13T19:19:13.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.308+0000 7f6607fff640 1 --2- 172.21.15.53:0/2515437483 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f660c0382a0 0x7f660c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:13.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.308+0000 7f6607fff640 1 -- 172.21.15.53:0/2515437483 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f661006c750 con 0x7f66201290e0 2024-09-13T19:19:13.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.308+0000 7f661effd640 1 --2- 172.21.15.53:0/2515437483 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f660c0382a0 0x7f660c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:13.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.309+0000 7f661effd640 1 --2- 172.21.15.53:0/2515437483 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f660c0382a0 0x7f660c03a760 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6614007fd0 tx=0x7f6614007ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:13.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.313+0000 7f6607fff640 1 -- 172.21.15.53:0/2515437483 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6610030e20 con 0x7f66201290e0 2024-09-13T19:19:13.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.487+0000 7f6625ab7640 1 -- 172.21.15.53:0/2515437483 --> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f662006e510 con 0x7f660c0382a0 2024-09-13T19:19:13.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.501+0000 7f6607fff640 1 -- 172.21.15.53:0/2515437483 <== mgr.4098 v2:172.21.15.102:6824/4283826432 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665892 (secure 0 0 0) 0x7f662006e510 con 0x7f660c0382a0 2024-09-13T19:19:13.512 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:19:13.518 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T19:19:13.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.506+0000 7f6625ab7640 1 -- 172.21.15.53:0/2515437483 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f660c0382a0 msgr2=0x7f660c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:13.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.506+0000 7f6625ab7640 1 --2- 172.21.15.53:0/2515437483 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f660c0382a0 0x7f660c03a760 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6614007fd0 tx=0x7f6614007ac0 comp rx=0 tx=0).stop 2024-09-13T19:19:13.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.506+0000 7f6625ab7640 1 -- 172.21.15.53:0/2515437483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66201290e0 msgr2=0x7f66201c37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:13.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.506+0000 7f6625ab7640 1 --2- 172.21.15.53:0/2515437483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66201290e0 0x7f66201c37b0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f6610000c00 tx=0x7f66100046c0 comp rx=0 tx=0).stop 2024-09-13T19:19:13.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.506+0000 7f6625ab7640 1 -- 172.21.15.53:0/2515437483 shutdown_connections 2024-09-13T19:19:13.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.506+0000 7f6625ab7640 1 --2- 172.21.15.53:0/2515437483 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f660c0382a0 0x7f660c03a760 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:13.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.506+0000 7f6625ab7640 1 --2- 172.21.15.53:0/2515437483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66201290e0 0x7f66201c37b0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:13.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.506+0000 7f6625ab7640 1 -- 172.21.15.53:0/2515437483 >> 172.21.15.53:0/2515437483 conn(0x7f662009a890 msgr2=0x7f662009ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:19:13.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.506+0000 7f6625ab7640 1 -- 172.21.15.53:0/2515437483 shutdown_connections 2024-09-13T19:19:13.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.506+0000 7f6625ab7640 1 -- 172.21.15.53:0/2515437483 wait complete. 2024-09-13T19:19:13.521 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":141,"stamp":"2024-09-13T19:19:12.968387+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412809,"num_objects":229,"num_object_clones":0,"num_object_copies":465,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":4867,"num_read_kb":4444,"num_write":2106,"num_write_kb":61374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4479,"ondisk_log_size":4479,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":178012,"kb_used_data":40796,"kb_used_omap":6,"kb_used_meta":137145,"kb_avail":377309348,"statfs":{"total":386547056640,"available":386364772352,"internally_reserved":0,"allocated":41775104,"data_stored":40530870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":140437271},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25811688,"num_objects":9,"num_object_clones":0,"num_object_copies":25,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":452,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003373"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.986470+0000","last_change":"2024-09-13T19:15:55.897703+0000","last_active":"2024-09-13T19:16:31.986470+0000","last_peered":"2024-09-13T19:16:31.986470+0000","last_clean":"2024-09-13T19:16:31.986470+0000","last_became_active":"2024-09-13T19:15:55.897392+0000","last_became_peered":"2024-09-13T19:15:55.897392+0000","last_unstale":"2024-09-13T19:16:31.986470+0000","last_undegraded":"2024-09-13T19:16:31.986470+0000","last_fullsized":"2024-09-13T19:16:31.986470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:06:25.645854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"36'8","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.962167+0000","last_change":"2024-09-13T19:15:57.889239+0000","last_active":"2024-09-13T19:19:05.962167+0000","last_peered":"2024-09-13T19:19:05.962167+0000","last_clean":"2024-09-13T19:19:05.962167+0000","last_became_active":"2024-09-13T19:15:57.888352+0000","last_became_peered":"2024-09-13T19:15:57.888352+0000","last_unstale":"2024-09-13T19:19:05.962167+0000","last_undegraded":"2024-09-13T19:19:05.962167+0000","last_fullsized":"2024-09-13T19:19:05.962167+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:44.850376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"34'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.986216+0000","last_change":"2024-09-13T19:15:55.896090+0000","last_active":"2024-09-13T19:16:31.986216+0000","last_peered":"2024-09-13T19:16:31.986216+0000","last_clean":"2024-09-13T19:16:31.986216+0000","last_became_active":"2024-09-13T19:15:55.894768+0000","last_became_peered":"2024-09-13T19:15:55.894768+0000","last_unstale":"2024-09-13T19:16:31.986216+0000","last_undegraded":"2024-09-13T19:16:31.986216+0000","last_fullsized":"2024-09-13T19:16:31.986216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:42.707424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"36'6","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.063780+0000","last_change":"2024-09-13T19:15:57.895729+0000","last_active":"2024-09-13T19:19:06.063780+0000","last_peered":"2024-09-13T19:19:06.063780+0000","last_clean":"2024-09-13T19:19:06.063780+0000","last_became_active":"2024-09-13T19:15:57.895424+0000","last_became_peered":"2024-09-13T19:15:57.895424+0000","last_unstale":"2024-09-13T19:19:06.063780+0000","last_undegraded":"2024-09-13T19:19:06.063780+0000","last_fullsized":"2024-09-13T19:19:06.063780+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:13:56.189818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985541+0000","last_change":"2024-09-13T19:15:55.900265+0000","last_active":"2024-09-13T19:16:31.985541+0000","last_peered":"2024-09-13T19:16:31.985541+0000","last_clean":"2024-09-13T19:16:31.985541+0000","last_became_active":"2024-09-13T19:15:55.899965+0000","last_became_peered":"2024-09-13T19:15:55.899965+0000","last_unstale":"2024-09-13T19:16:31.985541+0000","last_undegraded":"2024-09-13T19:16:31.985541+0000","last_fullsized":"2024-09-13T19:16:31.985541+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:21.434261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"36'13","reported_seq":70,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.930148+0000","last_change":"2024-09-13T19:15:57.895266+0000","last_active":"2024-09-13T19:19:05.930148+0000","last_peered":"2024-09-13T19:19:05.930148+0000","last_clean":"2024-09-13T19:19:05.930148+0000","last_became_active":"2024-09-13T19:15:57.894955+0000","last_became_peered":"2024-09-13T19:15:57.894955+0000","last_unstale":"2024-09-13T19:19:05.930148+0000","last_undegraded":"2024-09-13T19:19:05.930148+0000","last_fullsized":"2024-09-13T19:19:05.930148+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:00.565048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985385+0000","last_change":"2024-09-13T19:15:55.890339+0000","last_active":"2024-09-13T19:16:31.985385+0000","last_peered":"2024-09-13T19:16:31.985385+0000","last_clean":"2024-09-13T19:16:31.985385+0000","last_became_active":"2024-09-13T19:15:55.889830+0000","last_became_peered":"2024-09-13T19:15:55.889830+0000","last_unstale":"2024-09-13T19:16:31.985385+0000","last_undegraded":"2024-09-13T19:16:31.985385+0000","last_fullsized":"2024-09-13T19:16:31.985385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:24.740012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"36'4","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.699868+0000","last_change":"2024-09-13T19:15:57.895013+0000","last_active":"2024-09-13T19:19:05.699868+0000","last_peered":"2024-09-13T19:19:05.699868+0000","last_clean":"2024-09-13T19:19:05.699868+0000","last_became_active":"2024-09-13T19:15:57.894733+0000","last_became_peered":"2024-09-13T19:15:57.894733+0000","last_unstale":"2024-09-13T19:19:05.699868+0000","last_undegraded":"2024-09-13T19:19:05.699868+0000","last_fullsized":"2024-09-13T19:19:05.699868+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:55:38.336831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"36'3","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:28.944247+0000","last_change":"2024-09-13T19:15:55.895687+0000","last_active":"2024-09-13T19:18:28.944247+0000","last_peered":"2024-09-13T19:18:28.944247+0000","last_clean":"2024-09-13T19:18:28.944247+0000","last_became_active":"2024-09-13T19:15:55.895362+0000","last_became_peered":"2024-09-13T19:15:55.895362+0000","last_unstale":"2024-09-13T19:18:28.944247+0000","last_undegraded":"2024-09-13T19:18:28.944247+0000","last_fullsized":"2024-09-13T19:18:28.944247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:12.815210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"36'8","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.594848+0000","last_change":"2024-09-13T19:15:57.889968+0000","last_active":"2024-09-13T19:19:05.594848+0000","last_peered":"2024-09-13T19:19:05.594848+0000","last_clean":"2024-09-13T19:19:05.594848+0000","last_became_active":"2024-09-13T19:15:57.889664+0000","last_became_peered":"2024-09-13T19:15:57.889664+0000","last_unstale":"2024-09-13T19:19:05.594848+0000","last_undegraded":"2024-09-13T19:19:05.594848+0000","last_fullsized":"2024-09-13T19:19:05.594848+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:07.656555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.836502+0000","last_change":"2024-09-13T19:15:55.890058+0000","last_active":"2024-09-13T19:19:05.836502+0000","last_peered":"2024-09-13T19:19:05.836502+0000","last_clean":"2024-09-13T19:19:05.836502+0000","last_became_active":"2024-09-13T19:15:55.889485+0000","last_became_peered":"2024-09-13T19:15:55.889485+0000","last_unstale":"2024-09-13T19:19:05.836502+0000","last_undegraded":"2024-09-13T19:19:05.836502+0000","last_fullsized":"2024-09-13T19:19:05.836502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:05:45.706743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"36'2","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:37.740715+0000","last_change":"2024-09-13T19:15:57.901409+0000","last_active":"2024-09-13T19:16:37.740715+0000","last_peered":"2024-09-13T19:16:37.740715+0000","last_clean":"2024-09-13T19:16:37.740715+0000","last_became_active":"2024-09-13T19:15:57.900785+0000","last_became_peered":"2024-09-13T19:15:57.900785+0000","last_unstale":"2024-09-13T19:16:37.740715+0000","last_undegraded":"2024-09-13T19:16:37.740715+0000","last_fullsized":"2024-09-13T19:16:37.740715+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:37.144718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"36'1","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:28.944154+0000","last_change":"2024-09-13T19:15:55.898268+0000","last_active":"2024-09-13T19:18:28.944154+0000","last_peered":"2024-09-13T19:18:28.944154+0000","last_clean":"2024-09-13T19:18:28.944154+0000","last_became_active":"2024-09-13T19:15:55.897381+0000","last_became_peered":"2024-09-13T19:15:55.897381+0000","last_unstale":"2024-09-13T19:18:28.944154+0000","last_undegraded":"2024-09-13T19:18:28.944154+0000","last_fullsized":"2024-09-13T19:18:28.944154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:08:10.316406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"36'16","reported_seq":90,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.842428+0000","last_change":"2024-09-13T19:15:57.893695+0000","last_active":"2024-09-13T19:19:05.842428+0000","last_peered":"2024-09-13T19:19:05.842428+0000","last_clean":"2024-09-13T19:19:05.842428+0000","last_became_active":"2024-09-13T19:15:57.893408+0000","last_became_peered":"2024-09-13T19:15:57.893408+0000","last_unstale":"2024-09-13T19:19:05.842428+0000","last_undegraded":"2024-09-13T19:19:05.842428+0000","last_fullsized":"2024-09-13T19:19:05.842428+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:37.777072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"36'1","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:26.939076+0000","last_change":"2024-09-13T19:15:55.901574+0000","last_active":"2024-09-13T19:18:26.939076+0000","last_peered":"2024-09-13T19:18:26.939076+0000","last_clean":"2024-09-13T19:18:26.939076+0000","last_became_active":"2024-09-13T19:15:55.901190+0000","last_became_peered":"2024-09-13T19:15:55.901190+0000","last_unstale":"2024-09-13T19:18:26.939076+0000","last_undegraded":"2024-09-13T19:18:26.939076+0000","last_fullsized":"2024-09-13T19:18:26.939076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:48:45.584149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"36'16","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.842549+0000","last_change":"2024-09-13T19:15:57.898655+0000","last_active":"2024-09-13T19:19:05.842549+0000","last_peered":"2024-09-13T19:19:05.842549+0000","last_clean":"2024-09-13T19:19:05.842549+0000","last_became_active":"2024-09-13T19:15:57.898325+0000","last_became_peered":"2024-09-13T19:15:57.898325+0000","last_unstale":"2024-09-13T19:19:05.842549+0000","last_undegraded":"2024-09-13T19:19:05.842549+0000","last_fullsized":"2024-09-13T19:19:05.842549+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:29.689654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":52,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"36'4","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.842445+0000","last_change":"2024-09-13T19:15:57.890027+0000","last_active":"2024-09-13T19:19:05.842445+0000","last_peered":"2024-09-13T19:19:05.842445+0000","last_clean":"2024-09-13T19:19:05.842445+0000","last_became_active":"2024-09-13T19:15:57.887144+0000","last_became_peered":"2024-09-13T19:15:57.887144+0000","last_unstale":"2024-09-13T19:19:05.842445+0000","last_undegraded":"2024-09-13T19:19:05.842445+0000","last_fullsized":"2024-09-13T19:19:05.842445+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:55.470024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"36'1","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:23.943012+0000","last_change":"2024-09-13T19:15:55.896889+0000","last_active":"2024-09-13T19:18:23.943012+0000","last_peered":"2024-09-13T19:18:23.943012+0000","last_clean":"2024-09-13T19:18:23.943012+0000","last_became_active":"2024-09-13T19:15:55.895552+0000","last_became_peered":"2024-09-13T19:15:55.895552+0000","last_unstale":"2024-09-13T19:18:23.943012+0000","last_undegraded":"2024-09-13T19:18:23.943012+0000","last_fullsized":"2024-09-13T19:18:23.943012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:11.960376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"36'8","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.961901+0000","last_change":"2024-09-13T19:15:57.889071+0000","last_active":"2024-09-13T19:19:05.961901+0000","last_peered":"2024-09-13T19:19:05.961901+0000","last_clean":"2024-09-13T19:19:05.961901+0000","last_became_active":"2024-09-13T19:15:57.886511+0000","last_became_peered":"2024-09-13T19:15:57.886511+0000","last_unstale":"2024-09-13T19:19:05.961901+0000","last_undegraded":"2024-09-13T19:19:05.961901+0000","last_fullsized":"2024-09-13T19:19:05.961901+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:29.689654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.989246+0000","last_change":"2024-09-13T19:15:55.898694+0000","last_active":"2024-09-13T19:16:31.989246+0000","last_peered":"2024-09-13T19:16:31.989246+0000","last_clean":"2024-09-13T19:16:31.989246+0000","last_became_active":"2024-09-13T19:15:55.896952+0000","last_became_peered":"2024-09-13T19:15:55.896952+0000","last_unstale":"2024-09-13T19:16:31.989246+0000","last_undegraded":"2024-09-13T19:16:31.989246+0000","last_fullsized":"2024-09-13T19:16:31.989246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:07.205939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"36'8","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.961849+0000","last_change":"2024-09-13T19:15:57.891691+0000","last_active":"2024-09-13T19:19:05.961849+0000","last_peered":"2024-09-13T19:19:05.961849+0000","last_clean":"2024-09-13T19:19:05.961849+0000","last_became_active":"2024-09-13T19:15:57.891411+0000","last_became_peered":"2024-09-13T19:15:57.891411+0000","last_unstale":"2024-09-13T19:19:05.961849+0000","last_undegraded":"2024-09-13T19:19:05.961849+0000","last_fullsized":"2024-09-13T19:19:05.961849+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:00.474958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"36'2","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:37.184808+0000","last_change":"2024-09-13T19:15:55.896710+0000","last_active":"2024-09-13T19:16:37.184808+0000","last_peered":"2024-09-13T19:16:37.184808+0000","last_clean":"2024-09-13T19:16:37.184808+0000","last_became_active":"2024-09-13T19:15:55.895453+0000","last_became_peered":"2024-09-13T19:15:55.895453+0000","last_unstale":"2024-09-13T19:16:37.184808+0000","last_undegraded":"2024-09-13T19:16:37.184808+0000","last_fullsized":"2024-09-13T19:16:37.184808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:02.236650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"36'8","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.700241+0000","last_change":"2024-09-13T19:15:57.896559+0000","last_active":"2024-09-13T19:19:05.700241+0000","last_peered":"2024-09-13T19:19:05.700241+0000","last_clean":"2024-09-13T19:19:05.700241+0000","last_became_active":"2024-09-13T19:15:57.896208+0000","last_became_peered":"2024-09-13T19:15:57.896208+0000","last_unstale":"2024-09-13T19:19:05.700241+0000","last_undegraded":"2024-09-13T19:19:05.700241+0000","last_fullsized":"2024-09-13T19:19:05.700241+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:17.061411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:04.776815+0000","last_change":"2024-09-13T19:15:55.892927+0000","last_active":"2024-09-13T19:18:04.776815+0000","last_peered":"2024-09-13T19:18:04.776815+0000","last_clean":"2024-09-13T19:18:04.776815+0000","last_became_active":"2024-09-13T19:15:55.892616+0000","last_became_peered":"2024-09-13T19:15:55.892616+0000","last_unstale":"2024-09-13T19:18:04.776815+0000","last_undegraded":"2024-09-13T19:18:04.776815+0000","last_fullsized":"2024-09-13T19:18:04.776815+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:43:49.825167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"36'2","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:01.383748+0000","last_change":"2024-09-13T19:15:57.897850+0000","last_active":"2024-09-13T19:18:01.383748+0000","last_peered":"2024-09-13T19:18:01.383748+0000","last_clean":"2024-09-13T19:18:01.383748+0000","last_became_active":"2024-09-13T19:15:57.897566+0000","last_became_peered":"2024-09-13T19:15:57.897566+0000","last_unstale":"2024-09-13T19:18:01.383748+0000","last_undegraded":"2024-09-13T19:18:01.383748+0000","last_fullsized":"2024-09-13T19:18:01.383748+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:28:00.527551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984851+0000","last_change":"2024-09-13T19:15:55.894579+0000","last_active":"2024-09-13T19:16:31.984851+0000","last_peered":"2024-09-13T19:16:31.984851+0000","last_clean":"2024-09-13T19:16:31.984851+0000","last_became_active":"2024-09-13T19:15:55.893594+0000","last_became_peered":"2024-09-13T19:15:55.893594+0000","last_unstale":"2024-09-13T19:16:31.984851+0000","last_undegraded":"2024-09-13T19:16:31.984851+0000","last_fullsized":"2024-09-13T19:16:31.984851+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:00.650641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"36'6","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.842241+0000","last_change":"2024-09-13T19:15:57.890303+0000","last_active":"2024-09-13T19:19:05.842241+0000","last_peered":"2024-09-13T19:19:05.842241+0000","last_clean":"2024-09-13T19:19:05.842241+0000","last_became_active":"2024-09-13T19:15:57.889901+0000","last_became_peered":"2024-09-13T19:15:57.889901+0000","last_unstale":"2024-09-13T19:19:05.842241+0000","last_undegraded":"2024-09-13T19:19:05.842241+0000","last_fullsized":"2024-09-13T19:19:05.842241+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:15.189353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.982141+0000","last_change":"2024-09-13T19:15:55.899097+0000","last_active":"2024-09-13T19:16:31.982141+0000","last_peered":"2024-09-13T19:16:31.982141+0000","last_clean":"2024-09-13T19:16:31.982141+0000","last_became_active":"2024-09-13T19:15:55.898679+0000","last_became_peered":"2024-09-13T19:15:55.898679+0000","last_unstale":"2024-09-13T19:16:31.982141+0000","last_undegraded":"2024-09-13T19:16:31.982141+0000","last_fullsized":"2024-09-13T19:16:31.982141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:27:38.213575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"36'35","reported_seq":99,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.884618+0000","last_change":"2024-09-13T19:16:05.921753+0000","last_active":"2024-09-13T19:19:05.884618+0000","last_peered":"2024-09-13T19:19:05.884618+0000","last_clean":"2024-09-13T19:19:05.884618+0000","last_became_active":"2024-09-13T19:16:05.921156+0000","last_became_peered":"2024-09-13T19:16:05.921156+0000","last_unstale":"2024-09-13T19:19:05.884618+0000","last_undegraded":"2024-09-13T19:19:05.884618+0000","last_fullsized":"2024-09-13T19:19:05.884618+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:05.248200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"36'6","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.601363+0000","last_change":"2024-09-13T19:15:57.897717+0000","last_active":"2024-09-13T19:19:05.601363+0000","last_peered":"2024-09-13T19:19:05.601363+0000","last_clean":"2024-09-13T19:19:05.601363+0000","last_became_active":"2024-09-13T19:15:57.895870+0000","last_became_peered":"2024-09-13T19:15:57.895870+0000","last_unstale":"2024-09-13T19:19:05.601363+0000","last_undegraded":"2024-09-13T19:19:05.601363+0000","last_fullsized":"2024-09-13T19:19:05.601363+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:18.507963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.981961+0000","last_change":"2024-09-13T19:15:55.895213+0000","last_active":"2024-09-13T19:16:31.981961+0000","last_peered":"2024-09-13T19:16:31.981961+0000","last_clean":"2024-09-13T19:16:31.981961+0000","last_became_active":"2024-09-13T19:15:55.894099+0000","last_became_peered":"2024-09-13T19:15:55.894099+0000","last_unstale":"2024-09-13T19:16:31.981961+0000","last_undegraded":"2024-09-13T19:16:31.981961+0000","last_fullsized":"2024-09-13T19:16:31.981961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:27:58.520969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985712+0000","last_change":"2024-09-13T19:15:59.896913+0000","last_active":"2024-09-13T19:16:31.985712+0000","last_peered":"2024-09-13T19:16:31.985712+0000","last_clean":"2024-09-13T19:16:31.985712+0000","last_became_active":"2024-09-13T19:15:59.896648+0000","last_became_peered":"2024-09-13T19:15:59.896648+0000","last_unstale":"2024-09-13T19:16:31.985712+0000","last_undegraded":"2024-09-13T19:16:31.985712+0000","last_fullsized":"2024-09-13T19:16:31.985712+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:46.250392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"36'30","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.155817+0000","last_change":"2024-09-13T19:16:01.907027+0000","last_active":"2024-09-13T19:18:03.155817+0000","last_peered":"2024-09-13T19:18:03.155817+0000","last_clean":"2024-09-13T19:18:03.155817+0000","last_became_active":"2024-09-13T19:16:01.906675+0000","last_became_peered":"2024-09-13T19:16:01.906675+0000","last_unstale":"2024-09-13T19:18:03.155817+0000","last_undegraded":"2024-09-13T19:18:03.155817+0000","last_fullsized":"2024-09-13T19:18:03.155817+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:45.278694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.990499+0000","last_change":"2024-09-13T19:16:03.914490+0000","last_active":"2024-09-13T19:16:31.990499+0000","last_peered":"2024-09-13T19:16:31.990499+0000","last_clean":"2024-09-13T19:16:31.990499+0000","last_became_active":"2024-09-13T19:16:03.914111+0000","last_became_peered":"2024-09-13T19:16:03.914111+0000","last_unstale":"2024-09-13T19:16:31.990499+0000","last_undegraded":"2024-09-13T19:16:31.990499+0000","last_fullsized":"2024-09-13T19:16:31.990499+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:15.864837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"36'7","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:20.744686+0000","last_change":"2024-09-13T19:16:05.925198+0000","last_active":"2024-09-13T19:17:20.744686+0000","last_peered":"2024-09-13T19:17:20.744686+0000","last_clean":"2024-09-13T19:17:20.744686+0000","last_became_active":"2024-09-13T19:16:05.924829+0000","last_became_peered":"2024-09-13T19:16:05.924829+0000","last_unstale":"2024-09-13T19:17:20.744686+0000","last_undegraded":"2024-09-13T19:17:20.744686+0000","last_fullsized":"2024-09-13T19:17:20.744686+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:34:08.741130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"36'10","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.920422+0000","last_change":"2024-09-13T19:15:57.898414+0000","last_active":"2024-09-13T19:19:05.920422+0000","last_peered":"2024-09-13T19:19:05.920422+0000","last_clean":"2024-09-13T19:19:05.920422+0000","last_became_active":"2024-09-13T19:15:57.897928+0000","last_became_peered":"2024-09-13T19:15:57.897928+0000","last_unstale":"2024-09-13T19:19:05.920422+0000","last_undegraded":"2024-09-13T19:19:05.920422+0000","last_fullsized":"2024-09-13T19:19:05.920422+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:32.186245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985358+0000","last_change":"2024-09-13T19:15:55.892255+0000","last_active":"2024-09-13T19:16:31.985358+0000","last_peered":"2024-09-13T19:16:31.985358+0000","last_clean":"2024-09-13T19:16:31.985358+0000","last_became_active":"2024-09-13T19:15:55.891934+0000","last_became_peered":"2024-09-13T19:15:55.891934+0000","last_unstale":"2024-09-13T19:16:31.985358+0000","last_undegraded":"2024-09-13T19:16:31.985358+0000","last_fullsized":"2024-09-13T19:16:31.985358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:14:40.566289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984081+0000","last_change":"2024-09-13T19:15:59.892496+0000","last_active":"2024-09-13T19:16:31.984081+0000","last_peered":"2024-09-13T19:16:31.984081+0000","last_clean":"2024-09-13T19:16:31.984081+0000","last_became_active":"2024-09-13T19:15:59.892230+0000","last_became_peered":"2024-09-13T19:15:59.892230+0000","last_unstale":"2024-09-13T19:16:31.984081+0000","last_undegraded":"2024-09-13T19:16:31.984081+0000","last_fullsized":"2024-09-13T19:16:31.984081+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:58.175054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"36'8","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:38.373021+0000","last_change":"2024-09-13T19:16:01.903662+0000","last_active":"2024-09-13T19:16:38.373021+0000","last_peered":"2024-09-13T19:16:38.373021+0000","last_clean":"2024-09-13T19:16:38.373021+0000","last_became_active":"2024-09-13T19:16:01.903371+0000","last_became_peered":"2024-09-13T19:16:01.903371+0000","last_unstale":"2024-09-13T19:16:38.373021+0000","last_undegraded":"2024-09-13T19:16:38.373021+0000","last_fullsized":"2024-09-13T19:16:38.373021+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:53.296370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.988897+0000","last_change":"2024-09-13T19:16:03.915815+0000","last_active":"2024-09-13T19:16:31.988897+0000","last_peered":"2024-09-13T19:16:31.988897+0000","last_clean":"2024-09-13T19:16:31.988897+0000","last_became_active":"2024-09-13T19:16:03.915538+0000","last_became_peered":"2024-09-13T19:16:03.915538+0000","last_unstale":"2024-09-13T19:16:31.988897+0000","last_undegraded":"2024-09-13T19:16:31.988897+0000","last_fullsized":"2024-09-13T19:16:31.988897+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:54:45.306953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"34'2","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.983505+0000","last_change":"2024-09-13T19:16:05.911958+0000","last_active":"2024-09-13T19:16:31.983505+0000","last_peered":"2024-09-13T19:16:31.983505+0000","last_clean":"2024-09-13T19:16:31.983505+0000","last_became_active":"2024-09-13T19:16:05.911683+0000","last_became_peered":"2024-09-13T19:16:05.911683+0000","last_unstale":"2024-09-13T19:16:31.983505+0000","last_undegraded":"2024-09-13T19:16:31.983505+0000","last_fullsized":"2024-09-13T19:16:31.983505+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:54:45.632821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"36'4","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.919899+0000","last_change":"2024-09-13T19:15:57.897213+0000","last_active":"2024-09-13T19:19:05.919899+0000","last_peered":"2024-09-13T19:19:05.919899+0000","last_clean":"2024-09-13T19:19:05.919899+0000","last_became_active":"2024-09-13T19:15:57.896965+0000","last_became_peered":"2024-09-13T19:15:57.896965+0000","last_unstale":"2024-09-13T19:19:05.919899+0000","last_undegraded":"2024-09-13T19:19:05.919899+0000","last_fullsized":"2024-09-13T19:19:05.919899+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:07:02.179917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.830677+0000","last_change":"2024-09-13T19:15:55.899327+0000","last_active":"2024-09-13T19:19:05.830677+0000","last_peered":"2024-09-13T19:19:05.830677+0000","last_clean":"2024-09-13T19:19:05.830677+0000","last_became_active":"2024-09-13T19:15:55.895444+0000","last_became_peered":"2024-09-13T19:15:55.895444+0000","last_unstale":"2024-09-13T19:19:05.830677+0000","last_undegraded":"2024-09-13T19:19:05.830677+0000","last_fullsized":"2024-09-13T19:19:05.830677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:01:17.850573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.986459+0000","last_change":"2024-09-13T19:15:59.895805+0000","last_active":"2024-09-13T19:16:31.986459+0000","last_peered":"2024-09-13T19:16:31.986459+0000","last_clean":"2024-09-13T19:16:31.986459+0000","last_became_active":"2024-09-13T19:15:59.895332+0000","last_became_peered":"2024-09-13T19:15:59.895332+0000","last_unstale":"2024-09-13T19:16:31.986459+0000","last_undegraded":"2024-09-13T19:16:31.986459+0000","last_fullsized":"2024-09-13T19:16:31.986459+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:50.391526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"34'10","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985590+0000","last_change":"2024-09-13T19:16:01.905730+0000","last_active":"2024-09-13T19:16:31.985590+0000","last_peered":"2024-09-13T19:16:31.985590+0000","last_clean":"2024-09-13T19:16:31.985590+0000","last_became_active":"2024-09-13T19:16:01.905457+0000","last_became_peered":"2024-09-13T19:16:01.905457+0000","last_unstale":"2024-09-13T19:16:31.985590+0000","last_undegraded":"2024-09-13T19:16:31.985590+0000","last_fullsized":"2024-09-13T19:16:31.985590+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:49.792682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"36'282","reported_seq":381,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:04.973465+0000","last_change":"2024-09-13T19:16:03.917127+0000","last_active":"2024-09-13T19:19:04.973465+0000","last_peered":"2024-09-13T19:19:04.973465+0000","last_clean":"2024-09-13T19:19:04.973465+0000","last_became_active":"2024-09-13T19:16:03.916853+0000","last_became_peered":"2024-09-13T19:16:03.916853+0000","last_unstale":"2024-09-13T19:19:04.973465+0000","last_undegraded":"2024-09-13T19:19:04.973465+0000","last_fullsized":"2024-09-13T19:19:04.973465+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:35:56.150634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"36'2","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.897376+0000","last_change":"2024-09-13T19:16:05.912480+0000","last_active":"2024-09-13T19:19:05.897376+0000","last_peered":"2024-09-13T19:19:05.897376+0000","last_clean":"2024-09-13T19:19:05.897376+0000","last_became_active":"2024-09-13T19:16:05.912191+0000","last_became_peered":"2024-09-13T19:16:05.912191+0000","last_unstale":"2024-09-13T19:19:05.897376+0000","last_undegraded":"2024-09-13T19:19:05.897376+0000","last_fullsized":"2024-09-13T19:19:05.897376+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:58.001697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"36'4","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.920393+0000","last_change":"2024-09-13T19:15:57.890567+0000","last_active":"2024-09-13T19:19:05.920393+0000","last_peered":"2024-09-13T19:19:05.920393+0000","last_clean":"2024-09-13T19:19:05.920393+0000","last_became_active":"2024-09-13T19:15:57.890015+0000","last_became_peered":"2024-09-13T19:15:57.890015+0000","last_unstale":"2024-09-13T19:19:05.920393+0000","last_undegraded":"2024-09-13T19:19:05.920393+0000","last_fullsized":"2024-09-13T19:19:05.920393+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:12.703558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.988304+0000","last_change":"2024-09-13T19:15:55.894913+0000","last_active":"2024-09-13T19:16:31.988304+0000","last_peered":"2024-09-13T19:16:31.988304+0000","last_clean":"2024-09-13T19:16:31.988304+0000","last_became_active":"2024-09-13T19:15:55.894380+0000","last_became_peered":"2024-09-13T19:15:55.894380+0000","last_unstale":"2024-09-13T19:16:31.988304+0000","last_undegraded":"2024-09-13T19:16:31.988304+0000","last_fullsized":"2024-09-13T19:16:31.988304+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:50:15.856299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984719+0000","last_change":"2024-09-13T19:15:59.897351+0000","last_active":"2024-09-13T19:16:31.984719+0000","last_peered":"2024-09-13T19:16:31.984719+0000","last_clean":"2024-09-13T19:16:31.984719+0000","last_became_active":"2024-09-13T19:15:59.896572+0000","last_became_peered":"2024-09-13T19:15:59.896572+0000","last_unstale":"2024-09-13T19:16:31.984719+0000","last_undegraded":"2024-09-13T19:16:31.984719+0000","last_fullsized":"2024-09-13T19:16:31.984719+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:59.226392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"36'30","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.150792+0000","last_change":"2024-09-13T19:16:01.906742+0000","last_active":"2024-09-13T19:18:03.150792+0000","last_peered":"2024-09-13T19:18:03.150792+0000","last_clean":"2024-09-13T19:18:03.150792+0000","last_became_active":"2024-09-13T19:16:01.906471+0000","last_became_peered":"2024-09-13T19:16:01.906471+0000","last_unstale":"2024-09-13T19:18:03.150792+0000","last_undegraded":"2024-09-13T19:18:03.150792+0000","last_fullsized":"2024-09-13T19:18:03.150792+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:06.655467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"36'282","reported_seq":410,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.964999+0000","last_change":"2024-09-13T19:16:03.909320+0000","last_active":"2024-09-13T19:19:05.964999+0000","last_peered":"2024-09-13T19:19:05.964999+0000","last_clean":"2024-09-13T19:19:05.964999+0000","last_became_active":"2024-09-13T19:16:03.909046+0000","last_became_peered":"2024-09-13T19:16:03.909046+0000","last_unstale":"2024-09-13T19:19:05.964999+0000","last_undegraded":"2024-09-13T19:19:05.964999+0000","last_fullsized":"2024-09-13T19:19:05.964999+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:17.180563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"36'16","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:01.383779+0000","last_change":"2024-09-13T19:16:31.997893+0000","last_active":"2024-09-13T19:18:01.383779+0000","last_peered":"2024-09-13T19:18:01.383779+0000","last_clean":"2024-09-13T19:18:01.383779+0000","last_became_active":"2024-09-13T19:16:31.991055+0000","last_became_peered":"2024-09-13T19:16:31.991055+0000","last_unstale":"2024-09-13T19:18:01.383779+0000","last_undegraded":"2024-09-13T19:18:01.383779+0000","last_fullsized":"2024-09-13T19:18:01.383779+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:44.244007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":73,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.986838+0000","last_change":"2024-09-13T19:15:55.893934+0000","last_active":"2024-09-13T19:16:31.986838+0000","last_peered":"2024-09-13T19:16:31.986838+0000","last_clean":"2024-09-13T19:16:31.986838+0000","last_became_active":"2024-09-13T19:15:55.893544+0000","last_became_peered":"2024-09-13T19:15:55.893544+0000","last_unstale":"2024-09-13T19:16:31.986838+0000","last_undegraded":"2024-09-13T19:16:31.986838+0000","last_fullsized":"2024-09-13T19:16:31.986838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:18:40.262875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.990140+0000","last_change":"2024-09-13T19:15:59.897690+0000","last_active":"2024-09-13T19:16:31.990140+0000","last_peered":"2024-09-13T19:16:31.990140+0000","last_clean":"2024-09-13T19:16:31.990140+0000","last_became_active":"2024-09-13T19:15:59.897435+0000","last_became_peered":"2024-09-13T19:15:59.897435+0000","last_unstale":"2024-09-13T19:16:31.990140+0000","last_undegraded":"2024-09-13T19:16:31.990140+0000","last_fullsized":"2024-09-13T19:16:31.990140+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:59:16.566449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"36'41","reported_seq":88,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:05.014107+0000","last_change":"2024-09-13T19:16:01.904848+0000","last_active":"2024-09-13T19:18:05.014107+0000","last_peered":"2024-09-13T19:18:05.014107+0000","last_clean":"2024-09-13T19:18:05.014107+0000","last_became_active":"2024-09-13T19:16:01.904454+0000","last_became_peered":"2024-09-13T19:16:01.904454+0000","last_unstale":"2024-09-13T19:18:05.014107+0000","last_undegraded":"2024-09-13T19:18:05.014107+0000","last_fullsized":"2024-09-13T19:18:05.014107+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:57.161122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984623+0000","last_change":"2024-09-13T19:16:03.912757+0000","last_active":"2024-09-13T19:16:31.984623+0000","last_peered":"2024-09-13T19:16:31.984623+0000","last_clean":"2024-09-13T19:16:31.984623+0000","last_became_active":"2024-09-13T19:16:03.912383+0000","last_became_peered":"2024-09-13T19:16:03.912383+0000","last_unstale":"2024-09-13T19:16:31.984623+0000","last_undegraded":"2024-09-13T19:16:31.984623+0000","last_fullsized":"2024-09-13T19:16:31.984623+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:51:11.448119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"36'5","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:20.746478+0000","last_change":"2024-09-13T19:16:05.919436+0000","last_active":"2024-09-13T19:17:20.746478+0000","last_peered":"2024-09-13T19:17:20.746478+0000","last_clean":"2024-09-13T19:17:20.746478+0000","last_became_active":"2024-09-13T19:16:05.919154+0000","last_became_peered":"2024-09-13T19:16:05.919154+0000","last_unstale":"2024-09-13T19:17:20.746478+0000","last_undegraded":"2024-09-13T19:17:20.746478+0000","last_fullsized":"2024-09-13T19:17:20.746478+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:37.455541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"36'3","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.929721+0000","last_change":"2024-09-13T19:15:57.890834+0000","last_active":"2024-09-13T19:19:05.929721+0000","last_peered":"2024-09-13T19:19:05.929721+0000","last_clean":"2024-09-13T19:19:05.929721+0000","last_became_active":"2024-09-13T19:15:57.890345+0000","last_became_peered":"2024-09-13T19:15:57.890345+0000","last_unstale":"2024-09-13T19:19:05.929721+0000","last_undegraded":"2024-09-13T19:19:05.929721+0000","last_fullsized":"2024-09-13T19:19:05.929721+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:57:17.627397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.833713+0000","last_change":"2024-09-13T19:15:55.891871+0000","last_active":"2024-09-13T19:19:05.833713+0000","last_peered":"2024-09-13T19:19:05.833713+0000","last_clean":"2024-09-13T19:19:05.833713+0000","last_became_active":"2024-09-13T19:15:55.891250+0000","last_became_peered":"2024-09-13T19:15:55.891250+0000","last_unstale":"2024-09-13T19:19:05.833713+0000","last_undegraded":"2024-09-13T19:19:05.833713+0000","last_fullsized":"2024-09-13T19:19:05.833713+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:28:19.256515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.983694+0000","last_change":"2024-09-13T19:15:59.891252+0000","last_active":"2024-09-13T19:16:31.983694+0000","last_peered":"2024-09-13T19:16:31.983694+0000","last_clean":"2024-09-13T19:16:31.983694+0000","last_became_active":"2024-09-13T19:15:59.891028+0000","last_became_peered":"2024-09-13T19:15:59.891028+0000","last_unstale":"2024-09-13T19:16:31.983694+0000","last_undegraded":"2024-09-13T19:16:31.983694+0000","last_fullsized":"2024-09-13T19:16:31.983694+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:30:01.518005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"36'30","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.140570+0000","last_change":"2024-09-13T19:16:01.904850+0000","last_active":"2024-09-13T19:18:03.140570+0000","last_peered":"2024-09-13T19:18:03.140570+0000","last_clean":"2024-09-13T19:18:03.140570+0000","last_became_active":"2024-09-13T19:16:01.904534+0000","last_became_peered":"2024-09-13T19:16:01.904534+0000","last_unstale":"2024-09-13T19:18:03.140570+0000","last_undegraded":"2024-09-13T19:18:03.140570+0000","last_fullsized":"2024-09-13T19:18:03.140570+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:00.451745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.983684+0000","last_change":"2024-09-13T19:16:03.914154+0000","last_active":"2024-09-13T19:16:31.983684+0000","last_peered":"2024-09-13T19:16:31.983684+0000","last_clean":"2024-09-13T19:16:31.983684+0000","last_became_active":"2024-09-13T19:16:03.913829+0000","last_became_peered":"2024-09-13T19:16:03.913829+0000","last_unstale":"2024-09-13T19:16:31.983684+0000","last_undegraded":"2024-09-13T19:16:31.983684+0000","last_fullsized":"2024-09-13T19:16:31.983684+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:43:05.803759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"36'3","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:15.156823+0000","last_change":"2024-09-13T19:16:05.913878+0000","last_active":"2024-09-13T19:17:15.156823+0000","last_peered":"2024-09-13T19:17:15.156823+0000","last_clean":"2024-09-13T19:17:15.156823+0000","last_became_active":"2024-09-13T19:16:05.913578+0000","last_became_peered":"2024-09-13T19:16:05.913578+0000","last_unstale":"2024-09-13T19:17:15.156823+0000","last_undegraded":"2024-09-13T19:17:15.156823+0000","last_fullsized":"2024-09-13T19:17:15.156823+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:39.890039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.986992+0000","last_change":"2024-09-13T19:15:57.898011+0000","last_active":"2024-09-13T19:16:31.986992+0000","last_peered":"2024-09-13T19:16:31.986992+0000","last_clean":"2024-09-13T19:16:31.986992+0000","last_became_active":"2024-09-13T19:15:57.897468+0000","last_became_peered":"2024-09-13T19:15:57.897468+0000","last_unstale":"2024-09-13T19:16:31.986992+0000","last_undegraded":"2024-09-13T19:16:31.986992+0000","last_fullsized":"2024-09-13T19:16:31.986992+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:27:40.220158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985332+0000","last_change":"2024-09-13T19:15:55.893786+0000","last_active":"2024-09-13T19:16:31.985332+0000","last_peered":"2024-09-13T19:16:31.985332+0000","last_clean":"2024-09-13T19:16:31.985332+0000","last_became_active":"2024-09-13T19:15:55.893489+0000","last_became_peered":"2024-09-13T19:15:55.893489+0000","last_unstale":"2024-09-13T19:16:31.985332+0000","last_undegraded":"2024-09-13T19:16:31.985332+0000","last_fullsized":"2024-09-13T19:16:31.985332+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:43.870700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985334+0000","last_change":"2024-09-13T19:15:59.895668+0000","last_active":"2024-09-13T19:16:31.985334+0000","last_peered":"2024-09-13T19:16:31.985334+0000","last_clean":"2024-09-13T19:16:31.985334+0000","last_became_active":"2024-09-13T19:15:59.895291+0000","last_became_peered":"2024-09-13T19:15:59.895291+0000","last_unstale":"2024-09-13T19:16:31.985334+0000","last_undegraded":"2024-09-13T19:16:31.985334+0000","last_fullsized":"2024-09-13T19:16:31.985334+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:26.583265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"36'36","reported_seq":81,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.161853+0000","last_change":"2024-09-13T19:16:01.896793+0000","last_active":"2024-09-13T19:18:03.161853+0000","last_peered":"2024-09-13T19:18:03.161853+0000","last_clean":"2024-09-13T19:18:03.161853+0000","last_became_active":"2024-09-13T19:16:01.896507+0000","last_became_peered":"2024-09-13T19:16:01.896507+0000","last_unstale":"2024-09-13T19:18:03.161853+0000","last_undegraded":"2024-09-13T19:18:03.161853+0000","last_fullsized":"2024-09-13T19:18:03.161853+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:36.387463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"36'282","reported_seq":375,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.241587+0000","last_change":"2024-09-13T19:16:03.911636+0000","last_active":"2024-09-13T19:19:06.241587+0000","last_peered":"2024-09-13T19:19:06.241587+0000","last_clean":"2024-09-13T19:19:06.241587+0000","last_became_active":"2024-09-13T19:16:03.910504+0000","last_became_peered":"2024-09-13T19:16:03.910504+0000","last_unstale":"2024-09-13T19:19:06.241587+0000","last_undegraded":"2024-09-13T19:19:06.241587+0000","last_fullsized":"2024-09-13T19:19:06.241587+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:47.820382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"36'4","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:20.736275+0000","last_change":"2024-09-13T19:16:05.913148+0000","last_active":"2024-09-13T19:17:20.736275+0000","last_peered":"2024-09-13T19:17:20.736275+0000","last_clean":"2024-09-13T19:17:20.736275+0000","last_became_active":"2024-09-13T19:16:05.912881+0000","last_became_peered":"2024-09-13T19:16:05.912881+0000","last_unstale":"2024-09-13T19:17:20.736275+0000","last_undegraded":"2024-09-13T19:17:20.736275+0000","last_fullsized":"2024-09-13T19:17:20.736275+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:52:47.776691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"36'4","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.696199+0000","last_change":"2024-09-13T19:15:57.884610+0000","last_active":"2024-09-13T19:19:05.696199+0000","last_peered":"2024-09-13T19:19:05.696199+0000","last_clean":"2024-09-13T19:19:05.696199+0000","last_became_active":"2024-09-13T19:15:57.883675+0000","last_became_peered":"2024-09-13T19:15:57.883675+0000","last_unstale":"2024-09-13T19:19:05.696199+0000","last_undegraded":"2024-09-13T19:19:05.696199+0000","last_fullsized":"2024-09-13T19:19:05.696199+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:14.821792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"36'6","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:13.941865+0000","last_change":"2024-09-13T19:15:55.892801+0000","last_active":"2024-09-13T19:18:13.941865+0000","last_peered":"2024-09-13T19:18:13.941865+0000","last_clean":"2024-09-13T19:18:13.941865+0000","last_became_active":"2024-09-13T19:15:55.891882+0000","last_became_peered":"2024-09-13T19:15:55.891882+0000","last_unstale":"2024-09-13T19:18:13.941865+0000","last_undegraded":"2024-09-13T19:18:13.941865+0000","last_fullsized":"2024-09-13T19:18:13.941865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:04.866489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":15,"num_write_kb":4722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:33.926996+0000","last_change":"2024-09-13T19:16:31.992973+0000","last_active":"2024-09-13T19:16:33.926996+0000","last_peered":"2024-09-13T19:16:33.926996+0000","last_clean":"2024-09-13T19:16:33.926996+0000","last_became_active":"2024-09-13T19:16:31.992122+0000","last_became_peered":"2024-09-13T19:16:31.992122+0000","last_unstale":"2024-09-13T19:16:33.926996+0000","last_undegraded":"2024-09-13T19:16:33.926996+0000","last_fullsized":"2024-09-13T19:16:33.926996+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:17.756694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"36'55","reported_seq":111,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.163816+0000","last_change":"2024-09-13T19:16:01.906341+0000","last_active":"2024-09-13T19:18:03.163816+0000","last_peered":"2024-09-13T19:18:03.163816+0000","last_clean":"2024-09-13T19:18:03.163816+0000","last_became_active":"2024-09-13T19:16:01.906031+0000","last_became_peered":"2024-09-13T19:16:01.906031+0000","last_unstale":"2024-09-13T19:18:03.163816+0000","last_undegraded":"2024-09-13T19:18:03.163816+0000","last_fullsized":"2024-09-13T19:18:03.163816+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:10:29.683024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.983190+0000","last_change":"2024-09-13T19:16:03.908434+0000","last_active":"2024-09-13T19:16:31.983190+0000","last_peered":"2024-09-13T19:16:31.983190+0000","last_clean":"2024-09-13T19:16:31.983190+0000","last_became_active":"2024-09-13T19:16:03.908134+0000","last_became_peered":"2024-09-13T19:16:03.908134+0000","last_unstale":"2024-09-13T19:16:31.983190+0000","last_undegraded":"2024-09-13T19:16:31.983190+0000","last_fullsized":"2024-09-13T19:16:31.983190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:49:37.071802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"36'18","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.183081+0000","last_change":"2024-09-13T19:16:05.915102+0000","last_active":"2024-09-13T19:19:06.183081+0000","last_peered":"2024-09-13T19:19:06.183081+0000","last_clean":"2024-09-13T19:19:06.183081+0000","last_became_active":"2024-09-13T19:16:05.914853+0000","last_became_peered":"2024-09-13T19:16:05.914853+0000","last_unstale":"2024-09-13T19:19:06.183081+0000","last_undegraded":"2024-09-13T19:19:06.183081+0000","last_fullsized":"2024-09-13T19:19:06.183081+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:59.082750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"36'6","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.700154+0000","last_change":"2024-09-13T19:15:57.903310+0000","last_active":"2024-09-13T19:19:05.700154+0000","last_peered":"2024-09-13T19:19:05.700154+0000","last_clean":"2024-09-13T19:19:05.700154+0000","last_became_active":"2024-09-13T19:15:57.902955+0000","last_became_peered":"2024-09-13T19:15:57.902955+0000","last_unstale":"2024-09-13T19:19:05.700154+0000","last_undegraded":"2024-09-13T19:19:05.700154+0000","last_fullsized":"2024-09-13T19:19:05.700154+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:45.877283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984439+0000","last_change":"2024-09-13T19:15:55.891315+0000","last_active":"2024-09-13T19:16:31.984439+0000","last_peered":"2024-09-13T19:16:31.984439+0000","last_clean":"2024-09-13T19:16:31.984439+0000","last_became_active":"2024-09-13T19:15:55.890805+0000","last_became_peered":"2024-09-13T19:15:55.890805+0000","last_unstale":"2024-09-13T19:16:31.984439+0000","last_undegraded":"2024-09-13T19:16:31.984439+0000","last_fullsized":"2024-09-13T19:16:31.984439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:20.126050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.987047+0000","last_change":"2024-09-13T19:15:59.898184+0000","last_active":"2024-09-13T19:16:31.987047+0000","last_peered":"2024-09-13T19:16:31.987047+0000","last_clean":"2024-09-13T19:16:31.987047+0000","last_became_active":"2024-09-13T19:15:59.897884+0000","last_became_peered":"2024-09-13T19:15:59.897884+0000","last_unstale":"2024-09-13T19:16:31.987047+0000","last_undegraded":"2024-09-13T19:16:31.987047+0000","last_fullsized":"2024-09-13T19:16:31.987047+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:34.869944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"36'33","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:18.942178+0000","last_change":"2024-09-13T19:16:01.903021+0000","last_active":"2024-09-13T19:18:18.942178+0000","last_peered":"2024-09-13T19:18:18.942178+0000","last_clean":"2024-09-13T19:18:18.942178+0000","last_became_active":"2024-09-13T19:16:01.902657+0000","last_became_peered":"2024-09-13T19:16:01.902657+0000","last_unstale":"2024-09-13T19:18:18.942178+0000","last_undegraded":"2024-09-13T19:18:18.942178+0000","last_fullsized":"2024-09-13T19:18:18.942178+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:41.157697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5807,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":27,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984486+0000","last_change":"2024-09-13T19:16:03.915798+0000","last_active":"2024-09-13T19:16:31.984486+0000","last_peered":"2024-09-13T19:16:31.984486+0000","last_clean":"2024-09-13T19:16:31.984486+0000","last_became_active":"2024-09-13T19:16:03.915499+0000","last_became_peered":"2024-09-13T19:16:03.915499+0000","last_unstale":"2024-09-13T19:16:31.984486+0000","last_undegraded":"2024-09-13T19:16:31.984486+0000","last_fullsized":"2024-09-13T19:16:31.984486+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:32.988972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"36'3","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:08.940888+0000","last_change":"2024-09-13T19:16:05.920534+0000","last_active":"2024-09-13T19:18:08.940888+0000","last_peered":"2024-09-13T19:18:08.940888+0000","last_clean":"2024-09-13T19:18:08.940888+0000","last_became_active":"2024-09-13T19:16:05.920239+0000","last_became_peered":"2024-09-13T19:16:05.920239+0000","last_unstale":"2024-09-13T19:18:08.940888+0000","last_undegraded":"2024-09-13T19:18:08.940888+0000","last_fullsized":"2024-09-13T19:18:08.940888+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:56.959074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"36'8","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.920365+0000","last_change":"2024-09-13T19:15:57.901642+0000","last_active":"2024-09-13T19:19:05.920365+0000","last_peered":"2024-09-13T19:19:05.920365+0000","last_clean":"2024-09-13T19:19:05.920365+0000","last_became_active":"2024-09-13T19:15:57.901131+0000","last_became_peered":"2024-09-13T19:15:57.901131+0000","last_unstale":"2024-09-13T19:19:05.920365+0000","last_undegraded":"2024-09-13T19:19:05.920365+0000","last_fullsized":"2024-09-13T19:19:05.920365+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:14:23.651972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.982818+0000","last_change":"2024-09-13T19:15:55.900444+0000","last_active":"2024-09-13T19:16:31.982818+0000","last_peered":"2024-09-13T19:16:31.982818+0000","last_clean":"2024-09-13T19:16:31.982818+0000","last_became_active":"2024-09-13T19:15:55.900143+0000","last_became_peered":"2024-09-13T19:15:55.900143+0000","last_unstale":"2024-09-13T19:16:31.982818+0000","last_undegraded":"2024-09-13T19:16:31.982818+0000","last_fullsized":"2024-09-13T19:16:31.982818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:35.770490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984163+0000","last_change":"2024-09-13T19:15:59.895249+0000","last_active":"2024-09-13T19:16:31.984163+0000","last_peered":"2024-09-13T19:16:31.984163+0000","last_clean":"2024-09-13T19:16:31.984163+0000","last_became_active":"2024-09-13T19:15:59.894793+0000","last_became_peered":"2024-09-13T19:15:59.894793+0000","last_unstale":"2024-09-13T19:16:31.984163+0000","last_undegraded":"2024-09-13T19:16:31.984163+0000","last_fullsized":"2024-09-13T19:16:31.984163+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:00:58.200294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"36'36","reported_seq":81,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.170094+0000","last_change":"2024-09-13T19:16:01.898005+0000","last_active":"2024-09-13T19:18:03.170094+0000","last_peered":"2024-09-13T19:18:03.170094+0000","last_clean":"2024-09-13T19:18:03.170094+0000","last_became_active":"2024-09-13T19:16:01.897733+0000","last_became_peered":"2024-09-13T19:16:01.897733+0000","last_unstale":"2024-09-13T19:18:03.170094+0000","last_undegraded":"2024-09-13T19:18:03.170094+0000","last_fullsized":"2024-09-13T19:18:03.170094+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:59:18.573044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"36'282","reported_seq":409,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.187004+0000","last_change":"2024-09-13T19:16:03.916031+0000","last_active":"2024-09-13T19:19:06.187004+0000","last_peered":"2024-09-13T19:19:06.187004+0000","last_clean":"2024-09-13T19:19:06.187004+0000","last_became_active":"2024-09-13T19:16:03.915589+0000","last_became_peered":"2024-09-13T19:16:03.915589+0000","last_unstale":"2024-09-13T19:19:06.187004+0000","last_undegraded":"2024-09-13T19:19:06.187004+0000","last_fullsized":"2024-09-13T19:19:06.187004+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:43.165549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"36'12","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:11.936636+0000","last_change":"2024-09-13T19:16:05.912837+0000","last_active":"2024-09-13T19:18:11.936636+0000","last_peered":"2024-09-13T19:18:11.936636+0000","last_clean":"2024-09-13T19:18:11.936636+0000","last_became_active":"2024-09-13T19:16:05.912339+0000","last_became_peered":"2024-09-13T19:16:05.912339+0000","last_unstale":"2024-09-13T19:18:11.936636+0000","last_undegraded":"2024-09-13T19:18:11.936636+0000","last_fullsized":"2024-09-13T19:18:11.936636+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:59.279329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"36'6","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:38.868840+0000","last_change":"2024-09-13T19:15:57.900840+0000","last_active":"2024-09-13T19:16:38.868840+0000","last_peered":"2024-09-13T19:16:38.868840+0000","last_clean":"2024-09-13T19:16:38.868840+0000","last_became_active":"2024-09-13T19:15:57.900560+0000","last_became_peered":"2024-09-13T19:15:57.900560+0000","last_unstale":"2024-09-13T19:16:38.868840+0000","last_undegraded":"2024-09-13T19:16:38.868840+0000","last_fullsized":"2024-09-13T19:16:38.868840+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:00.474958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.982771+0000","last_change":"2024-09-13T19:15:55.897670+0000","last_active":"2024-09-13T19:16:31.982771+0000","last_peered":"2024-09-13T19:16:31.982771+0000","last_clean":"2024-09-13T19:16:31.982771+0000","last_became_active":"2024-09-13T19:15:55.895799+0000","last_became_peered":"2024-09-13T19:15:55.895799+0000","last_unstale":"2024-09-13T19:16:31.982771+0000","last_undegraded":"2024-09-13T19:16:31.982771+0000","last_fullsized":"2024-09-13T19:16:31.982771+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:36.836879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'3","reported_seq":413,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:04.365221+0000","last_change":"2024-09-13T19:15:59.894637+0000","last_active":"2024-09-13T19:18:04.365221+0000","last_peered":"2024-09-13T19:18:04.365221+0000","last_clean":"2024-09-13T19:18:04.365221+0000","last_became_active":"2024-09-13T19:15:59.894303+0000","last_became_peered":"2024-09-13T19:15:59.894303+0000","last_unstale":"2024-09-13T19:18:04.365221+0000","last_undegraded":"2024-09-13T19:18:04.365221+0000","last_fullsized":"2024-09-13T19:18:04.365221+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:57.476409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"34'10","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.983512+0000","last_change":"2024-09-13T19:16:01.906838+0000","last_active":"2024-09-13T19:16:31.983512+0000","last_peered":"2024-09-13T19:16:31.983512+0000","last_clean":"2024-09-13T19:16:31.983512+0000","last_became_active":"2024-09-13T19:16:01.906490+0000","last_became_peered":"2024-09-13T19:16:01.906490+0000","last_unstale":"2024-09-13T19:16:31.983512+0000","last_undegraded":"2024-09-13T19:16:31.983512+0000","last_fullsized":"2024-09-13T19:16:31.983512+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:37.861718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"36'282","reported_seq":499,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.068344+0000","last_change":"2024-09-13T19:16:03.905840+0000","last_active":"2024-09-13T19:19:06.068344+0000","last_peered":"2024-09-13T19:19:06.068344+0000","last_clean":"2024-09-13T19:19:06.068344+0000","last_became_active":"2024-09-13T19:16:03.905523+0000","last_became_peered":"2024-09-13T19:16:03.905523+0000","last_unstale":"2024-09-13T19:19:06.068344+0000","last_undegraded":"2024-09-13T19:19:06.068344+0000","last_fullsized":"2024-09-13T19:19:06.068344+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:24.576600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"36'4","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:04.643906+0000","last_change":"2024-09-13T19:16:05.910975+0000","last_active":"2024-09-13T19:18:04.643906+0000","last_peered":"2024-09-13T19:18:04.643906+0000","last_clean":"2024-09-13T19:18:04.643906+0000","last_became_active":"2024-09-13T19:16:05.910656+0000","last_became_peered":"2024-09-13T19:16:05.910656+0000","last_unstale":"2024-09-13T19:18:04.643906+0000","last_undegraded":"2024-09-13T19:18:04.643906+0000","last_fullsized":"2024-09-13T19:18:04.643906+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:04:51.033264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"36'3","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:13.941421+0000","last_change":"2024-09-13T19:15:57.904037+0000","last_active":"2024-09-13T19:18:13.941421+0000","last_peered":"2024-09-13T19:18:13.941421+0000","last_clean":"2024-09-13T19:18:13.941421+0000","last_became_active":"2024-09-13T19:15:57.903761+0000","last_became_peered":"2024-09-13T19:15:57.903761+0000","last_unstale":"2024-09-13T19:18:13.941421+0000","last_undegraded":"2024-09-13T19:18:13.941421+0000","last_fullsized":"2024-09-13T19:18:13.941421+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:35:04.649421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.981607+0000","last_change":"2024-09-13T19:15:55.900225+0000","last_active":"2024-09-13T19:16:31.981607+0000","last_peered":"2024-09-13T19:16:31.981607+0000","last_clean":"2024-09-13T19:16:31.981607+0000","last_became_active":"2024-09-13T19:15:55.899919+0000","last_became_peered":"2024-09-13T19:15:55.899919+0000","last_unstale":"2024-09-13T19:16:31.981607+0000","last_undegraded":"2024-09-13T19:16:31.981607+0000","last_fullsized":"2024-09-13T19:16:31.981607+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:05.080518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"36'4","reported_seq":226,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:04.355954+0000","last_change":"2024-09-13T19:15:59.897278+0000","last_active":"2024-09-13T19:18:04.355954+0000","last_peered":"2024-09-13T19:18:04.355954+0000","last_clean":"2024-09-13T19:18:04.355954+0000","last_became_active":"2024-09-13T19:15:59.896081+0000","last_became_peered":"2024-09-13T19:15:59.896081+0000","last_unstale":"2024-09-13T19:18:04.355954+0000","last_undegraded":"2024-09-13T19:18:04.355954+0000","last_fullsized":"2024-09-13T19:18:04.355954+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:24:49.015447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"36'39","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.157144+0000","last_change":"2024-09-13T19:16:01.902853+0000","last_active":"2024-09-13T19:18:03.157144+0000","last_peered":"2024-09-13T19:18:03.157144+0000","last_clean":"2024-09-13T19:18:03.157144+0000","last_became_active":"2024-09-13T19:16:01.902532+0000","last_became_peered":"2024-09-13T19:16:01.902532+0000","last_unstale":"2024-09-13T19:18:03.157144+0000","last_undegraded":"2024-09-13T19:18:03.157144+0000","last_fullsized":"2024-09-13T19:18:03.157144+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:31:43.981533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985458+0000","last_change":"2024-09-13T19:16:03.913346+0000","last_active":"2024-09-13T19:16:31.985458+0000","last_peered":"2024-09-13T19:16:31.985458+0000","last_clean":"2024-09-13T19:16:31.985458+0000","last_became_active":"2024-09-13T19:16:03.913019+0000","last_became_peered":"2024-09-13T19:16:03.913019+0000","last_unstale":"2024-09-13T19:16:31.985458+0000","last_undegraded":"2024-09-13T19:16:31.985458+0000","last_fullsized":"2024-09-13T19:16:31.985458+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:24.528793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"36'8","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.020235+0000","last_change":"2024-09-13T19:16:05.911657+0000","last_active":"2024-09-13T19:19:06.020235+0000","last_peered":"2024-09-13T19:19:06.020235+0000","last_clean":"2024-09-13T19:19:06.020235+0000","last_became_active":"2024-09-13T19:16:05.911364+0000","last_became_peered":"2024-09-13T19:16:05.911364+0000","last_unstale":"2024-09-13T19:19:06.020235+0000","last_undegraded":"2024-09-13T19:19:06.020235+0000","last_fullsized":"2024-09-13T19:19:06.020235+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:04.570906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"36'13","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.969400+0000","last_change":"2024-09-13T19:15:57.901609+0000","last_active":"2024-09-13T19:19:05.969400+0000","last_peered":"2024-09-13T19:19:05.969400+0000","last_clean":"2024-09-13T19:19:05.969400+0000","last_became_active":"2024-09-13T19:15:57.900905+0000","last_became_peered":"2024-09-13T19:15:57.900905+0000","last_unstale":"2024-09-13T19:19:05.969400+0000","last_undegraded":"2024-09-13T19:19:05.969400+0000","last_fullsized":"2024-09-13T19:19:05.969400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:12:06.491226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":205,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.988269+0000","last_change":"2024-09-13T19:15:41.170734+0000","last_active":"2024-09-13T19:16:31.988269+0000","last_peered":"2024-09-13T19:16:31.988269+0000","last_clean":"2024-09-13T19:16:31.988269+0000","last_became_active":"2024-09-13T19:15:41.169707+0000","last_became_peered":"2024-09-13T19:15:41.169707+0000","last_unstale":"2024-09-13T19:16:31.988269+0000","last_undegraded":"2024-09-13T19:16:31.988269+0000","last_fullsized":"2024-09-13T19:16:31.988269+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:39.557965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:39.557965+0000","last_clean_scrub_stamp":"2024-09-13T19:15:39.557965+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:40:20.817136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.982316+0000","last_change":"2024-09-13T19:15:46.580815+0000","last_active":"2024-09-13T19:16:31.982316+0000","last_peered":"2024-09-13T19:16:31.982316+0000","last_clean":"2024-09-13T19:16:31.982316+0000","last_became_active":"2024-09-13T19:15:44.577382+0000","last_became_peered":"2024-09-13T19:15:44.577382+0000","last_unstale":"2024-09-13T19:16:31.982316+0000","last_undegraded":"2024-09-13T19:16:31.982316+0000","last_fullsized":"2024-09-13T19:16:31.982316+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:47.750191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047916199999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.981982+0000","last_change":"2024-09-13T19:15:55.900746+0000","last_active":"2024-09-13T19:16:31.981982+0000","last_peered":"2024-09-13T19:16:31.981982+0000","last_clean":"2024-09-13T19:16:31.981982+0000","last_became_active":"2024-09-13T19:15:55.899672+0000","last_became_peered":"2024-09-13T19:15:55.899672+0000","last_unstale":"2024-09-13T19:16:31.981982+0000","last_undegraded":"2024-09-13T19:16:31.981982+0000","last_fullsized":"2024-09-13T19:16:31.981982+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:57:15.620815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.991398+0000","last_change":"2024-09-13T19:15:59.891901+0000","last_active":"2024-09-13T19:16:31.991398+0000","last_peered":"2024-09-13T19:16:31.991398+0000","last_clean":"2024-09-13T19:16:31.991398+0000","last_became_active":"2024-09-13T19:15:59.891615+0000","last_became_peered":"2024-09-13T19:15:59.891615+0000","last_unstale":"2024-09-13T19:16:31.991398+0000","last_undegraded":"2024-09-13T19:16:31.991398+0000","last_fullsized":"2024-09-13T19:16:31.991398+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:37.130876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"36'76","reported_seq":145,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.167978+0000","last_change":"2024-09-13T19:16:01.905525+0000","last_active":"2024-09-13T19:18:03.167978+0000","last_peered":"2024-09-13T19:18:03.167978+0000","last_clean":"2024-09-13T19:18:03.167978+0000","last_became_active":"2024-09-13T19:16:01.905085+0000","last_became_peered":"2024-09-13T19:16:01.905085+0000","last_unstale":"2024-09-13T19:18:03.167978+0000","last_undegraded":"2024-09-13T19:18:03.167978+0000","last_fullsized":"2024-09-13T19:18:03.167978+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:13:47.049154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985422+0000","last_change":"2024-09-13T19:16:03.914155+0000","last_active":"2024-09-13T19:16:31.985422+0000","last_peered":"2024-09-13T19:16:31.985422+0000","last_clean":"2024-09-13T19:16:31.985422+0000","last_became_active":"2024-09-13T19:16:03.913802+0000","last_became_peered":"2024-09-13T19:16:03.913802+0000","last_unstale":"2024-09-13T19:16:31.985422+0000","last_undegraded":"2024-09-13T19:16:31.985422+0000","last_fullsized":"2024-09-13T19:16:31.985422+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:22.123364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"36'89","reported_seq":187,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.972680+0000","last_change":"2024-09-13T19:16:05.911930+0000","last_active":"2024-09-13T19:19:05.972680+0000","last_peered":"2024-09-13T19:19:05.972680+0000","last_clean":"2024-09-13T19:19:05.972680+0000","last_became_active":"2024-09-13T19:16:05.911595+0000","last_became_peered":"2024-09-13T19:16:05.911595+0000","last_unstale":"2024-09-13T19:19:05.972680+0000","last_undegraded":"2024-09-13T19:19:05.972680+0000","last_fullsized":"2024-09-13T19:19:05.972680+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:14:31.680165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":289,"num_read_kb":269,"num_write":182,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"36'4","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:20.922687+0000","last_change":"2024-09-13T19:15:57.897546+0000","last_active":"2024-09-13T19:17:20.922687+0000","last_peered":"2024-09-13T19:17:20.922687+0000","last_clean":"2024-09-13T19:17:20.922687+0000","last_became_active":"2024-09-13T19:15:57.897307+0000","last_became_peered":"2024-09-13T19:15:57.897307+0000","last_unstale":"2024-09-13T19:17:20.922687+0000","last_undegraded":"2024-09-13T19:17:20.922687+0000","last_fullsized":"2024-09-13T19:17:20.922687+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:49.283391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.981198+0000","last_change":"2024-09-13T19:15:46.581436+0000","last_active":"2024-09-13T19:16:31.981198+0000","last_peered":"2024-09-13T19:16:31.981198+0000","last_clean":"2024-09-13T19:16:31.981198+0000","last_became_active":"2024-09-13T19:15:44.576304+0000","last_became_peered":"2024-09-13T19:15:44.576304+0000","last_unstale":"2024-09-13T19:16:31.981198+0000","last_undegraded":"2024-09-13T19:16:31.981198+0000","last_fullsized":"2024-09-13T19:16:31.981198+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:57.538288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011332060000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"36'4","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:38.347356+0000","last_change":"2024-09-13T19:15:55.891911+0000","last_active":"2024-09-13T19:16:38.347356+0000","last_peered":"2024-09-13T19:16:38.347356+0000","last_clean":"2024-09-13T19:16:38.347356+0000","last_became_active":"2024-09-13T19:15:55.891377+0000","last_became_peered":"2024-09-13T19:15:55.891377+0000","last_unstale":"2024-09-13T19:16:38.347356+0000","last_undegraded":"2024-09-13T19:16:38.347356+0000","last_fullsized":"2024-09-13T19:16:38.347356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:12.598004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985654+0000","last_change":"2024-09-13T19:15:59.896527+0000","last_active":"2024-09-13T19:16:31.985654+0000","last_peered":"2024-09-13T19:16:31.985654+0000","last_clean":"2024-09-13T19:16:31.985654+0000","last_became_active":"2024-09-13T19:15:59.896248+0000","last_became_peered":"2024-09-13T19:15:59.896248+0000","last_unstale":"2024-09-13T19:16:31.985654+0000","last_undegraded":"2024-09-13T19:16:31.985654+0000","last_fullsized":"2024-09-13T19:16:31.985654+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:49.569002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"36'274","reported_seq":477,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.855714+0000","last_change":"2024-09-13T19:16:01.907411+0000","last_active":"2024-09-13T19:19:05.855714+0000","last_peered":"2024-09-13T19:19:05.855714+0000","last_clean":"2024-09-13T19:19:05.855714+0000","last_became_active":"2024-09-13T19:16:01.907024+0000","last_became_peered":"2024-09-13T19:16:01.907024+0000","last_unstale":"2024-09-13T19:19:05.855714+0000","last_undegraded":"2024-09-13T19:19:05.855714+0000","last_fullsized":"2024-09-13T19:19:05.855714+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:22.520942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.982628+0000","last_change":"2024-09-13T19:16:03.916021+0000","last_active":"2024-09-13T19:16:31.982628+0000","last_peered":"2024-09-13T19:16:31.982628+0000","last_clean":"2024-09-13T19:16:31.982628+0000","last_became_active":"2024-09-13T19:16:03.915712+0000","last_became_peered":"2024-09-13T19:16:03.915712+0000","last_unstale":"2024-09-13T19:16:31.982628+0000","last_undegraded":"2024-09-13T19:16:31.982628+0000","last_fullsized":"2024-09-13T19:16:31.982628+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:48.381454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"36'3","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:20.742805+0000","last_change":"2024-09-13T19:16:05.917279+0000","last_active":"2024-09-13T19:17:20.742805+0000","last_peered":"2024-09-13T19:17:20.742805+0000","last_clean":"2024-09-13T19:17:20.742805+0000","last_became_active":"2024-09-13T19:16:05.916999+0000","last_became_peered":"2024-09-13T19:16:05.916999+0000","last_unstale":"2024-09-13T19:17:20.742805+0000","last_undegraded":"2024-09-13T19:17:20.742805+0000","last_fullsized":"2024-09-13T19:17:20.742805+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:56:17.231660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.986198+0000","last_change":"2024-09-13T19:15:57.890320+0000","last_active":"2024-09-13T19:16:31.986198+0000","last_peered":"2024-09-13T19:16:31.986198+0000","last_clean":"2024-09-13T19:16:31.986198+0000","last_became_active":"2024-09-13T19:15:57.889885+0000","last_became_peered":"2024-09-13T19:15:57.889885+0000","last_unstale":"2024-09-13T19:16:31.986198+0000","last_undegraded":"2024-09-13T19:16:31.986198+0000","last_fullsized":"2024-09-13T19:16:31.986198+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:45:51.717296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.983888+0000","last_change":"2024-09-13T19:15:47.256565+0000","last_active":"2024-09-13T19:16:31.983888+0000","last_peered":"2024-09-13T19:16:31.983888+0000","last_clean":"2024-09-13T19:16:31.983888+0000","last_became_active":"2024-09-13T19:15:44.575483+0000","last_became_peered":"2024-09-13T19:15:44.575483+0000","last_unstale":"2024-09-13T19:16:31.983888+0000","last_undegraded":"2024-09-13T19:16:31.983888+0000","last_fullsized":"2024-09-13T19:16:31.983888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:05:11.992289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036796000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"36'6","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:38.361020+0000","last_change":"2024-09-13T19:15:55.892997+0000","last_active":"2024-09-13T19:16:38.361020+0000","last_peered":"2024-09-13T19:16:38.361020+0000","last_clean":"2024-09-13T19:16:38.361020+0000","last_became_active":"2024-09-13T19:15:55.892629+0000","last_became_peered":"2024-09-13T19:15:55.892629+0000","last_unstale":"2024-09-13T19:16:38.361020+0000","last_undegraded":"2024-09-13T19:16:38.361020+0000","last_fullsized":"2024-09-13T19:16:38.361020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:35:23.726304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"27'1","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.986613+0000","last_change":"2024-09-13T19:15:59.892045+0000","last_active":"2024-09-13T19:16:31.986613+0000","last_peered":"2024-09-13T19:16:31.986613+0000","last_clean":"2024-09-13T19:16:31.986613+0000","last_became_active":"2024-09-13T19:15:59.891588+0000","last_became_peered":"2024-09-13T19:15:59.891588+0000","last_unstale":"2024-09-13T19:16:31.986613+0000","last_undegraded":"2024-09-13T19:16:31.986613+0000","last_fullsized":"2024-09-13T19:16:31.986613+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:31:11.012170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'16","reported_seq":84,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:04.973539+0000","last_change":"2024-09-13T19:16:01.904560+0000","last_active":"2024-09-13T19:19:04.973539+0000","last_peered":"2024-09-13T19:19:04.973539+0000","last_clean":"2024-09-13T19:19:04.973539+0000","last_became_active":"2024-09-13T19:16:01.903947+0000","last_became_peered":"2024-09-13T19:16:01.903947+0000","last_unstale":"2024-09-13T19:19:04.973539+0000","last_undegraded":"2024-09-13T19:19:04.973539+0000","last_fullsized":"2024-09-13T19:19:04.973539+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:50.008512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984720+0000","last_change":"2024-09-13T19:16:03.911563+0000","last_active":"2024-09-13T19:16:31.984720+0000","last_peered":"2024-09-13T19:16:31.984720+0000","last_clean":"2024-09-13T19:16:31.984720+0000","last_became_active":"2024-09-13T19:16:03.910776+0000","last_became_peered":"2024-09-13T19:16:03.910776+0000","last_unstale":"2024-09-13T19:16:31.984720+0000","last_undegraded":"2024-09-13T19:16:31.984720+0000","last_fullsized":"2024-09-13T19:16:31.984720+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:23:18.198813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"36'2","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.612807+0000","last_change":"2024-09-13T19:16:05.920464+0000","last_active":"2024-09-13T19:19:05.612807+0000","last_peered":"2024-09-13T19:19:05.612807+0000","last_clean":"2024-09-13T19:19:05.612807+0000","last_became_active":"2024-09-13T19:16:05.920191+0000","last_became_peered":"2024-09-13T19:16:05.920191+0000","last_unstale":"2024-09-13T19:19:05.612807+0000","last_undegraded":"2024-09-13T19:19:05.612807+0000","last_fullsized":"2024-09-13T19:19:05.612807+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:52:02.982809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"36'12","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:05.005403+0000","last_change":"2024-09-13T19:15:57.886935+0000","last_active":"2024-09-13T19:18:05.005403+0000","last_peered":"2024-09-13T19:18:05.005403+0000","last_clean":"2024-09-13T19:18:05.005403+0000","last_became_active":"2024-09-13T19:15:57.886273+0000","last_became_peered":"2024-09-13T19:15:57.886273+0000","last_unstale":"2024-09-13T19:18:05.005403+0000","last_undegraded":"2024-09-13T19:18:05.005403+0000","last_fullsized":"2024-09-13T19:18:05.005403+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:58.238081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":44,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.981722+0000","last_change":"2024-09-13T19:15:46.581526+0000","last_active":"2024-09-13T19:16:31.981722+0000","last_peered":"2024-09-13T19:16:31.981722+0000","last_clean":"2024-09-13T19:16:31.981722+0000","last_became_active":"2024-09-13T19:15:44.576052+0000","last_became_peered":"2024-09-13T19:15:44.576052+0000","last_unstale":"2024-09-13T19:16:31.981722+0000","last_undegraded":"2024-09-13T19:16:31.981722+0000","last_fullsized":"2024-09-13T19:16:31.981722+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:33.633045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012221599999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.824572+0000","last_change":"2024-09-13T19:15:55.892933+0000","last_active":"2024-09-13T19:19:05.824572+0000","last_peered":"2024-09-13T19:19:05.824572+0000","last_clean":"2024-09-13T19:19:05.824572+0000","last_became_active":"2024-09-13T19:15:55.892636+0000","last_became_peered":"2024-09-13T19:15:55.892636+0000","last_unstale":"2024-09-13T19:19:05.824572+0000","last_undegraded":"2024-09-13T19:19:05.824572+0000","last_fullsized":"2024-09-13T19:19:05.824572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:50:15.856299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985127+0000","last_change":"2024-09-13T19:15:59.896602+0000","last_active":"2024-09-13T19:16:31.985127+0000","last_peered":"2024-09-13T19:16:31.985127+0000","last_clean":"2024-09-13T19:16:31.985127+0000","last_became_active":"2024-09-13T19:15:59.896248+0000","last_became_peered":"2024-09-13T19:15:59.896248+0000","last_unstale":"2024-09-13T19:16:31.985127+0000","last_undegraded":"2024-09-13T19:16:31.985127+0000","last_fullsized":"2024-09-13T19:16:31.985127+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:09:14.547740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'13","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.032597+0000","last_change":"2024-09-13T19:16:01.905842+0000","last_active":"2024-09-13T19:19:05.032597+0000","last_peered":"2024-09-13T19:19:05.032597+0000","last_clean":"2024-09-13T19:19:05.032597+0000","last_became_active":"2024-09-13T19:16:01.905280+0000","last_became_peered":"2024-09-13T19:16:01.905280+0000","last_unstale":"2024-09-13T19:19:05.032597+0000","last_undegraded":"2024-09-13T19:19:05.032597+0000","last_fullsized":"2024-09-13T19:19:05.032597+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:18:18.978521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984723+0000","last_change":"2024-09-13T19:16:03.916612+0000","last_active":"2024-09-13T19:16:31.984723+0000","last_peered":"2024-09-13T19:16:31.984723+0000","last_clean":"2024-09-13T19:16:31.984723+0000","last_became_active":"2024-09-13T19:16:03.916344+0000","last_became_peered":"2024-09-13T19:16:03.916344+0000","last_unstale":"2024-09-13T19:16:31.984723+0000","last_undegraded":"2024-09-13T19:16:31.984723+0000","last_fullsized":"2024-09-13T19:16:31.984723+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:58.688605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"36'4","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:04.590724+0000","last_change":"2024-09-13T19:16:05.919765+0000","last_active":"2024-09-13T19:18:04.590724+0000","last_peered":"2024-09-13T19:18:04.590724+0000","last_clean":"2024-09-13T19:18:04.590724+0000","last_became_active":"2024-09-13T19:16:05.919156+0000","last_became_peered":"2024-09-13T19:16:05.919156+0000","last_unstale":"2024-09-13T19:18:04.590724+0000","last_undegraded":"2024-09-13T19:18:04.590724+0000","last_fullsized":"2024-09-13T19:18:04.590724+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:55.590810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"36'18","reported_seq":69,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:05.012582+0000","last_change":"2024-09-13T19:15:57.903146+0000","last_active":"2024-09-13T19:18:05.012582+0000","last_peered":"2024-09-13T19:18:05.012582+0000","last_clean":"2024-09-13T19:18:05.012582+0000","last_became_active":"2024-09-13T19:15:57.902819+0000","last_became_peered":"2024-09-13T19:15:57.902819+0000","last_unstale":"2024-09-13T19:18:05.012582+0000","last_undegraded":"2024-09-13T19:18:05.012582+0000","last_fullsized":"2024-09-13T19:18:05.012582+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:50.793368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":50,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.986102+0000","last_change":"2024-09-13T19:15:55.893781+0000","last_active":"2024-09-13T19:16:31.986102+0000","last_peered":"2024-09-13T19:16:31.986102+0000","last_clean":"2024-09-13T19:16:31.986102+0000","last_became_active":"2024-09-13T19:15:55.893468+0000","last_became_peered":"2024-09-13T19:15:55.893468+0000","last_unstale":"2024-09-13T19:16:31.986102+0000","last_undegraded":"2024-09-13T19:16:31.986102+0000","last_fullsized":"2024-09-13T19:16:31.986102+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:06:44.577134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984402+0000","last_change":"2024-09-13T19:15:46.583117+0000","last_active":"2024-09-13T19:16:31.984402+0000","last_peered":"2024-09-13T19:16:31.984402+0000","last_clean":"2024-09-13T19:16:31.984402+0000","last_became_active":"2024-09-13T19:15:44.575726+0000","last_became_peered":"2024-09-13T19:15:44.575726+0000","last_unstale":"2024-09-13T19:16:31.984402+0000","last_undegraded":"2024-09-13T19:16:31.984402+0000","last_fullsized":"2024-09-13T19:16:31.984402+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:27.090413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041430200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"36'1","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:38.944809+0000","last_change":"2024-09-13T19:16:31.990974+0000","last_active":"2024-09-13T19:18:38.944809+0000","last_peered":"2024-09-13T19:18:38.944809+0000","last_clean":"2024-09-13T19:18:38.944809+0000","last_became_active":"2024-09-13T19:16:31.990669+0000","last_became_peered":"2024-09-13T19:16:31.990669+0000","last_unstale":"2024-09-13T19:18:38.944809+0000","last_undegraded":"2024-09-13T19:18:38.944809+0000","last_fullsized":"2024-09-13T19:18:38.944809+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:49:36.858038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"36'61","reported_seq":120,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.169086+0000","last_change":"2024-09-13T19:16:01.902406+0000","last_active":"2024-09-13T19:18:03.169086+0000","last_peered":"2024-09-13T19:18:03.169086+0000","last_clean":"2024-09-13T19:18:03.169086+0000","last_became_active":"2024-09-13T19:16:01.902095+0000","last_became_peered":"2024-09-13T19:16:01.902095+0000","last_unstale":"2024-09-13T19:18:03.169086+0000","last_undegraded":"2024-09-13T19:18:03.169086+0000","last_fullsized":"2024-09-13T19:18:03.169086+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:52.393641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.986023+0000","last_change":"2024-09-13T19:16:03.910134+0000","last_active":"2024-09-13T19:16:31.986023+0000","last_peered":"2024-09-13T19:16:31.986023+0000","last_clean":"2024-09-13T19:16:31.986023+0000","last_became_active":"2024-09-13T19:16:03.909803+0000","last_became_peered":"2024-09-13T19:16:03.909803+0000","last_unstale":"2024-09-13T19:16:31.986023+0000","last_undegraded":"2024-09-13T19:16:31.986023+0000","last_fullsized":"2024-09-13T19:16:31.986023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:14:02.210649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"36'11","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:05.008743+0000","last_change":"2024-09-13T19:16:05.915976+0000","last_active":"2024-09-13T19:18:05.008743+0000","last_peered":"2024-09-13T19:18:05.008743+0000","last_clean":"2024-09-13T19:18:05.008743+0000","last_became_active":"2024-09-13T19:16:05.915672+0000","last_became_peered":"2024-09-13T19:16:05.915672+0000","last_unstale":"2024-09-13T19:18:05.008743+0000","last_undegraded":"2024-09-13T19:18:05.008743+0000","last_fullsized":"2024-09-13T19:18:05.008743+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:55.714578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"36'10","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:05.005754+0000","last_change":"2024-09-13T19:15:57.903282+0000","last_active":"2024-09-13T19:18:05.005754+0000","last_peered":"2024-09-13T19:18:05.005754+0000","last_clean":"2024-09-13T19:18:05.005754+0000","last_became_active":"2024-09-13T19:15:57.902793+0000","last_became_peered":"2024-09-13T19:15:57.902793+0000","last_unstale":"2024-09-13T19:18:05.005754+0000","last_undegraded":"2024-09-13T19:18:05.005754+0000","last_fullsized":"2024-09-13T19:18:05.005754+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:43:25.003517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984951+0000","last_change":"2024-09-13T19:15:55.895728+0000","last_active":"2024-09-13T19:16:31.984951+0000","last_peered":"2024-09-13T19:16:31.984951+0000","last_clean":"2024-09-13T19:16:31.984951+0000","last_became_active":"2024-09-13T19:15:55.894340+0000","last_became_peered":"2024-09-13T19:15:55.894340+0000","last_unstale":"2024-09-13T19:16:31.984951+0000","last_undegraded":"2024-09-13T19:16:31.984951+0000","last_fullsized":"2024-09-13T19:16:31.984951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:13:59.182464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984808+0000","last_change":"2024-09-13T19:15:46.581685+0000","last_active":"2024-09-13T19:16:31.984808+0000","last_peered":"2024-09-13T19:16:31.984808+0000","last_clean":"2024-09-13T19:16:31.984808+0000","last_became_active":"2024-09-13T19:15:44.576006+0000","last_became_peered":"2024-09-13T19:15:44.576006+0000","last_unstale":"2024-09-13T19:16:31.984808+0000","last_undegraded":"2024-09-13T19:16:31.984808+0000","last_fullsized":"2024-09-13T19:16:31.984808+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:52:37.043288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013309299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.981613+0000","last_change":"2024-09-13T19:15:59.895062+0000","last_active":"2024-09-13T19:16:31.981613+0000","last_peered":"2024-09-13T19:16:31.981613+0000","last_clean":"2024-09-13T19:16:31.981613+0000","last_became_active":"2024-09-13T19:15:59.894761+0000","last_became_peered":"2024-09-13T19:15:59.894761+0000","last_unstale":"2024-09-13T19:16:31.981613+0000","last_undegraded":"2024-09-13T19:16:31.981613+0000","last_fullsized":"2024-09-13T19:16:31.981613+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:04.423400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'14","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.990533+0000","last_change":"2024-09-13T19:16:01.907701+0000","last_active":"2024-09-13T19:16:31.990533+0000","last_peered":"2024-09-13T19:16:31.990533+0000","last_clean":"2024-09-13T19:16:31.990533+0000","last_became_active":"2024-09-13T19:16:01.907419+0000","last_became_peered":"2024-09-13T19:16:01.907419+0000","last_unstale":"2024-09-13T19:16:31.990533+0000","last_undegraded":"2024-09-13T19:16:31.990533+0000","last_fullsized":"2024-09-13T19:16:31.990533+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:12:10.504205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"36'282","reported_seq":346,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:04.973517+0000","last_change":"2024-09-13T19:16:03.908228+0000","last_active":"2024-09-13T19:19:04.973517+0000","last_peered":"2024-09-13T19:19:04.973517+0000","last_clean":"2024-09-13T19:19:04.973517+0000","last_became_active":"2024-09-13T19:16:03.907957+0000","last_became_peered":"2024-09-13T19:16:03.907957+0000","last_unstale":"2024-09-13T19:19:04.973517+0000","last_undegraded":"2024-09-13T19:19:04.973517+0000","last_fullsized":"2024-09-13T19:19:04.973517+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:35.448179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"34'2","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.983260+0000","last_change":"2024-09-13T19:16:05.924834+0000","last_active":"2024-09-13T19:16:31.983260+0000","last_peered":"2024-09-13T19:16:31.983260+0000","last_clean":"2024-09-13T19:16:31.983260+0000","last_became_active":"2024-09-13T19:16:05.924162+0000","last_became_peered":"2024-09-13T19:16:05.924162+0000","last_unstale":"2024-09-13T19:16:31.983260+0000","last_undegraded":"2024-09-13T19:16:31.983260+0000","last_fullsized":"2024-09-13T19:16:31.983260+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:00.770168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"36'6","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.969496+0000","last_change":"2024-09-13T19:15:57.897089+0000","last_active":"2024-09-13T19:19:05.969496+0000","last_peered":"2024-09-13T19:19:05.969496+0000","last_clean":"2024-09-13T19:19:05.969496+0000","last_became_active":"2024-09-13T19:15:57.896078+0000","last_became_peered":"2024-09-13T19:15:57.896078+0000","last_unstale":"2024-09-13T19:19:05.969496+0000","last_undegraded":"2024-09-13T19:19:05.969496+0000","last_fullsized":"2024-09-13T19:19:05.969496+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:10.200427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985502+0000","last_change":"2024-09-13T19:15:55.895594+0000","last_active":"2024-09-13T19:16:31.985502+0000","last_peered":"2024-09-13T19:16:31.985502+0000","last_clean":"2024-09-13T19:16:31.985502+0000","last_became_active":"2024-09-13T19:15:55.895282+0000","last_became_peered":"2024-09-13T19:15:55.895282+0000","last_unstale":"2024-09-13T19:16:31.985502+0000","last_undegraded":"2024-09-13T19:16:31.985502+0000","last_fullsized":"2024-09-13T19:16:31.985502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:13.182770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985921+0000","last_change":"2024-09-13T19:15:46.583177+0000","last_active":"2024-09-13T19:16:31.985921+0000","last_peered":"2024-09-13T19:16:31.985921+0000","last_clean":"2024-09-13T19:16:31.985921+0000","last_became_active":"2024-09-13T19:15:44.574967+0000","last_became_peered":"2024-09-13T19:15:44.574967+0000","last_unstale":"2024-09-13T19:16:31.985921+0000","last_undegraded":"2024-09-13T19:16:31.985921+0000","last_fullsized":"2024-09-13T19:16:31.985921+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:20:13.639706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049330999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"27'1","reported_seq":218,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:04.347176+0000","last_change":"2024-09-13T19:15:59.895363+0000","last_active":"2024-09-13T19:18:04.347176+0000","last_peered":"2024-09-13T19:18:04.347176+0000","last_clean":"2024-09-13T19:18:04.347176+0000","last_became_active":"2024-09-13T19:15:59.894966+0000","last_became_peered":"2024-09-13T19:15:59.894966+0000","last_unstale":"2024-09-13T19:18:04.347176+0000","last_undegraded":"2024-09-13T19:18:04.347176+0000","last_fullsized":"2024-09-13T19:18:04.347176+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:45.317531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"36'11","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:20.925826+0000","last_change":"2024-09-13T19:16:01.903652+0000","last_active":"2024-09-13T19:17:20.925826+0000","last_peered":"2024-09-13T19:17:20.925826+0000","last_clean":"2024-09-13T19:17:20.925826+0000","last_became_active":"2024-09-13T19:16:01.902739+0000","last_became_peered":"2024-09-13T19:16:01.902739+0000","last_unstale":"2024-09-13T19:17:20.925826+0000","last_undegraded":"2024-09-13T19:17:20.925826+0000","last_fullsized":"2024-09-13T19:17:20.925826+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:51:13.428618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"36'282","reported_seq":417,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.183631+0000","last_change":"2024-09-13T19:16:03.909318+0000","last_active":"2024-09-13T19:19:06.183631+0000","last_peered":"2024-09-13T19:19:06.183631+0000","last_clean":"2024-09-13T19:19:06.183631+0000","last_became_active":"2024-09-13T19:16:03.909038+0000","last_became_peered":"2024-09-13T19:16:03.909038+0000","last_unstale":"2024-09-13T19:19:06.183631+0000","last_undegraded":"2024-09-13T19:19:06.183631+0000","last_fullsized":"2024-09-13T19:19:06.183631+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:32.924238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'3","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.990000+0000","last_change":"2024-09-13T19:16:05.924059+0000","last_active":"2024-09-13T19:16:31.990000+0000","last_peered":"2024-09-13T19:16:31.990000+0000","last_clean":"2024-09-13T19:16:31.990000+0000","last_became_active":"2024-09-13T19:16:05.923739+0000","last_became_peered":"2024-09-13T19:16:05.923739+0000","last_unstale":"2024-09-13T19:16:31.990000+0000","last_undegraded":"2024-09-13T19:16:31.990000+0000","last_fullsized":"2024-09-13T19:16:31.990000+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:49.018736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"36'6","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.962120+0000","last_change":"2024-09-13T19:15:57.897999+0000","last_active":"2024-09-13T19:19:05.962120+0000","last_peered":"2024-09-13T19:19:05.962120+0000","last_clean":"2024-09-13T19:19:05.962120+0000","last_became_active":"2024-09-13T19:15:57.897727+0000","last_became_peered":"2024-09-13T19:15:57.897727+0000","last_unstale":"2024-09-13T19:19:05.962120+0000","last_undegraded":"2024-09-13T19:19:05.962120+0000","last_fullsized":"2024-09-13T19:19:05.962120+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:38.843461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.989964+0000","last_change":"2024-09-13T19:15:55.895727+0000","last_active":"2024-09-13T19:16:31.989964+0000","last_peered":"2024-09-13T19:16:31.989964+0000","last_clean":"2024-09-13T19:16:31.989964+0000","last_became_active":"2024-09-13T19:15:55.895394+0000","last_became_peered":"2024-09-13T19:15:55.895394+0000","last_unstale":"2024-09-13T19:16:31.989964+0000","last_undegraded":"2024-09-13T19:16:31.989964+0000","last_fullsized":"2024-09-13T19:16:31.989964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:06:25.645854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984574+0000","last_change":"2024-09-13T19:15:46.581172+0000","last_active":"2024-09-13T19:16:31.984574+0000","last_peered":"2024-09-13T19:16:31.984574+0000","last_clean":"2024-09-13T19:16:31.984574+0000","last_became_active":"2024-09-13T19:15:44.607248+0000","last_became_peered":"2024-09-13T19:15:44.607248+0000","last_unstale":"2024-09-13T19:16:31.984574+0000","last_undegraded":"2024-09-13T19:16:31.984574+0000","last_fullsized":"2024-09-13T19:16:31.984574+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:09:50.029342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086245899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.994102+0000","last_change":"2024-09-13T19:16:31.993085+0000","last_active":"2024-09-13T19:16:31.994102+0000","last_peered":"2024-09-13T19:16:31.994102+0000","last_clean":"2024-09-13T19:16:31.994102+0000","last_became_active":"2024-09-13T19:16:31.992752+0000","last_became_peered":"2024-09-13T19:16:31.992752+0000","last_unstale":"2024-09-13T19:16:31.994102+0000","last_undegraded":"2024-09-13T19:16:31.994102+0000","last_fullsized":"2024-09-13T19:16:31.994102+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:31:25.664984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"36'84","reported_seq":156,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.154948+0000","last_change":"2024-09-13T19:16:01.906627+0000","last_active":"2024-09-13T19:18:03.154948+0000","last_peered":"2024-09-13T19:18:03.154948+0000","last_clean":"2024-09-13T19:18:03.154948+0000","last_became_active":"2024-09-13T19:16:01.906317+0000","last_became_peered":"2024-09-13T19:16:01.906317+0000","last_unstale":"2024-09-13T19:18:03.154948+0000","last_undegraded":"2024-09-13T19:18:03.154948+0000","last_fullsized":"2024-09-13T19:18:03.154948+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:31.838003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":81,"num_read_kb":82,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984273+0000","last_change":"2024-09-13T19:16:03.910414+0000","last_active":"2024-09-13T19:16:31.984273+0000","last_peered":"2024-09-13T19:16:31.984273+0000","last_clean":"2024-09-13T19:16:31.984273+0000","last_became_active":"2024-09-13T19:16:03.909941+0000","last_became_peered":"2024-09-13T19:16:03.909941+0000","last_unstale":"2024-09-13T19:16:31.984273+0000","last_undegraded":"2024-09-13T19:16:31.984273+0000","last_fullsized":"2024-09-13T19:16:31.984273+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:24.874734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.989013+0000","last_change":"2024-09-13T19:16:05.911849+0000","last_active":"2024-09-13T19:16:31.989013+0000","last_peered":"2024-09-13T19:16:31.989013+0000","last_clean":"2024-09-13T19:16:31.989013+0000","last_became_active":"2024-09-13T19:16:05.911465+0000","last_became_peered":"2024-09-13T19:16:05.911465+0000","last_unstale":"2024-09-13T19:16:31.989013+0000","last_undegraded":"2024-09-13T19:16:31.989013+0000","last_fullsized":"2024-09-13T19:16:31.989013+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:53:28.959608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985196+0000","last_change":"2024-09-13T19:16:05.917443+0000","last_active":"2024-09-13T19:16:31.985196+0000","last_peered":"2024-09-13T19:16:31.985196+0000","last_clean":"2024-09-13T19:16:31.985196+0000","last_became_active":"2024-09-13T19:16:05.917156+0000","last_became_peered":"2024-09-13T19:16:05.917156+0000","last_unstale":"2024-09-13T19:16:31.985196+0000","last_undegraded":"2024-09-13T19:16:31.985196+0000","last_fullsized":"2024-09-13T19:16:31.985196+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:54:47.314314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"36'8","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.700214+0000","last_change":"2024-09-13T19:15:57.899020+0000","last_active":"2024-09-13T19:19:05.700214+0000","last_peered":"2024-09-13T19:19:05.700214+0000","last_clean":"2024-09-13T19:19:05.700214+0000","last_became_active":"2024-09-13T19:15:57.898761+0000","last_became_peered":"2024-09-13T19:15:57.898761+0000","last_unstale":"2024-09-13T19:19:05.700214+0000","last_undegraded":"2024-09-13T19:19:05.700214+0000","last_fullsized":"2024-09-13T19:19:05.700214+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:01:19.857155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.982961+0000","last_change":"2024-09-13T19:15:55.898265+0000","last_active":"2024-09-13T19:16:31.982961+0000","last_peered":"2024-09-13T19:16:31.982961+0000","last_clean":"2024-09-13T19:16:31.982961+0000","last_became_active":"2024-09-13T19:15:55.892518+0000","last_became_peered":"2024-09-13T19:15:55.892518+0000","last_unstale":"2024-09-13T19:16:31.982961+0000","last_undegraded":"2024-09-13T19:16:31.982961+0000","last_fullsized":"2024-09-13T19:16:31.982961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:48.786786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.991243+0000","last_change":"2024-09-13T19:15:59.894006+0000","last_active":"2024-09-13T19:16:31.991243+0000","last_peered":"2024-09-13T19:16:31.991243+0000","last_clean":"2024-09-13T19:16:31.991243+0000","last_became_active":"2024-09-13T19:15:59.892690+0000","last_became_peered":"2024-09-13T19:15:59.892690+0000","last_unstale":"2024-09-13T19:16:31.991243+0000","last_undegraded":"2024-09-13T19:16:31.991243+0000","last_fullsized":"2024-09-13T19:16:31.991243+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:09.953397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"36'33","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:23.943430+0000","last_change":"2024-09-13T19:16:01.904994+0000","last_active":"2024-09-13T19:18:23.943430+0000","last_peered":"2024-09-13T19:18:23.943430+0000","last_clean":"2024-09-13T19:18:23.943430+0000","last_became_active":"2024-09-13T19:16:01.904684+0000","last_became_peered":"2024-09-13T19:16:01.904684+0000","last_unstale":"2024-09-13T19:18:23.943430+0000","last_undegraded":"2024-09-13T19:18:23.943430+0000","last_fullsized":"2024-09-13T19:18:23.943430+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:07.994368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.982387+0000","last_change":"2024-09-13T19:16:03.912531+0000","last_active":"2024-09-13T19:16:31.982387+0000","last_peered":"2024-09-13T19:16:31.982387+0000","last_clean":"2024-09-13T19:16:31.982387+0000","last_became_active":"2024-09-13T19:16:03.912244+0000","last_became_peered":"2024-09-13T19:16:03.912244+0000","last_unstale":"2024-09-13T19:16:31.982387+0000","last_undegraded":"2024-09-13T19:16:31.982387+0000","last_fullsized":"2024-09-13T19:16:31.982387+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:47:14.892797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"36'3","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:02.851990+0000","last_change":"2024-09-13T19:16:05.921280+0000","last_active":"2024-09-13T19:18:02.851990+0000","last_peered":"2024-09-13T19:18:02.851990+0000","last_clean":"2024-09-13T19:18:02.851990+0000","last_became_active":"2024-09-13T19:16:05.920951+0000","last_became_peered":"2024-09-13T19:16:05.920951+0000","last_unstale":"2024-09-13T19:18:02.851990+0000","last_undegraded":"2024-09-13T19:18:02.851990+0000","last_fullsized":"2024-09-13T19:18:02.851990+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:21.035521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"36'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.592256+0000","last_change":"2024-09-13T19:15:57.902138+0000","last_active":"2024-09-13T19:19:05.592256+0000","last_peered":"2024-09-13T19:19:05.592256+0000","last_clean":"2024-09-13T19:19:05.592256+0000","last_became_active":"2024-09-13T19:15:57.901732+0000","last_became_peered":"2024-09-13T19:15:57.901732+0000","last_unstale":"2024-09-13T19:19:05.592256+0000","last_undegraded":"2024-09-13T19:19:05.592256+0000","last_fullsized":"2024-09-13T19:19:05.592256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:23.440843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"36'4","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:38.357818+0000","last_change":"2024-09-13T19:15:55.894585+0000","last_active":"2024-09-13T19:16:38.357818+0000","last_peered":"2024-09-13T19:16:38.357818+0000","last_clean":"2024-09-13T19:16:38.357818+0000","last_became_active":"2024-09-13T19:15:55.894279+0000","last_became_peered":"2024-09-13T19:15:55.894279+0000","last_unstale":"2024-09-13T19:16:38.357818+0000","last_undegraded":"2024-09-13T19:16:38.357818+0000","last_fullsized":"2024-09-13T19:16:38.357818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:37.997344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.982888+0000","last_change":"2024-09-13T19:15:59.895645+0000","last_active":"2024-09-13T19:16:31.982888+0000","last_peered":"2024-09-13T19:16:31.982888+0000","last_clean":"2024-09-13T19:16:31.982888+0000","last_became_active":"2024-09-13T19:15:59.895325+0000","last_became_peered":"2024-09-13T19:15:59.895325+0000","last_unstale":"2024-09-13T19:16:31.982888+0000","last_undegraded":"2024-09-13T19:16:31.982888+0000","last_fullsized":"2024-09-13T19:16:31.982888+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:17.756694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"36'5","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.036888+0000","last_change":"2024-09-13T19:16:01.901632+0000","last_active":"2024-09-13T19:19:05.036888+0000","last_peered":"2024-09-13T19:19:05.036888+0000","last_clean":"2024-09-13T19:19:05.036888+0000","last_became_active":"2024-09-13T19:16:01.901250+0000","last_became_peered":"2024-09-13T19:16:01.901250+0000","last_unstale":"2024-09-13T19:19:05.036888+0000","last_undegraded":"2024-09-13T19:19:05.036888+0000","last_fullsized":"2024-09-13T19:19:05.036888+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:51.022673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984245+0000","last_change":"2024-09-13T19:16:03.913428+0000","last_active":"2024-09-13T19:16:31.984245+0000","last_peered":"2024-09-13T19:16:31.984245+0000","last_clean":"2024-09-13T19:16:31.984245+0000","last_became_active":"2024-09-13T19:16:03.913053+0000","last_became_peered":"2024-09-13T19:16:03.913053+0000","last_unstale":"2024-09-13T19:16:31.984245+0000","last_undegraded":"2024-09-13T19:16:31.984245+0000","last_fullsized":"2024-09-13T19:16:31.984245+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:16.591819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"36'2","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.701436+0000","last_change":"2024-09-13T19:16:05.912786+0000","last_active":"2024-09-13T19:19:05.701436+0000","last_peered":"2024-09-13T19:19:05.701436+0000","last_clean":"2024-09-13T19:19:05.701436+0000","last_became_active":"2024-09-13T19:16:05.912428+0000","last_became_peered":"2024-09-13T19:16:05.912428+0000","last_unstale":"2024-09-13T19:19:05.701436+0000","last_undegraded":"2024-09-13T19:19:05.701436+0000","last_fullsized":"2024-09-13T19:19:05.701436+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:59.991034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"36'7","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.968817+0000","last_change":"2024-09-13T19:15:57.896825+0000","last_active":"2024-09-13T19:19:05.968817+0000","last_peered":"2024-09-13T19:19:05.968817+0000","last_clean":"2024-09-13T19:19:05.968817+0000","last_became_active":"2024-09-13T19:15:57.896463+0000","last_became_peered":"2024-09-13T19:15:57.896463+0000","last_unstale":"2024-09-13T19:19:05.968817+0000","last_undegraded":"2024-09-13T19:19:05.968817+0000","last_fullsized":"2024-09-13T19:19:05.968817+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:26.337812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"36'2","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:37.182663+0000","last_change":"2024-09-13T19:15:55.888440+0000","last_active":"2024-09-13T19:16:37.182663+0000","last_peered":"2024-09-13T19:16:37.182663+0000","last_clean":"2024-09-13T19:16:37.182663+0000","last_became_active":"2024-09-13T19:15:55.888108+0000","last_became_peered":"2024-09-13T19:15:55.888108+0000","last_unstale":"2024-09-13T19:16:37.182663+0000","last_undegraded":"2024-09-13T19:16:37.182663+0000","last_fullsized":"2024-09-13T19:16:37.182663+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:04:11.428321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985263+0000","last_change":"2024-09-13T19:15:59.893154+0000","last_active":"2024-09-13T19:16:31.985263+0000","last_peered":"2024-09-13T19:16:31.985263+0000","last_clean":"2024-09-13T19:16:31.985263+0000","last_became_active":"2024-09-13T19:15:59.892842+0000","last_became_peered":"2024-09-13T19:15:59.892842+0000","last_unstale":"2024-09-13T19:16:31.985263+0000","last_undegraded":"2024-09-13T19:16:31.985263+0000","last_fullsized":"2024-09-13T19:16:31.985263+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:16.726485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"36'41","reported_seq":100,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.224131+0000","last_change":"2024-09-13T19:16:01.903266+0000","last_active":"2024-09-13T19:19:05.224131+0000","last_peered":"2024-09-13T19:19:05.224131+0000","last_clean":"2024-09-13T19:19:05.224131+0000","last_became_active":"2024-09-13T19:16:01.902991+0000","last_became_peered":"2024-09-13T19:16:01.902991+0000","last_unstale":"2024-09-13T19:19:05.224131+0000","last_undegraded":"2024-09-13T19:19:05.224131+0000","last_fullsized":"2024-09-13T19:19:05.224131+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:42.038997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.988447+0000","last_change":"2024-09-13T19:16:03.912257+0000","last_active":"2024-09-13T19:16:31.988447+0000","last_peered":"2024-09-13T19:16:31.988447+0000","last_clean":"2024-09-13T19:16:31.988447+0000","last_became_active":"2024-09-13T19:16:03.911917+0000","last_became_peered":"2024-09-13T19:16:03.911917+0000","last_unstale":"2024-09-13T19:16:31.988447+0000","last_undegraded":"2024-09-13T19:16:31.988447+0000","last_fullsized":"2024-09-13T19:16:31.988447+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:23.564311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"36'4","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:01.380390+0000","last_change":"2024-09-13T19:16:05.924382+0000","last_active":"2024-09-13T19:18:01.380390+0000","last_peered":"2024-09-13T19:18:01.380390+0000","last_clean":"2024-09-13T19:18:01.380390+0000","last_became_active":"2024-09-13T19:16:05.923368+0000","last_became_peered":"2024-09-13T19:16:05.923368+0000","last_unstale":"2024-09-13T19:18:01.380390+0000","last_undegraded":"2024-09-13T19:18:01.380390+0000","last_fullsized":"2024-09-13T19:18:01.380390+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:03.139035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"36'16","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.842276+0000","last_change":"2024-09-13T19:16:31.999453+0000","last_active":"2024-09-13T19:19:05.842276+0000","last_peered":"2024-09-13T19:19:05.842276+0000","last_clean":"2024-09-13T19:19:05.842276+0000","last_became_active":"2024-09-13T19:16:31.991993+0000","last_became_peered":"2024-09-13T19:16:31.991993+0000","last_unstale":"2024-09-13T19:19:05.842276+0000","last_undegraded":"2024-09-13T19:19:05.842276+0000","last_fullsized":"2024-09-13T19:19:05.842276+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:24:47.009062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"36'2","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:37.182603+0000","last_change":"2024-09-13T19:15:55.892008+0000","last_active":"2024-09-13T19:16:37.182603+0000","last_peered":"2024-09-13T19:16:37.182603+0000","last_clean":"2024-09-13T19:16:37.182603+0000","last_became_active":"2024-09-13T19:15:55.891711+0000","last_became_peered":"2024-09-13T19:15:55.891711+0000","last_unstale":"2024-09-13T19:16:37.182603+0000","last_undegraded":"2024-09-13T19:16:37.182603+0000","last_fullsized":"2024-09-13T19:16:37.182603+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:18:40.262875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.981334+0000","last_change":"2024-09-13T19:15:59.891859+0000","last_active":"2024-09-13T19:16:31.981334+0000","last_peered":"2024-09-13T19:16:31.981334+0000","last_clean":"2024-09-13T19:16:31.981334+0000","last_became_active":"2024-09-13T19:15:59.891581+0000","last_became_peered":"2024-09-13T19:15:59.891581+0000","last_unstale":"2024-09-13T19:16:31.981334+0000","last_undegraded":"2024-09-13T19:16:31.981334+0000","last_fullsized":"2024-09-13T19:16:31.981334+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:49:36.858038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"36'30","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.147034+0000","last_change":"2024-09-13T19:16:01.899778+0000","last_active":"2024-09-13T19:18:03.147034+0000","last_peered":"2024-09-13T19:18:03.147034+0000","last_clean":"2024-09-13T19:18:03.147034+0000","last_became_active":"2024-09-13T19:16:01.899438+0000","last_became_peered":"2024-09-13T19:16:01.899438+0000","last_unstale":"2024-09-13T19:18:03.147034+0000","last_undegraded":"2024-09-13T19:18:03.147034+0000","last_fullsized":"2024-09-13T19:18:03.147034+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:39.137471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.986072+0000","last_change":"2024-09-13T19:16:03.910613+0000","last_active":"2024-09-13T19:16:31.986072+0000","last_peered":"2024-09-13T19:16:31.986072+0000","last_clean":"2024-09-13T19:16:31.986072+0000","last_became_active":"2024-09-13T19:16:03.910319+0000","last_became_peered":"2024-09-13T19:16:03.910319+0000","last_unstale":"2024-09-13T19:16:31.986072+0000","last_undegraded":"2024-09-13T19:16:31.986072+0000","last_fullsized":"2024-09-13T19:16:31.986072+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:55:44.357662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"36'10","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.842277+0000","last_change":"2024-09-13T19:15:57.897487+0000","last_active":"2024-09-13T19:19:05.842277+0000","last_peered":"2024-09-13T19:19:05.842277+0000","last_clean":"2024-09-13T19:19:05.842277+0000","last_became_active":"2024-09-13T19:15:57.897232+0000","last_became_peered":"2024-09-13T19:15:57.897232+0000","last_unstale":"2024-09-13T19:19:05.842277+0000","last_undegraded":"2024-09-13T19:19:05.842277+0000","last_fullsized":"2024-09-13T19:19:05.842277+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:57:32.169161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:01.372999+0000","last_change":"2024-09-13T19:15:55.901992+0000","last_active":"2024-09-13T19:18:01.372999+0000","last_peered":"2024-09-13T19:18:01.372999+0000","last_clean":"2024-09-13T19:18:01.372999+0000","last_became_active":"2024-09-13T19:15:55.901257+0000","last_became_peered":"2024-09-13T19:15:55.901257+0000","last_unstale":"2024-09-13T19:18:01.372999+0000","last_undegraded":"2024-09-13T19:18:01.372999+0000","last_fullsized":"2024-09-13T19:18:01.372999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:05:52.991944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.986502+0000","last_change":"2024-09-13T19:15:59.896674+0000","last_active":"2024-09-13T19:16:31.986502+0000","last_peered":"2024-09-13T19:16:31.986502+0000","last_clean":"2024-09-13T19:16:31.986502+0000","last_became_active":"2024-09-13T19:15:59.896339+0000","last_became_peered":"2024-09-13T19:15:59.896339+0000","last_unstale":"2024-09-13T19:16:31.986502+0000","last_undegraded":"2024-09-13T19:16:31.986502+0000","last_fullsized":"2024-09-13T19:16:31.986502+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:25.993976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"36'54","reported_seq":110,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.166975+0000","last_change":"2024-09-13T19:16:01.901418+0000","last_active":"2024-09-13T19:18:03.166975+0000","last_peered":"2024-09-13T19:18:03.166975+0000","last_clean":"2024-09-13T19:18:03.166975+0000","last_became_active":"2024-09-13T19:16:01.901092+0000","last_became_peered":"2024-09-13T19:16:01.901092+0000","last_unstale":"2024-09-13T19:18:03.166975+0000","last_undegraded":"2024-09-13T19:18:03.166975+0000","last_fullsized":"2024-09-13T19:18:03.166975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:39:03.339805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984142+0000","last_change":"2024-09-13T19:16:03.910823+0000","last_active":"2024-09-13T19:16:31.984142+0000","last_peered":"2024-09-13T19:16:31.984142+0000","last_clean":"2024-09-13T19:16:31.984142+0000","last_became_active":"2024-09-13T19:16:03.910305+0000","last_became_peered":"2024-09-13T19:16:03.910305+0000","last_unstale":"2024-09-13T19:16:31.984142+0000","last_undegraded":"2024-09-13T19:16:31.984142+0000","last_fullsized":"2024-09-13T19:16:31.984142+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:34:06.206573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"36'22","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.267841+0000","last_change":"2024-09-13T19:16:05.913081+0000","last_active":"2024-09-13T19:19:05.267841+0000","last_peered":"2024-09-13T19:19:05.267841+0000","last_clean":"2024-09-13T19:19:05.267841+0000","last_became_active":"2024-09-13T19:16:05.912675+0000","last_became_peered":"2024-09-13T19:16:05.912675+0000","last_unstale":"2024-09-13T19:19:05.267841+0000","last_undegraded":"2024-09-13T19:19:05.267841+0000","last_fullsized":"2024-09-13T19:19:05.267841+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:51:50.650591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"36'6","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:20.923362+0000","last_change":"2024-09-13T19:15:57.890233+0000","last_active":"2024-09-13T19:17:20.923362+0000","last_peered":"2024-09-13T19:17:20.923362+0000","last_clean":"2024-09-13T19:17:20.923362+0000","last_became_active":"2024-09-13T19:15:57.889921+0000","last_became_peered":"2024-09-13T19:15:57.889921+0000","last_unstale":"2024-09-13T19:17:20.923362+0000","last_undegraded":"2024-09-13T19:17:20.923362+0000","last_fullsized":"2024-09-13T19:17:20.923362+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:45.927205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.989729+0000","last_change":"2024-09-13T19:15:55.895671+0000","last_active":"2024-09-13T19:16:31.989729+0000","last_peered":"2024-09-13T19:16:31.989729+0000","last_clean":"2024-09-13T19:16:31.989729+0000","last_became_active":"2024-09-13T19:15:55.895344+0000","last_became_peered":"2024-09-13T19:15:55.895344+0000","last_unstale":"2024-09-13T19:16:31.989729+0000","last_undegraded":"2024-09-13T19:16:31.989729+0000","last_fullsized":"2024-09-13T19:16:31.989729+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:21.381003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.986359+0000","last_change":"2024-09-13T19:15:59.888500+0000","last_active":"2024-09-13T19:16:31.986359+0000","last_peered":"2024-09-13T19:16:31.986359+0000","last_clean":"2024-09-13T19:16:31.986359+0000","last_became_active":"2024-09-13T19:15:59.888213+0000","last_became_peered":"2024-09-13T19:15:59.888213+0000","last_unstale":"2024-09-13T19:16:31.986359+0000","last_undegraded":"2024-09-13T19:16:31.986359+0000","last_fullsized":"2024-09-13T19:16:31.986359+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:46.856761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"36'36","reported_seq":81,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.148094+0000","last_change":"2024-09-13T19:16:01.908414+0000","last_active":"2024-09-13T19:18:03.148094+0000","last_peered":"2024-09-13T19:18:03.148094+0000","last_clean":"2024-09-13T19:18:03.148094+0000","last_became_active":"2024-09-13T19:16:01.908116+0000","last_became_peered":"2024-09-13T19:16:01.908116+0000","last_unstale":"2024-09-13T19:18:03.148094+0000","last_undegraded":"2024-09-13T19:18:03.148094+0000","last_fullsized":"2024-09-13T19:18:03.148094+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:09.064613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.989465+0000","last_change":"2024-09-13T19:16:03.914462+0000","last_active":"2024-09-13T19:16:31.989465+0000","last_peered":"2024-09-13T19:16:31.989465+0000","last_clean":"2024-09-13T19:16:31.989465+0000","last_became_active":"2024-09-13T19:16:03.914179+0000","last_became_peered":"2024-09-13T19:16:03.914179+0000","last_unstale":"2024-09-13T19:16:31.989465+0000","last_undegraded":"2024-09-13T19:16:31.989465+0000","last_fullsized":"2024-09-13T19:16:31.989465+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:53:26.952246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"34'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.981447+0000","last_change":"2024-09-13T19:16:05.917077+0000","last_active":"2024-09-13T19:16:31.981447+0000","last_peered":"2024-09-13T19:16:31.981447+0000","last_clean":"2024-09-13T19:16:31.981447+0000","last_became_active":"2024-09-13T19:16:05.916822+0000","last_became_peered":"2024-09-13T19:16:05.916822+0000","last_unstale":"2024-09-13T19:16:31.981447+0000","last_undegraded":"2024-09-13T19:16:31.981447+0000","last_fullsized":"2024-09-13T19:16:31.981447+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:48.822908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"36'22","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.922897+0000","last_change":"2024-09-13T19:15:57.902395+0000","last_active":"2024-09-13T19:19:05.922897+0000","last_peered":"2024-09-13T19:19:05.922897+0000","last_clean":"2024-09-13T19:19:05.922897+0000","last_became_active":"2024-09-13T19:15:57.901330+0000","last_became_peered":"2024-09-13T19:15:57.901330+0000","last_unstale":"2024-09-13T19:19:05.922897+0000","last_undegraded":"2024-09-13T19:19:05.922897+0000","last_fullsized":"2024-09-13T19:19:05.922897+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:28.096605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":60,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.988565+0000","last_change":"2024-09-13T19:15:55.896540+0000","last_active":"2024-09-13T19:16:31.988565+0000","last_peered":"2024-09-13T19:16:31.988565+0000","last_clean":"2024-09-13T19:16:31.988565+0000","last_became_active":"2024-09-13T19:15:55.896196+0000","last_became_peered":"2024-09-13T19:15:55.896196+0000","last_unstale":"2024-09-13T19:16:31.988565+0000","last_undegraded":"2024-09-13T19:16:31.988565+0000","last_fullsized":"2024-09-13T19:16:31.988565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:14:40.566289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984960+0000","last_change":"2024-09-13T19:15:59.891464+0000","last_active":"2024-09-13T19:16:31.984960+0000","last_peered":"2024-09-13T19:16:31.984960+0000","last_clean":"2024-09-13T19:16:31.984960+0000","last_became_active":"2024-09-13T19:15:59.891131+0000","last_became_peered":"2024-09-13T19:15:59.891131+0000","last_unstale":"2024-09-13T19:16:31.984960+0000","last_undegraded":"2024-09-13T19:16:31.984960+0000","last_fullsized":"2024-09-13T19:16:31.984960+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:17.195737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"36'32","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.165035+0000","last_change":"2024-09-13T19:16:01.902629+0000","last_active":"2024-09-13T19:18:03.165035+0000","last_peered":"2024-09-13T19:18:03.165035+0000","last_clean":"2024-09-13T19:18:03.165035+0000","last_became_active":"2024-09-13T19:16:01.902251+0000","last_became_peered":"2024-09-13T19:16:01.902251+0000","last_unstale":"2024-09-13T19:18:03.165035+0000","last_undegraded":"2024-09-13T19:18:03.165035+0000","last_fullsized":"2024-09-13T19:18:03.165035+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:41.211074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985247+0000","last_change":"2024-09-13T19:16:03.915520+0000","last_active":"2024-09-13T19:16:31.985247+0000","last_peered":"2024-09-13T19:16:31.985247+0000","last_clean":"2024-09-13T19:16:31.985247+0000","last_became_active":"2024-09-13T19:16:03.915225+0000","last_became_peered":"2024-09-13T19:16:03.915225+0000","last_unstale":"2024-09-13T19:16:31.985247+0000","last_undegraded":"2024-09-13T19:16:31.985247+0000","last_fullsized":"2024-09-13T19:16:31.985247+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:09:47.134188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"36'5","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:05.007010+0000","last_change":"2024-09-13T19:16:05.925066+0000","last_active":"2024-09-13T19:18:05.007010+0000","last_peered":"2024-09-13T19:18:05.007010+0000","last_clean":"2024-09-13T19:18:05.007010+0000","last_became_active":"2024-09-13T19:16:05.923235+0000","last_became_peered":"2024-09-13T19:16:05.923235+0000","last_unstale":"2024-09-13T19:18:05.007010+0000","last_undegraded":"2024-09-13T19:18:05.007010+0000","last_fullsized":"2024-09-13T19:18:05.007010+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:34:27.801710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"36'8","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.920257+0000","last_change":"2024-09-13T19:15:57.886598+0000","last_active":"2024-09-13T19:19:05.920257+0000","last_peered":"2024-09-13T19:19:05.920257+0000","last_clean":"2024-09-13T19:19:05.920257+0000","last_became_active":"2024-09-13T19:15:57.886263+0000","last_became_peered":"2024-09-13T19:15:57.886263+0000","last_unstale":"2024-09-13T19:19:05.920257+0000","last_undegraded":"2024-09-13T19:19:05.920257+0000","last_fullsized":"2024-09-13T19:19:05.920257+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:45:55.706532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.982036+0000","last_change":"2024-09-13T19:15:55.894466+0000","last_active":"2024-09-13T19:16:31.982036+0000","last_peered":"2024-09-13T19:16:31.982036+0000","last_clean":"2024-09-13T19:16:31.982036+0000","last_became_active":"2024-09-13T19:15:55.893629+0000","last_became_peered":"2024-09-13T19:15:55.893629+0000","last_unstale":"2024-09-13T19:16:31.982036+0000","last_undegraded":"2024-09-13T19:16:31.982036+0000","last_fullsized":"2024-09-13T19:16:31.982036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:23.425081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.991439+0000","last_change":"2024-09-13T19:15:59.892732+0000","last_active":"2024-09-13T19:16:31.991439+0000","last_peered":"2024-09-13T19:16:31.991439+0000","last_clean":"2024-09-13T19:16:31.991439+0000","last_became_active":"2024-09-13T19:15:59.892445+0000","last_became_peered":"2024-09-13T19:15:59.892445+0000","last_unstale":"2024-09-13T19:16:31.991439+0000","last_undegraded":"2024-09-13T19:16:31.991439+0000","last_fullsized":"2024-09-13T19:16:31.991439+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:13.561243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'11","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.983279+0000","last_change":"2024-09-13T19:16:01.906065+0000","last_active":"2024-09-13T19:16:31.983279+0000","last_peered":"2024-09-13T19:16:31.983279+0000","last_clean":"2024-09-13T19:16:31.983279+0000","last_became_active":"2024-09-13T19:16:01.905553+0000","last_became_peered":"2024-09-13T19:16:01.905553+0000","last_unstale":"2024-09-13T19:16:31.983279+0000","last_undegraded":"2024-09-13T19:16:31.983279+0000","last_fullsized":"2024-09-13T19:16:31.983279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:31.722728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"36'282","reported_seq":366,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:04.973463+0000","last_change":"2024-09-13T19:16:03.913513+0000","last_active":"2024-09-13T19:19:04.973463+0000","last_peered":"2024-09-13T19:19:04.973463+0000","last_clean":"2024-09-13T19:19:04.973463+0000","last_became_active":"2024-09-13T19:16:03.913170+0000","last_became_peered":"2024-09-13T19:16:03.913170+0000","last_unstale":"2024-09-13T19:19:04.973463+0000","last_undegraded":"2024-09-13T19:19:04.973463+0000","last_fullsized":"2024-09-13T19:19:04.973463+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:38.207076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"36'4","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.925551+0000","last_change":"2024-09-13T19:16:05.920004+0000","last_active":"2024-09-13T19:19:05.925551+0000","last_peered":"2024-09-13T19:19:05.925551+0000","last_clean":"2024-09-13T19:19:05.925551+0000","last_became_active":"2024-09-13T19:16:05.918050+0000","last_became_peered":"2024-09-13T19:16:05.918050+0000","last_unstale":"2024-09-13T19:19:05.925551+0000","last_undegraded":"2024-09-13T19:19:05.925551+0000","last_fullsized":"2024-09-13T19:19:05.925551+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:16.813767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"36'9","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.601503+0000","last_change":"2024-09-13T19:15:57.885999+0000","last_active":"2024-09-13T19:19:05.601503+0000","last_peered":"2024-09-13T19:19:05.601503+0000","last_clean":"2024-09-13T19:19:05.601503+0000","last_became_active":"2024-09-13T19:15:57.885711+0000","last_became_peered":"2024-09-13T19:15:57.885711+0000","last_unstale":"2024-09-13T19:19:05.601503+0000","last_undegraded":"2024-09-13T19:19:05.601503+0000","last_fullsized":"2024-09-13T19:19:05.601503+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:08:12.322988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.827523+0000","last_change":"2024-09-13T19:15:55.891066+0000","last_active":"2024-09-13T19:19:05.827523+0000","last_peered":"2024-09-13T19:19:05.827523+0000","last_clean":"2024-09-13T19:19:05.827523+0000","last_became_active":"2024-09-13T19:15:55.890670+0000","last_became_peered":"2024-09-13T19:15:55.890670+0000","last_unstale":"2024-09-13T19:19:05.827523+0000","last_undegraded":"2024-09-13T19:19:05.827523+0000","last_fullsized":"2024-09-13T19:19:05.827523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:05:45.706743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.989358+0000","last_change":"2024-09-13T19:15:59.894250+0000","last_active":"2024-09-13T19:16:31.989358+0000","last_peered":"2024-09-13T19:16:31.989358+0000","last_clean":"2024-09-13T19:16:31.989358+0000","last_became_active":"2024-09-13T19:15:59.893905+0000","last_became_peered":"2024-09-13T19:15:59.893905+0000","last_unstale":"2024-09-13T19:16:31.989358+0000","last_undegraded":"2024-09-13T19:16:31.989358+0000","last_fullsized":"2024-09-13T19:16:31.989358+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:47.786088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"36'37","reported_seq":82,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:28.943545+0000","last_change":"2024-09-13T19:16:01.903680+0000","last_active":"2024-09-13T19:18:28.943545+0000","last_peered":"2024-09-13T19:18:28.943545+0000","last_clean":"2024-09-13T19:18:28.943545+0000","last_became_active":"2024-09-13T19:16:01.903395+0000","last_became_peered":"2024-09-13T19:16:01.903395+0000","last_unstale":"2024-09-13T19:18:28.943545+0000","last_undegraded":"2024-09-13T19:18:28.943545+0000","last_fullsized":"2024-09-13T19:18:28.943545+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:36.199224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.982986+0000","last_change":"2024-09-13T19:16:03.911108+0000","last_active":"2024-09-13T19:16:31.982986+0000","last_peered":"2024-09-13T19:16:31.982986+0000","last_clean":"2024-09-13T19:16:31.982986+0000","last_became_active":"2024-09-13T19:16:03.910550+0000","last_became_peered":"2024-09-13T19:16:03.910550+0000","last_unstale":"2024-09-13T19:16:31.982986+0000","last_undegraded":"2024-09-13T19:16:31.982986+0000","last_fullsized":"2024-09-13T19:16:31.982986+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:40.236729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"36'2","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.066047+0000","last_change":"2024-09-13T19:16:05.913865+0000","last_active":"2024-09-13T19:19:06.066047+0000","last_peered":"2024-09-13T19:19:06.066047+0000","last_clean":"2024-09-13T19:19:06.066047+0000","last_became_active":"2024-09-13T19:16:05.913598+0000","last_became_peered":"2024-09-13T19:16:05.913598+0000","last_unstale":"2024-09-13T19:19:06.066047+0000","last_undegraded":"2024-09-13T19:19:06.066047+0000","last_fullsized":"2024-09-13T19:19:06.066047+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:52:26.855754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985584+0000","last_change":"2024-09-13T19:15:57.884460+0000","last_active":"2024-09-13T19:16:31.985584+0000","last_peered":"2024-09-13T19:16:31.985584+0000","last_clean":"2024-09-13T19:16:31.985584+0000","last_became_active":"2024-09-13T19:15:57.883463+0000","last_became_peered":"2024-09-13T19:15:57.883463+0000","last_unstale":"2024-09-13T19:16:31.985584+0000","last_undegraded":"2024-09-13T19:16:31.985584+0000","last_fullsized":"2024-09-13T19:16:31.985584+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:25.431664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985018+0000","last_change":"2024-09-13T19:15:55.900188+0000","last_active":"2024-09-13T19:16:31.985018+0000","last_peered":"2024-09-13T19:16:31.985018+0000","last_clean":"2024-09-13T19:16:31.985018+0000","last_became_active":"2024-09-13T19:15:55.899847+0000","last_became_peered":"2024-09-13T19:15:55.899847+0000","last_unstale":"2024-09-13T19:16:31.985018+0000","last_undegraded":"2024-09-13T19:16:31.985018+0000","last_fullsized":"2024-09-13T19:16:31.985018+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:58.468375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.988573+0000","last_change":"2024-09-13T19:15:59.895828+0000","last_active":"2024-09-13T19:16:31.988573+0000","last_peered":"2024-09-13T19:16:31.988573+0000","last_clean":"2024-09-13T19:16:31.988573+0000","last_became_active":"2024-09-13T19:15:59.895512+0000","last_became_peered":"2024-09-13T19:15:59.895512+0000","last_unstale":"2024-09-13T19:16:31.988573+0000","last_undegraded":"2024-09-13T19:16:31.988573+0000","last_fullsized":"2024-09-13T19:16:31.988573+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:25.447228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"36'30","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.139542+0000","last_change":"2024-09-13T19:16:01.902662+0000","last_active":"2024-09-13T19:18:03.139542+0000","last_peered":"2024-09-13T19:18:03.139542+0000","last_clean":"2024-09-13T19:18:03.139542+0000","last_became_active":"2024-09-13T19:16:01.902285+0000","last_became_peered":"2024-09-13T19:16:01.902285+0000","last_unstale":"2024-09-13T19:18:03.139542+0000","last_undegraded":"2024-09-13T19:18:03.139542+0000","last_fullsized":"2024-09-13T19:18:03.139542+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:09:04.500386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.981123+0000","last_change":"2024-09-13T19:16:03.911855+0000","last_active":"2024-09-13T19:16:31.981123+0000","last_peered":"2024-09-13T19:16:31.981123+0000","last_clean":"2024-09-13T19:16:31.981123+0000","last_became_active":"2024-09-13T19:16:03.911587+0000","last_became_peered":"2024-09-13T19:16:03.911587+0000","last_unstale":"2024-09-13T19:16:31.981123+0000","last_undegraded":"2024-09-13T19:16:31.981123+0000","last_fullsized":"2024-09-13T19:16:31.981123+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:01.426149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.982828+0000","last_change":"2024-09-13T19:16:05.923352+0000","last_active":"2024-09-13T19:16:31.982828+0000","last_peered":"2024-09-13T19:16:31.982828+0000","last_clean":"2024-09-13T19:16:31.982828+0000","last_became_active":"2024-09-13T19:16:05.923014+0000","last_became_peered":"2024-09-13T19:16:05.923014+0000","last_unstale":"2024-09-13T19:16:31.982828+0000","last_undegraded":"2024-09-13T19:16:31.982828+0000","last_fullsized":"2024-09-13T19:16:31.982828+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:13:48.786297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"36'4","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:20.738989+0000","last_change":"2024-09-13T19:15:57.896578+0000","last_active":"2024-09-13T19:17:20.738989+0000","last_peered":"2024-09-13T19:17:20.738989+0000","last_clean":"2024-09-13T19:17:20.738989+0000","last_became_active":"2024-09-13T19:15:57.896310+0000","last_became_peered":"2024-09-13T19:15:57.896310+0000","last_unstale":"2024-09-13T19:17:20.738989+0000","last_undegraded":"2024-09-13T19:17:20.738989+0000","last_fullsized":"2024-09-13T19:17:20.738989+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:34:00.185743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985981+0000","last_change":"2024-09-13T19:15:55.895484+0000","last_active":"2024-09-13T19:16:31.985981+0000","last_peered":"2024-09-13T19:16:31.985981+0000","last_clean":"2024-09-13T19:16:31.985981+0000","last_became_active":"2024-09-13T19:15:55.893600+0000","last_became_peered":"2024-09-13T19:15:55.893600+0000","last_unstale":"2024-09-13T19:16:31.985981+0000","last_undegraded":"2024-09-13T19:16:31.985981+0000","last_fullsized":"2024-09-13T19:16:31.985981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:48.542373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.990846+0000","last_change":"2024-09-13T19:15:59.896873+0000","last_active":"2024-09-13T19:16:31.990846+0000","last_peered":"2024-09-13T19:16:31.990846+0000","last_clean":"2024-09-13T19:16:31.990846+0000","last_became_active":"2024-09-13T19:15:59.896518+0000","last_became_peered":"2024-09-13T19:15:59.896518+0000","last_unstale":"2024-09-13T19:16:31.990846+0000","last_undegraded":"2024-09-13T19:16:31.990846+0000","last_fullsized":"2024-09-13T19:16:31.990846+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:12.206811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"36'26","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.162759+0000","last_change":"2024-09-13T19:16:01.903010+0000","last_active":"2024-09-13T19:18:03.162759+0000","last_peered":"2024-09-13T19:18:03.162759+0000","last_clean":"2024-09-13T19:18:03.162759+0000","last_became_active":"2024-09-13T19:16:01.902699+0000","last_became_peered":"2024-09-13T19:16:01.902699+0000","last_unstale":"2024-09-13T19:18:03.162759+0000","last_undegraded":"2024-09-13T19:18:03.162759+0000","last_fullsized":"2024-09-13T19:18:03.162759+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:52.846038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.981606+0000","last_change":"2024-09-13T19:16:03.913624+0000","last_active":"2024-09-13T19:16:31.981606+0000","last_peered":"2024-09-13T19:16:31.981606+0000","last_clean":"2024-09-13T19:16:31.981606+0000","last_became_active":"2024-09-13T19:16:03.913228+0000","last_became_peered":"2024-09-13T19:16:03.913228+0000","last_unstale":"2024-09-13T19:16:31.981606+0000","last_undegraded":"2024-09-13T19:16:31.981606+0000","last_fullsized":"2024-09-13T19:16:31.981606+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:44:11.841765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"36'4","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.172465+0000","last_change":"2024-09-13T19:16:05.925781+0000","last_active":"2024-09-13T19:18:03.172465+0000","last_peered":"2024-09-13T19:18:03.172465+0000","last_clean":"2024-09-13T19:18:03.172465+0000","last_became_active":"2024-09-13T19:16:05.925519+0000","last_became_peered":"2024-09-13T19:16:05.925519+0000","last_unstale":"2024-09-13T19:18:03.172465+0000","last_undegraded":"2024-09-13T19:18:03.172465+0000","last_fullsized":"2024-09-13T19:18:03.172465+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:36.528746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"36'5","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.930007+0000","last_change":"2024-09-13T19:15:57.886387+0000","last_active":"2024-09-13T19:19:05.930007+0000","last_peered":"2024-09-13T19:19:05.930007+0000","last_clean":"2024-09-13T19:19:05.930007+0000","last_became_active":"2024-09-13T19:15:57.885993+0000","last_became_peered":"2024-09-13T19:15:57.885993+0000","last_unstale":"2024-09-13T19:19:05.930007+0000","last_undegraded":"2024-09-13T19:19:05.930007+0000","last_fullsized":"2024-09-13T19:19:05.930007+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:07.087101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.990648+0000","last_change":"2024-09-13T19:15:55.895882+0000","last_active":"2024-09-13T19:16:31.990648+0000","last_peered":"2024-09-13T19:16:31.990648+0000","last_clean":"2024-09-13T19:16:31.990648+0000","last_became_active":"2024-09-13T19:15:55.895040+0000","last_became_peered":"2024-09-13T19:15:55.895040+0000","last_unstale":"2024-09-13T19:16:31.990648+0000","last_undegraded":"2024-09-13T19:16:31.990648+0000","last_fullsized":"2024-09-13T19:16:31.990648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:24.740012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"36'2","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:01.747242+0000","last_change":"2024-09-13T19:15:59.897872+0000","last_active":"2024-09-13T19:18:01.747242+0000","last_peered":"2024-09-13T19:18:01.747242+0000","last_clean":"2024-09-13T19:18:01.747242+0000","last_became_active":"2024-09-13T19:15:59.897609+0000","last_became_peered":"2024-09-13T19:15:59.897609+0000","last_unstale":"2024-09-13T19:18:01.747242+0000","last_undegraded":"2024-09-13T19:18:01.747242+0000","last_fullsized":"2024-09-13T19:18:01.747242+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:51.446526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"36'33","reported_seq":77,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.037728+0000","last_change":"2024-09-13T19:16:01.902324+0000","last_active":"2024-09-13T19:19:05.037728+0000","last_peered":"2024-09-13T19:19:05.037728+0000","last_clean":"2024-09-13T19:19:05.037728+0000","last_became_active":"2024-09-13T19:16:01.902042+0000","last_became_peered":"2024-09-13T19:16:01.902042+0000","last_unstale":"2024-09-13T19:19:05.037728+0000","last_undegraded":"2024-09-13T19:19:05.037728+0000","last_fullsized":"2024-09-13T19:19:05.037728+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:30:13.522406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984100+0000","last_change":"2024-09-13T19:16:03.911392+0000","last_active":"2024-09-13T19:16:31.984100+0000","last_peered":"2024-09-13T19:16:31.984100+0000","last_clean":"2024-09-13T19:16:31.984100+0000","last_became_active":"2024-09-13T19:16:03.911052+0000","last_became_peered":"2024-09-13T19:16:03.911052+0000","last_unstale":"2024-09-13T19:16:31.984100+0000","last_undegraded":"2024-09-13T19:16:31.984100+0000","last_fullsized":"2024-09-13T19:16:31.984100+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:04.781550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"36'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.174978+0000","last_change":"2024-09-13T19:16:05.924212+0000","last_active":"2024-09-13T19:18:03.174978+0000","last_peered":"2024-09-13T19:18:03.174978+0000","last_clean":"2024-09-13T19:18:03.174978+0000","last_became_active":"2024-09-13T19:16:05.922822+0000","last_became_peered":"2024-09-13T19:16:05.922822+0000","last_unstale":"2024-09-13T19:18:03.174978+0000","last_undegraded":"2024-09-13T19:18:03.174978+0000","last_fullsized":"2024-09-13T19:18:03.174978+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:17:25.804534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"36'1","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:08.940484+0000","last_change":"2024-09-13T19:15:57.903389+0000","last_active":"2024-09-13T19:18:08.940484+0000","last_peered":"2024-09-13T19:18:08.940484+0000","last_clean":"2024-09-13T19:18:08.940484+0000","last_became_active":"2024-09-13T19:15:57.902883+0000","last_became_peered":"2024-09-13T19:15:57.902883+0000","last_unstale":"2024-09-13T19:18:08.940484+0000","last_undegraded":"2024-09-13T19:18:08.940484+0000","last_fullsized":"2024-09-13T19:18:08.940484+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:01:22.545027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.957154+0000","last_change":"2024-09-13T19:15:55.899096+0000","last_active":"2024-09-13T19:19:05.957154+0000","last_peered":"2024-09-13T19:19:05.957154+0000","last_clean":"2024-09-13T19:19:05.957154+0000","last_became_active":"2024-09-13T19:15:55.898653+0000","last_became_peered":"2024-09-13T19:15:55.898653+0000","last_unstale":"2024-09-13T19:19:05.957154+0000","last_undegraded":"2024-09-13T19:19:05.957154+0000","last_fullsized":"2024-09-13T19:19:05.957154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:40.072036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"36'8","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.696064+0000","last_change":"2024-09-13T19:15:57.886714+0000","last_active":"2024-09-13T19:19:05.696064+0000","last_peered":"2024-09-13T19:19:05.696064+0000","last_clean":"2024-09-13T19:19:05.696064+0000","last_became_active":"2024-09-13T19:15:57.886330+0000","last_became_peered":"2024-09-13T19:15:57.886330+0000","last_unstale":"2024-09-13T19:19:05.696064+0000","last_undegraded":"2024-09-13T19:19:05.696064+0000","last_fullsized":"2024-09-13T19:19:05.696064+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:30.441032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:04.951690+0000","last_change":"2024-09-13T19:15:55.891290+0000","last_active":"2024-09-13T19:18:04.951690+0000","last_peered":"2024-09-13T19:18:04.951690+0000","last_clean":"2024-09-13T19:18:04.951690+0000","last_became_active":"2024-09-13T19:15:55.890821+0000","last_became_peered":"2024-09-13T19:15:55.890821+0000","last_unstale":"2024-09-13T19:18:04.951690+0000","last_undegraded":"2024-09-13T19:18:04.951690+0000","last_fullsized":"2024-09-13T19:18:04.951690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:08:38.168335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"36'2","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:38.101539+0000","last_change":"2024-09-13T19:15:57.898663+0000","last_active":"2024-09-13T19:16:38.101539+0000","last_peered":"2024-09-13T19:16:38.101539+0000","last_clean":"2024-09-13T19:16:38.101539+0000","last_became_active":"2024-09-13T19:15:57.898295+0000","last_became_peered":"2024-09-13T19:15:57.898295+0000","last_unstale":"2024-09-13T19:16:38.101539+0000","last_undegraded":"2024-09-13T19:16:38.101539+0000","last_fullsized":"2024-09-13T19:16:38.101539+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:31:39.968554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.981947+0000","last_change":"2024-09-13T19:15:55.893929+0000","last_active":"2024-09-13T19:16:31.981947+0000","last_peered":"2024-09-13T19:16:31.981947+0000","last_clean":"2024-09-13T19:16:31.981947+0000","last_became_active":"2024-09-13T19:15:55.893191+0000","last_became_peered":"2024-09-13T19:15:55.893191+0000","last_unstale":"2024-09-13T19:16:31.981947+0000","last_undegraded":"2024-09-13T19:16:31.981947+0000","last_fullsized":"2024-09-13T19:16:31.981947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:27.683071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"36'6","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:01.383171+0000","last_change":"2024-09-13T19:15:57.887458+0000","last_active":"2024-09-13T19:18:01.383171+0000","last_peered":"2024-09-13T19:18:01.383171+0000","last_clean":"2024-09-13T19:18:01.383171+0000","last_became_active":"2024-09-13T19:15:57.886670+0000","last_became_peered":"2024-09-13T19:15:57.886670+0000","last_unstale":"2024-09-13T19:18:01.383171+0000","last_undegraded":"2024-09-13T19:18:01.383171+0000","last_fullsized":"2024-09-13T19:18:01.383171+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:59:56.951236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984646+0000","last_change":"2024-09-13T19:15:55.894421+0000","last_active":"2024-09-13T19:16:31.984646+0000","last_peered":"2024-09-13T19:16:31.984646+0000","last_clean":"2024-09-13T19:16:31.984646+0000","last_became_active":"2024-09-13T19:15:55.893569+0000","last_became_peered":"2024-09-13T19:15:55.893569+0000","last_unstale":"2024-09-13T19:16:31.984646+0000","last_undegraded":"2024-09-13T19:16:31.984646+0000","last_fullsized":"2024-09-13T19:16:31.984646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:12.839590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"36'6","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:20.923363+0000","last_change":"2024-09-13T19:15:57.896837+0000","last_active":"2024-09-13T19:17:20.923363+0000","last_peered":"2024-09-13T19:17:20.923363+0000","last_clean":"2024-09-13T19:17:20.923363+0000","last_became_active":"2024-09-13T19:15:57.896487+0000","last_became_peered":"2024-09-13T19:15:57.896487+0000","last_unstale":"2024-09-13T19:17:20.923363+0000","last_undegraded":"2024-09-13T19:17:20.923363+0000","last_fullsized":"2024-09-13T19:17:20.923363+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:50:35.823934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985084+0000","last_change":"2024-09-13T19:15:55.892917+0000","last_active":"2024-09-13T19:16:31.985084+0000","last_peered":"2024-09-13T19:16:31.985084+0000","last_clean":"2024-09-13T19:16:31.985084+0000","last_became_active":"2024-09-13T19:15:55.892026+0000","last_became_peered":"2024-09-13T19:15:55.892026+0000","last_unstale":"2024-09-13T19:16:31.985084+0000","last_undegraded":"2024-09-13T19:16:31.985084+0000","last_fullsized":"2024-09-13T19:16:31.985084+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:35.843439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"36'16","reported_seq":79,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.968515+0000","last_change":"2024-09-13T19:15:57.903134+0000","last_active":"2024-09-13T19:19:05.968515+0000","last_peered":"2024-09-13T19:19:05.968515+0000","last_clean":"2024-09-13T19:19:05.968515+0000","last_became_active":"2024-09-13T19:15:57.902841+0000","last_became_peered":"2024-09-13T19:15:57.902841+0000","last_unstale":"2024-09-13T19:19:05.968515+0000","last_undegraded":"2024-09-13T19:19:05.968515+0000","last_fullsized":"2024-09-13T19:19:05.968515+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:28:00.527551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":56,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"36'2","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:37.182812+0000","last_change":"2024-09-13T19:15:55.897004+0000","last_active":"2024-09-13T19:16:37.182812+0000","last_peered":"2024-09-13T19:16:37.182812+0000","last_clean":"2024-09-13T19:16:37.182812+0000","last_became_active":"2024-09-13T19:15:55.896490+0000","last_became_peered":"2024-09-13T19:15:55.896490+0000","last_unstale":"2024-09-13T19:16:37.182812+0000","last_undegraded":"2024-09-13T19:16:37.182812+0000","last_fullsized":"2024-09-13T19:16:37.182812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:37.997344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"36'6","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.842512+0000","last_change":"2024-09-13T19:15:57.888143+0000","last_active":"2024-09-13T19:19:05.842512+0000","last_peered":"2024-09-13T19:19:05.842512+0000","last_clean":"2024-09-13T19:19:05.842512+0000","last_became_active":"2024-09-13T19:15:57.887810+0000","last_became_peered":"2024-09-13T19:15:57.887810+0000","last_unstale":"2024-09-13T19:19:05.842512+0000","last_undegraded":"2024-09-13T19:19:05.842512+0000","last_fullsized":"2024-09-13T19:19:05.842512+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:32.469582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.989052+0000","last_change":"2024-09-13T19:15:55.892243+0000","last_active":"2024-09-13T19:16:31.989052+0000","last_peered":"2024-09-13T19:16:31.989052+0000","last_clean":"2024-09-13T19:16:31.989052+0000","last_became_active":"2024-09-13T19:15:55.891422+0000","last_became_peered":"2024-09-13T19:15:55.891422+0000","last_unstale":"2024-09-13T19:16:31.989052+0000","last_undegraded":"2024-09-13T19:16:31.989052+0000","last_fullsized":"2024-09-13T19:16:31.989052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:02.236650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"36'2","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.696175+0000","last_change":"2024-09-13T19:15:57.891037+0000","last_active":"2024-09-13T19:19:05.696175+0000","last_peered":"2024-09-13T19:19:05.696175+0000","last_clean":"2024-09-13T19:19:05.696175+0000","last_became_active":"2024-09-13T19:15:57.890491+0000","last_became_peered":"2024-09-13T19:15:57.890491+0000","last_unstale":"2024-09-13T19:19:05.696175+0000","last_undegraded":"2024-09-13T19:19:05.696175+0000","last_fullsized":"2024-09-13T19:19:05.696175+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:31:09.005785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"36'3","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:06.935961+0000","last_change":"2024-09-13T19:15:55.892364+0000","last_active":"2024-09-13T19:18:06.935961+0000","last_peered":"2024-09-13T19:18:06.935961+0000","last_clean":"2024-09-13T19:18:06.935961+0000","last_became_active":"2024-09-13T19:15:55.891860+0000","last_became_peered":"2024-09-13T19:15:55.891860+0000","last_unstale":"2024-09-13T19:18:06.935961+0000","last_undegraded":"2024-09-13T19:18:06.935961+0000","last_fullsized":"2024-09-13T19:18:06.935961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:50.200323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"36'6","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.842250+0000","last_change":"2024-09-13T19:15:57.892359+0000","last_active":"2024-09-13T19:19:05.842250+0000","last_peered":"2024-09-13T19:19:05.842250+0000","last_clean":"2024-09-13T19:19:05.842250+0000","last_became_active":"2024-09-13T19:15:57.892073+0000","last_became_peered":"2024-09-13T19:15:57.892073+0000","last_unstale":"2024-09-13T19:19:05.842250+0000","last_undegraded":"2024-09-13T19:19:05.842250+0000","last_fullsized":"2024-09-13T19:19:05.842250+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:35.680347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"36'3","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.546064+0000","last_change":"2024-09-13T19:15:55.897908+0000","last_active":"2024-09-13T19:19:05.546064+0000","last_peered":"2024-09-13T19:19:05.546064+0000","last_clean":"2024-09-13T19:19:05.546064+0000","last_became_active":"2024-09-13T19:15:55.895911+0000","last_became_peered":"2024-09-13T19:15:55.895911+0000","last_unstale":"2024-09-13T19:19:05.546064+0000","last_undegraded":"2024-09-13T19:19:05.546064+0000","last_fullsized":"2024-09-13T19:19:05.546064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:13.474342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"36'6","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:20.739628+0000","last_change":"2024-09-13T19:16:31.995370+0000","last_active":"2024-09-13T19:17:20.739628+0000","last_peered":"2024-09-13T19:17:20.739628+0000","last_clean":"2024-09-13T19:17:20.739628+0000","last_became_active":"2024-09-13T19:16:31.993403+0000","last_became_peered":"2024-09-13T19:16:31.993403+0000","last_unstale":"2024-09-13T19:17:20.739628+0000","last_undegraded":"2024-09-13T19:17:20.739628+0000","last_fullsized":"2024-09-13T19:17:20.739628+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:02:35.322551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:38.353948+0000","last_change":"2024-09-13T19:15:55.896003+0000","last_active":"2024-09-13T19:16:38.353948+0000","last_peered":"2024-09-13T19:16:38.353948+0000","last_clean":"2024-09-13T19:16:38.353948+0000","last_became_active":"2024-09-13T19:15:55.894607+0000","last_became_peered":"2024-09-13T19:15:55.894607+0000","last_unstale":"2024-09-13T19:16:38.353948+0000","last_undegraded":"2024-09-13T19:16:38.353948+0000","last_fullsized":"2024-09-13T19:16:38.353948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:23.607524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"36'2","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:20.923380+0000","last_change":"2024-09-13T19:15:57.901296+0000","last_active":"2024-09-13T19:17:20.923380+0000","last_peered":"2024-09-13T19:17:20.923380+0000","last_clean":"2024-09-13T19:17:20.923380+0000","last_became_active":"2024-09-13T19:15:57.900902+0000","last_became_peered":"2024-09-13T19:15:57.900902+0000","last_unstale":"2024-09-13T19:17:20.923380+0000","last_undegraded":"2024-09-13T19:17:20.923380+0000","last_fullsized":"2024-09-13T19:17:20.923380+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:33:43.956584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.988865+0000","last_change":"2024-09-13T19:15:55.906203+0000","last_active":"2024-09-13T19:16:31.988865+0000","last_peered":"2024-09-13T19:16:31.988865+0000","last_clean":"2024-09-13T19:16:31.988865+0000","last_became_active":"2024-09-13T19:15:55.905867+0000","last_became_peered":"2024-09-13T19:15:55.905867+0000","last_unstale":"2024-09-13T19:16:31.988865+0000","last_undegraded":"2024-09-13T19:16:31.988865+0000","last_fullsized":"2024-09-13T19:16:31.988865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:40.072036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.991480+0000","last_change":"2024-09-13T19:15:57.889883+0000","last_active":"2024-09-13T19:16:31.991480+0000","last_peered":"2024-09-13T19:16:31.991480+0000","last_clean":"2024-09-13T19:16:31.991480+0000","last_became_active":"2024-09-13T19:15:57.889606+0000","last_became_peered":"2024-09-13T19:15:57.889606+0000","last_unstale":"2024-09-13T19:16:31.991480+0000","last_undegraded":"2024-09-13T19:16:31.991480+0000","last_fullsized":"2024-09-13T19:16:31.991480+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:14.720100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:37.717588+0000","last_change":"2024-09-13T19:15:55.896394+0000","last_active":"2024-09-13T19:16:37.717588+0000","last_peered":"2024-09-13T19:16:37.717588+0000","last_clean":"2024-09-13T19:16:37.717588+0000","last_became_active":"2024-09-13T19:15:55.896086+0000","last_became_peered":"2024-09-13T19:15:55.896086+0000","last_unstale":"2024-09-13T19:16:37.717588+0000","last_undegraded":"2024-09-13T19:16:37.717588+0000","last_fullsized":"2024-09-13T19:16:37.717588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:07.205939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"36'12","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.842313+0000","last_change":"2024-09-13T19:16:31.992315+0000","last_active":"2024-09-13T19:19:05.842313+0000","last_peered":"2024-09-13T19:19:05.842313+0000","last_clean":"2024-09-13T19:19:05.842313+0000","last_became_active":"2024-09-13T19:16:31.991965+0000","last_became_peered":"2024-09-13T19:16:31.991965+0000","last_unstale":"2024-09-13T19:19:05.842313+0000","last_undegraded":"2024-09-13T19:19:05.842313+0000","last_fullsized":"2024-09-13T19:19:05.842313+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:43.311146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.983154+0000","last_change":"2024-09-13T19:15:55.894925+0000","last_active":"2024-09-13T19:16:31.983154+0000","last_peered":"2024-09-13T19:16:31.983154+0000","last_clean":"2024-09-13T19:16:31.983154+0000","last_became_active":"2024-09-13T19:15:55.894634+0000","last_became_peered":"2024-09-13T19:15:55.894634+0000","last_unstale":"2024-09-13T19:16:31.983154+0000","last_undegraded":"2024-09-13T19:16:31.983154+0000","last_fullsized":"2024-09-13T19:16:31.983154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:43:22.996934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"36'4","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:38.370554+0000","last_change":"2024-09-13T19:15:57.892811+0000","last_active":"2024-09-13T19:16:38.370554+0000","last_peered":"2024-09-13T19:16:38.370554+0000","last_clean":"2024-09-13T19:16:38.370554+0000","last_became_active":"2024-09-13T19:15:57.892558+0000","last_became_peered":"2024-09-13T19:15:57.892558+0000","last_unstale":"2024-09-13T19:16:38.370554+0000","last_undegraded":"2024-09-13T19:16:38.370554+0000","last_fullsized":"2024-09-13T19:16:38.370554+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:32.863560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:04.817098+0000","last_change":"2024-09-13T19:15:55.894980+0000","last_active":"2024-09-13T19:18:04.817098+0000","last_peered":"2024-09-13T19:18:04.817098+0000","last_clean":"2024-09-13T19:18:04.817098+0000","last_became_active":"2024-09-13T19:15:55.894667+0000","last_became_peered":"2024-09-13T19:15:55.894667+0000","last_unstale":"2024-09-13T19:18:04.817098+0000","last_undegraded":"2024-09-13T19:18:04.817098+0000","last_fullsized":"2024-09-13T19:18:04.817098+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:05.649972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"36'17","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.601852+0000","last_change":"2024-09-13T19:15:57.896510+0000","last_active":"2024-09-13T19:19:05.601852+0000","last_peered":"2024-09-13T19:19:05.601852+0000","last_clean":"2024-09-13T19:19:05.601852+0000","last_became_active":"2024-09-13T19:15:57.896200+0000","last_became_peered":"2024-09-13T19:15:57.896200+0000","last_unstale":"2024-09-13T19:19:05.601852+0000","last_undegraded":"2024-09-13T19:19:05.601852+0000","last_fullsized":"2024-09-13T19:19:05.601852+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:10.570988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":50,"num_read_kb":42,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.575188+0000","last_change":"2024-09-13T19:15:55.899411+0000","last_active":"2024-09-13T19:19:05.575188+0000","last_peered":"2024-09-13T19:19:05.575188+0000","last_clean":"2024-09-13T19:19:05.575188+0000","last_became_active":"2024-09-13T19:15:55.899104+0000","last_became_peered":"2024-09-13T19:15:55.899104+0000","last_unstale":"2024-09-13T19:19:05.575188+0000","last_undegraded":"2024-09-13T19:19:05.575188+0000","last_fullsized":"2024-09-13T19:19:05.575188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:11.960376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"36'12","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.919823+0000","last_change":"2024-09-13T19:15:57.890188+0000","last_active":"2024-09-13T19:19:05.919823+0000","last_peered":"2024-09-13T19:19:05.919823+0000","last_clean":"2024-09-13T19:19:05.919823+0000","last_became_active":"2024-09-13T19:15:57.889781+0000","last_became_peered":"2024-09-13T19:15:57.889781+0000","last_unstale":"2024-09-13T19:19:05.919823+0000","last_undegraded":"2024-09-13T19:19:05.919823+0000","last_fullsized":"2024-09-13T19:19:05.919823+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:25.431664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984819+0000","last_change":"2024-09-13T19:15:55.898914+0000","last_active":"2024-09-13T19:16:31.984819+0000","last_peered":"2024-09-13T19:16:31.984819+0000","last_clean":"2024-09-13T19:16:31.984819+0000","last_became_active":"2024-09-13T19:15:55.898627+0000","last_became_peered":"2024-09-13T19:15:55.898627+0000","last_unstale":"2024-09-13T19:16:31.984819+0000","last_undegraded":"2024-09-13T19:16:31.984819+0000","last_fullsized":"2024-09-13T19:16:31.984819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:12.713518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.981855+0000","last_change":"2024-09-13T19:15:55.899524+0000","last_active":"2024-09-13T19:16:31.981855+0000","last_peered":"2024-09-13T19:16:31.981855+0000","last_clean":"2024-09-13T19:16:31.981855+0000","last_became_active":"2024-09-13T19:15:55.899225+0000","last_became_peered":"2024-09-13T19:15:55.899225+0000","last_unstale":"2024-09-13T19:16:31.981855+0000","last_undegraded":"2024-09-13T19:16:31.981855+0000","last_fullsized":"2024-09-13T19:16:31.981855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:53:11.602684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"36'6","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.695792+0000","last_change":"2024-09-13T19:15:57.890646+0000","last_active":"2024-09-13T19:19:05.695792+0000","last_peered":"2024-09-13T19:19:05.695792+0000","last_clean":"2024-09-13T19:19:05.695792+0000","last_became_active":"2024-09-13T19:15:57.890325+0000","last_became_peered":"2024-09-13T19:15:57.890325+0000","last_unstale":"2024-09-13T19:19:05.695792+0000","last_undegraded":"2024-09-13T19:19:05.695792+0000","last_fullsized":"2024-09-13T19:19:05.695792+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:52:40.259021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.983543+0000","last_change":"2024-09-13T19:15:55.895990+0000","last_active":"2024-09-13T19:16:31.983543+0000","last_peered":"2024-09-13T19:16:31.983543+0000","last_clean":"2024-09-13T19:16:31.983543+0000","last_became_active":"2024-09-13T19:15:55.894485+0000","last_became_peered":"2024-09-13T19:15:55.894485+0000","last_unstale":"2024-09-13T19:16:31.983543+0000","last_undegraded":"2024-09-13T19:16:31.983543+0000","last_fullsized":"2024-09-13T19:16:31.983543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:15.987813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"36'8","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.594537+0000","last_change":"2024-09-13T19:15:57.902376+0000","last_active":"2024-09-13T19:19:05.594537+0000","last_peered":"2024-09-13T19:19:05.594537+0000","last_clean":"2024-09-13T19:19:05.594537+0000","last_became_active":"2024-09-13T19:15:57.902123+0000","last_became_peered":"2024-09-13T19:15:57.902123+0000","last_unstale":"2024-09-13T19:19:05.594537+0000","last_undegraded":"2024-09-13T19:19:05.594537+0000","last_fullsized":"2024-09-13T19:19:05.594537+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:06.873072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1595,"num_read_kb":1485,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38719488,"data_stored":38719488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640303,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48124,"kb_used_data":12780,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323716,"statfs":{"total":96636764160,"available":96587485184,"internally_reserved":0,"allocated":13086720,"data_stored":12741536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640302,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51068,"kb_used_data":11564,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94320772,"statfs":{"total":96636764160,"available":96584470528,"internally_reserved":0,"allocated":11841536,"data_stored":11556210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640302,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40784,"kb_used_data":5440,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94331056,"statfs":{"total":96636764160,"available":96595001344,"internally_reserved":0,"allocated":5570560,"data_stored":5265629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705711,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38036,"kb_used_data":11012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94333804,"statfs":{"total":96636764160,"available":96597815296,"internally_reserved":0,"allocated":11276288,"data_stored":10967495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10809344,"data_stored":10809344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4517888,"data_stored":4517888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":10809344,"data_stored":10809344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T19:19:13.531 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T19:19:13.531 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T19:19:13.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.659+0000 7f0f22d11640 1 Processor -- start 2024-09-13T19:19:13.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.660+0000 7f0f22d11640 1 -- start start 2024-09-13T19:19:13.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.660+0000 7f0f22d11640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0f1c096a10 0x7f0f1c06e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:13.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.660+0000 7f0f22d11640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f1c0702f0 con 0x7f0f1c096630 2024-09-13T19:19:13.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.660+0000 7f0f22d11640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f0f1c096e20 con 0x7f0f1c096a10 2024-09-13T19:19:13.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.660+0000 7f0f1bfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0f1c096a10 0x7f0f1c06e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:13.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.660+0000 7f0f20aad640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f0f1c096630 0x7f0f1c06d910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59842/0 (socket says 172.21.15.53:59842) 2024-09-13T19:19:13.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.660+0000 7f0f20aad640 1 -- 172.21.15.53:0/3302325257 learned_addr learned my addr 172.21.15.53:0/3302325257 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T19:19:13.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.660+0000 7f0f1bfff640 1 -- 172.21.15.53:0/3302325257 >> v1:172.21.15.53:6789/0 conn(0x7f0f1c096630 legacy=0x7f0f1c06d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:13.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.660+0000 7f0f1bfff640 1 -- 172.21.15.53:0/3302325257 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f1c06f1f0 con 0x7f0f1c096a10 2024-09-13T19:19:13.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.661+0000 7f0f1bfff640 1 --2- 172.21.15.53:0/3302325257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f1c096a10 0x7f0f1c06e020 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f0f1000a8c0 tx=0x7f0f1002b4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d39ffc950a82aba2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:13.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.661+0000 7f0f1b7fe640 1 -- 172.21.15.53:0/3302325257 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f1000b040 con 0x7f0f1c096a10 2024-09-13T19:19:13.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.661+0000 7f0f1b7fe640 1 -- 172.21.15.53:0/3302325257 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f10030640 con 0x7f0f1c096a10 2024-09-13T19:19:13.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.661+0000 7f0f1b7fe640 1 -- 172.21.15.53:0/3302325257 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f10030940 con 0x7f0f1c096a10 2024-09-13T19:19:13.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.662+0000 7f0f22d11640 1 -- 172.21.15.53:0/3302325257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f1c096a10 msgr2=0x7f0f1c06e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:13.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.662+0000 7f0f22d11640 1 --2- 172.21.15.53:0/3302325257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f1c096a10 0x7f0f1c06e020 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f0f1000a8c0 tx=0x7f0f1002b4d0 comp rx=0 tx=0).stop 2024-09-13T19:19:13.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.662+0000 7f0f22d11640 1 -- 172.21.15.53:0/3302325257 shutdown_connections 2024-09-13T19:19:13.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.662+0000 7f0f22d11640 1 --2- 172.21.15.53:0/3302325257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f1c096a10 0x7f0f1c06e020 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:13.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.662+0000 7f0f22d11640 1 -- 172.21.15.53:0/3302325257 >> 172.21.15.53:0/3302325257 conn(0x7f0f1c09a890 msgr2=0x7f0f1c09aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:19:13.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.662+0000 7f0f22d11640 1 -- 172.21.15.53:0/3302325257 shutdown_connections 2024-09-13T19:19:13.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.662+0000 7f0f22d11640 1 -- 172.21.15.53:0/3302325257 wait complete. 2024-09-13T19:19:13.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.663+0000 7f0f22d11640 1 Processor -- start 2024-09-13T19:19:13.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.663+0000 7f0f22d11640 1 -- start start 2024-09-13T19:19:13.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.663+0000 7f0f22d11640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f1c096630 0x7f0f1c1bf070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:13.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.663+0000 7f0f22d11640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f0f1c06e6e0 con 0x7f0f1c096630 2024-09-13T19:19:13.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.663+0000 7f0f20aad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f1c096630 0x7f0f1c1bf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:13.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.663+0000 7f0f20aad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f1c096630 0x7f0f1c1bf070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35928/0 (socket says 172.21.15.53:35928) 2024-09-13T19:19:13.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.663+0000 7f0f20aad640 1 -- 172.21.15.53:0/3213972062 learned_addr learned my addr 172.21.15.53:0/3213972062 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:19:13.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.664+0000 7f0f20aad640 1 -- 172.21.15.53:0/3213972062 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f1c1255c0 con 0x7f0f1c096630 2024-09-13T19:19:13.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.664+0000 7f0f20aad640 1 --2- 172.21.15.53:0/3213972062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f1c096630 0x7f0f1c1bf070 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c00e8c0 tx=0x7f0f0c00ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:13.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.664+0000 7f0f197fa640 1 -- 172.21.15.53:0/3213972062 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f0c015070 con 0x7f0f1c096630 2024-09-13T19:19:13.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.664+0000 7f0f197fa640 1 -- 172.21.15.53:0/3213972062 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f0c005ae0 con 0x7f0f1c096630 2024-09-13T19:19:13.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.664+0000 7f0f22d11640 1 -- 172.21.15.53:0/3213972062 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f1c1272a0 con 0x7f0f1c096630 2024-09-13T19:19:13.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.664+0000 7f0f197fa640 1 -- 172.21.15.53:0/3213972062 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f0c005dc0 con 0x7f0f1c096630 2024-09-13T19:19:13.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.664+0000 7f0f22d11640 1 -- 172.21.15.53:0/3213972062 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f1c1bf5b0 con 0x7f0f1c096630 2024-09-13T19:19:13.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.665+0000 7f0f197fa640 1 -- 172.21.15.53:0/3213972062 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0f0c018070 con 0x7f0f1c096630 2024-09-13T19:19:13.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.665+0000 7f0f22d11640 1 -- 172.21.15.53:0/3213972062 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f1c06d080 con 0x7f0f1c096630 2024-09-13T19:19:13.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.665+0000 7f0f197fa640 1 --2- 172.21.15.53:0/3213972062 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0f080382a0 0x7f0f0803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:13.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.665+0000 7f0f197fa640 1 -- 172.21.15.53:0/3213972062 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f0f0c04e320 con 0x7f0f1c096630 2024-09-13T19:19:13.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.666+0000 7f0f1bfff640 1 --2- 172.21.15.53:0/3213972062 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0f080382a0 0x7f0f0803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:13.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.666+0000 7f0f1bfff640 1 --2- 172.21.15.53:0/3213972062 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0f080382a0 0x7f0f0803a760 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0f10035000 tx=0x7f0f10030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:13.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.670+0000 7f0f197fa640 1 -- 172.21.15.53:0/3213972062 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0f0c010cd0 con 0x7f0f1c096630 2024-09-13T19:19:13.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.840+0000 7f0f22d11640 1 -- 172.21.15.53:0/3213972062 --> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0f1c127040 con 0x7f0f080382a0 2024-09-13T19:19:13.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.855+0000 7f0f197fa640 1 -- 172.21.15.53:0/3213972062 <== mgr.4098 v2:172.21.15.102:6824/4283826432 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665892 (secure 0 0 0) 0x7f0f1c127040 con 0x7f0f080382a0 2024-09-13T19:19:13.867 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:19:13.872 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T19:19:13.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.860+0000 7f0f22d11640 1 -- 172.21.15.53:0/3213972062 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0f080382a0 msgr2=0x7f0f0803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:13.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.860+0000 7f0f22d11640 1 --2- 172.21.15.53:0/3213972062 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0f080382a0 0x7f0f0803a760 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0f10035000 tx=0x7f0f10030000 comp rx=0 tx=0).stop 2024-09-13T19:19:13.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.860+0000 7f0f22d11640 1 -- 172.21.15.53:0/3213972062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f1c096630 msgr2=0x7f0f1c1bf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:13.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.860+0000 7f0f22d11640 1 --2- 172.21.15.53:0/3213972062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f1c096630 0x7f0f1c1bf070 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c00e8c0 tx=0x7f0f0c00ed80 comp rx=0 tx=0).stop 2024-09-13T19:19:13.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.860+0000 7f0f22d11640 1 -- 172.21.15.53:0/3213972062 shutdown_connections 2024-09-13T19:19:13.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.860+0000 7f0f22d11640 1 --2- 172.21.15.53:0/3213972062 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f0f080382a0 0x7f0f0803a760 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:13.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.860+0000 7f0f22d11640 1 --2- 172.21.15.53:0/3213972062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f1c096630 0x7f0f1c1bf070 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:13.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.860+0000 7f0f22d11640 1 -- 172.21.15.53:0/3213972062 >> 172.21.15.53:0/3213972062 conn(0x7f0f1c09a890 msgr2=0x7f0f1c097390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:19:13.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.860+0000 7f0f22d11640 1 -- 172.21.15.53:0/3213972062 shutdown_connections 2024-09-13T19:19:13.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:13.860+0000 7f0f22d11640 1 -- 172.21.15.53:0/3213972062 wait complete. 2024-09-13T19:19:13.876 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":141,"stamp":"2024-09-13T19:19:12.968387+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412809,"num_objects":229,"num_object_clones":0,"num_object_copies":465,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":4867,"num_read_kb":4444,"num_write":2106,"num_write_kb":61374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4479,"ondisk_log_size":4479,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":178012,"kb_used_data":40796,"kb_used_omap":6,"kb_used_meta":137145,"kb_avail":377309348,"statfs":{"total":386547056640,"available":386364772352,"internally_reserved":0,"allocated":41775104,"data_stored":40530870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":140437271},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25811688,"num_objects":9,"num_object_clones":0,"num_object_copies":25,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":452,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003373"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.986470+0000","last_change":"2024-09-13T19:15:55.897703+0000","last_active":"2024-09-13T19:16:31.986470+0000","last_peered":"2024-09-13T19:16:31.986470+0000","last_clean":"2024-09-13T19:16:31.986470+0000","last_became_active":"2024-09-13T19:15:55.897392+0000","last_became_peered":"2024-09-13T19:15:55.897392+0000","last_unstale":"2024-09-13T19:16:31.986470+0000","last_undegraded":"2024-09-13T19:16:31.986470+0000","last_fullsized":"2024-09-13T19:16:31.986470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:06:25.645854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"36'8","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.962167+0000","last_change":"2024-09-13T19:15:57.889239+0000","last_active":"2024-09-13T19:19:05.962167+0000","last_peered":"2024-09-13T19:19:05.962167+0000","last_clean":"2024-09-13T19:19:05.962167+0000","last_became_active":"2024-09-13T19:15:57.888352+0000","last_became_peered":"2024-09-13T19:15:57.888352+0000","last_unstale":"2024-09-13T19:19:05.962167+0000","last_undegraded":"2024-09-13T19:19:05.962167+0000","last_fullsized":"2024-09-13T19:19:05.962167+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:44.850376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"34'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.986216+0000","last_change":"2024-09-13T19:15:55.896090+0000","last_active":"2024-09-13T19:16:31.986216+0000","last_peered":"2024-09-13T19:16:31.986216+0000","last_clean":"2024-09-13T19:16:31.986216+0000","last_became_active":"2024-09-13T19:15:55.894768+0000","last_became_peered":"2024-09-13T19:15:55.894768+0000","last_unstale":"2024-09-13T19:16:31.986216+0000","last_undegraded":"2024-09-13T19:16:31.986216+0000","last_fullsized":"2024-09-13T19:16:31.986216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:42.707424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"36'6","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.063780+0000","last_change":"2024-09-13T19:15:57.895729+0000","last_active":"2024-09-13T19:19:06.063780+0000","last_peered":"2024-09-13T19:19:06.063780+0000","last_clean":"2024-09-13T19:19:06.063780+0000","last_became_active":"2024-09-13T19:15:57.895424+0000","last_became_peered":"2024-09-13T19:15:57.895424+0000","last_unstale":"2024-09-13T19:19:06.063780+0000","last_undegraded":"2024-09-13T19:19:06.063780+0000","last_fullsized":"2024-09-13T19:19:06.063780+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:13:56.189818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985541+0000","last_change":"2024-09-13T19:15:55.900265+0000","last_active":"2024-09-13T19:16:31.985541+0000","last_peered":"2024-09-13T19:16:31.985541+0000","last_clean":"2024-09-13T19:16:31.985541+0000","last_became_active":"2024-09-13T19:15:55.899965+0000","last_became_peered":"2024-09-13T19:15:55.899965+0000","last_unstale":"2024-09-13T19:16:31.985541+0000","last_undegraded":"2024-09-13T19:16:31.985541+0000","last_fullsized":"2024-09-13T19:16:31.985541+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:21.434261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"36'13","reported_seq":70,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.930148+0000","last_change":"2024-09-13T19:15:57.895266+0000","last_active":"2024-09-13T19:19:05.930148+0000","last_peered":"2024-09-13T19:19:05.930148+0000","last_clean":"2024-09-13T19:19:05.930148+0000","last_became_active":"2024-09-13T19:15:57.894955+0000","last_became_peered":"2024-09-13T19:15:57.894955+0000","last_unstale":"2024-09-13T19:19:05.930148+0000","last_undegraded":"2024-09-13T19:19:05.930148+0000","last_fullsized":"2024-09-13T19:19:05.930148+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:00.565048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985385+0000","last_change":"2024-09-13T19:15:55.890339+0000","last_active":"2024-09-13T19:16:31.985385+0000","last_peered":"2024-09-13T19:16:31.985385+0000","last_clean":"2024-09-13T19:16:31.985385+0000","last_became_active":"2024-09-13T19:15:55.889830+0000","last_became_peered":"2024-09-13T19:15:55.889830+0000","last_unstale":"2024-09-13T19:16:31.985385+0000","last_undegraded":"2024-09-13T19:16:31.985385+0000","last_fullsized":"2024-09-13T19:16:31.985385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:24.740012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"36'4","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.699868+0000","last_change":"2024-09-13T19:15:57.895013+0000","last_active":"2024-09-13T19:19:05.699868+0000","last_peered":"2024-09-13T19:19:05.699868+0000","last_clean":"2024-09-13T19:19:05.699868+0000","last_became_active":"2024-09-13T19:15:57.894733+0000","last_became_peered":"2024-09-13T19:15:57.894733+0000","last_unstale":"2024-09-13T19:19:05.699868+0000","last_undegraded":"2024-09-13T19:19:05.699868+0000","last_fullsized":"2024-09-13T19:19:05.699868+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:55:38.336831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"36'3","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:28.944247+0000","last_change":"2024-09-13T19:15:55.895687+0000","last_active":"2024-09-13T19:18:28.944247+0000","last_peered":"2024-09-13T19:18:28.944247+0000","last_clean":"2024-09-13T19:18:28.944247+0000","last_became_active":"2024-09-13T19:15:55.895362+0000","last_became_peered":"2024-09-13T19:15:55.895362+0000","last_unstale":"2024-09-13T19:18:28.944247+0000","last_undegraded":"2024-09-13T19:18:28.944247+0000","last_fullsized":"2024-09-13T19:18:28.944247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:12.815210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"36'8","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.594848+0000","last_change":"2024-09-13T19:15:57.889968+0000","last_active":"2024-09-13T19:19:05.594848+0000","last_peered":"2024-09-13T19:19:05.594848+0000","last_clean":"2024-09-13T19:19:05.594848+0000","last_became_active":"2024-09-13T19:15:57.889664+0000","last_became_peered":"2024-09-13T19:15:57.889664+0000","last_unstale":"2024-09-13T19:19:05.594848+0000","last_undegraded":"2024-09-13T19:19:05.594848+0000","last_fullsized":"2024-09-13T19:19:05.594848+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:07.656555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.836502+0000","last_change":"2024-09-13T19:15:55.890058+0000","last_active":"2024-09-13T19:19:05.836502+0000","last_peered":"2024-09-13T19:19:05.836502+0000","last_clean":"2024-09-13T19:19:05.836502+0000","last_became_active":"2024-09-13T19:15:55.889485+0000","last_became_peered":"2024-09-13T19:15:55.889485+0000","last_unstale":"2024-09-13T19:19:05.836502+0000","last_undegraded":"2024-09-13T19:19:05.836502+0000","last_fullsized":"2024-09-13T19:19:05.836502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:05:45.706743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"36'2","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:37.740715+0000","last_change":"2024-09-13T19:15:57.901409+0000","last_active":"2024-09-13T19:16:37.740715+0000","last_peered":"2024-09-13T19:16:37.740715+0000","last_clean":"2024-09-13T19:16:37.740715+0000","last_became_active":"2024-09-13T19:15:57.900785+0000","last_became_peered":"2024-09-13T19:15:57.900785+0000","last_unstale":"2024-09-13T19:16:37.740715+0000","last_undegraded":"2024-09-13T19:16:37.740715+0000","last_fullsized":"2024-09-13T19:16:37.740715+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:37.144718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"36'1","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:28.944154+0000","last_change":"2024-09-13T19:15:55.898268+0000","last_active":"2024-09-13T19:18:28.944154+0000","last_peered":"2024-09-13T19:18:28.944154+0000","last_clean":"2024-09-13T19:18:28.944154+0000","last_became_active":"2024-09-13T19:15:55.897381+0000","last_became_peered":"2024-09-13T19:15:55.897381+0000","last_unstale":"2024-09-13T19:18:28.944154+0000","last_undegraded":"2024-09-13T19:18:28.944154+0000","last_fullsized":"2024-09-13T19:18:28.944154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:08:10.316406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"36'16","reported_seq":90,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.842428+0000","last_change":"2024-09-13T19:15:57.893695+0000","last_active":"2024-09-13T19:19:05.842428+0000","last_peered":"2024-09-13T19:19:05.842428+0000","last_clean":"2024-09-13T19:19:05.842428+0000","last_became_active":"2024-09-13T19:15:57.893408+0000","last_became_peered":"2024-09-13T19:15:57.893408+0000","last_unstale":"2024-09-13T19:19:05.842428+0000","last_undegraded":"2024-09-13T19:19:05.842428+0000","last_fullsized":"2024-09-13T19:19:05.842428+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:37.777072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"36'1","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:26.939076+0000","last_change":"2024-09-13T19:15:55.901574+0000","last_active":"2024-09-13T19:18:26.939076+0000","last_peered":"2024-09-13T19:18:26.939076+0000","last_clean":"2024-09-13T19:18:26.939076+0000","last_became_active":"2024-09-13T19:15:55.901190+0000","last_became_peered":"2024-09-13T19:15:55.901190+0000","last_unstale":"2024-09-13T19:18:26.939076+0000","last_undegraded":"2024-09-13T19:18:26.939076+0000","last_fullsized":"2024-09-13T19:18:26.939076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:48:45.584149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"36'16","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.842549+0000","last_change":"2024-09-13T19:15:57.898655+0000","last_active":"2024-09-13T19:19:05.842549+0000","last_peered":"2024-09-13T19:19:05.842549+0000","last_clean":"2024-09-13T19:19:05.842549+0000","last_became_active":"2024-09-13T19:15:57.898325+0000","last_became_peered":"2024-09-13T19:15:57.898325+0000","last_unstale":"2024-09-13T19:19:05.842549+0000","last_undegraded":"2024-09-13T19:19:05.842549+0000","last_fullsized":"2024-09-13T19:19:05.842549+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:29.689654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":52,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"36'4","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.842445+0000","last_change":"2024-09-13T19:15:57.890027+0000","last_active":"2024-09-13T19:19:05.842445+0000","last_peered":"2024-09-13T19:19:05.842445+0000","last_clean":"2024-09-13T19:19:05.842445+0000","last_became_active":"2024-09-13T19:15:57.887144+0000","last_became_peered":"2024-09-13T19:15:57.887144+0000","last_unstale":"2024-09-13T19:19:05.842445+0000","last_undegraded":"2024-09-13T19:19:05.842445+0000","last_fullsized":"2024-09-13T19:19:05.842445+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:55.470024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"36'1","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:23.943012+0000","last_change":"2024-09-13T19:15:55.896889+0000","last_active":"2024-09-13T19:18:23.943012+0000","last_peered":"2024-09-13T19:18:23.943012+0000","last_clean":"2024-09-13T19:18:23.943012+0000","last_became_active":"2024-09-13T19:15:55.895552+0000","last_became_peered":"2024-09-13T19:15:55.895552+0000","last_unstale":"2024-09-13T19:18:23.943012+0000","last_undegraded":"2024-09-13T19:18:23.943012+0000","last_fullsized":"2024-09-13T19:18:23.943012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:11.960376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"36'8","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.961901+0000","last_change":"2024-09-13T19:15:57.889071+0000","last_active":"2024-09-13T19:19:05.961901+0000","last_peered":"2024-09-13T19:19:05.961901+0000","last_clean":"2024-09-13T19:19:05.961901+0000","last_became_active":"2024-09-13T19:15:57.886511+0000","last_became_peered":"2024-09-13T19:15:57.886511+0000","last_unstale":"2024-09-13T19:19:05.961901+0000","last_undegraded":"2024-09-13T19:19:05.961901+0000","last_fullsized":"2024-09-13T19:19:05.961901+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:29.689654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.989246+0000","last_change":"2024-09-13T19:15:55.898694+0000","last_active":"2024-09-13T19:16:31.989246+0000","last_peered":"2024-09-13T19:16:31.989246+0000","last_clean":"2024-09-13T19:16:31.989246+0000","last_became_active":"2024-09-13T19:15:55.896952+0000","last_became_peered":"2024-09-13T19:15:55.896952+0000","last_unstale":"2024-09-13T19:16:31.989246+0000","last_undegraded":"2024-09-13T19:16:31.989246+0000","last_fullsized":"2024-09-13T19:16:31.989246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:07.205939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"36'8","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.961849+0000","last_change":"2024-09-13T19:15:57.891691+0000","last_active":"2024-09-13T19:19:05.961849+0000","last_peered":"2024-09-13T19:19:05.961849+0000","last_clean":"2024-09-13T19:19:05.961849+0000","last_became_active":"2024-09-13T19:15:57.891411+0000","last_became_peered":"2024-09-13T19:15:57.891411+0000","last_unstale":"2024-09-13T19:19:05.961849+0000","last_undegraded":"2024-09-13T19:19:05.961849+0000","last_fullsized":"2024-09-13T19:19:05.961849+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:00.474958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"36'2","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:37.184808+0000","last_change":"2024-09-13T19:15:55.896710+0000","last_active":"2024-09-13T19:16:37.184808+0000","last_peered":"2024-09-13T19:16:37.184808+0000","last_clean":"2024-09-13T19:16:37.184808+0000","last_became_active":"2024-09-13T19:15:55.895453+0000","last_became_peered":"2024-09-13T19:15:55.895453+0000","last_unstale":"2024-09-13T19:16:37.184808+0000","last_undegraded":"2024-09-13T19:16:37.184808+0000","last_fullsized":"2024-09-13T19:16:37.184808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:02.236650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"36'8","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.700241+0000","last_change":"2024-09-13T19:15:57.896559+0000","last_active":"2024-09-13T19:19:05.700241+0000","last_peered":"2024-09-13T19:19:05.700241+0000","last_clean":"2024-09-13T19:19:05.700241+0000","last_became_active":"2024-09-13T19:15:57.896208+0000","last_became_peered":"2024-09-13T19:15:57.896208+0000","last_unstale":"2024-09-13T19:19:05.700241+0000","last_undegraded":"2024-09-13T19:19:05.700241+0000","last_fullsized":"2024-09-13T19:19:05.700241+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:17.061411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:04.776815+0000","last_change":"2024-09-13T19:15:55.892927+0000","last_active":"2024-09-13T19:18:04.776815+0000","last_peered":"2024-09-13T19:18:04.776815+0000","last_clean":"2024-09-13T19:18:04.776815+0000","last_became_active":"2024-09-13T19:15:55.892616+0000","last_became_peered":"2024-09-13T19:15:55.892616+0000","last_unstale":"2024-09-13T19:18:04.776815+0000","last_undegraded":"2024-09-13T19:18:04.776815+0000","last_fullsized":"2024-09-13T19:18:04.776815+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:43:49.825167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"36'2","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:01.383748+0000","last_change":"2024-09-13T19:15:57.897850+0000","last_active":"2024-09-13T19:18:01.383748+0000","last_peered":"2024-09-13T19:18:01.383748+0000","last_clean":"2024-09-13T19:18:01.383748+0000","last_became_active":"2024-09-13T19:15:57.897566+0000","last_became_peered":"2024-09-13T19:15:57.897566+0000","last_unstale":"2024-09-13T19:18:01.383748+0000","last_undegraded":"2024-09-13T19:18:01.383748+0000","last_fullsized":"2024-09-13T19:18:01.383748+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:28:00.527551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984851+0000","last_change":"2024-09-13T19:15:55.894579+0000","last_active":"2024-09-13T19:16:31.984851+0000","last_peered":"2024-09-13T19:16:31.984851+0000","last_clean":"2024-09-13T19:16:31.984851+0000","last_became_active":"2024-09-13T19:15:55.893594+0000","last_became_peered":"2024-09-13T19:15:55.893594+0000","last_unstale":"2024-09-13T19:16:31.984851+0000","last_undegraded":"2024-09-13T19:16:31.984851+0000","last_fullsized":"2024-09-13T19:16:31.984851+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:00.650641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"36'6","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.842241+0000","last_change":"2024-09-13T19:15:57.890303+0000","last_active":"2024-09-13T19:19:05.842241+0000","last_peered":"2024-09-13T19:19:05.842241+0000","last_clean":"2024-09-13T19:19:05.842241+0000","last_became_active":"2024-09-13T19:15:57.889901+0000","last_became_peered":"2024-09-13T19:15:57.889901+0000","last_unstale":"2024-09-13T19:19:05.842241+0000","last_undegraded":"2024-09-13T19:19:05.842241+0000","last_fullsized":"2024-09-13T19:19:05.842241+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:15.189353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.982141+0000","last_change":"2024-09-13T19:15:55.899097+0000","last_active":"2024-09-13T19:16:31.982141+0000","last_peered":"2024-09-13T19:16:31.982141+0000","last_clean":"2024-09-13T19:16:31.982141+0000","last_became_active":"2024-09-13T19:15:55.898679+0000","last_became_peered":"2024-09-13T19:15:55.898679+0000","last_unstale":"2024-09-13T19:16:31.982141+0000","last_undegraded":"2024-09-13T19:16:31.982141+0000","last_fullsized":"2024-09-13T19:16:31.982141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:27:38.213575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"36'35","reported_seq":99,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.884618+0000","last_change":"2024-09-13T19:16:05.921753+0000","last_active":"2024-09-13T19:19:05.884618+0000","last_peered":"2024-09-13T19:19:05.884618+0000","last_clean":"2024-09-13T19:19:05.884618+0000","last_became_active":"2024-09-13T19:16:05.921156+0000","last_became_peered":"2024-09-13T19:16:05.921156+0000","last_unstale":"2024-09-13T19:19:05.884618+0000","last_undegraded":"2024-09-13T19:19:05.884618+0000","last_fullsized":"2024-09-13T19:19:05.884618+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:05.248200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"36'6","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.601363+0000","last_change":"2024-09-13T19:15:57.897717+0000","last_active":"2024-09-13T19:19:05.601363+0000","last_peered":"2024-09-13T19:19:05.601363+0000","last_clean":"2024-09-13T19:19:05.601363+0000","last_became_active":"2024-09-13T19:15:57.895870+0000","last_became_peered":"2024-09-13T19:15:57.895870+0000","last_unstale":"2024-09-13T19:19:05.601363+0000","last_undegraded":"2024-09-13T19:19:05.601363+0000","last_fullsized":"2024-09-13T19:19:05.601363+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:18.507963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.981961+0000","last_change":"2024-09-13T19:15:55.895213+0000","last_active":"2024-09-13T19:16:31.981961+0000","last_peered":"2024-09-13T19:16:31.981961+0000","last_clean":"2024-09-13T19:16:31.981961+0000","last_became_active":"2024-09-13T19:15:55.894099+0000","last_became_peered":"2024-09-13T19:15:55.894099+0000","last_unstale":"2024-09-13T19:16:31.981961+0000","last_undegraded":"2024-09-13T19:16:31.981961+0000","last_fullsized":"2024-09-13T19:16:31.981961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:27:58.520969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985712+0000","last_change":"2024-09-13T19:15:59.896913+0000","last_active":"2024-09-13T19:16:31.985712+0000","last_peered":"2024-09-13T19:16:31.985712+0000","last_clean":"2024-09-13T19:16:31.985712+0000","last_became_active":"2024-09-13T19:15:59.896648+0000","last_became_peered":"2024-09-13T19:15:59.896648+0000","last_unstale":"2024-09-13T19:16:31.985712+0000","last_undegraded":"2024-09-13T19:16:31.985712+0000","last_fullsized":"2024-09-13T19:16:31.985712+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:46.250392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"36'30","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.155817+0000","last_change":"2024-09-13T19:16:01.907027+0000","last_active":"2024-09-13T19:18:03.155817+0000","last_peered":"2024-09-13T19:18:03.155817+0000","last_clean":"2024-09-13T19:18:03.155817+0000","last_became_active":"2024-09-13T19:16:01.906675+0000","last_became_peered":"2024-09-13T19:16:01.906675+0000","last_unstale":"2024-09-13T19:18:03.155817+0000","last_undegraded":"2024-09-13T19:18:03.155817+0000","last_fullsized":"2024-09-13T19:18:03.155817+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:45.278694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.990499+0000","last_change":"2024-09-13T19:16:03.914490+0000","last_active":"2024-09-13T19:16:31.990499+0000","last_peered":"2024-09-13T19:16:31.990499+0000","last_clean":"2024-09-13T19:16:31.990499+0000","last_became_active":"2024-09-13T19:16:03.914111+0000","last_became_peered":"2024-09-13T19:16:03.914111+0000","last_unstale":"2024-09-13T19:16:31.990499+0000","last_undegraded":"2024-09-13T19:16:31.990499+0000","last_fullsized":"2024-09-13T19:16:31.990499+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:15.864837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"36'7","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:20.744686+0000","last_change":"2024-09-13T19:16:05.925198+0000","last_active":"2024-09-13T19:17:20.744686+0000","last_peered":"2024-09-13T19:17:20.744686+0000","last_clean":"2024-09-13T19:17:20.744686+0000","last_became_active":"2024-09-13T19:16:05.924829+0000","last_became_peered":"2024-09-13T19:16:05.924829+0000","last_unstale":"2024-09-13T19:17:20.744686+0000","last_undegraded":"2024-09-13T19:17:20.744686+0000","last_fullsized":"2024-09-13T19:17:20.744686+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:34:08.741130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"36'10","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.920422+0000","last_change":"2024-09-13T19:15:57.898414+0000","last_active":"2024-09-13T19:19:05.920422+0000","last_peered":"2024-09-13T19:19:05.920422+0000","last_clean":"2024-09-13T19:19:05.920422+0000","last_became_active":"2024-09-13T19:15:57.897928+0000","last_became_peered":"2024-09-13T19:15:57.897928+0000","last_unstale":"2024-09-13T19:19:05.920422+0000","last_undegraded":"2024-09-13T19:19:05.920422+0000","last_fullsized":"2024-09-13T19:19:05.920422+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:32.186245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985358+0000","last_change":"2024-09-13T19:15:55.892255+0000","last_active":"2024-09-13T19:16:31.985358+0000","last_peered":"2024-09-13T19:16:31.985358+0000","last_clean":"2024-09-13T19:16:31.985358+0000","last_became_active":"2024-09-13T19:15:55.891934+0000","last_became_peered":"2024-09-13T19:15:55.891934+0000","last_unstale":"2024-09-13T19:16:31.985358+0000","last_undegraded":"2024-09-13T19:16:31.985358+0000","last_fullsized":"2024-09-13T19:16:31.985358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:14:40.566289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984081+0000","last_change":"2024-09-13T19:15:59.892496+0000","last_active":"2024-09-13T19:16:31.984081+0000","last_peered":"2024-09-13T19:16:31.984081+0000","last_clean":"2024-09-13T19:16:31.984081+0000","last_became_active":"2024-09-13T19:15:59.892230+0000","last_became_peered":"2024-09-13T19:15:59.892230+0000","last_unstale":"2024-09-13T19:16:31.984081+0000","last_undegraded":"2024-09-13T19:16:31.984081+0000","last_fullsized":"2024-09-13T19:16:31.984081+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:58.175054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"36'8","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:38.373021+0000","last_change":"2024-09-13T19:16:01.903662+0000","last_active":"2024-09-13T19:16:38.373021+0000","last_peered":"2024-09-13T19:16:38.373021+0000","last_clean":"2024-09-13T19:16:38.373021+0000","last_became_active":"2024-09-13T19:16:01.903371+0000","last_became_peered":"2024-09-13T19:16:01.903371+0000","last_unstale":"2024-09-13T19:16:38.373021+0000","last_undegraded":"2024-09-13T19:16:38.373021+0000","last_fullsized":"2024-09-13T19:16:38.373021+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:53.296370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.988897+0000","last_change":"2024-09-13T19:16:03.915815+0000","last_active":"2024-09-13T19:16:31.988897+0000","last_peered":"2024-09-13T19:16:31.988897+0000","last_clean":"2024-09-13T19:16:31.988897+0000","last_became_active":"2024-09-13T19:16:03.915538+0000","last_became_peered":"2024-09-13T19:16:03.915538+0000","last_unstale":"2024-09-13T19:16:31.988897+0000","last_undegraded":"2024-09-13T19:16:31.988897+0000","last_fullsized":"2024-09-13T19:16:31.988897+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:54:45.306953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"34'2","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.983505+0000","last_change":"2024-09-13T19:16:05.911958+0000","last_active":"2024-09-13T19:16:31.983505+0000","last_peered":"2024-09-13T19:16:31.983505+0000","last_clean":"2024-09-13T19:16:31.983505+0000","last_became_active":"2024-09-13T19:16:05.911683+0000","last_became_peered":"2024-09-13T19:16:05.911683+0000","last_unstale":"2024-09-13T19:16:31.983505+0000","last_undegraded":"2024-09-13T19:16:31.983505+0000","last_fullsized":"2024-09-13T19:16:31.983505+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:54:45.632821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"36'4","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.919899+0000","last_change":"2024-09-13T19:15:57.897213+0000","last_active":"2024-09-13T19:19:05.919899+0000","last_peered":"2024-09-13T19:19:05.919899+0000","last_clean":"2024-09-13T19:19:05.919899+0000","last_became_active":"2024-09-13T19:15:57.896965+0000","last_became_peered":"2024-09-13T19:15:57.896965+0000","last_unstale":"2024-09-13T19:19:05.919899+0000","last_undegraded":"2024-09-13T19:19:05.919899+0000","last_fullsized":"2024-09-13T19:19:05.919899+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:07:02.179917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.830677+0000","last_change":"2024-09-13T19:15:55.899327+0000","last_active":"2024-09-13T19:19:05.830677+0000","last_peered":"2024-09-13T19:19:05.830677+0000","last_clean":"2024-09-13T19:19:05.830677+0000","last_became_active":"2024-09-13T19:15:55.895444+0000","last_became_peered":"2024-09-13T19:15:55.895444+0000","last_unstale":"2024-09-13T19:19:05.830677+0000","last_undegraded":"2024-09-13T19:19:05.830677+0000","last_fullsized":"2024-09-13T19:19:05.830677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:01:17.850573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.986459+0000","last_change":"2024-09-13T19:15:59.895805+0000","last_active":"2024-09-13T19:16:31.986459+0000","last_peered":"2024-09-13T19:16:31.986459+0000","last_clean":"2024-09-13T19:16:31.986459+0000","last_became_active":"2024-09-13T19:15:59.895332+0000","last_became_peered":"2024-09-13T19:15:59.895332+0000","last_unstale":"2024-09-13T19:16:31.986459+0000","last_undegraded":"2024-09-13T19:16:31.986459+0000","last_fullsized":"2024-09-13T19:16:31.986459+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:50.391526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"34'10","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985590+0000","last_change":"2024-09-13T19:16:01.905730+0000","last_active":"2024-09-13T19:16:31.985590+0000","last_peered":"2024-09-13T19:16:31.985590+0000","last_clean":"2024-09-13T19:16:31.985590+0000","last_became_active":"2024-09-13T19:16:01.905457+0000","last_became_peered":"2024-09-13T19:16:01.905457+0000","last_unstale":"2024-09-13T19:16:31.985590+0000","last_undegraded":"2024-09-13T19:16:31.985590+0000","last_fullsized":"2024-09-13T19:16:31.985590+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:49.792682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"36'282","reported_seq":381,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:04.973465+0000","last_change":"2024-09-13T19:16:03.917127+0000","last_active":"2024-09-13T19:19:04.973465+0000","last_peered":"2024-09-13T19:19:04.973465+0000","last_clean":"2024-09-13T19:19:04.973465+0000","last_became_active":"2024-09-13T19:16:03.916853+0000","last_became_peered":"2024-09-13T19:16:03.916853+0000","last_unstale":"2024-09-13T19:19:04.973465+0000","last_undegraded":"2024-09-13T19:19:04.973465+0000","last_fullsized":"2024-09-13T19:19:04.973465+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:35:56.150634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"36'2","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.897376+0000","last_change":"2024-09-13T19:16:05.912480+0000","last_active":"2024-09-13T19:19:05.897376+0000","last_peered":"2024-09-13T19:19:05.897376+0000","last_clean":"2024-09-13T19:19:05.897376+0000","last_became_active":"2024-09-13T19:16:05.912191+0000","last_became_peered":"2024-09-13T19:16:05.912191+0000","last_unstale":"2024-09-13T19:19:05.897376+0000","last_undegraded":"2024-09-13T19:19:05.897376+0000","last_fullsized":"2024-09-13T19:19:05.897376+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:58.001697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"36'4","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.920393+0000","last_change":"2024-09-13T19:15:57.890567+0000","last_active":"2024-09-13T19:19:05.920393+0000","last_peered":"2024-09-13T19:19:05.920393+0000","last_clean":"2024-09-13T19:19:05.920393+0000","last_became_active":"2024-09-13T19:15:57.890015+0000","last_became_peered":"2024-09-13T19:15:57.890015+0000","last_unstale":"2024-09-13T19:19:05.920393+0000","last_undegraded":"2024-09-13T19:19:05.920393+0000","last_fullsized":"2024-09-13T19:19:05.920393+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:12.703558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.988304+0000","last_change":"2024-09-13T19:15:55.894913+0000","last_active":"2024-09-13T19:16:31.988304+0000","last_peered":"2024-09-13T19:16:31.988304+0000","last_clean":"2024-09-13T19:16:31.988304+0000","last_became_active":"2024-09-13T19:15:55.894380+0000","last_became_peered":"2024-09-13T19:15:55.894380+0000","last_unstale":"2024-09-13T19:16:31.988304+0000","last_undegraded":"2024-09-13T19:16:31.988304+0000","last_fullsized":"2024-09-13T19:16:31.988304+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:50:15.856299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984719+0000","last_change":"2024-09-13T19:15:59.897351+0000","last_active":"2024-09-13T19:16:31.984719+0000","last_peered":"2024-09-13T19:16:31.984719+0000","last_clean":"2024-09-13T19:16:31.984719+0000","last_became_active":"2024-09-13T19:15:59.896572+0000","last_became_peered":"2024-09-13T19:15:59.896572+0000","last_unstale":"2024-09-13T19:16:31.984719+0000","last_undegraded":"2024-09-13T19:16:31.984719+0000","last_fullsized":"2024-09-13T19:16:31.984719+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:59.226392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"36'30","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.150792+0000","last_change":"2024-09-13T19:16:01.906742+0000","last_active":"2024-09-13T19:18:03.150792+0000","last_peered":"2024-09-13T19:18:03.150792+0000","last_clean":"2024-09-13T19:18:03.150792+0000","last_became_active":"2024-09-13T19:16:01.906471+0000","last_became_peered":"2024-09-13T19:16:01.906471+0000","last_unstale":"2024-09-13T19:18:03.150792+0000","last_undegraded":"2024-09-13T19:18:03.150792+0000","last_fullsized":"2024-09-13T19:18:03.150792+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:06.655467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"36'282","reported_seq":410,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.964999+0000","last_change":"2024-09-13T19:16:03.909320+0000","last_active":"2024-09-13T19:19:05.964999+0000","last_peered":"2024-09-13T19:19:05.964999+0000","last_clean":"2024-09-13T19:19:05.964999+0000","last_became_active":"2024-09-13T19:16:03.909046+0000","last_became_peered":"2024-09-13T19:16:03.909046+0000","last_unstale":"2024-09-13T19:19:05.964999+0000","last_undegraded":"2024-09-13T19:19:05.964999+0000","last_fullsized":"2024-09-13T19:19:05.964999+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:17.180563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"36'16","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:01.383779+0000","last_change":"2024-09-13T19:16:31.997893+0000","last_active":"2024-09-13T19:18:01.383779+0000","last_peered":"2024-09-13T19:18:01.383779+0000","last_clean":"2024-09-13T19:18:01.383779+0000","last_became_active":"2024-09-13T19:16:31.991055+0000","last_became_peered":"2024-09-13T19:16:31.991055+0000","last_unstale":"2024-09-13T19:18:01.383779+0000","last_undegraded":"2024-09-13T19:18:01.383779+0000","last_fullsized":"2024-09-13T19:18:01.383779+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:44.244007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":73,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.986838+0000","last_change":"2024-09-13T19:15:55.893934+0000","last_active":"2024-09-13T19:16:31.986838+0000","last_peered":"2024-09-13T19:16:31.986838+0000","last_clean":"2024-09-13T19:16:31.986838+0000","last_became_active":"2024-09-13T19:15:55.893544+0000","last_became_peered":"2024-09-13T19:15:55.893544+0000","last_unstale":"2024-09-13T19:16:31.986838+0000","last_undegraded":"2024-09-13T19:16:31.986838+0000","last_fullsized":"2024-09-13T19:16:31.986838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:18:40.262875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.990140+0000","last_change":"2024-09-13T19:15:59.897690+0000","last_active":"2024-09-13T19:16:31.990140+0000","last_peered":"2024-09-13T19:16:31.990140+0000","last_clean":"2024-09-13T19:16:31.990140+0000","last_became_active":"2024-09-13T19:15:59.897435+0000","last_became_peered":"2024-09-13T19:15:59.897435+0000","last_unstale":"2024-09-13T19:16:31.990140+0000","last_undegraded":"2024-09-13T19:16:31.990140+0000","last_fullsized":"2024-09-13T19:16:31.990140+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:59:16.566449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"36'41","reported_seq":88,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:05.014107+0000","last_change":"2024-09-13T19:16:01.904848+0000","last_active":"2024-09-13T19:18:05.014107+0000","last_peered":"2024-09-13T19:18:05.014107+0000","last_clean":"2024-09-13T19:18:05.014107+0000","last_became_active":"2024-09-13T19:16:01.904454+0000","last_became_peered":"2024-09-13T19:16:01.904454+0000","last_unstale":"2024-09-13T19:18:05.014107+0000","last_undegraded":"2024-09-13T19:18:05.014107+0000","last_fullsized":"2024-09-13T19:18:05.014107+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:57.161122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984623+0000","last_change":"2024-09-13T19:16:03.912757+0000","last_active":"2024-09-13T19:16:31.984623+0000","last_peered":"2024-09-13T19:16:31.984623+0000","last_clean":"2024-09-13T19:16:31.984623+0000","last_became_active":"2024-09-13T19:16:03.912383+0000","last_became_peered":"2024-09-13T19:16:03.912383+0000","last_unstale":"2024-09-13T19:16:31.984623+0000","last_undegraded":"2024-09-13T19:16:31.984623+0000","last_fullsized":"2024-09-13T19:16:31.984623+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:51:11.448119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"36'5","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:20.746478+0000","last_change":"2024-09-13T19:16:05.919436+0000","last_active":"2024-09-13T19:17:20.746478+0000","last_peered":"2024-09-13T19:17:20.746478+0000","last_clean":"2024-09-13T19:17:20.746478+0000","last_became_active":"2024-09-13T19:16:05.919154+0000","last_became_peered":"2024-09-13T19:16:05.919154+0000","last_unstale":"2024-09-13T19:17:20.746478+0000","last_undegraded":"2024-09-13T19:17:20.746478+0000","last_fullsized":"2024-09-13T19:17:20.746478+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:37.455541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"36'3","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.929721+0000","last_change":"2024-09-13T19:15:57.890834+0000","last_active":"2024-09-13T19:19:05.929721+0000","last_peered":"2024-09-13T19:19:05.929721+0000","last_clean":"2024-09-13T19:19:05.929721+0000","last_became_active":"2024-09-13T19:15:57.890345+0000","last_became_peered":"2024-09-13T19:15:57.890345+0000","last_unstale":"2024-09-13T19:19:05.929721+0000","last_undegraded":"2024-09-13T19:19:05.929721+0000","last_fullsized":"2024-09-13T19:19:05.929721+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:57:17.627397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.833713+0000","last_change":"2024-09-13T19:15:55.891871+0000","last_active":"2024-09-13T19:19:05.833713+0000","last_peered":"2024-09-13T19:19:05.833713+0000","last_clean":"2024-09-13T19:19:05.833713+0000","last_became_active":"2024-09-13T19:15:55.891250+0000","last_became_peered":"2024-09-13T19:15:55.891250+0000","last_unstale":"2024-09-13T19:19:05.833713+0000","last_undegraded":"2024-09-13T19:19:05.833713+0000","last_fullsized":"2024-09-13T19:19:05.833713+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:28:19.256515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.983694+0000","last_change":"2024-09-13T19:15:59.891252+0000","last_active":"2024-09-13T19:16:31.983694+0000","last_peered":"2024-09-13T19:16:31.983694+0000","last_clean":"2024-09-13T19:16:31.983694+0000","last_became_active":"2024-09-13T19:15:59.891028+0000","last_became_peered":"2024-09-13T19:15:59.891028+0000","last_unstale":"2024-09-13T19:16:31.983694+0000","last_undegraded":"2024-09-13T19:16:31.983694+0000","last_fullsized":"2024-09-13T19:16:31.983694+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:30:01.518005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"36'30","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.140570+0000","last_change":"2024-09-13T19:16:01.904850+0000","last_active":"2024-09-13T19:18:03.140570+0000","last_peered":"2024-09-13T19:18:03.140570+0000","last_clean":"2024-09-13T19:18:03.140570+0000","last_became_active":"2024-09-13T19:16:01.904534+0000","last_became_peered":"2024-09-13T19:16:01.904534+0000","last_unstale":"2024-09-13T19:18:03.140570+0000","last_undegraded":"2024-09-13T19:18:03.140570+0000","last_fullsized":"2024-09-13T19:18:03.140570+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:00.451745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.983684+0000","last_change":"2024-09-13T19:16:03.914154+0000","last_active":"2024-09-13T19:16:31.983684+0000","last_peered":"2024-09-13T19:16:31.983684+0000","last_clean":"2024-09-13T19:16:31.983684+0000","last_became_active":"2024-09-13T19:16:03.913829+0000","last_became_peered":"2024-09-13T19:16:03.913829+0000","last_unstale":"2024-09-13T19:16:31.983684+0000","last_undegraded":"2024-09-13T19:16:31.983684+0000","last_fullsized":"2024-09-13T19:16:31.983684+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:43:05.803759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"36'3","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:15.156823+0000","last_change":"2024-09-13T19:16:05.913878+0000","last_active":"2024-09-13T19:17:15.156823+0000","last_peered":"2024-09-13T19:17:15.156823+0000","last_clean":"2024-09-13T19:17:15.156823+0000","last_became_active":"2024-09-13T19:16:05.913578+0000","last_became_peered":"2024-09-13T19:16:05.913578+0000","last_unstale":"2024-09-13T19:17:15.156823+0000","last_undegraded":"2024-09-13T19:17:15.156823+0000","last_fullsized":"2024-09-13T19:17:15.156823+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:39.890039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.986992+0000","last_change":"2024-09-13T19:15:57.898011+0000","last_active":"2024-09-13T19:16:31.986992+0000","last_peered":"2024-09-13T19:16:31.986992+0000","last_clean":"2024-09-13T19:16:31.986992+0000","last_became_active":"2024-09-13T19:15:57.897468+0000","last_became_peered":"2024-09-13T19:15:57.897468+0000","last_unstale":"2024-09-13T19:16:31.986992+0000","last_undegraded":"2024-09-13T19:16:31.986992+0000","last_fullsized":"2024-09-13T19:16:31.986992+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:27:40.220158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985332+0000","last_change":"2024-09-13T19:15:55.893786+0000","last_active":"2024-09-13T19:16:31.985332+0000","last_peered":"2024-09-13T19:16:31.985332+0000","last_clean":"2024-09-13T19:16:31.985332+0000","last_became_active":"2024-09-13T19:15:55.893489+0000","last_became_peered":"2024-09-13T19:15:55.893489+0000","last_unstale":"2024-09-13T19:16:31.985332+0000","last_undegraded":"2024-09-13T19:16:31.985332+0000","last_fullsized":"2024-09-13T19:16:31.985332+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:43.870700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985334+0000","last_change":"2024-09-13T19:15:59.895668+0000","last_active":"2024-09-13T19:16:31.985334+0000","last_peered":"2024-09-13T19:16:31.985334+0000","last_clean":"2024-09-13T19:16:31.985334+0000","last_became_active":"2024-09-13T19:15:59.895291+0000","last_became_peered":"2024-09-13T19:15:59.895291+0000","last_unstale":"2024-09-13T19:16:31.985334+0000","last_undegraded":"2024-09-13T19:16:31.985334+0000","last_fullsized":"2024-09-13T19:16:31.985334+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:26.583265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"36'36","reported_seq":81,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.161853+0000","last_change":"2024-09-13T19:16:01.896793+0000","last_active":"2024-09-13T19:18:03.161853+0000","last_peered":"2024-09-13T19:18:03.161853+0000","last_clean":"2024-09-13T19:18:03.161853+0000","last_became_active":"2024-09-13T19:16:01.896507+0000","last_became_peered":"2024-09-13T19:16:01.896507+0000","last_unstale":"2024-09-13T19:18:03.161853+0000","last_undegraded":"2024-09-13T19:18:03.161853+0000","last_fullsized":"2024-09-13T19:18:03.161853+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:36.387463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"36'282","reported_seq":375,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.241587+0000","last_change":"2024-09-13T19:16:03.911636+0000","last_active":"2024-09-13T19:19:06.241587+0000","last_peered":"2024-09-13T19:19:06.241587+0000","last_clean":"2024-09-13T19:19:06.241587+0000","last_became_active":"2024-09-13T19:16:03.910504+0000","last_became_peered":"2024-09-13T19:16:03.910504+0000","last_unstale":"2024-09-13T19:19:06.241587+0000","last_undegraded":"2024-09-13T19:19:06.241587+0000","last_fullsized":"2024-09-13T19:19:06.241587+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:47.820382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"36'4","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:20.736275+0000","last_change":"2024-09-13T19:16:05.913148+0000","last_active":"2024-09-13T19:17:20.736275+0000","last_peered":"2024-09-13T19:17:20.736275+0000","last_clean":"2024-09-13T19:17:20.736275+0000","last_became_active":"2024-09-13T19:16:05.912881+0000","last_became_peered":"2024-09-13T19:16:05.912881+0000","last_unstale":"2024-09-13T19:17:20.736275+0000","last_undegraded":"2024-09-13T19:17:20.736275+0000","last_fullsized":"2024-09-13T19:17:20.736275+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:52:47.776691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"36'4","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.696199+0000","last_change":"2024-09-13T19:15:57.884610+0000","last_active":"2024-09-13T19:19:05.696199+0000","last_peered":"2024-09-13T19:19:05.696199+0000","last_clean":"2024-09-13T19:19:05.696199+0000","last_became_active":"2024-09-13T19:15:57.883675+0000","last_became_peered":"2024-09-13T19:15:57.883675+0000","last_unstale":"2024-09-13T19:19:05.696199+0000","last_undegraded":"2024-09-13T19:19:05.696199+0000","last_fullsized":"2024-09-13T19:19:05.696199+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:14.821792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"36'6","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:13.941865+0000","last_change":"2024-09-13T19:15:55.892801+0000","last_active":"2024-09-13T19:18:13.941865+0000","last_peered":"2024-09-13T19:18:13.941865+0000","last_clean":"2024-09-13T19:18:13.941865+0000","last_became_active":"2024-09-13T19:15:55.891882+0000","last_became_peered":"2024-09-13T19:15:55.891882+0000","last_unstale":"2024-09-13T19:18:13.941865+0000","last_undegraded":"2024-09-13T19:18:13.941865+0000","last_fullsized":"2024-09-13T19:18:13.941865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:04.866489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":15,"num_write_kb":4722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:33.926996+0000","last_change":"2024-09-13T19:16:31.992973+0000","last_active":"2024-09-13T19:16:33.926996+0000","last_peered":"2024-09-13T19:16:33.926996+0000","last_clean":"2024-09-13T19:16:33.926996+0000","last_became_active":"2024-09-13T19:16:31.992122+0000","last_became_peered":"2024-09-13T19:16:31.992122+0000","last_unstale":"2024-09-13T19:16:33.926996+0000","last_undegraded":"2024-09-13T19:16:33.926996+0000","last_fullsized":"2024-09-13T19:16:33.926996+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:17.756694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"36'55","reported_seq":111,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.163816+0000","last_change":"2024-09-13T19:16:01.906341+0000","last_active":"2024-09-13T19:18:03.163816+0000","last_peered":"2024-09-13T19:18:03.163816+0000","last_clean":"2024-09-13T19:18:03.163816+0000","last_became_active":"2024-09-13T19:16:01.906031+0000","last_became_peered":"2024-09-13T19:16:01.906031+0000","last_unstale":"2024-09-13T19:18:03.163816+0000","last_undegraded":"2024-09-13T19:18:03.163816+0000","last_fullsized":"2024-09-13T19:18:03.163816+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:10:29.683024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.983190+0000","last_change":"2024-09-13T19:16:03.908434+0000","last_active":"2024-09-13T19:16:31.983190+0000","last_peered":"2024-09-13T19:16:31.983190+0000","last_clean":"2024-09-13T19:16:31.983190+0000","last_became_active":"2024-09-13T19:16:03.908134+0000","last_became_peered":"2024-09-13T19:16:03.908134+0000","last_unstale":"2024-09-13T19:16:31.983190+0000","last_undegraded":"2024-09-13T19:16:31.983190+0000","last_fullsized":"2024-09-13T19:16:31.983190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:49:37.071802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"36'18","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.183081+0000","last_change":"2024-09-13T19:16:05.915102+0000","last_active":"2024-09-13T19:19:06.183081+0000","last_peered":"2024-09-13T19:19:06.183081+0000","last_clean":"2024-09-13T19:19:06.183081+0000","last_became_active":"2024-09-13T19:16:05.914853+0000","last_became_peered":"2024-09-13T19:16:05.914853+0000","last_unstale":"2024-09-13T19:19:06.183081+0000","last_undegraded":"2024-09-13T19:19:06.183081+0000","last_fullsized":"2024-09-13T19:19:06.183081+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:59.082750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"36'6","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.700154+0000","last_change":"2024-09-13T19:15:57.903310+0000","last_active":"2024-09-13T19:19:05.700154+0000","last_peered":"2024-09-13T19:19:05.700154+0000","last_clean":"2024-09-13T19:19:05.700154+0000","last_became_active":"2024-09-13T19:15:57.902955+0000","last_became_peered":"2024-09-13T19:15:57.902955+0000","last_unstale":"2024-09-13T19:19:05.700154+0000","last_undegraded":"2024-09-13T19:19:05.700154+0000","last_fullsized":"2024-09-13T19:19:05.700154+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:45.877283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984439+0000","last_change":"2024-09-13T19:15:55.891315+0000","last_active":"2024-09-13T19:16:31.984439+0000","last_peered":"2024-09-13T19:16:31.984439+0000","last_clean":"2024-09-13T19:16:31.984439+0000","last_became_active":"2024-09-13T19:15:55.890805+0000","last_became_peered":"2024-09-13T19:15:55.890805+0000","last_unstale":"2024-09-13T19:16:31.984439+0000","last_undegraded":"2024-09-13T19:16:31.984439+0000","last_fullsized":"2024-09-13T19:16:31.984439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:20.126050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.987047+0000","last_change":"2024-09-13T19:15:59.898184+0000","last_active":"2024-09-13T19:16:31.987047+0000","last_peered":"2024-09-13T19:16:31.987047+0000","last_clean":"2024-09-13T19:16:31.987047+0000","last_became_active":"2024-09-13T19:15:59.897884+0000","last_became_peered":"2024-09-13T19:15:59.897884+0000","last_unstale":"2024-09-13T19:16:31.987047+0000","last_undegraded":"2024-09-13T19:16:31.987047+0000","last_fullsized":"2024-09-13T19:16:31.987047+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:34.869944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"36'33","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:18.942178+0000","last_change":"2024-09-13T19:16:01.903021+0000","last_active":"2024-09-13T19:18:18.942178+0000","last_peered":"2024-09-13T19:18:18.942178+0000","last_clean":"2024-09-13T19:18:18.942178+0000","last_became_active":"2024-09-13T19:16:01.902657+0000","last_became_peered":"2024-09-13T19:16:01.902657+0000","last_unstale":"2024-09-13T19:18:18.942178+0000","last_undegraded":"2024-09-13T19:18:18.942178+0000","last_fullsized":"2024-09-13T19:18:18.942178+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:41.157697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5807,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":27,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984486+0000","last_change":"2024-09-13T19:16:03.915798+0000","last_active":"2024-09-13T19:16:31.984486+0000","last_peered":"2024-09-13T19:16:31.984486+0000","last_clean":"2024-09-13T19:16:31.984486+0000","last_became_active":"2024-09-13T19:16:03.915499+0000","last_became_peered":"2024-09-13T19:16:03.915499+0000","last_unstale":"2024-09-13T19:16:31.984486+0000","last_undegraded":"2024-09-13T19:16:31.984486+0000","last_fullsized":"2024-09-13T19:16:31.984486+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:32.988972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"36'3","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:08.940888+0000","last_change":"2024-09-13T19:16:05.920534+0000","last_active":"2024-09-13T19:18:08.940888+0000","last_peered":"2024-09-13T19:18:08.940888+0000","last_clean":"2024-09-13T19:18:08.940888+0000","last_became_active":"2024-09-13T19:16:05.920239+0000","last_became_peered":"2024-09-13T19:16:05.920239+0000","last_unstale":"2024-09-13T19:18:08.940888+0000","last_undegraded":"2024-09-13T19:18:08.940888+0000","last_fullsized":"2024-09-13T19:18:08.940888+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:56.959074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"36'8","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.920365+0000","last_change":"2024-09-13T19:15:57.901642+0000","last_active":"2024-09-13T19:19:05.920365+0000","last_peered":"2024-09-13T19:19:05.920365+0000","last_clean":"2024-09-13T19:19:05.920365+0000","last_became_active":"2024-09-13T19:15:57.901131+0000","last_became_peered":"2024-09-13T19:15:57.901131+0000","last_unstale":"2024-09-13T19:19:05.920365+0000","last_undegraded":"2024-09-13T19:19:05.920365+0000","last_fullsized":"2024-09-13T19:19:05.920365+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:14:23.651972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.982818+0000","last_change":"2024-09-13T19:15:55.900444+0000","last_active":"2024-09-13T19:16:31.982818+0000","last_peered":"2024-09-13T19:16:31.982818+0000","last_clean":"2024-09-13T19:16:31.982818+0000","last_became_active":"2024-09-13T19:15:55.900143+0000","last_became_peered":"2024-09-13T19:15:55.900143+0000","last_unstale":"2024-09-13T19:16:31.982818+0000","last_undegraded":"2024-09-13T19:16:31.982818+0000","last_fullsized":"2024-09-13T19:16:31.982818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:35.770490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984163+0000","last_change":"2024-09-13T19:15:59.895249+0000","last_active":"2024-09-13T19:16:31.984163+0000","last_peered":"2024-09-13T19:16:31.984163+0000","last_clean":"2024-09-13T19:16:31.984163+0000","last_became_active":"2024-09-13T19:15:59.894793+0000","last_became_peered":"2024-09-13T19:15:59.894793+0000","last_unstale":"2024-09-13T19:16:31.984163+0000","last_undegraded":"2024-09-13T19:16:31.984163+0000","last_fullsized":"2024-09-13T19:16:31.984163+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:00:58.200294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"36'36","reported_seq":81,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.170094+0000","last_change":"2024-09-13T19:16:01.898005+0000","last_active":"2024-09-13T19:18:03.170094+0000","last_peered":"2024-09-13T19:18:03.170094+0000","last_clean":"2024-09-13T19:18:03.170094+0000","last_became_active":"2024-09-13T19:16:01.897733+0000","last_became_peered":"2024-09-13T19:16:01.897733+0000","last_unstale":"2024-09-13T19:18:03.170094+0000","last_undegraded":"2024-09-13T19:18:03.170094+0000","last_fullsized":"2024-09-13T19:18:03.170094+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:59:18.573044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"36'282","reported_seq":409,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.187004+0000","last_change":"2024-09-13T19:16:03.916031+0000","last_active":"2024-09-13T19:19:06.187004+0000","last_peered":"2024-09-13T19:19:06.187004+0000","last_clean":"2024-09-13T19:19:06.187004+0000","last_became_active":"2024-09-13T19:16:03.915589+0000","last_became_peered":"2024-09-13T19:16:03.915589+0000","last_unstale":"2024-09-13T19:19:06.187004+0000","last_undegraded":"2024-09-13T19:19:06.187004+0000","last_fullsized":"2024-09-13T19:19:06.187004+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:43.165549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"36'12","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:11.936636+0000","last_change":"2024-09-13T19:16:05.912837+0000","last_active":"2024-09-13T19:18:11.936636+0000","last_peered":"2024-09-13T19:18:11.936636+0000","last_clean":"2024-09-13T19:18:11.936636+0000","last_became_active":"2024-09-13T19:16:05.912339+0000","last_became_peered":"2024-09-13T19:16:05.912339+0000","last_unstale":"2024-09-13T19:18:11.936636+0000","last_undegraded":"2024-09-13T19:18:11.936636+0000","last_fullsized":"2024-09-13T19:18:11.936636+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:59.279329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"36'6","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:38.868840+0000","last_change":"2024-09-13T19:15:57.900840+0000","last_active":"2024-09-13T19:16:38.868840+0000","last_peered":"2024-09-13T19:16:38.868840+0000","last_clean":"2024-09-13T19:16:38.868840+0000","last_became_active":"2024-09-13T19:15:57.900560+0000","last_became_peered":"2024-09-13T19:15:57.900560+0000","last_unstale":"2024-09-13T19:16:38.868840+0000","last_undegraded":"2024-09-13T19:16:38.868840+0000","last_fullsized":"2024-09-13T19:16:38.868840+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:00.474958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.982771+0000","last_change":"2024-09-13T19:15:55.897670+0000","last_active":"2024-09-13T19:16:31.982771+0000","last_peered":"2024-09-13T19:16:31.982771+0000","last_clean":"2024-09-13T19:16:31.982771+0000","last_became_active":"2024-09-13T19:15:55.895799+0000","last_became_peered":"2024-09-13T19:15:55.895799+0000","last_unstale":"2024-09-13T19:16:31.982771+0000","last_undegraded":"2024-09-13T19:16:31.982771+0000","last_fullsized":"2024-09-13T19:16:31.982771+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:36.836879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'3","reported_seq":413,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:04.365221+0000","last_change":"2024-09-13T19:15:59.894637+0000","last_active":"2024-09-13T19:18:04.365221+0000","last_peered":"2024-09-13T19:18:04.365221+0000","last_clean":"2024-09-13T19:18:04.365221+0000","last_became_active":"2024-09-13T19:15:59.894303+0000","last_became_peered":"2024-09-13T19:15:59.894303+0000","last_unstale":"2024-09-13T19:18:04.365221+0000","last_undegraded":"2024-09-13T19:18:04.365221+0000","last_fullsized":"2024-09-13T19:18:04.365221+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:57.476409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"34'10","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.983512+0000","last_change":"2024-09-13T19:16:01.906838+0000","last_active":"2024-09-13T19:16:31.983512+0000","last_peered":"2024-09-13T19:16:31.983512+0000","last_clean":"2024-09-13T19:16:31.983512+0000","last_became_active":"2024-09-13T19:16:01.906490+0000","last_became_peered":"2024-09-13T19:16:01.906490+0000","last_unstale":"2024-09-13T19:16:31.983512+0000","last_undegraded":"2024-09-13T19:16:31.983512+0000","last_fullsized":"2024-09-13T19:16:31.983512+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:37.861718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"36'282","reported_seq":499,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.068344+0000","last_change":"2024-09-13T19:16:03.905840+0000","last_active":"2024-09-13T19:19:06.068344+0000","last_peered":"2024-09-13T19:19:06.068344+0000","last_clean":"2024-09-13T19:19:06.068344+0000","last_became_active":"2024-09-13T19:16:03.905523+0000","last_became_peered":"2024-09-13T19:16:03.905523+0000","last_unstale":"2024-09-13T19:19:06.068344+0000","last_undegraded":"2024-09-13T19:19:06.068344+0000","last_fullsized":"2024-09-13T19:19:06.068344+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:24.576600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"36'4","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:04.643906+0000","last_change":"2024-09-13T19:16:05.910975+0000","last_active":"2024-09-13T19:18:04.643906+0000","last_peered":"2024-09-13T19:18:04.643906+0000","last_clean":"2024-09-13T19:18:04.643906+0000","last_became_active":"2024-09-13T19:16:05.910656+0000","last_became_peered":"2024-09-13T19:16:05.910656+0000","last_unstale":"2024-09-13T19:18:04.643906+0000","last_undegraded":"2024-09-13T19:18:04.643906+0000","last_fullsized":"2024-09-13T19:18:04.643906+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:04:51.033264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"36'3","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:13.941421+0000","last_change":"2024-09-13T19:15:57.904037+0000","last_active":"2024-09-13T19:18:13.941421+0000","last_peered":"2024-09-13T19:18:13.941421+0000","last_clean":"2024-09-13T19:18:13.941421+0000","last_became_active":"2024-09-13T19:15:57.903761+0000","last_became_peered":"2024-09-13T19:15:57.903761+0000","last_unstale":"2024-09-13T19:18:13.941421+0000","last_undegraded":"2024-09-13T19:18:13.941421+0000","last_fullsized":"2024-09-13T19:18:13.941421+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:35:04.649421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.981607+0000","last_change":"2024-09-13T19:15:55.900225+0000","last_active":"2024-09-13T19:16:31.981607+0000","last_peered":"2024-09-13T19:16:31.981607+0000","last_clean":"2024-09-13T19:16:31.981607+0000","last_became_active":"2024-09-13T19:15:55.899919+0000","last_became_peered":"2024-09-13T19:15:55.899919+0000","last_unstale":"2024-09-13T19:16:31.981607+0000","last_undegraded":"2024-09-13T19:16:31.981607+0000","last_fullsized":"2024-09-13T19:16:31.981607+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:05.080518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"36'4","reported_seq":226,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:04.355954+0000","last_change":"2024-09-13T19:15:59.897278+0000","last_active":"2024-09-13T19:18:04.355954+0000","last_peered":"2024-09-13T19:18:04.355954+0000","last_clean":"2024-09-13T19:18:04.355954+0000","last_became_active":"2024-09-13T19:15:59.896081+0000","last_became_peered":"2024-09-13T19:15:59.896081+0000","last_unstale":"2024-09-13T19:18:04.355954+0000","last_undegraded":"2024-09-13T19:18:04.355954+0000","last_fullsized":"2024-09-13T19:18:04.355954+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:24:49.015447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"36'39","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.157144+0000","last_change":"2024-09-13T19:16:01.902853+0000","last_active":"2024-09-13T19:18:03.157144+0000","last_peered":"2024-09-13T19:18:03.157144+0000","last_clean":"2024-09-13T19:18:03.157144+0000","last_became_active":"2024-09-13T19:16:01.902532+0000","last_became_peered":"2024-09-13T19:16:01.902532+0000","last_unstale":"2024-09-13T19:18:03.157144+0000","last_undegraded":"2024-09-13T19:18:03.157144+0000","last_fullsized":"2024-09-13T19:18:03.157144+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:31:43.981533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985458+0000","last_change":"2024-09-13T19:16:03.913346+0000","last_active":"2024-09-13T19:16:31.985458+0000","last_peered":"2024-09-13T19:16:31.985458+0000","last_clean":"2024-09-13T19:16:31.985458+0000","last_became_active":"2024-09-13T19:16:03.913019+0000","last_became_peered":"2024-09-13T19:16:03.913019+0000","last_unstale":"2024-09-13T19:16:31.985458+0000","last_undegraded":"2024-09-13T19:16:31.985458+0000","last_fullsized":"2024-09-13T19:16:31.985458+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:24.528793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"36'8","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.020235+0000","last_change":"2024-09-13T19:16:05.911657+0000","last_active":"2024-09-13T19:19:06.020235+0000","last_peered":"2024-09-13T19:19:06.020235+0000","last_clean":"2024-09-13T19:19:06.020235+0000","last_became_active":"2024-09-13T19:16:05.911364+0000","last_became_peered":"2024-09-13T19:16:05.911364+0000","last_unstale":"2024-09-13T19:19:06.020235+0000","last_undegraded":"2024-09-13T19:19:06.020235+0000","last_fullsized":"2024-09-13T19:19:06.020235+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:04.570906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"36'13","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.969400+0000","last_change":"2024-09-13T19:15:57.901609+0000","last_active":"2024-09-13T19:19:05.969400+0000","last_peered":"2024-09-13T19:19:05.969400+0000","last_clean":"2024-09-13T19:19:05.969400+0000","last_became_active":"2024-09-13T19:15:57.900905+0000","last_became_peered":"2024-09-13T19:15:57.900905+0000","last_unstale":"2024-09-13T19:19:05.969400+0000","last_undegraded":"2024-09-13T19:19:05.969400+0000","last_fullsized":"2024-09-13T19:19:05.969400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:12:06.491226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":205,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.988269+0000","last_change":"2024-09-13T19:15:41.170734+0000","last_active":"2024-09-13T19:16:31.988269+0000","last_peered":"2024-09-13T19:16:31.988269+0000","last_clean":"2024-09-13T19:16:31.988269+0000","last_became_active":"2024-09-13T19:15:41.169707+0000","last_became_peered":"2024-09-13T19:15:41.169707+0000","last_unstale":"2024-09-13T19:16:31.988269+0000","last_undegraded":"2024-09-13T19:16:31.988269+0000","last_fullsized":"2024-09-13T19:16:31.988269+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:39.557965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:39.557965+0000","last_clean_scrub_stamp":"2024-09-13T19:15:39.557965+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:40:20.817136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.982316+0000","last_change":"2024-09-13T19:15:46.580815+0000","last_active":"2024-09-13T19:16:31.982316+0000","last_peered":"2024-09-13T19:16:31.982316+0000","last_clean":"2024-09-13T19:16:31.982316+0000","last_became_active":"2024-09-13T19:15:44.577382+0000","last_became_peered":"2024-09-13T19:15:44.577382+0000","last_unstale":"2024-09-13T19:16:31.982316+0000","last_undegraded":"2024-09-13T19:16:31.982316+0000","last_fullsized":"2024-09-13T19:16:31.982316+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:47.750191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047916199999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.981982+0000","last_change":"2024-09-13T19:15:55.900746+0000","last_active":"2024-09-13T19:16:31.981982+0000","last_peered":"2024-09-13T19:16:31.981982+0000","last_clean":"2024-09-13T19:16:31.981982+0000","last_became_active":"2024-09-13T19:15:55.899672+0000","last_became_peered":"2024-09-13T19:15:55.899672+0000","last_unstale":"2024-09-13T19:16:31.981982+0000","last_undegraded":"2024-09-13T19:16:31.981982+0000","last_fullsized":"2024-09-13T19:16:31.981982+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:57:15.620815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.991398+0000","last_change":"2024-09-13T19:15:59.891901+0000","last_active":"2024-09-13T19:16:31.991398+0000","last_peered":"2024-09-13T19:16:31.991398+0000","last_clean":"2024-09-13T19:16:31.991398+0000","last_became_active":"2024-09-13T19:15:59.891615+0000","last_became_peered":"2024-09-13T19:15:59.891615+0000","last_unstale":"2024-09-13T19:16:31.991398+0000","last_undegraded":"2024-09-13T19:16:31.991398+0000","last_fullsized":"2024-09-13T19:16:31.991398+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:37.130876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"36'76","reported_seq":145,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.167978+0000","last_change":"2024-09-13T19:16:01.905525+0000","last_active":"2024-09-13T19:18:03.167978+0000","last_peered":"2024-09-13T19:18:03.167978+0000","last_clean":"2024-09-13T19:18:03.167978+0000","last_became_active":"2024-09-13T19:16:01.905085+0000","last_became_peered":"2024-09-13T19:16:01.905085+0000","last_unstale":"2024-09-13T19:18:03.167978+0000","last_undegraded":"2024-09-13T19:18:03.167978+0000","last_fullsized":"2024-09-13T19:18:03.167978+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:13:47.049154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985422+0000","last_change":"2024-09-13T19:16:03.914155+0000","last_active":"2024-09-13T19:16:31.985422+0000","last_peered":"2024-09-13T19:16:31.985422+0000","last_clean":"2024-09-13T19:16:31.985422+0000","last_became_active":"2024-09-13T19:16:03.913802+0000","last_became_peered":"2024-09-13T19:16:03.913802+0000","last_unstale":"2024-09-13T19:16:31.985422+0000","last_undegraded":"2024-09-13T19:16:31.985422+0000","last_fullsized":"2024-09-13T19:16:31.985422+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:22.123364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"36'89","reported_seq":187,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.972680+0000","last_change":"2024-09-13T19:16:05.911930+0000","last_active":"2024-09-13T19:19:05.972680+0000","last_peered":"2024-09-13T19:19:05.972680+0000","last_clean":"2024-09-13T19:19:05.972680+0000","last_became_active":"2024-09-13T19:16:05.911595+0000","last_became_peered":"2024-09-13T19:16:05.911595+0000","last_unstale":"2024-09-13T19:19:05.972680+0000","last_undegraded":"2024-09-13T19:19:05.972680+0000","last_fullsized":"2024-09-13T19:19:05.972680+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:14:31.680165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":289,"num_read_kb":269,"num_write":182,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"36'4","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:20.922687+0000","last_change":"2024-09-13T19:15:57.897546+0000","last_active":"2024-09-13T19:17:20.922687+0000","last_peered":"2024-09-13T19:17:20.922687+0000","last_clean":"2024-09-13T19:17:20.922687+0000","last_became_active":"2024-09-13T19:15:57.897307+0000","last_became_peered":"2024-09-13T19:15:57.897307+0000","last_unstale":"2024-09-13T19:17:20.922687+0000","last_undegraded":"2024-09-13T19:17:20.922687+0000","last_fullsized":"2024-09-13T19:17:20.922687+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:49.283391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.981198+0000","last_change":"2024-09-13T19:15:46.581436+0000","last_active":"2024-09-13T19:16:31.981198+0000","last_peered":"2024-09-13T19:16:31.981198+0000","last_clean":"2024-09-13T19:16:31.981198+0000","last_became_active":"2024-09-13T19:15:44.576304+0000","last_became_peered":"2024-09-13T19:15:44.576304+0000","last_unstale":"2024-09-13T19:16:31.981198+0000","last_undegraded":"2024-09-13T19:16:31.981198+0000","last_fullsized":"2024-09-13T19:16:31.981198+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:57.538288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011332060000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"36'4","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:38.347356+0000","last_change":"2024-09-13T19:15:55.891911+0000","last_active":"2024-09-13T19:16:38.347356+0000","last_peered":"2024-09-13T19:16:38.347356+0000","last_clean":"2024-09-13T19:16:38.347356+0000","last_became_active":"2024-09-13T19:15:55.891377+0000","last_became_peered":"2024-09-13T19:15:55.891377+0000","last_unstale":"2024-09-13T19:16:38.347356+0000","last_undegraded":"2024-09-13T19:16:38.347356+0000","last_fullsized":"2024-09-13T19:16:38.347356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:12.598004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985654+0000","last_change":"2024-09-13T19:15:59.896527+0000","last_active":"2024-09-13T19:16:31.985654+0000","last_peered":"2024-09-13T19:16:31.985654+0000","last_clean":"2024-09-13T19:16:31.985654+0000","last_became_active":"2024-09-13T19:15:59.896248+0000","last_became_peered":"2024-09-13T19:15:59.896248+0000","last_unstale":"2024-09-13T19:16:31.985654+0000","last_undegraded":"2024-09-13T19:16:31.985654+0000","last_fullsized":"2024-09-13T19:16:31.985654+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:49.569002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"36'274","reported_seq":477,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.855714+0000","last_change":"2024-09-13T19:16:01.907411+0000","last_active":"2024-09-13T19:19:05.855714+0000","last_peered":"2024-09-13T19:19:05.855714+0000","last_clean":"2024-09-13T19:19:05.855714+0000","last_became_active":"2024-09-13T19:16:01.907024+0000","last_became_peered":"2024-09-13T19:16:01.907024+0000","last_unstale":"2024-09-13T19:19:05.855714+0000","last_undegraded":"2024-09-13T19:19:05.855714+0000","last_fullsized":"2024-09-13T19:19:05.855714+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:22.520942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.982628+0000","last_change":"2024-09-13T19:16:03.916021+0000","last_active":"2024-09-13T19:16:31.982628+0000","last_peered":"2024-09-13T19:16:31.982628+0000","last_clean":"2024-09-13T19:16:31.982628+0000","last_became_active":"2024-09-13T19:16:03.915712+0000","last_became_peered":"2024-09-13T19:16:03.915712+0000","last_unstale":"2024-09-13T19:16:31.982628+0000","last_undegraded":"2024-09-13T19:16:31.982628+0000","last_fullsized":"2024-09-13T19:16:31.982628+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:48.381454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"36'3","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:20.742805+0000","last_change":"2024-09-13T19:16:05.917279+0000","last_active":"2024-09-13T19:17:20.742805+0000","last_peered":"2024-09-13T19:17:20.742805+0000","last_clean":"2024-09-13T19:17:20.742805+0000","last_became_active":"2024-09-13T19:16:05.916999+0000","last_became_peered":"2024-09-13T19:16:05.916999+0000","last_unstale":"2024-09-13T19:17:20.742805+0000","last_undegraded":"2024-09-13T19:17:20.742805+0000","last_fullsized":"2024-09-13T19:17:20.742805+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:56:17.231660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.986198+0000","last_change":"2024-09-13T19:15:57.890320+0000","last_active":"2024-09-13T19:16:31.986198+0000","last_peered":"2024-09-13T19:16:31.986198+0000","last_clean":"2024-09-13T19:16:31.986198+0000","last_became_active":"2024-09-13T19:15:57.889885+0000","last_became_peered":"2024-09-13T19:15:57.889885+0000","last_unstale":"2024-09-13T19:16:31.986198+0000","last_undegraded":"2024-09-13T19:16:31.986198+0000","last_fullsized":"2024-09-13T19:16:31.986198+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:45:51.717296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.983888+0000","last_change":"2024-09-13T19:15:47.256565+0000","last_active":"2024-09-13T19:16:31.983888+0000","last_peered":"2024-09-13T19:16:31.983888+0000","last_clean":"2024-09-13T19:16:31.983888+0000","last_became_active":"2024-09-13T19:15:44.575483+0000","last_became_peered":"2024-09-13T19:15:44.575483+0000","last_unstale":"2024-09-13T19:16:31.983888+0000","last_undegraded":"2024-09-13T19:16:31.983888+0000","last_fullsized":"2024-09-13T19:16:31.983888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:05:11.992289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036796000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"36'6","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:38.361020+0000","last_change":"2024-09-13T19:15:55.892997+0000","last_active":"2024-09-13T19:16:38.361020+0000","last_peered":"2024-09-13T19:16:38.361020+0000","last_clean":"2024-09-13T19:16:38.361020+0000","last_became_active":"2024-09-13T19:15:55.892629+0000","last_became_peered":"2024-09-13T19:15:55.892629+0000","last_unstale":"2024-09-13T19:16:38.361020+0000","last_undegraded":"2024-09-13T19:16:38.361020+0000","last_fullsized":"2024-09-13T19:16:38.361020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:35:23.726304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"27'1","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.986613+0000","last_change":"2024-09-13T19:15:59.892045+0000","last_active":"2024-09-13T19:16:31.986613+0000","last_peered":"2024-09-13T19:16:31.986613+0000","last_clean":"2024-09-13T19:16:31.986613+0000","last_became_active":"2024-09-13T19:15:59.891588+0000","last_became_peered":"2024-09-13T19:15:59.891588+0000","last_unstale":"2024-09-13T19:16:31.986613+0000","last_undegraded":"2024-09-13T19:16:31.986613+0000","last_fullsized":"2024-09-13T19:16:31.986613+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:31:11.012170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'16","reported_seq":84,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:04.973539+0000","last_change":"2024-09-13T19:16:01.904560+0000","last_active":"2024-09-13T19:19:04.973539+0000","last_peered":"2024-09-13T19:19:04.973539+0000","last_clean":"2024-09-13T19:19:04.973539+0000","last_became_active":"2024-09-13T19:16:01.903947+0000","last_became_peered":"2024-09-13T19:16:01.903947+0000","last_unstale":"2024-09-13T19:19:04.973539+0000","last_undegraded":"2024-09-13T19:19:04.973539+0000","last_fullsized":"2024-09-13T19:19:04.973539+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:50.008512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984720+0000","last_change":"2024-09-13T19:16:03.911563+0000","last_active":"2024-09-13T19:16:31.984720+0000","last_peered":"2024-09-13T19:16:31.984720+0000","last_clean":"2024-09-13T19:16:31.984720+0000","last_became_active":"2024-09-13T19:16:03.910776+0000","last_became_peered":"2024-09-13T19:16:03.910776+0000","last_unstale":"2024-09-13T19:16:31.984720+0000","last_undegraded":"2024-09-13T19:16:31.984720+0000","last_fullsized":"2024-09-13T19:16:31.984720+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:23:18.198813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"36'2","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.612807+0000","last_change":"2024-09-13T19:16:05.920464+0000","last_active":"2024-09-13T19:19:05.612807+0000","last_peered":"2024-09-13T19:19:05.612807+0000","last_clean":"2024-09-13T19:19:05.612807+0000","last_became_active":"2024-09-13T19:16:05.920191+0000","last_became_peered":"2024-09-13T19:16:05.920191+0000","last_unstale":"2024-09-13T19:19:05.612807+0000","last_undegraded":"2024-09-13T19:19:05.612807+0000","last_fullsized":"2024-09-13T19:19:05.612807+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:52:02.982809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"36'12","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:05.005403+0000","last_change":"2024-09-13T19:15:57.886935+0000","last_active":"2024-09-13T19:18:05.005403+0000","last_peered":"2024-09-13T19:18:05.005403+0000","last_clean":"2024-09-13T19:18:05.005403+0000","last_became_active":"2024-09-13T19:15:57.886273+0000","last_became_peered":"2024-09-13T19:15:57.886273+0000","last_unstale":"2024-09-13T19:18:05.005403+0000","last_undegraded":"2024-09-13T19:18:05.005403+0000","last_fullsized":"2024-09-13T19:18:05.005403+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:58.238081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":44,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.981722+0000","last_change":"2024-09-13T19:15:46.581526+0000","last_active":"2024-09-13T19:16:31.981722+0000","last_peered":"2024-09-13T19:16:31.981722+0000","last_clean":"2024-09-13T19:16:31.981722+0000","last_became_active":"2024-09-13T19:15:44.576052+0000","last_became_peered":"2024-09-13T19:15:44.576052+0000","last_unstale":"2024-09-13T19:16:31.981722+0000","last_undegraded":"2024-09-13T19:16:31.981722+0000","last_fullsized":"2024-09-13T19:16:31.981722+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:33.633045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012221599999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.824572+0000","last_change":"2024-09-13T19:15:55.892933+0000","last_active":"2024-09-13T19:19:05.824572+0000","last_peered":"2024-09-13T19:19:05.824572+0000","last_clean":"2024-09-13T19:19:05.824572+0000","last_became_active":"2024-09-13T19:15:55.892636+0000","last_became_peered":"2024-09-13T19:15:55.892636+0000","last_unstale":"2024-09-13T19:19:05.824572+0000","last_undegraded":"2024-09-13T19:19:05.824572+0000","last_fullsized":"2024-09-13T19:19:05.824572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:50:15.856299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985127+0000","last_change":"2024-09-13T19:15:59.896602+0000","last_active":"2024-09-13T19:16:31.985127+0000","last_peered":"2024-09-13T19:16:31.985127+0000","last_clean":"2024-09-13T19:16:31.985127+0000","last_became_active":"2024-09-13T19:15:59.896248+0000","last_became_peered":"2024-09-13T19:15:59.896248+0000","last_unstale":"2024-09-13T19:16:31.985127+0000","last_undegraded":"2024-09-13T19:16:31.985127+0000","last_fullsized":"2024-09-13T19:16:31.985127+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:09:14.547740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'13","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.032597+0000","last_change":"2024-09-13T19:16:01.905842+0000","last_active":"2024-09-13T19:19:05.032597+0000","last_peered":"2024-09-13T19:19:05.032597+0000","last_clean":"2024-09-13T19:19:05.032597+0000","last_became_active":"2024-09-13T19:16:01.905280+0000","last_became_peered":"2024-09-13T19:16:01.905280+0000","last_unstale":"2024-09-13T19:19:05.032597+0000","last_undegraded":"2024-09-13T19:19:05.032597+0000","last_fullsized":"2024-09-13T19:19:05.032597+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:18:18.978521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984723+0000","last_change":"2024-09-13T19:16:03.916612+0000","last_active":"2024-09-13T19:16:31.984723+0000","last_peered":"2024-09-13T19:16:31.984723+0000","last_clean":"2024-09-13T19:16:31.984723+0000","last_became_active":"2024-09-13T19:16:03.916344+0000","last_became_peered":"2024-09-13T19:16:03.916344+0000","last_unstale":"2024-09-13T19:16:31.984723+0000","last_undegraded":"2024-09-13T19:16:31.984723+0000","last_fullsized":"2024-09-13T19:16:31.984723+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:58.688605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"36'4","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:04.590724+0000","last_change":"2024-09-13T19:16:05.919765+0000","last_active":"2024-09-13T19:18:04.590724+0000","last_peered":"2024-09-13T19:18:04.590724+0000","last_clean":"2024-09-13T19:18:04.590724+0000","last_became_active":"2024-09-13T19:16:05.919156+0000","last_became_peered":"2024-09-13T19:16:05.919156+0000","last_unstale":"2024-09-13T19:18:04.590724+0000","last_undegraded":"2024-09-13T19:18:04.590724+0000","last_fullsized":"2024-09-13T19:18:04.590724+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:55.590810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"36'18","reported_seq":69,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:05.012582+0000","last_change":"2024-09-13T19:15:57.903146+0000","last_active":"2024-09-13T19:18:05.012582+0000","last_peered":"2024-09-13T19:18:05.012582+0000","last_clean":"2024-09-13T19:18:05.012582+0000","last_became_active":"2024-09-13T19:15:57.902819+0000","last_became_peered":"2024-09-13T19:15:57.902819+0000","last_unstale":"2024-09-13T19:18:05.012582+0000","last_undegraded":"2024-09-13T19:18:05.012582+0000","last_fullsized":"2024-09-13T19:18:05.012582+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:50.793368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":50,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.986102+0000","last_change":"2024-09-13T19:15:55.893781+0000","last_active":"2024-09-13T19:16:31.986102+0000","last_peered":"2024-09-13T19:16:31.986102+0000","last_clean":"2024-09-13T19:16:31.986102+0000","last_became_active":"2024-09-13T19:15:55.893468+0000","last_became_peered":"2024-09-13T19:15:55.893468+0000","last_unstale":"2024-09-13T19:16:31.986102+0000","last_undegraded":"2024-09-13T19:16:31.986102+0000","last_fullsized":"2024-09-13T19:16:31.986102+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:06:44.577134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984402+0000","last_change":"2024-09-13T19:15:46.583117+0000","last_active":"2024-09-13T19:16:31.984402+0000","last_peered":"2024-09-13T19:16:31.984402+0000","last_clean":"2024-09-13T19:16:31.984402+0000","last_became_active":"2024-09-13T19:15:44.575726+0000","last_became_peered":"2024-09-13T19:15:44.575726+0000","last_unstale":"2024-09-13T19:16:31.984402+0000","last_undegraded":"2024-09-13T19:16:31.984402+0000","last_fullsized":"2024-09-13T19:16:31.984402+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:27.090413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041430200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"36'1","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:38.944809+0000","last_change":"2024-09-13T19:16:31.990974+0000","last_active":"2024-09-13T19:18:38.944809+0000","last_peered":"2024-09-13T19:18:38.944809+0000","last_clean":"2024-09-13T19:18:38.944809+0000","last_became_active":"2024-09-13T19:16:31.990669+0000","last_became_peered":"2024-09-13T19:16:31.990669+0000","last_unstale":"2024-09-13T19:18:38.944809+0000","last_undegraded":"2024-09-13T19:18:38.944809+0000","last_fullsized":"2024-09-13T19:18:38.944809+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:49:36.858038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"36'61","reported_seq":120,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.169086+0000","last_change":"2024-09-13T19:16:01.902406+0000","last_active":"2024-09-13T19:18:03.169086+0000","last_peered":"2024-09-13T19:18:03.169086+0000","last_clean":"2024-09-13T19:18:03.169086+0000","last_became_active":"2024-09-13T19:16:01.902095+0000","last_became_peered":"2024-09-13T19:16:01.902095+0000","last_unstale":"2024-09-13T19:18:03.169086+0000","last_undegraded":"2024-09-13T19:18:03.169086+0000","last_fullsized":"2024-09-13T19:18:03.169086+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:52.393641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.986023+0000","last_change":"2024-09-13T19:16:03.910134+0000","last_active":"2024-09-13T19:16:31.986023+0000","last_peered":"2024-09-13T19:16:31.986023+0000","last_clean":"2024-09-13T19:16:31.986023+0000","last_became_active":"2024-09-13T19:16:03.909803+0000","last_became_peered":"2024-09-13T19:16:03.909803+0000","last_unstale":"2024-09-13T19:16:31.986023+0000","last_undegraded":"2024-09-13T19:16:31.986023+0000","last_fullsized":"2024-09-13T19:16:31.986023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:14:02.210649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"36'11","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:05.008743+0000","last_change":"2024-09-13T19:16:05.915976+0000","last_active":"2024-09-13T19:18:05.008743+0000","last_peered":"2024-09-13T19:18:05.008743+0000","last_clean":"2024-09-13T19:18:05.008743+0000","last_became_active":"2024-09-13T19:16:05.915672+0000","last_became_peered":"2024-09-13T19:16:05.915672+0000","last_unstale":"2024-09-13T19:18:05.008743+0000","last_undegraded":"2024-09-13T19:18:05.008743+0000","last_fullsized":"2024-09-13T19:18:05.008743+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:55.714578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"36'10","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:05.005754+0000","last_change":"2024-09-13T19:15:57.903282+0000","last_active":"2024-09-13T19:18:05.005754+0000","last_peered":"2024-09-13T19:18:05.005754+0000","last_clean":"2024-09-13T19:18:05.005754+0000","last_became_active":"2024-09-13T19:15:57.902793+0000","last_became_peered":"2024-09-13T19:15:57.902793+0000","last_unstale":"2024-09-13T19:18:05.005754+0000","last_undegraded":"2024-09-13T19:18:05.005754+0000","last_fullsized":"2024-09-13T19:18:05.005754+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:43:25.003517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984951+0000","last_change":"2024-09-13T19:15:55.895728+0000","last_active":"2024-09-13T19:16:31.984951+0000","last_peered":"2024-09-13T19:16:31.984951+0000","last_clean":"2024-09-13T19:16:31.984951+0000","last_became_active":"2024-09-13T19:15:55.894340+0000","last_became_peered":"2024-09-13T19:15:55.894340+0000","last_unstale":"2024-09-13T19:16:31.984951+0000","last_undegraded":"2024-09-13T19:16:31.984951+0000","last_fullsized":"2024-09-13T19:16:31.984951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:13:59.182464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984808+0000","last_change":"2024-09-13T19:15:46.581685+0000","last_active":"2024-09-13T19:16:31.984808+0000","last_peered":"2024-09-13T19:16:31.984808+0000","last_clean":"2024-09-13T19:16:31.984808+0000","last_became_active":"2024-09-13T19:15:44.576006+0000","last_became_peered":"2024-09-13T19:15:44.576006+0000","last_unstale":"2024-09-13T19:16:31.984808+0000","last_undegraded":"2024-09-13T19:16:31.984808+0000","last_fullsized":"2024-09-13T19:16:31.984808+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:52:37.043288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013309299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.981613+0000","last_change":"2024-09-13T19:15:59.895062+0000","last_active":"2024-09-13T19:16:31.981613+0000","last_peered":"2024-09-13T19:16:31.981613+0000","last_clean":"2024-09-13T19:16:31.981613+0000","last_became_active":"2024-09-13T19:15:59.894761+0000","last_became_peered":"2024-09-13T19:15:59.894761+0000","last_unstale":"2024-09-13T19:16:31.981613+0000","last_undegraded":"2024-09-13T19:16:31.981613+0000","last_fullsized":"2024-09-13T19:16:31.981613+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:04.423400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'14","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.990533+0000","last_change":"2024-09-13T19:16:01.907701+0000","last_active":"2024-09-13T19:16:31.990533+0000","last_peered":"2024-09-13T19:16:31.990533+0000","last_clean":"2024-09-13T19:16:31.990533+0000","last_became_active":"2024-09-13T19:16:01.907419+0000","last_became_peered":"2024-09-13T19:16:01.907419+0000","last_unstale":"2024-09-13T19:16:31.990533+0000","last_undegraded":"2024-09-13T19:16:31.990533+0000","last_fullsized":"2024-09-13T19:16:31.990533+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:12:10.504205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"36'282","reported_seq":346,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:04.973517+0000","last_change":"2024-09-13T19:16:03.908228+0000","last_active":"2024-09-13T19:19:04.973517+0000","last_peered":"2024-09-13T19:19:04.973517+0000","last_clean":"2024-09-13T19:19:04.973517+0000","last_became_active":"2024-09-13T19:16:03.907957+0000","last_became_peered":"2024-09-13T19:16:03.907957+0000","last_unstale":"2024-09-13T19:19:04.973517+0000","last_undegraded":"2024-09-13T19:19:04.973517+0000","last_fullsized":"2024-09-13T19:19:04.973517+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:35.448179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"34'2","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.983260+0000","last_change":"2024-09-13T19:16:05.924834+0000","last_active":"2024-09-13T19:16:31.983260+0000","last_peered":"2024-09-13T19:16:31.983260+0000","last_clean":"2024-09-13T19:16:31.983260+0000","last_became_active":"2024-09-13T19:16:05.924162+0000","last_became_peered":"2024-09-13T19:16:05.924162+0000","last_unstale":"2024-09-13T19:16:31.983260+0000","last_undegraded":"2024-09-13T19:16:31.983260+0000","last_fullsized":"2024-09-13T19:16:31.983260+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:00.770168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"36'6","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.969496+0000","last_change":"2024-09-13T19:15:57.897089+0000","last_active":"2024-09-13T19:19:05.969496+0000","last_peered":"2024-09-13T19:19:05.969496+0000","last_clean":"2024-09-13T19:19:05.969496+0000","last_became_active":"2024-09-13T19:15:57.896078+0000","last_became_peered":"2024-09-13T19:15:57.896078+0000","last_unstale":"2024-09-13T19:19:05.969496+0000","last_undegraded":"2024-09-13T19:19:05.969496+0000","last_fullsized":"2024-09-13T19:19:05.969496+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:10.200427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985502+0000","last_change":"2024-09-13T19:15:55.895594+0000","last_active":"2024-09-13T19:16:31.985502+0000","last_peered":"2024-09-13T19:16:31.985502+0000","last_clean":"2024-09-13T19:16:31.985502+0000","last_became_active":"2024-09-13T19:15:55.895282+0000","last_became_peered":"2024-09-13T19:15:55.895282+0000","last_unstale":"2024-09-13T19:16:31.985502+0000","last_undegraded":"2024-09-13T19:16:31.985502+0000","last_fullsized":"2024-09-13T19:16:31.985502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:13.182770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985921+0000","last_change":"2024-09-13T19:15:46.583177+0000","last_active":"2024-09-13T19:16:31.985921+0000","last_peered":"2024-09-13T19:16:31.985921+0000","last_clean":"2024-09-13T19:16:31.985921+0000","last_became_active":"2024-09-13T19:15:44.574967+0000","last_became_peered":"2024-09-13T19:15:44.574967+0000","last_unstale":"2024-09-13T19:16:31.985921+0000","last_undegraded":"2024-09-13T19:16:31.985921+0000","last_fullsized":"2024-09-13T19:16:31.985921+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:20:13.639706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049330999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"27'1","reported_seq":218,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:04.347176+0000","last_change":"2024-09-13T19:15:59.895363+0000","last_active":"2024-09-13T19:18:04.347176+0000","last_peered":"2024-09-13T19:18:04.347176+0000","last_clean":"2024-09-13T19:18:04.347176+0000","last_became_active":"2024-09-13T19:15:59.894966+0000","last_became_peered":"2024-09-13T19:15:59.894966+0000","last_unstale":"2024-09-13T19:18:04.347176+0000","last_undegraded":"2024-09-13T19:18:04.347176+0000","last_fullsized":"2024-09-13T19:18:04.347176+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:45.317531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"36'11","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:20.925826+0000","last_change":"2024-09-13T19:16:01.903652+0000","last_active":"2024-09-13T19:17:20.925826+0000","last_peered":"2024-09-13T19:17:20.925826+0000","last_clean":"2024-09-13T19:17:20.925826+0000","last_became_active":"2024-09-13T19:16:01.902739+0000","last_became_peered":"2024-09-13T19:16:01.902739+0000","last_unstale":"2024-09-13T19:17:20.925826+0000","last_undegraded":"2024-09-13T19:17:20.925826+0000","last_fullsized":"2024-09-13T19:17:20.925826+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:51:13.428618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"36'282","reported_seq":417,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.183631+0000","last_change":"2024-09-13T19:16:03.909318+0000","last_active":"2024-09-13T19:19:06.183631+0000","last_peered":"2024-09-13T19:19:06.183631+0000","last_clean":"2024-09-13T19:19:06.183631+0000","last_became_active":"2024-09-13T19:16:03.909038+0000","last_became_peered":"2024-09-13T19:16:03.909038+0000","last_unstale":"2024-09-13T19:19:06.183631+0000","last_undegraded":"2024-09-13T19:19:06.183631+0000","last_fullsized":"2024-09-13T19:19:06.183631+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:32.924238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'3","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.990000+0000","last_change":"2024-09-13T19:16:05.924059+0000","last_active":"2024-09-13T19:16:31.990000+0000","last_peered":"2024-09-13T19:16:31.990000+0000","last_clean":"2024-09-13T19:16:31.990000+0000","last_became_active":"2024-09-13T19:16:05.923739+0000","last_became_peered":"2024-09-13T19:16:05.923739+0000","last_unstale":"2024-09-13T19:16:31.990000+0000","last_undegraded":"2024-09-13T19:16:31.990000+0000","last_fullsized":"2024-09-13T19:16:31.990000+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:49.018736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"36'6","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.962120+0000","last_change":"2024-09-13T19:15:57.897999+0000","last_active":"2024-09-13T19:19:05.962120+0000","last_peered":"2024-09-13T19:19:05.962120+0000","last_clean":"2024-09-13T19:19:05.962120+0000","last_became_active":"2024-09-13T19:15:57.897727+0000","last_became_peered":"2024-09-13T19:15:57.897727+0000","last_unstale":"2024-09-13T19:19:05.962120+0000","last_undegraded":"2024-09-13T19:19:05.962120+0000","last_fullsized":"2024-09-13T19:19:05.962120+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:38.843461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.989964+0000","last_change":"2024-09-13T19:15:55.895727+0000","last_active":"2024-09-13T19:16:31.989964+0000","last_peered":"2024-09-13T19:16:31.989964+0000","last_clean":"2024-09-13T19:16:31.989964+0000","last_became_active":"2024-09-13T19:15:55.895394+0000","last_became_peered":"2024-09-13T19:15:55.895394+0000","last_unstale":"2024-09-13T19:16:31.989964+0000","last_undegraded":"2024-09-13T19:16:31.989964+0000","last_fullsized":"2024-09-13T19:16:31.989964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:06:25.645854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984574+0000","last_change":"2024-09-13T19:15:46.581172+0000","last_active":"2024-09-13T19:16:31.984574+0000","last_peered":"2024-09-13T19:16:31.984574+0000","last_clean":"2024-09-13T19:16:31.984574+0000","last_became_active":"2024-09-13T19:15:44.607248+0000","last_became_peered":"2024-09-13T19:15:44.607248+0000","last_unstale":"2024-09-13T19:16:31.984574+0000","last_undegraded":"2024-09-13T19:16:31.984574+0000","last_fullsized":"2024-09-13T19:16:31.984574+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:09:50.029342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086245899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.994102+0000","last_change":"2024-09-13T19:16:31.993085+0000","last_active":"2024-09-13T19:16:31.994102+0000","last_peered":"2024-09-13T19:16:31.994102+0000","last_clean":"2024-09-13T19:16:31.994102+0000","last_became_active":"2024-09-13T19:16:31.992752+0000","last_became_peered":"2024-09-13T19:16:31.992752+0000","last_unstale":"2024-09-13T19:16:31.994102+0000","last_undegraded":"2024-09-13T19:16:31.994102+0000","last_fullsized":"2024-09-13T19:16:31.994102+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:31:25.664984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"36'84","reported_seq":156,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.154948+0000","last_change":"2024-09-13T19:16:01.906627+0000","last_active":"2024-09-13T19:18:03.154948+0000","last_peered":"2024-09-13T19:18:03.154948+0000","last_clean":"2024-09-13T19:18:03.154948+0000","last_became_active":"2024-09-13T19:16:01.906317+0000","last_became_peered":"2024-09-13T19:16:01.906317+0000","last_unstale":"2024-09-13T19:18:03.154948+0000","last_undegraded":"2024-09-13T19:18:03.154948+0000","last_fullsized":"2024-09-13T19:18:03.154948+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:31.838003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":81,"num_read_kb":82,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984273+0000","last_change":"2024-09-13T19:16:03.910414+0000","last_active":"2024-09-13T19:16:31.984273+0000","last_peered":"2024-09-13T19:16:31.984273+0000","last_clean":"2024-09-13T19:16:31.984273+0000","last_became_active":"2024-09-13T19:16:03.909941+0000","last_became_peered":"2024-09-13T19:16:03.909941+0000","last_unstale":"2024-09-13T19:16:31.984273+0000","last_undegraded":"2024-09-13T19:16:31.984273+0000","last_fullsized":"2024-09-13T19:16:31.984273+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:24.874734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.989013+0000","last_change":"2024-09-13T19:16:05.911849+0000","last_active":"2024-09-13T19:16:31.989013+0000","last_peered":"2024-09-13T19:16:31.989013+0000","last_clean":"2024-09-13T19:16:31.989013+0000","last_became_active":"2024-09-13T19:16:05.911465+0000","last_became_peered":"2024-09-13T19:16:05.911465+0000","last_unstale":"2024-09-13T19:16:31.989013+0000","last_undegraded":"2024-09-13T19:16:31.989013+0000","last_fullsized":"2024-09-13T19:16:31.989013+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:53:28.959608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985196+0000","last_change":"2024-09-13T19:16:05.917443+0000","last_active":"2024-09-13T19:16:31.985196+0000","last_peered":"2024-09-13T19:16:31.985196+0000","last_clean":"2024-09-13T19:16:31.985196+0000","last_became_active":"2024-09-13T19:16:05.917156+0000","last_became_peered":"2024-09-13T19:16:05.917156+0000","last_unstale":"2024-09-13T19:16:31.985196+0000","last_undegraded":"2024-09-13T19:16:31.985196+0000","last_fullsized":"2024-09-13T19:16:31.985196+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:54:47.314314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"36'8","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.700214+0000","last_change":"2024-09-13T19:15:57.899020+0000","last_active":"2024-09-13T19:19:05.700214+0000","last_peered":"2024-09-13T19:19:05.700214+0000","last_clean":"2024-09-13T19:19:05.700214+0000","last_became_active":"2024-09-13T19:15:57.898761+0000","last_became_peered":"2024-09-13T19:15:57.898761+0000","last_unstale":"2024-09-13T19:19:05.700214+0000","last_undegraded":"2024-09-13T19:19:05.700214+0000","last_fullsized":"2024-09-13T19:19:05.700214+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:01:19.857155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.982961+0000","last_change":"2024-09-13T19:15:55.898265+0000","last_active":"2024-09-13T19:16:31.982961+0000","last_peered":"2024-09-13T19:16:31.982961+0000","last_clean":"2024-09-13T19:16:31.982961+0000","last_became_active":"2024-09-13T19:15:55.892518+0000","last_became_peered":"2024-09-13T19:15:55.892518+0000","last_unstale":"2024-09-13T19:16:31.982961+0000","last_undegraded":"2024-09-13T19:16:31.982961+0000","last_fullsized":"2024-09-13T19:16:31.982961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:48.786786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.991243+0000","last_change":"2024-09-13T19:15:59.894006+0000","last_active":"2024-09-13T19:16:31.991243+0000","last_peered":"2024-09-13T19:16:31.991243+0000","last_clean":"2024-09-13T19:16:31.991243+0000","last_became_active":"2024-09-13T19:15:59.892690+0000","last_became_peered":"2024-09-13T19:15:59.892690+0000","last_unstale":"2024-09-13T19:16:31.991243+0000","last_undegraded":"2024-09-13T19:16:31.991243+0000","last_fullsized":"2024-09-13T19:16:31.991243+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:09.953397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"36'33","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:23.943430+0000","last_change":"2024-09-13T19:16:01.904994+0000","last_active":"2024-09-13T19:18:23.943430+0000","last_peered":"2024-09-13T19:18:23.943430+0000","last_clean":"2024-09-13T19:18:23.943430+0000","last_became_active":"2024-09-13T19:16:01.904684+0000","last_became_peered":"2024-09-13T19:16:01.904684+0000","last_unstale":"2024-09-13T19:18:23.943430+0000","last_undegraded":"2024-09-13T19:18:23.943430+0000","last_fullsized":"2024-09-13T19:18:23.943430+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:07.994368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.982387+0000","last_change":"2024-09-13T19:16:03.912531+0000","last_active":"2024-09-13T19:16:31.982387+0000","last_peered":"2024-09-13T19:16:31.982387+0000","last_clean":"2024-09-13T19:16:31.982387+0000","last_became_active":"2024-09-13T19:16:03.912244+0000","last_became_peered":"2024-09-13T19:16:03.912244+0000","last_unstale":"2024-09-13T19:16:31.982387+0000","last_undegraded":"2024-09-13T19:16:31.982387+0000","last_fullsized":"2024-09-13T19:16:31.982387+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:47:14.892797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"36'3","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:02.851990+0000","last_change":"2024-09-13T19:16:05.921280+0000","last_active":"2024-09-13T19:18:02.851990+0000","last_peered":"2024-09-13T19:18:02.851990+0000","last_clean":"2024-09-13T19:18:02.851990+0000","last_became_active":"2024-09-13T19:16:05.920951+0000","last_became_peered":"2024-09-13T19:16:05.920951+0000","last_unstale":"2024-09-13T19:18:02.851990+0000","last_undegraded":"2024-09-13T19:18:02.851990+0000","last_fullsized":"2024-09-13T19:18:02.851990+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:21.035521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"36'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.592256+0000","last_change":"2024-09-13T19:15:57.902138+0000","last_active":"2024-09-13T19:19:05.592256+0000","last_peered":"2024-09-13T19:19:05.592256+0000","last_clean":"2024-09-13T19:19:05.592256+0000","last_became_active":"2024-09-13T19:15:57.901732+0000","last_became_peered":"2024-09-13T19:15:57.901732+0000","last_unstale":"2024-09-13T19:19:05.592256+0000","last_undegraded":"2024-09-13T19:19:05.592256+0000","last_fullsized":"2024-09-13T19:19:05.592256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:23.440843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"36'4","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:38.357818+0000","last_change":"2024-09-13T19:15:55.894585+0000","last_active":"2024-09-13T19:16:38.357818+0000","last_peered":"2024-09-13T19:16:38.357818+0000","last_clean":"2024-09-13T19:16:38.357818+0000","last_became_active":"2024-09-13T19:15:55.894279+0000","last_became_peered":"2024-09-13T19:15:55.894279+0000","last_unstale":"2024-09-13T19:16:38.357818+0000","last_undegraded":"2024-09-13T19:16:38.357818+0000","last_fullsized":"2024-09-13T19:16:38.357818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:37.997344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.982888+0000","last_change":"2024-09-13T19:15:59.895645+0000","last_active":"2024-09-13T19:16:31.982888+0000","last_peered":"2024-09-13T19:16:31.982888+0000","last_clean":"2024-09-13T19:16:31.982888+0000","last_became_active":"2024-09-13T19:15:59.895325+0000","last_became_peered":"2024-09-13T19:15:59.895325+0000","last_unstale":"2024-09-13T19:16:31.982888+0000","last_undegraded":"2024-09-13T19:16:31.982888+0000","last_fullsized":"2024-09-13T19:16:31.982888+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:17.756694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"36'5","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.036888+0000","last_change":"2024-09-13T19:16:01.901632+0000","last_active":"2024-09-13T19:19:05.036888+0000","last_peered":"2024-09-13T19:19:05.036888+0000","last_clean":"2024-09-13T19:19:05.036888+0000","last_became_active":"2024-09-13T19:16:01.901250+0000","last_became_peered":"2024-09-13T19:16:01.901250+0000","last_unstale":"2024-09-13T19:19:05.036888+0000","last_undegraded":"2024-09-13T19:19:05.036888+0000","last_fullsized":"2024-09-13T19:19:05.036888+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:51.022673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984245+0000","last_change":"2024-09-13T19:16:03.913428+0000","last_active":"2024-09-13T19:16:31.984245+0000","last_peered":"2024-09-13T19:16:31.984245+0000","last_clean":"2024-09-13T19:16:31.984245+0000","last_became_active":"2024-09-13T19:16:03.913053+0000","last_became_peered":"2024-09-13T19:16:03.913053+0000","last_unstale":"2024-09-13T19:16:31.984245+0000","last_undegraded":"2024-09-13T19:16:31.984245+0000","last_fullsized":"2024-09-13T19:16:31.984245+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:16.591819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"36'2","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.701436+0000","last_change":"2024-09-13T19:16:05.912786+0000","last_active":"2024-09-13T19:19:05.701436+0000","last_peered":"2024-09-13T19:19:05.701436+0000","last_clean":"2024-09-13T19:19:05.701436+0000","last_became_active":"2024-09-13T19:16:05.912428+0000","last_became_peered":"2024-09-13T19:16:05.912428+0000","last_unstale":"2024-09-13T19:19:05.701436+0000","last_undegraded":"2024-09-13T19:19:05.701436+0000","last_fullsized":"2024-09-13T19:19:05.701436+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:59.991034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"36'7","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.968817+0000","last_change":"2024-09-13T19:15:57.896825+0000","last_active":"2024-09-13T19:19:05.968817+0000","last_peered":"2024-09-13T19:19:05.968817+0000","last_clean":"2024-09-13T19:19:05.968817+0000","last_became_active":"2024-09-13T19:15:57.896463+0000","last_became_peered":"2024-09-13T19:15:57.896463+0000","last_unstale":"2024-09-13T19:19:05.968817+0000","last_undegraded":"2024-09-13T19:19:05.968817+0000","last_fullsized":"2024-09-13T19:19:05.968817+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:26.337812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"36'2","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:37.182663+0000","last_change":"2024-09-13T19:15:55.888440+0000","last_active":"2024-09-13T19:16:37.182663+0000","last_peered":"2024-09-13T19:16:37.182663+0000","last_clean":"2024-09-13T19:16:37.182663+0000","last_became_active":"2024-09-13T19:15:55.888108+0000","last_became_peered":"2024-09-13T19:15:55.888108+0000","last_unstale":"2024-09-13T19:16:37.182663+0000","last_undegraded":"2024-09-13T19:16:37.182663+0000","last_fullsized":"2024-09-13T19:16:37.182663+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:04:11.428321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985263+0000","last_change":"2024-09-13T19:15:59.893154+0000","last_active":"2024-09-13T19:16:31.985263+0000","last_peered":"2024-09-13T19:16:31.985263+0000","last_clean":"2024-09-13T19:16:31.985263+0000","last_became_active":"2024-09-13T19:15:59.892842+0000","last_became_peered":"2024-09-13T19:15:59.892842+0000","last_unstale":"2024-09-13T19:16:31.985263+0000","last_undegraded":"2024-09-13T19:16:31.985263+0000","last_fullsized":"2024-09-13T19:16:31.985263+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:16.726485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"36'41","reported_seq":100,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.224131+0000","last_change":"2024-09-13T19:16:01.903266+0000","last_active":"2024-09-13T19:19:05.224131+0000","last_peered":"2024-09-13T19:19:05.224131+0000","last_clean":"2024-09-13T19:19:05.224131+0000","last_became_active":"2024-09-13T19:16:01.902991+0000","last_became_peered":"2024-09-13T19:16:01.902991+0000","last_unstale":"2024-09-13T19:19:05.224131+0000","last_undegraded":"2024-09-13T19:19:05.224131+0000","last_fullsized":"2024-09-13T19:19:05.224131+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:42.038997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.988447+0000","last_change":"2024-09-13T19:16:03.912257+0000","last_active":"2024-09-13T19:16:31.988447+0000","last_peered":"2024-09-13T19:16:31.988447+0000","last_clean":"2024-09-13T19:16:31.988447+0000","last_became_active":"2024-09-13T19:16:03.911917+0000","last_became_peered":"2024-09-13T19:16:03.911917+0000","last_unstale":"2024-09-13T19:16:31.988447+0000","last_undegraded":"2024-09-13T19:16:31.988447+0000","last_fullsized":"2024-09-13T19:16:31.988447+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:23.564311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"36'4","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:01.380390+0000","last_change":"2024-09-13T19:16:05.924382+0000","last_active":"2024-09-13T19:18:01.380390+0000","last_peered":"2024-09-13T19:18:01.380390+0000","last_clean":"2024-09-13T19:18:01.380390+0000","last_became_active":"2024-09-13T19:16:05.923368+0000","last_became_peered":"2024-09-13T19:16:05.923368+0000","last_unstale":"2024-09-13T19:18:01.380390+0000","last_undegraded":"2024-09-13T19:18:01.380390+0000","last_fullsized":"2024-09-13T19:18:01.380390+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:03.139035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"36'16","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.842276+0000","last_change":"2024-09-13T19:16:31.999453+0000","last_active":"2024-09-13T19:19:05.842276+0000","last_peered":"2024-09-13T19:19:05.842276+0000","last_clean":"2024-09-13T19:19:05.842276+0000","last_became_active":"2024-09-13T19:16:31.991993+0000","last_became_peered":"2024-09-13T19:16:31.991993+0000","last_unstale":"2024-09-13T19:19:05.842276+0000","last_undegraded":"2024-09-13T19:19:05.842276+0000","last_fullsized":"2024-09-13T19:19:05.842276+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:24:47.009062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"36'2","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:37.182603+0000","last_change":"2024-09-13T19:15:55.892008+0000","last_active":"2024-09-13T19:16:37.182603+0000","last_peered":"2024-09-13T19:16:37.182603+0000","last_clean":"2024-09-13T19:16:37.182603+0000","last_became_active":"2024-09-13T19:15:55.891711+0000","last_became_peered":"2024-09-13T19:15:55.891711+0000","last_unstale":"2024-09-13T19:16:37.182603+0000","last_undegraded":"2024-09-13T19:16:37.182603+0000","last_fullsized":"2024-09-13T19:16:37.182603+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:18:40.262875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.981334+0000","last_change":"2024-09-13T19:15:59.891859+0000","last_active":"2024-09-13T19:16:31.981334+0000","last_peered":"2024-09-13T19:16:31.981334+0000","last_clean":"2024-09-13T19:16:31.981334+0000","last_became_active":"2024-09-13T19:15:59.891581+0000","last_became_peered":"2024-09-13T19:15:59.891581+0000","last_unstale":"2024-09-13T19:16:31.981334+0000","last_undegraded":"2024-09-13T19:16:31.981334+0000","last_fullsized":"2024-09-13T19:16:31.981334+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:49:36.858038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"36'30","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.147034+0000","last_change":"2024-09-13T19:16:01.899778+0000","last_active":"2024-09-13T19:18:03.147034+0000","last_peered":"2024-09-13T19:18:03.147034+0000","last_clean":"2024-09-13T19:18:03.147034+0000","last_became_active":"2024-09-13T19:16:01.899438+0000","last_became_peered":"2024-09-13T19:16:01.899438+0000","last_unstale":"2024-09-13T19:18:03.147034+0000","last_undegraded":"2024-09-13T19:18:03.147034+0000","last_fullsized":"2024-09-13T19:18:03.147034+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:39.137471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.986072+0000","last_change":"2024-09-13T19:16:03.910613+0000","last_active":"2024-09-13T19:16:31.986072+0000","last_peered":"2024-09-13T19:16:31.986072+0000","last_clean":"2024-09-13T19:16:31.986072+0000","last_became_active":"2024-09-13T19:16:03.910319+0000","last_became_peered":"2024-09-13T19:16:03.910319+0000","last_unstale":"2024-09-13T19:16:31.986072+0000","last_undegraded":"2024-09-13T19:16:31.986072+0000","last_fullsized":"2024-09-13T19:16:31.986072+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:55:44.357662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"36'10","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.842277+0000","last_change":"2024-09-13T19:15:57.897487+0000","last_active":"2024-09-13T19:19:05.842277+0000","last_peered":"2024-09-13T19:19:05.842277+0000","last_clean":"2024-09-13T19:19:05.842277+0000","last_became_active":"2024-09-13T19:15:57.897232+0000","last_became_peered":"2024-09-13T19:15:57.897232+0000","last_unstale":"2024-09-13T19:19:05.842277+0000","last_undegraded":"2024-09-13T19:19:05.842277+0000","last_fullsized":"2024-09-13T19:19:05.842277+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:57:32.169161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:01.372999+0000","last_change":"2024-09-13T19:15:55.901992+0000","last_active":"2024-09-13T19:18:01.372999+0000","last_peered":"2024-09-13T19:18:01.372999+0000","last_clean":"2024-09-13T19:18:01.372999+0000","last_became_active":"2024-09-13T19:15:55.901257+0000","last_became_peered":"2024-09-13T19:15:55.901257+0000","last_unstale":"2024-09-13T19:18:01.372999+0000","last_undegraded":"2024-09-13T19:18:01.372999+0000","last_fullsized":"2024-09-13T19:18:01.372999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:05:52.991944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.986502+0000","last_change":"2024-09-13T19:15:59.896674+0000","last_active":"2024-09-13T19:16:31.986502+0000","last_peered":"2024-09-13T19:16:31.986502+0000","last_clean":"2024-09-13T19:16:31.986502+0000","last_became_active":"2024-09-13T19:15:59.896339+0000","last_became_peered":"2024-09-13T19:15:59.896339+0000","last_unstale":"2024-09-13T19:16:31.986502+0000","last_undegraded":"2024-09-13T19:16:31.986502+0000","last_fullsized":"2024-09-13T19:16:31.986502+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:25.993976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"36'54","reported_seq":110,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.166975+0000","last_change":"2024-09-13T19:16:01.901418+0000","last_active":"2024-09-13T19:18:03.166975+0000","last_peered":"2024-09-13T19:18:03.166975+0000","last_clean":"2024-09-13T19:18:03.166975+0000","last_became_active":"2024-09-13T19:16:01.901092+0000","last_became_peered":"2024-09-13T19:16:01.901092+0000","last_unstale":"2024-09-13T19:18:03.166975+0000","last_undegraded":"2024-09-13T19:18:03.166975+0000","last_fullsized":"2024-09-13T19:18:03.166975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:39:03.339805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984142+0000","last_change":"2024-09-13T19:16:03.910823+0000","last_active":"2024-09-13T19:16:31.984142+0000","last_peered":"2024-09-13T19:16:31.984142+0000","last_clean":"2024-09-13T19:16:31.984142+0000","last_became_active":"2024-09-13T19:16:03.910305+0000","last_became_peered":"2024-09-13T19:16:03.910305+0000","last_unstale":"2024-09-13T19:16:31.984142+0000","last_undegraded":"2024-09-13T19:16:31.984142+0000","last_fullsized":"2024-09-13T19:16:31.984142+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:34:06.206573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"36'22","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.267841+0000","last_change":"2024-09-13T19:16:05.913081+0000","last_active":"2024-09-13T19:19:05.267841+0000","last_peered":"2024-09-13T19:19:05.267841+0000","last_clean":"2024-09-13T19:19:05.267841+0000","last_became_active":"2024-09-13T19:16:05.912675+0000","last_became_peered":"2024-09-13T19:16:05.912675+0000","last_unstale":"2024-09-13T19:19:05.267841+0000","last_undegraded":"2024-09-13T19:19:05.267841+0000","last_fullsized":"2024-09-13T19:19:05.267841+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:51:50.650591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"36'6","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:20.923362+0000","last_change":"2024-09-13T19:15:57.890233+0000","last_active":"2024-09-13T19:17:20.923362+0000","last_peered":"2024-09-13T19:17:20.923362+0000","last_clean":"2024-09-13T19:17:20.923362+0000","last_became_active":"2024-09-13T19:15:57.889921+0000","last_became_peered":"2024-09-13T19:15:57.889921+0000","last_unstale":"2024-09-13T19:17:20.923362+0000","last_undegraded":"2024-09-13T19:17:20.923362+0000","last_fullsized":"2024-09-13T19:17:20.923362+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:45.927205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.989729+0000","last_change":"2024-09-13T19:15:55.895671+0000","last_active":"2024-09-13T19:16:31.989729+0000","last_peered":"2024-09-13T19:16:31.989729+0000","last_clean":"2024-09-13T19:16:31.989729+0000","last_became_active":"2024-09-13T19:15:55.895344+0000","last_became_peered":"2024-09-13T19:15:55.895344+0000","last_unstale":"2024-09-13T19:16:31.989729+0000","last_undegraded":"2024-09-13T19:16:31.989729+0000","last_fullsized":"2024-09-13T19:16:31.989729+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:21.381003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.986359+0000","last_change":"2024-09-13T19:15:59.888500+0000","last_active":"2024-09-13T19:16:31.986359+0000","last_peered":"2024-09-13T19:16:31.986359+0000","last_clean":"2024-09-13T19:16:31.986359+0000","last_became_active":"2024-09-13T19:15:59.888213+0000","last_became_peered":"2024-09-13T19:15:59.888213+0000","last_unstale":"2024-09-13T19:16:31.986359+0000","last_undegraded":"2024-09-13T19:16:31.986359+0000","last_fullsized":"2024-09-13T19:16:31.986359+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:46.856761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"36'36","reported_seq":81,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.148094+0000","last_change":"2024-09-13T19:16:01.908414+0000","last_active":"2024-09-13T19:18:03.148094+0000","last_peered":"2024-09-13T19:18:03.148094+0000","last_clean":"2024-09-13T19:18:03.148094+0000","last_became_active":"2024-09-13T19:16:01.908116+0000","last_became_peered":"2024-09-13T19:16:01.908116+0000","last_unstale":"2024-09-13T19:18:03.148094+0000","last_undegraded":"2024-09-13T19:18:03.148094+0000","last_fullsized":"2024-09-13T19:18:03.148094+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:09.064613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.989465+0000","last_change":"2024-09-13T19:16:03.914462+0000","last_active":"2024-09-13T19:16:31.989465+0000","last_peered":"2024-09-13T19:16:31.989465+0000","last_clean":"2024-09-13T19:16:31.989465+0000","last_became_active":"2024-09-13T19:16:03.914179+0000","last_became_peered":"2024-09-13T19:16:03.914179+0000","last_unstale":"2024-09-13T19:16:31.989465+0000","last_undegraded":"2024-09-13T19:16:31.989465+0000","last_fullsized":"2024-09-13T19:16:31.989465+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:53:26.952246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"34'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.981447+0000","last_change":"2024-09-13T19:16:05.917077+0000","last_active":"2024-09-13T19:16:31.981447+0000","last_peered":"2024-09-13T19:16:31.981447+0000","last_clean":"2024-09-13T19:16:31.981447+0000","last_became_active":"2024-09-13T19:16:05.916822+0000","last_became_peered":"2024-09-13T19:16:05.916822+0000","last_unstale":"2024-09-13T19:16:31.981447+0000","last_undegraded":"2024-09-13T19:16:31.981447+0000","last_fullsized":"2024-09-13T19:16:31.981447+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:48.822908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"36'22","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.922897+0000","last_change":"2024-09-13T19:15:57.902395+0000","last_active":"2024-09-13T19:19:05.922897+0000","last_peered":"2024-09-13T19:19:05.922897+0000","last_clean":"2024-09-13T19:19:05.922897+0000","last_became_active":"2024-09-13T19:15:57.901330+0000","last_became_peered":"2024-09-13T19:15:57.901330+0000","last_unstale":"2024-09-13T19:19:05.922897+0000","last_undegraded":"2024-09-13T19:19:05.922897+0000","last_fullsized":"2024-09-13T19:19:05.922897+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:28.096605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":60,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.988565+0000","last_change":"2024-09-13T19:15:55.896540+0000","last_active":"2024-09-13T19:16:31.988565+0000","last_peered":"2024-09-13T19:16:31.988565+0000","last_clean":"2024-09-13T19:16:31.988565+0000","last_became_active":"2024-09-13T19:15:55.896196+0000","last_became_peered":"2024-09-13T19:15:55.896196+0000","last_unstale":"2024-09-13T19:16:31.988565+0000","last_undegraded":"2024-09-13T19:16:31.988565+0000","last_fullsized":"2024-09-13T19:16:31.988565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:14:40.566289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984960+0000","last_change":"2024-09-13T19:15:59.891464+0000","last_active":"2024-09-13T19:16:31.984960+0000","last_peered":"2024-09-13T19:16:31.984960+0000","last_clean":"2024-09-13T19:16:31.984960+0000","last_became_active":"2024-09-13T19:15:59.891131+0000","last_became_peered":"2024-09-13T19:15:59.891131+0000","last_unstale":"2024-09-13T19:16:31.984960+0000","last_undegraded":"2024-09-13T19:16:31.984960+0000","last_fullsized":"2024-09-13T19:16:31.984960+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:17.195737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"36'32","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.165035+0000","last_change":"2024-09-13T19:16:01.902629+0000","last_active":"2024-09-13T19:18:03.165035+0000","last_peered":"2024-09-13T19:18:03.165035+0000","last_clean":"2024-09-13T19:18:03.165035+0000","last_became_active":"2024-09-13T19:16:01.902251+0000","last_became_peered":"2024-09-13T19:16:01.902251+0000","last_unstale":"2024-09-13T19:18:03.165035+0000","last_undegraded":"2024-09-13T19:18:03.165035+0000","last_fullsized":"2024-09-13T19:18:03.165035+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:41.211074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985247+0000","last_change":"2024-09-13T19:16:03.915520+0000","last_active":"2024-09-13T19:16:31.985247+0000","last_peered":"2024-09-13T19:16:31.985247+0000","last_clean":"2024-09-13T19:16:31.985247+0000","last_became_active":"2024-09-13T19:16:03.915225+0000","last_became_peered":"2024-09-13T19:16:03.915225+0000","last_unstale":"2024-09-13T19:16:31.985247+0000","last_undegraded":"2024-09-13T19:16:31.985247+0000","last_fullsized":"2024-09-13T19:16:31.985247+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:09:47.134188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"36'5","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:05.007010+0000","last_change":"2024-09-13T19:16:05.925066+0000","last_active":"2024-09-13T19:18:05.007010+0000","last_peered":"2024-09-13T19:18:05.007010+0000","last_clean":"2024-09-13T19:18:05.007010+0000","last_became_active":"2024-09-13T19:16:05.923235+0000","last_became_peered":"2024-09-13T19:16:05.923235+0000","last_unstale":"2024-09-13T19:18:05.007010+0000","last_undegraded":"2024-09-13T19:18:05.007010+0000","last_fullsized":"2024-09-13T19:18:05.007010+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:34:27.801710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"36'8","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.920257+0000","last_change":"2024-09-13T19:15:57.886598+0000","last_active":"2024-09-13T19:19:05.920257+0000","last_peered":"2024-09-13T19:19:05.920257+0000","last_clean":"2024-09-13T19:19:05.920257+0000","last_became_active":"2024-09-13T19:15:57.886263+0000","last_became_peered":"2024-09-13T19:15:57.886263+0000","last_unstale":"2024-09-13T19:19:05.920257+0000","last_undegraded":"2024-09-13T19:19:05.920257+0000","last_fullsized":"2024-09-13T19:19:05.920257+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:45:55.706532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.982036+0000","last_change":"2024-09-13T19:15:55.894466+0000","last_active":"2024-09-13T19:16:31.982036+0000","last_peered":"2024-09-13T19:16:31.982036+0000","last_clean":"2024-09-13T19:16:31.982036+0000","last_became_active":"2024-09-13T19:15:55.893629+0000","last_became_peered":"2024-09-13T19:15:55.893629+0000","last_unstale":"2024-09-13T19:16:31.982036+0000","last_undegraded":"2024-09-13T19:16:31.982036+0000","last_fullsized":"2024-09-13T19:16:31.982036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:23.425081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.991439+0000","last_change":"2024-09-13T19:15:59.892732+0000","last_active":"2024-09-13T19:16:31.991439+0000","last_peered":"2024-09-13T19:16:31.991439+0000","last_clean":"2024-09-13T19:16:31.991439+0000","last_became_active":"2024-09-13T19:15:59.892445+0000","last_became_peered":"2024-09-13T19:15:59.892445+0000","last_unstale":"2024-09-13T19:16:31.991439+0000","last_undegraded":"2024-09-13T19:16:31.991439+0000","last_fullsized":"2024-09-13T19:16:31.991439+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:13.561243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'11","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.983279+0000","last_change":"2024-09-13T19:16:01.906065+0000","last_active":"2024-09-13T19:16:31.983279+0000","last_peered":"2024-09-13T19:16:31.983279+0000","last_clean":"2024-09-13T19:16:31.983279+0000","last_became_active":"2024-09-13T19:16:01.905553+0000","last_became_peered":"2024-09-13T19:16:01.905553+0000","last_unstale":"2024-09-13T19:16:31.983279+0000","last_undegraded":"2024-09-13T19:16:31.983279+0000","last_fullsized":"2024-09-13T19:16:31.983279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:31.722728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"36'282","reported_seq":366,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:04.973463+0000","last_change":"2024-09-13T19:16:03.913513+0000","last_active":"2024-09-13T19:19:04.973463+0000","last_peered":"2024-09-13T19:19:04.973463+0000","last_clean":"2024-09-13T19:19:04.973463+0000","last_became_active":"2024-09-13T19:16:03.913170+0000","last_became_peered":"2024-09-13T19:16:03.913170+0000","last_unstale":"2024-09-13T19:19:04.973463+0000","last_undegraded":"2024-09-13T19:19:04.973463+0000","last_fullsized":"2024-09-13T19:19:04.973463+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:38.207076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"36'4","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.925551+0000","last_change":"2024-09-13T19:16:05.920004+0000","last_active":"2024-09-13T19:19:05.925551+0000","last_peered":"2024-09-13T19:19:05.925551+0000","last_clean":"2024-09-13T19:19:05.925551+0000","last_became_active":"2024-09-13T19:16:05.918050+0000","last_became_peered":"2024-09-13T19:16:05.918050+0000","last_unstale":"2024-09-13T19:19:05.925551+0000","last_undegraded":"2024-09-13T19:19:05.925551+0000","last_fullsized":"2024-09-13T19:19:05.925551+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:16.813767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"36'9","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.601503+0000","last_change":"2024-09-13T19:15:57.885999+0000","last_active":"2024-09-13T19:19:05.601503+0000","last_peered":"2024-09-13T19:19:05.601503+0000","last_clean":"2024-09-13T19:19:05.601503+0000","last_became_active":"2024-09-13T19:15:57.885711+0000","last_became_peered":"2024-09-13T19:15:57.885711+0000","last_unstale":"2024-09-13T19:19:05.601503+0000","last_undegraded":"2024-09-13T19:19:05.601503+0000","last_fullsized":"2024-09-13T19:19:05.601503+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:08:12.322988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.827523+0000","last_change":"2024-09-13T19:15:55.891066+0000","last_active":"2024-09-13T19:19:05.827523+0000","last_peered":"2024-09-13T19:19:05.827523+0000","last_clean":"2024-09-13T19:19:05.827523+0000","last_became_active":"2024-09-13T19:15:55.890670+0000","last_became_peered":"2024-09-13T19:15:55.890670+0000","last_unstale":"2024-09-13T19:19:05.827523+0000","last_undegraded":"2024-09-13T19:19:05.827523+0000","last_fullsized":"2024-09-13T19:19:05.827523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:05:45.706743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.989358+0000","last_change":"2024-09-13T19:15:59.894250+0000","last_active":"2024-09-13T19:16:31.989358+0000","last_peered":"2024-09-13T19:16:31.989358+0000","last_clean":"2024-09-13T19:16:31.989358+0000","last_became_active":"2024-09-13T19:15:59.893905+0000","last_became_peered":"2024-09-13T19:15:59.893905+0000","last_unstale":"2024-09-13T19:16:31.989358+0000","last_undegraded":"2024-09-13T19:16:31.989358+0000","last_fullsized":"2024-09-13T19:16:31.989358+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:47.786088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"36'37","reported_seq":82,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:28.943545+0000","last_change":"2024-09-13T19:16:01.903680+0000","last_active":"2024-09-13T19:18:28.943545+0000","last_peered":"2024-09-13T19:18:28.943545+0000","last_clean":"2024-09-13T19:18:28.943545+0000","last_became_active":"2024-09-13T19:16:01.903395+0000","last_became_peered":"2024-09-13T19:16:01.903395+0000","last_unstale":"2024-09-13T19:18:28.943545+0000","last_undegraded":"2024-09-13T19:18:28.943545+0000","last_fullsized":"2024-09-13T19:18:28.943545+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:36.199224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.982986+0000","last_change":"2024-09-13T19:16:03.911108+0000","last_active":"2024-09-13T19:16:31.982986+0000","last_peered":"2024-09-13T19:16:31.982986+0000","last_clean":"2024-09-13T19:16:31.982986+0000","last_became_active":"2024-09-13T19:16:03.910550+0000","last_became_peered":"2024-09-13T19:16:03.910550+0000","last_unstale":"2024-09-13T19:16:31.982986+0000","last_undegraded":"2024-09-13T19:16:31.982986+0000","last_fullsized":"2024-09-13T19:16:31.982986+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:40.236729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"36'2","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.066047+0000","last_change":"2024-09-13T19:16:05.913865+0000","last_active":"2024-09-13T19:19:06.066047+0000","last_peered":"2024-09-13T19:19:06.066047+0000","last_clean":"2024-09-13T19:19:06.066047+0000","last_became_active":"2024-09-13T19:16:05.913598+0000","last_became_peered":"2024-09-13T19:16:05.913598+0000","last_unstale":"2024-09-13T19:19:06.066047+0000","last_undegraded":"2024-09-13T19:19:06.066047+0000","last_fullsized":"2024-09-13T19:19:06.066047+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:52:26.855754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985584+0000","last_change":"2024-09-13T19:15:57.884460+0000","last_active":"2024-09-13T19:16:31.985584+0000","last_peered":"2024-09-13T19:16:31.985584+0000","last_clean":"2024-09-13T19:16:31.985584+0000","last_became_active":"2024-09-13T19:15:57.883463+0000","last_became_peered":"2024-09-13T19:15:57.883463+0000","last_unstale":"2024-09-13T19:16:31.985584+0000","last_undegraded":"2024-09-13T19:16:31.985584+0000","last_fullsized":"2024-09-13T19:16:31.985584+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:25.431664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985018+0000","last_change":"2024-09-13T19:15:55.900188+0000","last_active":"2024-09-13T19:16:31.985018+0000","last_peered":"2024-09-13T19:16:31.985018+0000","last_clean":"2024-09-13T19:16:31.985018+0000","last_became_active":"2024-09-13T19:15:55.899847+0000","last_became_peered":"2024-09-13T19:15:55.899847+0000","last_unstale":"2024-09-13T19:16:31.985018+0000","last_undegraded":"2024-09-13T19:16:31.985018+0000","last_fullsized":"2024-09-13T19:16:31.985018+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:58.468375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.988573+0000","last_change":"2024-09-13T19:15:59.895828+0000","last_active":"2024-09-13T19:16:31.988573+0000","last_peered":"2024-09-13T19:16:31.988573+0000","last_clean":"2024-09-13T19:16:31.988573+0000","last_became_active":"2024-09-13T19:15:59.895512+0000","last_became_peered":"2024-09-13T19:15:59.895512+0000","last_unstale":"2024-09-13T19:16:31.988573+0000","last_undegraded":"2024-09-13T19:16:31.988573+0000","last_fullsized":"2024-09-13T19:16:31.988573+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:25.447228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"36'30","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.139542+0000","last_change":"2024-09-13T19:16:01.902662+0000","last_active":"2024-09-13T19:18:03.139542+0000","last_peered":"2024-09-13T19:18:03.139542+0000","last_clean":"2024-09-13T19:18:03.139542+0000","last_became_active":"2024-09-13T19:16:01.902285+0000","last_became_peered":"2024-09-13T19:16:01.902285+0000","last_unstale":"2024-09-13T19:18:03.139542+0000","last_undegraded":"2024-09-13T19:18:03.139542+0000","last_fullsized":"2024-09-13T19:18:03.139542+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:09:04.500386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.981123+0000","last_change":"2024-09-13T19:16:03.911855+0000","last_active":"2024-09-13T19:16:31.981123+0000","last_peered":"2024-09-13T19:16:31.981123+0000","last_clean":"2024-09-13T19:16:31.981123+0000","last_became_active":"2024-09-13T19:16:03.911587+0000","last_became_peered":"2024-09-13T19:16:03.911587+0000","last_unstale":"2024-09-13T19:16:31.981123+0000","last_undegraded":"2024-09-13T19:16:31.981123+0000","last_fullsized":"2024-09-13T19:16:31.981123+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:01.426149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.982828+0000","last_change":"2024-09-13T19:16:05.923352+0000","last_active":"2024-09-13T19:16:31.982828+0000","last_peered":"2024-09-13T19:16:31.982828+0000","last_clean":"2024-09-13T19:16:31.982828+0000","last_became_active":"2024-09-13T19:16:05.923014+0000","last_became_peered":"2024-09-13T19:16:05.923014+0000","last_unstale":"2024-09-13T19:16:31.982828+0000","last_undegraded":"2024-09-13T19:16:31.982828+0000","last_fullsized":"2024-09-13T19:16:31.982828+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:13:48.786297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"36'4","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:20.738989+0000","last_change":"2024-09-13T19:15:57.896578+0000","last_active":"2024-09-13T19:17:20.738989+0000","last_peered":"2024-09-13T19:17:20.738989+0000","last_clean":"2024-09-13T19:17:20.738989+0000","last_became_active":"2024-09-13T19:15:57.896310+0000","last_became_peered":"2024-09-13T19:15:57.896310+0000","last_unstale":"2024-09-13T19:17:20.738989+0000","last_undegraded":"2024-09-13T19:17:20.738989+0000","last_fullsized":"2024-09-13T19:17:20.738989+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:34:00.185743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985981+0000","last_change":"2024-09-13T19:15:55.895484+0000","last_active":"2024-09-13T19:16:31.985981+0000","last_peered":"2024-09-13T19:16:31.985981+0000","last_clean":"2024-09-13T19:16:31.985981+0000","last_became_active":"2024-09-13T19:15:55.893600+0000","last_became_peered":"2024-09-13T19:15:55.893600+0000","last_unstale":"2024-09-13T19:16:31.985981+0000","last_undegraded":"2024-09-13T19:16:31.985981+0000","last_fullsized":"2024-09-13T19:16:31.985981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:48.542373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.990846+0000","last_change":"2024-09-13T19:15:59.896873+0000","last_active":"2024-09-13T19:16:31.990846+0000","last_peered":"2024-09-13T19:16:31.990846+0000","last_clean":"2024-09-13T19:16:31.990846+0000","last_became_active":"2024-09-13T19:15:59.896518+0000","last_became_peered":"2024-09-13T19:15:59.896518+0000","last_unstale":"2024-09-13T19:16:31.990846+0000","last_undegraded":"2024-09-13T19:16:31.990846+0000","last_fullsized":"2024-09-13T19:16:31.990846+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:12.206811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"36'26","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.162759+0000","last_change":"2024-09-13T19:16:01.903010+0000","last_active":"2024-09-13T19:18:03.162759+0000","last_peered":"2024-09-13T19:18:03.162759+0000","last_clean":"2024-09-13T19:18:03.162759+0000","last_became_active":"2024-09-13T19:16:01.902699+0000","last_became_peered":"2024-09-13T19:16:01.902699+0000","last_unstale":"2024-09-13T19:18:03.162759+0000","last_undegraded":"2024-09-13T19:18:03.162759+0000","last_fullsized":"2024-09-13T19:18:03.162759+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:52.846038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.981606+0000","last_change":"2024-09-13T19:16:03.913624+0000","last_active":"2024-09-13T19:16:31.981606+0000","last_peered":"2024-09-13T19:16:31.981606+0000","last_clean":"2024-09-13T19:16:31.981606+0000","last_became_active":"2024-09-13T19:16:03.913228+0000","last_became_peered":"2024-09-13T19:16:03.913228+0000","last_unstale":"2024-09-13T19:16:31.981606+0000","last_undegraded":"2024-09-13T19:16:31.981606+0000","last_fullsized":"2024-09-13T19:16:31.981606+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:44:11.841765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"36'4","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.172465+0000","last_change":"2024-09-13T19:16:05.925781+0000","last_active":"2024-09-13T19:18:03.172465+0000","last_peered":"2024-09-13T19:18:03.172465+0000","last_clean":"2024-09-13T19:18:03.172465+0000","last_became_active":"2024-09-13T19:16:05.925519+0000","last_became_peered":"2024-09-13T19:16:05.925519+0000","last_unstale":"2024-09-13T19:18:03.172465+0000","last_undegraded":"2024-09-13T19:18:03.172465+0000","last_fullsized":"2024-09-13T19:18:03.172465+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:36.528746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"36'5","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.930007+0000","last_change":"2024-09-13T19:15:57.886387+0000","last_active":"2024-09-13T19:19:05.930007+0000","last_peered":"2024-09-13T19:19:05.930007+0000","last_clean":"2024-09-13T19:19:05.930007+0000","last_became_active":"2024-09-13T19:15:57.885993+0000","last_became_peered":"2024-09-13T19:15:57.885993+0000","last_unstale":"2024-09-13T19:19:05.930007+0000","last_undegraded":"2024-09-13T19:19:05.930007+0000","last_fullsized":"2024-09-13T19:19:05.930007+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:07.087101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.990648+0000","last_change":"2024-09-13T19:15:55.895882+0000","last_active":"2024-09-13T19:16:31.990648+0000","last_peered":"2024-09-13T19:16:31.990648+0000","last_clean":"2024-09-13T19:16:31.990648+0000","last_became_active":"2024-09-13T19:15:55.895040+0000","last_became_peered":"2024-09-13T19:15:55.895040+0000","last_unstale":"2024-09-13T19:16:31.990648+0000","last_undegraded":"2024-09-13T19:16:31.990648+0000","last_fullsized":"2024-09-13T19:16:31.990648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:24.740012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"36'2","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:01.747242+0000","last_change":"2024-09-13T19:15:59.897872+0000","last_active":"2024-09-13T19:18:01.747242+0000","last_peered":"2024-09-13T19:18:01.747242+0000","last_clean":"2024-09-13T19:18:01.747242+0000","last_became_active":"2024-09-13T19:15:59.897609+0000","last_became_peered":"2024-09-13T19:15:59.897609+0000","last_unstale":"2024-09-13T19:18:01.747242+0000","last_undegraded":"2024-09-13T19:18:01.747242+0000","last_fullsized":"2024-09-13T19:18:01.747242+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:51.446526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"36'33","reported_seq":77,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.037728+0000","last_change":"2024-09-13T19:16:01.902324+0000","last_active":"2024-09-13T19:19:05.037728+0000","last_peered":"2024-09-13T19:19:05.037728+0000","last_clean":"2024-09-13T19:19:05.037728+0000","last_became_active":"2024-09-13T19:16:01.902042+0000","last_became_peered":"2024-09-13T19:16:01.902042+0000","last_unstale":"2024-09-13T19:19:05.037728+0000","last_undegraded":"2024-09-13T19:19:05.037728+0000","last_fullsized":"2024-09-13T19:19:05.037728+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:30:13.522406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984100+0000","last_change":"2024-09-13T19:16:03.911392+0000","last_active":"2024-09-13T19:16:31.984100+0000","last_peered":"2024-09-13T19:16:31.984100+0000","last_clean":"2024-09-13T19:16:31.984100+0000","last_became_active":"2024-09-13T19:16:03.911052+0000","last_became_peered":"2024-09-13T19:16:03.911052+0000","last_unstale":"2024-09-13T19:16:31.984100+0000","last_undegraded":"2024-09-13T19:16:31.984100+0000","last_fullsized":"2024-09-13T19:16:31.984100+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:04.781550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"36'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.174978+0000","last_change":"2024-09-13T19:16:05.924212+0000","last_active":"2024-09-13T19:18:03.174978+0000","last_peered":"2024-09-13T19:18:03.174978+0000","last_clean":"2024-09-13T19:18:03.174978+0000","last_became_active":"2024-09-13T19:16:05.922822+0000","last_became_peered":"2024-09-13T19:16:05.922822+0000","last_unstale":"2024-09-13T19:18:03.174978+0000","last_undegraded":"2024-09-13T19:18:03.174978+0000","last_fullsized":"2024-09-13T19:18:03.174978+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:17:25.804534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"36'1","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:08.940484+0000","last_change":"2024-09-13T19:15:57.903389+0000","last_active":"2024-09-13T19:18:08.940484+0000","last_peered":"2024-09-13T19:18:08.940484+0000","last_clean":"2024-09-13T19:18:08.940484+0000","last_became_active":"2024-09-13T19:15:57.902883+0000","last_became_peered":"2024-09-13T19:15:57.902883+0000","last_unstale":"2024-09-13T19:18:08.940484+0000","last_undegraded":"2024-09-13T19:18:08.940484+0000","last_fullsized":"2024-09-13T19:18:08.940484+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:01:22.545027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.957154+0000","last_change":"2024-09-13T19:15:55.899096+0000","last_active":"2024-09-13T19:19:05.957154+0000","last_peered":"2024-09-13T19:19:05.957154+0000","last_clean":"2024-09-13T19:19:05.957154+0000","last_became_active":"2024-09-13T19:15:55.898653+0000","last_became_peered":"2024-09-13T19:15:55.898653+0000","last_unstale":"2024-09-13T19:19:05.957154+0000","last_undegraded":"2024-09-13T19:19:05.957154+0000","last_fullsized":"2024-09-13T19:19:05.957154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:40.072036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"36'8","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.696064+0000","last_change":"2024-09-13T19:15:57.886714+0000","last_active":"2024-09-13T19:19:05.696064+0000","last_peered":"2024-09-13T19:19:05.696064+0000","last_clean":"2024-09-13T19:19:05.696064+0000","last_became_active":"2024-09-13T19:15:57.886330+0000","last_became_peered":"2024-09-13T19:15:57.886330+0000","last_unstale":"2024-09-13T19:19:05.696064+0000","last_undegraded":"2024-09-13T19:19:05.696064+0000","last_fullsized":"2024-09-13T19:19:05.696064+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:30.441032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:04.951690+0000","last_change":"2024-09-13T19:15:55.891290+0000","last_active":"2024-09-13T19:18:04.951690+0000","last_peered":"2024-09-13T19:18:04.951690+0000","last_clean":"2024-09-13T19:18:04.951690+0000","last_became_active":"2024-09-13T19:15:55.890821+0000","last_became_peered":"2024-09-13T19:15:55.890821+0000","last_unstale":"2024-09-13T19:18:04.951690+0000","last_undegraded":"2024-09-13T19:18:04.951690+0000","last_fullsized":"2024-09-13T19:18:04.951690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:08:38.168335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"36'2","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:38.101539+0000","last_change":"2024-09-13T19:15:57.898663+0000","last_active":"2024-09-13T19:16:38.101539+0000","last_peered":"2024-09-13T19:16:38.101539+0000","last_clean":"2024-09-13T19:16:38.101539+0000","last_became_active":"2024-09-13T19:15:57.898295+0000","last_became_peered":"2024-09-13T19:15:57.898295+0000","last_unstale":"2024-09-13T19:16:38.101539+0000","last_undegraded":"2024-09-13T19:16:38.101539+0000","last_fullsized":"2024-09-13T19:16:38.101539+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:31:39.968554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.981947+0000","last_change":"2024-09-13T19:15:55.893929+0000","last_active":"2024-09-13T19:16:31.981947+0000","last_peered":"2024-09-13T19:16:31.981947+0000","last_clean":"2024-09-13T19:16:31.981947+0000","last_became_active":"2024-09-13T19:15:55.893191+0000","last_became_peered":"2024-09-13T19:15:55.893191+0000","last_unstale":"2024-09-13T19:16:31.981947+0000","last_undegraded":"2024-09-13T19:16:31.981947+0000","last_fullsized":"2024-09-13T19:16:31.981947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:27.683071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"36'6","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:01.383171+0000","last_change":"2024-09-13T19:15:57.887458+0000","last_active":"2024-09-13T19:18:01.383171+0000","last_peered":"2024-09-13T19:18:01.383171+0000","last_clean":"2024-09-13T19:18:01.383171+0000","last_became_active":"2024-09-13T19:15:57.886670+0000","last_became_peered":"2024-09-13T19:15:57.886670+0000","last_unstale":"2024-09-13T19:18:01.383171+0000","last_undegraded":"2024-09-13T19:18:01.383171+0000","last_fullsized":"2024-09-13T19:18:01.383171+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:59:56.951236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984646+0000","last_change":"2024-09-13T19:15:55.894421+0000","last_active":"2024-09-13T19:16:31.984646+0000","last_peered":"2024-09-13T19:16:31.984646+0000","last_clean":"2024-09-13T19:16:31.984646+0000","last_became_active":"2024-09-13T19:15:55.893569+0000","last_became_peered":"2024-09-13T19:15:55.893569+0000","last_unstale":"2024-09-13T19:16:31.984646+0000","last_undegraded":"2024-09-13T19:16:31.984646+0000","last_fullsized":"2024-09-13T19:16:31.984646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:12.839590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"36'6","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:20.923363+0000","last_change":"2024-09-13T19:15:57.896837+0000","last_active":"2024-09-13T19:17:20.923363+0000","last_peered":"2024-09-13T19:17:20.923363+0000","last_clean":"2024-09-13T19:17:20.923363+0000","last_became_active":"2024-09-13T19:15:57.896487+0000","last_became_peered":"2024-09-13T19:15:57.896487+0000","last_unstale":"2024-09-13T19:17:20.923363+0000","last_undegraded":"2024-09-13T19:17:20.923363+0000","last_fullsized":"2024-09-13T19:17:20.923363+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:50:35.823934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985084+0000","last_change":"2024-09-13T19:15:55.892917+0000","last_active":"2024-09-13T19:16:31.985084+0000","last_peered":"2024-09-13T19:16:31.985084+0000","last_clean":"2024-09-13T19:16:31.985084+0000","last_became_active":"2024-09-13T19:15:55.892026+0000","last_became_peered":"2024-09-13T19:15:55.892026+0000","last_unstale":"2024-09-13T19:16:31.985084+0000","last_undegraded":"2024-09-13T19:16:31.985084+0000","last_fullsized":"2024-09-13T19:16:31.985084+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:35.843439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"36'16","reported_seq":79,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.968515+0000","last_change":"2024-09-13T19:15:57.903134+0000","last_active":"2024-09-13T19:19:05.968515+0000","last_peered":"2024-09-13T19:19:05.968515+0000","last_clean":"2024-09-13T19:19:05.968515+0000","last_became_active":"2024-09-13T19:15:57.902841+0000","last_became_peered":"2024-09-13T19:15:57.902841+0000","last_unstale":"2024-09-13T19:19:05.968515+0000","last_undegraded":"2024-09-13T19:19:05.968515+0000","last_fullsized":"2024-09-13T19:19:05.968515+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:28:00.527551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":56,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"36'2","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:37.182812+0000","last_change":"2024-09-13T19:15:55.897004+0000","last_active":"2024-09-13T19:16:37.182812+0000","last_peered":"2024-09-13T19:16:37.182812+0000","last_clean":"2024-09-13T19:16:37.182812+0000","last_became_active":"2024-09-13T19:15:55.896490+0000","last_became_peered":"2024-09-13T19:15:55.896490+0000","last_unstale":"2024-09-13T19:16:37.182812+0000","last_undegraded":"2024-09-13T19:16:37.182812+0000","last_fullsized":"2024-09-13T19:16:37.182812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:37.997344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"36'6","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.842512+0000","last_change":"2024-09-13T19:15:57.888143+0000","last_active":"2024-09-13T19:19:05.842512+0000","last_peered":"2024-09-13T19:19:05.842512+0000","last_clean":"2024-09-13T19:19:05.842512+0000","last_became_active":"2024-09-13T19:15:57.887810+0000","last_became_peered":"2024-09-13T19:15:57.887810+0000","last_unstale":"2024-09-13T19:19:05.842512+0000","last_undegraded":"2024-09-13T19:19:05.842512+0000","last_fullsized":"2024-09-13T19:19:05.842512+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:32.469582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.989052+0000","last_change":"2024-09-13T19:15:55.892243+0000","last_active":"2024-09-13T19:16:31.989052+0000","last_peered":"2024-09-13T19:16:31.989052+0000","last_clean":"2024-09-13T19:16:31.989052+0000","last_became_active":"2024-09-13T19:15:55.891422+0000","last_became_peered":"2024-09-13T19:15:55.891422+0000","last_unstale":"2024-09-13T19:16:31.989052+0000","last_undegraded":"2024-09-13T19:16:31.989052+0000","last_fullsized":"2024-09-13T19:16:31.989052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:02.236650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"36'2","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.696175+0000","last_change":"2024-09-13T19:15:57.891037+0000","last_active":"2024-09-13T19:19:05.696175+0000","last_peered":"2024-09-13T19:19:05.696175+0000","last_clean":"2024-09-13T19:19:05.696175+0000","last_became_active":"2024-09-13T19:15:57.890491+0000","last_became_peered":"2024-09-13T19:15:57.890491+0000","last_unstale":"2024-09-13T19:19:05.696175+0000","last_undegraded":"2024-09-13T19:19:05.696175+0000","last_fullsized":"2024-09-13T19:19:05.696175+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:31:09.005785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"36'3","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:06.935961+0000","last_change":"2024-09-13T19:15:55.892364+0000","last_active":"2024-09-13T19:18:06.935961+0000","last_peered":"2024-09-13T19:18:06.935961+0000","last_clean":"2024-09-13T19:18:06.935961+0000","last_became_active":"2024-09-13T19:15:55.891860+0000","last_became_peered":"2024-09-13T19:15:55.891860+0000","last_unstale":"2024-09-13T19:18:06.935961+0000","last_undegraded":"2024-09-13T19:18:06.935961+0000","last_fullsized":"2024-09-13T19:18:06.935961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:50.200323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"36'6","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.842250+0000","last_change":"2024-09-13T19:15:57.892359+0000","last_active":"2024-09-13T19:19:05.842250+0000","last_peered":"2024-09-13T19:19:05.842250+0000","last_clean":"2024-09-13T19:19:05.842250+0000","last_became_active":"2024-09-13T19:15:57.892073+0000","last_became_peered":"2024-09-13T19:15:57.892073+0000","last_unstale":"2024-09-13T19:19:05.842250+0000","last_undegraded":"2024-09-13T19:19:05.842250+0000","last_fullsized":"2024-09-13T19:19:05.842250+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:35.680347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"36'3","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.546064+0000","last_change":"2024-09-13T19:15:55.897908+0000","last_active":"2024-09-13T19:19:05.546064+0000","last_peered":"2024-09-13T19:19:05.546064+0000","last_clean":"2024-09-13T19:19:05.546064+0000","last_became_active":"2024-09-13T19:15:55.895911+0000","last_became_peered":"2024-09-13T19:15:55.895911+0000","last_unstale":"2024-09-13T19:19:05.546064+0000","last_undegraded":"2024-09-13T19:19:05.546064+0000","last_fullsized":"2024-09-13T19:19:05.546064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:13.474342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"36'6","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:20.739628+0000","last_change":"2024-09-13T19:16:31.995370+0000","last_active":"2024-09-13T19:17:20.739628+0000","last_peered":"2024-09-13T19:17:20.739628+0000","last_clean":"2024-09-13T19:17:20.739628+0000","last_became_active":"2024-09-13T19:16:31.993403+0000","last_became_peered":"2024-09-13T19:16:31.993403+0000","last_unstale":"2024-09-13T19:17:20.739628+0000","last_undegraded":"2024-09-13T19:17:20.739628+0000","last_fullsized":"2024-09-13T19:17:20.739628+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:02:35.322551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:38.353948+0000","last_change":"2024-09-13T19:15:55.896003+0000","last_active":"2024-09-13T19:16:38.353948+0000","last_peered":"2024-09-13T19:16:38.353948+0000","last_clean":"2024-09-13T19:16:38.353948+0000","last_became_active":"2024-09-13T19:15:55.894607+0000","last_became_peered":"2024-09-13T19:15:55.894607+0000","last_unstale":"2024-09-13T19:16:38.353948+0000","last_undegraded":"2024-09-13T19:16:38.353948+0000","last_fullsized":"2024-09-13T19:16:38.353948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:23.607524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"36'2","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:20.923380+0000","last_change":"2024-09-13T19:15:57.901296+0000","last_active":"2024-09-13T19:17:20.923380+0000","last_peered":"2024-09-13T19:17:20.923380+0000","last_clean":"2024-09-13T19:17:20.923380+0000","last_became_active":"2024-09-13T19:15:57.900902+0000","last_became_peered":"2024-09-13T19:15:57.900902+0000","last_unstale":"2024-09-13T19:17:20.923380+0000","last_undegraded":"2024-09-13T19:17:20.923380+0000","last_fullsized":"2024-09-13T19:17:20.923380+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:33:43.956584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.988865+0000","last_change":"2024-09-13T19:15:55.906203+0000","last_active":"2024-09-13T19:16:31.988865+0000","last_peered":"2024-09-13T19:16:31.988865+0000","last_clean":"2024-09-13T19:16:31.988865+0000","last_became_active":"2024-09-13T19:15:55.905867+0000","last_became_peered":"2024-09-13T19:15:55.905867+0000","last_unstale":"2024-09-13T19:16:31.988865+0000","last_undegraded":"2024-09-13T19:16:31.988865+0000","last_fullsized":"2024-09-13T19:16:31.988865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:40.072036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.991480+0000","last_change":"2024-09-13T19:15:57.889883+0000","last_active":"2024-09-13T19:16:31.991480+0000","last_peered":"2024-09-13T19:16:31.991480+0000","last_clean":"2024-09-13T19:16:31.991480+0000","last_became_active":"2024-09-13T19:15:57.889606+0000","last_became_peered":"2024-09-13T19:15:57.889606+0000","last_unstale":"2024-09-13T19:16:31.991480+0000","last_undegraded":"2024-09-13T19:16:31.991480+0000","last_fullsized":"2024-09-13T19:16:31.991480+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:14.720100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:37.717588+0000","last_change":"2024-09-13T19:15:55.896394+0000","last_active":"2024-09-13T19:16:37.717588+0000","last_peered":"2024-09-13T19:16:37.717588+0000","last_clean":"2024-09-13T19:16:37.717588+0000","last_became_active":"2024-09-13T19:15:55.896086+0000","last_became_peered":"2024-09-13T19:15:55.896086+0000","last_unstale":"2024-09-13T19:16:37.717588+0000","last_undegraded":"2024-09-13T19:16:37.717588+0000","last_fullsized":"2024-09-13T19:16:37.717588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:07.205939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"36'12","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.842313+0000","last_change":"2024-09-13T19:16:31.992315+0000","last_active":"2024-09-13T19:19:05.842313+0000","last_peered":"2024-09-13T19:19:05.842313+0000","last_clean":"2024-09-13T19:19:05.842313+0000","last_became_active":"2024-09-13T19:16:31.991965+0000","last_became_peered":"2024-09-13T19:16:31.991965+0000","last_unstale":"2024-09-13T19:19:05.842313+0000","last_undegraded":"2024-09-13T19:19:05.842313+0000","last_fullsized":"2024-09-13T19:19:05.842313+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:43.311146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.983154+0000","last_change":"2024-09-13T19:15:55.894925+0000","last_active":"2024-09-13T19:16:31.983154+0000","last_peered":"2024-09-13T19:16:31.983154+0000","last_clean":"2024-09-13T19:16:31.983154+0000","last_became_active":"2024-09-13T19:15:55.894634+0000","last_became_peered":"2024-09-13T19:15:55.894634+0000","last_unstale":"2024-09-13T19:16:31.983154+0000","last_undegraded":"2024-09-13T19:16:31.983154+0000","last_fullsized":"2024-09-13T19:16:31.983154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:43:22.996934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"36'4","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:38.370554+0000","last_change":"2024-09-13T19:15:57.892811+0000","last_active":"2024-09-13T19:16:38.370554+0000","last_peered":"2024-09-13T19:16:38.370554+0000","last_clean":"2024-09-13T19:16:38.370554+0000","last_became_active":"2024-09-13T19:15:57.892558+0000","last_became_peered":"2024-09-13T19:15:57.892558+0000","last_unstale":"2024-09-13T19:16:38.370554+0000","last_undegraded":"2024-09-13T19:16:38.370554+0000","last_fullsized":"2024-09-13T19:16:38.370554+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:32.863560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:04.817098+0000","last_change":"2024-09-13T19:15:55.894980+0000","last_active":"2024-09-13T19:18:04.817098+0000","last_peered":"2024-09-13T19:18:04.817098+0000","last_clean":"2024-09-13T19:18:04.817098+0000","last_became_active":"2024-09-13T19:15:55.894667+0000","last_became_peered":"2024-09-13T19:15:55.894667+0000","last_unstale":"2024-09-13T19:18:04.817098+0000","last_undegraded":"2024-09-13T19:18:04.817098+0000","last_fullsized":"2024-09-13T19:18:04.817098+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:05.649972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"36'17","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.601852+0000","last_change":"2024-09-13T19:15:57.896510+0000","last_active":"2024-09-13T19:19:05.601852+0000","last_peered":"2024-09-13T19:19:05.601852+0000","last_clean":"2024-09-13T19:19:05.601852+0000","last_became_active":"2024-09-13T19:15:57.896200+0000","last_became_peered":"2024-09-13T19:15:57.896200+0000","last_unstale":"2024-09-13T19:19:05.601852+0000","last_undegraded":"2024-09-13T19:19:05.601852+0000","last_fullsized":"2024-09-13T19:19:05.601852+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:10.570988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":50,"num_read_kb":42,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.575188+0000","last_change":"2024-09-13T19:15:55.899411+0000","last_active":"2024-09-13T19:19:05.575188+0000","last_peered":"2024-09-13T19:19:05.575188+0000","last_clean":"2024-09-13T19:19:05.575188+0000","last_became_active":"2024-09-13T19:15:55.899104+0000","last_became_peered":"2024-09-13T19:15:55.899104+0000","last_unstale":"2024-09-13T19:19:05.575188+0000","last_undegraded":"2024-09-13T19:19:05.575188+0000","last_fullsized":"2024-09-13T19:19:05.575188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:11.960376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"36'12","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.919823+0000","last_change":"2024-09-13T19:15:57.890188+0000","last_active":"2024-09-13T19:19:05.919823+0000","last_peered":"2024-09-13T19:19:05.919823+0000","last_clean":"2024-09-13T19:19:05.919823+0000","last_became_active":"2024-09-13T19:15:57.889781+0000","last_became_peered":"2024-09-13T19:15:57.889781+0000","last_unstale":"2024-09-13T19:19:05.919823+0000","last_undegraded":"2024-09-13T19:19:05.919823+0000","last_fullsized":"2024-09-13T19:19:05.919823+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:25.431664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984819+0000","last_change":"2024-09-13T19:15:55.898914+0000","last_active":"2024-09-13T19:16:31.984819+0000","last_peered":"2024-09-13T19:16:31.984819+0000","last_clean":"2024-09-13T19:16:31.984819+0000","last_became_active":"2024-09-13T19:15:55.898627+0000","last_became_peered":"2024-09-13T19:15:55.898627+0000","last_unstale":"2024-09-13T19:16:31.984819+0000","last_undegraded":"2024-09-13T19:16:31.984819+0000","last_fullsized":"2024-09-13T19:16:31.984819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:12.713518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.981855+0000","last_change":"2024-09-13T19:15:55.899524+0000","last_active":"2024-09-13T19:16:31.981855+0000","last_peered":"2024-09-13T19:16:31.981855+0000","last_clean":"2024-09-13T19:16:31.981855+0000","last_became_active":"2024-09-13T19:15:55.899225+0000","last_became_peered":"2024-09-13T19:15:55.899225+0000","last_unstale":"2024-09-13T19:16:31.981855+0000","last_undegraded":"2024-09-13T19:16:31.981855+0000","last_fullsized":"2024-09-13T19:16:31.981855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:53:11.602684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"36'6","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.695792+0000","last_change":"2024-09-13T19:15:57.890646+0000","last_active":"2024-09-13T19:19:05.695792+0000","last_peered":"2024-09-13T19:19:05.695792+0000","last_clean":"2024-09-13T19:19:05.695792+0000","last_became_active":"2024-09-13T19:15:57.890325+0000","last_became_peered":"2024-09-13T19:15:57.890325+0000","last_unstale":"2024-09-13T19:19:05.695792+0000","last_undegraded":"2024-09-13T19:19:05.695792+0000","last_fullsized":"2024-09-13T19:19:05.695792+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:52:40.259021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.983543+0000","last_change":"2024-09-13T19:15:55.895990+0000","last_active":"2024-09-13T19:16:31.983543+0000","last_peered":"2024-09-13T19:16:31.983543+0000","last_clean":"2024-09-13T19:16:31.983543+0000","last_became_active":"2024-09-13T19:15:55.894485+0000","last_became_peered":"2024-09-13T19:15:55.894485+0000","last_unstale":"2024-09-13T19:16:31.983543+0000","last_undegraded":"2024-09-13T19:16:31.983543+0000","last_fullsized":"2024-09-13T19:16:31.983543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:15.987813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"36'8","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.594537+0000","last_change":"2024-09-13T19:15:57.902376+0000","last_active":"2024-09-13T19:19:05.594537+0000","last_peered":"2024-09-13T19:19:05.594537+0000","last_clean":"2024-09-13T19:19:05.594537+0000","last_became_active":"2024-09-13T19:15:57.902123+0000","last_became_peered":"2024-09-13T19:15:57.902123+0000","last_unstale":"2024-09-13T19:19:05.594537+0000","last_undegraded":"2024-09-13T19:19:05.594537+0000","last_fullsized":"2024-09-13T19:19:05.594537+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:06.873072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1595,"num_read_kb":1485,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38719488,"data_stored":38719488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640303,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48124,"kb_used_data":12780,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323716,"statfs":{"total":96636764160,"available":96587485184,"internally_reserved":0,"allocated":13086720,"data_stored":12741536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640302,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51068,"kb_used_data":11564,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94320772,"statfs":{"total":96636764160,"available":96584470528,"internally_reserved":0,"allocated":11841536,"data_stored":11556210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640302,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40784,"kb_used_data":5440,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94331056,"statfs":{"total":96636764160,"available":96595001344,"internally_reserved":0,"allocated":5570560,"data_stored":5265629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705711,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38036,"kb_used_data":11012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94333804,"statfs":{"total":96636764160,"available":96597815296,"internally_reserved":0,"allocated":11276288,"data_stored":10967495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10809344,"data_stored":10809344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4517888,"data_stored":4517888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":10809344,"data_stored":10809344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T19:19:13.885 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T19:19:14.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.011+0000 7fe1b46a5640 1 Processor -- start 2024-09-13T19:19:14.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.011+0000 7fe1b46a5640 1 -- start start 2024-09-13T19:19:14.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.012+0000 7fe1b46a5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe1ac09a100 0x7fe1ac133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:14.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.012+0000 7fe1b46a5640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1ac09d3b0 con 0x7fe1ac09bd50 2024-09-13T19:19:14.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.012+0000 7fe1b46a5640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fe1ac09c840 con 0x7fe1ac09a100 2024-09-13T19:19:14.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.012+0000 7fe1b1c40640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe1ac09a100 0x7fe1ac133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:14.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.012+0000 7fe1b2441640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe1ac09bd50 0x7fe1ac09c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59844/0 (socket says 172.21.15.53:59844) 2024-09-13T19:19:14.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.012+0000 7fe1b2441640 1 -- 172.21.15.53:0/1466264822 learned_addr learned my addr 172.21.15.53:0/1466264822 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T19:19:14.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.012+0000 7fe1b1c40640 1 -- 172.21.15.53:0/1466264822 >> v1:172.21.15.53:6789/0 conn(0x7fe1ac09bd50 legacy=0x7fe1ac09c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:14.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.012+0000 7fe1b1c40640 1 -- 172.21.15.53:0/1466264822 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1ac098230 con 0x7fe1ac09a100 2024-09-13T19:19:14.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.012+0000 7fe1b143f640 1 -- 172.21.15.53:0/1466264822 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1392076148 0 0) 0x7fe1a8001490 con 0x7fe1ac09bd50 2024-09-13T19:19:14.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.013+0000 7fe1b1c40640 1 --2- 172.21.15.53:0/1466264822 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1ac09a100 0x7fe1ac133da0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fe19c009720 tx=0x7fe19c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d60001d15cf2270f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:14.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.013+0000 7fe1b143f640 1 -- 172.21.15.53:0/1466264822 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe19c037070 con 0x7fe1ac09a100 2024-09-13T19:19:14.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.013+0000 7fe1b143f640 1 -- 172.21.15.53:0/1466264822 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe19c02ad90 con 0x7fe1ac09a100 2024-09-13T19:19:14.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.013+0000 7fe1b143f640 1 -- 172.21.15.53:0/1466264822 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe19c032590 con 0x7fe1ac09a100 2024-09-13T19:19:14.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.014+0000 7fe1b46a5640 1 -- 172.21.15.53:0/1466264822 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1ac09a100 msgr2=0x7fe1ac133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:14.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.014+0000 7fe1b46a5640 1 --2- 172.21.15.53:0/1466264822 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1ac09a100 0x7fe1ac133da0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fe19c009720 tx=0x7fe19c02a110 comp rx=0 tx=0).stop 2024-09-13T19:19:14.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.014+0000 7fe1b46a5640 1 -- 172.21.15.53:0/1466264822 shutdown_connections 2024-09-13T19:19:14.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.014+0000 7fe1b46a5640 1 --2- 172.21.15.53:0/1466264822 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1ac09a100 0x7fe1ac133da0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:14.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.014+0000 7fe1b46a5640 1 -- 172.21.15.53:0/1466264822 >> 172.21.15.53:0/1466264822 conn(0x7fe1ac06d4a0 msgr2=0x7fe1ac06d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:19:14.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.014+0000 7fe1b46a5640 1 -- 172.21.15.53:0/1466264822 shutdown_connections 2024-09-13T19:19:14.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.014+0000 7fe1b46a5640 1 -- 172.21.15.53:0/1466264822 wait complete. 2024-09-13T19:19:14.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.014+0000 7fe1b46a5640 1 Processor -- start 2024-09-13T19:19:14.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.015+0000 7fe1b46a5640 1 -- start start 2024-09-13T19:19:14.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.015+0000 7fe1b46a5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1ac09a100 0x7fe1ac1c3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:14.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.015+0000 7fe1b46a5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ac134670 con 0x7fe1ac09a100 2024-09-13T19:19:14.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.015+0000 7fe1b2441640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1ac09a100 0x7fe1ac1c3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:14.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.015+0000 7fe1b2441640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1ac09a100 0x7fe1ac1c3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35936/0 (socket says 172.21.15.53:35936) 2024-09-13T19:19:14.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.015+0000 7fe1b2441640 1 -- 172.21.15.53:0/2016260599 learned_addr learned my addr 172.21.15.53:0/2016260599 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:19:14.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.015+0000 7fe1b2441640 1 -- 172.21.15.53:0/2016260599 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1ac095e90 con 0x7fe1ac09a100 2024-09-13T19:19:14.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.015+0000 7fe1b2441640 1 --2- 172.21.15.53:0/2016260599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1ac09a100 0x7fe1ac1c3990 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fe1a800c790 tx=0x7fe1a800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:14.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.016+0000 7fe1a2ffd640 1 -- 172.21.15.53:0/2016260599 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1a8018070 con 0x7fe1ac09a100 2024-09-13T19:19:14.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.016+0000 7fe1a2ffd640 1 -- 172.21.15.53:0/2016260599 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1a8004d70 con 0x7fe1ac09a100 2024-09-13T19:19:14.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.016+0000 7fe1b46a5640 1 -- 172.21.15.53:0/2016260599 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1ac096d60 con 0x7fe1ac09a100 2024-09-13T19:19:14.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.016+0000 7fe1a2ffd640 1 -- 172.21.15.53:0/2016260599 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1a800a7f0 con 0x7fe1ac09a100 2024-09-13T19:19:14.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.016+0000 7fe1b46a5640 1 -- 172.21.15.53:0/2016260599 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1ac1c40b0 con 0x7fe1ac09a100 2024-09-13T19:19:14.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.016+0000 7fe1a2ffd640 1 -- 172.21.15.53:0/2016260599 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe1a801b070 con 0x7fe1ac09a100 2024-09-13T19:19:14.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.017+0000 7fe1a2ffd640 1 --2- 172.21.15.53:0/2016260599 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe1900382a0 0x7fe19003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:14.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.017+0000 7fe1a2ffd640 1 -- 172.21.15.53:0/2016260599 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fe1a804b470 con 0x7fe1ac09a100 2024-09-13T19:19:14.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.017+0000 7fe1b46a5640 1 -- 172.21.15.53:0/2016260599 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1ac09d020 con 0x7fe1ac09a100 2024-09-13T19:19:14.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.017+0000 7fe1b1c40640 1 --2- 172.21.15.53:0/2016260599 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe1900382a0 0x7fe19003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:14.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.018+0000 7fe1b1c40640 1 --2- 172.21.15.53:0/2016260599 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe1900382a0 0x7fe19003a760 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe19c034000 tx=0x7fe19c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:14.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.021+0000 7fe1a2ffd640 1 -- 172.21.15.53:0/2016260599 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe1ac09d3b0 con 0x7fe1ac09a100 2024-09-13T19:19:14.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.200+0000 7fe1b46a5640 1 -- 172.21.15.53:0/2016260599 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe1ac096a50 con 0x7fe1ac09a100 2024-09-13T19:19:14.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.201+0000 7fe1a2ffd640 1 -- 172.21.15.53:0/2016260599 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+21239 (secure 0 0 0) 0x7fe1a8011360 con 0x7fe1ac09a100 2024-09-13T19:19:14.206 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:19:14.206 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":36,"fsid":"69e598bd-9014-4d1e-9444-0be214085a05","created":"2024-09-13T19:15:26.858539+0000","modified":"2024-09-13T19:16:31.977779+0000","last_up_change":"2024-09-13T19:15:38.556807+0000","last_in_change":"2024-09-13T19:15:27.961132+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T19:15:38.950231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T19:15:42.720446+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-13T19:15:53.893991+0000","flags":1,"flags_names":"hashpspool","type":3,"size":3,"min_size":2,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-13T19:15:56.204104+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.190000057220459,"score_stable":1.190000057220459,"optimal_score":1,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-13T19:15:58.207697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-13T19:15:59.989338+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-13T19:16:01.938136+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-13T19:16:04.006686+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d078da3c-b2bc-4d4e-940d-e3a343202a5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":4021716951},{"type":"v1","addr":"172.21.15.53:6801","nonce":4021716951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":4021716951},{"type":"v1","addr":"172.21.15.53:6803","nonce":4021716951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":4021716951},{"type":"v1","addr":"172.21.15.53:6807","nonce":4021716951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":4021716951},{"type":"v1","addr":"172.21.15.53:6805","nonce":4021716951}]},"public_addr":"172.21.15.53:6801/4021716951","cluster_addr":"172.21.15.53:6803/4021716951","heartbeat_back_addr":"172.21.15.53:6807/4021716951","heartbeat_front_addr":"172.21.15.53:6805/4021716951","state":["exists","up"]},{"osd":1,"uuid":"b461168d-7796-4d47-934f-2e5992d5a05e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2204418452},{"type":"v1","addr":"172.21.15.102:6809","nonce":2204418452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":2204418452},{"type":"v1","addr":"172.21.15.102:6811","nonce":2204418452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":2204418452},{"type":"v1","addr":"172.21.15.102:6815","nonce":2204418452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2204418452},{"type":"v1","addr":"172.21.15.102:6813","nonce":2204418452}]},"public_addr":"172.21.15.102:6809/2204418452","cluster_addr":"172.21.15.102:6811/2204418452","heartbeat_back_addr":"172.21.15.102:6815/2204418452","heartbeat_front_addr":"172.21.15.102:6813/2204418452","state":["exists","up"]},{"osd":2,"uuid":"0eb25aef-9bcf-4e31-9896-d9d2c1c6bc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2238176080},{"type":"v1","addr":"172.21.15.102:6817","nonce":2238176080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":2238176080},{"type":"v1","addr":"172.21.15.102:6819","nonce":2238176080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2238176080},{"type":"v1","addr":"172.21.15.102:6823","nonce":2238176080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2238176080},{"type":"v1","addr":"172.21.15.102:6821","nonce":2238176080}]},"public_addr":"172.21.15.102:6817/2238176080","cluster_addr":"172.21.15.102:6819/2238176080","heartbeat_back_addr":"172.21.15.102:6823/2238176080","heartbeat_front_addr":"172.21.15.102:6821/2238176080","state":["exists","up"]},{"osd":3,"uuid":"c84cc8db-3bd3-432e-b84a-58235ad2888e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":3096737090},{"type":"v1","addr":"172.21.15.102:6801","nonce":3096737090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3096737090},{"type":"v1","addr":"172.21.15.102:6803","nonce":3096737090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3096737090},{"type":"v1","addr":"172.21.15.102:6807","nonce":3096737090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3096737090},{"type":"v1","addr":"172.21.15.102:6805","nonce":3096737090}]},"public_addr":"172.21.15.102:6801/3096737090","cluster_addr":"172.21.15.102:6803/3096737090","heartbeat_back_addr":"172.21.15.102:6807/3096737090","heartbeat_front_addr":"172.21.15.102:6805/3096737090","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T19:15:34.603524+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T19:15:35.432574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T19:15:35.230750+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T19:15:35.026997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.8","mappings":[{"from":3,"to":2}]},{"pgid":"4.10","mappings":[{"from":3,"to":2}]},{"pgid":"4.2b","mappings":[{"from":1,"to":2}]},{"pgid":"4.2e","mappings":[{"from":3,"to":0}]},{"pgid":"5.0","mappings":[{"from":0,"to":2}]},{"pgid":"5.3","mappings":[{"from":0,"to":2}]},{"pgid":"5.a","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T19:19:14.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.203+0000 7fe1b46a5640 1 -- 172.21.15.53:0/2016260599 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe1900382a0 msgr2=0x7fe19003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:14.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.203+0000 7fe1b46a5640 1 --2- 172.21.15.53:0/2016260599 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe1900382a0 0x7fe19003a760 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe19c034000 tx=0x7fe19c02e000 comp rx=0 tx=0).stop 2024-09-13T19:19:14.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.203+0000 7fe1b46a5640 1 -- 172.21.15.53:0/2016260599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1ac09a100 msgr2=0x7fe1ac1c3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:14.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.203+0000 7fe1b46a5640 1 --2- 172.21.15.53:0/2016260599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1ac09a100 0x7fe1ac1c3990 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fe1a800c790 tx=0x7fe1a800cc50 comp rx=0 tx=0).stop 2024-09-13T19:19:14.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.203+0000 7fe1b46a5640 1 -- 172.21.15.53:0/2016260599 shutdown_connections 2024-09-13T19:19:14.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.203+0000 7fe1b46a5640 1 --2- 172.21.15.53:0/2016260599 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe1900382a0 0x7fe19003a760 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:14.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.203+0000 7fe1b46a5640 1 --2- 172.21.15.53:0/2016260599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1ac09a100 0x7fe1ac1c3990 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:14.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.203+0000 7fe1b46a5640 1 -- 172.21.15.53:0/2016260599 >> 172.21.15.53:0/2016260599 conn(0x7fe1ac06d4a0 msgr2=0x7fe1ac09f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:19:14.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.203+0000 7fe1b46a5640 1 -- 172.21.15.53:0/2016260599 shutdown_connections 2024-09-13T19:19:14.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:14.204+0000 7fe1b46a5640 1 -- 172.21.15.53:0/2016260599 wait complete. 2024-09-13T19:19:15.219 INFO:tasks.ceph:Scrubbing osd.0 2024-09-13T19:19:15.219 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-13T19:19:15.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.333+0000 7fe059986640 1 Processor -- start 2024-09-13T19:19:15.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.333+0000 7fe059986640 1 -- start start 2024-09-13T19:19:15.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.334+0000 7fe059986640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe05409a390 0x7fe054134090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:15.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.334+0000 7fe059986640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe054098a60 con 0x7fe0540995d0 2024-09-13T19:19:15.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.334+0000 7fe059986640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fe0540992c0 con 0x7fe05409a390 2024-09-13T19:19:15.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.334+0000 7fe0527fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe05409a390 0x7fe054134090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:15.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.334+0000 7fe052ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe0540995d0 0x7fe054099c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:51920/0 (socket says 172.21.15.53:51920) 2024-09-13T19:19:15.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.334+0000 7fe052ffd640 1 -- 172.21.15.53:0/335859354 learned_addr learned my addr 172.21.15.53:0/335859354 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T19:19:15.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.334+0000 7fe0527fc640 1 -- 172.21.15.53:0/335859354 >> v1:172.21.15.53:6789/0 conn(0x7fe0540995d0 legacy=0x7fe054099c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:15.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.334+0000 7fe051ffb640 1 -- 172.21.15.53:0/335859354 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 31055863 0 0) 0x7fe054098a60 con 0x7fe0540995d0 2024-09-13T19:19:15.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.334+0000 7fe0527fc640 1 -- 172.21.15.53:0/335859354 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe05409a7a0 con 0x7fe05409a390 2024-09-13T19:19:15.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.335+0000 7fe0527fc640 1 --2- 172.21.15.53:0/335859354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe05409a390 0x7fe054134090 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fe048009720 tx=0x7fe04802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b0f129e08e4a644 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:15.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.335+0000 7fe051ffb640 1 -- 172.21.15.53:0/335859354 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe048037070 con 0x7fe05409a390 2024-09-13T19:19:15.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.335+0000 7fe051ffb640 1 -- 172.21.15.53:0/335859354 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe04802ad90 con 0x7fe05409a390 2024-09-13T19:19:15.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.335+0000 7fe051ffb640 1 -- 172.21.15.53:0/335859354 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe048032590 con 0x7fe05409a390 2024-09-13T19:19:15.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.336+0000 7fe059986640 1 -- 172.21.15.53:0/335859354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe05409a390 msgr2=0x7fe054134090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:15.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.336+0000 7fe059986640 1 --2- 172.21.15.53:0/335859354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe05409a390 0x7fe054134090 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fe048009720 tx=0x7fe04802a110 comp rx=0 tx=0).stop 2024-09-13T19:19:15.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.336+0000 7fe059986640 1 -- 172.21.15.53:0/335859354 shutdown_connections 2024-09-13T19:19:15.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.336+0000 7fe059986640 1 --2- 172.21.15.53:0/335859354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe05409a390 0x7fe054134090 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:15.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.336+0000 7fe059986640 1 -- 172.21.15.53:0/335859354 >> 172.21.15.53:0/335859354 conn(0x7fe05406d4b0 msgr2=0x7fe05406d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:19:15.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.336+0000 7fe059986640 1 -- 172.21.15.53:0/335859354 shutdown_connections 2024-09-13T19:19:15.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.336+0000 7fe059986640 1 -- 172.21.15.53:0/335859354 wait complete. 2024-09-13T19:19:15.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.337+0000 7fe059986640 1 Processor -- start 2024-09-13T19:19:15.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.337+0000 7fe059986640 1 -- start start 2024-09-13T19:19:15.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.337+0000 7fe059986640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0540995d0 0x7fe0541c3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:15.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.337+0000 7fe059986640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe054134960 con 0x7fe0540995d0 2024-09-13T19:19:15.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.338+0000 7fe052ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0540995d0 0x7fe0541c3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:15.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.338+0000 7fe052ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0540995d0 0x7fe0541c3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53466/0 (socket says 172.21.15.53:53466) 2024-09-13T19:19:15.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.338+0000 7fe052ffd640 1 -- 172.21.15.53:0/1793862893 learned_addr learned my addr 172.21.15.53:0/1793862893 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:19:15.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.338+0000 7fe052ffd640 1 -- 172.21.15.53:0/1793862893 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe054096670 con 0x7fe0540995d0 2024-09-13T19:19:15.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.338+0000 7fe052ffd640 1 --2- 172.21.15.53:0/1793862893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0540995d0 0x7fe0541c3dd0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fe04400c420 tx=0x7fe04400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:15.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.338+0000 7fe03bfff640 1 -- 172.21.15.53:0/1793862893 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe044018070 con 0x7fe0540995d0 2024-09-13T19:19:15.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.338+0000 7fe03bfff640 1 -- 172.21.15.53:0/1793862893 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0440074d0 con 0x7fe0540995d0 2024-09-13T19:19:15.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.338+0000 7fe059986640 1 -- 172.21.15.53:0/1793862893 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0540975e0 con 0x7fe0540995d0 2024-09-13T19:19:15.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.338+0000 7fe03bfff640 1 -- 172.21.15.53:0/1793862893 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe044004950 con 0x7fe0540995d0 2024-09-13T19:19:15.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.338+0000 7fe059986640 1 -- 172.21.15.53:0/1793862893 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe054126290 con 0x7fe0540995d0 2024-09-13T19:19:15.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.339+0000 7fe03bfff640 1 -- 172.21.15.53:0/1793862893 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe04401b070 con 0x7fe0540995d0 2024-09-13T19:19:15.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.339+0000 7fe059986640 1 -- 172.21.15.53:0/1793862893 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe0540977d0 con 0x7fe0540995d0 2024-09-13T19:19:15.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.339+0000 7fe03bfff640 1 --2- 172.21.15.53:0/1793862893 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe0400382a0 0x7fe04003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:15.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.339+0000 7fe03bfff640 1 -- 172.21.15.53:0/1793862893 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fe04404b0c0 con 0x7fe0540995d0 2024-09-13T19:19:15.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.340+0000 7fe03bfff640 1 --2- 172.21.15.53:0/1793862893 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fe0400446a0 0x7fe040046b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:15.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.340+0000 7fe03bfff640 1 -- 172.21.15.53:0/1793862893 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe044017ec0 con 0x7fe0400446a0 2024-09-13T19:19:15.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.340+0000 7fe03bfff640 1 -- 172.21.15.53:0/1793862893 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fe044052050 con 0x7fe0540995d0 2024-09-13T19:19:15.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.340+0000 7fe0537fe640 1 --2- 172.21.15.53:0/1793862893 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fe0400446a0 0x7fe040046b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:15.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.340+0000 7fe0527fc640 1 --2- 172.21.15.53:0/1793862893 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe0400382a0 0x7fe04003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:15.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.340+0000 7fe0537fe640 1 --2- 172.21.15.53:0/1793862893 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fe0400446a0 0x7fe040046b40 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:15.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.340+0000 7fe0527fc640 1 --2- 172.21.15.53:0/1793862893 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe0400382a0 0x7fe04003a760 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe048034000 tx=0x7fe04802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:15.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.341+0000 7fe03bfff640 1 -- 172.21.15.53:0/1793862893 <== osd.0 v2:172.21.15.53:6800/4021716951 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe044017ec0 con 0x7fe0400446a0 2024-09-13T19:19:15.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.353+0000 7fe059986640 1 -- 172.21.15.53:0/1793862893 --> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe054099c80 con 0x7fe0400446a0 2024-09-13T19:19:15.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.353+0000 7fe03bfff640 1 -- 172.21.15.53:0/1793862893 <== osd.0 v2:172.21.15.53:6800/4021716951 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe054099c80 con 0x7fe0400446a0 2024-09-13T19:19:15.357 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T19:19:15.357 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T19:19:15.358 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T19:19:15.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.354+0000 7fe059986640 1 -- 172.21.15.53:0/1793862893 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fe0400446a0 msgr2=0x7fe040046b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:15.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.354+0000 7fe059986640 1 --2- 172.21.15.53:0/1793862893 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fe0400446a0 0x7fe040046b40 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:15.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.354+0000 7fe059986640 1 -- 172.21.15.53:0/1793862893 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe0400382a0 msgr2=0x7fe04003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:15.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.354+0000 7fe059986640 1 --2- 172.21.15.53:0/1793862893 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe0400382a0 0x7fe04003a760 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe048034000 tx=0x7fe04802e000 comp rx=0 tx=0).stop 2024-09-13T19:19:15.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.354+0000 7fe059986640 1 -- 172.21.15.53:0/1793862893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0540995d0 msgr2=0x7fe0541c3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:15.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.354+0000 7fe059986640 1 --2- 172.21.15.53:0/1793862893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0540995d0 0x7fe0541c3dd0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fe04400c420 tx=0x7fe04400c8e0 comp rx=0 tx=0).stop 2024-09-13T19:19:15.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.354+0000 7fe059986640 1 -- 172.21.15.53:0/1793862893 shutdown_connections 2024-09-13T19:19:15.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.354+0000 7fe059986640 1 --2- 172.21.15.53:0/1793862893 >> [v2:172.21.15.53:6800/4021716951,v1:172.21.15.53:6801/4021716951] conn(0x7fe0400446a0 0x7fe040046b40 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:15.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.354+0000 7fe059986640 1 --2- 172.21.15.53:0/1793862893 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fe0400382a0 0x7fe04003a760 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:15.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.354+0000 7fe059986640 1 --2- 172.21.15.53:0/1793862893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0540995d0 0x7fe0541c3dd0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:15.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.354+0000 7fe059986640 1 -- 172.21.15.53:0/1793862893 >> 172.21.15.53:0/1793862893 conn(0x7fe05406d4b0 msgr2=0x7fe05408d690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:19:15.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.354+0000 7fe059986640 1 -- 172.21.15.53:0/1793862893 shutdown_connections 2024-09-13T19:19:15.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.354+0000 7fe059986640 1 -- 172.21.15.53:0/1793862893 wait complete. 2024-09-13T19:19:15.368 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-13T19:19:15.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.467+0000 7ffb7b1e8640 1 Processor -- start 2024-09-13T19:19:15.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.467+0000 7ffb7b1e8640 1 -- start start 2024-09-13T19:19:15.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.467+0000 7ffb7b1e8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ffb74096630 0x7ffb74096a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:15.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.467+0000 7ffb7b1e8640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb740702f0 con 0x7ffb7406d910 2024-09-13T19:19:15.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.468+0000 7ffb7b1e8640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7ffb7406f1f0 con 0x7ffb74096630 2024-09-13T19:19:15.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.468+0000 7ffb78f84640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ffb74096630 0x7ffb74096a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:15.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.468+0000 7ffb78f84640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ffb74096630 0x7ffb74096a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53476/0 (socket says 172.21.15.53:53476) 2024-09-13T19:19:15.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.468+0000 7ffb73fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ffb7406d910 0x7ffb7406dd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:51932/0 (socket says 172.21.15.53:51932) 2024-09-13T19:19:15.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.468+0000 7ffb78f84640 1 -- 172.21.15.53:0/2508795638 learned_addr learned my addr 172.21.15.53:0/2508795638 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:19:15.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.468+0000 7ffb78f84640 1 -- 172.21.15.53:0/2508795638 >> v1:172.21.15.53:6789/0 conn(0x7ffb7406d910 legacy=0x7ffb7406dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:15.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.468+0000 7ffb78f84640 1 -- 172.21.15.53:0/2508795638 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb7406fb80 con 0x7ffb74096630 2024-09-13T19:19:15.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.469+0000 7ffb78f84640 1 --2- 172.21.15.53:0/2508795638 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb74096630 0x7ffb74096a10 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7ffb6400a990 tx=0x7ffb6402b5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d83b729cecdbfa8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:15.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.469+0000 7ffb737fe640 1 -- 172.21.15.53:0/2508795638 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb6400b040 con 0x7ffb74096630 2024-09-13T19:19:15.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.469+0000 7ffb737fe640 1 -- 172.21.15.53:0/2508795638 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb64030640 con 0x7ffb74096630 2024-09-13T19:19:15.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.469+0000 7ffb737fe640 1 -- 172.21.15.53:0/2508795638 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb64030940 con 0x7ffb74096630 2024-09-13T19:19:15.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.469+0000 7ffb7b1e8640 1 -- 172.21.15.53:0/2508795638 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb74096630 msgr2=0x7ffb74096a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:15.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.469+0000 7ffb7b1e8640 1 --2- 172.21.15.53:0/2508795638 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb74096630 0x7ffb74096a10 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7ffb6400a990 tx=0x7ffb6402b5e0 comp rx=0 tx=0).stop 2024-09-13T19:19:15.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.469+0000 7ffb7b1e8640 1 -- 172.21.15.53:0/2508795638 shutdown_connections 2024-09-13T19:19:15.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.469+0000 7ffb7b1e8640 1 --2- 172.21.15.53:0/2508795638 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb74096630 0x7ffb74096a10 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:15.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.469+0000 7ffb7b1e8640 1 -- 172.21.15.53:0/2508795638 >> 172.21.15.53:0/2508795638 conn(0x7ffb7409a890 msgr2=0x7ffb7409aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:19:15.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.469+0000 7ffb7b1e8640 1 -- 172.21.15.53:0/2508795638 shutdown_connections 2024-09-13T19:19:15.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.469+0000 7ffb7b1e8640 1 -- 172.21.15.53:0/2508795638 wait complete. 2024-09-13T19:19:15.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.470+0000 7ffb7b1e8640 1 Processor -- start 2024-09-13T19:19:15.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.470+0000 7ffb7b1e8640 1 -- start start 2024-09-13T19:19:15.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.471+0000 7ffb7b1e8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb7406d910 0x7ffb741c3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:15.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.471+0000 7ffb7b1e8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ffb7406d410 con 0x7ffb7406d910 2024-09-13T19:19:15.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.471+0000 7ffb78f84640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb7406d910 0x7ffb741c3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:15.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.471+0000 7ffb78f84640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb7406d910 0x7ffb741c3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53490/0 (socket says 172.21.15.53:53490) 2024-09-13T19:19:15.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.471+0000 7ffb78f84640 1 -- 172.21.15.53:0/226920267 learned_addr learned my addr 172.21.15.53:0/226920267 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:19:15.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.471+0000 7ffb78f84640 1 -- 172.21.15.53:0/226920267 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb74128150 con 0x7ffb7406d910 2024-09-13T19:19:15.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.471+0000 7ffb78f84640 1 --2- 172.21.15.53:0/226920267 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb7406d910 0x7ffb741c3440 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7ffb6400a1c0 tx=0x7ffb640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:15.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.471+0000 7ffb717fa640 1 -- 172.21.15.53:0/226920267 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb6403f070 con 0x7ffb7406d910 2024-09-13T19:19:15.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.471+0000 7ffb717fa640 1 -- 172.21.15.53:0/226920267 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb640329c0 con 0x7ffb7406d910 2024-09-13T19:19:15.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.471+0000 7ffb717fa640 1 -- 172.21.15.53:0/226920267 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb64032ca0 con 0x7ffb7406d910 2024-09-13T19:19:15.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.471+0000 7ffb7b1e8640 1 -- 172.21.15.53:0/226920267 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb7408b5f0 con 0x7ffb7406d910 2024-09-13T19:19:15.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.472+0000 7ffb7b1e8640 1 -- 172.21.15.53:0/226920267 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb741c3980 con 0x7ffb7406d910 2024-09-13T19:19:15.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.472+0000 7ffb717fa640 1 -- 172.21.15.53:0/226920267 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ffb64042070 con 0x7ffb7406d910 2024-09-13T19:19:15.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.473+0000 7ffb717fa640 1 --2- 172.21.15.53:0/226920267 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ffb600382a0 0x7ffb6003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:15.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.472+0000 7ffb7b1e8640 1 -- 172.21.15.53:0/226920267 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb74129f00 con 0x7ffb7406d910 2024-09-13T19:19:15.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.473+0000 7ffb717fa640 1 -- 172.21.15.53:0/226920267 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7ffb6406c810 con 0x7ffb7406d910 2024-09-13T19:19:15.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.473+0000 7ffb73fff640 1 --2- 172.21.15.53:0/226920267 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ffb600382a0 0x7ffb6003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:15.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.473+0000 7ffb73fff640 1 --2- 172.21.15.53:0/226920267 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ffb600382a0 0x7ffb6003a760 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ffb680015f0 tx=0x7ffb68007a40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:15.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.477+0000 7ffb717fa640 1 -- 172.21.15.53:0/226920267 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffb74129f00 con 0x7ffb7406d910 2024-09-13T19:19:15.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.655+0000 7ffb7b1e8640 1 -- 172.21.15.53:0/226920267 --> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7ffb7412a4f0 con 0x7ffb600382a0 2024-09-13T19:19:15.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.657+0000 7ffb717fa640 1 -- 172.21.15.53:0/226920267 <== mgr.4098 v2:172.21.15.102:6824/4283826432 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ffb7412a4f0 con 0x7ffb600382a0 2024-09-13T19:19:15.660 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 0 to deep-scrub 2024-09-13T19:19:15.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.659+0000 7ffb7b1e8640 1 -- 172.21.15.53:0/226920267 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ffb600382a0 msgr2=0x7ffb6003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:15.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.659+0000 7ffb7b1e8640 1 --2- 172.21.15.53:0/226920267 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ffb600382a0 0x7ffb6003a760 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ffb680015f0 tx=0x7ffb68007a40 comp rx=0 tx=0).stop 2024-09-13T19:19:15.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.659+0000 7ffb7b1e8640 1 -- 172.21.15.53:0/226920267 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb7406d910 msgr2=0x7ffb741c3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:15.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.659+0000 7ffb7b1e8640 1 --2- 172.21.15.53:0/226920267 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb7406d910 0x7ffb741c3440 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7ffb6400a1c0 tx=0x7ffb640046c0 comp rx=0 tx=0).stop 2024-09-13T19:19:15.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.659+0000 7ffb7b1e8640 1 -- 172.21.15.53:0/226920267 shutdown_connections 2024-09-13T19:19:15.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.659+0000 7ffb7b1e8640 1 --2- 172.21.15.53:0/226920267 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ffb600382a0 0x7ffb6003a760 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:15.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.659+0000 7ffb7b1e8640 1 --2- 172.21.15.53:0/226920267 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb7406d910 0x7ffb741c3440 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:15.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.659+0000 7ffb7b1e8640 1 -- 172.21.15.53:0/226920267 >> 172.21.15.53:0/226920267 conn(0x7ffb7409a890 msgr2=0x7ffb74070b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:19:15.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.659+0000 7ffb7b1e8640 1 -- 172.21.15.53:0/226920267 shutdown_connections 2024-09-13T19:19:15.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.659+0000 7ffb7b1e8640 1 -- 172.21.15.53:0/226920267 wait complete. 2024-09-13T19:19:15.673 INFO:tasks.ceph:Scrubbing osd.1 2024-09-13T19:19:15.673 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-13T19:19:15.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.774+0000 7ff77553b640 1 Processor -- start 2024-09-13T19:19:15.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.774+0000 7ff77553b640 1 -- start start 2024-09-13T19:19:15.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.775+0000 7ff77553b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff77006e620 0x7ff77006ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:15.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.775+0000 7ff77553b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff77006e1d0 con 0x7ff770121a50 2024-09-13T19:19:15.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.775+0000 7ff77553b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7ff77006f950 con 0x7ff77006e620 2024-09-13T19:19:15.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.775+0000 7ff76effd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff77006e620 0x7ff77006ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:15.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.775+0000 7ff76e7fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff770121a50 0x7ff770121e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:51938/0 (socket says 172.21.15.53:51938) 2024-09-13T19:19:15.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.775+0000 7ff76e7fc640 1 -- 172.21.15.53:0/1936617402 learned_addr learned my addr 172.21.15.53:0/1936617402 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T19:19:15.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.775+0000 7ff76effd640 1 -- 172.21.15.53:0/1936617402 >> v1:172.21.15.53:6789/0 conn(0x7ff770121a50 legacy=0x7ff770121e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:15.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.775+0000 7ff76effd640 1 -- 172.21.15.53:0/1936617402 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7700989a0 con 0x7ff77006e620 2024-09-13T19:19:15.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.776+0000 7ff76effd640 1 --2- 172.21.15.53:0/1936617402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff77006e620 0x7ff77006ea00 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7ff760009720 tx=0x7ff76002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=318a674e24df7ca9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:15.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.776+0000 7ff76dffb640 1 -- 172.21.15.53:0/1936617402 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff760037070 con 0x7ff77006e620 2024-09-13T19:19:15.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.776+0000 7ff76dffb640 1 -- 172.21.15.53:0/1936617402 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff76002ad90 con 0x7ff77006e620 2024-09-13T19:19:15.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.776+0000 7ff76dffb640 1 -- 172.21.15.53:0/1936617402 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff760032590 con 0x7ff77006e620 2024-09-13T19:19:15.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.777+0000 7ff77553b640 1 -- 172.21.15.53:0/1936617402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff77006e620 msgr2=0x7ff77006ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:15.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.777+0000 7ff77553b640 1 --2- 172.21.15.53:0/1936617402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff77006e620 0x7ff77006ea00 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7ff760009720 tx=0x7ff76002a110 comp rx=0 tx=0).stop 2024-09-13T19:19:15.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.777+0000 7ff77553b640 1 -- 172.21.15.53:0/1936617402 shutdown_connections 2024-09-13T19:19:15.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.777+0000 7ff77553b640 1 --2- 172.21.15.53:0/1936617402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff77006e620 0x7ff77006ea00 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:15.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.777+0000 7ff77553b640 1 -- 172.21.15.53:0/1936617402 >> 172.21.15.53:0/1936617402 conn(0x7ff7700998b0 msgr2=0x7ff770099cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:19:15.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.777+0000 7ff77553b640 1 -- 172.21.15.53:0/1936617402 shutdown_connections 2024-09-13T19:19:15.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.777+0000 7ff77553b640 1 -- 172.21.15.53:0/1936617402 wait complete. 2024-09-13T19:19:15.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.778+0000 7ff77553b640 1 Processor -- start 2024-09-13T19:19:15.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.778+0000 7ff77553b640 1 -- start start 2024-09-13T19:19:15.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.778+0000 7ff77553b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff77006e620 0x7ff770122ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:15.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.778+0000 7ff77553b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff770070730 con 0x7ff77006e620 2024-09-13T19:19:15.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.779+0000 7ff76effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff77006e620 0x7ff770122ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:15.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.779+0000 7ff76effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff77006e620 0x7ff770122ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53508/0 (socket says 172.21.15.53:53508) 2024-09-13T19:19:15.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.779+0000 7ff76effd640 1 -- 172.21.15.53:0/3591963524 learned_addr learned my addr 172.21.15.53:0/3591963524 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:19:15.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.779+0000 7ff76effd640 1 -- 172.21.15.53:0/3591963524 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff770125d80 con 0x7ff77006e620 2024-09-13T19:19:15.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.779+0000 7ff76effd640 1 --2- 172.21.15.53:0/3591963524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff77006e620 0x7ff770122ca0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7ff760009840 tx=0x7ff7600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:15.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.779+0000 7ff7577fe640 1 -- 172.21.15.53:0/3591963524 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff760041020 con 0x7ff77006e620 2024-09-13T19:19:15.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.779+0000 7ff7577fe640 1 -- 172.21.15.53:0/3591963524 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff76003d550 con 0x7ff77006e620 2024-09-13T19:19:15.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.779+0000 7ff77553b640 1 -- 172.21.15.53:0/3591963524 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff770124750 con 0x7ff77006e620 2024-09-13T19:19:15.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.779+0000 7ff7577fe640 1 -- 172.21.15.53:0/3591963524 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff760037040 con 0x7ff77006e620 2024-09-13T19:19:15.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.779+0000 7ff77553b640 1 -- 172.21.15.53:0/3591963524 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff770090b40 con 0x7ff77006e620 2024-09-13T19:19:15.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.780+0000 7ff77553b640 1 -- 172.21.15.53:0/3591963524 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff7700911d0 con 0x7ff77006e620 2024-09-13T19:19:15.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.780+0000 7ff7577fe640 1 -- 172.21.15.53:0/3591963524 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff760044020 con 0x7ff77006e620 2024-09-13T19:19:15.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.780+0000 7ff7577fe640 1 --2- 172.21.15.53:0/3591963524 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff75c0382a0 0x7ff75c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:15.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.780+0000 7ff7577fe640 1 -- 172.21.15.53:0/3591963524 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7ff76006c3f0 con 0x7ff77006e620 2024-09-13T19:19:15.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.780+0000 7ff7577fe640 1 --2- 172.21.15.53:0/3591963524 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x7ff75c0446a0 0x7ff75c046b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:15.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.780+0000 7ff7577fe640 1 -- 172.21.15.53:0/3591963524 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff76002be50 con 0x7ff75c0446a0 2024-09-13T19:19:15.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.780+0000 7ff7577fe640 1 -- 172.21.15.53:0/3591963524 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7ff760073050 con 0x7ff77006e620 2024-09-13T19:19:15.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.781+0000 7ff76e7fc640 1 --2- 172.21.15.53:0/3591963524 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff75c0382a0 0x7ff75c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:15.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.781+0000 7ff76f7fe640 1 --2- 172.21.15.53:0/3591963524 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x7ff75c0446a0 0x7ff75c046b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:15.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.781+0000 7ff76e7fc640 1 --2- 172.21.15.53:0/3591963524 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff75c0382a0 0x7ff75c03a760 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff764007fd0 tx=0x7ff764007ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:15.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.781+0000 7ff76f7fe640 1 --2- 172.21.15.53:0/3591963524 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x7ff75c0446a0 0x7ff75c046b40 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:15.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.782+0000 7ff7577fe640 1 -- 172.21.15.53:0/3591963524 <== osd.1 v2:172.21.15.102:6808/2204418452 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff76002be50 con 0x7ff75c0446a0 2024-09-13T19:19:15.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.795+0000 7ff77553b640 1 -- 172.21.15.53:0/3591963524 --> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff7700901f0 con 0x7ff75c0446a0 2024-09-13T19:19:15.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.795+0000 7ff7577fe640 1 -- 172.21.15.53:0/3591963524 <== osd.1 v2:172.21.15.102:6808/2204418452 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff76800ad10 con 0x7ff75c0446a0 2024-09-13T19:19:15.799 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T19:19:15.799 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T19:19:15.799 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T19:19:15.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.795+0000 7ff77553b640 1 -- 172.21.15.53:0/3591963524 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x7ff75c0446a0 msgr2=0x7ff75c046b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:15.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.795+0000 7ff77553b640 1 --2- 172.21.15.53:0/3591963524 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x7ff75c0446a0 0x7ff75c046b40 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:15.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.795+0000 7ff77553b640 1 -- 172.21.15.53:0/3591963524 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff75c0382a0 msgr2=0x7ff75c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:15.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.795+0000 7ff77553b640 1 --2- 172.21.15.53:0/3591963524 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff75c0382a0 0x7ff75c03a760 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff764007fd0 tx=0x7ff764007ac0 comp rx=0 tx=0).stop 2024-09-13T19:19:15.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.795+0000 7ff77553b640 1 -- 172.21.15.53:0/3591963524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff77006e620 msgr2=0x7ff770122ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:15.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.795+0000 7ff77553b640 1 --2- 172.21.15.53:0/3591963524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff77006e620 0x7ff770122ca0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7ff760009840 tx=0x7ff7600046c0 comp rx=0 tx=0).stop 2024-09-13T19:19:15.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.796+0000 7ff77553b640 1 -- 172.21.15.53:0/3591963524 shutdown_connections 2024-09-13T19:19:15.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.796+0000 7ff77553b640 1 --2- 172.21.15.53:0/3591963524 >> [v2:172.21.15.102:6808/2204418452,v1:172.21.15.102:6809/2204418452] conn(0x7ff75c0446a0 0x7ff75c046b40 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:15.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.796+0000 7ff77553b640 1 --2- 172.21.15.53:0/3591963524 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ff75c0382a0 0x7ff75c03a760 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:15.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.796+0000 7ff77553b640 1 --2- 172.21.15.53:0/3591963524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff77006e620 0x7ff770122ca0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:15.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.796+0000 7ff77553b640 1 -- 172.21.15.53:0/3591963524 >> 172.21.15.53:0/3591963524 conn(0x7ff7700998b0 msgr2=0x7ff770129390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:19:15.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.796+0000 7ff77553b640 1 -- 172.21.15.53:0/3591963524 shutdown_connections 2024-09-13T19:19:15.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.796+0000 7ff77553b640 1 -- 172.21.15.53:0/3591963524 wait complete. 2024-09-13T19:19:15.809 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-13T19:19:15.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.909+0000 7f010d34b640 1 Processor -- start 2024-09-13T19:19:15.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.909+0000 7f010d34b640 1 -- start start 2024-09-13T19:19:15.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.910+0000 7f010d34b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f010812f9d0 0x7f0108131dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:15.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.910+0000 7f010d34b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0108071f70 con 0x7f010812cca0 2024-09-13T19:19:15.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.910+0000 7f010d34b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f010806e350 con 0x7f010812f9d0 2024-09-13T19:19:15.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.910+0000 7f01067fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f010812f9d0 0x7f0108131dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:15.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.910+0000 7f0106ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f010812cca0 0x7f010812d080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:51946/0 (socket says 172.21.15.53:51946) 2024-09-13T19:19:15.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.910+0000 7f0106ffd640 1 -- 172.21.15.53:0/535249824 learned_addr learned my addr 172.21.15.53:0/535249824 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T19:19:15.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.910+0000 7f01067fc640 1 -- 172.21.15.53:0/535249824 >> v1:172.21.15.53:6789/0 conn(0x7f010812cca0 legacy=0x7f010812d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:15.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.910+0000 7f01067fc640 1 -- 172.21.15.53:0/535249824 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01080715c0 con 0x7f010812f9d0 2024-09-13T19:19:15.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.911+0000 7f01067fc640 1 --2- 172.21.15.53:0/535249824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f010812f9d0 0x7f0108131dc0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f00fc009720 tx=0x7f00fc02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d604207979d2fba3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:15.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.911+0000 7f0105ffb640 1 -- 172.21.15.53:0/535249824 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00fc037070 con 0x7f010812f9d0 2024-09-13T19:19:15.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.911+0000 7f0105ffb640 1 -- 172.21.15.53:0/535249824 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00fc02ad90 con 0x7f010812f9d0 2024-09-13T19:19:15.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.911+0000 7f0105ffb640 1 -- 172.21.15.53:0/535249824 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00fc032590 con 0x7f010812f9d0 2024-09-13T19:19:15.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.912+0000 7f010d34b640 1 -- 172.21.15.53:0/535249824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f010812f9d0 msgr2=0x7f0108131dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:15.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.912+0000 7f010d34b640 1 --2- 172.21.15.53:0/535249824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f010812f9d0 0x7f0108131dc0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f00fc009720 tx=0x7f00fc02a110 comp rx=0 tx=0).stop 2024-09-13T19:19:15.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.912+0000 7f010d34b640 1 -- 172.21.15.53:0/535249824 shutdown_connections 2024-09-13T19:19:15.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.912+0000 7f010d34b640 1 --2- 172.21.15.53:0/535249824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f010812f9d0 0x7f0108131dc0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:15.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.912+0000 7f010d34b640 1 -- 172.21.15.53:0/535249824 >> 172.21.15.53:0/535249824 conn(0x7f010809a890 msgr2=0x7f010809aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:19:15.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.912+0000 7f010d34b640 1 -- 172.21.15.53:0/535249824 shutdown_connections 2024-09-13T19:19:15.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.912+0000 7f010d34b640 1 -- 172.21.15.53:0/535249824 wait complete. 2024-09-13T19:19:15.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.913+0000 7f010d34b640 1 Processor -- start 2024-09-13T19:19:15.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.913+0000 7f010d34b640 1 -- start start 2024-09-13T19:19:15.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.913+0000 7f010d34b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f010812cca0 0x7f0108125b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:15.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.913+0000 7f010d34b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f010812ca50 con 0x7f010812cca0 2024-09-13T19:19:15.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.913+0000 7f0106ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f010812cca0 0x7f0108125b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:15.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.914+0000 7f0106ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f010812cca0 0x7f0108125b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53526/0 (socket says 172.21.15.53:53526) 2024-09-13T19:19:15.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.914+0000 7f0106ffd640 1 -- 172.21.15.53:0/3117155976 learned_addr learned my addr 172.21.15.53:0/3117155976 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:19:15.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.914+0000 7f0106ffd640 1 -- 172.21.15.53:0/3117155976 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01081244b0 con 0x7f010812cca0 2024-09-13T19:19:15.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.914+0000 7f0106ffd640 1 --2- 172.21.15.53:0/3117155976 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f010812cca0 0x7f0108125b10 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f00f800c380 tx=0x7f00f800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:15.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.914+0000 7f00ef7fe640 1 -- 172.21.15.53:0/3117155976 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00f8005c10 con 0x7f010812cca0 2024-09-13T19:19:15.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.914+0000 7f00ef7fe640 1 -- 172.21.15.53:0/3117155976 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00f8005db0 con 0x7f010812cca0 2024-09-13T19:19:15.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.914+0000 7f010d34b640 1 -- 172.21.15.53:0/3117155976 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01081249e0 con 0x7f010812cca0 2024-09-13T19:19:15.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.914+0000 7f00ef7fe640 1 -- 172.21.15.53:0/3117155976 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00f8004930 con 0x7f010812cca0 2024-09-13T19:19:15.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.914+0000 7f010d34b640 1 -- 172.21.15.53:0/3117155976 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0108126230 con 0x7f010812cca0 2024-09-13T19:19:15.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.915+0000 7f00ef7fe640 1 -- 172.21.15.53:0/3117155976 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f00f801a020 con 0x7f010812cca0 2024-09-13T19:19:15.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.915+0000 7f010d34b640 1 -- 172.21.15.53:0/3117155976 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f010806e9a0 con 0x7f010812cca0 2024-09-13T19:19:15.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.915+0000 7f00ef7fe640 1 --2- 172.21.15.53:0/3117155976 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f00f40382a0 0x7f00f403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:15.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.915+0000 7f00ef7fe640 1 -- 172.21.15.53:0/3117155976 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f00f804b5b0 con 0x7f010812cca0 2024-09-13T19:19:15.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.915+0000 7f01067fc640 1 --2- 172.21.15.53:0/3117155976 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f00f40382a0 0x7f00f403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:15.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.916+0000 7f01067fc640 1 --2- 172.21.15.53:0/3117155976 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f00f40382a0 0x7f00f403a760 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f00fc009720 tx=0x7f00fc02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:15.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:15.920+0000 7f00ef7fe640 1 -- 172.21.15.53:0/3117155976 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f00f80127f0 con 0x7f010812cca0 2024-09-13T19:19:16.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.096+0000 7f010d34b640 1 -- 172.21.15.53:0/3117155976 --> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f0108123370 con 0x7f00f40382a0 2024-09-13T19:19:16.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.097+0000 7f00ef7fe640 1 -- 172.21.15.53:0/3117155976 <== mgr.4098 v2:172.21.15.102:6824/4283826432 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0108123370 con 0x7f00f40382a0 2024-09-13T19:19:16.101 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 1 to deep-scrub 2024-09-13T19:19:16.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.099+0000 7f010d34b640 1 -- 172.21.15.53:0/3117155976 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f00f40382a0 msgr2=0x7f00f403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:16.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.099+0000 7f010d34b640 1 --2- 172.21.15.53:0/3117155976 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f00f40382a0 0x7f00f403a760 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f00fc009720 tx=0x7f00fc02e000 comp rx=0 tx=0).stop 2024-09-13T19:19:16.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.099+0000 7f010d34b640 1 -- 172.21.15.53:0/3117155976 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f010812cca0 msgr2=0x7f0108125b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:16.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.099+0000 7f010d34b640 1 --2- 172.21.15.53:0/3117155976 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f010812cca0 0x7f0108125b10 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f00f800c380 tx=0x7f00f800c840 comp rx=0 tx=0).stop 2024-09-13T19:19:16.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.099+0000 7f010d34b640 1 -- 172.21.15.53:0/3117155976 shutdown_connections 2024-09-13T19:19:16.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.099+0000 7f010d34b640 1 --2- 172.21.15.53:0/3117155976 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f00f40382a0 0x7f00f403a760 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:16.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.099+0000 7f010d34b640 1 --2- 172.21.15.53:0/3117155976 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f010812cca0 0x7f0108125b10 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:16.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.099+0000 7f010d34b640 1 -- 172.21.15.53:0/3117155976 >> 172.21.15.53:0/3117155976 conn(0x7f010809a890 msgr2=0x7f010806f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:19:16.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.099+0000 7f010d34b640 1 -- 172.21.15.53:0/3117155976 shutdown_connections 2024-09-13T19:19:16.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.099+0000 7f010d34b640 1 -- 172.21.15.53:0/3117155976 wait complete. 2024-09-13T19:19:16.114 INFO:tasks.ceph:Scrubbing osd.2 2024-09-13T19:19:16.114 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-13T19:19:16.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.216+0000 7ffbb5152640 1 Processor -- start 2024-09-13T19:19:16.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.216+0000 7ffbb5152640 1 -- start start 2024-09-13T19:19:16.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.216+0000 7ffbb5152640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ffbb006dbb0 0x7ffbb0131b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:16.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.216+0000 7ffbb5152640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbb0099260 con 0x7ffbb006d0c0 2024-09-13T19:19:16.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.216+0000 7ffbb5152640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7ffbb0070670 con 0x7ffbb006dbb0 2024-09-13T19:19:16.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.216+0000 7ffbae59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ffbb006dbb0 0x7ffbb0131b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:16.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.216+0000 7ffbaed9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ffbb006d0c0 0x7ffbb006d4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:51958/0 (socket says 172.21.15.53:51958) 2024-09-13T19:19:16.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.216+0000 7ffbaed9d640 1 -- 172.21.15.53:0/4035973827 learned_addr learned my addr 172.21.15.53:0/4035973827 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T19:19:16.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.217+0000 7ffbae59c640 1 -- 172.21.15.53:0/4035973827 >> v1:172.21.15.53:6789/0 conn(0x7ffbb006d0c0 legacy=0x7ffbb006d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:16.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.217+0000 7ffbadd9b640 1 -- 172.21.15.53:0/4035973827 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3172691524 0 0) 0x7ffbb0099260 con 0x7ffbb006d0c0 2024-09-13T19:19:16.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.217+0000 7ffbae59c640 1 -- 172.21.15.53:0/4035973827 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbb0071d70 con 0x7ffbb006dbb0 2024-09-13T19:19:16.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.217+0000 7ffbae59c640 1 --2- 172.21.15.53:0/4035973827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbb006dbb0 0x7ffbb0131b30 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7ffba4009750 tx=0x7ffba402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e52ab62e1995f080 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:16.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.218+0000 7ffbadd9b640 1 -- 172.21.15.53:0/4035973827 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffba4037070 con 0x7ffbb006dbb0 2024-09-13T19:19:16.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.218+0000 7ffbadd9b640 1 -- 172.21.15.53:0/4035973827 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffba402ad80 con 0x7ffbb006dbb0 2024-09-13T19:19:16.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.218+0000 7ffbadd9b640 1 -- 172.21.15.53:0/4035973827 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffba4032590 con 0x7ffbb006dbb0 2024-09-13T19:19:16.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.218+0000 7ffbb5152640 1 -- 172.21.15.53:0/4035973827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbb006dbb0 msgr2=0x7ffbb0131b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:16.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.218+0000 7ffbb5152640 1 --2- 172.21.15.53:0/4035973827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbb006dbb0 0x7ffbb0131b30 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7ffba4009750 tx=0x7ffba402a140 comp rx=0 tx=0).stop 2024-09-13T19:19:16.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.218+0000 7ffbb5152640 1 -- 172.21.15.53:0/4035973827 shutdown_connections 2024-09-13T19:19:16.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.218+0000 7ffbb5152640 1 --2- 172.21.15.53:0/4035973827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbb006dbb0 0x7ffbb0131b30 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:16.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.218+0000 7ffbb5152640 1 -- 172.21.15.53:0/4035973827 >> 172.21.15.53:0/4035973827 conn(0x7ffbb00998b0 msgr2=0x7ffbb0099cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:19:16.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.218+0000 7ffbb5152640 1 -- 172.21.15.53:0/4035973827 shutdown_connections 2024-09-13T19:19:16.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.218+0000 7ffbb5152640 1 -- 172.21.15.53:0/4035973827 wait complete. 2024-09-13T19:19:16.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.219+0000 7ffbb5152640 1 Processor -- start 2024-09-13T19:19:16.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.219+0000 7ffbb5152640 1 -- start start 2024-09-13T19:19:16.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.220+0000 7ffbb5152640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbb006d0c0 0x7ffbb0122d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:16.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.220+0000 7ffbb5152640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb01321f0 con 0x7ffbb006d0c0 2024-09-13T19:19:16.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.220+0000 7ffbaed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbb006d0c0 0x7ffbb0122d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:16.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.220+0000 7ffbaed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbb006d0c0 0x7ffbb0122d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53540/0 (socket says 172.21.15.53:53540) 2024-09-13T19:19:16.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.220+0000 7ffbaed9d640 1 -- 172.21.15.53:0/1881654630 learned_addr learned my addr 172.21.15.53:0/1881654630 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:19:16.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.220+0000 7ffbaed9d640 1 -- 172.21.15.53:0/1881654630 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbb01259e0 con 0x7ffbb006d0c0 2024-09-13T19:19:16.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.220+0000 7ffbaed9d640 1 --2- 172.21.15.53:0/1881654630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbb006d0c0 0x7ffbb0122d70 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7ffba000c420 tx=0x7ffba000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:16.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.220+0000 7ffb977fe640 1 -- 172.21.15.53:0/1881654630 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffba0018070 con 0x7ffbb006d0c0 2024-09-13T19:19:16.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.220+0000 7ffb977fe640 1 -- 172.21.15.53:0/1881654630 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffba00074d0 con 0x7ffbb006d0c0 2024-09-13T19:19:16.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.220+0000 7ffb977fe640 1 -- 172.21.15.53:0/1881654630 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffba0004950 con 0x7ffbb006d0c0 2024-09-13T19:19:16.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.220+0000 7ffbb5152640 1 -- 172.21.15.53:0/1881654630 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbb0125240 con 0x7ffbb006d0c0 2024-09-13T19:19:16.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.220+0000 7ffbb5152640 1 -- 172.21.15.53:0/1881654630 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbb01232b0 con 0x7ffbb006d0c0 2024-09-13T19:19:16.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.221+0000 7ffbb5152640 1 -- 172.21.15.53:0/1881654630 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ffbb00724c0 con 0x7ffbb006d0c0 2024-09-13T19:19:16.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.221+0000 7ffb977fe640 1 -- 172.21.15.53:0/1881654630 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ffba001b070 con 0x7ffbb006d0c0 2024-09-13T19:19:16.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.221+0000 7ffb977fe640 1 --2- 172.21.15.53:0/1881654630 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ffb9c0382a0 0x7ffb9c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:16.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.221+0000 7ffb977fe640 1 -- 172.21.15.53:0/1881654630 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7ffba004b0a0 con 0x7ffbb006d0c0 2024-09-13T19:19:16.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.222+0000 7ffb977fe640 1 --2- 172.21.15.53:0/1881654630 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7ffb9c0446a0 0x7ffb9c046b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:16.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.222+0000 7ffb977fe640 1 -- 172.21.15.53:0/1881654630 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffba0006e50 con 0x7ffb9c0446a0 2024-09-13T19:19:16.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.222+0000 7ffb977fe640 1 -- 172.21.15.53:0/1881654630 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7ffba0052050 con 0x7ffbb006d0c0 2024-09-13T19:19:16.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.222+0000 7ffbae59c640 1 --2- 172.21.15.53:0/1881654630 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ffb9c0382a0 0x7ffb9c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:16.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.222+0000 7ffbaf59e640 1 --2- 172.21.15.53:0/1881654630 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7ffb9c0446a0 0x7ffb9c046b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:16.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.222+0000 7ffbae59c640 1 --2- 172.21.15.53:0/1881654630 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ffb9c0382a0 0x7ffb9c03a760 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ffba4034000 tx=0x7ffba402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:16.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.222+0000 7ffbaf59e640 1 --2- 172.21.15.53:0/1881654630 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7ffb9c0446a0 0x7ffb9c046b40 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:16.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.223+0000 7ffb977fe640 1 -- 172.21.15.53:0/1881654630 <== osd.2 v2:172.21.15.102:6816/2238176080 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ffba0006e50 con 0x7ffb9c0446a0 2024-09-13T19:19:16.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.236+0000 7ffbb5152640 1 -- 172.21.15.53:0/1881654630 --> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ffbb006d4a0 con 0x7ffb9c0446a0 2024-09-13T19:19:16.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.236+0000 7ffb977fe640 1 -- 172.21.15.53:0/1881654630 <== osd.2 v2:172.21.15.102:6816/2238176080 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ffbb006d4a0 con 0x7ffb9c0446a0 2024-09-13T19:19:16.240 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T19:19:16.240 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T19:19:16.240 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T19:19:16.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.236+0000 7ffbb5152640 1 -- 172.21.15.53:0/1881654630 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7ffb9c0446a0 msgr2=0x7ffb9c046b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:16.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.236+0000 7ffbb5152640 1 --2- 172.21.15.53:0/1881654630 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7ffb9c0446a0 0x7ffb9c046b40 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:16.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.236+0000 7ffbb5152640 1 -- 172.21.15.53:0/1881654630 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ffb9c0382a0 msgr2=0x7ffb9c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:16.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.236+0000 7ffbb5152640 1 --2- 172.21.15.53:0/1881654630 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ffb9c0382a0 0x7ffb9c03a760 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ffba4034000 tx=0x7ffba402e000 comp rx=0 tx=0).stop 2024-09-13T19:19:16.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.236+0000 7ffbb5152640 1 -- 172.21.15.53:0/1881654630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbb006d0c0 msgr2=0x7ffbb0122d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:16.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.236+0000 7ffbb5152640 1 --2- 172.21.15.53:0/1881654630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbb006d0c0 0x7ffbb0122d70 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7ffba000c420 tx=0x7ffba000c8e0 comp rx=0 tx=0).stop 2024-09-13T19:19:16.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.236+0000 7ffbb5152640 1 -- 172.21.15.53:0/1881654630 shutdown_connections 2024-09-13T19:19:16.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.236+0000 7ffbb5152640 1 --2- 172.21.15.53:0/1881654630 >> [v2:172.21.15.102:6816/2238176080,v1:172.21.15.102:6817/2238176080] conn(0x7ffb9c0446a0 0x7ffb9c046b40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:16.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.236+0000 7ffbb5152640 1 --2- 172.21.15.53:0/1881654630 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7ffb9c0382a0 0x7ffb9c03a760 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:16.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.236+0000 7ffbb5152640 1 --2- 172.21.15.53:0/1881654630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbb006d0c0 0x7ffbb0122d70 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:16.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.236+0000 7ffbb5152640 1 -- 172.21.15.53:0/1881654630 >> 172.21.15.53:0/1881654630 conn(0x7ffbb00998b0 msgr2=0x7ffbb0090da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:19:16.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.237+0000 7ffbb5152640 1 -- 172.21.15.53:0/1881654630 shutdown_connections 2024-09-13T19:19:16.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.237+0000 7ffbb5152640 1 -- 172.21.15.53:0/1881654630 wait complete. 2024-09-13T19:19:16.250 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-13T19:19:16.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.349+0000 7f57f176f640 1 Processor -- start 2024-09-13T19:19:16.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.349+0000 7f57f176f640 1 -- start start 2024-09-13T19:19:16.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.349+0000 7f57f176f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f57ec09a100 0x7f57ec133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:16.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.349+0000 7f57f176f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57ec09d3b0 con 0x7f57ec09bd50 2024-09-13T19:19:16.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.349+0000 7f57f176f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f57ec09c840 con 0x7f57ec09a100 2024-09-13T19:19:16.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.349+0000 7f57ea7fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f57ec09a100 0x7f57ec133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:16.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.349+0000 7f57eaffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f57ec09bd50 0x7f57ec09c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:51970/0 (socket says 172.21.15.53:51970) 2024-09-13T19:19:16.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.349+0000 7f57eaffd640 1 -- 172.21.15.53:0/1573045695 learned_addr learned my addr 172.21.15.53:0/1573045695 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T19:19:16.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.350+0000 7f57ea7fc640 1 -- 172.21.15.53:0/1573045695 >> v1:172.21.15.53:6789/0 conn(0x7f57ec09bd50 legacy=0x7f57ec09c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:16.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.350+0000 7f57ea7fc640 1 -- 172.21.15.53:0/1573045695 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57ec098230 con 0x7f57ec09a100 2024-09-13T19:19:16.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.350+0000 7f57ea7fc640 1 --2- 172.21.15.53:0/1573045695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57ec09a100 0x7f57ec133da0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f57dc009720 tx=0x7f57dc02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0cc9b90aec3a1fe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:16.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.351+0000 7f57e9ffb640 1 -- 172.21.15.53:0/1573045695 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57dc037070 con 0x7f57ec09a100 2024-09-13T19:19:16.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.351+0000 7f57e9ffb640 1 -- 172.21.15.53:0/1573045695 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57dc02ad90 con 0x7f57ec09a100 2024-09-13T19:19:16.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.351+0000 7f57e9ffb640 1 -- 172.21.15.53:0/1573045695 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57dc032590 con 0x7f57ec09a100 2024-09-13T19:19:16.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.351+0000 7f57f176f640 1 -- 172.21.15.53:0/1573045695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57ec09a100 msgr2=0x7f57ec133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:16.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.351+0000 7f57f176f640 1 --2- 172.21.15.53:0/1573045695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57ec09a100 0x7f57ec133da0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f57dc009720 tx=0x7f57dc02a110 comp rx=0 tx=0).stop 2024-09-13T19:19:16.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.351+0000 7f57f176f640 1 -- 172.21.15.53:0/1573045695 shutdown_connections 2024-09-13T19:19:16.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.351+0000 7f57f176f640 1 --2- 172.21.15.53:0/1573045695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57ec09a100 0x7f57ec133da0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:16.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.351+0000 7f57f176f640 1 -- 172.21.15.53:0/1573045695 >> 172.21.15.53:0/1573045695 conn(0x7f57ec06d4a0 msgr2=0x7f57ec06d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:19:16.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.351+0000 7f57f176f640 1 -- 172.21.15.53:0/1573045695 shutdown_connections 2024-09-13T19:19:16.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.351+0000 7f57f176f640 1 -- 172.21.15.53:0/1573045695 wait complete. 2024-09-13T19:19:16.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.352+0000 7f57f176f640 1 Processor -- start 2024-09-13T19:19:16.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.352+0000 7f57f176f640 1 -- start start 2024-09-13T19:19:16.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.353+0000 7f57f176f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57ec09a100 0x7f57ec1c3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:16.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.353+0000 7f57f176f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f57ec134670 con 0x7f57ec09a100 2024-09-13T19:19:16.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.353+0000 7f57eaffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57ec09a100 0x7f57ec1c3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:16.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.353+0000 7f57eaffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57ec09a100 0x7f57ec1c3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53550/0 (socket says 172.21.15.53:53550) 2024-09-13T19:19:16.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.353+0000 7f57eaffd640 1 -- 172.21.15.53:0/1999670215 learned_addr learned my addr 172.21.15.53:0/1999670215 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:19:16.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.353+0000 7f57eaffd640 1 -- 172.21.15.53:0/1999670215 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57ec125ee0 con 0x7f57ec09a100 2024-09-13T19:19:16.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.353+0000 7f57eaffd640 1 --2- 172.21.15.53:0/1999670215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57ec09a100 0x7f57ec1c3990 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f57d400c4a0 tx=0x7f57d400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:16.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.353+0000 7f57e37fe640 1 -- 172.21.15.53:0/1999670215 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57d4017070 con 0x7f57ec09a100 2024-09-13T19:19:16.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.353+0000 7f57e37fe640 1 -- 172.21.15.53:0/1999670215 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57d4005c10 con 0x7f57ec09a100 2024-09-13T19:19:16.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.353+0000 7f57f176f640 1 -- 172.21.15.53:0/1999670215 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57ec095510 con 0x7f57ec09a100 2024-09-13T19:19:16.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.353+0000 7f57e37fe640 1 -- 172.21.15.53:0/1999670215 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57d4007070 con 0x7f57ec09a100 2024-09-13T19:19:16.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.353+0000 7f57f176f640 1 -- 172.21.15.53:0/1999670215 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57ec0961a0 con 0x7f57ec09a100 2024-09-13T19:19:16.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.354+0000 7f57e37fe640 1 -- 172.21.15.53:0/1999670215 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f57d401a070 con 0x7f57ec09a100 2024-09-13T19:19:16.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.354+0000 7f57f176f640 1 -- 172.21.15.53:0/1999670215 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57ec096490 con 0x7f57ec09a100 2024-09-13T19:19:16.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.354+0000 7f57e37fe640 1 --2- 172.21.15.53:0/1999670215 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f57cc0382a0 0x7f57cc03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:16.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.354+0000 7f57e37fe640 1 -- 172.21.15.53:0/1999670215 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f57d404b000 con 0x7f57ec09a100 2024-09-13T19:19:16.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.355+0000 7f57ea7fc640 1 --2- 172.21.15.53:0/1999670215 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f57cc0382a0 0x7f57cc03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:16.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.355+0000 7f57ea7fc640 1 --2- 172.21.15.53:0/1999670215 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f57cc0382a0 0x7f57cc03a760 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f57dc034000 tx=0x7f57dc02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:16.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.359+0000 7f57e37fe640 1 -- 172.21.15.53:0/1999670215 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f57ec096490 con 0x7f57ec09a100 2024-09-13T19:19:16.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.537+0000 7f57f176f640 1 -- 172.21.15.53:0/1999670215 --> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f57ec09a760 con 0x7f57cc0382a0 2024-09-13T19:19:16.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.538+0000 7f57e37fe640 1 -- 172.21.15.53:0/1999670215 <== mgr.4098 v2:172.21.15.102:6824/4283826432 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f57dc032710 con 0x7f57cc0382a0 2024-09-13T19:19:16.541 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 2 to deep-scrub 2024-09-13T19:19:16.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.540+0000 7f57f176f640 1 -- 172.21.15.53:0/1999670215 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f57cc0382a0 msgr2=0x7f57cc03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:16.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.540+0000 7f57f176f640 1 --2- 172.21.15.53:0/1999670215 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f57cc0382a0 0x7f57cc03a760 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f57dc034000 tx=0x7f57dc02e000 comp rx=0 tx=0).stop 2024-09-13T19:19:16.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.540+0000 7f57f176f640 1 -- 172.21.15.53:0/1999670215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57ec09a100 msgr2=0x7f57ec1c3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:16.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.540+0000 7f57f176f640 1 --2- 172.21.15.53:0/1999670215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57ec09a100 0x7f57ec1c3990 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f57d400c4a0 tx=0x7f57d400c960 comp rx=0 tx=0).stop 2024-09-13T19:19:16.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.540+0000 7f57f176f640 1 -- 172.21.15.53:0/1999670215 shutdown_connections 2024-09-13T19:19:16.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.540+0000 7f57f176f640 1 --2- 172.21.15.53:0/1999670215 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f57cc0382a0 0x7f57cc03a760 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:16.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.540+0000 7f57f176f640 1 --2- 172.21.15.53:0/1999670215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57ec09a100 0x7f57ec1c3990 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:16.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.540+0000 7f57f176f640 1 -- 172.21.15.53:0/1999670215 >> 172.21.15.53:0/1999670215 conn(0x7f57ec06d4a0 msgr2=0x7f57ec096af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:19:16.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.540+0000 7f57f176f640 1 -- 172.21.15.53:0/1999670215 shutdown_connections 2024-09-13T19:19:16.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.540+0000 7f57f176f640 1 -- 172.21.15.53:0/1999670215 wait complete. 2024-09-13T19:19:16.554 INFO:tasks.ceph:Scrubbing osd.3 2024-09-13T19:19:16.554 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-13T19:19:16.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.655+0000 7fa80e328640 1 Processor -- start 2024-09-13T19:19:16.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.655+0000 7fa80e328640 1 -- start start 2024-09-13T19:19:16.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.656+0000 7fa80e328640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa80806dbb0 0x7fa808131b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:16.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.656+0000 7fa80e328640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa808099260 con 0x7fa80806d0c0 2024-09-13T19:19:16.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.656+0000 7fa80e328640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fa808070670 con 0x7fa80806dbb0 2024-09-13T19:19:16.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.656+0000 7fa8077fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa80806dbb0 0x7fa808131b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:16.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.656+0000 7fa807fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa80806d0c0 0x7fa80806d4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:51982/0 (socket says 172.21.15.53:51982) 2024-09-13T19:19:16.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.656+0000 7fa807fff640 1 -- 172.21.15.53:0/2665441937 learned_addr learned my addr 172.21.15.53:0/2665441937 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T19:19:16.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.656+0000 7fa8077fe640 1 -- 172.21.15.53:0/2665441937 >> v1:172.21.15.53:6789/0 conn(0x7fa80806d0c0 legacy=0x7fa80806d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:16.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.656+0000 7fa8077fe640 1 -- 172.21.15.53:0/2665441937 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa808071d70 con 0x7fa80806dbb0 2024-09-13T19:19:16.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.656+0000 7fa806ffd640 1 -- 172.21.15.53:0/2665441937 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3533915713 0 0) 0x7fa808099260 con 0x7fa80806d0c0 2024-09-13T19:19:16.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.657+0000 7fa8077fe640 1 --2- 172.21.15.53:0/2665441937 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa80806dbb0 0x7fa808131b30 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc009750 tx=0x7fa7fc02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2085bac3d53aabab server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:16.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.657+0000 7fa806ffd640 1 -- 172.21.15.53:0/2665441937 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7fc037070 con 0x7fa80806dbb0 2024-09-13T19:19:16.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.657+0000 7fa806ffd640 1 -- 172.21.15.53:0/2665441937 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7fc02ad80 con 0x7fa80806dbb0 2024-09-13T19:19:16.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.657+0000 7fa806ffd640 1 -- 172.21.15.53:0/2665441937 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7fc032590 con 0x7fa80806dbb0 2024-09-13T19:19:16.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.658+0000 7fa80e328640 1 -- 172.21.15.53:0/2665441937 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa80806dbb0 msgr2=0x7fa808131b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:16.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.658+0000 7fa80e328640 1 --2- 172.21.15.53:0/2665441937 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa80806dbb0 0x7fa808131b30 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc009750 tx=0x7fa7fc02a140 comp rx=0 tx=0).stop 2024-09-13T19:19:16.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.658+0000 7fa80e328640 1 -- 172.21.15.53:0/2665441937 shutdown_connections 2024-09-13T19:19:16.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.658+0000 7fa80e328640 1 --2- 172.21.15.53:0/2665441937 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa80806dbb0 0x7fa808131b30 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:16.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.658+0000 7fa80e328640 1 -- 172.21.15.53:0/2665441937 >> 172.21.15.53:0/2665441937 conn(0x7fa8080998b0 msgr2=0x7fa808099cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:19:16.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.658+0000 7fa80e328640 1 -- 172.21.15.53:0/2665441937 shutdown_connections 2024-09-13T19:19:16.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.658+0000 7fa80e328640 1 -- 172.21.15.53:0/2665441937 wait complete. 2024-09-13T19:19:16.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.659+0000 7fa80e328640 1 Processor -- start 2024-09-13T19:19:16.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.659+0000 7fa80e328640 1 -- start start 2024-09-13T19:19:16.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.659+0000 7fa80e328640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa80806d0c0 0x7fa80812e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:16.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.659+0000 7fa80e328640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa8081321f0 con 0x7fa80806d0c0 2024-09-13T19:19:16.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.659+0000 7fa807fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa80806d0c0 0x7fa80812e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:16.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.659+0000 7fa807fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa80806d0c0 0x7fa80812e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53576/0 (socket says 172.21.15.53:53576) 2024-09-13T19:19:16.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.659+0000 7fa807fff640 1 -- 172.21.15.53:0/3001305077 learned_addr learned my addr 172.21.15.53:0/3001305077 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:19:16.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.660+0000 7fa807fff640 1 -- 172.21.15.53:0/3001305077 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8080957f0 con 0x7fa80806d0c0 2024-09-13T19:19:16.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.660+0000 7fa807fff640 1 --2- 172.21.15.53:0/3001305077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa80806d0c0 0x7fa80812e4d0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fa7f800c420 tx=0x7fa7f800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:16.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.660+0000 7fa804ff9640 1 -- 172.21.15.53:0/3001305077 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7f8018070 con 0x7fa80806d0c0 2024-09-13T19:19:16.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.660+0000 7fa804ff9640 1 -- 172.21.15.53:0/3001305077 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7f80074d0 con 0x7fa80806d0c0 2024-09-13T19:19:16.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.660+0000 7fa804ff9640 1 -- 172.21.15.53:0/3001305077 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7f8004950 con 0x7fa80806d0c0 2024-09-13T19:19:16.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.660+0000 7fa80e328640 1 -- 172.21.15.53:0/3001305077 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa808121e20 con 0x7fa80806d0c0 2024-09-13T19:19:16.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.660+0000 7fa80e328640 1 -- 172.21.15.53:0/3001305077 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa80812ea10 con 0x7fa80806d0c0 2024-09-13T19:19:16.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.661+0000 7fa80e328640 1 -- 172.21.15.53:0/3001305077 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa80806d4a0 con 0x7fa80806d0c0 2024-09-13T19:19:16.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.661+0000 7fa804ff9640 1 -- 172.21.15.53:0/3001305077 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa7f801b070 con 0x7fa80806d0c0 2024-09-13T19:19:16.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.661+0000 7fa804ff9640 1 --2- 172.21.15.53:0/3001305077 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa7f40382a0 0x7fa7f403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:16.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.661+0000 7fa804ff9640 1 -- 172.21.15.53:0/3001305077 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fa7f804b140 con 0x7fa80806d0c0 2024-09-13T19:19:16.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.661+0000 7fa804ff9640 1 --2- 172.21.15.53:0/3001305077 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x7fa7f4044700 0x7fa7f4046ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:16.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.661+0000 7fa804ff9640 1 -- 172.21.15.53:0/3001305077 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa7f8017ec0 con 0x7fa7f4044700 2024-09-13T19:19:16.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.661+0000 7fa804ff9640 1 -- 172.21.15.53:0/3001305077 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fa7f8052050 con 0x7fa80806d0c0 2024-09-13T19:19:16.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.661+0000 7fa8077fe640 1 --2- 172.21.15.53:0/3001305077 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa7f40382a0 0x7fa7f403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:16.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.661+0000 7fa80c8c5640 1 --2- 172.21.15.53:0/3001305077 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x7fa7f4044700 0x7fa7f4046ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:16.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.662+0000 7fa80c8c5640 1 --2- 172.21.15.53:0/3001305077 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x7fa7f4044700 0x7fa7f4046ba0 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:16.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.662+0000 7fa8077fe640 1 --2- 172.21.15.53:0/3001305077 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa7f40382a0 0x7fa7f403a760 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc034000 tx=0x7fa7fc02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:16.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.663+0000 7fa804ff9640 1 -- 172.21.15.53:0/3001305077 <== osd.3 v2:172.21.15.102:6800/3096737090 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa7f8017ec0 con 0x7fa7f4044700 2024-09-13T19:19:16.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.675+0000 7fa80e328640 1 -- 172.21.15.53:0/3001305077 --> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa808096760 con 0x7fa7f4044700 2024-09-13T19:19:16.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.676+0000 7fa804ff9640 1 -- 172.21.15.53:0/3001305077 <== osd.3 v2:172.21.15.102:6800/3096737090 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa808096760 con 0x7fa7f4044700 2024-09-13T19:19:16.680 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T19:19:16.680 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T19:19:16.680 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T19:19:16.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.676+0000 7fa80e328640 1 -- 172.21.15.53:0/3001305077 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x7fa7f4044700 msgr2=0x7fa7f4046ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:16.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.676+0000 7fa80e328640 1 --2- 172.21.15.53:0/3001305077 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x7fa7f4044700 0x7fa7f4046ba0 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:16.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.676+0000 7fa80e328640 1 -- 172.21.15.53:0/3001305077 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa7f40382a0 msgr2=0x7fa7f403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:16.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.676+0000 7fa80e328640 1 --2- 172.21.15.53:0/3001305077 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa7f40382a0 0x7fa7f403a760 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc034000 tx=0x7fa7fc02e000 comp rx=0 tx=0).stop 2024-09-13T19:19:16.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.676+0000 7fa80e328640 1 -- 172.21.15.53:0/3001305077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa80806d0c0 msgr2=0x7fa80812e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:16.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.676+0000 7fa80e328640 1 --2- 172.21.15.53:0/3001305077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa80806d0c0 0x7fa80812e4d0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fa7f800c420 tx=0x7fa7f800c8e0 comp rx=0 tx=0).stop 2024-09-13T19:19:16.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.676+0000 7fa80e328640 1 -- 172.21.15.53:0/3001305077 shutdown_connections 2024-09-13T19:19:16.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.676+0000 7fa80e328640 1 --2- 172.21.15.53:0/3001305077 >> [v2:172.21.15.102:6800/3096737090,v1:172.21.15.102:6801/3096737090] conn(0x7fa7f4044700 0x7fa7f4046ba0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:16.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.676+0000 7fa80e328640 1 --2- 172.21.15.53:0/3001305077 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fa7f40382a0 0x7fa7f403a760 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:16.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.676+0000 7fa80e328640 1 --2- 172.21.15.53:0/3001305077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa80806d0c0 0x7fa80812e4d0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:16.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.676+0000 7fa80e328640 1 -- 172.21.15.53:0/3001305077 >> 172.21.15.53:0/3001305077 conn(0x7fa8080998b0 msgr2=0x7fa80808ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:19:16.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.676+0000 7fa80e328640 1 -- 172.21.15.53:0/3001305077 shutdown_connections 2024-09-13T19:19:16.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.677+0000 7fa80e328640 1 -- 172.21.15.53:0/3001305077 wait complete. 2024-09-13T19:19:16.690 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-13T19:19:16.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.789+0000 7fee01ba2640 1 Processor -- start 2024-09-13T19:19:16.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.789+0000 7fee01ba2640 1 -- start start 2024-09-13T19:19:16.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.789+0000 7fee01ba2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fedfc06d0c0 0x7fedfc06d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:16.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.789+0000 7fee01ba2640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedfc06e6e0 con 0x7fedfc06d9e0 2024-09-13T19:19:16.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.789+0000 7fee01ba2640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fedfc06f900 con 0x7fedfc06d0c0 2024-09-13T19:19:16.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.789+0000 7fee00ba0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fedfc06d0c0 0x7fedfc06d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:16.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.789+0000 7fedfbfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fedfc06d9e0 0x7fedfc06de10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:51992/0 (socket says 172.21.15.53:51992) 2024-09-13T19:19:16.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.789+0000 7fedfbfff640 1 -- 172.21.15.53:0/2258522869 learned_addr learned my addr 172.21.15.53:0/2258522869 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T19:19:16.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.790+0000 7fee00ba0640 1 -- 172.21.15.53:0/2258522869 >> v1:172.21.15.53:6789/0 conn(0x7fedfc06d9e0 legacy=0x7fedfc06de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:16.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.790+0000 7fee00ba0640 1 -- 172.21.15.53:0/2258522869 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedfc06ef90 con 0x7fedfc06d0c0 2024-09-13T19:19:16.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.790+0000 7fee00ba0640 1 --2- 172.21.15.53:0/2258522869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fedfc06d0c0 0x7fedfc06d4a0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fedf0009720 tx=0x7fedf002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ca99bda53c89e2f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:16.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.791+0000 7fedfb7fe640 1 -- 172.21.15.53:0/2258522869 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedf0037070 con 0x7fedfc06d0c0 2024-09-13T19:19:16.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.791+0000 7fedfb7fe640 1 -- 172.21.15.53:0/2258522869 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedf002ad90 con 0x7fedfc06d0c0 2024-09-13T19:19:16.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.791+0000 7fedfb7fe640 1 -- 172.21.15.53:0/2258522869 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedf0032590 con 0x7fedfc06d0c0 2024-09-13T19:19:16.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.791+0000 7fee01ba2640 1 -- 172.21.15.53:0/2258522869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fedfc06d0c0 msgr2=0x7fedfc06d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:16.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.791+0000 7fee01ba2640 1 --2- 172.21.15.53:0/2258522869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fedfc06d0c0 0x7fedfc06d4a0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fedf0009720 tx=0x7fedf002a110 comp rx=0 tx=0).stop 2024-09-13T19:19:16.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.791+0000 7fee01ba2640 1 -- 172.21.15.53:0/2258522869 shutdown_connections 2024-09-13T19:19:16.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.791+0000 7fee01ba2640 1 --2- 172.21.15.53:0/2258522869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fedfc06d0c0 0x7fedfc06d4a0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:16.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.791+0000 7fee01ba2640 1 -- 172.21.15.53:0/2258522869 >> 172.21.15.53:0/2258522869 conn(0x7fedfc09c8b0 msgr2=0x7fedfc09ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:19:16.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.791+0000 7fee01ba2640 1 -- 172.21.15.53:0/2258522869 shutdown_connections 2024-09-13T19:19:16.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.791+0000 7fee01ba2640 1 -- 172.21.15.53:0/2258522869 wait complete. 2024-09-13T19:19:16.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.792+0000 7fee01ba2640 1 Processor -- start 2024-09-13T19:19:16.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.792+0000 7fee01ba2640 1 -- start start 2024-09-13T19:19:16.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.792+0000 7fee01ba2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fedfc06d0c0 0x7fedfc123a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:16.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.792+0000 7fee01ba2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fedfc133b50 con 0x7fedfc06d0c0 2024-09-13T19:19:16.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.793+0000 7fee00ba0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fedfc06d0c0 0x7fedfc123a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:16.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.793+0000 7fee00ba0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fedfc06d0c0 0x7fedfc123a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53594/0 (socket says 172.21.15.53:53594) 2024-09-13T19:19:16.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.793+0000 7fee00ba0640 1 -- 172.21.15.53:0/1726442167 learned_addr learned my addr 172.21.15.53:0/1726442167 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:19:16.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.793+0000 7fee00ba0640 1 -- 172.21.15.53:0/1726442167 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedfc0974f0 con 0x7fedfc06d0c0 2024-09-13T19:19:16.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.793+0000 7fee00ba0640 1 --2- 172.21.15.53:0/1726442167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fedfc06d0c0 0x7fedfc123a70 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fedf002a150 tx=0x7fedf00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:16.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.793+0000 7fedf97fa640 1 -- 172.21.15.53:0/1726442167 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedf0041070 con 0x7fedfc06d0c0 2024-09-13T19:19:16.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.793+0000 7fedf97fa640 1 -- 172.21.15.53:0/1726442167 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedf0032e30 con 0x7fedfc06d0c0 2024-09-13T19:19:16.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.793+0000 7fee01ba2640 1 -- 172.21.15.53:0/1726442167 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedfc125510 con 0x7fedfc06d0c0 2024-09-13T19:19:16.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.793+0000 7fedf97fa640 1 -- 172.21.15.53:0/1726442167 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedf0037040 con 0x7fedfc06d0c0 2024-09-13T19:19:16.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.793+0000 7fee01ba2640 1 -- 172.21.15.53:0/1726442167 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedfc124190 con 0x7fedfc06d0c0 2024-09-13T19:19:16.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.794+0000 7fedf97fa640 1 -- 172.21.15.53:0/1726442167 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fedf0044070 con 0x7fedfc06d0c0 2024-09-13T19:19:16.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.794+0000 7fedf97fa640 1 --2- 172.21.15.53:0/1726442167 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fede00382a0 0x7fede003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:16.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.794+0000 7fedf97fa640 1 -- 172.21.15.53:0/1726442167 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fedf006c840 con 0x7fedfc06d0c0 2024-09-13T19:19:16.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.794+0000 7fee01ba2640 1 -- 172.21.15.53:0/1726442167 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedfc06d4a0 con 0x7fedfc06d0c0 2024-09-13T19:19:16.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.795+0000 7fedfbfff640 1 --2- 172.21.15.53:0/1726442167 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fede00382a0 0x7fede003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:16.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.795+0000 7fedfbfff640 1 --2- 172.21.15.53:0/1726442167 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fede00382a0 0x7fede003a760 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fede8000f60 tx=0x7fede8007a80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:16.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.799+0000 7fedf97fa640 1 -- 172.21.15.53:0/1726442167 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fedf003c7c0 con 0x7fedfc06d0c0 2024-09-13T19:19:16.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.973+0000 7fee01ba2640 1 -- 172.21.15.53:0/1726442167 --> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fedfc073190 con 0x7fede00382a0 2024-09-13T19:19:16.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.974+0000 7fedf97fa640 1 -- 172.21.15.53:0/1726442167 <== mgr.4098 v2:172.21.15.102:6824/4283826432 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fedfc073190 con 0x7fede00382a0 2024-09-13T19:19:16.977 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 3 to deep-scrub 2024-09-13T19:19:16.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.976+0000 7fee01ba2640 1 -- 172.21.15.53:0/1726442167 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fede00382a0 msgr2=0x7fede003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:16.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.976+0000 7fee01ba2640 1 --2- 172.21.15.53:0/1726442167 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fede00382a0 0x7fede003a760 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fede8000f60 tx=0x7fede8007a80 comp rx=0 tx=0).stop 2024-09-13T19:19:16.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.976+0000 7fee01ba2640 1 -- 172.21.15.53:0/1726442167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fedfc06d0c0 msgr2=0x7fedfc123a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:16.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.976+0000 7fee01ba2640 1 --2- 172.21.15.53:0/1726442167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fedfc06d0c0 0x7fedfc123a70 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fedf002a150 tx=0x7fedf00046c0 comp rx=0 tx=0).stop 2024-09-13T19:19:16.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.976+0000 7fee01ba2640 1 -- 172.21.15.53:0/1726442167 shutdown_connections 2024-09-13T19:19:16.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.976+0000 7fee01ba2640 1 --2- 172.21.15.53:0/1726442167 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fede00382a0 0x7fede003a760 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:16.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.976+0000 7fee01ba2640 1 --2- 172.21.15.53:0/1726442167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fedfc06d0c0 0x7fedfc123a70 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:16.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.976+0000 7fee01ba2640 1 -- 172.21.15.53:0/1726442167 >> 172.21.15.53:0/1726442167 conn(0x7fedfc09c8b0 msgr2=0x7fedfc099430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:19:16.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.976+0000 7fee01ba2640 1 -- 172.21.15.53:0/1726442167 shutdown_connections 2024-09-13T19:19:16.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:16.976+0000 7fee01ba2640 1 -- 172.21.15.53:0/1726442167 wait complete. 2024-09-13T19:19:16.991 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T19:19:17.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.087+0000 7f7dc08dd640 1 Processor -- start 2024-09-13T19:19:17.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.087+0000 7f7dc08dd640 1 -- start start 2024-09-13T19:19:17.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.088+0000 7f7dc08dd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7dbc09bd50 0x7f7dbc09c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:17.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.088+0000 7f7dc08dd640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dbc09d3b0 con 0x7f7dbc09c670 2024-09-13T19:19:17.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.088+0000 7f7dc08dd640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f7dbc098230 con 0x7f7dbc09bd50 2024-09-13T19:19:17.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.088+0000 7f7dba59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7dbc09bd50 0x7f7dbc09c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:17.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.088+0000 7f7db9d9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7dbc09c670 0x7f7dbc0990f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52008/0 (socket says 172.21.15.53:52008) 2024-09-13T19:19:17.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.088+0000 7f7db9d9b640 1 -- 172.21.15.53:0/2094790729 learned_addr learned my addr 172.21.15.53:0/2094790729 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T19:19:17.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.088+0000 7f7dba59c640 1 -- 172.21.15.53:0/2094790729 >> v1:172.21.15.53:6789/0 conn(0x7f7dbc09c670 legacy=0x7f7dbc0990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:17.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.088+0000 7f7dba59c640 1 -- 172.21.15.53:0/2094790729 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dbc0983e0 con 0x7f7dbc09bd50 2024-09-13T19:19:17.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.088+0000 7f7db959a640 1 -- 172.21.15.53:0/2094790729 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 297490884 0 0) 0x7f7db0001110 con 0x7f7dbc09c670 2024-09-13T19:19:17.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.089+0000 7f7dba59c640 1 --2- 172.21.15.53:0/2094790729 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7dbc09bd50 0x7f7dbc09c130 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f7dac009720 tx=0x7f7dac02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29f27ae334fc6a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:17.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.089+0000 7f7db959a640 1 -- 172.21.15.53:0/2094790729 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7dac037070 con 0x7f7dbc09bd50 2024-09-13T19:19:17.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.089+0000 7f7db959a640 1 -- 172.21.15.53:0/2094790729 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dac02ad90 con 0x7f7dbc09bd50 2024-09-13T19:19:17.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.089+0000 7f7db959a640 1 -- 172.21.15.53:0/2094790729 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7dac032590 con 0x7f7dbc09bd50 2024-09-13T19:19:17.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.090+0000 7f7dc08dd640 1 -- 172.21.15.53:0/2094790729 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7dbc09bd50 msgr2=0x7f7dbc09c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:17.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.090+0000 7f7dc08dd640 1 --2- 172.21.15.53:0/2094790729 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7dbc09bd50 0x7f7dbc09c130 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f7dac009720 tx=0x7f7dac02a110 comp rx=0 tx=0).stop 2024-09-13T19:19:17.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.090+0000 7f7dc08dd640 1 -- 172.21.15.53:0/2094790729 shutdown_connections 2024-09-13T19:19:17.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.090+0000 7f7dc08dd640 1 --2- 172.21.15.53:0/2094790729 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7dbc09bd50 0x7f7dbc09c130 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:17.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.090+0000 7f7dc08dd640 1 -- 172.21.15.53:0/2094790729 >> 172.21.15.53:0/2094790729 conn(0x7f7dbc06d4a0 msgr2=0x7f7dbc06d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:19:17.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.090+0000 7f7dc08dd640 1 -- 172.21.15.53:0/2094790729 shutdown_connections 2024-09-13T19:19:17.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.090+0000 7f7dc08dd640 1 -- 172.21.15.53:0/2094790729 wait complete. 2024-09-13T19:19:17.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.091+0000 7f7dc08dd640 1 Processor -- start 2024-09-13T19:19:17.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.091+0000 7f7dc08dd640 1 -- start start 2024-09-13T19:19:17.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.091+0000 7f7dc08dd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7dbc09bd50 0x7f7dbc096cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:17.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.091+0000 7f7dc08dd640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7dbc099b90 con 0x7f7dbc09bd50 2024-09-13T19:19:17.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.091+0000 7f7dba59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7dbc09bd50 0x7f7dbc096cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:17.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.091+0000 7f7dba59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7dbc09bd50 0x7f7dbc096cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53616/0 (socket says 172.21.15.53:53616) 2024-09-13T19:19:17.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.091+0000 7f7dba59c640 1 -- 172.21.15.53:0/3552894610 learned_addr learned my addr 172.21.15.53:0/3552894610 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:19:17.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.092+0000 7f7dba59c640 1 -- 172.21.15.53:0/3552894610 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dbc08c2c0 con 0x7f7dbc09bd50 2024-09-13T19:19:17.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.092+0000 7f7dba59c640 1 --2- 172.21.15.53:0/3552894610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7dbc09bd50 0x7f7dbc096cd0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f7dac035040 tx=0x7f7dac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:17.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.092+0000 7f7daaffd640 1 -- 172.21.15.53:0/3552894610 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7dac037040 con 0x7f7dbc09bd50 2024-09-13T19:19:17.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.092+0000 7f7daaffd640 1 -- 172.21.15.53:0/3552894610 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dac004160 con 0x7f7dbc09bd50 2024-09-13T19:19:17.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.092+0000 7f7daaffd640 1 -- 172.21.15.53:0/3552894610 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7dac004440 con 0x7f7dbc09bd50 2024-09-13T19:19:17.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.092+0000 7f7dc08dd640 1 -- 172.21.15.53:0/3552894610 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dbc09a760 con 0x7f7dbc09bd50 2024-09-13T19:19:17.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.092+0000 7f7dc08dd640 1 -- 172.21.15.53:0/3552894610 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dbc08c5d0 con 0x7f7dbc09bd50 2024-09-13T19:19:17.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.093+0000 7f7daaffd640 1 -- 172.21.15.53:0/3552894610 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7dac003610 con 0x7f7dbc09bd50 2024-09-13T19:19:17.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.093+0000 7f7dc08dd640 1 -- 172.21.15.53:0/3552894610 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dbc09a130 con 0x7f7dbc09bd50 2024-09-13T19:19:17.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.093+0000 7f7daaffd640 1 --2- 172.21.15.53:0/3552894610 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7d9c0382a0 0x7f7d9c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:17.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.093+0000 7f7daaffd640 1 -- 172.21.15.53:0/3552894610 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f7dac06cf70 con 0x7f7dbc09bd50 2024-09-13T19:19:17.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.094+0000 7f7db9d9b640 1 --2- 172.21.15.53:0/3552894610 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7d9c0382a0 0x7f7d9c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:17.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.094+0000 7f7db9d9b640 1 --2- 172.21.15.53:0/3552894610 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7d9c0382a0 0x7f7d9c03a760 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7db0000c00 tx=0x7f7db0001250 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:17.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.098+0000 7f7daaffd640 1 -- 172.21.15.53:0/3552894610 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7dac03ec70 con 0x7f7dbc09bd50 2024-09-13T19:19:17.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.270+0000 7f7dc08dd640 1 -- 172.21.15.53:0/3552894610 --> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7dbc1b5b50 con 0x7f7d9c0382a0 2024-09-13T19:19:17.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.286+0000 7f7daaffd640 1 -- 172.21.15.53:0/3552894610 <== mgr.4098 v2:172.21.15.102:6824/4283826432 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+663407 (secure 0 0 0) 0x7f7db00058d0 con 0x7f7d9c0382a0 2024-09-13T19:19:17.296 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:19:17.302 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T19:19:17.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.290+0000 7f7dc08dd640 1 -- 172.21.15.53:0/3552894610 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7d9c0382a0 msgr2=0x7f7d9c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:17.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.290+0000 7f7dc08dd640 1 --2- 172.21.15.53:0/3552894610 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7d9c0382a0 0x7f7d9c03a760 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7db0000c00 tx=0x7f7db0001250 comp rx=0 tx=0).stop 2024-09-13T19:19:17.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.290+0000 7f7dc08dd640 1 -- 172.21.15.53:0/3552894610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7dbc09bd50 msgr2=0x7f7dbc096cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:17.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.290+0000 7f7dc08dd640 1 --2- 172.21.15.53:0/3552894610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7dbc09bd50 0x7f7dbc096cd0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f7dac035040 tx=0x7f7dac0046c0 comp rx=0 tx=0).stop 2024-09-13T19:19:17.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.290+0000 7f7dc08dd640 1 -- 172.21.15.53:0/3552894610 shutdown_connections 2024-09-13T19:19:17.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.290+0000 7f7dc08dd640 1 --2- 172.21.15.53:0/3552894610 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f7d9c0382a0 0x7f7d9c03a760 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:17.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.290+0000 7f7dc08dd640 1 --2- 172.21.15.53:0/3552894610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7dbc09bd50 0x7f7dbc096cd0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:17.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.290+0000 7f7dc08dd640 1 -- 172.21.15.53:0/3552894610 >> 172.21.15.53:0/3552894610 conn(0x7f7dbc06d4a0 msgr2=0x7f7dbc09eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:19:17.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.290+0000 7f7dc08dd640 1 -- 172.21.15.53:0/3552894610 shutdown_connections 2024-09-13T19:19:17.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:17.290+0000 7f7dc08dd640 1 -- 172.21.15.53:0/3552894610 wait complete. 2024-09-13T19:19:17.305 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":143,"stamp":"2024-09-13T19:19:16.969789+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5083,"num_read_kb":4664,"num_write":2179,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4609,"ondisk_log_size":4609,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":144360,"kb_used_data":2976,"kb_used_omap":6,"kb_used_meta":141305,"kb_avail":377343000,"statfs":{"total":386547056640,"available":386399232000,"internally_reserved":0,"allocated":3047424,"data_stored":1807960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":144697111},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4281,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":713,"num_read_kb":672,"num_write":457,"num_write_kb":29372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003702"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.986470+0000","last_change":"2024-09-13T19:15:55.897703+0000","last_active":"2024-09-13T19:16:31.986470+0000","last_peered":"2024-09-13T19:16:31.986470+0000","last_clean":"2024-09-13T19:16:31.986470+0000","last_became_active":"2024-09-13T19:15:55.897392+0000","last_became_peered":"2024-09-13T19:15:55.897392+0000","last_unstale":"2024-09-13T19:16:31.986470+0000","last_undegraded":"2024-09-13T19:16:31.986470+0000","last_fullsized":"2024-09-13T19:16:31.986470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:06:25.645854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"36'8","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.962167+0000","last_change":"2024-09-13T19:15:57.889239+0000","last_active":"2024-09-13T19:19:05.962167+0000","last_peered":"2024-09-13T19:19:05.962167+0000","last_clean":"2024-09-13T19:19:05.962167+0000","last_became_active":"2024-09-13T19:15:57.888352+0000","last_became_peered":"2024-09-13T19:15:57.888352+0000","last_unstale":"2024-09-13T19:19:05.962167+0000","last_undegraded":"2024-09-13T19:19:05.962167+0000","last_fullsized":"2024-09-13T19:19:05.962167+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:44.850376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"34'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:01.934985+0000","last_change":"2024-09-13T19:15:55.896090+0000","last_active":"2024-09-13T19:18:01.934985+0000","last_peered":"2024-09-13T19:18:01.934985+0000","last_clean":"2024-09-13T19:18:01.934985+0000","last_became_active":"2024-09-13T19:15:55.894768+0000","last_became_peered":"2024-09-13T19:15:55.894768+0000","last_unstale":"2024-09-13T19:18:01.934985+0000","last_undegraded":"2024-09-13T19:18:01.934985+0000","last_fullsized":"2024-09-13T19:18:01.934985+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"36'6","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.063780+0000","last_change":"2024-09-13T19:15:57.895729+0000","last_active":"2024-09-13T19:19:06.063780+0000","last_peered":"2024-09-13T19:19:06.063780+0000","last_clean":"2024-09-13T19:19:06.063780+0000","last_became_active":"2024-09-13T19:15:57.895424+0000","last_became_peered":"2024-09-13T19:15:57.895424+0000","last_unstale":"2024-09-13T19:19:06.063780+0000","last_undegraded":"2024-09-13T19:19:06.063780+0000","last_fullsized":"2024-09-13T19:19:06.063780+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:13:56.189818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985541+0000","last_change":"2024-09-13T19:15:55.900265+0000","last_active":"2024-09-13T19:16:31.985541+0000","last_peered":"2024-09-13T19:16:31.985541+0000","last_clean":"2024-09-13T19:16:31.985541+0000","last_became_active":"2024-09-13T19:15:55.899965+0000","last_became_peered":"2024-09-13T19:15:55.899965+0000","last_unstale":"2024-09-13T19:16:31.985541+0000","last_undegraded":"2024-09-13T19:16:31.985541+0000","last_fullsized":"2024-09-13T19:16:31.985541+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:21.434261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"36'13","reported_seq":70,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.930148+0000","last_change":"2024-09-13T19:15:57.895266+0000","last_active":"2024-09-13T19:19:05.930148+0000","last_peered":"2024-09-13T19:19:05.930148+0000","last_clean":"2024-09-13T19:19:05.930148+0000","last_became_active":"2024-09-13T19:15:57.894955+0000","last_became_peered":"2024-09-13T19:15:57.894955+0000","last_unstale":"2024-09-13T19:19:05.930148+0000","last_undegraded":"2024-09-13T19:19:05.930148+0000","last_fullsized":"2024-09-13T19:19:05.930148+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:00.565048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985385+0000","last_change":"2024-09-13T19:15:55.890339+0000","last_active":"2024-09-13T19:16:31.985385+0000","last_peered":"2024-09-13T19:16:31.985385+0000","last_clean":"2024-09-13T19:16:31.985385+0000","last_became_active":"2024-09-13T19:15:55.889830+0000","last_became_peered":"2024-09-13T19:15:55.889830+0000","last_unstale":"2024-09-13T19:16:31.985385+0000","last_undegraded":"2024-09-13T19:16:31.985385+0000","last_fullsized":"2024-09-13T19:16:31.985385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:24.740012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"36'4","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.699868+0000","last_change":"2024-09-13T19:15:57.895013+0000","last_active":"2024-09-13T19:19:05.699868+0000","last_peered":"2024-09-13T19:19:05.699868+0000","last_clean":"2024-09-13T19:19:05.699868+0000","last_became_active":"2024-09-13T19:15:57.894733+0000","last_became_peered":"2024-09-13T19:15:57.894733+0000","last_unstale":"2024-09-13T19:19:05.699868+0000","last_undegraded":"2024-09-13T19:19:05.699868+0000","last_fullsized":"2024-09-13T19:19:05.699868+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:55:38.336831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.501720+0000","last_change":"2024-09-13T19:15:55.895687+0000","last_active":"2024-09-13T19:19:05.501720+0000","last_peered":"2024-09-13T19:19:05.501720+0000","last_clean":"2024-09-13T19:19:05.501720+0000","last_became_active":"2024-09-13T19:15:55.895362+0000","last_became_peered":"2024-09-13T19:15:55.895362+0000","last_unstale":"2024-09-13T19:19:05.501720+0000","last_undegraded":"2024-09-13T19:19:05.501720+0000","last_fullsized":"2024-09-13T19:19:05.501720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:12.815210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"36'8","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.594848+0000","last_change":"2024-09-13T19:15:57.889968+0000","last_active":"2024-09-13T19:19:05.594848+0000","last_peered":"2024-09-13T19:19:05.594848+0000","last_clean":"2024-09-13T19:19:05.594848+0000","last_became_active":"2024-09-13T19:15:57.889664+0000","last_became_peered":"2024-09-13T19:15:57.889664+0000","last_unstale":"2024-09-13T19:19:05.594848+0000","last_undegraded":"2024-09-13T19:19:05.594848+0000","last_fullsized":"2024-09-13T19:19:05.594848+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:07.656555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.836502+0000","last_change":"2024-09-13T19:15:55.890058+0000","last_active":"2024-09-13T19:19:05.836502+0000","last_peered":"2024-09-13T19:19:05.836502+0000","last_clean":"2024-09-13T19:19:05.836502+0000","last_became_active":"2024-09-13T19:15:55.889485+0000","last_became_peered":"2024-09-13T19:15:55.889485+0000","last_unstale":"2024-09-13T19:19:05.836502+0000","last_undegraded":"2024-09-13T19:19:05.836502+0000","last_fullsized":"2024-09-13T19:19:05.836502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:05:45.706743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"36'2","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:37.740715+0000","last_change":"2024-09-13T19:15:57.901409+0000","last_active":"2024-09-13T19:16:37.740715+0000","last_peered":"2024-09-13T19:16:37.740715+0000","last_clean":"2024-09-13T19:16:37.740715+0000","last_became_active":"2024-09-13T19:15:57.900785+0000","last_became_peered":"2024-09-13T19:15:57.900785+0000","last_unstale":"2024-09-13T19:16:37.740715+0000","last_undegraded":"2024-09-13T19:16:37.740715+0000","last_fullsized":"2024-09-13T19:16:37.740715+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:37.144718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"36'2","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.521875+0000","last_change":"2024-09-13T19:15:55.898268+0000","last_active":"2024-09-13T19:19:05.521875+0000","last_peered":"2024-09-13T19:19:05.521875+0000","last_clean":"2024-09-13T19:19:05.521875+0000","last_became_active":"2024-09-13T19:15:55.897381+0000","last_became_peered":"2024-09-13T19:15:55.897381+0000","last_unstale":"2024-09-13T19:19:05.521875+0000","last_undegraded":"2024-09-13T19:19:05.521875+0000","last_fullsized":"2024-09-13T19:19:05.521875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:08:10.316406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"36'16","reported_seq":90,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.842428+0000","last_change":"2024-09-13T19:15:57.893695+0000","last_active":"2024-09-13T19:19:05.842428+0000","last_peered":"2024-09-13T19:19:05.842428+0000","last_clean":"2024-09-13T19:19:05.842428+0000","last_became_active":"2024-09-13T19:15:57.893408+0000","last_became_peered":"2024-09-13T19:15:57.893408+0000","last_unstale":"2024-09-13T19:19:05.842428+0000","last_undegraded":"2024-09-13T19:19:05.842428+0000","last_fullsized":"2024-09-13T19:19:05.842428+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:37.777072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.793788+0000","last_change":"2024-09-13T19:15:55.901574+0000","last_active":"2024-09-13T19:19:12.793788+0000","last_peered":"2024-09-13T19:19:12.793788+0000","last_clean":"2024-09-13T19:19:12.793788+0000","last_became_active":"2024-09-13T19:15:55.901190+0000","last_became_peered":"2024-09-13T19:15:55.901190+0000","last_unstale":"2024-09-13T19:19:12.793788+0000","last_undegraded":"2024-09-13T19:19:12.793788+0000","last_fullsized":"2024-09-13T19:19:12.793788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"36'16","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.842549+0000","last_change":"2024-09-13T19:15:57.898655+0000","last_active":"2024-09-13T19:19:05.842549+0000","last_peered":"2024-09-13T19:19:05.842549+0000","last_clean":"2024-09-13T19:19:05.842549+0000","last_became_active":"2024-09-13T19:15:57.898325+0000","last_became_peered":"2024-09-13T19:15:57.898325+0000","last_unstale":"2024-09-13T19:19:05.842549+0000","last_undegraded":"2024-09-13T19:19:05.842549+0000","last_fullsized":"2024-09-13T19:19:05.842549+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:29.689654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":52,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"36'4","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.842445+0000","last_change":"2024-09-13T19:15:57.890027+0000","last_active":"2024-09-13T19:19:05.842445+0000","last_peered":"2024-09-13T19:19:05.842445+0000","last_clean":"2024-09-13T19:19:05.842445+0000","last_became_active":"2024-09-13T19:15:57.887144+0000","last_became_peered":"2024-09-13T19:15:57.887144+0000","last_unstale":"2024-09-13T19:19:05.842445+0000","last_undegraded":"2024-09-13T19:19:05.842445+0000","last_fullsized":"2024-09-13T19:19:05.842445+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:55.470024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"36'2","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.532705+0000","last_change":"2024-09-13T19:15:55.896889+0000","last_active":"2024-09-13T19:19:05.532705+0000","last_peered":"2024-09-13T19:19:05.532705+0000","last_clean":"2024-09-13T19:19:05.532705+0000","last_became_active":"2024-09-13T19:15:55.895552+0000","last_became_peered":"2024-09-13T19:15:55.895552+0000","last_unstale":"2024-09-13T19:19:05.532705+0000","last_undegraded":"2024-09-13T19:19:05.532705+0000","last_fullsized":"2024-09-13T19:19:05.532705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:11.960376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"36'8","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.961901+0000","last_change":"2024-09-13T19:15:57.889071+0000","last_active":"2024-09-13T19:19:05.961901+0000","last_peered":"2024-09-13T19:19:05.961901+0000","last_clean":"2024-09-13T19:19:05.961901+0000","last_became_active":"2024-09-13T19:15:57.886511+0000","last_became_peered":"2024-09-13T19:15:57.886511+0000","last_unstale":"2024-09-13T19:19:05.961901+0000","last_undegraded":"2024-09-13T19:19:05.961901+0000","last_fullsized":"2024-09-13T19:19:05.961901+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:29.689654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.989246+0000","last_change":"2024-09-13T19:15:55.898694+0000","last_active":"2024-09-13T19:16:31.989246+0000","last_peered":"2024-09-13T19:16:31.989246+0000","last_clean":"2024-09-13T19:16:31.989246+0000","last_became_active":"2024-09-13T19:15:55.896952+0000","last_became_peered":"2024-09-13T19:15:55.896952+0000","last_unstale":"2024-09-13T19:16:31.989246+0000","last_undegraded":"2024-09-13T19:16:31.989246+0000","last_fullsized":"2024-09-13T19:16:31.989246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:07.205939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"36'8","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.961849+0000","last_change":"2024-09-13T19:15:57.891691+0000","last_active":"2024-09-13T19:19:05.961849+0000","last_peered":"2024-09-13T19:19:05.961849+0000","last_clean":"2024-09-13T19:19:05.961849+0000","last_became_active":"2024-09-13T19:15:57.891411+0000","last_became_peered":"2024-09-13T19:15:57.891411+0000","last_unstale":"2024-09-13T19:19:05.961849+0000","last_undegraded":"2024-09-13T19:19:05.961849+0000","last_fullsized":"2024-09-13T19:19:05.961849+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:00.474958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"36'2","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:37.184808+0000","last_change":"2024-09-13T19:15:55.896710+0000","last_active":"2024-09-13T19:16:37.184808+0000","last_peered":"2024-09-13T19:16:37.184808+0000","last_clean":"2024-09-13T19:16:37.184808+0000","last_became_active":"2024-09-13T19:15:55.895453+0000","last_became_peered":"2024-09-13T19:15:55.895453+0000","last_unstale":"2024-09-13T19:16:37.184808+0000","last_undegraded":"2024-09-13T19:16:37.184808+0000","last_fullsized":"2024-09-13T19:16:37.184808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:02.236650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"36'8","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.708671+0000","last_change":"2024-09-13T19:15:57.896559+0000","last_active":"2024-09-13T19:19:05.708671+0000","last_peered":"2024-09-13T19:19:05.708671+0000","last_clean":"2024-09-13T19:19:05.708671+0000","last_became_active":"2024-09-13T19:15:57.896208+0000","last_became_peered":"2024-09-13T19:15:57.896208+0000","last_unstale":"2024-09-13T19:19:05.708671+0000","last_undegraded":"2024-09-13T19:19:05.708671+0000","last_fullsized":"2024-09-13T19:19:05.708671+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:04.776815+0000","last_change":"2024-09-13T19:15:55.892927+0000","last_active":"2024-09-13T19:18:04.776815+0000","last_peered":"2024-09-13T19:18:04.776815+0000","last_clean":"2024-09-13T19:18:04.776815+0000","last_became_active":"2024-09-13T19:15:55.892616+0000","last_became_peered":"2024-09-13T19:15:55.892616+0000","last_unstale":"2024-09-13T19:18:04.776815+0000","last_undegraded":"2024-09-13T19:18:04.776815+0000","last_fullsized":"2024-09-13T19:18:04.776815+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:43:49.825167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"36'2","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:01.383748+0000","last_change":"2024-09-13T19:15:57.897850+0000","last_active":"2024-09-13T19:18:01.383748+0000","last_peered":"2024-09-13T19:18:01.383748+0000","last_clean":"2024-09-13T19:18:01.383748+0000","last_became_active":"2024-09-13T19:15:57.897566+0000","last_became_peered":"2024-09-13T19:15:57.897566+0000","last_unstale":"2024-09-13T19:18:01.383748+0000","last_undegraded":"2024-09-13T19:18:01.383748+0000","last_fullsized":"2024-09-13T19:18:01.383748+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:28:00.527551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:21.938320+0000","last_change":"2024-09-13T19:15:55.894579+0000","last_active":"2024-09-13T19:18:21.938320+0000","last_peered":"2024-09-13T19:18:21.938320+0000","last_clean":"2024-09-13T19:18:21.938320+0000","last_became_active":"2024-09-13T19:15:55.893594+0000","last_became_peered":"2024-09-13T19:15:55.893594+0000","last_unstale":"2024-09-13T19:18:21.938320+0000","last_undegraded":"2024-09-13T19:18:21.938320+0000","last_fullsized":"2024-09-13T19:18:21.938320+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"36'6","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.842241+0000","last_change":"2024-09-13T19:15:57.890303+0000","last_active":"2024-09-13T19:19:05.842241+0000","last_peered":"2024-09-13T19:19:05.842241+0000","last_clean":"2024-09-13T19:19:05.842241+0000","last_became_active":"2024-09-13T19:15:57.889901+0000","last_became_peered":"2024-09-13T19:15:57.889901+0000","last_unstale":"2024-09-13T19:19:05.842241+0000","last_undegraded":"2024-09-13T19:19:05.842241+0000","last_fullsized":"2024-09-13T19:19:05.842241+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:15.189353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.982141+0000","last_change":"2024-09-13T19:15:55.899097+0000","last_active":"2024-09-13T19:16:31.982141+0000","last_peered":"2024-09-13T19:16:31.982141+0000","last_clean":"2024-09-13T19:16:31.982141+0000","last_became_active":"2024-09-13T19:15:55.898679+0000","last_became_peered":"2024-09-13T19:15:55.898679+0000","last_unstale":"2024-09-13T19:16:31.982141+0000","last_undegraded":"2024-09-13T19:16:31.982141+0000","last_fullsized":"2024-09-13T19:16:31.982141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:27:38.213575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"36'35","reported_seq":99,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.884618+0000","last_change":"2024-09-13T19:16:05.921753+0000","last_active":"2024-09-13T19:19:05.884618+0000","last_peered":"2024-09-13T19:19:05.884618+0000","last_clean":"2024-09-13T19:19:05.884618+0000","last_became_active":"2024-09-13T19:16:05.921156+0000","last_became_peered":"2024-09-13T19:16:05.921156+0000","last_unstale":"2024-09-13T19:19:05.884618+0000","last_undegraded":"2024-09-13T19:19:05.884618+0000","last_fullsized":"2024-09-13T19:19:05.884618+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:05.248200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"36'6","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.601363+0000","last_change":"2024-09-13T19:15:57.897717+0000","last_active":"2024-09-13T19:19:05.601363+0000","last_peered":"2024-09-13T19:19:05.601363+0000","last_clean":"2024-09-13T19:19:05.601363+0000","last_became_active":"2024-09-13T19:15:57.895870+0000","last_became_peered":"2024-09-13T19:15:57.895870+0000","last_unstale":"2024-09-13T19:19:05.601363+0000","last_undegraded":"2024-09-13T19:19:05.601363+0000","last_fullsized":"2024-09-13T19:19:05.601363+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:18.507963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.981961+0000","last_change":"2024-09-13T19:15:55.895213+0000","last_active":"2024-09-13T19:16:31.981961+0000","last_peered":"2024-09-13T19:16:31.981961+0000","last_clean":"2024-09-13T19:16:31.981961+0000","last_became_active":"2024-09-13T19:15:55.894099+0000","last_became_peered":"2024-09-13T19:15:55.894099+0000","last_unstale":"2024-09-13T19:16:31.981961+0000","last_undegraded":"2024-09-13T19:16:31.981961+0000","last_fullsized":"2024-09-13T19:16:31.981961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:27:58.520969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985712+0000","last_change":"2024-09-13T19:15:59.896913+0000","last_active":"2024-09-13T19:16:31.985712+0000","last_peered":"2024-09-13T19:16:31.985712+0000","last_clean":"2024-09-13T19:16:31.985712+0000","last_became_active":"2024-09-13T19:15:59.896648+0000","last_became_peered":"2024-09-13T19:15:59.896648+0000","last_unstale":"2024-09-13T19:16:31.985712+0000","last_undegraded":"2024-09-13T19:16:31.985712+0000","last_fullsized":"2024-09-13T19:16:31.985712+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:46.250392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"36'33","reported_seq":79,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.727768+0000","last_change":"2024-09-13T19:16:01.907027+0000","last_active":"2024-09-13T19:19:12.727768+0000","last_peered":"2024-09-13T19:19:12.727768+0000","last_clean":"2024-09-13T19:19:12.727768+0000","last_became_active":"2024-09-13T19:16:01.906675+0000","last_became_peered":"2024-09-13T19:16:01.906675+0000","last_unstale":"2024-09-13T19:19:12.727768+0000","last_undegraded":"2024-09-13T19:19:12.727768+0000","last_fullsized":"2024-09-13T19:19:12.727768+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:45.278694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.990499+0000","last_change":"2024-09-13T19:16:03.914490+0000","last_active":"2024-09-13T19:16:31.990499+0000","last_peered":"2024-09-13T19:16:31.990499+0000","last_clean":"2024-09-13T19:16:31.990499+0000","last_became_active":"2024-09-13T19:16:03.914111+0000","last_became_peered":"2024-09-13T19:16:03.914111+0000","last_unstale":"2024-09-13T19:16:31.990499+0000","last_undegraded":"2024-09-13T19:16:31.990499+0000","last_fullsized":"2024-09-13T19:16:31.990499+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:15.864837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"36'7","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:20.744686+0000","last_change":"2024-09-13T19:16:05.925198+0000","last_active":"2024-09-13T19:17:20.744686+0000","last_peered":"2024-09-13T19:17:20.744686+0000","last_clean":"2024-09-13T19:17:20.744686+0000","last_became_active":"2024-09-13T19:16:05.924829+0000","last_became_peered":"2024-09-13T19:16:05.924829+0000","last_unstale":"2024-09-13T19:17:20.744686+0000","last_undegraded":"2024-09-13T19:17:20.744686+0000","last_fullsized":"2024-09-13T19:17:20.744686+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:34:08.741130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"36'10","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.920422+0000","last_change":"2024-09-13T19:15:57.898414+0000","last_active":"2024-09-13T19:19:05.920422+0000","last_peered":"2024-09-13T19:19:05.920422+0000","last_clean":"2024-09-13T19:19:05.920422+0000","last_became_active":"2024-09-13T19:15:57.897928+0000","last_became_peered":"2024-09-13T19:15:57.897928+0000","last_unstale":"2024-09-13T19:19:05.920422+0000","last_undegraded":"2024-09-13T19:19:05.920422+0000","last_fullsized":"2024-09-13T19:19:05.920422+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:32.186245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985358+0000","last_change":"2024-09-13T19:15:55.892255+0000","last_active":"2024-09-13T19:16:31.985358+0000","last_peered":"2024-09-13T19:16:31.985358+0000","last_clean":"2024-09-13T19:16:31.985358+0000","last_became_active":"2024-09-13T19:15:55.891934+0000","last_became_peered":"2024-09-13T19:15:55.891934+0000","last_unstale":"2024-09-13T19:16:31.985358+0000","last_undegraded":"2024-09-13T19:16:31.985358+0000","last_fullsized":"2024-09-13T19:16:31.985358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:14:40.566289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:21.938344+0000","last_change":"2024-09-13T19:15:59.892496+0000","last_active":"2024-09-13T19:18:21.938344+0000","last_peered":"2024-09-13T19:18:21.938344+0000","last_clean":"2024-09-13T19:18:21.938344+0000","last_became_active":"2024-09-13T19:15:59.892230+0000","last_became_peered":"2024-09-13T19:15:59.892230+0000","last_unstale":"2024-09-13T19:18:21.938344+0000","last_undegraded":"2024-09-13T19:18:21.938344+0000","last_fullsized":"2024-09-13T19:18:21.938344+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"36'8","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:38.373021+0000","last_change":"2024-09-13T19:16:01.903662+0000","last_active":"2024-09-13T19:16:38.373021+0000","last_peered":"2024-09-13T19:16:38.373021+0000","last_clean":"2024-09-13T19:16:38.373021+0000","last_became_active":"2024-09-13T19:16:01.903371+0000","last_became_peered":"2024-09-13T19:16:01.903371+0000","last_unstale":"2024-09-13T19:16:38.373021+0000","last_undegraded":"2024-09-13T19:16:38.373021+0000","last_fullsized":"2024-09-13T19:16:38.373021+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:53.296370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.988897+0000","last_change":"2024-09-13T19:16:03.915815+0000","last_active":"2024-09-13T19:16:31.988897+0000","last_peered":"2024-09-13T19:16:31.988897+0000","last_clean":"2024-09-13T19:16:31.988897+0000","last_became_active":"2024-09-13T19:16:03.915538+0000","last_became_peered":"2024-09-13T19:16:03.915538+0000","last_unstale":"2024-09-13T19:16:31.988897+0000","last_undegraded":"2024-09-13T19:16:31.988897+0000","last_fullsized":"2024-09-13T19:16:31.988897+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:54:45.306953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"34'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:36.940451+0000","last_change":"2024-09-13T19:16:05.911958+0000","last_active":"2024-09-13T19:18:36.940451+0000","last_peered":"2024-09-13T19:18:36.940451+0000","last_clean":"2024-09-13T19:18:36.940451+0000","last_became_active":"2024-09-13T19:16:05.911683+0000","last_became_peered":"2024-09-13T19:16:05.911683+0000","last_unstale":"2024-09-13T19:18:36.940451+0000","last_undegraded":"2024-09-13T19:18:36.940451+0000","last_fullsized":"2024-09-13T19:18:36.940451+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"36'4","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.919899+0000","last_change":"2024-09-13T19:15:57.897213+0000","last_active":"2024-09-13T19:19:05.919899+0000","last_peered":"2024-09-13T19:19:05.919899+0000","last_clean":"2024-09-13T19:19:05.919899+0000","last_became_active":"2024-09-13T19:15:57.896965+0000","last_became_peered":"2024-09-13T19:15:57.896965+0000","last_unstale":"2024-09-13T19:19:05.919899+0000","last_undegraded":"2024-09-13T19:19:05.919899+0000","last_fullsized":"2024-09-13T19:19:05.919899+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:07:02.179917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.830677+0000","last_change":"2024-09-13T19:15:55.899327+0000","last_active":"2024-09-13T19:19:05.830677+0000","last_peered":"2024-09-13T19:19:05.830677+0000","last_clean":"2024-09-13T19:19:05.830677+0000","last_became_active":"2024-09-13T19:15:55.895444+0000","last_became_peered":"2024-09-13T19:15:55.895444+0000","last_unstale":"2024-09-13T19:19:05.830677+0000","last_undegraded":"2024-09-13T19:19:05.830677+0000","last_fullsized":"2024-09-13T19:19:05.830677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:01:17.850573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:26.939237+0000","last_change":"2024-09-13T19:15:59.895805+0000","last_active":"2024-09-13T19:18:26.939237+0000","last_peered":"2024-09-13T19:18:26.939237+0000","last_clean":"2024-09-13T19:18:26.939237+0000","last_became_active":"2024-09-13T19:15:59.895332+0000","last_became_peered":"2024-09-13T19:15:59.895332+0000","last_unstale":"2024-09-13T19:18:26.939237+0000","last_undegraded":"2024-09-13T19:18:26.939237+0000","last_fullsized":"2024-09-13T19:18:26.939237+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"34'10","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985590+0000","last_change":"2024-09-13T19:16:01.905730+0000","last_active":"2024-09-13T19:16:31.985590+0000","last_peered":"2024-09-13T19:16:31.985590+0000","last_clean":"2024-09-13T19:16:31.985590+0000","last_became_active":"2024-09-13T19:16:01.905457+0000","last_became_peered":"2024-09-13T19:16:01.905457+0000","last_unstale":"2024-09-13T19:16:31.985590+0000","last_undegraded":"2024-09-13T19:16:31.985590+0000","last_fullsized":"2024-09-13T19:16:31.985590+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:49.792682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"36'285","reported_seq":384,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.658696+0000","last_change":"2024-09-13T19:16:03.917127+0000","last_active":"2024-09-13T19:19:12.658696+0000","last_peered":"2024-09-13T19:19:12.658696+0000","last_clean":"2024-09-13T19:19:12.658696+0000","last_became_active":"2024-09-13T19:16:03.916853+0000","last_became_peered":"2024-09-13T19:16:03.916853+0000","last_unstale":"2024-09-13T19:19:12.658696+0000","last_undegraded":"2024-09-13T19:19:12.658696+0000","last_fullsized":"2024-09-13T19:19:12.658696+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:35:56.150634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"36'2","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.897376+0000","last_change":"2024-09-13T19:16:05.912480+0000","last_active":"2024-09-13T19:19:05.897376+0000","last_peered":"2024-09-13T19:19:05.897376+0000","last_clean":"2024-09-13T19:19:05.897376+0000","last_became_active":"2024-09-13T19:16:05.912191+0000","last_became_peered":"2024-09-13T19:16:05.912191+0000","last_unstale":"2024-09-13T19:19:05.897376+0000","last_undegraded":"2024-09-13T19:19:05.897376+0000","last_fullsized":"2024-09-13T19:19:05.897376+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:58.001697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"36'4","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.930011+0000","last_change":"2024-09-13T19:15:57.890567+0000","last_active":"2024-09-13T19:19:05.930011+0000","last_peered":"2024-09-13T19:19:05.930011+0000","last_clean":"2024-09-13T19:19:05.930011+0000","last_became_active":"2024-09-13T19:15:57.890015+0000","last_became_peered":"2024-09-13T19:15:57.890015+0000","last_unstale":"2024-09-13T19:19:05.930011+0000","last_undegraded":"2024-09-13T19:19:05.930011+0000","last_fullsized":"2024-09-13T19:19:05.930011+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.988304+0000","last_change":"2024-09-13T19:15:55.894913+0000","last_active":"2024-09-13T19:16:31.988304+0000","last_peered":"2024-09-13T19:16:31.988304+0000","last_clean":"2024-09-13T19:16:31.988304+0000","last_became_active":"2024-09-13T19:15:55.894380+0000","last_became_peered":"2024-09-13T19:15:55.894380+0000","last_unstale":"2024-09-13T19:16:31.988304+0000","last_undegraded":"2024-09-13T19:16:31.988304+0000","last_fullsized":"2024-09-13T19:16:31.988304+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:50:15.856299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984719+0000","last_change":"2024-09-13T19:15:59.897351+0000","last_active":"2024-09-13T19:16:31.984719+0000","last_peered":"2024-09-13T19:16:31.984719+0000","last_clean":"2024-09-13T19:16:31.984719+0000","last_became_active":"2024-09-13T19:15:59.896572+0000","last_became_peered":"2024-09-13T19:15:59.896572+0000","last_unstale":"2024-09-13T19:16:31.984719+0000","last_undegraded":"2024-09-13T19:16:31.984719+0000","last_fullsized":"2024-09-13T19:16:31.984719+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:59.226392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"36'33","reported_seq":79,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.711983+0000","last_change":"2024-09-13T19:16:01.906742+0000","last_active":"2024-09-13T19:19:12.711983+0000","last_peered":"2024-09-13T19:19:12.711983+0000","last_clean":"2024-09-13T19:19:12.711983+0000","last_became_active":"2024-09-13T19:16:01.906471+0000","last_became_peered":"2024-09-13T19:16:01.906471+0000","last_unstale":"2024-09-13T19:19:12.711983+0000","last_undegraded":"2024-09-13T19:19:12.711983+0000","last_fullsized":"2024-09-13T19:19:12.711983+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:06.655467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"36'285","reported_seq":414,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.825180+0000","last_change":"2024-09-13T19:16:03.909320+0000","last_active":"2024-09-13T19:19:12.825180+0000","last_peered":"2024-09-13T19:19:12.825180+0000","last_clean":"2024-09-13T19:19:12.825180+0000","last_became_active":"2024-09-13T19:16:03.909046+0000","last_became_peered":"2024-09-13T19:16:03.909046+0000","last_unstale":"2024-09-13T19:19:12.825180+0000","last_undegraded":"2024-09-13T19:19:12.825180+0000","last_fullsized":"2024-09-13T19:19:12.825180+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"36'16","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:01.383779+0000","last_change":"2024-09-13T19:16:31.997893+0000","last_active":"2024-09-13T19:18:01.383779+0000","last_peered":"2024-09-13T19:18:01.383779+0000","last_clean":"2024-09-13T19:18:01.383779+0000","last_became_active":"2024-09-13T19:16:31.991055+0000","last_became_peered":"2024-09-13T19:16:31.991055+0000","last_unstale":"2024-09-13T19:18:01.383779+0000","last_undegraded":"2024-09-13T19:18:01.383779+0000","last_fullsized":"2024-09-13T19:18:01.383779+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:44.244007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":73,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.986838+0000","last_change":"2024-09-13T19:15:55.893934+0000","last_active":"2024-09-13T19:16:31.986838+0000","last_peered":"2024-09-13T19:16:31.986838+0000","last_clean":"2024-09-13T19:16:31.986838+0000","last_became_active":"2024-09-13T19:15:55.893544+0000","last_became_peered":"2024-09-13T19:15:55.893544+0000","last_unstale":"2024-09-13T19:16:31.986838+0000","last_undegraded":"2024-09-13T19:16:31.986838+0000","last_fullsized":"2024-09-13T19:16:31.986838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:18:40.262875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.990140+0000","last_change":"2024-09-13T19:15:59.897690+0000","last_active":"2024-09-13T19:16:31.990140+0000","last_peered":"2024-09-13T19:16:31.990140+0000","last_clean":"2024-09-13T19:16:31.990140+0000","last_became_active":"2024-09-13T19:15:59.897435+0000","last_became_peered":"2024-09-13T19:15:59.897435+0000","last_unstale":"2024-09-13T19:16:31.990140+0000","last_undegraded":"2024-09-13T19:16:31.990140+0000","last_fullsized":"2024-09-13T19:16:31.990140+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:59:16.566449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"36'44","reported_seq":95,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.740211+0000","last_change":"2024-09-13T19:16:01.904848+0000","last_active":"2024-09-13T19:19:12.740211+0000","last_peered":"2024-09-13T19:19:12.740211+0000","last_clean":"2024-09-13T19:19:12.740211+0000","last_became_active":"2024-09-13T19:16:01.904454+0000","last_became_peered":"2024-09-13T19:16:01.904454+0000","last_unstale":"2024-09-13T19:19:12.740211+0000","last_undegraded":"2024-09-13T19:19:12.740211+0000","last_fullsized":"2024-09-13T19:19:12.740211+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:57.161122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:21.938309+0000","last_change":"2024-09-13T19:16:03.912757+0000","last_active":"2024-09-13T19:18:21.938309+0000","last_peered":"2024-09-13T19:18:21.938309+0000","last_clean":"2024-09-13T19:18:21.938309+0000","last_became_active":"2024-09-13T19:16:03.912383+0000","last_became_peered":"2024-09-13T19:16:03.912383+0000","last_unstale":"2024-09-13T19:18:21.938309+0000","last_undegraded":"2024-09-13T19:18:21.938309+0000","last_fullsized":"2024-09-13T19:18:21.938309+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"36'5","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:20.746478+0000","last_change":"2024-09-13T19:16:05.919436+0000","last_active":"2024-09-13T19:17:20.746478+0000","last_peered":"2024-09-13T19:17:20.746478+0000","last_clean":"2024-09-13T19:17:20.746478+0000","last_became_active":"2024-09-13T19:16:05.919154+0000","last_became_peered":"2024-09-13T19:16:05.919154+0000","last_unstale":"2024-09-13T19:17:20.746478+0000","last_undegraded":"2024-09-13T19:17:20.746478+0000","last_fullsized":"2024-09-13T19:17:20.746478+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:37.455541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"36'3","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.929721+0000","last_change":"2024-09-13T19:15:57.890834+0000","last_active":"2024-09-13T19:19:05.929721+0000","last_peered":"2024-09-13T19:19:05.929721+0000","last_clean":"2024-09-13T19:19:05.929721+0000","last_became_active":"2024-09-13T19:15:57.890345+0000","last_became_peered":"2024-09-13T19:15:57.890345+0000","last_unstale":"2024-09-13T19:19:05.929721+0000","last_undegraded":"2024-09-13T19:19:05.929721+0000","last_fullsized":"2024-09-13T19:19:05.929721+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:57:17.627397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.833713+0000","last_change":"2024-09-13T19:15:55.891871+0000","last_active":"2024-09-13T19:19:05.833713+0000","last_peered":"2024-09-13T19:19:05.833713+0000","last_clean":"2024-09-13T19:19:05.833713+0000","last_became_active":"2024-09-13T19:15:55.891250+0000","last_became_peered":"2024-09-13T19:15:55.891250+0000","last_unstale":"2024-09-13T19:19:05.833713+0000","last_undegraded":"2024-09-13T19:19:05.833713+0000","last_fullsized":"2024-09-13T19:19:05.833713+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:28:19.256515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:11.936616+0000","last_change":"2024-09-13T19:15:59.891252+0000","last_active":"2024-09-13T19:18:11.936616+0000","last_peered":"2024-09-13T19:18:11.936616+0000","last_clean":"2024-09-13T19:18:11.936616+0000","last_became_active":"2024-09-13T19:15:59.891028+0000","last_became_peered":"2024-09-13T19:15:59.891028+0000","last_unstale":"2024-09-13T19:18:11.936616+0000","last_undegraded":"2024-09-13T19:18:11.936616+0000","last_fullsized":"2024-09-13T19:18:11.936616+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"36'33","reported_seq":79,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.780018+0000","last_change":"2024-09-13T19:16:01.904850+0000","last_active":"2024-09-13T19:19:12.780018+0000","last_peered":"2024-09-13T19:19:12.780018+0000","last_clean":"2024-09-13T19:19:12.780018+0000","last_became_active":"2024-09-13T19:16:01.904534+0000","last_became_peered":"2024-09-13T19:16:01.904534+0000","last_unstale":"2024-09-13T19:19:12.780018+0000","last_undegraded":"2024-09-13T19:19:12.780018+0000","last_fullsized":"2024-09-13T19:19:12.780018+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:00.451745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:16.937411+0000","last_change":"2024-09-13T19:16:03.914154+0000","last_active":"2024-09-13T19:18:16.937411+0000","last_peered":"2024-09-13T19:18:16.937411+0000","last_clean":"2024-09-13T19:18:16.937411+0000","last_became_active":"2024-09-13T19:16:03.913829+0000","last_became_peered":"2024-09-13T19:16:03.913829+0000","last_unstale":"2024-09-13T19:18:16.937411+0000","last_undegraded":"2024-09-13T19:18:16.937411+0000","last_fullsized":"2024-09-13T19:18:16.937411+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"36'3","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:15.156823+0000","last_change":"2024-09-13T19:16:05.913878+0000","last_active":"2024-09-13T19:17:15.156823+0000","last_peered":"2024-09-13T19:17:15.156823+0000","last_clean":"2024-09-13T19:17:15.156823+0000","last_became_active":"2024-09-13T19:16:05.913578+0000","last_became_peered":"2024-09-13T19:16:05.913578+0000","last_unstale":"2024-09-13T19:17:15.156823+0000","last_undegraded":"2024-09-13T19:17:15.156823+0000","last_fullsized":"2024-09-13T19:17:15.156823+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:39.890039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.986992+0000","last_change":"2024-09-13T19:15:57.898011+0000","last_active":"2024-09-13T19:16:31.986992+0000","last_peered":"2024-09-13T19:16:31.986992+0000","last_clean":"2024-09-13T19:16:31.986992+0000","last_became_active":"2024-09-13T19:15:57.897468+0000","last_became_peered":"2024-09-13T19:15:57.897468+0000","last_unstale":"2024-09-13T19:16:31.986992+0000","last_undegraded":"2024-09-13T19:16:31.986992+0000","last_fullsized":"2024-09-13T19:16:31.986992+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:27:40.220158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985332+0000","last_change":"2024-09-13T19:15:55.893786+0000","last_active":"2024-09-13T19:16:31.985332+0000","last_peered":"2024-09-13T19:16:31.985332+0000","last_clean":"2024-09-13T19:16:31.985332+0000","last_became_active":"2024-09-13T19:15:55.893489+0000","last_became_peered":"2024-09-13T19:15:55.893489+0000","last_unstale":"2024-09-13T19:16:31.985332+0000","last_undegraded":"2024-09-13T19:16:31.985332+0000","last_fullsized":"2024-09-13T19:16:31.985332+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:43.870700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:16.937440+0000","last_change":"2024-09-13T19:15:59.895668+0000","last_active":"2024-09-13T19:18:16.937440+0000","last_peered":"2024-09-13T19:18:16.937440+0000","last_clean":"2024-09-13T19:18:16.937440+0000","last_became_active":"2024-09-13T19:15:59.895291+0000","last_became_peered":"2024-09-13T19:15:59.895291+0000","last_unstale":"2024-09-13T19:18:16.937440+0000","last_undegraded":"2024-09-13T19:18:16.937440+0000","last_fullsized":"2024-09-13T19:18:16.937440+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"36'39","reported_seq":88,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.746014+0000","last_change":"2024-09-13T19:16:01.896793+0000","last_active":"2024-09-13T19:19:12.746014+0000","last_peered":"2024-09-13T19:19:12.746014+0000","last_clean":"2024-09-13T19:19:12.746014+0000","last_became_active":"2024-09-13T19:16:01.896507+0000","last_became_peered":"2024-09-13T19:16:01.896507+0000","last_unstale":"2024-09-13T19:19:12.746014+0000","last_undegraded":"2024-09-13T19:19:12.746014+0000","last_fullsized":"2024-09-13T19:19:12.746014+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:36.387463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"36'285","reported_seq":379,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.826278+0000","last_change":"2024-09-13T19:16:03.911636+0000","last_active":"2024-09-13T19:19:12.826278+0000","last_peered":"2024-09-13T19:19:12.826278+0000","last_clean":"2024-09-13T19:19:12.826278+0000","last_became_active":"2024-09-13T19:16:03.910504+0000","last_became_peered":"2024-09-13T19:16:03.910504+0000","last_unstale":"2024-09-13T19:19:12.826278+0000","last_undegraded":"2024-09-13T19:19:12.826278+0000","last_fullsized":"2024-09-13T19:19:12.826278+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"36'4","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:16.937502+0000","last_change":"2024-09-13T19:16:05.913148+0000","last_active":"2024-09-13T19:18:16.937502+0000","last_peered":"2024-09-13T19:18:16.937502+0000","last_clean":"2024-09-13T19:18:16.937502+0000","last_became_active":"2024-09-13T19:16:05.912881+0000","last_became_peered":"2024-09-13T19:16:05.912881+0000","last_unstale":"2024-09-13T19:18:16.937502+0000","last_undegraded":"2024-09-13T19:18:16.937502+0000","last_fullsized":"2024-09-13T19:18:16.937502+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"36'4","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.696199+0000","last_change":"2024-09-13T19:15:57.884610+0000","last_active":"2024-09-13T19:19:05.696199+0000","last_peered":"2024-09-13T19:19:05.696199+0000","last_clean":"2024-09-13T19:19:05.696199+0000","last_became_active":"2024-09-13T19:15:57.883675+0000","last_became_peered":"2024-09-13T19:15:57.883675+0000","last_unstale":"2024-09-13T19:19:05.696199+0000","last_undegraded":"2024-09-13T19:19:05.696199+0000","last_fullsized":"2024-09-13T19:19:05.696199+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:14.821792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"36'7","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.489095+0000","last_change":"2024-09-13T19:15:55.892801+0000","last_active":"2024-09-13T19:19:05.489095+0000","last_peered":"2024-09-13T19:19:05.489095+0000","last_clean":"2024-09-13T19:19:05.489095+0000","last_became_active":"2024-09-13T19:15:55.891882+0000","last_became_peered":"2024-09-13T19:15:55.891882+0000","last_unstale":"2024-09-13T19:19:05.489095+0000","last_undegraded":"2024-09-13T19:19:05.489095+0000","last_fullsized":"2024-09-13T19:19:05.489095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:04.866489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":16,"num_write_kb":4722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:33.926996+0000","last_change":"2024-09-13T19:16:31.992973+0000","last_active":"2024-09-13T19:16:33.926996+0000","last_peered":"2024-09-13T19:16:33.926996+0000","last_clean":"2024-09-13T19:16:33.926996+0000","last_became_active":"2024-09-13T19:16:31.992122+0000","last_became_peered":"2024-09-13T19:16:31.992122+0000","last_unstale":"2024-09-13T19:16:33.926996+0000","last_undegraded":"2024-09-13T19:16:33.926996+0000","last_fullsized":"2024-09-13T19:16:33.926996+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:17.756694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"36'61","reported_seq":125,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.788553+0000","last_change":"2024-09-13T19:16:01.906341+0000","last_active":"2024-09-13T19:19:12.788553+0000","last_peered":"2024-09-13T19:19:12.788553+0000","last_clean":"2024-09-13T19:19:12.788553+0000","last_became_active":"2024-09-13T19:16:01.906031+0000","last_became_peered":"2024-09-13T19:16:01.906031+0000","last_unstale":"2024-09-13T19:19:12.788553+0000","last_undegraded":"2024-09-13T19:19:12.788553+0000","last_fullsized":"2024-09-13T19:19:12.788553+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:10:29.683024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:16.937346+0000","last_change":"2024-09-13T19:16:03.908434+0000","last_active":"2024-09-13T19:18:16.937346+0000","last_peered":"2024-09-13T19:18:16.937346+0000","last_clean":"2024-09-13T19:18:16.937346+0000","last_became_active":"2024-09-13T19:16:03.908134+0000","last_became_peered":"2024-09-13T19:16:03.908134+0000","last_unstale":"2024-09-13T19:18:16.937346+0000","last_undegraded":"2024-09-13T19:18:16.937346+0000","last_fullsized":"2024-09-13T19:18:16.937346+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"36'18","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.186467+0000","last_change":"2024-09-13T19:16:05.915102+0000","last_active":"2024-09-13T19:19:06.186467+0000","last_peered":"2024-09-13T19:19:06.186467+0000","last_clean":"2024-09-13T19:19:06.186467+0000","last_became_active":"2024-09-13T19:16:05.914853+0000","last_became_peered":"2024-09-13T19:16:05.914853+0000","last_unstale":"2024-09-13T19:19:06.186467+0000","last_undegraded":"2024-09-13T19:19:06.186467+0000","last_fullsized":"2024-09-13T19:19:06.186467+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"36'6","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.700154+0000","last_change":"2024-09-13T19:15:57.903310+0000","last_active":"2024-09-13T19:19:05.700154+0000","last_peered":"2024-09-13T19:19:05.700154+0000","last_clean":"2024-09-13T19:19:05.700154+0000","last_became_active":"2024-09-13T19:15:57.902955+0000","last_became_peered":"2024-09-13T19:15:57.902955+0000","last_unstale":"2024-09-13T19:19:05.700154+0000","last_undegraded":"2024-09-13T19:19:05.700154+0000","last_fullsized":"2024-09-13T19:19:05.700154+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:45.877283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:11.936694+0000","last_change":"2024-09-13T19:15:55.891315+0000","last_active":"2024-09-13T19:18:11.936694+0000","last_peered":"2024-09-13T19:18:11.936694+0000","last_clean":"2024-09-13T19:18:11.936694+0000","last_became_active":"2024-09-13T19:15:55.890805+0000","last_became_peered":"2024-09-13T19:15:55.890805+0000","last_unstale":"2024-09-13T19:18:11.936694+0000","last_undegraded":"2024-09-13T19:18:11.936694+0000","last_fullsized":"2024-09-13T19:18:11.936694+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.987047+0000","last_change":"2024-09-13T19:15:59.898184+0000","last_active":"2024-09-13T19:16:31.987047+0000","last_peered":"2024-09-13T19:16:31.987047+0000","last_clean":"2024-09-13T19:16:31.987047+0000","last_became_active":"2024-09-13T19:15:59.897884+0000","last_became_peered":"2024-09-13T19:15:59.897884+0000","last_unstale":"2024-09-13T19:16:31.987047+0000","last_undegraded":"2024-09-13T19:16:31.987047+0000","last_fullsized":"2024-09-13T19:16:31.987047+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:34.869944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"36'37","reported_seq":84,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.805116+0000","last_change":"2024-09-13T19:16:01.903021+0000","last_active":"2024-09-13T19:19:12.805116+0000","last_peered":"2024-09-13T19:19:12.805116+0000","last_clean":"2024-09-13T19:19:12.805116+0000","last_became_active":"2024-09-13T19:16:01.902657+0000","last_became_peered":"2024-09-13T19:16:01.902657+0000","last_unstale":"2024-09-13T19:19:12.805116+0000","last_undegraded":"2024-09-13T19:19:12.805116+0000","last_fullsized":"2024-09-13T19:19:12.805116+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:41.157697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":44,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984486+0000","last_change":"2024-09-13T19:16:03.915798+0000","last_active":"2024-09-13T19:16:31.984486+0000","last_peered":"2024-09-13T19:16:31.984486+0000","last_clean":"2024-09-13T19:16:31.984486+0000","last_became_active":"2024-09-13T19:16:03.915499+0000","last_became_peered":"2024-09-13T19:16:03.915499+0000","last_unstale":"2024-09-13T19:16:31.984486+0000","last_undegraded":"2024-09-13T19:16:31.984486+0000","last_fullsized":"2024-09-13T19:16:31.984486+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:32.988972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"36'3","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:08.940888+0000","last_change":"2024-09-13T19:16:05.920534+0000","last_active":"2024-09-13T19:18:08.940888+0000","last_peered":"2024-09-13T19:18:08.940888+0000","last_clean":"2024-09-13T19:18:08.940888+0000","last_became_active":"2024-09-13T19:16:05.920239+0000","last_became_peered":"2024-09-13T19:16:05.920239+0000","last_unstale":"2024-09-13T19:18:08.940888+0000","last_undegraded":"2024-09-13T19:18:08.940888+0000","last_fullsized":"2024-09-13T19:18:08.940888+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:56.959074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"36'8","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.920365+0000","last_change":"2024-09-13T19:15:57.901642+0000","last_active":"2024-09-13T19:19:05.920365+0000","last_peered":"2024-09-13T19:19:05.920365+0000","last_clean":"2024-09-13T19:19:05.920365+0000","last_became_active":"2024-09-13T19:15:57.901131+0000","last_became_peered":"2024-09-13T19:15:57.901131+0000","last_unstale":"2024-09-13T19:19:05.920365+0000","last_undegraded":"2024-09-13T19:19:05.920365+0000","last_fullsized":"2024-09-13T19:19:05.920365+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:14:23.651972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.982818+0000","last_change":"2024-09-13T19:15:55.900444+0000","last_active":"2024-09-13T19:16:31.982818+0000","last_peered":"2024-09-13T19:16:31.982818+0000","last_clean":"2024-09-13T19:16:31.982818+0000","last_became_active":"2024-09-13T19:15:55.900143+0000","last_became_peered":"2024-09-13T19:15:55.900143+0000","last_unstale":"2024-09-13T19:16:31.982818+0000","last_undegraded":"2024-09-13T19:16:31.982818+0000","last_fullsized":"2024-09-13T19:16:31.982818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:35.770490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:16.937453+0000","last_change":"2024-09-13T19:15:59.895249+0000","last_active":"2024-09-13T19:18:16.937453+0000","last_peered":"2024-09-13T19:18:16.937453+0000","last_clean":"2024-09-13T19:18:16.937453+0000","last_became_active":"2024-09-13T19:15:59.894793+0000","last_became_peered":"2024-09-13T19:15:59.894793+0000","last_unstale":"2024-09-13T19:18:16.937453+0000","last_undegraded":"2024-09-13T19:18:16.937453+0000","last_fullsized":"2024-09-13T19:18:16.937453+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"36'39","reported_seq":88,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.770950+0000","last_change":"2024-09-13T19:16:01.898005+0000","last_active":"2024-09-13T19:19:12.770950+0000","last_peered":"2024-09-13T19:19:12.770950+0000","last_clean":"2024-09-13T19:19:12.770950+0000","last_became_active":"2024-09-13T19:16:01.897733+0000","last_became_peered":"2024-09-13T19:16:01.897733+0000","last_unstale":"2024-09-13T19:19:12.770950+0000","last_undegraded":"2024-09-13T19:19:12.770950+0000","last_fullsized":"2024-09-13T19:19:12.770950+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:59:18.573044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"36'285","reported_seq":412,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.659805+0000","last_change":"2024-09-13T19:16:03.916031+0000","last_active":"2024-09-13T19:19:12.659805+0000","last_peered":"2024-09-13T19:19:12.659805+0000","last_clean":"2024-09-13T19:19:12.659805+0000","last_became_active":"2024-09-13T19:16:03.915589+0000","last_became_peered":"2024-09-13T19:16:03.915589+0000","last_unstale":"2024-09-13T19:19:12.659805+0000","last_undegraded":"2024-09-13T19:19:12.659805+0000","last_fullsized":"2024-09-13T19:19:12.659805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:43.165549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"36'12","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.069679+0000","last_change":"2024-09-13T19:16:05.912837+0000","last_active":"2024-09-13T19:19:06.069679+0000","last_peered":"2024-09-13T19:19:06.069679+0000","last_clean":"2024-09-13T19:19:06.069679+0000","last_became_active":"2024-09-13T19:16:05.912339+0000","last_became_peered":"2024-09-13T19:16:05.912339+0000","last_unstale":"2024-09-13T19:19:06.069679+0000","last_undegraded":"2024-09-13T19:19:06.069679+0000","last_fullsized":"2024-09-13T19:19:06.069679+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"36'6","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:38.868840+0000","last_change":"2024-09-13T19:15:57.900840+0000","last_active":"2024-09-13T19:16:38.868840+0000","last_peered":"2024-09-13T19:16:38.868840+0000","last_clean":"2024-09-13T19:16:38.868840+0000","last_became_active":"2024-09-13T19:15:57.900560+0000","last_became_peered":"2024-09-13T19:15:57.900560+0000","last_unstale":"2024-09-13T19:16:38.868840+0000","last_undegraded":"2024-09-13T19:16:38.868840+0000","last_fullsized":"2024-09-13T19:16:38.868840+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:00.474958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.982771+0000","last_change":"2024-09-13T19:15:55.897670+0000","last_active":"2024-09-13T19:16:31.982771+0000","last_peered":"2024-09-13T19:16:31.982771+0000","last_clean":"2024-09-13T19:16:31.982771+0000","last_became_active":"2024-09-13T19:15:55.895799+0000","last_became_peered":"2024-09-13T19:15:55.895799+0000","last_unstale":"2024-09-13T19:16:31.982771+0000","last_undegraded":"2024-09-13T19:16:31.982771+0000","last_fullsized":"2024-09-13T19:16:31.982771+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:36.836879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'3","reported_seq":417,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.641235+0000","last_change":"2024-09-13T19:15:59.894637+0000","last_active":"2024-09-13T19:19:12.641235+0000","last_peered":"2024-09-13T19:19:12.641235+0000","last_clean":"2024-09-13T19:19:12.641235+0000","last_became_active":"2024-09-13T19:15:59.894303+0000","last_became_peered":"2024-09-13T19:15:59.894303+0000","last_unstale":"2024-09-13T19:19:12.641235+0000","last_undegraded":"2024-09-13T19:19:12.641235+0000","last_fullsized":"2024-09-13T19:19:12.641235+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:57.476409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"34'10","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.983512+0000","last_change":"2024-09-13T19:16:01.906838+0000","last_active":"2024-09-13T19:16:31.983512+0000","last_peered":"2024-09-13T19:16:31.983512+0000","last_clean":"2024-09-13T19:16:31.983512+0000","last_became_active":"2024-09-13T19:16:01.906490+0000","last_became_peered":"2024-09-13T19:16:01.906490+0000","last_unstale":"2024-09-13T19:16:31.983512+0000","last_undegraded":"2024-09-13T19:16:31.983512+0000","last_fullsized":"2024-09-13T19:16:31.983512+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:37.861718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"36'285","reported_seq":502,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.661231+0000","last_change":"2024-09-13T19:16:03.905840+0000","last_active":"2024-09-13T19:19:12.661231+0000","last_peered":"2024-09-13T19:19:12.661231+0000","last_clean":"2024-09-13T19:19:12.661231+0000","last_became_active":"2024-09-13T19:16:03.905523+0000","last_became_peered":"2024-09-13T19:16:03.905523+0000","last_unstale":"2024-09-13T19:19:12.661231+0000","last_undegraded":"2024-09-13T19:19:12.661231+0000","last_fullsized":"2024-09-13T19:19:12.661231+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:24.576600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"36'4","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:04.643906+0000","last_change":"2024-09-13T19:16:05.910975+0000","last_active":"2024-09-13T19:18:04.643906+0000","last_peered":"2024-09-13T19:18:04.643906+0000","last_clean":"2024-09-13T19:18:04.643906+0000","last_became_active":"2024-09-13T19:16:05.910656+0000","last_became_peered":"2024-09-13T19:16:05.910656+0000","last_unstale":"2024-09-13T19:18:04.643906+0000","last_undegraded":"2024-09-13T19:18:04.643906+0000","last_fullsized":"2024-09-13T19:18:04.643906+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:04:51.033264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"36'3","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:13.941421+0000","last_change":"2024-09-13T19:15:57.904037+0000","last_active":"2024-09-13T19:18:13.941421+0000","last_peered":"2024-09-13T19:18:13.941421+0000","last_clean":"2024-09-13T19:18:13.941421+0000","last_became_active":"2024-09-13T19:15:57.903761+0000","last_became_peered":"2024-09-13T19:15:57.903761+0000","last_unstale":"2024-09-13T19:18:13.941421+0000","last_undegraded":"2024-09-13T19:18:13.941421+0000","last_fullsized":"2024-09-13T19:18:13.941421+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:35:04.649421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.981607+0000","last_change":"2024-09-13T19:15:55.900225+0000","last_active":"2024-09-13T19:16:31.981607+0000","last_peered":"2024-09-13T19:16:31.981607+0000","last_clean":"2024-09-13T19:16:31.981607+0000","last_became_active":"2024-09-13T19:15:55.899919+0000","last_became_peered":"2024-09-13T19:15:55.899919+0000","last_unstale":"2024-09-13T19:16:31.981607+0000","last_undegraded":"2024-09-13T19:16:31.981607+0000","last_fullsized":"2024-09-13T19:16:31.981607+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:05.080518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"36'4","reported_seq":228,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.630685+0000","last_change":"2024-09-13T19:15:59.897278+0000","last_active":"2024-09-13T19:19:12.630685+0000","last_peered":"2024-09-13T19:19:12.630685+0000","last_clean":"2024-09-13T19:19:12.630685+0000","last_became_active":"2024-09-13T19:15:59.896081+0000","last_became_peered":"2024-09-13T19:15:59.896081+0000","last_unstale":"2024-09-13T19:19:12.630685+0000","last_undegraded":"2024-09-13T19:19:12.630685+0000","last_fullsized":"2024-09-13T19:19:12.630685+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:24:49.015447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"36'42","reported_seq":92,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.730856+0000","last_change":"2024-09-13T19:16:01.902853+0000","last_active":"2024-09-13T19:19:12.730856+0000","last_peered":"2024-09-13T19:19:12.730856+0000","last_clean":"2024-09-13T19:19:12.730856+0000","last_became_active":"2024-09-13T19:16:01.902532+0000","last_became_peered":"2024-09-13T19:16:01.902532+0000","last_unstale":"2024-09-13T19:19:12.730856+0000","last_undegraded":"2024-09-13T19:19:12.730856+0000","last_fullsized":"2024-09-13T19:19:12.730856+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:31:43.981533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985458+0000","last_change":"2024-09-13T19:16:03.913346+0000","last_active":"2024-09-13T19:16:31.985458+0000","last_peered":"2024-09-13T19:16:31.985458+0000","last_clean":"2024-09-13T19:16:31.985458+0000","last_became_active":"2024-09-13T19:16:03.913019+0000","last_became_peered":"2024-09-13T19:16:03.913019+0000","last_unstale":"2024-09-13T19:16:31.985458+0000","last_undegraded":"2024-09-13T19:16:31.985458+0000","last_fullsized":"2024-09-13T19:16:31.985458+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:24.528793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"36'8","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.020235+0000","last_change":"2024-09-13T19:16:05.911657+0000","last_active":"2024-09-13T19:19:06.020235+0000","last_peered":"2024-09-13T19:19:06.020235+0000","last_clean":"2024-09-13T19:19:06.020235+0000","last_became_active":"2024-09-13T19:16:05.911364+0000","last_became_peered":"2024-09-13T19:16:05.911364+0000","last_unstale":"2024-09-13T19:19:06.020235+0000","last_undegraded":"2024-09-13T19:19:06.020235+0000","last_fullsized":"2024-09-13T19:19:06.020235+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:04.570906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"36'13","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.969400+0000","last_change":"2024-09-13T19:15:57.901609+0000","last_active":"2024-09-13T19:19:05.969400+0000","last_peered":"2024-09-13T19:19:05.969400+0000","last_clean":"2024-09-13T19:19:05.969400+0000","last_became_active":"2024-09-13T19:15:57.900905+0000","last_became_peered":"2024-09-13T19:15:57.900905+0000","last_unstale":"2024-09-13T19:19:05.969400+0000","last_undegraded":"2024-09-13T19:19:05.969400+0000","last_fullsized":"2024-09-13T19:19:05.969400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:12:06.491226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":205,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.988269+0000","last_change":"2024-09-13T19:15:41.170734+0000","last_active":"2024-09-13T19:16:31.988269+0000","last_peered":"2024-09-13T19:16:31.988269+0000","last_clean":"2024-09-13T19:16:31.988269+0000","last_became_active":"2024-09-13T19:15:41.169707+0000","last_became_peered":"2024-09-13T19:15:41.169707+0000","last_unstale":"2024-09-13T19:16:31.988269+0000","last_undegraded":"2024-09-13T19:16:31.988269+0000","last_fullsized":"2024-09-13T19:16:31.988269+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:39.557965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:39.557965+0000","last_clean_scrub_stamp":"2024-09-13T19:15:39.557965+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:40:20.817136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.982316+0000","last_change":"2024-09-13T19:15:46.580815+0000","last_active":"2024-09-13T19:16:31.982316+0000","last_peered":"2024-09-13T19:16:31.982316+0000","last_clean":"2024-09-13T19:16:31.982316+0000","last_became_active":"2024-09-13T19:15:44.577382+0000","last_became_peered":"2024-09-13T19:15:44.577382+0000","last_unstale":"2024-09-13T19:16:31.982316+0000","last_undegraded":"2024-09-13T19:16:31.982316+0000","last_fullsized":"2024-09-13T19:16:31.982316+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:47.750191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047916199999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.981982+0000","last_change":"2024-09-13T19:15:55.900746+0000","last_active":"2024-09-13T19:16:31.981982+0000","last_peered":"2024-09-13T19:16:31.981982+0000","last_clean":"2024-09-13T19:16:31.981982+0000","last_became_active":"2024-09-13T19:15:55.899672+0000","last_became_peered":"2024-09-13T19:15:55.899672+0000","last_unstale":"2024-09-13T19:16:31.981982+0000","last_undegraded":"2024-09-13T19:16:31.981982+0000","last_fullsized":"2024-09-13T19:16:31.981982+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:57:15.620815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.991398+0000","last_change":"2024-09-13T19:15:59.891901+0000","last_active":"2024-09-13T19:16:31.991398+0000","last_peered":"2024-09-13T19:16:31.991398+0000","last_clean":"2024-09-13T19:16:31.991398+0000","last_became_active":"2024-09-13T19:15:59.891615+0000","last_became_peered":"2024-09-13T19:15:59.891615+0000","last_unstale":"2024-09-13T19:16:31.991398+0000","last_undegraded":"2024-09-13T19:16:31.991398+0000","last_fullsized":"2024-09-13T19:16:31.991398+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:37.130876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"36'85","reported_seq":166,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.764502+0000","last_change":"2024-09-13T19:16:01.905525+0000","last_active":"2024-09-13T19:19:12.764502+0000","last_peered":"2024-09-13T19:19:12.764502+0000","last_clean":"2024-09-13T19:19:12.764502+0000","last_became_active":"2024-09-13T19:16:01.905085+0000","last_became_peered":"2024-09-13T19:16:01.905085+0000","last_unstale":"2024-09-13T19:19:12.764502+0000","last_undegraded":"2024-09-13T19:19:12.764502+0000","last_fullsized":"2024-09-13T19:19:12.764502+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:13:47.049154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:16.937517+0000","last_change":"2024-09-13T19:16:03.914155+0000","last_active":"2024-09-13T19:18:16.937517+0000","last_peered":"2024-09-13T19:18:16.937517+0000","last_clean":"2024-09-13T19:18:16.937517+0000","last_became_active":"2024-09-13T19:16:03.913802+0000","last_became_peered":"2024-09-13T19:16:03.913802+0000","last_unstale":"2024-09-13T19:18:16.937517+0000","last_undegraded":"2024-09-13T19:18:16.937517+0000","last_fullsized":"2024-09-13T19:18:16.937517+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"36'89","reported_seq":187,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.972680+0000","last_change":"2024-09-13T19:16:05.911930+0000","last_active":"2024-09-13T19:19:05.972680+0000","last_peered":"2024-09-13T19:19:05.972680+0000","last_clean":"2024-09-13T19:19:05.972680+0000","last_became_active":"2024-09-13T19:16:05.911595+0000","last_became_peered":"2024-09-13T19:16:05.911595+0000","last_unstale":"2024-09-13T19:19:05.972680+0000","last_undegraded":"2024-09-13T19:19:05.972680+0000","last_fullsized":"2024-09-13T19:19:05.972680+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:14:31.680165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":289,"num_read_kb":269,"num_write":182,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"36'4","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:20.922687+0000","last_change":"2024-09-13T19:15:57.897546+0000","last_active":"2024-09-13T19:17:20.922687+0000","last_peered":"2024-09-13T19:17:20.922687+0000","last_clean":"2024-09-13T19:17:20.922687+0000","last_became_active":"2024-09-13T19:15:57.897307+0000","last_became_peered":"2024-09-13T19:15:57.897307+0000","last_unstale":"2024-09-13T19:17:20.922687+0000","last_undegraded":"2024-09-13T19:17:20.922687+0000","last_fullsized":"2024-09-13T19:17:20.922687+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:49.283391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.981198+0000","last_change":"2024-09-13T19:15:46.581436+0000","last_active":"2024-09-13T19:16:31.981198+0000","last_peered":"2024-09-13T19:16:31.981198+0000","last_clean":"2024-09-13T19:16:31.981198+0000","last_became_active":"2024-09-13T19:15:44.576304+0000","last_became_peered":"2024-09-13T19:15:44.576304+0000","last_unstale":"2024-09-13T19:16:31.981198+0000","last_undegraded":"2024-09-13T19:16:31.981198+0000","last_fullsized":"2024-09-13T19:16:31.981198+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:57.538288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011332060000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:01.934838+0000","last_change":"2024-09-13T19:15:55.891911+0000","last_active":"2024-09-13T19:18:01.934838+0000","last_peered":"2024-09-13T19:18:01.934838+0000","last_clean":"2024-09-13T19:18:01.934838+0000","last_became_active":"2024-09-13T19:15:55.891377+0000","last_became_peered":"2024-09-13T19:15:55.891377+0000","last_unstale":"2024-09-13T19:18:01.934838+0000","last_undegraded":"2024-09-13T19:18:01.934838+0000","last_fullsized":"2024-09-13T19:18:01.934838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985654+0000","last_change":"2024-09-13T19:15:59.896527+0000","last_active":"2024-09-13T19:16:31.985654+0000","last_peered":"2024-09-13T19:16:31.985654+0000","last_clean":"2024-09-13T19:16:31.985654+0000","last_became_active":"2024-09-13T19:15:59.896248+0000","last_became_peered":"2024-09-13T19:15:59.896248+0000","last_unstale":"2024-09-13T19:16:31.985654+0000","last_undegraded":"2024-09-13T19:16:31.985654+0000","last_fullsized":"2024-09-13T19:16:31.985654+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:49.569002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"36'285","reported_seq":501,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.783790+0000","last_change":"2024-09-13T19:16:01.907411+0000","last_active":"2024-09-13T19:19:12.783790+0000","last_peered":"2024-09-13T19:19:12.783790+0000","last_clean":"2024-09-13T19:19:12.783790+0000","last_became_active":"2024-09-13T19:16:01.907024+0000","last_became_peered":"2024-09-13T19:16:01.907024+0000","last_unstale":"2024-09-13T19:19:12.783790+0000","last_undegraded":"2024-09-13T19:19:12.783790+0000","last_fullsized":"2024-09-13T19:19:12.783790+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:22.520942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.982628+0000","last_change":"2024-09-13T19:16:03.916021+0000","last_active":"2024-09-13T19:16:31.982628+0000","last_peered":"2024-09-13T19:16:31.982628+0000","last_clean":"2024-09-13T19:16:31.982628+0000","last_became_active":"2024-09-13T19:16:03.915712+0000","last_became_peered":"2024-09-13T19:16:03.915712+0000","last_unstale":"2024-09-13T19:16:31.982628+0000","last_undegraded":"2024-09-13T19:16:31.982628+0000","last_fullsized":"2024-09-13T19:16:31.982628+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:48.381454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"36'3","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:20.742805+0000","last_change":"2024-09-13T19:16:05.917279+0000","last_active":"2024-09-13T19:17:20.742805+0000","last_peered":"2024-09-13T19:17:20.742805+0000","last_clean":"2024-09-13T19:17:20.742805+0000","last_became_active":"2024-09-13T19:16:05.916999+0000","last_became_peered":"2024-09-13T19:16:05.916999+0000","last_unstale":"2024-09-13T19:17:20.742805+0000","last_undegraded":"2024-09-13T19:17:20.742805+0000","last_fullsized":"2024-09-13T19:17:20.742805+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:56:17.231660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:06.935978+0000","last_change":"2024-09-13T19:15:57.890320+0000","last_active":"2024-09-13T19:18:06.935978+0000","last_peered":"2024-09-13T19:18:06.935978+0000","last_clean":"2024-09-13T19:18:06.935978+0000","last_became_active":"2024-09-13T19:15:57.889885+0000","last_became_peered":"2024-09-13T19:15:57.889885+0000","last_unstale":"2024-09-13T19:18:06.935978+0000","last_undegraded":"2024-09-13T19:18:06.935978+0000","last_fullsized":"2024-09-13T19:18:06.935978+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.983888+0000","last_change":"2024-09-13T19:15:47.256565+0000","last_active":"2024-09-13T19:16:31.983888+0000","last_peered":"2024-09-13T19:16:31.983888+0000","last_clean":"2024-09-13T19:16:31.983888+0000","last_became_active":"2024-09-13T19:15:44.575483+0000","last_became_peered":"2024-09-13T19:15:44.575483+0000","last_unstale":"2024-09-13T19:16:31.983888+0000","last_undegraded":"2024-09-13T19:16:31.983888+0000","last_fullsized":"2024-09-13T19:16:31.983888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:05:11.992289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036796000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"36'6","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:56.934064+0000","last_change":"2024-09-13T19:15:55.892997+0000","last_active":"2024-09-13T19:17:56.934064+0000","last_peered":"2024-09-13T19:17:56.934064+0000","last_clean":"2024-09-13T19:17:56.934064+0000","last_became_active":"2024-09-13T19:15:55.892629+0000","last_became_peered":"2024-09-13T19:15:55.892629+0000","last_unstale":"2024-09-13T19:17:56.934064+0000","last_undegraded":"2024-09-13T19:17:56.934064+0000","last_fullsized":"2024-09-13T19:17:56.934064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"27'1","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.986613+0000","last_change":"2024-09-13T19:15:59.892045+0000","last_active":"2024-09-13T19:16:31.986613+0000","last_peered":"2024-09-13T19:16:31.986613+0000","last_clean":"2024-09-13T19:16:31.986613+0000","last_became_active":"2024-09-13T19:15:59.891588+0000","last_became_peered":"2024-09-13T19:15:59.891588+0000","last_unstale":"2024-09-13T19:16:31.986613+0000","last_undegraded":"2024-09-13T19:16:31.986613+0000","last_fullsized":"2024-09-13T19:16:31.986613+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:31:11.012170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'16","reported_seq":84,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:04.973539+0000","last_change":"2024-09-13T19:16:01.904560+0000","last_active":"2024-09-13T19:19:04.973539+0000","last_peered":"2024-09-13T19:19:04.973539+0000","last_clean":"2024-09-13T19:19:04.973539+0000","last_became_active":"2024-09-13T19:16:01.903947+0000","last_became_peered":"2024-09-13T19:16:01.903947+0000","last_unstale":"2024-09-13T19:19:04.973539+0000","last_undegraded":"2024-09-13T19:19:04.973539+0000","last_fullsized":"2024-09-13T19:19:04.973539+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:50.008512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:11.936721+0000","last_change":"2024-09-13T19:16:03.911563+0000","last_active":"2024-09-13T19:18:11.936721+0000","last_peered":"2024-09-13T19:18:11.936721+0000","last_clean":"2024-09-13T19:18:11.936721+0000","last_became_active":"2024-09-13T19:16:03.910776+0000","last_became_peered":"2024-09-13T19:16:03.910776+0000","last_unstale":"2024-09-13T19:18:11.936721+0000","last_undegraded":"2024-09-13T19:18:11.936721+0000","last_fullsized":"2024-09-13T19:18:11.936721+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"36'2","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.612807+0000","last_change":"2024-09-13T19:16:05.920464+0000","last_active":"2024-09-13T19:19:05.612807+0000","last_peered":"2024-09-13T19:19:05.612807+0000","last_clean":"2024-09-13T19:19:05.612807+0000","last_became_active":"2024-09-13T19:16:05.920191+0000","last_became_peered":"2024-09-13T19:16:05.920191+0000","last_unstale":"2024-09-13T19:19:05.612807+0000","last_undegraded":"2024-09-13T19:19:05.612807+0000","last_fullsized":"2024-09-13T19:19:05.612807+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:52:02.982809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"36'12","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:05.011579+0000","last_change":"2024-09-13T19:15:57.886935+0000","last_active":"2024-09-13T19:18:05.011579+0000","last_peered":"2024-09-13T19:18:05.011579+0000","last_clean":"2024-09-13T19:18:05.011579+0000","last_became_active":"2024-09-13T19:15:57.886273+0000","last_became_peered":"2024-09-13T19:15:57.886273+0000","last_unstale":"2024-09-13T19:18:05.011579+0000","last_undegraded":"2024-09-13T19:18:05.011579+0000","last_fullsized":"2024-09-13T19:18:05.011579+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":44,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.981722+0000","last_change":"2024-09-13T19:15:46.581526+0000","last_active":"2024-09-13T19:16:31.981722+0000","last_peered":"2024-09-13T19:16:31.981722+0000","last_clean":"2024-09-13T19:16:31.981722+0000","last_became_active":"2024-09-13T19:15:44.576052+0000","last_became_peered":"2024-09-13T19:15:44.576052+0000","last_unstale":"2024-09-13T19:16:31.981722+0000","last_undegraded":"2024-09-13T19:16:31.981722+0000","last_fullsized":"2024-09-13T19:16:31.981722+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:33.633045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012221599999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.824572+0000","last_change":"2024-09-13T19:15:55.892933+0000","last_active":"2024-09-13T19:19:05.824572+0000","last_peered":"2024-09-13T19:19:05.824572+0000","last_clean":"2024-09-13T19:19:05.824572+0000","last_became_active":"2024-09-13T19:15:55.892636+0000","last_became_peered":"2024-09-13T19:15:55.892636+0000","last_unstale":"2024-09-13T19:19:05.824572+0000","last_undegraded":"2024-09-13T19:19:05.824572+0000","last_fullsized":"2024-09-13T19:19:05.824572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:50:15.856299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:06.935838+0000","last_change":"2024-09-13T19:15:59.896602+0000","last_active":"2024-09-13T19:18:06.935838+0000","last_peered":"2024-09-13T19:18:06.935838+0000","last_clean":"2024-09-13T19:18:06.935838+0000","last_became_active":"2024-09-13T19:15:59.896248+0000","last_became_peered":"2024-09-13T19:15:59.896248+0000","last_unstale":"2024-09-13T19:18:06.935838+0000","last_undegraded":"2024-09-13T19:18:06.935838+0000","last_fullsized":"2024-09-13T19:18:06.935838+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'13","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.032597+0000","last_change":"2024-09-13T19:16:01.905842+0000","last_active":"2024-09-13T19:19:05.032597+0000","last_peered":"2024-09-13T19:19:05.032597+0000","last_clean":"2024-09-13T19:19:05.032597+0000","last_became_active":"2024-09-13T19:16:01.905280+0000","last_became_peered":"2024-09-13T19:16:01.905280+0000","last_unstale":"2024-09-13T19:19:05.032597+0000","last_undegraded":"2024-09-13T19:19:05.032597+0000","last_fullsized":"2024-09-13T19:19:05.032597+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:18:18.978521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984723+0000","last_change":"2024-09-13T19:16:03.916612+0000","last_active":"2024-09-13T19:16:31.984723+0000","last_peered":"2024-09-13T19:16:31.984723+0000","last_clean":"2024-09-13T19:16:31.984723+0000","last_became_active":"2024-09-13T19:16:03.916344+0000","last_became_peered":"2024-09-13T19:16:03.916344+0000","last_unstale":"2024-09-13T19:16:31.984723+0000","last_undegraded":"2024-09-13T19:16:31.984723+0000","last_fullsized":"2024-09-13T19:16:31.984723+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:58.688605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"36'4","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:04.590724+0000","last_change":"2024-09-13T19:16:05.919765+0000","last_active":"2024-09-13T19:18:04.590724+0000","last_peered":"2024-09-13T19:18:04.590724+0000","last_clean":"2024-09-13T19:18:04.590724+0000","last_became_active":"2024-09-13T19:16:05.919156+0000","last_became_peered":"2024-09-13T19:16:05.919156+0000","last_unstale":"2024-09-13T19:18:04.590724+0000","last_undegraded":"2024-09-13T19:18:04.590724+0000","last_fullsized":"2024-09-13T19:18:04.590724+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:55.590810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"36'18","reported_seq":69,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:05.012582+0000","last_change":"2024-09-13T19:15:57.903146+0000","last_active":"2024-09-13T19:18:05.012582+0000","last_peered":"2024-09-13T19:18:05.012582+0000","last_clean":"2024-09-13T19:18:05.012582+0000","last_became_active":"2024-09-13T19:15:57.902819+0000","last_became_peered":"2024-09-13T19:15:57.902819+0000","last_unstale":"2024-09-13T19:18:05.012582+0000","last_undegraded":"2024-09-13T19:18:05.012582+0000","last_fullsized":"2024-09-13T19:18:05.012582+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:50.793368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":50,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.986102+0000","last_change":"2024-09-13T19:15:55.893781+0000","last_active":"2024-09-13T19:16:31.986102+0000","last_peered":"2024-09-13T19:16:31.986102+0000","last_clean":"2024-09-13T19:16:31.986102+0000","last_became_active":"2024-09-13T19:15:55.893468+0000","last_became_peered":"2024-09-13T19:15:55.893468+0000","last_unstale":"2024-09-13T19:16:31.986102+0000","last_undegraded":"2024-09-13T19:16:31.986102+0000","last_fullsized":"2024-09-13T19:16:31.986102+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:06:44.577134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:51.933308+0000","last_change":"2024-09-13T19:15:46.583117+0000","last_active":"2024-09-13T19:17:51.933308+0000","last_peered":"2024-09-13T19:17:51.933308+0000","last_clean":"2024-09-13T19:17:51.933308+0000","last_became_active":"2024-09-13T19:15:44.575726+0000","last_became_peered":"2024-09-13T19:15:44.575726+0000","last_unstale":"2024-09-13T19:17:51.933308+0000","last_undegraded":"2024-09-13T19:17:51.933308+0000","last_fullsized":"2024-09-13T19:17:51.933308+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041430200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"36'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.240759+0000","last_change":"2024-09-13T19:16:31.990974+0000","last_active":"2024-09-13T19:19:06.240759+0000","last_peered":"2024-09-13T19:19:06.240759+0000","last_clean":"2024-09-13T19:19:06.240759+0000","last_became_active":"2024-09-13T19:16:31.990669+0000","last_became_peered":"2024-09-13T19:16:31.990669+0000","last_unstale":"2024-09-13T19:19:06.240759+0000","last_undegraded":"2024-09-13T19:19:06.240759+0000","last_fullsized":"2024-09-13T19:19:06.240759+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:49:36.858038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"36'67","reported_seq":135,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.768787+0000","last_change":"2024-09-13T19:16:01.902406+0000","last_active":"2024-09-13T19:19:12.768787+0000","last_peered":"2024-09-13T19:19:12.768787+0000","last_clean":"2024-09-13T19:19:12.768787+0000","last_became_active":"2024-09-13T19:16:01.902095+0000","last_became_peered":"2024-09-13T19:16:01.902095+0000","last_unstale":"2024-09-13T19:19:12.768787+0000","last_undegraded":"2024-09-13T19:19:12.768787+0000","last_fullsized":"2024-09-13T19:19:12.768787+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.986023+0000","last_change":"2024-09-13T19:16:03.910134+0000","last_active":"2024-09-13T19:16:31.986023+0000","last_peered":"2024-09-13T19:16:31.986023+0000","last_clean":"2024-09-13T19:16:31.986023+0000","last_became_active":"2024-09-13T19:16:03.909803+0000","last_became_peered":"2024-09-13T19:16:03.909803+0000","last_unstale":"2024-09-13T19:16:31.986023+0000","last_undegraded":"2024-09-13T19:16:31.986023+0000","last_fullsized":"2024-09-13T19:16:31.986023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:14:02.210649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"36'11","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:21.938395+0000","last_change":"2024-09-13T19:16:05.915976+0000","last_active":"2024-09-13T19:18:21.938395+0000","last_peered":"2024-09-13T19:18:21.938395+0000","last_clean":"2024-09-13T19:18:21.938395+0000","last_became_active":"2024-09-13T19:16:05.915672+0000","last_became_peered":"2024-09-13T19:16:05.915672+0000","last_unstale":"2024-09-13T19:18:21.938395+0000","last_undegraded":"2024-09-13T19:18:21.938395+0000","last_fullsized":"2024-09-13T19:18:21.938395+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"36'10","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:05.005754+0000","last_change":"2024-09-13T19:15:57.903282+0000","last_active":"2024-09-13T19:18:05.005754+0000","last_peered":"2024-09-13T19:18:05.005754+0000","last_clean":"2024-09-13T19:18:05.005754+0000","last_became_active":"2024-09-13T19:15:57.902793+0000","last_became_peered":"2024-09-13T19:15:57.902793+0000","last_unstale":"2024-09-13T19:18:05.005754+0000","last_undegraded":"2024-09-13T19:18:05.005754+0000","last_fullsized":"2024-09-13T19:18:05.005754+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:43:25.003517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:01.934939+0000","last_change":"2024-09-13T19:15:55.895728+0000","last_active":"2024-09-13T19:18:01.934939+0000","last_peered":"2024-09-13T19:18:01.934939+0000","last_clean":"2024-09-13T19:18:01.934939+0000","last_became_active":"2024-09-13T19:15:55.894340+0000","last_became_peered":"2024-09-13T19:15:55.894340+0000","last_unstale":"2024-09-13T19:18:01.934939+0000","last_undegraded":"2024-09-13T19:18:01.934939+0000","last_fullsized":"2024-09-13T19:18:01.934939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984808+0000","last_change":"2024-09-13T19:15:46.581685+0000","last_active":"2024-09-13T19:16:31.984808+0000","last_peered":"2024-09-13T19:16:31.984808+0000","last_clean":"2024-09-13T19:16:31.984808+0000","last_became_active":"2024-09-13T19:15:44.576006+0000","last_became_peered":"2024-09-13T19:15:44.576006+0000","last_unstale":"2024-09-13T19:16:31.984808+0000","last_undegraded":"2024-09-13T19:16:31.984808+0000","last_fullsized":"2024-09-13T19:16:31.984808+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:52:37.043288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013309299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.981613+0000","last_change":"2024-09-13T19:15:59.895062+0000","last_active":"2024-09-13T19:16:31.981613+0000","last_peered":"2024-09-13T19:16:31.981613+0000","last_clean":"2024-09-13T19:16:31.981613+0000","last_became_active":"2024-09-13T19:15:59.894761+0000","last_became_peered":"2024-09-13T19:15:59.894761+0000","last_unstale":"2024-09-13T19:16:31.981613+0000","last_undegraded":"2024-09-13T19:16:31.981613+0000","last_fullsized":"2024-09-13T19:16:31.981613+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:04.423400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'14","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.990533+0000","last_change":"2024-09-13T19:16:01.907701+0000","last_active":"2024-09-13T19:16:31.990533+0000","last_peered":"2024-09-13T19:16:31.990533+0000","last_clean":"2024-09-13T19:16:31.990533+0000","last_became_active":"2024-09-13T19:16:01.907419+0000","last_became_peered":"2024-09-13T19:16:01.907419+0000","last_unstale":"2024-09-13T19:16:31.990533+0000","last_undegraded":"2024-09-13T19:16:31.990533+0000","last_fullsized":"2024-09-13T19:16:31.990533+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:12:10.504205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"36'285","reported_seq":349,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.657369+0000","last_change":"2024-09-13T19:16:03.908228+0000","last_active":"2024-09-13T19:19:12.657369+0000","last_peered":"2024-09-13T19:19:12.657369+0000","last_clean":"2024-09-13T19:19:12.657369+0000","last_became_active":"2024-09-13T19:16:03.907957+0000","last_became_peered":"2024-09-13T19:16:03.907957+0000","last_unstale":"2024-09-13T19:19:12.657369+0000","last_undegraded":"2024-09-13T19:19:12.657369+0000","last_fullsized":"2024-09-13T19:19:12.657369+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:35.448179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"34'2","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.983260+0000","last_change":"2024-09-13T19:16:05.924834+0000","last_active":"2024-09-13T19:16:31.983260+0000","last_peered":"2024-09-13T19:16:31.983260+0000","last_clean":"2024-09-13T19:16:31.983260+0000","last_became_active":"2024-09-13T19:16:05.924162+0000","last_became_peered":"2024-09-13T19:16:05.924162+0000","last_unstale":"2024-09-13T19:16:31.983260+0000","last_undegraded":"2024-09-13T19:16:31.983260+0000","last_fullsized":"2024-09-13T19:16:31.983260+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:00.770168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"36'6","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.969496+0000","last_change":"2024-09-13T19:15:57.897089+0000","last_active":"2024-09-13T19:19:05.969496+0000","last_peered":"2024-09-13T19:19:05.969496+0000","last_clean":"2024-09-13T19:19:05.969496+0000","last_became_active":"2024-09-13T19:15:57.896078+0000","last_became_peered":"2024-09-13T19:15:57.896078+0000","last_unstale":"2024-09-13T19:19:05.969496+0000","last_undegraded":"2024-09-13T19:19:05.969496+0000","last_fullsized":"2024-09-13T19:19:05.969496+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:10.200427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985502+0000","last_change":"2024-09-13T19:15:55.895594+0000","last_active":"2024-09-13T19:16:31.985502+0000","last_peered":"2024-09-13T19:16:31.985502+0000","last_clean":"2024-09-13T19:16:31.985502+0000","last_became_active":"2024-09-13T19:15:55.895282+0000","last_became_peered":"2024-09-13T19:15:55.895282+0000","last_unstale":"2024-09-13T19:16:31.985502+0000","last_undegraded":"2024-09-13T19:16:31.985502+0000","last_fullsized":"2024-09-13T19:16:31.985502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:13.182770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:56.934172+0000","last_change":"2024-09-13T19:15:46.583177+0000","last_active":"2024-09-13T19:17:56.934172+0000","last_peered":"2024-09-13T19:17:56.934172+0000","last_clean":"2024-09-13T19:17:56.934172+0000","last_became_active":"2024-09-13T19:15:44.574967+0000","last_became_peered":"2024-09-13T19:15:44.574967+0000","last_unstale":"2024-09-13T19:17:56.934172+0000","last_undegraded":"2024-09-13T19:17:56.934172+0000","last_fullsized":"2024-09-13T19:17:56.934172+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049330999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"27'1","reported_seq":220,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.631380+0000","last_change":"2024-09-13T19:15:59.895363+0000","last_active":"2024-09-13T19:19:12.631380+0000","last_peered":"2024-09-13T19:19:12.631380+0000","last_clean":"2024-09-13T19:19:12.631380+0000","last_became_active":"2024-09-13T19:15:59.894966+0000","last_became_peered":"2024-09-13T19:15:59.894966+0000","last_unstale":"2024-09-13T19:19:12.631380+0000","last_undegraded":"2024-09-13T19:19:12.631380+0000","last_fullsized":"2024-09-13T19:19:12.631380+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:45.317531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"36'11","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:20.925826+0000","last_change":"2024-09-13T19:16:01.903652+0000","last_active":"2024-09-13T19:17:20.925826+0000","last_peered":"2024-09-13T19:17:20.925826+0000","last_clean":"2024-09-13T19:17:20.925826+0000","last_became_active":"2024-09-13T19:16:01.902739+0000","last_became_peered":"2024-09-13T19:16:01.902739+0000","last_unstale":"2024-09-13T19:17:20.925826+0000","last_undegraded":"2024-09-13T19:17:20.925826+0000","last_fullsized":"2024-09-13T19:17:20.925826+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:51:13.428618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"36'285","reported_seq":421,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.824114+0000","last_change":"2024-09-13T19:16:03.909318+0000","last_active":"2024-09-13T19:19:12.824114+0000","last_peered":"2024-09-13T19:19:12.824114+0000","last_clean":"2024-09-13T19:19:12.824114+0000","last_became_active":"2024-09-13T19:16:03.909038+0000","last_became_peered":"2024-09-13T19:16:03.909038+0000","last_unstale":"2024-09-13T19:19:12.824114+0000","last_undegraded":"2024-09-13T19:19:12.824114+0000","last_fullsized":"2024-09-13T19:19:12.824114+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'3","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.990000+0000","last_change":"2024-09-13T19:16:05.924059+0000","last_active":"2024-09-13T19:16:31.990000+0000","last_peered":"2024-09-13T19:16:31.990000+0000","last_clean":"2024-09-13T19:16:31.990000+0000","last_became_active":"2024-09-13T19:16:05.923739+0000","last_became_peered":"2024-09-13T19:16:05.923739+0000","last_unstale":"2024-09-13T19:16:31.990000+0000","last_undegraded":"2024-09-13T19:16:31.990000+0000","last_fullsized":"2024-09-13T19:16:31.990000+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:49.018736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"36'6","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.962120+0000","last_change":"2024-09-13T19:15:57.897999+0000","last_active":"2024-09-13T19:19:05.962120+0000","last_peered":"2024-09-13T19:19:05.962120+0000","last_clean":"2024-09-13T19:19:05.962120+0000","last_became_active":"2024-09-13T19:15:57.897727+0000","last_became_peered":"2024-09-13T19:15:57.897727+0000","last_unstale":"2024-09-13T19:19:05.962120+0000","last_undegraded":"2024-09-13T19:19:05.962120+0000","last_fullsized":"2024-09-13T19:19:05.962120+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:38.843461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.989964+0000","last_change":"2024-09-13T19:15:55.895727+0000","last_active":"2024-09-13T19:16:31.989964+0000","last_peered":"2024-09-13T19:16:31.989964+0000","last_clean":"2024-09-13T19:16:31.989964+0000","last_became_active":"2024-09-13T19:15:55.895394+0000","last_became_peered":"2024-09-13T19:15:55.895394+0000","last_unstale":"2024-09-13T19:16:31.989964+0000","last_undegraded":"2024-09-13T19:16:31.989964+0000","last_fullsized":"2024-09-13T19:16:31.989964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:06:25.645854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984574+0000","last_change":"2024-09-13T19:15:46.581172+0000","last_active":"2024-09-13T19:16:31.984574+0000","last_peered":"2024-09-13T19:16:31.984574+0000","last_clean":"2024-09-13T19:16:31.984574+0000","last_became_active":"2024-09-13T19:15:44.607248+0000","last_became_peered":"2024-09-13T19:15:44.607248+0000","last_unstale":"2024-09-13T19:16:31.984574+0000","last_undegraded":"2024-09-13T19:16:31.984574+0000","last_fullsized":"2024-09-13T19:16:31.984574+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:09:50.029342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086245899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.994102+0000","last_change":"2024-09-13T19:16:31.993085+0000","last_active":"2024-09-13T19:16:31.994102+0000","last_peered":"2024-09-13T19:16:31.994102+0000","last_clean":"2024-09-13T19:16:31.994102+0000","last_became_active":"2024-09-13T19:16:31.992752+0000","last_became_peered":"2024-09-13T19:16:31.992752+0000","last_unstale":"2024-09-13T19:16:31.994102+0000","last_undegraded":"2024-09-13T19:16:31.994102+0000","last_fullsized":"2024-09-13T19:16:31.994102+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:31:25.664984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"36'93","reported_seq":177,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.785686+0000","last_change":"2024-09-13T19:16:01.906627+0000","last_active":"2024-09-13T19:19:12.785686+0000","last_peered":"2024-09-13T19:19:12.785686+0000","last_clean":"2024-09-13T19:19:12.785686+0000","last_became_active":"2024-09-13T19:16:01.906317+0000","last_became_peered":"2024-09-13T19:16:01.906317+0000","last_unstale":"2024-09-13T19:19:12.785686+0000","last_undegraded":"2024-09-13T19:19:12.785686+0000","last_fullsized":"2024-09-13T19:19:12.785686+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:31.838003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":99,"num_read_kb":103,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:11.936671+0000","last_change":"2024-09-13T19:16:03.910414+0000","last_active":"2024-09-13T19:18:11.936671+0000","last_peered":"2024-09-13T19:18:11.936671+0000","last_clean":"2024-09-13T19:18:11.936671+0000","last_became_active":"2024-09-13T19:16:03.909941+0000","last_became_peered":"2024-09-13T19:16:03.909941+0000","last_unstale":"2024-09-13T19:18:11.936671+0000","last_undegraded":"2024-09-13T19:18:11.936671+0000","last_fullsized":"2024-09-13T19:18:11.936671+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.989013+0000","last_change":"2024-09-13T19:16:05.911849+0000","last_active":"2024-09-13T19:16:31.989013+0000","last_peered":"2024-09-13T19:16:31.989013+0000","last_clean":"2024-09-13T19:16:31.989013+0000","last_became_active":"2024-09-13T19:16:05.911465+0000","last_became_peered":"2024-09-13T19:16:05.911465+0000","last_unstale":"2024-09-13T19:16:31.989013+0000","last_undegraded":"2024-09-13T19:16:31.989013+0000","last_fullsized":"2024-09-13T19:16:31.989013+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:53:28.959608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985196+0000","last_change":"2024-09-13T19:16:05.917443+0000","last_active":"2024-09-13T19:16:31.985196+0000","last_peered":"2024-09-13T19:16:31.985196+0000","last_clean":"2024-09-13T19:16:31.985196+0000","last_became_active":"2024-09-13T19:16:05.917156+0000","last_became_peered":"2024-09-13T19:16:05.917156+0000","last_unstale":"2024-09-13T19:16:31.985196+0000","last_undegraded":"2024-09-13T19:16:31.985196+0000","last_fullsized":"2024-09-13T19:16:31.985196+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:54:47.314314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"36'8","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.700214+0000","last_change":"2024-09-13T19:15:57.899020+0000","last_active":"2024-09-13T19:19:05.700214+0000","last_peered":"2024-09-13T19:19:05.700214+0000","last_clean":"2024-09-13T19:19:05.700214+0000","last_became_active":"2024-09-13T19:15:57.898761+0000","last_became_peered":"2024-09-13T19:15:57.898761+0000","last_unstale":"2024-09-13T19:19:05.700214+0000","last_undegraded":"2024-09-13T19:19:05.700214+0000","last_fullsized":"2024-09-13T19:19:05.700214+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:01:19.857155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.982961+0000","last_change":"2024-09-13T19:15:55.898265+0000","last_active":"2024-09-13T19:16:31.982961+0000","last_peered":"2024-09-13T19:16:31.982961+0000","last_clean":"2024-09-13T19:16:31.982961+0000","last_became_active":"2024-09-13T19:15:55.892518+0000","last_became_peered":"2024-09-13T19:15:55.892518+0000","last_unstale":"2024-09-13T19:16:31.982961+0000","last_undegraded":"2024-09-13T19:16:31.982961+0000","last_fullsized":"2024-09-13T19:16:31.982961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:48.786786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.991243+0000","last_change":"2024-09-13T19:15:59.894006+0000","last_active":"2024-09-13T19:16:31.991243+0000","last_peered":"2024-09-13T19:16:31.991243+0000","last_clean":"2024-09-13T19:16:31.991243+0000","last_became_active":"2024-09-13T19:15:59.892690+0000","last_became_peered":"2024-09-13T19:15:59.892690+0000","last_unstale":"2024-09-13T19:16:31.991243+0000","last_undegraded":"2024-09-13T19:16:31.991243+0000","last_fullsized":"2024-09-13T19:16:31.991243+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:09.953397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"36'36","reported_seq":83,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.743210+0000","last_change":"2024-09-13T19:16:01.904994+0000","last_active":"2024-09-13T19:19:12.743210+0000","last_peered":"2024-09-13T19:19:12.743210+0000","last_clean":"2024-09-13T19:19:12.743210+0000","last_became_active":"2024-09-13T19:16:01.904684+0000","last_became_peered":"2024-09-13T19:16:01.904684+0000","last_unstale":"2024-09-13T19:19:12.743210+0000","last_undegraded":"2024-09-13T19:19:12.743210+0000","last_fullsized":"2024-09-13T19:19:12.743210+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:07.994368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.982387+0000","last_change":"2024-09-13T19:16:03.912531+0000","last_active":"2024-09-13T19:16:31.982387+0000","last_peered":"2024-09-13T19:16:31.982387+0000","last_clean":"2024-09-13T19:16:31.982387+0000","last_became_active":"2024-09-13T19:16:03.912244+0000","last_became_peered":"2024-09-13T19:16:03.912244+0000","last_unstale":"2024-09-13T19:16:31.982387+0000","last_undegraded":"2024-09-13T19:16:31.982387+0000","last_fullsized":"2024-09-13T19:16:31.982387+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:47:14.892797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"36'3","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:06.935876+0000","last_change":"2024-09-13T19:16:05.921280+0000","last_active":"2024-09-13T19:18:06.935876+0000","last_peered":"2024-09-13T19:18:06.935876+0000","last_clean":"2024-09-13T19:18:06.935876+0000","last_became_active":"2024-09-13T19:16:05.920951+0000","last_became_peered":"2024-09-13T19:16:05.920951+0000","last_unstale":"2024-09-13T19:18:06.935876+0000","last_undegraded":"2024-09-13T19:18:06.935876+0000","last_fullsized":"2024-09-13T19:18:06.935876+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"36'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.592256+0000","last_change":"2024-09-13T19:15:57.902138+0000","last_active":"2024-09-13T19:19:05.592256+0000","last_peered":"2024-09-13T19:19:05.592256+0000","last_clean":"2024-09-13T19:19:05.592256+0000","last_became_active":"2024-09-13T19:15:57.901732+0000","last_became_peered":"2024-09-13T19:15:57.901732+0000","last_unstale":"2024-09-13T19:19:05.592256+0000","last_undegraded":"2024-09-13T19:19:05.592256+0000","last_fullsized":"2024-09-13T19:19:05.592256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:23.440843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"36'4","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:38.357818+0000","last_change":"2024-09-13T19:15:55.894585+0000","last_active":"2024-09-13T19:16:38.357818+0000","last_peered":"2024-09-13T19:16:38.357818+0000","last_clean":"2024-09-13T19:16:38.357818+0000","last_became_active":"2024-09-13T19:15:55.894279+0000","last_became_peered":"2024-09-13T19:15:55.894279+0000","last_unstale":"2024-09-13T19:16:38.357818+0000","last_undegraded":"2024-09-13T19:16:38.357818+0000","last_fullsized":"2024-09-13T19:16:38.357818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:37.997344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.982888+0000","last_change":"2024-09-13T19:15:59.895645+0000","last_active":"2024-09-13T19:16:31.982888+0000","last_peered":"2024-09-13T19:16:31.982888+0000","last_clean":"2024-09-13T19:16:31.982888+0000","last_became_active":"2024-09-13T19:15:59.895325+0000","last_became_peered":"2024-09-13T19:15:59.895325+0000","last_unstale":"2024-09-13T19:16:31.982888+0000","last_undegraded":"2024-09-13T19:16:31.982888+0000","last_fullsized":"2024-09-13T19:16:31.982888+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:17.756694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"36'5","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.061054+0000","last_change":"2024-09-13T19:16:01.901632+0000","last_active":"2024-09-13T19:19:05.061054+0000","last_peered":"2024-09-13T19:19:05.061054+0000","last_clean":"2024-09-13T19:19:05.061054+0000","last_became_active":"2024-09-13T19:16:01.901250+0000","last_became_peered":"2024-09-13T19:16:01.901250+0000","last_unstale":"2024-09-13T19:19:05.061054+0000","last_undegraded":"2024-09-13T19:19:05.061054+0000","last_fullsized":"2024-09-13T19:19:05.061054+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984245+0000","last_change":"2024-09-13T19:16:03.913428+0000","last_active":"2024-09-13T19:16:31.984245+0000","last_peered":"2024-09-13T19:16:31.984245+0000","last_clean":"2024-09-13T19:16:31.984245+0000","last_became_active":"2024-09-13T19:16:03.913053+0000","last_became_peered":"2024-09-13T19:16:03.913053+0000","last_unstale":"2024-09-13T19:16:31.984245+0000","last_undegraded":"2024-09-13T19:16:31.984245+0000","last_fullsized":"2024-09-13T19:16:31.984245+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:16.591819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"36'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.710033+0000","last_change":"2024-09-13T19:16:05.912786+0000","last_active":"2024-09-13T19:19:05.710033+0000","last_peered":"2024-09-13T19:19:05.710033+0000","last_clean":"2024-09-13T19:19:05.710033+0000","last_became_active":"2024-09-13T19:16:05.912428+0000","last_became_peered":"2024-09-13T19:16:05.912428+0000","last_unstale":"2024-09-13T19:19:05.710033+0000","last_undegraded":"2024-09-13T19:19:05.710033+0000","last_fullsized":"2024-09-13T19:19:05.710033+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"36'7","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.064847+0000","last_change":"2024-09-13T19:15:57.896825+0000","last_active":"2024-09-13T19:19:06.064847+0000","last_peered":"2024-09-13T19:19:06.064847+0000","last_clean":"2024-09-13T19:19:06.064847+0000","last_became_active":"2024-09-13T19:15:57.896463+0000","last_became_peered":"2024-09-13T19:15:57.896463+0000","last_unstale":"2024-09-13T19:19:06.064847+0000","last_undegraded":"2024-09-13T19:19:06.064847+0000","last_fullsized":"2024-09-13T19:19:06.064847+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"36'2","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:37.182663+0000","last_change":"2024-09-13T19:15:55.888440+0000","last_active":"2024-09-13T19:16:37.182663+0000","last_peered":"2024-09-13T19:16:37.182663+0000","last_clean":"2024-09-13T19:16:37.182663+0000","last_became_active":"2024-09-13T19:15:55.888108+0000","last_became_peered":"2024-09-13T19:15:55.888108+0000","last_unstale":"2024-09-13T19:16:37.182663+0000","last_undegraded":"2024-09-13T19:16:37.182663+0000","last_fullsized":"2024-09-13T19:16:37.182663+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:04:11.428321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985263+0000","last_change":"2024-09-13T19:15:59.893154+0000","last_active":"2024-09-13T19:16:31.985263+0000","last_peered":"2024-09-13T19:16:31.985263+0000","last_clean":"2024-09-13T19:16:31.985263+0000","last_became_active":"2024-09-13T19:15:59.892842+0000","last_became_peered":"2024-09-13T19:15:59.892842+0000","last_unstale":"2024-09-13T19:16:31.985263+0000","last_undegraded":"2024-09-13T19:16:31.985263+0000","last_fullsized":"2024-09-13T19:16:31.985263+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:16.726485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"36'44","reported_seq":108,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.710107+0000","last_change":"2024-09-13T19:16:01.903266+0000","last_active":"2024-09-13T19:19:12.710107+0000","last_peered":"2024-09-13T19:19:12.710107+0000","last_clean":"2024-09-13T19:19:12.710107+0000","last_became_active":"2024-09-13T19:16:01.902991+0000","last_became_peered":"2024-09-13T19:16:01.902991+0000","last_unstale":"2024-09-13T19:19:12.710107+0000","last_undegraded":"2024-09-13T19:19:12.710107+0000","last_fullsized":"2024-09-13T19:19:12.710107+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.988447+0000","last_change":"2024-09-13T19:16:03.912257+0000","last_active":"2024-09-13T19:16:31.988447+0000","last_peered":"2024-09-13T19:16:31.988447+0000","last_clean":"2024-09-13T19:16:31.988447+0000","last_became_active":"2024-09-13T19:16:03.911917+0000","last_became_peered":"2024-09-13T19:16:03.911917+0000","last_unstale":"2024-09-13T19:16:31.988447+0000","last_undegraded":"2024-09-13T19:16:31.988447+0000","last_fullsized":"2024-09-13T19:16:31.988447+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:23.564311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"36'4","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:01.380390+0000","last_change":"2024-09-13T19:16:05.924382+0000","last_active":"2024-09-13T19:18:01.380390+0000","last_peered":"2024-09-13T19:18:01.380390+0000","last_clean":"2024-09-13T19:18:01.380390+0000","last_became_active":"2024-09-13T19:16:05.923368+0000","last_became_peered":"2024-09-13T19:16:05.923368+0000","last_unstale":"2024-09-13T19:18:01.380390+0000","last_undegraded":"2024-09-13T19:18:01.380390+0000","last_fullsized":"2024-09-13T19:18:01.380390+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:03.139035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"36'16","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.842276+0000","last_change":"2024-09-13T19:16:31.999453+0000","last_active":"2024-09-13T19:19:05.842276+0000","last_peered":"2024-09-13T19:19:05.842276+0000","last_clean":"2024-09-13T19:19:05.842276+0000","last_became_active":"2024-09-13T19:16:31.991993+0000","last_became_peered":"2024-09-13T19:16:31.991993+0000","last_unstale":"2024-09-13T19:19:05.842276+0000","last_undegraded":"2024-09-13T19:19:05.842276+0000","last_fullsized":"2024-09-13T19:19:05.842276+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:24:47.009062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"36'2","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:37.182603+0000","last_change":"2024-09-13T19:15:55.892008+0000","last_active":"2024-09-13T19:16:37.182603+0000","last_peered":"2024-09-13T19:16:37.182603+0000","last_clean":"2024-09-13T19:16:37.182603+0000","last_became_active":"2024-09-13T19:15:55.891711+0000","last_became_peered":"2024-09-13T19:15:55.891711+0000","last_unstale":"2024-09-13T19:16:37.182603+0000","last_undegraded":"2024-09-13T19:16:37.182603+0000","last_fullsized":"2024-09-13T19:16:37.182603+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:18:40.262875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.981334+0000","last_change":"2024-09-13T19:15:59.891859+0000","last_active":"2024-09-13T19:16:31.981334+0000","last_peered":"2024-09-13T19:16:31.981334+0000","last_clean":"2024-09-13T19:16:31.981334+0000","last_became_active":"2024-09-13T19:15:59.891581+0000","last_became_peered":"2024-09-13T19:15:59.891581+0000","last_unstale":"2024-09-13T19:16:31.981334+0000","last_undegraded":"2024-09-13T19:16:31.981334+0000","last_fullsized":"2024-09-13T19:16:31.981334+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:49:36.858038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"36'33","reported_seq":79,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.814325+0000","last_change":"2024-09-13T19:16:01.899778+0000","last_active":"2024-09-13T19:19:12.814325+0000","last_peered":"2024-09-13T19:19:12.814325+0000","last_clean":"2024-09-13T19:19:12.814325+0000","last_became_active":"2024-09-13T19:16:01.899438+0000","last_became_peered":"2024-09-13T19:16:01.899438+0000","last_unstale":"2024-09-13T19:19:12.814325+0000","last_undegraded":"2024-09-13T19:19:12.814325+0000","last_fullsized":"2024-09-13T19:19:12.814325+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:39.137471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.986072+0000","last_change":"2024-09-13T19:16:03.910613+0000","last_active":"2024-09-13T19:16:31.986072+0000","last_peered":"2024-09-13T19:16:31.986072+0000","last_clean":"2024-09-13T19:16:31.986072+0000","last_became_active":"2024-09-13T19:16:03.910319+0000","last_became_peered":"2024-09-13T19:16:03.910319+0000","last_unstale":"2024-09-13T19:16:31.986072+0000","last_undegraded":"2024-09-13T19:16:31.986072+0000","last_fullsized":"2024-09-13T19:16:31.986072+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:55:44.357662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"36'10","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.842277+0000","last_change":"2024-09-13T19:15:57.897487+0000","last_active":"2024-09-13T19:19:05.842277+0000","last_peered":"2024-09-13T19:19:05.842277+0000","last_clean":"2024-09-13T19:19:05.842277+0000","last_became_active":"2024-09-13T19:15:57.897232+0000","last_became_peered":"2024-09-13T19:15:57.897232+0000","last_unstale":"2024-09-13T19:19:05.842277+0000","last_undegraded":"2024-09-13T19:19:05.842277+0000","last_fullsized":"2024-09-13T19:19:05.842277+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:57:32.169161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:01.372999+0000","last_change":"2024-09-13T19:15:55.901992+0000","last_active":"2024-09-13T19:18:01.372999+0000","last_peered":"2024-09-13T19:18:01.372999+0000","last_clean":"2024-09-13T19:18:01.372999+0000","last_became_active":"2024-09-13T19:15:55.901257+0000","last_became_peered":"2024-09-13T19:15:55.901257+0000","last_unstale":"2024-09-13T19:18:01.372999+0000","last_undegraded":"2024-09-13T19:18:01.372999+0000","last_fullsized":"2024-09-13T19:18:01.372999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:05:52.991944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:01.935000+0000","last_change":"2024-09-13T19:15:59.896674+0000","last_active":"2024-09-13T19:18:01.935000+0000","last_peered":"2024-09-13T19:18:01.935000+0000","last_clean":"2024-09-13T19:18:01.935000+0000","last_became_active":"2024-09-13T19:15:59.896339+0000","last_became_peered":"2024-09-13T19:15:59.896339+0000","last_unstale":"2024-09-13T19:18:01.935000+0000","last_undegraded":"2024-09-13T19:18:01.935000+0000","last_fullsized":"2024-09-13T19:18:01.935000+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"36'60","reported_seq":125,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.812346+0000","last_change":"2024-09-13T19:16:01.901418+0000","last_active":"2024-09-13T19:19:12.812346+0000","last_peered":"2024-09-13T19:19:12.812346+0000","last_clean":"2024-09-13T19:19:12.812346+0000","last_became_active":"2024-09-13T19:16:01.901092+0000","last_became_peered":"2024-09-13T19:16:01.901092+0000","last_unstale":"2024-09-13T19:19:12.812346+0000","last_undegraded":"2024-09-13T19:19:12.812346+0000","last_fullsized":"2024-09-13T19:19:12.812346+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984142+0000","last_change":"2024-09-13T19:16:03.910823+0000","last_active":"2024-09-13T19:16:31.984142+0000","last_peered":"2024-09-13T19:16:31.984142+0000","last_clean":"2024-09-13T19:16:31.984142+0000","last_became_active":"2024-09-13T19:16:03.910305+0000","last_became_peered":"2024-09-13T19:16:03.910305+0000","last_unstale":"2024-09-13T19:16:31.984142+0000","last_undegraded":"2024-09-13T19:16:31.984142+0000","last_fullsized":"2024-09-13T19:16:31.984142+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:34:06.206573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"36'22","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.598961+0000","last_change":"2024-09-13T19:16:05.913081+0000","last_active":"2024-09-13T19:19:05.598961+0000","last_peered":"2024-09-13T19:19:05.598961+0000","last_clean":"2024-09-13T19:19:05.598961+0000","last_became_active":"2024-09-13T19:16:05.912675+0000","last_became_peered":"2024-09-13T19:16:05.912675+0000","last_unstale":"2024-09-13T19:19:05.598961+0000","last_undegraded":"2024-09-13T19:19:05.598961+0000","last_fullsized":"2024-09-13T19:19:05.598961+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"36'6","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:56.934198+0000","last_change":"2024-09-13T19:15:57.890233+0000","last_active":"2024-09-13T19:17:56.934198+0000","last_peered":"2024-09-13T19:17:56.934198+0000","last_clean":"2024-09-13T19:17:56.934198+0000","last_became_active":"2024-09-13T19:15:57.889921+0000","last_became_peered":"2024-09-13T19:15:57.889921+0000","last_unstale":"2024-09-13T19:17:56.934198+0000","last_undegraded":"2024-09-13T19:17:56.934198+0000","last_fullsized":"2024-09-13T19:17:56.934198+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.989729+0000","last_change":"2024-09-13T19:15:55.895671+0000","last_active":"2024-09-13T19:16:31.989729+0000","last_peered":"2024-09-13T19:16:31.989729+0000","last_clean":"2024-09-13T19:16:31.989729+0000","last_became_active":"2024-09-13T19:15:55.895344+0000","last_became_peered":"2024-09-13T19:15:55.895344+0000","last_unstale":"2024-09-13T19:16:31.989729+0000","last_undegraded":"2024-09-13T19:16:31.989729+0000","last_fullsized":"2024-09-13T19:16:31.989729+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:21.381003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.986359+0000","last_change":"2024-09-13T19:15:59.888500+0000","last_active":"2024-09-13T19:16:31.986359+0000","last_peered":"2024-09-13T19:16:31.986359+0000","last_clean":"2024-09-13T19:16:31.986359+0000","last_became_active":"2024-09-13T19:15:59.888213+0000","last_became_peered":"2024-09-13T19:15:59.888213+0000","last_unstale":"2024-09-13T19:16:31.986359+0000","last_undegraded":"2024-09-13T19:16:31.986359+0000","last_fullsized":"2024-09-13T19:16:31.986359+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:46.856761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"36'39","reported_seq":88,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.703306+0000","last_change":"2024-09-13T19:16:01.908414+0000","last_active":"2024-09-13T19:19:12.703306+0000","last_peered":"2024-09-13T19:19:12.703306+0000","last_clean":"2024-09-13T19:19:12.703306+0000","last_became_active":"2024-09-13T19:16:01.908116+0000","last_became_peered":"2024-09-13T19:16:01.908116+0000","last_unstale":"2024-09-13T19:19:12.703306+0000","last_undegraded":"2024-09-13T19:19:12.703306+0000","last_fullsized":"2024-09-13T19:19:12.703306+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:09.064613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.989465+0000","last_change":"2024-09-13T19:16:03.914462+0000","last_active":"2024-09-13T19:16:31.989465+0000","last_peered":"2024-09-13T19:16:31.989465+0000","last_clean":"2024-09-13T19:16:31.989465+0000","last_became_active":"2024-09-13T19:16:03.914179+0000","last_became_peered":"2024-09-13T19:16:03.914179+0000","last_unstale":"2024-09-13T19:16:31.989465+0000","last_undegraded":"2024-09-13T19:16:31.989465+0000","last_fullsized":"2024-09-13T19:16:31.989465+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:53:26.952246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"34'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.981447+0000","last_change":"2024-09-13T19:16:05.917077+0000","last_active":"2024-09-13T19:16:31.981447+0000","last_peered":"2024-09-13T19:16:31.981447+0000","last_clean":"2024-09-13T19:16:31.981447+0000","last_became_active":"2024-09-13T19:16:05.916822+0000","last_became_peered":"2024-09-13T19:16:05.916822+0000","last_unstale":"2024-09-13T19:16:31.981447+0000","last_undegraded":"2024-09-13T19:16:31.981447+0000","last_fullsized":"2024-09-13T19:16:31.981447+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:48.822908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"36'22","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.922897+0000","last_change":"2024-09-13T19:15:57.902395+0000","last_active":"2024-09-13T19:19:05.922897+0000","last_peered":"2024-09-13T19:19:05.922897+0000","last_clean":"2024-09-13T19:19:05.922897+0000","last_became_active":"2024-09-13T19:15:57.901330+0000","last_became_peered":"2024-09-13T19:15:57.901330+0000","last_unstale":"2024-09-13T19:19:05.922897+0000","last_undegraded":"2024-09-13T19:19:05.922897+0000","last_fullsized":"2024-09-13T19:19:05.922897+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:28.096605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":60,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.988565+0000","last_change":"2024-09-13T19:15:55.896540+0000","last_active":"2024-09-13T19:16:31.988565+0000","last_peered":"2024-09-13T19:16:31.988565+0000","last_clean":"2024-09-13T19:16:31.988565+0000","last_became_active":"2024-09-13T19:15:55.896196+0000","last_became_peered":"2024-09-13T19:15:55.896196+0000","last_unstale":"2024-09-13T19:16:31.988565+0000","last_undegraded":"2024-09-13T19:16:31.988565+0000","last_fullsized":"2024-09-13T19:16:31.988565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:14:40.566289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984960+0000","last_change":"2024-09-13T19:15:59.891464+0000","last_active":"2024-09-13T19:16:31.984960+0000","last_peered":"2024-09-13T19:16:31.984960+0000","last_clean":"2024-09-13T19:16:31.984960+0000","last_became_active":"2024-09-13T19:15:59.891131+0000","last_became_peered":"2024-09-13T19:15:59.891131+0000","last_unstale":"2024-09-13T19:16:31.984960+0000","last_undegraded":"2024-09-13T19:16:31.984960+0000","last_fullsized":"2024-09-13T19:16:31.984960+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:17.195737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"36'35","reported_seq":83,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.756192+0000","last_change":"2024-09-13T19:16:01.902629+0000","last_active":"2024-09-13T19:19:12.756192+0000","last_peered":"2024-09-13T19:19:12.756192+0000","last_clean":"2024-09-13T19:19:12.756192+0000","last_became_active":"2024-09-13T19:16:01.902251+0000","last_became_peered":"2024-09-13T19:16:01.902251+0000","last_unstale":"2024-09-13T19:19:12.756192+0000","last_undegraded":"2024-09-13T19:19:12.756192+0000","last_fullsized":"2024-09-13T19:19:12.756192+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:06.935896+0000","last_change":"2024-09-13T19:16:03.915520+0000","last_active":"2024-09-13T19:18:06.935896+0000","last_peered":"2024-09-13T19:18:06.935896+0000","last_clean":"2024-09-13T19:18:06.935896+0000","last_became_active":"2024-09-13T19:16:03.915225+0000","last_became_peered":"2024-09-13T19:16:03.915225+0000","last_unstale":"2024-09-13T19:18:06.935896+0000","last_undegraded":"2024-09-13T19:18:06.935896+0000","last_fullsized":"2024-09-13T19:18:06.935896+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"36'5","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:05.007010+0000","last_change":"2024-09-13T19:16:05.925066+0000","last_active":"2024-09-13T19:18:05.007010+0000","last_peered":"2024-09-13T19:18:05.007010+0000","last_clean":"2024-09-13T19:18:05.007010+0000","last_became_active":"2024-09-13T19:16:05.923235+0000","last_became_peered":"2024-09-13T19:16:05.923235+0000","last_unstale":"2024-09-13T19:18:05.007010+0000","last_undegraded":"2024-09-13T19:18:05.007010+0000","last_fullsized":"2024-09-13T19:18:05.007010+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:34:27.801710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"36'8","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.930007+0000","last_change":"2024-09-13T19:15:57.886598+0000","last_active":"2024-09-13T19:19:05.930007+0000","last_peered":"2024-09-13T19:19:05.930007+0000","last_clean":"2024-09-13T19:19:05.930007+0000","last_became_active":"2024-09-13T19:15:57.886263+0000","last_became_peered":"2024-09-13T19:15:57.886263+0000","last_unstale":"2024-09-13T19:19:05.930007+0000","last_undegraded":"2024-09-13T19:19:05.930007+0000","last_fullsized":"2024-09-13T19:19:05.930007+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.982036+0000","last_change":"2024-09-13T19:15:55.894466+0000","last_active":"2024-09-13T19:16:31.982036+0000","last_peered":"2024-09-13T19:16:31.982036+0000","last_clean":"2024-09-13T19:16:31.982036+0000","last_became_active":"2024-09-13T19:15:55.893629+0000","last_became_peered":"2024-09-13T19:15:55.893629+0000","last_unstale":"2024-09-13T19:16:31.982036+0000","last_undegraded":"2024-09-13T19:16:31.982036+0000","last_fullsized":"2024-09-13T19:16:31.982036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:23.425081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.991439+0000","last_change":"2024-09-13T19:15:59.892732+0000","last_active":"2024-09-13T19:16:31.991439+0000","last_peered":"2024-09-13T19:16:31.991439+0000","last_clean":"2024-09-13T19:16:31.991439+0000","last_became_active":"2024-09-13T19:15:59.892445+0000","last_became_peered":"2024-09-13T19:15:59.892445+0000","last_unstale":"2024-09-13T19:16:31.991439+0000","last_undegraded":"2024-09-13T19:16:31.991439+0000","last_fullsized":"2024-09-13T19:16:31.991439+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:13.561243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'11","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.983279+0000","last_change":"2024-09-13T19:16:01.906065+0000","last_active":"2024-09-13T19:16:31.983279+0000","last_peered":"2024-09-13T19:16:31.983279+0000","last_clean":"2024-09-13T19:16:31.983279+0000","last_became_active":"2024-09-13T19:16:01.905553+0000","last_became_peered":"2024-09-13T19:16:01.905553+0000","last_unstale":"2024-09-13T19:16:31.983279+0000","last_undegraded":"2024-09-13T19:16:31.983279+0000","last_fullsized":"2024-09-13T19:16:31.983279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:31.722728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"36'285","reported_seq":369,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.655752+0000","last_change":"2024-09-13T19:16:03.913513+0000","last_active":"2024-09-13T19:19:12.655752+0000","last_peered":"2024-09-13T19:19:12.655752+0000","last_clean":"2024-09-13T19:19:12.655752+0000","last_became_active":"2024-09-13T19:16:03.913170+0000","last_became_peered":"2024-09-13T19:16:03.913170+0000","last_unstale":"2024-09-13T19:19:12.655752+0000","last_undegraded":"2024-09-13T19:19:12.655752+0000","last_fullsized":"2024-09-13T19:19:12.655752+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:38.207076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"36'4","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.925551+0000","last_change":"2024-09-13T19:16:05.920004+0000","last_active":"2024-09-13T19:19:05.925551+0000","last_peered":"2024-09-13T19:19:05.925551+0000","last_clean":"2024-09-13T19:19:05.925551+0000","last_became_active":"2024-09-13T19:16:05.918050+0000","last_became_peered":"2024-09-13T19:16:05.918050+0000","last_unstale":"2024-09-13T19:19:05.925551+0000","last_undegraded":"2024-09-13T19:19:05.925551+0000","last_fullsized":"2024-09-13T19:19:05.925551+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:16.813767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"36'9","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.601503+0000","last_change":"2024-09-13T19:15:57.885999+0000","last_active":"2024-09-13T19:19:05.601503+0000","last_peered":"2024-09-13T19:19:05.601503+0000","last_clean":"2024-09-13T19:19:05.601503+0000","last_became_active":"2024-09-13T19:15:57.885711+0000","last_became_peered":"2024-09-13T19:15:57.885711+0000","last_unstale":"2024-09-13T19:19:05.601503+0000","last_undegraded":"2024-09-13T19:19:05.601503+0000","last_fullsized":"2024-09-13T19:19:05.601503+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:08:12.322988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.827523+0000","last_change":"2024-09-13T19:15:55.891066+0000","last_active":"2024-09-13T19:19:05.827523+0000","last_peered":"2024-09-13T19:19:05.827523+0000","last_clean":"2024-09-13T19:19:05.827523+0000","last_became_active":"2024-09-13T19:15:55.890670+0000","last_became_peered":"2024-09-13T19:15:55.890670+0000","last_unstale":"2024-09-13T19:19:05.827523+0000","last_undegraded":"2024-09-13T19:19:05.827523+0000","last_fullsized":"2024-09-13T19:19:05.827523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:05:45.706743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.989358+0000","last_change":"2024-09-13T19:15:59.894250+0000","last_active":"2024-09-13T19:16:31.989358+0000","last_peered":"2024-09-13T19:16:31.989358+0000","last_clean":"2024-09-13T19:16:31.989358+0000","last_became_active":"2024-09-13T19:15:59.893905+0000","last_became_peered":"2024-09-13T19:15:59.893905+0000","last_unstale":"2024-09-13T19:16:31.989358+0000","last_undegraded":"2024-09-13T19:16:31.989358+0000","last_fullsized":"2024-09-13T19:16:31.989358+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:47.786088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"36'40","reported_seq":89,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.773896+0000","last_change":"2024-09-13T19:16:01.903680+0000","last_active":"2024-09-13T19:19:12.773896+0000","last_peered":"2024-09-13T19:19:12.773896+0000","last_clean":"2024-09-13T19:19:12.773896+0000","last_became_active":"2024-09-13T19:16:01.903395+0000","last_became_peered":"2024-09-13T19:16:01.903395+0000","last_unstale":"2024-09-13T19:19:12.773896+0000","last_undegraded":"2024-09-13T19:19:12.773896+0000","last_fullsized":"2024-09-13T19:19:12.773896+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:36.199224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:31.939745+0000","last_change":"2024-09-13T19:16:03.911108+0000","last_active":"2024-09-13T19:18:31.939745+0000","last_peered":"2024-09-13T19:18:31.939745+0000","last_clean":"2024-09-13T19:18:31.939745+0000","last_became_active":"2024-09-13T19:16:03.910550+0000","last_became_peered":"2024-09-13T19:16:03.910550+0000","last_unstale":"2024-09-13T19:18:31.939745+0000","last_undegraded":"2024-09-13T19:18:31.939745+0000","last_fullsized":"2024-09-13T19:18:31.939745+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"36'2","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.066047+0000","last_change":"2024-09-13T19:16:05.913865+0000","last_active":"2024-09-13T19:19:06.066047+0000","last_peered":"2024-09-13T19:19:06.066047+0000","last_clean":"2024-09-13T19:19:06.066047+0000","last_became_active":"2024-09-13T19:16:05.913598+0000","last_became_peered":"2024-09-13T19:16:05.913598+0000","last_unstale":"2024-09-13T19:19:06.066047+0000","last_undegraded":"2024-09-13T19:19:06.066047+0000","last_fullsized":"2024-09-13T19:19:06.066047+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:52:26.855754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985584+0000","last_change":"2024-09-13T19:15:57.884460+0000","last_active":"2024-09-13T19:16:31.985584+0000","last_peered":"2024-09-13T19:16:31.985584+0000","last_clean":"2024-09-13T19:16:31.985584+0000","last_became_active":"2024-09-13T19:15:57.883463+0000","last_became_peered":"2024-09-13T19:15:57.883463+0000","last_unstale":"2024-09-13T19:16:31.985584+0000","last_undegraded":"2024-09-13T19:16:31.985584+0000","last_fullsized":"2024-09-13T19:16:31.985584+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:25.431664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.985018+0000","last_change":"2024-09-13T19:15:55.900188+0000","last_active":"2024-09-13T19:16:31.985018+0000","last_peered":"2024-09-13T19:16:31.985018+0000","last_clean":"2024-09-13T19:16:31.985018+0000","last_became_active":"2024-09-13T19:15:55.899847+0000","last_became_peered":"2024-09-13T19:15:55.899847+0000","last_unstale":"2024-09-13T19:16:31.985018+0000","last_undegraded":"2024-09-13T19:16:31.985018+0000","last_fullsized":"2024-09-13T19:16:31.985018+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:58.468375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.988573+0000","last_change":"2024-09-13T19:15:59.895828+0000","last_active":"2024-09-13T19:16:31.988573+0000","last_peered":"2024-09-13T19:16:31.988573+0000","last_clean":"2024-09-13T19:16:31.988573+0000","last_became_active":"2024-09-13T19:15:59.895512+0000","last_became_peered":"2024-09-13T19:15:59.895512+0000","last_unstale":"2024-09-13T19:16:31.988573+0000","last_undegraded":"2024-09-13T19:16:31.988573+0000","last_fullsized":"2024-09-13T19:16:31.988573+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:25.447228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"36'33","reported_seq":80,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.778039+0000","last_change":"2024-09-13T19:16:01.902662+0000","last_active":"2024-09-13T19:19:12.778039+0000","last_peered":"2024-09-13T19:19:12.778039+0000","last_clean":"2024-09-13T19:19:12.778039+0000","last_became_active":"2024-09-13T19:16:01.902285+0000","last_became_peered":"2024-09-13T19:16:01.902285+0000","last_unstale":"2024-09-13T19:19:12.778039+0000","last_undegraded":"2024-09-13T19:19:12.778039+0000","last_fullsized":"2024-09-13T19:19:12.778039+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.981123+0000","last_change":"2024-09-13T19:16:03.911855+0000","last_active":"2024-09-13T19:16:31.981123+0000","last_peered":"2024-09-13T19:16:31.981123+0000","last_clean":"2024-09-13T19:16:31.981123+0000","last_became_active":"2024-09-13T19:16:03.911587+0000","last_became_peered":"2024-09-13T19:16:03.911587+0000","last_unstale":"2024-09-13T19:16:31.981123+0000","last_undegraded":"2024-09-13T19:16:31.981123+0000","last_fullsized":"2024-09-13T19:16:31.981123+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:01.426149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.982828+0000","last_change":"2024-09-13T19:16:05.923352+0000","last_active":"2024-09-13T19:16:31.982828+0000","last_peered":"2024-09-13T19:16:31.982828+0000","last_clean":"2024-09-13T19:16:31.982828+0000","last_became_active":"2024-09-13T19:16:05.923014+0000","last_became_peered":"2024-09-13T19:16:05.923014+0000","last_unstale":"2024-09-13T19:16:31.982828+0000","last_undegraded":"2024-09-13T19:16:31.982828+0000","last_fullsized":"2024-09-13T19:16:31.982828+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:13:48.786297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"36'4","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:20.738989+0000","last_change":"2024-09-13T19:15:57.896578+0000","last_active":"2024-09-13T19:17:20.738989+0000","last_peered":"2024-09-13T19:17:20.738989+0000","last_clean":"2024-09-13T19:17:20.738989+0000","last_became_active":"2024-09-13T19:15:57.896310+0000","last_became_peered":"2024-09-13T19:15:57.896310+0000","last_unstale":"2024-09-13T19:17:20.738989+0000","last_undegraded":"2024-09-13T19:17:20.738989+0000","last_fullsized":"2024-09-13T19:17:20.738989+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:34:00.185743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:56.934185+0000","last_change":"2024-09-13T19:15:55.895484+0000","last_active":"2024-09-13T19:17:56.934185+0000","last_peered":"2024-09-13T19:17:56.934185+0000","last_clean":"2024-09-13T19:17:56.934185+0000","last_became_active":"2024-09-13T19:15:55.893600+0000","last_became_peered":"2024-09-13T19:15:55.893600+0000","last_unstale":"2024-09-13T19:17:56.934185+0000","last_undegraded":"2024-09-13T19:17:56.934185+0000","last_fullsized":"2024-09-13T19:17:56.934185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.990846+0000","last_change":"2024-09-13T19:15:59.896873+0000","last_active":"2024-09-13T19:16:31.990846+0000","last_peered":"2024-09-13T19:16:31.990846+0000","last_clean":"2024-09-13T19:16:31.990846+0000","last_became_active":"2024-09-13T19:15:59.896518+0000","last_became_peered":"2024-09-13T19:15:59.896518+0000","last_unstale":"2024-09-13T19:16:31.990846+0000","last_undegraded":"2024-09-13T19:16:31.990846+0000","last_fullsized":"2024-09-13T19:16:31.990846+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:12.206811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"36'29","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.748621+0000","last_change":"2024-09-13T19:16:01.903010+0000","last_active":"2024-09-13T19:19:12.748621+0000","last_peered":"2024-09-13T19:19:12.748621+0000","last_clean":"2024-09-13T19:19:12.748621+0000","last_became_active":"2024-09-13T19:16:01.902699+0000","last_became_peered":"2024-09-13T19:16:01.902699+0000","last_unstale":"2024-09-13T19:19:12.748621+0000","last_undegraded":"2024-09-13T19:19:12.748621+0000","last_fullsized":"2024-09-13T19:19:12.748621+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:52.846038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.981606+0000","last_change":"2024-09-13T19:16:03.913624+0000","last_active":"2024-09-13T19:16:31.981606+0000","last_peered":"2024-09-13T19:16:31.981606+0000","last_clean":"2024-09-13T19:16:31.981606+0000","last_became_active":"2024-09-13T19:16:03.913228+0000","last_became_peered":"2024-09-13T19:16:03.913228+0000","last_unstale":"2024-09-13T19:16:31.981606+0000","last_undegraded":"2024-09-13T19:16:31.981606+0000","last_fullsized":"2024-09-13T19:16:31.981606+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:44:11.841765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"36'4","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.172465+0000","last_change":"2024-09-13T19:16:05.925781+0000","last_active":"2024-09-13T19:18:03.172465+0000","last_peered":"2024-09-13T19:18:03.172465+0000","last_clean":"2024-09-13T19:18:03.172465+0000","last_became_active":"2024-09-13T19:16:05.925519+0000","last_became_peered":"2024-09-13T19:16:05.925519+0000","last_unstale":"2024-09-13T19:18:03.172465+0000","last_undegraded":"2024-09-13T19:18:03.172465+0000","last_fullsized":"2024-09-13T19:18:03.172465+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:36.528746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"36'5","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.930007+0000","last_change":"2024-09-13T19:15:57.886387+0000","last_active":"2024-09-13T19:19:05.930007+0000","last_peered":"2024-09-13T19:19:05.930007+0000","last_clean":"2024-09-13T19:19:05.930007+0000","last_became_active":"2024-09-13T19:15:57.885993+0000","last_became_peered":"2024-09-13T19:15:57.885993+0000","last_unstale":"2024-09-13T19:19:05.930007+0000","last_undegraded":"2024-09-13T19:19:05.930007+0000","last_fullsized":"2024-09-13T19:19:05.930007+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:07.087101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.990648+0000","last_change":"2024-09-13T19:15:55.895882+0000","last_active":"2024-09-13T19:16:31.990648+0000","last_peered":"2024-09-13T19:16:31.990648+0000","last_clean":"2024-09-13T19:16:31.990648+0000","last_became_active":"2024-09-13T19:15:55.895040+0000","last_became_peered":"2024-09-13T19:15:55.895040+0000","last_unstale":"2024-09-13T19:16:31.990648+0000","last_undegraded":"2024-09-13T19:16:31.990648+0000","last_fullsized":"2024-09-13T19:16:31.990648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:24.740012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"36'2","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:01.747242+0000","last_change":"2024-09-13T19:15:59.897872+0000","last_active":"2024-09-13T19:18:01.747242+0000","last_peered":"2024-09-13T19:18:01.747242+0000","last_clean":"2024-09-13T19:18:01.747242+0000","last_became_active":"2024-09-13T19:15:59.897609+0000","last_became_peered":"2024-09-13T19:15:59.897609+0000","last_unstale":"2024-09-13T19:18:01.747242+0000","last_undegraded":"2024-09-13T19:18:01.747242+0000","last_fullsized":"2024-09-13T19:18:01.747242+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:51.446526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"36'36","reported_seq":84,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.758116+0000","last_change":"2024-09-13T19:16:01.902324+0000","last_active":"2024-09-13T19:19:12.758116+0000","last_peered":"2024-09-13T19:19:12.758116+0000","last_clean":"2024-09-13T19:19:12.758116+0000","last_became_active":"2024-09-13T19:16:01.902042+0000","last_became_peered":"2024-09-13T19:16:01.902042+0000","last_unstale":"2024-09-13T19:19:12.758116+0000","last_undegraded":"2024-09-13T19:19:12.758116+0000","last_fullsized":"2024-09-13T19:19:12.758116+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:30:13.522406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:16.346297+0000","last_change":"2024-09-13T19:19:16.346321+0000","last_active":"2024-09-13T19:19:16.346297+0000","last_peered":"2024-09-13T19:19:16.346297+0000","last_clean":"2024-09-13T19:19:16.346297+0000","last_became_active":"2024-09-13T19:16:03.911052+0000","last_became_peered":"2024-09-13T19:16:03.911052+0000","last_unstale":"2024-09-13T19:19:16.346297+0000","last_undegraded":"2024-09-13T19:19:16.346297+0000","last_fullsized":"2024-09-13T19:19:16.346297+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:16.346224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:16.346224+0000","last_clean_scrub_stamp":"2024-09-13T19:19:16.346224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:31.215677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"36'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.174978+0000","last_change":"2024-09-13T19:16:05.924212+0000","last_active":"2024-09-13T19:18:03.174978+0000","last_peered":"2024-09-13T19:18:03.174978+0000","last_clean":"2024-09-13T19:18:03.174978+0000","last_became_active":"2024-09-13T19:16:05.922822+0000","last_became_peered":"2024-09-13T19:16:05.922822+0000","last_unstale":"2024-09-13T19:18:03.174978+0000","last_undegraded":"2024-09-13T19:18:03.174978+0000","last_fullsized":"2024-09-13T19:18:03.174978+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:17:25.804534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"36'1","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:08.940484+0000","last_change":"2024-09-13T19:15:57.903389+0000","last_active":"2024-09-13T19:18:08.940484+0000","last_peered":"2024-09-13T19:18:08.940484+0000","last_clean":"2024-09-13T19:18:08.940484+0000","last_became_active":"2024-09-13T19:15:57.902883+0000","last_became_peered":"2024-09-13T19:15:57.902883+0000","last_unstale":"2024-09-13T19:18:08.940484+0000","last_undegraded":"2024-09-13T19:18:08.940484+0000","last_fullsized":"2024-09-13T19:18:08.940484+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:01:22.545027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.957154+0000","last_change":"2024-09-13T19:15:55.899096+0000","last_active":"2024-09-13T19:19:05.957154+0000","last_peered":"2024-09-13T19:19:05.957154+0000","last_clean":"2024-09-13T19:19:05.957154+0000","last_became_active":"2024-09-13T19:15:55.898653+0000","last_became_peered":"2024-09-13T19:15:55.898653+0000","last_unstale":"2024-09-13T19:19:05.957154+0000","last_undegraded":"2024-09-13T19:19:05.957154+0000","last_fullsized":"2024-09-13T19:19:05.957154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:40.072036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"36'8","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.705139+0000","last_change":"2024-09-13T19:15:57.886714+0000","last_active":"2024-09-13T19:19:05.705139+0000","last_peered":"2024-09-13T19:19:05.705139+0000","last_clean":"2024-09-13T19:19:05.705139+0000","last_became_active":"2024-09-13T19:15:57.886330+0000","last_became_peered":"2024-09-13T19:15:57.886330+0000","last_unstale":"2024-09-13T19:19:05.705139+0000","last_undegraded":"2024-09-13T19:19:05.705139+0000","last_fullsized":"2024-09-13T19:19:05.705139+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:04.954305+0000","last_change":"2024-09-13T19:15:55.891290+0000","last_active":"2024-09-13T19:18:04.954305+0000","last_peered":"2024-09-13T19:18:04.954305+0000","last_clean":"2024-09-13T19:18:04.954305+0000","last_became_active":"2024-09-13T19:15:55.890821+0000","last_became_peered":"2024-09-13T19:15:55.890821+0000","last_unstale":"2024-09-13T19:18:04.954305+0000","last_undegraded":"2024-09-13T19:18:04.954305+0000","last_fullsized":"2024-09-13T19:18:04.954305+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"36'2","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:38.101539+0000","last_change":"2024-09-13T19:15:57.898663+0000","last_active":"2024-09-13T19:16:38.101539+0000","last_peered":"2024-09-13T19:16:38.101539+0000","last_clean":"2024-09-13T19:16:38.101539+0000","last_became_active":"2024-09-13T19:15:57.898295+0000","last_became_peered":"2024-09-13T19:15:57.898295+0000","last_unstale":"2024-09-13T19:16:38.101539+0000","last_undegraded":"2024-09-13T19:16:38.101539+0000","last_fullsized":"2024-09-13T19:16:38.101539+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:31:39.968554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.981947+0000","last_change":"2024-09-13T19:15:55.893929+0000","last_active":"2024-09-13T19:16:31.981947+0000","last_peered":"2024-09-13T19:16:31.981947+0000","last_clean":"2024-09-13T19:16:31.981947+0000","last_became_active":"2024-09-13T19:15:55.893191+0000","last_became_peered":"2024-09-13T19:15:55.893191+0000","last_unstale":"2024-09-13T19:16:31.981947+0000","last_undegraded":"2024-09-13T19:16:31.981947+0000","last_fullsized":"2024-09-13T19:16:31.981947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:27.683071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"36'6","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:06.935780+0000","last_change":"2024-09-13T19:15:57.887458+0000","last_active":"2024-09-13T19:18:06.935780+0000","last_peered":"2024-09-13T19:18:06.935780+0000","last_clean":"2024-09-13T19:18:06.935780+0000","last_became_active":"2024-09-13T19:15:57.886670+0000","last_became_peered":"2024-09-13T19:15:57.886670+0000","last_unstale":"2024-09-13T19:18:06.935780+0000","last_undegraded":"2024-09-13T19:18:06.935780+0000","last_fullsized":"2024-09-13T19:18:06.935780+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:01.934912+0000","last_change":"2024-09-13T19:15:55.894421+0000","last_active":"2024-09-13T19:18:01.934912+0000","last_peered":"2024-09-13T19:18:01.934912+0000","last_clean":"2024-09-13T19:18:01.934912+0000","last_became_active":"2024-09-13T19:15:55.893569+0000","last_became_peered":"2024-09-13T19:15:55.893569+0000","last_unstale":"2024-09-13T19:18:01.934912+0000","last_undegraded":"2024-09-13T19:18:01.934912+0000","last_fullsized":"2024-09-13T19:18:01.934912+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"36'6","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:01.934898+0000","last_change":"2024-09-13T19:15:57.896837+0000","last_active":"2024-09-13T19:18:01.934898+0000","last_peered":"2024-09-13T19:18:01.934898+0000","last_clean":"2024-09-13T19:18:01.934898+0000","last_became_active":"2024-09-13T19:15:57.896487+0000","last_became_peered":"2024-09-13T19:15:57.896487+0000","last_unstale":"2024-09-13T19:18:01.934898+0000","last_undegraded":"2024-09-13T19:18:01.934898+0000","last_fullsized":"2024-09-13T19:18:01.934898+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:06.935808+0000","last_change":"2024-09-13T19:15:55.892917+0000","last_active":"2024-09-13T19:18:06.935808+0000","last_peered":"2024-09-13T19:18:06.935808+0000","last_clean":"2024-09-13T19:18:06.935808+0000","last_became_active":"2024-09-13T19:15:55.892026+0000","last_became_peered":"2024-09-13T19:15:55.892026+0000","last_unstale":"2024-09-13T19:18:06.935808+0000","last_undegraded":"2024-09-13T19:18:06.935808+0000","last_fullsized":"2024-09-13T19:18:06.935808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"36'16","reported_seq":79,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.968515+0000","last_change":"2024-09-13T19:15:57.903134+0000","last_active":"2024-09-13T19:19:05.968515+0000","last_peered":"2024-09-13T19:19:05.968515+0000","last_clean":"2024-09-13T19:19:05.968515+0000","last_became_active":"2024-09-13T19:15:57.902841+0000","last_became_peered":"2024-09-13T19:15:57.902841+0000","last_unstale":"2024-09-13T19:19:05.968515+0000","last_undegraded":"2024-09-13T19:19:05.968515+0000","last_fullsized":"2024-09-13T19:19:05.968515+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:28:00.527551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":56,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"36'2","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:37.182812+0000","last_change":"2024-09-13T19:15:55.897004+0000","last_active":"2024-09-13T19:16:37.182812+0000","last_peered":"2024-09-13T19:16:37.182812+0000","last_clean":"2024-09-13T19:16:37.182812+0000","last_became_active":"2024-09-13T19:15:55.896490+0000","last_became_peered":"2024-09-13T19:15:55.896490+0000","last_unstale":"2024-09-13T19:16:37.182812+0000","last_undegraded":"2024-09-13T19:16:37.182812+0000","last_fullsized":"2024-09-13T19:16:37.182812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:37.997344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"36'6","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.848896+0000","last_change":"2024-09-13T19:15:57.888143+0000","last_active":"2024-09-13T19:19:05.848896+0000","last_peered":"2024-09-13T19:19:05.848896+0000","last_clean":"2024-09-13T19:19:05.848896+0000","last_became_active":"2024-09-13T19:15:57.887810+0000","last_became_peered":"2024-09-13T19:15:57.887810+0000","last_unstale":"2024-09-13T19:19:05.848896+0000","last_undegraded":"2024-09-13T19:19:05.848896+0000","last_fullsized":"2024-09-13T19:19:05.848896+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.989052+0000","last_change":"2024-09-13T19:15:55.892243+0000","last_active":"2024-09-13T19:16:31.989052+0000","last_peered":"2024-09-13T19:16:31.989052+0000","last_clean":"2024-09-13T19:16:31.989052+0000","last_became_active":"2024-09-13T19:15:55.891422+0000","last_became_peered":"2024-09-13T19:15:55.891422+0000","last_unstale":"2024-09-13T19:16:31.989052+0000","last_undegraded":"2024-09-13T19:16:31.989052+0000","last_fullsized":"2024-09-13T19:16:31.989052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:02.236650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"36'2","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.696175+0000","last_change":"2024-09-13T19:15:57.891037+0000","last_active":"2024-09-13T19:19:05.696175+0000","last_peered":"2024-09-13T19:19:05.696175+0000","last_clean":"2024-09-13T19:19:05.696175+0000","last_became_active":"2024-09-13T19:15:57.890491+0000","last_became_peered":"2024-09-13T19:15:57.890491+0000","last_unstale":"2024-09-13T19:19:05.696175+0000","last_undegraded":"2024-09-13T19:19:05.696175+0000","last_fullsized":"2024-09-13T19:19:05.696175+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:31:09.005785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.799217+0000","last_change":"2024-09-13T19:15:55.892364+0000","last_active":"2024-09-13T19:19:12.799217+0000","last_peered":"2024-09-13T19:19:12.799217+0000","last_clean":"2024-09-13T19:19:12.799217+0000","last_became_active":"2024-09-13T19:15:55.891860+0000","last_became_peered":"2024-09-13T19:15:55.891860+0000","last_unstale":"2024-09-13T19:19:12.799217+0000","last_undegraded":"2024-09-13T19:19:12.799217+0000","last_fullsized":"2024-09-13T19:19:12.799217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"36'6","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.842250+0000","last_change":"2024-09-13T19:15:57.892359+0000","last_active":"2024-09-13T19:19:05.842250+0000","last_peered":"2024-09-13T19:19:05.842250+0000","last_clean":"2024-09-13T19:19:05.842250+0000","last_became_active":"2024-09-13T19:15:57.892073+0000","last_became_peered":"2024-09-13T19:15:57.892073+0000","last_unstale":"2024-09-13T19:19:05.842250+0000","last_undegraded":"2024-09-13T19:19:05.842250+0000","last_fullsized":"2024-09-13T19:19:05.842250+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:35.680347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"36'4","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.549508+0000","last_change":"2024-09-13T19:15:55.897908+0000","last_active":"2024-09-13T19:19:05.549508+0000","last_peered":"2024-09-13T19:19:05.549508+0000","last_clean":"2024-09-13T19:19:05.549508+0000","last_became_active":"2024-09-13T19:15:55.895911+0000","last_became_peered":"2024-09-13T19:15:55.895911+0000","last_unstale":"2024-09-13T19:19:05.549508+0000","last_undegraded":"2024-09-13T19:19:05.549508+0000","last_fullsized":"2024-09-13T19:19:05.549508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:13.474342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"36'6","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:51.942682+0000","last_change":"2024-09-13T19:16:31.995370+0000","last_active":"2024-09-13T19:18:51.942682+0000","last_peered":"2024-09-13T19:18:51.942682+0000","last_clean":"2024-09-13T19:18:51.942682+0000","last_became_active":"2024-09-13T19:16:31.993403+0000","last_became_peered":"2024-09-13T19:16:31.993403+0000","last_unstale":"2024-09-13T19:18:51.942682+0000","last_undegraded":"2024-09-13T19:18:51.942682+0000","last_fullsized":"2024-09-13T19:18:51.942682+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:11.936651+0000","last_change":"2024-09-13T19:15:55.896003+0000","last_active":"2024-09-13T19:18:11.936651+0000","last_peered":"2024-09-13T19:18:11.936651+0000","last_clean":"2024-09-13T19:18:11.936651+0000","last_became_active":"2024-09-13T19:15:55.894607+0000","last_became_peered":"2024-09-13T19:15:55.894607+0000","last_unstale":"2024-09-13T19:18:11.936651+0000","last_undegraded":"2024-09-13T19:18:11.936651+0000","last_fullsized":"2024-09-13T19:18:11.936651+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"36'2","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:11.936745+0000","last_change":"2024-09-13T19:15:57.901296+0000","last_active":"2024-09-13T19:18:11.936745+0000","last_peered":"2024-09-13T19:18:11.936745+0000","last_clean":"2024-09-13T19:18:11.936745+0000","last_became_active":"2024-09-13T19:15:57.900902+0000","last_became_peered":"2024-09-13T19:15:57.900902+0000","last_unstale":"2024-09-13T19:18:11.936745+0000","last_undegraded":"2024-09-13T19:18:11.936745+0000","last_fullsized":"2024-09-13T19:18:11.936745+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.988865+0000","last_change":"2024-09-13T19:15:55.906203+0000","last_active":"2024-09-13T19:16:31.988865+0000","last_peered":"2024-09-13T19:16:31.988865+0000","last_clean":"2024-09-13T19:16:31.988865+0000","last_became_active":"2024-09-13T19:15:55.905867+0000","last_became_peered":"2024-09-13T19:15:55.905867+0000","last_unstale":"2024-09-13T19:16:31.988865+0000","last_undegraded":"2024-09-13T19:16:31.988865+0000","last_fullsized":"2024-09-13T19:16:31.988865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:40.072036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.991480+0000","last_change":"2024-09-13T19:15:57.889883+0000","last_active":"2024-09-13T19:16:31.991480+0000","last_peered":"2024-09-13T19:16:31.991480+0000","last_clean":"2024-09-13T19:16:31.991480+0000","last_became_active":"2024-09-13T19:15:57.889606+0000","last_became_peered":"2024-09-13T19:15:57.889606+0000","last_unstale":"2024-09-13T19:16:31.991480+0000","last_undegraded":"2024-09-13T19:16:31.991480+0000","last_fullsized":"2024-09-13T19:16:31.991480+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:14.720100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:37.717588+0000","last_change":"2024-09-13T19:15:55.896394+0000","last_active":"2024-09-13T19:16:37.717588+0000","last_peered":"2024-09-13T19:16:37.717588+0000","last_clean":"2024-09-13T19:16:37.717588+0000","last_became_active":"2024-09-13T19:15:55.896086+0000","last_became_peered":"2024-09-13T19:15:55.896086+0000","last_unstale":"2024-09-13T19:16:37.717588+0000","last_undegraded":"2024-09-13T19:16:37.717588+0000","last_fullsized":"2024-09-13T19:16:37.717588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:07.205939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"36'12","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.842313+0000","last_change":"2024-09-13T19:16:31.992315+0000","last_active":"2024-09-13T19:19:05.842313+0000","last_peered":"2024-09-13T19:19:05.842313+0000","last_clean":"2024-09-13T19:19:05.842313+0000","last_became_active":"2024-09-13T19:16:31.991965+0000","last_became_peered":"2024-09-13T19:16:31.991965+0000","last_unstale":"2024-09-13T19:19:05.842313+0000","last_undegraded":"2024-09-13T19:19:05.842313+0000","last_fullsized":"2024-09-13T19:19:05.842313+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:43.311146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.983154+0000","last_change":"2024-09-13T19:15:55.894925+0000","last_active":"2024-09-13T19:16:31.983154+0000","last_peered":"2024-09-13T19:16:31.983154+0000","last_clean":"2024-09-13T19:16:31.983154+0000","last_became_active":"2024-09-13T19:15:55.894634+0000","last_became_peered":"2024-09-13T19:15:55.894634+0000","last_unstale":"2024-09-13T19:16:31.983154+0000","last_undegraded":"2024-09-13T19:16:31.983154+0000","last_fullsized":"2024-09-13T19:16:31.983154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:43:22.996934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"36'4","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:38.370554+0000","last_change":"2024-09-13T19:15:57.892811+0000","last_active":"2024-09-13T19:16:38.370554+0000","last_peered":"2024-09-13T19:16:38.370554+0000","last_clean":"2024-09-13T19:16:38.370554+0000","last_became_active":"2024-09-13T19:15:57.892558+0000","last_became_peered":"2024-09-13T19:15:57.892558+0000","last_unstale":"2024-09-13T19:16:38.370554+0000","last_undegraded":"2024-09-13T19:16:38.370554+0000","last_fullsized":"2024-09-13T19:16:38.370554+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:32.863560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:04.817098+0000","last_change":"2024-09-13T19:15:55.894980+0000","last_active":"2024-09-13T19:18:04.817098+0000","last_peered":"2024-09-13T19:18:04.817098+0000","last_clean":"2024-09-13T19:18:04.817098+0000","last_became_active":"2024-09-13T19:15:55.894667+0000","last_became_peered":"2024-09-13T19:15:55.894667+0000","last_unstale":"2024-09-13T19:18:04.817098+0000","last_undegraded":"2024-09-13T19:18:04.817098+0000","last_fullsized":"2024-09-13T19:18:04.817098+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:05.649972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"36'17","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.601852+0000","last_change":"2024-09-13T19:15:57.896510+0000","last_active":"2024-09-13T19:19:05.601852+0000","last_peered":"2024-09-13T19:19:05.601852+0000","last_clean":"2024-09-13T19:19:05.601852+0000","last_became_active":"2024-09-13T19:15:57.896200+0000","last_became_peered":"2024-09-13T19:15:57.896200+0000","last_unstale":"2024-09-13T19:19:05.601852+0000","last_undegraded":"2024-09-13T19:19:05.601852+0000","last_fullsized":"2024-09-13T19:19:05.601852+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:10.570988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":50,"num_read_kb":42,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.575188+0000","last_change":"2024-09-13T19:15:55.899411+0000","last_active":"2024-09-13T19:19:05.575188+0000","last_peered":"2024-09-13T19:19:05.575188+0000","last_clean":"2024-09-13T19:19:05.575188+0000","last_became_active":"2024-09-13T19:15:55.899104+0000","last_became_peered":"2024-09-13T19:15:55.899104+0000","last_unstale":"2024-09-13T19:19:05.575188+0000","last_undegraded":"2024-09-13T19:19:05.575188+0000","last_fullsized":"2024-09-13T19:19:05.575188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:11.960376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"36'12","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.919823+0000","last_change":"2024-09-13T19:15:57.890188+0000","last_active":"2024-09-13T19:19:05.919823+0000","last_peered":"2024-09-13T19:19:05.919823+0000","last_clean":"2024-09-13T19:19:05.919823+0000","last_became_active":"2024-09-13T19:15:57.889781+0000","last_became_peered":"2024-09-13T19:15:57.889781+0000","last_unstale":"2024-09-13T19:19:05.919823+0000","last_undegraded":"2024-09-13T19:19:05.919823+0000","last_fullsized":"2024-09-13T19:19:05.919823+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:25.431664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.984819+0000","last_change":"2024-09-13T19:15:55.898914+0000","last_active":"2024-09-13T19:16:31.984819+0000","last_peered":"2024-09-13T19:16:31.984819+0000","last_clean":"2024-09-13T19:16:31.984819+0000","last_became_active":"2024-09-13T19:15:55.898627+0000","last_became_peered":"2024-09-13T19:15:55.898627+0000","last_unstale":"2024-09-13T19:16:31.984819+0000","last_undegraded":"2024-09-13T19:16:31.984819+0000","last_fullsized":"2024-09-13T19:16:31.984819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:12.713518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:16:31.981855+0000","last_change":"2024-09-13T19:15:55.899524+0000","last_active":"2024-09-13T19:16:31.981855+0000","last_peered":"2024-09-13T19:16:31.981855+0000","last_clean":"2024-09-13T19:16:31.981855+0000","last_became_active":"2024-09-13T19:15:55.899225+0000","last_became_peered":"2024-09-13T19:15:55.899225+0000","last_unstale":"2024-09-13T19:16:31.981855+0000","last_undegraded":"2024-09-13T19:16:31.981855+0000","last_fullsized":"2024-09-13T19:16:31.981855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:53:11.602684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"36'6","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.708700+0000","last_change":"2024-09-13T19:15:57.890646+0000","last_active":"2024-09-13T19:19:05.708700+0000","last_peered":"2024-09-13T19:19:05.708700+0000","last_clean":"2024-09-13T19:19:05.708700+0000","last_became_active":"2024-09-13T19:15:57.890325+0000","last_became_peered":"2024-09-13T19:15:57.890325+0000","last_unstale":"2024-09-13T19:19:05.708700+0000","last_undegraded":"2024-09-13T19:19:05.708700+0000","last_fullsized":"2024-09-13T19:19:05.708700+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:16.937377+0000","last_change":"2024-09-13T19:15:55.895990+0000","last_active":"2024-09-13T19:18:16.937377+0000","last_peered":"2024-09-13T19:18:16.937377+0000","last_clean":"2024-09-13T19:18:16.937377+0000","last_became_active":"2024-09-13T19:15:55.894485+0000","last_became_peered":"2024-09-13T19:15:55.894485+0000","last_unstale":"2024-09-13T19:18:16.937377+0000","last_undegraded":"2024-09-13T19:18:16.937377+0000","last_fullsized":"2024-09-13T19:18:16.937377+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"36'8","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.594537+0000","last_change":"2024-09-13T19:15:57.902376+0000","last_active":"2024-09-13T19:19:05.594537+0000","last_peered":"2024-09-13T19:19:05.594537+0000","last_clean":"2024-09-13T19:19:05.594537+0000","last_became_active":"2024-09-13T19:15:57.902123+0000","last_became_peered":"2024-09-13T19:15:57.902123+0000","last_unstale":"2024-09-13T19:19:05.594537+0000","last_undegraded":"2024-09-13T19:19:05.594537+0000","last_fullsized":"2024-09-13T19:19:05.594537+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:06.873072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1374,"ondisk_log_size":1374,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1595,"num_read_kb":1485,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640304,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39996,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331844,"statfs":{"total":96636764160,"available":96595808256,"internally_reserved":0,"allocated":503808,"data_stored":158624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640303,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40512,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331328,"statfs":{"total":96636764160,"available":96595279872,"internally_reserved":0,"allocated":1032192,"data_stored":746866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640303,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36372,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335468,"statfs":{"total":96636764160,"available":96599519232,"internally_reserved":0,"allocated":1048576,"data_stored":746030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705712,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":462848,"data_stored":156440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T19:19:17.315 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.315 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.315 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.315 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.316 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.316 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.316 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.316 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.316 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.316 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.316 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.316 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.316 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.317 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.317 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.317 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.317 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.317 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.317 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.317 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.317 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.318 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.318 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.318 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.318 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.318 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.318 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.318 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.318 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.318 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.319 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.319 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-13T19:15:58.873497+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.319 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-13T19:16:00.880092+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.319 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-13T19:16:02.887943+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=2, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.319 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.319 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.319 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.319 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-13T19:15:58.873497+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.320 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-13T19:16:00.880092+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.320 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-13T19:16:02.887943+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=2, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.320 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.320 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.320 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.320 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-13T19:15:58.873497+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.320 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-13T19:16:00.880092+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.320 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-13T19:16:02.887943+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=2, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.320 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.321 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.321 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.321 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-13T19:15:58.873497+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.321 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-13T19:16:00.880092+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.321 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-13T19:16:02.887943+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=2, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.321 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.321 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.321 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-13T19:15:58.873497+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.321 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-13T19:16:00.880092+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.322 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-13T19:16:02.887943+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=2, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.322 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.322 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.322 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.322 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-13T19:15:58.873497+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.322 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-13T19:16:00.880092+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.322 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-13T19:16:02.887943+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=2, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.322 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.323 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.323 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.323 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-13T19:15:58.873497+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.323 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-13T19:16:00.880092+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.323 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-13T19:16:02.887943+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=2, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.323 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.323 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.323 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.323 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-13T19:15:58.873497+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.324 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-13T19:16:00.880092+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.324 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-13T19:16:02.887943+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=2, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.324 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.324 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.324 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.324 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-13T19:15:58.873497+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.324 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-13T19:16:00.880092+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.324 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-13T19:16:02.887943+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=2, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.325 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.325 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.325 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.325 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-13T19:15:58.873497+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.325 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-13T19:16:00.880092+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.325 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-13T19:16:02.887943+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=2, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.325 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.325 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.326 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.326 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-13T19:15:58.873497+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.326 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-13T19:16:00.880092+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.326 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-13T19:16:02.887943+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=2, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.326 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.326 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.326 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.326 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-13T19:15:58.873497+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.327 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-13T19:16:00.880092+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.327 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-13T19:16:02.887943+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=2, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.327 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.327 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.327 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-13T19:15:39.557965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=39, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.327 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-13T19:15:43.565433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.327 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.327 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-13T19:15:58.873497+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.327 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-13T19:16:00.880092+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.328 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-13T19:16:02.887943+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=2, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.328 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.328 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.328 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-13T19:15:43.565433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.328 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.328 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-13T19:15:58.873497+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.328 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-13T19:16:00.880092+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.328 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-13T19:16:02.887943+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=2, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.329 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.329 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.329 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-13T19:15:43.565433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.329 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.329 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-13T19:15:58.873497+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.329 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-13T19:16:00.880092+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.329 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-13T19:16:02.887943+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=2, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.329 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.330 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.330 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-13T19:15:43.565433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.330 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.330 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-13T19:15:58.873497+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.330 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-13T19:16:00.880092+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.330 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-13T19:16:02.887943+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=2, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.330 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.330 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.330 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.331 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-13T19:15:43.565433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.331 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-13T19:15:58.873497+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.331 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-13T19:16:00.880092+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.331 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-13T19:16:02.887943+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=2, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.331 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.331 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.331 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.331 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-13T19:15:43.565433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.331 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-13T19:15:58.873497+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.332 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-13T19:16:00.880092+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.332 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-13T19:16:02.887943+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=2, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.332 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.332 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.332 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.332 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-13T19:15:43.565433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.332 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-13T19:15:58.873497+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.332 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-13T19:16:00.880092+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.333 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-13T19:16:02.887943+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=2, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.333 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.333 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.333 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.333 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-13T19:15:43.565433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.333 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-13T19:15:58.873497+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.333 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-13T19:16:00.880092+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.333 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-13T19:16:02.887943+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=2, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.333 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.334 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.334 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.334 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.334 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-13T19:15:58.873497+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.334 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-13T19:16:00.880092+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.334 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-13T19:16:02.887943+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=2, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.334 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.334 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.335 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.335 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-13T19:15:58.873497+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.335 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-13T19:16:00.880092+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.335 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-13T19:16:02.887943+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=2, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.335 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.335 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.335 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.335 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-13T19:15:58.873497+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.335 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-13T19:16:00.880092+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.336 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-13T19:16:02.887943+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=2, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.336 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.336 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.336 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.336 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-13T19:15:58.873497+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.336 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-13T19:16:00.880092+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.336 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-13T19:16:02.887943+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=2, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.336 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.336 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.337 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-13T19:15:58.873497+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.337 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-13T19:16:00.880092+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.337 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-13T19:16:02.887943+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=2, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.337 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.337 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.337 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.337 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-13T19:15:58.873497+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.337 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-13T19:16:00.880092+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.337 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-13T19:16:02.887943+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=2, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.338 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.338 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.338 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.338 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-13T19:15:58.873497+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.338 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-13T19:16:00.880092+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.338 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-13T19:16:02.887943+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=2, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.338 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.338 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.338 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.339 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-13T19:15:58.873497+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.339 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-13T19:16:00.880092+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.339 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-13T19:16:02.887943+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=2, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.339 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.339 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.339 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.339 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-13T19:15:58.873497+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.339 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-13T19:16:00.880092+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.339 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-13T19:16:02.887943+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=2, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.339 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.340 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.340 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.340 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-13T19:15:58.873497+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.340 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-13T19:16:00.880092+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.340 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-13T19:16:02.887943+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=2, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.341 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.341 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.341 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.341 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-13T19:15:58.873497+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.341 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-13T19:16:00.880092+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.341 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-13T19:16:02.887943+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=2, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.341 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.342 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.342 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.342 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-13T19:15:58.873497+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.342 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-13T19:16:00.880092+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.342 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.342 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.342 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.342 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.343 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.343 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.343 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.343 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.343 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.343 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.343 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.343 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.343 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.344 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.344 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.344 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.344 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.344 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.344 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.344 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.344 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.345 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.345 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.345 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.345 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.345 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.345 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.345 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.345 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.346 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.346 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.346 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.346 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.346 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.346 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.346 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.346 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:17.346 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T19:19:17.997 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-09-13T19:19:37.347 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T19:19:37.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.460+0000 7f70884b7640 1 Processor -- start 2024-09-13T19:19:37.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.460+0000 7f70884b7640 1 -- start start 2024-09-13T19:19:37.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.461+0000 7f70884b7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f708012e940 0x7f7080130d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:37.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.461+0000 7f70884b7640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f708006eba0 con 0x7f708006eda0 2024-09-13T19:19:37.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.461+0000 7f70884b7640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f708006d2f0 con 0x7f708012e940 2024-09-13T19:19:37.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.461+0000 7f7085a52640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f708012e940 0x7f7080130d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:37.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.461+0000 7f7086253640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f708006eda0 0x7f708006f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48898/0 (socket says 172.21.15.53:48898) 2024-09-13T19:19:37.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.461+0000 7f7086253640 1 -- 172.21.15.53:0/3293857369 learned_addr learned my addr 172.21.15.53:0/3293857369 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T19:19:37.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.461+0000 7f7085a52640 1 -- 172.21.15.53:0/3293857369 >> v1:172.21.15.53:6789/0 conn(0x7f708006eda0 legacy=0x7f708006f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:37.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.461+0000 7f7085251640 1 -- 172.21.15.53:0/3293857369 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4239620561 0 0) 0x7f708006eba0 con 0x7f708006eda0 2024-09-13T19:19:37.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.461+0000 7f7085a52640 1 -- 172.21.15.53:0/3293857369 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7080070d50 con 0x7f708012e940 2024-09-13T19:19:37.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.462+0000 7f7085a52640 1 --2- 172.21.15.53:0/3293857369 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f708012e940 0x7f7080130d30 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f7070009720 tx=0x7f707002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1e5aae212d862b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:37.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.462+0000 7f7085251640 1 -- 172.21.15.53:0/3293857369 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7070037070 con 0x7f708012e940 2024-09-13T19:19:37.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.462+0000 7f7085251640 1 -- 172.21.15.53:0/3293857369 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f707002ae20 con 0x7f708012e940 2024-09-13T19:19:37.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.462+0000 7f7085251640 1 -- 172.21.15.53:0/3293857369 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7070032590 con 0x7f708012e940 2024-09-13T19:19:37.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.463+0000 7f70884b7640 1 -- 172.21.15.53:0/3293857369 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f708012e940 msgr2=0x7f7080130d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:37.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.463+0000 7f70884b7640 1 --2- 172.21.15.53:0/3293857369 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f708012e940 0x7f7080130d30 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f7070009720 tx=0x7f707002a1a0 comp rx=0 tx=0).stop 2024-09-13T19:19:37.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.463+0000 7f70884b7640 1 -- 172.21.15.53:0/3293857369 shutdown_connections 2024-09-13T19:19:37.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.463+0000 7f70884b7640 1 --2- 172.21.15.53:0/3293857369 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f708012e940 0x7f7080130d30 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:37.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.463+0000 7f70884b7640 1 -- 172.21.15.53:0/3293857369 >> 172.21.15.53:0/3293857369 conn(0x7f708009a890 msgr2=0x7f708009aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:19:37.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.463+0000 7f70884b7640 1 -- 172.21.15.53:0/3293857369 shutdown_connections 2024-09-13T19:19:37.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.463+0000 7f70884b7640 1 -- 172.21.15.53:0/3293857369 wait complete. 2024-09-13T19:19:37.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.464+0000 7f70884b7640 1 Processor -- start 2024-09-13T19:19:37.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.464+0000 7f70884b7640 1 -- start start 2024-09-13T19:19:37.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.464+0000 7f70884b7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f708006eda0 0x7f70801293b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:37.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.464+0000 7f70884b7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f708006fcd0 con 0x7f708006eda0 2024-09-13T19:19:37.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.464+0000 7f7086253640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f708006eda0 0x7f70801293b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:37.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.464+0000 7f7086253640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f708006eda0 0x7f70801293b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44926/0 (socket says 172.21.15.53:44926) 2024-09-13T19:19:37.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.464+0000 7f7086253640 1 -- 172.21.15.53:0/2745541084 learned_addr learned my addr 172.21.15.53:0/2745541084 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:19:37.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.464+0000 7f7086253640 1 -- 172.21.15.53:0/2745541084 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70801288f0 con 0x7f708006eda0 2024-09-13T19:19:37.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.464+0000 7f7086253640 1 --2- 172.21.15.53:0/2745541084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f708006eda0 0x7f70801293b0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f707c00c420 tx=0x7f707c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:37.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.465+0000 7f7076ffd640 1 -- 172.21.15.53:0/2745541084 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f707c018070 con 0x7f708006eda0 2024-09-13T19:19:37.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.465+0000 7f7076ffd640 1 -- 172.21.15.53:0/2745541084 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f707c0074d0 con 0x7f708006eda0 2024-09-13T19:19:37.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.465+0000 7f70884b7640 1 -- 172.21.15.53:0/2745541084 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7080128040 con 0x7f708006eda0 2024-09-13T19:19:37.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.465+0000 7f7076ffd640 1 -- 172.21.15.53:0/2745541084 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f707c004950 con 0x7f708006eda0 2024-09-13T19:19:37.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.465+0000 7f70884b7640 1 -- 172.21.15.53:0/2745541084 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f708012b910 con 0x7f708006eda0 2024-09-13T19:19:37.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.466+0000 7f7076ffd640 1 -- 172.21.15.53:0/2745541084 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f707c01b070 con 0x7f708006eda0 2024-09-13T19:19:37.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.466+0000 7f70884b7640 1 -- 172.21.15.53:0/2745541084 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f708006f180 con 0x7f708006eda0 2024-09-13T19:19:37.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.466+0000 7f7076ffd640 1 --2- 172.21.15.53:0/2745541084 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f70640382a0 0x7f706403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:37.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.466+0000 7f7076ffd640 1 -- 172.21.15.53:0/2745541084 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f707c04b0c0 con 0x7f708006eda0 2024-09-13T19:19:37.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.466+0000 7f7085a52640 1 --2- 172.21.15.53:0/2745541084 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f70640382a0 0x7f706403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:37.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.467+0000 7f7085a52640 1 --2- 172.21.15.53:0/2745541084 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f70640382a0 0x7f706403a760 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7070034000 tx=0x7f707002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:37.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.471+0000 7f7076ffd640 1 -- 172.21.15.53:0/2745541084 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f707c011980 con 0x7f708006eda0 2024-09-13T19:19:37.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.644+0000 7f70884b7640 1 -- 172.21.15.53:0/2745541084 --> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f708012ac70 con 0x7f70640382a0 2024-09-13T19:19:37.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.658+0000 7f7076ffd640 1 -- 172.21.15.53:0/2745541084 <== mgr.4098 v2:172.21.15.102:6824/4283826432 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+658814 (secure 0 0 0) 0x7f708012ac70 con 0x7f70640382a0 2024-09-13T19:19:37.669 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:19:37.674 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T19:19:37.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.663+0000 7f70884b7640 1 -- 172.21.15.53:0/2745541084 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f70640382a0 msgr2=0x7f706403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:37.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.663+0000 7f70884b7640 1 --2- 172.21.15.53:0/2745541084 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f70640382a0 0x7f706403a760 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7070034000 tx=0x7f707002e000 comp rx=0 tx=0).stop 2024-09-13T19:19:37.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.663+0000 7f70884b7640 1 -- 172.21.15.53:0/2745541084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f708006eda0 msgr2=0x7f70801293b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:37.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.663+0000 7f70884b7640 1 --2- 172.21.15.53:0/2745541084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f708006eda0 0x7f70801293b0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f707c00c420 tx=0x7f707c00c8e0 comp rx=0 tx=0).stop 2024-09-13T19:19:37.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.663+0000 7f70884b7640 1 -- 172.21.15.53:0/2745541084 shutdown_connections 2024-09-13T19:19:37.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.663+0000 7f70884b7640 1 --2- 172.21.15.53:0/2745541084 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f70640382a0 0x7f706403a760 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:37.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.663+0000 7f70884b7640 1 --2- 172.21.15.53:0/2745541084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f708006eda0 0x7f70801293b0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:37.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.663+0000 7f70884b7640 1 -- 172.21.15.53:0/2745541084 >> 172.21.15.53:0/2745541084 conn(0x7f708009a890 msgr2=0x7f708006d910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:19:37.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.663+0000 7f70884b7640 1 -- 172.21.15.53:0/2745541084 shutdown_connections 2024-09-13T19:19:37.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:37.663+0000 7f70884b7640 1 -- 172.21.15.53:0/2745541084 wait complete. 2024-09-13T19:19:37.678 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":153,"stamp":"2024-09-13T19:19:36.976606+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5083,"num_read_kb":4664,"num_write":2179,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2342,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4730,"ondisk_log_size":4730,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148512,"kb_used_data":2976,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377338848,"statfs":{"total":386547056640,"available":386394980352,"internally_reserved":0,"allocated":3047424,"data_stored":1807960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":148956951},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1204,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004410"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.939728+0000","last_change":"2024-09-13T19:15:55.897703+0000","last_active":"2024-09-13T19:18:03.939728+0000","last_peered":"2024-09-13T19:18:03.939728+0000","last_clean":"2024-09-13T19:18:03.939728+0000","last_became_active":"2024-09-13T19:15:55.897392+0000","last_became_peered":"2024-09-13T19:15:55.897392+0000","last_unstale":"2024-09-13T19:18:03.939728+0000","last_undegraded":"2024-09-13T19:18:03.939728+0000","last_fullsized":"2024-09-13T19:18:03.939728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"36'8","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.969344+0000","last_change":"2024-09-13T19:15:57.889239+0000","last_active":"2024-09-13T19:19:05.969344+0000","last_peered":"2024-09-13T19:19:05.969344+0000","last_clean":"2024-09-13T19:19:05.969344+0000","last_became_active":"2024-09-13T19:15:57.888352+0000","last_became_peered":"2024-09-13T19:15:57.888352+0000","last_unstale":"2024-09-13T19:19:05.969344+0000","last_undegraded":"2024-09-13T19:19:05.969344+0000","last_fullsized":"2024-09-13T19:19:05.969344+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"34'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:01.934985+0000","last_change":"2024-09-13T19:15:55.896090+0000","last_active":"2024-09-13T19:18:01.934985+0000","last_peered":"2024-09-13T19:18:01.934985+0000","last_clean":"2024-09-13T19:18:01.934985+0000","last_became_active":"2024-09-13T19:15:55.894768+0000","last_became_peered":"2024-09-13T19:15:55.894768+0000","last_unstale":"2024-09-13T19:18:01.934985+0000","last_undegraded":"2024-09-13T19:18:01.934985+0000","last_fullsized":"2024-09-13T19:18:01.934985+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"36'6","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.064737+0000","last_change":"2024-09-13T19:15:57.895729+0000","last_active":"2024-09-13T19:19:06.064737+0000","last_peered":"2024-09-13T19:19:06.064737+0000","last_clean":"2024-09-13T19:19:06.064737+0000","last_became_active":"2024-09-13T19:15:57.895424+0000","last_became_peered":"2024-09-13T19:15:57.895424+0000","last_unstale":"2024-09-13T19:19:06.064737+0000","last_undegraded":"2024-09-13T19:19:06.064737+0000","last_fullsized":"2024-09-13T19:19:06.064737+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.940353+0000","last_change":"2024-09-13T19:15:55.900265+0000","last_active":"2024-09-13T19:18:03.940353+0000","last_peered":"2024-09-13T19:18:03.940353+0000","last_clean":"2024-09-13T19:18:03.940353+0000","last_became_active":"2024-09-13T19:15:55.899965+0000","last_became_peered":"2024-09-13T19:15:55.899965+0000","last_unstale":"2024-09-13T19:18:03.940353+0000","last_undegraded":"2024-09-13T19:18:03.940353+0000","last_fullsized":"2024-09-13T19:18:03.940353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"36'13","reported_seq":71,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.064006+0000","last_change":"2024-09-13T19:15:57.895266+0000","last_active":"2024-09-13T19:19:06.064006+0000","last_peered":"2024-09-13T19:19:06.064006+0000","last_clean":"2024-09-13T19:19:06.064006+0000","last_became_active":"2024-09-13T19:15:57.894955+0000","last_became_peered":"2024-09-13T19:15:57.894955+0000","last_unstale":"2024-09-13T19:19:06.064006+0000","last_undegraded":"2024-09-13T19:19:06.064006+0000","last_fullsized":"2024-09-13T19:19:06.064006+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:58.939021+0000","last_change":"2024-09-13T19:15:55.890339+0000","last_active":"2024-09-13T19:17:58.939021+0000","last_peered":"2024-09-13T19:17:58.939021+0000","last_clean":"2024-09-13T19:17:58.939021+0000","last_became_active":"2024-09-13T19:15:55.889830+0000","last_became_peered":"2024-09-13T19:15:55.889830+0000","last_unstale":"2024-09-13T19:17:58.939021+0000","last_undegraded":"2024-09-13T19:17:58.939021+0000","last_fullsized":"2024-09-13T19:17:58.939021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.705273+0000","last_change":"2024-09-13T19:15:57.895013+0000","last_active":"2024-09-13T19:19:05.705273+0000","last_peered":"2024-09-13T19:19:05.705273+0000","last_clean":"2024-09-13T19:19:05.705273+0000","last_became_active":"2024-09-13T19:15:57.894733+0000","last_became_peered":"2024-09-13T19:15:57.894733+0000","last_unstale":"2024-09-13T19:19:05.705273+0000","last_undegraded":"2024-09-13T19:19:05.705273+0000","last_fullsized":"2024-09-13T19:19:05.705273+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"36'4","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.793620+0000","last_change":"2024-09-13T19:15:55.895687+0000","last_active":"2024-09-13T19:19:12.793620+0000","last_peered":"2024-09-13T19:19:12.793620+0000","last_clean":"2024-09-13T19:19:12.793620+0000","last_became_active":"2024-09-13T19:15:55.895362+0000","last_became_peered":"2024-09-13T19:15:55.895362+0000","last_unstale":"2024-09-13T19:19:12.793620+0000","last_undegraded":"2024-09-13T19:19:12.793620+0000","last_fullsized":"2024-09-13T19:19:12.793620+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"36'8","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.601209+0000","last_change":"2024-09-13T19:15:57.889968+0000","last_active":"2024-09-13T19:19:05.601209+0000","last_peered":"2024-09-13T19:19:05.601209+0000","last_clean":"2024-09-13T19:19:05.601209+0000","last_became_active":"2024-09-13T19:15:57.889664+0000","last_became_peered":"2024-09-13T19:15:57.889664+0000","last_unstale":"2024-09-13T19:19:05.601209+0000","last_undegraded":"2024-09-13T19:19:05.601209+0000","last_fullsized":"2024-09-13T19:19:05.601209+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"36'4","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.839121+0000","last_change":"2024-09-13T19:15:55.890058+0000","last_active":"2024-09-13T19:19:05.839121+0000","last_peered":"2024-09-13T19:19:05.839121+0000","last_clean":"2024-09-13T19:19:05.839121+0000","last_became_active":"2024-09-13T19:15:55.889485+0000","last_became_peered":"2024-09-13T19:15:55.889485+0000","last_unstale":"2024-09-13T19:19:05.839121+0000","last_undegraded":"2024-09-13T19:19:05.839121+0000","last_fullsized":"2024-09-13T19:19:05.839121+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.940306+0000","last_change":"2024-09-13T19:15:57.901409+0000","last_active":"2024-09-13T19:18:03.940306+0000","last_peered":"2024-09-13T19:18:03.940306+0000","last_clean":"2024-09-13T19:18:03.940306+0000","last_became_active":"2024-09-13T19:15:57.900785+0000","last_became_peered":"2024-09-13T19:15:57.900785+0000","last_unstale":"2024-09-13T19:18:03.940306+0000","last_undegraded":"2024-09-13T19:18:03.940306+0000","last_fullsized":"2024-09-13T19:18:03.940306+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.796442+0000","last_change":"2024-09-13T19:15:55.898268+0000","last_active":"2024-09-13T19:19:12.796442+0000","last_peered":"2024-09-13T19:19:12.796442+0000","last_clean":"2024-09-13T19:19:12.796442+0000","last_became_active":"2024-09-13T19:15:55.897381+0000","last_became_peered":"2024-09-13T19:15:55.897381+0000","last_unstale":"2024-09-13T19:19:12.796442+0000","last_undegraded":"2024-09-13T19:19:12.796442+0000","last_fullsized":"2024-09-13T19:19:12.796442+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"36'16","reported_seq":91,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.851499+0000","last_change":"2024-09-13T19:15:57.893695+0000","last_active":"2024-09-13T19:19:05.851499+0000","last_peered":"2024-09-13T19:19:05.851499+0000","last_clean":"2024-09-13T19:19:05.851499+0000","last_became_active":"2024-09-13T19:15:57.893408+0000","last_became_peered":"2024-09-13T19:15:57.893408+0000","last_unstale":"2024-09-13T19:19:05.851499+0000","last_undegraded":"2024-09-13T19:19:05.851499+0000","last_fullsized":"2024-09-13T19:19:05.851499+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.793788+0000","last_change":"2024-09-13T19:15:55.901574+0000","last_active":"2024-09-13T19:19:12.793788+0000","last_peered":"2024-09-13T19:19:12.793788+0000","last_clean":"2024-09-13T19:19:12.793788+0000","last_became_active":"2024-09-13T19:15:55.901190+0000","last_became_peered":"2024-09-13T19:15:55.901190+0000","last_unstale":"2024-09-13T19:19:12.793788+0000","last_undegraded":"2024-09-13T19:19:12.793788+0000","last_fullsized":"2024-09-13T19:19:12.793788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"36'16","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.854176+0000","last_change":"2024-09-13T19:15:57.898655+0000","last_active":"2024-09-13T19:19:05.854176+0000","last_peered":"2024-09-13T19:19:05.854176+0000","last_clean":"2024-09-13T19:19:05.854176+0000","last_became_active":"2024-09-13T19:15:57.898325+0000","last_became_peered":"2024-09-13T19:15:57.898325+0000","last_unstale":"2024-09-13T19:19:05.854176+0000","last_undegraded":"2024-09-13T19:19:05.854176+0000","last_fullsized":"2024-09-13T19:19:05.854176+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":52,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"36'4","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.854247+0000","last_change":"2024-09-13T19:15:57.890027+0000","last_active":"2024-09-13T19:19:05.854247+0000","last_peered":"2024-09-13T19:19:05.854247+0000","last_clean":"2024-09-13T19:19:05.854247+0000","last_became_active":"2024-09-13T19:15:57.887144+0000","last_became_peered":"2024-09-13T19:15:57.887144+0000","last_unstale":"2024-09-13T19:19:05.854247+0000","last_undegraded":"2024-09-13T19:19:05.854247+0000","last_fullsized":"2024-09-13T19:19:05.854247+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.799205+0000","last_change":"2024-09-13T19:15:55.896889+0000","last_active":"2024-09-13T19:19:12.799205+0000","last_peered":"2024-09-13T19:19:12.799205+0000","last_clean":"2024-09-13T19:19:12.799205+0000","last_became_active":"2024-09-13T19:15:55.895552+0000","last_became_peered":"2024-09-13T19:15:55.895552+0000","last_unstale":"2024-09-13T19:19:12.799205+0000","last_undegraded":"2024-09-13T19:19:12.799205+0000","last_fullsized":"2024-09-13T19:19:12.799205+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"36'8","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.968823+0000","last_change":"2024-09-13T19:15:57.889071+0000","last_active":"2024-09-13T19:19:05.968823+0000","last_peered":"2024-09-13T19:19:05.968823+0000","last_clean":"2024-09-13T19:19:05.968823+0000","last_became_active":"2024-09-13T19:15:57.886511+0000","last_became_peered":"2024-09-13T19:15:57.886511+0000","last_unstale":"2024-09-13T19:19:05.968823+0000","last_undegraded":"2024-09-13T19:19:05.968823+0000","last_fullsized":"2024-09-13T19:19:05.968823+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:23.942873+0000","last_change":"2024-09-13T19:15:55.898694+0000","last_active":"2024-09-13T19:18:23.942873+0000","last_peered":"2024-09-13T19:18:23.942873+0000","last_clean":"2024-09-13T19:18:23.942873+0000","last_became_active":"2024-09-13T19:15:55.896952+0000","last_became_peered":"2024-09-13T19:15:55.896952+0000","last_unstale":"2024-09-13T19:18:23.942873+0000","last_undegraded":"2024-09-13T19:18:23.942873+0000","last_fullsized":"2024-09-13T19:18:23.942873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"36'8","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.968826+0000","last_change":"2024-09-13T19:15:57.891691+0000","last_active":"2024-09-13T19:19:05.968826+0000","last_peered":"2024-09-13T19:19:05.968826+0000","last_clean":"2024-09-13T19:19:05.968826+0000","last_became_active":"2024-09-13T19:15:57.891411+0000","last_became_peered":"2024-09-13T19:15:57.891411+0000","last_unstale":"2024-09-13T19:19:05.968826+0000","last_undegraded":"2024-09-13T19:19:05.968826+0000","last_fullsized":"2024-09-13T19:19:05.968826+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:23.942911+0000","last_change":"2024-09-13T19:15:55.896710+0000","last_active":"2024-09-13T19:18:23.942911+0000","last_peered":"2024-09-13T19:18:23.942911+0000","last_clean":"2024-09-13T19:18:23.942911+0000","last_became_active":"2024-09-13T19:15:55.895453+0000","last_became_peered":"2024-09-13T19:15:55.895453+0000","last_unstale":"2024-09-13T19:18:23.942911+0000","last_undegraded":"2024-09-13T19:18:23.942911+0000","last_fullsized":"2024-09-13T19:18:23.942911+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"36'8","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.708671+0000","last_change":"2024-09-13T19:15:57.896559+0000","last_active":"2024-09-13T19:19:05.708671+0000","last_peered":"2024-09-13T19:19:05.708671+0000","last_clean":"2024-09-13T19:19:05.708671+0000","last_became_active":"2024-09-13T19:15:57.896208+0000","last_became_peered":"2024-09-13T19:15:57.896208+0000","last_unstale":"2024-09-13T19:19:05.708671+0000","last_undegraded":"2024-09-13T19:19:05.708671+0000","last_fullsized":"2024-09-13T19:19:05.708671+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:23.942886+0000","last_change":"2024-09-13T19:15:55.892927+0000","last_active":"2024-09-13T19:18:23.942886+0000","last_peered":"2024-09-13T19:18:23.942886+0000","last_clean":"2024-09-13T19:18:23.942886+0000","last_became_active":"2024-09-13T19:15:55.892616+0000","last_became_peered":"2024-09-13T19:15:55.892616+0000","last_unstale":"2024-09-13T19:18:23.942886+0000","last_undegraded":"2024-09-13T19:18:23.942886+0000","last_fullsized":"2024-09-13T19:18:23.942886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"36'2","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:23.942761+0000","last_change":"2024-09-13T19:15:57.897850+0000","last_active":"2024-09-13T19:18:23.942761+0000","last_peered":"2024-09-13T19:18:23.942761+0000","last_clean":"2024-09-13T19:18:23.942761+0000","last_became_active":"2024-09-13T19:15:57.897566+0000","last_became_peered":"2024-09-13T19:15:57.897566+0000","last_unstale":"2024-09-13T19:18:23.942761+0000","last_undegraded":"2024-09-13T19:18:23.942761+0000","last_fullsized":"2024-09-13T19:18:23.942761+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:21.938320+0000","last_change":"2024-09-13T19:15:55.894579+0000","last_active":"2024-09-13T19:18:21.938320+0000","last_peered":"2024-09-13T19:18:21.938320+0000","last_clean":"2024-09-13T19:18:21.938320+0000","last_became_active":"2024-09-13T19:15:55.893594+0000","last_became_peered":"2024-09-13T19:15:55.893594+0000","last_unstale":"2024-09-13T19:18:21.938320+0000","last_undegraded":"2024-09-13T19:18:21.938320+0000","last_fullsized":"2024-09-13T19:18:21.938320+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"36'6","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.848555+0000","last_change":"2024-09-13T19:15:57.890303+0000","last_active":"2024-09-13T19:19:05.848555+0000","last_peered":"2024-09-13T19:19:05.848555+0000","last_clean":"2024-09-13T19:19:05.848555+0000","last_became_active":"2024-09-13T19:15:57.889901+0000","last_became_peered":"2024-09-13T19:15:57.889901+0000","last_unstale":"2024-09-13T19:19:05.848555+0000","last_undegraded":"2024-09-13T19:19:05.848555+0000","last_fullsized":"2024-09-13T19:19:05.848555+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:18.942707+0000","last_change":"2024-09-13T19:15:55.899097+0000","last_active":"2024-09-13T19:18:18.942707+0000","last_peered":"2024-09-13T19:18:18.942707+0000","last_clean":"2024-09-13T19:18:18.942707+0000","last_became_active":"2024-09-13T19:15:55.898679+0000","last_became_peered":"2024-09-13T19:15:55.898679+0000","last_unstale":"2024-09-13T19:18:18.942707+0000","last_undegraded":"2024-09-13T19:18:18.942707+0000","last_fullsized":"2024-09-13T19:18:18.942707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"36'35","reported_seq":100,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.978025+0000","last_change":"2024-09-13T19:16:05.921753+0000","last_active":"2024-09-13T19:19:05.978025+0000","last_peered":"2024-09-13T19:19:05.978025+0000","last_clean":"2024-09-13T19:19:05.978025+0000","last_became_active":"2024-09-13T19:16:05.921156+0000","last_became_peered":"2024-09-13T19:16:05.921156+0000","last_unstale":"2024-09-13T19:19:05.978025+0000","last_undegraded":"2024-09-13T19:19:05.978025+0000","last_fullsized":"2024-09-13T19:19:05.978025+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"36'6","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.601778+0000","last_change":"2024-09-13T19:15:57.897717+0000","last_active":"2024-09-13T19:19:05.601778+0000","last_peered":"2024-09-13T19:19:05.601778+0000","last_clean":"2024-09-13T19:19:05.601778+0000","last_became_active":"2024-09-13T19:15:57.895870+0000","last_became_peered":"2024-09-13T19:15:57.895870+0000","last_unstale":"2024-09-13T19:19:05.601778+0000","last_undegraded":"2024-09-13T19:19:05.601778+0000","last_fullsized":"2024-09-13T19:19:05.601778+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:18.942743+0000","last_change":"2024-09-13T19:15:55.895213+0000","last_active":"2024-09-13T19:18:18.942743+0000","last_peered":"2024-09-13T19:18:18.942743+0000","last_clean":"2024-09-13T19:18:18.942743+0000","last_became_active":"2024-09-13T19:15:55.894099+0000","last_became_peered":"2024-09-13T19:15:55.894099+0000","last_unstale":"2024-09-13T19:18:18.942743+0000","last_undegraded":"2024-09-13T19:18:18.942743+0000","last_fullsized":"2024-09-13T19:18:18.942743+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:20.089068+0000","last_change":"2024-09-13T19:19:20.089107+0000","last_active":"2024-09-13T19:19:20.089068+0000","last_peered":"2024-09-13T19:19:20.089068+0000","last_clean":"2024-09-13T19:19:20.089068+0000","last_became_active":"2024-09-13T19:15:59.896648+0000","last_became_peered":"2024-09-13T19:15:59.896648+0000","last_unstale":"2024-09-13T19:19:20.089068+0000","last_undegraded":"2024-09-13T19:19:20.089068+0000","last_fullsized":"2024-09-13T19:19:20.089068+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:20.088934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:20.088934+0000","last_clean_scrub_stamp":"2024-09-13T19:19:20.088934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:25.257454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"36'33","reported_seq":80,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.728690+0000","last_change":"2024-09-13T19:16:01.907027+0000","last_active":"2024-09-13T19:19:12.728690+0000","last_peered":"2024-09-13T19:19:12.728690+0000","last_clean":"2024-09-13T19:19:12.728690+0000","last_became_active":"2024-09-13T19:16:01.906675+0000","last_became_peered":"2024-09-13T19:16:01.906675+0000","last_unstale":"2024-09-13T19:19:12.728690+0000","last_undegraded":"2024-09-13T19:19:12.728690+0000","last_fullsized":"2024-09-13T19:19:12.728690+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:28.943693+0000","last_change":"2024-09-13T19:16:03.914490+0000","last_active":"2024-09-13T19:18:28.943693+0000","last_peered":"2024-09-13T19:18:28.943693+0000","last_clean":"2024-09-13T19:18:28.943693+0000","last_became_active":"2024-09-13T19:16:03.914111+0000","last_became_peered":"2024-09-13T19:16:03.914111+0000","last_unstale":"2024-09-13T19:18:28.943693+0000","last_undegraded":"2024-09-13T19:18:28.943693+0000","last_fullsized":"2024-09-13T19:18:28.943693+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"36'7","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:33.944238+0000","last_change":"2024-09-13T19:16:05.925198+0000","last_active":"2024-09-13T19:18:33.944238+0000","last_peered":"2024-09-13T19:18:33.944238+0000","last_clean":"2024-09-13T19:18:33.944238+0000","last_became_active":"2024-09-13T19:16:05.924829+0000","last_became_peered":"2024-09-13T19:16:05.924829+0000","last_unstale":"2024-09-13T19:18:33.944238+0000","last_undegraded":"2024-09-13T19:18:33.944238+0000","last_fullsized":"2024-09-13T19:18:33.944238+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"36'10","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.929537+0000","last_change":"2024-09-13T19:15:57.898414+0000","last_active":"2024-09-13T19:19:05.929537+0000","last_peered":"2024-09-13T19:19:05.929537+0000","last_clean":"2024-09-13T19:19:05.929537+0000","last_became_active":"2024-09-13T19:15:57.897928+0000","last_became_peered":"2024-09-13T19:15:57.897928+0000","last_unstale":"2024-09-13T19:19:05.929537+0000","last_undegraded":"2024-09-13T19:19:05.929537+0000","last_fullsized":"2024-09-13T19:19:05.929537+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:18.941961+0000","last_change":"2024-09-13T19:15:55.892255+0000","last_active":"2024-09-13T19:18:18.941961+0000","last_peered":"2024-09-13T19:18:18.941961+0000","last_clean":"2024-09-13T19:18:18.941961+0000","last_became_active":"2024-09-13T19:15:55.891934+0000","last_became_peered":"2024-09-13T19:15:55.891934+0000","last_unstale":"2024-09-13T19:18:18.941961+0000","last_undegraded":"2024-09-13T19:18:18.941961+0000","last_fullsized":"2024-09-13T19:18:18.941961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:21.938344+0000","last_change":"2024-09-13T19:15:59.892496+0000","last_active":"2024-09-13T19:18:21.938344+0000","last_peered":"2024-09-13T19:18:21.938344+0000","last_clean":"2024-09-13T19:18:21.938344+0000","last_became_active":"2024-09-13T19:15:59.892230+0000","last_became_peered":"2024-09-13T19:15:59.892230+0000","last_unstale":"2024-09-13T19:18:21.938344+0000","last_undegraded":"2024-09-13T19:18:21.938344+0000","last_fullsized":"2024-09-13T19:18:21.938344+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"36'11","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:20.693227+0000","last_change":"2024-09-13T19:19:20.693258+0000","last_active":"2024-09-13T19:19:20.693227+0000","last_peered":"2024-09-13T19:19:20.693227+0000","last_clean":"2024-09-13T19:19:20.693227+0000","last_became_active":"2024-09-13T19:16:01.903371+0000","last_became_peered":"2024-09-13T19:16:01.903371+0000","last_unstale":"2024-09-13T19:19:20.693227+0000","last_undegraded":"2024-09-13T19:19:20.693227+0000","last_fullsized":"2024-09-13T19:19:20.693227+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'11","last_scrub_stamp":"2024-09-13T19:19:20.693140+0000","last_deep_scrub":"36'11","last_deep_scrub_stamp":"2024-09-13T19:19:20.693140+0000","last_clean_scrub_stamp":"2024-09-13T19:19:20.693140+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:19.872266+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:28.943663+0000","last_change":"2024-09-13T19:16:03.915815+0000","last_active":"2024-09-13T19:18:28.943663+0000","last_peered":"2024-09-13T19:18:28.943663+0000","last_clean":"2024-09-13T19:18:28.943663+0000","last_became_active":"2024-09-13T19:16:03.915538+0000","last_became_peered":"2024-09-13T19:16:03.915538+0000","last_unstale":"2024-09-13T19:18:28.943663+0000","last_undegraded":"2024-09-13T19:18:28.943663+0000","last_fullsized":"2024-09-13T19:18:28.943663+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"34'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:36.940451+0000","last_change":"2024-09-13T19:16:05.911958+0000","last_active":"2024-09-13T19:18:36.940451+0000","last_peered":"2024-09-13T19:18:36.940451+0000","last_clean":"2024-09-13T19:18:36.940451+0000","last_became_active":"2024-09-13T19:16:05.911683+0000","last_became_peered":"2024-09-13T19:16:05.911683+0000","last_unstale":"2024-09-13T19:18:36.940451+0000","last_undegraded":"2024-09-13T19:18:36.940451+0000","last_fullsized":"2024-09-13T19:18:36.940451+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"36'4","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.929834+0000","last_change":"2024-09-13T19:15:57.897213+0000","last_active":"2024-09-13T19:19:05.929834+0000","last_peered":"2024-09-13T19:19:05.929834+0000","last_clean":"2024-09-13T19:19:05.929834+0000","last_became_active":"2024-09-13T19:15:57.896965+0000","last_became_peered":"2024-09-13T19:15:57.896965+0000","last_unstale":"2024-09-13T19:19:05.929834+0000","last_undegraded":"2024-09-13T19:19:05.929834+0000","last_fullsized":"2024-09-13T19:19:05.929834+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"36'4","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.833100+0000","last_change":"2024-09-13T19:15:55.899327+0000","last_active":"2024-09-13T19:19:05.833100+0000","last_peered":"2024-09-13T19:19:05.833100+0000","last_clean":"2024-09-13T19:19:05.833100+0000","last_became_active":"2024-09-13T19:15:55.895444+0000","last_became_peered":"2024-09-13T19:15:55.895444+0000","last_unstale":"2024-09-13T19:19:05.833100+0000","last_undegraded":"2024-09-13T19:19:05.833100+0000","last_fullsized":"2024-09-13T19:19:05.833100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:35.477880+0000","last_change":"2024-09-13T19:19:35.477903+0000","last_active":"2024-09-13T19:19:35.477880+0000","last_peered":"2024-09-13T19:19:35.477880+0000","last_clean":"2024-09-13T19:19:35.477880+0000","last_became_active":"2024-09-13T19:15:59.895332+0000","last_became_peered":"2024-09-13T19:15:59.895332+0000","last_unstale":"2024-09-13T19:19:35.477880+0000","last_undegraded":"2024-09-13T19:19:35.477880+0000","last_fullsized":"2024-09-13T19:19:35.477880+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:35.477788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:35.477788+0000","last_clean_scrub_stamp":"2024-09-13T19:19:35.477788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:23:52.241441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"36'15","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:25.800975+0000","last_change":"2024-09-13T19:19:25.801012+0000","last_active":"2024-09-13T19:19:25.800975+0000","last_peered":"2024-09-13T19:19:25.800975+0000","last_clean":"2024-09-13T19:19:25.800975+0000","last_became_active":"2024-09-13T19:16:01.905457+0000","last_became_peered":"2024-09-13T19:16:01.905457+0000","last_unstale":"2024-09-13T19:19:25.800975+0000","last_undegraded":"2024-09-13T19:19:25.800975+0000","last_fullsized":"2024-09-13T19:19:25.800975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'15","last_scrub_stamp":"2024-09-13T19:19:25.800877+0000","last_deep_scrub":"36'15","last_deep_scrub_stamp":"2024-09-13T19:19:25.800877+0000","last_clean_scrub_stamp":"2024-09-13T19:19:25.800877+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:36.670597+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"36'285","reported_seq":385,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.820494+0000","last_change":"2024-09-13T19:16:03.917127+0000","last_active":"2024-09-13T19:19:12.820494+0000","last_peered":"2024-09-13T19:19:12.820494+0000","last_clean":"2024-09-13T19:19:12.820494+0000","last_became_active":"2024-09-13T19:16:03.916853+0000","last_became_peered":"2024-09-13T19:16:03.916853+0000","last_unstale":"2024-09-13T19:19:12.820494+0000","last_undegraded":"2024-09-13T19:19:12.820494+0000","last_fullsized":"2024-09-13T19:19:12.820494+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"36'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.966037+0000","last_change":"2024-09-13T19:16:05.912480+0000","last_active":"2024-09-13T19:19:05.966037+0000","last_peered":"2024-09-13T19:19:05.966037+0000","last_clean":"2024-09-13T19:19:05.966037+0000","last_became_active":"2024-09-13T19:16:05.912191+0000","last_became_peered":"2024-09-13T19:16:05.912191+0000","last_unstale":"2024-09-13T19:19:05.966037+0000","last_undegraded":"2024-09-13T19:19:05.966037+0000","last_fullsized":"2024-09-13T19:19:05.966037+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"36'4","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.930011+0000","last_change":"2024-09-13T19:15:57.890567+0000","last_active":"2024-09-13T19:19:05.930011+0000","last_peered":"2024-09-13T19:19:05.930011+0000","last_clean":"2024-09-13T19:19:05.930011+0000","last_became_active":"2024-09-13T19:15:57.890015+0000","last_became_peered":"2024-09-13T19:15:57.890015+0000","last_unstale":"2024-09-13T19:19:05.930011+0000","last_undegraded":"2024-09-13T19:19:05.930011+0000","last_fullsized":"2024-09-13T19:19:05.930011+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:18.941930+0000","last_change":"2024-09-13T19:15:55.894913+0000","last_active":"2024-09-13T19:18:18.941930+0000","last_peered":"2024-09-13T19:18:18.941930+0000","last_clean":"2024-09-13T19:18:18.941930+0000","last_became_active":"2024-09-13T19:15:55.894380+0000","last_became_peered":"2024-09-13T19:15:55.894380+0000","last_unstale":"2024-09-13T19:18:18.941930+0000","last_undegraded":"2024-09-13T19:18:18.941930+0000","last_fullsized":"2024-09-13T19:18:18.941930+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:16.988795+0000","last_change":"2024-09-13T19:19:16.988819+0000","last_active":"2024-09-13T19:19:16.988795+0000","last_peered":"2024-09-13T19:19:16.988795+0000","last_clean":"2024-09-13T19:19:16.988795+0000","last_became_active":"2024-09-13T19:15:59.896572+0000","last_became_peered":"2024-09-13T19:15:59.896572+0000","last_unstale":"2024-09-13T19:19:16.988795+0000","last_undegraded":"2024-09-13T19:19:16.988795+0000","last_fullsized":"2024-09-13T19:19:16.988795+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:16.988701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:16.988701+0000","last_clean_scrub_stamp":"2024-09-13T19:19:16.988701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:14.282330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"36'36","reported_seq":91,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:22.776961+0000","last_change":"2024-09-13T19:19:22.777010+0000","last_active":"2024-09-13T19:19:22.776961+0000","last_peered":"2024-09-13T19:19:22.776961+0000","last_clean":"2024-09-13T19:19:22.776961+0000","last_became_active":"2024-09-13T19:16:01.906471+0000","last_became_peered":"2024-09-13T19:16:01.906471+0000","last_unstale":"2024-09-13T19:19:22.776961+0000","last_undegraded":"2024-09-13T19:19:22.776961+0000","last_fullsized":"2024-09-13T19:19:22.776961+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-13T19:19:22.776859+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-13T19:19:22.776859+0000","last_clean_scrub_stamp":"2024-09-13T19:19:22.776859+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:40.452064+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"36'285","reported_seq":422,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:20.301108+0000","last_change":"2024-09-13T19:19:20.301137+0000","last_active":"2024-09-13T19:19:20.301108+0000","last_peered":"2024-09-13T19:19:20.301108+0000","last_clean":"2024-09-13T19:19:20.301108+0000","last_became_active":"2024-09-13T19:16:03.909046+0000","last_became_peered":"2024-09-13T19:16:03.909046+0000","last_unstale":"2024-09-13T19:19:20.301108+0000","last_undegraded":"2024-09-13T19:19:20.301108+0000","last_fullsized":"2024-09-13T19:19:20.301108+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-13T19:19:20.301016+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-13T19:19:20.301016+0000","last_clean_scrub_stamp":"2024-09-13T19:19:20.301016+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:00.732319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"36'16","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:43.945542+0000","last_change":"2024-09-13T19:16:31.997893+0000","last_active":"2024-09-13T19:18:43.945542+0000","last_peered":"2024-09-13T19:18:43.945542+0000","last_clean":"2024-09-13T19:18:43.945542+0000","last_became_active":"2024-09-13T19:16:31.991055+0000","last_became_peered":"2024-09-13T19:16:31.991055+0000","last_unstale":"2024-09-13T19:18:43.945542+0000","last_undegraded":"2024-09-13T19:18:43.945542+0000","last_fullsized":"2024-09-13T19:18:43.945542+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":73,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:13.941358+0000","last_change":"2024-09-13T19:15:55.893934+0000","last_active":"2024-09-13T19:18:13.941358+0000","last_peered":"2024-09-13T19:18:13.941358+0000","last_clean":"2024-09-13T19:18:13.941358+0000","last_became_active":"2024-09-13T19:15:55.893544+0000","last_became_peered":"2024-09-13T19:15:55.893544+0000","last_unstale":"2024-09-13T19:18:13.941358+0000","last_undegraded":"2024-09-13T19:18:13.941358+0000","last_fullsized":"2024-09-13T19:18:13.941358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:25.690461+0000","last_change":"2024-09-13T19:19:25.690504+0000","last_active":"2024-09-13T19:19:25.690461+0000","last_peered":"2024-09-13T19:19:25.690461+0000","last_clean":"2024-09-13T19:19:25.690461+0000","last_became_active":"2024-09-13T19:15:59.897435+0000","last_became_peered":"2024-09-13T19:15:59.897435+0000","last_unstale":"2024-09-13T19:19:25.690461+0000","last_undegraded":"2024-09-13T19:19:25.690461+0000","last_fullsized":"2024-09-13T19:19:25.690461+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:25.690361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:25.690361+0000","last_clean_scrub_stamp":"2024-09-13T19:19:25.690361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:23:10.242794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"36'52","reported_seq":112,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:26.852857+0000","last_change":"2024-09-13T19:19:26.852897+0000","last_active":"2024-09-13T19:19:26.852857+0000","last_peered":"2024-09-13T19:19:26.852857+0000","last_clean":"2024-09-13T19:19:26.852857+0000","last_became_active":"2024-09-13T19:16:01.904454+0000","last_became_peered":"2024-09-13T19:16:01.904454+0000","last_unstale":"2024-09-13T19:19:26.852857+0000","last_undegraded":"2024-09-13T19:19:26.852857+0000","last_fullsized":"2024-09-13T19:19:26.852857+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'52","last_scrub_stamp":"2024-09-13T19:19:26.852772+0000","last_deep_scrub":"36'52","last_deep_scrub_stamp":"2024-09-13T19:19:26.852772+0000","last_clean_scrub_stamp":"2024-09-13T19:19:26.852772+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:51.100890+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:25.339833+0000","last_change":"2024-09-13T19:19:25.339857+0000","last_active":"2024-09-13T19:19:25.339833+0000","last_peered":"2024-09-13T19:19:25.339833+0000","last_clean":"2024-09-13T19:19:25.339833+0000","last_became_active":"2024-09-13T19:16:03.912383+0000","last_became_peered":"2024-09-13T19:16:03.912383+0000","last_unstale":"2024-09-13T19:19:25.339833+0000","last_undegraded":"2024-09-13T19:19:25.339833+0000","last_fullsized":"2024-09-13T19:19:25.339833+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:25.339734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:25.339734+0000","last_clean_scrub_stamp":"2024-09-13T19:19:25.339734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:29.120530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"36'5","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:13.941213+0000","last_change":"2024-09-13T19:16:05.919436+0000","last_active":"2024-09-13T19:18:13.941213+0000","last_peered":"2024-09-13T19:18:13.941213+0000","last_clean":"2024-09-13T19:18:13.941213+0000","last_became_active":"2024-09-13T19:16:05.919154+0000","last_became_peered":"2024-09-13T19:16:05.919154+0000","last_unstale":"2024-09-13T19:18:13.941213+0000","last_undegraded":"2024-09-13T19:18:13.941213+0000","last_fullsized":"2024-09-13T19:18:13.941213+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"36'3","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.063710+0000","last_change":"2024-09-13T19:15:57.890834+0000","last_active":"2024-09-13T19:19:06.063710+0000","last_peered":"2024-09-13T19:19:06.063710+0000","last_clean":"2024-09-13T19:19:06.063710+0000","last_became_active":"2024-09-13T19:15:57.890345+0000","last_became_peered":"2024-09-13T19:15:57.890345+0000","last_unstale":"2024-09-13T19:19:06.063710+0000","last_undegraded":"2024-09-13T19:19:06.063710+0000","last_fullsized":"2024-09-13T19:19:06.063710+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.836073+0000","last_change":"2024-09-13T19:15:55.891871+0000","last_active":"2024-09-13T19:19:05.836073+0000","last_peered":"2024-09-13T19:19:05.836073+0000","last_clean":"2024-09-13T19:19:05.836073+0000","last_became_active":"2024-09-13T19:15:55.891250+0000","last_became_peered":"2024-09-13T19:15:55.891250+0000","last_unstale":"2024-09-13T19:19:05.836073+0000","last_undegraded":"2024-09-13T19:19:05.836073+0000","last_fullsized":"2024-09-13T19:19:05.836073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:11.936616+0000","last_change":"2024-09-13T19:15:59.891252+0000","last_active":"2024-09-13T19:18:11.936616+0000","last_peered":"2024-09-13T19:18:11.936616+0000","last_clean":"2024-09-13T19:18:11.936616+0000","last_became_active":"2024-09-13T19:15:59.891028+0000","last_became_peered":"2024-09-13T19:15:59.891028+0000","last_unstale":"2024-09-13T19:18:11.936616+0000","last_undegraded":"2024-09-13T19:18:11.936616+0000","last_fullsized":"2024-09-13T19:18:11.936616+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"36'36","reported_seq":91,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:29.094496+0000","last_change":"2024-09-13T19:19:29.094550+0000","last_active":"2024-09-13T19:19:29.094496+0000","last_peered":"2024-09-13T19:19:29.094496+0000","last_clean":"2024-09-13T19:19:29.094496+0000","last_became_active":"2024-09-13T19:16:01.904534+0000","last_became_peered":"2024-09-13T19:16:01.904534+0000","last_unstale":"2024-09-13T19:19:29.094496+0000","last_undegraded":"2024-09-13T19:19:29.094496+0000","last_fullsized":"2024-09-13T19:19:29.094496+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-13T19:19:29.094383+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-13T19:19:29.094383+0000","last_clean_scrub_stamp":"2024-09-13T19:19:29.094383+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:28:19.264538+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:33.431802+0000","last_change":"2024-09-13T19:19:33.431831+0000","last_active":"2024-09-13T19:19:33.431802+0000","last_peered":"2024-09-13T19:19:33.431802+0000","last_clean":"2024-09-13T19:19:33.431802+0000","last_became_active":"2024-09-13T19:16:03.913829+0000","last_became_peered":"2024-09-13T19:16:03.913829+0000","last_unstale":"2024-09-13T19:19:33.431802+0000","last_undegraded":"2024-09-13T19:19:33.431802+0000","last_fullsized":"2024-09-13T19:19:33.431802+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:33.431688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:33.431688+0000","last_clean_scrub_stamp":"2024-09-13T19:19:33.431688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:40:42.508968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"36'3","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:13.941355+0000","last_change":"2024-09-13T19:16:05.913878+0000","last_active":"2024-09-13T19:18:13.941355+0000","last_peered":"2024-09-13T19:18:13.941355+0000","last_clean":"2024-09-13T19:18:13.941355+0000","last_became_active":"2024-09-13T19:16:05.913578+0000","last_became_peered":"2024-09-13T19:16:05.913578+0000","last_unstale":"2024-09-13T19:18:13.941355+0000","last_undegraded":"2024-09-13T19:18:13.941355+0000","last_fullsized":"2024-09-13T19:18:13.941355+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:08.940264+0000","last_change":"2024-09-13T19:15:57.898011+0000","last_active":"2024-09-13T19:18:08.940264+0000","last_peered":"2024-09-13T19:18:08.940264+0000","last_clean":"2024-09-13T19:18:08.940264+0000","last_became_active":"2024-09-13T19:15:57.897468+0000","last_became_peered":"2024-09-13T19:15:57.897468+0000","last_unstale":"2024-09-13T19:18:08.940264+0000","last_undegraded":"2024-09-13T19:18:08.940264+0000","last_fullsized":"2024-09-13T19:18:08.940264+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:13.941963+0000","last_change":"2024-09-13T19:15:55.893786+0000","last_active":"2024-09-13T19:18:13.941963+0000","last_peered":"2024-09-13T19:18:13.941963+0000","last_clean":"2024-09-13T19:18:13.941963+0000","last_became_active":"2024-09-13T19:15:55.893489+0000","last_became_peered":"2024-09-13T19:15:55.893489+0000","last_unstale":"2024-09-13T19:18:13.941963+0000","last_undegraded":"2024-09-13T19:18:13.941963+0000","last_fullsized":"2024-09-13T19:18:13.941963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:36.500213+0000","last_change":"2024-09-13T19:19:36.500258+0000","last_active":"2024-09-13T19:19:36.500213+0000","last_peered":"2024-09-13T19:19:36.500213+0000","last_clean":"2024-09-13T19:19:36.500213+0000","last_became_active":"2024-09-13T19:15:59.895291+0000","last_became_peered":"2024-09-13T19:15:59.895291+0000","last_unstale":"2024-09-13T19:19:36.500213+0000","last_undegraded":"2024-09-13T19:19:36.500213+0000","last_fullsized":"2024-09-13T19:19:36.500213+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:36.500113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:36.500113+0000","last_clean_scrub_stamp":"2024-09-13T19:19:36.500113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:16:46.762131+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"36'45","reported_seq":103,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:19.049551+0000","last_change":"2024-09-13T19:19:19.049589+0000","last_active":"2024-09-13T19:19:19.049551+0000","last_peered":"2024-09-13T19:19:19.049551+0000","last_clean":"2024-09-13T19:19:19.049551+0000","last_became_active":"2024-09-13T19:16:01.896507+0000","last_became_peered":"2024-09-13T19:16:01.896507+0000","last_unstale":"2024-09-13T19:19:19.049551+0000","last_undegraded":"2024-09-13T19:19:19.049551+0000","last_fullsized":"2024-09-13T19:19:19.049551+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'45","last_scrub_stamp":"2024-09-13T19:19:19.049456+0000","last_deep_scrub":"36'45","last_deep_scrub_stamp":"2024-09-13T19:19:19.049456+0000","last_clean_scrub_stamp":"2024-09-13T19:19:19.049456+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:40.433022+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"36'285","reported_seq":387,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:21.320872+0000","last_change":"2024-09-13T19:19:21.320904+0000","last_active":"2024-09-13T19:19:21.320872+0000","last_peered":"2024-09-13T19:19:21.320872+0000","last_clean":"2024-09-13T19:19:21.320872+0000","last_became_active":"2024-09-13T19:16:03.910504+0000","last_became_peered":"2024-09-13T19:16:03.910504+0000","last_unstale":"2024-09-13T19:19:21.320872+0000","last_undegraded":"2024-09-13T19:19:21.320872+0000","last_fullsized":"2024-09-13T19:19:21.320872+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-13T19:19:21.320768+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-13T19:19:21.320768+0000","last_clean_scrub_stamp":"2024-09-13T19:19:21.320768+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:21:36.601671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"36'4","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:16.937502+0000","last_change":"2024-09-13T19:16:05.913148+0000","last_active":"2024-09-13T19:18:16.937502+0000","last_peered":"2024-09-13T19:18:16.937502+0000","last_clean":"2024-09-13T19:18:16.937502+0000","last_became_active":"2024-09-13T19:16:05.912881+0000","last_became_peered":"2024-09-13T19:16:05.912881+0000","last_unstale":"2024-09-13T19:18:16.937502+0000","last_undegraded":"2024-09-13T19:18:16.937502+0000","last_fullsized":"2024-09-13T19:18:16.937502+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.708391+0000","last_change":"2024-09-13T19:15:57.884610+0000","last_active":"2024-09-13T19:19:05.708391+0000","last_peered":"2024-09-13T19:19:05.708391+0000","last_clean":"2024-09-13T19:19:05.708391+0000","last_became_active":"2024-09-13T19:15:57.883675+0000","last_became_peered":"2024-09-13T19:15:57.883675+0000","last_unstale":"2024-09-13T19:19:05.708391+0000","last_undegraded":"2024-09-13T19:19:05.708391+0000","last_fullsized":"2024-09-13T19:19:05.708391+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"36'7","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.796438+0000","last_change":"2024-09-13T19:15:55.892801+0000","last_active":"2024-09-13T19:19:12.796438+0000","last_peered":"2024-09-13T19:19:12.796438+0000","last_clean":"2024-09-13T19:19:12.796438+0000","last_became_active":"2024-09-13T19:15:55.891882+0000","last_became_peered":"2024-09-13T19:15:55.891882+0000","last_unstale":"2024-09-13T19:19:12.796438+0000","last_undegraded":"2024-09-13T19:19:12.796438+0000","last_fullsized":"2024-09-13T19:19:12.796438+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":16,"num_write_kb":4722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:43.945589+0000","last_change":"2024-09-13T19:16:31.992973+0000","last_active":"2024-09-13T19:18:43.945589+0000","last_peered":"2024-09-13T19:18:43.945589+0000","last_clean":"2024-09-13T19:18:43.945589+0000","last_became_active":"2024-09-13T19:16:31.992122+0000","last_became_peered":"2024-09-13T19:16:31.992122+0000","last_unstale":"2024-09-13T19:18:43.945589+0000","last_undegraded":"2024-09-13T19:18:43.945589+0000","last_fullsized":"2024-09-13T19:18:43.945589+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"36'61","reported_seq":126,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.789396+0000","last_change":"2024-09-13T19:16:01.906341+0000","last_active":"2024-09-13T19:19:12.789396+0000","last_peered":"2024-09-13T19:19:12.789396+0000","last_clean":"2024-09-13T19:19:12.789396+0000","last_became_active":"2024-09-13T19:16:01.906031+0000","last_became_peered":"2024-09-13T19:16:01.906031+0000","last_unstale":"2024-09-13T19:19:12.789396+0000","last_undegraded":"2024-09-13T19:19:12.789396+0000","last_fullsized":"2024-09-13T19:19:12.789396+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:23.383889+0000","last_change":"2024-09-13T19:19:23.383957+0000","last_active":"2024-09-13T19:19:23.383889+0000","last_peered":"2024-09-13T19:19:23.383889+0000","last_clean":"2024-09-13T19:19:23.383889+0000","last_became_active":"2024-09-13T19:16:03.908134+0000","last_became_peered":"2024-09-13T19:16:03.908134+0000","last_unstale":"2024-09-13T19:19:23.383889+0000","last_undegraded":"2024-09-13T19:19:23.383889+0000","last_fullsized":"2024-09-13T19:19:23.383889+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:23.383782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:23.383782+0000","last_clean_scrub_stamp":"2024-09-13T19:19:23.383782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:10.783386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"36'18","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.186467+0000","last_change":"2024-09-13T19:16:05.915102+0000","last_active":"2024-09-13T19:19:06.186467+0000","last_peered":"2024-09-13T19:19:06.186467+0000","last_clean":"2024-09-13T19:19:06.186467+0000","last_became_active":"2024-09-13T19:16:05.914853+0000","last_became_peered":"2024-09-13T19:16:05.914853+0000","last_unstale":"2024-09-13T19:19:06.186467+0000","last_undegraded":"2024-09-13T19:19:06.186467+0000","last_fullsized":"2024-09-13T19:19:06.186467+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"36'6","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.708810+0000","last_change":"2024-09-13T19:15:57.903310+0000","last_active":"2024-09-13T19:19:05.708810+0000","last_peered":"2024-09-13T19:19:05.708810+0000","last_clean":"2024-09-13T19:19:05.708810+0000","last_became_active":"2024-09-13T19:15:57.902955+0000","last_became_peered":"2024-09-13T19:15:57.902955+0000","last_unstale":"2024-09-13T19:19:05.708810+0000","last_undegraded":"2024-09-13T19:19:05.708810+0000","last_fullsized":"2024-09-13T19:19:05.708810+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:11.936694+0000","last_change":"2024-09-13T19:15:55.891315+0000","last_active":"2024-09-13T19:18:11.936694+0000","last_peered":"2024-09-13T19:18:11.936694+0000","last_clean":"2024-09-13T19:18:11.936694+0000","last_became_active":"2024-09-13T19:15:55.890805+0000","last_became_peered":"2024-09-13T19:15:55.890805+0000","last_unstale":"2024-09-13T19:18:11.936694+0000","last_undegraded":"2024-09-13T19:18:11.936694+0000","last_fullsized":"2024-09-13T19:18:11.936694+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:32.806761+0000","last_change":"2024-09-13T19:19:32.806783+0000","last_active":"2024-09-13T19:19:32.806761+0000","last_peered":"2024-09-13T19:19:32.806761+0000","last_clean":"2024-09-13T19:19:32.806761+0000","last_became_active":"2024-09-13T19:15:59.897884+0000","last_became_peered":"2024-09-13T19:15:59.897884+0000","last_unstale":"2024-09-13T19:19:32.806761+0000","last_undegraded":"2024-09-13T19:19:32.806761+0000","last_fullsized":"2024-09-13T19:19:32.806761+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:32.806649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:32.806649+0000","last_clean_scrub_stamp":"2024-09-13T19:19:32.806649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:35.455381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"36'41","reported_seq":97,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:21.708435+0000","last_change":"2024-09-13T19:19:21.708485+0000","last_active":"2024-09-13T19:19:21.708435+0000","last_peered":"2024-09-13T19:19:21.708435+0000","last_clean":"2024-09-13T19:19:21.708435+0000","last_became_active":"2024-09-13T19:16:01.902657+0000","last_became_peered":"2024-09-13T19:16:01.902657+0000","last_unstale":"2024-09-13T19:19:21.708435+0000","last_undegraded":"2024-09-13T19:19:21.708435+0000","last_fullsized":"2024-09-13T19:19:21.708435+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'41","last_scrub_stamp":"2024-09-13T19:19:21.708338+0000","last_deep_scrub":"36'41","last_deep_scrub_stamp":"2024-09-13T19:19:21.708338+0000","last_clean_scrub_stamp":"2024-09-13T19:19:21.708338+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:24.621364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":44,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:18.942865+0000","last_change":"2024-09-13T19:16:03.915798+0000","last_active":"2024-09-13T19:18:18.942865+0000","last_peered":"2024-09-13T19:18:18.942865+0000","last_clean":"2024-09-13T19:18:18.942865+0000","last_became_active":"2024-09-13T19:16:03.915499+0000","last_became_peered":"2024-09-13T19:16:03.915499+0000","last_unstale":"2024-09-13T19:18:18.942865+0000","last_undegraded":"2024-09-13T19:18:18.942865+0000","last_fullsized":"2024-09-13T19:18:18.942865+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"36'3","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.067818+0000","last_change":"2024-09-13T19:16:05.920534+0000","last_active":"2024-09-13T19:19:06.067818+0000","last_peered":"2024-09-13T19:19:06.067818+0000","last_clean":"2024-09-13T19:19:06.067818+0000","last_became_active":"2024-09-13T19:16:05.920239+0000","last_became_peered":"2024-09-13T19:16:05.920239+0000","last_unstale":"2024-09-13T19:19:06.067818+0000","last_undegraded":"2024-09-13T19:19:06.067818+0000","last_fullsized":"2024-09-13T19:19:06.067818+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"36'8","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:33.099182+0000","last_change":"2024-09-13T19:19:33.099210+0000","last_active":"2024-09-13T19:19:33.099182+0000","last_peered":"2024-09-13T19:19:33.099182+0000","last_clean":"2024-09-13T19:19:33.099182+0000","last_became_active":"2024-09-13T19:15:57.901131+0000","last_became_peered":"2024-09-13T19:15:57.901131+0000","last_unstale":"2024-09-13T19:19:33.099182+0000","last_undegraded":"2024-09-13T19:19:33.099182+0000","last_fullsized":"2024-09-13T19:19:33.099182+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-13T19:19:33.099097+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-13T19:19:33.099097+0000","last_clean_scrub_stamp":"2024-09-13T19:19:33.099097+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:21:52.129989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:08.941018+0000","last_change":"2024-09-13T19:15:55.900444+0000","last_active":"2024-09-13T19:18:08.941018+0000","last_peered":"2024-09-13T19:18:08.941018+0000","last_clean":"2024-09-13T19:18:08.941018+0000","last_became_active":"2024-09-13T19:15:55.900143+0000","last_became_peered":"2024-09-13T19:15:55.900143+0000","last_unstale":"2024-09-13T19:18:08.941018+0000","last_undegraded":"2024-09-13T19:18:08.941018+0000","last_fullsized":"2024-09-13T19:18:08.941018+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:16.937453+0000","last_change":"2024-09-13T19:15:59.895249+0000","last_active":"2024-09-13T19:18:16.937453+0000","last_peered":"2024-09-13T19:18:16.937453+0000","last_clean":"2024-09-13T19:18:16.937453+0000","last_became_active":"2024-09-13T19:15:59.894793+0000","last_became_peered":"2024-09-13T19:15:59.894793+0000","last_unstale":"2024-09-13T19:18:16.937453+0000","last_undegraded":"2024-09-13T19:18:16.937453+0000","last_fullsized":"2024-09-13T19:18:16.937453+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"36'45","reported_seq":103,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:30.838950+0000","last_change":"2024-09-13T19:19:30.838996+0000","last_active":"2024-09-13T19:19:30.838950+0000","last_peered":"2024-09-13T19:19:30.838950+0000","last_clean":"2024-09-13T19:19:30.838950+0000","last_became_active":"2024-09-13T19:16:01.897733+0000","last_became_peered":"2024-09-13T19:16:01.897733+0000","last_unstale":"2024-09-13T19:19:30.838950+0000","last_undegraded":"2024-09-13T19:19:30.838950+0000","last_fullsized":"2024-09-13T19:19:30.838950+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'45","last_scrub_stamp":"2024-09-13T19:19:30.838860+0000","last_deep_scrub":"36'45","last_deep_scrub_stamp":"2024-09-13T19:19:30.838860+0000","last_clean_scrub_stamp":"2024-09-13T19:19:30.838860+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:39:39.517349+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"36'285","reported_seq":421,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:23.814436+0000","last_change":"2024-09-13T19:19:23.814508+0000","last_active":"2024-09-13T19:19:23.814436+0000","last_peered":"2024-09-13T19:19:23.814436+0000","last_clean":"2024-09-13T19:19:23.814436+0000","last_became_active":"2024-09-13T19:16:03.915589+0000","last_became_peered":"2024-09-13T19:16:03.915589+0000","last_unstale":"2024-09-13T19:19:23.814436+0000","last_undegraded":"2024-09-13T19:19:23.814436+0000","last_fullsized":"2024-09-13T19:19:23.814436+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-13T19:19:23.814324+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-13T19:19:23.814324+0000","last_clean_scrub_stamp":"2024-09-13T19:19:23.814324+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:26.983039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"36'12","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.069679+0000","last_change":"2024-09-13T19:16:05.912837+0000","last_active":"2024-09-13T19:19:06.069679+0000","last_peered":"2024-09-13T19:19:06.069679+0000","last_clean":"2024-09-13T19:19:06.069679+0000","last_became_active":"2024-09-13T19:16:05.912339+0000","last_became_peered":"2024-09-13T19:16:05.912339+0000","last_unstale":"2024-09-13T19:19:06.069679+0000","last_undegraded":"2024-09-13T19:19:06.069679+0000","last_fullsized":"2024-09-13T19:19:06.069679+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"36'6","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:13.941308+0000","last_change":"2024-09-13T19:15:57.900840+0000","last_active":"2024-09-13T19:18:13.941308+0000","last_peered":"2024-09-13T19:18:13.941308+0000","last_clean":"2024-09-13T19:18:13.941308+0000","last_became_active":"2024-09-13T19:15:57.900560+0000","last_became_peered":"2024-09-13T19:15:57.900560+0000","last_unstale":"2024-09-13T19:18:13.941308+0000","last_undegraded":"2024-09-13T19:18:13.941308+0000","last_fullsized":"2024-09-13T19:18:13.941308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:08.940978+0000","last_change":"2024-09-13T19:15:55.897670+0000","last_active":"2024-09-13T19:18:08.940978+0000","last_peered":"2024-09-13T19:18:08.940978+0000","last_clean":"2024-09-13T19:18:08.940978+0000","last_became_active":"2024-09-13T19:15:55.895799+0000","last_became_peered":"2024-09-13T19:15:55.895799+0000","last_unstale":"2024-09-13T19:18:08.940978+0000","last_undegraded":"2024-09-13T19:18:08.940978+0000","last_fullsized":"2024-09-13T19:18:08.940978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'5","reported_seq":428,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:28.767953+0000","last_change":"2024-09-13T19:19:28.767985+0000","last_active":"2024-09-13T19:19:28.767953+0000","last_peered":"2024-09-13T19:19:28.767953+0000","last_clean":"2024-09-13T19:19:28.767953+0000","last_became_active":"2024-09-13T19:15:59.894303+0000","last_became_peered":"2024-09-13T19:15:59.894303+0000","last_unstale":"2024-09-13T19:19:28.767953+0000","last_undegraded":"2024-09-13T19:19:28.767953+0000","last_fullsized":"2024-09-13T19:19:28.767953+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-09-13T19:19:28.767856+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-09-13T19:19:28.767856+0000","last_clean_scrub_stamp":"2024-09-13T19:19:28.767856+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:10.640290+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"34'10","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:18.942806+0000","last_change":"2024-09-13T19:16:01.906838+0000","last_active":"2024-09-13T19:18:18.942806+0000","last_peered":"2024-09-13T19:18:18.942806+0000","last_clean":"2024-09-13T19:18:18.942806+0000","last_became_active":"2024-09-13T19:16:01.906490+0000","last_became_peered":"2024-09-13T19:16:01.906490+0000","last_unstale":"2024-09-13T19:18:18.942806+0000","last_undegraded":"2024-09-13T19:18:18.942806+0000","last_fullsized":"2024-09-13T19:18:18.942806+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"36'285","reported_seq":511,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:19.722812+0000","last_change":"2024-09-13T19:19:19.722840+0000","last_active":"2024-09-13T19:19:19.722812+0000","last_peered":"2024-09-13T19:19:19.722812+0000","last_clean":"2024-09-13T19:19:19.722812+0000","last_became_active":"2024-09-13T19:16:03.905523+0000","last_became_peered":"2024-09-13T19:16:03.905523+0000","last_unstale":"2024-09-13T19:19:19.722812+0000","last_undegraded":"2024-09-13T19:19:19.722812+0000","last_fullsized":"2024-09-13T19:19:19.722812+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-13T19:19:19.722719+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-13T19:19:19.722719+0000","last_clean_scrub_stamp":"2024-09-13T19:19:19.722719+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:33.649384+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"36'4","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:27.845980+0000","last_change":"2024-09-13T19:19:27.846042+0000","last_active":"2024-09-13T19:19:27.845980+0000","last_peered":"2024-09-13T19:19:27.845980+0000","last_clean":"2024-09-13T19:19:27.845980+0000","last_became_active":"2024-09-13T19:16:05.910656+0000","last_became_peered":"2024-09-13T19:16:05.910656+0000","last_unstale":"2024-09-13T19:19:27.845980+0000","last_undegraded":"2024-09-13T19:19:27.845980+0000","last_fullsized":"2024-09-13T19:19:27.845980+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:19:27.845857+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:19:27.845857+0000","last_clean_scrub_stamp":"2024-09-13T19:19:27.845857+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:46.547978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"36'3","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.064047+0000","last_change":"2024-09-13T19:15:57.904037+0000","last_active":"2024-09-13T19:19:06.064047+0000","last_peered":"2024-09-13T19:19:06.064047+0000","last_clean":"2024-09-13T19:19:06.064047+0000","last_became_active":"2024-09-13T19:15:57.903761+0000","last_became_peered":"2024-09-13T19:15:57.903761+0000","last_unstale":"2024-09-13T19:19:06.064047+0000","last_undegraded":"2024-09-13T19:19:06.064047+0000","last_fullsized":"2024-09-13T19:19:06.064047+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:08.940925+0000","last_change":"2024-09-13T19:15:55.900225+0000","last_active":"2024-09-13T19:18:08.940925+0000","last_peered":"2024-09-13T19:18:08.940925+0000","last_clean":"2024-09-13T19:18:08.940925+0000","last_became_active":"2024-09-13T19:15:55.899919+0000","last_became_peered":"2024-09-13T19:15:55.899919+0000","last_unstale":"2024-09-13T19:18:08.940925+0000","last_undegraded":"2024-09-13T19:18:08.940925+0000","last_fullsized":"2024-09-13T19:18:08.940925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"36'5","reported_seq":238,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:18.034886+0000","last_change":"2024-09-13T19:19:18.034914+0000","last_active":"2024-09-13T19:19:18.034886+0000","last_peered":"2024-09-13T19:19:18.034886+0000","last_clean":"2024-09-13T19:19:18.034886+0000","last_became_active":"2024-09-13T19:15:59.896081+0000","last_became_peered":"2024-09-13T19:15:59.896081+0000","last_unstale":"2024-09-13T19:19:18.034886+0000","last_undegraded":"2024-09-13T19:19:18.034886+0000","last_fullsized":"2024-09-13T19:19:18.034886+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-09-13T19:19:18.034798+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-09-13T19:19:18.034798+0000","last_clean_scrub_stamp":"2024-09-13T19:19:18.034798+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:47.783875+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"36'49","reported_seq":108,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:22.687814+0000","last_change":"2024-09-13T19:19:22.687872+0000","last_active":"2024-09-13T19:19:22.687814+0000","last_peered":"2024-09-13T19:19:22.687814+0000","last_clean":"2024-09-13T19:19:22.687814+0000","last_became_active":"2024-09-13T19:16:01.902532+0000","last_became_peered":"2024-09-13T19:16:01.902532+0000","last_unstale":"2024-09-13T19:19:22.687814+0000","last_undegraded":"2024-09-13T19:19:22.687814+0000","last_fullsized":"2024-09-13T19:19:22.687814+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'49","last_scrub_stamp":"2024-09-13T19:19:22.687725+0000","last_deep_scrub":"36'49","last_deep_scrub_stamp":"2024-09-13T19:19:22.687725+0000","last_clean_scrub_stamp":"2024-09-13T19:19:22.687725+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:20.499665+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:17.747793+0000","last_change":"2024-09-13T19:19:17.747855+0000","last_active":"2024-09-13T19:19:17.747793+0000","last_peered":"2024-09-13T19:19:17.747793+0000","last_clean":"2024-09-13T19:19:17.747793+0000","last_became_active":"2024-09-13T19:16:03.913019+0000","last_became_peered":"2024-09-13T19:16:03.913019+0000","last_unstale":"2024-09-13T19:19:17.747793+0000","last_undegraded":"2024-09-13T19:19:17.747793+0000","last_fullsized":"2024-09-13T19:19:17.747793+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:17.747683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:17.747683+0000","last_clean_scrub_stamp":"2024-09-13T19:19:17.747683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:01.675286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"36'8","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.184832+0000","last_change":"2024-09-13T19:16:05.911657+0000","last_active":"2024-09-13T19:19:06.184832+0000","last_peered":"2024-09-13T19:19:06.184832+0000","last_clean":"2024-09-13T19:19:06.184832+0000","last_became_active":"2024-09-13T19:16:05.911364+0000","last_became_peered":"2024-09-13T19:16:05.911364+0000","last_unstale":"2024-09-13T19:19:06.184832+0000","last_undegraded":"2024-09-13T19:19:06.184832+0000","last_fullsized":"2024-09-13T19:19:06.184832+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"36'13","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:32.054304+0000","last_change":"2024-09-13T19:19:32.054330+0000","last_active":"2024-09-13T19:19:32.054304+0000","last_peered":"2024-09-13T19:19:32.054304+0000","last_clean":"2024-09-13T19:19:32.054304+0000","last_became_active":"2024-09-13T19:15:57.900905+0000","last_became_peered":"2024-09-13T19:15:57.900905+0000","last_unstale":"2024-09-13T19:19:32.054304+0000","last_undegraded":"2024-09-13T19:19:32.054304+0000","last_fullsized":"2024-09-13T19:19:32.054304+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'13","last_scrub_stamp":"2024-09-13T19:19:32.054214+0000","last_deep_scrub":"36'13","last_deep_scrub_stamp":"2024-09-13T19:19:32.054214+0000","last_clean_scrub_stamp":"2024-09-13T19:19:32.054214+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:27.473875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":206,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:43.936724+0000","last_change":"2024-09-13T19:15:41.170734+0000","last_active":"2024-09-13T19:17:43.936724+0000","last_peered":"2024-09-13T19:17:43.936724+0000","last_clean":"2024-09-13T19:17:43.936724+0000","last_became_active":"2024-09-13T19:15:41.169707+0000","last_became_peered":"2024-09-13T19:15:41.169707+0000","last_unstale":"2024-09-13T19:17:43.936724+0000","last_undegraded":"2024-09-13T19:17:43.936724+0000","last_fullsized":"2024-09-13T19:17:43.936724+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:39.557965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:39.557965+0000","last_clean_scrub_stamp":"2024-09-13T19:15:39.557965+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:48.937960+0000","last_change":"2024-09-13T19:15:46.580815+0000","last_active":"2024-09-13T19:17:48.937960+0000","last_peered":"2024-09-13T19:17:48.937960+0000","last_clean":"2024-09-13T19:17:48.937960+0000","last_became_active":"2024-09-13T19:15:44.577382+0000","last_became_peered":"2024-09-13T19:15:44.577382+0000","last_unstale":"2024-09-13T19:17:48.937960+0000","last_undegraded":"2024-09-13T19:17:48.937960+0000","last_fullsized":"2024-09-13T19:17:48.937960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047916199999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.940230+0000","last_change":"2024-09-13T19:15:55.900746+0000","last_active":"2024-09-13T19:18:03.940230+0000","last_peered":"2024-09-13T19:18:03.940230+0000","last_clean":"2024-09-13T19:18:03.940230+0000","last_became_active":"2024-09-13T19:15:55.899672+0000","last_became_peered":"2024-09-13T19:15:55.899672+0000","last_unstale":"2024-09-13T19:18:03.940230+0000","last_undegraded":"2024-09-13T19:18:03.940230+0000","last_fullsized":"2024-09-13T19:18:03.940230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:33.821035+0000","last_change":"2024-09-13T19:19:33.821056+0000","last_active":"2024-09-13T19:19:33.821035+0000","last_peered":"2024-09-13T19:19:33.821035+0000","last_clean":"2024-09-13T19:19:33.821035+0000","last_became_active":"2024-09-13T19:15:59.891615+0000","last_became_peered":"2024-09-13T19:15:59.891615+0000","last_unstale":"2024-09-13T19:19:33.821035+0000","last_undegraded":"2024-09-13T19:19:33.821035+0000","last_fullsized":"2024-09-13T19:19:33.821035+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:33.820938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:33.820938+0000","last_clean_scrub_stamp":"2024-09-13T19:19:33.820938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:08.178435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"36'85","reported_seq":167,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.765505+0000","last_change":"2024-09-13T19:16:01.905525+0000","last_active":"2024-09-13T19:19:12.765505+0000","last_peered":"2024-09-13T19:19:12.765505+0000","last_clean":"2024-09-13T19:19:12.765505+0000","last_became_active":"2024-09-13T19:16:01.905085+0000","last_became_peered":"2024-09-13T19:16:01.905085+0000","last_unstale":"2024-09-13T19:19:12.765505+0000","last_undegraded":"2024-09-13T19:19:12.765505+0000","last_fullsized":"2024-09-13T19:19:12.765505+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:29.339028+0000","last_change":"2024-09-13T19:19:29.339050+0000","last_active":"2024-09-13T19:19:29.339028+0000","last_peered":"2024-09-13T19:19:29.339028+0000","last_clean":"2024-09-13T19:19:29.339028+0000","last_became_active":"2024-09-13T19:16:03.913802+0000","last_became_peered":"2024-09-13T19:16:03.913802+0000","last_unstale":"2024-09-13T19:19:29.339028+0000","last_undegraded":"2024-09-13T19:19:29.339028+0000","last_fullsized":"2024-09-13T19:19:29.339028+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:29.338926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:29.338926+0000","last_clean_scrub_stamp":"2024-09-13T19:19:29.338926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:01.790473+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"36'89","reported_seq":188,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.976587+0000","last_change":"2024-09-13T19:16:05.911930+0000","last_active":"2024-09-13T19:19:05.976587+0000","last_peered":"2024-09-13T19:19:05.976587+0000","last_clean":"2024-09-13T19:19:05.976587+0000","last_became_active":"2024-09-13T19:16:05.911595+0000","last_became_peered":"2024-09-13T19:16:05.911595+0000","last_unstale":"2024-09-13T19:19:05.976587+0000","last_undegraded":"2024-09-13T19:19:05.976587+0000","last_fullsized":"2024-09-13T19:19:05.976587+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":289,"num_read_kb":269,"num_write":182,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"36'4","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:08.941113+0000","last_change":"2024-09-13T19:15:57.897546+0000","last_active":"2024-09-13T19:18:08.941113+0000","last_peered":"2024-09-13T19:18:08.941113+0000","last_clean":"2024-09-13T19:18:08.941113+0000","last_became_active":"2024-09-13T19:15:57.897307+0000","last_became_peered":"2024-09-13T19:15:57.897307+0000","last_unstale":"2024-09-13T19:18:08.941113+0000","last_undegraded":"2024-09-13T19:18:08.941113+0000","last_fullsized":"2024-09-13T19:18:08.941113+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:43.937158+0000","last_change":"2024-09-13T19:15:46.581436+0000","last_active":"2024-09-13T19:17:43.937158+0000","last_peered":"2024-09-13T19:17:43.937158+0000","last_clean":"2024-09-13T19:17:43.937158+0000","last_became_active":"2024-09-13T19:15:44.576304+0000","last_became_peered":"2024-09-13T19:15:44.576304+0000","last_unstale":"2024-09-13T19:17:43.937158+0000","last_undegraded":"2024-09-13T19:17:43.937158+0000","last_fullsized":"2024-09-13T19:17:43.937158+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011332060000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:01.934838+0000","last_change":"2024-09-13T19:15:55.891911+0000","last_active":"2024-09-13T19:18:01.934838+0000","last_peered":"2024-09-13T19:18:01.934838+0000","last_clean":"2024-09-13T19:18:01.934838+0000","last_became_active":"2024-09-13T19:15:55.891377+0000","last_became_peered":"2024-09-13T19:15:55.891377+0000","last_unstale":"2024-09-13T19:18:01.934838+0000","last_undegraded":"2024-09-13T19:18:01.934838+0000","last_fullsized":"2024-09-13T19:18:01.934838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:22.038984+0000","last_change":"2024-09-13T19:19:22.039024+0000","last_active":"2024-09-13T19:19:22.038984+0000","last_peered":"2024-09-13T19:19:22.038984+0000","last_clean":"2024-09-13T19:19:22.038984+0000","last_became_active":"2024-09-13T19:15:59.896248+0000","last_became_peered":"2024-09-13T19:15:59.896248+0000","last_unstale":"2024-09-13T19:19:22.038984+0000","last_undegraded":"2024-09-13T19:19:22.038984+0000","last_fullsized":"2024-09-13T19:19:22.038984+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:22.038847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:22.038847+0000","last_clean_scrub_stamp":"2024-09-13T19:19:22.038847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:43:03.494237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"36'291","reported_seq":516,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:17.746380+0000","last_change":"2024-09-13T19:19:17.746426+0000","last_active":"2024-09-13T19:19:17.746380+0000","last_peered":"2024-09-13T19:19:17.746380+0000","last_clean":"2024-09-13T19:19:17.746380+0000","last_became_active":"2024-09-13T19:16:01.907024+0000","last_became_peered":"2024-09-13T19:16:01.907024+0000","last_unstale":"2024-09-13T19:19:17.746380+0000","last_undegraded":"2024-09-13T19:19:17.746380+0000","last_fullsized":"2024-09-13T19:19:17.746380+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'291","last_scrub_stamp":"2024-09-13T19:19:17.746277+0000","last_deep_scrub":"36'291","last_deep_scrub_stamp":"2024-09-13T19:19:17.746277+0000","last_clean_scrub_stamp":"2024-09-13T19:19:17.746277+0000","objects_scrubbed":10,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:14.177663+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:08.941061+0000","last_change":"2024-09-13T19:16:03.916021+0000","last_active":"2024-09-13T19:18:08.941061+0000","last_peered":"2024-09-13T19:18:08.941061+0000","last_clean":"2024-09-13T19:18:08.941061+0000","last_became_active":"2024-09-13T19:16:03.915712+0000","last_became_peered":"2024-09-13T19:16:03.915712+0000","last_unstale":"2024-09-13T19:18:08.941061+0000","last_undegraded":"2024-09-13T19:18:08.941061+0000","last_fullsized":"2024-09-13T19:18:08.941061+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"36'3","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:18.942053+0000","last_change":"2024-09-13T19:16:05.917279+0000","last_active":"2024-09-13T19:18:18.942053+0000","last_peered":"2024-09-13T19:18:18.942053+0000","last_clean":"2024-09-13T19:18:18.942053+0000","last_became_active":"2024-09-13T19:16:05.916999+0000","last_became_peered":"2024-09-13T19:16:05.916999+0000","last_unstale":"2024-09-13T19:18:18.942053+0000","last_undegraded":"2024-09-13T19:18:18.942053+0000","last_fullsized":"2024-09-13T19:18:18.942053+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:06.935978+0000","last_change":"2024-09-13T19:15:57.890320+0000","last_active":"2024-09-13T19:18:06.935978+0000","last_peered":"2024-09-13T19:18:06.935978+0000","last_clean":"2024-09-13T19:18:06.935978+0000","last_became_active":"2024-09-13T19:15:57.889885+0000","last_became_peered":"2024-09-13T19:15:57.889885+0000","last_unstale":"2024-09-13T19:18:06.935978+0000","last_undegraded":"2024-09-13T19:18:06.935978+0000","last_fullsized":"2024-09-13T19:18:06.935978+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:48.937288+0000","last_change":"2024-09-13T19:15:47.256565+0000","last_active":"2024-09-13T19:17:48.937288+0000","last_peered":"2024-09-13T19:17:48.937288+0000","last_clean":"2024-09-13T19:17:48.937288+0000","last_became_active":"2024-09-13T19:15:44.575483+0000","last_became_peered":"2024-09-13T19:15:44.575483+0000","last_unstale":"2024-09-13T19:17:48.937288+0000","last_undegraded":"2024-09-13T19:17:48.937288+0000","last_fullsized":"2024-09-13T19:17:48.937288+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036796000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"36'6","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:56.934064+0000","last_change":"2024-09-13T19:15:55.892997+0000","last_active":"2024-09-13T19:17:56.934064+0000","last_peered":"2024-09-13T19:17:56.934064+0000","last_clean":"2024-09-13T19:17:56.934064+0000","last_became_active":"2024-09-13T19:15:55.892629+0000","last_became_peered":"2024-09-13T19:15:55.892629+0000","last_unstale":"2024-09-13T19:17:56.934064+0000","last_undegraded":"2024-09-13T19:17:56.934064+0000","last_fullsized":"2024-09-13T19:17:56.934064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"27'1","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:08.940369+0000","last_change":"2024-09-13T19:15:59.892045+0000","last_active":"2024-09-13T19:18:08.940369+0000","last_peered":"2024-09-13T19:18:08.940369+0000","last_clean":"2024-09-13T19:18:08.940369+0000","last_became_active":"2024-09-13T19:15:59.891588+0000","last_became_peered":"2024-09-13T19:15:59.891588+0000","last_unstale":"2024-09-13T19:18:08.940369+0000","last_undegraded":"2024-09-13T19:18:08.940369+0000","last_fullsized":"2024-09-13T19:18:08.940369+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'23","reported_seq":100,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:28.812123+0000","last_change":"2024-09-13T19:19:28.812189+0000","last_active":"2024-09-13T19:19:28.812123+0000","last_peered":"2024-09-13T19:19:28.812123+0000","last_clean":"2024-09-13T19:19:28.812123+0000","last_became_active":"2024-09-13T19:16:01.903947+0000","last_became_peered":"2024-09-13T19:16:01.903947+0000","last_unstale":"2024-09-13T19:19:28.812123+0000","last_undegraded":"2024-09-13T19:19:28.812123+0000","last_fullsized":"2024-09-13T19:19:28.812123+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'23","last_scrub_stamp":"2024-09-13T19:19:28.812026+0000","last_deep_scrub":"36'23","last_deep_scrub_stamp":"2024-09-13T19:19:28.812026+0000","last_clean_scrub_stamp":"2024-09-13T19:19:28.812026+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:37.761542+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:17.389523+0000","last_change":"2024-09-13T19:19:17.389541+0000","last_active":"2024-09-13T19:19:17.389523+0000","last_peered":"2024-09-13T19:19:17.389523+0000","last_clean":"2024-09-13T19:19:17.389523+0000","last_became_active":"2024-09-13T19:16:03.910776+0000","last_became_peered":"2024-09-13T19:16:03.910776+0000","last_unstale":"2024-09-13T19:19:17.389523+0000","last_undegraded":"2024-09-13T19:19:17.389523+0000","last_fullsized":"2024-09-13T19:19:17.389523+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:17.389460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:17.389460+0000","last_clean_scrub_stamp":"2024-09-13T19:19:17.389460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:17:14.265847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"36'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.846491+0000","last_change":"2024-09-13T19:16:05.920464+0000","last_active":"2024-09-13T19:19:05.846491+0000","last_peered":"2024-09-13T19:19:05.846491+0000","last_clean":"2024-09-13T19:19:05.846491+0000","last_became_active":"2024-09-13T19:16:05.920191+0000","last_became_peered":"2024-09-13T19:16:05.920191+0000","last_unstale":"2024-09-13T19:19:05.846491+0000","last_undegraded":"2024-09-13T19:19:05.846491+0000","last_fullsized":"2024-09-13T19:19:05.846491+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"36'12","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:05.011579+0000","last_change":"2024-09-13T19:15:57.886935+0000","last_active":"2024-09-13T19:18:05.011579+0000","last_peered":"2024-09-13T19:18:05.011579+0000","last_clean":"2024-09-13T19:18:05.011579+0000","last_became_active":"2024-09-13T19:15:57.886273+0000","last_became_peered":"2024-09-13T19:15:57.886273+0000","last_unstale":"2024-09-13T19:18:05.011579+0000","last_undegraded":"2024-09-13T19:18:05.011579+0000","last_fullsized":"2024-09-13T19:18:05.011579+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":44,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:48.937901+0000","last_change":"2024-09-13T19:15:46.581526+0000","last_active":"2024-09-13T19:17:48.937901+0000","last_peered":"2024-09-13T19:17:48.937901+0000","last_clean":"2024-09-13T19:17:48.937901+0000","last_became_active":"2024-09-13T19:15:44.576052+0000","last_became_peered":"2024-09-13T19:15:44.576052+0000","last_unstale":"2024-09-13T19:17:48.937901+0000","last_undegraded":"2024-09-13T19:17:48.937901+0000","last_fullsized":"2024-09-13T19:17:48.937901+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012221599999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"36'4","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.827132+0000","last_change":"2024-09-13T19:15:55.892933+0000","last_active":"2024-09-13T19:19:05.827132+0000","last_peered":"2024-09-13T19:19:05.827132+0000","last_clean":"2024-09-13T19:19:05.827132+0000","last_became_active":"2024-09-13T19:15:55.892636+0000","last_became_peered":"2024-09-13T19:15:55.892636+0000","last_unstale":"2024-09-13T19:19:05.827132+0000","last_undegraded":"2024-09-13T19:19:05.827132+0000","last_fullsized":"2024-09-13T19:19:05.827132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:34.461514+0000","last_change":"2024-09-13T19:19:34.461541+0000","last_active":"2024-09-13T19:19:34.461514+0000","last_peered":"2024-09-13T19:19:34.461514+0000","last_clean":"2024-09-13T19:19:34.461514+0000","last_became_active":"2024-09-13T19:15:59.896248+0000","last_became_peered":"2024-09-13T19:15:59.896248+0000","last_unstale":"2024-09-13T19:19:34.461514+0000","last_undegraded":"2024-09-13T19:19:34.461514+0000","last_fullsized":"2024-09-13T19:19:34.461514+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:34.461398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:34.461398+0000","last_clean_scrub_stamp":"2024-09-13T19:19:34.461398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:38.595301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'13","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.056522+0000","last_change":"2024-09-13T19:16:01.905842+0000","last_active":"2024-09-13T19:19:05.056522+0000","last_peered":"2024-09-13T19:19:05.056522+0000","last_clean":"2024-09-13T19:19:05.056522+0000","last_became_active":"2024-09-13T19:16:01.905280+0000","last_became_peered":"2024-09-13T19:16:01.905280+0000","last_unstale":"2024-09-13T19:19:05.056522+0000","last_undegraded":"2024-09-13T19:19:05.056522+0000","last_fullsized":"2024-09-13T19:19:05.056522+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:13.942066+0000","last_change":"2024-09-13T19:16:03.916612+0000","last_active":"2024-09-13T19:18:13.942066+0000","last_peered":"2024-09-13T19:18:13.942066+0000","last_clean":"2024-09-13T19:18:13.942066+0000","last_became_active":"2024-09-13T19:16:03.916344+0000","last_became_peered":"2024-09-13T19:16:03.916344+0000","last_unstale":"2024-09-13T19:18:13.942066+0000","last_undegraded":"2024-09-13T19:18:13.942066+0000","last_fullsized":"2024-09-13T19:18:13.942066+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"36'4","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:18.941983+0000","last_change":"2024-09-13T19:16:05.919765+0000","last_active":"2024-09-13T19:18:18.941983+0000","last_peered":"2024-09-13T19:18:18.941983+0000","last_clean":"2024-09-13T19:18:18.941983+0000","last_became_active":"2024-09-13T19:16:05.919156+0000","last_became_peered":"2024-09-13T19:16:05.919156+0000","last_unstale":"2024-09-13T19:18:18.941983+0000","last_undegraded":"2024-09-13T19:18:18.941983+0000","last_fullsized":"2024-09-13T19:18:18.941983+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"36'18","reported_seq":70,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:05.012863+0000","last_change":"2024-09-13T19:15:57.903146+0000","last_active":"2024-09-13T19:18:05.012863+0000","last_peered":"2024-09-13T19:18:05.012863+0000","last_clean":"2024-09-13T19:18:05.012863+0000","last_became_active":"2024-09-13T19:15:57.902819+0000","last_became_peered":"2024-09-13T19:15:57.902819+0000","last_unstale":"2024-09-13T19:18:05.012863+0000","last_undegraded":"2024-09-13T19:18:05.012863+0000","last_fullsized":"2024-09-13T19:18:05.012863+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":50,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.939644+0000","last_change":"2024-09-13T19:15:55.893781+0000","last_active":"2024-09-13T19:18:03.939644+0000","last_peered":"2024-09-13T19:18:03.939644+0000","last_clean":"2024-09-13T19:18:03.939644+0000","last_became_active":"2024-09-13T19:15:55.893468+0000","last_became_peered":"2024-09-13T19:15:55.893468+0000","last_unstale":"2024-09-13T19:18:03.939644+0000","last_undegraded":"2024-09-13T19:18:03.939644+0000","last_fullsized":"2024-09-13T19:18:03.939644+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:51.933308+0000","last_change":"2024-09-13T19:15:46.583117+0000","last_active":"2024-09-13T19:17:51.933308+0000","last_peered":"2024-09-13T19:17:51.933308+0000","last_clean":"2024-09-13T19:17:51.933308+0000","last_became_active":"2024-09-13T19:15:44.575726+0000","last_became_peered":"2024-09-13T19:15:44.575726+0000","last_unstale":"2024-09-13T19:17:51.933308+0000","last_undegraded":"2024-09-13T19:17:51.933308+0000","last_fullsized":"2024-09-13T19:17:51.933308+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041430200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"36'1","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.653153+0000","last_change":"2024-09-13T19:16:31.990974+0000","last_active":"2024-09-13T19:19:12.653153+0000","last_peered":"2024-09-13T19:19:12.653153+0000","last_clean":"2024-09-13T19:19:12.653153+0000","last_became_active":"2024-09-13T19:16:31.990669+0000","last_became_peered":"2024-09-13T19:16:31.990669+0000","last_unstale":"2024-09-13T19:19:12.653153+0000","last_undegraded":"2024-09-13T19:19:12.653153+0000","last_fullsized":"2024-09-13T19:19:12.653153+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"36'73","reported_seq":149,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:28.341082+0000","last_change":"2024-09-13T19:19:28.341123+0000","last_active":"2024-09-13T19:19:28.341082+0000","last_peered":"2024-09-13T19:19:28.341082+0000","last_clean":"2024-09-13T19:19:28.341082+0000","last_became_active":"2024-09-13T19:16:01.902095+0000","last_became_peered":"2024-09-13T19:16:01.902095+0000","last_unstale":"2024-09-13T19:19:28.341082+0000","last_undegraded":"2024-09-13T19:19:28.341082+0000","last_fullsized":"2024-09-13T19:19:28.341082+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'73","last_scrub_stamp":"2024-09-13T19:19:28.340973+0000","last_deep_scrub":"36'73","last_deep_scrub_stamp":"2024-09-13T19:19:28.340973+0000","last_clean_scrub_stamp":"2024-09-13T19:19:28.340973+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:31:45.923087+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:21.760539+0000","last_change":"2024-09-13T19:19:21.760567+0000","last_active":"2024-09-13T19:19:21.760539+0000","last_peered":"2024-09-13T19:19:21.760539+0000","last_clean":"2024-09-13T19:19:21.760539+0000","last_became_active":"2024-09-13T19:16:03.909803+0000","last_became_peered":"2024-09-13T19:16:03.909803+0000","last_unstale":"2024-09-13T19:19:21.760539+0000","last_undegraded":"2024-09-13T19:19:21.760539+0000","last_fullsized":"2024-09-13T19:19:21.760539+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:21.760449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:21.760449+0000","last_clean_scrub_stamp":"2024-09-13T19:19:21.760449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:57.014320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"36'11","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:21.938395+0000","last_change":"2024-09-13T19:16:05.915976+0000","last_active":"2024-09-13T19:18:21.938395+0000","last_peered":"2024-09-13T19:18:21.938395+0000","last_clean":"2024-09-13T19:18:21.938395+0000","last_became_active":"2024-09-13T19:16:05.915672+0000","last_became_peered":"2024-09-13T19:16:05.915672+0000","last_unstale":"2024-09-13T19:18:21.938395+0000","last_undegraded":"2024-09-13T19:18:21.938395+0000","last_fullsized":"2024-09-13T19:18:21.938395+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"36'10","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:05.012628+0000","last_change":"2024-09-13T19:15:57.903282+0000","last_active":"2024-09-13T19:18:05.012628+0000","last_peered":"2024-09-13T19:18:05.012628+0000","last_clean":"2024-09-13T19:18:05.012628+0000","last_became_active":"2024-09-13T19:15:57.902793+0000","last_became_peered":"2024-09-13T19:15:57.902793+0000","last_unstale":"2024-09-13T19:18:05.012628+0000","last_undegraded":"2024-09-13T19:18:05.012628+0000","last_fullsized":"2024-09-13T19:18:05.012628+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:01.934939+0000","last_change":"2024-09-13T19:15:55.895728+0000","last_active":"2024-09-13T19:18:01.934939+0000","last_peered":"2024-09-13T19:18:01.934939+0000","last_clean":"2024-09-13T19:18:01.934939+0000","last_became_active":"2024-09-13T19:15:55.894340+0000","last_became_peered":"2024-09-13T19:15:55.894340+0000","last_unstale":"2024-09-13T19:18:01.934939+0000","last_undegraded":"2024-09-13T19:18:01.934939+0000","last_fullsized":"2024-09-13T19:18:01.934939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:48.938000+0000","last_change":"2024-09-13T19:15:46.581685+0000","last_active":"2024-09-13T19:17:48.938000+0000","last_peered":"2024-09-13T19:17:48.938000+0000","last_clean":"2024-09-13T19:17:48.938000+0000","last_became_active":"2024-09-13T19:15:44.576006+0000","last_became_peered":"2024-09-13T19:15:44.576006+0000","last_unstale":"2024-09-13T19:17:48.938000+0000","last_undegraded":"2024-09-13T19:17:48.938000+0000","last_fullsized":"2024-09-13T19:17:48.938000+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013309299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:26.089115+0000","last_change":"2024-09-13T19:19:26.089170+0000","last_active":"2024-09-13T19:19:26.089115+0000","last_peered":"2024-09-13T19:19:26.089115+0000","last_clean":"2024-09-13T19:19:26.089115+0000","last_became_active":"2024-09-13T19:15:59.894761+0000","last_became_peered":"2024-09-13T19:15:59.894761+0000","last_unstale":"2024-09-13T19:19:26.089115+0000","last_undegraded":"2024-09-13T19:19:26.089115+0000","last_fullsized":"2024-09-13T19:19:26.089115+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:26.089011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:26.089011+0000","last_clean_scrub_stamp":"2024-09-13T19:19:26.089011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:08.982394+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"36'21","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:16.767430+0000","last_change":"2024-09-13T19:19:16.767496+0000","last_active":"2024-09-13T19:19:16.767430+0000","last_peered":"2024-09-13T19:19:16.767430+0000","last_clean":"2024-09-13T19:19:16.767430+0000","last_became_active":"2024-09-13T19:16:01.907419+0000","last_became_peered":"2024-09-13T19:16:01.907419+0000","last_unstale":"2024-09-13T19:19:16.767430+0000","last_undegraded":"2024-09-13T19:19:16.767430+0000","last_fullsized":"2024-09-13T19:19:16.767430+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'21","last_scrub_stamp":"2024-09-13T19:19:16.767339+0000","last_deep_scrub":"36'21","last_deep_scrub_stamp":"2024-09-13T19:19:16.767339+0000","last_clean_scrub_stamp":"2024-09-13T19:19:16.767339+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:34.127072+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"36'285","reported_seq":358,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:23.651191+0000","last_change":"2024-09-13T19:19:23.651260+0000","last_active":"2024-09-13T19:19:23.651191+0000","last_peered":"2024-09-13T19:19:23.651191+0000","last_clean":"2024-09-13T19:19:23.651191+0000","last_became_active":"2024-09-13T19:16:03.907957+0000","last_became_peered":"2024-09-13T19:16:03.907957+0000","last_unstale":"2024-09-13T19:19:23.651191+0000","last_undegraded":"2024-09-13T19:19:23.651191+0000","last_fullsized":"2024-09-13T19:19:23.651191+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-13T19:19:23.651077+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-13T19:19:23.651077+0000","last_clean_scrub_stamp":"2024-09-13T19:19:23.651077+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:39:32.329566+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"34'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:23.943599+0000","last_change":"2024-09-13T19:16:05.924834+0000","last_active":"2024-09-13T19:18:23.943599+0000","last_peered":"2024-09-13T19:18:23.943599+0000","last_clean":"2024-09-13T19:18:23.943599+0000","last_became_active":"2024-09-13T19:16:05.924162+0000","last_became_peered":"2024-09-13T19:16:05.924162+0000","last_unstale":"2024-09-13T19:18:23.943599+0000","last_undegraded":"2024-09-13T19:18:23.943599+0000","last_fullsized":"2024-09-13T19:18:23.943599+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"36'6","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.970176+0000","last_change":"2024-09-13T19:15:57.897089+0000","last_active":"2024-09-13T19:19:05.970176+0000","last_peered":"2024-09-13T19:19:05.970176+0000","last_clean":"2024-09-13T19:19:05.970176+0000","last_became_active":"2024-09-13T19:15:57.896078+0000","last_became_peered":"2024-09-13T19:15:57.896078+0000","last_unstale":"2024-09-13T19:19:05.970176+0000","last_undegraded":"2024-09-13T19:19:05.970176+0000","last_fullsized":"2024-09-13T19:19:05.970176+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:08.941138+0000","last_change":"2024-09-13T19:15:55.895594+0000","last_active":"2024-09-13T19:18:08.941138+0000","last_peered":"2024-09-13T19:18:08.941138+0000","last_clean":"2024-09-13T19:18:08.941138+0000","last_became_active":"2024-09-13T19:15:55.895282+0000","last_became_peered":"2024-09-13T19:15:55.895282+0000","last_unstale":"2024-09-13T19:18:08.941138+0000","last_undegraded":"2024-09-13T19:18:08.941138+0000","last_fullsized":"2024-09-13T19:18:08.941138+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:56.934172+0000","last_change":"2024-09-13T19:15:46.583177+0000","last_active":"2024-09-13T19:17:56.934172+0000","last_peered":"2024-09-13T19:17:56.934172+0000","last_clean":"2024-09-13T19:17:56.934172+0000","last_became_active":"2024-09-13T19:15:44.574967+0000","last_became_peered":"2024-09-13T19:15:44.574967+0000","last_unstale":"2024-09-13T19:17:56.934172+0000","last_undegraded":"2024-09-13T19:17:56.934172+0000","last_fullsized":"2024-09-13T19:17:56.934172+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049330999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"36'2","reported_seq":230,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:25.112462+0000","last_change":"2024-09-13T19:19:25.112490+0000","last_active":"2024-09-13T19:19:25.112462+0000","last_peered":"2024-09-13T19:19:25.112462+0000","last_clean":"2024-09-13T19:19:25.112462+0000","last_became_active":"2024-09-13T19:15:59.894966+0000","last_became_peered":"2024-09-13T19:15:59.894966+0000","last_unstale":"2024-09-13T19:19:25.112462+0000","last_undegraded":"2024-09-13T19:19:25.112462+0000","last_fullsized":"2024-09-13T19:19:25.112462+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:25.112380+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:25.112380+0000","last_clean_scrub_stamp":"2024-09-13T19:19:25.112380+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:41.200956+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"36'16","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:27.099236+0000","last_change":"2024-09-13T19:19:27.099288+0000","last_active":"2024-09-13T19:19:27.099236+0000","last_peered":"2024-09-13T19:19:27.099236+0000","last_clean":"2024-09-13T19:19:27.099236+0000","last_became_active":"2024-09-13T19:16:01.902739+0000","last_became_peered":"2024-09-13T19:16:01.902739+0000","last_unstale":"2024-09-13T19:19:27.099236+0000","last_undegraded":"2024-09-13T19:19:27.099236+0000","last_fullsized":"2024-09-13T19:19:27.099236+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-13T19:19:27.099139+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-13T19:19:27.099139+0000","last_clean_scrub_stamp":"2024-09-13T19:19:27.099139+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:22:57.737015+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"36'285","reported_seq":429,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:22.346065+0000","last_change":"2024-09-13T19:19:22.346094+0000","last_active":"2024-09-13T19:19:22.346065+0000","last_peered":"2024-09-13T19:19:22.346065+0000","last_clean":"2024-09-13T19:19:22.346065+0000","last_became_active":"2024-09-13T19:16:03.909038+0000","last_became_peered":"2024-09-13T19:16:03.909038+0000","last_unstale":"2024-09-13T19:19:22.346065+0000","last_undegraded":"2024-09-13T19:19:22.346065+0000","last_fullsized":"2024-09-13T19:19:22.346065+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-13T19:19:22.345954+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-13T19:19:22.345954+0000","last_clean_scrub_stamp":"2024-09-13T19:19:22.345954+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:07.575589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'3","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:23.942859+0000","last_change":"2024-09-13T19:16:05.924059+0000","last_active":"2024-09-13T19:18:23.942859+0000","last_peered":"2024-09-13T19:18:23.942859+0000","last_clean":"2024-09-13T19:18:23.942859+0000","last_became_active":"2024-09-13T19:16:05.923739+0000","last_became_peered":"2024-09-13T19:16:05.923739+0000","last_unstale":"2024-09-13T19:18:23.942859+0000","last_undegraded":"2024-09-13T19:18:23.942859+0000","last_fullsized":"2024-09-13T19:18:23.942859+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"36'6","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.968795+0000","last_change":"2024-09-13T19:15:57.897999+0000","last_active":"2024-09-13T19:19:05.968795+0000","last_peered":"2024-09-13T19:19:05.968795+0000","last_clean":"2024-09-13T19:19:05.968795+0000","last_became_active":"2024-09-13T19:15:57.897727+0000","last_became_peered":"2024-09-13T19:15:57.897727+0000","last_unstale":"2024-09-13T19:19:05.968795+0000","last_undegraded":"2024-09-13T19:19:05.968795+0000","last_fullsized":"2024-09-13T19:19:05.968795+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:08.940449+0000","last_change":"2024-09-13T19:15:55.895727+0000","last_active":"2024-09-13T19:18:08.940449+0000","last_peered":"2024-09-13T19:18:08.940449+0000","last_clean":"2024-09-13T19:18:08.940449+0000","last_became_active":"2024-09-13T19:15:55.895394+0000","last_became_peered":"2024-09-13T19:15:55.895394+0000","last_unstale":"2024-09-13T19:18:08.940449+0000","last_undegraded":"2024-09-13T19:18:08.940449+0000","last_fullsized":"2024-09-13T19:18:08.940449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:53.938816+0000","last_change":"2024-09-13T19:15:46.581172+0000","last_active":"2024-09-13T19:17:53.938816+0000","last_peered":"2024-09-13T19:17:53.938816+0000","last_clean":"2024-09-13T19:17:53.938816+0000","last_became_active":"2024-09-13T19:15:44.607248+0000","last_became_peered":"2024-09-13T19:15:44.607248+0000","last_unstale":"2024-09-13T19:17:53.938816+0000","last_undegraded":"2024-09-13T19:17:53.938816+0000","last_fullsized":"2024-09-13T19:17:53.938816+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086245899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:58.939388+0000","last_change":"2024-09-13T19:16:31.993085+0000","last_active":"2024-09-13T19:17:58.939388+0000","last_peered":"2024-09-13T19:17:58.939388+0000","last_clean":"2024-09-13T19:17:58.939388+0000","last_became_active":"2024-09-13T19:16:31.992752+0000","last_became_peered":"2024-09-13T19:16:31.992752+0000","last_unstale":"2024-09-13T19:17:58.939388+0000","last_undegraded":"2024-09-13T19:17:58.939388+0000","last_fullsized":"2024-09-13T19:17:58.939388+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"36'98","reported_seq":191,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:24.778346+0000","last_change":"2024-09-13T19:19:24.778390+0000","last_active":"2024-09-13T19:19:24.778346+0000","last_peered":"2024-09-13T19:19:24.778346+0000","last_clean":"2024-09-13T19:19:24.778346+0000","last_became_active":"2024-09-13T19:16:01.906317+0000","last_became_peered":"2024-09-13T19:16:01.906317+0000","last_unstale":"2024-09-13T19:19:24.778346+0000","last_undegraded":"2024-09-13T19:19:24.778346+0000","last_fullsized":"2024-09-13T19:19:24.778346+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'98","last_scrub_stamp":"2024-09-13T19:19:24.778260+0000","last_deep_scrub":"36'98","last_deep_scrub_stamp":"2024-09-13T19:19:24.778260+0000","last_clean_scrub_stamp":"2024-09-13T19:19:24.778260+0000","objects_scrubbed":8,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:51.569747+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":99,"num_read_kb":103,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:19.337985+0000","last_change":"2024-09-13T19:19:19.338010+0000","last_active":"2024-09-13T19:19:19.337985+0000","last_peered":"2024-09-13T19:19:19.337985+0000","last_clean":"2024-09-13T19:19:19.337985+0000","last_became_active":"2024-09-13T19:16:03.909941+0000","last_became_peered":"2024-09-13T19:16:03.909941+0000","last_unstale":"2024-09-13T19:19:19.337985+0000","last_undegraded":"2024-09-13T19:19:19.337985+0000","last_fullsized":"2024-09-13T19:19:19.337985+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:19.337887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:19.337887+0000","last_clean_scrub_stamp":"2024-09-13T19:19:19.337887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:59.954982+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:31.797118+0000","last_change":"2024-09-13T19:19:31.797143+0000","last_active":"2024-09-13T19:19:31.797118+0000","last_peered":"2024-09-13T19:19:31.797118+0000","last_clean":"2024-09-13T19:19:31.797118+0000","last_became_active":"2024-09-13T19:16:05.911465+0000","last_became_peered":"2024-09-13T19:16:05.911465+0000","last_unstale":"2024-09-13T19:19:31.797118+0000","last_undegraded":"2024-09-13T19:19:31.797118+0000","last_fullsized":"2024-09-13T19:19:31.797118+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:31.797033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:31.797033+0000","last_clean_scrub_stamp":"2024-09-13T19:19:31.797033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:28:44.716045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:13.941331+0000","last_change":"2024-09-13T19:16:05.917443+0000","last_active":"2024-09-13T19:18:13.941331+0000","last_peered":"2024-09-13T19:18:13.941331+0000","last_clean":"2024-09-13T19:18:13.941331+0000","last_became_active":"2024-09-13T19:16:05.917156+0000","last_became_peered":"2024-09-13T19:16:05.917156+0000","last_unstale":"2024-09-13T19:18:13.941331+0000","last_undegraded":"2024-09-13T19:18:13.941331+0000","last_fullsized":"2024-09-13T19:18:13.941331+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"36'8","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.708661+0000","last_change":"2024-09-13T19:15:57.899020+0000","last_active":"2024-09-13T19:19:05.708661+0000","last_peered":"2024-09-13T19:19:05.708661+0000","last_clean":"2024-09-13T19:19:05.708661+0000","last_became_active":"2024-09-13T19:15:57.898761+0000","last_became_peered":"2024-09-13T19:15:57.898761+0000","last_unstale":"2024-09-13T19:19:05.708661+0000","last_undegraded":"2024-09-13T19:19:05.708661+0000","last_fullsized":"2024-09-13T19:19:05.708661+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:18.942784+0000","last_change":"2024-09-13T19:15:55.898265+0000","last_active":"2024-09-13T19:18:18.942784+0000","last_peered":"2024-09-13T19:18:18.942784+0000","last_clean":"2024-09-13T19:18:18.942784+0000","last_became_active":"2024-09-13T19:15:55.892518+0000","last_became_peered":"2024-09-13T19:15:55.892518+0000","last_unstale":"2024-09-13T19:18:18.942784+0000","last_undegraded":"2024-09-13T19:18:18.942784+0000","last_fullsized":"2024-09-13T19:18:18.942784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:30.756336+0000","last_change":"2024-09-13T19:19:30.756383+0000","last_active":"2024-09-13T19:19:30.756336+0000","last_peered":"2024-09-13T19:19:30.756336+0000","last_clean":"2024-09-13T19:19:30.756336+0000","last_became_active":"2024-09-13T19:15:59.892690+0000","last_became_peered":"2024-09-13T19:15:59.892690+0000","last_unstale":"2024-09-13T19:19:30.756336+0000","last_undegraded":"2024-09-13T19:19:30.756336+0000","last_fullsized":"2024-09-13T19:19:30.756336+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:30.756223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:30.756223+0000","last_clean_scrub_stamp":"2024-09-13T19:19:30.756223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:04:11.520992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"36'40","reported_seq":96,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:31.067728+0000","last_change":"2024-09-13T19:19:31.067778+0000","last_active":"2024-09-13T19:19:31.067728+0000","last_peered":"2024-09-13T19:19:31.067728+0000","last_clean":"2024-09-13T19:19:31.067728+0000","last_became_active":"2024-09-13T19:16:01.904684+0000","last_became_peered":"2024-09-13T19:16:01.904684+0000","last_unstale":"2024-09-13T19:19:31.067728+0000","last_undegraded":"2024-09-13T19:19:31.067728+0000","last_fullsized":"2024-09-13T19:19:31.067728+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'40","last_scrub_stamp":"2024-09-13T19:19:31.067631+0000","last_deep_scrub":"36'40","last_deep_scrub_stamp":"2024-09-13T19:19:31.067631+0000","last_clean_scrub_stamp":"2024-09-13T19:19:31.067631+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:43.676892+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:23.943412+0000","last_change":"2024-09-13T19:16:03.912531+0000","last_active":"2024-09-13T19:18:23.943412+0000","last_peered":"2024-09-13T19:18:23.943412+0000","last_clean":"2024-09-13T19:18:23.943412+0000","last_became_active":"2024-09-13T19:16:03.912244+0000","last_became_peered":"2024-09-13T19:16:03.912244+0000","last_unstale":"2024-09-13T19:18:23.943412+0000","last_undegraded":"2024-09-13T19:18:23.943412+0000","last_fullsized":"2024-09-13T19:18:23.943412+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"36'3","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:06.935876+0000","last_change":"2024-09-13T19:16:05.921280+0000","last_active":"2024-09-13T19:18:06.935876+0000","last_peered":"2024-09-13T19:18:06.935876+0000","last_clean":"2024-09-13T19:18:06.935876+0000","last_became_active":"2024-09-13T19:16:05.920951+0000","last_became_peered":"2024-09-13T19:16:05.920951+0000","last_unstale":"2024-09-13T19:18:06.935876+0000","last_undegraded":"2024-09-13T19:18:06.935876+0000","last_fullsized":"2024-09-13T19:18:06.935876+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"36'4","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.601585+0000","last_change":"2024-09-13T19:15:57.902138+0000","last_active":"2024-09-13T19:19:05.601585+0000","last_peered":"2024-09-13T19:19:05.601585+0000","last_clean":"2024-09-13T19:19:05.601585+0000","last_became_active":"2024-09-13T19:15:57.901732+0000","last_became_peered":"2024-09-13T19:15:57.901732+0000","last_unstale":"2024-09-13T19:19:05.601585+0000","last_undegraded":"2024-09-13T19:19:05.601585+0000","last_fullsized":"2024-09-13T19:19:05.601585+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:23.942798+0000","last_change":"2024-09-13T19:15:55.894585+0000","last_active":"2024-09-13T19:18:23.942798+0000","last_peered":"2024-09-13T19:18:23.942798+0000","last_clean":"2024-09-13T19:18:23.942798+0000","last_became_active":"2024-09-13T19:15:55.894279+0000","last_became_peered":"2024-09-13T19:15:55.894279+0000","last_unstale":"2024-09-13T19:18:23.942798+0000","last_undegraded":"2024-09-13T19:18:23.942798+0000","last_fullsized":"2024-09-13T19:18:23.942798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:24.099254+0000","last_change":"2024-09-13T19:19:24.099278+0000","last_active":"2024-09-13T19:19:24.099254+0000","last_peered":"2024-09-13T19:19:24.099254+0000","last_clean":"2024-09-13T19:19:24.099254+0000","last_became_active":"2024-09-13T19:15:59.895325+0000","last_became_peered":"2024-09-13T19:15:59.895325+0000","last_unstale":"2024-09-13T19:19:24.099254+0000","last_undegraded":"2024-09-13T19:19:24.099254+0000","last_fullsized":"2024-09-13T19:19:24.099254+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:24.099164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:24.099164+0000","last_clean_scrub_stamp":"2024-09-13T19:19:24.099164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:16.483764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"36'8","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:30.333549+0000","last_change":"2024-09-13T19:19:30.333585+0000","last_active":"2024-09-13T19:19:30.333549+0000","last_peered":"2024-09-13T19:19:30.333549+0000","last_clean":"2024-09-13T19:19:30.333549+0000","last_became_active":"2024-09-13T19:16:01.901250+0000","last_became_peered":"2024-09-13T19:16:01.901250+0000","last_unstale":"2024-09-13T19:19:30.333549+0000","last_undegraded":"2024-09-13T19:19:30.333549+0000","last_fullsized":"2024-09-13T19:19:30.333549+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-13T19:19:30.333464+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-13T19:19:30.333464+0000","last_clean_scrub_stamp":"2024-09-13T19:19:30.333464+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:12:35.870136+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:16.732038+0000","last_change":"2024-09-13T19:19:16.732086+0000","last_active":"2024-09-13T19:19:16.732038+0000","last_peered":"2024-09-13T19:19:16.732038+0000","last_clean":"2024-09-13T19:19:16.732038+0000","last_became_active":"2024-09-13T19:16:03.913053+0000","last_became_peered":"2024-09-13T19:16:03.913053+0000","last_unstale":"2024-09-13T19:19:16.732038+0000","last_undegraded":"2024-09-13T19:19:16.732038+0000","last_fullsized":"2024-09-13T19:19:16.732038+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:16.731903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:16.731903+0000","last_clean_scrub_stamp":"2024-09-13T19:19:16.731903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:42.561076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"36'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.710033+0000","last_change":"2024-09-13T19:16:05.912786+0000","last_active":"2024-09-13T19:19:05.710033+0000","last_peered":"2024-09-13T19:19:05.710033+0000","last_clean":"2024-09-13T19:19:05.710033+0000","last_became_active":"2024-09-13T19:16:05.912428+0000","last_became_peered":"2024-09-13T19:16:05.912428+0000","last_unstale":"2024-09-13T19:19:05.710033+0000","last_undegraded":"2024-09-13T19:19:05.710033+0000","last_fullsized":"2024-09-13T19:19:05.710033+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"36'7","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.064847+0000","last_change":"2024-09-13T19:15:57.896825+0000","last_active":"2024-09-13T19:19:06.064847+0000","last_peered":"2024-09-13T19:19:06.064847+0000","last_clean":"2024-09-13T19:19:06.064847+0000","last_became_active":"2024-09-13T19:15:57.896463+0000","last_became_peered":"2024-09-13T19:15:57.896463+0000","last_unstale":"2024-09-13T19:19:06.064847+0000","last_undegraded":"2024-09-13T19:19:06.064847+0000","last_fullsized":"2024-09-13T19:19:06.064847+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:23.942849+0000","last_change":"2024-09-13T19:15:55.888440+0000","last_active":"2024-09-13T19:18:23.942849+0000","last_peered":"2024-09-13T19:18:23.942849+0000","last_clean":"2024-09-13T19:18:23.942849+0000","last_became_active":"2024-09-13T19:15:55.888108+0000","last_became_peered":"2024-09-13T19:15:55.888108+0000","last_unstale":"2024-09-13T19:18:23.942849+0000","last_undegraded":"2024-09-13T19:18:23.942849+0000","last_fullsized":"2024-09-13T19:18:23.942849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:18.941874+0000","last_change":"2024-09-13T19:15:59.893154+0000","last_active":"2024-09-13T19:18:18.941874+0000","last_peered":"2024-09-13T19:18:18.941874+0000","last_clean":"2024-09-13T19:18:18.941874+0000","last_became_active":"2024-09-13T19:15:59.892842+0000","last_became_peered":"2024-09-13T19:15:59.892842+0000","last_unstale":"2024-09-13T19:18:18.941874+0000","last_undegraded":"2024-09-13T19:18:18.941874+0000","last_fullsized":"2024-09-13T19:18:18.941874+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"36'48","reported_seq":120,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:24.358477+0000","last_change":"2024-09-13T19:19:24.358526+0000","last_active":"2024-09-13T19:19:24.358477+0000","last_peered":"2024-09-13T19:19:24.358477+0000","last_clean":"2024-09-13T19:19:24.358477+0000","last_became_active":"2024-09-13T19:16:01.902991+0000","last_became_peered":"2024-09-13T19:16:01.902991+0000","last_unstale":"2024-09-13T19:19:24.358477+0000","last_undegraded":"2024-09-13T19:19:24.358477+0000","last_fullsized":"2024-09-13T19:19:24.358477+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'48","last_scrub_stamp":"2024-09-13T19:19:24.358388+0000","last_deep_scrub":"36'48","last_deep_scrub_stamp":"2024-09-13T19:19:24.358388+0000","last_clean_scrub_stamp":"2024-09-13T19:19:24.358388+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:23:15.090837+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:27.782078+0000","last_change":"2024-09-13T19:19:27.782128+0000","last_active":"2024-09-13T19:19:27.782078+0000","last_peered":"2024-09-13T19:19:27.782078+0000","last_clean":"2024-09-13T19:19:27.782078+0000","last_became_active":"2024-09-13T19:16:03.911917+0000","last_became_peered":"2024-09-13T19:16:03.911917+0000","last_unstale":"2024-09-13T19:19:27.782078+0000","last_undegraded":"2024-09-13T19:19:27.782078+0000","last_fullsized":"2024-09-13T19:19:27.782078+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:27.781937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:27.781937+0000","last_clean_scrub_stamp":"2024-09-13T19:19:27.781937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:51.979166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"36'4","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:38.945635+0000","last_change":"2024-09-13T19:16:05.924382+0000","last_active":"2024-09-13T19:18:38.945635+0000","last_peered":"2024-09-13T19:18:38.945635+0000","last_clean":"2024-09-13T19:18:38.945635+0000","last_became_active":"2024-09-13T19:16:05.923368+0000","last_became_peered":"2024-09-13T19:16:05.923368+0000","last_unstale":"2024-09-13T19:18:38.945635+0000","last_undegraded":"2024-09-13T19:18:38.945635+0000","last_fullsized":"2024-09-13T19:18:38.945635+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"36'16","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.849006+0000","last_change":"2024-09-13T19:16:31.999453+0000","last_active":"2024-09-13T19:19:05.849006+0000","last_peered":"2024-09-13T19:19:05.849006+0000","last_clean":"2024-09-13T19:19:05.849006+0000","last_became_active":"2024-09-13T19:16:31.991993+0000","last_became_peered":"2024-09-13T19:16:31.991993+0000","last_unstale":"2024-09-13T19:19:05.849006+0000","last_undegraded":"2024-09-13T19:19:05.849006+0000","last_fullsized":"2024-09-13T19:19:05.849006+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:23.942988+0000","last_change":"2024-09-13T19:15:55.892008+0000","last_active":"2024-09-13T19:18:23.942988+0000","last_peered":"2024-09-13T19:18:23.942988+0000","last_clean":"2024-09-13T19:18:23.942988+0000","last_became_active":"2024-09-13T19:15:55.891711+0000","last_became_peered":"2024-09-13T19:15:55.891711+0000","last_unstale":"2024-09-13T19:18:23.942988+0000","last_undegraded":"2024-09-13T19:18:23.942988+0000","last_fullsized":"2024-09-13T19:18:23.942988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:28.138750+0000","last_change":"2024-09-13T19:19:28.138774+0000","last_active":"2024-09-13T19:19:28.138750+0000","last_peered":"2024-09-13T19:19:28.138750+0000","last_clean":"2024-09-13T19:19:28.138750+0000","last_became_active":"2024-09-13T19:15:59.891581+0000","last_became_peered":"2024-09-13T19:15:59.891581+0000","last_unstale":"2024-09-13T19:19:28.138750+0000","last_undegraded":"2024-09-13T19:19:28.138750+0000","last_fullsized":"2024-09-13T19:19:28.138750+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:28.138649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:28.138649+0000","last_clean_scrub_stamp":"2024-09-13T19:19:28.138649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:49.838315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"36'36","reported_seq":91,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:29.830558+0000","last_change":"2024-09-13T19:19:29.830588+0000","last_active":"2024-09-13T19:19:29.830558+0000","last_peered":"2024-09-13T19:19:29.830558+0000","last_clean":"2024-09-13T19:19:29.830558+0000","last_became_active":"2024-09-13T19:16:01.899438+0000","last_became_peered":"2024-09-13T19:16:01.899438+0000","last_unstale":"2024-09-13T19:19:29.830558+0000","last_undegraded":"2024-09-13T19:19:29.830558+0000","last_fullsized":"2024-09-13T19:19:29.830558+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-13T19:19:29.830469+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-13T19:19:29.830469+0000","last_clean_scrub_stamp":"2024-09-13T19:19:29.830469+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:27.642409+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:20.751480+0000","last_change":"2024-09-13T19:19:20.751502+0000","last_active":"2024-09-13T19:19:20.751480+0000","last_peered":"2024-09-13T19:19:20.751480+0000","last_clean":"2024-09-13T19:19:20.751480+0000","last_became_active":"2024-09-13T19:16:03.910319+0000","last_became_peered":"2024-09-13T19:16:03.910319+0000","last_unstale":"2024-09-13T19:19:20.751480+0000","last_undegraded":"2024-09-13T19:19:20.751480+0000","last_fullsized":"2024-09-13T19:19:20.751480+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:20.751392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:20.751392+0000","last_clean_scrub_stamp":"2024-09-13T19:19:20.751392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:18.995121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"36'10","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.851276+0000","last_change":"2024-09-13T19:15:57.897487+0000","last_active":"2024-09-13T19:19:05.851276+0000","last_peered":"2024-09-13T19:19:05.851276+0000","last_clean":"2024-09-13T19:19:05.851276+0000","last_became_active":"2024-09-13T19:15:57.897232+0000","last_became_peered":"2024-09-13T19:15:57.897232+0000","last_unstale":"2024-09-13T19:19:05.851276+0000","last_undegraded":"2024-09-13T19:19:05.851276+0000","last_fullsized":"2024-09-13T19:19:05.851276+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:23.943384+0000","last_change":"2024-09-13T19:15:55.901992+0000","last_active":"2024-09-13T19:18:23.943384+0000","last_peered":"2024-09-13T19:18:23.943384+0000","last_clean":"2024-09-13T19:18:23.943384+0000","last_became_active":"2024-09-13T19:15:55.901257+0000","last_became_peered":"2024-09-13T19:15:55.901257+0000","last_unstale":"2024-09-13T19:18:23.943384+0000","last_undegraded":"2024-09-13T19:18:23.943384+0000","last_fullsized":"2024-09-13T19:18:23.943384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:32.383161+0000","last_change":"2024-09-13T19:19:32.383184+0000","last_active":"2024-09-13T19:19:32.383161+0000","last_peered":"2024-09-13T19:19:32.383161+0000","last_clean":"2024-09-13T19:19:32.383161+0000","last_became_active":"2024-09-13T19:15:59.896339+0000","last_became_peered":"2024-09-13T19:15:59.896339+0000","last_unstale":"2024-09-13T19:19:32.383161+0000","last_undegraded":"2024-09-13T19:19:32.383161+0000","last_fullsized":"2024-09-13T19:19:32.383161+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:32.383058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:32.383058+0000","last_clean_scrub_stamp":"2024-09-13T19:19:32.383058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:00.272146+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"36'63","reported_seq":136,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:31.346681+0000","last_change":"2024-09-13T19:19:31.346722+0000","last_active":"2024-09-13T19:19:31.346681+0000","last_peered":"2024-09-13T19:19:31.346681+0000","last_clean":"2024-09-13T19:19:31.346681+0000","last_became_active":"2024-09-13T19:16:01.901092+0000","last_became_peered":"2024-09-13T19:16:01.901092+0000","last_unstale":"2024-09-13T19:19:31.346681+0000","last_undegraded":"2024-09-13T19:19:31.346681+0000","last_fullsized":"2024-09-13T19:19:31.346681+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'63","last_scrub_stamp":"2024-09-13T19:19:31.346567+0000","last_deep_scrub":"36'63","last_deep_scrub_stamp":"2024-09-13T19:19:31.346567+0000","last_clean_scrub_stamp":"2024-09-13T19:19:31.346567+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:48:17.500355+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:18.709566+0000","last_change":"2024-09-13T19:19:18.709589+0000","last_active":"2024-09-13T19:19:18.709566+0000","last_peered":"2024-09-13T19:19:18.709566+0000","last_clean":"2024-09-13T19:19:18.709566+0000","last_became_active":"2024-09-13T19:16:03.910305+0000","last_became_peered":"2024-09-13T19:16:03.910305+0000","last_unstale":"2024-09-13T19:19:18.709566+0000","last_undegraded":"2024-09-13T19:19:18.709566+0000","last_fullsized":"2024-09-13T19:19:18.709566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:18.709481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:18.709481+0000","last_clean_scrub_stamp":"2024-09-13T19:19:18.709481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:41.615886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"36'22","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.598961+0000","last_change":"2024-09-13T19:16:05.913081+0000","last_active":"2024-09-13T19:19:05.598961+0000","last_peered":"2024-09-13T19:19:05.598961+0000","last_clean":"2024-09-13T19:19:05.598961+0000","last_became_active":"2024-09-13T19:16:05.912675+0000","last_became_peered":"2024-09-13T19:16:05.912675+0000","last_unstale":"2024-09-13T19:19:05.598961+0000","last_undegraded":"2024-09-13T19:19:05.598961+0000","last_fullsized":"2024-09-13T19:19:05.598961+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"36'6","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:56.934198+0000","last_change":"2024-09-13T19:15:57.890233+0000","last_active":"2024-09-13T19:17:56.934198+0000","last_peered":"2024-09-13T19:17:56.934198+0000","last_clean":"2024-09-13T19:17:56.934198+0000","last_became_active":"2024-09-13T19:15:57.889921+0000","last_became_peered":"2024-09-13T19:15:57.889921+0000","last_unstale":"2024-09-13T19:17:56.934198+0000","last_undegraded":"2024-09-13T19:17:56.934198+0000","last_fullsized":"2024-09-13T19:17:56.934198+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:23.942762+0000","last_change":"2024-09-13T19:15:55.895671+0000","last_active":"2024-09-13T19:18:23.942762+0000","last_peered":"2024-09-13T19:18:23.942762+0000","last_clean":"2024-09-13T19:18:23.942762+0000","last_became_active":"2024-09-13T19:15:55.895344+0000","last_became_peered":"2024-09-13T19:15:55.895344+0000","last_unstale":"2024-09-13T19:18:23.942762+0000","last_undegraded":"2024-09-13T19:18:23.942762+0000","last_fullsized":"2024-09-13T19:18:23.942762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.939721+0000","last_change":"2024-09-13T19:15:59.888500+0000","last_active":"2024-09-13T19:18:03.939721+0000","last_peered":"2024-09-13T19:18:03.939721+0000","last_clean":"2024-09-13T19:18:03.939721+0000","last_became_active":"2024-09-13T19:15:59.888213+0000","last_became_peered":"2024-09-13T19:15:59.888213+0000","last_unstale":"2024-09-13T19:18:03.939721+0000","last_undegraded":"2024-09-13T19:18:03.939721+0000","last_fullsized":"2024-09-13T19:18:03.939721+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"36'39","reported_seq":89,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.704256+0000","last_change":"2024-09-13T19:16:01.908414+0000","last_active":"2024-09-13T19:19:12.704256+0000","last_peered":"2024-09-13T19:19:12.704256+0000","last_clean":"2024-09-13T19:19:12.704256+0000","last_became_active":"2024-09-13T19:16:01.908116+0000","last_became_peered":"2024-09-13T19:16:01.908116+0000","last_unstale":"2024-09-13T19:19:12.704256+0000","last_undegraded":"2024-09-13T19:19:12.704256+0000","last_fullsized":"2024-09-13T19:19:12.704256+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:31.769578+0000","last_change":"2024-09-13T19:19:31.769602+0000","last_active":"2024-09-13T19:19:31.769578+0000","last_peered":"2024-09-13T19:19:31.769578+0000","last_clean":"2024-09-13T19:19:31.769578+0000","last_became_active":"2024-09-13T19:16:03.914179+0000","last_became_peered":"2024-09-13T19:16:03.914179+0000","last_unstale":"2024-09-13T19:19:31.769578+0000","last_undegraded":"2024-09-13T19:19:31.769578+0000","last_fullsized":"2024-09-13T19:19:31.769578+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:31.769488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:31.769488+0000","last_clean_scrub_stamp":"2024-09-13T19:19:31.769488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:13.242003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"34'2","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:28.944191+0000","last_change":"2024-09-13T19:16:05.917077+0000","last_active":"2024-09-13T19:18:28.944191+0000","last_peered":"2024-09-13T19:18:28.944191+0000","last_clean":"2024-09-13T19:18:28.944191+0000","last_became_active":"2024-09-13T19:16:05.916822+0000","last_became_peered":"2024-09-13T19:16:05.916822+0000","last_unstale":"2024-09-13T19:18:28.944191+0000","last_undegraded":"2024-09-13T19:18:28.944191+0000","last_fullsized":"2024-09-13T19:18:28.944191+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"36'22","reported_seq":82,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:30.102419+0000","last_change":"2024-09-13T19:19:30.102447+0000","last_active":"2024-09-13T19:19:30.102419+0000","last_peered":"2024-09-13T19:19:30.102419+0000","last_clean":"2024-09-13T19:19:30.102419+0000","last_became_active":"2024-09-13T19:15:57.901330+0000","last_became_peered":"2024-09-13T19:15:57.901330+0000","last_unstale":"2024-09-13T19:19:30.102419+0000","last_undegraded":"2024-09-13T19:19:30.102419+0000","last_fullsized":"2024-09-13T19:19:30.102419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'22","last_scrub_stamp":"2024-09-13T19:19:30.102322+0000","last_deep_scrub":"36'22","last_deep_scrub_stamp":"2024-09-13T19:19:30.102322+0000","last_clean_scrub_stamp":"2024-09-13T19:19:30.102322+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:16.992227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":60,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:28.943575+0000","last_change":"2024-09-13T19:15:55.896540+0000","last_active":"2024-09-13T19:18:28.943575+0000","last_peered":"2024-09-13T19:18:28.943575+0000","last_clean":"2024-09-13T19:18:28.943575+0000","last_became_active":"2024-09-13T19:15:55.896196+0000","last_became_peered":"2024-09-13T19:15:55.896196+0000","last_unstale":"2024-09-13T19:18:28.943575+0000","last_undegraded":"2024-09-13T19:18:28.943575+0000","last_fullsized":"2024-09-13T19:18:28.943575+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:28.943527+0000","last_change":"2024-09-13T19:15:59.891464+0000","last_active":"2024-09-13T19:18:28.943527+0000","last_peered":"2024-09-13T19:18:28.943527+0000","last_clean":"2024-09-13T19:18:28.943527+0000","last_became_active":"2024-09-13T19:15:59.891131+0000","last_became_peered":"2024-09-13T19:15:59.891131+0000","last_unstale":"2024-09-13T19:18:28.943527+0000","last_undegraded":"2024-09-13T19:18:28.943527+0000","last_fullsized":"2024-09-13T19:18:28.943527+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"36'39","reported_seq":95,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:27.304444+0000","last_change":"2024-09-13T19:19:27.304502+0000","last_active":"2024-09-13T19:19:27.304444+0000","last_peered":"2024-09-13T19:19:27.304444+0000","last_clean":"2024-09-13T19:19:27.304444+0000","last_became_active":"2024-09-13T19:16:01.902251+0000","last_became_peered":"2024-09-13T19:16:01.902251+0000","last_unstale":"2024-09-13T19:19:27.304444+0000","last_undegraded":"2024-09-13T19:19:27.304444+0000","last_fullsized":"2024-09-13T19:19:27.304444+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'39","last_scrub_stamp":"2024-09-13T19:19:27.304335+0000","last_deep_scrub":"36'39","last_deep_scrub_stamp":"2024-09-13T19:19:27.304335+0000","last_clean_scrub_stamp":"2024-09-13T19:19:27.304335+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:19:17.836466+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:06.935896+0000","last_change":"2024-09-13T19:16:03.915520+0000","last_active":"2024-09-13T19:18:06.935896+0000","last_peered":"2024-09-13T19:18:06.935896+0000","last_clean":"2024-09-13T19:18:06.935896+0000","last_became_active":"2024-09-13T19:16:03.915225+0000","last_became_peered":"2024-09-13T19:16:03.915225+0000","last_unstale":"2024-09-13T19:18:06.935896+0000","last_undegraded":"2024-09-13T19:18:06.935896+0000","last_fullsized":"2024-09-13T19:18:06.935896+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"36'5","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:28.944166+0000","last_change":"2024-09-13T19:16:05.925066+0000","last_active":"2024-09-13T19:18:28.944166+0000","last_peered":"2024-09-13T19:18:28.944166+0000","last_clean":"2024-09-13T19:18:28.944166+0000","last_became_active":"2024-09-13T19:16:05.923235+0000","last_became_peered":"2024-09-13T19:16:05.923235+0000","last_unstale":"2024-09-13T19:18:28.944166+0000","last_undegraded":"2024-09-13T19:18:28.944166+0000","last_fullsized":"2024-09-13T19:18:28.944166+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"36'8","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.930007+0000","last_change":"2024-09-13T19:15:57.886598+0000","last_active":"2024-09-13T19:19:05.930007+0000","last_peered":"2024-09-13T19:19:05.930007+0000","last_clean":"2024-09-13T19:19:05.930007+0000","last_became_active":"2024-09-13T19:15:57.886263+0000","last_became_peered":"2024-09-13T19:15:57.886263+0000","last_unstale":"2024-09-13T19:19:05.930007+0000","last_undegraded":"2024-09-13T19:19:05.930007+0000","last_fullsized":"2024-09-13T19:19:05.930007+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:28.944236+0000","last_change":"2024-09-13T19:15:55.894466+0000","last_active":"2024-09-13T19:18:28.944236+0000","last_peered":"2024-09-13T19:18:28.944236+0000","last_clean":"2024-09-13T19:18:28.944236+0000","last_became_active":"2024-09-13T19:15:55.893629+0000","last_became_peered":"2024-09-13T19:15:55.893629+0000","last_unstale":"2024-09-13T19:18:28.944236+0000","last_undegraded":"2024-09-13T19:18:28.944236+0000","last_fullsized":"2024-09-13T19:18:28.944236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:32.783520+0000","last_change":"2024-09-13T19:19:32.783543+0000","last_active":"2024-09-13T19:19:32.783520+0000","last_peered":"2024-09-13T19:19:32.783520+0000","last_clean":"2024-09-13T19:19:32.783520+0000","last_became_active":"2024-09-13T19:15:59.892445+0000","last_became_peered":"2024-09-13T19:15:59.892445+0000","last_unstale":"2024-09-13T19:19:32.783520+0000","last_undegraded":"2024-09-13T19:19:32.783520+0000","last_fullsized":"2024-09-13T19:19:32.783520+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:32.783411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:32.783411+0000","last_clean_scrub_stamp":"2024-09-13T19:19:32.783411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:00:48.438787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'11","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.940380+0000","last_change":"2024-09-13T19:16:01.906065+0000","last_active":"2024-09-13T19:18:03.940380+0000","last_peered":"2024-09-13T19:18:03.940380+0000","last_clean":"2024-09-13T19:18:03.940380+0000","last_became_active":"2024-09-13T19:16:01.905553+0000","last_became_peered":"2024-09-13T19:16:01.905553+0000","last_unstale":"2024-09-13T19:18:03.940380+0000","last_undegraded":"2024-09-13T19:18:03.940380+0000","last_fullsized":"2024-09-13T19:18:03.940380+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:00.880092+0000","last_clean_scrub_stamp":"2024-09-13T19:16:00.880092+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"36'285","reported_seq":378,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:19.719742+0000","last_change":"2024-09-13T19:19:19.719772+0000","last_active":"2024-09-13T19:19:19.719742+0000","last_peered":"2024-09-13T19:19:19.719742+0000","last_clean":"2024-09-13T19:19:19.719742+0000","last_became_active":"2024-09-13T19:16:03.913170+0000","last_became_peered":"2024-09-13T19:16:03.913170+0000","last_unstale":"2024-09-13T19:19:19.719742+0000","last_undegraded":"2024-09-13T19:19:19.719742+0000","last_fullsized":"2024-09-13T19:19:19.719742+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-13T19:19:19.719650+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-13T19:19:19.719650+0000","last_clean_scrub_stamp":"2024-09-13T19:19:19.719650+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:13:51.353091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"36'4","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.933358+0000","last_change":"2024-09-13T19:16:05.920004+0000","last_active":"2024-09-13T19:19:05.933358+0000","last_peered":"2024-09-13T19:19:05.933358+0000","last_clean":"2024-09-13T19:19:05.933358+0000","last_became_active":"2024-09-13T19:16:05.918050+0000","last_became_peered":"2024-09-13T19:16:05.918050+0000","last_unstale":"2024-09-13T19:19:05.933358+0000","last_undegraded":"2024-09-13T19:19:05.933358+0000","last_fullsized":"2024-09-13T19:19:05.933358+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"36'9","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.063864+0000","last_change":"2024-09-13T19:15:57.885999+0000","last_active":"2024-09-13T19:19:06.063864+0000","last_peered":"2024-09-13T19:19:06.063864+0000","last_clean":"2024-09-13T19:19:06.063864+0000","last_became_active":"2024-09-13T19:15:57.885711+0000","last_became_peered":"2024-09-13T19:15:57.885711+0000","last_unstale":"2024-09-13T19:19:06.063864+0000","last_undegraded":"2024-09-13T19:19:06.063864+0000","last_fullsized":"2024-09-13T19:19:06.063864+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.830312+0000","last_change":"2024-09-13T19:15:55.891066+0000","last_active":"2024-09-13T19:19:05.830312+0000","last_peered":"2024-09-13T19:19:05.830312+0000","last_clean":"2024-09-13T19:19:05.830312+0000","last_became_active":"2024-09-13T19:15:55.890670+0000","last_became_peered":"2024-09-13T19:15:55.890670+0000","last_unstale":"2024-09-13T19:19:05.830312+0000","last_undegraded":"2024-09-13T19:19:05.830312+0000","last_fullsized":"2024-09-13T19:19:05.830312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:29.803492+0000","last_change":"2024-09-13T19:19:29.803524+0000","last_active":"2024-09-13T19:19:29.803492+0000","last_peered":"2024-09-13T19:19:29.803492+0000","last_clean":"2024-09-13T19:19:29.803492+0000","last_became_active":"2024-09-13T19:15:59.893905+0000","last_became_peered":"2024-09-13T19:15:59.893905+0000","last_unstale":"2024-09-13T19:19:29.803492+0000","last_undegraded":"2024-09-13T19:19:29.803492+0000","last_fullsized":"2024-09-13T19:19:29.803492+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:29.803399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:29.803399+0000","last_clean_scrub_stamp":"2024-09-13T19:19:29.803399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:13.674139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"36'46","reported_seq":104,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:18.724087+0000","last_change":"2024-09-13T19:19:18.724144+0000","last_active":"2024-09-13T19:19:18.724087+0000","last_peered":"2024-09-13T19:19:18.724087+0000","last_clean":"2024-09-13T19:19:18.724087+0000","last_became_active":"2024-09-13T19:16:01.903395+0000","last_became_peered":"2024-09-13T19:16:01.903395+0000","last_unstale":"2024-09-13T19:19:18.724087+0000","last_undegraded":"2024-09-13T19:19:18.724087+0000","last_fullsized":"2024-09-13T19:19:18.724087+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'46","last_scrub_stamp":"2024-09-13T19:19:18.723995+0000","last_deep_scrub":"36'46","last_deep_scrub_stamp":"2024-09-13T19:19:18.723995+0000","last_clean_scrub_stamp":"2024-09-13T19:19:18.723995+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:23.717143+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:18.382095+0000","last_change":"2024-09-13T19:19:18.382122+0000","last_active":"2024-09-13T19:19:18.382095+0000","last_peered":"2024-09-13T19:19:18.382095+0000","last_clean":"2024-09-13T19:19:18.382095+0000","last_became_active":"2024-09-13T19:16:03.910550+0000","last_became_peered":"2024-09-13T19:16:03.910550+0000","last_unstale":"2024-09-13T19:19:18.382095+0000","last_undegraded":"2024-09-13T19:19:18.382095+0000","last_fullsized":"2024-09-13T19:19:18.382095+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:18.381995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:18.381995+0000","last_clean_scrub_stamp":"2024-09-13T19:19:18.381995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:49.252007+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"36'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.212023+0000","last_change":"2024-09-13T19:16:05.913865+0000","last_active":"2024-09-13T19:19:06.212023+0000","last_peered":"2024-09-13T19:19:06.212023+0000","last_clean":"2024-09-13T19:19:06.212023+0000","last_became_active":"2024-09-13T19:16:05.913598+0000","last_became_peered":"2024-09-13T19:16:05.913598+0000","last_unstale":"2024-09-13T19:19:06.212023+0000","last_undegraded":"2024-09-13T19:19:06.212023+0000","last_fullsized":"2024-09-13T19:19:06.212023+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:28.943418+0000","last_change":"2024-09-13T19:15:57.884460+0000","last_active":"2024-09-13T19:18:28.943418+0000","last_peered":"2024-09-13T19:18:28.943418+0000","last_clean":"2024-09-13T19:18:28.943418+0000","last_became_active":"2024-09-13T19:15:57.883463+0000","last_became_peered":"2024-09-13T19:15:57.883463+0000","last_unstale":"2024-09-13T19:18:28.943418+0000","last_undegraded":"2024-09-13T19:18:28.943418+0000","last_fullsized":"2024-09-13T19:18:28.943418+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:28.944303+0000","last_change":"2024-09-13T19:15:55.900188+0000","last_active":"2024-09-13T19:18:28.944303+0000","last_peered":"2024-09-13T19:18:28.944303+0000","last_clean":"2024-09-13T19:18:28.944303+0000","last_became_active":"2024-09-13T19:15:55.899847+0000","last_became_peered":"2024-09-13T19:15:55.899847+0000","last_unstale":"2024-09-13T19:18:28.944303+0000","last_undegraded":"2024-09-13T19:18:28.944303+0000","last_fullsized":"2024-09-13T19:18:28.944303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:33.839962+0000","last_change":"2024-09-13T19:19:33.840008+0000","last_active":"2024-09-13T19:19:33.839962+0000","last_peered":"2024-09-13T19:19:33.839962+0000","last_clean":"2024-09-13T19:19:33.839962+0000","last_became_active":"2024-09-13T19:15:59.895512+0000","last_became_peered":"2024-09-13T19:15:59.895512+0000","last_unstale":"2024-09-13T19:19:33.839962+0000","last_undegraded":"2024-09-13T19:19:33.839962+0000","last_fullsized":"2024-09-13T19:19:33.839962+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:33.839854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:33.839854+0000","last_clean_scrub_stamp":"2024-09-13T19:19:33.839854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:49.315701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"36'36","reported_seq":91,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:26.305275+0000","last_change":"2024-09-13T19:19:26.305329+0000","last_active":"2024-09-13T19:19:26.305275+0000","last_peered":"2024-09-13T19:19:26.305275+0000","last_clean":"2024-09-13T19:19:26.305275+0000","last_became_active":"2024-09-13T19:16:01.902285+0000","last_became_peered":"2024-09-13T19:16:01.902285+0000","last_unstale":"2024-09-13T19:19:26.305275+0000","last_undegraded":"2024-09-13T19:19:26.305275+0000","last_fullsized":"2024-09-13T19:19:26.305275+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-13T19:19:26.305171+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-13T19:19:26.305171+0000","last_clean_scrub_stamp":"2024-09-13T19:19:26.305171+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:15:14.766698+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:28.944134+0000","last_change":"2024-09-13T19:16:03.911855+0000","last_active":"2024-09-13T19:18:28.944134+0000","last_peered":"2024-09-13T19:18:28.944134+0000","last_clean":"2024-09-13T19:18:28.944134+0000","last_became_active":"2024-09-13T19:16:03.911587+0000","last_became_peered":"2024-09-13T19:16:03.911587+0000","last_unstale":"2024-09-13T19:18:28.944134+0000","last_undegraded":"2024-09-13T19:18:28.944134+0000","last_fullsized":"2024-09-13T19:18:28.944134+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:33.945014+0000","last_change":"2024-09-13T19:16:05.923352+0000","last_active":"2024-09-13T19:18:33.945014+0000","last_peered":"2024-09-13T19:18:33.945014+0000","last_clean":"2024-09-13T19:18:33.945014+0000","last_became_active":"2024-09-13T19:16:05.923014+0000","last_became_peered":"2024-09-13T19:16:05.923014+0000","last_unstale":"2024-09-13T19:18:33.945014+0000","last_undegraded":"2024-09-13T19:18:33.945014+0000","last_fullsized":"2024-09-13T19:18:33.945014+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:23.943443+0000","last_change":"2024-09-13T19:15:57.896578+0000","last_active":"2024-09-13T19:18:23.943443+0000","last_peered":"2024-09-13T19:18:23.943443+0000","last_clean":"2024-09-13T19:18:23.943443+0000","last_became_active":"2024-09-13T19:15:57.896310+0000","last_became_peered":"2024-09-13T19:15:57.896310+0000","last_unstale":"2024-09-13T19:18:23.943443+0000","last_undegraded":"2024-09-13T19:18:23.943443+0000","last_fullsized":"2024-09-13T19:18:23.943443+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:56.934185+0000","last_change":"2024-09-13T19:15:55.895484+0000","last_active":"2024-09-13T19:17:56.934185+0000","last_peered":"2024-09-13T19:17:56.934185+0000","last_clean":"2024-09-13T19:17:56.934185+0000","last_became_active":"2024-09-13T19:15:55.893600+0000","last_became_peered":"2024-09-13T19:15:55.893600+0000","last_unstale":"2024-09-13T19:17:56.934185+0000","last_undegraded":"2024-09-13T19:17:56.934185+0000","last_fullsized":"2024-09-13T19:17:56.934185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:26.733975+0000","last_change":"2024-09-13T19:19:26.734018+0000","last_active":"2024-09-13T19:19:26.733975+0000","last_peered":"2024-09-13T19:19:26.733975+0000","last_clean":"2024-09-13T19:19:26.733975+0000","last_became_active":"2024-09-13T19:15:59.896518+0000","last_became_peered":"2024-09-13T19:15:59.896518+0000","last_unstale":"2024-09-13T19:19:26.733975+0000","last_undegraded":"2024-09-13T19:19:26.733975+0000","last_fullsized":"2024-09-13T19:19:26.733975+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:26.733839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:26.733839+0000","last_clean_scrub_stamp":"2024-09-13T19:19:26.733839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:27.626320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"36'30","reported_seq":83,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:23.073612+0000","last_change":"2024-09-13T19:19:23.073664+0000","last_active":"2024-09-13T19:19:23.073612+0000","last_peered":"2024-09-13T19:19:23.073612+0000","last_clean":"2024-09-13T19:19:23.073612+0000","last_became_active":"2024-09-13T19:16:01.902699+0000","last_became_peered":"2024-09-13T19:16:01.902699+0000","last_unstale":"2024-09-13T19:19:23.073612+0000","last_undegraded":"2024-09-13T19:19:23.073612+0000","last_fullsized":"2024-09-13T19:19:23.073612+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'30","last_scrub_stamp":"2024-09-13T19:19:23.073511+0000","last_deep_scrub":"36'30","last_deep_scrub_stamp":"2024-09-13T19:19:23.073511+0000","last_clean_scrub_stamp":"2024-09-13T19:19:23.073511+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:54:35.654271+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:33.944881+0000","last_change":"2024-09-13T19:16:03.913624+0000","last_active":"2024-09-13T19:18:33.944881+0000","last_peered":"2024-09-13T19:18:33.944881+0000","last_clean":"2024-09-13T19:18:33.944881+0000","last_became_active":"2024-09-13T19:16:03.913228+0000","last_became_peered":"2024-09-13T19:16:03.913228+0000","last_unstale":"2024-09-13T19:18:33.944881+0000","last_undegraded":"2024-09-13T19:18:33.944881+0000","last_fullsized":"2024-09-13T19:18:33.944881+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:02.887943+0000","last_clean_scrub_stamp":"2024-09-13T19:16:02.887943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"36'4","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:33.944981+0000","last_change":"2024-09-13T19:16:05.925781+0000","last_active":"2024-09-13T19:18:33.944981+0000","last_peered":"2024-09-13T19:18:33.944981+0000","last_clean":"2024-09-13T19:18:33.944981+0000","last_became_active":"2024-09-13T19:16:05.925519+0000","last_became_peered":"2024-09-13T19:16:05.925519+0000","last_unstale":"2024-09-13T19:18:33.944981+0000","last_undegraded":"2024-09-13T19:18:33.944981+0000","last_fullsized":"2024-09-13T19:18:33.944981+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"36'5","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.063256+0000","last_change":"2024-09-13T19:15:57.886387+0000","last_active":"2024-09-13T19:19:06.063256+0000","last_peered":"2024-09-13T19:19:06.063256+0000","last_clean":"2024-09-13T19:19:06.063256+0000","last_became_active":"2024-09-13T19:15:57.885993+0000","last_became_peered":"2024-09-13T19:15:57.885993+0000","last_unstale":"2024-09-13T19:19:06.063256+0000","last_undegraded":"2024-09-13T19:19:06.063256+0000","last_fullsized":"2024-09-13T19:19:06.063256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.939799+0000","last_change":"2024-09-13T19:15:55.895882+0000","last_active":"2024-09-13T19:18:03.939799+0000","last_peered":"2024-09-13T19:18:03.939799+0000","last_clean":"2024-09-13T19:18:03.939799+0000","last_became_active":"2024-09-13T19:15:55.895040+0000","last_became_peered":"2024-09-13T19:15:55.895040+0000","last_unstale":"2024-09-13T19:18:03.939799+0000","last_undegraded":"2024-09-13T19:18:03.939799+0000","last_fullsized":"2024-09-13T19:18:03.939799+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"36'3","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:24.660289+0000","last_change":"2024-09-13T19:19:24.660340+0000","last_active":"2024-09-13T19:19:24.660289+0000","last_peered":"2024-09-13T19:19:24.660289+0000","last_clean":"2024-09-13T19:19:24.660289+0000","last_became_active":"2024-09-13T19:15:59.897609+0000","last_became_peered":"2024-09-13T19:15:59.897609+0000","last_unstale":"2024-09-13T19:19:24.660289+0000","last_undegraded":"2024-09-13T19:19:24.660289+0000","last_fullsized":"2024-09-13T19:19:24.660289+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-13T19:19:24.660188+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-13T19:19:24.660188+0000","last_clean_scrub_stamp":"2024-09-13T19:19:24.660188+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:56.245062+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"36'40","reported_seq":97,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:21.050539+0000","last_change":"2024-09-13T19:19:21.050618+0000","last_active":"2024-09-13T19:19:21.050539+0000","last_peered":"2024-09-13T19:19:21.050539+0000","last_clean":"2024-09-13T19:19:21.050539+0000","last_became_active":"2024-09-13T19:16:01.902042+0000","last_became_peered":"2024-09-13T19:16:01.902042+0000","last_unstale":"2024-09-13T19:19:21.050539+0000","last_undegraded":"2024-09-13T19:19:21.050539+0000","last_fullsized":"2024-09-13T19:19:21.050539+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'40","last_scrub_stamp":"2024-09-13T19:19:21.050438+0000","last_deep_scrub":"36'40","last_deep_scrub_stamp":"2024-09-13T19:19:21.050438+0000","last_clean_scrub_stamp":"2024-09-13T19:19:21.050438+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:19.019166+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:16.346297+0000","last_change":"2024-09-13T19:19:16.346321+0000","last_active":"2024-09-13T19:19:16.346297+0000","last_peered":"2024-09-13T19:19:16.346297+0000","last_clean":"2024-09-13T19:19:16.346297+0000","last_became_active":"2024-09-13T19:16:03.911052+0000","last_became_peered":"2024-09-13T19:16:03.911052+0000","last_unstale":"2024-09-13T19:19:16.346297+0000","last_undegraded":"2024-09-13T19:19:16.346297+0000","last_fullsized":"2024-09-13T19:19:16.346297+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:16.346224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:16.346224+0000","last_clean_scrub_stamp":"2024-09-13T19:19:16.346224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:31.215677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"36'2","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:28.944271+0000","last_change":"2024-09-13T19:16:05.924212+0000","last_active":"2024-09-13T19:18:28.944271+0000","last_peered":"2024-09-13T19:18:28.944271+0000","last_clean":"2024-09-13T19:18:28.944271+0000","last_became_active":"2024-09-13T19:16:05.922822+0000","last_became_peered":"2024-09-13T19:16:05.922822+0000","last_unstale":"2024-09-13T19:18:28.944271+0000","last_undegraded":"2024-09-13T19:18:28.944271+0000","last_fullsized":"2024-09-13T19:18:28.944271+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"36'1","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.063513+0000","last_change":"2024-09-13T19:15:57.903389+0000","last_active":"2024-09-13T19:19:06.063513+0000","last_peered":"2024-09-13T19:19:06.063513+0000","last_clean":"2024-09-13T19:19:06.063513+0000","last_became_active":"2024-09-13T19:15:57.902883+0000","last_became_peered":"2024-09-13T19:15:57.902883+0000","last_unstale":"2024-09-13T19:19:06.063513+0000","last_undegraded":"2024-09-13T19:19:06.063513+0000","last_fullsized":"2024-09-13T19:19:06.063513+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.959542+0000","last_change":"2024-09-13T19:15:55.899096+0000","last_active":"2024-09-13T19:19:05.959542+0000","last_peered":"2024-09-13T19:19:05.959542+0000","last_clean":"2024-09-13T19:19:05.959542+0000","last_became_active":"2024-09-13T19:15:55.898653+0000","last_became_peered":"2024-09-13T19:15:55.898653+0000","last_unstale":"2024-09-13T19:19:05.959542+0000","last_undegraded":"2024-09-13T19:19:05.959542+0000","last_fullsized":"2024-09-13T19:19:05.959542+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"36'8","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.705139+0000","last_change":"2024-09-13T19:15:57.886714+0000","last_active":"2024-09-13T19:19:05.705139+0000","last_peered":"2024-09-13T19:19:05.705139+0000","last_clean":"2024-09-13T19:19:05.705139+0000","last_became_active":"2024-09-13T19:15:57.886330+0000","last_became_peered":"2024-09-13T19:15:57.886330+0000","last_unstale":"2024-09-13T19:19:05.705139+0000","last_undegraded":"2024-09-13T19:19:05.705139+0000","last_fullsized":"2024-09-13T19:19:05.705139+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:04.954305+0000","last_change":"2024-09-13T19:15:55.891290+0000","last_active":"2024-09-13T19:18:04.954305+0000","last_peered":"2024-09-13T19:18:04.954305+0000","last_clean":"2024-09-13T19:18:04.954305+0000","last_became_active":"2024-09-13T19:15:55.890821+0000","last_became_peered":"2024-09-13T19:15:55.890821+0000","last_unstale":"2024-09-13T19:18:04.954305+0000","last_undegraded":"2024-09-13T19:18:04.954305+0000","last_fullsized":"2024-09-13T19:18:04.954305+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"36'2","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:08.941077+0000","last_change":"2024-09-13T19:15:57.898663+0000","last_active":"2024-09-13T19:18:08.941077+0000","last_peered":"2024-09-13T19:18:08.941077+0000","last_clean":"2024-09-13T19:18:08.941077+0000","last_became_active":"2024-09-13T19:15:57.898295+0000","last_became_peered":"2024-09-13T19:15:57.898295+0000","last_unstale":"2024-09-13T19:18:08.941077+0000","last_undegraded":"2024-09-13T19:18:08.941077+0000","last_fullsized":"2024-09-13T19:18:08.941077+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.940216+0000","last_change":"2024-09-13T19:15:55.893929+0000","last_active":"2024-09-13T19:18:03.940216+0000","last_peered":"2024-09-13T19:18:03.940216+0000","last_clean":"2024-09-13T19:18:03.940216+0000","last_became_active":"2024-09-13T19:15:55.893191+0000","last_became_peered":"2024-09-13T19:15:55.893191+0000","last_unstale":"2024-09-13T19:18:03.940216+0000","last_undegraded":"2024-09-13T19:18:03.940216+0000","last_fullsized":"2024-09-13T19:18:03.940216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"36'6","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:06.935780+0000","last_change":"2024-09-13T19:15:57.887458+0000","last_active":"2024-09-13T19:18:06.935780+0000","last_peered":"2024-09-13T19:18:06.935780+0000","last_clean":"2024-09-13T19:18:06.935780+0000","last_became_active":"2024-09-13T19:15:57.886670+0000","last_became_peered":"2024-09-13T19:15:57.886670+0000","last_unstale":"2024-09-13T19:18:06.935780+0000","last_undegraded":"2024-09-13T19:18:06.935780+0000","last_fullsized":"2024-09-13T19:18:06.935780+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:01.934912+0000","last_change":"2024-09-13T19:15:55.894421+0000","last_active":"2024-09-13T19:18:01.934912+0000","last_peered":"2024-09-13T19:18:01.934912+0000","last_clean":"2024-09-13T19:18:01.934912+0000","last_became_active":"2024-09-13T19:15:55.893569+0000","last_became_peered":"2024-09-13T19:15:55.893569+0000","last_unstale":"2024-09-13T19:18:01.934912+0000","last_undegraded":"2024-09-13T19:18:01.934912+0000","last_fullsized":"2024-09-13T19:18:01.934912+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"36'6","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:01.934898+0000","last_change":"2024-09-13T19:15:57.896837+0000","last_active":"2024-09-13T19:18:01.934898+0000","last_peered":"2024-09-13T19:18:01.934898+0000","last_clean":"2024-09-13T19:18:01.934898+0000","last_became_active":"2024-09-13T19:15:57.896487+0000","last_became_peered":"2024-09-13T19:15:57.896487+0000","last_unstale":"2024-09-13T19:18:01.934898+0000","last_undegraded":"2024-09-13T19:18:01.934898+0000","last_fullsized":"2024-09-13T19:18:01.934898+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:06.935808+0000","last_change":"2024-09-13T19:15:55.892917+0000","last_active":"2024-09-13T19:18:06.935808+0000","last_peered":"2024-09-13T19:18:06.935808+0000","last_clean":"2024-09-13T19:18:06.935808+0000","last_became_active":"2024-09-13T19:15:55.892026+0000","last_became_peered":"2024-09-13T19:15:55.892026+0000","last_unstale":"2024-09-13T19:18:06.935808+0000","last_undegraded":"2024-09-13T19:18:06.935808+0000","last_fullsized":"2024-09-13T19:18:06.935808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"36'16","reported_seq":80,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.969386+0000","last_change":"2024-09-13T19:15:57.903134+0000","last_active":"2024-09-13T19:19:05.969386+0000","last_peered":"2024-09-13T19:19:05.969386+0000","last_clean":"2024-09-13T19:19:05.969386+0000","last_became_active":"2024-09-13T19:15:57.902841+0000","last_became_peered":"2024-09-13T19:15:57.902841+0000","last_unstale":"2024-09-13T19:19:05.969386+0000","last_undegraded":"2024-09-13T19:19:05.969386+0000","last_fullsized":"2024-09-13T19:19:05.969386+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":56,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:08.940421+0000","last_change":"2024-09-13T19:15:55.897004+0000","last_active":"2024-09-13T19:18:08.940421+0000","last_peered":"2024-09-13T19:18:08.940421+0000","last_clean":"2024-09-13T19:18:08.940421+0000","last_became_active":"2024-09-13T19:15:55.896490+0000","last_became_peered":"2024-09-13T19:15:55.896490+0000","last_unstale":"2024-09-13T19:18:08.940421+0000","last_undegraded":"2024-09-13T19:18:08.940421+0000","last_fullsized":"2024-09-13T19:18:08.940421+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"36'6","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.848896+0000","last_change":"2024-09-13T19:15:57.888143+0000","last_active":"2024-09-13T19:19:05.848896+0000","last_peered":"2024-09-13T19:19:05.848896+0000","last_clean":"2024-09-13T19:19:05.848896+0000","last_became_active":"2024-09-13T19:15:57.887810+0000","last_became_peered":"2024-09-13T19:15:57.887810+0000","last_unstale":"2024-09-13T19:19:05.848896+0000","last_undegraded":"2024-09-13T19:19:05.848896+0000","last_fullsized":"2024-09-13T19:19:05.848896+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:08.940389+0000","last_change":"2024-09-13T19:15:55.892243+0000","last_active":"2024-09-13T19:18:08.940389+0000","last_peered":"2024-09-13T19:18:08.940389+0000","last_clean":"2024-09-13T19:18:08.940389+0000","last_became_active":"2024-09-13T19:15:55.891422+0000","last_became_peered":"2024-09-13T19:15:55.891422+0000","last_unstale":"2024-09-13T19:18:08.940389+0000","last_undegraded":"2024-09-13T19:18:08.940389+0000","last_fullsized":"2024-09-13T19:18:08.940389+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"36'2","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.705339+0000","last_change":"2024-09-13T19:15:57.891037+0000","last_active":"2024-09-13T19:19:05.705339+0000","last_peered":"2024-09-13T19:19:05.705339+0000","last_clean":"2024-09-13T19:19:05.705339+0000","last_became_active":"2024-09-13T19:15:57.890491+0000","last_became_peered":"2024-09-13T19:15:57.890491+0000","last_unstale":"2024-09-13T19:19:05.705339+0000","last_undegraded":"2024-09-13T19:19:05.705339+0000","last_fullsized":"2024-09-13T19:19:05.705339+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.799217+0000","last_change":"2024-09-13T19:15:55.892364+0000","last_active":"2024-09-13T19:19:12.799217+0000","last_peered":"2024-09-13T19:19:12.799217+0000","last_clean":"2024-09-13T19:19:12.799217+0000","last_became_active":"2024-09-13T19:15:55.891860+0000","last_became_peered":"2024-09-13T19:15:55.891860+0000","last_unstale":"2024-09-13T19:19:12.799217+0000","last_undegraded":"2024-09-13T19:19:12.799217+0000","last_fullsized":"2024-09-13T19:19:12.799217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"36'6","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.849021+0000","last_change":"2024-09-13T19:15:57.892359+0000","last_active":"2024-09-13T19:19:05.849021+0000","last_peered":"2024-09-13T19:19:05.849021+0000","last_clean":"2024-09-13T19:19:05.849021+0000","last_became_active":"2024-09-13T19:15:57.892073+0000","last_became_peered":"2024-09-13T19:15:57.892073+0000","last_unstale":"2024-09-13T19:19:05.849021+0000","last_undegraded":"2024-09-13T19:19:05.849021+0000","last_fullsized":"2024-09-13T19:19:05.849021+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.796401+0000","last_change":"2024-09-13T19:15:55.897908+0000","last_active":"2024-09-13T19:19:12.796401+0000","last_peered":"2024-09-13T19:19:12.796401+0000","last_clean":"2024-09-13T19:19:12.796401+0000","last_became_active":"2024-09-13T19:15:55.895911+0000","last_became_peered":"2024-09-13T19:15:55.895911+0000","last_unstale":"2024-09-13T19:19:12.796401+0000","last_undegraded":"2024-09-13T19:19:12.796401+0000","last_fullsized":"2024-09-13T19:19:12.796401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"36'6","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:51.942682+0000","last_change":"2024-09-13T19:16:31.995370+0000","last_active":"2024-09-13T19:18:51.942682+0000","last_peered":"2024-09-13T19:18:51.942682+0000","last_clean":"2024-09-13T19:18:51.942682+0000","last_became_active":"2024-09-13T19:16:31.993403+0000","last_became_peered":"2024-09-13T19:16:31.993403+0000","last_unstale":"2024-09-13T19:18:51.942682+0000","last_undegraded":"2024-09-13T19:18:51.942682+0000","last_fullsized":"2024-09-13T19:18:51.942682+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:11.936651+0000","last_change":"2024-09-13T19:15:55.896003+0000","last_active":"2024-09-13T19:18:11.936651+0000","last_peered":"2024-09-13T19:18:11.936651+0000","last_clean":"2024-09-13T19:18:11.936651+0000","last_became_active":"2024-09-13T19:15:55.894607+0000","last_became_peered":"2024-09-13T19:15:55.894607+0000","last_unstale":"2024-09-13T19:18:11.936651+0000","last_undegraded":"2024-09-13T19:18:11.936651+0000","last_fullsized":"2024-09-13T19:18:11.936651+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"36'2","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:11.936745+0000","last_change":"2024-09-13T19:15:57.901296+0000","last_active":"2024-09-13T19:18:11.936745+0000","last_peered":"2024-09-13T19:18:11.936745+0000","last_clean":"2024-09-13T19:18:11.936745+0000","last_became_active":"2024-09-13T19:15:57.900902+0000","last_became_peered":"2024-09-13T19:15:57.900902+0000","last_unstale":"2024-09-13T19:18:11.936745+0000","last_undegraded":"2024-09-13T19:18:11.936745+0000","last_fullsized":"2024-09-13T19:18:11.936745+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:13.941218+0000","last_change":"2024-09-13T19:15:55.906203+0000","last_active":"2024-09-13T19:18:13.941218+0000","last_peered":"2024-09-13T19:18:13.941218+0000","last_clean":"2024-09-13T19:18:13.941218+0000","last_became_active":"2024-09-13T19:15:55.905867+0000","last_became_peered":"2024-09-13T19:15:55.905867+0000","last_unstale":"2024-09-13T19:18:13.941218+0000","last_undegraded":"2024-09-13T19:18:13.941218+0000","last_fullsized":"2024-09-13T19:18:13.941218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:13.941325+0000","last_change":"2024-09-13T19:15:57.889883+0000","last_active":"2024-09-13T19:18:13.941325+0000","last_peered":"2024-09-13T19:18:13.941325+0000","last_clean":"2024-09-13T19:18:13.941325+0000","last_became_active":"2024-09-13T19:15:57.889606+0000","last_became_peered":"2024-09-13T19:15:57.889606+0000","last_unstale":"2024-09-13T19:18:13.941325+0000","last_undegraded":"2024-09-13T19:18:13.941325+0000","last_fullsized":"2024-09-13T19:18:13.941325+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:13.941268+0000","last_change":"2024-09-13T19:15:55.896394+0000","last_active":"2024-09-13T19:18:13.941268+0000","last_peered":"2024-09-13T19:18:13.941268+0000","last_clean":"2024-09-13T19:18:13.941268+0000","last_became_active":"2024-09-13T19:15:55.896086+0000","last_became_peered":"2024-09-13T19:15:55.896086+0000","last_unstale":"2024-09-13T19:18:13.941268+0000","last_undegraded":"2024-09-13T19:18:13.941268+0000","last_fullsized":"2024-09-13T19:18:13.941268+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"36'12","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.851430+0000","last_change":"2024-09-13T19:16:31.992315+0000","last_active":"2024-09-13T19:19:05.851430+0000","last_peered":"2024-09-13T19:19:05.851430+0000","last_clean":"2024-09-13T19:19:05.851430+0000","last_became_active":"2024-09-13T19:16:31.991965+0000","last_became_peered":"2024-09-13T19:16:31.991965+0000","last_unstale":"2024-09-13T19:19:05.851430+0000","last_undegraded":"2024-09-13T19:19:05.851430+0000","last_fullsized":"2024-09-13T19:19:05.851430+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:13.941892+0000","last_change":"2024-09-13T19:15:55.894925+0000","last_active":"2024-09-13T19:18:13.941892+0000","last_peered":"2024-09-13T19:18:13.941892+0000","last_clean":"2024-09-13T19:18:13.941892+0000","last_became_active":"2024-09-13T19:15:55.894634+0000","last_became_peered":"2024-09-13T19:15:55.894634+0000","last_unstale":"2024-09-13T19:18:13.941892+0000","last_undegraded":"2024-09-13T19:18:13.941892+0000","last_fullsized":"2024-09-13T19:18:13.941892+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:13.941251+0000","last_change":"2024-09-13T19:15:57.892811+0000","last_active":"2024-09-13T19:18:13.941251+0000","last_peered":"2024-09-13T19:18:13.941251+0000","last_clean":"2024-09-13T19:18:13.941251+0000","last_became_active":"2024-09-13T19:15:57.892558+0000","last_became_peered":"2024-09-13T19:15:57.892558+0000","last_unstale":"2024-09-13T19:18:13.941251+0000","last_undegraded":"2024-09-13T19:18:13.941251+0000","last_fullsized":"2024-09-13T19:18:13.941251+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:13.941936+0000","last_change":"2024-09-13T19:15:55.894980+0000","last_active":"2024-09-13T19:18:13.941936+0000","last_peered":"2024-09-13T19:18:13.941936+0000","last_clean":"2024-09-13T19:18:13.941936+0000","last_became_active":"2024-09-13T19:15:55.894667+0000","last_became_peered":"2024-09-13T19:15:55.894667+0000","last_unstale":"2024-09-13T19:18:13.941936+0000","last_undegraded":"2024-09-13T19:18:13.941936+0000","last_fullsized":"2024-09-13T19:18:13.941936+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"36'17","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.064729+0000","last_change":"2024-09-13T19:15:57.896510+0000","last_active":"2024-09-13T19:19:06.064729+0000","last_peered":"2024-09-13T19:19:06.064729+0000","last_clean":"2024-09-13T19:19:06.064729+0000","last_became_active":"2024-09-13T19:15:57.896200+0000","last_became_peered":"2024-09-13T19:15:57.896200+0000","last_unstale":"2024-09-13T19:19:06.064729+0000","last_undegraded":"2024-09-13T19:19:06.064729+0000","last_fullsized":"2024-09-13T19:19:06.064729+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":50,"num_read_kb":42,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.577648+0000","last_change":"2024-09-13T19:15:55.899411+0000","last_active":"2024-09-13T19:19:05.577648+0000","last_peered":"2024-09-13T19:19:05.577648+0000","last_clean":"2024-09-13T19:19:05.577648+0000","last_became_active":"2024-09-13T19:15:55.899104+0000","last_became_peered":"2024-09-13T19:15:55.899104+0000","last_unstale":"2024-09-13T19:19:05.577648+0000","last_undegraded":"2024-09-13T19:19:05.577648+0000","last_fullsized":"2024-09-13T19:19:05.577648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"36'12","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.929902+0000","last_change":"2024-09-13T19:15:57.890188+0000","last_active":"2024-09-13T19:19:05.929902+0000","last_peered":"2024-09-13T19:19:05.929902+0000","last_clean":"2024-09-13T19:19:05.929902+0000","last_became_active":"2024-09-13T19:15:57.889781+0000","last_became_peered":"2024-09-13T19:15:57.889781+0000","last_unstale":"2024-09-13T19:19:05.929902+0000","last_undegraded":"2024-09-13T19:19:05.929902+0000","last_fullsized":"2024-09-13T19:19:05.929902+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:18.942880+0000","last_change":"2024-09-13T19:15:55.898914+0000","last_active":"2024-09-13T19:18:18.942880+0000","last_peered":"2024-09-13T19:18:18.942880+0000","last_clean":"2024-09-13T19:18:18.942880+0000","last_became_active":"2024-09-13T19:15:55.898627+0000","last_became_peered":"2024-09-13T19:15:55.898627+0000","last_unstale":"2024-09-13T19:18:18.942880+0000","last_undegraded":"2024-09-13T19:18:18.942880+0000","last_fullsized":"2024-09-13T19:18:18.942880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:18.942614+0000","last_change":"2024-09-13T19:15:55.899524+0000","last_active":"2024-09-13T19:18:18.942614+0000","last_peered":"2024-09-13T19:18:18.942614+0000","last_clean":"2024-09-13T19:18:18.942614+0000","last_became_active":"2024-09-13T19:15:55.899225+0000","last_became_peered":"2024-09-13T19:15:55.899225+0000","last_unstale":"2024-09-13T19:18:18.942614+0000","last_undegraded":"2024-09-13T19:18:18.942614+0000","last_fullsized":"2024-09-13T19:18:18.942614+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"36'6","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.708700+0000","last_change":"2024-09-13T19:15:57.890646+0000","last_active":"2024-09-13T19:19:05.708700+0000","last_peered":"2024-09-13T19:19:05.708700+0000","last_clean":"2024-09-13T19:19:05.708700+0000","last_became_active":"2024-09-13T19:15:57.890325+0000","last_became_peered":"2024-09-13T19:15:57.890325+0000","last_unstale":"2024-09-13T19:19:05.708700+0000","last_undegraded":"2024-09-13T19:19:05.708700+0000","last_fullsized":"2024-09-13T19:19:05.708700+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:16.937377+0000","last_change":"2024-09-13T19:15:55.895990+0000","last_active":"2024-09-13T19:18:16.937377+0000","last_peered":"2024-09-13T19:18:16.937377+0000","last_clean":"2024-09-13T19:18:16.937377+0000","last_became_active":"2024-09-13T19:15:55.894485+0000","last_became_peered":"2024-09-13T19:15:55.894485+0000","last_unstale":"2024-09-13T19:18:16.937377+0000","last_undegraded":"2024-09-13T19:18:16.937377+0000","last_fullsized":"2024-09-13T19:18:16.937377+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"36'8","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.602074+0000","last_change":"2024-09-13T19:15:57.902376+0000","last_active":"2024-09-13T19:19:05.602074+0000","last_peered":"2024-09-13T19:19:05.602074+0000","last_clean":"2024-09-13T19:19:05.602074+0000","last_became_active":"2024-09-13T19:15:57.902123+0000","last_became_peered":"2024-09-13T19:15:57.902123+0000","last_unstale":"2024-09-13T19:19:05.602074+0000","last_undegraded":"2024-09-13T19:19:05.602074+0000","last_fullsized":"2024-09-13T19:19:05.602074+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2342,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1490,"ondisk_log_size":1490,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1595,"num_read_kb":1485,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640308,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39996,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331844,"statfs":{"total":96636764160,"available":96595808256,"internally_reserved":0,"allocated":503808,"data_stored":158624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640307,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40512,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331328,"statfs":{"total":96636764160,"available":96595279872,"internally_reserved":0,"allocated":1032192,"data_stored":746866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640307,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36368,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335472,"statfs":{"total":96636764160,"available":96599523328,"internally_reserved":0,"allocated":1048576,"data_stored":746030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705716,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31636,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340204,"statfs":{"total":96636764160,"available":96604368896,"internally_reserved":0,"allocated":462848,"data_stored":156440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T19:19:37.689 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.689 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.689 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.689 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.689 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.690 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.690 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.690 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.690 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.690 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.690 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.690 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.690 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.690 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.691 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.691 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.691 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.691 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.691 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.691 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.691 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.691 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.692 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.692 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.692 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.692 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.692 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.692 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.692 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.692 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.692 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.693 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-13T19:16:00.880092+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.693 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-13T19:16:02.887943+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=2, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.693 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.693 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.693 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.693 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-13T19:15:58.873497+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.693 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-13T19:16:02.887943+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=2, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.693 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.693 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.694 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.694 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-13T19:16:02.887943+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=2, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.694 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.694 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.694 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.694 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.694 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.695 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.695 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.695 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.695 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-13T19:15:58.873497+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.695 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.695 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.695 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.695 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.695 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.696 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.696 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-13T19:15:58.873497+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.696 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-13T19:16:00.880092+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.696 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.696 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.696 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.696 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-13T19:16:02.887943+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=2, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.696 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.697 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.697 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-13T19:15:58.873497+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.697 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.697 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.697 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.697 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-13T19:16:00.880092+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.697 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.697 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.698 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.698 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-13T19:15:39.557965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=39, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.698 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-13T19:15:43.565433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.698 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.698 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-13T19:16:00.880092+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.698 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.698 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.698 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-13T19:15:43.565433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.699 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.699 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-13T19:16:02.887943+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=2, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.699 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.699 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.699 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-13T19:15:43.565433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.699 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.699 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-13T19:15:58.873497+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.699 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.700 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.700 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-13T19:15:43.565433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.700 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.700 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-13T19:16:00.880092+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.700 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-13T19:16:02.887943+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=2, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.700 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.700 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.701 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.701 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-13T19:15:43.565433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.701 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-13T19:15:58.873497+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.701 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.701 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.701 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.701 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-13T19:15:43.565433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.701 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.702 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.702 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.702 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-13T19:15:43.565433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.702 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.702 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.702 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.702 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-13T19:15:43.565433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.702 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-13T19:15:58.873497+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.703 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.703 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.703 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.703 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-13T19:16:02.887943+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=2, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.703 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.703 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.703 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.703 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.703 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.704 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.704 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-13T19:15:58.873497+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.704 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.704 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.704 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.704 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.704 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.704 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.705 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.705 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.705 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-13T19:15:58.873497+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.705 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-13T19:16:00.880092+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.705 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.705 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.705 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-13T19:15:58.873497+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.705 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-13T19:16:02.887943+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=2, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.706 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.706 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.706 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.706 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-13T19:16:00.880092+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.706 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.706 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.706 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.706 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.707 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.707 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.707 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-13T19:16:02.887943+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=2, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.707 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.707 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.707 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.707 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-13T19:16:02.887943+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=2, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.707 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.707 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.708 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.708 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.708 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.708 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.708 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.708 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.708 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.708 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.709 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.709 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.709 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.709 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.709 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.710 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.710 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.710 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.710 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.710 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.710 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.710 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.710 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.710 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.711 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.711 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.711 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.711 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.711 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.711 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.711 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.711 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.711 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.711 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.712 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.712 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.712 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.712 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.712 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.712 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:37.712 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T19:19:57.714 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T19:19:57.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:57.826+0000 7f5ac8882640 1 Processor -- start 2024-09-13T19:19:57.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:57.826+0000 7f5ac8882640 1 -- start start 2024-09-13T19:19:57.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:57.826+0000 7f5ac8882640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5ac412cca0 0x7f5ac412d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:57.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:57.827+0000 7f5ac8882640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ac412d5c0 con 0x7f5ac41290e0 2024-09-13T19:19:57.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:57.827+0000 7f5ac8882640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f5ac406e350 con 0x7f5ac412cca0 2024-09-13T19:19:57.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:57.827+0000 7f5ac259c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5ac412cca0 0x7f5ac412d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:57.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:57.827+0000 7f5ac259c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5ac412cca0 0x7f5ac412d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55560/0 (socket says 172.21.15.53:55560) 2024-09-13T19:19:57.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:57.827+0000 7f5ac259c640 1 -- 172.21.15.53:0/1400483710 learned_addr learned my addr 172.21.15.53:0/1400483710 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:19:57.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:57.827+0000 7f5ac1d9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f5ac41290e0 0x7f5ac4129530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:38896/0 (socket says 172.21.15.53:38896) 2024-09-13T19:19:57.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:57.827+0000 7f5ac259c640 1 -- 172.21.15.53:0/1400483710 >> v1:172.21.15.53:6789/0 conn(0x7f5ac41290e0 legacy=0x7f5ac4129530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:57.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:57.827+0000 7f5ac259c640 1 -- 172.21.15.53:0/1400483710 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac4071f70 con 0x7f5ac412cca0 2024-09-13T19:19:57.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:57.828+0000 7f5ac259c640 1 --2- 172.21.15.53:0/1400483710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ac412cca0 0x7f5ac412d080 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f5ab40097f0 tx=0x7f5ab402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bbd3659b783dd40 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:57.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:57.828+0000 7f5ac159a640 1 -- 172.21.15.53:0/1400483710 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ab4037070 con 0x7f5ac412cca0 2024-09-13T19:19:57.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:57.828+0000 7f5ac159a640 1 -- 172.21.15.53:0/1400483710 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ab4032440 con 0x7f5ac412cca0 2024-09-13T19:19:57.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:57.828+0000 7f5ac159a640 1 -- 172.21.15.53:0/1400483710 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ab402ae60 con 0x7f5ac412cca0 2024-09-13T19:19:57.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:57.828+0000 7f5ac8882640 1 -- 172.21.15.53:0/1400483710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ac412cca0 msgr2=0x7f5ac412d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:57.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:57.828+0000 7f5ac8882640 1 --2- 172.21.15.53:0/1400483710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ac412cca0 0x7f5ac412d080 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f5ab40097f0 tx=0x7f5ab402a1e0 comp rx=0 tx=0).stop 2024-09-13T19:19:57.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:57.828+0000 7f5ac8882640 1 -- 172.21.15.53:0/1400483710 shutdown_connections 2024-09-13T19:19:57.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:57.828+0000 7f5ac8882640 1 --2- 172.21.15.53:0/1400483710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ac412cca0 0x7f5ac412d080 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:57.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:57.828+0000 7f5ac8882640 1 -- 172.21.15.53:0/1400483710 >> 172.21.15.53:0/1400483710 conn(0x7f5ac409a890 msgr2=0x7f5ac409aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:19:57.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:57.828+0000 7f5ac8882640 1 -- 172.21.15.53:0/1400483710 shutdown_connections 2024-09-13T19:19:57.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:57.829+0000 7f5ac8882640 1 -- 172.21.15.53:0/1400483710 wait complete. 2024-09-13T19:19:57.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:57.829+0000 7f5ac8882640 1 Processor -- start 2024-09-13T19:19:57.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:57.830+0000 7f5ac8882640 1 -- start start 2024-09-13T19:19:57.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:57.830+0000 7f5ac8882640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ac41290e0 0x7f5ac41c37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:57.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:57.830+0000 7f5ac8882640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac4070e60 con 0x7f5ac41290e0 2024-09-13T19:19:57.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:57.830+0000 7f5ac259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ac41290e0 0x7f5ac41c37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:57.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:57.830+0000 7f5ac259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ac41290e0 0x7f5ac41c37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55568/0 (socket says 172.21.15.53:55568) 2024-09-13T19:19:57.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:57.830+0000 7f5ac259c640 1 -- 172.21.15.53:0/740819520 learned_addr learned my addr 172.21.15.53:0/740819520 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:19:57.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:57.830+0000 7f5ac259c640 1 -- 172.21.15.53:0/740819520 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac40700f0 con 0x7f5ac41290e0 2024-09-13T19:19:57.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:57.830+0000 7f5ac259c640 1 --2- 172.21.15.53:0/740819520 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ac41290e0 0x7f5ac41c37b0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4035040 tx=0x7f5ab40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:57.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:57.831+0000 7f5ab2ffd640 1 -- 172.21.15.53:0/740819520 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ab4041020 con 0x7f5ac41290e0 2024-09-13T19:19:57.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:57.831+0000 7f5ab2ffd640 1 -- 172.21.15.53:0/740819520 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ab40307f0 con 0x7f5ac41290e0 2024-09-13T19:19:57.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:57.831+0000 7f5ac8882640 1 -- 172.21.15.53:0/740819520 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ac40709d0 con 0x7f5ac41290e0 2024-09-13T19:19:57.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:57.831+0000 7f5ab2ffd640 1 -- 172.21.15.53:0/740819520 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ab4037040 con 0x7f5ac41290e0 2024-09-13T19:19:57.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:57.831+0000 7f5ac8882640 1 -- 172.21.15.53:0/740819520 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ac41c3cf0 con 0x7f5ac41290e0 2024-09-13T19:19:57.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:57.832+0000 7f5ab2ffd640 1 -- 172.21.15.53:0/740819520 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5ab4044020 con 0x7f5ac41290e0 2024-09-13T19:19:57.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:57.832+0000 7f5ac8882640 1 -- 172.21.15.53:0/740819520 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ac4126db0 con 0x7f5ac41290e0 2024-09-13T19:19:57.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:57.832+0000 7f5ab2ffd640 1 --2- 172.21.15.53:0/740819520 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5aa40382a0 0x7f5aa403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:19:57.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:57.832+0000 7f5ab2ffd640 1 -- 172.21.15.53:0/740819520 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f5ab406c810 con 0x7f5ac41290e0 2024-09-13T19:19:57.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:57.832+0000 7f5ac1d9b640 1 --2- 172.21.15.53:0/740819520 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5aa40382a0 0x7f5aa403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:19:57.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:57.833+0000 7f5ac1d9b640 1 --2- 172.21.15.53:0/740819520 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5aa40382a0 0x7f5aa403a760 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8001550 tx=0x7f5ab8007a40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:19:57.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:57.837+0000 7f5ab2ffd640 1 -- 172.21.15.53:0/740819520 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5ab404b030 con 0x7f5ac41290e0 2024-09-13T19:19:58.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:58.010+0000 7f5ac8882640 1 -- 172.21.15.53:0/740819520 --> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5ac406e510 con 0x7f5aa40382a0 2024-09-13T19:19:58.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:58.025+0000 7f5ab2ffd640 1 -- 172.21.15.53:0/740819520 <== mgr.4098 v2:172.21.15.102:6824/4283826432 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+661935 (secure 0 0 0) 0x7f5ac406e510 con 0x7f5aa40382a0 2024-09-13T19:19:58.036 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:19:58.041 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T19:19:58.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:58.030+0000 7f5ac8882640 1 -- 172.21.15.53:0/740819520 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5aa40382a0 msgr2=0x7f5aa403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:58.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:58.030+0000 7f5ac8882640 1 --2- 172.21.15.53:0/740819520 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5aa40382a0 0x7f5aa403a760 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8001550 tx=0x7f5ab8007a40 comp rx=0 tx=0).stop 2024-09-13T19:19:58.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:58.030+0000 7f5ac8882640 1 -- 172.21.15.53:0/740819520 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ac41290e0 msgr2=0x7f5ac41c37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:19:58.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:58.030+0000 7f5ac8882640 1 --2- 172.21.15.53:0/740819520 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ac41290e0 0x7f5ac41c37b0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4035040 tx=0x7f5ab40046c0 comp rx=0 tx=0).stop 2024-09-13T19:19:58.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:58.030+0000 7f5ac8882640 1 -- 172.21.15.53:0/740819520 shutdown_connections 2024-09-13T19:19:58.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:58.030+0000 7f5ac8882640 1 --2- 172.21.15.53:0/740819520 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f5aa40382a0 0x7f5aa403a760 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:58.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:58.030+0000 7f5ac8882640 1 --2- 172.21.15.53:0/740819520 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ac41290e0 0x7f5ac41c37b0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:19:58.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:58.030+0000 7f5ac8882640 1 -- 172.21.15.53:0/740819520 >> 172.21.15.53:0/740819520 conn(0x7f5ac409a890 msgr2=0x7f5ac409ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:19:58.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:58.030+0000 7f5ac8882640 1 -- 172.21.15.53:0/740819520 shutdown_connections 2024-09-13T19:19:58.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:19:58.030+0000 7f5ac8882640 1 -- 172.21.15.53:0/740819520 wait complete. 2024-09-13T19:19:58.045 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":163,"stamp":"2024-09-13T19:19:56.983607+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5083,"num_read_kb":4664,"num_write":2179,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4770,"ondisk_log_size":4770,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148512,"kb_used_data":2976,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377338848,"statfs":{"total":386547056640,"available":386394980352,"internally_reserved":0,"allocated":3047424,"data_stored":1807960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":148956951},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004710"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:50.738443+0000","last_change":"2024-09-13T19:19:50.738469+0000","last_active":"2024-09-13T19:19:50.738443+0000","last_peered":"2024-09-13T19:19:50.738443+0000","last_clean":"2024-09-13T19:19:50.738443+0000","last_became_active":"2024-09-13T19:15:55.897392+0000","last_became_peered":"2024-09-13T19:15:55.897392+0000","last_unstale":"2024-09-13T19:19:50.738443+0000","last_undegraded":"2024-09-13T19:19:50.738443+0000","last_fullsized":"2024-09-13T19:19:50.738443+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:50.738354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:50.738354+0000","last_clean_scrub_stamp":"2024-09-13T19:19:50.738354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:08.713727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"36'8","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:46.925658+0000","last_change":"2024-09-13T19:19:46.925684+0000","last_active":"2024-09-13T19:19:46.925658+0000","last_peered":"2024-09-13T19:19:46.925658+0000","last_clean":"2024-09-13T19:19:46.925658+0000","last_became_active":"2024-09-13T19:15:57.888352+0000","last_became_peered":"2024-09-13T19:15:57.888352+0000","last_unstale":"2024-09-13T19:19:46.925658+0000","last_undegraded":"2024-09-13T19:19:46.925658+0000","last_fullsized":"2024-09-13T19:19:46.925658+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-13T19:19:46.925571+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-13T19:19:46.925571+0000","last_clean_scrub_stamp":"2024-09-13T19:19:46.925571+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:13.870292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"34'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:50.673917+0000","last_change":"2024-09-13T19:19:50.673945+0000","last_active":"2024-09-13T19:19:50.673917+0000","last_peered":"2024-09-13T19:19:50.673917+0000","last_clean":"2024-09-13T19:19:50.673917+0000","last_became_active":"2024-09-13T19:15:55.894768+0000","last_became_peered":"2024-09-13T19:15:55.894768+0000","last_unstale":"2024-09-13T19:19:50.673917+0000","last_undegraded":"2024-09-13T19:19:50.673917+0000","last_fullsized":"2024-09-13T19:19:50.673917+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:19:50.673808+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:19:50.673808+0000","last_clean_scrub_stamp":"2024-09-13T19:19:50.673808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:40.076259+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"36'6","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.064737+0000","last_change":"2024-09-13T19:15:57.895729+0000","last_active":"2024-09-13T19:19:06.064737+0000","last_peered":"2024-09-13T19:19:06.064737+0000","last_clean":"2024-09-13T19:19:06.064737+0000","last_became_active":"2024-09-13T19:15:57.895424+0000","last_became_peered":"2024-09-13T19:15:57.895424+0000","last_unstale":"2024-09-13T19:19:06.064737+0000","last_undegraded":"2024-09-13T19:19:06.064737+0000","last_fullsized":"2024-09-13T19:19:06.064737+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.940353+0000","last_change":"2024-09-13T19:15:55.900265+0000","last_active":"2024-09-13T19:18:03.940353+0000","last_peered":"2024-09-13T19:18:03.940353+0000","last_clean":"2024-09-13T19:18:03.940353+0000","last_became_active":"2024-09-13T19:15:55.899965+0000","last_became_peered":"2024-09-13T19:15:55.899965+0000","last_unstale":"2024-09-13T19:18:03.940353+0000","last_undegraded":"2024-09-13T19:18:03.940353+0000","last_fullsized":"2024-09-13T19:18:03.940353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"36'13","reported_seq":71,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.064006+0000","last_change":"2024-09-13T19:15:57.895266+0000","last_active":"2024-09-13T19:19:06.064006+0000","last_peered":"2024-09-13T19:19:06.064006+0000","last_clean":"2024-09-13T19:19:06.064006+0000","last_became_active":"2024-09-13T19:15:57.894955+0000","last_became_peered":"2024-09-13T19:15:57.894955+0000","last_unstale":"2024-09-13T19:19:06.064006+0000","last_undegraded":"2024-09-13T19:19:06.064006+0000","last_fullsized":"2024-09-13T19:19:06.064006+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:58.939021+0000","last_change":"2024-09-13T19:15:55.890339+0000","last_active":"2024-09-13T19:17:58.939021+0000","last_peered":"2024-09-13T19:17:58.939021+0000","last_clean":"2024-09-13T19:17:58.939021+0000","last_became_active":"2024-09-13T19:15:55.889830+0000","last_became_peered":"2024-09-13T19:15:55.889830+0000","last_unstale":"2024-09-13T19:17:58.939021+0000","last_undegraded":"2024-09-13T19:17:58.939021+0000","last_fullsized":"2024-09-13T19:17:58.939021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.705273+0000","last_change":"2024-09-13T19:15:57.895013+0000","last_active":"2024-09-13T19:19:05.705273+0000","last_peered":"2024-09-13T19:19:05.705273+0000","last_clean":"2024-09-13T19:19:05.705273+0000","last_became_active":"2024-09-13T19:15:57.894733+0000","last_became_peered":"2024-09-13T19:15:57.894733+0000","last_unstale":"2024-09-13T19:19:05.705273+0000","last_undegraded":"2024-09-13T19:19:05.705273+0000","last_fullsized":"2024-09-13T19:19:05.705273+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"36'4","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.793620+0000","last_change":"2024-09-13T19:15:55.895687+0000","last_active":"2024-09-13T19:19:12.793620+0000","last_peered":"2024-09-13T19:19:12.793620+0000","last_clean":"2024-09-13T19:19:12.793620+0000","last_became_active":"2024-09-13T19:15:55.895362+0000","last_became_peered":"2024-09-13T19:15:55.895362+0000","last_unstale":"2024-09-13T19:19:12.793620+0000","last_undegraded":"2024-09-13T19:19:12.793620+0000","last_fullsized":"2024-09-13T19:19:12.793620+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"36'8","reported_seq":68,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:47.935029+0000","last_change":"2024-09-13T19:19:47.935056+0000","last_active":"2024-09-13T19:19:47.935029+0000","last_peered":"2024-09-13T19:19:47.935029+0000","last_clean":"2024-09-13T19:19:47.935029+0000","last_became_active":"2024-09-13T19:15:57.889664+0000","last_became_peered":"2024-09-13T19:15:57.889664+0000","last_unstale":"2024-09-13T19:19:47.935029+0000","last_undegraded":"2024-09-13T19:19:47.935029+0000","last_fullsized":"2024-09-13T19:19:47.935029+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-13T19:19:47.934931+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-13T19:19:47.934931+0000","last_clean_scrub_stamp":"2024-09-13T19:19:47.934931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:58.003188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"36'4","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.839121+0000","last_change":"2024-09-13T19:15:55.890058+0000","last_active":"2024-09-13T19:19:05.839121+0000","last_peered":"2024-09-13T19:19:05.839121+0000","last_clean":"2024-09-13T19:19:05.839121+0000","last_became_active":"2024-09-13T19:15:55.889485+0000","last_became_peered":"2024-09-13T19:15:55.889485+0000","last_unstale":"2024-09-13T19:19:05.839121+0000","last_undegraded":"2024-09-13T19:19:05.839121+0000","last_fullsized":"2024-09-13T19:19:05.839121+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"36'2","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:34.063040+0000","last_change":"2024-09-13T19:19:34.063067+0000","last_active":"2024-09-13T19:19:34.063040+0000","last_peered":"2024-09-13T19:19:34.063040+0000","last_clean":"2024-09-13T19:19:34.063040+0000","last_became_active":"2024-09-13T19:15:57.900785+0000","last_became_peered":"2024-09-13T19:15:57.900785+0000","last_unstale":"2024-09-13T19:19:34.063040+0000","last_undegraded":"2024-09-13T19:19:34.063040+0000","last_fullsized":"2024-09-13T19:19:34.063040+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:34.062937+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:34.062937+0000","last_clean_scrub_stamp":"2024-09-13T19:19:34.062937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:11:39.030166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.796442+0000","last_change":"2024-09-13T19:15:55.898268+0000","last_active":"2024-09-13T19:19:12.796442+0000","last_peered":"2024-09-13T19:19:12.796442+0000","last_clean":"2024-09-13T19:19:12.796442+0000","last_became_active":"2024-09-13T19:15:55.897381+0000","last_became_peered":"2024-09-13T19:15:55.897381+0000","last_unstale":"2024-09-13T19:19:12.796442+0000","last_undegraded":"2024-09-13T19:19:12.796442+0000","last_fullsized":"2024-09-13T19:19:12.796442+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"36'16","reported_seq":99,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:47.809865+0000","last_change":"2024-09-13T19:19:47.809912+0000","last_active":"2024-09-13T19:19:47.809865+0000","last_peered":"2024-09-13T19:19:47.809865+0000","last_clean":"2024-09-13T19:19:47.809865+0000","last_became_active":"2024-09-13T19:15:57.893408+0000","last_became_peered":"2024-09-13T19:15:57.893408+0000","last_unstale":"2024-09-13T19:19:47.809865+0000","last_undegraded":"2024-09-13T19:19:47.809865+0000","last_fullsized":"2024-09-13T19:19:47.809865+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-13T19:19:47.809763+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-13T19:19:47.809763+0000","last_clean_scrub_stamp":"2024-09-13T19:19:47.809763+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:37:38.871573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"36'2","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:48.658576+0000","last_change":"2024-09-13T19:19:48.658601+0000","last_active":"2024-09-13T19:19:48.658576+0000","last_peered":"2024-09-13T19:19:48.658576+0000","last_clean":"2024-09-13T19:19:48.658576+0000","last_became_active":"2024-09-13T19:15:55.901190+0000","last_became_peered":"2024-09-13T19:15:55.901190+0000","last_unstale":"2024-09-13T19:19:48.658576+0000","last_undegraded":"2024-09-13T19:19:48.658576+0000","last_fullsized":"2024-09-13T19:19:48.658576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:48.658486+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:48.658486+0000","last_clean_scrub_stamp":"2024-09-13T19:19:48.658486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:15:38.548787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"36'16","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.854176+0000","last_change":"2024-09-13T19:15:57.898655+0000","last_active":"2024-09-13T19:19:05.854176+0000","last_peered":"2024-09-13T19:19:05.854176+0000","last_clean":"2024-09-13T19:19:05.854176+0000","last_became_active":"2024-09-13T19:15:57.898325+0000","last_became_peered":"2024-09-13T19:15:57.898325+0000","last_unstale":"2024-09-13T19:19:05.854176+0000","last_undegraded":"2024-09-13T19:19:05.854176+0000","last_fullsized":"2024-09-13T19:19:05.854176+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":52,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"36'4","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.854247+0000","last_change":"2024-09-13T19:15:57.890027+0000","last_active":"2024-09-13T19:19:05.854247+0000","last_peered":"2024-09-13T19:19:05.854247+0000","last_clean":"2024-09-13T19:19:05.854247+0000","last_became_active":"2024-09-13T19:15:57.887144+0000","last_became_peered":"2024-09-13T19:15:57.887144+0000","last_unstale":"2024-09-13T19:19:05.854247+0000","last_undegraded":"2024-09-13T19:19:05.854247+0000","last_fullsized":"2024-09-13T19:19:05.854247+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.799205+0000","last_change":"2024-09-13T19:15:55.896889+0000","last_active":"2024-09-13T19:19:12.799205+0000","last_peered":"2024-09-13T19:19:12.799205+0000","last_clean":"2024-09-13T19:19:12.799205+0000","last_became_active":"2024-09-13T19:15:55.895552+0000","last_became_peered":"2024-09-13T19:15:55.895552+0000","last_unstale":"2024-09-13T19:19:12.799205+0000","last_undegraded":"2024-09-13T19:19:12.799205+0000","last_fullsized":"2024-09-13T19:19:12.799205+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"36'8","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:48.955061+0000","last_change":"2024-09-13T19:19:48.955111+0000","last_active":"2024-09-13T19:19:48.955061+0000","last_peered":"2024-09-13T19:19:48.955061+0000","last_clean":"2024-09-13T19:19:48.955061+0000","last_became_active":"2024-09-13T19:15:57.886511+0000","last_became_peered":"2024-09-13T19:15:57.886511+0000","last_unstale":"2024-09-13T19:19:48.955061+0000","last_undegraded":"2024-09-13T19:19:48.955061+0000","last_fullsized":"2024-09-13T19:19:48.955061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-13T19:19:48.954919+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-13T19:19:48.954919+0000","last_clean_scrub_stamp":"2024-09-13T19:19:48.954919+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:06.835960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:48.818273+0000","last_change":"2024-09-13T19:19:48.818317+0000","last_active":"2024-09-13T19:19:48.818273+0000","last_peered":"2024-09-13T19:19:48.818273+0000","last_clean":"2024-09-13T19:19:48.818273+0000","last_became_active":"2024-09-13T19:15:55.896952+0000","last_became_peered":"2024-09-13T19:15:55.896952+0000","last_unstale":"2024-09-13T19:19:48.818273+0000","last_undegraded":"2024-09-13T19:19:48.818273+0000","last_fullsized":"2024-09-13T19:19:48.818273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:48.818164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:48.818164+0000","last_clean_scrub_stamp":"2024-09-13T19:19:48.818164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:02.241073+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"36'8","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.968826+0000","last_change":"2024-09-13T19:15:57.891691+0000","last_active":"2024-09-13T19:19:05.968826+0000","last_peered":"2024-09-13T19:19:05.968826+0000","last_clean":"2024-09-13T19:19:05.968826+0000","last_became_active":"2024-09-13T19:15:57.891411+0000","last_became_peered":"2024-09-13T19:15:57.891411+0000","last_unstale":"2024-09-13T19:19:05.968826+0000","last_undegraded":"2024-09-13T19:19:05.968826+0000","last_fullsized":"2024-09-13T19:19:05.968826+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:23.942911+0000","last_change":"2024-09-13T19:15:55.896710+0000","last_active":"2024-09-13T19:18:23.942911+0000","last_peered":"2024-09-13T19:18:23.942911+0000","last_clean":"2024-09-13T19:18:23.942911+0000","last_became_active":"2024-09-13T19:15:55.895453+0000","last_became_peered":"2024-09-13T19:15:55.895453+0000","last_unstale":"2024-09-13T19:18:23.942911+0000","last_undegraded":"2024-09-13T19:18:23.942911+0000","last_fullsized":"2024-09-13T19:18:23.942911+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"36'8","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:46.621422+0000","last_change":"2024-09-13T19:19:46.621446+0000","last_active":"2024-09-13T19:19:46.621422+0000","last_peered":"2024-09-13T19:19:46.621422+0000","last_clean":"2024-09-13T19:19:46.621422+0000","last_became_active":"2024-09-13T19:15:57.896208+0000","last_became_peered":"2024-09-13T19:15:57.896208+0000","last_unstale":"2024-09-13T19:19:46.621422+0000","last_undegraded":"2024-09-13T19:19:46.621422+0000","last_fullsized":"2024-09-13T19:19:46.621422+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-13T19:19:46.621332+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-13T19:19:46.621332+0000","last_clean_scrub_stamp":"2024-09-13T19:19:46.621332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:00.483604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:23.942886+0000","last_change":"2024-09-13T19:15:55.892927+0000","last_active":"2024-09-13T19:18:23.942886+0000","last_peered":"2024-09-13T19:18:23.942886+0000","last_clean":"2024-09-13T19:18:23.942886+0000","last_became_active":"2024-09-13T19:15:55.892616+0000","last_became_peered":"2024-09-13T19:15:55.892616+0000","last_unstale":"2024-09-13T19:18:23.942886+0000","last_undegraded":"2024-09-13T19:18:23.942886+0000","last_fullsized":"2024-09-13T19:18:23.942886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"36'2","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:49.771954+0000","last_change":"2024-09-13T19:19:49.771997+0000","last_active":"2024-09-13T19:19:49.771954+0000","last_peered":"2024-09-13T19:19:49.771954+0000","last_clean":"2024-09-13T19:19:49.771954+0000","last_became_active":"2024-09-13T19:15:57.897566+0000","last_became_peered":"2024-09-13T19:15:57.897566+0000","last_unstale":"2024-09-13T19:19:49.771954+0000","last_undegraded":"2024-09-13T19:19:49.771954+0000","last_fullsized":"2024-09-13T19:19:49.771954+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:49.771831+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:49.771831+0000","last_clean_scrub_stamp":"2024-09-13T19:19:49.771831+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:38.756140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:21.938320+0000","last_change":"2024-09-13T19:15:55.894579+0000","last_active":"2024-09-13T19:18:21.938320+0000","last_peered":"2024-09-13T19:18:21.938320+0000","last_clean":"2024-09-13T19:18:21.938320+0000","last_became_active":"2024-09-13T19:15:55.893594+0000","last_became_peered":"2024-09-13T19:15:55.893594+0000","last_unstale":"2024-09-13T19:18:21.938320+0000","last_undegraded":"2024-09-13T19:18:21.938320+0000","last_fullsized":"2024-09-13T19:18:21.938320+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"36'6","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:52.023727+0000","last_change":"2024-09-13T19:19:52.023770+0000","last_active":"2024-09-13T19:19:52.023727+0000","last_peered":"2024-09-13T19:19:52.023727+0000","last_clean":"2024-09-13T19:19:52.023727+0000","last_became_active":"2024-09-13T19:15:57.889901+0000","last_became_peered":"2024-09-13T19:15:57.889901+0000","last_unstale":"2024-09-13T19:19:52.023727+0000","last_undegraded":"2024-09-13T19:19:52.023727+0000","last_fullsized":"2024-09-13T19:19:52.023727+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:19:52.023617+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:19:52.023617+0000","last_clean_scrub_stamp":"2024-09-13T19:19:52.023617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:55.796931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:18.942707+0000","last_change":"2024-09-13T19:15:55.899097+0000","last_active":"2024-09-13T19:18:18.942707+0000","last_peered":"2024-09-13T19:18:18.942707+0000","last_clean":"2024-09-13T19:18:18.942707+0000","last_became_active":"2024-09-13T19:15:55.898679+0000","last_became_peered":"2024-09-13T19:15:55.898679+0000","last_unstale":"2024-09-13T19:18:18.942707+0000","last_undegraded":"2024-09-13T19:18:18.942707+0000","last_fullsized":"2024-09-13T19:18:18.942707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"36'35","reported_seq":100,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.978025+0000","last_change":"2024-09-13T19:16:05.921753+0000","last_active":"2024-09-13T19:19:05.978025+0000","last_peered":"2024-09-13T19:19:05.978025+0000","last_clean":"2024-09-13T19:19:05.978025+0000","last_became_active":"2024-09-13T19:16:05.921156+0000","last_became_peered":"2024-09-13T19:16:05.921156+0000","last_unstale":"2024-09-13T19:19:05.978025+0000","last_undegraded":"2024-09-13T19:19:05.978025+0000","last_fullsized":"2024-09-13T19:19:05.978025+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"36'6","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:49.875510+0000","last_change":"2024-09-13T19:19:49.875536+0000","last_active":"2024-09-13T19:19:49.875510+0000","last_peered":"2024-09-13T19:19:49.875510+0000","last_clean":"2024-09-13T19:19:49.875510+0000","last_became_active":"2024-09-13T19:15:57.895870+0000","last_became_peered":"2024-09-13T19:15:57.895870+0000","last_unstale":"2024-09-13T19:19:49.875510+0000","last_undegraded":"2024-09-13T19:19:49.875510+0000","last_fullsized":"2024-09-13T19:19:49.875510+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:19:49.875424+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:19:49.875424+0000","last_clean_scrub_stamp":"2024-09-13T19:19:49.875424+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:44.778091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:18.942743+0000","last_change":"2024-09-13T19:15:55.895213+0000","last_active":"2024-09-13T19:18:18.942743+0000","last_peered":"2024-09-13T19:18:18.942743+0000","last_clean":"2024-09-13T19:18:18.942743+0000","last_became_active":"2024-09-13T19:15:55.894099+0000","last_became_peered":"2024-09-13T19:15:55.894099+0000","last_unstale":"2024-09-13T19:18:18.942743+0000","last_undegraded":"2024-09-13T19:18:18.942743+0000","last_fullsized":"2024-09-13T19:18:18.942743+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:20.089068+0000","last_change":"2024-09-13T19:19:20.089107+0000","last_active":"2024-09-13T19:19:20.089068+0000","last_peered":"2024-09-13T19:19:20.089068+0000","last_clean":"2024-09-13T19:19:20.089068+0000","last_became_active":"2024-09-13T19:15:59.896648+0000","last_became_peered":"2024-09-13T19:15:59.896648+0000","last_unstale":"2024-09-13T19:19:20.089068+0000","last_undegraded":"2024-09-13T19:19:20.089068+0000","last_fullsized":"2024-09-13T19:19:20.089068+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:20.088934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:20.088934+0000","last_clean_scrub_stamp":"2024-09-13T19:19:20.088934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:25.257454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"36'36","reported_seq":91,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:41.951351+0000","last_change":"2024-09-13T19:19:41.951384+0000","last_active":"2024-09-13T19:19:41.951351+0000","last_peered":"2024-09-13T19:19:41.951351+0000","last_clean":"2024-09-13T19:19:41.951351+0000","last_became_active":"2024-09-13T19:16:01.906675+0000","last_became_peered":"2024-09-13T19:16:01.906675+0000","last_unstale":"2024-09-13T19:19:41.951351+0000","last_undegraded":"2024-09-13T19:19:41.951351+0000","last_fullsized":"2024-09-13T19:19:41.951351+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-13T19:19:41.951264+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-13T19:19:41.951264+0000","last_clean_scrub_stamp":"2024-09-13T19:19:41.951264+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:19.199178+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:35.864331+0000","last_change":"2024-09-13T19:19:35.864355+0000","last_active":"2024-09-13T19:19:35.864331+0000","last_peered":"2024-09-13T19:19:35.864331+0000","last_clean":"2024-09-13T19:19:35.864331+0000","last_became_active":"2024-09-13T19:16:03.914111+0000","last_became_peered":"2024-09-13T19:16:03.914111+0000","last_unstale":"2024-09-13T19:19:35.864331+0000","last_undegraded":"2024-09-13T19:19:35.864331+0000","last_fullsized":"2024-09-13T19:19:35.864331+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:35.864237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:35.864237+0000","last_clean_scrub_stamp":"2024-09-13T19:19:35.864237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:31:06.989608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"36'7","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:33.944238+0000","last_change":"2024-09-13T19:16:05.925198+0000","last_active":"2024-09-13T19:18:33.944238+0000","last_peered":"2024-09-13T19:18:33.944238+0000","last_clean":"2024-09-13T19:18:33.944238+0000","last_became_active":"2024-09-13T19:16:05.924829+0000","last_became_peered":"2024-09-13T19:16:05.924829+0000","last_unstale":"2024-09-13T19:18:33.944238+0000","last_undegraded":"2024-09-13T19:18:33.944238+0000","last_fullsized":"2024-09-13T19:18:33.944238+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"36'10","reported_seq":70,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:48.913828+0000","last_change":"2024-09-13T19:19:48.913853+0000","last_active":"2024-09-13T19:19:48.913828+0000","last_peered":"2024-09-13T19:19:48.913828+0000","last_clean":"2024-09-13T19:19:48.913828+0000","last_became_active":"2024-09-13T19:15:57.897928+0000","last_became_peered":"2024-09-13T19:15:57.897928+0000","last_unstale":"2024-09-13T19:19:48.913828+0000","last_undegraded":"2024-09-13T19:19:48.913828+0000","last_fullsized":"2024-09-13T19:19:48.913828+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-13T19:19:48.913742+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-13T19:19:48.913742+0000","last_clean_scrub_stamp":"2024-09-13T19:19:48.913742+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:09:14.046682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:18.941961+0000","last_change":"2024-09-13T19:15:55.892255+0000","last_active":"2024-09-13T19:18:18.941961+0000","last_peered":"2024-09-13T19:18:18.941961+0000","last_clean":"2024-09-13T19:18:18.941961+0000","last_became_active":"2024-09-13T19:15:55.891934+0000","last_became_peered":"2024-09-13T19:15:55.891934+0000","last_unstale":"2024-09-13T19:18:18.941961+0000","last_undegraded":"2024-09-13T19:18:18.941961+0000","last_fullsized":"2024-09-13T19:18:18.941961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:39.498827+0000","last_change":"2024-09-13T19:19:39.498853+0000","last_active":"2024-09-13T19:19:39.498827+0000","last_peered":"2024-09-13T19:19:39.498827+0000","last_clean":"2024-09-13T19:19:39.498827+0000","last_became_active":"2024-09-13T19:15:59.892230+0000","last_became_peered":"2024-09-13T19:15:59.892230+0000","last_unstale":"2024-09-13T19:19:39.498827+0000","last_undegraded":"2024-09-13T19:19:39.498827+0000","last_fullsized":"2024-09-13T19:19:39.498827+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:39.498723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:39.498723+0000","last_clean_scrub_stamp":"2024-09-13T19:19:39.498723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:50.652003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"36'11","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:20.693227+0000","last_change":"2024-09-13T19:19:20.693258+0000","last_active":"2024-09-13T19:19:20.693227+0000","last_peered":"2024-09-13T19:19:20.693227+0000","last_clean":"2024-09-13T19:19:20.693227+0000","last_became_active":"2024-09-13T19:16:01.903371+0000","last_became_peered":"2024-09-13T19:16:01.903371+0000","last_unstale":"2024-09-13T19:19:20.693227+0000","last_undegraded":"2024-09-13T19:19:20.693227+0000","last_fullsized":"2024-09-13T19:19:20.693227+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'11","last_scrub_stamp":"2024-09-13T19:19:20.693140+0000","last_deep_scrub":"36'11","last_deep_scrub_stamp":"2024-09-13T19:19:20.693140+0000","last_clean_scrub_stamp":"2024-09-13T19:19:20.693140+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:19.872266+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:39.817530+0000","last_change":"2024-09-13T19:19:39.817552+0000","last_active":"2024-09-13T19:19:39.817530+0000","last_peered":"2024-09-13T19:19:39.817530+0000","last_clean":"2024-09-13T19:19:39.817530+0000","last_became_active":"2024-09-13T19:16:03.915538+0000","last_became_peered":"2024-09-13T19:16:03.915538+0000","last_unstale":"2024-09-13T19:19:39.817530+0000","last_undegraded":"2024-09-13T19:19:39.817530+0000","last_fullsized":"2024-09-13T19:19:39.817530+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:39.817428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:39.817428+0000","last_clean_scrub_stamp":"2024-09-13T19:19:39.817428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:06:06.681988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"34'2","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:41.520495+0000","last_change":"2024-09-13T19:19:41.520527+0000","last_active":"2024-09-13T19:19:41.520495+0000","last_peered":"2024-09-13T19:19:41.520495+0000","last_clean":"2024-09-13T19:19:41.520495+0000","last_became_active":"2024-09-13T19:16:05.911683+0000","last_became_peered":"2024-09-13T19:16:05.911683+0000","last_unstale":"2024-09-13T19:19:41.520495+0000","last_undegraded":"2024-09-13T19:19:41.520495+0000","last_fullsized":"2024-09-13T19:19:41.520495+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:19:41.520392+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:19:41.520392+0000","last_clean_scrub_stamp":"2024-09-13T19:19:41.520392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:23.565901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"36'4","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:53.901762+0000","last_change":"2024-09-13T19:19:53.901787+0000","last_active":"2024-09-13T19:19:53.901762+0000","last_peered":"2024-09-13T19:19:53.901762+0000","last_clean":"2024-09-13T19:19:53.901762+0000","last_became_active":"2024-09-13T19:15:57.896965+0000","last_became_peered":"2024-09-13T19:15:57.896965+0000","last_unstale":"2024-09-13T19:19:53.901762+0000","last_undegraded":"2024-09-13T19:19:53.901762+0000","last_fullsized":"2024-09-13T19:19:53.901762+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:19:53.901665+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:19:53.901665+0000","last_clean_scrub_stamp":"2024-09-13T19:19:53.901665+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:59.285297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"36'4","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.833100+0000","last_change":"2024-09-13T19:15:55.899327+0000","last_active":"2024-09-13T19:19:05.833100+0000","last_peered":"2024-09-13T19:19:05.833100+0000","last_clean":"2024-09-13T19:19:05.833100+0000","last_became_active":"2024-09-13T19:15:55.895444+0000","last_became_peered":"2024-09-13T19:15:55.895444+0000","last_unstale":"2024-09-13T19:19:05.833100+0000","last_undegraded":"2024-09-13T19:19:05.833100+0000","last_fullsized":"2024-09-13T19:19:05.833100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:35.477880+0000","last_change":"2024-09-13T19:19:35.477903+0000","last_active":"2024-09-13T19:19:35.477880+0000","last_peered":"2024-09-13T19:19:35.477880+0000","last_clean":"2024-09-13T19:19:35.477880+0000","last_became_active":"2024-09-13T19:15:59.895332+0000","last_became_peered":"2024-09-13T19:15:59.895332+0000","last_unstale":"2024-09-13T19:19:35.477880+0000","last_undegraded":"2024-09-13T19:19:35.477880+0000","last_fullsized":"2024-09-13T19:19:35.477880+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:35.477788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:35.477788+0000","last_clean_scrub_stamp":"2024-09-13T19:19:35.477788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:23:52.241441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"36'15","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:25.800975+0000","last_change":"2024-09-13T19:19:25.801012+0000","last_active":"2024-09-13T19:19:25.800975+0000","last_peered":"2024-09-13T19:19:25.800975+0000","last_clean":"2024-09-13T19:19:25.800975+0000","last_became_active":"2024-09-13T19:16:01.905457+0000","last_became_peered":"2024-09-13T19:16:01.905457+0000","last_unstale":"2024-09-13T19:19:25.800975+0000","last_undegraded":"2024-09-13T19:19:25.800975+0000","last_fullsized":"2024-09-13T19:19:25.800975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'15","last_scrub_stamp":"2024-09-13T19:19:25.800877+0000","last_deep_scrub":"36'15","last_deep_scrub_stamp":"2024-09-13T19:19:25.800877+0000","last_clean_scrub_stamp":"2024-09-13T19:19:25.800877+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:36.670597+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"36'286","reported_seq":394,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:50.851017+0000","last_change":"2024-09-13T19:19:50.851047+0000","last_active":"2024-09-13T19:19:50.851017+0000","last_peered":"2024-09-13T19:19:50.851017+0000","last_clean":"2024-09-13T19:19:50.851017+0000","last_became_active":"2024-09-13T19:16:03.916853+0000","last_became_peered":"2024-09-13T19:16:03.916853+0000","last_unstale":"2024-09-13T19:19:50.851017+0000","last_undegraded":"2024-09-13T19:19:50.851017+0000","last_fullsized":"2024-09-13T19:19:50.851017+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'286","last_scrub_stamp":"2024-09-13T19:19:50.850910+0000","last_deep_scrub":"36'286","last_deep_scrub_stamp":"2024-09-13T19:19:50.850910+0000","last_clean_scrub_stamp":"2024-09-13T19:19:50.850910+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:27:51.431330+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"36'2","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:39.721687+0000","last_change":"2024-09-13T19:19:39.721711+0000","last_active":"2024-09-13T19:19:39.721687+0000","last_peered":"2024-09-13T19:19:39.721687+0000","last_clean":"2024-09-13T19:19:39.721687+0000","last_became_active":"2024-09-13T19:16:05.912191+0000","last_became_peered":"2024-09-13T19:16:05.912191+0000","last_unstale":"2024-09-13T19:19:39.721687+0000","last_undegraded":"2024-09-13T19:19:39.721687+0000","last_fullsized":"2024-09-13T19:19:39.721687+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:39.721599+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:39.721599+0000","last_clean_scrub_stamp":"2024-09-13T19:19:39.721599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:58:45.282753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"36'4","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.930011+0000","last_change":"2024-09-13T19:15:57.890567+0000","last_active":"2024-09-13T19:19:05.930011+0000","last_peered":"2024-09-13T19:19:05.930011+0000","last_clean":"2024-09-13T19:19:05.930011+0000","last_became_active":"2024-09-13T19:15:57.890015+0000","last_became_peered":"2024-09-13T19:15:57.890015+0000","last_unstale":"2024-09-13T19:19:05.930011+0000","last_undegraded":"2024-09-13T19:19:05.930011+0000","last_fullsized":"2024-09-13T19:19:05.930011+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:18.941930+0000","last_change":"2024-09-13T19:15:55.894913+0000","last_active":"2024-09-13T19:18:18.941930+0000","last_peered":"2024-09-13T19:18:18.941930+0000","last_clean":"2024-09-13T19:18:18.941930+0000","last_became_active":"2024-09-13T19:15:55.894380+0000","last_became_peered":"2024-09-13T19:15:55.894380+0000","last_unstale":"2024-09-13T19:18:18.941930+0000","last_undegraded":"2024-09-13T19:18:18.941930+0000","last_fullsized":"2024-09-13T19:18:18.941930+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:16.988795+0000","last_change":"2024-09-13T19:19:16.988819+0000","last_active":"2024-09-13T19:19:16.988795+0000","last_peered":"2024-09-13T19:19:16.988795+0000","last_clean":"2024-09-13T19:19:16.988795+0000","last_became_active":"2024-09-13T19:15:59.896572+0000","last_became_peered":"2024-09-13T19:15:59.896572+0000","last_unstale":"2024-09-13T19:19:16.988795+0000","last_undegraded":"2024-09-13T19:19:16.988795+0000","last_fullsized":"2024-09-13T19:19:16.988795+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:16.988701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:16.988701+0000","last_clean_scrub_stamp":"2024-09-13T19:19:16.988701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:14.282330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"36'36","reported_seq":91,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:22.776961+0000","last_change":"2024-09-13T19:19:22.777010+0000","last_active":"2024-09-13T19:19:22.776961+0000","last_peered":"2024-09-13T19:19:22.776961+0000","last_clean":"2024-09-13T19:19:22.776961+0000","last_became_active":"2024-09-13T19:16:01.906471+0000","last_became_peered":"2024-09-13T19:16:01.906471+0000","last_unstale":"2024-09-13T19:19:22.776961+0000","last_undegraded":"2024-09-13T19:19:22.776961+0000","last_fullsized":"2024-09-13T19:19:22.776961+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-13T19:19:22.776859+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-13T19:19:22.776859+0000","last_clean_scrub_stamp":"2024-09-13T19:19:22.776859+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:40.452064+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"36'285","reported_seq":422,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:20.301108+0000","last_change":"2024-09-13T19:19:20.301137+0000","last_active":"2024-09-13T19:19:20.301108+0000","last_peered":"2024-09-13T19:19:20.301108+0000","last_clean":"2024-09-13T19:19:20.301108+0000","last_became_active":"2024-09-13T19:16:03.909046+0000","last_became_peered":"2024-09-13T19:16:03.909046+0000","last_unstale":"2024-09-13T19:19:20.301108+0000","last_undegraded":"2024-09-13T19:19:20.301108+0000","last_fullsized":"2024-09-13T19:19:20.301108+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-13T19:19:20.301016+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-13T19:19:20.301016+0000","last_clean_scrub_stamp":"2024-09-13T19:19:20.301016+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:00.732319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"36'16","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:43.945542+0000","last_change":"2024-09-13T19:16:31.997893+0000","last_active":"2024-09-13T19:18:43.945542+0000","last_peered":"2024-09-13T19:18:43.945542+0000","last_clean":"2024-09-13T19:18:43.945542+0000","last_became_active":"2024-09-13T19:16:31.991055+0000","last_became_peered":"2024-09-13T19:16:31.991055+0000","last_unstale":"2024-09-13T19:18:43.945542+0000","last_undegraded":"2024-09-13T19:18:43.945542+0000","last_fullsized":"2024-09-13T19:18:43.945542+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":73,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:13.941358+0000","last_change":"2024-09-13T19:15:55.893934+0000","last_active":"2024-09-13T19:18:13.941358+0000","last_peered":"2024-09-13T19:18:13.941358+0000","last_clean":"2024-09-13T19:18:13.941358+0000","last_became_active":"2024-09-13T19:15:55.893544+0000","last_became_peered":"2024-09-13T19:15:55.893544+0000","last_unstale":"2024-09-13T19:18:13.941358+0000","last_undegraded":"2024-09-13T19:18:13.941358+0000","last_fullsized":"2024-09-13T19:18:13.941358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:25.690461+0000","last_change":"2024-09-13T19:19:25.690504+0000","last_active":"2024-09-13T19:19:25.690461+0000","last_peered":"2024-09-13T19:19:25.690461+0000","last_clean":"2024-09-13T19:19:25.690461+0000","last_became_active":"2024-09-13T19:15:59.897435+0000","last_became_peered":"2024-09-13T19:15:59.897435+0000","last_unstale":"2024-09-13T19:19:25.690461+0000","last_undegraded":"2024-09-13T19:19:25.690461+0000","last_fullsized":"2024-09-13T19:19:25.690461+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:25.690361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:25.690361+0000","last_clean_scrub_stamp":"2024-09-13T19:19:25.690361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:23:10.242794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"36'52","reported_seq":112,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:26.852857+0000","last_change":"2024-09-13T19:19:26.852897+0000","last_active":"2024-09-13T19:19:26.852857+0000","last_peered":"2024-09-13T19:19:26.852857+0000","last_clean":"2024-09-13T19:19:26.852857+0000","last_became_active":"2024-09-13T19:16:01.904454+0000","last_became_peered":"2024-09-13T19:16:01.904454+0000","last_unstale":"2024-09-13T19:19:26.852857+0000","last_undegraded":"2024-09-13T19:19:26.852857+0000","last_fullsized":"2024-09-13T19:19:26.852857+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'52","last_scrub_stamp":"2024-09-13T19:19:26.852772+0000","last_deep_scrub":"36'52","last_deep_scrub_stamp":"2024-09-13T19:19:26.852772+0000","last_clean_scrub_stamp":"2024-09-13T19:19:26.852772+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:51.100890+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:25.339833+0000","last_change":"2024-09-13T19:19:25.339857+0000","last_active":"2024-09-13T19:19:25.339833+0000","last_peered":"2024-09-13T19:19:25.339833+0000","last_clean":"2024-09-13T19:19:25.339833+0000","last_became_active":"2024-09-13T19:16:03.912383+0000","last_became_peered":"2024-09-13T19:16:03.912383+0000","last_unstale":"2024-09-13T19:19:25.339833+0000","last_undegraded":"2024-09-13T19:19:25.339833+0000","last_fullsized":"2024-09-13T19:19:25.339833+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:25.339734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:25.339734+0000","last_clean_scrub_stamp":"2024-09-13T19:19:25.339734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:29.120530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"36'5","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:13.941213+0000","last_change":"2024-09-13T19:16:05.919436+0000","last_active":"2024-09-13T19:18:13.941213+0000","last_peered":"2024-09-13T19:18:13.941213+0000","last_clean":"2024-09-13T19:18:13.941213+0000","last_became_active":"2024-09-13T19:16:05.919154+0000","last_became_peered":"2024-09-13T19:16:05.919154+0000","last_unstale":"2024-09-13T19:18:13.941213+0000","last_undegraded":"2024-09-13T19:18:13.941213+0000","last_fullsized":"2024-09-13T19:18:13.941213+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"36'3","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.063710+0000","last_change":"2024-09-13T19:15:57.890834+0000","last_active":"2024-09-13T19:19:06.063710+0000","last_peered":"2024-09-13T19:19:06.063710+0000","last_clean":"2024-09-13T19:19:06.063710+0000","last_became_active":"2024-09-13T19:15:57.890345+0000","last_became_peered":"2024-09-13T19:15:57.890345+0000","last_unstale":"2024-09-13T19:19:06.063710+0000","last_undegraded":"2024-09-13T19:19:06.063710+0000","last_fullsized":"2024-09-13T19:19:06.063710+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.836073+0000","last_change":"2024-09-13T19:15:55.891871+0000","last_active":"2024-09-13T19:19:05.836073+0000","last_peered":"2024-09-13T19:19:05.836073+0000","last_clean":"2024-09-13T19:19:05.836073+0000","last_became_active":"2024-09-13T19:15:55.891250+0000","last_became_peered":"2024-09-13T19:15:55.891250+0000","last_unstale":"2024-09-13T19:19:05.836073+0000","last_undegraded":"2024-09-13T19:19:05.836073+0000","last_fullsized":"2024-09-13T19:19:05.836073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:40.548727+0000","last_change":"2024-09-13T19:19:40.548760+0000","last_active":"2024-09-13T19:19:40.548727+0000","last_peered":"2024-09-13T19:19:40.548727+0000","last_clean":"2024-09-13T19:19:40.548727+0000","last_became_active":"2024-09-13T19:15:59.891028+0000","last_became_peered":"2024-09-13T19:15:59.891028+0000","last_unstale":"2024-09-13T19:19:40.548727+0000","last_undegraded":"2024-09-13T19:19:40.548727+0000","last_fullsized":"2024-09-13T19:19:40.548727+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:40.548634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:40.548634+0000","last_clean_scrub_stamp":"2024-09-13T19:19:40.548634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:18:54.086278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"36'36","reported_seq":91,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:29.094496+0000","last_change":"2024-09-13T19:19:29.094550+0000","last_active":"2024-09-13T19:19:29.094496+0000","last_peered":"2024-09-13T19:19:29.094496+0000","last_clean":"2024-09-13T19:19:29.094496+0000","last_became_active":"2024-09-13T19:16:01.904534+0000","last_became_peered":"2024-09-13T19:16:01.904534+0000","last_unstale":"2024-09-13T19:19:29.094496+0000","last_undegraded":"2024-09-13T19:19:29.094496+0000","last_fullsized":"2024-09-13T19:19:29.094496+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-13T19:19:29.094383+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-13T19:19:29.094383+0000","last_clean_scrub_stamp":"2024-09-13T19:19:29.094383+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:28:19.264538+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:33.431802+0000","last_change":"2024-09-13T19:19:33.431831+0000","last_active":"2024-09-13T19:19:33.431802+0000","last_peered":"2024-09-13T19:19:33.431802+0000","last_clean":"2024-09-13T19:19:33.431802+0000","last_became_active":"2024-09-13T19:16:03.913829+0000","last_became_peered":"2024-09-13T19:16:03.913829+0000","last_unstale":"2024-09-13T19:19:33.431802+0000","last_undegraded":"2024-09-13T19:19:33.431802+0000","last_fullsized":"2024-09-13T19:19:33.431802+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:33.431688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:33.431688+0000","last_clean_scrub_stamp":"2024-09-13T19:19:33.431688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:40:42.508968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"36'3","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:13.941355+0000","last_change":"2024-09-13T19:16:05.913878+0000","last_active":"2024-09-13T19:18:13.941355+0000","last_peered":"2024-09-13T19:18:13.941355+0000","last_clean":"2024-09-13T19:18:13.941355+0000","last_became_active":"2024-09-13T19:16:05.913578+0000","last_became_peered":"2024-09-13T19:16:05.913578+0000","last_unstale":"2024-09-13T19:18:13.941355+0000","last_undegraded":"2024-09-13T19:18:13.941355+0000","last_fullsized":"2024-09-13T19:18:13.941355+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:53.682343+0000","last_change":"2024-09-13T19:19:53.682379+0000","last_active":"2024-09-13T19:19:53.682343+0000","last_peered":"2024-09-13T19:19:53.682343+0000","last_clean":"2024-09-13T19:19:53.682343+0000","last_became_active":"2024-09-13T19:15:57.897468+0000","last_became_peered":"2024-09-13T19:15:57.897468+0000","last_unstale":"2024-09-13T19:19:53.682343+0000","last_undegraded":"2024-09-13T19:19:53.682343+0000","last_fullsized":"2024-09-13T19:19:53.682343+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:53.682234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:53.682234+0000","last_clean_scrub_stamp":"2024-09-13T19:19:53.682234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:20.626955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:13.941963+0000","last_change":"2024-09-13T19:15:55.893786+0000","last_active":"2024-09-13T19:18:13.941963+0000","last_peered":"2024-09-13T19:18:13.941963+0000","last_clean":"2024-09-13T19:18:13.941963+0000","last_became_active":"2024-09-13T19:15:55.893489+0000","last_became_peered":"2024-09-13T19:15:55.893489+0000","last_unstale":"2024-09-13T19:18:13.941963+0000","last_undegraded":"2024-09-13T19:18:13.941963+0000","last_fullsized":"2024-09-13T19:18:13.941963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:36.500213+0000","last_change":"2024-09-13T19:19:36.500258+0000","last_active":"2024-09-13T19:19:36.500213+0000","last_peered":"2024-09-13T19:19:36.500213+0000","last_clean":"2024-09-13T19:19:36.500213+0000","last_became_active":"2024-09-13T19:15:59.895291+0000","last_became_peered":"2024-09-13T19:15:59.895291+0000","last_unstale":"2024-09-13T19:19:36.500213+0000","last_undegraded":"2024-09-13T19:19:36.500213+0000","last_fullsized":"2024-09-13T19:19:36.500213+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:36.500113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:36.500113+0000","last_clean_scrub_stamp":"2024-09-13T19:19:36.500113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:16:46.762131+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"36'45","reported_seq":103,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:19.049551+0000","last_change":"2024-09-13T19:19:19.049589+0000","last_active":"2024-09-13T19:19:19.049551+0000","last_peered":"2024-09-13T19:19:19.049551+0000","last_clean":"2024-09-13T19:19:19.049551+0000","last_became_active":"2024-09-13T19:16:01.896507+0000","last_became_peered":"2024-09-13T19:16:01.896507+0000","last_unstale":"2024-09-13T19:19:19.049551+0000","last_undegraded":"2024-09-13T19:19:19.049551+0000","last_fullsized":"2024-09-13T19:19:19.049551+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'45","last_scrub_stamp":"2024-09-13T19:19:19.049456+0000","last_deep_scrub":"36'45","last_deep_scrub_stamp":"2024-09-13T19:19:19.049456+0000","last_clean_scrub_stamp":"2024-09-13T19:19:19.049456+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:40.433022+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"36'285","reported_seq":387,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:21.320872+0000","last_change":"2024-09-13T19:19:21.320904+0000","last_active":"2024-09-13T19:19:21.320872+0000","last_peered":"2024-09-13T19:19:21.320872+0000","last_clean":"2024-09-13T19:19:21.320872+0000","last_became_active":"2024-09-13T19:16:03.910504+0000","last_became_peered":"2024-09-13T19:16:03.910504+0000","last_unstale":"2024-09-13T19:19:21.320872+0000","last_undegraded":"2024-09-13T19:19:21.320872+0000","last_fullsized":"2024-09-13T19:19:21.320872+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-13T19:19:21.320768+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-13T19:19:21.320768+0000","last_clean_scrub_stamp":"2024-09-13T19:19:21.320768+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:21:36.601671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"36'4","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:16.937502+0000","last_change":"2024-09-13T19:16:05.913148+0000","last_active":"2024-09-13T19:18:16.937502+0000","last_peered":"2024-09-13T19:18:16.937502+0000","last_clean":"2024-09-13T19:18:16.937502+0000","last_became_active":"2024-09-13T19:16:05.912881+0000","last_became_peered":"2024-09-13T19:16:05.912881+0000","last_unstale":"2024-09-13T19:18:16.937502+0000","last_undegraded":"2024-09-13T19:18:16.937502+0000","last_fullsized":"2024-09-13T19:18:16.937502+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"36'4","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:41.805475+0000","last_change":"2024-09-13T19:19:41.805515+0000","last_active":"2024-09-13T19:19:41.805475+0000","last_peered":"2024-09-13T19:19:41.805475+0000","last_clean":"2024-09-13T19:19:41.805475+0000","last_became_active":"2024-09-13T19:15:57.883675+0000","last_became_peered":"2024-09-13T19:15:57.883675+0000","last_unstale":"2024-09-13T19:19:41.805475+0000","last_undegraded":"2024-09-13T19:19:41.805475+0000","last_fullsized":"2024-09-13T19:19:41.805475+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:19:41.805394+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:19:41.805394+0000","last_clean_scrub_stamp":"2024-09-13T19:19:41.805394+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:11:49.618178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"36'7","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.796438+0000","last_change":"2024-09-13T19:15:55.892801+0000","last_active":"2024-09-13T19:19:12.796438+0000","last_peered":"2024-09-13T19:19:12.796438+0000","last_clean":"2024-09-13T19:19:12.796438+0000","last_became_active":"2024-09-13T19:15:55.891882+0000","last_became_peered":"2024-09-13T19:15:55.891882+0000","last_unstale":"2024-09-13T19:19:12.796438+0000","last_undegraded":"2024-09-13T19:19:12.796438+0000","last_fullsized":"2024-09-13T19:19:12.796438+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":16,"num_write_kb":4722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:43.945589+0000","last_change":"2024-09-13T19:16:31.992973+0000","last_active":"2024-09-13T19:18:43.945589+0000","last_peered":"2024-09-13T19:18:43.945589+0000","last_clean":"2024-09-13T19:18:43.945589+0000","last_became_active":"2024-09-13T19:16:31.992122+0000","last_became_peered":"2024-09-13T19:16:31.992122+0000","last_unstale":"2024-09-13T19:18:43.945589+0000","last_undegraded":"2024-09-13T19:18:43.945589+0000","last_fullsized":"2024-09-13T19:18:43.945589+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"36'66","reported_seq":139,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:44.917475+0000","last_change":"2024-09-13T19:19:44.917516+0000","last_active":"2024-09-13T19:19:44.917475+0000","last_peered":"2024-09-13T19:19:44.917475+0000","last_clean":"2024-09-13T19:19:44.917475+0000","last_became_active":"2024-09-13T19:16:01.906031+0000","last_became_peered":"2024-09-13T19:16:01.906031+0000","last_unstale":"2024-09-13T19:19:44.917475+0000","last_undegraded":"2024-09-13T19:19:44.917475+0000","last_fullsized":"2024-09-13T19:19:44.917475+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'66","last_scrub_stamp":"2024-09-13T19:19:44.917388+0000","last_deep_scrub":"36'66","last_deep_scrub_stamp":"2024-09-13T19:19:44.917388+0000","last_clean_scrub_stamp":"2024-09-13T19:19:44.917388+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:13:12.711321+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:23.383889+0000","last_change":"2024-09-13T19:19:23.383957+0000","last_active":"2024-09-13T19:19:23.383889+0000","last_peered":"2024-09-13T19:19:23.383889+0000","last_clean":"2024-09-13T19:19:23.383889+0000","last_became_active":"2024-09-13T19:16:03.908134+0000","last_became_peered":"2024-09-13T19:16:03.908134+0000","last_unstale":"2024-09-13T19:19:23.383889+0000","last_undegraded":"2024-09-13T19:19:23.383889+0000","last_fullsized":"2024-09-13T19:19:23.383889+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:23.383782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:23.383782+0000","last_clean_scrub_stamp":"2024-09-13T19:19:23.383782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:10.783386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"36'18","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.186467+0000","last_change":"2024-09-13T19:16:05.915102+0000","last_active":"2024-09-13T19:19:06.186467+0000","last_peered":"2024-09-13T19:19:06.186467+0000","last_clean":"2024-09-13T19:19:06.186467+0000","last_became_active":"2024-09-13T19:16:05.914853+0000","last_became_peered":"2024-09-13T19:16:05.914853+0000","last_unstale":"2024-09-13T19:19:06.186467+0000","last_undegraded":"2024-09-13T19:19:06.186467+0000","last_fullsized":"2024-09-13T19:19:06.186467+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"36'6","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:37.807480+0000","last_change":"2024-09-13T19:19:37.807504+0000","last_active":"2024-09-13T19:19:37.807480+0000","last_peered":"2024-09-13T19:19:37.807480+0000","last_clean":"2024-09-13T19:19:37.807480+0000","last_became_active":"2024-09-13T19:15:57.902955+0000","last_became_peered":"2024-09-13T19:15:57.902955+0000","last_unstale":"2024-09-13T19:19:37.807480+0000","last_undegraded":"2024-09-13T19:19:37.807480+0000","last_fullsized":"2024-09-13T19:19:37.807480+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:19:37.807394+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:19:37.807394+0000","last_clean_scrub_stamp":"2024-09-13T19:19:37.807394+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:23:23.699122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:11.936694+0000","last_change":"2024-09-13T19:15:55.891315+0000","last_active":"2024-09-13T19:18:11.936694+0000","last_peered":"2024-09-13T19:18:11.936694+0000","last_clean":"2024-09-13T19:18:11.936694+0000","last_became_active":"2024-09-13T19:15:55.890805+0000","last_became_peered":"2024-09-13T19:15:55.890805+0000","last_unstale":"2024-09-13T19:18:11.936694+0000","last_undegraded":"2024-09-13T19:18:11.936694+0000","last_fullsized":"2024-09-13T19:18:11.936694+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:32.806761+0000","last_change":"2024-09-13T19:19:32.806783+0000","last_active":"2024-09-13T19:19:32.806761+0000","last_peered":"2024-09-13T19:19:32.806761+0000","last_clean":"2024-09-13T19:19:32.806761+0000","last_became_active":"2024-09-13T19:15:59.897884+0000","last_became_peered":"2024-09-13T19:15:59.897884+0000","last_unstale":"2024-09-13T19:19:32.806761+0000","last_undegraded":"2024-09-13T19:19:32.806761+0000","last_fullsized":"2024-09-13T19:19:32.806761+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:32.806649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:32.806649+0000","last_clean_scrub_stamp":"2024-09-13T19:19:32.806649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:35.455381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"36'41","reported_seq":97,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:21.708435+0000","last_change":"2024-09-13T19:19:21.708485+0000","last_active":"2024-09-13T19:19:21.708435+0000","last_peered":"2024-09-13T19:19:21.708435+0000","last_clean":"2024-09-13T19:19:21.708435+0000","last_became_active":"2024-09-13T19:16:01.902657+0000","last_became_peered":"2024-09-13T19:16:01.902657+0000","last_unstale":"2024-09-13T19:19:21.708435+0000","last_undegraded":"2024-09-13T19:19:21.708435+0000","last_fullsized":"2024-09-13T19:19:21.708435+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'41","last_scrub_stamp":"2024-09-13T19:19:21.708338+0000","last_deep_scrub":"36'41","last_deep_scrub_stamp":"2024-09-13T19:19:21.708338+0000","last_clean_scrub_stamp":"2024-09-13T19:19:21.708338+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:24.621364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":44,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:38.960192+0000","last_change":"2024-09-13T19:19:38.960234+0000","last_active":"2024-09-13T19:19:38.960192+0000","last_peered":"2024-09-13T19:19:38.960192+0000","last_clean":"2024-09-13T19:19:38.960192+0000","last_became_active":"2024-09-13T19:16:03.915499+0000","last_became_peered":"2024-09-13T19:16:03.915499+0000","last_unstale":"2024-09-13T19:19:38.960192+0000","last_undegraded":"2024-09-13T19:19:38.960192+0000","last_fullsized":"2024-09-13T19:19:38.960192+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:38.960096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:38.960096+0000","last_clean_scrub_stamp":"2024-09-13T19:19:38.960096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:34.121371+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"36'3","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.067818+0000","last_change":"2024-09-13T19:16:05.920534+0000","last_active":"2024-09-13T19:19:06.067818+0000","last_peered":"2024-09-13T19:19:06.067818+0000","last_clean":"2024-09-13T19:19:06.067818+0000","last_became_active":"2024-09-13T19:16:05.920239+0000","last_became_peered":"2024-09-13T19:16:05.920239+0000","last_unstale":"2024-09-13T19:19:06.067818+0000","last_undegraded":"2024-09-13T19:19:06.067818+0000","last_fullsized":"2024-09-13T19:19:06.067818+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"36'8","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:33.099182+0000","last_change":"2024-09-13T19:19:33.099210+0000","last_active":"2024-09-13T19:19:33.099182+0000","last_peered":"2024-09-13T19:19:33.099182+0000","last_clean":"2024-09-13T19:19:33.099182+0000","last_became_active":"2024-09-13T19:15:57.901131+0000","last_became_peered":"2024-09-13T19:15:57.901131+0000","last_unstale":"2024-09-13T19:19:33.099182+0000","last_undegraded":"2024-09-13T19:19:33.099182+0000","last_fullsized":"2024-09-13T19:19:33.099182+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-13T19:19:33.099097+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-13T19:19:33.099097+0000","last_clean_scrub_stamp":"2024-09-13T19:19:33.099097+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:21:52.129989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:08.941018+0000","last_change":"2024-09-13T19:15:55.900444+0000","last_active":"2024-09-13T19:18:08.941018+0000","last_peered":"2024-09-13T19:18:08.941018+0000","last_clean":"2024-09-13T19:18:08.941018+0000","last_became_active":"2024-09-13T19:15:55.900143+0000","last_became_peered":"2024-09-13T19:15:55.900143+0000","last_unstale":"2024-09-13T19:18:08.941018+0000","last_undegraded":"2024-09-13T19:18:08.941018+0000","last_fullsized":"2024-09-13T19:18:08.941018+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:38.478085+0000","last_change":"2024-09-13T19:19:38.478130+0000","last_active":"2024-09-13T19:19:38.478085+0000","last_peered":"2024-09-13T19:19:38.478085+0000","last_clean":"2024-09-13T19:19:38.478085+0000","last_became_active":"2024-09-13T19:15:59.894793+0000","last_became_peered":"2024-09-13T19:15:59.894793+0000","last_unstale":"2024-09-13T19:19:38.478085+0000","last_undegraded":"2024-09-13T19:19:38.478085+0000","last_fullsized":"2024-09-13T19:19:38.478085+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:38.477940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:38.477940+0000","last_clean_scrub_stamp":"2024-09-13T19:19:38.477940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:10.926294+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"36'45","reported_seq":103,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:30.838950+0000","last_change":"2024-09-13T19:19:30.838996+0000","last_active":"2024-09-13T19:19:30.838950+0000","last_peered":"2024-09-13T19:19:30.838950+0000","last_clean":"2024-09-13T19:19:30.838950+0000","last_became_active":"2024-09-13T19:16:01.897733+0000","last_became_peered":"2024-09-13T19:16:01.897733+0000","last_unstale":"2024-09-13T19:19:30.838950+0000","last_undegraded":"2024-09-13T19:19:30.838950+0000","last_fullsized":"2024-09-13T19:19:30.838950+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'45","last_scrub_stamp":"2024-09-13T19:19:30.838860+0000","last_deep_scrub":"36'45","last_deep_scrub_stamp":"2024-09-13T19:19:30.838860+0000","last_clean_scrub_stamp":"2024-09-13T19:19:30.838860+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:39:39.517349+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"36'285","reported_seq":421,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:23.814436+0000","last_change":"2024-09-13T19:19:23.814508+0000","last_active":"2024-09-13T19:19:23.814436+0000","last_peered":"2024-09-13T19:19:23.814436+0000","last_clean":"2024-09-13T19:19:23.814436+0000","last_became_active":"2024-09-13T19:16:03.915589+0000","last_became_peered":"2024-09-13T19:16:03.915589+0000","last_unstale":"2024-09-13T19:19:23.814436+0000","last_undegraded":"2024-09-13T19:19:23.814436+0000","last_fullsized":"2024-09-13T19:19:23.814436+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-13T19:19:23.814324+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-13T19:19:23.814324+0000","last_clean_scrub_stamp":"2024-09-13T19:19:23.814324+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:26.983039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"36'12","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.069679+0000","last_change":"2024-09-13T19:16:05.912837+0000","last_active":"2024-09-13T19:19:06.069679+0000","last_peered":"2024-09-13T19:19:06.069679+0000","last_clean":"2024-09-13T19:19:06.069679+0000","last_became_active":"2024-09-13T19:16:05.912339+0000","last_became_peered":"2024-09-13T19:16:05.912339+0000","last_unstale":"2024-09-13T19:19:06.069679+0000","last_undegraded":"2024-09-13T19:19:06.069679+0000","last_fullsized":"2024-09-13T19:19:06.069679+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"36'6","reported_seq":68,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:40.761675+0000","last_change":"2024-09-13T19:19:40.761706+0000","last_active":"2024-09-13T19:19:40.761675+0000","last_peered":"2024-09-13T19:19:40.761675+0000","last_clean":"2024-09-13T19:19:40.761675+0000","last_became_active":"2024-09-13T19:15:57.900560+0000","last_became_peered":"2024-09-13T19:15:57.900560+0000","last_unstale":"2024-09-13T19:19:40.761675+0000","last_undegraded":"2024-09-13T19:19:40.761675+0000","last_fullsized":"2024-09-13T19:19:40.761675+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:19:40.761587+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:19:40.761587+0000","last_clean_scrub_stamp":"2024-09-13T19:19:40.761587+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:45.661345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:08.940978+0000","last_change":"2024-09-13T19:15:55.897670+0000","last_active":"2024-09-13T19:18:08.940978+0000","last_peered":"2024-09-13T19:18:08.940978+0000","last_clean":"2024-09-13T19:18:08.940978+0000","last_became_active":"2024-09-13T19:15:55.895799+0000","last_became_peered":"2024-09-13T19:15:55.895799+0000","last_unstale":"2024-09-13T19:18:08.940978+0000","last_undegraded":"2024-09-13T19:18:08.940978+0000","last_fullsized":"2024-09-13T19:18:08.940978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'5","reported_seq":428,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:28.767953+0000","last_change":"2024-09-13T19:19:28.767985+0000","last_active":"2024-09-13T19:19:28.767953+0000","last_peered":"2024-09-13T19:19:28.767953+0000","last_clean":"2024-09-13T19:19:28.767953+0000","last_became_active":"2024-09-13T19:15:59.894303+0000","last_became_peered":"2024-09-13T19:15:59.894303+0000","last_unstale":"2024-09-13T19:19:28.767953+0000","last_undegraded":"2024-09-13T19:19:28.767953+0000","last_fullsized":"2024-09-13T19:19:28.767953+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-09-13T19:19:28.767856+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-09-13T19:19:28.767856+0000","last_clean_scrub_stamp":"2024-09-13T19:19:28.767856+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:10.640290+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"36'15","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:43.951874+0000","last_change":"2024-09-13T19:19:43.951910+0000","last_active":"2024-09-13T19:19:43.951874+0000","last_peered":"2024-09-13T19:19:43.951874+0000","last_clean":"2024-09-13T19:19:43.951874+0000","last_became_active":"2024-09-13T19:16:01.906490+0000","last_became_peered":"2024-09-13T19:16:01.906490+0000","last_unstale":"2024-09-13T19:19:43.951874+0000","last_undegraded":"2024-09-13T19:19:43.951874+0000","last_fullsized":"2024-09-13T19:19:43.951874+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'15","last_scrub_stamp":"2024-09-13T19:19:43.951784+0000","last_deep_scrub":"36'15","last_deep_scrub_stamp":"2024-09-13T19:19:43.951784+0000","last_clean_scrub_stamp":"2024-09-13T19:19:43.951784+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:38.693730+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"36'285","reported_seq":511,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:19.722812+0000","last_change":"2024-09-13T19:19:19.722840+0000","last_active":"2024-09-13T19:19:19.722812+0000","last_peered":"2024-09-13T19:19:19.722812+0000","last_clean":"2024-09-13T19:19:19.722812+0000","last_became_active":"2024-09-13T19:16:03.905523+0000","last_became_peered":"2024-09-13T19:16:03.905523+0000","last_unstale":"2024-09-13T19:19:19.722812+0000","last_undegraded":"2024-09-13T19:19:19.722812+0000","last_fullsized":"2024-09-13T19:19:19.722812+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-13T19:19:19.722719+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-13T19:19:19.722719+0000","last_clean_scrub_stamp":"2024-09-13T19:19:19.722719+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:33.649384+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"36'4","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:27.845980+0000","last_change":"2024-09-13T19:19:27.846042+0000","last_active":"2024-09-13T19:19:27.845980+0000","last_peered":"2024-09-13T19:19:27.845980+0000","last_clean":"2024-09-13T19:19:27.845980+0000","last_became_active":"2024-09-13T19:16:05.910656+0000","last_became_peered":"2024-09-13T19:16:05.910656+0000","last_unstale":"2024-09-13T19:19:27.845980+0000","last_undegraded":"2024-09-13T19:19:27.845980+0000","last_fullsized":"2024-09-13T19:19:27.845980+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:19:27.845857+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:19:27.845857+0000","last_clean_scrub_stamp":"2024-09-13T19:19:27.845857+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:46.547978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"36'3","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:34.847598+0000","last_change":"2024-09-13T19:19:34.847663+0000","last_active":"2024-09-13T19:19:34.847598+0000","last_peered":"2024-09-13T19:19:34.847598+0000","last_clean":"2024-09-13T19:19:34.847598+0000","last_became_active":"2024-09-13T19:15:57.903761+0000","last_became_peered":"2024-09-13T19:15:57.903761+0000","last_unstale":"2024-09-13T19:19:34.847598+0000","last_undegraded":"2024-09-13T19:19:34.847598+0000","last_fullsized":"2024-09-13T19:19:34.847598+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-13T19:19:34.847491+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-13T19:19:34.847491+0000","last_clean_scrub_stamp":"2024-09-13T19:19:34.847491+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:49.358180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:08.940925+0000","last_change":"2024-09-13T19:15:55.900225+0000","last_active":"2024-09-13T19:18:08.940925+0000","last_peered":"2024-09-13T19:18:08.940925+0000","last_clean":"2024-09-13T19:18:08.940925+0000","last_became_active":"2024-09-13T19:15:55.899919+0000","last_became_peered":"2024-09-13T19:15:55.899919+0000","last_unstale":"2024-09-13T19:18:08.940925+0000","last_undegraded":"2024-09-13T19:18:08.940925+0000","last_fullsized":"2024-09-13T19:18:08.940925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"36'5","reported_seq":238,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:18.034886+0000","last_change":"2024-09-13T19:19:18.034914+0000","last_active":"2024-09-13T19:19:18.034886+0000","last_peered":"2024-09-13T19:19:18.034886+0000","last_clean":"2024-09-13T19:19:18.034886+0000","last_became_active":"2024-09-13T19:15:59.896081+0000","last_became_peered":"2024-09-13T19:15:59.896081+0000","last_unstale":"2024-09-13T19:19:18.034886+0000","last_undegraded":"2024-09-13T19:19:18.034886+0000","last_fullsized":"2024-09-13T19:19:18.034886+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-09-13T19:19:18.034798+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-09-13T19:19:18.034798+0000","last_clean_scrub_stamp":"2024-09-13T19:19:18.034798+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:47.783875+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"36'49","reported_seq":108,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:22.687814+0000","last_change":"2024-09-13T19:19:22.687872+0000","last_active":"2024-09-13T19:19:22.687814+0000","last_peered":"2024-09-13T19:19:22.687814+0000","last_clean":"2024-09-13T19:19:22.687814+0000","last_became_active":"2024-09-13T19:16:01.902532+0000","last_became_peered":"2024-09-13T19:16:01.902532+0000","last_unstale":"2024-09-13T19:19:22.687814+0000","last_undegraded":"2024-09-13T19:19:22.687814+0000","last_fullsized":"2024-09-13T19:19:22.687814+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'49","last_scrub_stamp":"2024-09-13T19:19:22.687725+0000","last_deep_scrub":"36'49","last_deep_scrub_stamp":"2024-09-13T19:19:22.687725+0000","last_clean_scrub_stamp":"2024-09-13T19:19:22.687725+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:20.499665+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:17.747793+0000","last_change":"2024-09-13T19:19:17.747855+0000","last_active":"2024-09-13T19:19:17.747793+0000","last_peered":"2024-09-13T19:19:17.747793+0000","last_clean":"2024-09-13T19:19:17.747793+0000","last_became_active":"2024-09-13T19:16:03.913019+0000","last_became_peered":"2024-09-13T19:16:03.913019+0000","last_unstale":"2024-09-13T19:19:17.747793+0000","last_undegraded":"2024-09-13T19:19:17.747793+0000","last_fullsized":"2024-09-13T19:19:17.747793+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:17.747683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:17.747683+0000","last_clean_scrub_stamp":"2024-09-13T19:19:17.747683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:01.675286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"36'9","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:43.841962+0000","last_change":"2024-09-13T19:19:43.841990+0000","last_active":"2024-09-13T19:19:43.841962+0000","last_peered":"2024-09-13T19:19:43.841962+0000","last_clean":"2024-09-13T19:19:43.841962+0000","last_became_active":"2024-09-13T19:16:05.911364+0000","last_became_peered":"2024-09-13T19:16:05.911364+0000","last_unstale":"2024-09-13T19:19:43.841962+0000","last_undegraded":"2024-09-13T19:19:43.841962+0000","last_fullsized":"2024-09-13T19:19:43.841962+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'9","last_scrub_stamp":"2024-09-13T19:19:43.841870+0000","last_deep_scrub":"36'9","last_deep_scrub_stamp":"2024-09-13T19:19:43.841870+0000","last_clean_scrub_stamp":"2024-09-13T19:19:43.841870+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:01.817243+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"36'13","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:32.054304+0000","last_change":"2024-09-13T19:19:32.054330+0000","last_active":"2024-09-13T19:19:32.054304+0000","last_peered":"2024-09-13T19:19:32.054304+0000","last_clean":"2024-09-13T19:19:32.054304+0000","last_became_active":"2024-09-13T19:15:57.900905+0000","last_became_peered":"2024-09-13T19:15:57.900905+0000","last_unstale":"2024-09-13T19:19:32.054304+0000","last_undegraded":"2024-09-13T19:19:32.054304+0000","last_fullsized":"2024-09-13T19:19:32.054304+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'13","last_scrub_stamp":"2024-09-13T19:19:32.054214+0000","last_deep_scrub":"36'13","last_deep_scrub_stamp":"2024-09-13T19:19:32.054214+0000","last_clean_scrub_stamp":"2024-09-13T19:19:32.054214+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:27.473875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":207,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:16.099079+0000","last_change":"2024-09-13T19:15:41.170734+0000","last_active":"2024-09-13T19:19:16.099079+0000","last_peered":"2024-09-13T19:19:16.099079+0000","last_clean":"2024-09-13T19:19:16.099079+0000","last_became_active":"2024-09-13T19:15:41.169707+0000","last_became_peered":"2024-09-13T19:15:41.169707+0000","last_unstale":"2024-09-13T19:19:16.099079+0000","last_undegraded":"2024-09-13T19:19:16.099079+0000","last_fullsized":"2024-09-13T19:19:16.099079+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:39.557965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:39.557965+0000","last_clean_scrub_stamp":"2024-09-13T19:15:39.557965+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:16.976065+0000","last_change":"2024-09-13T19:15:46.580815+0000","last_active":"2024-09-13T19:19:16.976065+0000","last_peered":"2024-09-13T19:19:16.976065+0000","last_clean":"2024-09-13T19:19:16.976065+0000","last_became_active":"2024-09-13T19:15:44.577382+0000","last_became_peered":"2024-09-13T19:15:44.577382+0000","last_unstale":"2024-09-13T19:19:16.976065+0000","last_undegraded":"2024-09-13T19:19:16.976065+0000","last_fullsized":"2024-09-13T19:19:16.976065+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047916199999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.940230+0000","last_change":"2024-09-13T19:15:55.900746+0000","last_active":"2024-09-13T19:18:03.940230+0000","last_peered":"2024-09-13T19:18:03.940230+0000","last_clean":"2024-09-13T19:18:03.940230+0000","last_became_active":"2024-09-13T19:15:55.899672+0000","last_became_peered":"2024-09-13T19:15:55.899672+0000","last_unstale":"2024-09-13T19:18:03.940230+0000","last_undegraded":"2024-09-13T19:18:03.940230+0000","last_fullsized":"2024-09-13T19:18:03.940230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:33.821035+0000","last_change":"2024-09-13T19:19:33.821056+0000","last_active":"2024-09-13T19:19:33.821035+0000","last_peered":"2024-09-13T19:19:33.821035+0000","last_clean":"2024-09-13T19:19:33.821035+0000","last_became_active":"2024-09-13T19:15:59.891615+0000","last_became_peered":"2024-09-13T19:15:59.891615+0000","last_unstale":"2024-09-13T19:19:33.821035+0000","last_undegraded":"2024-09-13T19:19:33.821035+0000","last_fullsized":"2024-09-13T19:19:33.821035+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:33.820938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:33.820938+0000","last_clean_scrub_stamp":"2024-09-13T19:19:33.820938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:08.178435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"36'87","reported_seq":177,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:35.064023+0000","last_change":"2024-09-13T19:19:35.064073+0000","last_active":"2024-09-13T19:19:35.064023+0000","last_peered":"2024-09-13T19:19:35.064023+0000","last_clean":"2024-09-13T19:19:35.064023+0000","last_became_active":"2024-09-13T19:16:01.905085+0000","last_became_peered":"2024-09-13T19:16:01.905085+0000","last_unstale":"2024-09-13T19:19:35.064023+0000","last_undegraded":"2024-09-13T19:19:35.064023+0000","last_fullsized":"2024-09-13T19:19:35.064023+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'87","last_scrub_stamp":"2024-09-13T19:19:35.063922+0000","last_deep_scrub":"36'87","last_deep_scrub_stamp":"2024-09-13T19:19:35.063922+0000","last_clean_scrub_stamp":"2024-09-13T19:19:35.063922+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:35:21.486542+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:29.339028+0000","last_change":"2024-09-13T19:19:29.339050+0000","last_active":"2024-09-13T19:19:29.339028+0000","last_peered":"2024-09-13T19:19:29.339028+0000","last_clean":"2024-09-13T19:19:29.339028+0000","last_became_active":"2024-09-13T19:16:03.913802+0000","last_became_peered":"2024-09-13T19:16:03.913802+0000","last_unstale":"2024-09-13T19:19:29.339028+0000","last_undegraded":"2024-09-13T19:19:29.339028+0000","last_fullsized":"2024-09-13T19:19:29.339028+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:29.338926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:29.338926+0000","last_clean_scrub_stamp":"2024-09-13T19:19:29.338926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:01.790473+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"36'89","reported_seq":196,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:35.858476+0000","last_change":"2024-09-13T19:19:35.858501+0000","last_active":"2024-09-13T19:19:35.858476+0000","last_peered":"2024-09-13T19:19:35.858476+0000","last_clean":"2024-09-13T19:19:35.858476+0000","last_became_active":"2024-09-13T19:16:05.911595+0000","last_became_peered":"2024-09-13T19:16:05.911595+0000","last_unstale":"2024-09-13T19:19:35.858476+0000","last_undegraded":"2024-09-13T19:19:35.858476+0000","last_fullsized":"2024-09-13T19:19:35.858476+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'89","last_scrub_stamp":"2024-09-13T19:19:35.858385+0000","last_deep_scrub":"36'89","last_deep_scrub_stamp":"2024-09-13T19:19:35.858385+0000","last_clean_scrub_stamp":"2024-09-13T19:19:35.858385+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:44:48.738301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":289,"num_read_kb":269,"num_write":182,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"36'4","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:51.888317+0000","last_change":"2024-09-13T19:19:51.888342+0000","last_active":"2024-09-13T19:19:51.888317+0000","last_peered":"2024-09-13T19:19:51.888317+0000","last_clean":"2024-09-13T19:19:51.888317+0000","last_became_active":"2024-09-13T19:15:57.897307+0000","last_became_peered":"2024-09-13T19:15:57.897307+0000","last_unstale":"2024-09-13T19:19:51.888317+0000","last_undegraded":"2024-09-13T19:19:51.888317+0000","last_fullsized":"2024-09-13T19:19:51.888317+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:19:51.888223+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:19:51.888223+0000","last_clean_scrub_stamp":"2024-09-13T19:19:51.888223+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:42:47.629919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:16.976055+0000","last_change":"2024-09-13T19:15:46.581436+0000","last_active":"2024-09-13T19:19:16.976055+0000","last_peered":"2024-09-13T19:19:16.976055+0000","last_clean":"2024-09-13T19:19:16.976055+0000","last_became_active":"2024-09-13T19:15:44.576304+0000","last_became_peered":"2024-09-13T19:15:44.576304+0000","last_unstale":"2024-09-13T19:19:16.976055+0000","last_undegraded":"2024-09-13T19:19:16.976055+0000","last_fullsized":"2024-09-13T19:19:16.976055+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011332060000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:01.934838+0000","last_change":"2024-09-13T19:15:55.891911+0000","last_active":"2024-09-13T19:18:01.934838+0000","last_peered":"2024-09-13T19:18:01.934838+0000","last_clean":"2024-09-13T19:18:01.934838+0000","last_became_active":"2024-09-13T19:15:55.891377+0000","last_became_peered":"2024-09-13T19:15:55.891377+0000","last_unstale":"2024-09-13T19:18:01.934838+0000","last_undegraded":"2024-09-13T19:18:01.934838+0000","last_fullsized":"2024-09-13T19:18:01.934838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:22.038984+0000","last_change":"2024-09-13T19:19:22.039024+0000","last_active":"2024-09-13T19:19:22.038984+0000","last_peered":"2024-09-13T19:19:22.038984+0000","last_clean":"2024-09-13T19:19:22.038984+0000","last_became_active":"2024-09-13T19:15:59.896248+0000","last_became_peered":"2024-09-13T19:15:59.896248+0000","last_unstale":"2024-09-13T19:19:22.038984+0000","last_undegraded":"2024-09-13T19:19:22.038984+0000","last_fullsized":"2024-09-13T19:19:22.038984+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:22.038847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:22.038847+0000","last_clean_scrub_stamp":"2024-09-13T19:19:22.038847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:43:03.494237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"36'291","reported_seq":516,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:17.746380+0000","last_change":"2024-09-13T19:19:17.746426+0000","last_active":"2024-09-13T19:19:17.746380+0000","last_peered":"2024-09-13T19:19:17.746380+0000","last_clean":"2024-09-13T19:19:17.746380+0000","last_became_active":"2024-09-13T19:16:01.907024+0000","last_became_peered":"2024-09-13T19:16:01.907024+0000","last_unstale":"2024-09-13T19:19:17.746380+0000","last_undegraded":"2024-09-13T19:19:17.746380+0000","last_fullsized":"2024-09-13T19:19:17.746380+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'291","last_scrub_stamp":"2024-09-13T19:19:17.746277+0000","last_deep_scrub":"36'291","last_deep_scrub_stamp":"2024-09-13T19:19:17.746277+0000","last_clean_scrub_stamp":"2024-09-13T19:19:17.746277+0000","objects_scrubbed":10,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:14.177663+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:42.977642+0000","last_change":"2024-09-13T19:19:42.977665+0000","last_active":"2024-09-13T19:19:42.977642+0000","last_peered":"2024-09-13T19:19:42.977642+0000","last_clean":"2024-09-13T19:19:42.977642+0000","last_became_active":"2024-09-13T19:16:03.915712+0000","last_became_peered":"2024-09-13T19:16:03.915712+0000","last_unstale":"2024-09-13T19:19:42.977642+0000","last_undegraded":"2024-09-13T19:19:42.977642+0000","last_fullsized":"2024-09-13T19:19:42.977642+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:42.977545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:42.977545+0000","last_clean_scrub_stamp":"2024-09-13T19:19:42.977545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:25.110230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"36'3","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:18.942053+0000","last_change":"2024-09-13T19:16:05.917279+0000","last_active":"2024-09-13T19:18:18.942053+0000","last_peered":"2024-09-13T19:18:18.942053+0000","last_clean":"2024-09-13T19:18:18.942053+0000","last_became_active":"2024-09-13T19:16:05.916999+0000","last_became_peered":"2024-09-13T19:16:05.916999+0000","last_unstale":"2024-09-13T19:18:18.942053+0000","last_undegraded":"2024-09-13T19:18:18.942053+0000","last_fullsized":"2024-09-13T19:18:18.942053+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:06.935978+0000","last_change":"2024-09-13T19:15:57.890320+0000","last_active":"2024-09-13T19:18:06.935978+0000","last_peered":"2024-09-13T19:18:06.935978+0000","last_clean":"2024-09-13T19:18:06.935978+0000","last_became_active":"2024-09-13T19:15:57.889885+0000","last_became_peered":"2024-09-13T19:15:57.889885+0000","last_unstale":"2024-09-13T19:18:06.935978+0000","last_undegraded":"2024-09-13T19:18:06.935978+0000","last_fullsized":"2024-09-13T19:18:06.935978+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:16.539724+0000","last_change":"2024-09-13T19:15:47.256565+0000","last_active":"2024-09-13T19:19:16.539724+0000","last_peered":"2024-09-13T19:19:16.539724+0000","last_clean":"2024-09-13T19:19:16.539724+0000","last_became_active":"2024-09-13T19:15:44.575483+0000","last_became_peered":"2024-09-13T19:15:44.575483+0000","last_unstale":"2024-09-13T19:19:16.539724+0000","last_undegraded":"2024-09-13T19:19:16.539724+0000","last_fullsized":"2024-09-13T19:19:16.539724+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036796000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"36'6","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:15.658477+0000","last_change":"2024-09-13T19:15:55.892997+0000","last_active":"2024-09-13T19:19:15.658477+0000","last_peered":"2024-09-13T19:19:15.658477+0000","last_clean":"2024-09-13T19:19:15.658477+0000","last_became_active":"2024-09-13T19:15:55.892629+0000","last_became_peered":"2024-09-13T19:15:55.892629+0000","last_unstale":"2024-09-13T19:19:15.658477+0000","last_undegraded":"2024-09-13T19:19:15.658477+0000","last_fullsized":"2024-09-13T19:19:15.658477+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"36'2","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:36.826974+0000","last_change":"2024-09-13T19:19:36.827027+0000","last_active":"2024-09-13T19:19:36.826974+0000","last_peered":"2024-09-13T19:19:36.826974+0000","last_clean":"2024-09-13T19:19:36.826974+0000","last_became_active":"2024-09-13T19:15:59.891588+0000","last_became_peered":"2024-09-13T19:15:59.891588+0000","last_unstale":"2024-09-13T19:19:36.826974+0000","last_undegraded":"2024-09-13T19:19:36.826974+0000","last_fullsized":"2024-09-13T19:19:36.826974+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:36.826862+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:36.826862+0000","last_clean_scrub_stamp":"2024-09-13T19:19:36.826862+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:13:00.231898+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'23","reported_seq":100,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:28.812123+0000","last_change":"2024-09-13T19:19:28.812189+0000","last_active":"2024-09-13T19:19:28.812123+0000","last_peered":"2024-09-13T19:19:28.812123+0000","last_clean":"2024-09-13T19:19:28.812123+0000","last_became_active":"2024-09-13T19:16:01.903947+0000","last_became_peered":"2024-09-13T19:16:01.903947+0000","last_unstale":"2024-09-13T19:19:28.812123+0000","last_undegraded":"2024-09-13T19:19:28.812123+0000","last_fullsized":"2024-09-13T19:19:28.812123+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'23","last_scrub_stamp":"2024-09-13T19:19:28.812026+0000","last_deep_scrub":"36'23","last_deep_scrub_stamp":"2024-09-13T19:19:28.812026+0000","last_clean_scrub_stamp":"2024-09-13T19:19:28.812026+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:37.761542+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:17.389523+0000","last_change":"2024-09-13T19:19:17.389541+0000","last_active":"2024-09-13T19:19:17.389523+0000","last_peered":"2024-09-13T19:19:17.389523+0000","last_clean":"2024-09-13T19:19:17.389523+0000","last_became_active":"2024-09-13T19:16:03.910776+0000","last_became_peered":"2024-09-13T19:16:03.910776+0000","last_unstale":"2024-09-13T19:19:17.389523+0000","last_undegraded":"2024-09-13T19:19:17.389523+0000","last_fullsized":"2024-09-13T19:19:17.389523+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:17.389460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:17.389460+0000","last_clean_scrub_stamp":"2024-09-13T19:19:17.389460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:17:14.265847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"36'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.846491+0000","last_change":"2024-09-13T19:16:05.920464+0000","last_active":"2024-09-13T19:19:05.846491+0000","last_peered":"2024-09-13T19:19:05.846491+0000","last_clean":"2024-09-13T19:19:05.846491+0000","last_became_active":"2024-09-13T19:16:05.920191+0000","last_became_peered":"2024-09-13T19:16:05.920191+0000","last_unstale":"2024-09-13T19:19:05.846491+0000","last_undegraded":"2024-09-13T19:19:05.846491+0000","last_fullsized":"2024-09-13T19:19:05.846491+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"36'12","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:51.707611+0000","last_change":"2024-09-13T19:19:51.707637+0000","last_active":"2024-09-13T19:19:51.707611+0000","last_peered":"2024-09-13T19:19:51.707611+0000","last_clean":"2024-09-13T19:19:51.707611+0000","last_became_active":"2024-09-13T19:15:57.886273+0000","last_became_peered":"2024-09-13T19:15:57.886273+0000","last_unstale":"2024-09-13T19:19:51.707611+0000","last_undegraded":"2024-09-13T19:19:51.707611+0000","last_fullsized":"2024-09-13T19:19:51.707611+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-13T19:19:51.707517+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-13T19:19:51.707517+0000","last_clean_scrub_stamp":"2024-09-13T19:19:51.707517+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:13.558324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":44,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:16.975976+0000","last_change":"2024-09-13T19:15:46.581526+0000","last_active":"2024-09-13T19:19:16.975976+0000","last_peered":"2024-09-13T19:19:16.975976+0000","last_clean":"2024-09-13T19:19:16.975976+0000","last_became_active":"2024-09-13T19:15:44.576052+0000","last_became_peered":"2024-09-13T19:15:44.576052+0000","last_unstale":"2024-09-13T19:19:16.975976+0000","last_undegraded":"2024-09-13T19:19:16.975976+0000","last_fullsized":"2024-09-13T19:19:16.975976+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012221599999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"36'4","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.827132+0000","last_change":"2024-09-13T19:15:55.892933+0000","last_active":"2024-09-13T19:19:05.827132+0000","last_peered":"2024-09-13T19:19:05.827132+0000","last_clean":"2024-09-13T19:19:05.827132+0000","last_became_active":"2024-09-13T19:15:55.892636+0000","last_became_peered":"2024-09-13T19:15:55.892636+0000","last_unstale":"2024-09-13T19:19:05.827132+0000","last_undegraded":"2024-09-13T19:19:05.827132+0000","last_fullsized":"2024-09-13T19:19:05.827132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:34.461514+0000","last_change":"2024-09-13T19:19:34.461541+0000","last_active":"2024-09-13T19:19:34.461514+0000","last_peered":"2024-09-13T19:19:34.461514+0000","last_clean":"2024-09-13T19:19:34.461514+0000","last_became_active":"2024-09-13T19:15:59.896248+0000","last_became_peered":"2024-09-13T19:15:59.896248+0000","last_unstale":"2024-09-13T19:19:34.461514+0000","last_undegraded":"2024-09-13T19:19:34.461514+0000","last_fullsized":"2024-09-13T19:19:34.461514+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:34.461398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:34.461398+0000","last_clean_scrub_stamp":"2024-09-13T19:19:34.461398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:38.595301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'20","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:47.912400+0000","last_change":"2024-09-13T19:19:47.912445+0000","last_active":"2024-09-13T19:19:47.912400+0000","last_peered":"2024-09-13T19:19:47.912400+0000","last_clean":"2024-09-13T19:19:47.912400+0000","last_became_active":"2024-09-13T19:16:01.905280+0000","last_became_peered":"2024-09-13T19:16:01.905280+0000","last_unstale":"2024-09-13T19:19:47.912400+0000","last_undegraded":"2024-09-13T19:19:47.912400+0000","last_fullsized":"2024-09-13T19:19:47.912400+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'20","last_scrub_stamp":"2024-09-13T19:19:47.912299+0000","last_deep_scrub":"36'20","last_deep_scrub_stamp":"2024-09-13T19:19:47.912299+0000","last_clean_scrub_stamp":"2024-09-13T19:19:47.912299+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:39.230968+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:46.871068+0000","last_change":"2024-09-13T19:19:46.871092+0000","last_active":"2024-09-13T19:19:46.871068+0000","last_peered":"2024-09-13T19:19:46.871068+0000","last_clean":"2024-09-13T19:19:46.871068+0000","last_became_active":"2024-09-13T19:16:03.916344+0000","last_became_peered":"2024-09-13T19:16:03.916344+0000","last_unstale":"2024-09-13T19:19:46.871068+0000","last_undegraded":"2024-09-13T19:19:46.871068+0000","last_fullsized":"2024-09-13T19:19:46.871068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:46.870973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:46.870973+0000","last_clean_scrub_stamp":"2024-09-13T19:19:46.870973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:23:10.637473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"36'4","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:18.941983+0000","last_change":"2024-09-13T19:16:05.919765+0000","last_active":"2024-09-13T19:18:18.941983+0000","last_peered":"2024-09-13T19:18:18.941983+0000","last_clean":"2024-09-13T19:18:18.941983+0000","last_became_active":"2024-09-13T19:16:05.919156+0000","last_became_peered":"2024-09-13T19:16:05.919156+0000","last_unstale":"2024-09-13T19:18:18.941983+0000","last_undegraded":"2024-09-13T19:18:18.941983+0000","last_fullsized":"2024-09-13T19:18:18.941983+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"36'18","reported_seq":78,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:40.864634+0000","last_change":"2024-09-13T19:19:40.864674+0000","last_active":"2024-09-13T19:19:40.864634+0000","last_peered":"2024-09-13T19:19:40.864634+0000","last_clean":"2024-09-13T19:19:40.864634+0000","last_became_active":"2024-09-13T19:15:57.902819+0000","last_became_peered":"2024-09-13T19:15:57.902819+0000","last_unstale":"2024-09-13T19:19:40.864634+0000","last_undegraded":"2024-09-13T19:19:40.864634+0000","last_fullsized":"2024-09-13T19:19:40.864634+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'18","last_scrub_stamp":"2024-09-13T19:19:40.864526+0000","last_deep_scrub":"36'18","last_deep_scrub_stamp":"2024-09-13T19:19:40.864526+0000","last_clean_scrub_stamp":"2024-09-13T19:19:40.864526+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:41.407519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":50,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.939644+0000","last_change":"2024-09-13T19:15:55.893781+0000","last_active":"2024-09-13T19:18:03.939644+0000","last_peered":"2024-09-13T19:18:03.939644+0000","last_clean":"2024-09-13T19:18:03.939644+0000","last_became_active":"2024-09-13T19:15:55.893468+0000","last_became_peered":"2024-09-13T19:15:55.893468+0000","last_unstale":"2024-09-13T19:18:03.939644+0000","last_undegraded":"2024-09-13T19:18:03.939644+0000","last_fullsized":"2024-09-13T19:18:03.939644+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:15.658450+0000","last_change":"2024-09-13T19:15:46.583117+0000","last_active":"2024-09-13T19:19:15.658450+0000","last_peered":"2024-09-13T19:19:15.658450+0000","last_clean":"2024-09-13T19:19:15.658450+0000","last_became_active":"2024-09-13T19:15:44.575726+0000","last_became_peered":"2024-09-13T19:15:44.575726+0000","last_unstale":"2024-09-13T19:19:15.658450+0000","last_undegraded":"2024-09-13T19:19:15.658450+0000","last_fullsized":"2024-09-13T19:19:15.658450+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041430200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"36'1","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.653153+0000","last_change":"2024-09-13T19:16:31.990974+0000","last_active":"2024-09-13T19:19:12.653153+0000","last_peered":"2024-09-13T19:19:12.653153+0000","last_clean":"2024-09-13T19:19:12.653153+0000","last_became_active":"2024-09-13T19:16:31.990669+0000","last_became_peered":"2024-09-13T19:16:31.990669+0000","last_unstale":"2024-09-13T19:19:12.653153+0000","last_undegraded":"2024-09-13T19:19:12.653153+0000","last_fullsized":"2024-09-13T19:19:12.653153+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"36'73","reported_seq":149,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:28.341082+0000","last_change":"2024-09-13T19:19:28.341123+0000","last_active":"2024-09-13T19:19:28.341082+0000","last_peered":"2024-09-13T19:19:28.341082+0000","last_clean":"2024-09-13T19:19:28.341082+0000","last_became_active":"2024-09-13T19:16:01.902095+0000","last_became_peered":"2024-09-13T19:16:01.902095+0000","last_unstale":"2024-09-13T19:19:28.341082+0000","last_undegraded":"2024-09-13T19:19:28.341082+0000","last_fullsized":"2024-09-13T19:19:28.341082+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'73","last_scrub_stamp":"2024-09-13T19:19:28.340973+0000","last_deep_scrub":"36'73","last_deep_scrub_stamp":"2024-09-13T19:19:28.340973+0000","last_clean_scrub_stamp":"2024-09-13T19:19:28.340973+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:31:45.923087+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:21.760539+0000","last_change":"2024-09-13T19:19:21.760567+0000","last_active":"2024-09-13T19:19:21.760539+0000","last_peered":"2024-09-13T19:19:21.760539+0000","last_clean":"2024-09-13T19:19:21.760539+0000","last_became_active":"2024-09-13T19:16:03.909803+0000","last_became_peered":"2024-09-13T19:16:03.909803+0000","last_unstale":"2024-09-13T19:19:21.760539+0000","last_undegraded":"2024-09-13T19:19:21.760539+0000","last_fullsized":"2024-09-13T19:19:21.760539+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:21.760449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:21.760449+0000","last_clean_scrub_stamp":"2024-09-13T19:19:21.760449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:57.014320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"36'11","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:21.938395+0000","last_change":"2024-09-13T19:16:05.915976+0000","last_active":"2024-09-13T19:18:21.938395+0000","last_peered":"2024-09-13T19:18:21.938395+0000","last_clean":"2024-09-13T19:18:21.938395+0000","last_became_active":"2024-09-13T19:16:05.915672+0000","last_became_peered":"2024-09-13T19:16:05.915672+0000","last_unstale":"2024-09-13T19:18:21.938395+0000","last_undegraded":"2024-09-13T19:18:21.938395+0000","last_fullsized":"2024-09-13T19:18:21.938395+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"36'10","reported_seq":68,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:38.781537+0000","last_change":"2024-09-13T19:19:38.781574+0000","last_active":"2024-09-13T19:19:38.781537+0000","last_peered":"2024-09-13T19:19:38.781537+0000","last_clean":"2024-09-13T19:19:38.781537+0000","last_became_active":"2024-09-13T19:15:57.902793+0000","last_became_peered":"2024-09-13T19:15:57.902793+0000","last_unstale":"2024-09-13T19:19:38.781537+0000","last_undegraded":"2024-09-13T19:19:38.781537+0000","last_fullsized":"2024-09-13T19:19:38.781537+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-13T19:19:38.781447+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-13T19:19:38.781447+0000","last_clean_scrub_stamp":"2024-09-13T19:19:38.781447+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:50.170162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:56.680517+0000","last_change":"2024-09-13T19:19:56.680541+0000","last_active":"2024-09-13T19:19:56.680517+0000","last_peered":"2024-09-13T19:19:56.680517+0000","last_clean":"2024-09-13T19:19:56.680517+0000","last_became_active":"2024-09-13T19:15:55.894340+0000","last_became_peered":"2024-09-13T19:15:55.894340+0000","last_unstale":"2024-09-13T19:19:56.680517+0000","last_undegraded":"2024-09-13T19:19:56.680517+0000","last_fullsized":"2024-09-13T19:19:56.680517+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:56.680427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:56.680427+0000","last_clean_scrub_stamp":"2024-09-13T19:19:56.680427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:52:19.982338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:16.976016+0000","last_change":"2024-09-13T19:15:46.581685+0000","last_active":"2024-09-13T19:19:16.976016+0000","last_peered":"2024-09-13T19:19:16.976016+0000","last_clean":"2024-09-13T19:19:16.976016+0000","last_became_active":"2024-09-13T19:15:44.576006+0000","last_became_peered":"2024-09-13T19:15:44.576006+0000","last_unstale":"2024-09-13T19:19:16.976016+0000","last_undegraded":"2024-09-13T19:19:16.976016+0000","last_fullsized":"2024-09-13T19:19:16.976016+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013309299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:26.089115+0000","last_change":"2024-09-13T19:19:26.089170+0000","last_active":"2024-09-13T19:19:26.089115+0000","last_peered":"2024-09-13T19:19:26.089115+0000","last_clean":"2024-09-13T19:19:26.089115+0000","last_became_active":"2024-09-13T19:15:59.894761+0000","last_became_peered":"2024-09-13T19:15:59.894761+0000","last_unstale":"2024-09-13T19:19:26.089115+0000","last_undegraded":"2024-09-13T19:19:26.089115+0000","last_fullsized":"2024-09-13T19:19:26.089115+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:26.089011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:26.089011+0000","last_clean_scrub_stamp":"2024-09-13T19:19:26.089011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:08.982394+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"36'21","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:16.767430+0000","last_change":"2024-09-13T19:19:16.767496+0000","last_active":"2024-09-13T19:19:16.767430+0000","last_peered":"2024-09-13T19:19:16.767430+0000","last_clean":"2024-09-13T19:19:16.767430+0000","last_became_active":"2024-09-13T19:16:01.907419+0000","last_became_peered":"2024-09-13T19:16:01.907419+0000","last_unstale":"2024-09-13T19:19:16.767430+0000","last_undegraded":"2024-09-13T19:19:16.767430+0000","last_fullsized":"2024-09-13T19:19:16.767430+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'21","last_scrub_stamp":"2024-09-13T19:19:16.767339+0000","last_deep_scrub":"36'21","last_deep_scrub_stamp":"2024-09-13T19:19:16.767339+0000","last_clean_scrub_stamp":"2024-09-13T19:19:16.767339+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:34.127072+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"36'285","reported_seq":358,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:23.651191+0000","last_change":"2024-09-13T19:19:23.651260+0000","last_active":"2024-09-13T19:19:23.651191+0000","last_peered":"2024-09-13T19:19:23.651191+0000","last_clean":"2024-09-13T19:19:23.651191+0000","last_became_active":"2024-09-13T19:16:03.907957+0000","last_became_peered":"2024-09-13T19:16:03.907957+0000","last_unstale":"2024-09-13T19:19:23.651191+0000","last_undegraded":"2024-09-13T19:19:23.651191+0000","last_fullsized":"2024-09-13T19:19:23.651191+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-13T19:19:23.651077+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-13T19:19:23.651077+0000","last_clean_scrub_stamp":"2024-09-13T19:19:23.651077+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:39:32.329566+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"34'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:23.943599+0000","last_change":"2024-09-13T19:16:05.924834+0000","last_active":"2024-09-13T19:18:23.943599+0000","last_peered":"2024-09-13T19:18:23.943599+0000","last_clean":"2024-09-13T19:18:23.943599+0000","last_became_active":"2024-09-13T19:16:05.924162+0000","last_became_peered":"2024-09-13T19:16:05.924162+0000","last_unstale":"2024-09-13T19:18:23.943599+0000","last_undegraded":"2024-09-13T19:18:23.943599+0000","last_fullsized":"2024-09-13T19:18:23.943599+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"36'6","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.970176+0000","last_change":"2024-09-13T19:15:57.897089+0000","last_active":"2024-09-13T19:19:05.970176+0000","last_peered":"2024-09-13T19:19:05.970176+0000","last_clean":"2024-09-13T19:19:05.970176+0000","last_became_active":"2024-09-13T19:15:57.896078+0000","last_became_peered":"2024-09-13T19:15:57.896078+0000","last_unstale":"2024-09-13T19:19:05.970176+0000","last_undegraded":"2024-09-13T19:19:05.970176+0000","last_fullsized":"2024-09-13T19:19:05.970176+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:08.941138+0000","last_change":"2024-09-13T19:15:55.895594+0000","last_active":"2024-09-13T19:18:08.941138+0000","last_peered":"2024-09-13T19:18:08.941138+0000","last_clean":"2024-09-13T19:18:08.941138+0000","last_became_active":"2024-09-13T19:15:55.895282+0000","last_became_peered":"2024-09-13T19:15:55.895282+0000","last_unstale":"2024-09-13T19:18:08.941138+0000","last_undegraded":"2024-09-13T19:18:08.941138+0000","last_fullsized":"2024-09-13T19:18:08.941138+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:56.934172+0000","last_change":"2024-09-13T19:15:46.583177+0000","last_active":"2024-09-13T19:17:56.934172+0000","last_peered":"2024-09-13T19:17:56.934172+0000","last_clean":"2024-09-13T19:17:56.934172+0000","last_became_active":"2024-09-13T19:15:44.574967+0000","last_became_peered":"2024-09-13T19:15:44.574967+0000","last_unstale":"2024-09-13T19:17:56.934172+0000","last_undegraded":"2024-09-13T19:17:56.934172+0000","last_fullsized":"2024-09-13T19:17:56.934172+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049330999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"36'2","reported_seq":230,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:25.112462+0000","last_change":"2024-09-13T19:19:25.112490+0000","last_active":"2024-09-13T19:19:25.112462+0000","last_peered":"2024-09-13T19:19:25.112462+0000","last_clean":"2024-09-13T19:19:25.112462+0000","last_became_active":"2024-09-13T19:15:59.894966+0000","last_became_peered":"2024-09-13T19:15:59.894966+0000","last_unstale":"2024-09-13T19:19:25.112462+0000","last_undegraded":"2024-09-13T19:19:25.112462+0000","last_fullsized":"2024-09-13T19:19:25.112462+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:25.112380+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:25.112380+0000","last_clean_scrub_stamp":"2024-09-13T19:19:25.112380+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:41.200956+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"36'16","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:27.099236+0000","last_change":"2024-09-13T19:19:27.099288+0000","last_active":"2024-09-13T19:19:27.099236+0000","last_peered":"2024-09-13T19:19:27.099236+0000","last_clean":"2024-09-13T19:19:27.099236+0000","last_became_active":"2024-09-13T19:16:01.902739+0000","last_became_peered":"2024-09-13T19:16:01.902739+0000","last_unstale":"2024-09-13T19:19:27.099236+0000","last_undegraded":"2024-09-13T19:19:27.099236+0000","last_fullsized":"2024-09-13T19:19:27.099236+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-13T19:19:27.099139+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-13T19:19:27.099139+0000","last_clean_scrub_stamp":"2024-09-13T19:19:27.099139+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:22:57.737015+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"36'285","reported_seq":429,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:22.346065+0000","last_change":"2024-09-13T19:19:22.346094+0000","last_active":"2024-09-13T19:19:22.346065+0000","last_peered":"2024-09-13T19:19:22.346065+0000","last_clean":"2024-09-13T19:19:22.346065+0000","last_became_active":"2024-09-13T19:16:03.909038+0000","last_became_peered":"2024-09-13T19:16:03.909038+0000","last_unstale":"2024-09-13T19:19:22.346065+0000","last_undegraded":"2024-09-13T19:19:22.346065+0000","last_fullsized":"2024-09-13T19:19:22.346065+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-13T19:19:22.345954+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-13T19:19:22.345954+0000","last_clean_scrub_stamp":"2024-09-13T19:19:22.345954+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:07.575589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'3","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:23.942859+0000","last_change":"2024-09-13T19:16:05.924059+0000","last_active":"2024-09-13T19:18:23.942859+0000","last_peered":"2024-09-13T19:18:23.942859+0000","last_clean":"2024-09-13T19:18:23.942859+0000","last_became_active":"2024-09-13T19:16:05.923739+0000","last_became_peered":"2024-09-13T19:16:05.923739+0000","last_unstale":"2024-09-13T19:18:23.942859+0000","last_undegraded":"2024-09-13T19:18:23.942859+0000","last_fullsized":"2024-09-13T19:18:23.942859+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"36'6","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:51.725082+0000","last_change":"2024-09-13T19:19:51.725112+0000","last_active":"2024-09-13T19:19:51.725082+0000","last_peered":"2024-09-13T19:19:51.725082+0000","last_clean":"2024-09-13T19:19:51.725082+0000","last_became_active":"2024-09-13T19:15:57.897727+0000","last_became_peered":"2024-09-13T19:15:57.897727+0000","last_unstale":"2024-09-13T19:19:51.725082+0000","last_undegraded":"2024-09-13T19:19:51.725082+0000","last_fullsized":"2024-09-13T19:19:51.725082+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:19:51.724981+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:19:51.724981+0000","last_clean_scrub_stamp":"2024-09-13T19:19:51.724981+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:11:51.172869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:08.940449+0000","last_change":"2024-09-13T19:15:55.895727+0000","last_active":"2024-09-13T19:18:08.940449+0000","last_peered":"2024-09-13T19:18:08.940449+0000","last_clean":"2024-09-13T19:18:08.940449+0000","last_became_active":"2024-09-13T19:15:55.895394+0000","last_became_peered":"2024-09-13T19:15:55.895394+0000","last_unstale":"2024-09-13T19:18:08.940449+0000","last_undegraded":"2024-09-13T19:18:08.940449+0000","last_fullsized":"2024-09-13T19:18:08.940449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:53.938816+0000","last_change":"2024-09-13T19:15:46.581172+0000","last_active":"2024-09-13T19:17:53.938816+0000","last_peered":"2024-09-13T19:17:53.938816+0000","last_clean":"2024-09-13T19:17:53.938816+0000","last_became_active":"2024-09-13T19:15:44.607248+0000","last_became_peered":"2024-09-13T19:15:44.607248+0000","last_unstale":"2024-09-13T19:17:53.938816+0000","last_undegraded":"2024-09-13T19:17:53.938816+0000","last_fullsized":"2024-09-13T19:17:53.938816+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086245899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:17:58.939388+0000","last_change":"2024-09-13T19:16:31.993085+0000","last_active":"2024-09-13T19:17:58.939388+0000","last_peered":"2024-09-13T19:17:58.939388+0000","last_clean":"2024-09-13T19:17:58.939388+0000","last_became_active":"2024-09-13T19:16:31.992752+0000","last_became_peered":"2024-09-13T19:16:31.992752+0000","last_unstale":"2024-09-13T19:17:58.939388+0000","last_undegraded":"2024-09-13T19:17:58.939388+0000","last_fullsized":"2024-09-13T19:17:58.939388+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"36'98","reported_seq":191,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:24.778346+0000","last_change":"2024-09-13T19:19:24.778390+0000","last_active":"2024-09-13T19:19:24.778346+0000","last_peered":"2024-09-13T19:19:24.778346+0000","last_clean":"2024-09-13T19:19:24.778346+0000","last_became_active":"2024-09-13T19:16:01.906317+0000","last_became_peered":"2024-09-13T19:16:01.906317+0000","last_unstale":"2024-09-13T19:19:24.778346+0000","last_undegraded":"2024-09-13T19:19:24.778346+0000","last_fullsized":"2024-09-13T19:19:24.778346+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'98","last_scrub_stamp":"2024-09-13T19:19:24.778260+0000","last_deep_scrub":"36'98","last_deep_scrub_stamp":"2024-09-13T19:19:24.778260+0000","last_clean_scrub_stamp":"2024-09-13T19:19:24.778260+0000","objects_scrubbed":8,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:51.569747+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":99,"num_read_kb":103,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:19.337985+0000","last_change":"2024-09-13T19:19:19.338010+0000","last_active":"2024-09-13T19:19:19.337985+0000","last_peered":"2024-09-13T19:19:19.337985+0000","last_clean":"2024-09-13T19:19:19.337985+0000","last_became_active":"2024-09-13T19:16:03.909941+0000","last_became_peered":"2024-09-13T19:16:03.909941+0000","last_unstale":"2024-09-13T19:19:19.337985+0000","last_undegraded":"2024-09-13T19:19:19.337985+0000","last_fullsized":"2024-09-13T19:19:19.337985+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:19.337887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:19.337887+0000","last_clean_scrub_stamp":"2024-09-13T19:19:19.337887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:59.954982+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:31.797118+0000","last_change":"2024-09-13T19:19:31.797143+0000","last_active":"2024-09-13T19:19:31.797118+0000","last_peered":"2024-09-13T19:19:31.797118+0000","last_clean":"2024-09-13T19:19:31.797118+0000","last_became_active":"2024-09-13T19:16:05.911465+0000","last_became_peered":"2024-09-13T19:16:05.911465+0000","last_unstale":"2024-09-13T19:19:31.797118+0000","last_undegraded":"2024-09-13T19:19:31.797118+0000","last_fullsized":"2024-09-13T19:19:31.797118+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:31.797033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:31.797033+0000","last_clean_scrub_stamp":"2024-09-13T19:19:31.797033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:28:44.716045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:13.941331+0000","last_change":"2024-09-13T19:16:05.917443+0000","last_active":"2024-09-13T19:18:13.941331+0000","last_peered":"2024-09-13T19:18:13.941331+0000","last_clean":"2024-09-13T19:18:13.941331+0000","last_became_active":"2024-09-13T19:16:05.917156+0000","last_became_peered":"2024-09-13T19:16:05.917156+0000","last_unstale":"2024-09-13T19:18:13.941331+0000","last_undegraded":"2024-09-13T19:18:13.941331+0000","last_fullsized":"2024-09-13T19:18:13.941331+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"36'8","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.708661+0000","last_change":"2024-09-13T19:15:57.899020+0000","last_active":"2024-09-13T19:19:05.708661+0000","last_peered":"2024-09-13T19:19:05.708661+0000","last_clean":"2024-09-13T19:19:05.708661+0000","last_became_active":"2024-09-13T19:15:57.898761+0000","last_became_peered":"2024-09-13T19:15:57.898761+0000","last_unstale":"2024-09-13T19:19:05.708661+0000","last_undegraded":"2024-09-13T19:19:05.708661+0000","last_fullsized":"2024-09-13T19:19:05.708661+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:18.942784+0000","last_change":"2024-09-13T19:15:55.898265+0000","last_active":"2024-09-13T19:18:18.942784+0000","last_peered":"2024-09-13T19:18:18.942784+0000","last_clean":"2024-09-13T19:18:18.942784+0000","last_became_active":"2024-09-13T19:15:55.892518+0000","last_became_peered":"2024-09-13T19:15:55.892518+0000","last_unstale":"2024-09-13T19:18:18.942784+0000","last_undegraded":"2024-09-13T19:18:18.942784+0000","last_fullsized":"2024-09-13T19:18:18.942784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:30.756336+0000","last_change":"2024-09-13T19:19:30.756383+0000","last_active":"2024-09-13T19:19:30.756336+0000","last_peered":"2024-09-13T19:19:30.756336+0000","last_clean":"2024-09-13T19:19:30.756336+0000","last_became_active":"2024-09-13T19:15:59.892690+0000","last_became_peered":"2024-09-13T19:15:59.892690+0000","last_unstale":"2024-09-13T19:19:30.756336+0000","last_undegraded":"2024-09-13T19:19:30.756336+0000","last_fullsized":"2024-09-13T19:19:30.756336+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:30.756223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:30.756223+0000","last_clean_scrub_stamp":"2024-09-13T19:19:30.756223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:04:11.520992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"36'40","reported_seq":96,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:31.067728+0000","last_change":"2024-09-13T19:19:31.067778+0000","last_active":"2024-09-13T19:19:31.067728+0000","last_peered":"2024-09-13T19:19:31.067728+0000","last_clean":"2024-09-13T19:19:31.067728+0000","last_became_active":"2024-09-13T19:16:01.904684+0000","last_became_peered":"2024-09-13T19:16:01.904684+0000","last_unstale":"2024-09-13T19:19:31.067728+0000","last_undegraded":"2024-09-13T19:19:31.067728+0000","last_fullsized":"2024-09-13T19:19:31.067728+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'40","last_scrub_stamp":"2024-09-13T19:19:31.067631+0000","last_deep_scrub":"36'40","last_deep_scrub_stamp":"2024-09-13T19:19:31.067631+0000","last_clean_scrub_stamp":"2024-09-13T19:19:31.067631+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:43.676892+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:38.002187+0000","last_change":"2024-09-13T19:19:38.002210+0000","last_active":"2024-09-13T19:19:38.002187+0000","last_peered":"2024-09-13T19:19:38.002187+0000","last_clean":"2024-09-13T19:19:38.002187+0000","last_became_active":"2024-09-13T19:16:03.912244+0000","last_became_peered":"2024-09-13T19:16:03.912244+0000","last_unstale":"2024-09-13T19:19:38.002187+0000","last_undegraded":"2024-09-13T19:19:38.002187+0000","last_fullsized":"2024-09-13T19:19:38.002187+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:38.002099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:38.002099+0000","last_clean_scrub_stamp":"2024-09-13T19:19:38.002099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:02.124751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"36'3","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:06.935876+0000","last_change":"2024-09-13T19:16:05.921280+0000","last_active":"2024-09-13T19:18:06.935876+0000","last_peered":"2024-09-13T19:18:06.935876+0000","last_clean":"2024-09-13T19:18:06.935876+0000","last_became_active":"2024-09-13T19:16:05.920951+0000","last_became_peered":"2024-09-13T19:16:05.920951+0000","last_unstale":"2024-09-13T19:18:06.935876+0000","last_undegraded":"2024-09-13T19:18:06.935876+0000","last_fullsized":"2024-09-13T19:18:06.935876+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"36'4","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:44.877396+0000","last_change":"2024-09-13T19:19:44.877430+0000","last_active":"2024-09-13T19:19:44.877396+0000","last_peered":"2024-09-13T19:19:44.877396+0000","last_clean":"2024-09-13T19:19:44.877396+0000","last_became_active":"2024-09-13T19:15:57.901732+0000","last_became_peered":"2024-09-13T19:15:57.901732+0000","last_unstale":"2024-09-13T19:19:44.877396+0000","last_undegraded":"2024-09-13T19:19:44.877396+0000","last_fullsized":"2024-09-13T19:19:44.877396+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:19:44.877311+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:19:44.877311+0000","last_clean_scrub_stamp":"2024-09-13T19:19:44.877311+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:11:44.325198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"36'4","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:52.675796+0000","last_change":"2024-09-13T19:19:52.675825+0000","last_active":"2024-09-13T19:19:52.675796+0000","last_peered":"2024-09-13T19:19:52.675796+0000","last_clean":"2024-09-13T19:19:52.675796+0000","last_became_active":"2024-09-13T19:15:55.894279+0000","last_became_peered":"2024-09-13T19:15:55.894279+0000","last_unstale":"2024-09-13T19:19:52.675796+0000","last_undegraded":"2024-09-13T19:19:52.675796+0000","last_fullsized":"2024-09-13T19:19:52.675796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:19:52.675686+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:19:52.675686+0000","last_clean_scrub_stamp":"2024-09-13T19:19:52.675686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:16.286898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:24.099254+0000","last_change":"2024-09-13T19:19:24.099278+0000","last_active":"2024-09-13T19:19:24.099254+0000","last_peered":"2024-09-13T19:19:24.099254+0000","last_clean":"2024-09-13T19:19:24.099254+0000","last_became_active":"2024-09-13T19:15:59.895325+0000","last_became_peered":"2024-09-13T19:15:59.895325+0000","last_unstale":"2024-09-13T19:19:24.099254+0000","last_undegraded":"2024-09-13T19:19:24.099254+0000","last_fullsized":"2024-09-13T19:19:24.099254+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:24.099164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:24.099164+0000","last_clean_scrub_stamp":"2024-09-13T19:19:24.099164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:16.483764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"36'8","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:30.333549+0000","last_change":"2024-09-13T19:19:30.333585+0000","last_active":"2024-09-13T19:19:30.333549+0000","last_peered":"2024-09-13T19:19:30.333549+0000","last_clean":"2024-09-13T19:19:30.333549+0000","last_became_active":"2024-09-13T19:16:01.901250+0000","last_became_peered":"2024-09-13T19:16:01.901250+0000","last_unstale":"2024-09-13T19:19:30.333549+0000","last_undegraded":"2024-09-13T19:19:30.333549+0000","last_fullsized":"2024-09-13T19:19:30.333549+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-13T19:19:30.333464+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-13T19:19:30.333464+0000","last_clean_scrub_stamp":"2024-09-13T19:19:30.333464+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:12:35.870136+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:16.732038+0000","last_change":"2024-09-13T19:19:16.732086+0000","last_active":"2024-09-13T19:19:16.732038+0000","last_peered":"2024-09-13T19:19:16.732038+0000","last_clean":"2024-09-13T19:19:16.732038+0000","last_became_active":"2024-09-13T19:16:03.913053+0000","last_became_peered":"2024-09-13T19:16:03.913053+0000","last_unstale":"2024-09-13T19:19:16.732038+0000","last_undegraded":"2024-09-13T19:19:16.732038+0000","last_fullsized":"2024-09-13T19:19:16.732038+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:16.731903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:16.731903+0000","last_clean_scrub_stamp":"2024-09-13T19:19:16.731903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:42.561076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"36'2","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:45.575337+0000","last_change":"2024-09-13T19:19:45.575382+0000","last_active":"2024-09-13T19:19:45.575337+0000","last_peered":"2024-09-13T19:19:45.575337+0000","last_clean":"2024-09-13T19:19:45.575337+0000","last_became_active":"2024-09-13T19:16:05.912428+0000","last_became_peered":"2024-09-13T19:16:05.912428+0000","last_unstale":"2024-09-13T19:19:45.575337+0000","last_undegraded":"2024-09-13T19:19:45.575337+0000","last_fullsized":"2024-09-13T19:19:45.575337+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:45.575217+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:45.575217+0000","last_clean_scrub_stamp":"2024-09-13T19:19:45.575217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:52:00.818473+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"36'8","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:44.570507+0000","last_change":"2024-09-13T19:19:44.570540+0000","last_active":"2024-09-13T19:19:44.570507+0000","last_peered":"2024-09-13T19:19:44.570507+0000","last_clean":"2024-09-13T19:19:44.570507+0000","last_became_active":"2024-09-13T19:15:57.896463+0000","last_became_peered":"2024-09-13T19:15:57.896463+0000","last_unstale":"2024-09-13T19:19:44.570507+0000","last_undegraded":"2024-09-13T19:19:44.570507+0000","last_fullsized":"2024-09-13T19:19:44.570507+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-13T19:19:44.570415+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-13T19:19:44.570415+0000","last_clean_scrub_stamp":"2024-09-13T19:19:44.570415+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:32:33.923357+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:23.942849+0000","last_change":"2024-09-13T19:15:55.888440+0000","last_active":"2024-09-13T19:18:23.942849+0000","last_peered":"2024-09-13T19:18:23.942849+0000","last_clean":"2024-09-13T19:18:23.942849+0000","last_became_active":"2024-09-13T19:15:55.888108+0000","last_became_peered":"2024-09-13T19:15:55.888108+0000","last_unstale":"2024-09-13T19:18:23.942849+0000","last_undegraded":"2024-09-13T19:18:23.942849+0000","last_fullsized":"2024-09-13T19:18:23.942849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:34.858389+0000","last_change":"2024-09-13T19:19:34.858432+0000","last_active":"2024-09-13T19:19:34.858389+0000","last_peered":"2024-09-13T19:19:34.858389+0000","last_clean":"2024-09-13T19:19:34.858389+0000","last_became_active":"2024-09-13T19:15:59.892842+0000","last_became_peered":"2024-09-13T19:15:59.892842+0000","last_unstale":"2024-09-13T19:19:34.858389+0000","last_undegraded":"2024-09-13T19:19:34.858389+0000","last_fullsized":"2024-09-13T19:19:34.858389+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:34.858282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:34.858282+0000","last_clean_scrub_stamp":"2024-09-13T19:19:34.858282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:59.055511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"36'48","reported_seq":120,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:24.358477+0000","last_change":"2024-09-13T19:19:24.358526+0000","last_active":"2024-09-13T19:19:24.358477+0000","last_peered":"2024-09-13T19:19:24.358477+0000","last_clean":"2024-09-13T19:19:24.358477+0000","last_became_active":"2024-09-13T19:16:01.902991+0000","last_became_peered":"2024-09-13T19:16:01.902991+0000","last_unstale":"2024-09-13T19:19:24.358477+0000","last_undegraded":"2024-09-13T19:19:24.358477+0000","last_fullsized":"2024-09-13T19:19:24.358477+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'48","last_scrub_stamp":"2024-09-13T19:19:24.358388+0000","last_deep_scrub":"36'48","last_deep_scrub_stamp":"2024-09-13T19:19:24.358388+0000","last_clean_scrub_stamp":"2024-09-13T19:19:24.358388+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:23:15.090837+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:27.782078+0000","last_change":"2024-09-13T19:19:27.782128+0000","last_active":"2024-09-13T19:19:27.782078+0000","last_peered":"2024-09-13T19:19:27.782078+0000","last_clean":"2024-09-13T19:19:27.782078+0000","last_became_active":"2024-09-13T19:16:03.911917+0000","last_became_peered":"2024-09-13T19:16:03.911917+0000","last_unstale":"2024-09-13T19:19:27.782078+0000","last_undegraded":"2024-09-13T19:19:27.782078+0000","last_fullsized":"2024-09-13T19:19:27.782078+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:27.781937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:27.781937+0000","last_clean_scrub_stamp":"2024-09-13T19:19:27.781937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:51.979166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"36'4","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:38.945635+0000","last_change":"2024-09-13T19:16:05.924382+0000","last_active":"2024-09-13T19:18:38.945635+0000","last_peered":"2024-09-13T19:18:38.945635+0000","last_clean":"2024-09-13T19:18:38.945635+0000","last_became_active":"2024-09-13T19:16:05.923368+0000","last_became_peered":"2024-09-13T19:16:05.923368+0000","last_unstale":"2024-09-13T19:18:38.945635+0000","last_undegraded":"2024-09-13T19:18:38.945635+0000","last_fullsized":"2024-09-13T19:18:38.945635+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"36'16","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.849006+0000","last_change":"2024-09-13T19:16:31.999453+0000","last_active":"2024-09-13T19:19:05.849006+0000","last_peered":"2024-09-13T19:19:05.849006+0000","last_clean":"2024-09-13T19:19:05.849006+0000","last_became_active":"2024-09-13T19:16:31.991993+0000","last_became_peered":"2024-09-13T19:16:31.991993+0000","last_unstale":"2024-09-13T19:19:05.849006+0000","last_undegraded":"2024-09-13T19:19:05.849006+0000","last_fullsized":"2024-09-13T19:19:05.849006+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:23.942988+0000","last_change":"2024-09-13T19:15:55.892008+0000","last_active":"2024-09-13T19:18:23.942988+0000","last_peered":"2024-09-13T19:18:23.942988+0000","last_clean":"2024-09-13T19:18:23.942988+0000","last_became_active":"2024-09-13T19:15:55.891711+0000","last_became_peered":"2024-09-13T19:15:55.891711+0000","last_unstale":"2024-09-13T19:18:23.942988+0000","last_undegraded":"2024-09-13T19:18:23.942988+0000","last_fullsized":"2024-09-13T19:18:23.942988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:28.138750+0000","last_change":"2024-09-13T19:19:28.138774+0000","last_active":"2024-09-13T19:19:28.138750+0000","last_peered":"2024-09-13T19:19:28.138750+0000","last_clean":"2024-09-13T19:19:28.138750+0000","last_became_active":"2024-09-13T19:15:59.891581+0000","last_became_peered":"2024-09-13T19:15:59.891581+0000","last_unstale":"2024-09-13T19:19:28.138750+0000","last_undegraded":"2024-09-13T19:19:28.138750+0000","last_fullsized":"2024-09-13T19:19:28.138750+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:28.138649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:28.138649+0000","last_clean_scrub_stamp":"2024-09-13T19:19:28.138649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:49.838315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"36'36","reported_seq":91,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:29.830558+0000","last_change":"2024-09-13T19:19:29.830588+0000","last_active":"2024-09-13T19:19:29.830558+0000","last_peered":"2024-09-13T19:19:29.830558+0000","last_clean":"2024-09-13T19:19:29.830558+0000","last_became_active":"2024-09-13T19:16:01.899438+0000","last_became_peered":"2024-09-13T19:16:01.899438+0000","last_unstale":"2024-09-13T19:19:29.830558+0000","last_undegraded":"2024-09-13T19:19:29.830558+0000","last_fullsized":"2024-09-13T19:19:29.830558+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-13T19:19:29.830469+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-13T19:19:29.830469+0000","last_clean_scrub_stamp":"2024-09-13T19:19:29.830469+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:27.642409+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:20.751480+0000","last_change":"2024-09-13T19:19:20.751502+0000","last_active":"2024-09-13T19:19:20.751480+0000","last_peered":"2024-09-13T19:19:20.751480+0000","last_clean":"2024-09-13T19:19:20.751480+0000","last_became_active":"2024-09-13T19:16:03.910319+0000","last_became_peered":"2024-09-13T19:16:03.910319+0000","last_unstale":"2024-09-13T19:19:20.751480+0000","last_undegraded":"2024-09-13T19:19:20.751480+0000","last_fullsized":"2024-09-13T19:19:20.751480+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:20.751392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:20.751392+0000","last_clean_scrub_stamp":"2024-09-13T19:19:20.751392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:18.995121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"36'10","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:52.862771+0000","last_change":"2024-09-13T19:19:52.862813+0000","last_active":"2024-09-13T19:19:52.862771+0000","last_peered":"2024-09-13T19:19:52.862771+0000","last_clean":"2024-09-13T19:19:52.862771+0000","last_became_active":"2024-09-13T19:15:57.897232+0000","last_became_peered":"2024-09-13T19:15:57.897232+0000","last_unstale":"2024-09-13T19:19:52.862771+0000","last_undegraded":"2024-09-13T19:19:52.862771+0000","last_fullsized":"2024-09-13T19:19:52.862771+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-13T19:19:52.862661+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-13T19:19:52.862661+0000","last_clean_scrub_stamp":"2024-09-13T19:19:52.862661+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:54.838456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:23.943384+0000","last_change":"2024-09-13T19:15:55.901992+0000","last_active":"2024-09-13T19:18:23.943384+0000","last_peered":"2024-09-13T19:18:23.943384+0000","last_clean":"2024-09-13T19:18:23.943384+0000","last_became_active":"2024-09-13T19:15:55.901257+0000","last_became_peered":"2024-09-13T19:15:55.901257+0000","last_unstale":"2024-09-13T19:18:23.943384+0000","last_undegraded":"2024-09-13T19:18:23.943384+0000","last_fullsized":"2024-09-13T19:18:23.943384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:32.383161+0000","last_change":"2024-09-13T19:19:32.383184+0000","last_active":"2024-09-13T19:19:32.383161+0000","last_peered":"2024-09-13T19:19:32.383161+0000","last_clean":"2024-09-13T19:19:32.383161+0000","last_became_active":"2024-09-13T19:15:59.896339+0000","last_became_peered":"2024-09-13T19:15:59.896339+0000","last_unstale":"2024-09-13T19:19:32.383161+0000","last_undegraded":"2024-09-13T19:19:32.383161+0000","last_fullsized":"2024-09-13T19:19:32.383161+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:32.383058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:32.383058+0000","last_clean_scrub_stamp":"2024-09-13T19:19:32.383058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:00.272146+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"36'63","reported_seq":136,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:31.346681+0000","last_change":"2024-09-13T19:19:31.346722+0000","last_active":"2024-09-13T19:19:31.346681+0000","last_peered":"2024-09-13T19:19:31.346681+0000","last_clean":"2024-09-13T19:19:31.346681+0000","last_became_active":"2024-09-13T19:16:01.901092+0000","last_became_peered":"2024-09-13T19:16:01.901092+0000","last_unstale":"2024-09-13T19:19:31.346681+0000","last_undegraded":"2024-09-13T19:19:31.346681+0000","last_fullsized":"2024-09-13T19:19:31.346681+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'63","last_scrub_stamp":"2024-09-13T19:19:31.346567+0000","last_deep_scrub":"36'63","last_deep_scrub_stamp":"2024-09-13T19:19:31.346567+0000","last_clean_scrub_stamp":"2024-09-13T19:19:31.346567+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:48:17.500355+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:18.709566+0000","last_change":"2024-09-13T19:19:18.709589+0000","last_active":"2024-09-13T19:19:18.709566+0000","last_peered":"2024-09-13T19:19:18.709566+0000","last_clean":"2024-09-13T19:19:18.709566+0000","last_became_active":"2024-09-13T19:16:03.910305+0000","last_became_peered":"2024-09-13T19:16:03.910305+0000","last_unstale":"2024-09-13T19:19:18.709566+0000","last_undegraded":"2024-09-13T19:19:18.709566+0000","last_fullsized":"2024-09-13T19:19:18.709566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:18.709481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:18.709481+0000","last_clean_scrub_stamp":"2024-09-13T19:19:18.709481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:41.615886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"36'22","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.598961+0000","last_change":"2024-09-13T19:16:05.913081+0000","last_active":"2024-09-13T19:19:05.598961+0000","last_peered":"2024-09-13T19:19:05.598961+0000","last_clean":"2024-09-13T19:19:05.598961+0000","last_became_active":"2024-09-13T19:16:05.912675+0000","last_became_peered":"2024-09-13T19:16:05.912675+0000","last_unstale":"2024-09-13T19:19:05.598961+0000","last_undegraded":"2024-09-13T19:19:05.598961+0000","last_fullsized":"2024-09-13T19:19:05.598961+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"36'6","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:15.658919+0000","last_change":"2024-09-13T19:15:57.890233+0000","last_active":"2024-09-13T19:19:15.658919+0000","last_peered":"2024-09-13T19:19:15.658919+0000","last_clean":"2024-09-13T19:19:15.658919+0000","last_became_active":"2024-09-13T19:15:57.889921+0000","last_became_peered":"2024-09-13T19:15:57.889921+0000","last_unstale":"2024-09-13T19:19:15.658919+0000","last_undegraded":"2024-09-13T19:19:15.658919+0000","last_fullsized":"2024-09-13T19:19:15.658919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:23.942762+0000","last_change":"2024-09-13T19:15:55.895671+0000","last_active":"2024-09-13T19:18:23.942762+0000","last_peered":"2024-09-13T19:18:23.942762+0000","last_clean":"2024-09-13T19:18:23.942762+0000","last_became_active":"2024-09-13T19:15:55.895344+0000","last_became_peered":"2024-09-13T19:15:55.895344+0000","last_unstale":"2024-09-13T19:18:23.942762+0000","last_undegraded":"2024-09-13T19:18:23.942762+0000","last_fullsized":"2024-09-13T19:18:23.942762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:38.765104+0000","last_change":"2024-09-13T19:19:38.765129+0000","last_active":"2024-09-13T19:19:38.765104+0000","last_peered":"2024-09-13T19:19:38.765104+0000","last_clean":"2024-09-13T19:19:38.765104+0000","last_became_active":"2024-09-13T19:15:59.888213+0000","last_became_peered":"2024-09-13T19:15:59.888213+0000","last_unstale":"2024-09-13T19:19:38.765104+0000","last_undegraded":"2024-09-13T19:19:38.765104+0000","last_fullsized":"2024-09-13T19:19:38.765104+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:38.764987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:38.764987+0000","last_clean_scrub_stamp":"2024-09-13T19:19:38.764987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:30.399476+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"36'45","reported_seq":103,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:40.991571+0000","last_change":"2024-09-13T19:19:40.991618+0000","last_active":"2024-09-13T19:19:40.991571+0000","last_peered":"2024-09-13T19:19:40.991571+0000","last_clean":"2024-09-13T19:19:40.991571+0000","last_became_active":"2024-09-13T19:16:01.908116+0000","last_became_peered":"2024-09-13T19:16:01.908116+0000","last_unstale":"2024-09-13T19:19:40.991571+0000","last_undegraded":"2024-09-13T19:19:40.991571+0000","last_fullsized":"2024-09-13T19:19:40.991571+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'45","last_scrub_stamp":"2024-09-13T19:19:40.991484+0000","last_deep_scrub":"36'45","last_deep_scrub_stamp":"2024-09-13T19:19:40.991484+0000","last_clean_scrub_stamp":"2024-09-13T19:19:40.991484+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:20.333822+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:31.769578+0000","last_change":"2024-09-13T19:19:31.769602+0000","last_active":"2024-09-13T19:19:31.769578+0000","last_peered":"2024-09-13T19:19:31.769578+0000","last_clean":"2024-09-13T19:19:31.769578+0000","last_became_active":"2024-09-13T19:16:03.914179+0000","last_became_peered":"2024-09-13T19:16:03.914179+0000","last_unstale":"2024-09-13T19:19:31.769578+0000","last_undegraded":"2024-09-13T19:19:31.769578+0000","last_fullsized":"2024-09-13T19:19:31.769578+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:31.769488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:31.769488+0000","last_clean_scrub_stamp":"2024-09-13T19:19:31.769488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:13.242003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"34'2","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:28.944191+0000","last_change":"2024-09-13T19:16:05.917077+0000","last_active":"2024-09-13T19:18:28.944191+0000","last_peered":"2024-09-13T19:18:28.944191+0000","last_clean":"2024-09-13T19:18:28.944191+0000","last_became_active":"2024-09-13T19:16:05.916822+0000","last_became_peered":"2024-09-13T19:16:05.916822+0000","last_unstale":"2024-09-13T19:18:28.944191+0000","last_undegraded":"2024-09-13T19:18:28.944191+0000","last_fullsized":"2024-09-13T19:18:28.944191+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"36'22","reported_seq":82,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:30.102419+0000","last_change":"2024-09-13T19:19:30.102447+0000","last_active":"2024-09-13T19:19:30.102419+0000","last_peered":"2024-09-13T19:19:30.102419+0000","last_clean":"2024-09-13T19:19:30.102419+0000","last_became_active":"2024-09-13T19:15:57.901330+0000","last_became_peered":"2024-09-13T19:15:57.901330+0000","last_unstale":"2024-09-13T19:19:30.102419+0000","last_undegraded":"2024-09-13T19:19:30.102419+0000","last_fullsized":"2024-09-13T19:19:30.102419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'22","last_scrub_stamp":"2024-09-13T19:19:30.102322+0000","last_deep_scrub":"36'22","last_deep_scrub_stamp":"2024-09-13T19:19:30.102322+0000","last_clean_scrub_stamp":"2024-09-13T19:19:30.102322+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:16.992227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":60,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:28.943575+0000","last_change":"2024-09-13T19:15:55.896540+0000","last_active":"2024-09-13T19:18:28.943575+0000","last_peered":"2024-09-13T19:18:28.943575+0000","last_clean":"2024-09-13T19:18:28.943575+0000","last_became_active":"2024-09-13T19:15:55.896196+0000","last_became_peered":"2024-09-13T19:15:55.896196+0000","last_unstale":"2024-09-13T19:18:28.943575+0000","last_undegraded":"2024-09-13T19:18:28.943575+0000","last_fullsized":"2024-09-13T19:18:28.943575+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:37.784973+0000","last_change":"2024-09-13T19:19:37.784998+0000","last_active":"2024-09-13T19:19:37.784973+0000","last_peered":"2024-09-13T19:19:37.784973+0000","last_clean":"2024-09-13T19:19:37.784973+0000","last_became_active":"2024-09-13T19:15:59.891131+0000","last_became_peered":"2024-09-13T19:15:59.891131+0000","last_unstale":"2024-09-13T19:19:37.784973+0000","last_undegraded":"2024-09-13T19:19:37.784973+0000","last_fullsized":"2024-09-13T19:19:37.784973+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:37.784843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:37.784843+0000","last_clean_scrub_stamp":"2024-09-13T19:19:37.784843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:04:18.549612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"36'39","reported_seq":95,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:27.304444+0000","last_change":"2024-09-13T19:19:27.304502+0000","last_active":"2024-09-13T19:19:27.304444+0000","last_peered":"2024-09-13T19:19:27.304444+0000","last_clean":"2024-09-13T19:19:27.304444+0000","last_became_active":"2024-09-13T19:16:01.902251+0000","last_became_peered":"2024-09-13T19:16:01.902251+0000","last_unstale":"2024-09-13T19:19:27.304444+0000","last_undegraded":"2024-09-13T19:19:27.304444+0000","last_fullsized":"2024-09-13T19:19:27.304444+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'39","last_scrub_stamp":"2024-09-13T19:19:27.304335+0000","last_deep_scrub":"36'39","last_deep_scrub_stamp":"2024-09-13T19:19:27.304335+0000","last_clean_scrub_stamp":"2024-09-13T19:19:27.304335+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:19:17.836466+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:37.488029+0000","last_change":"2024-09-13T19:19:37.488048+0000","last_active":"2024-09-13T19:19:37.488029+0000","last_peered":"2024-09-13T19:19:37.488029+0000","last_clean":"2024-09-13T19:19:37.488029+0000","last_became_active":"2024-09-13T19:16:03.915225+0000","last_became_peered":"2024-09-13T19:16:03.915225+0000","last_unstale":"2024-09-13T19:19:37.488029+0000","last_undegraded":"2024-09-13T19:19:37.488029+0000","last_fullsized":"2024-09-13T19:19:37.488029+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:37.487953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:37.487953+0000","last_clean_scrub_stamp":"2024-09-13T19:19:37.487953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:42.911372+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"36'5","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:28.944166+0000","last_change":"2024-09-13T19:16:05.925066+0000","last_active":"2024-09-13T19:18:28.944166+0000","last_peered":"2024-09-13T19:18:28.944166+0000","last_clean":"2024-09-13T19:18:28.944166+0000","last_became_active":"2024-09-13T19:16:05.923235+0000","last_became_peered":"2024-09-13T19:16:05.923235+0000","last_unstale":"2024-09-13T19:18:28.944166+0000","last_undegraded":"2024-09-13T19:18:28.944166+0000","last_fullsized":"2024-09-13T19:18:28.944166+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"36'8","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:47.641332+0000","last_change":"2024-09-13T19:19:47.641385+0000","last_active":"2024-09-13T19:19:47.641332+0000","last_peered":"2024-09-13T19:19:47.641332+0000","last_clean":"2024-09-13T19:19:47.641332+0000","last_became_active":"2024-09-13T19:15:57.886263+0000","last_became_peered":"2024-09-13T19:15:57.886263+0000","last_unstale":"2024-09-13T19:19:47.641332+0000","last_undegraded":"2024-09-13T19:19:47.641332+0000","last_fullsized":"2024-09-13T19:19:47.641332+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-13T19:19:47.641228+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-13T19:19:47.641228+0000","last_clean_scrub_stamp":"2024-09-13T19:19:47.641228+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:30.867550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:28.944236+0000","last_change":"2024-09-13T19:15:55.894466+0000","last_active":"2024-09-13T19:18:28.944236+0000","last_peered":"2024-09-13T19:18:28.944236+0000","last_clean":"2024-09-13T19:18:28.944236+0000","last_became_active":"2024-09-13T19:15:55.893629+0000","last_became_peered":"2024-09-13T19:15:55.893629+0000","last_unstale":"2024-09-13T19:18:28.944236+0000","last_undegraded":"2024-09-13T19:18:28.944236+0000","last_fullsized":"2024-09-13T19:18:28.944236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:32.783520+0000","last_change":"2024-09-13T19:19:32.783543+0000","last_active":"2024-09-13T19:19:32.783520+0000","last_peered":"2024-09-13T19:19:32.783520+0000","last_clean":"2024-09-13T19:19:32.783520+0000","last_became_active":"2024-09-13T19:15:59.892445+0000","last_became_peered":"2024-09-13T19:15:59.892445+0000","last_unstale":"2024-09-13T19:19:32.783520+0000","last_undegraded":"2024-09-13T19:19:32.783520+0000","last_fullsized":"2024-09-13T19:19:32.783520+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:32.783411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:32.783411+0000","last_clean_scrub_stamp":"2024-09-13T19:19:32.783411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:00:48.438787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"36'16","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:45.872566+0000","last_change":"2024-09-13T19:19:45.872607+0000","last_active":"2024-09-13T19:19:45.872566+0000","last_peered":"2024-09-13T19:19:45.872566+0000","last_clean":"2024-09-13T19:19:45.872566+0000","last_became_active":"2024-09-13T19:16:01.905553+0000","last_became_peered":"2024-09-13T19:16:01.905553+0000","last_unstale":"2024-09-13T19:19:45.872566+0000","last_undegraded":"2024-09-13T19:19:45.872566+0000","last_fullsized":"2024-09-13T19:19:45.872566+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-13T19:19:45.872465+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-13T19:19:45.872465+0000","last_clean_scrub_stamp":"2024-09-13T19:19:45.872465+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:31:04.671736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"36'285","reported_seq":378,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:19.719742+0000","last_change":"2024-09-13T19:19:19.719772+0000","last_active":"2024-09-13T19:19:19.719742+0000","last_peered":"2024-09-13T19:19:19.719742+0000","last_clean":"2024-09-13T19:19:19.719742+0000","last_became_active":"2024-09-13T19:16:03.913170+0000","last_became_peered":"2024-09-13T19:16:03.913170+0000","last_unstale":"2024-09-13T19:19:19.719742+0000","last_undegraded":"2024-09-13T19:19:19.719742+0000","last_fullsized":"2024-09-13T19:19:19.719742+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-13T19:19:19.719650+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-13T19:19:19.719650+0000","last_clean_scrub_stamp":"2024-09-13T19:19:19.719650+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:13:51.353091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"36'4","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.933358+0000","last_change":"2024-09-13T19:16:05.920004+0000","last_active":"2024-09-13T19:19:05.933358+0000","last_peered":"2024-09-13T19:19:05.933358+0000","last_clean":"2024-09-13T19:19:05.933358+0000","last_became_active":"2024-09-13T19:16:05.918050+0000","last_became_peered":"2024-09-13T19:16:05.918050+0000","last_unstale":"2024-09-13T19:19:05.933358+0000","last_undegraded":"2024-09-13T19:19:05.933358+0000","last_fullsized":"2024-09-13T19:19:05.933358+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"36'10","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:43.832951+0000","last_change":"2024-09-13T19:19:43.832987+0000","last_active":"2024-09-13T19:19:43.832951+0000","last_peered":"2024-09-13T19:19:43.832951+0000","last_clean":"2024-09-13T19:19:43.832951+0000","last_became_active":"2024-09-13T19:15:57.885711+0000","last_became_peered":"2024-09-13T19:15:57.885711+0000","last_unstale":"2024-09-13T19:19:43.832951+0000","last_undegraded":"2024-09-13T19:19:43.832951+0000","last_fullsized":"2024-09-13T19:19:43.832951+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-13T19:19:43.832854+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-13T19:19:43.832854+0000","last_clean_scrub_stamp":"2024-09-13T19:19:43.832854+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:23.636694+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.830312+0000","last_change":"2024-09-13T19:15:55.891066+0000","last_active":"2024-09-13T19:19:05.830312+0000","last_peered":"2024-09-13T19:19:05.830312+0000","last_clean":"2024-09-13T19:19:05.830312+0000","last_became_active":"2024-09-13T19:15:55.890670+0000","last_became_peered":"2024-09-13T19:15:55.890670+0000","last_unstale":"2024-09-13T19:19:05.830312+0000","last_undegraded":"2024-09-13T19:19:05.830312+0000","last_fullsized":"2024-09-13T19:19:05.830312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:29.803492+0000","last_change":"2024-09-13T19:19:29.803524+0000","last_active":"2024-09-13T19:19:29.803492+0000","last_peered":"2024-09-13T19:19:29.803492+0000","last_clean":"2024-09-13T19:19:29.803492+0000","last_became_active":"2024-09-13T19:15:59.893905+0000","last_became_peered":"2024-09-13T19:15:59.893905+0000","last_unstale":"2024-09-13T19:19:29.803492+0000","last_undegraded":"2024-09-13T19:19:29.803492+0000","last_fullsized":"2024-09-13T19:19:29.803492+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:29.803399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:29.803399+0000","last_clean_scrub_stamp":"2024-09-13T19:19:29.803399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:13.674139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"36'46","reported_seq":104,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:18.724087+0000","last_change":"2024-09-13T19:19:18.724144+0000","last_active":"2024-09-13T19:19:18.724087+0000","last_peered":"2024-09-13T19:19:18.724087+0000","last_clean":"2024-09-13T19:19:18.724087+0000","last_became_active":"2024-09-13T19:16:01.903395+0000","last_became_peered":"2024-09-13T19:16:01.903395+0000","last_unstale":"2024-09-13T19:19:18.724087+0000","last_undegraded":"2024-09-13T19:19:18.724087+0000","last_fullsized":"2024-09-13T19:19:18.724087+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'46","last_scrub_stamp":"2024-09-13T19:19:18.723995+0000","last_deep_scrub":"36'46","last_deep_scrub_stamp":"2024-09-13T19:19:18.723995+0000","last_clean_scrub_stamp":"2024-09-13T19:19:18.723995+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:23.717143+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:18.382095+0000","last_change":"2024-09-13T19:19:18.382122+0000","last_active":"2024-09-13T19:19:18.382095+0000","last_peered":"2024-09-13T19:19:18.382095+0000","last_clean":"2024-09-13T19:19:18.382095+0000","last_became_active":"2024-09-13T19:16:03.910550+0000","last_became_peered":"2024-09-13T19:16:03.910550+0000","last_unstale":"2024-09-13T19:19:18.382095+0000","last_undegraded":"2024-09-13T19:19:18.382095+0000","last_fullsized":"2024-09-13T19:19:18.382095+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:18.381995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:18.381995+0000","last_clean_scrub_stamp":"2024-09-13T19:19:18.381995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:49.252007+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"36'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.212023+0000","last_change":"2024-09-13T19:16:05.913865+0000","last_active":"2024-09-13T19:19:06.212023+0000","last_peered":"2024-09-13T19:19:06.212023+0000","last_clean":"2024-09-13T19:19:06.212023+0000","last_became_active":"2024-09-13T19:16:05.913598+0000","last_became_peered":"2024-09-13T19:16:05.913598+0000","last_unstale":"2024-09-13T19:19:06.212023+0000","last_undegraded":"2024-09-13T19:19:06.212023+0000","last_fullsized":"2024-09-13T19:19:06.212023+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:42.851372+0000","last_change":"2024-09-13T19:19:42.851396+0000","last_active":"2024-09-13T19:19:42.851372+0000","last_peered":"2024-09-13T19:19:42.851372+0000","last_clean":"2024-09-13T19:19:42.851372+0000","last_became_active":"2024-09-13T19:15:57.883463+0000","last_became_peered":"2024-09-13T19:15:57.883463+0000","last_unstale":"2024-09-13T19:19:42.851372+0000","last_undegraded":"2024-09-13T19:19:42.851372+0000","last_fullsized":"2024-09-13T19:19:42.851372+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:19:42.851247+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:19:42.851247+0000","last_clean_scrub_stamp":"2024-09-13T19:19:42.851247+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:47.003451+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:28.944303+0000","last_change":"2024-09-13T19:15:55.900188+0000","last_active":"2024-09-13T19:18:28.944303+0000","last_peered":"2024-09-13T19:18:28.944303+0000","last_clean":"2024-09-13T19:18:28.944303+0000","last_became_active":"2024-09-13T19:15:55.899847+0000","last_became_peered":"2024-09-13T19:15:55.899847+0000","last_unstale":"2024-09-13T19:18:28.944303+0000","last_undegraded":"2024-09-13T19:18:28.944303+0000","last_fullsized":"2024-09-13T19:18:28.944303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:33.839962+0000","last_change":"2024-09-13T19:19:33.840008+0000","last_active":"2024-09-13T19:19:33.839962+0000","last_peered":"2024-09-13T19:19:33.839962+0000","last_clean":"2024-09-13T19:19:33.839962+0000","last_became_active":"2024-09-13T19:15:59.895512+0000","last_became_peered":"2024-09-13T19:15:59.895512+0000","last_unstale":"2024-09-13T19:19:33.839962+0000","last_undegraded":"2024-09-13T19:19:33.839962+0000","last_fullsized":"2024-09-13T19:19:33.839962+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:33.839854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:33.839854+0000","last_clean_scrub_stamp":"2024-09-13T19:19:33.839854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:49.315701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"36'36","reported_seq":91,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:26.305275+0000","last_change":"2024-09-13T19:19:26.305329+0000","last_active":"2024-09-13T19:19:26.305275+0000","last_peered":"2024-09-13T19:19:26.305275+0000","last_clean":"2024-09-13T19:19:26.305275+0000","last_became_active":"2024-09-13T19:16:01.902285+0000","last_became_peered":"2024-09-13T19:16:01.902285+0000","last_unstale":"2024-09-13T19:19:26.305275+0000","last_undegraded":"2024-09-13T19:19:26.305275+0000","last_fullsized":"2024-09-13T19:19:26.305275+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-13T19:19:26.305171+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-13T19:19:26.305171+0000","last_clean_scrub_stamp":"2024-09-13T19:19:26.305171+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:15:14.766698+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:40.004211+0000","last_change":"2024-09-13T19:19:40.004237+0000","last_active":"2024-09-13T19:19:40.004211+0000","last_peered":"2024-09-13T19:19:40.004211+0000","last_clean":"2024-09-13T19:19:40.004211+0000","last_became_active":"2024-09-13T19:16:03.911587+0000","last_became_peered":"2024-09-13T19:16:03.911587+0000","last_unstale":"2024-09-13T19:19:40.004211+0000","last_undegraded":"2024-09-13T19:19:40.004211+0000","last_fullsized":"2024-09-13T19:19:40.004211+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:40.004104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:40.004104+0000","last_clean_scrub_stamp":"2024-09-13T19:19:40.004104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:57.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:33.945014+0000","last_change":"2024-09-13T19:16:05.923352+0000","last_active":"2024-09-13T19:18:33.945014+0000","last_peered":"2024-09-13T19:18:33.945014+0000","last_clean":"2024-09-13T19:18:33.945014+0000","last_became_active":"2024-09-13T19:16:05.923014+0000","last_became_peered":"2024-09-13T19:16:05.923014+0000","last_unstale":"2024-09-13T19:18:33.945014+0000","last_undegraded":"2024-09-13T19:18:33.945014+0000","last_fullsized":"2024-09-13T19:18:33.945014+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:23.943443+0000","last_change":"2024-09-13T19:15:57.896578+0000","last_active":"2024-09-13T19:18:23.943443+0000","last_peered":"2024-09-13T19:18:23.943443+0000","last_clean":"2024-09-13T19:18:23.943443+0000","last_became_active":"2024-09-13T19:15:57.896310+0000","last_became_peered":"2024-09-13T19:15:57.896310+0000","last_unstale":"2024-09-13T19:18:23.943443+0000","last_undegraded":"2024-09-13T19:18:23.943443+0000","last_fullsized":"2024-09-13T19:18:23.943443+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:15.658593+0000","last_change":"2024-09-13T19:15:55.895484+0000","last_active":"2024-09-13T19:19:15.658593+0000","last_peered":"2024-09-13T19:19:15.658593+0000","last_clean":"2024-09-13T19:19:15.658593+0000","last_became_active":"2024-09-13T19:15:55.893600+0000","last_became_peered":"2024-09-13T19:15:55.893600+0000","last_unstale":"2024-09-13T19:19:15.658593+0000","last_undegraded":"2024-09-13T19:19:15.658593+0000","last_fullsized":"2024-09-13T19:19:15.658593+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:26.733975+0000","last_change":"2024-09-13T19:19:26.734018+0000","last_active":"2024-09-13T19:19:26.733975+0000","last_peered":"2024-09-13T19:19:26.733975+0000","last_clean":"2024-09-13T19:19:26.733975+0000","last_became_active":"2024-09-13T19:15:59.896518+0000","last_became_peered":"2024-09-13T19:15:59.896518+0000","last_unstale":"2024-09-13T19:19:26.733975+0000","last_undegraded":"2024-09-13T19:19:26.733975+0000","last_fullsized":"2024-09-13T19:19:26.733975+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:26.733839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:26.733839+0000","last_clean_scrub_stamp":"2024-09-13T19:19:26.733839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:27.626320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"36'30","reported_seq":83,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:23.073612+0000","last_change":"2024-09-13T19:19:23.073664+0000","last_active":"2024-09-13T19:19:23.073612+0000","last_peered":"2024-09-13T19:19:23.073612+0000","last_clean":"2024-09-13T19:19:23.073612+0000","last_became_active":"2024-09-13T19:16:01.902699+0000","last_became_peered":"2024-09-13T19:16:01.902699+0000","last_unstale":"2024-09-13T19:19:23.073612+0000","last_undegraded":"2024-09-13T19:19:23.073612+0000","last_fullsized":"2024-09-13T19:19:23.073612+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'30","last_scrub_stamp":"2024-09-13T19:19:23.073511+0000","last_deep_scrub":"36'30","last_deep_scrub_stamp":"2024-09-13T19:19:23.073511+0000","last_clean_scrub_stamp":"2024-09-13T19:19:23.073511+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:54:35.654271+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:37.027586+0000","last_change":"2024-09-13T19:19:37.027611+0000","last_active":"2024-09-13T19:19:37.027586+0000","last_peered":"2024-09-13T19:19:37.027586+0000","last_clean":"2024-09-13T19:19:37.027586+0000","last_became_active":"2024-09-13T19:16:03.913228+0000","last_became_peered":"2024-09-13T19:16:03.913228+0000","last_unstale":"2024-09-13T19:19:37.027586+0000","last_undegraded":"2024-09-13T19:19:37.027586+0000","last_fullsized":"2024-09-13T19:19:37.027586+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:37.027487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:37.027487+0000","last_clean_scrub_stamp":"2024-09-13T19:19:37.027487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:39:06.797236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"36'4","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:33.944981+0000","last_change":"2024-09-13T19:16:05.925781+0000","last_active":"2024-09-13T19:18:33.944981+0000","last_peered":"2024-09-13T19:18:33.944981+0000","last_clean":"2024-09-13T19:18:33.944981+0000","last_became_active":"2024-09-13T19:16:05.925519+0000","last_became_peered":"2024-09-13T19:16:05.925519+0000","last_unstale":"2024-09-13T19:18:33.944981+0000","last_undegraded":"2024-09-13T19:18:33.944981+0000","last_fullsized":"2024-09-13T19:18:33.944981+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"36'6","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:45.816308+0000","last_change":"2024-09-13T19:19:45.816379+0000","last_active":"2024-09-13T19:19:45.816308+0000","last_peered":"2024-09-13T19:19:45.816308+0000","last_clean":"2024-09-13T19:19:45.816308+0000","last_became_active":"2024-09-13T19:15:57.885993+0000","last_became_peered":"2024-09-13T19:15:57.885993+0000","last_unstale":"2024-09-13T19:19:45.816308+0000","last_undegraded":"2024-09-13T19:19:45.816308+0000","last_fullsized":"2024-09-13T19:19:45.816308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:19:45.816207+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:19:45.816207+0000","last_clean_scrub_stamp":"2024-09-13T19:19:45.816207+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:58:05.931904+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.939799+0000","last_change":"2024-09-13T19:15:55.895882+0000","last_active":"2024-09-13T19:18:03.939799+0000","last_peered":"2024-09-13T19:18:03.939799+0000","last_clean":"2024-09-13T19:18:03.939799+0000","last_became_active":"2024-09-13T19:15:55.895040+0000","last_became_peered":"2024-09-13T19:15:55.895040+0000","last_unstale":"2024-09-13T19:18:03.939799+0000","last_undegraded":"2024-09-13T19:18:03.939799+0000","last_fullsized":"2024-09-13T19:18:03.939799+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"36'3","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:24.660289+0000","last_change":"2024-09-13T19:19:24.660340+0000","last_active":"2024-09-13T19:19:24.660289+0000","last_peered":"2024-09-13T19:19:24.660289+0000","last_clean":"2024-09-13T19:19:24.660289+0000","last_became_active":"2024-09-13T19:15:59.897609+0000","last_became_peered":"2024-09-13T19:15:59.897609+0000","last_unstale":"2024-09-13T19:19:24.660289+0000","last_undegraded":"2024-09-13T19:19:24.660289+0000","last_fullsized":"2024-09-13T19:19:24.660289+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-13T19:19:24.660188+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-13T19:19:24.660188+0000","last_clean_scrub_stamp":"2024-09-13T19:19:24.660188+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:56.245062+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"36'40","reported_seq":97,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:21.050539+0000","last_change":"2024-09-13T19:19:21.050618+0000","last_active":"2024-09-13T19:19:21.050539+0000","last_peered":"2024-09-13T19:19:21.050539+0000","last_clean":"2024-09-13T19:19:21.050539+0000","last_became_active":"2024-09-13T19:16:01.902042+0000","last_became_peered":"2024-09-13T19:16:01.902042+0000","last_unstale":"2024-09-13T19:19:21.050539+0000","last_undegraded":"2024-09-13T19:19:21.050539+0000","last_fullsized":"2024-09-13T19:19:21.050539+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'40","last_scrub_stamp":"2024-09-13T19:19:21.050438+0000","last_deep_scrub":"36'40","last_deep_scrub_stamp":"2024-09-13T19:19:21.050438+0000","last_clean_scrub_stamp":"2024-09-13T19:19:21.050438+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:19.019166+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:16.346297+0000","last_change":"2024-09-13T19:19:16.346321+0000","last_active":"2024-09-13T19:19:16.346297+0000","last_peered":"2024-09-13T19:19:16.346297+0000","last_clean":"2024-09-13T19:19:16.346297+0000","last_became_active":"2024-09-13T19:16:03.911052+0000","last_became_peered":"2024-09-13T19:16:03.911052+0000","last_unstale":"2024-09-13T19:19:16.346297+0000","last_undegraded":"2024-09-13T19:19:16.346297+0000","last_fullsized":"2024-09-13T19:19:16.346297+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:16.346224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:16.346224+0000","last_clean_scrub_stamp":"2024-09-13T19:19:16.346224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:31.215677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"36'2","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:28.944271+0000","last_change":"2024-09-13T19:16:05.924212+0000","last_active":"2024-09-13T19:18:28.944271+0000","last_peered":"2024-09-13T19:18:28.944271+0000","last_clean":"2024-09-13T19:18:28.944271+0000","last_became_active":"2024-09-13T19:16:05.922822+0000","last_became_peered":"2024-09-13T19:16:05.922822+0000","last_unstale":"2024-09-13T19:18:28.944271+0000","last_undegraded":"2024-09-13T19:18:28.944271+0000","last_fullsized":"2024-09-13T19:18:28.944271+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:36.838386+0000","last_change":"2024-09-13T19:19:36.838417+0000","last_active":"2024-09-13T19:19:36.838386+0000","last_peered":"2024-09-13T19:19:36.838386+0000","last_clean":"2024-09-13T19:19:36.838386+0000","last_became_active":"2024-09-13T19:15:57.902883+0000","last_became_peered":"2024-09-13T19:15:57.902883+0000","last_unstale":"2024-09-13T19:19:36.838386+0000","last_undegraded":"2024-09-13T19:19:36.838386+0000","last_fullsized":"2024-09-13T19:19:36.838386+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:36.838299+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:36.838299+0000","last_clean_scrub_stamp":"2024-09-13T19:19:36.838299+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:44:59.482570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:46.836757+0000","last_change":"2024-09-13T19:19:46.836795+0000","last_active":"2024-09-13T19:19:46.836757+0000","last_peered":"2024-09-13T19:19:46.836757+0000","last_clean":"2024-09-13T19:19:46.836757+0000","last_became_active":"2024-09-13T19:15:55.898653+0000","last_became_peered":"2024-09-13T19:15:55.898653+0000","last_unstale":"2024-09-13T19:19:46.836757+0000","last_undegraded":"2024-09-13T19:19:46.836757+0000","last_fullsized":"2024-09-13T19:19:46.836757+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:46.836659+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:46.836659+0000","last_clean_scrub_stamp":"2024-09-13T19:19:46.836659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:47:36.269620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"36'8","reported_seq":68,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:49.674709+0000","last_change":"2024-09-13T19:19:49.674734+0000","last_active":"2024-09-13T19:19:49.674709+0000","last_peered":"2024-09-13T19:19:49.674709+0000","last_clean":"2024-09-13T19:19:49.674709+0000","last_became_active":"2024-09-13T19:15:57.886330+0000","last_became_peered":"2024-09-13T19:15:57.886330+0000","last_unstale":"2024-09-13T19:19:49.674709+0000","last_undegraded":"2024-09-13T19:19:49.674709+0000","last_fullsized":"2024-09-13T19:19:49.674709+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-13T19:19:49.674619+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-13T19:19:49.674619+0000","last_clean_scrub_stamp":"2024-09-13T19:19:49.674619+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:12:49.826958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:04.954305+0000","last_change":"2024-09-13T19:15:55.891290+0000","last_active":"2024-09-13T19:18:04.954305+0000","last_peered":"2024-09-13T19:18:04.954305+0000","last_clean":"2024-09-13T19:18:04.954305+0000","last_became_active":"2024-09-13T19:15:55.890821+0000","last_became_peered":"2024-09-13T19:15:55.890821+0000","last_unstale":"2024-09-13T19:18:04.954305+0000","last_undegraded":"2024-09-13T19:18:04.954305+0000","last_fullsized":"2024-09-13T19:18:04.954305+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:36.019599+0000","last_change":"2024-09-13T19:19:36.019627+0000","last_active":"2024-09-13T19:19:36.019599+0000","last_peered":"2024-09-13T19:19:36.019599+0000","last_clean":"2024-09-13T19:19:36.019599+0000","last_became_active":"2024-09-13T19:15:57.898295+0000","last_became_peered":"2024-09-13T19:15:57.898295+0000","last_unstale":"2024-09-13T19:19:36.019599+0000","last_undegraded":"2024-09-13T19:19:36.019599+0000","last_fullsized":"2024-09-13T19:19:36.019599+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:36.019516+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:36.019516+0000","last_clean_scrub_stamp":"2024-09-13T19:19:36.019516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:53:21.194483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:03.940216+0000","last_change":"2024-09-13T19:15:55.893929+0000","last_active":"2024-09-13T19:18:03.940216+0000","last_peered":"2024-09-13T19:18:03.940216+0000","last_clean":"2024-09-13T19:18:03.940216+0000","last_became_active":"2024-09-13T19:15:55.893191+0000","last_became_peered":"2024-09-13T19:15:55.893191+0000","last_unstale":"2024-09-13T19:18:03.940216+0000","last_undegraded":"2024-09-13T19:18:03.940216+0000","last_fullsized":"2024-09-13T19:18:03.940216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"36'6","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:53.687726+0000","last_change":"2024-09-13T19:19:53.687759+0000","last_active":"2024-09-13T19:19:53.687726+0000","last_peered":"2024-09-13T19:19:53.687726+0000","last_clean":"2024-09-13T19:19:53.687726+0000","last_became_active":"2024-09-13T19:15:57.886670+0000","last_became_peered":"2024-09-13T19:15:57.886670+0000","last_unstale":"2024-09-13T19:19:53.687726+0000","last_undegraded":"2024-09-13T19:19:53.687726+0000","last_fullsized":"2024-09-13T19:19:53.687726+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:19:53.687608+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:19:53.687608+0000","last_clean_scrub_stamp":"2024-09-13T19:19:53.687608+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:17:16.127903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:01.934912+0000","last_change":"2024-09-13T19:15:55.894421+0000","last_active":"2024-09-13T19:18:01.934912+0000","last_peered":"2024-09-13T19:18:01.934912+0000","last_clean":"2024-09-13T19:18:01.934912+0000","last_became_active":"2024-09-13T19:15:55.893569+0000","last_became_peered":"2024-09-13T19:15:55.893569+0000","last_unstale":"2024-09-13T19:18:01.934912+0000","last_undegraded":"2024-09-13T19:18:01.934912+0000","last_fullsized":"2024-09-13T19:18:01.934912+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"36'6","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:43.530091+0000","last_change":"2024-09-13T19:19:43.530124+0000","last_active":"2024-09-13T19:19:43.530091+0000","last_peered":"2024-09-13T19:19:43.530091+0000","last_clean":"2024-09-13T19:19:43.530091+0000","last_became_active":"2024-09-13T19:15:57.896487+0000","last_became_peered":"2024-09-13T19:15:57.896487+0000","last_unstale":"2024-09-13T19:19:43.530091+0000","last_undegraded":"2024-09-13T19:19:43.530091+0000","last_fullsized":"2024-09-13T19:19:43.530091+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:19:43.529999+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:19:43.529999+0000","last_clean_scrub_stamp":"2024-09-13T19:19:43.529999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:03:46.729174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:06.935808+0000","last_change":"2024-09-13T19:15:55.892917+0000","last_active":"2024-09-13T19:18:06.935808+0000","last_peered":"2024-09-13T19:18:06.935808+0000","last_clean":"2024-09-13T19:18:06.935808+0000","last_became_active":"2024-09-13T19:15:55.892026+0000","last_became_peered":"2024-09-13T19:15:55.892026+0000","last_unstale":"2024-09-13T19:18:06.935808+0000","last_undegraded":"2024-09-13T19:18:06.935808+0000","last_fullsized":"2024-09-13T19:18:06.935808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"36'16","reported_seq":88,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:41.888097+0000","last_change":"2024-09-13T19:19:41.888155+0000","last_active":"2024-09-13T19:19:41.888097+0000","last_peered":"2024-09-13T19:19:41.888097+0000","last_clean":"2024-09-13T19:19:41.888097+0000","last_became_active":"2024-09-13T19:15:57.902841+0000","last_became_peered":"2024-09-13T19:15:57.902841+0000","last_unstale":"2024-09-13T19:19:41.888097+0000","last_undegraded":"2024-09-13T19:19:41.888097+0000","last_fullsized":"2024-09-13T19:19:41.888097+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-13T19:19:41.887974+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-13T19:19:41.887974+0000","last_clean_scrub_stamp":"2024-09-13T19:19:41.887974+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:50:07.467247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":56,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"36'2","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:53.061124+0000","last_change":"2024-09-13T19:19:53.061149+0000","last_active":"2024-09-13T19:19:53.061124+0000","last_peered":"2024-09-13T19:19:53.061124+0000","last_clean":"2024-09-13T19:19:53.061124+0000","last_became_active":"2024-09-13T19:15:55.896490+0000","last_became_peered":"2024-09-13T19:15:55.896490+0000","last_unstale":"2024-09-13T19:19:53.061124+0000","last_undegraded":"2024-09-13T19:19:53.061124+0000","last_fullsized":"2024-09-13T19:19:53.061124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:53.061037+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:53.061037+0000","last_clean_scrub_stamp":"2024-09-13T19:19:53.061037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:29.265310+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"36'6","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:55.659140+0000","last_change":"2024-09-13T19:19:55.659165+0000","last_active":"2024-09-13T19:19:55.659140+0000","last_peered":"2024-09-13T19:19:55.659140+0000","last_clean":"2024-09-13T19:19:55.659140+0000","last_became_active":"2024-09-13T19:15:57.887810+0000","last_became_peered":"2024-09-13T19:15:57.887810+0000","last_unstale":"2024-09-13T19:19:55.659140+0000","last_undegraded":"2024-09-13T19:19:55.659140+0000","last_fullsized":"2024-09-13T19:19:55.659140+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:19:55.659049+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:19:55.659049+0000","last_clean_scrub_stamp":"2024-09-13T19:19:55.659049+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:55.028329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:08.940389+0000","last_change":"2024-09-13T19:15:55.892243+0000","last_active":"2024-09-13T19:18:08.940389+0000","last_peered":"2024-09-13T19:18:08.940389+0000","last_clean":"2024-09-13T19:18:08.940389+0000","last_became_active":"2024-09-13T19:15:55.891422+0000","last_became_peered":"2024-09-13T19:15:55.891422+0000","last_unstale":"2024-09-13T19:18:08.940389+0000","last_undegraded":"2024-09-13T19:18:08.940389+0000","last_fullsized":"2024-09-13T19:18:08.940389+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"36'2","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.705339+0000","last_change":"2024-09-13T19:15:57.891037+0000","last_active":"2024-09-13T19:19:05.705339+0000","last_peered":"2024-09-13T19:19:05.705339+0000","last_clean":"2024-09-13T19:19:05.705339+0000","last_became_active":"2024-09-13T19:15:57.890491+0000","last_became_peered":"2024-09-13T19:15:57.890491+0000","last_unstale":"2024-09-13T19:19:05.705339+0000","last_undegraded":"2024-09-13T19:19:05.705339+0000","last_fullsized":"2024-09-13T19:19:05.705339+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.799217+0000","last_change":"2024-09-13T19:15:55.892364+0000","last_active":"2024-09-13T19:19:12.799217+0000","last_peered":"2024-09-13T19:19:12.799217+0000","last_clean":"2024-09-13T19:19:12.799217+0000","last_became_active":"2024-09-13T19:15:55.891860+0000","last_became_peered":"2024-09-13T19:15:55.891860+0000","last_unstale":"2024-09-13T19:19:12.799217+0000","last_undegraded":"2024-09-13T19:19:12.799217+0000","last_fullsized":"2024-09-13T19:19:12.799217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"36'6","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.849021+0000","last_change":"2024-09-13T19:15:57.892359+0000","last_active":"2024-09-13T19:19:05.849021+0000","last_peered":"2024-09-13T19:19:05.849021+0000","last_clean":"2024-09-13T19:19:05.849021+0000","last_became_active":"2024-09-13T19:15:57.892073+0000","last_became_peered":"2024-09-13T19:15:57.892073+0000","last_unstale":"2024-09-13T19:19:05.849021+0000","last_undegraded":"2024-09-13T19:19:05.849021+0000","last_fullsized":"2024-09-13T19:19:05.849021+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.796401+0000","last_change":"2024-09-13T19:15:55.897908+0000","last_active":"2024-09-13T19:19:12.796401+0000","last_peered":"2024-09-13T19:19:12.796401+0000","last_clean":"2024-09-13T19:19:12.796401+0000","last_became_active":"2024-09-13T19:15:55.895911+0000","last_became_peered":"2024-09-13T19:15:55.895911+0000","last_unstale":"2024-09-13T19:19:12.796401+0000","last_undegraded":"2024-09-13T19:19:12.796401+0000","last_fullsized":"2024-09-13T19:19:12.796401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"36'6","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:51.942682+0000","last_change":"2024-09-13T19:16:31.995370+0000","last_active":"2024-09-13T19:18:51.942682+0000","last_peered":"2024-09-13T19:18:51.942682+0000","last_clean":"2024-09-13T19:18:51.942682+0000","last_became_active":"2024-09-13T19:16:31.993403+0000","last_became_peered":"2024-09-13T19:16:31.993403+0000","last_unstale":"2024-09-13T19:18:51.942682+0000","last_undegraded":"2024-09-13T19:18:51.942682+0000","last_fullsized":"2024-09-13T19:18:51.942682+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:54.652654+0000","last_change":"2024-09-13T19:19:54.652681+0000","last_active":"2024-09-13T19:19:54.652654+0000","last_peered":"2024-09-13T19:19:54.652654+0000","last_clean":"2024-09-13T19:19:54.652654+0000","last_became_active":"2024-09-13T19:15:55.894607+0000","last_became_peered":"2024-09-13T19:15:55.894607+0000","last_unstale":"2024-09-13T19:19:54.652654+0000","last_undegraded":"2024-09-13T19:19:54.652654+0000","last_fullsized":"2024-09-13T19:19:54.652654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:54.652549+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:54.652549+0000","last_clean_scrub_stamp":"2024-09-13T19:19:54.652549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:13:55.710652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"36'2","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:42.516393+0000","last_change":"2024-09-13T19:19:42.516418+0000","last_active":"2024-09-13T19:19:42.516393+0000","last_peered":"2024-09-13T19:19:42.516393+0000","last_clean":"2024-09-13T19:19:42.516393+0000","last_became_active":"2024-09-13T19:15:57.900902+0000","last_became_peered":"2024-09-13T19:15:57.900902+0000","last_unstale":"2024-09-13T19:19:42.516393+0000","last_undegraded":"2024-09-13T19:19:42.516393+0000","last_fullsized":"2024-09-13T19:19:42.516393+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:42.516279+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:42.516279+0000","last_clean_scrub_stamp":"2024-09-13T19:19:42.516279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:17.797802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:51.003600+0000","last_change":"2024-09-13T19:19:51.003653+0000","last_active":"2024-09-13T19:19:51.003600+0000","last_peered":"2024-09-13T19:19:51.003600+0000","last_clean":"2024-09-13T19:19:51.003600+0000","last_became_active":"2024-09-13T19:15:55.905867+0000","last_became_peered":"2024-09-13T19:15:55.905867+0000","last_unstale":"2024-09-13T19:19:51.003600+0000","last_undegraded":"2024-09-13T19:19:51.003600+0000","last_fullsized":"2024-09-13T19:19:51.003600+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:51.003475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:51.003475+0000","last_clean_scrub_stamp":"2024-09-13T19:19:51.003475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:43.388075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:45.895122+0000","last_change":"2024-09-13T19:19:45.895163+0000","last_active":"2024-09-13T19:19:45.895122+0000","last_peered":"2024-09-13T19:19:45.895122+0000","last_clean":"2024-09-13T19:19:45.895122+0000","last_became_active":"2024-09-13T19:15:57.889606+0000","last_became_peered":"2024-09-13T19:15:57.889606+0000","last_unstale":"2024-09-13T19:19:45.895122+0000","last_undegraded":"2024-09-13T19:19:45.895122+0000","last_fullsized":"2024-09-13T19:19:45.895122+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:19:45.895012+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:19:45.895012+0000","last_clean_scrub_stamp":"2024-09-13T19:19:45.895012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:09.506224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:13.941268+0000","last_change":"2024-09-13T19:15:55.896394+0000","last_active":"2024-09-13T19:18:13.941268+0000","last_peered":"2024-09-13T19:18:13.941268+0000","last_clean":"2024-09-13T19:18:13.941268+0000","last_became_active":"2024-09-13T19:15:55.896086+0000","last_became_peered":"2024-09-13T19:15:55.896086+0000","last_unstale":"2024-09-13T19:18:13.941268+0000","last_undegraded":"2024-09-13T19:18:13.941268+0000","last_fullsized":"2024-09-13T19:18:13.941268+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"36'12","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.851430+0000","last_change":"2024-09-13T19:16:31.992315+0000","last_active":"2024-09-13T19:19:05.851430+0000","last_peered":"2024-09-13T19:19:05.851430+0000","last_clean":"2024-09-13T19:19:05.851430+0000","last_became_active":"2024-09-13T19:16:31.991965+0000","last_became_peered":"2024-09-13T19:16:31.991965+0000","last_unstale":"2024-09-13T19:19:05.851430+0000","last_undegraded":"2024-09-13T19:19:05.851430+0000","last_fullsized":"2024-09-13T19:19:05.851430+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:13.941892+0000","last_change":"2024-09-13T19:15:55.894925+0000","last_active":"2024-09-13T19:18:13.941892+0000","last_peered":"2024-09-13T19:18:13.941892+0000","last_clean":"2024-09-13T19:18:13.941892+0000","last_became_active":"2024-09-13T19:15:55.894634+0000","last_became_peered":"2024-09-13T19:15:55.894634+0000","last_unstale":"2024-09-13T19:18:13.941892+0000","last_undegraded":"2024-09-13T19:18:13.941892+0000","last_fullsized":"2024-09-13T19:18:13.941892+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:13.941251+0000","last_change":"2024-09-13T19:15:57.892811+0000","last_active":"2024-09-13T19:18:13.941251+0000","last_peered":"2024-09-13T19:18:13.941251+0000","last_clean":"2024-09-13T19:18:13.941251+0000","last_became_active":"2024-09-13T19:15:57.892558+0000","last_became_peered":"2024-09-13T19:15:57.892558+0000","last_unstale":"2024-09-13T19:18:13.941251+0000","last_undegraded":"2024-09-13T19:18:13.941251+0000","last_fullsized":"2024-09-13T19:18:13.941251+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:13.941936+0000","last_change":"2024-09-13T19:15:55.894980+0000","last_active":"2024-09-13T19:18:13.941936+0000","last_peered":"2024-09-13T19:18:13.941936+0000","last_clean":"2024-09-13T19:18:13.941936+0000","last_became_active":"2024-09-13T19:15:55.894667+0000","last_became_peered":"2024-09-13T19:15:55.894667+0000","last_unstale":"2024-09-13T19:18:13.941936+0000","last_undegraded":"2024-09-13T19:18:13.941936+0000","last_fullsized":"2024-09-13T19:18:13.941936+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"36'17","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:06.064729+0000","last_change":"2024-09-13T19:15:57.896510+0000","last_active":"2024-09-13T19:19:06.064729+0000","last_peered":"2024-09-13T19:19:06.064729+0000","last_clean":"2024-09-13T19:19:06.064729+0000","last_became_active":"2024-09-13T19:15:57.896200+0000","last_became_peered":"2024-09-13T19:15:57.896200+0000","last_unstale":"2024-09-13T19:19:06.064729+0000","last_undegraded":"2024-09-13T19:19:06.064729+0000","last_fullsized":"2024-09-13T19:19:06.064729+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":50,"num_read_kb":42,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:44.812057+0000","last_change":"2024-09-13T19:19:44.812086+0000","last_active":"2024-09-13T19:19:44.812057+0000","last_peered":"2024-09-13T19:19:44.812057+0000","last_clean":"2024-09-13T19:19:44.812057+0000","last_became_active":"2024-09-13T19:15:55.899104+0000","last_became_peered":"2024-09-13T19:15:55.899104+0000","last_unstale":"2024-09-13T19:19:44.812057+0000","last_undegraded":"2024-09-13T19:19:44.812057+0000","last_fullsized":"2024-09-13T19:19:44.812057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:44.811952+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:44.811952+0000","last_clean_scrub_stamp":"2024-09-13T19:19:44.811952+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:20.375216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"36'12","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:49.979971+0000","last_change":"2024-09-13T19:19:49.979997+0000","last_active":"2024-09-13T19:19:49.979971+0000","last_peered":"2024-09-13T19:19:49.979971+0000","last_clean":"2024-09-13T19:19:49.979971+0000","last_became_active":"2024-09-13T19:15:57.889781+0000","last_became_peered":"2024-09-13T19:15:57.889781+0000","last_unstale":"2024-09-13T19:19:49.979971+0000","last_undegraded":"2024-09-13T19:19:49.979971+0000","last_fullsized":"2024-09-13T19:19:49.979971+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-13T19:19:49.979869+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-13T19:19:49.979869+0000","last_clean_scrub_stamp":"2024-09-13T19:19:49.979869+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:02:58.441045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:18.942880+0000","last_change":"2024-09-13T19:15:55.898914+0000","last_active":"2024-09-13T19:18:18.942880+0000","last_peered":"2024-09-13T19:18:18.942880+0000","last_clean":"2024-09-13T19:18:18.942880+0000","last_became_active":"2024-09-13T19:15:55.898627+0000","last_became_peered":"2024-09-13T19:15:55.898627+0000","last_unstale":"2024-09-13T19:18:18.942880+0000","last_undegraded":"2024-09-13T19:18:18.942880+0000","last_fullsized":"2024-09-13T19:18:18.942880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:18.942614+0000","last_change":"2024-09-13T19:15:55.899524+0000","last_active":"2024-09-13T19:18:18.942614+0000","last_peered":"2024-09-13T19:18:18.942614+0000","last_clean":"2024-09-13T19:18:18.942614+0000","last_became_active":"2024-09-13T19:15:55.899225+0000","last_became_peered":"2024-09-13T19:15:55.899225+0000","last_unstale":"2024-09-13T19:18:18.942614+0000","last_undegraded":"2024-09-13T19:18:18.942614+0000","last_fullsized":"2024-09-13T19:18:18.942614+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"36'6","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.708700+0000","last_change":"2024-09-13T19:15:57.890646+0000","last_active":"2024-09-13T19:19:05.708700+0000","last_peered":"2024-09-13T19:19:05.708700+0000","last_clean":"2024-09-13T19:19:05.708700+0000","last_became_active":"2024-09-13T19:15:57.890325+0000","last_became_peered":"2024-09-13T19:15:57.890325+0000","last_unstale":"2024-09-13T19:19:05.708700+0000","last_undegraded":"2024-09-13T19:19:05.708700+0000","last_fullsized":"2024-09-13T19:19:05.708700+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:52.700739+0000","last_change":"2024-09-13T19:19:52.700775+0000","last_active":"2024-09-13T19:19:52.700739+0000","last_peered":"2024-09-13T19:19:52.700739+0000","last_clean":"2024-09-13T19:19:52.700739+0000","last_became_active":"2024-09-13T19:15:55.894485+0000","last_became_peered":"2024-09-13T19:15:55.894485+0000","last_unstale":"2024-09-13T19:19:52.700739+0000","last_undegraded":"2024-09-13T19:19:52.700739+0000","last_fullsized":"2024-09-13T19:19:52.700739+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:52.700644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:52.700644+0000","last_clean_scrub_stamp":"2024-09-13T19:19:52.700644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:49.700387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"36'8","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:42.871412+0000","last_change":"2024-09-13T19:19:42.871437+0000","last_active":"2024-09-13T19:19:42.871412+0000","last_peered":"2024-09-13T19:19:42.871412+0000","last_clean":"2024-09-13T19:19:42.871412+0000","last_became_active":"2024-09-13T19:15:57.902123+0000","last_became_peered":"2024-09-13T19:15:57.902123+0000","last_unstale":"2024-09-13T19:19:42.871412+0000","last_undegraded":"2024-09-13T19:19:42.871412+0000","last_fullsized":"2024-09-13T19:19:42.871412+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-13T19:19:42.871311+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-13T19:19:42.871311+0000","last_clean_scrub_stamp":"2024-09-13T19:19:42.871311+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:31.855620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1523,"ondisk_log_size":1523,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1595,"num_read_kb":1485,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":477,"ondisk_log_size":477,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640312,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39996,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331844,"statfs":{"total":96636764160,"available":96595808256,"internally_reserved":0,"allocated":503808,"data_stored":158624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640311,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40512,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331328,"statfs":{"total":96636764160,"available":96595279872,"internally_reserved":0,"allocated":1032192,"data_stored":746866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640311,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36368,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335472,"statfs":{"total":96636764160,"available":96599523328,"internally_reserved":0,"allocated":1048576,"data_stored":746030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705720,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31636,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340204,"statfs":{"total":96636764160,"available":96604368896,"internally_reserved":0,"allocated":462848,"data_stored":156440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T19:19:58.057 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.057 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.057 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.057 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.057 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.057 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.058 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.058 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.058 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.058 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.058 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.058 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.058 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.058 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.059 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.059 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.059 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.059 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.059 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.059 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.059 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.060 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.060 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.060 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.060 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.060 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.060 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.060 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.061 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.061 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.061 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.061 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.061 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-13T19:15:58.873497+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.061 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.061 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.061 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.062 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.062 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.062 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.062 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.062 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-13T19:15:39.557965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=39, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.062 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-13T19:15:43.565433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.062 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.063 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-13T19:15:43.565433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.063 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.063 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.063 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.063 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-13T19:15:43.565433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.063 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.063 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.064 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-13T19:15:43.565433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.064 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.064 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.064 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.064 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-13T19:15:43.565433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.064 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-13T19:15:58.873497+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.064 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.064 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-13T19:15:43.565433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.065 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.065 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.065 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.065 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-13T19:15:43.565433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.065 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.065 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.065 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-13T19:15:43.565433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.065 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-13T19:15:58.873497+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.066 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.066 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.066 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.066 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.066 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.066 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.066 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.066 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.067 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.067 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.067 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.067 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.067 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.067 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.067 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.068 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.068 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.068 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.068 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.068 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.068 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.068 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.069 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.069 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.069 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.069 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.069 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.069 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.069 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.070 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.070 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.070 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.070 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.070 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.070 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.070 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.070 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.071 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.071 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.071 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.071 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.071 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.071 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.071 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.071 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:19:58.071 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T19:20:18.072 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T19:20:18.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.185+0000 7f66b4637640 1 Processor -- start 2024-09-13T19:20:18.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.185+0000 7f66b4637640 1 -- start start 2024-09-13T19:20:18.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.185+0000 7f66b4637640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f66ac12f9d0 0x7f66ac131dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:20:18.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.185+0000 7f66b4637640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66ac071f70 con 0x7f66ac12cca0 2024-09-13T19:20:18.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.185+0000 7f66b4637640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f66ac06e350 con 0x7f66ac12f9d0 2024-09-13T19:20:18.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.186+0000 7f66b1bd2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f66ac12f9d0 0x7f66ac131dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:20:18.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.186+0000 7f66b23d3640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f66ac12cca0 0x7f66ac12d080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:38234/0 (socket says 172.21.15.53:38234) 2024-09-13T19:20:18.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.186+0000 7f66b23d3640 1 -- 172.21.15.53:0/3013731090 learned_addr learned my addr 172.21.15.53:0/3013731090 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T19:20:18.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.186+0000 7f66b1bd2640 1 -- 172.21.15.53:0/3013731090 >> v1:172.21.15.53:6789/0 conn(0x7f66ac12cca0 legacy=0x7f66ac12d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:20:18.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.186+0000 7f66b1bd2640 1 -- 172.21.15.53:0/3013731090 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66ac0715c0 con 0x7f66ac12f9d0 2024-09-13T19:20:18.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.187+0000 7f66b1bd2640 1 --2- 172.21.15.53:0/3013731090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66ac12f9d0 0x7f66ac131dc0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f669c009720 tx=0x7f669c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3436375ad639bb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:20:18.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.187+0000 7f66b13d1640 1 -- 172.21.15.53:0/3013731090 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f669c037070 con 0x7f66ac12f9d0 2024-09-13T19:20:18.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.187+0000 7f66b13d1640 1 -- 172.21.15.53:0/3013731090 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f669c02ad90 con 0x7f66ac12f9d0 2024-09-13T19:20:18.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.187+0000 7f66b13d1640 1 -- 172.21.15.53:0/3013731090 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f669c032590 con 0x7f66ac12f9d0 2024-09-13T19:20:18.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.187+0000 7f66b4637640 1 -- 172.21.15.53:0/3013731090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66ac12f9d0 msgr2=0x7f66ac131dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:20:18.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.187+0000 7f66b4637640 1 --2- 172.21.15.53:0/3013731090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66ac12f9d0 0x7f66ac131dc0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f669c009720 tx=0x7f669c02a110 comp rx=0 tx=0).stop 2024-09-13T19:20:18.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.187+0000 7f66b4637640 1 -- 172.21.15.53:0/3013731090 shutdown_connections 2024-09-13T19:20:18.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.187+0000 7f66b4637640 1 --2- 172.21.15.53:0/3013731090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66ac12f9d0 0x7f66ac131dc0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:20:18.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.187+0000 7f66b4637640 1 -- 172.21.15.53:0/3013731090 >> 172.21.15.53:0/3013731090 conn(0x7f66ac09a890 msgr2=0x7f66ac09aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:20:18.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.188+0000 7f66b4637640 1 -- 172.21.15.53:0/3013731090 shutdown_connections 2024-09-13T19:20:18.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.188+0000 7f66b4637640 1 -- 172.21.15.53:0/3013731090 wait complete. 2024-09-13T19:20:18.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.188+0000 7f66b4637640 1 Processor -- start 2024-09-13T19:20:18.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.188+0000 7f66b4637640 1 -- start start 2024-09-13T19:20:18.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.189+0000 7f66b4637640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66ac12cca0 0x7f66ac1258b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:20:18.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.189+0000 7f66b4637640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f66ac12ca50 con 0x7f66ac12cca0 2024-09-13T19:20:18.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.189+0000 7f66b23d3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66ac12cca0 0x7f66ac1258b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:20:18.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.189+0000 7f66b23d3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66ac12cca0 0x7f66ac1258b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35714/0 (socket says 172.21.15.53:35714) 2024-09-13T19:20:18.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.189+0000 7f66b23d3640 1 -- 172.21.15.53:0/2103248547 learned_addr learned my addr 172.21.15.53:0/2103248547 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:20:18.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.189+0000 7f66b23d3640 1 -- 172.21.15.53:0/2103248547 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66ac123af0 con 0x7f66ac12cca0 2024-09-13T19:20:18.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.189+0000 7f66b23d3640 1 --2- 172.21.15.53:0/2103248547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66ac12cca0 0x7f66ac1258b0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f66a800c480 tx=0x7f66a800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:20:18.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.189+0000 7f66a2ffd640 1 -- 172.21.15.53:0/2103248547 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66a8017070 con 0x7f66ac12cca0 2024-09-13T19:20:18.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.189+0000 7f66a2ffd640 1 -- 172.21.15.53:0/2103248547 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66a8005c10 con 0x7f66ac12cca0 2024-09-13T19:20:18.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.189+0000 7f66b4637640 1 -- 172.21.15.53:0/2103248547 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66ac126db0 con 0x7f66ac12cca0 2024-09-13T19:20:18.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.190+0000 7f66a2ffd640 1 -- 172.21.15.53:0/2103248547 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66a80070d0 con 0x7f66ac12cca0 2024-09-13T19:20:18.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.190+0000 7f66b4637640 1 -- 172.21.15.53:0/2103248547 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66ac125df0 con 0x7f66ac12cca0 2024-09-13T19:20:18.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.191+0000 7f66a2ffd640 1 -- 172.21.15.53:0/2103248547 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f66a801a070 con 0x7f66ac12cca0 2024-09-13T19:20:18.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.191+0000 7f66b4637640 1 -- 172.21.15.53:0/2103248547 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66ac073120 con 0x7f66ac12cca0 2024-09-13T19:20:18.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.191+0000 7f66a2ffd640 1 --2- 172.21.15.53:0/2103248547 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f66900382a0 0x7f669003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:20:18.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.191+0000 7f66a2ffd640 1 -- 172.21.15.53:0/2103248547 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f66a804af90 con 0x7f66ac12cca0 2024-09-13T19:20:18.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.191+0000 7f66b1bd2640 1 --2- 172.21.15.53:0/2103248547 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f66900382a0 0x7f669003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:20:18.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.192+0000 7f66b1bd2640 1 --2- 172.21.15.53:0/2103248547 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f66900382a0 0x7f669003a760 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f669c009720 tx=0x7f669c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:20:18.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.196+0000 7f66a2ffd640 1 -- 172.21.15.53:0/2103248547 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f66ac073120 con 0x7f66ac12cca0 2024-09-13T19:20:18.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.372+0000 7f66b4637640 1 -- 172.21.15.53:0/2103248547 --> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f66ac124af0 con 0x7f66900382a0 2024-09-13T19:20:18.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.387+0000 7f66a2ffd640 1 -- 172.21.15.53:0/2103248547 <== mgr.4098 v2:172.21.15.102:6824/4283826432 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+664960 (secure 0 0 0) 0x7f66ac124af0 con 0x7f66900382a0 2024-09-13T19:20:18.399 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:20:18.405 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T19:20:18.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.392+0000 7f66b4637640 1 -- 172.21.15.53:0/2103248547 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f66900382a0 msgr2=0x7f669003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:20:18.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.392+0000 7f66b4637640 1 --2- 172.21.15.53:0/2103248547 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f66900382a0 0x7f669003a760 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f669c009720 tx=0x7f669c02e000 comp rx=0 tx=0).stop 2024-09-13T19:20:18.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.392+0000 7f66b4637640 1 -- 172.21.15.53:0/2103248547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66ac12cca0 msgr2=0x7f66ac1258b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:20:18.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.392+0000 7f66b4637640 1 --2- 172.21.15.53:0/2103248547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66ac12cca0 0x7f66ac1258b0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f66a800c480 tx=0x7f66a800c940 comp rx=0 tx=0).stop 2024-09-13T19:20:18.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.392+0000 7f66b4637640 1 -- 172.21.15.53:0/2103248547 shutdown_connections 2024-09-13T19:20:18.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.392+0000 7f66b4637640 1 --2- 172.21.15.53:0/2103248547 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f66900382a0 0x7f669003a760 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:20:18.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.392+0000 7f66b4637640 1 --2- 172.21.15.53:0/2103248547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66ac12cca0 0x7f66ac1258b0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:20:18.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.392+0000 7f66b4637640 1 -- 172.21.15.53:0/2103248547 >> 172.21.15.53:0/2103248547 conn(0x7f66ac09a890 msgr2=0x7f66ac097ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:20:18.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.392+0000 7f66b4637640 1 -- 172.21.15.53:0/2103248547 shutdown_connections 2024-09-13T19:20:18.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:18.392+0000 7f66b4637640 1 -- 172.21.15.53:0/2103248547 wait complete. 2024-09-13T19:20:18.408 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":173,"stamp":"2024-09-13T19:20:16.990299+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5083,"num_read_kb":4664,"num_write":2179,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4785,"ondisk_log_size":4785,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152672,"kb_used_data":2976,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334688,"statfs":{"total":386547056640,"available":386390720512,"internally_reserved":0,"allocated":3047424,"data_stored":1807960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":153216791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004083"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:50.738469+0000","last_change":"2024-09-13T19:19:50.738469+0000","last_active":"2024-09-13T19:19:50.738469+0000","last_peered":"2024-09-13T19:19:50.738469+0000","last_clean":"2024-09-13T19:19:50.738469+0000","last_became_active":"2024-09-13T19:15:55.897392+0000","last_became_peered":"2024-09-13T19:15:55.897392+0000","last_unstale":"2024-09-13T19:19:50.738469+0000","last_undegraded":"2024-09-13T19:19:50.738469+0000","last_fullsized":"2024-09-13T19:19:50.738469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:50.738354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:50.738354+0000","last_clean_scrub_stamp":"2024-09-13T19:19:50.738354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:08.713727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"36'8","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:46.925658+0000","last_change":"2024-09-13T19:19:46.925684+0000","last_active":"2024-09-13T19:19:46.925658+0000","last_peered":"2024-09-13T19:19:46.925658+0000","last_clean":"2024-09-13T19:19:46.925658+0000","last_became_active":"2024-09-13T19:15:57.888352+0000","last_became_peered":"2024-09-13T19:15:57.888352+0000","last_unstale":"2024-09-13T19:19:46.925658+0000","last_undegraded":"2024-09-13T19:19:46.925658+0000","last_fullsized":"2024-09-13T19:19:46.925658+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-13T19:19:46.925571+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-13T19:19:46.925571+0000","last_clean_scrub_stamp":"2024-09-13T19:19:46.925571+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:13.870292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"34'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:50.673945+0000","last_change":"2024-09-13T19:19:50.673945+0000","last_active":"2024-09-13T19:19:50.673945+0000","last_peered":"2024-09-13T19:19:50.673945+0000","last_clean":"2024-09-13T19:19:50.673945+0000","last_became_active":"2024-09-13T19:15:55.894768+0000","last_became_peered":"2024-09-13T19:15:55.894768+0000","last_unstale":"2024-09-13T19:19:50.673945+0000","last_undegraded":"2024-09-13T19:19:50.673945+0000","last_fullsized":"2024-09-13T19:19:50.673945+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:19:50.673808+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:19:50.673808+0000","last_clean_scrub_stamp":"2024-09-13T19:19:50.673808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:40.076259+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"36'8","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:59.943290+0000","last_change":"2024-09-13T19:19:59.943321+0000","last_active":"2024-09-13T19:19:59.943290+0000","last_peered":"2024-09-13T19:19:59.943290+0000","last_clean":"2024-09-13T19:19:59.943290+0000","last_became_active":"2024-09-13T19:15:57.895424+0000","last_became_peered":"2024-09-13T19:15:57.895424+0000","last_unstale":"2024-09-13T19:19:59.943290+0000","last_undegraded":"2024-09-13T19:19:59.943290+0000","last_fullsized":"2024-09-13T19:19:59.943290+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-13T19:19:59.943201+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-13T19:19:59.943201+0000","last_clean_scrub_stamp":"2024-09-13T19:19:59.943201+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:27:16.681252+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:16.976533+0000","last_change":"2024-09-13T19:15:55.900265+0000","last_active":"2024-09-13T19:19:16.976533+0000","last_peered":"2024-09-13T19:19:16.976533+0000","last_clean":"2024-09-13T19:19:16.976533+0000","last_became_active":"2024-09-13T19:15:55.899965+0000","last_became_peered":"2024-09-13T19:15:55.899965+0000","last_unstale":"2024-09-13T19:19:16.976533+0000","last_undegraded":"2024-09-13T19:19:16.976533+0000","last_fullsized":"2024-09-13T19:19:16.976533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"36'14","reported_seq":80,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:00.925969+0000","last_change":"2024-09-13T19:20:00.926015+0000","last_active":"2024-09-13T19:20:00.925969+0000","last_peered":"2024-09-13T19:20:00.925969+0000","last_clean":"2024-09-13T19:20:00.925969+0000","last_became_active":"2024-09-13T19:15:57.894955+0000","last_became_peered":"2024-09-13T19:15:57.894955+0000","last_unstale":"2024-09-13T19:20:00.925969+0000","last_undegraded":"2024-09-13T19:20:00.925969+0000","last_fullsized":"2024-09-13T19:20:00.925969+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'14","last_scrub_stamp":"2024-09-13T19:20:00.925871+0000","last_deep_scrub":"36'14","last_deep_scrub_stamp":"2024-09-13T19:20:00.925871+0000","last_clean_scrub_stamp":"2024-09-13T19:20:00.925871+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:33.369865+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:00.514729+0000","last_change":"2024-09-13T19:20:00.514752+0000","last_active":"2024-09-13T19:20:00.514729+0000","last_peered":"2024-09-13T19:20:00.514729+0000","last_clean":"2024-09-13T19:20:00.514729+0000","last_became_active":"2024-09-13T19:15:55.889830+0000","last_became_peered":"2024-09-13T19:15:55.889830+0000","last_unstale":"2024-09-13T19:20:00.514729+0000","last_undegraded":"2024-09-13T19:20:00.514729+0000","last_fullsized":"2024-09-13T19:20:00.514729+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:00.514637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:00.514637+0000","last_clean_scrub_stamp":"2024-09-13T19:20:00.514637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:37.261883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"36'4","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:01.969039+0000","last_change":"2024-09-13T19:20:01.969069+0000","last_active":"2024-09-13T19:20:01.969039+0000","last_peered":"2024-09-13T19:20:01.969039+0000","last_clean":"2024-09-13T19:20:01.969039+0000","last_became_active":"2024-09-13T19:15:57.894733+0000","last_became_peered":"2024-09-13T19:15:57.894733+0000","last_unstale":"2024-09-13T19:20:01.969039+0000","last_undegraded":"2024-09-13T19:20:01.969039+0000","last_fullsized":"2024-09-13T19:20:01.969039+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:20:01.968947+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:20:01.968947+0000","last_clean_scrub_stamp":"2024-09-13T19:20:01.968947+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:59.545881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"36'4","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:11.960619+0000","last_change":"2024-09-13T19:20:11.960650+0000","last_active":"2024-09-13T19:20:11.960619+0000","last_peered":"2024-09-13T19:20:11.960619+0000","last_clean":"2024-09-13T19:20:11.960619+0000","last_became_active":"2024-09-13T19:15:55.895362+0000","last_became_peered":"2024-09-13T19:15:55.895362+0000","last_unstale":"2024-09-13T19:20:11.960619+0000","last_undegraded":"2024-09-13T19:20:11.960619+0000","last_fullsized":"2024-09-13T19:20:11.960619+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:20:11.960527+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:20:11.960527+0000","last_clean_scrub_stamp":"2024-09-13T19:20:11.960527+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:58.156294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"36'8","reported_seq":69,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:47.935056+0000","last_change":"2024-09-13T19:19:47.935056+0000","last_active":"2024-09-13T19:19:47.935056+0000","last_peered":"2024-09-13T19:19:47.935056+0000","last_clean":"2024-09-13T19:19:47.935056+0000","last_became_active":"2024-09-13T19:15:57.889664+0000","last_became_peered":"2024-09-13T19:15:57.889664+0000","last_unstale":"2024-09-13T19:19:47.935056+0000","last_undegraded":"2024-09-13T19:19:47.935056+0000","last_fullsized":"2024-09-13T19:19:47.935056+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-13T19:19:47.934931+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-13T19:19:47.934931+0000","last_clean_scrub_stamp":"2024-09-13T19:19:47.934931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:58.003188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"36'4","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:59.557096+0000","last_change":"2024-09-13T19:19:59.557143+0000","last_active":"2024-09-13T19:19:59.557096+0000","last_peered":"2024-09-13T19:19:59.557096+0000","last_clean":"2024-09-13T19:19:59.557096+0000","last_became_active":"2024-09-13T19:15:55.889485+0000","last_became_peered":"2024-09-13T19:15:55.889485+0000","last_unstale":"2024-09-13T19:19:59.557096+0000","last_undegraded":"2024-09-13T19:19:59.557096+0000","last_fullsized":"2024-09-13T19:19:59.557096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:19:59.556986+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:19:59.556986+0000","last_clean_scrub_stamp":"2024-09-13T19:19:59.556986+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:35.761259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"36'2","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:34.063067+0000","last_change":"2024-09-13T19:19:34.063067+0000","last_active":"2024-09-13T19:19:34.063067+0000","last_peered":"2024-09-13T19:19:34.063067+0000","last_clean":"2024-09-13T19:19:34.063067+0000","last_became_active":"2024-09-13T19:15:57.900785+0000","last_became_peered":"2024-09-13T19:15:57.900785+0000","last_unstale":"2024-09-13T19:19:34.063067+0000","last_undegraded":"2024-09-13T19:19:34.063067+0000","last_fullsized":"2024-09-13T19:19:34.063067+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:34.062937+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:34.062937+0000","last_clean_scrub_stamp":"2024-09-13T19:19:34.062937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:11:39.030166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"36'2","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:08.989884+0000","last_change":"2024-09-13T19:20:08.989911+0000","last_active":"2024-09-13T19:20:08.989884+0000","last_peered":"2024-09-13T19:20:08.989884+0000","last_clean":"2024-09-13T19:20:08.989884+0000","last_became_active":"2024-09-13T19:15:55.897381+0000","last_became_peered":"2024-09-13T19:15:55.897381+0000","last_unstale":"2024-09-13T19:20:08.989884+0000","last_undegraded":"2024-09-13T19:20:08.989884+0000","last_fullsized":"2024-09-13T19:20:08.989884+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:20:08.989795+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:20:08.989795+0000","last_clean_scrub_stamp":"2024-09-13T19:20:08.989795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:20.035191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"36'16","reported_seq":100,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:47.809912+0000","last_change":"2024-09-13T19:19:47.809912+0000","last_active":"2024-09-13T19:19:47.809912+0000","last_peered":"2024-09-13T19:19:47.809912+0000","last_clean":"2024-09-13T19:19:47.809912+0000","last_became_active":"2024-09-13T19:15:57.893408+0000","last_became_peered":"2024-09-13T19:15:57.893408+0000","last_unstale":"2024-09-13T19:19:47.809912+0000","last_undegraded":"2024-09-13T19:19:47.809912+0000","last_fullsized":"2024-09-13T19:19:47.809912+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-13T19:19:47.809763+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-13T19:19:47.809763+0000","last_clean_scrub_stamp":"2024-09-13T19:19:47.809763+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:37:38.871573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"36'2","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:48.658576+0000","last_change":"2024-09-13T19:19:48.658601+0000","last_active":"2024-09-13T19:19:48.658576+0000","last_peered":"2024-09-13T19:19:48.658576+0000","last_clean":"2024-09-13T19:19:48.658576+0000","last_became_active":"2024-09-13T19:15:55.901190+0000","last_became_peered":"2024-09-13T19:15:55.901190+0000","last_unstale":"2024-09-13T19:19:48.658576+0000","last_undegraded":"2024-09-13T19:19:48.658576+0000","last_fullsized":"2024-09-13T19:19:48.658576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:48.658486+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:48.658486+0000","last_clean_scrub_stamp":"2024-09-13T19:19:48.658486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:15:38.548787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"36'16","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:55.632013+0000","last_change":"2024-09-13T19:19:55.632013+0000","last_active":"2024-09-13T19:19:55.632013+0000","last_peered":"2024-09-13T19:19:55.632013+0000","last_clean":"2024-09-13T19:19:55.632013+0000","last_became_active":"2024-09-13T19:15:57.898325+0000","last_became_peered":"2024-09-13T19:15:57.898325+0000","last_unstale":"2024-09-13T19:19:55.632013+0000","last_undegraded":"2024-09-13T19:19:55.632013+0000","last_fullsized":"2024-09-13T19:19:55.632013+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-13T19:19:55.631818+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-13T19:19:55.631818+0000","last_clean_scrub_stamp":"2024-09-13T19:19:55.631818+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:59.940789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":52,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"36'4","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:03.927384+0000","last_change":"2024-09-13T19:20:03.927407+0000","last_active":"2024-09-13T19:20:03.927384+0000","last_peered":"2024-09-13T19:20:03.927384+0000","last_clean":"2024-09-13T19:20:03.927384+0000","last_became_active":"2024-09-13T19:15:57.887144+0000","last_became_peered":"2024-09-13T19:15:57.887144+0000","last_unstale":"2024-09-13T19:20:03.927384+0000","last_undegraded":"2024-09-13T19:20:03.927384+0000","last_fullsized":"2024-09-13T19:20:03.927384+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:20:03.927294+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:20:03.927294+0000","last_clean_scrub_stamp":"2024-09-13T19:20:03.927294+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:18:50.671482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"36'2","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:55.084086+0000","last_change":"2024-09-13T19:19:55.084112+0000","last_active":"2024-09-13T19:19:55.084086+0000","last_peered":"2024-09-13T19:19:55.084086+0000","last_clean":"2024-09-13T19:19:55.084086+0000","last_became_active":"2024-09-13T19:15:55.895552+0000","last_became_peered":"2024-09-13T19:15:55.895552+0000","last_unstale":"2024-09-13T19:19:55.084086+0000","last_undegraded":"2024-09-13T19:19:55.084086+0000","last_fullsized":"2024-09-13T19:19:55.084086+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:55.083997+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:55.083997+0000","last_clean_scrub_stamp":"2024-09-13T19:19:55.083997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:16.783662+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"36'8","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:48.955061+0000","last_change":"2024-09-13T19:19:48.955111+0000","last_active":"2024-09-13T19:19:48.955061+0000","last_peered":"2024-09-13T19:19:48.955061+0000","last_clean":"2024-09-13T19:19:48.955061+0000","last_became_active":"2024-09-13T19:15:57.886511+0000","last_became_peered":"2024-09-13T19:15:57.886511+0000","last_unstale":"2024-09-13T19:19:48.955061+0000","last_undegraded":"2024-09-13T19:19:48.955061+0000","last_fullsized":"2024-09-13T19:19:48.955061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-13T19:19:48.954919+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-13T19:19:48.954919+0000","last_clean_scrub_stamp":"2024-09-13T19:19:48.954919+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:06.835960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:48.818273+0000","last_change":"2024-09-13T19:19:48.818317+0000","last_active":"2024-09-13T19:19:48.818273+0000","last_peered":"2024-09-13T19:19:48.818273+0000","last_clean":"2024-09-13T19:19:48.818273+0000","last_became_active":"2024-09-13T19:15:55.896952+0000","last_became_peered":"2024-09-13T19:15:55.896952+0000","last_unstale":"2024-09-13T19:19:48.818273+0000","last_undegraded":"2024-09-13T19:19:48.818273+0000","last_fullsized":"2024-09-13T19:19:48.818273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:48.818164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:48.818164+0000","last_clean_scrub_stamp":"2024-09-13T19:19:48.818164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:02.241073+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"36'8","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:58.078958+0000","last_change":"2024-09-13T19:19:58.078987+0000","last_active":"2024-09-13T19:19:58.078958+0000","last_peered":"2024-09-13T19:19:58.078958+0000","last_clean":"2024-09-13T19:19:58.078958+0000","last_became_active":"2024-09-13T19:15:57.891411+0000","last_became_peered":"2024-09-13T19:15:57.891411+0000","last_unstale":"2024-09-13T19:19:58.078958+0000","last_undegraded":"2024-09-13T19:19:58.078958+0000","last_fullsized":"2024-09-13T19:19:58.078958+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-13T19:19:58.078853+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-13T19:19:58.078853+0000","last_clean_scrub_stamp":"2024-09-13T19:19:58.078853+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:14.717815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"36'2","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:57.048072+0000","last_change":"2024-09-13T19:19:57.048117+0000","last_active":"2024-09-13T19:19:57.048072+0000","last_peered":"2024-09-13T19:19:57.048072+0000","last_clean":"2024-09-13T19:19:57.048072+0000","last_became_active":"2024-09-13T19:15:55.895453+0000","last_became_peered":"2024-09-13T19:15:55.895453+0000","last_unstale":"2024-09-13T19:19:57.048072+0000","last_undegraded":"2024-09-13T19:19:57.048072+0000","last_fullsized":"2024-09-13T19:19:57.048072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:57.047952+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:57.047952+0000","last_clean_scrub_stamp":"2024-09-13T19:19:57.047952+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:44.511756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"36'8","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:46.621422+0000","last_change":"2024-09-13T19:19:46.621446+0000","last_active":"2024-09-13T19:19:46.621422+0000","last_peered":"2024-09-13T19:19:46.621422+0000","last_clean":"2024-09-13T19:19:46.621422+0000","last_became_active":"2024-09-13T19:15:57.896208+0000","last_became_peered":"2024-09-13T19:15:57.896208+0000","last_unstale":"2024-09-13T19:19:46.621422+0000","last_undegraded":"2024-09-13T19:19:46.621422+0000","last_fullsized":"2024-09-13T19:19:46.621422+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-13T19:19:46.621332+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-13T19:19:46.621332+0000","last_clean_scrub_stamp":"2024-09-13T19:19:46.621332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:00.483604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:05.080505+0000","last_change":"2024-09-13T19:20:05.080533+0000","last_active":"2024-09-13T19:20:05.080505+0000","last_peered":"2024-09-13T19:20:05.080505+0000","last_clean":"2024-09-13T19:20:05.080505+0000","last_became_active":"2024-09-13T19:15:55.892616+0000","last_became_peered":"2024-09-13T19:15:55.892616+0000","last_unstale":"2024-09-13T19:20:05.080505+0000","last_undegraded":"2024-09-13T19:20:05.080505+0000","last_fullsized":"2024-09-13T19:20:05.080505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:20:05.080420+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:20:05.080420+0000","last_clean_scrub_stamp":"2024-09-13T19:20:05.080420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:29.203072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"36'2","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:49.771954+0000","last_change":"2024-09-13T19:19:49.771997+0000","last_active":"2024-09-13T19:19:49.771954+0000","last_peered":"2024-09-13T19:19:49.771954+0000","last_clean":"2024-09-13T19:19:49.771954+0000","last_became_active":"2024-09-13T19:15:57.897566+0000","last_became_peered":"2024-09-13T19:15:57.897566+0000","last_unstale":"2024-09-13T19:19:49.771954+0000","last_undegraded":"2024-09-13T19:19:49.771954+0000","last_fullsized":"2024-09-13T19:19:49.771954+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:49.771831+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:49.771831+0000","last_clean_scrub_stamp":"2024-09-13T19:19:49.771831+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:38.756140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:00.631042+0000","last_change":"2024-09-13T19:20:00.631090+0000","last_active":"2024-09-13T19:20:00.631042+0000","last_peered":"2024-09-13T19:20:00.631042+0000","last_clean":"2024-09-13T19:20:00.631042+0000","last_became_active":"2024-09-13T19:15:55.893594+0000","last_became_peered":"2024-09-13T19:15:55.893594+0000","last_unstale":"2024-09-13T19:20:00.631042+0000","last_undegraded":"2024-09-13T19:20:00.631042+0000","last_fullsized":"2024-09-13T19:20:00.631042+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:00.630941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:00.630941+0000","last_clean_scrub_stamp":"2024-09-13T19:20:00.630941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:06:00.888554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"36'6","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:52.023727+0000","last_change":"2024-09-13T19:19:52.023770+0000","last_active":"2024-09-13T19:19:52.023727+0000","last_peered":"2024-09-13T19:19:52.023727+0000","last_clean":"2024-09-13T19:19:52.023727+0000","last_became_active":"2024-09-13T19:15:57.889901+0000","last_became_peered":"2024-09-13T19:15:57.889901+0000","last_unstale":"2024-09-13T19:19:52.023727+0000","last_undegraded":"2024-09-13T19:19:52.023727+0000","last_fullsized":"2024-09-13T19:19:52.023727+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:19:52.023617+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:19:52.023617+0000","last_clean_scrub_stamp":"2024-09-13T19:19:52.023617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:55.796931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:12.967331+0000","last_change":"2024-09-13T19:20:12.967360+0000","last_active":"2024-09-13T19:20:12.967331+0000","last_peered":"2024-09-13T19:20:12.967331+0000","last_clean":"2024-09-13T19:20:12.967331+0000","last_became_active":"2024-09-13T19:15:55.898679+0000","last_became_peered":"2024-09-13T19:15:55.898679+0000","last_unstale":"2024-09-13T19:20:12.967331+0000","last_undegraded":"2024-09-13T19:20:12.967331+0000","last_fullsized":"2024-09-13T19:20:12.967331+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:12.967205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:12.967205+0000","last_clean_scrub_stamp":"2024-09-13T19:20:12.967205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:14:48.427858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"36'35","reported_seq":100,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.978025+0000","last_change":"2024-09-13T19:16:05.921753+0000","last_active":"2024-09-13T19:19:05.978025+0000","last_peered":"2024-09-13T19:19:05.978025+0000","last_clean":"2024-09-13T19:19:05.978025+0000","last_became_active":"2024-09-13T19:16:05.921156+0000","last_became_peered":"2024-09-13T19:16:05.921156+0000","last_unstale":"2024-09-13T19:19:05.978025+0000","last_undegraded":"2024-09-13T19:19:05.978025+0000","last_fullsized":"2024-09-13T19:19:05.978025+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"36'6","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:49.875510+0000","last_change":"2024-09-13T19:19:49.875536+0000","last_active":"2024-09-13T19:19:49.875510+0000","last_peered":"2024-09-13T19:19:49.875510+0000","last_clean":"2024-09-13T19:19:49.875510+0000","last_became_active":"2024-09-13T19:15:57.895870+0000","last_became_peered":"2024-09-13T19:15:57.895870+0000","last_unstale":"2024-09-13T19:19:49.875510+0000","last_undegraded":"2024-09-13T19:19:49.875510+0000","last_fullsized":"2024-09-13T19:19:49.875510+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:19:49.875424+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:19:49.875424+0000","last_clean_scrub_stamp":"2024-09-13T19:19:49.875424+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:44.778091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:18.942743+0000","last_change":"2024-09-13T19:15:55.895213+0000","last_active":"2024-09-13T19:18:18.942743+0000","last_peered":"2024-09-13T19:18:18.942743+0000","last_clean":"2024-09-13T19:18:18.942743+0000","last_became_active":"2024-09-13T19:15:55.894099+0000","last_became_peered":"2024-09-13T19:15:55.894099+0000","last_unstale":"2024-09-13T19:18:18.942743+0000","last_undegraded":"2024-09-13T19:18:18.942743+0000","last_fullsized":"2024-09-13T19:18:18.942743+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:20.089068+0000","last_change":"2024-09-13T19:19:20.089107+0000","last_active":"2024-09-13T19:19:20.089068+0000","last_peered":"2024-09-13T19:19:20.089068+0000","last_clean":"2024-09-13T19:19:20.089068+0000","last_became_active":"2024-09-13T19:15:59.896648+0000","last_became_peered":"2024-09-13T19:15:59.896648+0000","last_unstale":"2024-09-13T19:19:20.089068+0000","last_undegraded":"2024-09-13T19:19:20.089068+0000","last_fullsized":"2024-09-13T19:19:20.089068+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:20.088934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:20.088934+0000","last_clean_scrub_stamp":"2024-09-13T19:19:20.088934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:25.257454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"36'36","reported_seq":91,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:41.951351+0000","last_change":"2024-09-13T19:19:41.951384+0000","last_active":"2024-09-13T19:19:41.951351+0000","last_peered":"2024-09-13T19:19:41.951351+0000","last_clean":"2024-09-13T19:19:41.951351+0000","last_became_active":"2024-09-13T19:16:01.906675+0000","last_became_peered":"2024-09-13T19:16:01.906675+0000","last_unstale":"2024-09-13T19:19:41.951351+0000","last_undegraded":"2024-09-13T19:19:41.951351+0000","last_fullsized":"2024-09-13T19:19:41.951351+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-13T19:19:41.951264+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-13T19:19:41.951264+0000","last_clean_scrub_stamp":"2024-09-13T19:19:41.951264+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:19.199178+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:35.864331+0000","last_change":"2024-09-13T19:19:35.864355+0000","last_active":"2024-09-13T19:19:35.864331+0000","last_peered":"2024-09-13T19:19:35.864331+0000","last_clean":"2024-09-13T19:19:35.864331+0000","last_became_active":"2024-09-13T19:16:03.914111+0000","last_became_peered":"2024-09-13T19:16:03.914111+0000","last_unstale":"2024-09-13T19:19:35.864331+0000","last_undegraded":"2024-09-13T19:19:35.864331+0000","last_fullsized":"2024-09-13T19:19:35.864331+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:35.864237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:35.864237+0000","last_clean_scrub_stamp":"2024-09-13T19:19:35.864237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:31:06.989608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"36'7","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:33.944238+0000","last_change":"2024-09-13T19:16:05.925198+0000","last_active":"2024-09-13T19:18:33.944238+0000","last_peered":"2024-09-13T19:18:33.944238+0000","last_clean":"2024-09-13T19:18:33.944238+0000","last_became_active":"2024-09-13T19:16:05.924829+0000","last_became_peered":"2024-09-13T19:16:05.924829+0000","last_unstale":"2024-09-13T19:18:33.944238+0000","last_undegraded":"2024-09-13T19:18:33.944238+0000","last_fullsized":"2024-09-13T19:18:33.944238+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"36'10","reported_seq":70,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:48.913828+0000","last_change":"2024-09-13T19:19:48.913853+0000","last_active":"2024-09-13T19:19:48.913828+0000","last_peered":"2024-09-13T19:19:48.913828+0000","last_clean":"2024-09-13T19:19:48.913828+0000","last_became_active":"2024-09-13T19:15:57.897928+0000","last_became_peered":"2024-09-13T19:15:57.897928+0000","last_unstale":"2024-09-13T19:19:48.913828+0000","last_undegraded":"2024-09-13T19:19:48.913828+0000","last_fullsized":"2024-09-13T19:19:48.913828+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-13T19:19:48.913742+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-13T19:19:48.913742+0000","last_clean_scrub_stamp":"2024-09-13T19:19:48.913742+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:09:14.046682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:03.557803+0000","last_change":"2024-09-13T19:20:03.557828+0000","last_active":"2024-09-13T19:20:03.557803+0000","last_peered":"2024-09-13T19:20:03.557803+0000","last_clean":"2024-09-13T19:20:03.557803+0000","last_became_active":"2024-09-13T19:15:55.891934+0000","last_became_peered":"2024-09-13T19:15:55.891934+0000","last_unstale":"2024-09-13T19:20:03.557803+0000","last_undegraded":"2024-09-13T19:20:03.557803+0000","last_fullsized":"2024-09-13T19:20:03.557803+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:03.557697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:03.557697+0000","last_clean_scrub_stamp":"2024-09-13T19:20:03.557697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:16.166958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:39.498827+0000","last_change":"2024-09-13T19:19:39.498853+0000","last_active":"2024-09-13T19:19:39.498827+0000","last_peered":"2024-09-13T19:19:39.498827+0000","last_clean":"2024-09-13T19:19:39.498827+0000","last_became_active":"2024-09-13T19:15:59.892230+0000","last_became_peered":"2024-09-13T19:15:59.892230+0000","last_unstale":"2024-09-13T19:19:39.498827+0000","last_undegraded":"2024-09-13T19:19:39.498827+0000","last_fullsized":"2024-09-13T19:19:39.498827+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:39.498723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:39.498723+0000","last_clean_scrub_stamp":"2024-09-13T19:19:39.498723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:50.652003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"36'11","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:20.693227+0000","last_change":"2024-09-13T19:19:20.693258+0000","last_active":"2024-09-13T19:19:20.693227+0000","last_peered":"2024-09-13T19:19:20.693227+0000","last_clean":"2024-09-13T19:19:20.693227+0000","last_became_active":"2024-09-13T19:16:01.903371+0000","last_became_peered":"2024-09-13T19:16:01.903371+0000","last_unstale":"2024-09-13T19:19:20.693227+0000","last_undegraded":"2024-09-13T19:19:20.693227+0000","last_fullsized":"2024-09-13T19:19:20.693227+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'11","last_scrub_stamp":"2024-09-13T19:19:20.693140+0000","last_deep_scrub":"36'11","last_deep_scrub_stamp":"2024-09-13T19:19:20.693140+0000","last_clean_scrub_stamp":"2024-09-13T19:19:20.693140+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:19.872266+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:39.817530+0000","last_change":"2024-09-13T19:19:39.817552+0000","last_active":"2024-09-13T19:19:39.817530+0000","last_peered":"2024-09-13T19:19:39.817530+0000","last_clean":"2024-09-13T19:19:39.817530+0000","last_became_active":"2024-09-13T19:16:03.915538+0000","last_became_peered":"2024-09-13T19:16:03.915538+0000","last_unstale":"2024-09-13T19:19:39.817530+0000","last_undegraded":"2024-09-13T19:19:39.817530+0000","last_fullsized":"2024-09-13T19:19:39.817530+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:39.817428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:39.817428+0000","last_clean_scrub_stamp":"2024-09-13T19:19:39.817428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:06:06.681988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"34'2","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:41.520495+0000","last_change":"2024-09-13T19:19:41.520527+0000","last_active":"2024-09-13T19:19:41.520495+0000","last_peered":"2024-09-13T19:19:41.520495+0000","last_clean":"2024-09-13T19:19:41.520495+0000","last_became_active":"2024-09-13T19:16:05.911683+0000","last_became_peered":"2024-09-13T19:16:05.911683+0000","last_unstale":"2024-09-13T19:19:41.520495+0000","last_undegraded":"2024-09-13T19:19:41.520495+0000","last_fullsized":"2024-09-13T19:19:41.520495+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:19:41.520392+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:19:41.520392+0000","last_clean_scrub_stamp":"2024-09-13T19:19:41.520392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:23.565901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"36'4","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:53.901762+0000","last_change":"2024-09-13T19:19:53.901787+0000","last_active":"2024-09-13T19:19:53.901762+0000","last_peered":"2024-09-13T19:19:53.901762+0000","last_clean":"2024-09-13T19:19:53.901762+0000","last_became_active":"2024-09-13T19:15:57.896965+0000","last_became_peered":"2024-09-13T19:15:57.896965+0000","last_unstale":"2024-09-13T19:19:53.901762+0000","last_undegraded":"2024-09-13T19:19:53.901762+0000","last_fullsized":"2024-09-13T19:19:53.901762+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:19:53.901665+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:19:53.901665+0000","last_clean_scrub_stamp":"2024-09-13T19:19:53.901665+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:59.285297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"36'4","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:05.833100+0000","last_change":"2024-09-13T19:15:55.899327+0000","last_active":"2024-09-13T19:19:05.833100+0000","last_peered":"2024-09-13T19:19:05.833100+0000","last_clean":"2024-09-13T19:19:05.833100+0000","last_became_active":"2024-09-13T19:15:55.895444+0000","last_became_peered":"2024-09-13T19:15:55.895444+0000","last_unstale":"2024-09-13T19:19:05.833100+0000","last_undegraded":"2024-09-13T19:19:05.833100+0000","last_fullsized":"2024-09-13T19:19:05.833100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:35.477880+0000","last_change":"2024-09-13T19:19:35.477903+0000","last_active":"2024-09-13T19:19:35.477880+0000","last_peered":"2024-09-13T19:19:35.477880+0000","last_clean":"2024-09-13T19:19:35.477880+0000","last_became_active":"2024-09-13T19:15:59.895332+0000","last_became_peered":"2024-09-13T19:15:59.895332+0000","last_unstale":"2024-09-13T19:19:35.477880+0000","last_undegraded":"2024-09-13T19:19:35.477880+0000","last_fullsized":"2024-09-13T19:19:35.477880+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:35.477788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:35.477788+0000","last_clean_scrub_stamp":"2024-09-13T19:19:35.477788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:23:52.241441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"36'15","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:25.800975+0000","last_change":"2024-09-13T19:19:25.801012+0000","last_active":"2024-09-13T19:19:25.800975+0000","last_peered":"2024-09-13T19:19:25.800975+0000","last_clean":"2024-09-13T19:19:25.800975+0000","last_became_active":"2024-09-13T19:16:01.905457+0000","last_became_peered":"2024-09-13T19:16:01.905457+0000","last_unstale":"2024-09-13T19:19:25.800975+0000","last_undegraded":"2024-09-13T19:19:25.800975+0000","last_fullsized":"2024-09-13T19:19:25.800975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'15","last_scrub_stamp":"2024-09-13T19:19:25.800877+0000","last_deep_scrub":"36'15","last_deep_scrub_stamp":"2024-09-13T19:19:25.800877+0000","last_clean_scrub_stamp":"2024-09-13T19:19:25.800877+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:36.670597+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"36'286","reported_seq":394,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:50.851017+0000","last_change":"2024-09-13T19:19:50.851047+0000","last_active":"2024-09-13T19:19:50.851017+0000","last_peered":"2024-09-13T19:19:50.851017+0000","last_clean":"2024-09-13T19:19:50.851017+0000","last_became_active":"2024-09-13T19:16:03.916853+0000","last_became_peered":"2024-09-13T19:16:03.916853+0000","last_unstale":"2024-09-13T19:19:50.851017+0000","last_undegraded":"2024-09-13T19:19:50.851017+0000","last_fullsized":"2024-09-13T19:19:50.851017+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'286","last_scrub_stamp":"2024-09-13T19:19:50.850910+0000","last_deep_scrub":"36'286","last_deep_scrub_stamp":"2024-09-13T19:19:50.850910+0000","last_clean_scrub_stamp":"2024-09-13T19:19:50.850910+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:27:51.431330+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"36'2","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:39.721687+0000","last_change":"2024-09-13T19:19:39.721711+0000","last_active":"2024-09-13T19:19:39.721687+0000","last_peered":"2024-09-13T19:19:39.721687+0000","last_clean":"2024-09-13T19:19:39.721687+0000","last_became_active":"2024-09-13T19:16:05.912191+0000","last_became_peered":"2024-09-13T19:16:05.912191+0000","last_unstale":"2024-09-13T19:19:39.721687+0000","last_undegraded":"2024-09-13T19:19:39.721687+0000","last_fullsized":"2024-09-13T19:19:39.721687+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:39.721599+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:39.721599+0000","last_clean_scrub_stamp":"2024-09-13T19:19:39.721599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:58:45.282753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"36'4","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:01.628888+0000","last_change":"2024-09-13T19:20:01.628913+0000","last_active":"2024-09-13T19:20:01.628888+0000","last_peered":"2024-09-13T19:20:01.628888+0000","last_clean":"2024-09-13T19:20:01.628888+0000","last_became_active":"2024-09-13T19:15:57.890015+0000","last_became_peered":"2024-09-13T19:15:57.890015+0000","last_unstale":"2024-09-13T19:20:01.628888+0000","last_undegraded":"2024-09-13T19:20:01.628888+0000","last_fullsized":"2024-09-13T19:20:01.628888+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:20:01.628788+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:20:01.628788+0000","last_clean_scrub_stamp":"2024-09-13T19:20:01.628788+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:21.086734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:06.088049+0000","last_change":"2024-09-13T19:20:06.088085+0000","last_active":"2024-09-13T19:20:06.088049+0000","last_peered":"2024-09-13T19:20:06.088049+0000","last_clean":"2024-09-13T19:20:06.088049+0000","last_became_active":"2024-09-13T19:15:55.894380+0000","last_became_peered":"2024-09-13T19:15:55.894380+0000","last_unstale":"2024-09-13T19:20:06.088049+0000","last_undegraded":"2024-09-13T19:20:06.088049+0000","last_fullsized":"2024-09-13T19:20:06.088049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:06.087929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:06.087929+0000","last_clean_scrub_stamp":"2024-09-13T19:20:06.087929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:01.249205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:16.988795+0000","last_change":"2024-09-13T19:19:16.988819+0000","last_active":"2024-09-13T19:19:16.988795+0000","last_peered":"2024-09-13T19:19:16.988795+0000","last_clean":"2024-09-13T19:19:16.988795+0000","last_became_active":"2024-09-13T19:15:59.896572+0000","last_became_peered":"2024-09-13T19:15:59.896572+0000","last_unstale":"2024-09-13T19:19:16.988795+0000","last_undegraded":"2024-09-13T19:19:16.988795+0000","last_fullsized":"2024-09-13T19:19:16.988795+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:16.988701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:16.988701+0000","last_clean_scrub_stamp":"2024-09-13T19:19:16.988701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:14.282330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"36'36","reported_seq":91,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:22.776961+0000","last_change":"2024-09-13T19:19:22.777010+0000","last_active":"2024-09-13T19:19:22.776961+0000","last_peered":"2024-09-13T19:19:22.776961+0000","last_clean":"2024-09-13T19:19:22.776961+0000","last_became_active":"2024-09-13T19:16:01.906471+0000","last_became_peered":"2024-09-13T19:16:01.906471+0000","last_unstale":"2024-09-13T19:19:22.776961+0000","last_undegraded":"2024-09-13T19:19:22.776961+0000","last_fullsized":"2024-09-13T19:19:22.776961+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-13T19:19:22.776859+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-13T19:19:22.776859+0000","last_clean_scrub_stamp":"2024-09-13T19:19:22.776859+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:40.452064+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"36'285","reported_seq":422,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:20.301108+0000","last_change":"2024-09-13T19:19:20.301137+0000","last_active":"2024-09-13T19:19:20.301108+0000","last_peered":"2024-09-13T19:19:20.301108+0000","last_clean":"2024-09-13T19:19:20.301108+0000","last_became_active":"2024-09-13T19:16:03.909046+0000","last_became_peered":"2024-09-13T19:16:03.909046+0000","last_unstale":"2024-09-13T19:19:20.301108+0000","last_undegraded":"2024-09-13T19:19:20.301108+0000","last_fullsized":"2024-09-13T19:19:20.301108+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-13T19:19:20.301016+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-13T19:19:20.301016+0000","last_clean_scrub_stamp":"2024-09-13T19:19:20.301016+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:00.732319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"36'16","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:11.578636+0000","last_change":"2024-09-13T19:20:11.578670+0000","last_active":"2024-09-13T19:20:11.578636+0000","last_peered":"2024-09-13T19:20:11.578636+0000","last_clean":"2024-09-13T19:20:11.578636+0000","last_became_active":"2024-09-13T19:16:31.991055+0000","last_became_peered":"2024-09-13T19:16:31.991055+0000","last_unstale":"2024-09-13T19:20:11.578636+0000","last_undegraded":"2024-09-13T19:20:11.578636+0000","last_fullsized":"2024-09-13T19:20:11.578636+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-13T19:20:11.578543+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-13T19:20:11.578543+0000","last_clean_scrub_stamp":"2024-09-13T19:20:11.578543+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:35.701195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":73,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:54.641844+0000","last_change":"2024-09-13T19:19:54.641871+0000","last_active":"2024-09-13T19:19:54.641844+0000","last_peered":"2024-09-13T19:19:54.641844+0000","last_clean":"2024-09-13T19:19:54.641844+0000","last_became_active":"2024-09-13T19:15:55.893544+0000","last_became_peered":"2024-09-13T19:15:55.893544+0000","last_unstale":"2024-09-13T19:19:54.641844+0000","last_undegraded":"2024-09-13T19:19:54.641844+0000","last_fullsized":"2024-09-13T19:19:54.641844+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:54.641751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:54.641751+0000","last_clean_scrub_stamp":"2024-09-13T19:19:54.641751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:04.710009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:25.690461+0000","last_change":"2024-09-13T19:19:25.690504+0000","last_active":"2024-09-13T19:19:25.690461+0000","last_peered":"2024-09-13T19:19:25.690461+0000","last_clean":"2024-09-13T19:19:25.690461+0000","last_became_active":"2024-09-13T19:15:59.897435+0000","last_became_peered":"2024-09-13T19:15:59.897435+0000","last_unstale":"2024-09-13T19:19:25.690461+0000","last_undegraded":"2024-09-13T19:19:25.690461+0000","last_fullsized":"2024-09-13T19:19:25.690461+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:25.690361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:25.690361+0000","last_clean_scrub_stamp":"2024-09-13T19:19:25.690361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:23:10.242794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"36'52","reported_seq":112,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:26.852857+0000","last_change":"2024-09-13T19:19:26.852897+0000","last_active":"2024-09-13T19:19:26.852857+0000","last_peered":"2024-09-13T19:19:26.852857+0000","last_clean":"2024-09-13T19:19:26.852857+0000","last_became_active":"2024-09-13T19:16:01.904454+0000","last_became_peered":"2024-09-13T19:16:01.904454+0000","last_unstale":"2024-09-13T19:19:26.852857+0000","last_undegraded":"2024-09-13T19:19:26.852857+0000","last_fullsized":"2024-09-13T19:19:26.852857+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'52","last_scrub_stamp":"2024-09-13T19:19:26.852772+0000","last_deep_scrub":"36'52","last_deep_scrub_stamp":"2024-09-13T19:19:26.852772+0000","last_clean_scrub_stamp":"2024-09-13T19:19:26.852772+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:51.100890+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:25.339833+0000","last_change":"2024-09-13T19:19:25.339857+0000","last_active":"2024-09-13T19:19:25.339833+0000","last_peered":"2024-09-13T19:19:25.339833+0000","last_clean":"2024-09-13T19:19:25.339833+0000","last_became_active":"2024-09-13T19:16:03.912383+0000","last_became_peered":"2024-09-13T19:16:03.912383+0000","last_unstale":"2024-09-13T19:19:25.339833+0000","last_undegraded":"2024-09-13T19:19:25.339833+0000","last_fullsized":"2024-09-13T19:19:25.339833+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:25.339734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:25.339734+0000","last_clean_scrub_stamp":"2024-09-13T19:19:25.339734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:29.120530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"36'5","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:07.574666+0000","last_change":"2024-09-13T19:20:07.574709+0000","last_active":"2024-09-13T19:20:07.574666+0000","last_peered":"2024-09-13T19:20:07.574666+0000","last_clean":"2024-09-13T19:20:07.574666+0000","last_became_active":"2024-09-13T19:16:05.919154+0000","last_became_peered":"2024-09-13T19:16:05.919154+0000","last_unstale":"2024-09-13T19:20:07.574666+0000","last_undegraded":"2024-09-13T19:20:07.574666+0000","last_fullsized":"2024-09-13T19:20:07.574666+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-09-13T19:20:07.574573+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-09-13T19:20:07.574573+0000","last_clean_scrub_stamp":"2024-09-13T19:20:07.574573+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:56:34.868499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"36'4","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:54.102896+0000","last_change":"2024-09-13T19:19:54.102926+0000","last_active":"2024-09-13T19:19:54.102896+0000","last_peered":"2024-09-13T19:19:54.102896+0000","last_clean":"2024-09-13T19:19:54.102896+0000","last_became_active":"2024-09-13T19:15:57.890345+0000","last_became_peered":"2024-09-13T19:15:57.890345+0000","last_unstale":"2024-09-13T19:19:54.102896+0000","last_undegraded":"2024-09-13T19:19:54.102896+0000","last_fullsized":"2024-09-13T19:19:54.102896+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:19:54.102800+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:19:54.102800+0000","last_clean_scrub_stamp":"2024-09-13T19:19:54.102800+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:26.429123+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:01.536466+0000","last_change":"2024-09-13T19:20:01.536496+0000","last_active":"2024-09-13T19:20:01.536466+0000","last_peered":"2024-09-13T19:20:01.536466+0000","last_clean":"2024-09-13T19:20:01.536466+0000","last_became_active":"2024-09-13T19:15:55.891250+0000","last_became_peered":"2024-09-13T19:15:55.891250+0000","last_unstale":"2024-09-13T19:20:01.536466+0000","last_undegraded":"2024-09-13T19:20:01.536466+0000","last_fullsized":"2024-09-13T19:20:01.536466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:20:01.536373+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:20:01.536373+0000","last_clean_scrub_stamp":"2024-09-13T19:20:01.536373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:49:59.441969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:40.548727+0000","last_change":"2024-09-13T19:19:40.548760+0000","last_active":"2024-09-13T19:19:40.548727+0000","last_peered":"2024-09-13T19:19:40.548727+0000","last_clean":"2024-09-13T19:19:40.548727+0000","last_became_active":"2024-09-13T19:15:59.891028+0000","last_became_peered":"2024-09-13T19:15:59.891028+0000","last_unstale":"2024-09-13T19:19:40.548727+0000","last_undegraded":"2024-09-13T19:19:40.548727+0000","last_fullsized":"2024-09-13T19:19:40.548727+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:40.548634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:40.548634+0000","last_clean_scrub_stamp":"2024-09-13T19:19:40.548634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:18:54.086278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"36'36","reported_seq":91,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:29.094496+0000","last_change":"2024-09-13T19:19:29.094550+0000","last_active":"2024-09-13T19:19:29.094496+0000","last_peered":"2024-09-13T19:19:29.094496+0000","last_clean":"2024-09-13T19:19:29.094496+0000","last_became_active":"2024-09-13T19:16:01.904534+0000","last_became_peered":"2024-09-13T19:16:01.904534+0000","last_unstale":"2024-09-13T19:19:29.094496+0000","last_undegraded":"2024-09-13T19:19:29.094496+0000","last_fullsized":"2024-09-13T19:19:29.094496+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-13T19:19:29.094383+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-13T19:19:29.094383+0000","last_clean_scrub_stamp":"2024-09-13T19:19:29.094383+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:28:19.264538+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:33.431802+0000","last_change":"2024-09-13T19:19:33.431831+0000","last_active":"2024-09-13T19:19:33.431802+0000","last_peered":"2024-09-13T19:19:33.431802+0000","last_clean":"2024-09-13T19:19:33.431802+0000","last_became_active":"2024-09-13T19:16:03.913829+0000","last_became_peered":"2024-09-13T19:16:03.913829+0000","last_unstale":"2024-09-13T19:19:33.431802+0000","last_undegraded":"2024-09-13T19:19:33.431802+0000","last_fullsized":"2024-09-13T19:19:33.431802+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:33.431688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:33.431688+0000","last_clean_scrub_stamp":"2024-09-13T19:19:33.431688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:40:42.508968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"36'4","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:12.054031+0000","last_change":"2024-09-13T19:20:12.054063+0000","last_active":"2024-09-13T19:20:12.054031+0000","last_peered":"2024-09-13T19:20:12.054031+0000","last_clean":"2024-09-13T19:20:12.054031+0000","last_became_active":"2024-09-13T19:16:05.913578+0000","last_became_peered":"2024-09-13T19:16:05.913578+0000","last_unstale":"2024-09-13T19:20:12.054031+0000","last_undegraded":"2024-09-13T19:20:12.054031+0000","last_fullsized":"2024-09-13T19:20:12.054031+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:20:12.053936+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:20:12.053936+0000","last_clean_scrub_stamp":"2024-09-13T19:20:12.053936+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:13:39.847869+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:53.682343+0000","last_change":"2024-09-13T19:19:53.682379+0000","last_active":"2024-09-13T19:19:53.682343+0000","last_peered":"2024-09-13T19:19:53.682343+0000","last_clean":"2024-09-13T19:19:53.682343+0000","last_became_active":"2024-09-13T19:15:57.897468+0000","last_became_peered":"2024-09-13T19:15:57.897468+0000","last_unstale":"2024-09-13T19:19:53.682343+0000","last_undegraded":"2024-09-13T19:19:53.682343+0000","last_fullsized":"2024-09-13T19:19:53.682343+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:53.682234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:53.682234+0000","last_clean_scrub_stamp":"2024-09-13T19:19:53.682234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:20.626955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:13.941963+0000","last_change":"2024-09-13T19:15:55.893786+0000","last_active":"2024-09-13T19:18:13.941963+0000","last_peered":"2024-09-13T19:18:13.941963+0000","last_clean":"2024-09-13T19:18:13.941963+0000","last_became_active":"2024-09-13T19:15:55.893489+0000","last_became_peered":"2024-09-13T19:15:55.893489+0000","last_unstale":"2024-09-13T19:18:13.941963+0000","last_undegraded":"2024-09-13T19:18:13.941963+0000","last_fullsized":"2024-09-13T19:18:13.941963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:36.500213+0000","last_change":"2024-09-13T19:19:36.500258+0000","last_active":"2024-09-13T19:19:36.500213+0000","last_peered":"2024-09-13T19:19:36.500213+0000","last_clean":"2024-09-13T19:19:36.500213+0000","last_became_active":"2024-09-13T19:15:59.895291+0000","last_became_peered":"2024-09-13T19:15:59.895291+0000","last_unstale":"2024-09-13T19:19:36.500213+0000","last_undegraded":"2024-09-13T19:19:36.500213+0000","last_fullsized":"2024-09-13T19:19:36.500213+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:36.500113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:36.500113+0000","last_clean_scrub_stamp":"2024-09-13T19:19:36.500113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:16:46.762131+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"36'45","reported_seq":103,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:19.049551+0000","last_change":"2024-09-13T19:19:19.049589+0000","last_active":"2024-09-13T19:19:19.049551+0000","last_peered":"2024-09-13T19:19:19.049551+0000","last_clean":"2024-09-13T19:19:19.049551+0000","last_became_active":"2024-09-13T19:16:01.896507+0000","last_became_peered":"2024-09-13T19:16:01.896507+0000","last_unstale":"2024-09-13T19:19:19.049551+0000","last_undegraded":"2024-09-13T19:19:19.049551+0000","last_fullsized":"2024-09-13T19:19:19.049551+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'45","last_scrub_stamp":"2024-09-13T19:19:19.049456+0000","last_deep_scrub":"36'45","last_deep_scrub_stamp":"2024-09-13T19:19:19.049456+0000","last_clean_scrub_stamp":"2024-09-13T19:19:19.049456+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:40.433022+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"36'285","reported_seq":387,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:21.320872+0000","last_change":"2024-09-13T19:19:21.320904+0000","last_active":"2024-09-13T19:19:21.320872+0000","last_peered":"2024-09-13T19:19:21.320872+0000","last_clean":"2024-09-13T19:19:21.320872+0000","last_became_active":"2024-09-13T19:16:03.910504+0000","last_became_peered":"2024-09-13T19:16:03.910504+0000","last_unstale":"2024-09-13T19:19:21.320872+0000","last_undegraded":"2024-09-13T19:19:21.320872+0000","last_fullsized":"2024-09-13T19:19:21.320872+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-13T19:19:21.320768+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-13T19:19:21.320768+0000","last_clean_scrub_stamp":"2024-09-13T19:19:21.320768+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:21:36.601671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"36'4","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:14.493601+0000","last_change":"2024-09-13T19:20:14.493626+0000","last_active":"2024-09-13T19:20:14.493601+0000","last_peered":"2024-09-13T19:20:14.493601+0000","last_clean":"2024-09-13T19:20:14.493601+0000","last_became_active":"2024-09-13T19:16:05.912881+0000","last_became_peered":"2024-09-13T19:16:05.912881+0000","last_unstale":"2024-09-13T19:20:14.493601+0000","last_undegraded":"2024-09-13T19:20:14.493601+0000","last_fullsized":"2024-09-13T19:20:14.493601+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:20:14.493507+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:20:14.493507+0000","last_clean_scrub_stamp":"2024-09-13T19:20:14.493507+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:11:30.673524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"36'4","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:41.805475+0000","last_change":"2024-09-13T19:19:41.805515+0000","last_active":"2024-09-13T19:19:41.805475+0000","last_peered":"2024-09-13T19:19:41.805475+0000","last_clean":"2024-09-13T19:19:41.805475+0000","last_became_active":"2024-09-13T19:15:57.883675+0000","last_became_peered":"2024-09-13T19:15:57.883675+0000","last_unstale":"2024-09-13T19:19:41.805475+0000","last_undegraded":"2024-09-13T19:19:41.805475+0000","last_fullsized":"2024-09-13T19:19:41.805475+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:19:41.805394+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:19:41.805394+0000","last_clean_scrub_stamp":"2024-09-13T19:19:41.805394+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:11:49.618178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"36'7","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.796438+0000","last_change":"2024-09-13T19:15:55.892801+0000","last_active":"2024-09-13T19:19:12.796438+0000","last_peered":"2024-09-13T19:19:12.796438+0000","last_clean":"2024-09-13T19:19:12.796438+0000","last_became_active":"2024-09-13T19:15:55.891882+0000","last_became_peered":"2024-09-13T19:15:55.891882+0000","last_unstale":"2024-09-13T19:19:12.796438+0000","last_undegraded":"2024-09-13T19:19:12.796438+0000","last_fullsized":"2024-09-13T19:19:12.796438+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":16,"num_write_kb":4722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:10.565233+0000","last_change":"2024-09-13T19:20:10.565263+0000","last_active":"2024-09-13T19:20:10.565233+0000","last_peered":"2024-09-13T19:20:10.565233+0000","last_clean":"2024-09-13T19:20:10.565233+0000","last_became_active":"2024-09-13T19:16:31.992122+0000","last_became_peered":"2024-09-13T19:16:31.992122+0000","last_unstale":"2024-09-13T19:20:10.565233+0000","last_undegraded":"2024-09-13T19:20:10.565233+0000","last_fullsized":"2024-09-13T19:20:10.565233+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:10.565140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:10.565140+0000","last_clean_scrub_stamp":"2024-09-13T19:20:10.565140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:36.265398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"36'66","reported_seq":139,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:44.917475+0000","last_change":"2024-09-13T19:19:44.917516+0000","last_active":"2024-09-13T19:19:44.917475+0000","last_peered":"2024-09-13T19:19:44.917475+0000","last_clean":"2024-09-13T19:19:44.917475+0000","last_became_active":"2024-09-13T19:16:01.906031+0000","last_became_peered":"2024-09-13T19:16:01.906031+0000","last_unstale":"2024-09-13T19:19:44.917475+0000","last_undegraded":"2024-09-13T19:19:44.917475+0000","last_fullsized":"2024-09-13T19:19:44.917475+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'66","last_scrub_stamp":"2024-09-13T19:19:44.917388+0000","last_deep_scrub":"36'66","last_deep_scrub_stamp":"2024-09-13T19:19:44.917388+0000","last_clean_scrub_stamp":"2024-09-13T19:19:44.917388+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:13:12.711321+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:23.383889+0000","last_change":"2024-09-13T19:19:23.383957+0000","last_active":"2024-09-13T19:19:23.383889+0000","last_peered":"2024-09-13T19:19:23.383889+0000","last_clean":"2024-09-13T19:19:23.383889+0000","last_became_active":"2024-09-13T19:16:03.908134+0000","last_became_peered":"2024-09-13T19:16:03.908134+0000","last_unstale":"2024-09-13T19:19:23.383889+0000","last_undegraded":"2024-09-13T19:19:23.383889+0000","last_fullsized":"2024-09-13T19:19:23.383889+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:23.383782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:23.383782+0000","last_clean_scrub_stamp":"2024-09-13T19:19:23.383782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:10.783386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"36'21","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:15.545616+0000","last_change":"2024-09-13T19:20:15.545652+0000","last_active":"2024-09-13T19:20:15.545616+0000","last_peered":"2024-09-13T19:20:15.545616+0000","last_clean":"2024-09-13T19:20:15.545616+0000","last_became_active":"2024-09-13T19:16:05.914853+0000","last_became_peered":"2024-09-13T19:16:05.914853+0000","last_unstale":"2024-09-13T19:20:15.545616+0000","last_undegraded":"2024-09-13T19:20:15.545616+0000","last_fullsized":"2024-09-13T19:20:15.545616+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'21","last_scrub_stamp":"2024-09-13T19:20:15.545533+0000","last_deep_scrub":"36'21","last_deep_scrub_stamp":"2024-09-13T19:20:15.545533+0000","last_clean_scrub_stamp":"2024-09-13T19:20:15.545533+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:59:00.701185+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"36'6","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:37.807480+0000","last_change":"2024-09-13T19:19:37.807504+0000","last_active":"2024-09-13T19:19:37.807480+0000","last_peered":"2024-09-13T19:19:37.807480+0000","last_clean":"2024-09-13T19:19:37.807480+0000","last_became_active":"2024-09-13T19:15:57.902955+0000","last_became_peered":"2024-09-13T19:15:57.902955+0000","last_unstale":"2024-09-13T19:19:37.807480+0000","last_undegraded":"2024-09-13T19:19:37.807480+0000","last_fullsized":"2024-09-13T19:19:37.807480+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:19:37.807394+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:19:37.807394+0000","last_clean_scrub_stamp":"2024-09-13T19:19:37.807394+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:23:23.699122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:05.537016+0000","last_change":"2024-09-13T19:20:05.537039+0000","last_active":"2024-09-13T19:20:05.537016+0000","last_peered":"2024-09-13T19:20:05.537016+0000","last_clean":"2024-09-13T19:20:05.537016+0000","last_became_active":"2024-09-13T19:15:55.890805+0000","last_became_peered":"2024-09-13T19:15:55.890805+0000","last_unstale":"2024-09-13T19:20:05.537016+0000","last_undegraded":"2024-09-13T19:20:05.537016+0000","last_fullsized":"2024-09-13T19:20:05.537016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:05.536913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:05.536913+0000","last_clean_scrub_stamp":"2024-09-13T19:20:05.536913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:08:13.286175+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:32.806761+0000","last_change":"2024-09-13T19:19:32.806783+0000","last_active":"2024-09-13T19:19:32.806761+0000","last_peered":"2024-09-13T19:19:32.806761+0000","last_clean":"2024-09-13T19:19:32.806761+0000","last_became_active":"2024-09-13T19:15:59.897884+0000","last_became_peered":"2024-09-13T19:15:59.897884+0000","last_unstale":"2024-09-13T19:19:32.806761+0000","last_undegraded":"2024-09-13T19:19:32.806761+0000","last_fullsized":"2024-09-13T19:19:32.806761+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:32.806649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:32.806649+0000","last_clean_scrub_stamp":"2024-09-13T19:19:32.806649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:35.455381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"36'41","reported_seq":97,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:21.708435+0000","last_change":"2024-09-13T19:19:21.708485+0000","last_active":"2024-09-13T19:19:21.708435+0000","last_peered":"2024-09-13T19:19:21.708435+0000","last_clean":"2024-09-13T19:19:21.708435+0000","last_became_active":"2024-09-13T19:16:01.902657+0000","last_became_peered":"2024-09-13T19:16:01.902657+0000","last_unstale":"2024-09-13T19:19:21.708435+0000","last_undegraded":"2024-09-13T19:19:21.708435+0000","last_fullsized":"2024-09-13T19:19:21.708435+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'41","last_scrub_stamp":"2024-09-13T19:19:21.708338+0000","last_deep_scrub":"36'41","last_deep_scrub_stamp":"2024-09-13T19:19:21.708338+0000","last_clean_scrub_stamp":"2024-09-13T19:19:21.708338+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:24.621364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":44,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:38.960192+0000","last_change":"2024-09-13T19:19:38.960234+0000","last_active":"2024-09-13T19:19:38.960192+0000","last_peered":"2024-09-13T19:19:38.960192+0000","last_clean":"2024-09-13T19:19:38.960192+0000","last_became_active":"2024-09-13T19:16:03.915499+0000","last_became_peered":"2024-09-13T19:16:03.915499+0000","last_unstale":"2024-09-13T19:19:38.960192+0000","last_undegraded":"2024-09-13T19:19:38.960192+0000","last_fullsized":"2024-09-13T19:19:38.960192+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:38.960096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:38.960096+0000","last_clean_scrub_stamp":"2024-09-13T19:19:38.960096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:34.121371+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"36'4","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:06.957184+0000","last_change":"2024-09-13T19:20:06.957184+0000","last_active":"2024-09-13T19:20:06.957184+0000","last_peered":"2024-09-13T19:20:06.957184+0000","last_clean":"2024-09-13T19:20:06.957184+0000","last_became_active":"2024-09-13T19:16:05.920239+0000","last_became_peered":"2024-09-13T19:16:05.920239+0000","last_unstale":"2024-09-13T19:20:06.957184+0000","last_undegraded":"2024-09-13T19:20:06.957184+0000","last_fullsized":"2024-09-13T19:20:06.957184+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:20:06.957071+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:20:06.957071+0000","last_clean_scrub_stamp":"2024-09-13T19:20:06.957071+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:07:39.659763+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"36'8","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:33.099182+0000","last_change":"2024-09-13T19:19:33.099210+0000","last_active":"2024-09-13T19:19:33.099182+0000","last_peered":"2024-09-13T19:19:33.099182+0000","last_clean":"2024-09-13T19:19:33.099182+0000","last_became_active":"2024-09-13T19:15:57.901131+0000","last_became_peered":"2024-09-13T19:15:57.901131+0000","last_unstale":"2024-09-13T19:19:33.099182+0000","last_undegraded":"2024-09-13T19:19:33.099182+0000","last_fullsized":"2024-09-13T19:19:33.099182+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-13T19:19:33.099097+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-13T19:19:33.099097+0000","last_clean_scrub_stamp":"2024-09-13T19:19:33.099097+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:21:52.129989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:08.941018+0000","last_change":"2024-09-13T19:15:55.900444+0000","last_active":"2024-09-13T19:18:08.941018+0000","last_peered":"2024-09-13T19:18:08.941018+0000","last_clean":"2024-09-13T19:18:08.941018+0000","last_became_active":"2024-09-13T19:15:55.900143+0000","last_became_peered":"2024-09-13T19:15:55.900143+0000","last_unstale":"2024-09-13T19:18:08.941018+0000","last_undegraded":"2024-09-13T19:18:08.941018+0000","last_fullsized":"2024-09-13T19:18:08.941018+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:38.478085+0000","last_change":"2024-09-13T19:19:38.478130+0000","last_active":"2024-09-13T19:19:38.478085+0000","last_peered":"2024-09-13T19:19:38.478085+0000","last_clean":"2024-09-13T19:19:38.478085+0000","last_became_active":"2024-09-13T19:15:59.894793+0000","last_became_peered":"2024-09-13T19:15:59.894793+0000","last_unstale":"2024-09-13T19:19:38.478085+0000","last_undegraded":"2024-09-13T19:19:38.478085+0000","last_fullsized":"2024-09-13T19:19:38.478085+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:38.477940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:38.477940+0000","last_clean_scrub_stamp":"2024-09-13T19:19:38.477940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:10.926294+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"36'45","reported_seq":103,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:30.838950+0000","last_change":"2024-09-13T19:19:30.838996+0000","last_active":"2024-09-13T19:19:30.838950+0000","last_peered":"2024-09-13T19:19:30.838950+0000","last_clean":"2024-09-13T19:19:30.838950+0000","last_became_active":"2024-09-13T19:16:01.897733+0000","last_became_peered":"2024-09-13T19:16:01.897733+0000","last_unstale":"2024-09-13T19:19:30.838950+0000","last_undegraded":"2024-09-13T19:19:30.838950+0000","last_fullsized":"2024-09-13T19:19:30.838950+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'45","last_scrub_stamp":"2024-09-13T19:19:30.838860+0000","last_deep_scrub":"36'45","last_deep_scrub_stamp":"2024-09-13T19:19:30.838860+0000","last_clean_scrub_stamp":"2024-09-13T19:19:30.838860+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:39:39.517349+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"36'285","reported_seq":421,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:23.814436+0000","last_change":"2024-09-13T19:19:23.814508+0000","last_active":"2024-09-13T19:19:23.814436+0000","last_peered":"2024-09-13T19:19:23.814436+0000","last_clean":"2024-09-13T19:19:23.814436+0000","last_became_active":"2024-09-13T19:16:03.915589+0000","last_became_peered":"2024-09-13T19:16:03.915589+0000","last_unstale":"2024-09-13T19:19:23.814436+0000","last_undegraded":"2024-09-13T19:19:23.814436+0000","last_fullsized":"2024-09-13T19:19:23.814436+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-13T19:19:23.814324+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-13T19:19:23.814324+0000","last_clean_scrub_stamp":"2024-09-13T19:19:23.814324+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:26.983039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"36'13","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:12.475238+0000","last_change":"2024-09-13T19:20:12.475238+0000","last_active":"2024-09-13T19:20:12.475238+0000","last_peered":"2024-09-13T19:20:12.475238+0000","last_clean":"2024-09-13T19:20:12.475238+0000","last_became_active":"2024-09-13T19:16:05.912339+0000","last_became_peered":"2024-09-13T19:16:05.912339+0000","last_unstale":"2024-09-13T19:20:12.475238+0000","last_undegraded":"2024-09-13T19:20:12.475238+0000","last_fullsized":"2024-09-13T19:20:12.475238+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'13","last_scrub_stamp":"2024-09-13T19:20:12.475107+0000","last_deep_scrub":"36'13","last_deep_scrub_stamp":"2024-09-13T19:20:12.475107+0000","last_clean_scrub_stamp":"2024-09-13T19:20:12.475107+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:23:20.507295+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"36'6","reported_seq":68,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:40.761675+0000","last_change":"2024-09-13T19:19:40.761706+0000","last_active":"2024-09-13T19:19:40.761675+0000","last_peered":"2024-09-13T19:19:40.761675+0000","last_clean":"2024-09-13T19:19:40.761675+0000","last_became_active":"2024-09-13T19:15:57.900560+0000","last_became_peered":"2024-09-13T19:15:57.900560+0000","last_unstale":"2024-09-13T19:19:40.761675+0000","last_undegraded":"2024-09-13T19:19:40.761675+0000","last_fullsized":"2024-09-13T19:19:40.761675+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:19:40.761587+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:19:40.761587+0000","last_clean_scrub_stamp":"2024-09-13T19:19:40.761587+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:45.661345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:08.940978+0000","last_change":"2024-09-13T19:15:55.897670+0000","last_active":"2024-09-13T19:18:08.940978+0000","last_peered":"2024-09-13T19:18:08.940978+0000","last_clean":"2024-09-13T19:18:08.940978+0000","last_became_active":"2024-09-13T19:15:55.895799+0000","last_became_peered":"2024-09-13T19:15:55.895799+0000","last_unstale":"2024-09-13T19:18:08.940978+0000","last_undegraded":"2024-09-13T19:18:08.940978+0000","last_fullsized":"2024-09-13T19:18:08.940978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'5","reported_seq":428,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:28.767953+0000","last_change":"2024-09-13T19:19:28.767985+0000","last_active":"2024-09-13T19:19:28.767953+0000","last_peered":"2024-09-13T19:19:28.767953+0000","last_clean":"2024-09-13T19:19:28.767953+0000","last_became_active":"2024-09-13T19:15:59.894303+0000","last_became_peered":"2024-09-13T19:15:59.894303+0000","last_unstale":"2024-09-13T19:19:28.767953+0000","last_undegraded":"2024-09-13T19:19:28.767953+0000","last_fullsized":"2024-09-13T19:19:28.767953+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-09-13T19:19:28.767856+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-09-13T19:19:28.767856+0000","last_clean_scrub_stamp":"2024-09-13T19:19:28.767856+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:10.640290+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"36'15","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:43.951874+0000","last_change":"2024-09-13T19:19:43.951910+0000","last_active":"2024-09-13T19:19:43.951874+0000","last_peered":"2024-09-13T19:19:43.951874+0000","last_clean":"2024-09-13T19:19:43.951874+0000","last_became_active":"2024-09-13T19:16:01.906490+0000","last_became_peered":"2024-09-13T19:16:01.906490+0000","last_unstale":"2024-09-13T19:19:43.951874+0000","last_undegraded":"2024-09-13T19:19:43.951874+0000","last_fullsized":"2024-09-13T19:19:43.951874+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'15","last_scrub_stamp":"2024-09-13T19:19:43.951784+0000","last_deep_scrub":"36'15","last_deep_scrub_stamp":"2024-09-13T19:19:43.951784+0000","last_clean_scrub_stamp":"2024-09-13T19:19:43.951784+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:38.693730+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"36'285","reported_seq":511,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:19.722812+0000","last_change":"2024-09-13T19:19:19.722840+0000","last_active":"2024-09-13T19:19:19.722812+0000","last_peered":"2024-09-13T19:19:19.722812+0000","last_clean":"2024-09-13T19:19:19.722812+0000","last_became_active":"2024-09-13T19:16:03.905523+0000","last_became_peered":"2024-09-13T19:16:03.905523+0000","last_unstale":"2024-09-13T19:19:19.722812+0000","last_undegraded":"2024-09-13T19:19:19.722812+0000","last_fullsized":"2024-09-13T19:19:19.722812+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-13T19:19:19.722719+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-13T19:19:19.722719+0000","last_clean_scrub_stamp":"2024-09-13T19:19:19.722719+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:33.649384+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"36'4","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:27.845980+0000","last_change":"2024-09-13T19:19:27.846042+0000","last_active":"2024-09-13T19:19:27.845980+0000","last_peered":"2024-09-13T19:19:27.845980+0000","last_clean":"2024-09-13T19:19:27.845980+0000","last_became_active":"2024-09-13T19:16:05.910656+0000","last_became_peered":"2024-09-13T19:16:05.910656+0000","last_unstale":"2024-09-13T19:19:27.845980+0000","last_undegraded":"2024-09-13T19:19:27.845980+0000","last_fullsized":"2024-09-13T19:19:27.845980+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:19:27.845857+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:19:27.845857+0000","last_clean_scrub_stamp":"2024-09-13T19:19:27.845857+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:46.547978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"36'3","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:34.847598+0000","last_change":"2024-09-13T19:19:34.847663+0000","last_active":"2024-09-13T19:19:34.847598+0000","last_peered":"2024-09-13T19:19:34.847598+0000","last_clean":"2024-09-13T19:19:34.847598+0000","last_became_active":"2024-09-13T19:15:57.903761+0000","last_became_peered":"2024-09-13T19:15:57.903761+0000","last_unstale":"2024-09-13T19:19:34.847598+0000","last_undegraded":"2024-09-13T19:19:34.847598+0000","last_fullsized":"2024-09-13T19:19:34.847598+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-13T19:19:34.847491+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-13T19:19:34.847491+0000","last_clean_scrub_stamp":"2024-09-13T19:19:34.847491+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:49.358180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:08.940925+0000","last_change":"2024-09-13T19:15:55.900225+0000","last_active":"2024-09-13T19:18:08.940925+0000","last_peered":"2024-09-13T19:18:08.940925+0000","last_clean":"2024-09-13T19:18:08.940925+0000","last_became_active":"2024-09-13T19:15:55.899919+0000","last_became_peered":"2024-09-13T19:15:55.899919+0000","last_unstale":"2024-09-13T19:18:08.940925+0000","last_undegraded":"2024-09-13T19:18:08.940925+0000","last_fullsized":"2024-09-13T19:18:08.940925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"36'5","reported_seq":238,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:18.034886+0000","last_change":"2024-09-13T19:19:18.034914+0000","last_active":"2024-09-13T19:19:18.034886+0000","last_peered":"2024-09-13T19:19:18.034886+0000","last_clean":"2024-09-13T19:19:18.034886+0000","last_became_active":"2024-09-13T19:15:59.896081+0000","last_became_peered":"2024-09-13T19:15:59.896081+0000","last_unstale":"2024-09-13T19:19:18.034886+0000","last_undegraded":"2024-09-13T19:19:18.034886+0000","last_fullsized":"2024-09-13T19:19:18.034886+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-09-13T19:19:18.034798+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-09-13T19:19:18.034798+0000","last_clean_scrub_stamp":"2024-09-13T19:19:18.034798+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:47.783875+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"36'49","reported_seq":108,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:22.687814+0000","last_change":"2024-09-13T19:19:22.687872+0000","last_active":"2024-09-13T19:19:22.687814+0000","last_peered":"2024-09-13T19:19:22.687814+0000","last_clean":"2024-09-13T19:19:22.687814+0000","last_became_active":"2024-09-13T19:16:01.902532+0000","last_became_peered":"2024-09-13T19:16:01.902532+0000","last_unstale":"2024-09-13T19:19:22.687814+0000","last_undegraded":"2024-09-13T19:19:22.687814+0000","last_fullsized":"2024-09-13T19:19:22.687814+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'49","last_scrub_stamp":"2024-09-13T19:19:22.687725+0000","last_deep_scrub":"36'49","last_deep_scrub_stamp":"2024-09-13T19:19:22.687725+0000","last_clean_scrub_stamp":"2024-09-13T19:19:22.687725+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:20.499665+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:17.747793+0000","last_change":"2024-09-13T19:19:17.747855+0000","last_active":"2024-09-13T19:19:17.747793+0000","last_peered":"2024-09-13T19:19:17.747793+0000","last_clean":"2024-09-13T19:19:17.747793+0000","last_became_active":"2024-09-13T19:16:03.913019+0000","last_became_peered":"2024-09-13T19:16:03.913019+0000","last_unstale":"2024-09-13T19:19:17.747793+0000","last_undegraded":"2024-09-13T19:19:17.747793+0000","last_fullsized":"2024-09-13T19:19:17.747793+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:17.747683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:17.747683+0000","last_clean_scrub_stamp":"2024-09-13T19:19:17.747683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:01.675286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"36'9","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:43.841962+0000","last_change":"2024-09-13T19:19:43.841990+0000","last_active":"2024-09-13T19:19:43.841962+0000","last_peered":"2024-09-13T19:19:43.841962+0000","last_clean":"2024-09-13T19:19:43.841962+0000","last_became_active":"2024-09-13T19:16:05.911364+0000","last_became_peered":"2024-09-13T19:16:05.911364+0000","last_unstale":"2024-09-13T19:19:43.841962+0000","last_undegraded":"2024-09-13T19:19:43.841962+0000","last_fullsized":"2024-09-13T19:19:43.841962+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'9","last_scrub_stamp":"2024-09-13T19:19:43.841870+0000","last_deep_scrub":"36'9","last_deep_scrub_stamp":"2024-09-13T19:19:43.841870+0000","last_clean_scrub_stamp":"2024-09-13T19:19:43.841870+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:01.817243+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"36'13","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:32.054330+0000","last_change":"2024-09-13T19:19:32.054330+0000","last_active":"2024-09-13T19:19:32.054330+0000","last_peered":"2024-09-13T19:19:32.054330+0000","last_clean":"2024-09-13T19:19:32.054330+0000","last_became_active":"2024-09-13T19:15:57.900905+0000","last_became_peered":"2024-09-13T19:15:57.900905+0000","last_unstale":"2024-09-13T19:19:32.054330+0000","last_undegraded":"2024-09-13T19:19:32.054330+0000","last_fullsized":"2024-09-13T19:19:32.054330+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'13","last_scrub_stamp":"2024-09-13T19:19:32.054214+0000","last_deep_scrub":"36'13","last_deep_scrub_stamp":"2024-09-13T19:19:32.054214+0000","last_clean_scrub_stamp":"2024-09-13T19:19:32.054214+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:27.473875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"36'119","reported_seq":217,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:02.103919+0000","last_change":"2024-09-13T19:20:02.103971+0000","last_active":"2024-09-13T19:20:02.103919+0000","last_peered":"2024-09-13T19:20:02.103919+0000","last_clean":"2024-09-13T19:20:02.103919+0000","last_became_active":"2024-09-13T19:15:41.169707+0000","last_became_peered":"2024-09-13T19:15:41.169707+0000","last_unstale":"2024-09-13T19:20:02.103919+0000","last_undegraded":"2024-09-13T19:20:02.103919+0000","last_fullsized":"2024-09-13T19:20:02.103919+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'119","last_scrub_stamp":"2024-09-13T19:20:02.103817+0000","last_deep_scrub":"36'119","last_deep_scrub_stamp":"2024-09-13T19:20:02.103817+0000","last_clean_scrub_stamp":"2024-09-13T19:20:02.103817+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:35:48.526437+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:16.976065+0000","last_change":"2024-09-13T19:15:46.580815+0000","last_active":"2024-09-13T19:19:16.976065+0000","last_peered":"2024-09-13T19:19:16.976065+0000","last_clean":"2024-09-13T19:19:16.976065+0000","last_became_active":"2024-09-13T19:15:44.577382+0000","last_became_peered":"2024-09-13T19:15:44.577382+0000","last_unstale":"2024-09-13T19:19:16.976065+0000","last_undegraded":"2024-09-13T19:19:16.976065+0000","last_fullsized":"2024-09-13T19:19:16.976065+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047916199999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:05.909175+0000","last_change":"2024-09-13T19:20:05.909175+0000","last_active":"2024-09-13T19:20:05.909175+0000","last_peered":"2024-09-13T19:20:05.909175+0000","last_clean":"2024-09-13T19:20:05.909175+0000","last_became_active":"2024-09-13T19:15:55.899672+0000","last_became_peered":"2024-09-13T19:15:55.899672+0000","last_unstale":"2024-09-13T19:20:05.909175+0000","last_undegraded":"2024-09-13T19:20:05.909175+0000","last_fullsized":"2024-09-13T19:20:05.909175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:05.909049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:05.909049+0000","last_clean_scrub_stamp":"2024-09-13T19:20:05.909049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:51.724581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:33.821056+0000","last_change":"2024-09-13T19:19:33.821056+0000","last_active":"2024-09-13T19:19:33.821056+0000","last_peered":"2024-09-13T19:19:33.821056+0000","last_clean":"2024-09-13T19:19:33.821056+0000","last_became_active":"2024-09-13T19:15:59.891615+0000","last_became_peered":"2024-09-13T19:15:59.891615+0000","last_unstale":"2024-09-13T19:19:33.821056+0000","last_undegraded":"2024-09-13T19:19:33.821056+0000","last_fullsized":"2024-09-13T19:19:33.821056+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:33.820938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:33.820938+0000","last_clean_scrub_stamp":"2024-09-13T19:19:33.820938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:08.178435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"36'87","reported_seq":177,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:35.064023+0000","last_change":"2024-09-13T19:19:35.064073+0000","last_active":"2024-09-13T19:19:35.064023+0000","last_peered":"2024-09-13T19:19:35.064023+0000","last_clean":"2024-09-13T19:19:35.064023+0000","last_became_active":"2024-09-13T19:16:01.905085+0000","last_became_peered":"2024-09-13T19:16:01.905085+0000","last_unstale":"2024-09-13T19:19:35.064023+0000","last_undegraded":"2024-09-13T19:19:35.064023+0000","last_fullsized":"2024-09-13T19:19:35.064023+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'87","last_scrub_stamp":"2024-09-13T19:19:35.063922+0000","last_deep_scrub":"36'87","last_deep_scrub_stamp":"2024-09-13T19:19:35.063922+0000","last_clean_scrub_stamp":"2024-09-13T19:19:35.063922+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:35:21.486542+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:29.339028+0000","last_change":"2024-09-13T19:19:29.339050+0000","last_active":"2024-09-13T19:19:29.339028+0000","last_peered":"2024-09-13T19:19:29.339028+0000","last_clean":"2024-09-13T19:19:29.339028+0000","last_became_active":"2024-09-13T19:16:03.913802+0000","last_became_peered":"2024-09-13T19:16:03.913802+0000","last_unstale":"2024-09-13T19:19:29.339028+0000","last_undegraded":"2024-09-13T19:19:29.339028+0000","last_fullsized":"2024-09-13T19:19:29.339028+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:29.338926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:29.338926+0000","last_clean_scrub_stamp":"2024-09-13T19:19:29.338926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:01.790473+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"36'89","reported_seq":196,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:35.858476+0000","last_change":"2024-09-13T19:19:35.858501+0000","last_active":"2024-09-13T19:19:35.858476+0000","last_peered":"2024-09-13T19:19:35.858476+0000","last_clean":"2024-09-13T19:19:35.858476+0000","last_became_active":"2024-09-13T19:16:05.911595+0000","last_became_peered":"2024-09-13T19:16:05.911595+0000","last_unstale":"2024-09-13T19:19:35.858476+0000","last_undegraded":"2024-09-13T19:19:35.858476+0000","last_fullsized":"2024-09-13T19:19:35.858476+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'89","last_scrub_stamp":"2024-09-13T19:19:35.858385+0000","last_deep_scrub":"36'89","last_deep_scrub_stamp":"2024-09-13T19:19:35.858385+0000","last_clean_scrub_stamp":"2024-09-13T19:19:35.858385+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:44:48.738301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":289,"num_read_kb":269,"num_write":182,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"36'4","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:51.888317+0000","last_change":"2024-09-13T19:19:51.888342+0000","last_active":"2024-09-13T19:19:51.888317+0000","last_peered":"2024-09-13T19:19:51.888317+0000","last_clean":"2024-09-13T19:19:51.888317+0000","last_became_active":"2024-09-13T19:15:57.897307+0000","last_became_peered":"2024-09-13T19:15:57.897307+0000","last_unstale":"2024-09-13T19:19:51.888317+0000","last_undegraded":"2024-09-13T19:19:51.888317+0000","last_fullsized":"2024-09-13T19:19:51.888317+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:19:51.888223+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:19:51.888223+0000","last_clean_scrub_stamp":"2024-09-13T19:19:51.888223+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:42:47.629919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:16.976055+0000","last_change":"2024-09-13T19:15:46.581436+0000","last_active":"2024-09-13T19:19:16.976055+0000","last_peered":"2024-09-13T19:19:16.976055+0000","last_clean":"2024-09-13T19:19:16.976055+0000","last_became_active":"2024-09-13T19:15:44.576304+0000","last_became_peered":"2024-09-13T19:15:44.576304+0000","last_unstale":"2024-09-13T19:19:16.976055+0000","last_undegraded":"2024-09-13T19:19:16.976055+0000","last_fullsized":"2024-09-13T19:19:16.976055+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011332060000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"36'4","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:07.532251+0000","last_change":"2024-09-13T19:20:07.532331+0000","last_active":"2024-09-13T19:20:07.532251+0000","last_peered":"2024-09-13T19:20:07.532251+0000","last_clean":"2024-09-13T19:20:07.532251+0000","last_became_active":"2024-09-13T19:15:55.891377+0000","last_became_peered":"2024-09-13T19:15:55.891377+0000","last_unstale":"2024-09-13T19:20:07.532251+0000","last_undegraded":"2024-09-13T19:20:07.532251+0000","last_fullsized":"2024-09-13T19:20:07.532251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:20:07.532141+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:20:07.532141+0000","last_clean_scrub_stamp":"2024-09-13T19:20:07.532141+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:36.325943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:22.038984+0000","last_change":"2024-09-13T19:19:22.039024+0000","last_active":"2024-09-13T19:19:22.038984+0000","last_peered":"2024-09-13T19:19:22.038984+0000","last_clean":"2024-09-13T19:19:22.038984+0000","last_became_active":"2024-09-13T19:15:59.896248+0000","last_became_peered":"2024-09-13T19:15:59.896248+0000","last_unstale":"2024-09-13T19:19:22.038984+0000","last_undegraded":"2024-09-13T19:19:22.038984+0000","last_fullsized":"2024-09-13T19:19:22.038984+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:22.038847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:22.038847+0000","last_clean_scrub_stamp":"2024-09-13T19:19:22.038847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:43:03.494237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"36'291","reported_seq":517,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:17.746426+0000","last_change":"2024-09-13T19:19:17.746426+0000","last_active":"2024-09-13T19:19:17.746426+0000","last_peered":"2024-09-13T19:19:17.746426+0000","last_clean":"2024-09-13T19:19:17.746426+0000","last_became_active":"2024-09-13T19:16:01.907024+0000","last_became_peered":"2024-09-13T19:16:01.907024+0000","last_unstale":"2024-09-13T19:19:17.746426+0000","last_undegraded":"2024-09-13T19:19:17.746426+0000","last_fullsized":"2024-09-13T19:19:17.746426+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'291","last_scrub_stamp":"2024-09-13T19:19:17.746277+0000","last_deep_scrub":"36'291","last_deep_scrub_stamp":"2024-09-13T19:19:17.746277+0000","last_clean_scrub_stamp":"2024-09-13T19:19:17.746277+0000","objects_scrubbed":10,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:14.177663+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:42.977665+0000","last_change":"2024-09-13T19:19:42.977665+0000","last_active":"2024-09-13T19:19:42.977665+0000","last_peered":"2024-09-13T19:19:42.977665+0000","last_clean":"2024-09-13T19:19:42.977665+0000","last_became_active":"2024-09-13T19:16:03.915712+0000","last_became_peered":"2024-09-13T19:16:03.915712+0000","last_unstale":"2024-09-13T19:19:42.977665+0000","last_undegraded":"2024-09-13T19:19:42.977665+0000","last_fullsized":"2024-09-13T19:19:42.977665+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:42.977545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:42.977545+0000","last_clean_scrub_stamp":"2024-09-13T19:19:42.977545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:25.110230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"36'3","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:13.028914+0000","last_change":"2024-09-13T19:20:13.028953+0000","last_active":"2024-09-13T19:20:13.028914+0000","last_peered":"2024-09-13T19:20:13.028914+0000","last_clean":"2024-09-13T19:20:13.028914+0000","last_became_active":"2024-09-13T19:16:05.916999+0000","last_became_peered":"2024-09-13T19:16:05.916999+0000","last_unstale":"2024-09-13T19:20:13.028914+0000","last_undegraded":"2024-09-13T19:20:13.028914+0000","last_fullsized":"2024-09-13T19:20:13.028914+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-13T19:20:13.028808+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-13T19:20:13.028808+0000","last_clean_scrub_stamp":"2024-09-13T19:20:13.028808+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:31:31.828079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:59.635953+0000","last_change":"2024-09-13T19:19:59.635953+0000","last_active":"2024-09-13T19:19:59.635953+0000","last_peered":"2024-09-13T19:19:59.635953+0000","last_clean":"2024-09-13T19:19:59.635953+0000","last_became_active":"2024-09-13T19:15:57.889885+0000","last_became_peered":"2024-09-13T19:15:57.889885+0000","last_unstale":"2024-09-13T19:19:59.635953+0000","last_undegraded":"2024-09-13T19:19:59.635953+0000","last_fullsized":"2024-09-13T19:19:59.635953+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:19:59.635832+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:19:59.635832+0000","last_clean_scrub_stamp":"2024-09-13T19:19:59.635832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:11.239363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:57.558472+0000","last_change":"2024-09-13T19:19:57.558512+0000","last_active":"2024-09-13T19:19:57.558472+0000","last_peered":"2024-09-13T19:19:57.558472+0000","last_clean":"2024-09-13T19:19:57.558472+0000","last_became_active":"2024-09-13T19:15:44.575483+0000","last_became_peered":"2024-09-13T19:15:44.575483+0000","last_unstale":"2024-09-13T19:19:57.558472+0000","last_undegraded":"2024-09-13T19:19:57.558472+0000","last_fullsized":"2024-09-13T19:19:57.558472+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:57.558357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:57.558357+0000","last_clean_scrub_stamp":"2024-09-13T19:19:57.558357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:49.942957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036796000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"36'6","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:10.464777+0000","last_change":"2024-09-13T19:20:10.464804+0000","last_active":"2024-09-13T19:20:10.464777+0000","last_peered":"2024-09-13T19:20:10.464777+0000","last_clean":"2024-09-13T19:20:10.464777+0000","last_became_active":"2024-09-13T19:15:55.892629+0000","last_became_peered":"2024-09-13T19:15:55.892629+0000","last_unstale":"2024-09-13T19:20:10.464777+0000","last_undegraded":"2024-09-13T19:20:10.464777+0000","last_fullsized":"2024-09-13T19:20:10.464777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:20:10.464678+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:20:10.464678+0000","last_clean_scrub_stamp":"2024-09-13T19:20:10.464678+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:02:22.663147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"36'2","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:36.826974+0000","last_change":"2024-09-13T19:19:36.827027+0000","last_active":"2024-09-13T19:19:36.826974+0000","last_peered":"2024-09-13T19:19:36.826974+0000","last_clean":"2024-09-13T19:19:36.826974+0000","last_became_active":"2024-09-13T19:15:59.891588+0000","last_became_peered":"2024-09-13T19:15:59.891588+0000","last_unstale":"2024-09-13T19:19:36.826974+0000","last_undegraded":"2024-09-13T19:19:36.826974+0000","last_fullsized":"2024-09-13T19:19:36.826974+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:36.826862+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:36.826862+0000","last_clean_scrub_stamp":"2024-09-13T19:19:36.826862+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:13:00.231898+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'23","reported_seq":101,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:28.812189+0000","last_change":"2024-09-13T19:19:28.812189+0000","last_active":"2024-09-13T19:19:28.812189+0000","last_peered":"2024-09-13T19:19:28.812189+0000","last_clean":"2024-09-13T19:19:28.812189+0000","last_became_active":"2024-09-13T19:16:01.903947+0000","last_became_peered":"2024-09-13T19:16:01.903947+0000","last_unstale":"2024-09-13T19:19:28.812189+0000","last_undegraded":"2024-09-13T19:19:28.812189+0000","last_fullsized":"2024-09-13T19:19:28.812189+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'23","last_scrub_stamp":"2024-09-13T19:19:28.812026+0000","last_deep_scrub":"36'23","last_deep_scrub_stamp":"2024-09-13T19:19:28.812026+0000","last_clean_scrub_stamp":"2024-09-13T19:19:28.812026+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:37.761542+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:17.389541+0000","last_change":"2024-09-13T19:19:17.389541+0000","last_active":"2024-09-13T19:19:17.389541+0000","last_peered":"2024-09-13T19:19:17.389541+0000","last_clean":"2024-09-13T19:19:17.389541+0000","last_became_active":"2024-09-13T19:16:03.910776+0000","last_became_peered":"2024-09-13T19:16:03.910776+0000","last_unstale":"2024-09-13T19:19:17.389541+0000","last_undegraded":"2024-09-13T19:19:17.389541+0000","last_fullsized":"2024-09-13T19:19:17.389541+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:17.389460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:17.389460+0000","last_clean_scrub_stamp":"2024-09-13T19:19:17.389460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:17:14.265847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"36'2","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:02.955991+0000","last_change":"2024-09-13T19:20:02.956015+0000","last_active":"2024-09-13T19:20:02.955991+0000","last_peered":"2024-09-13T19:20:02.955991+0000","last_clean":"2024-09-13T19:20:02.955991+0000","last_became_active":"2024-09-13T19:16:05.920191+0000","last_became_peered":"2024-09-13T19:16:05.920191+0000","last_unstale":"2024-09-13T19:20:02.955991+0000","last_undegraded":"2024-09-13T19:20:02.955991+0000","last_fullsized":"2024-09-13T19:20:02.955991+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:20:02.955898+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:20:02.955898+0000","last_clean_scrub_stamp":"2024-09-13T19:20:02.955898+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:47:52.449314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"36'12","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:51.707637+0000","last_change":"2024-09-13T19:19:51.707637+0000","last_active":"2024-09-13T19:19:51.707637+0000","last_peered":"2024-09-13T19:19:51.707637+0000","last_clean":"2024-09-13T19:19:51.707637+0000","last_became_active":"2024-09-13T19:15:57.886273+0000","last_became_peered":"2024-09-13T19:15:57.886273+0000","last_unstale":"2024-09-13T19:19:51.707637+0000","last_undegraded":"2024-09-13T19:19:51.707637+0000","last_fullsized":"2024-09-13T19:19:51.707637+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-13T19:19:51.707517+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-13T19:19:51.707517+0000","last_clean_scrub_stamp":"2024-09-13T19:19:51.707517+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:13.558324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":44,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:16.975976+0000","last_change":"2024-09-13T19:15:46.581526+0000","last_active":"2024-09-13T19:19:16.975976+0000","last_peered":"2024-09-13T19:19:16.975976+0000","last_clean":"2024-09-13T19:19:16.975976+0000","last_became_active":"2024-09-13T19:15:44.576052+0000","last_became_peered":"2024-09-13T19:15:44.576052+0000","last_unstale":"2024-09-13T19:19:16.975976+0000","last_undegraded":"2024-09-13T19:19:16.975976+0000","last_fullsized":"2024-09-13T19:19:16.975976+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012221599999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"36'4","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:04.539043+0000","last_change":"2024-09-13T19:20:04.539043+0000","last_active":"2024-09-13T19:20:04.539043+0000","last_peered":"2024-09-13T19:20:04.539043+0000","last_clean":"2024-09-13T19:20:04.539043+0000","last_became_active":"2024-09-13T19:15:55.892636+0000","last_became_peered":"2024-09-13T19:15:55.892636+0000","last_unstale":"2024-09-13T19:20:04.539043+0000","last_undegraded":"2024-09-13T19:20:04.539043+0000","last_fullsized":"2024-09-13T19:20:04.539043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:20:04.538913+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:20:04.538913+0000","last_clean_scrub_stamp":"2024-09-13T19:20:04.538913+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:59.958573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:34.461541+0000","last_change":"2024-09-13T19:19:34.461541+0000","last_active":"2024-09-13T19:19:34.461541+0000","last_peered":"2024-09-13T19:19:34.461541+0000","last_clean":"2024-09-13T19:19:34.461541+0000","last_became_active":"2024-09-13T19:15:59.896248+0000","last_became_peered":"2024-09-13T19:15:59.896248+0000","last_unstale":"2024-09-13T19:19:34.461541+0000","last_undegraded":"2024-09-13T19:19:34.461541+0000","last_fullsized":"2024-09-13T19:19:34.461541+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:34.461398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:34.461398+0000","last_clean_scrub_stamp":"2024-09-13T19:19:34.461398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:38.595301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'20","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:47.912400+0000","last_change":"2024-09-13T19:19:47.912445+0000","last_active":"2024-09-13T19:19:47.912400+0000","last_peered":"2024-09-13T19:19:47.912400+0000","last_clean":"2024-09-13T19:19:47.912400+0000","last_became_active":"2024-09-13T19:16:01.905280+0000","last_became_peered":"2024-09-13T19:16:01.905280+0000","last_unstale":"2024-09-13T19:19:47.912400+0000","last_undegraded":"2024-09-13T19:19:47.912400+0000","last_fullsized":"2024-09-13T19:19:47.912400+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'20","last_scrub_stamp":"2024-09-13T19:19:47.912299+0000","last_deep_scrub":"36'20","last_deep_scrub_stamp":"2024-09-13T19:19:47.912299+0000","last_clean_scrub_stamp":"2024-09-13T19:19:47.912299+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:39.230968+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:46.871068+0000","last_change":"2024-09-13T19:19:46.871092+0000","last_active":"2024-09-13T19:19:46.871068+0000","last_peered":"2024-09-13T19:19:46.871068+0000","last_clean":"2024-09-13T19:19:46.871068+0000","last_became_active":"2024-09-13T19:16:03.916344+0000","last_became_peered":"2024-09-13T19:16:03.916344+0000","last_unstale":"2024-09-13T19:19:46.871068+0000","last_undegraded":"2024-09-13T19:19:46.871068+0000","last_fullsized":"2024-09-13T19:19:46.871068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:46.870973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:46.870973+0000","last_clean_scrub_stamp":"2024-09-13T19:19:46.870973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:23:10.637473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"36'4","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:18.941983+0000","last_change":"2024-09-13T19:16:05.919765+0000","last_active":"2024-09-13T19:18:18.941983+0000","last_peered":"2024-09-13T19:18:18.941983+0000","last_clean":"2024-09-13T19:18:18.941983+0000","last_became_active":"2024-09-13T19:16:05.919156+0000","last_became_peered":"2024-09-13T19:16:05.919156+0000","last_unstale":"2024-09-13T19:18:18.941983+0000","last_undegraded":"2024-09-13T19:18:18.941983+0000","last_fullsized":"2024-09-13T19:18:18.941983+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"36'18","reported_seq":79,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:40.864674+0000","last_change":"2024-09-13T19:19:40.864674+0000","last_active":"2024-09-13T19:19:40.864674+0000","last_peered":"2024-09-13T19:19:40.864674+0000","last_clean":"2024-09-13T19:19:40.864674+0000","last_became_active":"2024-09-13T19:15:57.902819+0000","last_became_peered":"2024-09-13T19:15:57.902819+0000","last_unstale":"2024-09-13T19:19:40.864674+0000","last_undegraded":"2024-09-13T19:19:40.864674+0000","last_fullsized":"2024-09-13T19:19:40.864674+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'18","last_scrub_stamp":"2024-09-13T19:19:40.864526+0000","last_deep_scrub":"36'18","last_deep_scrub_stamp":"2024-09-13T19:19:40.864526+0000","last_clean_scrub_stamp":"2024-09-13T19:19:40.864526+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:41.407519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":50,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:56.588557+0000","last_change":"2024-09-13T19:19:56.588557+0000","last_active":"2024-09-13T19:19:56.588557+0000","last_peered":"2024-09-13T19:19:56.588557+0000","last_clean":"2024-09-13T19:19:56.588557+0000","last_became_active":"2024-09-13T19:15:55.893468+0000","last_became_peered":"2024-09-13T19:15:55.893468+0000","last_unstale":"2024-09-13T19:19:56.588557+0000","last_undegraded":"2024-09-13T19:19:56.588557+0000","last_fullsized":"2024-09-13T19:19:56.588557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:19:56.588443+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:19:56.588443+0000","last_clean_scrub_stamp":"2024-09-13T19:19:56.588443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:05.049618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:04.583147+0000","last_change":"2024-09-13T19:20:04.583169+0000","last_active":"2024-09-13T19:20:04.583147+0000","last_peered":"2024-09-13T19:20:04.583147+0000","last_clean":"2024-09-13T19:20:04.583147+0000","last_became_active":"2024-09-13T19:15:44.575726+0000","last_became_peered":"2024-09-13T19:15:44.575726+0000","last_unstale":"2024-09-13T19:20:04.583147+0000","last_undegraded":"2024-09-13T19:20:04.583147+0000","last_fullsized":"2024-09-13T19:20:04.583147+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:04.583059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:04.583059+0000","last_clean_scrub_stamp":"2024-09-13T19:20:04.583059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:35:00.459031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041430200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"36'2","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:08.533247+0000","last_change":"2024-09-13T19:20:08.533281+0000","last_active":"2024-09-13T19:20:08.533247+0000","last_peered":"2024-09-13T19:20:08.533247+0000","last_clean":"2024-09-13T19:20:08.533247+0000","last_became_active":"2024-09-13T19:16:31.990669+0000","last_became_peered":"2024-09-13T19:16:31.990669+0000","last_unstale":"2024-09-13T19:20:08.533247+0000","last_undegraded":"2024-09-13T19:20:08.533247+0000","last_fullsized":"2024-09-13T19:20:08.533247+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:20:08.533151+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:20:08.533151+0000","last_clean_scrub_stamp":"2024-09-13T19:20:08.533151+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:56:29.841704+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"36'73","reported_seq":150,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:28.341123+0000","last_change":"2024-09-13T19:19:28.341123+0000","last_active":"2024-09-13T19:19:28.341123+0000","last_peered":"2024-09-13T19:19:28.341123+0000","last_clean":"2024-09-13T19:19:28.341123+0000","last_became_active":"2024-09-13T19:16:01.902095+0000","last_became_peered":"2024-09-13T19:16:01.902095+0000","last_unstale":"2024-09-13T19:19:28.341123+0000","last_undegraded":"2024-09-13T19:19:28.341123+0000","last_fullsized":"2024-09-13T19:19:28.341123+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'73","last_scrub_stamp":"2024-09-13T19:19:28.340973+0000","last_deep_scrub":"36'73","last_deep_scrub_stamp":"2024-09-13T19:19:28.340973+0000","last_clean_scrub_stamp":"2024-09-13T19:19:28.340973+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:31:45.923087+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:21.760567+0000","last_change":"2024-09-13T19:19:21.760567+0000","last_active":"2024-09-13T19:19:21.760567+0000","last_peered":"2024-09-13T19:19:21.760567+0000","last_clean":"2024-09-13T19:19:21.760567+0000","last_became_active":"2024-09-13T19:16:03.909803+0000","last_became_peered":"2024-09-13T19:16:03.909803+0000","last_unstale":"2024-09-13T19:19:21.760567+0000","last_undegraded":"2024-09-13T19:19:21.760567+0000","last_fullsized":"2024-09-13T19:19:21.760567+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:21.760449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:21.760449+0000","last_clean_scrub_stamp":"2024-09-13T19:19:21.760449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:57.014320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"36'11","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:16.494474+0000","last_change":"2024-09-13T19:20:16.494500+0000","last_active":"2024-09-13T19:20:16.494474+0000","last_peered":"2024-09-13T19:20:16.494474+0000","last_clean":"2024-09-13T19:20:16.494474+0000","last_became_active":"2024-09-13T19:16:05.915672+0000","last_became_peered":"2024-09-13T19:16:05.915672+0000","last_unstale":"2024-09-13T19:20:16.494474+0000","last_undegraded":"2024-09-13T19:20:16.494474+0000","last_fullsized":"2024-09-13T19:20:16.494474+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'11","last_scrub_stamp":"2024-09-13T19:20:16.494379+0000","last_deep_scrub":"36'11","last_deep_scrub_stamp":"2024-09-13T19:20:16.494379+0000","last_clean_scrub_stamp":"2024-09-13T19:20:16.494379+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:31.484004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"36'10","reported_seq":69,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:38.781574+0000","last_change":"2024-09-13T19:19:38.781574+0000","last_active":"2024-09-13T19:19:38.781574+0000","last_peered":"2024-09-13T19:19:38.781574+0000","last_clean":"2024-09-13T19:19:38.781574+0000","last_became_active":"2024-09-13T19:15:57.902793+0000","last_became_peered":"2024-09-13T19:15:57.902793+0000","last_unstale":"2024-09-13T19:19:38.781574+0000","last_undegraded":"2024-09-13T19:19:38.781574+0000","last_fullsized":"2024-09-13T19:19:38.781574+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-13T19:19:38.781447+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-13T19:19:38.781447+0000","last_clean_scrub_stamp":"2024-09-13T19:19:38.781447+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:50.170162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:56.680541+0000","last_change":"2024-09-13T19:19:56.680541+0000","last_active":"2024-09-13T19:19:56.680541+0000","last_peered":"2024-09-13T19:19:56.680541+0000","last_clean":"2024-09-13T19:19:56.680541+0000","last_became_active":"2024-09-13T19:15:55.894340+0000","last_became_peered":"2024-09-13T19:15:55.894340+0000","last_unstale":"2024-09-13T19:19:56.680541+0000","last_undegraded":"2024-09-13T19:19:56.680541+0000","last_fullsized":"2024-09-13T19:19:56.680541+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:56.680427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:56.680427+0000","last_clean_scrub_stamp":"2024-09-13T19:19:56.680427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:52:19.982338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:16.976016+0000","last_change":"2024-09-13T19:15:46.581685+0000","last_active":"2024-09-13T19:19:16.976016+0000","last_peered":"2024-09-13T19:19:16.976016+0000","last_clean":"2024-09-13T19:19:16.976016+0000","last_became_active":"2024-09-13T19:15:44.576006+0000","last_became_peered":"2024-09-13T19:15:44.576006+0000","last_unstale":"2024-09-13T19:19:16.976016+0000","last_undegraded":"2024-09-13T19:19:16.976016+0000","last_fullsized":"2024-09-13T19:19:16.976016+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013309299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:26.089170+0000","last_change":"2024-09-13T19:19:26.089170+0000","last_active":"2024-09-13T19:19:26.089170+0000","last_peered":"2024-09-13T19:19:26.089170+0000","last_clean":"2024-09-13T19:19:26.089170+0000","last_became_active":"2024-09-13T19:15:59.894761+0000","last_became_peered":"2024-09-13T19:15:59.894761+0000","last_unstale":"2024-09-13T19:19:26.089170+0000","last_undegraded":"2024-09-13T19:19:26.089170+0000","last_fullsized":"2024-09-13T19:19:26.089170+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:26.089011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:26.089011+0000","last_clean_scrub_stamp":"2024-09-13T19:19:26.089011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:08.982394+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"36'21","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:16.767496+0000","last_change":"2024-09-13T19:19:16.767496+0000","last_active":"2024-09-13T19:19:16.767496+0000","last_peered":"2024-09-13T19:19:16.767496+0000","last_clean":"2024-09-13T19:19:16.767496+0000","last_became_active":"2024-09-13T19:16:01.907419+0000","last_became_peered":"2024-09-13T19:16:01.907419+0000","last_unstale":"2024-09-13T19:19:16.767496+0000","last_undegraded":"2024-09-13T19:19:16.767496+0000","last_fullsized":"2024-09-13T19:19:16.767496+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'21","last_scrub_stamp":"2024-09-13T19:19:16.767339+0000","last_deep_scrub":"36'21","last_deep_scrub_stamp":"2024-09-13T19:19:16.767339+0000","last_clean_scrub_stamp":"2024-09-13T19:19:16.767339+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:34.127072+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"36'285","reported_seq":359,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:23.651260+0000","last_change":"2024-09-13T19:19:23.651260+0000","last_active":"2024-09-13T19:19:23.651260+0000","last_peered":"2024-09-13T19:19:23.651260+0000","last_clean":"2024-09-13T19:19:23.651260+0000","last_became_active":"2024-09-13T19:16:03.907957+0000","last_became_peered":"2024-09-13T19:16:03.907957+0000","last_unstale":"2024-09-13T19:19:23.651260+0000","last_undegraded":"2024-09-13T19:19:23.651260+0000","last_fullsized":"2024-09-13T19:19:23.651260+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-13T19:19:23.651077+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-13T19:19:23.651077+0000","last_clean_scrub_stamp":"2024-09-13T19:19:23.651077+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:39:32.329566+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"34'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:23.943599+0000","last_change":"2024-09-13T19:16:05.924834+0000","last_active":"2024-09-13T19:18:23.943599+0000","last_peered":"2024-09-13T19:18:23.943599+0000","last_clean":"2024-09-13T19:18:23.943599+0000","last_became_active":"2024-09-13T19:16:05.924162+0000","last_became_peered":"2024-09-13T19:16:05.924162+0000","last_unstale":"2024-09-13T19:18:23.943599+0000","last_undegraded":"2024-09-13T19:18:23.943599+0000","last_fullsized":"2024-09-13T19:18:23.943599+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"36'6","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:55.942806+0000","last_change":"2024-09-13T19:19:55.942806+0000","last_active":"2024-09-13T19:19:55.942806+0000","last_peered":"2024-09-13T19:19:55.942806+0000","last_clean":"2024-09-13T19:19:55.942806+0000","last_became_active":"2024-09-13T19:15:57.896078+0000","last_became_peered":"2024-09-13T19:15:57.896078+0000","last_unstale":"2024-09-13T19:19:55.942806+0000","last_undegraded":"2024-09-13T19:19:55.942806+0000","last_fullsized":"2024-09-13T19:19:55.942806+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:19:55.942686+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:19:55.942686+0000","last_clean_scrub_stamp":"2024-09-13T19:19:55.942686+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:37.569282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:07.951990+0000","last_change":"2024-09-13T19:20:07.952015+0000","last_active":"2024-09-13T19:20:07.951990+0000","last_peered":"2024-09-13T19:20:07.951990+0000","last_clean":"2024-09-13T19:20:07.951990+0000","last_became_active":"2024-09-13T19:15:55.895282+0000","last_became_peered":"2024-09-13T19:15:55.895282+0000","last_unstale":"2024-09-13T19:20:07.951990+0000","last_undegraded":"2024-09-13T19:20:07.951990+0000","last_fullsized":"2024-09-13T19:20:07.951990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:07.951873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:07.951873+0000","last_clean_scrub_stamp":"2024-09-13T19:20:07.951873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:24.347833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:03.610700+0000","last_change":"2024-09-13T19:20:03.610700+0000","last_active":"2024-09-13T19:20:03.610700+0000","last_peered":"2024-09-13T19:20:03.610700+0000","last_clean":"2024-09-13T19:20:03.610700+0000","last_became_active":"2024-09-13T19:15:44.574967+0000","last_became_peered":"2024-09-13T19:15:44.574967+0000","last_unstale":"2024-09-13T19:20:03.610700+0000","last_undegraded":"2024-09-13T19:20:03.610700+0000","last_fullsized":"2024-09-13T19:20:03.610700+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:03.610567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:03.610567+0000","last_clean_scrub_stamp":"2024-09-13T19:20:03.610567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:27.117889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049330999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"36'2","reported_seq":231,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:25.112490+0000","last_change":"2024-09-13T19:19:25.112490+0000","last_active":"2024-09-13T19:19:25.112490+0000","last_peered":"2024-09-13T19:19:25.112490+0000","last_clean":"2024-09-13T19:19:25.112490+0000","last_became_active":"2024-09-13T19:15:59.894966+0000","last_became_peered":"2024-09-13T19:15:59.894966+0000","last_unstale":"2024-09-13T19:19:25.112490+0000","last_undegraded":"2024-09-13T19:19:25.112490+0000","last_fullsized":"2024-09-13T19:19:25.112490+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:25.112380+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:25.112380+0000","last_clean_scrub_stamp":"2024-09-13T19:19:25.112380+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:41.200956+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"36'16","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:27.099288+0000","last_change":"2024-09-13T19:19:27.099288+0000","last_active":"2024-09-13T19:19:27.099288+0000","last_peered":"2024-09-13T19:19:27.099288+0000","last_clean":"2024-09-13T19:19:27.099288+0000","last_became_active":"2024-09-13T19:16:01.902739+0000","last_became_peered":"2024-09-13T19:16:01.902739+0000","last_unstale":"2024-09-13T19:19:27.099288+0000","last_undegraded":"2024-09-13T19:19:27.099288+0000","last_fullsized":"2024-09-13T19:19:27.099288+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-13T19:19:27.099139+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-13T19:19:27.099139+0000","last_clean_scrub_stamp":"2024-09-13T19:19:27.099139+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:22:57.737015+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"36'285","reported_seq":430,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:22.346094+0000","last_change":"2024-09-13T19:19:22.346094+0000","last_active":"2024-09-13T19:19:22.346094+0000","last_peered":"2024-09-13T19:19:22.346094+0000","last_clean":"2024-09-13T19:19:22.346094+0000","last_became_active":"2024-09-13T19:16:03.909038+0000","last_became_peered":"2024-09-13T19:16:03.909038+0000","last_unstale":"2024-09-13T19:19:22.346094+0000","last_undegraded":"2024-09-13T19:19:22.346094+0000","last_fullsized":"2024-09-13T19:19:22.346094+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-13T19:19:22.345954+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-13T19:19:22.345954+0000","last_clean_scrub_stamp":"2024-09-13T19:19:22.345954+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:07.575589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'3","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:23.942859+0000","last_change":"2024-09-13T19:16:05.924059+0000","last_active":"2024-09-13T19:18:23.942859+0000","last_peered":"2024-09-13T19:18:23.942859+0000","last_clean":"2024-09-13T19:18:23.942859+0000","last_became_active":"2024-09-13T19:16:05.923739+0000","last_became_peered":"2024-09-13T19:16:05.923739+0000","last_unstale":"2024-09-13T19:18:23.942859+0000","last_undegraded":"2024-09-13T19:18:23.942859+0000","last_fullsized":"2024-09-13T19:18:23.942859+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"36'6","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:51.725112+0000","last_change":"2024-09-13T19:19:51.725112+0000","last_active":"2024-09-13T19:19:51.725112+0000","last_peered":"2024-09-13T19:19:51.725112+0000","last_clean":"2024-09-13T19:19:51.725112+0000","last_became_active":"2024-09-13T19:15:57.897727+0000","last_became_peered":"2024-09-13T19:15:57.897727+0000","last_unstale":"2024-09-13T19:19:51.725112+0000","last_undegraded":"2024-09-13T19:19:51.725112+0000","last_fullsized":"2024-09-13T19:19:51.725112+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:19:51.724981+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:19:51.724981+0000","last_clean_scrub_stamp":"2024-09-13T19:19:51.724981+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:11:51.172869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:08.107244+0000","last_change":"2024-09-13T19:20:08.107270+0000","last_active":"2024-09-13T19:20:08.107244+0000","last_peered":"2024-09-13T19:20:08.107244+0000","last_clean":"2024-09-13T19:20:08.107244+0000","last_became_active":"2024-09-13T19:15:55.895394+0000","last_became_peered":"2024-09-13T19:15:55.895394+0000","last_unstale":"2024-09-13T19:20:08.107244+0000","last_undegraded":"2024-09-13T19:20:08.107244+0000","last_fullsized":"2024-09-13T19:20:08.107244+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:08.107136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:08.107136+0000","last_clean_scrub_stamp":"2024-09-13T19:20:08.107136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:47.449474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:16.976011+0000","last_change":"2024-09-13T19:15:46.581172+0000","last_active":"2024-09-13T19:19:16.976011+0000","last_peered":"2024-09-13T19:19:16.976011+0000","last_clean":"2024-09-13T19:19:16.976011+0000","last_became_active":"2024-09-13T19:15:44.607248+0000","last_became_peered":"2024-09-13T19:15:44.607248+0000","last_unstale":"2024-09-13T19:19:16.976011+0000","last_undegraded":"2024-09-13T19:19:16.976011+0000","last_fullsized":"2024-09-13T19:19:16.976011+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:43.565433+0000","last_clean_scrub_stamp":"2024-09-13T19:15:43.565433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086245899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:16.976793+0000","last_change":"2024-09-13T19:16:31.993085+0000","last_active":"2024-09-13T19:19:16.976793+0000","last_peered":"2024-09-13T19:19:16.976793+0000","last_clean":"2024-09-13T19:19:16.976793+0000","last_became_active":"2024-09-13T19:16:31.992752+0000","last_became_peered":"2024-09-13T19:16:31.992752+0000","last_unstale":"2024-09-13T19:19:16.976793+0000","last_undegraded":"2024-09-13T19:19:16.976793+0000","last_fullsized":"2024-09-13T19:19:16.976793+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"36'98","reported_seq":192,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:24.778390+0000","last_change":"2024-09-13T19:19:24.778390+0000","last_active":"2024-09-13T19:19:24.778390+0000","last_peered":"2024-09-13T19:19:24.778390+0000","last_clean":"2024-09-13T19:19:24.778390+0000","last_became_active":"2024-09-13T19:16:01.906317+0000","last_became_peered":"2024-09-13T19:16:01.906317+0000","last_unstale":"2024-09-13T19:19:24.778390+0000","last_undegraded":"2024-09-13T19:19:24.778390+0000","last_fullsized":"2024-09-13T19:19:24.778390+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'98","last_scrub_stamp":"2024-09-13T19:19:24.778260+0000","last_deep_scrub":"36'98","last_deep_scrub_stamp":"2024-09-13T19:19:24.778260+0000","last_clean_scrub_stamp":"2024-09-13T19:19:24.778260+0000","objects_scrubbed":8,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:51.569747+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":99,"num_read_kb":103,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:19.338010+0000","last_change":"2024-09-13T19:19:19.338010+0000","last_active":"2024-09-13T19:19:19.338010+0000","last_peered":"2024-09-13T19:19:19.338010+0000","last_clean":"2024-09-13T19:19:19.338010+0000","last_became_active":"2024-09-13T19:16:03.909941+0000","last_became_peered":"2024-09-13T19:16:03.909941+0000","last_unstale":"2024-09-13T19:19:19.338010+0000","last_undegraded":"2024-09-13T19:19:19.338010+0000","last_fullsized":"2024-09-13T19:19:19.338010+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:19.337887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:19.337887+0000","last_clean_scrub_stamp":"2024-09-13T19:19:19.337887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:59.954982+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:31.797118+0000","last_change":"2024-09-13T19:19:31.797143+0000","last_active":"2024-09-13T19:19:31.797118+0000","last_peered":"2024-09-13T19:19:31.797118+0000","last_clean":"2024-09-13T19:19:31.797118+0000","last_became_active":"2024-09-13T19:16:05.911465+0000","last_became_peered":"2024-09-13T19:16:05.911465+0000","last_unstale":"2024-09-13T19:19:31.797118+0000","last_undegraded":"2024-09-13T19:19:31.797118+0000","last_fullsized":"2024-09-13T19:19:31.797118+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:31.797033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:31.797033+0000","last_clean_scrub_stamp":"2024-09-13T19:19:31.797033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:28:44.716045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:06.551488+0000","last_change":"2024-09-13T19:20:06.551512+0000","last_active":"2024-09-13T19:20:06.551488+0000","last_peered":"2024-09-13T19:20:06.551488+0000","last_clean":"2024-09-13T19:20:06.551488+0000","last_became_active":"2024-09-13T19:16:05.917156+0000","last_became_peered":"2024-09-13T19:16:05.917156+0000","last_unstale":"2024-09-13T19:20:06.551488+0000","last_undegraded":"2024-09-13T19:20:06.551488+0000","last_fullsized":"2024-09-13T19:20:06.551488+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:06.551412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:06.551412+0000","last_clean_scrub_stamp":"2024-09-13T19:20:06.551412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:11.518642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"36'8","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:05.520463+0000","last_change":"2024-09-13T19:20:05.520506+0000","last_active":"2024-09-13T19:20:05.520463+0000","last_peered":"2024-09-13T19:20:05.520463+0000","last_clean":"2024-09-13T19:20:05.520463+0000","last_became_active":"2024-09-13T19:15:57.898761+0000","last_became_peered":"2024-09-13T19:15:57.898761+0000","last_unstale":"2024-09-13T19:20:05.520463+0000","last_undegraded":"2024-09-13T19:20:05.520463+0000","last_fullsized":"2024-09-13T19:20:05.520463+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-13T19:20:05.520357+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-13T19:20:05.520357+0000","last_clean_scrub_stamp":"2024-09-13T19:20:05.520357+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:27:43.542866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:09.992753+0000","last_change":"2024-09-13T19:20:09.992800+0000","last_active":"2024-09-13T19:20:09.992753+0000","last_peered":"2024-09-13T19:20:09.992753+0000","last_clean":"2024-09-13T19:20:09.992753+0000","last_became_active":"2024-09-13T19:15:55.892518+0000","last_became_peered":"2024-09-13T19:15:55.892518+0000","last_unstale":"2024-09-13T19:20:09.992753+0000","last_undegraded":"2024-09-13T19:20:09.992753+0000","last_fullsized":"2024-09-13T19:20:09.992753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:09.992654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:09.992654+0000","last_clean_scrub_stamp":"2024-09-13T19:20:09.992654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:42.323390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:30.756336+0000","last_change":"2024-09-13T19:19:30.756383+0000","last_active":"2024-09-13T19:19:30.756336+0000","last_peered":"2024-09-13T19:19:30.756336+0000","last_clean":"2024-09-13T19:19:30.756336+0000","last_became_active":"2024-09-13T19:15:59.892690+0000","last_became_peered":"2024-09-13T19:15:59.892690+0000","last_unstale":"2024-09-13T19:19:30.756336+0000","last_undegraded":"2024-09-13T19:19:30.756336+0000","last_fullsized":"2024-09-13T19:19:30.756336+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:30.756223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:30.756223+0000","last_clean_scrub_stamp":"2024-09-13T19:19:30.756223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:04:11.520992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"36'40","reported_seq":96,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:31.067728+0000","last_change":"2024-09-13T19:19:31.067778+0000","last_active":"2024-09-13T19:19:31.067728+0000","last_peered":"2024-09-13T19:19:31.067728+0000","last_clean":"2024-09-13T19:19:31.067728+0000","last_became_active":"2024-09-13T19:16:01.904684+0000","last_became_peered":"2024-09-13T19:16:01.904684+0000","last_unstale":"2024-09-13T19:19:31.067728+0000","last_undegraded":"2024-09-13T19:19:31.067728+0000","last_fullsized":"2024-09-13T19:19:31.067728+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'40","last_scrub_stamp":"2024-09-13T19:19:31.067631+0000","last_deep_scrub":"36'40","last_deep_scrub_stamp":"2024-09-13T19:19:31.067631+0000","last_clean_scrub_stamp":"2024-09-13T19:19:31.067631+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:43.676892+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:38.002187+0000","last_change":"2024-09-13T19:19:38.002210+0000","last_active":"2024-09-13T19:19:38.002187+0000","last_peered":"2024-09-13T19:19:38.002187+0000","last_clean":"2024-09-13T19:19:38.002187+0000","last_became_active":"2024-09-13T19:16:03.912244+0000","last_became_peered":"2024-09-13T19:16:03.912244+0000","last_unstale":"2024-09-13T19:19:38.002187+0000","last_undegraded":"2024-09-13T19:19:38.002187+0000","last_fullsized":"2024-09-13T19:19:38.002187+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:38.002099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:38.002099+0000","last_clean_scrub_stamp":"2024-09-13T19:19:38.002099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:02.124751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"36'3","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:15.659673+0000","last_change":"2024-09-13T19:16:05.921280+0000","last_active":"2024-09-13T19:19:15.659673+0000","last_peered":"2024-09-13T19:19:15.659673+0000","last_clean":"2024-09-13T19:19:15.659673+0000","last_became_active":"2024-09-13T19:16:05.920951+0000","last_became_peered":"2024-09-13T19:16:05.920951+0000","last_unstale":"2024-09-13T19:19:15.659673+0000","last_undegraded":"2024-09-13T19:19:15.659673+0000","last_fullsized":"2024-09-13T19:19:15.659673+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"36'4","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:44.877396+0000","last_change":"2024-09-13T19:19:44.877430+0000","last_active":"2024-09-13T19:19:44.877396+0000","last_peered":"2024-09-13T19:19:44.877396+0000","last_clean":"2024-09-13T19:19:44.877396+0000","last_became_active":"2024-09-13T19:15:57.901732+0000","last_became_peered":"2024-09-13T19:15:57.901732+0000","last_unstale":"2024-09-13T19:19:44.877396+0000","last_undegraded":"2024-09-13T19:19:44.877396+0000","last_fullsized":"2024-09-13T19:19:44.877396+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:19:44.877311+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:19:44.877311+0000","last_clean_scrub_stamp":"2024-09-13T19:19:44.877311+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:11:44.325198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"36'4","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:52.675796+0000","last_change":"2024-09-13T19:19:52.675825+0000","last_active":"2024-09-13T19:19:52.675796+0000","last_peered":"2024-09-13T19:19:52.675796+0000","last_clean":"2024-09-13T19:19:52.675796+0000","last_became_active":"2024-09-13T19:15:55.894279+0000","last_became_peered":"2024-09-13T19:15:55.894279+0000","last_unstale":"2024-09-13T19:19:52.675796+0000","last_undegraded":"2024-09-13T19:19:52.675796+0000","last_fullsized":"2024-09-13T19:19:52.675796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:19:52.675686+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:19:52.675686+0000","last_clean_scrub_stamp":"2024-09-13T19:19:52.675686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:16.286898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:24.099254+0000","last_change":"2024-09-13T19:19:24.099278+0000","last_active":"2024-09-13T19:19:24.099254+0000","last_peered":"2024-09-13T19:19:24.099254+0000","last_clean":"2024-09-13T19:19:24.099254+0000","last_became_active":"2024-09-13T19:15:59.895325+0000","last_became_peered":"2024-09-13T19:15:59.895325+0000","last_unstale":"2024-09-13T19:19:24.099254+0000","last_undegraded":"2024-09-13T19:19:24.099254+0000","last_fullsized":"2024-09-13T19:19:24.099254+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:24.099164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:24.099164+0000","last_clean_scrub_stamp":"2024-09-13T19:19:24.099164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:16.483764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"36'8","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:30.333549+0000","last_change":"2024-09-13T19:19:30.333585+0000","last_active":"2024-09-13T19:19:30.333549+0000","last_peered":"2024-09-13T19:19:30.333549+0000","last_clean":"2024-09-13T19:19:30.333549+0000","last_became_active":"2024-09-13T19:16:01.901250+0000","last_became_peered":"2024-09-13T19:16:01.901250+0000","last_unstale":"2024-09-13T19:19:30.333549+0000","last_undegraded":"2024-09-13T19:19:30.333549+0000","last_fullsized":"2024-09-13T19:19:30.333549+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-13T19:19:30.333464+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-13T19:19:30.333464+0000","last_clean_scrub_stamp":"2024-09-13T19:19:30.333464+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:12:35.870136+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:16.732038+0000","last_change":"2024-09-13T19:19:16.732086+0000","last_active":"2024-09-13T19:19:16.732038+0000","last_peered":"2024-09-13T19:19:16.732038+0000","last_clean":"2024-09-13T19:19:16.732038+0000","last_became_active":"2024-09-13T19:16:03.913053+0000","last_became_peered":"2024-09-13T19:16:03.913053+0000","last_unstale":"2024-09-13T19:19:16.732038+0000","last_undegraded":"2024-09-13T19:19:16.732038+0000","last_fullsized":"2024-09-13T19:19:16.732038+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:16.731903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:16.731903+0000","last_clean_scrub_stamp":"2024-09-13T19:19:16.731903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:42.561076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"36'2","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:45.575337+0000","last_change":"2024-09-13T19:19:45.575382+0000","last_active":"2024-09-13T19:19:45.575337+0000","last_peered":"2024-09-13T19:19:45.575337+0000","last_clean":"2024-09-13T19:19:45.575337+0000","last_became_active":"2024-09-13T19:16:05.912428+0000","last_became_peered":"2024-09-13T19:16:05.912428+0000","last_unstale":"2024-09-13T19:19:45.575337+0000","last_undegraded":"2024-09-13T19:19:45.575337+0000","last_fullsized":"2024-09-13T19:19:45.575337+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:45.575217+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:45.575217+0000","last_clean_scrub_stamp":"2024-09-13T19:19:45.575217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:52:00.818473+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"36'8","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:44.570507+0000","last_change":"2024-09-13T19:19:44.570540+0000","last_active":"2024-09-13T19:19:44.570507+0000","last_peered":"2024-09-13T19:19:44.570507+0000","last_clean":"2024-09-13T19:19:44.570507+0000","last_became_active":"2024-09-13T19:15:57.896463+0000","last_became_peered":"2024-09-13T19:15:57.896463+0000","last_unstale":"2024-09-13T19:19:44.570507+0000","last_undegraded":"2024-09-13T19:19:44.570507+0000","last_fullsized":"2024-09-13T19:19:44.570507+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-13T19:19:44.570415+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-13T19:19:44.570415+0000","last_clean_scrub_stamp":"2024-09-13T19:19:44.570415+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:32:33.923357+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"36'2","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:58.515777+0000","last_change":"2024-09-13T19:19:58.515809+0000","last_active":"2024-09-13T19:19:58.515777+0000","last_peered":"2024-09-13T19:19:58.515777+0000","last_clean":"2024-09-13T19:19:58.515777+0000","last_became_active":"2024-09-13T19:15:55.888108+0000","last_became_peered":"2024-09-13T19:15:55.888108+0000","last_unstale":"2024-09-13T19:19:58.515777+0000","last_undegraded":"2024-09-13T19:19:58.515777+0000","last_fullsized":"2024-09-13T19:19:58.515777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:58.515690+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:58.515690+0000","last_clean_scrub_stamp":"2024-09-13T19:19:58.515690+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:14.604266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:34.858389+0000","last_change":"2024-09-13T19:19:34.858432+0000","last_active":"2024-09-13T19:19:34.858389+0000","last_peered":"2024-09-13T19:19:34.858389+0000","last_clean":"2024-09-13T19:19:34.858389+0000","last_became_active":"2024-09-13T19:15:59.892842+0000","last_became_peered":"2024-09-13T19:15:59.892842+0000","last_unstale":"2024-09-13T19:19:34.858389+0000","last_undegraded":"2024-09-13T19:19:34.858389+0000","last_fullsized":"2024-09-13T19:19:34.858389+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:34.858282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:34.858282+0000","last_clean_scrub_stamp":"2024-09-13T19:19:34.858282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:59.055511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"36'48","reported_seq":120,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:24.358477+0000","last_change":"2024-09-13T19:19:24.358526+0000","last_active":"2024-09-13T19:19:24.358477+0000","last_peered":"2024-09-13T19:19:24.358477+0000","last_clean":"2024-09-13T19:19:24.358477+0000","last_became_active":"2024-09-13T19:16:01.902991+0000","last_became_peered":"2024-09-13T19:16:01.902991+0000","last_unstale":"2024-09-13T19:19:24.358477+0000","last_undegraded":"2024-09-13T19:19:24.358477+0000","last_fullsized":"2024-09-13T19:19:24.358477+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'48","last_scrub_stamp":"2024-09-13T19:19:24.358388+0000","last_deep_scrub":"36'48","last_deep_scrub_stamp":"2024-09-13T19:19:24.358388+0000","last_clean_scrub_stamp":"2024-09-13T19:19:24.358388+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:23:15.090837+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:27.782078+0000","last_change":"2024-09-13T19:19:27.782128+0000","last_active":"2024-09-13T19:19:27.782078+0000","last_peered":"2024-09-13T19:19:27.782078+0000","last_clean":"2024-09-13T19:19:27.782078+0000","last_became_active":"2024-09-13T19:16:03.911917+0000","last_became_peered":"2024-09-13T19:16:03.911917+0000","last_unstale":"2024-09-13T19:19:27.782078+0000","last_undegraded":"2024-09-13T19:19:27.782078+0000","last_fullsized":"2024-09-13T19:19:27.782078+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:27.781937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:27.781937+0000","last_clean_scrub_stamp":"2024-09-13T19:19:27.781937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:51.979166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"36'4","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:38.945635+0000","last_change":"2024-09-13T19:16:05.924382+0000","last_active":"2024-09-13T19:18:38.945635+0000","last_peered":"2024-09-13T19:18:38.945635+0000","last_clean":"2024-09-13T19:18:38.945635+0000","last_became_active":"2024-09-13T19:16:05.923368+0000","last_became_peered":"2024-09-13T19:16:05.923368+0000","last_unstale":"2024-09-13T19:18:38.945635+0000","last_undegraded":"2024-09-13T19:18:38.945635+0000","last_fullsized":"2024-09-13T19:18:38.945635+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"36'16","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:12.626408+0000","last_change":"2024-09-13T19:20:12.626437+0000","last_active":"2024-09-13T19:20:12.626408+0000","last_peered":"2024-09-13T19:20:12.626408+0000","last_clean":"2024-09-13T19:20:12.626408+0000","last_became_active":"2024-09-13T19:16:31.991993+0000","last_became_peered":"2024-09-13T19:16:31.991993+0000","last_unstale":"2024-09-13T19:20:12.626408+0000","last_undegraded":"2024-09-13T19:20:12.626408+0000","last_fullsized":"2024-09-13T19:20:12.626408+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-13T19:20:12.626317+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-13T19:20:12.626317+0000","last_clean_scrub_stamp":"2024-09-13T19:20:12.626317+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:58:19.642331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"36'2","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:04.093302+0000","last_change":"2024-09-13T19:20:04.093337+0000","last_active":"2024-09-13T19:20:04.093302+0000","last_peered":"2024-09-13T19:20:04.093302+0000","last_clean":"2024-09-13T19:20:04.093302+0000","last_became_active":"2024-09-13T19:15:55.891711+0000","last_became_peered":"2024-09-13T19:15:55.891711+0000","last_unstale":"2024-09-13T19:20:04.093302+0000","last_undegraded":"2024-09-13T19:20:04.093302+0000","last_fullsized":"2024-09-13T19:20:04.093302+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:20:04.093201+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:20:04.093201+0000","last_clean_scrub_stamp":"2024-09-13T19:20:04.093201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:39:33.862950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:28.138750+0000","last_change":"2024-09-13T19:19:28.138774+0000","last_active":"2024-09-13T19:19:28.138750+0000","last_peered":"2024-09-13T19:19:28.138750+0000","last_clean":"2024-09-13T19:19:28.138750+0000","last_became_active":"2024-09-13T19:15:59.891581+0000","last_became_peered":"2024-09-13T19:15:59.891581+0000","last_unstale":"2024-09-13T19:19:28.138750+0000","last_undegraded":"2024-09-13T19:19:28.138750+0000","last_fullsized":"2024-09-13T19:19:28.138750+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:28.138649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:28.138649+0000","last_clean_scrub_stamp":"2024-09-13T19:19:28.138649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:49.838315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"36'36","reported_seq":91,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:29.830558+0000","last_change":"2024-09-13T19:19:29.830588+0000","last_active":"2024-09-13T19:19:29.830558+0000","last_peered":"2024-09-13T19:19:29.830558+0000","last_clean":"2024-09-13T19:19:29.830558+0000","last_became_active":"2024-09-13T19:16:01.899438+0000","last_became_peered":"2024-09-13T19:16:01.899438+0000","last_unstale":"2024-09-13T19:19:29.830558+0000","last_undegraded":"2024-09-13T19:19:29.830558+0000","last_fullsized":"2024-09-13T19:19:29.830558+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-13T19:19:29.830469+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-13T19:19:29.830469+0000","last_clean_scrub_stamp":"2024-09-13T19:19:29.830469+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:27.642409+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:20.751480+0000","last_change":"2024-09-13T19:19:20.751502+0000","last_active":"2024-09-13T19:19:20.751480+0000","last_peered":"2024-09-13T19:19:20.751480+0000","last_clean":"2024-09-13T19:19:20.751480+0000","last_became_active":"2024-09-13T19:16:03.910319+0000","last_became_peered":"2024-09-13T19:16:03.910319+0000","last_unstale":"2024-09-13T19:19:20.751480+0000","last_undegraded":"2024-09-13T19:19:20.751480+0000","last_fullsized":"2024-09-13T19:19:20.751480+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:20.751392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:20.751392+0000","last_clean_scrub_stamp":"2024-09-13T19:19:20.751392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:18.995121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"36'10","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:52.862813+0000","last_change":"2024-09-13T19:19:52.862813+0000","last_active":"2024-09-13T19:19:52.862813+0000","last_peered":"2024-09-13T19:19:52.862813+0000","last_clean":"2024-09-13T19:19:52.862813+0000","last_became_active":"2024-09-13T19:15:57.897232+0000","last_became_peered":"2024-09-13T19:15:57.897232+0000","last_unstale":"2024-09-13T19:19:52.862813+0000","last_undegraded":"2024-09-13T19:19:52.862813+0000","last_fullsized":"2024-09-13T19:19:52.862813+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-13T19:19:52.862661+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-13T19:19:52.862661+0000","last_clean_scrub_stamp":"2024-09-13T19:19:52.862661+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:54.838456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:04.931294+0000","last_change":"2024-09-13T19:20:04.931320+0000","last_active":"2024-09-13T19:20:04.931294+0000","last_peered":"2024-09-13T19:20:04.931294+0000","last_clean":"2024-09-13T19:20:04.931294+0000","last_became_active":"2024-09-13T19:15:55.901257+0000","last_became_peered":"2024-09-13T19:15:55.901257+0000","last_unstale":"2024-09-13T19:20:04.931294+0000","last_undegraded":"2024-09-13T19:20:04.931294+0000","last_fullsized":"2024-09-13T19:20:04.931294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:20:04.931174+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:20:04.931174+0000","last_clean_scrub_stamp":"2024-09-13T19:20:04.931174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:16:16.436095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:32.383184+0000","last_change":"2024-09-13T19:19:32.383184+0000","last_active":"2024-09-13T19:19:32.383184+0000","last_peered":"2024-09-13T19:19:32.383184+0000","last_clean":"2024-09-13T19:19:32.383184+0000","last_became_active":"2024-09-13T19:15:59.896339+0000","last_became_peered":"2024-09-13T19:15:59.896339+0000","last_unstale":"2024-09-13T19:19:32.383184+0000","last_undegraded":"2024-09-13T19:19:32.383184+0000","last_fullsized":"2024-09-13T19:19:32.383184+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:32.383058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:32.383058+0000","last_clean_scrub_stamp":"2024-09-13T19:19:32.383058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:00.272146+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"36'63","reported_seq":136,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:31.346681+0000","last_change":"2024-09-13T19:19:31.346722+0000","last_active":"2024-09-13T19:19:31.346681+0000","last_peered":"2024-09-13T19:19:31.346681+0000","last_clean":"2024-09-13T19:19:31.346681+0000","last_became_active":"2024-09-13T19:16:01.901092+0000","last_became_peered":"2024-09-13T19:16:01.901092+0000","last_unstale":"2024-09-13T19:19:31.346681+0000","last_undegraded":"2024-09-13T19:19:31.346681+0000","last_fullsized":"2024-09-13T19:19:31.346681+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'63","last_scrub_stamp":"2024-09-13T19:19:31.346567+0000","last_deep_scrub":"36'63","last_deep_scrub_stamp":"2024-09-13T19:19:31.346567+0000","last_clean_scrub_stamp":"2024-09-13T19:19:31.346567+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:48:17.500355+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:18.709566+0000","last_change":"2024-09-13T19:19:18.709589+0000","last_active":"2024-09-13T19:19:18.709566+0000","last_peered":"2024-09-13T19:19:18.709566+0000","last_clean":"2024-09-13T19:19:18.709566+0000","last_became_active":"2024-09-13T19:16:03.910305+0000","last_became_peered":"2024-09-13T19:16:03.910305+0000","last_unstale":"2024-09-13T19:19:18.709566+0000","last_undegraded":"2024-09-13T19:19:18.709566+0000","last_fullsized":"2024-09-13T19:19:18.709566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:18.709481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:18.709481+0000","last_clean_scrub_stamp":"2024-09-13T19:19:18.709481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:41.615886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"36'22","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:13.494631+0000","last_change":"2024-09-13T19:20:13.494661+0000","last_active":"2024-09-13T19:20:13.494631+0000","last_peered":"2024-09-13T19:20:13.494631+0000","last_clean":"2024-09-13T19:20:13.494631+0000","last_became_active":"2024-09-13T19:16:05.912675+0000","last_became_peered":"2024-09-13T19:16:05.912675+0000","last_unstale":"2024-09-13T19:20:13.494631+0000","last_undegraded":"2024-09-13T19:20:13.494631+0000","last_fullsized":"2024-09-13T19:20:13.494631+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'22","last_scrub_stamp":"2024-09-13T19:20:13.494529+0000","last_deep_scrub":"36'22","last_deep_scrub_stamp":"2024-09-13T19:20:13.494529+0000","last_clean_scrub_stamp":"2024-09-13T19:20:13.494529+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:42:34.844694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"36'6","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:57.642302+0000","last_change":"2024-09-13T19:19:57.642327+0000","last_active":"2024-09-13T19:19:57.642302+0000","last_peered":"2024-09-13T19:19:57.642302+0000","last_clean":"2024-09-13T19:19:57.642302+0000","last_became_active":"2024-09-13T19:15:57.889921+0000","last_became_peered":"2024-09-13T19:15:57.889921+0000","last_unstale":"2024-09-13T19:19:57.642302+0000","last_undegraded":"2024-09-13T19:19:57.642302+0000","last_fullsized":"2024-09-13T19:19:57.642302+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:19:57.642210+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:19:57.642210+0000","last_clean_scrub_stamp":"2024-09-13T19:19:57.642210+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:10:09.081946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:07.128790+0000","last_change":"2024-09-13T19:20:07.128831+0000","last_active":"2024-09-13T19:20:07.128790+0000","last_peered":"2024-09-13T19:20:07.128790+0000","last_clean":"2024-09-13T19:20:07.128790+0000","last_became_active":"2024-09-13T19:15:55.895344+0000","last_became_peered":"2024-09-13T19:15:55.895344+0000","last_unstale":"2024-09-13T19:20:07.128790+0000","last_undegraded":"2024-09-13T19:20:07.128790+0000","last_fullsized":"2024-09-13T19:20:07.128790+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:07.128707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:07.128707+0000","last_clean_scrub_stamp":"2024-09-13T19:20:07.128707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:25.121795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:38.765129+0000","last_change":"2024-09-13T19:19:38.765129+0000","last_active":"2024-09-13T19:19:38.765129+0000","last_peered":"2024-09-13T19:19:38.765129+0000","last_clean":"2024-09-13T19:19:38.765129+0000","last_became_active":"2024-09-13T19:15:59.888213+0000","last_became_peered":"2024-09-13T19:15:59.888213+0000","last_unstale":"2024-09-13T19:19:38.765129+0000","last_undegraded":"2024-09-13T19:19:38.765129+0000","last_fullsized":"2024-09-13T19:19:38.765129+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:38.764987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:38.764987+0000","last_clean_scrub_stamp":"2024-09-13T19:19:38.764987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:30.399476+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"36'45","reported_seq":103,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:40.991571+0000","last_change":"2024-09-13T19:19:40.991618+0000","last_active":"2024-09-13T19:19:40.991571+0000","last_peered":"2024-09-13T19:19:40.991571+0000","last_clean":"2024-09-13T19:19:40.991571+0000","last_became_active":"2024-09-13T19:16:01.908116+0000","last_became_peered":"2024-09-13T19:16:01.908116+0000","last_unstale":"2024-09-13T19:19:40.991571+0000","last_undegraded":"2024-09-13T19:19:40.991571+0000","last_fullsized":"2024-09-13T19:19:40.991571+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'45","last_scrub_stamp":"2024-09-13T19:19:40.991484+0000","last_deep_scrub":"36'45","last_deep_scrub_stamp":"2024-09-13T19:19:40.991484+0000","last_clean_scrub_stamp":"2024-09-13T19:19:40.991484+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:20.333822+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:31.769578+0000","last_change":"2024-09-13T19:19:31.769602+0000","last_active":"2024-09-13T19:19:31.769578+0000","last_peered":"2024-09-13T19:19:31.769578+0000","last_clean":"2024-09-13T19:19:31.769578+0000","last_became_active":"2024-09-13T19:16:03.914179+0000","last_became_peered":"2024-09-13T19:16:03.914179+0000","last_unstale":"2024-09-13T19:19:31.769578+0000","last_undegraded":"2024-09-13T19:19:31.769578+0000","last_fullsized":"2024-09-13T19:19:31.769578+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:31.769488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:31.769488+0000","last_clean_scrub_stamp":"2024-09-13T19:19:31.769488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:13.242003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"34'2","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:54.942437+0000","last_change":"2024-09-13T19:19:54.942494+0000","last_active":"2024-09-13T19:19:54.942437+0000","last_peered":"2024-09-13T19:19:54.942437+0000","last_clean":"2024-09-13T19:19:54.942437+0000","last_became_active":"2024-09-13T19:16:05.916822+0000","last_became_peered":"2024-09-13T19:16:05.916822+0000","last_unstale":"2024-09-13T19:19:54.942437+0000","last_undegraded":"2024-09-13T19:19:54.942437+0000","last_fullsized":"2024-09-13T19:19:54.942437+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:19:54.942324+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:19:54.942324+0000","last_clean_scrub_stamp":"2024-09-13T19:19:54.942324+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:41:03.981946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"36'22","reported_seq":82,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:30.102419+0000","last_change":"2024-09-13T19:19:30.102447+0000","last_active":"2024-09-13T19:19:30.102419+0000","last_peered":"2024-09-13T19:19:30.102419+0000","last_clean":"2024-09-13T19:19:30.102419+0000","last_became_active":"2024-09-13T19:15:57.901330+0000","last_became_peered":"2024-09-13T19:15:57.901330+0000","last_unstale":"2024-09-13T19:19:30.102419+0000","last_undegraded":"2024-09-13T19:19:30.102419+0000","last_fullsized":"2024-09-13T19:19:30.102419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'22","last_scrub_stamp":"2024-09-13T19:19:30.102322+0000","last_deep_scrub":"36'22","last_deep_scrub_stamp":"2024-09-13T19:19:30.102322+0000","last_clean_scrub_stamp":"2024-09-13T19:19:30.102322+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:16.992227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":60,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:59.067849+0000","last_change":"2024-09-13T19:19:59.067896+0000","last_active":"2024-09-13T19:19:59.067849+0000","last_peered":"2024-09-13T19:19:59.067849+0000","last_clean":"2024-09-13T19:19:59.067849+0000","last_became_active":"2024-09-13T19:15:55.896196+0000","last_became_peered":"2024-09-13T19:15:55.896196+0000","last_unstale":"2024-09-13T19:19:59.067849+0000","last_undegraded":"2024-09-13T19:19:59.067849+0000","last_fullsized":"2024-09-13T19:19:59.067849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:59.067754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:59.067754+0000","last_clean_scrub_stamp":"2024-09-13T19:19:59.067754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:11.124902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:37.784973+0000","last_change":"2024-09-13T19:19:37.784998+0000","last_active":"2024-09-13T19:19:37.784973+0000","last_peered":"2024-09-13T19:19:37.784973+0000","last_clean":"2024-09-13T19:19:37.784973+0000","last_became_active":"2024-09-13T19:15:59.891131+0000","last_became_peered":"2024-09-13T19:15:59.891131+0000","last_unstale":"2024-09-13T19:19:37.784973+0000","last_undegraded":"2024-09-13T19:19:37.784973+0000","last_fullsized":"2024-09-13T19:19:37.784973+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:37.784843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:37.784843+0000","last_clean_scrub_stamp":"2024-09-13T19:19:37.784843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:04:18.549612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"36'39","reported_seq":96,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:27.304502+0000","last_change":"2024-09-13T19:19:27.304502+0000","last_active":"2024-09-13T19:19:27.304502+0000","last_peered":"2024-09-13T19:19:27.304502+0000","last_clean":"2024-09-13T19:19:27.304502+0000","last_became_active":"2024-09-13T19:16:01.902251+0000","last_became_peered":"2024-09-13T19:16:01.902251+0000","last_unstale":"2024-09-13T19:19:27.304502+0000","last_undegraded":"2024-09-13T19:19:27.304502+0000","last_fullsized":"2024-09-13T19:19:27.304502+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'39","last_scrub_stamp":"2024-09-13T19:19:27.304335+0000","last_deep_scrub":"36'39","last_deep_scrub_stamp":"2024-09-13T19:19:27.304335+0000","last_clean_scrub_stamp":"2024-09-13T19:19:27.304335+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:19:17.836466+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:37.488048+0000","last_change":"2024-09-13T19:19:37.488048+0000","last_active":"2024-09-13T19:19:37.488048+0000","last_peered":"2024-09-13T19:19:37.488048+0000","last_clean":"2024-09-13T19:19:37.488048+0000","last_became_active":"2024-09-13T19:16:03.915225+0000","last_became_peered":"2024-09-13T19:16:03.915225+0000","last_unstale":"2024-09-13T19:19:37.488048+0000","last_undegraded":"2024-09-13T19:19:37.488048+0000","last_fullsized":"2024-09-13T19:19:37.488048+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:37.487953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:37.487953+0000","last_clean_scrub_stamp":"2024-09-13T19:19:37.487953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:42.911372+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"36'5","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:28.944166+0000","last_change":"2024-09-13T19:16:05.925066+0000","last_active":"2024-09-13T19:18:28.944166+0000","last_peered":"2024-09-13T19:18:28.944166+0000","last_clean":"2024-09-13T19:18:28.944166+0000","last_became_active":"2024-09-13T19:16:05.923235+0000","last_became_peered":"2024-09-13T19:16:05.923235+0000","last_unstale":"2024-09-13T19:18:28.944166+0000","last_undegraded":"2024-09-13T19:18:28.944166+0000","last_fullsized":"2024-09-13T19:18:28.944166+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"36'8","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:47.641332+0000","last_change":"2024-09-13T19:19:47.641385+0000","last_active":"2024-09-13T19:19:47.641332+0000","last_peered":"2024-09-13T19:19:47.641332+0000","last_clean":"2024-09-13T19:19:47.641332+0000","last_became_active":"2024-09-13T19:15:57.886263+0000","last_became_peered":"2024-09-13T19:15:57.886263+0000","last_unstale":"2024-09-13T19:19:47.641332+0000","last_undegraded":"2024-09-13T19:19:47.641332+0000","last_fullsized":"2024-09-13T19:19:47.641332+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-13T19:19:47.641228+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-13T19:19:47.641228+0000","last_clean_scrub_stamp":"2024-09-13T19:19:47.641228+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:30.867550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:28.944236+0000","last_change":"2024-09-13T19:15:55.894466+0000","last_active":"2024-09-13T19:18:28.944236+0000","last_peered":"2024-09-13T19:18:28.944236+0000","last_clean":"2024-09-13T19:18:28.944236+0000","last_became_active":"2024-09-13T19:15:55.893629+0000","last_became_peered":"2024-09-13T19:15:55.893629+0000","last_unstale":"2024-09-13T19:18:28.944236+0000","last_undegraded":"2024-09-13T19:18:28.944236+0000","last_fullsized":"2024-09-13T19:18:28.944236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:32.783520+0000","last_change":"2024-09-13T19:19:32.783543+0000","last_active":"2024-09-13T19:19:32.783520+0000","last_peered":"2024-09-13T19:19:32.783520+0000","last_clean":"2024-09-13T19:19:32.783520+0000","last_became_active":"2024-09-13T19:15:59.892445+0000","last_became_peered":"2024-09-13T19:15:59.892445+0000","last_unstale":"2024-09-13T19:19:32.783520+0000","last_undegraded":"2024-09-13T19:19:32.783520+0000","last_fullsized":"2024-09-13T19:19:32.783520+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:32.783411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:32.783411+0000","last_clean_scrub_stamp":"2024-09-13T19:19:32.783411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:00:48.438787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"36'16","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:45.872607+0000","last_change":"2024-09-13T19:19:45.872607+0000","last_active":"2024-09-13T19:19:45.872607+0000","last_peered":"2024-09-13T19:19:45.872607+0000","last_clean":"2024-09-13T19:19:45.872607+0000","last_became_active":"2024-09-13T19:16:01.905553+0000","last_became_peered":"2024-09-13T19:16:01.905553+0000","last_unstale":"2024-09-13T19:19:45.872607+0000","last_undegraded":"2024-09-13T19:19:45.872607+0000","last_fullsized":"2024-09-13T19:19:45.872607+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-13T19:19:45.872465+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-13T19:19:45.872465+0000","last_clean_scrub_stamp":"2024-09-13T19:19:45.872465+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:31:04.671736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"36'285","reported_seq":379,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:19.719772+0000","last_change":"2024-09-13T19:19:19.719772+0000","last_active":"2024-09-13T19:19:19.719772+0000","last_peered":"2024-09-13T19:19:19.719772+0000","last_clean":"2024-09-13T19:19:19.719772+0000","last_became_active":"2024-09-13T19:16:03.913170+0000","last_became_peered":"2024-09-13T19:16:03.913170+0000","last_unstale":"2024-09-13T19:19:19.719772+0000","last_undegraded":"2024-09-13T19:19:19.719772+0000","last_fullsized":"2024-09-13T19:19:19.719772+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-13T19:19:19.719650+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-13T19:19:19.719650+0000","last_clean_scrub_stamp":"2024-09-13T19:19:19.719650+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:13:51.353091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"36'4","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:58.931901+0000","last_change":"2024-09-13T19:19:58.931951+0000","last_active":"2024-09-13T19:19:58.931901+0000","last_peered":"2024-09-13T19:19:58.931901+0000","last_clean":"2024-09-13T19:19:58.931901+0000","last_became_active":"2024-09-13T19:16:05.918050+0000","last_became_peered":"2024-09-13T19:16:05.918050+0000","last_unstale":"2024-09-13T19:19:58.931901+0000","last_undegraded":"2024-09-13T19:19:58.931901+0000","last_fullsized":"2024-09-13T19:19:58.931901+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:19:58.931793+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:19:58.931793+0000","last_clean_scrub_stamp":"2024-09-13T19:19:58.931793+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:51.645100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"36'10","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:43.832951+0000","last_change":"2024-09-13T19:19:43.832987+0000","last_active":"2024-09-13T19:19:43.832951+0000","last_peered":"2024-09-13T19:19:43.832951+0000","last_clean":"2024-09-13T19:19:43.832951+0000","last_became_active":"2024-09-13T19:15:57.885711+0000","last_became_peered":"2024-09-13T19:15:57.885711+0000","last_unstale":"2024-09-13T19:19:43.832951+0000","last_undegraded":"2024-09-13T19:19:43.832951+0000","last_fullsized":"2024-09-13T19:19:43.832951+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-13T19:19:43.832854+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-13T19:19:43.832854+0000","last_clean_scrub_stamp":"2024-09-13T19:19:43.832854+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:23.636694+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:03.133872+0000","last_change":"2024-09-13T19:20:03.133898+0000","last_active":"2024-09-13T19:20:03.133872+0000","last_peered":"2024-09-13T19:20:03.133872+0000","last_clean":"2024-09-13T19:20:03.133872+0000","last_became_active":"2024-09-13T19:15:55.890670+0000","last_became_peered":"2024-09-13T19:15:55.890670+0000","last_unstale":"2024-09-13T19:20:03.133872+0000","last_undegraded":"2024-09-13T19:20:03.133872+0000","last_fullsized":"2024-09-13T19:20:03.133872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:20:03.133782+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:20:03.133782+0000","last_clean_scrub_stamp":"2024-09-13T19:20:03.133782+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:53:48.308748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:29.803492+0000","last_change":"2024-09-13T19:19:29.803524+0000","last_active":"2024-09-13T19:19:29.803492+0000","last_peered":"2024-09-13T19:19:29.803492+0000","last_clean":"2024-09-13T19:19:29.803492+0000","last_became_active":"2024-09-13T19:15:59.893905+0000","last_became_peered":"2024-09-13T19:15:59.893905+0000","last_unstale":"2024-09-13T19:19:29.803492+0000","last_undegraded":"2024-09-13T19:19:29.803492+0000","last_fullsized":"2024-09-13T19:19:29.803492+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:29.803399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:29.803399+0000","last_clean_scrub_stamp":"2024-09-13T19:19:29.803399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:13.674139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"36'46","reported_seq":104,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:18.724087+0000","last_change":"2024-09-13T19:19:18.724144+0000","last_active":"2024-09-13T19:19:18.724087+0000","last_peered":"2024-09-13T19:19:18.724087+0000","last_clean":"2024-09-13T19:19:18.724087+0000","last_became_active":"2024-09-13T19:16:01.903395+0000","last_became_peered":"2024-09-13T19:16:01.903395+0000","last_unstale":"2024-09-13T19:19:18.724087+0000","last_undegraded":"2024-09-13T19:19:18.724087+0000","last_fullsized":"2024-09-13T19:19:18.724087+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'46","last_scrub_stamp":"2024-09-13T19:19:18.723995+0000","last_deep_scrub":"36'46","last_deep_scrub_stamp":"2024-09-13T19:19:18.723995+0000","last_clean_scrub_stamp":"2024-09-13T19:19:18.723995+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:23.717143+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:18.382095+0000","last_change":"2024-09-13T19:19:18.382122+0000","last_active":"2024-09-13T19:19:18.382095+0000","last_peered":"2024-09-13T19:19:18.382095+0000","last_clean":"2024-09-13T19:19:18.382095+0000","last_became_active":"2024-09-13T19:16:03.910550+0000","last_became_peered":"2024-09-13T19:16:03.910550+0000","last_unstale":"2024-09-13T19:19:18.382095+0000","last_undegraded":"2024-09-13T19:19:18.382095+0000","last_fullsized":"2024-09-13T19:19:18.382095+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:18.381995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:18.381995+0000","last_clean_scrub_stamp":"2024-09-13T19:19:18.381995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:49.252007+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"36'3","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:11.045173+0000","last_change":"2024-09-13T19:20:11.045199+0000","last_active":"2024-09-13T19:20:11.045173+0000","last_peered":"2024-09-13T19:20:11.045173+0000","last_clean":"2024-09-13T19:20:11.045173+0000","last_became_active":"2024-09-13T19:16:05.913598+0000","last_became_peered":"2024-09-13T19:16:05.913598+0000","last_unstale":"2024-09-13T19:20:11.045173+0000","last_undegraded":"2024-09-13T19:20:11.045173+0000","last_fullsized":"2024-09-13T19:20:11.045173+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-13T19:20:11.045091+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-13T19:20:11.045091+0000","last_clean_scrub_stamp":"2024-09-13T19:20:11.045091+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:05.787037+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:42.851372+0000","last_change":"2024-09-13T19:19:42.851396+0000","last_active":"2024-09-13T19:19:42.851372+0000","last_peered":"2024-09-13T19:19:42.851372+0000","last_clean":"2024-09-13T19:19:42.851372+0000","last_became_active":"2024-09-13T19:15:57.883463+0000","last_became_peered":"2024-09-13T19:15:57.883463+0000","last_unstale":"2024-09-13T19:19:42.851372+0000","last_undegraded":"2024-09-13T19:19:42.851372+0000","last_fullsized":"2024-09-13T19:19:42.851372+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:19:42.851247+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:19:42.851247+0000","last_clean_scrub_stamp":"2024-09-13T19:19:42.851247+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:47.003451+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:28.944303+0000","last_change":"2024-09-13T19:15:55.900188+0000","last_active":"2024-09-13T19:18:28.944303+0000","last_peered":"2024-09-13T19:18:28.944303+0000","last_clean":"2024-09-13T19:18:28.944303+0000","last_became_active":"2024-09-13T19:15:55.899847+0000","last_became_peered":"2024-09-13T19:15:55.899847+0000","last_unstale":"2024-09-13T19:18:28.944303+0000","last_undegraded":"2024-09-13T19:18:28.944303+0000","last_fullsized":"2024-09-13T19:18:28.944303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:33.839962+0000","last_change":"2024-09-13T19:19:33.840008+0000","last_active":"2024-09-13T19:19:33.839962+0000","last_peered":"2024-09-13T19:19:33.839962+0000","last_clean":"2024-09-13T19:19:33.839962+0000","last_became_active":"2024-09-13T19:15:59.895512+0000","last_became_peered":"2024-09-13T19:15:59.895512+0000","last_unstale":"2024-09-13T19:19:33.839962+0000","last_undegraded":"2024-09-13T19:19:33.839962+0000","last_fullsized":"2024-09-13T19:19:33.839962+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:33.839854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:33.839854+0000","last_clean_scrub_stamp":"2024-09-13T19:19:33.839854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:49.315701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"36'36","reported_seq":91,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:26.305275+0000","last_change":"2024-09-13T19:19:26.305329+0000","last_active":"2024-09-13T19:19:26.305275+0000","last_peered":"2024-09-13T19:19:26.305275+0000","last_clean":"2024-09-13T19:19:26.305275+0000","last_became_active":"2024-09-13T19:16:01.902285+0000","last_became_peered":"2024-09-13T19:16:01.902285+0000","last_unstale":"2024-09-13T19:19:26.305275+0000","last_undegraded":"2024-09-13T19:19:26.305275+0000","last_fullsized":"2024-09-13T19:19:26.305275+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-13T19:19:26.305171+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-13T19:19:26.305171+0000","last_clean_scrub_stamp":"2024-09-13T19:19:26.305171+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:15:14.766698+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:40.004211+0000","last_change":"2024-09-13T19:19:40.004237+0000","last_active":"2024-09-13T19:19:40.004211+0000","last_peered":"2024-09-13T19:19:40.004211+0000","last_clean":"2024-09-13T19:19:40.004211+0000","last_became_active":"2024-09-13T19:16:03.911587+0000","last_became_peered":"2024-09-13T19:16:03.911587+0000","last_unstale":"2024-09-13T19:19:40.004211+0000","last_undegraded":"2024-09-13T19:19:40.004211+0000","last_fullsized":"2024-09-13T19:19:40.004211+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:40.004104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:40.004104+0000","last_clean_scrub_stamp":"2024-09-13T19:19:40.004104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:57.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:33.945014+0000","last_change":"2024-09-13T19:16:05.923352+0000","last_active":"2024-09-13T19:18:33.945014+0000","last_peered":"2024-09-13T19:18:33.945014+0000","last_clean":"2024-09-13T19:18:33.945014+0000","last_became_active":"2024-09-13T19:16:05.923014+0000","last_became_peered":"2024-09-13T19:16:05.923014+0000","last_unstale":"2024-09-13T19:18:33.945014+0000","last_undegraded":"2024-09-13T19:18:33.945014+0000","last_fullsized":"2024-09-13T19:18:33.945014+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"36'4","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:56.969792+0000","last_change":"2024-09-13T19:19:56.969818+0000","last_active":"2024-09-13T19:19:56.969792+0000","last_peered":"2024-09-13T19:19:56.969792+0000","last_clean":"2024-09-13T19:19:56.969792+0000","last_became_active":"2024-09-13T19:15:57.896310+0000","last_became_peered":"2024-09-13T19:15:57.896310+0000","last_unstale":"2024-09-13T19:19:56.969792+0000","last_undegraded":"2024-09-13T19:19:56.969792+0000","last_fullsized":"2024-09-13T19:19:56.969792+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:19:56.969709+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:19:56.969709+0000","last_clean_scrub_stamp":"2024-09-13T19:19:56.969709+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:00:10.970577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:58.684717+0000","last_change":"2024-09-13T19:19:58.684741+0000","last_active":"2024-09-13T19:19:58.684717+0000","last_peered":"2024-09-13T19:19:58.684717+0000","last_clean":"2024-09-13T19:19:58.684717+0000","last_became_active":"2024-09-13T19:15:55.893600+0000","last_became_peered":"2024-09-13T19:15:55.893600+0000","last_unstale":"2024-09-13T19:19:58.684717+0000","last_undegraded":"2024-09-13T19:19:58.684717+0000","last_fullsized":"2024-09-13T19:19:58.684717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:58.684635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:58.684635+0000","last_clean_scrub_stamp":"2024-09-13T19:19:58.684635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:42:25.367627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:26.733975+0000","last_change":"2024-09-13T19:19:26.734018+0000","last_active":"2024-09-13T19:19:26.733975+0000","last_peered":"2024-09-13T19:19:26.733975+0000","last_clean":"2024-09-13T19:19:26.733975+0000","last_became_active":"2024-09-13T19:15:59.896518+0000","last_became_peered":"2024-09-13T19:15:59.896518+0000","last_unstale":"2024-09-13T19:19:26.733975+0000","last_undegraded":"2024-09-13T19:19:26.733975+0000","last_fullsized":"2024-09-13T19:19:26.733975+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:26.733839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:26.733839+0000","last_clean_scrub_stamp":"2024-09-13T19:19:26.733839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:27.626320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"36'30","reported_seq":83,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:23.073612+0000","last_change":"2024-09-13T19:19:23.073664+0000","last_active":"2024-09-13T19:19:23.073612+0000","last_peered":"2024-09-13T19:19:23.073612+0000","last_clean":"2024-09-13T19:19:23.073612+0000","last_became_active":"2024-09-13T19:16:01.902699+0000","last_became_peered":"2024-09-13T19:16:01.902699+0000","last_unstale":"2024-09-13T19:19:23.073612+0000","last_undegraded":"2024-09-13T19:19:23.073612+0000","last_fullsized":"2024-09-13T19:19:23.073612+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'30","last_scrub_stamp":"2024-09-13T19:19:23.073511+0000","last_deep_scrub":"36'30","last_deep_scrub_stamp":"2024-09-13T19:19:23.073511+0000","last_clean_scrub_stamp":"2024-09-13T19:19:23.073511+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:54:35.654271+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:37.027586+0000","last_change":"2024-09-13T19:19:37.027611+0000","last_active":"2024-09-13T19:19:37.027586+0000","last_peered":"2024-09-13T19:19:37.027586+0000","last_clean":"2024-09-13T19:19:37.027586+0000","last_became_active":"2024-09-13T19:16:03.913228+0000","last_became_peered":"2024-09-13T19:16:03.913228+0000","last_unstale":"2024-09-13T19:19:37.027586+0000","last_undegraded":"2024-09-13T19:19:37.027586+0000","last_fullsized":"2024-09-13T19:19:37.027586+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:37.027487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:37.027487+0000","last_clean_scrub_stamp":"2024-09-13T19:19:37.027487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:39:06.797236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"36'4","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:33.944981+0000","last_change":"2024-09-13T19:16:05.925781+0000","last_active":"2024-09-13T19:18:33.944981+0000","last_peered":"2024-09-13T19:18:33.944981+0000","last_clean":"2024-09-13T19:18:33.944981+0000","last_became_active":"2024-09-13T19:16:05.925519+0000","last_became_peered":"2024-09-13T19:16:05.925519+0000","last_unstale":"2024-09-13T19:18:33.944981+0000","last_undegraded":"2024-09-13T19:18:33.944981+0000","last_fullsized":"2024-09-13T19:18:33.944981+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"36'6","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:45.816308+0000","last_change":"2024-09-13T19:19:45.816379+0000","last_active":"2024-09-13T19:19:45.816308+0000","last_peered":"2024-09-13T19:19:45.816308+0000","last_clean":"2024-09-13T19:19:45.816308+0000","last_became_active":"2024-09-13T19:15:57.885993+0000","last_became_peered":"2024-09-13T19:15:57.885993+0000","last_unstale":"2024-09-13T19:19:45.816308+0000","last_undegraded":"2024-09-13T19:19:45.816308+0000","last_fullsized":"2024-09-13T19:19:45.816308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:19:45.816207+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:19:45.816207+0000","last_clean_scrub_stamp":"2024-09-13T19:19:45.816207+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:58:05.931904+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:09.058802+0000","last_change":"2024-09-13T19:20:09.058844+0000","last_active":"2024-09-13T19:20:09.058802+0000","last_peered":"2024-09-13T19:20:09.058802+0000","last_clean":"2024-09-13T19:20:09.058802+0000","last_became_active":"2024-09-13T19:15:55.895040+0000","last_became_peered":"2024-09-13T19:15:55.895040+0000","last_unstale":"2024-09-13T19:20:09.058802+0000","last_undegraded":"2024-09-13T19:20:09.058802+0000","last_fullsized":"2024-09-13T19:20:09.058802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:09.058683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:09.058683+0000","last_clean_scrub_stamp":"2024-09-13T19:20:09.058683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:46.306597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"36'3","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:24.660289+0000","last_change":"2024-09-13T19:19:24.660340+0000","last_active":"2024-09-13T19:19:24.660289+0000","last_peered":"2024-09-13T19:19:24.660289+0000","last_clean":"2024-09-13T19:19:24.660289+0000","last_became_active":"2024-09-13T19:15:59.897609+0000","last_became_peered":"2024-09-13T19:15:59.897609+0000","last_unstale":"2024-09-13T19:19:24.660289+0000","last_undegraded":"2024-09-13T19:19:24.660289+0000","last_fullsized":"2024-09-13T19:19:24.660289+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-13T19:19:24.660188+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-13T19:19:24.660188+0000","last_clean_scrub_stamp":"2024-09-13T19:19:24.660188+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:56.245062+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"36'40","reported_seq":97,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:21.050539+0000","last_change":"2024-09-13T19:19:21.050618+0000","last_active":"2024-09-13T19:19:21.050539+0000","last_peered":"2024-09-13T19:19:21.050539+0000","last_clean":"2024-09-13T19:19:21.050539+0000","last_became_active":"2024-09-13T19:16:01.902042+0000","last_became_peered":"2024-09-13T19:16:01.902042+0000","last_unstale":"2024-09-13T19:19:21.050539+0000","last_undegraded":"2024-09-13T19:19:21.050539+0000","last_fullsized":"2024-09-13T19:19:21.050539+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'40","last_scrub_stamp":"2024-09-13T19:19:21.050438+0000","last_deep_scrub":"36'40","last_deep_scrub_stamp":"2024-09-13T19:19:21.050438+0000","last_clean_scrub_stamp":"2024-09-13T19:19:21.050438+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:19.019166+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:16.346297+0000","last_change":"2024-09-13T19:19:16.346321+0000","last_active":"2024-09-13T19:19:16.346297+0000","last_peered":"2024-09-13T19:19:16.346297+0000","last_clean":"2024-09-13T19:19:16.346297+0000","last_became_active":"2024-09-13T19:16:03.911052+0000","last_became_peered":"2024-09-13T19:16:03.911052+0000","last_unstale":"2024-09-13T19:19:16.346297+0000","last_undegraded":"2024-09-13T19:19:16.346297+0000","last_fullsized":"2024-09-13T19:19:16.346297+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:16.346224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:16.346224+0000","last_clean_scrub_stamp":"2024-09-13T19:19:16.346224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:31.215677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"36'2","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:28.944271+0000","last_change":"2024-09-13T19:16:05.924212+0000","last_active":"2024-09-13T19:18:28.944271+0000","last_peered":"2024-09-13T19:18:28.944271+0000","last_clean":"2024-09-13T19:18:28.944271+0000","last_became_active":"2024-09-13T19:16:05.922822+0000","last_became_peered":"2024-09-13T19:16:05.922822+0000","last_unstale":"2024-09-13T19:18:28.944271+0000","last_undegraded":"2024-09-13T19:18:28.944271+0000","last_fullsized":"2024-09-13T19:18:28.944271+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:36.838386+0000","last_change":"2024-09-13T19:19:36.838417+0000","last_active":"2024-09-13T19:19:36.838386+0000","last_peered":"2024-09-13T19:19:36.838386+0000","last_clean":"2024-09-13T19:19:36.838386+0000","last_became_active":"2024-09-13T19:15:57.902883+0000","last_became_peered":"2024-09-13T19:15:57.902883+0000","last_unstale":"2024-09-13T19:19:36.838386+0000","last_undegraded":"2024-09-13T19:19:36.838386+0000","last_fullsized":"2024-09-13T19:19:36.838386+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:36.838299+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:36.838299+0000","last_clean_scrub_stamp":"2024-09-13T19:19:36.838299+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:44:59.482570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:46.836795+0000","last_change":"2024-09-13T19:19:46.836795+0000","last_active":"2024-09-13T19:19:46.836795+0000","last_peered":"2024-09-13T19:19:46.836795+0000","last_clean":"2024-09-13T19:19:46.836795+0000","last_became_active":"2024-09-13T19:15:55.898653+0000","last_became_peered":"2024-09-13T19:15:55.898653+0000","last_unstale":"2024-09-13T19:19:46.836795+0000","last_undegraded":"2024-09-13T19:19:46.836795+0000","last_fullsized":"2024-09-13T19:19:46.836795+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:46.836659+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:46.836659+0000","last_clean_scrub_stamp":"2024-09-13T19:19:46.836659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:47:36.269620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"36'8","reported_seq":69,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:49.674734+0000","last_change":"2024-09-13T19:19:49.674734+0000","last_active":"2024-09-13T19:19:49.674734+0000","last_peered":"2024-09-13T19:19:49.674734+0000","last_clean":"2024-09-13T19:19:49.674734+0000","last_became_active":"2024-09-13T19:15:57.886330+0000","last_became_peered":"2024-09-13T19:15:57.886330+0000","last_unstale":"2024-09-13T19:19:49.674734+0000","last_undegraded":"2024-09-13T19:19:49.674734+0000","last_fullsized":"2024-09-13T19:19:49.674734+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-13T19:19:49.674619+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-13T19:19:49.674619+0000","last_clean_scrub_stamp":"2024-09-13T19:19:49.674619+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:12:49.826958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:06.543134+0000","last_change":"2024-09-13T19:20:06.543134+0000","last_active":"2024-09-13T19:20:06.543134+0000","last_peered":"2024-09-13T19:20:06.543134+0000","last_clean":"2024-09-13T19:20:06.543134+0000","last_became_active":"2024-09-13T19:15:55.890821+0000","last_became_peered":"2024-09-13T19:15:55.890821+0000","last_unstale":"2024-09-13T19:20:06.543134+0000","last_undegraded":"2024-09-13T19:20:06.543134+0000","last_fullsized":"2024-09-13T19:20:06.543134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:20:06.543016+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:20:06.543016+0000","last_clean_scrub_stamp":"2024-09-13T19:20:06.543016+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:12.896542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:36.019599+0000","last_change":"2024-09-13T19:19:36.019627+0000","last_active":"2024-09-13T19:19:36.019599+0000","last_peered":"2024-09-13T19:19:36.019599+0000","last_clean":"2024-09-13T19:19:36.019599+0000","last_became_active":"2024-09-13T19:15:57.898295+0000","last_became_peered":"2024-09-13T19:15:57.898295+0000","last_unstale":"2024-09-13T19:19:36.019599+0000","last_undegraded":"2024-09-13T19:19:36.019599+0000","last_fullsized":"2024-09-13T19:19:36.019599+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:36.019516+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:36.019516+0000","last_clean_scrub_stamp":"2024-09-13T19:19:36.019516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:53:21.194483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:16.976354+0000","last_change":"2024-09-13T19:15:55.893929+0000","last_active":"2024-09-13T19:19:16.976354+0000","last_peered":"2024-09-13T19:19:16.976354+0000","last_clean":"2024-09-13T19:19:16.976354+0000","last_became_active":"2024-09-13T19:15:55.893191+0000","last_became_peered":"2024-09-13T19:15:55.893191+0000","last_unstale":"2024-09-13T19:19:16.976354+0000","last_undegraded":"2024-09-13T19:19:16.976354+0000","last_fullsized":"2024-09-13T19:19:16.976354+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"36'6","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:53.687759+0000","last_change":"2024-09-13T19:19:53.687759+0000","last_active":"2024-09-13T19:19:53.687759+0000","last_peered":"2024-09-13T19:19:53.687759+0000","last_clean":"2024-09-13T19:19:53.687759+0000","last_became_active":"2024-09-13T19:15:57.886670+0000","last_became_peered":"2024-09-13T19:15:57.886670+0000","last_unstale":"2024-09-13T19:19:53.687759+0000","last_undegraded":"2024-09-13T19:19:53.687759+0000","last_fullsized":"2024-09-13T19:19:53.687759+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:19:53.687608+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:19:53.687608+0000","last_clean_scrub_stamp":"2024-09-13T19:19:53.687608+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:17:16.127903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:02.618155+0000","last_change":"2024-09-13T19:20:02.618155+0000","last_active":"2024-09-13T19:20:02.618155+0000","last_peered":"2024-09-13T19:20:02.618155+0000","last_clean":"2024-09-13T19:20:02.618155+0000","last_became_active":"2024-09-13T19:15:55.893569+0000","last_became_peered":"2024-09-13T19:15:55.893569+0000","last_unstale":"2024-09-13T19:20:02.618155+0000","last_undegraded":"2024-09-13T19:20:02.618155+0000","last_fullsized":"2024-09-13T19:20:02.618155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:02.618037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:02.618037+0000","last_clean_scrub_stamp":"2024-09-13T19:20:02.618037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:22:59.114041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"36'6","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:43.530124+0000","last_change":"2024-09-13T19:19:43.530124+0000","last_active":"2024-09-13T19:19:43.530124+0000","last_peered":"2024-09-13T19:19:43.530124+0000","last_clean":"2024-09-13T19:19:43.530124+0000","last_became_active":"2024-09-13T19:15:57.896487+0000","last_became_peered":"2024-09-13T19:15:57.896487+0000","last_unstale":"2024-09-13T19:19:43.530124+0000","last_undegraded":"2024-09-13T19:19:43.530124+0000","last_fullsized":"2024-09-13T19:19:43.530124+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:19:43.529999+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:19:43.529999+0000","last_clean_scrub_stamp":"2024-09-13T19:19:43.529999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:03:46.729174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:09.501604+0000","last_change":"2024-09-13T19:20:09.501604+0000","last_active":"2024-09-13T19:20:09.501604+0000","last_peered":"2024-09-13T19:20:09.501604+0000","last_clean":"2024-09-13T19:20:09.501604+0000","last_became_active":"2024-09-13T19:15:55.892026+0000","last_became_peered":"2024-09-13T19:15:55.892026+0000","last_unstale":"2024-09-13T19:20:09.501604+0000","last_undegraded":"2024-09-13T19:20:09.501604+0000","last_fullsized":"2024-09-13T19:20:09.501604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:09.501488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:09.501488+0000","last_clean_scrub_stamp":"2024-09-13T19:20:09.501488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:11:22.750033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"36'16","reported_seq":89,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:41.888155+0000","last_change":"2024-09-13T19:19:41.888155+0000","last_active":"2024-09-13T19:19:41.888155+0000","last_peered":"2024-09-13T19:19:41.888155+0000","last_clean":"2024-09-13T19:19:41.888155+0000","last_became_active":"2024-09-13T19:15:57.902841+0000","last_became_peered":"2024-09-13T19:15:57.902841+0000","last_unstale":"2024-09-13T19:19:41.888155+0000","last_undegraded":"2024-09-13T19:19:41.888155+0000","last_fullsized":"2024-09-13T19:19:41.888155+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-13T19:19:41.887974+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-13T19:19:41.887974+0000","last_clean_scrub_stamp":"2024-09-13T19:19:41.887974+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:50:07.467247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":56,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"36'2","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:53.061124+0000","last_change":"2024-09-13T19:19:53.061149+0000","last_active":"2024-09-13T19:19:53.061124+0000","last_peered":"2024-09-13T19:19:53.061124+0000","last_clean":"2024-09-13T19:19:53.061124+0000","last_became_active":"2024-09-13T19:15:55.896490+0000","last_became_peered":"2024-09-13T19:15:55.896490+0000","last_unstale":"2024-09-13T19:19:53.061124+0000","last_undegraded":"2024-09-13T19:19:53.061124+0000","last_fullsized":"2024-09-13T19:19:53.061124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:53.061037+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:53.061037+0000","last_clean_scrub_stamp":"2024-09-13T19:19:53.061037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:29.265310+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"36'6","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:55.659165+0000","last_change":"2024-09-13T19:19:55.659165+0000","last_active":"2024-09-13T19:19:55.659165+0000","last_peered":"2024-09-13T19:19:55.659165+0000","last_clean":"2024-09-13T19:19:55.659165+0000","last_became_active":"2024-09-13T19:15:57.887810+0000","last_became_peered":"2024-09-13T19:15:57.887810+0000","last_unstale":"2024-09-13T19:19:55.659165+0000","last_undegraded":"2024-09-13T19:19:55.659165+0000","last_fullsized":"2024-09-13T19:19:55.659165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:19:55.659049+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:19:55.659049+0000","last_clean_scrub_stamp":"2024-09-13T19:19:55.659049+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:55.028329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:02.547096+0000","last_change":"2024-09-13T19:20:02.547135+0000","last_active":"2024-09-13T19:20:02.547096+0000","last_peered":"2024-09-13T19:20:02.547096+0000","last_clean":"2024-09-13T19:20:02.547096+0000","last_became_active":"2024-09-13T19:15:55.891422+0000","last_became_peered":"2024-09-13T19:15:55.891422+0000","last_unstale":"2024-09-13T19:20:02.547096+0000","last_undegraded":"2024-09-13T19:20:02.547096+0000","last_fullsized":"2024-09-13T19:20:02.547096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:02.547002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:02.547002+0000","last_clean_scrub_stamp":"2024-09-13T19:20:02.547002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:49.436907+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"36'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:56.048975+0000","last_change":"2024-09-13T19:19:56.048975+0000","last_active":"2024-09-13T19:19:56.048975+0000","last_peered":"2024-09-13T19:19:56.048975+0000","last_clean":"2024-09-13T19:19:56.048975+0000","last_became_active":"2024-09-13T19:15:57.890491+0000","last_became_peered":"2024-09-13T19:15:57.890491+0000","last_unstale":"2024-09-13T19:19:56.048975+0000","last_undegraded":"2024-09-13T19:19:56.048975+0000","last_fullsized":"2024-09-13T19:19:56.048975+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:56.048815+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:56.048815+0000","last_clean_scrub_stamp":"2024-09-13T19:19:56.048815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:28:46.218969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"36'4","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:08.490661+0000","last_change":"2024-09-13T19:20:08.490661+0000","last_active":"2024-09-13T19:20:08.490661+0000","last_peered":"2024-09-13T19:20:08.490661+0000","last_clean":"2024-09-13T19:20:08.490661+0000","last_became_active":"2024-09-13T19:15:55.891860+0000","last_became_peered":"2024-09-13T19:15:55.891860+0000","last_unstale":"2024-09-13T19:20:08.490661+0000","last_undegraded":"2024-09-13T19:20:08.490661+0000","last_fullsized":"2024-09-13T19:20:08.490661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:20:08.490539+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:20:08.490539+0000","last_clean_scrub_stamp":"2024-09-13T19:20:08.490539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:22:22.024813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"36'6","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:00.044385+0000","last_change":"2024-09-13T19:20:00.044411+0000","last_active":"2024-09-13T19:20:00.044385+0000","last_peered":"2024-09-13T19:20:00.044385+0000","last_clean":"2024-09-13T19:20:00.044385+0000","last_became_active":"2024-09-13T19:15:57.892073+0000","last_became_peered":"2024-09-13T19:15:57.892073+0000","last_unstale":"2024-09-13T19:20:00.044385+0000","last_undegraded":"2024-09-13T19:20:00.044385+0000","last_fullsized":"2024-09-13T19:20:00.044385+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:20:00.044289+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:20:00.044289+0000","last_clean_scrub_stamp":"2024-09-13T19:20:00.044289+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:22:19.075182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:12.796401+0000","last_change":"2024-09-13T19:15:55.897908+0000","last_active":"2024-09-13T19:19:12.796401+0000","last_peered":"2024-09-13T19:19:12.796401+0000","last_clean":"2024-09-13T19:19:12.796401+0000","last_became_active":"2024-09-13T19:15:55.895911+0000","last_became_peered":"2024-09-13T19:15:55.895911+0000","last_unstale":"2024-09-13T19:19:12.796401+0000","last_undegraded":"2024-09-13T19:19:12.796401+0000","last_fullsized":"2024-09-13T19:19:12.796401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"36'6","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:51.942682+0000","last_change":"2024-09-13T19:16:31.995370+0000","last_active":"2024-09-13T19:18:51.942682+0000","last_peered":"2024-09-13T19:18:51.942682+0000","last_clean":"2024-09-13T19:18:51.942682+0000","last_became_active":"2024-09-13T19:16:31.993403+0000","last_became_peered":"2024-09-13T19:16:31.993403+0000","last_unstale":"2024-09-13T19:18:51.942682+0000","last_undegraded":"2024-09-13T19:18:51.942682+0000","last_fullsized":"2024-09-13T19:18:51.942682+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:56.867113+0000","last_clean_scrub_stamp":"2024-09-13T19:15:56.867113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:54.652654+0000","last_change":"2024-09-13T19:19:54.652681+0000","last_active":"2024-09-13T19:19:54.652654+0000","last_peered":"2024-09-13T19:19:54.652654+0000","last_clean":"2024-09-13T19:19:54.652654+0000","last_became_active":"2024-09-13T19:15:55.894607+0000","last_became_peered":"2024-09-13T19:15:55.894607+0000","last_unstale":"2024-09-13T19:19:54.652654+0000","last_undegraded":"2024-09-13T19:19:54.652654+0000","last_fullsized":"2024-09-13T19:19:54.652654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:54.652549+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:54.652549+0000","last_clean_scrub_stamp":"2024-09-13T19:19:54.652549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:13:55.710652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"36'2","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:42.516393+0000","last_change":"2024-09-13T19:19:42.516418+0000","last_active":"2024-09-13T19:19:42.516393+0000","last_peered":"2024-09-13T19:19:42.516393+0000","last_clean":"2024-09-13T19:19:42.516393+0000","last_became_active":"2024-09-13T19:15:57.900902+0000","last_became_peered":"2024-09-13T19:15:57.900902+0000","last_unstale":"2024-09-13T19:19:42.516393+0000","last_undegraded":"2024-09-13T19:19:42.516393+0000","last_fullsized":"2024-09-13T19:19:42.516393+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:42.516279+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:42.516279+0000","last_clean_scrub_stamp":"2024-09-13T19:19:42.516279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:17.797802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:51.003600+0000","last_change":"2024-09-13T19:19:51.003653+0000","last_active":"2024-09-13T19:19:51.003600+0000","last_peered":"2024-09-13T19:19:51.003600+0000","last_clean":"2024-09-13T19:19:51.003600+0000","last_became_active":"2024-09-13T19:15:55.905867+0000","last_became_peered":"2024-09-13T19:15:55.905867+0000","last_unstale":"2024-09-13T19:19:51.003600+0000","last_undegraded":"2024-09-13T19:19:51.003600+0000","last_fullsized":"2024-09-13T19:19:51.003600+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:51.003475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:51.003475+0000","last_clean_scrub_stamp":"2024-09-13T19:19:51.003475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:43.388075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:45.895122+0000","last_change":"2024-09-13T19:19:45.895163+0000","last_active":"2024-09-13T19:19:45.895122+0000","last_peered":"2024-09-13T19:19:45.895122+0000","last_clean":"2024-09-13T19:19:45.895122+0000","last_became_active":"2024-09-13T19:15:57.889606+0000","last_became_peered":"2024-09-13T19:15:57.889606+0000","last_unstale":"2024-09-13T19:19:45.895122+0000","last_undegraded":"2024-09-13T19:19:45.895122+0000","last_fullsized":"2024-09-13T19:19:45.895122+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:19:45.895012+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:19:45.895012+0000","last_clean_scrub_stamp":"2024-09-13T19:19:45.895012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:09.506224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:01.092965+0000","last_change":"2024-09-13T19:20:01.092995+0000","last_active":"2024-09-13T19:20:01.092965+0000","last_peered":"2024-09-13T19:20:01.092965+0000","last_clean":"2024-09-13T19:20:01.092965+0000","last_became_active":"2024-09-13T19:15:55.896086+0000","last_became_peered":"2024-09-13T19:15:55.896086+0000","last_unstale":"2024-09-13T19:20:01.092965+0000","last_undegraded":"2024-09-13T19:20:01.092965+0000","last_fullsized":"2024-09-13T19:20:01.092965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:20:01.092860+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:20:01.092860+0000","last_clean_scrub_stamp":"2024-09-13T19:20:01.092860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:06.060089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"36'12","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:09.526035+0000","last_change":"2024-09-13T19:20:09.526086+0000","last_active":"2024-09-13T19:20:09.526035+0000","last_peered":"2024-09-13T19:20:09.526035+0000","last_clean":"2024-09-13T19:20:09.526035+0000","last_became_active":"2024-09-13T19:16:31.991965+0000","last_became_peered":"2024-09-13T19:16:31.991965+0000","last_unstale":"2024-09-13T19:20:09.526035+0000","last_undegraded":"2024-09-13T19:20:09.526035+0000","last_fullsized":"2024-09-13T19:20:09.526035+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-13T19:20:09.525926+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-13T19:20:09.525926+0000","last_clean_scrub_stamp":"2024-09-13T19:20:09.525926+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:11:08.529306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:13.941892+0000","last_change":"2024-09-13T19:15:55.894925+0000","last_active":"2024-09-13T19:18:13.941892+0000","last_peered":"2024-09-13T19:18:13.941892+0000","last_clean":"2024-09-13T19:18:13.941892+0000","last_became_active":"2024-09-13T19:15:55.894634+0000","last_became_peered":"2024-09-13T19:15:55.894634+0000","last_unstale":"2024-09-13T19:18:13.941892+0000","last_undegraded":"2024-09-13T19:18:13.941892+0000","last_fullsized":"2024-09-13T19:18:13.941892+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"36'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:10.090642+0000","last_change":"2024-09-13T19:20:10.090669+0000","last_active":"2024-09-13T19:20:10.090642+0000","last_peered":"2024-09-13T19:20:10.090642+0000","last_clean":"2024-09-13T19:20:10.090642+0000","last_became_active":"2024-09-13T19:15:57.892558+0000","last_became_peered":"2024-09-13T19:15:57.892558+0000","last_unstale":"2024-09-13T19:20:10.090642+0000","last_undegraded":"2024-09-13T19:20:10.090642+0000","last_fullsized":"2024-09-13T19:20:10.090642+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:20:10.090552+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:20:10.090552+0000","last_clean_scrub_stamp":"2024-09-13T19:20:10.090552+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:34.228351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:13.941936+0000","last_change":"2024-09-13T19:15:55.894980+0000","last_active":"2024-09-13T19:18:13.941936+0000","last_peered":"2024-09-13T19:18:13.941936+0000","last_clean":"2024-09-13T19:18:13.941936+0000","last_became_active":"2024-09-13T19:15:55.894667+0000","last_became_peered":"2024-09-13T19:15:55.894667+0000","last_unstale":"2024-09-13T19:18:13.941936+0000","last_undegraded":"2024-09-13T19:18:13.941936+0000","last_fullsized":"2024-09-13T19:18:13.941936+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"36'18","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:57.954916+0000","last_change":"2024-09-13T19:19:57.954953+0000","last_active":"2024-09-13T19:19:57.954916+0000","last_peered":"2024-09-13T19:19:57.954916+0000","last_clean":"2024-09-13T19:19:57.954916+0000","last_became_active":"2024-09-13T19:15:57.896200+0000","last_became_peered":"2024-09-13T19:15:57.896200+0000","last_unstale":"2024-09-13T19:19:57.954916+0000","last_undegraded":"2024-09-13T19:19:57.954916+0000","last_fullsized":"2024-09-13T19:19:57.954916+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'18","last_scrub_stamp":"2024-09-13T19:19:57.954831+0000","last_deep_scrub":"36'18","last_deep_scrub_stamp":"2024-09-13T19:19:57.954831+0000","last_clean_scrub_stamp":"2024-09-13T19:19:57.954831+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:03:45.500917+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":50,"num_read_kb":42,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:44.812057+0000","last_change":"2024-09-13T19:19:44.812086+0000","last_active":"2024-09-13T19:19:44.812057+0000","last_peered":"2024-09-13T19:19:44.812057+0000","last_clean":"2024-09-13T19:19:44.812057+0000","last_became_active":"2024-09-13T19:15:55.899104+0000","last_became_peered":"2024-09-13T19:15:55.899104+0000","last_unstale":"2024-09-13T19:19:44.812057+0000","last_undegraded":"2024-09-13T19:19:44.812057+0000","last_fullsized":"2024-09-13T19:19:44.812057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:44.811952+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:44.811952+0000","last_clean_scrub_stamp":"2024-09-13T19:19:44.811952+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:20.375216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"36'12","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:49.979971+0000","last_change":"2024-09-13T19:19:49.979997+0000","last_active":"2024-09-13T19:19:49.979971+0000","last_peered":"2024-09-13T19:19:49.979971+0000","last_clean":"2024-09-13T19:19:49.979971+0000","last_became_active":"2024-09-13T19:15:57.889781+0000","last_became_peered":"2024-09-13T19:15:57.889781+0000","last_unstale":"2024-09-13T19:19:49.979971+0000","last_undegraded":"2024-09-13T19:19:49.979971+0000","last_fullsized":"2024-09-13T19:19:49.979971+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-13T19:19:49.979869+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-13T19:19:49.979869+0000","last_clean_scrub_stamp":"2024-09-13T19:19:49.979869+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:02:58.441045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:10.970047+0000","last_change":"2024-09-13T19:20:10.970073+0000","last_active":"2024-09-13T19:20:10.970047+0000","last_peered":"2024-09-13T19:20:10.970047+0000","last_clean":"2024-09-13T19:20:10.970047+0000","last_became_active":"2024-09-13T19:15:55.898627+0000","last_became_peered":"2024-09-13T19:15:55.898627+0000","last_unstale":"2024-09-13T19:20:10.970047+0000","last_undegraded":"2024-09-13T19:20:10.970047+0000","last_fullsized":"2024-09-13T19:20:10.970047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:10.969953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:10.969953+0000","last_clean_scrub_stamp":"2024-09-13T19:20:10.969953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:30.846775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:18.942614+0000","last_change":"2024-09-13T19:15:55.899524+0000","last_active":"2024-09-13T19:18:18.942614+0000","last_peered":"2024-09-13T19:18:18.942614+0000","last_clean":"2024-09-13T19:18:18.942614+0000","last_became_active":"2024-09-13T19:15:55.899225+0000","last_became_peered":"2024-09-13T19:15:55.899225+0000","last_unstale":"2024-09-13T19:18:18.942614+0000","last_undegraded":"2024-09-13T19:18:18.942614+0000","last_fullsized":"2024-09-13T19:18:18.942614+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:54.860530+0000","last_clean_scrub_stamp":"2024-09-13T19:15:54.860530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"36'6","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:11.491027+0000","last_change":"2024-09-13T19:20:11.491091+0000","last_active":"2024-09-13T19:20:11.491027+0000","last_peered":"2024-09-13T19:20:11.491027+0000","last_clean":"2024-09-13T19:20:11.491027+0000","last_became_active":"2024-09-13T19:15:57.890325+0000","last_became_peered":"2024-09-13T19:15:57.890325+0000","last_unstale":"2024-09-13T19:20:11.491027+0000","last_undegraded":"2024-09-13T19:20:11.491027+0000","last_fullsized":"2024-09-13T19:20:11.491027+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:20:11.490910+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:20:11.490910+0000","last_clean_scrub_stamp":"2024-09-13T19:20:11.490910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:00:52.840106+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:52.700739+0000","last_change":"2024-09-13T19:19:52.700775+0000","last_active":"2024-09-13T19:19:52.700739+0000","last_peered":"2024-09-13T19:19:52.700739+0000","last_clean":"2024-09-13T19:19:52.700739+0000","last_became_active":"2024-09-13T19:15:55.894485+0000","last_became_peered":"2024-09-13T19:15:55.894485+0000","last_unstale":"2024-09-13T19:19:52.700739+0000","last_undegraded":"2024-09-13T19:19:52.700739+0000","last_fullsized":"2024-09-13T19:19:52.700739+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:52.700644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:52.700644+0000","last_clean_scrub_stamp":"2024-09-13T19:19:52.700644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:49.700387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"36'8","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:42.871412+0000","last_change":"2024-09-13T19:19:42.871437+0000","last_active":"2024-09-13T19:19:42.871412+0000","last_peered":"2024-09-13T19:19:42.871412+0000","last_clean":"2024-09-13T19:19:42.871412+0000","last_became_active":"2024-09-13T19:15:57.902123+0000","last_became_peered":"2024-09-13T19:15:57.902123+0000","last_unstale":"2024-09-13T19:19:42.871412+0000","last_undegraded":"2024-09-13T19:19:42.871412+0000","last_fullsized":"2024-09-13T19:19:42.871412+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-13T19:19:42.871311+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-13T19:19:42.871311+0000","last_clean_scrub_stamp":"2024-09-13T19:19:42.871311+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:31.855620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1523,"ondisk_log_size":1523,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1595,"num_read_kb":1485,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":482,"ondisk_log_size":482,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640316,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39996,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331844,"statfs":{"total":96636764160,"available":96595808256,"internally_reserved":0,"allocated":503808,"data_stored":158624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640315,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40512,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331328,"statfs":{"total":96636764160,"available":96595279872,"internally_reserved":0,"allocated":1032192,"data_stored":746866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640315,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40528,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331312,"statfs":{"total":96636764160,"available":96595263488,"internally_reserved":0,"allocated":1048576,"data_stored":746030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705724,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31636,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340204,"statfs":{"total":96636764160,"available":96604368896,"internally_reserved":0,"allocated":462848,"data_stored":156440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T19:20:18.418 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:20:18.419 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:20:18.419 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:20:18.419 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:20:18.419 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:20:18.420 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:20:18.420 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:20:18.420 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:20:18.420 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:20:18.420 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:20:18.421 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-13T19:15:43.565433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:20:18.421 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-13T19:15:43.565433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:20:18.421 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-13T19:15:43.565433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:20:18.421 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:20:18.421 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-13T19:15:43.565433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:20:18.422 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:20:18.422 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:20:18.422 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-13T19:15:43.565433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:20:18.422 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-13T19:15:58.873497+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:20:18.422 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:20:18.423 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:20:18.423 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:20:18.423 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:20:18.423 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:20:18.424 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:20:18.424 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:20:18.424 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:20:18.424 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:20:18.424 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:20:18.424 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-13T19:15:56.867113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:20:18.425 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:20:18.425 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:20:18.425 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-13T19:15:54.860530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=54, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:20:18.425 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T19:20:38.427 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T19:20:38.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.538+0000 7f094785a640 1 Processor -- start 2024-09-13T19:20:38.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.539+0000 7f094785a640 1 -- start start 2024-09-13T19:20:38.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.539+0000 7f094785a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f094009a100 0x7f0940133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:20:38.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.539+0000 7f094785a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f094009d3b0 con 0x7f094009bd50 2024-09-13T19:20:38.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.539+0000 7f094785a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f094009c840 con 0x7f094009a100 2024-09-13T19:20:38.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.539+0000 7f0944df5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f094009a100 0x7f0940133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:20:38.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.539+0000 7f09455f6640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f094009bd50 0x7f094009c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39286/0 (socket says 172.21.15.53:39286) 2024-09-13T19:20:38.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.539+0000 7f09455f6640 1 -- 172.21.15.53:0/3210431089 learned_addr learned my addr 172.21.15.53:0/3210431089 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T19:20:38.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.540+0000 7f0944df5640 1 -- 172.21.15.53:0/3210431089 >> v1:172.21.15.53:6789/0 conn(0x7f094009bd50 legacy=0x7f094009c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:20:38.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.540+0000 7f0944df5640 1 -- 172.21.15.53:0/3210431089 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0940098230 con 0x7f094009a100 2024-09-13T19:20:38.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.540+0000 7f0944df5640 1 --2- 172.21.15.53:0/3210431089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f094009a100 0x7f0940133da0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f0930009720 tx=0x7f093002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ff6815c01742d17 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:20:38.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.540+0000 7f0937fff640 1 -- 172.21.15.53:0/3210431089 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0930037070 con 0x7f094009a100 2024-09-13T19:20:38.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.541+0000 7f0937fff640 1 -- 172.21.15.53:0/3210431089 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f093002ad90 con 0x7f094009a100 2024-09-13T19:20:38.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.541+0000 7f0937fff640 1 -- 172.21.15.53:0/3210431089 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0930032590 con 0x7f094009a100 2024-09-13T19:20:38.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.541+0000 7f094785a640 1 -- 172.21.15.53:0/3210431089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f094009a100 msgr2=0x7f0940133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:20:38.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.541+0000 7f094785a640 1 --2- 172.21.15.53:0/3210431089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f094009a100 0x7f0940133da0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f0930009720 tx=0x7f093002a110 comp rx=0 tx=0).stop 2024-09-13T19:20:38.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.541+0000 7f094785a640 1 -- 172.21.15.53:0/3210431089 shutdown_connections 2024-09-13T19:20:38.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.541+0000 7f094785a640 1 --2- 172.21.15.53:0/3210431089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f094009a100 0x7f0940133da0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:20:38.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.541+0000 7f094785a640 1 -- 172.21.15.53:0/3210431089 >> 172.21.15.53:0/3210431089 conn(0x7f094006d4a0 msgr2=0x7f094006d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:20:38.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.541+0000 7f094785a640 1 -- 172.21.15.53:0/3210431089 shutdown_connections 2024-09-13T19:20:38.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.541+0000 7f094785a640 1 -- 172.21.15.53:0/3210431089 wait complete. 2024-09-13T19:20:38.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.542+0000 7f094785a640 1 Processor -- start 2024-09-13T19:20:38.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.542+0000 7f094785a640 1 -- start start 2024-09-13T19:20:38.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.542+0000 7f094785a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f094009a100 0x7f0940132880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:20:38.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.542+0000 7f094785a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f0940134670 con 0x7f094009a100 2024-09-13T19:20:38.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.543+0000 7f09455f6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f094009a100 0x7f0940132880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:20:38.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.543+0000 7f09455f6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f094009a100 0x7f0940132880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57020/0 (socket says 172.21.15.53:57020) 2024-09-13T19:20:38.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.543+0000 7f09455f6640 1 -- 172.21.15.53:0/2313135932 learned_addr learned my addr 172.21.15.53:0/2313135932 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:20:38.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.543+0000 7f09455f6640 1 -- 172.21.15.53:0/2313135932 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0940095540 con 0x7f094009a100 2024-09-13T19:20:38.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.543+0000 7f09455f6640 1 --2- 172.21.15.53:0/2313135932 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f094009a100 0x7f0940132880 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f093c00c4a0 tx=0x7f093c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:20:38.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.543+0000 7f0935ffb640 1 -- 172.21.15.53:0/2313135932 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f093c017070 con 0x7f094009a100 2024-09-13T19:20:38.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.543+0000 7f0935ffb640 1 -- 172.21.15.53:0/2313135932 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f093c005c10 con 0x7f094009a100 2024-09-13T19:20:38.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.543+0000 7f094785a640 1 -- 172.21.15.53:0/2313135932 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09400950a0 con 0x7f094009a100 2024-09-13T19:20:38.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.543+0000 7f0935ffb640 1 -- 172.21.15.53:0/2313135932 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f093c007070 con 0x7f094009a100 2024-09-13T19:20:38.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.543+0000 7f094785a640 1 -- 172.21.15.53:0/2313135932 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09400963b0 con 0x7f094009a100 2024-09-13T19:20:38.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.544+0000 7f0935ffb640 1 -- 172.21.15.53:0/2313135932 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f093c01a070 con 0x7f094009a100 2024-09-13T19:20:38.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.544+0000 7f094785a640 1 -- 172.21.15.53:0/2313135932 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09400008d0 con 0x7f094009a100 2024-09-13T19:20:38.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.544+0000 7f0935ffb640 1 --2- 172.21.15.53:0/2313135932 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f09240382a0 0x7f092403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:20:38.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.545+0000 7f0935ffb640 1 -- 172.21.15.53:0/2313135932 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f093c04b000 con 0x7f094009a100 2024-09-13T19:20:38.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.545+0000 7f0944df5640 1 --2- 172.21.15.53:0/2313135932 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f09240382a0 0x7f092403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:20:38.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.545+0000 7f0944df5640 1 --2- 172.21.15.53:0/2313135932 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f09240382a0 0x7f092403a760 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0930034000 tx=0x7f093002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:20:38.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.549+0000 7f0935ffb640 1 -- 172.21.15.53:0/2313135932 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f09400963b0 con 0x7f094009a100 2024-09-13T19:20:38.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.725+0000 7f094785a640 1 -- 172.21.15.53:0/2313135932 --> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0940074970 con 0x7f09240382a0 2024-09-13T19:20:38.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.741+0000 7f0935ffb640 1 -- 172.21.15.53:0/2313135932 <== mgr.4098 v2:172.21.15.102:6824/4283826432 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665946 (secure 0 0 0) 0x7f0940074970 con 0x7f09240382a0 2024-09-13T19:20:38.752 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:20:38.758 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T19:20:38.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.745+0000 7f094785a640 1 -- 172.21.15.53:0/2313135932 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f09240382a0 msgr2=0x7f092403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:20:38.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.745+0000 7f094785a640 1 --2- 172.21.15.53:0/2313135932 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f09240382a0 0x7f092403a760 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0930034000 tx=0x7f093002e000 comp rx=0 tx=0).stop 2024-09-13T19:20:38.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.745+0000 7f094785a640 1 -- 172.21.15.53:0/2313135932 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f094009a100 msgr2=0x7f0940132880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:20:38.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.745+0000 7f094785a640 1 --2- 172.21.15.53:0/2313135932 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f094009a100 0x7f0940132880 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f093c00c4a0 tx=0x7f093c00c960 comp rx=0 tx=0).stop 2024-09-13T19:20:38.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.746+0000 7f094785a640 1 -- 172.21.15.53:0/2313135932 shutdown_connections 2024-09-13T19:20:38.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.746+0000 7f094785a640 1 --2- 172.21.15.53:0/2313135932 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f09240382a0 0x7f092403a760 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:20:38.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.746+0000 7f094785a640 1 --2- 172.21.15.53:0/2313135932 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f094009a100 0x7f0940132880 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:20:38.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.746+0000 7f094785a640 1 -- 172.21.15.53:0/2313135932 >> 172.21.15.53:0/2313135932 conn(0x7f094006d4a0 msgr2=0x7f0940096a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:20:38.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.746+0000 7f094785a640 1 -- 172.21.15.53:0/2313135932 shutdown_connections 2024-09-13T19:20:38.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:38.746+0000 7f094785a640 1 -- 172.21.15.53:0/2313135932 wait complete. 2024-09-13T19:20:38.762 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":183,"stamp":"2024-09-13T19:20:36.996603+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5083,"num_read_kb":4664,"num_write":2179,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4788,"ondisk_log_size":4788,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152672,"kb_used_data":2976,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334688,"statfs":{"total":386547056640,"available":386390720512,"internally_reserved":0,"allocated":3047424,"data_stored":1807960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":153216791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004097"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:50.738469+0000","last_change":"2024-09-13T19:19:50.738469+0000","last_active":"2024-09-13T19:19:50.738469+0000","last_peered":"2024-09-13T19:19:50.738469+0000","last_clean":"2024-09-13T19:19:50.738469+0000","last_became_active":"2024-09-13T19:15:55.897392+0000","last_became_peered":"2024-09-13T19:15:55.897392+0000","last_unstale":"2024-09-13T19:19:50.738469+0000","last_undegraded":"2024-09-13T19:19:50.738469+0000","last_fullsized":"2024-09-13T19:19:50.738469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:50.738354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:50.738354+0000","last_clean_scrub_stamp":"2024-09-13T19:19:50.738354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:08.713727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"36'8","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:46.925658+0000","last_change":"2024-09-13T19:19:46.925684+0000","last_active":"2024-09-13T19:19:46.925658+0000","last_peered":"2024-09-13T19:19:46.925658+0000","last_clean":"2024-09-13T19:19:46.925658+0000","last_became_active":"2024-09-13T19:15:57.888352+0000","last_became_peered":"2024-09-13T19:15:57.888352+0000","last_unstale":"2024-09-13T19:19:46.925658+0000","last_undegraded":"2024-09-13T19:19:46.925658+0000","last_fullsized":"2024-09-13T19:19:46.925658+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-13T19:19:46.925571+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-13T19:19:46.925571+0000","last_clean_scrub_stamp":"2024-09-13T19:19:46.925571+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:13.870292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"34'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:50.673945+0000","last_change":"2024-09-13T19:19:50.673945+0000","last_active":"2024-09-13T19:19:50.673945+0000","last_peered":"2024-09-13T19:19:50.673945+0000","last_clean":"2024-09-13T19:19:50.673945+0000","last_became_active":"2024-09-13T19:15:55.894768+0000","last_became_peered":"2024-09-13T19:15:55.894768+0000","last_unstale":"2024-09-13T19:19:50.673945+0000","last_undegraded":"2024-09-13T19:19:50.673945+0000","last_fullsized":"2024-09-13T19:19:50.673945+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:19:50.673808+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:19:50.673808+0000","last_clean_scrub_stamp":"2024-09-13T19:19:50.673808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:40.076259+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"36'8","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:59.943290+0000","last_change":"2024-09-13T19:19:59.943321+0000","last_active":"2024-09-13T19:19:59.943290+0000","last_peered":"2024-09-13T19:19:59.943290+0000","last_clean":"2024-09-13T19:19:59.943290+0000","last_became_active":"2024-09-13T19:15:57.895424+0000","last_became_peered":"2024-09-13T19:15:57.895424+0000","last_unstale":"2024-09-13T19:19:59.943290+0000","last_undegraded":"2024-09-13T19:19:59.943290+0000","last_fullsized":"2024-09-13T19:19:59.943290+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-13T19:19:59.943201+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-13T19:19:59.943201+0000","last_clean_scrub_stamp":"2024-09-13T19:19:59.943201+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:27:16.681252+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:23.013829+0000","last_change":"2024-09-13T19:20:23.013869+0000","last_active":"2024-09-13T19:20:23.013829+0000","last_peered":"2024-09-13T19:20:23.013829+0000","last_clean":"2024-09-13T19:20:23.013829+0000","last_became_active":"2024-09-13T19:15:55.899965+0000","last_became_peered":"2024-09-13T19:15:55.899965+0000","last_unstale":"2024-09-13T19:20:23.013829+0000","last_undegraded":"2024-09-13T19:20:23.013829+0000","last_fullsized":"2024-09-13T19:20:23.013829+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:23.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:23.013721+0000","last_clean_scrub_stamp":"2024-09-13T19:20:23.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:56.351961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"36'14","reported_seq":80,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:00.925969+0000","last_change":"2024-09-13T19:20:00.926015+0000","last_active":"2024-09-13T19:20:00.925969+0000","last_peered":"2024-09-13T19:20:00.925969+0000","last_clean":"2024-09-13T19:20:00.925969+0000","last_became_active":"2024-09-13T19:15:57.894955+0000","last_became_peered":"2024-09-13T19:15:57.894955+0000","last_unstale":"2024-09-13T19:20:00.925969+0000","last_undegraded":"2024-09-13T19:20:00.925969+0000","last_fullsized":"2024-09-13T19:20:00.925969+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'14","last_scrub_stamp":"2024-09-13T19:20:00.925871+0000","last_deep_scrub":"36'14","last_deep_scrub_stamp":"2024-09-13T19:20:00.925871+0000","last_clean_scrub_stamp":"2024-09-13T19:20:00.925871+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:33.369865+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:00.514729+0000","last_change":"2024-09-13T19:20:00.514752+0000","last_active":"2024-09-13T19:20:00.514729+0000","last_peered":"2024-09-13T19:20:00.514729+0000","last_clean":"2024-09-13T19:20:00.514729+0000","last_became_active":"2024-09-13T19:15:55.889830+0000","last_became_peered":"2024-09-13T19:15:55.889830+0000","last_unstale":"2024-09-13T19:20:00.514729+0000","last_undegraded":"2024-09-13T19:20:00.514729+0000","last_fullsized":"2024-09-13T19:20:00.514729+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:00.514637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:00.514637+0000","last_clean_scrub_stamp":"2024-09-13T19:20:00.514637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:37.261883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"36'4","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:01.969039+0000","last_change":"2024-09-13T19:20:01.969069+0000","last_active":"2024-09-13T19:20:01.969039+0000","last_peered":"2024-09-13T19:20:01.969039+0000","last_clean":"2024-09-13T19:20:01.969039+0000","last_became_active":"2024-09-13T19:15:57.894733+0000","last_became_peered":"2024-09-13T19:15:57.894733+0000","last_unstale":"2024-09-13T19:20:01.969039+0000","last_undegraded":"2024-09-13T19:20:01.969039+0000","last_fullsized":"2024-09-13T19:20:01.969039+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:20:01.968947+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:20:01.968947+0000","last_clean_scrub_stamp":"2024-09-13T19:20:01.968947+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:59.545881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"36'4","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:11.960619+0000","last_change":"2024-09-13T19:20:11.960650+0000","last_active":"2024-09-13T19:20:11.960619+0000","last_peered":"2024-09-13T19:20:11.960619+0000","last_clean":"2024-09-13T19:20:11.960619+0000","last_became_active":"2024-09-13T19:15:55.895362+0000","last_became_peered":"2024-09-13T19:15:55.895362+0000","last_unstale":"2024-09-13T19:20:11.960619+0000","last_undegraded":"2024-09-13T19:20:11.960619+0000","last_fullsized":"2024-09-13T19:20:11.960619+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:20:11.960527+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:20:11.960527+0000","last_clean_scrub_stamp":"2024-09-13T19:20:11.960527+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:58.156294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"36'8","reported_seq":69,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:47.935056+0000","last_change":"2024-09-13T19:19:47.935056+0000","last_active":"2024-09-13T19:19:47.935056+0000","last_peered":"2024-09-13T19:19:47.935056+0000","last_clean":"2024-09-13T19:19:47.935056+0000","last_became_active":"2024-09-13T19:15:57.889664+0000","last_became_peered":"2024-09-13T19:15:57.889664+0000","last_unstale":"2024-09-13T19:19:47.935056+0000","last_undegraded":"2024-09-13T19:19:47.935056+0000","last_fullsized":"2024-09-13T19:19:47.935056+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-13T19:19:47.934931+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-13T19:19:47.934931+0000","last_clean_scrub_stamp":"2024-09-13T19:19:47.934931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:58.003188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"36'4","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:59.557096+0000","last_change":"2024-09-13T19:19:59.557143+0000","last_active":"2024-09-13T19:19:59.557096+0000","last_peered":"2024-09-13T19:19:59.557096+0000","last_clean":"2024-09-13T19:19:59.557096+0000","last_became_active":"2024-09-13T19:15:55.889485+0000","last_became_peered":"2024-09-13T19:15:55.889485+0000","last_unstale":"2024-09-13T19:19:59.557096+0000","last_undegraded":"2024-09-13T19:19:59.557096+0000","last_fullsized":"2024-09-13T19:19:59.557096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:19:59.556986+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:19:59.556986+0000","last_clean_scrub_stamp":"2024-09-13T19:19:59.556986+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:35.761259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"36'2","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:34.063067+0000","last_change":"2024-09-13T19:19:34.063067+0000","last_active":"2024-09-13T19:19:34.063067+0000","last_peered":"2024-09-13T19:19:34.063067+0000","last_clean":"2024-09-13T19:19:34.063067+0000","last_became_active":"2024-09-13T19:15:57.900785+0000","last_became_peered":"2024-09-13T19:15:57.900785+0000","last_unstale":"2024-09-13T19:19:34.063067+0000","last_undegraded":"2024-09-13T19:19:34.063067+0000","last_fullsized":"2024-09-13T19:19:34.063067+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:34.062937+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:34.062937+0000","last_clean_scrub_stamp":"2024-09-13T19:19:34.062937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:11:39.030166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"36'2","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:08.989884+0000","last_change":"2024-09-13T19:20:08.989911+0000","last_active":"2024-09-13T19:20:08.989884+0000","last_peered":"2024-09-13T19:20:08.989884+0000","last_clean":"2024-09-13T19:20:08.989884+0000","last_became_active":"2024-09-13T19:15:55.897381+0000","last_became_peered":"2024-09-13T19:15:55.897381+0000","last_unstale":"2024-09-13T19:20:08.989884+0000","last_undegraded":"2024-09-13T19:20:08.989884+0000","last_fullsized":"2024-09-13T19:20:08.989884+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:20:08.989795+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:20:08.989795+0000","last_clean_scrub_stamp":"2024-09-13T19:20:08.989795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:20.035191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"36'16","reported_seq":100,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:47.809912+0000","last_change":"2024-09-13T19:19:47.809912+0000","last_active":"2024-09-13T19:19:47.809912+0000","last_peered":"2024-09-13T19:19:47.809912+0000","last_clean":"2024-09-13T19:19:47.809912+0000","last_became_active":"2024-09-13T19:15:57.893408+0000","last_became_peered":"2024-09-13T19:15:57.893408+0000","last_unstale":"2024-09-13T19:19:47.809912+0000","last_undegraded":"2024-09-13T19:19:47.809912+0000","last_fullsized":"2024-09-13T19:19:47.809912+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-13T19:19:47.809763+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-13T19:19:47.809763+0000","last_clean_scrub_stamp":"2024-09-13T19:19:47.809763+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:37:38.871573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"36'2","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:48.658576+0000","last_change":"2024-09-13T19:19:48.658601+0000","last_active":"2024-09-13T19:19:48.658576+0000","last_peered":"2024-09-13T19:19:48.658576+0000","last_clean":"2024-09-13T19:19:48.658576+0000","last_became_active":"2024-09-13T19:15:55.901190+0000","last_became_peered":"2024-09-13T19:15:55.901190+0000","last_unstale":"2024-09-13T19:19:48.658576+0000","last_undegraded":"2024-09-13T19:19:48.658576+0000","last_fullsized":"2024-09-13T19:19:48.658576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:48.658486+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:48.658486+0000","last_clean_scrub_stamp":"2024-09-13T19:19:48.658486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:15:38.548787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"36'16","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:55.632013+0000","last_change":"2024-09-13T19:19:55.632013+0000","last_active":"2024-09-13T19:19:55.632013+0000","last_peered":"2024-09-13T19:19:55.632013+0000","last_clean":"2024-09-13T19:19:55.632013+0000","last_became_active":"2024-09-13T19:15:57.898325+0000","last_became_peered":"2024-09-13T19:15:57.898325+0000","last_unstale":"2024-09-13T19:19:55.632013+0000","last_undegraded":"2024-09-13T19:19:55.632013+0000","last_fullsized":"2024-09-13T19:19:55.632013+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-13T19:19:55.631818+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-13T19:19:55.631818+0000","last_clean_scrub_stamp":"2024-09-13T19:19:55.631818+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:59.940789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":52,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"36'4","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:03.927384+0000","last_change":"2024-09-13T19:20:03.927407+0000","last_active":"2024-09-13T19:20:03.927384+0000","last_peered":"2024-09-13T19:20:03.927384+0000","last_clean":"2024-09-13T19:20:03.927384+0000","last_became_active":"2024-09-13T19:15:57.887144+0000","last_became_peered":"2024-09-13T19:15:57.887144+0000","last_unstale":"2024-09-13T19:20:03.927384+0000","last_undegraded":"2024-09-13T19:20:03.927384+0000","last_fullsized":"2024-09-13T19:20:03.927384+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:20:03.927294+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:20:03.927294+0000","last_clean_scrub_stamp":"2024-09-13T19:20:03.927294+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:18:50.671482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"36'2","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:55.084086+0000","last_change":"2024-09-13T19:19:55.084112+0000","last_active":"2024-09-13T19:19:55.084086+0000","last_peered":"2024-09-13T19:19:55.084086+0000","last_clean":"2024-09-13T19:19:55.084086+0000","last_became_active":"2024-09-13T19:15:55.895552+0000","last_became_peered":"2024-09-13T19:15:55.895552+0000","last_unstale":"2024-09-13T19:19:55.084086+0000","last_undegraded":"2024-09-13T19:19:55.084086+0000","last_fullsized":"2024-09-13T19:19:55.084086+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:55.083997+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:55.083997+0000","last_clean_scrub_stamp":"2024-09-13T19:19:55.083997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:16.783662+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"36'8","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:48.955061+0000","last_change":"2024-09-13T19:19:48.955111+0000","last_active":"2024-09-13T19:19:48.955061+0000","last_peered":"2024-09-13T19:19:48.955061+0000","last_clean":"2024-09-13T19:19:48.955061+0000","last_became_active":"2024-09-13T19:15:57.886511+0000","last_became_peered":"2024-09-13T19:15:57.886511+0000","last_unstale":"2024-09-13T19:19:48.955061+0000","last_undegraded":"2024-09-13T19:19:48.955061+0000","last_fullsized":"2024-09-13T19:19:48.955061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-13T19:19:48.954919+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-13T19:19:48.954919+0000","last_clean_scrub_stamp":"2024-09-13T19:19:48.954919+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:06.835960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:48.818273+0000","last_change":"2024-09-13T19:19:48.818317+0000","last_active":"2024-09-13T19:19:48.818273+0000","last_peered":"2024-09-13T19:19:48.818273+0000","last_clean":"2024-09-13T19:19:48.818273+0000","last_became_active":"2024-09-13T19:15:55.896952+0000","last_became_peered":"2024-09-13T19:15:55.896952+0000","last_unstale":"2024-09-13T19:19:48.818273+0000","last_undegraded":"2024-09-13T19:19:48.818273+0000","last_fullsized":"2024-09-13T19:19:48.818273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:48.818164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:48.818164+0000","last_clean_scrub_stamp":"2024-09-13T19:19:48.818164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:02.241073+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"36'8","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:58.078958+0000","last_change":"2024-09-13T19:19:58.078987+0000","last_active":"2024-09-13T19:19:58.078958+0000","last_peered":"2024-09-13T19:19:58.078958+0000","last_clean":"2024-09-13T19:19:58.078958+0000","last_became_active":"2024-09-13T19:15:57.891411+0000","last_became_peered":"2024-09-13T19:15:57.891411+0000","last_unstale":"2024-09-13T19:19:58.078958+0000","last_undegraded":"2024-09-13T19:19:58.078958+0000","last_fullsized":"2024-09-13T19:19:58.078958+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-13T19:19:58.078853+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-13T19:19:58.078853+0000","last_clean_scrub_stamp":"2024-09-13T19:19:58.078853+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:14.717815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"36'2","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:57.048072+0000","last_change":"2024-09-13T19:19:57.048117+0000","last_active":"2024-09-13T19:19:57.048072+0000","last_peered":"2024-09-13T19:19:57.048072+0000","last_clean":"2024-09-13T19:19:57.048072+0000","last_became_active":"2024-09-13T19:15:55.895453+0000","last_became_peered":"2024-09-13T19:15:55.895453+0000","last_unstale":"2024-09-13T19:19:57.048072+0000","last_undegraded":"2024-09-13T19:19:57.048072+0000","last_fullsized":"2024-09-13T19:19:57.048072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:57.047952+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:57.047952+0000","last_clean_scrub_stamp":"2024-09-13T19:19:57.047952+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:44.511756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"36'8","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:46.621422+0000","last_change":"2024-09-13T19:19:46.621446+0000","last_active":"2024-09-13T19:19:46.621422+0000","last_peered":"2024-09-13T19:19:46.621422+0000","last_clean":"2024-09-13T19:19:46.621422+0000","last_became_active":"2024-09-13T19:15:57.896208+0000","last_became_peered":"2024-09-13T19:15:57.896208+0000","last_unstale":"2024-09-13T19:19:46.621422+0000","last_undegraded":"2024-09-13T19:19:46.621422+0000","last_fullsized":"2024-09-13T19:19:46.621422+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-13T19:19:46.621332+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-13T19:19:46.621332+0000","last_clean_scrub_stamp":"2024-09-13T19:19:46.621332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:00.483604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:05.080505+0000","last_change":"2024-09-13T19:20:05.080533+0000","last_active":"2024-09-13T19:20:05.080505+0000","last_peered":"2024-09-13T19:20:05.080505+0000","last_clean":"2024-09-13T19:20:05.080505+0000","last_became_active":"2024-09-13T19:15:55.892616+0000","last_became_peered":"2024-09-13T19:15:55.892616+0000","last_unstale":"2024-09-13T19:20:05.080505+0000","last_undegraded":"2024-09-13T19:20:05.080505+0000","last_fullsized":"2024-09-13T19:20:05.080505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:20:05.080420+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:20:05.080420+0000","last_clean_scrub_stamp":"2024-09-13T19:20:05.080420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:29.203072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"36'2","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:49.771954+0000","last_change":"2024-09-13T19:19:49.771997+0000","last_active":"2024-09-13T19:19:49.771954+0000","last_peered":"2024-09-13T19:19:49.771954+0000","last_clean":"2024-09-13T19:19:49.771954+0000","last_became_active":"2024-09-13T19:15:57.897566+0000","last_became_peered":"2024-09-13T19:15:57.897566+0000","last_unstale":"2024-09-13T19:19:49.771954+0000","last_undegraded":"2024-09-13T19:19:49.771954+0000","last_fullsized":"2024-09-13T19:19:49.771954+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:49.771831+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:49.771831+0000","last_clean_scrub_stamp":"2024-09-13T19:19:49.771831+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:38.756140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:00.631042+0000","last_change":"2024-09-13T19:20:00.631090+0000","last_active":"2024-09-13T19:20:00.631042+0000","last_peered":"2024-09-13T19:20:00.631042+0000","last_clean":"2024-09-13T19:20:00.631042+0000","last_became_active":"2024-09-13T19:15:55.893594+0000","last_became_peered":"2024-09-13T19:15:55.893594+0000","last_unstale":"2024-09-13T19:20:00.631042+0000","last_undegraded":"2024-09-13T19:20:00.631042+0000","last_fullsized":"2024-09-13T19:20:00.631042+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:00.630941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:00.630941+0000","last_clean_scrub_stamp":"2024-09-13T19:20:00.630941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:06:00.888554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"36'6","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:52.023727+0000","last_change":"2024-09-13T19:19:52.023770+0000","last_active":"2024-09-13T19:19:52.023727+0000","last_peered":"2024-09-13T19:19:52.023727+0000","last_clean":"2024-09-13T19:19:52.023727+0000","last_became_active":"2024-09-13T19:15:57.889901+0000","last_became_peered":"2024-09-13T19:15:57.889901+0000","last_unstale":"2024-09-13T19:19:52.023727+0000","last_undegraded":"2024-09-13T19:19:52.023727+0000","last_fullsized":"2024-09-13T19:19:52.023727+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:19:52.023617+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:19:52.023617+0000","last_clean_scrub_stamp":"2024-09-13T19:19:52.023617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:55.796931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:12.967331+0000","last_change":"2024-09-13T19:20:12.967360+0000","last_active":"2024-09-13T19:20:12.967331+0000","last_peered":"2024-09-13T19:20:12.967331+0000","last_clean":"2024-09-13T19:20:12.967331+0000","last_became_active":"2024-09-13T19:15:55.898679+0000","last_became_peered":"2024-09-13T19:15:55.898679+0000","last_unstale":"2024-09-13T19:20:12.967331+0000","last_undegraded":"2024-09-13T19:20:12.967331+0000","last_fullsized":"2024-09-13T19:20:12.967331+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:12.967205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:12.967205+0000","last_clean_scrub_stamp":"2024-09-13T19:20:12.967205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:14:48.427858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"36'36","reported_seq":109,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:14.953031+0000","last_change":"2024-09-13T19:20:14.953060+0000","last_active":"2024-09-13T19:20:14.953031+0000","last_peered":"2024-09-13T19:20:14.953031+0000","last_clean":"2024-09-13T19:20:14.953031+0000","last_became_active":"2024-09-13T19:16:05.921156+0000","last_became_peered":"2024-09-13T19:16:05.921156+0000","last_unstale":"2024-09-13T19:20:14.953031+0000","last_undegraded":"2024-09-13T19:20:14.953031+0000","last_fullsized":"2024-09-13T19:20:14.953031+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-13T19:20:14.952944+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-13T19:20:14.952944+0000","last_clean_scrub_stamp":"2024-09-13T19:20:14.952944+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:33:18.777351+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"36'6","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:49.875510+0000","last_change":"2024-09-13T19:19:49.875536+0000","last_active":"2024-09-13T19:19:49.875510+0000","last_peered":"2024-09-13T19:19:49.875510+0000","last_clean":"2024-09-13T19:19:49.875510+0000","last_became_active":"2024-09-13T19:15:57.895870+0000","last_became_peered":"2024-09-13T19:15:57.895870+0000","last_unstale":"2024-09-13T19:19:49.875510+0000","last_undegraded":"2024-09-13T19:19:49.875510+0000","last_fullsized":"2024-09-13T19:19:49.875510+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:19:49.875424+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:19:49.875424+0000","last_clean_scrub_stamp":"2024-09-13T19:19:49.875424+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:44.778091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:18.021810+0000","last_change":"2024-09-13T19:20:18.021834+0000","last_active":"2024-09-13T19:20:18.021810+0000","last_peered":"2024-09-13T19:20:18.021810+0000","last_clean":"2024-09-13T19:20:18.021810+0000","last_became_active":"2024-09-13T19:15:55.894099+0000","last_became_peered":"2024-09-13T19:15:55.894099+0000","last_unstale":"2024-09-13T19:20:18.021810+0000","last_undegraded":"2024-09-13T19:20:18.021810+0000","last_fullsized":"2024-09-13T19:20:18.021810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:18.021712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:18.021712+0000","last_clean_scrub_stamp":"2024-09-13T19:20:18.021712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:58:34.223917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:20.089068+0000","last_change":"2024-09-13T19:19:20.089107+0000","last_active":"2024-09-13T19:19:20.089068+0000","last_peered":"2024-09-13T19:19:20.089068+0000","last_clean":"2024-09-13T19:19:20.089068+0000","last_became_active":"2024-09-13T19:15:59.896648+0000","last_became_peered":"2024-09-13T19:15:59.896648+0000","last_unstale":"2024-09-13T19:19:20.089068+0000","last_undegraded":"2024-09-13T19:19:20.089068+0000","last_fullsized":"2024-09-13T19:19:20.089068+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:20.088934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:20.088934+0000","last_clean_scrub_stamp":"2024-09-13T19:19:20.088934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:25.257454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"36'36","reported_seq":91,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:41.951351+0000","last_change":"2024-09-13T19:19:41.951384+0000","last_active":"2024-09-13T19:19:41.951351+0000","last_peered":"2024-09-13T19:19:41.951351+0000","last_clean":"2024-09-13T19:19:41.951351+0000","last_became_active":"2024-09-13T19:16:01.906675+0000","last_became_peered":"2024-09-13T19:16:01.906675+0000","last_unstale":"2024-09-13T19:19:41.951351+0000","last_undegraded":"2024-09-13T19:19:41.951351+0000","last_fullsized":"2024-09-13T19:19:41.951351+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-13T19:19:41.951264+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-13T19:19:41.951264+0000","last_clean_scrub_stamp":"2024-09-13T19:19:41.951264+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:19.199178+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:35.864331+0000","last_change":"2024-09-13T19:19:35.864355+0000","last_active":"2024-09-13T19:19:35.864331+0000","last_peered":"2024-09-13T19:19:35.864331+0000","last_clean":"2024-09-13T19:19:35.864331+0000","last_became_active":"2024-09-13T19:16:03.914111+0000","last_became_peered":"2024-09-13T19:16:03.914111+0000","last_unstale":"2024-09-13T19:19:35.864331+0000","last_undegraded":"2024-09-13T19:19:35.864331+0000","last_fullsized":"2024-09-13T19:19:35.864331+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:35.864237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:35.864237+0000","last_clean_scrub_stamp":"2024-09-13T19:19:35.864237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:31:06.989608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"36'7","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:16.925335+0000","last_change":"2024-09-13T19:20:16.925360+0000","last_active":"2024-09-13T19:20:16.925335+0000","last_peered":"2024-09-13T19:20:16.925335+0000","last_clean":"2024-09-13T19:20:16.925335+0000","last_became_active":"2024-09-13T19:16:05.924829+0000","last_became_peered":"2024-09-13T19:16:05.924829+0000","last_unstale":"2024-09-13T19:20:16.925335+0000","last_undegraded":"2024-09-13T19:20:16.925335+0000","last_fullsized":"2024-09-13T19:20:16.925335+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'7","last_scrub_stamp":"2024-09-13T19:20:16.925225+0000","last_deep_scrub":"36'7","last_deep_scrub_stamp":"2024-09-13T19:20:16.925225+0000","last_clean_scrub_stamp":"2024-09-13T19:20:16.925225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:11.827893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"36'10","reported_seq":70,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:48.913828+0000","last_change":"2024-09-13T19:19:48.913853+0000","last_active":"2024-09-13T19:19:48.913828+0000","last_peered":"2024-09-13T19:19:48.913828+0000","last_clean":"2024-09-13T19:19:48.913828+0000","last_became_active":"2024-09-13T19:15:57.897928+0000","last_became_peered":"2024-09-13T19:15:57.897928+0000","last_unstale":"2024-09-13T19:19:48.913828+0000","last_undegraded":"2024-09-13T19:19:48.913828+0000","last_fullsized":"2024-09-13T19:19:48.913828+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-13T19:19:48.913742+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-13T19:19:48.913742+0000","last_clean_scrub_stamp":"2024-09-13T19:19:48.913742+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:09:14.046682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:03.557803+0000","last_change":"2024-09-13T19:20:03.557828+0000","last_active":"2024-09-13T19:20:03.557803+0000","last_peered":"2024-09-13T19:20:03.557803+0000","last_clean":"2024-09-13T19:20:03.557803+0000","last_became_active":"2024-09-13T19:15:55.891934+0000","last_became_peered":"2024-09-13T19:15:55.891934+0000","last_unstale":"2024-09-13T19:20:03.557803+0000","last_undegraded":"2024-09-13T19:20:03.557803+0000","last_fullsized":"2024-09-13T19:20:03.557803+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:03.557697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:03.557697+0000","last_clean_scrub_stamp":"2024-09-13T19:20:03.557697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:16.166958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:39.498827+0000","last_change":"2024-09-13T19:19:39.498853+0000","last_active":"2024-09-13T19:19:39.498827+0000","last_peered":"2024-09-13T19:19:39.498827+0000","last_clean":"2024-09-13T19:19:39.498827+0000","last_became_active":"2024-09-13T19:15:59.892230+0000","last_became_peered":"2024-09-13T19:15:59.892230+0000","last_unstale":"2024-09-13T19:19:39.498827+0000","last_undegraded":"2024-09-13T19:19:39.498827+0000","last_fullsized":"2024-09-13T19:19:39.498827+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:39.498723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:39.498723+0000","last_clean_scrub_stamp":"2024-09-13T19:19:39.498723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:50.652003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"36'11","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:20.693227+0000","last_change":"2024-09-13T19:19:20.693258+0000","last_active":"2024-09-13T19:19:20.693227+0000","last_peered":"2024-09-13T19:19:20.693227+0000","last_clean":"2024-09-13T19:19:20.693227+0000","last_became_active":"2024-09-13T19:16:01.903371+0000","last_became_peered":"2024-09-13T19:16:01.903371+0000","last_unstale":"2024-09-13T19:19:20.693227+0000","last_undegraded":"2024-09-13T19:19:20.693227+0000","last_fullsized":"2024-09-13T19:19:20.693227+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'11","last_scrub_stamp":"2024-09-13T19:19:20.693140+0000","last_deep_scrub":"36'11","last_deep_scrub_stamp":"2024-09-13T19:19:20.693140+0000","last_clean_scrub_stamp":"2024-09-13T19:19:20.693140+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:19.872266+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:39.817530+0000","last_change":"2024-09-13T19:19:39.817552+0000","last_active":"2024-09-13T19:19:39.817530+0000","last_peered":"2024-09-13T19:19:39.817530+0000","last_clean":"2024-09-13T19:19:39.817530+0000","last_became_active":"2024-09-13T19:16:03.915538+0000","last_became_peered":"2024-09-13T19:16:03.915538+0000","last_unstale":"2024-09-13T19:19:39.817530+0000","last_undegraded":"2024-09-13T19:19:39.817530+0000","last_fullsized":"2024-09-13T19:19:39.817530+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:39.817428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:39.817428+0000","last_clean_scrub_stamp":"2024-09-13T19:19:39.817428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:06:06.681988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"34'2","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:41.520495+0000","last_change":"2024-09-13T19:19:41.520527+0000","last_active":"2024-09-13T19:19:41.520495+0000","last_peered":"2024-09-13T19:19:41.520495+0000","last_clean":"2024-09-13T19:19:41.520495+0000","last_became_active":"2024-09-13T19:16:05.911683+0000","last_became_peered":"2024-09-13T19:16:05.911683+0000","last_unstale":"2024-09-13T19:19:41.520495+0000","last_undegraded":"2024-09-13T19:19:41.520495+0000","last_fullsized":"2024-09-13T19:19:41.520495+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:19:41.520392+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:19:41.520392+0000","last_clean_scrub_stamp":"2024-09-13T19:19:41.520392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:23.565901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"36'4","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:53.901762+0000","last_change":"2024-09-13T19:19:53.901787+0000","last_active":"2024-09-13T19:19:53.901762+0000","last_peered":"2024-09-13T19:19:53.901762+0000","last_clean":"2024-09-13T19:19:53.901762+0000","last_became_active":"2024-09-13T19:15:57.896965+0000","last_became_peered":"2024-09-13T19:15:57.896965+0000","last_unstale":"2024-09-13T19:19:53.901762+0000","last_undegraded":"2024-09-13T19:19:53.901762+0000","last_fullsized":"2024-09-13T19:19:53.901762+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:19:53.901665+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:19:53.901665+0000","last_clean_scrub_stamp":"2024-09-13T19:19:53.901665+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:59.285297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"36'4","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:15.019308+0000","last_change":"2024-09-13T19:20:15.019334+0000","last_active":"2024-09-13T19:20:15.019308+0000","last_peered":"2024-09-13T19:20:15.019308+0000","last_clean":"2024-09-13T19:20:15.019308+0000","last_became_active":"2024-09-13T19:15:55.895444+0000","last_became_peered":"2024-09-13T19:15:55.895444+0000","last_unstale":"2024-09-13T19:20:15.019308+0000","last_undegraded":"2024-09-13T19:20:15.019308+0000","last_fullsized":"2024-09-13T19:20:15.019308+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:20:15.019221+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:20:15.019221+0000","last_clean_scrub_stamp":"2024-09-13T19:20:15.019221+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:26.009738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:35.477880+0000","last_change":"2024-09-13T19:19:35.477903+0000","last_active":"2024-09-13T19:19:35.477880+0000","last_peered":"2024-09-13T19:19:35.477880+0000","last_clean":"2024-09-13T19:19:35.477880+0000","last_became_active":"2024-09-13T19:15:59.895332+0000","last_became_peered":"2024-09-13T19:15:59.895332+0000","last_unstale":"2024-09-13T19:19:35.477880+0000","last_undegraded":"2024-09-13T19:19:35.477880+0000","last_fullsized":"2024-09-13T19:19:35.477880+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:35.477788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:35.477788+0000","last_clean_scrub_stamp":"2024-09-13T19:19:35.477788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:23:52.241441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"36'15","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:25.800975+0000","last_change":"2024-09-13T19:19:25.801012+0000","last_active":"2024-09-13T19:19:25.800975+0000","last_peered":"2024-09-13T19:19:25.800975+0000","last_clean":"2024-09-13T19:19:25.800975+0000","last_became_active":"2024-09-13T19:16:01.905457+0000","last_became_peered":"2024-09-13T19:16:01.905457+0000","last_unstale":"2024-09-13T19:19:25.800975+0000","last_undegraded":"2024-09-13T19:19:25.800975+0000","last_fullsized":"2024-09-13T19:19:25.800975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'15","last_scrub_stamp":"2024-09-13T19:19:25.800877+0000","last_deep_scrub":"36'15","last_deep_scrub_stamp":"2024-09-13T19:19:25.800877+0000","last_clean_scrub_stamp":"2024-09-13T19:19:25.800877+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:36.670597+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"36'286","reported_seq":394,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:50.851017+0000","last_change":"2024-09-13T19:19:50.851047+0000","last_active":"2024-09-13T19:19:50.851017+0000","last_peered":"2024-09-13T19:19:50.851017+0000","last_clean":"2024-09-13T19:19:50.851017+0000","last_became_active":"2024-09-13T19:16:03.916853+0000","last_became_peered":"2024-09-13T19:16:03.916853+0000","last_unstale":"2024-09-13T19:19:50.851017+0000","last_undegraded":"2024-09-13T19:19:50.851017+0000","last_fullsized":"2024-09-13T19:19:50.851017+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'286","last_scrub_stamp":"2024-09-13T19:19:50.850910+0000","last_deep_scrub":"36'286","last_deep_scrub_stamp":"2024-09-13T19:19:50.850910+0000","last_clean_scrub_stamp":"2024-09-13T19:19:50.850910+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:27:51.431330+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"36'2","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:39.721687+0000","last_change":"2024-09-13T19:19:39.721711+0000","last_active":"2024-09-13T19:19:39.721687+0000","last_peered":"2024-09-13T19:19:39.721687+0000","last_clean":"2024-09-13T19:19:39.721687+0000","last_became_active":"2024-09-13T19:16:05.912191+0000","last_became_peered":"2024-09-13T19:16:05.912191+0000","last_unstale":"2024-09-13T19:19:39.721687+0000","last_undegraded":"2024-09-13T19:19:39.721687+0000","last_fullsized":"2024-09-13T19:19:39.721687+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:39.721599+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:39.721599+0000","last_clean_scrub_stamp":"2024-09-13T19:19:39.721599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:58:45.282753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"36'4","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:01.628888+0000","last_change":"2024-09-13T19:20:01.628913+0000","last_active":"2024-09-13T19:20:01.628888+0000","last_peered":"2024-09-13T19:20:01.628888+0000","last_clean":"2024-09-13T19:20:01.628888+0000","last_became_active":"2024-09-13T19:15:57.890015+0000","last_became_peered":"2024-09-13T19:15:57.890015+0000","last_unstale":"2024-09-13T19:20:01.628888+0000","last_undegraded":"2024-09-13T19:20:01.628888+0000","last_fullsized":"2024-09-13T19:20:01.628888+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:20:01.628788+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:20:01.628788+0000","last_clean_scrub_stamp":"2024-09-13T19:20:01.628788+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:21.086734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:06.088049+0000","last_change":"2024-09-13T19:20:06.088085+0000","last_active":"2024-09-13T19:20:06.088049+0000","last_peered":"2024-09-13T19:20:06.088049+0000","last_clean":"2024-09-13T19:20:06.088049+0000","last_became_active":"2024-09-13T19:15:55.894380+0000","last_became_peered":"2024-09-13T19:15:55.894380+0000","last_unstale":"2024-09-13T19:20:06.088049+0000","last_undegraded":"2024-09-13T19:20:06.088049+0000","last_fullsized":"2024-09-13T19:20:06.088049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:06.087929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:06.087929+0000","last_clean_scrub_stamp":"2024-09-13T19:20:06.087929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:01.249205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:16.988795+0000","last_change":"2024-09-13T19:19:16.988819+0000","last_active":"2024-09-13T19:19:16.988795+0000","last_peered":"2024-09-13T19:19:16.988795+0000","last_clean":"2024-09-13T19:19:16.988795+0000","last_became_active":"2024-09-13T19:15:59.896572+0000","last_became_peered":"2024-09-13T19:15:59.896572+0000","last_unstale":"2024-09-13T19:19:16.988795+0000","last_undegraded":"2024-09-13T19:19:16.988795+0000","last_fullsized":"2024-09-13T19:19:16.988795+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:16.988701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:16.988701+0000","last_clean_scrub_stamp":"2024-09-13T19:19:16.988701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:14.282330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"36'36","reported_seq":91,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:22.776961+0000","last_change":"2024-09-13T19:19:22.777010+0000","last_active":"2024-09-13T19:19:22.776961+0000","last_peered":"2024-09-13T19:19:22.776961+0000","last_clean":"2024-09-13T19:19:22.776961+0000","last_became_active":"2024-09-13T19:16:01.906471+0000","last_became_peered":"2024-09-13T19:16:01.906471+0000","last_unstale":"2024-09-13T19:19:22.776961+0000","last_undegraded":"2024-09-13T19:19:22.776961+0000","last_fullsized":"2024-09-13T19:19:22.776961+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-13T19:19:22.776859+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-13T19:19:22.776859+0000","last_clean_scrub_stamp":"2024-09-13T19:19:22.776859+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:40.452064+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"36'285","reported_seq":422,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:20.301108+0000","last_change":"2024-09-13T19:19:20.301137+0000","last_active":"2024-09-13T19:19:20.301108+0000","last_peered":"2024-09-13T19:19:20.301108+0000","last_clean":"2024-09-13T19:19:20.301108+0000","last_became_active":"2024-09-13T19:16:03.909046+0000","last_became_peered":"2024-09-13T19:16:03.909046+0000","last_unstale":"2024-09-13T19:19:20.301108+0000","last_undegraded":"2024-09-13T19:19:20.301108+0000","last_fullsized":"2024-09-13T19:19:20.301108+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-13T19:19:20.301016+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-13T19:19:20.301016+0000","last_clean_scrub_stamp":"2024-09-13T19:19:20.301016+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:00.732319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"36'16","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:11.578636+0000","last_change":"2024-09-13T19:20:11.578670+0000","last_active":"2024-09-13T19:20:11.578636+0000","last_peered":"2024-09-13T19:20:11.578636+0000","last_clean":"2024-09-13T19:20:11.578636+0000","last_became_active":"2024-09-13T19:16:31.991055+0000","last_became_peered":"2024-09-13T19:16:31.991055+0000","last_unstale":"2024-09-13T19:20:11.578636+0000","last_undegraded":"2024-09-13T19:20:11.578636+0000","last_fullsized":"2024-09-13T19:20:11.578636+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-13T19:20:11.578543+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-13T19:20:11.578543+0000","last_clean_scrub_stamp":"2024-09-13T19:20:11.578543+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:35.701195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":73,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:54.641871+0000","last_change":"2024-09-13T19:19:54.641871+0000","last_active":"2024-09-13T19:19:54.641871+0000","last_peered":"2024-09-13T19:19:54.641871+0000","last_clean":"2024-09-13T19:19:54.641871+0000","last_became_active":"2024-09-13T19:15:55.893544+0000","last_became_peered":"2024-09-13T19:15:55.893544+0000","last_unstale":"2024-09-13T19:19:54.641871+0000","last_undegraded":"2024-09-13T19:19:54.641871+0000","last_fullsized":"2024-09-13T19:19:54.641871+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:54.641751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:54.641751+0000","last_clean_scrub_stamp":"2024-09-13T19:19:54.641751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:04.710009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:25.690504+0000","last_change":"2024-09-13T19:19:25.690504+0000","last_active":"2024-09-13T19:19:25.690504+0000","last_peered":"2024-09-13T19:19:25.690504+0000","last_clean":"2024-09-13T19:19:25.690504+0000","last_became_active":"2024-09-13T19:15:59.897435+0000","last_became_peered":"2024-09-13T19:15:59.897435+0000","last_unstale":"2024-09-13T19:19:25.690504+0000","last_undegraded":"2024-09-13T19:19:25.690504+0000","last_fullsized":"2024-09-13T19:19:25.690504+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:25.690361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:25.690361+0000","last_clean_scrub_stamp":"2024-09-13T19:19:25.690361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:23:10.242794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"36'52","reported_seq":113,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:26.852897+0000","last_change":"2024-09-13T19:19:26.852897+0000","last_active":"2024-09-13T19:19:26.852897+0000","last_peered":"2024-09-13T19:19:26.852897+0000","last_clean":"2024-09-13T19:19:26.852897+0000","last_became_active":"2024-09-13T19:16:01.904454+0000","last_became_peered":"2024-09-13T19:16:01.904454+0000","last_unstale":"2024-09-13T19:19:26.852897+0000","last_undegraded":"2024-09-13T19:19:26.852897+0000","last_fullsized":"2024-09-13T19:19:26.852897+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'52","last_scrub_stamp":"2024-09-13T19:19:26.852772+0000","last_deep_scrub":"36'52","last_deep_scrub_stamp":"2024-09-13T19:19:26.852772+0000","last_clean_scrub_stamp":"2024-09-13T19:19:26.852772+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:51.100890+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:25.339857+0000","last_change":"2024-09-13T19:19:25.339857+0000","last_active":"2024-09-13T19:19:25.339857+0000","last_peered":"2024-09-13T19:19:25.339857+0000","last_clean":"2024-09-13T19:19:25.339857+0000","last_became_active":"2024-09-13T19:16:03.912383+0000","last_became_peered":"2024-09-13T19:16:03.912383+0000","last_unstale":"2024-09-13T19:19:25.339857+0000","last_undegraded":"2024-09-13T19:19:25.339857+0000","last_fullsized":"2024-09-13T19:19:25.339857+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:25.339734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:25.339734+0000","last_clean_scrub_stamp":"2024-09-13T19:19:25.339734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:29.120530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"36'5","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:07.574709+0000","last_change":"2024-09-13T19:20:07.574709+0000","last_active":"2024-09-13T19:20:07.574709+0000","last_peered":"2024-09-13T19:20:07.574709+0000","last_clean":"2024-09-13T19:20:07.574709+0000","last_became_active":"2024-09-13T19:16:05.919154+0000","last_became_peered":"2024-09-13T19:16:05.919154+0000","last_unstale":"2024-09-13T19:20:07.574709+0000","last_undegraded":"2024-09-13T19:20:07.574709+0000","last_fullsized":"2024-09-13T19:20:07.574709+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-09-13T19:20:07.574573+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-09-13T19:20:07.574573+0000","last_clean_scrub_stamp":"2024-09-13T19:20:07.574573+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:56:34.868499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:54.102926+0000","last_change":"2024-09-13T19:19:54.102926+0000","last_active":"2024-09-13T19:19:54.102926+0000","last_peered":"2024-09-13T19:19:54.102926+0000","last_clean":"2024-09-13T19:19:54.102926+0000","last_became_active":"2024-09-13T19:15:57.890345+0000","last_became_peered":"2024-09-13T19:15:57.890345+0000","last_unstale":"2024-09-13T19:19:54.102926+0000","last_undegraded":"2024-09-13T19:19:54.102926+0000","last_fullsized":"2024-09-13T19:19:54.102926+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:19:54.102800+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:19:54.102800+0000","last_clean_scrub_stamp":"2024-09-13T19:19:54.102800+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:26.429123+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:01.536496+0000","last_change":"2024-09-13T19:20:01.536496+0000","last_active":"2024-09-13T19:20:01.536496+0000","last_peered":"2024-09-13T19:20:01.536496+0000","last_clean":"2024-09-13T19:20:01.536496+0000","last_became_active":"2024-09-13T19:15:55.891250+0000","last_became_peered":"2024-09-13T19:15:55.891250+0000","last_unstale":"2024-09-13T19:20:01.536496+0000","last_undegraded":"2024-09-13T19:20:01.536496+0000","last_fullsized":"2024-09-13T19:20:01.536496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:20:01.536373+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:20:01.536373+0000","last_clean_scrub_stamp":"2024-09-13T19:20:01.536373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:49:59.441969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:40.548760+0000","last_change":"2024-09-13T19:19:40.548760+0000","last_active":"2024-09-13T19:19:40.548760+0000","last_peered":"2024-09-13T19:19:40.548760+0000","last_clean":"2024-09-13T19:19:40.548760+0000","last_became_active":"2024-09-13T19:15:59.891028+0000","last_became_peered":"2024-09-13T19:15:59.891028+0000","last_unstale":"2024-09-13T19:19:40.548760+0000","last_undegraded":"2024-09-13T19:19:40.548760+0000","last_fullsized":"2024-09-13T19:19:40.548760+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:40.548634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:40.548634+0000","last_clean_scrub_stamp":"2024-09-13T19:19:40.548634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:18:54.086278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"36'36","reported_seq":92,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:29.094550+0000","last_change":"2024-09-13T19:19:29.094550+0000","last_active":"2024-09-13T19:19:29.094550+0000","last_peered":"2024-09-13T19:19:29.094550+0000","last_clean":"2024-09-13T19:19:29.094550+0000","last_became_active":"2024-09-13T19:16:01.904534+0000","last_became_peered":"2024-09-13T19:16:01.904534+0000","last_unstale":"2024-09-13T19:19:29.094550+0000","last_undegraded":"2024-09-13T19:19:29.094550+0000","last_fullsized":"2024-09-13T19:19:29.094550+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-13T19:19:29.094383+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-13T19:19:29.094383+0000","last_clean_scrub_stamp":"2024-09-13T19:19:29.094383+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:28:19.264538+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:33.431831+0000","last_change":"2024-09-13T19:19:33.431831+0000","last_active":"2024-09-13T19:19:33.431831+0000","last_peered":"2024-09-13T19:19:33.431831+0000","last_clean":"2024-09-13T19:19:33.431831+0000","last_became_active":"2024-09-13T19:16:03.913829+0000","last_became_peered":"2024-09-13T19:16:03.913829+0000","last_unstale":"2024-09-13T19:19:33.431831+0000","last_undegraded":"2024-09-13T19:19:33.431831+0000","last_fullsized":"2024-09-13T19:19:33.431831+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:33.431688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:33.431688+0000","last_clean_scrub_stamp":"2024-09-13T19:19:33.431688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:40:42.508968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"36'4","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:12.054063+0000","last_change":"2024-09-13T19:20:12.054063+0000","last_active":"2024-09-13T19:20:12.054063+0000","last_peered":"2024-09-13T19:20:12.054063+0000","last_clean":"2024-09-13T19:20:12.054063+0000","last_became_active":"2024-09-13T19:16:05.913578+0000","last_became_peered":"2024-09-13T19:16:05.913578+0000","last_unstale":"2024-09-13T19:20:12.054063+0000","last_undegraded":"2024-09-13T19:20:12.054063+0000","last_fullsized":"2024-09-13T19:20:12.054063+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:20:12.053936+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:20:12.053936+0000","last_clean_scrub_stamp":"2024-09-13T19:20:12.053936+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:13:39.847869+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:53.682379+0000","last_change":"2024-09-13T19:19:53.682379+0000","last_active":"2024-09-13T19:19:53.682379+0000","last_peered":"2024-09-13T19:19:53.682379+0000","last_clean":"2024-09-13T19:19:53.682379+0000","last_became_active":"2024-09-13T19:15:57.897468+0000","last_became_peered":"2024-09-13T19:15:57.897468+0000","last_unstale":"2024-09-13T19:19:53.682379+0000","last_undegraded":"2024-09-13T19:19:53.682379+0000","last_fullsized":"2024-09-13T19:19:53.682379+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:53.682234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:53.682234+0000","last_clean_scrub_stamp":"2024-09-13T19:19:53.682234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:20.626955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:30.972998+0000","last_change":"2024-09-13T19:20:30.973037+0000","last_active":"2024-09-13T19:20:30.972998+0000","last_peered":"2024-09-13T19:20:30.972998+0000","last_clean":"2024-09-13T19:20:30.972998+0000","last_became_active":"2024-09-13T19:15:55.893489+0000","last_became_peered":"2024-09-13T19:15:55.893489+0000","last_unstale":"2024-09-13T19:20:30.972998+0000","last_undegraded":"2024-09-13T19:20:30.972998+0000","last_fullsized":"2024-09-13T19:20:30.972998+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:30.972873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:30.972873+0000","last_clean_scrub_stamp":"2024-09-13T19:20:30.972873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:35.739544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:36.500258+0000","last_change":"2024-09-13T19:19:36.500258+0000","last_active":"2024-09-13T19:19:36.500258+0000","last_peered":"2024-09-13T19:19:36.500258+0000","last_clean":"2024-09-13T19:19:36.500258+0000","last_became_active":"2024-09-13T19:15:59.895291+0000","last_became_peered":"2024-09-13T19:15:59.895291+0000","last_unstale":"2024-09-13T19:19:36.500258+0000","last_undegraded":"2024-09-13T19:19:36.500258+0000","last_fullsized":"2024-09-13T19:19:36.500258+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:36.500113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:36.500113+0000","last_clean_scrub_stamp":"2024-09-13T19:19:36.500113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:16:46.762131+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"36'45","reported_seq":104,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:19.049589+0000","last_change":"2024-09-13T19:19:19.049589+0000","last_active":"2024-09-13T19:19:19.049589+0000","last_peered":"2024-09-13T19:19:19.049589+0000","last_clean":"2024-09-13T19:19:19.049589+0000","last_became_active":"2024-09-13T19:16:01.896507+0000","last_became_peered":"2024-09-13T19:16:01.896507+0000","last_unstale":"2024-09-13T19:19:19.049589+0000","last_undegraded":"2024-09-13T19:19:19.049589+0000","last_fullsized":"2024-09-13T19:19:19.049589+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'45","last_scrub_stamp":"2024-09-13T19:19:19.049456+0000","last_deep_scrub":"36'45","last_deep_scrub_stamp":"2024-09-13T19:19:19.049456+0000","last_clean_scrub_stamp":"2024-09-13T19:19:19.049456+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:40.433022+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"36'285","reported_seq":388,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:21.320904+0000","last_change":"2024-09-13T19:19:21.320904+0000","last_active":"2024-09-13T19:19:21.320904+0000","last_peered":"2024-09-13T19:19:21.320904+0000","last_clean":"2024-09-13T19:19:21.320904+0000","last_became_active":"2024-09-13T19:16:03.910504+0000","last_became_peered":"2024-09-13T19:16:03.910504+0000","last_unstale":"2024-09-13T19:19:21.320904+0000","last_undegraded":"2024-09-13T19:19:21.320904+0000","last_fullsized":"2024-09-13T19:19:21.320904+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-13T19:19:21.320768+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-13T19:19:21.320768+0000","last_clean_scrub_stamp":"2024-09-13T19:19:21.320768+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:21:36.601671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"36'4","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:14.493626+0000","last_change":"2024-09-13T19:20:14.493626+0000","last_active":"2024-09-13T19:20:14.493626+0000","last_peered":"2024-09-13T19:20:14.493626+0000","last_clean":"2024-09-13T19:20:14.493626+0000","last_became_active":"2024-09-13T19:16:05.912881+0000","last_became_peered":"2024-09-13T19:16:05.912881+0000","last_unstale":"2024-09-13T19:20:14.493626+0000","last_undegraded":"2024-09-13T19:20:14.493626+0000","last_fullsized":"2024-09-13T19:20:14.493626+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:20:14.493507+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:20:14.493507+0000","last_clean_scrub_stamp":"2024-09-13T19:20:14.493507+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:11:30.673524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"36'4","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:41.805515+0000","last_change":"2024-09-13T19:19:41.805515+0000","last_active":"2024-09-13T19:19:41.805515+0000","last_peered":"2024-09-13T19:19:41.805515+0000","last_clean":"2024-09-13T19:19:41.805515+0000","last_became_active":"2024-09-13T19:15:57.883675+0000","last_became_peered":"2024-09-13T19:15:57.883675+0000","last_unstale":"2024-09-13T19:19:41.805515+0000","last_undegraded":"2024-09-13T19:19:41.805515+0000","last_fullsized":"2024-09-13T19:19:41.805515+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:19:41.805394+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:19:41.805394+0000","last_clean_scrub_stamp":"2024-09-13T19:19:41.805394+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:11:49.618178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"36'7","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:29.975211+0000","last_change":"2024-09-13T19:20:29.975264+0000","last_active":"2024-09-13T19:20:29.975211+0000","last_peered":"2024-09-13T19:20:29.975211+0000","last_clean":"2024-09-13T19:20:29.975211+0000","last_became_active":"2024-09-13T19:15:55.891882+0000","last_became_peered":"2024-09-13T19:15:55.891882+0000","last_unstale":"2024-09-13T19:20:29.975211+0000","last_undegraded":"2024-09-13T19:20:29.975211+0000","last_fullsized":"2024-09-13T19:20:29.975211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'7","last_scrub_stamp":"2024-09-13T19:20:29.975084+0000","last_deep_scrub":"36'7","last_deep_scrub_stamp":"2024-09-13T19:20:29.975084+0000","last_clean_scrub_stamp":"2024-09-13T19:20:29.975084+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:31:43.005670+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":16,"num_write_kb":4722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:10.565233+0000","last_change":"2024-09-13T19:20:10.565263+0000","last_active":"2024-09-13T19:20:10.565233+0000","last_peered":"2024-09-13T19:20:10.565233+0000","last_clean":"2024-09-13T19:20:10.565233+0000","last_became_active":"2024-09-13T19:16:31.992122+0000","last_became_peered":"2024-09-13T19:16:31.992122+0000","last_unstale":"2024-09-13T19:20:10.565233+0000","last_undegraded":"2024-09-13T19:20:10.565233+0000","last_fullsized":"2024-09-13T19:20:10.565233+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:10.565140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:10.565140+0000","last_clean_scrub_stamp":"2024-09-13T19:20:10.565140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:36.265398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"36'66","reported_seq":140,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:44.917516+0000","last_change":"2024-09-13T19:19:44.917516+0000","last_active":"2024-09-13T19:19:44.917516+0000","last_peered":"2024-09-13T19:19:44.917516+0000","last_clean":"2024-09-13T19:19:44.917516+0000","last_became_active":"2024-09-13T19:16:01.906031+0000","last_became_peered":"2024-09-13T19:16:01.906031+0000","last_unstale":"2024-09-13T19:19:44.917516+0000","last_undegraded":"2024-09-13T19:19:44.917516+0000","last_fullsized":"2024-09-13T19:19:44.917516+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'66","last_scrub_stamp":"2024-09-13T19:19:44.917388+0000","last_deep_scrub":"36'66","last_deep_scrub_stamp":"2024-09-13T19:19:44.917388+0000","last_clean_scrub_stamp":"2024-09-13T19:19:44.917388+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:13:12.711321+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:23.383957+0000","last_change":"2024-09-13T19:19:23.383957+0000","last_active":"2024-09-13T19:19:23.383957+0000","last_peered":"2024-09-13T19:19:23.383957+0000","last_clean":"2024-09-13T19:19:23.383957+0000","last_became_active":"2024-09-13T19:16:03.908134+0000","last_became_peered":"2024-09-13T19:16:03.908134+0000","last_unstale":"2024-09-13T19:19:23.383957+0000","last_undegraded":"2024-09-13T19:19:23.383957+0000","last_fullsized":"2024-09-13T19:19:23.383957+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:23.383782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:23.383782+0000","last_clean_scrub_stamp":"2024-09-13T19:19:23.383782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:10.783386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"36'21","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:15.545652+0000","last_change":"2024-09-13T19:20:15.545652+0000","last_active":"2024-09-13T19:20:15.545652+0000","last_peered":"2024-09-13T19:20:15.545652+0000","last_clean":"2024-09-13T19:20:15.545652+0000","last_became_active":"2024-09-13T19:16:05.914853+0000","last_became_peered":"2024-09-13T19:16:05.914853+0000","last_unstale":"2024-09-13T19:20:15.545652+0000","last_undegraded":"2024-09-13T19:20:15.545652+0000","last_fullsized":"2024-09-13T19:20:15.545652+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'21","last_scrub_stamp":"2024-09-13T19:20:15.545533+0000","last_deep_scrub":"36'21","last_deep_scrub_stamp":"2024-09-13T19:20:15.545533+0000","last_clean_scrub_stamp":"2024-09-13T19:20:15.545533+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:59:00.701185+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"36'6","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:37.807504+0000","last_change":"2024-09-13T19:19:37.807504+0000","last_active":"2024-09-13T19:19:37.807504+0000","last_peered":"2024-09-13T19:19:37.807504+0000","last_clean":"2024-09-13T19:19:37.807504+0000","last_became_active":"2024-09-13T19:15:57.902955+0000","last_became_peered":"2024-09-13T19:15:57.902955+0000","last_unstale":"2024-09-13T19:19:37.807504+0000","last_undegraded":"2024-09-13T19:19:37.807504+0000","last_fullsized":"2024-09-13T19:19:37.807504+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:19:37.807394+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:19:37.807394+0000","last_clean_scrub_stamp":"2024-09-13T19:19:37.807394+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:23:23.699122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:05.537039+0000","last_change":"2024-09-13T19:20:05.537039+0000","last_active":"2024-09-13T19:20:05.537039+0000","last_peered":"2024-09-13T19:20:05.537039+0000","last_clean":"2024-09-13T19:20:05.537039+0000","last_became_active":"2024-09-13T19:15:55.890805+0000","last_became_peered":"2024-09-13T19:15:55.890805+0000","last_unstale":"2024-09-13T19:20:05.537039+0000","last_undegraded":"2024-09-13T19:20:05.537039+0000","last_fullsized":"2024-09-13T19:20:05.537039+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:05.536913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:05.536913+0000","last_clean_scrub_stamp":"2024-09-13T19:20:05.536913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:08:13.286175+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:32.806783+0000","last_change":"2024-09-13T19:19:32.806783+0000","last_active":"2024-09-13T19:19:32.806783+0000","last_peered":"2024-09-13T19:19:32.806783+0000","last_clean":"2024-09-13T19:19:32.806783+0000","last_became_active":"2024-09-13T19:15:59.897884+0000","last_became_peered":"2024-09-13T19:15:59.897884+0000","last_unstale":"2024-09-13T19:19:32.806783+0000","last_undegraded":"2024-09-13T19:19:32.806783+0000","last_fullsized":"2024-09-13T19:19:32.806783+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:32.806649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:32.806649+0000","last_clean_scrub_stamp":"2024-09-13T19:19:32.806649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:35.455381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"36'41","reported_seq":98,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:21.708485+0000","last_change":"2024-09-13T19:19:21.708485+0000","last_active":"2024-09-13T19:19:21.708485+0000","last_peered":"2024-09-13T19:19:21.708485+0000","last_clean":"2024-09-13T19:19:21.708485+0000","last_became_active":"2024-09-13T19:16:01.902657+0000","last_became_peered":"2024-09-13T19:16:01.902657+0000","last_unstale":"2024-09-13T19:19:21.708485+0000","last_undegraded":"2024-09-13T19:19:21.708485+0000","last_fullsized":"2024-09-13T19:19:21.708485+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'41","last_scrub_stamp":"2024-09-13T19:19:21.708338+0000","last_deep_scrub":"36'41","last_deep_scrub_stamp":"2024-09-13T19:19:21.708338+0000","last_clean_scrub_stamp":"2024-09-13T19:19:21.708338+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:24.621364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":44,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:38.960234+0000","last_change":"2024-09-13T19:19:38.960234+0000","last_active":"2024-09-13T19:19:38.960234+0000","last_peered":"2024-09-13T19:19:38.960234+0000","last_clean":"2024-09-13T19:19:38.960234+0000","last_became_active":"2024-09-13T19:16:03.915499+0000","last_became_peered":"2024-09-13T19:16:03.915499+0000","last_unstale":"2024-09-13T19:19:38.960234+0000","last_undegraded":"2024-09-13T19:19:38.960234+0000","last_fullsized":"2024-09-13T19:19:38.960234+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:38.960096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:38.960096+0000","last_clean_scrub_stamp":"2024-09-13T19:19:38.960096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:34.121371+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"36'4","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:06.957184+0000","last_change":"2024-09-13T19:20:06.957184+0000","last_active":"2024-09-13T19:20:06.957184+0000","last_peered":"2024-09-13T19:20:06.957184+0000","last_clean":"2024-09-13T19:20:06.957184+0000","last_became_active":"2024-09-13T19:16:05.920239+0000","last_became_peered":"2024-09-13T19:16:05.920239+0000","last_unstale":"2024-09-13T19:20:06.957184+0000","last_undegraded":"2024-09-13T19:20:06.957184+0000","last_fullsized":"2024-09-13T19:20:06.957184+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:20:06.957071+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:20:06.957071+0000","last_clean_scrub_stamp":"2024-09-13T19:20:06.957071+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:07:39.659763+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"36'8","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:33.099210+0000","last_change":"2024-09-13T19:19:33.099210+0000","last_active":"2024-09-13T19:19:33.099210+0000","last_peered":"2024-09-13T19:19:33.099210+0000","last_clean":"2024-09-13T19:19:33.099210+0000","last_became_active":"2024-09-13T19:15:57.901131+0000","last_became_peered":"2024-09-13T19:15:57.901131+0000","last_unstale":"2024-09-13T19:19:33.099210+0000","last_undegraded":"2024-09-13T19:19:33.099210+0000","last_fullsized":"2024-09-13T19:19:33.099210+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-13T19:19:33.099097+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-13T19:19:33.099097+0000","last_clean_scrub_stamp":"2024-09-13T19:19:33.099097+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:21:52.129989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:32.984053+0000","last_change":"2024-09-13T19:20:32.984127+0000","last_active":"2024-09-13T19:20:32.984053+0000","last_peered":"2024-09-13T19:20:32.984053+0000","last_clean":"2024-09-13T19:20:32.984053+0000","last_became_active":"2024-09-13T19:15:55.900143+0000","last_became_peered":"2024-09-13T19:15:55.900143+0000","last_unstale":"2024-09-13T19:20:32.984053+0000","last_undegraded":"2024-09-13T19:20:32.984053+0000","last_fullsized":"2024-09-13T19:20:32.984053+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:32.983958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:32.983958+0000","last_clean_scrub_stamp":"2024-09-13T19:20:32.983958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:48:14.336412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:38.478130+0000","last_change":"2024-09-13T19:19:38.478130+0000","last_active":"2024-09-13T19:19:38.478130+0000","last_peered":"2024-09-13T19:19:38.478130+0000","last_clean":"2024-09-13T19:19:38.478130+0000","last_became_active":"2024-09-13T19:15:59.894793+0000","last_became_peered":"2024-09-13T19:15:59.894793+0000","last_unstale":"2024-09-13T19:19:38.478130+0000","last_undegraded":"2024-09-13T19:19:38.478130+0000","last_fullsized":"2024-09-13T19:19:38.478130+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:38.477940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:38.477940+0000","last_clean_scrub_stamp":"2024-09-13T19:19:38.477940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:10.926294+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"36'45","reported_seq":104,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:30.838996+0000","last_change":"2024-09-13T19:19:30.838996+0000","last_active":"2024-09-13T19:19:30.838996+0000","last_peered":"2024-09-13T19:19:30.838996+0000","last_clean":"2024-09-13T19:19:30.838996+0000","last_became_active":"2024-09-13T19:16:01.897733+0000","last_became_peered":"2024-09-13T19:16:01.897733+0000","last_unstale":"2024-09-13T19:19:30.838996+0000","last_undegraded":"2024-09-13T19:19:30.838996+0000","last_fullsized":"2024-09-13T19:19:30.838996+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'45","last_scrub_stamp":"2024-09-13T19:19:30.838860+0000","last_deep_scrub":"36'45","last_deep_scrub_stamp":"2024-09-13T19:19:30.838860+0000","last_clean_scrub_stamp":"2024-09-13T19:19:30.838860+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:39:39.517349+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"36'285","reported_seq":422,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:23.814508+0000","last_change":"2024-09-13T19:19:23.814508+0000","last_active":"2024-09-13T19:19:23.814508+0000","last_peered":"2024-09-13T19:19:23.814508+0000","last_clean":"2024-09-13T19:19:23.814508+0000","last_became_active":"2024-09-13T19:16:03.915589+0000","last_became_peered":"2024-09-13T19:16:03.915589+0000","last_unstale":"2024-09-13T19:19:23.814508+0000","last_undegraded":"2024-09-13T19:19:23.814508+0000","last_fullsized":"2024-09-13T19:19:23.814508+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-13T19:19:23.814324+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-13T19:19:23.814324+0000","last_clean_scrub_stamp":"2024-09-13T19:19:23.814324+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:26.983039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"36'13","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:12.475238+0000","last_change":"2024-09-13T19:20:12.475238+0000","last_active":"2024-09-13T19:20:12.475238+0000","last_peered":"2024-09-13T19:20:12.475238+0000","last_clean":"2024-09-13T19:20:12.475238+0000","last_became_active":"2024-09-13T19:16:05.912339+0000","last_became_peered":"2024-09-13T19:16:05.912339+0000","last_unstale":"2024-09-13T19:20:12.475238+0000","last_undegraded":"2024-09-13T19:20:12.475238+0000","last_fullsized":"2024-09-13T19:20:12.475238+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'13","last_scrub_stamp":"2024-09-13T19:20:12.475107+0000","last_deep_scrub":"36'13","last_deep_scrub_stamp":"2024-09-13T19:20:12.475107+0000","last_clean_scrub_stamp":"2024-09-13T19:20:12.475107+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:23:20.507295+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"36'6","reported_seq":69,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:40.761706+0000","last_change":"2024-09-13T19:19:40.761706+0000","last_active":"2024-09-13T19:19:40.761706+0000","last_peered":"2024-09-13T19:19:40.761706+0000","last_clean":"2024-09-13T19:19:40.761706+0000","last_became_active":"2024-09-13T19:15:57.900560+0000","last_became_peered":"2024-09-13T19:15:57.900560+0000","last_unstale":"2024-09-13T19:19:40.761706+0000","last_undegraded":"2024-09-13T19:19:40.761706+0000","last_fullsized":"2024-09-13T19:19:40.761706+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:19:40.761587+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:19:40.761587+0000","last_clean_scrub_stamp":"2024-09-13T19:19:40.761587+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:45.661345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:16.041569+0000","last_change":"2024-09-13T19:20:16.041569+0000","last_active":"2024-09-13T19:20:16.041569+0000","last_peered":"2024-09-13T19:20:16.041569+0000","last_clean":"2024-09-13T19:20:16.041569+0000","last_became_active":"2024-09-13T19:15:55.895799+0000","last_became_peered":"2024-09-13T19:15:55.895799+0000","last_unstale":"2024-09-13T19:20:16.041569+0000","last_undegraded":"2024-09-13T19:20:16.041569+0000","last_fullsized":"2024-09-13T19:20:16.041569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:16.041444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:16.041444+0000","last_clean_scrub_stamp":"2024-09-13T19:20:16.041444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:27:11.582296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'5","reported_seq":429,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:28.767985+0000","last_change":"2024-09-13T19:19:28.767985+0000","last_active":"2024-09-13T19:19:28.767985+0000","last_peered":"2024-09-13T19:19:28.767985+0000","last_clean":"2024-09-13T19:19:28.767985+0000","last_became_active":"2024-09-13T19:15:59.894303+0000","last_became_peered":"2024-09-13T19:15:59.894303+0000","last_unstale":"2024-09-13T19:19:28.767985+0000","last_undegraded":"2024-09-13T19:19:28.767985+0000","last_fullsized":"2024-09-13T19:19:28.767985+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-09-13T19:19:28.767856+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-09-13T19:19:28.767856+0000","last_clean_scrub_stamp":"2024-09-13T19:19:28.767856+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:10.640290+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"36'15","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:43.951910+0000","last_change":"2024-09-13T19:19:43.951910+0000","last_active":"2024-09-13T19:19:43.951910+0000","last_peered":"2024-09-13T19:19:43.951910+0000","last_clean":"2024-09-13T19:19:43.951910+0000","last_became_active":"2024-09-13T19:16:01.906490+0000","last_became_peered":"2024-09-13T19:16:01.906490+0000","last_unstale":"2024-09-13T19:19:43.951910+0000","last_undegraded":"2024-09-13T19:19:43.951910+0000","last_fullsized":"2024-09-13T19:19:43.951910+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'15","last_scrub_stamp":"2024-09-13T19:19:43.951784+0000","last_deep_scrub":"36'15","last_deep_scrub_stamp":"2024-09-13T19:19:43.951784+0000","last_clean_scrub_stamp":"2024-09-13T19:19:43.951784+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:38.693730+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"36'285","reported_seq":512,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:19.722840+0000","last_change":"2024-09-13T19:19:19.722840+0000","last_active":"2024-09-13T19:19:19.722840+0000","last_peered":"2024-09-13T19:19:19.722840+0000","last_clean":"2024-09-13T19:19:19.722840+0000","last_became_active":"2024-09-13T19:16:03.905523+0000","last_became_peered":"2024-09-13T19:16:03.905523+0000","last_unstale":"2024-09-13T19:19:19.722840+0000","last_undegraded":"2024-09-13T19:19:19.722840+0000","last_fullsized":"2024-09-13T19:19:19.722840+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-13T19:19:19.722719+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-13T19:19:19.722719+0000","last_clean_scrub_stamp":"2024-09-13T19:19:19.722719+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:33.649384+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"36'4","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:27.846042+0000","last_change":"2024-09-13T19:19:27.846042+0000","last_active":"2024-09-13T19:19:27.846042+0000","last_peered":"2024-09-13T19:19:27.846042+0000","last_clean":"2024-09-13T19:19:27.846042+0000","last_became_active":"2024-09-13T19:16:05.910656+0000","last_became_peered":"2024-09-13T19:16:05.910656+0000","last_unstale":"2024-09-13T19:19:27.846042+0000","last_undegraded":"2024-09-13T19:19:27.846042+0000","last_fullsized":"2024-09-13T19:19:27.846042+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:19:27.845857+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:19:27.845857+0000","last_clean_scrub_stamp":"2024-09-13T19:19:27.845857+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:46.547978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"36'3","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:34.847663+0000","last_change":"2024-09-13T19:19:34.847663+0000","last_active":"2024-09-13T19:19:34.847663+0000","last_peered":"2024-09-13T19:19:34.847663+0000","last_clean":"2024-09-13T19:19:34.847663+0000","last_became_active":"2024-09-13T19:15:57.903761+0000","last_became_peered":"2024-09-13T19:15:57.903761+0000","last_unstale":"2024-09-13T19:19:34.847663+0000","last_undegraded":"2024-09-13T19:19:34.847663+0000","last_fullsized":"2024-09-13T19:19:34.847663+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-13T19:19:34.847491+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-13T19:19:34.847491+0000","last_clean_scrub_stamp":"2024-09-13T19:19:34.847491+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:49.358180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:21.001037+0000","last_change":"2024-09-13T19:20:21.001064+0000","last_active":"2024-09-13T19:20:21.001037+0000","last_peered":"2024-09-13T19:20:21.001037+0000","last_clean":"2024-09-13T19:20:21.001037+0000","last_became_active":"2024-09-13T19:15:55.899919+0000","last_became_peered":"2024-09-13T19:15:55.899919+0000","last_unstale":"2024-09-13T19:20:21.001037+0000","last_undegraded":"2024-09-13T19:20:21.001037+0000","last_fullsized":"2024-09-13T19:20:21.001037+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:21.000929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:21.000929+0000","last_clean_scrub_stamp":"2024-09-13T19:20:21.000929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:30.375003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"36'5","reported_seq":239,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:18.034914+0000","last_change":"2024-09-13T19:19:18.034914+0000","last_active":"2024-09-13T19:19:18.034914+0000","last_peered":"2024-09-13T19:19:18.034914+0000","last_clean":"2024-09-13T19:19:18.034914+0000","last_became_active":"2024-09-13T19:15:59.896081+0000","last_became_peered":"2024-09-13T19:15:59.896081+0000","last_unstale":"2024-09-13T19:19:18.034914+0000","last_undegraded":"2024-09-13T19:19:18.034914+0000","last_fullsized":"2024-09-13T19:19:18.034914+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-09-13T19:19:18.034798+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-09-13T19:19:18.034798+0000","last_clean_scrub_stamp":"2024-09-13T19:19:18.034798+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:47.783875+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"36'49","reported_seq":109,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:22.687872+0000","last_change":"2024-09-13T19:19:22.687872+0000","last_active":"2024-09-13T19:19:22.687872+0000","last_peered":"2024-09-13T19:19:22.687872+0000","last_clean":"2024-09-13T19:19:22.687872+0000","last_became_active":"2024-09-13T19:16:01.902532+0000","last_became_peered":"2024-09-13T19:16:01.902532+0000","last_unstale":"2024-09-13T19:19:22.687872+0000","last_undegraded":"2024-09-13T19:19:22.687872+0000","last_fullsized":"2024-09-13T19:19:22.687872+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'49","last_scrub_stamp":"2024-09-13T19:19:22.687725+0000","last_deep_scrub":"36'49","last_deep_scrub_stamp":"2024-09-13T19:19:22.687725+0000","last_clean_scrub_stamp":"2024-09-13T19:19:22.687725+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:20.499665+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:17.747855+0000","last_change":"2024-09-13T19:19:17.747855+0000","last_active":"2024-09-13T19:19:17.747855+0000","last_peered":"2024-09-13T19:19:17.747855+0000","last_clean":"2024-09-13T19:19:17.747855+0000","last_became_active":"2024-09-13T19:16:03.913019+0000","last_became_peered":"2024-09-13T19:16:03.913019+0000","last_unstale":"2024-09-13T19:19:17.747855+0000","last_undegraded":"2024-09-13T19:19:17.747855+0000","last_fullsized":"2024-09-13T19:19:17.747855+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:17.747683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:17.747683+0000","last_clean_scrub_stamp":"2024-09-13T19:19:17.747683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:01.675286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"36'9","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:43.841990+0000","last_change":"2024-09-13T19:19:43.841990+0000","last_active":"2024-09-13T19:19:43.841990+0000","last_peered":"2024-09-13T19:19:43.841990+0000","last_clean":"2024-09-13T19:19:43.841990+0000","last_became_active":"2024-09-13T19:16:05.911364+0000","last_became_peered":"2024-09-13T19:16:05.911364+0000","last_unstale":"2024-09-13T19:19:43.841990+0000","last_undegraded":"2024-09-13T19:19:43.841990+0000","last_fullsized":"2024-09-13T19:19:43.841990+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'9","last_scrub_stamp":"2024-09-13T19:19:43.841870+0000","last_deep_scrub":"36'9","last_deep_scrub_stamp":"2024-09-13T19:19:43.841870+0000","last_clean_scrub_stamp":"2024-09-13T19:19:43.841870+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:01.817243+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"36'13","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:32.054330+0000","last_change":"2024-09-13T19:19:32.054330+0000","last_active":"2024-09-13T19:19:32.054330+0000","last_peered":"2024-09-13T19:19:32.054330+0000","last_clean":"2024-09-13T19:19:32.054330+0000","last_became_active":"2024-09-13T19:15:57.900905+0000","last_became_peered":"2024-09-13T19:15:57.900905+0000","last_unstale":"2024-09-13T19:19:32.054330+0000","last_undegraded":"2024-09-13T19:19:32.054330+0000","last_fullsized":"2024-09-13T19:19:32.054330+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'13","last_scrub_stamp":"2024-09-13T19:19:32.054214+0000","last_deep_scrub":"36'13","last_deep_scrub_stamp":"2024-09-13T19:19:32.054214+0000","last_clean_scrub_stamp":"2024-09-13T19:19:32.054214+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:27.473875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"36'119","reported_seq":217,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:02.103919+0000","last_change":"2024-09-13T19:20:02.103971+0000","last_active":"2024-09-13T19:20:02.103919+0000","last_peered":"2024-09-13T19:20:02.103919+0000","last_clean":"2024-09-13T19:20:02.103919+0000","last_became_active":"2024-09-13T19:15:41.169707+0000","last_became_peered":"2024-09-13T19:15:41.169707+0000","last_unstale":"2024-09-13T19:20:02.103919+0000","last_undegraded":"2024-09-13T19:20:02.103919+0000","last_fullsized":"2024-09-13T19:20:02.103919+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'119","last_scrub_stamp":"2024-09-13T19:20:02.103817+0000","last_deep_scrub":"36'119","last_deep_scrub_stamp":"2024-09-13T19:20:02.103817+0000","last_clean_scrub_stamp":"2024-09-13T19:20:02.103817+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:35:48.526437+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"36'2","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:28.043602+0000","last_change":"2024-09-13T19:20:28.043630+0000","last_active":"2024-09-13T19:20:28.043602+0000","last_peered":"2024-09-13T19:20:28.043602+0000","last_clean":"2024-09-13T19:20:28.043602+0000","last_became_active":"2024-09-13T19:15:44.577382+0000","last_became_peered":"2024-09-13T19:15:44.577382+0000","last_unstale":"2024-09-13T19:20:28.043602+0000","last_undegraded":"2024-09-13T19:20:28.043602+0000","last_fullsized":"2024-09-13T19:20:28.043602+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:20:28.043510+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:20:28.043510+0000","last_clean_scrub_stamp":"2024-09-13T19:20:28.043510+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:09.474886+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00047916199999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:05.909175+0000","last_change":"2024-09-13T19:20:05.909175+0000","last_active":"2024-09-13T19:20:05.909175+0000","last_peered":"2024-09-13T19:20:05.909175+0000","last_clean":"2024-09-13T19:20:05.909175+0000","last_became_active":"2024-09-13T19:15:55.899672+0000","last_became_peered":"2024-09-13T19:15:55.899672+0000","last_unstale":"2024-09-13T19:20:05.909175+0000","last_undegraded":"2024-09-13T19:20:05.909175+0000","last_fullsized":"2024-09-13T19:20:05.909175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:05.909049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:05.909049+0000","last_clean_scrub_stamp":"2024-09-13T19:20:05.909049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:51.724581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:33.821056+0000","last_change":"2024-09-13T19:19:33.821056+0000","last_active":"2024-09-13T19:19:33.821056+0000","last_peered":"2024-09-13T19:19:33.821056+0000","last_clean":"2024-09-13T19:19:33.821056+0000","last_became_active":"2024-09-13T19:15:59.891615+0000","last_became_peered":"2024-09-13T19:15:59.891615+0000","last_unstale":"2024-09-13T19:19:33.821056+0000","last_undegraded":"2024-09-13T19:19:33.821056+0000","last_fullsized":"2024-09-13T19:19:33.821056+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:33.820938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:33.820938+0000","last_clean_scrub_stamp":"2024-09-13T19:19:33.820938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:08.178435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"36'87","reported_seq":178,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:35.064073+0000","last_change":"2024-09-13T19:19:35.064073+0000","last_active":"2024-09-13T19:19:35.064073+0000","last_peered":"2024-09-13T19:19:35.064073+0000","last_clean":"2024-09-13T19:19:35.064073+0000","last_became_active":"2024-09-13T19:16:01.905085+0000","last_became_peered":"2024-09-13T19:16:01.905085+0000","last_unstale":"2024-09-13T19:19:35.064073+0000","last_undegraded":"2024-09-13T19:19:35.064073+0000","last_fullsized":"2024-09-13T19:19:35.064073+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'87","last_scrub_stamp":"2024-09-13T19:19:35.063922+0000","last_deep_scrub":"36'87","last_deep_scrub_stamp":"2024-09-13T19:19:35.063922+0000","last_clean_scrub_stamp":"2024-09-13T19:19:35.063922+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:35:21.486542+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:29.339050+0000","last_change":"2024-09-13T19:19:29.339050+0000","last_active":"2024-09-13T19:19:29.339050+0000","last_peered":"2024-09-13T19:19:29.339050+0000","last_clean":"2024-09-13T19:19:29.339050+0000","last_became_active":"2024-09-13T19:16:03.913802+0000","last_became_peered":"2024-09-13T19:16:03.913802+0000","last_unstale":"2024-09-13T19:19:29.339050+0000","last_undegraded":"2024-09-13T19:19:29.339050+0000","last_fullsized":"2024-09-13T19:19:29.339050+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:29.338926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:29.338926+0000","last_clean_scrub_stamp":"2024-09-13T19:19:29.338926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:01.790473+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"36'89","reported_seq":197,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:35.858501+0000","last_change":"2024-09-13T19:19:35.858501+0000","last_active":"2024-09-13T19:19:35.858501+0000","last_peered":"2024-09-13T19:19:35.858501+0000","last_clean":"2024-09-13T19:19:35.858501+0000","last_became_active":"2024-09-13T19:16:05.911595+0000","last_became_peered":"2024-09-13T19:16:05.911595+0000","last_unstale":"2024-09-13T19:19:35.858501+0000","last_undegraded":"2024-09-13T19:19:35.858501+0000","last_fullsized":"2024-09-13T19:19:35.858501+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'89","last_scrub_stamp":"2024-09-13T19:19:35.858385+0000","last_deep_scrub":"36'89","last_deep_scrub_stamp":"2024-09-13T19:19:35.858385+0000","last_clean_scrub_stamp":"2024-09-13T19:19:35.858385+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:44:48.738301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":289,"num_read_kb":269,"num_write":182,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"36'4","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:51.888342+0000","last_change":"2024-09-13T19:19:51.888342+0000","last_active":"2024-09-13T19:19:51.888342+0000","last_peered":"2024-09-13T19:19:51.888342+0000","last_clean":"2024-09-13T19:19:51.888342+0000","last_became_active":"2024-09-13T19:15:57.897307+0000","last_became_peered":"2024-09-13T19:15:57.897307+0000","last_unstale":"2024-09-13T19:19:51.888342+0000","last_undegraded":"2024-09-13T19:19:51.888342+0000","last_fullsized":"2024-09-13T19:19:51.888342+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:19:51.888223+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:19:51.888223+0000","last_clean_scrub_stamp":"2024-09-13T19:19:51.888223+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:42:47.629919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:27.079687+0000","last_change":"2024-09-13T19:20:27.079712+0000","last_active":"2024-09-13T19:20:27.079687+0000","last_peered":"2024-09-13T19:20:27.079687+0000","last_clean":"2024-09-13T19:20:27.079687+0000","last_became_active":"2024-09-13T19:15:44.576304+0000","last_became_peered":"2024-09-13T19:15:44.576304+0000","last_unstale":"2024-09-13T19:20:27.079687+0000","last_undegraded":"2024-09-13T19:20:27.079687+0000","last_fullsized":"2024-09-13T19:20:27.079687+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:27.079602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:27.079602+0000","last_clean_scrub_stamp":"2024-09-13T19:20:27.079602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:43.029885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011332060000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"36'4","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:07.532251+0000","last_change":"2024-09-13T19:20:07.532331+0000","last_active":"2024-09-13T19:20:07.532251+0000","last_peered":"2024-09-13T19:20:07.532251+0000","last_clean":"2024-09-13T19:20:07.532251+0000","last_became_active":"2024-09-13T19:15:55.891377+0000","last_became_peered":"2024-09-13T19:15:55.891377+0000","last_unstale":"2024-09-13T19:20:07.532251+0000","last_undegraded":"2024-09-13T19:20:07.532251+0000","last_fullsized":"2024-09-13T19:20:07.532251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:20:07.532141+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:20:07.532141+0000","last_clean_scrub_stamp":"2024-09-13T19:20:07.532141+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:36.325943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:22.039024+0000","last_change":"2024-09-13T19:19:22.039024+0000","last_active":"2024-09-13T19:19:22.039024+0000","last_peered":"2024-09-13T19:19:22.039024+0000","last_clean":"2024-09-13T19:19:22.039024+0000","last_became_active":"2024-09-13T19:15:59.896248+0000","last_became_peered":"2024-09-13T19:15:59.896248+0000","last_unstale":"2024-09-13T19:19:22.039024+0000","last_undegraded":"2024-09-13T19:19:22.039024+0000","last_fullsized":"2024-09-13T19:19:22.039024+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:22.038847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:22.038847+0000","last_clean_scrub_stamp":"2024-09-13T19:19:22.038847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:43:03.494237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"36'291","reported_seq":517,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:17.746426+0000","last_change":"2024-09-13T19:19:17.746426+0000","last_active":"2024-09-13T19:19:17.746426+0000","last_peered":"2024-09-13T19:19:17.746426+0000","last_clean":"2024-09-13T19:19:17.746426+0000","last_became_active":"2024-09-13T19:16:01.907024+0000","last_became_peered":"2024-09-13T19:16:01.907024+0000","last_unstale":"2024-09-13T19:19:17.746426+0000","last_undegraded":"2024-09-13T19:19:17.746426+0000","last_fullsized":"2024-09-13T19:19:17.746426+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'291","last_scrub_stamp":"2024-09-13T19:19:17.746277+0000","last_deep_scrub":"36'291","last_deep_scrub_stamp":"2024-09-13T19:19:17.746277+0000","last_clean_scrub_stamp":"2024-09-13T19:19:17.746277+0000","objects_scrubbed":10,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:14.177663+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:42.977665+0000","last_change":"2024-09-13T19:19:42.977665+0000","last_active":"2024-09-13T19:19:42.977665+0000","last_peered":"2024-09-13T19:19:42.977665+0000","last_clean":"2024-09-13T19:19:42.977665+0000","last_became_active":"2024-09-13T19:16:03.915712+0000","last_became_peered":"2024-09-13T19:16:03.915712+0000","last_unstale":"2024-09-13T19:19:42.977665+0000","last_undegraded":"2024-09-13T19:19:42.977665+0000","last_fullsized":"2024-09-13T19:19:42.977665+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:42.977545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:42.977545+0000","last_clean_scrub_stamp":"2024-09-13T19:19:42.977545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:25.110230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"36'3","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:13.028953+0000","last_change":"2024-09-13T19:20:13.028953+0000","last_active":"2024-09-13T19:20:13.028953+0000","last_peered":"2024-09-13T19:20:13.028953+0000","last_clean":"2024-09-13T19:20:13.028953+0000","last_became_active":"2024-09-13T19:16:05.916999+0000","last_became_peered":"2024-09-13T19:16:05.916999+0000","last_unstale":"2024-09-13T19:20:13.028953+0000","last_undegraded":"2024-09-13T19:20:13.028953+0000","last_fullsized":"2024-09-13T19:20:13.028953+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-13T19:20:13.028808+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-13T19:20:13.028808+0000","last_clean_scrub_stamp":"2024-09-13T19:20:13.028808+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:31:31.828079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:59.635953+0000","last_change":"2024-09-13T19:19:59.635953+0000","last_active":"2024-09-13T19:19:59.635953+0000","last_peered":"2024-09-13T19:19:59.635953+0000","last_clean":"2024-09-13T19:19:59.635953+0000","last_became_active":"2024-09-13T19:15:57.889885+0000","last_became_peered":"2024-09-13T19:15:57.889885+0000","last_unstale":"2024-09-13T19:19:59.635953+0000","last_undegraded":"2024-09-13T19:19:59.635953+0000","last_fullsized":"2024-09-13T19:19:59.635953+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:19:59.635832+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:19:59.635832+0000","last_clean_scrub_stamp":"2024-09-13T19:19:59.635832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:11.239363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:57.558472+0000","last_change":"2024-09-13T19:19:57.558512+0000","last_active":"2024-09-13T19:19:57.558472+0000","last_peered":"2024-09-13T19:19:57.558472+0000","last_clean":"2024-09-13T19:19:57.558472+0000","last_became_active":"2024-09-13T19:15:44.575483+0000","last_became_peered":"2024-09-13T19:15:44.575483+0000","last_unstale":"2024-09-13T19:19:57.558472+0000","last_undegraded":"2024-09-13T19:19:57.558472+0000","last_fullsized":"2024-09-13T19:19:57.558472+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:57.558357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:57.558357+0000","last_clean_scrub_stamp":"2024-09-13T19:19:57.558357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:49.942957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036796000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"36'6","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:10.464777+0000","last_change":"2024-09-13T19:20:10.464804+0000","last_active":"2024-09-13T19:20:10.464777+0000","last_peered":"2024-09-13T19:20:10.464777+0000","last_clean":"2024-09-13T19:20:10.464777+0000","last_became_active":"2024-09-13T19:15:55.892629+0000","last_became_peered":"2024-09-13T19:15:55.892629+0000","last_unstale":"2024-09-13T19:20:10.464777+0000","last_undegraded":"2024-09-13T19:20:10.464777+0000","last_fullsized":"2024-09-13T19:20:10.464777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:20:10.464678+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:20:10.464678+0000","last_clean_scrub_stamp":"2024-09-13T19:20:10.464678+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:02:22.663147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:36.827027+0000","last_change":"2024-09-13T19:19:36.827027+0000","last_active":"2024-09-13T19:19:36.827027+0000","last_peered":"2024-09-13T19:19:36.827027+0000","last_clean":"2024-09-13T19:19:36.827027+0000","last_became_active":"2024-09-13T19:15:59.891588+0000","last_became_peered":"2024-09-13T19:15:59.891588+0000","last_unstale":"2024-09-13T19:19:36.827027+0000","last_undegraded":"2024-09-13T19:19:36.827027+0000","last_fullsized":"2024-09-13T19:19:36.827027+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:36.826862+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:36.826862+0000","last_clean_scrub_stamp":"2024-09-13T19:19:36.826862+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:13:00.231898+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'23","reported_seq":101,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:28.812189+0000","last_change":"2024-09-13T19:19:28.812189+0000","last_active":"2024-09-13T19:19:28.812189+0000","last_peered":"2024-09-13T19:19:28.812189+0000","last_clean":"2024-09-13T19:19:28.812189+0000","last_became_active":"2024-09-13T19:16:01.903947+0000","last_became_peered":"2024-09-13T19:16:01.903947+0000","last_unstale":"2024-09-13T19:19:28.812189+0000","last_undegraded":"2024-09-13T19:19:28.812189+0000","last_fullsized":"2024-09-13T19:19:28.812189+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'23","last_scrub_stamp":"2024-09-13T19:19:28.812026+0000","last_deep_scrub":"36'23","last_deep_scrub_stamp":"2024-09-13T19:19:28.812026+0000","last_clean_scrub_stamp":"2024-09-13T19:19:28.812026+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:37.761542+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:17.389541+0000","last_change":"2024-09-13T19:19:17.389541+0000","last_active":"2024-09-13T19:19:17.389541+0000","last_peered":"2024-09-13T19:19:17.389541+0000","last_clean":"2024-09-13T19:19:17.389541+0000","last_became_active":"2024-09-13T19:16:03.910776+0000","last_became_peered":"2024-09-13T19:16:03.910776+0000","last_unstale":"2024-09-13T19:19:17.389541+0000","last_undegraded":"2024-09-13T19:19:17.389541+0000","last_fullsized":"2024-09-13T19:19:17.389541+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:17.389460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:17.389460+0000","last_clean_scrub_stamp":"2024-09-13T19:19:17.389460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:17:14.265847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"36'2","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:02.955991+0000","last_change":"2024-09-13T19:20:02.956015+0000","last_active":"2024-09-13T19:20:02.955991+0000","last_peered":"2024-09-13T19:20:02.955991+0000","last_clean":"2024-09-13T19:20:02.955991+0000","last_became_active":"2024-09-13T19:16:05.920191+0000","last_became_peered":"2024-09-13T19:16:05.920191+0000","last_unstale":"2024-09-13T19:20:02.955991+0000","last_undegraded":"2024-09-13T19:20:02.955991+0000","last_fullsized":"2024-09-13T19:20:02.955991+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:20:02.955898+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:20:02.955898+0000","last_clean_scrub_stamp":"2024-09-13T19:20:02.955898+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:47:52.449314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"36'12","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:51.707637+0000","last_change":"2024-09-13T19:19:51.707637+0000","last_active":"2024-09-13T19:19:51.707637+0000","last_peered":"2024-09-13T19:19:51.707637+0000","last_clean":"2024-09-13T19:19:51.707637+0000","last_became_active":"2024-09-13T19:15:57.886273+0000","last_became_peered":"2024-09-13T19:15:57.886273+0000","last_unstale":"2024-09-13T19:19:51.707637+0000","last_undegraded":"2024-09-13T19:19:51.707637+0000","last_fullsized":"2024-09-13T19:19:51.707637+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-13T19:19:51.707517+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-13T19:19:51.707517+0000","last_clean_scrub_stamp":"2024-09-13T19:19:51.707517+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:13.558324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":44,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"36'3","reported_seq":68,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:26.056535+0000","last_change":"2024-09-13T19:20:26.056608+0000","last_active":"2024-09-13T19:20:26.056535+0000","last_peered":"2024-09-13T19:20:26.056535+0000","last_clean":"2024-09-13T19:20:26.056535+0000","last_became_active":"2024-09-13T19:15:44.576052+0000","last_became_peered":"2024-09-13T19:15:44.576052+0000","last_unstale":"2024-09-13T19:20:26.056535+0000","last_undegraded":"2024-09-13T19:20:26.056535+0000","last_fullsized":"2024-09-13T19:20:26.056535+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-13T19:20:26.056433+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-13T19:20:26.056433+0000","last_clean_scrub_stamp":"2024-09-13T19:20:26.056433+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:34:39.072899+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0012221599999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"36'4","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:04.539043+0000","last_change":"2024-09-13T19:20:04.539043+0000","last_active":"2024-09-13T19:20:04.539043+0000","last_peered":"2024-09-13T19:20:04.539043+0000","last_clean":"2024-09-13T19:20:04.539043+0000","last_became_active":"2024-09-13T19:15:55.892636+0000","last_became_peered":"2024-09-13T19:15:55.892636+0000","last_unstale":"2024-09-13T19:20:04.539043+0000","last_undegraded":"2024-09-13T19:20:04.539043+0000","last_fullsized":"2024-09-13T19:20:04.539043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:20:04.538913+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:20:04.538913+0000","last_clean_scrub_stamp":"2024-09-13T19:20:04.538913+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:59.958573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:34.461541+0000","last_change":"2024-09-13T19:19:34.461541+0000","last_active":"2024-09-13T19:19:34.461541+0000","last_peered":"2024-09-13T19:19:34.461541+0000","last_clean":"2024-09-13T19:19:34.461541+0000","last_became_active":"2024-09-13T19:15:59.896248+0000","last_became_peered":"2024-09-13T19:15:59.896248+0000","last_unstale":"2024-09-13T19:19:34.461541+0000","last_undegraded":"2024-09-13T19:19:34.461541+0000","last_fullsized":"2024-09-13T19:19:34.461541+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:34.461398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:34.461398+0000","last_clean_scrub_stamp":"2024-09-13T19:19:34.461398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:38.595301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'20","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:47.912445+0000","last_change":"2024-09-13T19:19:47.912445+0000","last_active":"2024-09-13T19:19:47.912445+0000","last_peered":"2024-09-13T19:19:47.912445+0000","last_clean":"2024-09-13T19:19:47.912445+0000","last_became_active":"2024-09-13T19:16:01.905280+0000","last_became_peered":"2024-09-13T19:16:01.905280+0000","last_unstale":"2024-09-13T19:19:47.912445+0000","last_undegraded":"2024-09-13T19:19:47.912445+0000","last_fullsized":"2024-09-13T19:19:47.912445+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'20","last_scrub_stamp":"2024-09-13T19:19:47.912299+0000","last_deep_scrub":"36'20","last_deep_scrub_stamp":"2024-09-13T19:19:47.912299+0000","last_clean_scrub_stamp":"2024-09-13T19:19:47.912299+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:39.230968+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:46.871092+0000","last_change":"2024-09-13T19:19:46.871092+0000","last_active":"2024-09-13T19:19:46.871092+0000","last_peered":"2024-09-13T19:19:46.871092+0000","last_clean":"2024-09-13T19:19:46.871092+0000","last_became_active":"2024-09-13T19:16:03.916344+0000","last_became_peered":"2024-09-13T19:16:03.916344+0000","last_unstale":"2024-09-13T19:19:46.871092+0000","last_undegraded":"2024-09-13T19:19:46.871092+0000","last_fullsized":"2024-09-13T19:19:46.871092+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:46.870973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:46.870973+0000","last_clean_scrub_stamp":"2024-09-13T19:19:46.870973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:23:10.637473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"36'4","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:13.996642+0000","last_change":"2024-09-13T19:20:13.996642+0000","last_active":"2024-09-13T19:20:13.996642+0000","last_peered":"2024-09-13T19:20:13.996642+0000","last_clean":"2024-09-13T19:20:13.996642+0000","last_became_active":"2024-09-13T19:16:05.919156+0000","last_became_peered":"2024-09-13T19:16:05.919156+0000","last_unstale":"2024-09-13T19:20:13.996642+0000","last_undegraded":"2024-09-13T19:20:13.996642+0000","last_fullsized":"2024-09-13T19:20:13.996642+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:20:13.996518+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:20:13.996518+0000","last_clean_scrub_stamp":"2024-09-13T19:20:13.996518+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:59:38.021261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"36'18","reported_seq":79,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:40.864674+0000","last_change":"2024-09-13T19:19:40.864674+0000","last_active":"2024-09-13T19:19:40.864674+0000","last_peered":"2024-09-13T19:19:40.864674+0000","last_clean":"2024-09-13T19:19:40.864674+0000","last_became_active":"2024-09-13T19:15:57.902819+0000","last_became_peered":"2024-09-13T19:15:57.902819+0000","last_unstale":"2024-09-13T19:19:40.864674+0000","last_undegraded":"2024-09-13T19:19:40.864674+0000","last_fullsized":"2024-09-13T19:19:40.864674+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'18","last_scrub_stamp":"2024-09-13T19:19:40.864526+0000","last_deep_scrub":"36'18","last_deep_scrub_stamp":"2024-09-13T19:19:40.864526+0000","last_clean_scrub_stamp":"2024-09-13T19:19:40.864526+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:41.407519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":50,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:56.588557+0000","last_change":"2024-09-13T19:19:56.588557+0000","last_active":"2024-09-13T19:19:56.588557+0000","last_peered":"2024-09-13T19:19:56.588557+0000","last_clean":"2024-09-13T19:19:56.588557+0000","last_became_active":"2024-09-13T19:15:55.893468+0000","last_became_peered":"2024-09-13T19:15:55.893468+0000","last_unstale":"2024-09-13T19:19:56.588557+0000","last_undegraded":"2024-09-13T19:19:56.588557+0000","last_fullsized":"2024-09-13T19:19:56.588557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:19:56.588443+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:19:56.588443+0000","last_clean_scrub_stamp":"2024-09-13T19:19:56.588443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:05.049618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:04.583147+0000","last_change":"2024-09-13T19:20:04.583169+0000","last_active":"2024-09-13T19:20:04.583147+0000","last_peered":"2024-09-13T19:20:04.583147+0000","last_clean":"2024-09-13T19:20:04.583147+0000","last_became_active":"2024-09-13T19:15:44.575726+0000","last_became_peered":"2024-09-13T19:15:44.575726+0000","last_unstale":"2024-09-13T19:20:04.583147+0000","last_undegraded":"2024-09-13T19:20:04.583147+0000","last_fullsized":"2024-09-13T19:20:04.583147+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:04.583059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:04.583059+0000","last_clean_scrub_stamp":"2024-09-13T19:20:04.583059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:35:00.459031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041430200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"36'2","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:08.533247+0000","last_change":"2024-09-13T19:20:08.533281+0000","last_active":"2024-09-13T19:20:08.533247+0000","last_peered":"2024-09-13T19:20:08.533247+0000","last_clean":"2024-09-13T19:20:08.533247+0000","last_became_active":"2024-09-13T19:16:31.990669+0000","last_became_peered":"2024-09-13T19:16:31.990669+0000","last_unstale":"2024-09-13T19:20:08.533247+0000","last_undegraded":"2024-09-13T19:20:08.533247+0000","last_fullsized":"2024-09-13T19:20:08.533247+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:20:08.533151+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:20:08.533151+0000","last_clean_scrub_stamp":"2024-09-13T19:20:08.533151+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:56:29.841704+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"36'73","reported_seq":150,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:28.341123+0000","last_change":"2024-09-13T19:19:28.341123+0000","last_active":"2024-09-13T19:19:28.341123+0000","last_peered":"2024-09-13T19:19:28.341123+0000","last_clean":"2024-09-13T19:19:28.341123+0000","last_became_active":"2024-09-13T19:16:01.902095+0000","last_became_peered":"2024-09-13T19:16:01.902095+0000","last_unstale":"2024-09-13T19:19:28.341123+0000","last_undegraded":"2024-09-13T19:19:28.341123+0000","last_fullsized":"2024-09-13T19:19:28.341123+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'73","last_scrub_stamp":"2024-09-13T19:19:28.340973+0000","last_deep_scrub":"36'73","last_deep_scrub_stamp":"2024-09-13T19:19:28.340973+0000","last_clean_scrub_stamp":"2024-09-13T19:19:28.340973+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:31:45.923087+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:21.760567+0000","last_change":"2024-09-13T19:19:21.760567+0000","last_active":"2024-09-13T19:19:21.760567+0000","last_peered":"2024-09-13T19:19:21.760567+0000","last_clean":"2024-09-13T19:19:21.760567+0000","last_became_active":"2024-09-13T19:16:03.909803+0000","last_became_peered":"2024-09-13T19:16:03.909803+0000","last_unstale":"2024-09-13T19:19:21.760567+0000","last_undegraded":"2024-09-13T19:19:21.760567+0000","last_fullsized":"2024-09-13T19:19:21.760567+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:21.760449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:21.760449+0000","last_clean_scrub_stamp":"2024-09-13T19:19:21.760449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:57.014320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"36'11","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:16.494500+0000","last_change":"2024-09-13T19:20:16.494500+0000","last_active":"2024-09-13T19:20:16.494500+0000","last_peered":"2024-09-13T19:20:16.494500+0000","last_clean":"2024-09-13T19:20:16.494500+0000","last_became_active":"2024-09-13T19:16:05.915672+0000","last_became_peered":"2024-09-13T19:16:05.915672+0000","last_unstale":"2024-09-13T19:20:16.494500+0000","last_undegraded":"2024-09-13T19:20:16.494500+0000","last_fullsized":"2024-09-13T19:20:16.494500+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'11","last_scrub_stamp":"2024-09-13T19:20:16.494379+0000","last_deep_scrub":"36'11","last_deep_scrub_stamp":"2024-09-13T19:20:16.494379+0000","last_clean_scrub_stamp":"2024-09-13T19:20:16.494379+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:31.484004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"36'10","reported_seq":69,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:38.781574+0000","last_change":"2024-09-13T19:19:38.781574+0000","last_active":"2024-09-13T19:19:38.781574+0000","last_peered":"2024-09-13T19:19:38.781574+0000","last_clean":"2024-09-13T19:19:38.781574+0000","last_became_active":"2024-09-13T19:15:57.902793+0000","last_became_peered":"2024-09-13T19:15:57.902793+0000","last_unstale":"2024-09-13T19:19:38.781574+0000","last_undegraded":"2024-09-13T19:19:38.781574+0000","last_fullsized":"2024-09-13T19:19:38.781574+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-13T19:19:38.781447+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-13T19:19:38.781447+0000","last_clean_scrub_stamp":"2024-09-13T19:19:38.781447+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:50.170162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:56.680541+0000","last_change":"2024-09-13T19:19:56.680541+0000","last_active":"2024-09-13T19:19:56.680541+0000","last_peered":"2024-09-13T19:19:56.680541+0000","last_clean":"2024-09-13T19:19:56.680541+0000","last_became_active":"2024-09-13T19:15:55.894340+0000","last_became_peered":"2024-09-13T19:15:55.894340+0000","last_unstale":"2024-09-13T19:19:56.680541+0000","last_undegraded":"2024-09-13T19:19:56.680541+0000","last_fullsized":"2024-09-13T19:19:56.680541+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:56.680427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:56.680427+0000","last_clean_scrub_stamp":"2024-09-13T19:19:56.680427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:52:19.982338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:25.096785+0000","last_change":"2024-09-13T19:20:25.096836+0000","last_active":"2024-09-13T19:20:25.096785+0000","last_peered":"2024-09-13T19:20:25.096785+0000","last_clean":"2024-09-13T19:20:25.096785+0000","last_became_active":"2024-09-13T19:15:44.576006+0000","last_became_peered":"2024-09-13T19:15:44.576006+0000","last_unstale":"2024-09-13T19:20:25.096785+0000","last_undegraded":"2024-09-13T19:20:25.096785+0000","last_fullsized":"2024-09-13T19:20:25.096785+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:25.096633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:25.096633+0000","last_clean_scrub_stamp":"2024-09-13T19:20:25.096633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:12.807745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013309299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:26.089170+0000","last_change":"2024-09-13T19:19:26.089170+0000","last_active":"2024-09-13T19:19:26.089170+0000","last_peered":"2024-09-13T19:19:26.089170+0000","last_clean":"2024-09-13T19:19:26.089170+0000","last_became_active":"2024-09-13T19:15:59.894761+0000","last_became_peered":"2024-09-13T19:15:59.894761+0000","last_unstale":"2024-09-13T19:19:26.089170+0000","last_undegraded":"2024-09-13T19:19:26.089170+0000","last_fullsized":"2024-09-13T19:19:26.089170+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:26.089011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:26.089011+0000","last_clean_scrub_stamp":"2024-09-13T19:19:26.089011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:08.982394+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"36'21","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:16.767496+0000","last_change":"2024-09-13T19:19:16.767496+0000","last_active":"2024-09-13T19:19:16.767496+0000","last_peered":"2024-09-13T19:19:16.767496+0000","last_clean":"2024-09-13T19:19:16.767496+0000","last_became_active":"2024-09-13T19:16:01.907419+0000","last_became_peered":"2024-09-13T19:16:01.907419+0000","last_unstale":"2024-09-13T19:19:16.767496+0000","last_undegraded":"2024-09-13T19:19:16.767496+0000","last_fullsized":"2024-09-13T19:19:16.767496+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'21","last_scrub_stamp":"2024-09-13T19:19:16.767339+0000","last_deep_scrub":"36'21","last_deep_scrub_stamp":"2024-09-13T19:19:16.767339+0000","last_clean_scrub_stamp":"2024-09-13T19:19:16.767339+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:34.127072+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"36'285","reported_seq":359,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:23.651260+0000","last_change":"2024-09-13T19:19:23.651260+0000","last_active":"2024-09-13T19:19:23.651260+0000","last_peered":"2024-09-13T19:19:23.651260+0000","last_clean":"2024-09-13T19:19:23.651260+0000","last_became_active":"2024-09-13T19:16:03.907957+0000","last_became_peered":"2024-09-13T19:16:03.907957+0000","last_unstale":"2024-09-13T19:19:23.651260+0000","last_undegraded":"2024-09-13T19:19:23.651260+0000","last_fullsized":"2024-09-13T19:19:23.651260+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-13T19:19:23.651077+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-13T19:19:23.651077+0000","last_clean_scrub_stamp":"2024-09-13T19:19:23.651077+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:39:32.329566+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"34'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:23.943599+0000","last_change":"2024-09-13T19:16:05.924834+0000","last_active":"2024-09-13T19:18:23.943599+0000","last_peered":"2024-09-13T19:18:23.943599+0000","last_clean":"2024-09-13T19:18:23.943599+0000","last_became_active":"2024-09-13T19:16:05.924162+0000","last_became_peered":"2024-09-13T19:16:05.924162+0000","last_unstale":"2024-09-13T19:18:23.943599+0000","last_undegraded":"2024-09-13T19:18:23.943599+0000","last_fullsized":"2024-09-13T19:18:23.943599+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"36'6","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:55.942806+0000","last_change":"2024-09-13T19:19:55.942806+0000","last_active":"2024-09-13T19:19:55.942806+0000","last_peered":"2024-09-13T19:19:55.942806+0000","last_clean":"2024-09-13T19:19:55.942806+0000","last_became_active":"2024-09-13T19:15:57.896078+0000","last_became_peered":"2024-09-13T19:15:57.896078+0000","last_unstale":"2024-09-13T19:19:55.942806+0000","last_undegraded":"2024-09-13T19:19:55.942806+0000","last_fullsized":"2024-09-13T19:19:55.942806+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:19:55.942686+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:19:55.942686+0000","last_clean_scrub_stamp":"2024-09-13T19:19:55.942686+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:37.569282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:07.952015+0000","last_change":"2024-09-13T19:20:07.952015+0000","last_active":"2024-09-13T19:20:07.952015+0000","last_peered":"2024-09-13T19:20:07.952015+0000","last_clean":"2024-09-13T19:20:07.952015+0000","last_became_active":"2024-09-13T19:15:55.895282+0000","last_became_peered":"2024-09-13T19:15:55.895282+0000","last_unstale":"2024-09-13T19:20:07.952015+0000","last_undegraded":"2024-09-13T19:20:07.952015+0000","last_fullsized":"2024-09-13T19:20:07.952015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:07.951873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:07.951873+0000","last_clean_scrub_stamp":"2024-09-13T19:20:07.951873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:24.347833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:03.610700+0000","last_change":"2024-09-13T19:20:03.610700+0000","last_active":"2024-09-13T19:20:03.610700+0000","last_peered":"2024-09-13T19:20:03.610700+0000","last_clean":"2024-09-13T19:20:03.610700+0000","last_became_active":"2024-09-13T19:15:44.574967+0000","last_became_peered":"2024-09-13T19:15:44.574967+0000","last_unstale":"2024-09-13T19:20:03.610700+0000","last_undegraded":"2024-09-13T19:20:03.610700+0000","last_fullsized":"2024-09-13T19:20:03.610700+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:03.610567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:03.610567+0000","last_clean_scrub_stamp":"2024-09-13T19:20:03.610567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:27.117889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049330999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"36'2","reported_seq":231,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:25.112490+0000","last_change":"2024-09-13T19:19:25.112490+0000","last_active":"2024-09-13T19:19:25.112490+0000","last_peered":"2024-09-13T19:19:25.112490+0000","last_clean":"2024-09-13T19:19:25.112490+0000","last_became_active":"2024-09-13T19:15:59.894966+0000","last_became_peered":"2024-09-13T19:15:59.894966+0000","last_unstale":"2024-09-13T19:19:25.112490+0000","last_undegraded":"2024-09-13T19:19:25.112490+0000","last_fullsized":"2024-09-13T19:19:25.112490+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:25.112380+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:25.112380+0000","last_clean_scrub_stamp":"2024-09-13T19:19:25.112380+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:41.200956+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"36'16","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:27.099288+0000","last_change":"2024-09-13T19:19:27.099288+0000","last_active":"2024-09-13T19:19:27.099288+0000","last_peered":"2024-09-13T19:19:27.099288+0000","last_clean":"2024-09-13T19:19:27.099288+0000","last_became_active":"2024-09-13T19:16:01.902739+0000","last_became_peered":"2024-09-13T19:16:01.902739+0000","last_unstale":"2024-09-13T19:19:27.099288+0000","last_undegraded":"2024-09-13T19:19:27.099288+0000","last_fullsized":"2024-09-13T19:19:27.099288+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-13T19:19:27.099139+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-13T19:19:27.099139+0000","last_clean_scrub_stamp":"2024-09-13T19:19:27.099139+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:22:57.737015+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"36'285","reported_seq":430,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:22.346094+0000","last_change":"2024-09-13T19:19:22.346094+0000","last_active":"2024-09-13T19:19:22.346094+0000","last_peered":"2024-09-13T19:19:22.346094+0000","last_clean":"2024-09-13T19:19:22.346094+0000","last_became_active":"2024-09-13T19:16:03.909038+0000","last_became_peered":"2024-09-13T19:16:03.909038+0000","last_unstale":"2024-09-13T19:19:22.346094+0000","last_undegraded":"2024-09-13T19:19:22.346094+0000","last_fullsized":"2024-09-13T19:19:22.346094+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-13T19:19:22.345954+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-13T19:19:22.345954+0000","last_clean_scrub_stamp":"2024-09-13T19:19:22.345954+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:07.575589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'3","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:15.955147+0000","last_change":"2024-09-13T19:20:15.955177+0000","last_active":"2024-09-13T19:20:15.955147+0000","last_peered":"2024-09-13T19:20:15.955147+0000","last_clean":"2024-09-13T19:20:15.955147+0000","last_became_active":"2024-09-13T19:16:05.923739+0000","last_became_peered":"2024-09-13T19:16:05.923739+0000","last_unstale":"2024-09-13T19:20:15.955147+0000","last_undegraded":"2024-09-13T19:20:15.955147+0000","last_fullsized":"2024-09-13T19:20:15.955147+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-13T19:20:15.955048+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-13T19:20:15.955048+0000","last_clean_scrub_stamp":"2024-09-13T19:20:15.955048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:09:41.087987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"36'6","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:51.725112+0000","last_change":"2024-09-13T19:19:51.725112+0000","last_active":"2024-09-13T19:19:51.725112+0000","last_peered":"2024-09-13T19:19:51.725112+0000","last_clean":"2024-09-13T19:19:51.725112+0000","last_became_active":"2024-09-13T19:15:57.897727+0000","last_became_peered":"2024-09-13T19:15:57.897727+0000","last_unstale":"2024-09-13T19:19:51.725112+0000","last_undegraded":"2024-09-13T19:19:51.725112+0000","last_fullsized":"2024-09-13T19:19:51.725112+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:19:51.724981+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:19:51.724981+0000","last_clean_scrub_stamp":"2024-09-13T19:19:51.724981+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:11:51.172869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:08.107270+0000","last_change":"2024-09-13T19:20:08.107270+0000","last_active":"2024-09-13T19:20:08.107270+0000","last_peered":"2024-09-13T19:20:08.107270+0000","last_clean":"2024-09-13T19:20:08.107270+0000","last_became_active":"2024-09-13T19:15:55.895394+0000","last_became_peered":"2024-09-13T19:15:55.895394+0000","last_unstale":"2024-09-13T19:20:08.107270+0000","last_undegraded":"2024-09-13T19:20:08.107270+0000","last_fullsized":"2024-09-13T19:20:08.107270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:08.107136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:08.107136+0000","last_clean_scrub_stamp":"2024-09-13T19:20:08.107136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:47.449474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:29.022277+0000","last_change":"2024-09-13T19:20:29.022303+0000","last_active":"2024-09-13T19:20:29.022277+0000","last_peered":"2024-09-13T19:20:29.022277+0000","last_clean":"2024-09-13T19:20:29.022277+0000","last_became_active":"2024-09-13T19:15:44.607248+0000","last_became_peered":"2024-09-13T19:15:44.607248+0000","last_unstale":"2024-09-13T19:20:29.022277+0000","last_undegraded":"2024-09-13T19:20:29.022277+0000","last_fullsized":"2024-09-13T19:20:29.022277+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:29.022179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:29.022179+0000","last_clean_scrub_stamp":"2024-09-13T19:20:29.022179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:15.924418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086245899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:16.976793+0000","last_change":"2024-09-13T19:16:31.993085+0000","last_active":"2024-09-13T19:19:16.976793+0000","last_peered":"2024-09-13T19:19:16.976793+0000","last_clean":"2024-09-13T19:19:16.976793+0000","last_became_active":"2024-09-13T19:16:31.992752+0000","last_became_peered":"2024-09-13T19:16:31.992752+0000","last_unstale":"2024-09-13T19:19:16.976793+0000","last_undegraded":"2024-09-13T19:19:16.976793+0000","last_fullsized":"2024-09-13T19:19:16.976793+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:15:58.873497+0000","last_clean_scrub_stamp":"2024-09-13T19:15:58.873497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"36'98","reported_seq":192,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:24.778390+0000","last_change":"2024-09-13T19:19:24.778390+0000","last_active":"2024-09-13T19:19:24.778390+0000","last_peered":"2024-09-13T19:19:24.778390+0000","last_clean":"2024-09-13T19:19:24.778390+0000","last_became_active":"2024-09-13T19:16:01.906317+0000","last_became_peered":"2024-09-13T19:16:01.906317+0000","last_unstale":"2024-09-13T19:19:24.778390+0000","last_undegraded":"2024-09-13T19:19:24.778390+0000","last_fullsized":"2024-09-13T19:19:24.778390+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'98","last_scrub_stamp":"2024-09-13T19:19:24.778260+0000","last_deep_scrub":"36'98","last_deep_scrub_stamp":"2024-09-13T19:19:24.778260+0000","last_clean_scrub_stamp":"2024-09-13T19:19:24.778260+0000","objects_scrubbed":8,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:51.569747+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":99,"num_read_kb":103,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:19.338010+0000","last_change":"2024-09-13T19:19:19.338010+0000","last_active":"2024-09-13T19:19:19.338010+0000","last_peered":"2024-09-13T19:19:19.338010+0000","last_clean":"2024-09-13T19:19:19.338010+0000","last_became_active":"2024-09-13T19:16:03.909941+0000","last_became_peered":"2024-09-13T19:16:03.909941+0000","last_unstale":"2024-09-13T19:19:19.338010+0000","last_undegraded":"2024-09-13T19:19:19.338010+0000","last_fullsized":"2024-09-13T19:19:19.338010+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:19.337887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:19.337887+0000","last_clean_scrub_stamp":"2024-09-13T19:19:19.337887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:59.954982+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:31.797118+0000","last_change":"2024-09-13T19:19:31.797143+0000","last_active":"2024-09-13T19:19:31.797118+0000","last_peered":"2024-09-13T19:19:31.797118+0000","last_clean":"2024-09-13T19:19:31.797118+0000","last_became_active":"2024-09-13T19:16:05.911465+0000","last_became_peered":"2024-09-13T19:16:05.911465+0000","last_unstale":"2024-09-13T19:19:31.797118+0000","last_undegraded":"2024-09-13T19:19:31.797118+0000","last_fullsized":"2024-09-13T19:19:31.797118+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:31.797033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:31.797033+0000","last_clean_scrub_stamp":"2024-09-13T19:19:31.797033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:28:44.716045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:06.551512+0000","last_change":"2024-09-13T19:20:06.551512+0000","last_active":"2024-09-13T19:20:06.551512+0000","last_peered":"2024-09-13T19:20:06.551512+0000","last_clean":"2024-09-13T19:20:06.551512+0000","last_became_active":"2024-09-13T19:16:05.917156+0000","last_became_peered":"2024-09-13T19:16:05.917156+0000","last_unstale":"2024-09-13T19:20:06.551512+0000","last_undegraded":"2024-09-13T19:20:06.551512+0000","last_fullsized":"2024-09-13T19:20:06.551512+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:06.551412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:06.551412+0000","last_clean_scrub_stamp":"2024-09-13T19:20:06.551412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:11.518642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"36'8","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:05.520463+0000","last_change":"2024-09-13T19:20:05.520506+0000","last_active":"2024-09-13T19:20:05.520463+0000","last_peered":"2024-09-13T19:20:05.520463+0000","last_clean":"2024-09-13T19:20:05.520463+0000","last_became_active":"2024-09-13T19:15:57.898761+0000","last_became_peered":"2024-09-13T19:15:57.898761+0000","last_unstale":"2024-09-13T19:20:05.520463+0000","last_undegraded":"2024-09-13T19:20:05.520463+0000","last_fullsized":"2024-09-13T19:20:05.520463+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-13T19:20:05.520357+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-13T19:20:05.520357+0000","last_clean_scrub_stamp":"2024-09-13T19:20:05.520357+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:27:43.542866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:09.992753+0000","last_change":"2024-09-13T19:20:09.992800+0000","last_active":"2024-09-13T19:20:09.992753+0000","last_peered":"2024-09-13T19:20:09.992753+0000","last_clean":"2024-09-13T19:20:09.992753+0000","last_became_active":"2024-09-13T19:15:55.892518+0000","last_became_peered":"2024-09-13T19:15:55.892518+0000","last_unstale":"2024-09-13T19:20:09.992753+0000","last_undegraded":"2024-09-13T19:20:09.992753+0000","last_fullsized":"2024-09-13T19:20:09.992753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:09.992654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:09.992654+0000","last_clean_scrub_stamp":"2024-09-13T19:20:09.992654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:42.323390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:30.756336+0000","last_change":"2024-09-13T19:19:30.756383+0000","last_active":"2024-09-13T19:19:30.756336+0000","last_peered":"2024-09-13T19:19:30.756336+0000","last_clean":"2024-09-13T19:19:30.756336+0000","last_became_active":"2024-09-13T19:15:59.892690+0000","last_became_peered":"2024-09-13T19:15:59.892690+0000","last_unstale":"2024-09-13T19:19:30.756336+0000","last_undegraded":"2024-09-13T19:19:30.756336+0000","last_fullsized":"2024-09-13T19:19:30.756336+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:30.756223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:30.756223+0000","last_clean_scrub_stamp":"2024-09-13T19:19:30.756223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:04:11.520992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"36'40","reported_seq":96,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:31.067728+0000","last_change":"2024-09-13T19:19:31.067778+0000","last_active":"2024-09-13T19:19:31.067728+0000","last_peered":"2024-09-13T19:19:31.067728+0000","last_clean":"2024-09-13T19:19:31.067728+0000","last_became_active":"2024-09-13T19:16:01.904684+0000","last_became_peered":"2024-09-13T19:16:01.904684+0000","last_unstale":"2024-09-13T19:19:31.067728+0000","last_undegraded":"2024-09-13T19:19:31.067728+0000","last_fullsized":"2024-09-13T19:19:31.067728+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'40","last_scrub_stamp":"2024-09-13T19:19:31.067631+0000","last_deep_scrub":"36'40","last_deep_scrub_stamp":"2024-09-13T19:19:31.067631+0000","last_clean_scrub_stamp":"2024-09-13T19:19:31.067631+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:43.676892+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:38.002187+0000","last_change":"2024-09-13T19:19:38.002210+0000","last_active":"2024-09-13T19:19:38.002187+0000","last_peered":"2024-09-13T19:19:38.002187+0000","last_clean":"2024-09-13T19:19:38.002187+0000","last_became_active":"2024-09-13T19:16:03.912244+0000","last_became_peered":"2024-09-13T19:16:03.912244+0000","last_unstale":"2024-09-13T19:19:38.002187+0000","last_undegraded":"2024-09-13T19:19:38.002187+0000","last_fullsized":"2024-09-13T19:19:38.002187+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:38.002099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:38.002099+0000","last_clean_scrub_stamp":"2024-09-13T19:19:38.002099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:02.124751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"36'3","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:17.506199+0000","last_change":"2024-09-13T19:20:17.506229+0000","last_active":"2024-09-13T19:20:17.506199+0000","last_peered":"2024-09-13T19:20:17.506199+0000","last_clean":"2024-09-13T19:20:17.506199+0000","last_became_active":"2024-09-13T19:16:05.920951+0000","last_became_peered":"2024-09-13T19:16:05.920951+0000","last_unstale":"2024-09-13T19:20:17.506199+0000","last_undegraded":"2024-09-13T19:20:17.506199+0000","last_fullsized":"2024-09-13T19:20:17.506199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-13T19:20:17.506077+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-13T19:20:17.506077+0000","last_clean_scrub_stamp":"2024-09-13T19:20:17.506077+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:59:18.394157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"36'4","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:44.877396+0000","last_change":"2024-09-13T19:19:44.877430+0000","last_active":"2024-09-13T19:19:44.877396+0000","last_peered":"2024-09-13T19:19:44.877396+0000","last_clean":"2024-09-13T19:19:44.877396+0000","last_became_active":"2024-09-13T19:15:57.901732+0000","last_became_peered":"2024-09-13T19:15:57.901732+0000","last_unstale":"2024-09-13T19:19:44.877396+0000","last_undegraded":"2024-09-13T19:19:44.877396+0000","last_fullsized":"2024-09-13T19:19:44.877396+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:19:44.877311+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:19:44.877311+0000","last_clean_scrub_stamp":"2024-09-13T19:19:44.877311+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:11:44.325198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"36'4","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:52.675796+0000","last_change":"2024-09-13T19:19:52.675825+0000","last_active":"2024-09-13T19:19:52.675796+0000","last_peered":"2024-09-13T19:19:52.675796+0000","last_clean":"2024-09-13T19:19:52.675796+0000","last_became_active":"2024-09-13T19:15:55.894279+0000","last_became_peered":"2024-09-13T19:15:55.894279+0000","last_unstale":"2024-09-13T19:19:52.675796+0000","last_undegraded":"2024-09-13T19:19:52.675796+0000","last_fullsized":"2024-09-13T19:19:52.675796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:19:52.675686+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:19:52.675686+0000","last_clean_scrub_stamp":"2024-09-13T19:19:52.675686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:16.286898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:24.099254+0000","last_change":"2024-09-13T19:19:24.099278+0000","last_active":"2024-09-13T19:19:24.099254+0000","last_peered":"2024-09-13T19:19:24.099254+0000","last_clean":"2024-09-13T19:19:24.099254+0000","last_became_active":"2024-09-13T19:15:59.895325+0000","last_became_peered":"2024-09-13T19:15:59.895325+0000","last_unstale":"2024-09-13T19:19:24.099254+0000","last_undegraded":"2024-09-13T19:19:24.099254+0000","last_fullsized":"2024-09-13T19:19:24.099254+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:24.099164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:24.099164+0000","last_clean_scrub_stamp":"2024-09-13T19:19:24.099164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:16.483764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"36'8","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:30.333549+0000","last_change":"2024-09-13T19:19:30.333585+0000","last_active":"2024-09-13T19:19:30.333549+0000","last_peered":"2024-09-13T19:19:30.333549+0000","last_clean":"2024-09-13T19:19:30.333549+0000","last_became_active":"2024-09-13T19:16:01.901250+0000","last_became_peered":"2024-09-13T19:16:01.901250+0000","last_unstale":"2024-09-13T19:19:30.333549+0000","last_undegraded":"2024-09-13T19:19:30.333549+0000","last_fullsized":"2024-09-13T19:19:30.333549+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-13T19:19:30.333464+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-13T19:19:30.333464+0000","last_clean_scrub_stamp":"2024-09-13T19:19:30.333464+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:12:35.870136+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:16.732038+0000","last_change":"2024-09-13T19:19:16.732086+0000","last_active":"2024-09-13T19:19:16.732038+0000","last_peered":"2024-09-13T19:19:16.732038+0000","last_clean":"2024-09-13T19:19:16.732038+0000","last_became_active":"2024-09-13T19:16:03.913053+0000","last_became_peered":"2024-09-13T19:16:03.913053+0000","last_unstale":"2024-09-13T19:19:16.732038+0000","last_undegraded":"2024-09-13T19:19:16.732038+0000","last_fullsized":"2024-09-13T19:19:16.732038+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:16.731903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:16.731903+0000","last_clean_scrub_stamp":"2024-09-13T19:19:16.731903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:42.561076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"36'2","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:45.575337+0000","last_change":"2024-09-13T19:19:45.575382+0000","last_active":"2024-09-13T19:19:45.575337+0000","last_peered":"2024-09-13T19:19:45.575337+0000","last_clean":"2024-09-13T19:19:45.575337+0000","last_became_active":"2024-09-13T19:16:05.912428+0000","last_became_peered":"2024-09-13T19:16:05.912428+0000","last_unstale":"2024-09-13T19:19:45.575337+0000","last_undegraded":"2024-09-13T19:19:45.575337+0000","last_fullsized":"2024-09-13T19:19:45.575337+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:45.575217+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:45.575217+0000","last_clean_scrub_stamp":"2024-09-13T19:19:45.575217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:52:00.818473+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"36'8","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:44.570540+0000","last_change":"2024-09-13T19:19:44.570540+0000","last_active":"2024-09-13T19:19:44.570540+0000","last_peered":"2024-09-13T19:19:44.570540+0000","last_clean":"2024-09-13T19:19:44.570540+0000","last_became_active":"2024-09-13T19:15:57.896463+0000","last_became_peered":"2024-09-13T19:15:57.896463+0000","last_unstale":"2024-09-13T19:19:44.570540+0000","last_undegraded":"2024-09-13T19:19:44.570540+0000","last_fullsized":"2024-09-13T19:19:44.570540+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-13T19:19:44.570415+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-13T19:19:44.570415+0000","last_clean_scrub_stamp":"2024-09-13T19:19:44.570415+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:32:33.923357+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"36'2","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:58.515777+0000","last_change":"2024-09-13T19:19:58.515809+0000","last_active":"2024-09-13T19:19:58.515777+0000","last_peered":"2024-09-13T19:19:58.515777+0000","last_clean":"2024-09-13T19:19:58.515777+0000","last_became_active":"2024-09-13T19:15:55.888108+0000","last_became_peered":"2024-09-13T19:15:55.888108+0000","last_unstale":"2024-09-13T19:19:58.515777+0000","last_undegraded":"2024-09-13T19:19:58.515777+0000","last_fullsized":"2024-09-13T19:19:58.515777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:58.515690+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:58.515690+0000","last_clean_scrub_stamp":"2024-09-13T19:19:58.515690+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:14.604266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:34.858389+0000","last_change":"2024-09-13T19:19:34.858432+0000","last_active":"2024-09-13T19:19:34.858389+0000","last_peered":"2024-09-13T19:19:34.858389+0000","last_clean":"2024-09-13T19:19:34.858389+0000","last_became_active":"2024-09-13T19:15:59.892842+0000","last_became_peered":"2024-09-13T19:15:59.892842+0000","last_unstale":"2024-09-13T19:19:34.858389+0000","last_undegraded":"2024-09-13T19:19:34.858389+0000","last_fullsized":"2024-09-13T19:19:34.858389+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:34.858282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:34.858282+0000","last_clean_scrub_stamp":"2024-09-13T19:19:34.858282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:59.055511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"36'48","reported_seq":120,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:24.358477+0000","last_change":"2024-09-13T19:19:24.358526+0000","last_active":"2024-09-13T19:19:24.358477+0000","last_peered":"2024-09-13T19:19:24.358477+0000","last_clean":"2024-09-13T19:19:24.358477+0000","last_became_active":"2024-09-13T19:16:01.902991+0000","last_became_peered":"2024-09-13T19:16:01.902991+0000","last_unstale":"2024-09-13T19:19:24.358477+0000","last_undegraded":"2024-09-13T19:19:24.358477+0000","last_fullsized":"2024-09-13T19:19:24.358477+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'48","last_scrub_stamp":"2024-09-13T19:19:24.358388+0000","last_deep_scrub":"36'48","last_deep_scrub_stamp":"2024-09-13T19:19:24.358388+0000","last_clean_scrub_stamp":"2024-09-13T19:19:24.358388+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:23:15.090837+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:27.782078+0000","last_change":"2024-09-13T19:19:27.782128+0000","last_active":"2024-09-13T19:19:27.782078+0000","last_peered":"2024-09-13T19:19:27.782078+0000","last_clean":"2024-09-13T19:19:27.782078+0000","last_became_active":"2024-09-13T19:16:03.911917+0000","last_became_peered":"2024-09-13T19:16:03.911917+0000","last_unstale":"2024-09-13T19:19:27.782078+0000","last_undegraded":"2024-09-13T19:19:27.782078+0000","last_fullsized":"2024-09-13T19:19:27.782078+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:27.781937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:27.781937+0000","last_clean_scrub_stamp":"2024-09-13T19:19:27.781937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:51.979166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"36'4","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:38.945635+0000","last_change":"2024-09-13T19:16:05.924382+0000","last_active":"2024-09-13T19:18:38.945635+0000","last_peered":"2024-09-13T19:18:38.945635+0000","last_clean":"2024-09-13T19:18:38.945635+0000","last_became_active":"2024-09-13T19:16:05.923368+0000","last_became_peered":"2024-09-13T19:16:05.923368+0000","last_unstale":"2024-09-13T19:18:38.945635+0000","last_undegraded":"2024-09-13T19:18:38.945635+0000","last_fullsized":"2024-09-13T19:18:38.945635+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"36'16","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:12.626408+0000","last_change":"2024-09-13T19:20:12.626437+0000","last_active":"2024-09-13T19:20:12.626408+0000","last_peered":"2024-09-13T19:20:12.626408+0000","last_clean":"2024-09-13T19:20:12.626408+0000","last_became_active":"2024-09-13T19:16:31.991993+0000","last_became_peered":"2024-09-13T19:16:31.991993+0000","last_unstale":"2024-09-13T19:20:12.626408+0000","last_undegraded":"2024-09-13T19:20:12.626408+0000","last_fullsized":"2024-09-13T19:20:12.626408+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-13T19:20:12.626317+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-13T19:20:12.626317+0000","last_clean_scrub_stamp":"2024-09-13T19:20:12.626317+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:58:19.642331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"36'2","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:04.093302+0000","last_change":"2024-09-13T19:20:04.093337+0000","last_active":"2024-09-13T19:20:04.093302+0000","last_peered":"2024-09-13T19:20:04.093302+0000","last_clean":"2024-09-13T19:20:04.093302+0000","last_became_active":"2024-09-13T19:15:55.891711+0000","last_became_peered":"2024-09-13T19:15:55.891711+0000","last_unstale":"2024-09-13T19:20:04.093302+0000","last_undegraded":"2024-09-13T19:20:04.093302+0000","last_fullsized":"2024-09-13T19:20:04.093302+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:20:04.093201+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:20:04.093201+0000","last_clean_scrub_stamp":"2024-09-13T19:20:04.093201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:39:33.862950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:28.138750+0000","last_change":"2024-09-13T19:19:28.138774+0000","last_active":"2024-09-13T19:19:28.138750+0000","last_peered":"2024-09-13T19:19:28.138750+0000","last_clean":"2024-09-13T19:19:28.138750+0000","last_became_active":"2024-09-13T19:15:59.891581+0000","last_became_peered":"2024-09-13T19:15:59.891581+0000","last_unstale":"2024-09-13T19:19:28.138750+0000","last_undegraded":"2024-09-13T19:19:28.138750+0000","last_fullsized":"2024-09-13T19:19:28.138750+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:28.138649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:28.138649+0000","last_clean_scrub_stamp":"2024-09-13T19:19:28.138649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:49.838315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"36'36","reported_seq":91,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:29.830558+0000","last_change":"2024-09-13T19:19:29.830588+0000","last_active":"2024-09-13T19:19:29.830558+0000","last_peered":"2024-09-13T19:19:29.830558+0000","last_clean":"2024-09-13T19:19:29.830558+0000","last_became_active":"2024-09-13T19:16:01.899438+0000","last_became_peered":"2024-09-13T19:16:01.899438+0000","last_unstale":"2024-09-13T19:19:29.830558+0000","last_undegraded":"2024-09-13T19:19:29.830558+0000","last_fullsized":"2024-09-13T19:19:29.830558+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-13T19:19:29.830469+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-13T19:19:29.830469+0000","last_clean_scrub_stamp":"2024-09-13T19:19:29.830469+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:27.642409+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:20.751480+0000","last_change":"2024-09-13T19:19:20.751502+0000","last_active":"2024-09-13T19:19:20.751480+0000","last_peered":"2024-09-13T19:19:20.751480+0000","last_clean":"2024-09-13T19:19:20.751480+0000","last_became_active":"2024-09-13T19:16:03.910319+0000","last_became_peered":"2024-09-13T19:16:03.910319+0000","last_unstale":"2024-09-13T19:19:20.751480+0000","last_undegraded":"2024-09-13T19:19:20.751480+0000","last_fullsized":"2024-09-13T19:19:20.751480+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:20.751392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:20.751392+0000","last_clean_scrub_stamp":"2024-09-13T19:19:20.751392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:18.995121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"36'10","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:52.862813+0000","last_change":"2024-09-13T19:19:52.862813+0000","last_active":"2024-09-13T19:19:52.862813+0000","last_peered":"2024-09-13T19:19:52.862813+0000","last_clean":"2024-09-13T19:19:52.862813+0000","last_became_active":"2024-09-13T19:15:57.897232+0000","last_became_peered":"2024-09-13T19:15:57.897232+0000","last_unstale":"2024-09-13T19:19:52.862813+0000","last_undegraded":"2024-09-13T19:19:52.862813+0000","last_fullsized":"2024-09-13T19:19:52.862813+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-13T19:19:52.862661+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-13T19:19:52.862661+0000","last_clean_scrub_stamp":"2024-09-13T19:19:52.862661+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:54.838456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:04.931294+0000","last_change":"2024-09-13T19:20:04.931320+0000","last_active":"2024-09-13T19:20:04.931294+0000","last_peered":"2024-09-13T19:20:04.931294+0000","last_clean":"2024-09-13T19:20:04.931294+0000","last_became_active":"2024-09-13T19:15:55.901257+0000","last_became_peered":"2024-09-13T19:15:55.901257+0000","last_unstale":"2024-09-13T19:20:04.931294+0000","last_undegraded":"2024-09-13T19:20:04.931294+0000","last_fullsized":"2024-09-13T19:20:04.931294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:20:04.931174+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:20:04.931174+0000","last_clean_scrub_stamp":"2024-09-13T19:20:04.931174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:16:16.436095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:32.383184+0000","last_change":"2024-09-13T19:19:32.383184+0000","last_active":"2024-09-13T19:19:32.383184+0000","last_peered":"2024-09-13T19:19:32.383184+0000","last_clean":"2024-09-13T19:19:32.383184+0000","last_became_active":"2024-09-13T19:15:59.896339+0000","last_became_peered":"2024-09-13T19:15:59.896339+0000","last_unstale":"2024-09-13T19:19:32.383184+0000","last_undegraded":"2024-09-13T19:19:32.383184+0000","last_fullsized":"2024-09-13T19:19:32.383184+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:32.383058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:32.383058+0000","last_clean_scrub_stamp":"2024-09-13T19:19:32.383058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:00.272146+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"36'63","reported_seq":136,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:31.346681+0000","last_change":"2024-09-13T19:19:31.346722+0000","last_active":"2024-09-13T19:19:31.346681+0000","last_peered":"2024-09-13T19:19:31.346681+0000","last_clean":"2024-09-13T19:19:31.346681+0000","last_became_active":"2024-09-13T19:16:01.901092+0000","last_became_peered":"2024-09-13T19:16:01.901092+0000","last_unstale":"2024-09-13T19:19:31.346681+0000","last_undegraded":"2024-09-13T19:19:31.346681+0000","last_fullsized":"2024-09-13T19:19:31.346681+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'63","last_scrub_stamp":"2024-09-13T19:19:31.346567+0000","last_deep_scrub":"36'63","last_deep_scrub_stamp":"2024-09-13T19:19:31.346567+0000","last_clean_scrub_stamp":"2024-09-13T19:19:31.346567+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:48:17.500355+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:18.709566+0000","last_change":"2024-09-13T19:19:18.709589+0000","last_active":"2024-09-13T19:19:18.709566+0000","last_peered":"2024-09-13T19:19:18.709566+0000","last_clean":"2024-09-13T19:19:18.709566+0000","last_became_active":"2024-09-13T19:16:03.910305+0000","last_became_peered":"2024-09-13T19:16:03.910305+0000","last_unstale":"2024-09-13T19:19:18.709566+0000","last_undegraded":"2024-09-13T19:19:18.709566+0000","last_fullsized":"2024-09-13T19:19:18.709566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:18.709481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:18.709481+0000","last_clean_scrub_stamp":"2024-09-13T19:19:18.709481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:41.615886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"36'22","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:13.494631+0000","last_change":"2024-09-13T19:20:13.494661+0000","last_active":"2024-09-13T19:20:13.494631+0000","last_peered":"2024-09-13T19:20:13.494631+0000","last_clean":"2024-09-13T19:20:13.494631+0000","last_became_active":"2024-09-13T19:16:05.912675+0000","last_became_peered":"2024-09-13T19:16:05.912675+0000","last_unstale":"2024-09-13T19:20:13.494631+0000","last_undegraded":"2024-09-13T19:20:13.494631+0000","last_fullsized":"2024-09-13T19:20:13.494631+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'22","last_scrub_stamp":"2024-09-13T19:20:13.494529+0000","last_deep_scrub":"36'22","last_deep_scrub_stamp":"2024-09-13T19:20:13.494529+0000","last_clean_scrub_stamp":"2024-09-13T19:20:13.494529+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:42:34.844694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"36'6","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:57.642302+0000","last_change":"2024-09-13T19:19:57.642327+0000","last_active":"2024-09-13T19:19:57.642302+0000","last_peered":"2024-09-13T19:19:57.642302+0000","last_clean":"2024-09-13T19:19:57.642302+0000","last_became_active":"2024-09-13T19:15:57.889921+0000","last_became_peered":"2024-09-13T19:15:57.889921+0000","last_unstale":"2024-09-13T19:19:57.642302+0000","last_undegraded":"2024-09-13T19:19:57.642302+0000","last_fullsized":"2024-09-13T19:19:57.642302+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:19:57.642210+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:19:57.642210+0000","last_clean_scrub_stamp":"2024-09-13T19:19:57.642210+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:10:09.081946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:07.128790+0000","last_change":"2024-09-13T19:20:07.128831+0000","last_active":"2024-09-13T19:20:07.128790+0000","last_peered":"2024-09-13T19:20:07.128790+0000","last_clean":"2024-09-13T19:20:07.128790+0000","last_became_active":"2024-09-13T19:15:55.895344+0000","last_became_peered":"2024-09-13T19:15:55.895344+0000","last_unstale":"2024-09-13T19:20:07.128790+0000","last_undegraded":"2024-09-13T19:20:07.128790+0000","last_fullsized":"2024-09-13T19:20:07.128790+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:07.128707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:07.128707+0000","last_clean_scrub_stamp":"2024-09-13T19:20:07.128707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:25.121795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:38.765129+0000","last_change":"2024-09-13T19:19:38.765129+0000","last_active":"2024-09-13T19:19:38.765129+0000","last_peered":"2024-09-13T19:19:38.765129+0000","last_clean":"2024-09-13T19:19:38.765129+0000","last_became_active":"2024-09-13T19:15:59.888213+0000","last_became_peered":"2024-09-13T19:15:59.888213+0000","last_unstale":"2024-09-13T19:19:38.765129+0000","last_undegraded":"2024-09-13T19:19:38.765129+0000","last_fullsized":"2024-09-13T19:19:38.765129+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:38.764987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:38.764987+0000","last_clean_scrub_stamp":"2024-09-13T19:19:38.764987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:30.399476+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"36'45","reported_seq":103,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:40.991571+0000","last_change":"2024-09-13T19:19:40.991618+0000","last_active":"2024-09-13T19:19:40.991571+0000","last_peered":"2024-09-13T19:19:40.991571+0000","last_clean":"2024-09-13T19:19:40.991571+0000","last_became_active":"2024-09-13T19:16:01.908116+0000","last_became_peered":"2024-09-13T19:16:01.908116+0000","last_unstale":"2024-09-13T19:19:40.991571+0000","last_undegraded":"2024-09-13T19:19:40.991571+0000","last_fullsized":"2024-09-13T19:19:40.991571+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'45","last_scrub_stamp":"2024-09-13T19:19:40.991484+0000","last_deep_scrub":"36'45","last_deep_scrub_stamp":"2024-09-13T19:19:40.991484+0000","last_clean_scrub_stamp":"2024-09-13T19:19:40.991484+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:20.333822+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:31.769578+0000","last_change":"2024-09-13T19:19:31.769602+0000","last_active":"2024-09-13T19:19:31.769578+0000","last_peered":"2024-09-13T19:19:31.769578+0000","last_clean":"2024-09-13T19:19:31.769578+0000","last_became_active":"2024-09-13T19:16:03.914179+0000","last_became_peered":"2024-09-13T19:16:03.914179+0000","last_unstale":"2024-09-13T19:19:31.769578+0000","last_undegraded":"2024-09-13T19:19:31.769578+0000","last_fullsized":"2024-09-13T19:19:31.769578+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:31.769488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:31.769488+0000","last_clean_scrub_stamp":"2024-09-13T19:19:31.769488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:13.242003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"34'2","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:54.942437+0000","last_change":"2024-09-13T19:19:54.942494+0000","last_active":"2024-09-13T19:19:54.942437+0000","last_peered":"2024-09-13T19:19:54.942437+0000","last_clean":"2024-09-13T19:19:54.942437+0000","last_became_active":"2024-09-13T19:16:05.916822+0000","last_became_peered":"2024-09-13T19:16:05.916822+0000","last_unstale":"2024-09-13T19:19:54.942437+0000","last_undegraded":"2024-09-13T19:19:54.942437+0000","last_fullsized":"2024-09-13T19:19:54.942437+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:19:54.942324+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:19:54.942324+0000","last_clean_scrub_stamp":"2024-09-13T19:19:54.942324+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:41:03.981946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"36'22","reported_seq":82,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:30.102419+0000","last_change":"2024-09-13T19:19:30.102447+0000","last_active":"2024-09-13T19:19:30.102419+0000","last_peered":"2024-09-13T19:19:30.102419+0000","last_clean":"2024-09-13T19:19:30.102419+0000","last_became_active":"2024-09-13T19:15:57.901330+0000","last_became_peered":"2024-09-13T19:15:57.901330+0000","last_unstale":"2024-09-13T19:19:30.102419+0000","last_undegraded":"2024-09-13T19:19:30.102419+0000","last_fullsized":"2024-09-13T19:19:30.102419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'22","last_scrub_stamp":"2024-09-13T19:19:30.102322+0000","last_deep_scrub":"36'22","last_deep_scrub_stamp":"2024-09-13T19:19:30.102322+0000","last_clean_scrub_stamp":"2024-09-13T19:19:30.102322+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:16.992227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":60,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:59.067849+0000","last_change":"2024-09-13T19:19:59.067896+0000","last_active":"2024-09-13T19:19:59.067849+0000","last_peered":"2024-09-13T19:19:59.067849+0000","last_clean":"2024-09-13T19:19:59.067849+0000","last_became_active":"2024-09-13T19:15:55.896196+0000","last_became_peered":"2024-09-13T19:15:55.896196+0000","last_unstale":"2024-09-13T19:19:59.067849+0000","last_undegraded":"2024-09-13T19:19:59.067849+0000","last_fullsized":"2024-09-13T19:19:59.067849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:59.067754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:59.067754+0000","last_clean_scrub_stamp":"2024-09-13T19:19:59.067754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:11.124902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:37.784973+0000","last_change":"2024-09-13T19:19:37.784998+0000","last_active":"2024-09-13T19:19:37.784973+0000","last_peered":"2024-09-13T19:19:37.784973+0000","last_clean":"2024-09-13T19:19:37.784973+0000","last_became_active":"2024-09-13T19:15:59.891131+0000","last_became_peered":"2024-09-13T19:15:59.891131+0000","last_unstale":"2024-09-13T19:19:37.784973+0000","last_undegraded":"2024-09-13T19:19:37.784973+0000","last_fullsized":"2024-09-13T19:19:37.784973+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:37.784843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:37.784843+0000","last_clean_scrub_stamp":"2024-09-13T19:19:37.784843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:04:18.549612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"36'39","reported_seq":96,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:27.304502+0000","last_change":"2024-09-13T19:19:27.304502+0000","last_active":"2024-09-13T19:19:27.304502+0000","last_peered":"2024-09-13T19:19:27.304502+0000","last_clean":"2024-09-13T19:19:27.304502+0000","last_became_active":"2024-09-13T19:16:01.902251+0000","last_became_peered":"2024-09-13T19:16:01.902251+0000","last_unstale":"2024-09-13T19:19:27.304502+0000","last_undegraded":"2024-09-13T19:19:27.304502+0000","last_fullsized":"2024-09-13T19:19:27.304502+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'39","last_scrub_stamp":"2024-09-13T19:19:27.304335+0000","last_deep_scrub":"36'39","last_deep_scrub_stamp":"2024-09-13T19:19:27.304335+0000","last_clean_scrub_stamp":"2024-09-13T19:19:27.304335+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:19:17.836466+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:37.488048+0000","last_change":"2024-09-13T19:19:37.488048+0000","last_active":"2024-09-13T19:19:37.488048+0000","last_peered":"2024-09-13T19:19:37.488048+0000","last_clean":"2024-09-13T19:19:37.488048+0000","last_became_active":"2024-09-13T19:16:03.915225+0000","last_became_peered":"2024-09-13T19:16:03.915225+0000","last_unstale":"2024-09-13T19:19:37.488048+0000","last_undegraded":"2024-09-13T19:19:37.488048+0000","last_fullsized":"2024-09-13T19:19:37.488048+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:37.487953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:37.487953+0000","last_clean_scrub_stamp":"2024-09-13T19:19:37.487953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:42.911372+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"36'5","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:28.944166+0000","last_change":"2024-09-13T19:16:05.925066+0000","last_active":"2024-09-13T19:18:28.944166+0000","last_peered":"2024-09-13T19:18:28.944166+0000","last_clean":"2024-09-13T19:18:28.944166+0000","last_became_active":"2024-09-13T19:16:05.923235+0000","last_became_peered":"2024-09-13T19:16:05.923235+0000","last_unstale":"2024-09-13T19:18:28.944166+0000","last_undegraded":"2024-09-13T19:18:28.944166+0000","last_fullsized":"2024-09-13T19:18:28.944166+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"36'8","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:47.641332+0000","last_change":"2024-09-13T19:19:47.641385+0000","last_active":"2024-09-13T19:19:47.641332+0000","last_peered":"2024-09-13T19:19:47.641332+0000","last_clean":"2024-09-13T19:19:47.641332+0000","last_became_active":"2024-09-13T19:15:57.886263+0000","last_became_peered":"2024-09-13T19:15:57.886263+0000","last_unstale":"2024-09-13T19:19:47.641332+0000","last_undegraded":"2024-09-13T19:19:47.641332+0000","last_fullsized":"2024-09-13T19:19:47.641332+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-13T19:19:47.641228+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-13T19:19:47.641228+0000","last_clean_scrub_stamp":"2024-09-13T19:19:47.641228+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:30.867550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:24.058859+0000","last_change":"2024-09-13T19:20:24.058883+0000","last_active":"2024-09-13T19:20:24.058859+0000","last_peered":"2024-09-13T19:20:24.058859+0000","last_clean":"2024-09-13T19:20:24.058859+0000","last_became_active":"2024-09-13T19:15:55.893629+0000","last_became_peered":"2024-09-13T19:15:55.893629+0000","last_unstale":"2024-09-13T19:20:24.058859+0000","last_undegraded":"2024-09-13T19:20:24.058859+0000","last_fullsized":"2024-09-13T19:20:24.058859+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:24.058757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:24.058757+0000","last_clean_scrub_stamp":"2024-09-13T19:20:24.058757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:30:15.283806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:32.783520+0000","last_change":"2024-09-13T19:19:32.783543+0000","last_active":"2024-09-13T19:19:32.783520+0000","last_peered":"2024-09-13T19:19:32.783520+0000","last_clean":"2024-09-13T19:19:32.783520+0000","last_became_active":"2024-09-13T19:15:59.892445+0000","last_became_peered":"2024-09-13T19:15:59.892445+0000","last_unstale":"2024-09-13T19:19:32.783520+0000","last_undegraded":"2024-09-13T19:19:32.783520+0000","last_fullsized":"2024-09-13T19:19:32.783520+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:32.783411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:32.783411+0000","last_clean_scrub_stamp":"2024-09-13T19:19:32.783411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:00:48.438787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"36'16","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:45.872607+0000","last_change":"2024-09-13T19:19:45.872607+0000","last_active":"2024-09-13T19:19:45.872607+0000","last_peered":"2024-09-13T19:19:45.872607+0000","last_clean":"2024-09-13T19:19:45.872607+0000","last_became_active":"2024-09-13T19:16:01.905553+0000","last_became_peered":"2024-09-13T19:16:01.905553+0000","last_unstale":"2024-09-13T19:19:45.872607+0000","last_undegraded":"2024-09-13T19:19:45.872607+0000","last_fullsized":"2024-09-13T19:19:45.872607+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-13T19:19:45.872465+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-13T19:19:45.872465+0000","last_clean_scrub_stamp":"2024-09-13T19:19:45.872465+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:31:04.671736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"36'285","reported_seq":379,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:19.719772+0000","last_change":"2024-09-13T19:19:19.719772+0000","last_active":"2024-09-13T19:19:19.719772+0000","last_peered":"2024-09-13T19:19:19.719772+0000","last_clean":"2024-09-13T19:19:19.719772+0000","last_became_active":"2024-09-13T19:16:03.913170+0000","last_became_peered":"2024-09-13T19:16:03.913170+0000","last_unstale":"2024-09-13T19:19:19.719772+0000","last_undegraded":"2024-09-13T19:19:19.719772+0000","last_fullsized":"2024-09-13T19:19:19.719772+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-13T19:19:19.719650+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-13T19:19:19.719650+0000","last_clean_scrub_stamp":"2024-09-13T19:19:19.719650+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:13:51.353091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"36'4","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:58.931901+0000","last_change":"2024-09-13T19:19:58.931951+0000","last_active":"2024-09-13T19:19:58.931901+0000","last_peered":"2024-09-13T19:19:58.931901+0000","last_clean":"2024-09-13T19:19:58.931901+0000","last_became_active":"2024-09-13T19:16:05.918050+0000","last_became_peered":"2024-09-13T19:16:05.918050+0000","last_unstale":"2024-09-13T19:19:58.931901+0000","last_undegraded":"2024-09-13T19:19:58.931901+0000","last_fullsized":"2024-09-13T19:19:58.931901+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:19:58.931793+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:19:58.931793+0000","last_clean_scrub_stamp":"2024-09-13T19:19:58.931793+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:51.645100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"36'10","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:43.832951+0000","last_change":"2024-09-13T19:19:43.832987+0000","last_active":"2024-09-13T19:19:43.832951+0000","last_peered":"2024-09-13T19:19:43.832951+0000","last_clean":"2024-09-13T19:19:43.832951+0000","last_became_active":"2024-09-13T19:15:57.885711+0000","last_became_peered":"2024-09-13T19:15:57.885711+0000","last_unstale":"2024-09-13T19:19:43.832951+0000","last_undegraded":"2024-09-13T19:19:43.832951+0000","last_fullsized":"2024-09-13T19:19:43.832951+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-13T19:19:43.832854+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-13T19:19:43.832854+0000","last_clean_scrub_stamp":"2024-09-13T19:19:43.832854+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:23.636694+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:03.133872+0000","last_change":"2024-09-13T19:20:03.133898+0000","last_active":"2024-09-13T19:20:03.133872+0000","last_peered":"2024-09-13T19:20:03.133872+0000","last_clean":"2024-09-13T19:20:03.133872+0000","last_became_active":"2024-09-13T19:15:55.890670+0000","last_became_peered":"2024-09-13T19:15:55.890670+0000","last_unstale":"2024-09-13T19:20:03.133872+0000","last_undegraded":"2024-09-13T19:20:03.133872+0000","last_fullsized":"2024-09-13T19:20:03.133872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:20:03.133782+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:20:03.133782+0000","last_clean_scrub_stamp":"2024-09-13T19:20:03.133782+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:53:48.308748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:29.803492+0000","last_change":"2024-09-13T19:19:29.803524+0000","last_active":"2024-09-13T19:19:29.803492+0000","last_peered":"2024-09-13T19:19:29.803492+0000","last_clean":"2024-09-13T19:19:29.803492+0000","last_became_active":"2024-09-13T19:15:59.893905+0000","last_became_peered":"2024-09-13T19:15:59.893905+0000","last_unstale":"2024-09-13T19:19:29.803492+0000","last_undegraded":"2024-09-13T19:19:29.803492+0000","last_fullsized":"2024-09-13T19:19:29.803492+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:29.803399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:29.803399+0000","last_clean_scrub_stamp":"2024-09-13T19:19:29.803399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:13.674139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"36'46","reported_seq":104,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:18.724087+0000","last_change":"2024-09-13T19:19:18.724144+0000","last_active":"2024-09-13T19:19:18.724087+0000","last_peered":"2024-09-13T19:19:18.724087+0000","last_clean":"2024-09-13T19:19:18.724087+0000","last_became_active":"2024-09-13T19:16:01.903395+0000","last_became_peered":"2024-09-13T19:16:01.903395+0000","last_unstale":"2024-09-13T19:19:18.724087+0000","last_undegraded":"2024-09-13T19:19:18.724087+0000","last_fullsized":"2024-09-13T19:19:18.724087+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'46","last_scrub_stamp":"2024-09-13T19:19:18.723995+0000","last_deep_scrub":"36'46","last_deep_scrub_stamp":"2024-09-13T19:19:18.723995+0000","last_clean_scrub_stamp":"2024-09-13T19:19:18.723995+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:23.717143+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:18.382095+0000","last_change":"2024-09-13T19:19:18.382122+0000","last_active":"2024-09-13T19:19:18.382095+0000","last_peered":"2024-09-13T19:19:18.382095+0000","last_clean":"2024-09-13T19:19:18.382095+0000","last_became_active":"2024-09-13T19:16:03.910550+0000","last_became_peered":"2024-09-13T19:16:03.910550+0000","last_unstale":"2024-09-13T19:19:18.382095+0000","last_undegraded":"2024-09-13T19:19:18.382095+0000","last_fullsized":"2024-09-13T19:19:18.382095+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:18.381995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:18.381995+0000","last_clean_scrub_stamp":"2024-09-13T19:19:18.381995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:49.252007+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"36'3","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:11.045173+0000","last_change":"2024-09-13T19:20:11.045199+0000","last_active":"2024-09-13T19:20:11.045173+0000","last_peered":"2024-09-13T19:20:11.045173+0000","last_clean":"2024-09-13T19:20:11.045173+0000","last_became_active":"2024-09-13T19:16:05.913598+0000","last_became_peered":"2024-09-13T19:16:05.913598+0000","last_unstale":"2024-09-13T19:20:11.045173+0000","last_undegraded":"2024-09-13T19:20:11.045173+0000","last_fullsized":"2024-09-13T19:20:11.045173+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-13T19:20:11.045091+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-13T19:20:11.045091+0000","last_clean_scrub_stamp":"2024-09-13T19:20:11.045091+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:05.787037+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:42.851372+0000","last_change":"2024-09-13T19:19:42.851396+0000","last_active":"2024-09-13T19:19:42.851372+0000","last_peered":"2024-09-13T19:19:42.851372+0000","last_clean":"2024-09-13T19:19:42.851372+0000","last_became_active":"2024-09-13T19:15:57.883463+0000","last_became_peered":"2024-09-13T19:15:57.883463+0000","last_unstale":"2024-09-13T19:19:42.851372+0000","last_undegraded":"2024-09-13T19:19:42.851372+0000","last_fullsized":"2024-09-13T19:19:42.851372+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:19:42.851247+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:19:42.851247+0000","last_clean_scrub_stamp":"2024-09-13T19:19:42.851247+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:47.003451+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:19.025155+0000","last_change":"2024-09-13T19:20:19.025184+0000","last_active":"2024-09-13T19:20:19.025155+0000","last_peered":"2024-09-13T19:20:19.025155+0000","last_clean":"2024-09-13T19:20:19.025155+0000","last_became_active":"2024-09-13T19:15:55.899847+0000","last_became_peered":"2024-09-13T19:15:55.899847+0000","last_unstale":"2024-09-13T19:20:19.025155+0000","last_undegraded":"2024-09-13T19:20:19.025155+0000","last_fullsized":"2024-09-13T19:20:19.025155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:19.025041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:19.025041+0000","last_clean_scrub_stamp":"2024-09-13T19:20:19.025041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:04:32.036977+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:33.839962+0000","last_change":"2024-09-13T19:19:33.840008+0000","last_active":"2024-09-13T19:19:33.839962+0000","last_peered":"2024-09-13T19:19:33.839962+0000","last_clean":"2024-09-13T19:19:33.839962+0000","last_became_active":"2024-09-13T19:15:59.895512+0000","last_became_peered":"2024-09-13T19:15:59.895512+0000","last_unstale":"2024-09-13T19:19:33.839962+0000","last_undegraded":"2024-09-13T19:19:33.839962+0000","last_fullsized":"2024-09-13T19:19:33.839962+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:33.839854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:33.839854+0000","last_clean_scrub_stamp":"2024-09-13T19:19:33.839854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:49.315701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"36'36","reported_seq":91,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:26.305275+0000","last_change":"2024-09-13T19:19:26.305329+0000","last_active":"2024-09-13T19:19:26.305275+0000","last_peered":"2024-09-13T19:19:26.305275+0000","last_clean":"2024-09-13T19:19:26.305275+0000","last_became_active":"2024-09-13T19:16:01.902285+0000","last_became_peered":"2024-09-13T19:16:01.902285+0000","last_unstale":"2024-09-13T19:19:26.305275+0000","last_undegraded":"2024-09-13T19:19:26.305275+0000","last_fullsized":"2024-09-13T19:19:26.305275+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-13T19:19:26.305171+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-13T19:19:26.305171+0000","last_clean_scrub_stamp":"2024-09-13T19:19:26.305171+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:15:14.766698+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:40.004211+0000","last_change":"2024-09-13T19:19:40.004237+0000","last_active":"2024-09-13T19:19:40.004211+0000","last_peered":"2024-09-13T19:19:40.004211+0000","last_clean":"2024-09-13T19:19:40.004211+0000","last_became_active":"2024-09-13T19:16:03.911587+0000","last_became_peered":"2024-09-13T19:16:03.911587+0000","last_unstale":"2024-09-13T19:19:40.004211+0000","last_undegraded":"2024-09-13T19:19:40.004211+0000","last_fullsized":"2024-09-13T19:19:40.004211+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:40.004104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:40.004104+0000","last_clean_scrub_stamp":"2024-09-13T19:19:40.004104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:57.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:33.945014+0000","last_change":"2024-09-13T19:16:05.923352+0000","last_active":"2024-09-13T19:18:33.945014+0000","last_peered":"2024-09-13T19:18:33.945014+0000","last_clean":"2024-09-13T19:18:33.945014+0000","last_became_active":"2024-09-13T19:16:05.923014+0000","last_became_peered":"2024-09-13T19:16:05.923014+0000","last_unstale":"2024-09-13T19:18:33.945014+0000","last_undegraded":"2024-09-13T19:18:33.945014+0000","last_fullsized":"2024-09-13T19:18:33.945014+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"36'4","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:56.969792+0000","last_change":"2024-09-13T19:19:56.969818+0000","last_active":"2024-09-13T19:19:56.969792+0000","last_peered":"2024-09-13T19:19:56.969792+0000","last_clean":"2024-09-13T19:19:56.969792+0000","last_became_active":"2024-09-13T19:15:57.896310+0000","last_became_peered":"2024-09-13T19:15:57.896310+0000","last_unstale":"2024-09-13T19:19:56.969792+0000","last_undegraded":"2024-09-13T19:19:56.969792+0000","last_fullsized":"2024-09-13T19:19:56.969792+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:19:56.969709+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:19:56.969709+0000","last_clean_scrub_stamp":"2024-09-13T19:19:56.969709+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:00:10.970577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:58.684717+0000","last_change":"2024-09-13T19:19:58.684741+0000","last_active":"2024-09-13T19:19:58.684717+0000","last_peered":"2024-09-13T19:19:58.684717+0000","last_clean":"2024-09-13T19:19:58.684717+0000","last_became_active":"2024-09-13T19:15:55.893600+0000","last_became_peered":"2024-09-13T19:15:55.893600+0000","last_unstale":"2024-09-13T19:19:58.684717+0000","last_undegraded":"2024-09-13T19:19:58.684717+0000","last_fullsized":"2024-09-13T19:19:58.684717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:58.684635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:58.684635+0000","last_clean_scrub_stamp":"2024-09-13T19:19:58.684635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:42:25.367627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:26.733975+0000","last_change":"2024-09-13T19:19:26.734018+0000","last_active":"2024-09-13T19:19:26.733975+0000","last_peered":"2024-09-13T19:19:26.733975+0000","last_clean":"2024-09-13T19:19:26.733975+0000","last_became_active":"2024-09-13T19:15:59.896518+0000","last_became_peered":"2024-09-13T19:15:59.896518+0000","last_unstale":"2024-09-13T19:19:26.733975+0000","last_undegraded":"2024-09-13T19:19:26.733975+0000","last_fullsized":"2024-09-13T19:19:26.733975+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:26.733839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:26.733839+0000","last_clean_scrub_stamp":"2024-09-13T19:19:26.733839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:27.626320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"36'30","reported_seq":83,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:23.073612+0000","last_change":"2024-09-13T19:19:23.073664+0000","last_active":"2024-09-13T19:19:23.073612+0000","last_peered":"2024-09-13T19:19:23.073612+0000","last_clean":"2024-09-13T19:19:23.073612+0000","last_became_active":"2024-09-13T19:16:01.902699+0000","last_became_peered":"2024-09-13T19:16:01.902699+0000","last_unstale":"2024-09-13T19:19:23.073612+0000","last_undegraded":"2024-09-13T19:19:23.073612+0000","last_fullsized":"2024-09-13T19:19:23.073612+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'30","last_scrub_stamp":"2024-09-13T19:19:23.073511+0000","last_deep_scrub":"36'30","last_deep_scrub_stamp":"2024-09-13T19:19:23.073511+0000","last_clean_scrub_stamp":"2024-09-13T19:19:23.073511+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:54:35.654271+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:37.027586+0000","last_change":"2024-09-13T19:19:37.027611+0000","last_active":"2024-09-13T19:19:37.027586+0000","last_peered":"2024-09-13T19:19:37.027586+0000","last_clean":"2024-09-13T19:19:37.027586+0000","last_became_active":"2024-09-13T19:16:03.913228+0000","last_became_peered":"2024-09-13T19:16:03.913228+0000","last_unstale":"2024-09-13T19:19:37.027586+0000","last_undegraded":"2024-09-13T19:19:37.027586+0000","last_fullsized":"2024-09-13T19:19:37.027586+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:37.027487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:37.027487+0000","last_clean_scrub_stamp":"2024-09-13T19:19:37.027487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:39:06.797236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"36'4","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:33.944981+0000","last_change":"2024-09-13T19:16:05.925781+0000","last_active":"2024-09-13T19:18:33.944981+0000","last_peered":"2024-09-13T19:18:33.944981+0000","last_clean":"2024-09-13T19:18:33.944981+0000","last_became_active":"2024-09-13T19:16:05.925519+0000","last_became_peered":"2024-09-13T19:16:05.925519+0000","last_unstale":"2024-09-13T19:18:33.944981+0000","last_undegraded":"2024-09-13T19:18:33.944981+0000","last_fullsized":"2024-09-13T19:18:33.944981+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"36'6","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:45.816308+0000","last_change":"2024-09-13T19:19:45.816379+0000","last_active":"2024-09-13T19:19:45.816308+0000","last_peered":"2024-09-13T19:19:45.816308+0000","last_clean":"2024-09-13T19:19:45.816308+0000","last_became_active":"2024-09-13T19:15:57.885993+0000","last_became_peered":"2024-09-13T19:15:57.885993+0000","last_unstale":"2024-09-13T19:19:45.816308+0000","last_undegraded":"2024-09-13T19:19:45.816308+0000","last_fullsized":"2024-09-13T19:19:45.816308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:19:45.816207+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:19:45.816207+0000","last_clean_scrub_stamp":"2024-09-13T19:19:45.816207+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:58:05.931904+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:09.058802+0000","last_change":"2024-09-13T19:20:09.058844+0000","last_active":"2024-09-13T19:20:09.058802+0000","last_peered":"2024-09-13T19:20:09.058802+0000","last_clean":"2024-09-13T19:20:09.058802+0000","last_became_active":"2024-09-13T19:15:55.895040+0000","last_became_peered":"2024-09-13T19:15:55.895040+0000","last_unstale":"2024-09-13T19:20:09.058802+0000","last_undegraded":"2024-09-13T19:20:09.058802+0000","last_fullsized":"2024-09-13T19:20:09.058802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:09.058683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:09.058683+0000","last_clean_scrub_stamp":"2024-09-13T19:20:09.058683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:46.306597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"36'3","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:24.660289+0000","last_change":"2024-09-13T19:19:24.660340+0000","last_active":"2024-09-13T19:19:24.660289+0000","last_peered":"2024-09-13T19:19:24.660289+0000","last_clean":"2024-09-13T19:19:24.660289+0000","last_became_active":"2024-09-13T19:15:59.897609+0000","last_became_peered":"2024-09-13T19:15:59.897609+0000","last_unstale":"2024-09-13T19:19:24.660289+0000","last_undegraded":"2024-09-13T19:19:24.660289+0000","last_fullsized":"2024-09-13T19:19:24.660289+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-13T19:19:24.660188+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-13T19:19:24.660188+0000","last_clean_scrub_stamp":"2024-09-13T19:19:24.660188+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:56.245062+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"36'40","reported_seq":97,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:21.050539+0000","last_change":"2024-09-13T19:19:21.050618+0000","last_active":"2024-09-13T19:19:21.050539+0000","last_peered":"2024-09-13T19:19:21.050539+0000","last_clean":"2024-09-13T19:19:21.050539+0000","last_became_active":"2024-09-13T19:16:01.902042+0000","last_became_peered":"2024-09-13T19:16:01.902042+0000","last_unstale":"2024-09-13T19:19:21.050539+0000","last_undegraded":"2024-09-13T19:19:21.050539+0000","last_fullsized":"2024-09-13T19:19:21.050539+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'40","last_scrub_stamp":"2024-09-13T19:19:21.050438+0000","last_deep_scrub":"36'40","last_deep_scrub_stamp":"2024-09-13T19:19:21.050438+0000","last_clean_scrub_stamp":"2024-09-13T19:19:21.050438+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:19.019166+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:16.346297+0000","last_change":"2024-09-13T19:19:16.346321+0000","last_active":"2024-09-13T19:19:16.346297+0000","last_peered":"2024-09-13T19:19:16.346297+0000","last_clean":"2024-09-13T19:19:16.346297+0000","last_became_active":"2024-09-13T19:16:03.911052+0000","last_became_peered":"2024-09-13T19:16:03.911052+0000","last_unstale":"2024-09-13T19:19:16.346297+0000","last_undegraded":"2024-09-13T19:19:16.346297+0000","last_fullsized":"2024-09-13T19:19:16.346297+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:16.346224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:16.346224+0000","last_clean_scrub_stamp":"2024-09-13T19:19:16.346224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:31.215677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"36'2","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:18:28.944271+0000","last_change":"2024-09-13T19:16:05.924212+0000","last_active":"2024-09-13T19:18:28.944271+0000","last_peered":"2024-09-13T19:18:28.944271+0000","last_clean":"2024-09-13T19:18:28.944271+0000","last_became_active":"2024-09-13T19:16:05.922822+0000","last_became_peered":"2024-09-13T19:16:05.922822+0000","last_unstale":"2024-09-13T19:18:28.944271+0000","last_undegraded":"2024-09-13T19:18:28.944271+0000","last_fullsized":"2024-09-13T19:18:28.944271+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:16:04.895305+0000","last_clean_scrub_stamp":"2024-09-13T19:16:04.895305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"36'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:36.838417+0000","last_change":"2024-09-13T19:19:36.838417+0000","last_active":"2024-09-13T19:19:36.838417+0000","last_peered":"2024-09-13T19:19:36.838417+0000","last_clean":"2024-09-13T19:19:36.838417+0000","last_became_active":"2024-09-13T19:15:57.902883+0000","last_became_peered":"2024-09-13T19:15:57.902883+0000","last_unstale":"2024-09-13T19:19:36.838417+0000","last_undegraded":"2024-09-13T19:19:36.838417+0000","last_fullsized":"2024-09-13T19:19:36.838417+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:36.838299+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:36.838299+0000","last_clean_scrub_stamp":"2024-09-13T19:19:36.838299+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:44:59.482570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:46.836795+0000","last_change":"2024-09-13T19:19:46.836795+0000","last_active":"2024-09-13T19:19:46.836795+0000","last_peered":"2024-09-13T19:19:46.836795+0000","last_clean":"2024-09-13T19:19:46.836795+0000","last_became_active":"2024-09-13T19:15:55.898653+0000","last_became_peered":"2024-09-13T19:15:55.898653+0000","last_unstale":"2024-09-13T19:19:46.836795+0000","last_undegraded":"2024-09-13T19:19:46.836795+0000","last_fullsized":"2024-09-13T19:19:46.836795+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:46.836659+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:46.836659+0000","last_clean_scrub_stamp":"2024-09-13T19:19:46.836659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:47:36.269620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"36'8","reported_seq":69,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:49.674734+0000","last_change":"2024-09-13T19:19:49.674734+0000","last_active":"2024-09-13T19:19:49.674734+0000","last_peered":"2024-09-13T19:19:49.674734+0000","last_clean":"2024-09-13T19:19:49.674734+0000","last_became_active":"2024-09-13T19:15:57.886330+0000","last_became_peered":"2024-09-13T19:15:57.886330+0000","last_unstale":"2024-09-13T19:19:49.674734+0000","last_undegraded":"2024-09-13T19:19:49.674734+0000","last_fullsized":"2024-09-13T19:19:49.674734+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-13T19:19:49.674619+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-13T19:19:49.674619+0000","last_clean_scrub_stamp":"2024-09-13T19:19:49.674619+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:12:49.826958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:06.543134+0000","last_change":"2024-09-13T19:20:06.543134+0000","last_active":"2024-09-13T19:20:06.543134+0000","last_peered":"2024-09-13T19:20:06.543134+0000","last_clean":"2024-09-13T19:20:06.543134+0000","last_became_active":"2024-09-13T19:15:55.890821+0000","last_became_peered":"2024-09-13T19:15:55.890821+0000","last_unstale":"2024-09-13T19:20:06.543134+0000","last_undegraded":"2024-09-13T19:20:06.543134+0000","last_fullsized":"2024-09-13T19:20:06.543134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:20:06.543016+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:20:06.543016+0000","last_clean_scrub_stamp":"2024-09-13T19:20:06.543016+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:12.896542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"36'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:36.019627+0000","last_change":"2024-09-13T19:19:36.019627+0000","last_active":"2024-09-13T19:19:36.019627+0000","last_peered":"2024-09-13T19:19:36.019627+0000","last_clean":"2024-09-13T19:19:36.019627+0000","last_became_active":"2024-09-13T19:15:57.898295+0000","last_became_peered":"2024-09-13T19:15:57.898295+0000","last_unstale":"2024-09-13T19:19:36.019627+0000","last_undegraded":"2024-09-13T19:19:36.019627+0000","last_fullsized":"2024-09-13T19:19:36.019627+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:36.019516+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:36.019516+0000","last_clean_scrub_stamp":"2024-09-13T19:19:36.019516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:53:21.194483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:32.012347+0000","last_change":"2024-09-13T19:20:32.012399+0000","last_active":"2024-09-13T19:20:32.012347+0000","last_peered":"2024-09-13T19:20:32.012347+0000","last_clean":"2024-09-13T19:20:32.012347+0000","last_became_active":"2024-09-13T19:15:55.893191+0000","last_became_peered":"2024-09-13T19:15:55.893191+0000","last_unstale":"2024-09-13T19:20:32.012347+0000","last_undegraded":"2024-09-13T19:20:32.012347+0000","last_fullsized":"2024-09-13T19:20:32.012347+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:32.012227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:32.012227+0000","last_clean_scrub_stamp":"2024-09-13T19:20:32.012227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:49.790813+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"36'6","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:53.687759+0000","last_change":"2024-09-13T19:19:53.687759+0000","last_active":"2024-09-13T19:19:53.687759+0000","last_peered":"2024-09-13T19:19:53.687759+0000","last_clean":"2024-09-13T19:19:53.687759+0000","last_became_active":"2024-09-13T19:15:57.886670+0000","last_became_peered":"2024-09-13T19:15:57.886670+0000","last_unstale":"2024-09-13T19:19:53.687759+0000","last_undegraded":"2024-09-13T19:19:53.687759+0000","last_fullsized":"2024-09-13T19:19:53.687759+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:19:53.687608+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:19:53.687608+0000","last_clean_scrub_stamp":"2024-09-13T19:19:53.687608+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:17:16.127903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:02.618155+0000","last_change":"2024-09-13T19:20:02.618155+0000","last_active":"2024-09-13T19:20:02.618155+0000","last_peered":"2024-09-13T19:20:02.618155+0000","last_clean":"2024-09-13T19:20:02.618155+0000","last_became_active":"2024-09-13T19:15:55.893569+0000","last_became_peered":"2024-09-13T19:15:55.893569+0000","last_unstale":"2024-09-13T19:20:02.618155+0000","last_undegraded":"2024-09-13T19:20:02.618155+0000","last_fullsized":"2024-09-13T19:20:02.618155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:02.618037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:02.618037+0000","last_clean_scrub_stamp":"2024-09-13T19:20:02.618037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:22:59.114041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"36'6","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:43.530124+0000","last_change":"2024-09-13T19:19:43.530124+0000","last_active":"2024-09-13T19:19:43.530124+0000","last_peered":"2024-09-13T19:19:43.530124+0000","last_clean":"2024-09-13T19:19:43.530124+0000","last_became_active":"2024-09-13T19:15:57.896487+0000","last_became_peered":"2024-09-13T19:15:57.896487+0000","last_unstale":"2024-09-13T19:19:43.530124+0000","last_undegraded":"2024-09-13T19:19:43.530124+0000","last_fullsized":"2024-09-13T19:19:43.530124+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:19:43.529999+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:19:43.529999+0000","last_clean_scrub_stamp":"2024-09-13T19:19:43.529999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:03:46.729174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:09.501604+0000","last_change":"2024-09-13T19:20:09.501604+0000","last_active":"2024-09-13T19:20:09.501604+0000","last_peered":"2024-09-13T19:20:09.501604+0000","last_clean":"2024-09-13T19:20:09.501604+0000","last_became_active":"2024-09-13T19:15:55.892026+0000","last_became_peered":"2024-09-13T19:15:55.892026+0000","last_unstale":"2024-09-13T19:20:09.501604+0000","last_undegraded":"2024-09-13T19:20:09.501604+0000","last_fullsized":"2024-09-13T19:20:09.501604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:09.501488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:09.501488+0000","last_clean_scrub_stamp":"2024-09-13T19:20:09.501488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:11:22.750033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"36'16","reported_seq":89,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:41.888155+0000","last_change":"2024-09-13T19:19:41.888155+0000","last_active":"2024-09-13T19:19:41.888155+0000","last_peered":"2024-09-13T19:19:41.888155+0000","last_clean":"2024-09-13T19:19:41.888155+0000","last_became_active":"2024-09-13T19:15:57.902841+0000","last_became_peered":"2024-09-13T19:15:57.902841+0000","last_unstale":"2024-09-13T19:19:41.888155+0000","last_undegraded":"2024-09-13T19:19:41.888155+0000","last_fullsized":"2024-09-13T19:19:41.888155+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-13T19:19:41.887974+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-13T19:19:41.887974+0000","last_clean_scrub_stamp":"2024-09-13T19:19:41.887974+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:50:07.467247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":56,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:53.061149+0000","last_change":"2024-09-13T19:19:53.061149+0000","last_active":"2024-09-13T19:19:53.061149+0000","last_peered":"2024-09-13T19:19:53.061149+0000","last_clean":"2024-09-13T19:19:53.061149+0000","last_became_active":"2024-09-13T19:15:55.896490+0000","last_became_peered":"2024-09-13T19:15:55.896490+0000","last_unstale":"2024-09-13T19:19:53.061149+0000","last_undegraded":"2024-09-13T19:19:53.061149+0000","last_fullsized":"2024-09-13T19:19:53.061149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:53.061037+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:53.061037+0000","last_clean_scrub_stamp":"2024-09-13T19:19:53.061037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:29.265310+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"36'6","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:55.659165+0000","last_change":"2024-09-13T19:19:55.659165+0000","last_active":"2024-09-13T19:19:55.659165+0000","last_peered":"2024-09-13T19:19:55.659165+0000","last_clean":"2024-09-13T19:19:55.659165+0000","last_became_active":"2024-09-13T19:15:57.887810+0000","last_became_peered":"2024-09-13T19:15:57.887810+0000","last_unstale":"2024-09-13T19:19:55.659165+0000","last_undegraded":"2024-09-13T19:19:55.659165+0000","last_fullsized":"2024-09-13T19:19:55.659165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:19:55.659049+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:19:55.659049+0000","last_clean_scrub_stamp":"2024-09-13T19:19:55.659049+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:55.028329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:02.547135+0000","last_change":"2024-09-13T19:20:02.547135+0000","last_active":"2024-09-13T19:20:02.547135+0000","last_peered":"2024-09-13T19:20:02.547135+0000","last_clean":"2024-09-13T19:20:02.547135+0000","last_became_active":"2024-09-13T19:15:55.891422+0000","last_became_peered":"2024-09-13T19:15:55.891422+0000","last_unstale":"2024-09-13T19:20:02.547135+0000","last_undegraded":"2024-09-13T19:20:02.547135+0000","last_fullsized":"2024-09-13T19:20:02.547135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:02.547002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:02.547002+0000","last_clean_scrub_stamp":"2024-09-13T19:20:02.547002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:49.436907+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"36'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:56.048975+0000","last_change":"2024-09-13T19:19:56.048975+0000","last_active":"2024-09-13T19:19:56.048975+0000","last_peered":"2024-09-13T19:19:56.048975+0000","last_clean":"2024-09-13T19:19:56.048975+0000","last_became_active":"2024-09-13T19:15:57.890491+0000","last_became_peered":"2024-09-13T19:15:57.890491+0000","last_unstale":"2024-09-13T19:19:56.048975+0000","last_undegraded":"2024-09-13T19:19:56.048975+0000","last_fullsized":"2024-09-13T19:19:56.048975+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:56.048815+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:56.048815+0000","last_clean_scrub_stamp":"2024-09-13T19:19:56.048815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:28:46.218969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"36'4","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:08.490661+0000","last_change":"2024-09-13T19:20:08.490661+0000","last_active":"2024-09-13T19:20:08.490661+0000","last_peered":"2024-09-13T19:20:08.490661+0000","last_clean":"2024-09-13T19:20:08.490661+0000","last_became_active":"2024-09-13T19:15:55.891860+0000","last_became_peered":"2024-09-13T19:15:55.891860+0000","last_unstale":"2024-09-13T19:20:08.490661+0000","last_undegraded":"2024-09-13T19:20:08.490661+0000","last_fullsized":"2024-09-13T19:20:08.490661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:20:08.490539+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:20:08.490539+0000","last_clean_scrub_stamp":"2024-09-13T19:20:08.490539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:22:22.024813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"36'6","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:00.044385+0000","last_change":"2024-09-13T19:20:00.044411+0000","last_active":"2024-09-13T19:20:00.044385+0000","last_peered":"2024-09-13T19:20:00.044385+0000","last_clean":"2024-09-13T19:20:00.044385+0000","last_became_active":"2024-09-13T19:15:57.892073+0000","last_became_peered":"2024-09-13T19:15:57.892073+0000","last_unstale":"2024-09-13T19:20:00.044385+0000","last_undegraded":"2024-09-13T19:20:00.044385+0000","last_fullsized":"2024-09-13T19:20:00.044385+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:20:00.044289+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:20:00.044289+0000","last_clean_scrub_stamp":"2024-09-13T19:20:00.044289+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:22:19.075182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"36'4","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:13.985513+0000","last_change":"2024-09-13T19:20:13.985513+0000","last_active":"2024-09-13T19:20:13.985513+0000","last_peered":"2024-09-13T19:20:13.985513+0000","last_clean":"2024-09-13T19:20:13.985513+0000","last_became_active":"2024-09-13T19:15:55.895911+0000","last_became_peered":"2024-09-13T19:15:55.895911+0000","last_unstale":"2024-09-13T19:20:13.985513+0000","last_undegraded":"2024-09-13T19:20:13.985513+0000","last_fullsized":"2024-09-13T19:20:13.985513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:20:13.985390+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:20:13.985390+0000","last_clean_scrub_stamp":"2024-09-13T19:20:13.985390+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:37:10.319405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"36'6","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:18.474999+0000","last_change":"2024-09-13T19:20:18.475022+0000","last_active":"2024-09-13T19:20:18.474999+0000","last_peered":"2024-09-13T19:20:18.474999+0000","last_clean":"2024-09-13T19:20:18.474999+0000","last_became_active":"2024-09-13T19:16:31.993403+0000","last_became_peered":"2024-09-13T19:16:31.993403+0000","last_unstale":"2024-09-13T19:20:18.474999+0000","last_undegraded":"2024-09-13T19:20:18.474999+0000","last_fullsized":"2024-09-13T19:20:18.474999+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:20:18.474922+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:20:18.474922+0000","last_clean_scrub_stamp":"2024-09-13T19:20:18.474922+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:56:02.335870+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:54.652681+0000","last_change":"2024-09-13T19:19:54.652681+0000","last_active":"2024-09-13T19:19:54.652681+0000","last_peered":"2024-09-13T19:19:54.652681+0000","last_clean":"2024-09-13T19:19:54.652681+0000","last_became_active":"2024-09-13T19:15:55.894607+0000","last_became_peered":"2024-09-13T19:15:55.894607+0000","last_unstale":"2024-09-13T19:19:54.652681+0000","last_undegraded":"2024-09-13T19:19:54.652681+0000","last_fullsized":"2024-09-13T19:19:54.652681+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:54.652549+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:54.652549+0000","last_clean_scrub_stamp":"2024-09-13T19:19:54.652549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:13:55.710652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"36'2","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:42.516418+0000","last_change":"2024-09-13T19:19:42.516418+0000","last_active":"2024-09-13T19:19:42.516418+0000","last_peered":"2024-09-13T19:19:42.516418+0000","last_clean":"2024-09-13T19:19:42.516418+0000","last_became_active":"2024-09-13T19:15:57.900902+0000","last_became_peered":"2024-09-13T19:15:57.900902+0000","last_unstale":"2024-09-13T19:19:42.516418+0000","last_undegraded":"2024-09-13T19:19:42.516418+0000","last_fullsized":"2024-09-13T19:19:42.516418+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:42.516279+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:42.516279+0000","last_clean_scrub_stamp":"2024-09-13T19:19:42.516279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:17.797802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:51.003653+0000","last_change":"2024-09-13T19:19:51.003653+0000","last_active":"2024-09-13T19:19:51.003653+0000","last_peered":"2024-09-13T19:19:51.003653+0000","last_clean":"2024-09-13T19:19:51.003653+0000","last_became_active":"2024-09-13T19:15:55.905867+0000","last_became_peered":"2024-09-13T19:15:55.905867+0000","last_unstale":"2024-09-13T19:19:51.003653+0000","last_undegraded":"2024-09-13T19:19:51.003653+0000","last_fullsized":"2024-09-13T19:19:51.003653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:51.003475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:51.003475+0000","last_clean_scrub_stamp":"2024-09-13T19:19:51.003475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:43.388075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:45.895163+0000","last_change":"2024-09-13T19:19:45.895163+0000","last_active":"2024-09-13T19:19:45.895163+0000","last_peered":"2024-09-13T19:19:45.895163+0000","last_clean":"2024-09-13T19:19:45.895163+0000","last_became_active":"2024-09-13T19:15:57.889606+0000","last_became_peered":"2024-09-13T19:15:57.889606+0000","last_unstale":"2024-09-13T19:19:45.895163+0000","last_undegraded":"2024-09-13T19:19:45.895163+0000","last_fullsized":"2024-09-13T19:19:45.895163+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:19:45.895012+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:19:45.895012+0000","last_clean_scrub_stamp":"2024-09-13T19:19:45.895012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:09.506224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:01.092995+0000","last_change":"2024-09-13T19:20:01.092995+0000","last_active":"2024-09-13T19:20:01.092995+0000","last_peered":"2024-09-13T19:20:01.092995+0000","last_clean":"2024-09-13T19:20:01.092995+0000","last_became_active":"2024-09-13T19:15:55.896086+0000","last_became_peered":"2024-09-13T19:15:55.896086+0000","last_unstale":"2024-09-13T19:20:01.092995+0000","last_undegraded":"2024-09-13T19:20:01.092995+0000","last_fullsized":"2024-09-13T19:20:01.092995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:20:01.092860+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:20:01.092860+0000","last_clean_scrub_stamp":"2024-09-13T19:20:01.092860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:06.060089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"36'12","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:09.526035+0000","last_change":"2024-09-13T19:20:09.526086+0000","last_active":"2024-09-13T19:20:09.526035+0000","last_peered":"2024-09-13T19:20:09.526035+0000","last_clean":"2024-09-13T19:20:09.526035+0000","last_became_active":"2024-09-13T19:16:31.991965+0000","last_became_peered":"2024-09-13T19:16:31.991965+0000","last_unstale":"2024-09-13T19:20:09.526035+0000","last_undegraded":"2024-09-13T19:20:09.526035+0000","last_fullsized":"2024-09-13T19:20:09.526035+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-13T19:20:09.525926+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-13T19:20:09.525926+0000","last_clean_scrub_stamp":"2024-09-13T19:20:09.525926+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:11:08.529306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:22.027601+0000","last_change":"2024-09-13T19:20:22.027601+0000","last_active":"2024-09-13T19:20:22.027601+0000","last_peered":"2024-09-13T19:20:22.027601+0000","last_clean":"2024-09-13T19:20:22.027601+0000","last_became_active":"2024-09-13T19:15:55.894634+0000","last_became_peered":"2024-09-13T19:15:55.894634+0000","last_unstale":"2024-09-13T19:20:22.027601+0000","last_undegraded":"2024-09-13T19:20:22.027601+0000","last_fullsized":"2024-09-13T19:20:22.027601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:22.027480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:22.027480+0000","last_clean_scrub_stamp":"2024-09-13T19:20:22.027480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:17.531054+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"36'4","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:10.090669+0000","last_change":"2024-09-13T19:20:10.090669+0000","last_active":"2024-09-13T19:20:10.090669+0000","last_peered":"2024-09-13T19:20:10.090669+0000","last_clean":"2024-09-13T19:20:10.090669+0000","last_became_active":"2024-09-13T19:15:57.892558+0000","last_became_peered":"2024-09-13T19:15:57.892558+0000","last_unstale":"2024-09-13T19:20:10.090669+0000","last_undegraded":"2024-09-13T19:20:10.090669+0000","last_fullsized":"2024-09-13T19:20:10.090669+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:20:10.090552+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:20:10.090552+0000","last_clean_scrub_stamp":"2024-09-13T19:20:10.090552+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:34.228351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:20.021283+0000","last_change":"2024-09-13T19:20:20.021283+0000","last_active":"2024-09-13T19:20:20.021283+0000","last_peered":"2024-09-13T19:20:20.021283+0000","last_clean":"2024-09-13T19:20:20.021283+0000","last_became_active":"2024-09-13T19:15:55.894667+0000","last_became_peered":"2024-09-13T19:15:55.894667+0000","last_unstale":"2024-09-13T19:20:20.021283+0000","last_undegraded":"2024-09-13T19:20:20.021283+0000","last_fullsized":"2024-09-13T19:20:20.021283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:20:20.021150+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:20:20.021150+0000","last_clean_scrub_stamp":"2024-09-13T19:20:20.021150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:07.033446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"36'18","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:57.954953+0000","last_change":"2024-09-13T19:19:57.954953+0000","last_active":"2024-09-13T19:19:57.954953+0000","last_peered":"2024-09-13T19:19:57.954953+0000","last_clean":"2024-09-13T19:19:57.954953+0000","last_became_active":"2024-09-13T19:15:57.896200+0000","last_became_peered":"2024-09-13T19:15:57.896200+0000","last_unstale":"2024-09-13T19:19:57.954953+0000","last_undegraded":"2024-09-13T19:19:57.954953+0000","last_fullsized":"2024-09-13T19:19:57.954953+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'18","last_scrub_stamp":"2024-09-13T19:19:57.954831+0000","last_deep_scrub":"36'18","last_deep_scrub_stamp":"2024-09-13T19:19:57.954831+0000","last_clean_scrub_stamp":"2024-09-13T19:19:57.954831+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:03:45.500917+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":50,"num_read_kb":42,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:44.812057+0000","last_change":"2024-09-13T19:19:44.812086+0000","last_active":"2024-09-13T19:19:44.812057+0000","last_peered":"2024-09-13T19:19:44.812057+0000","last_clean":"2024-09-13T19:19:44.812057+0000","last_became_active":"2024-09-13T19:15:55.899104+0000","last_became_peered":"2024-09-13T19:15:55.899104+0000","last_unstale":"2024-09-13T19:19:44.812057+0000","last_undegraded":"2024-09-13T19:19:44.812057+0000","last_fullsized":"2024-09-13T19:19:44.812057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:44.811952+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:44.811952+0000","last_clean_scrub_stamp":"2024-09-13T19:19:44.811952+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:20.375216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"36'12","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:49.979997+0000","last_change":"2024-09-13T19:19:49.979997+0000","last_active":"2024-09-13T19:19:49.979997+0000","last_peered":"2024-09-13T19:19:49.979997+0000","last_clean":"2024-09-13T19:19:49.979997+0000","last_became_active":"2024-09-13T19:15:57.889781+0000","last_became_peered":"2024-09-13T19:15:57.889781+0000","last_unstale":"2024-09-13T19:19:49.979997+0000","last_undegraded":"2024-09-13T19:19:49.979997+0000","last_fullsized":"2024-09-13T19:19:49.979997+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-13T19:19:49.979869+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-13T19:19:49.979869+0000","last_clean_scrub_stamp":"2024-09-13T19:19:49.979869+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:02:58.441045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:10.970047+0000","last_change":"2024-09-13T19:20:10.970073+0000","last_active":"2024-09-13T19:20:10.970047+0000","last_peered":"2024-09-13T19:20:10.970047+0000","last_clean":"2024-09-13T19:20:10.970047+0000","last_became_active":"2024-09-13T19:15:55.898627+0000","last_became_peered":"2024-09-13T19:15:55.898627+0000","last_unstale":"2024-09-13T19:20:10.970047+0000","last_undegraded":"2024-09-13T19:20:10.970047+0000","last_fullsized":"2024-09-13T19:20:10.970047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:10.969953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:10.969953+0000","last_clean_scrub_stamp":"2024-09-13T19:20:10.969953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:30.846775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:17.004523+0000","last_change":"2024-09-13T19:20:17.004553+0000","last_active":"2024-09-13T19:20:17.004523+0000","last_peered":"2024-09-13T19:20:17.004523+0000","last_clean":"2024-09-13T19:20:17.004523+0000","last_became_active":"2024-09-13T19:15:55.899225+0000","last_became_peered":"2024-09-13T19:15:55.899225+0000","last_unstale":"2024-09-13T19:20:17.004523+0000","last_undegraded":"2024-09-13T19:20:17.004523+0000","last_fullsized":"2024-09-13T19:20:17.004523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:17.004434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:17.004434+0000","last_clean_scrub_stamp":"2024-09-13T19:20:17.004434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:10:14.965615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"36'6","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:11.491027+0000","last_change":"2024-09-13T19:20:11.491091+0000","last_active":"2024-09-13T19:20:11.491027+0000","last_peered":"2024-09-13T19:20:11.491027+0000","last_clean":"2024-09-13T19:20:11.491027+0000","last_became_active":"2024-09-13T19:15:57.890325+0000","last_became_peered":"2024-09-13T19:15:57.890325+0000","last_unstale":"2024-09-13T19:20:11.491027+0000","last_undegraded":"2024-09-13T19:20:11.491027+0000","last_fullsized":"2024-09-13T19:20:11.491027+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:20:11.490910+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:20:11.490910+0000","last_clean_scrub_stamp":"2024-09-13T19:20:11.490910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:00:52.840106+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:52.700775+0000","last_change":"2024-09-13T19:19:52.700775+0000","last_active":"2024-09-13T19:19:52.700775+0000","last_peered":"2024-09-13T19:19:52.700775+0000","last_clean":"2024-09-13T19:19:52.700775+0000","last_became_active":"2024-09-13T19:15:55.894485+0000","last_became_peered":"2024-09-13T19:15:55.894485+0000","last_unstale":"2024-09-13T19:19:52.700775+0000","last_undegraded":"2024-09-13T19:19:52.700775+0000","last_fullsized":"2024-09-13T19:19:52.700775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:52.700644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:52.700644+0000","last_clean_scrub_stamp":"2024-09-13T19:19:52.700644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:49.700387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"36'8","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:42.871412+0000","last_change":"2024-09-13T19:19:42.871437+0000","last_active":"2024-09-13T19:19:42.871412+0000","last_peered":"2024-09-13T19:19:42.871412+0000","last_clean":"2024-09-13T19:19:42.871412+0000","last_became_active":"2024-09-13T19:15:57.902123+0000","last_became_peered":"2024-09-13T19:15:57.902123+0000","last_unstale":"2024-09-13T19:19:42.871412+0000","last_undegraded":"2024-09-13T19:19:42.871412+0000","last_fullsized":"2024-09-13T19:19:42.871412+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-13T19:19:42.871311+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-13T19:19:42.871311+0000","last_clean_scrub_stamp":"2024-09-13T19:19:42.871311+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:31.855620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1523,"ondisk_log_size":1523,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1595,"num_read_kb":1485,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":482,"ondisk_log_size":482,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640320,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39996,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331844,"statfs":{"total":96636764160,"available":96595808256,"internally_reserved":0,"allocated":503808,"data_stored":158624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640319,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40512,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331328,"statfs":{"total":96636764160,"available":96595279872,"internally_reserved":0,"allocated":1032192,"data_stored":746866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640319,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40528,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331312,"statfs":{"total":96636764160,"available":96595263488,"internally_reserved":0,"allocated":1048576,"data_stored":746030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705728,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31636,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340204,"statfs":{"total":96636764160,"available":96604368896,"internally_reserved":0,"allocated":462848,"data_stored":156440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T19:20:38.775 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:20:38.775 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-13T19:15:58.873497+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=15, tm_sec=58, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:20:38.776 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:20:38.776 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:20:38.777 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:20:38.777 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:20:38.777 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-13T19:16:04.895305+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=16, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=19, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:20:38.777 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T19:20:58.779 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T19:20:58.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:58.892+0000 7fd0ce35f640 1 Processor -- start 2024-09-13T19:20:58.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:58.893+0000 7fd0ce35f640 1 -- start start 2024-09-13T19:20:58.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:58.893+0000 7fd0ce35f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd0c812e940 0x7fd0c8130d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:20:58.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:58.893+0000 7fd0ce35f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0c806eba0 con 0x7fd0c806eda0 2024-09-13T19:20:58.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:58.893+0000 7fd0ce35f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fd0c806d2f0 con 0x7fd0c812e940 2024-09-13T19:20:58.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:58.893+0000 7fd0c77fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd0c812e940 0x7fd0c8130d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:20:58.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:58.893+0000 7fd0c7fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd0c806eda0 0x7fd0c806f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:38042/0 (socket says 172.21.15.53:38042) 2024-09-13T19:20:58.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:58.893+0000 7fd0c7fff640 1 -- 172.21.15.53:0/1475785355 learned_addr learned my addr 172.21.15.53:0/1475785355 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T19:20:58.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:58.893+0000 7fd0c77fe640 1 -- 172.21.15.53:0/1475785355 >> v1:172.21.15.53:6789/0 conn(0x7fd0c806eda0 legacy=0x7fd0c806f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:20:58.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:58.893+0000 7fd0c77fe640 1 -- 172.21.15.53:0/1475785355 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0c8070d50 con 0x7fd0c812e940 2024-09-13T19:20:58.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:58.894+0000 7fd0c77fe640 1 --2- 172.21.15.53:0/1475785355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0c812e940 0x7fd0c8130d30 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc009720 tx=0x7fd0bc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=756b8003f396cdd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:20:58.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:58.894+0000 7fd0c6ffd640 1 -- 172.21.15.53:0/1475785355 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0bc037070 con 0x7fd0c812e940 2024-09-13T19:20:58.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:58.894+0000 7fd0c6ffd640 1 -- 172.21.15.53:0/1475785355 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0bc02ae20 con 0x7fd0c812e940 2024-09-13T19:20:58.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:58.894+0000 7fd0c6ffd640 1 -- 172.21.15.53:0/1475785355 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0bc032590 con 0x7fd0c812e940 2024-09-13T19:20:58.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:58.895+0000 7fd0ce35f640 1 -- 172.21.15.53:0/1475785355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0c812e940 msgr2=0x7fd0c8130d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:20:58.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:58.895+0000 7fd0ce35f640 1 --2- 172.21.15.53:0/1475785355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0c812e940 0x7fd0c8130d30 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc009720 tx=0x7fd0bc02a1a0 comp rx=0 tx=0).stop 2024-09-13T19:20:58.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:58.895+0000 7fd0ce35f640 1 -- 172.21.15.53:0/1475785355 shutdown_connections 2024-09-13T19:20:58.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:58.895+0000 7fd0ce35f640 1 --2- 172.21.15.53:0/1475785355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0c812e940 0x7fd0c8130d30 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:20:58.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:58.895+0000 7fd0ce35f640 1 -- 172.21.15.53:0/1475785355 >> 172.21.15.53:0/1475785355 conn(0x7fd0c809a890 msgr2=0x7fd0c809aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:20:58.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:58.895+0000 7fd0ce35f640 1 -- 172.21.15.53:0/1475785355 shutdown_connections 2024-09-13T19:20:58.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:58.895+0000 7fd0ce35f640 1 -- 172.21.15.53:0/1475785355 wait complete. 2024-09-13T19:20:58.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:58.896+0000 7fd0ce35f640 1 Processor -- start 2024-09-13T19:20:58.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:58.896+0000 7fd0ce35f640 1 -- start start 2024-09-13T19:20:58.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:58.897+0000 7fd0ce35f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0c806eda0 0x7fd0c8125d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:20:58.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:58.897+0000 7fd0ce35f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c806fcd0 con 0x7fd0c806eda0 2024-09-13T19:20:58.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:58.897+0000 7fd0c7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0c806eda0 0x7fd0c8125d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:20:58.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:58.897+0000 7fd0c7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0c806eda0 0x7fd0c8125d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53962/0 (socket says 172.21.15.53:53962) 2024-09-13T19:20:58.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:58.897+0000 7fd0c7fff640 1 -- 172.21.15.53:0/738364898 learned_addr learned my addr 172.21.15.53:0/738364898 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:20:58.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:58.897+0000 7fd0c7fff640 1 -- 172.21.15.53:0/738364898 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0c8127420 con 0x7fd0c806eda0 2024-09-13T19:20:58.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:58.897+0000 7fd0c7fff640 1 --2- 172.21.15.53:0/738364898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0c806eda0 0x7fd0c8125d80 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fd0b800c4a0 tx=0x7fd0b800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:20:58.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:58.897+0000 7fd0c4ff9640 1 -- 172.21.15.53:0/738364898 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0b8017070 con 0x7fd0c806eda0 2024-09-13T19:20:58.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:58.897+0000 7fd0c4ff9640 1 -- 172.21.15.53:0/738364898 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0b8005c10 con 0x7fd0c806eda0 2024-09-13T19:20:58.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:58.897+0000 7fd0ce35f640 1 -- 172.21.15.53:0/738364898 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0c81252a0 con 0x7fd0c806eda0 2024-09-13T19:20:58.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:58.897+0000 7fd0c4ff9640 1 -- 172.21.15.53:0/738364898 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0b8007070 con 0x7fd0c806eda0 2024-09-13T19:20:58.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:58.897+0000 7fd0ce35f640 1 -- 172.21.15.53:0/738364898 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0c8127bf0 con 0x7fd0c806eda0 2024-09-13T19:20:58.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:58.898+0000 7fd0c4ff9640 1 -- 172.21.15.53:0/738364898 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd0b801a070 con 0x7fd0c806eda0 2024-09-13T19:20:58.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:58.898+0000 7fd0c4ff9640 1 --2- 172.21.15.53:0/738364898 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd0b40382a0 0x7fd0b403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:20:58.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:58.898+0000 7fd0ce35f640 1 -- 172.21.15.53:0/738364898 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0c806d890 con 0x7fd0c806eda0 2024-09-13T19:20:58.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:58.898+0000 7fd0c4ff9640 1 -- 172.21.15.53:0/738364898 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7fd0b804b000 con 0x7fd0c806eda0 2024-09-13T19:20:58.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:58.899+0000 7fd0c77fe640 1 --2- 172.21.15.53:0/738364898 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd0b40382a0 0x7fd0b403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:20:58.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:58.899+0000 7fd0c77fe640 1 --2- 172.21.15.53:0/738364898 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd0b40382a0 0x7fd0b403a760 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc034000 tx=0x7fd0bc02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:20:58.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:58.903+0000 7fd0c4ff9640 1 -- 172.21.15.53:0/738364898 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd0b801b3b0 con 0x7fd0c806eda0 2024-09-13T19:20:59.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.077+0000 7fd0ce35f640 1 -- 172.21.15.53:0/738364898 --> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd0c806f180 con 0x7fd0b40382a0 2024-09-13T19:20:59.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.092+0000 7fd0c4ff9640 1 -- 172.21.15.53:0/738364898 <== mgr.4098 v2:172.21.15.102:6824/4283826432 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666215 (secure 0 0 0) 0x7fd0c806f180 con 0x7fd0b40382a0 2024-09-13T19:20:59.105 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T19:20:59.111 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T19:20:59.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.097+0000 7fd0ce35f640 1 -- 172.21.15.53:0/738364898 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd0b40382a0 msgr2=0x7fd0b403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:20:59.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.097+0000 7fd0ce35f640 1 --2- 172.21.15.53:0/738364898 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd0b40382a0 0x7fd0b403a760 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc034000 tx=0x7fd0bc02e000 comp rx=0 tx=0).stop 2024-09-13T19:20:59.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.097+0000 7fd0ce35f640 1 -- 172.21.15.53:0/738364898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0c806eda0 msgr2=0x7fd0c8125d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:20:59.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.097+0000 7fd0ce35f640 1 --2- 172.21.15.53:0/738364898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0c806eda0 0x7fd0c8125d80 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fd0b800c4a0 tx=0x7fd0b800c960 comp rx=0 tx=0).stop 2024-09-13T19:20:59.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.097+0000 7fd0ce35f640 1 -- 172.21.15.53:0/738364898 shutdown_connections 2024-09-13T19:20:59.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.097+0000 7fd0ce35f640 1 --2- 172.21.15.53:0/738364898 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7fd0b40382a0 0x7fd0b403a760 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:20:59.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.097+0000 7fd0ce35f640 1 --2- 172.21.15.53:0/738364898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0c806eda0 0x7fd0c8125d80 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:20:59.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.097+0000 7fd0ce35f640 1 -- 172.21.15.53:0/738364898 >> 172.21.15.53:0/738364898 conn(0x7fd0c809a890 msgr2=0x7fd0c80714f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:20:59.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.097+0000 7fd0ce35f640 1 -- 172.21.15.53:0/738364898 shutdown_connections 2024-09-13T19:20:59.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.097+0000 7fd0ce35f640 1 -- 172.21.15.53:0/738364898 wait complete. 2024-09-13T19:20:59.116 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":194,"stamp":"2024-09-13T19:20:59.004303+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5083,"num_read_kb":4664,"num_write":2179,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4788,"ondisk_log_size":4788,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152672,"kb_used_data":2976,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334688,"statfs":{"total":386547056640,"available":386390720512,"internally_reserved":0,"allocated":3047424,"data_stored":1807960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":153216791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004277"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:50.738469+0000","last_change":"2024-09-13T19:19:50.738469+0000","last_active":"2024-09-13T19:19:50.738469+0000","last_peered":"2024-09-13T19:19:50.738469+0000","last_clean":"2024-09-13T19:19:50.738469+0000","last_became_active":"2024-09-13T19:15:55.897392+0000","last_became_peered":"2024-09-13T19:15:55.897392+0000","last_unstale":"2024-09-13T19:19:50.738469+0000","last_undegraded":"2024-09-13T19:19:50.738469+0000","last_fullsized":"2024-09-13T19:19:50.738469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:50.738354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:50.738354+0000","last_clean_scrub_stamp":"2024-09-13T19:19:50.738354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:08.713727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"36'8","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:46.925684+0000","last_change":"2024-09-13T19:19:46.925684+0000","last_active":"2024-09-13T19:19:46.925684+0000","last_peered":"2024-09-13T19:19:46.925684+0000","last_clean":"2024-09-13T19:19:46.925684+0000","last_became_active":"2024-09-13T19:15:57.888352+0000","last_became_peered":"2024-09-13T19:15:57.888352+0000","last_unstale":"2024-09-13T19:19:46.925684+0000","last_undegraded":"2024-09-13T19:19:46.925684+0000","last_fullsized":"2024-09-13T19:19:46.925684+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-13T19:19:46.925571+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-13T19:19:46.925571+0000","last_clean_scrub_stamp":"2024-09-13T19:19:46.925571+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:13.870292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"34'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:50.673945+0000","last_change":"2024-09-13T19:19:50.673945+0000","last_active":"2024-09-13T19:19:50.673945+0000","last_peered":"2024-09-13T19:19:50.673945+0000","last_clean":"2024-09-13T19:19:50.673945+0000","last_became_active":"2024-09-13T19:15:55.894768+0000","last_became_peered":"2024-09-13T19:15:55.894768+0000","last_unstale":"2024-09-13T19:19:50.673945+0000","last_undegraded":"2024-09-13T19:19:50.673945+0000","last_fullsized":"2024-09-13T19:19:50.673945+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:19:50.673808+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:19:50.673808+0000","last_clean_scrub_stamp":"2024-09-13T19:19:50.673808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:40.076259+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"36'8","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:59.943321+0000","last_change":"2024-09-13T19:19:59.943321+0000","last_active":"2024-09-13T19:19:59.943321+0000","last_peered":"2024-09-13T19:19:59.943321+0000","last_clean":"2024-09-13T19:19:59.943321+0000","last_became_active":"2024-09-13T19:15:57.895424+0000","last_became_peered":"2024-09-13T19:15:57.895424+0000","last_unstale":"2024-09-13T19:19:59.943321+0000","last_undegraded":"2024-09-13T19:19:59.943321+0000","last_fullsized":"2024-09-13T19:19:59.943321+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-13T19:19:59.943201+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-13T19:19:59.943201+0000","last_clean_scrub_stamp":"2024-09-13T19:19:59.943201+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:27:16.681252+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:23.013829+0000","last_change":"2024-09-13T19:20:23.013869+0000","last_active":"2024-09-13T19:20:23.013829+0000","last_peered":"2024-09-13T19:20:23.013829+0000","last_clean":"2024-09-13T19:20:23.013829+0000","last_became_active":"2024-09-13T19:15:55.899965+0000","last_became_peered":"2024-09-13T19:15:55.899965+0000","last_unstale":"2024-09-13T19:20:23.013829+0000","last_undegraded":"2024-09-13T19:20:23.013829+0000","last_fullsized":"2024-09-13T19:20:23.013829+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:23.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:23.013721+0000","last_clean_scrub_stamp":"2024-09-13T19:20:23.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:56.351961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"36'14","reported_seq":81,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:00.926015+0000","last_change":"2024-09-13T19:20:00.926015+0000","last_active":"2024-09-13T19:20:00.926015+0000","last_peered":"2024-09-13T19:20:00.926015+0000","last_clean":"2024-09-13T19:20:00.926015+0000","last_became_active":"2024-09-13T19:15:57.894955+0000","last_became_peered":"2024-09-13T19:15:57.894955+0000","last_unstale":"2024-09-13T19:20:00.926015+0000","last_undegraded":"2024-09-13T19:20:00.926015+0000","last_fullsized":"2024-09-13T19:20:00.926015+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'14","last_scrub_stamp":"2024-09-13T19:20:00.925871+0000","last_deep_scrub":"36'14","last_deep_scrub_stamp":"2024-09-13T19:20:00.925871+0000","last_clean_scrub_stamp":"2024-09-13T19:20:00.925871+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:33.369865+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:00.514729+0000","last_change":"2024-09-13T19:20:00.514752+0000","last_active":"2024-09-13T19:20:00.514729+0000","last_peered":"2024-09-13T19:20:00.514729+0000","last_clean":"2024-09-13T19:20:00.514729+0000","last_became_active":"2024-09-13T19:15:55.889830+0000","last_became_peered":"2024-09-13T19:15:55.889830+0000","last_unstale":"2024-09-13T19:20:00.514729+0000","last_undegraded":"2024-09-13T19:20:00.514729+0000","last_fullsized":"2024-09-13T19:20:00.514729+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:00.514637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:00.514637+0000","last_clean_scrub_stamp":"2024-09-13T19:20:00.514637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:37.261883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"36'4","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:01.969069+0000","last_change":"2024-09-13T19:20:01.969069+0000","last_active":"2024-09-13T19:20:01.969069+0000","last_peered":"2024-09-13T19:20:01.969069+0000","last_clean":"2024-09-13T19:20:01.969069+0000","last_became_active":"2024-09-13T19:15:57.894733+0000","last_became_peered":"2024-09-13T19:15:57.894733+0000","last_unstale":"2024-09-13T19:20:01.969069+0000","last_undegraded":"2024-09-13T19:20:01.969069+0000","last_fullsized":"2024-09-13T19:20:01.969069+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:20:01.968947+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:20:01.968947+0000","last_clean_scrub_stamp":"2024-09-13T19:20:01.968947+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:59.545881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"36'4","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:11.960650+0000","last_change":"2024-09-13T19:20:11.960650+0000","last_active":"2024-09-13T19:20:11.960650+0000","last_peered":"2024-09-13T19:20:11.960650+0000","last_clean":"2024-09-13T19:20:11.960650+0000","last_became_active":"2024-09-13T19:15:55.895362+0000","last_became_peered":"2024-09-13T19:15:55.895362+0000","last_unstale":"2024-09-13T19:20:11.960650+0000","last_undegraded":"2024-09-13T19:20:11.960650+0000","last_fullsized":"2024-09-13T19:20:11.960650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:20:11.960527+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:20:11.960527+0000","last_clean_scrub_stamp":"2024-09-13T19:20:11.960527+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:58.156294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"36'8","reported_seq":69,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:47.935056+0000","last_change":"2024-09-13T19:19:47.935056+0000","last_active":"2024-09-13T19:19:47.935056+0000","last_peered":"2024-09-13T19:19:47.935056+0000","last_clean":"2024-09-13T19:19:47.935056+0000","last_became_active":"2024-09-13T19:15:57.889664+0000","last_became_peered":"2024-09-13T19:15:57.889664+0000","last_unstale":"2024-09-13T19:19:47.935056+0000","last_undegraded":"2024-09-13T19:19:47.935056+0000","last_fullsized":"2024-09-13T19:19:47.935056+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-13T19:19:47.934931+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-13T19:19:47.934931+0000","last_clean_scrub_stamp":"2024-09-13T19:19:47.934931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:58.003188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"36'4","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:59.557143+0000","last_change":"2024-09-13T19:19:59.557143+0000","last_active":"2024-09-13T19:19:59.557143+0000","last_peered":"2024-09-13T19:19:59.557143+0000","last_clean":"2024-09-13T19:19:59.557143+0000","last_became_active":"2024-09-13T19:15:55.889485+0000","last_became_peered":"2024-09-13T19:15:55.889485+0000","last_unstale":"2024-09-13T19:19:59.557143+0000","last_undegraded":"2024-09-13T19:19:59.557143+0000","last_fullsized":"2024-09-13T19:19:59.557143+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:19:59.556986+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:19:59.556986+0000","last_clean_scrub_stamp":"2024-09-13T19:19:59.556986+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:35.761259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"36'2","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:34.063067+0000","last_change":"2024-09-13T19:19:34.063067+0000","last_active":"2024-09-13T19:19:34.063067+0000","last_peered":"2024-09-13T19:19:34.063067+0000","last_clean":"2024-09-13T19:19:34.063067+0000","last_became_active":"2024-09-13T19:15:57.900785+0000","last_became_peered":"2024-09-13T19:15:57.900785+0000","last_unstale":"2024-09-13T19:19:34.063067+0000","last_undegraded":"2024-09-13T19:19:34.063067+0000","last_fullsized":"2024-09-13T19:19:34.063067+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:34.062937+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:34.062937+0000","last_clean_scrub_stamp":"2024-09-13T19:19:34.062937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:11:39.030166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:08.989911+0000","last_change":"2024-09-13T19:20:08.989911+0000","last_active":"2024-09-13T19:20:08.989911+0000","last_peered":"2024-09-13T19:20:08.989911+0000","last_clean":"2024-09-13T19:20:08.989911+0000","last_became_active":"2024-09-13T19:15:55.897381+0000","last_became_peered":"2024-09-13T19:15:55.897381+0000","last_unstale":"2024-09-13T19:20:08.989911+0000","last_undegraded":"2024-09-13T19:20:08.989911+0000","last_fullsized":"2024-09-13T19:20:08.989911+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:20:08.989795+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:20:08.989795+0000","last_clean_scrub_stamp":"2024-09-13T19:20:08.989795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:20.035191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"36'16","reported_seq":100,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:47.809912+0000","last_change":"2024-09-13T19:19:47.809912+0000","last_active":"2024-09-13T19:19:47.809912+0000","last_peered":"2024-09-13T19:19:47.809912+0000","last_clean":"2024-09-13T19:19:47.809912+0000","last_became_active":"2024-09-13T19:15:57.893408+0000","last_became_peered":"2024-09-13T19:15:57.893408+0000","last_unstale":"2024-09-13T19:19:47.809912+0000","last_undegraded":"2024-09-13T19:19:47.809912+0000","last_fullsized":"2024-09-13T19:19:47.809912+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-13T19:19:47.809763+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-13T19:19:47.809763+0000","last_clean_scrub_stamp":"2024-09-13T19:19:47.809763+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:37:38.871573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:48.658601+0000","last_change":"2024-09-13T19:19:48.658601+0000","last_active":"2024-09-13T19:19:48.658601+0000","last_peered":"2024-09-13T19:19:48.658601+0000","last_clean":"2024-09-13T19:19:48.658601+0000","last_became_active":"2024-09-13T19:15:55.901190+0000","last_became_peered":"2024-09-13T19:15:55.901190+0000","last_unstale":"2024-09-13T19:19:48.658601+0000","last_undegraded":"2024-09-13T19:19:48.658601+0000","last_fullsized":"2024-09-13T19:19:48.658601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:48.658486+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:48.658486+0000","last_clean_scrub_stamp":"2024-09-13T19:19:48.658486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:15:38.548787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"36'16","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:55.632013+0000","last_change":"2024-09-13T19:19:55.632013+0000","last_active":"2024-09-13T19:19:55.632013+0000","last_peered":"2024-09-13T19:19:55.632013+0000","last_clean":"2024-09-13T19:19:55.632013+0000","last_became_active":"2024-09-13T19:15:57.898325+0000","last_became_peered":"2024-09-13T19:15:57.898325+0000","last_unstale":"2024-09-13T19:19:55.632013+0000","last_undegraded":"2024-09-13T19:19:55.632013+0000","last_fullsized":"2024-09-13T19:19:55.632013+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-13T19:19:55.631818+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-13T19:19:55.631818+0000","last_clean_scrub_stamp":"2024-09-13T19:19:55.631818+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:59.940789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":52,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"36'4","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:03.927407+0000","last_change":"2024-09-13T19:20:03.927407+0000","last_active":"2024-09-13T19:20:03.927407+0000","last_peered":"2024-09-13T19:20:03.927407+0000","last_clean":"2024-09-13T19:20:03.927407+0000","last_became_active":"2024-09-13T19:15:57.887144+0000","last_became_peered":"2024-09-13T19:15:57.887144+0000","last_unstale":"2024-09-13T19:20:03.927407+0000","last_undegraded":"2024-09-13T19:20:03.927407+0000","last_fullsized":"2024-09-13T19:20:03.927407+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:20:03.927294+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:20:03.927294+0000","last_clean_scrub_stamp":"2024-09-13T19:20:03.927294+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:18:50.671482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:55.084112+0000","last_change":"2024-09-13T19:19:55.084112+0000","last_active":"2024-09-13T19:19:55.084112+0000","last_peered":"2024-09-13T19:19:55.084112+0000","last_clean":"2024-09-13T19:19:55.084112+0000","last_became_active":"2024-09-13T19:15:55.895552+0000","last_became_peered":"2024-09-13T19:15:55.895552+0000","last_unstale":"2024-09-13T19:19:55.084112+0000","last_undegraded":"2024-09-13T19:19:55.084112+0000","last_fullsized":"2024-09-13T19:19:55.084112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:55.083997+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:55.083997+0000","last_clean_scrub_stamp":"2024-09-13T19:19:55.083997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:16.783662+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"36'8","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:48.955061+0000","last_change":"2024-09-13T19:19:48.955111+0000","last_active":"2024-09-13T19:19:48.955061+0000","last_peered":"2024-09-13T19:19:48.955061+0000","last_clean":"2024-09-13T19:19:48.955061+0000","last_became_active":"2024-09-13T19:15:57.886511+0000","last_became_peered":"2024-09-13T19:15:57.886511+0000","last_unstale":"2024-09-13T19:19:48.955061+0000","last_undegraded":"2024-09-13T19:19:48.955061+0000","last_fullsized":"2024-09-13T19:19:48.955061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-13T19:19:48.954919+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-13T19:19:48.954919+0000","last_clean_scrub_stamp":"2024-09-13T19:19:48.954919+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:06.835960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:48.818317+0000","last_change":"2024-09-13T19:19:48.818317+0000","last_active":"2024-09-13T19:19:48.818317+0000","last_peered":"2024-09-13T19:19:48.818317+0000","last_clean":"2024-09-13T19:19:48.818317+0000","last_became_active":"2024-09-13T19:15:55.896952+0000","last_became_peered":"2024-09-13T19:15:55.896952+0000","last_unstale":"2024-09-13T19:19:48.818317+0000","last_undegraded":"2024-09-13T19:19:48.818317+0000","last_fullsized":"2024-09-13T19:19:48.818317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:48.818164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:48.818164+0000","last_clean_scrub_stamp":"2024-09-13T19:19:48.818164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:02.241073+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"36'8","reported_seq":68,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:58.078987+0000","last_change":"2024-09-13T19:19:58.078987+0000","last_active":"2024-09-13T19:19:58.078987+0000","last_peered":"2024-09-13T19:19:58.078987+0000","last_clean":"2024-09-13T19:19:58.078987+0000","last_became_active":"2024-09-13T19:15:57.891411+0000","last_became_peered":"2024-09-13T19:15:57.891411+0000","last_unstale":"2024-09-13T19:19:58.078987+0000","last_undegraded":"2024-09-13T19:19:58.078987+0000","last_fullsized":"2024-09-13T19:19:58.078987+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-13T19:19:58.078853+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-13T19:19:58.078853+0000","last_clean_scrub_stamp":"2024-09-13T19:19:58.078853+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:14.717815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:57.048117+0000","last_change":"2024-09-13T19:19:57.048117+0000","last_active":"2024-09-13T19:19:57.048117+0000","last_peered":"2024-09-13T19:19:57.048117+0000","last_clean":"2024-09-13T19:19:57.048117+0000","last_became_active":"2024-09-13T19:15:55.895453+0000","last_became_peered":"2024-09-13T19:15:55.895453+0000","last_unstale":"2024-09-13T19:19:57.048117+0000","last_undegraded":"2024-09-13T19:19:57.048117+0000","last_fullsized":"2024-09-13T19:19:57.048117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:57.047952+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:57.047952+0000","last_clean_scrub_stamp":"2024-09-13T19:19:57.047952+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:44.511756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"36'8","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:46.621446+0000","last_change":"2024-09-13T19:19:46.621446+0000","last_active":"2024-09-13T19:19:46.621446+0000","last_peered":"2024-09-13T19:19:46.621446+0000","last_clean":"2024-09-13T19:19:46.621446+0000","last_became_active":"2024-09-13T19:15:57.896208+0000","last_became_peered":"2024-09-13T19:15:57.896208+0000","last_unstale":"2024-09-13T19:19:46.621446+0000","last_undegraded":"2024-09-13T19:19:46.621446+0000","last_fullsized":"2024-09-13T19:19:46.621446+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-13T19:19:46.621332+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-13T19:19:46.621332+0000","last_clean_scrub_stamp":"2024-09-13T19:19:46.621332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:00.483604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:05.080533+0000","last_change":"2024-09-13T19:20:05.080533+0000","last_active":"2024-09-13T19:20:05.080533+0000","last_peered":"2024-09-13T19:20:05.080533+0000","last_clean":"2024-09-13T19:20:05.080533+0000","last_became_active":"2024-09-13T19:15:55.892616+0000","last_became_peered":"2024-09-13T19:15:55.892616+0000","last_unstale":"2024-09-13T19:20:05.080533+0000","last_undegraded":"2024-09-13T19:20:05.080533+0000","last_fullsized":"2024-09-13T19:20:05.080533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:20:05.080420+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:20:05.080420+0000","last_clean_scrub_stamp":"2024-09-13T19:20:05.080420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:29.203072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"36'2","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:49.771997+0000","last_change":"2024-09-13T19:19:49.771997+0000","last_active":"2024-09-13T19:19:49.771997+0000","last_peered":"2024-09-13T19:19:49.771997+0000","last_clean":"2024-09-13T19:19:49.771997+0000","last_became_active":"2024-09-13T19:15:57.897566+0000","last_became_peered":"2024-09-13T19:15:57.897566+0000","last_unstale":"2024-09-13T19:19:49.771997+0000","last_undegraded":"2024-09-13T19:19:49.771997+0000","last_fullsized":"2024-09-13T19:19:49.771997+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:49.771831+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:49.771831+0000","last_clean_scrub_stamp":"2024-09-13T19:19:49.771831+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:38.756140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:00.631090+0000","last_change":"2024-09-13T19:20:00.631090+0000","last_active":"2024-09-13T19:20:00.631090+0000","last_peered":"2024-09-13T19:20:00.631090+0000","last_clean":"2024-09-13T19:20:00.631090+0000","last_became_active":"2024-09-13T19:15:55.893594+0000","last_became_peered":"2024-09-13T19:15:55.893594+0000","last_unstale":"2024-09-13T19:20:00.631090+0000","last_undegraded":"2024-09-13T19:20:00.631090+0000","last_fullsized":"2024-09-13T19:20:00.631090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:00.630941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:00.630941+0000","last_clean_scrub_stamp":"2024-09-13T19:20:00.630941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:06:00.888554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"36'6","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:52.023770+0000","last_change":"2024-09-13T19:19:52.023770+0000","last_active":"2024-09-13T19:19:52.023770+0000","last_peered":"2024-09-13T19:19:52.023770+0000","last_clean":"2024-09-13T19:19:52.023770+0000","last_became_active":"2024-09-13T19:15:57.889901+0000","last_became_peered":"2024-09-13T19:15:57.889901+0000","last_unstale":"2024-09-13T19:19:52.023770+0000","last_undegraded":"2024-09-13T19:19:52.023770+0000","last_fullsized":"2024-09-13T19:19:52.023770+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:19:52.023617+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:19:52.023617+0000","last_clean_scrub_stamp":"2024-09-13T19:19:52.023617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:55.796931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:12.967360+0000","last_change":"2024-09-13T19:20:12.967360+0000","last_active":"2024-09-13T19:20:12.967360+0000","last_peered":"2024-09-13T19:20:12.967360+0000","last_clean":"2024-09-13T19:20:12.967360+0000","last_became_active":"2024-09-13T19:15:55.898679+0000","last_became_peered":"2024-09-13T19:15:55.898679+0000","last_unstale":"2024-09-13T19:20:12.967360+0000","last_undegraded":"2024-09-13T19:20:12.967360+0000","last_fullsized":"2024-09-13T19:20:12.967360+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:12.967205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:12.967205+0000","last_clean_scrub_stamp":"2024-09-13T19:20:12.967205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:14:48.427858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"36'36","reported_seq":110,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:14.953060+0000","last_change":"2024-09-13T19:20:14.953060+0000","last_active":"2024-09-13T19:20:14.953060+0000","last_peered":"2024-09-13T19:20:14.953060+0000","last_clean":"2024-09-13T19:20:14.953060+0000","last_became_active":"2024-09-13T19:16:05.921156+0000","last_became_peered":"2024-09-13T19:16:05.921156+0000","last_unstale":"2024-09-13T19:20:14.953060+0000","last_undegraded":"2024-09-13T19:20:14.953060+0000","last_fullsized":"2024-09-13T19:20:14.953060+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-13T19:20:14.952944+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-13T19:20:14.952944+0000","last_clean_scrub_stamp":"2024-09-13T19:20:14.952944+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:33:18.777351+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"36'6","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:49.875536+0000","last_change":"2024-09-13T19:19:49.875536+0000","last_active":"2024-09-13T19:19:49.875536+0000","last_peered":"2024-09-13T19:19:49.875536+0000","last_clean":"2024-09-13T19:19:49.875536+0000","last_became_active":"2024-09-13T19:15:57.895870+0000","last_became_peered":"2024-09-13T19:15:57.895870+0000","last_unstale":"2024-09-13T19:19:49.875536+0000","last_undegraded":"2024-09-13T19:19:49.875536+0000","last_fullsized":"2024-09-13T19:19:49.875536+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:19:49.875424+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:19:49.875424+0000","last_clean_scrub_stamp":"2024-09-13T19:19:49.875424+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:44.778091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:18.021834+0000","last_change":"2024-09-13T19:20:18.021834+0000","last_active":"2024-09-13T19:20:18.021834+0000","last_peered":"2024-09-13T19:20:18.021834+0000","last_clean":"2024-09-13T19:20:18.021834+0000","last_became_active":"2024-09-13T19:15:55.894099+0000","last_became_peered":"2024-09-13T19:15:55.894099+0000","last_unstale":"2024-09-13T19:20:18.021834+0000","last_undegraded":"2024-09-13T19:20:18.021834+0000","last_fullsized":"2024-09-13T19:20:18.021834+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:18.021712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:18.021712+0000","last_clean_scrub_stamp":"2024-09-13T19:20:18.021712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:58:34.223917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:20.089107+0000","last_change":"2024-09-13T19:19:20.089107+0000","last_active":"2024-09-13T19:19:20.089107+0000","last_peered":"2024-09-13T19:19:20.089107+0000","last_clean":"2024-09-13T19:19:20.089107+0000","last_became_active":"2024-09-13T19:15:59.896648+0000","last_became_peered":"2024-09-13T19:15:59.896648+0000","last_unstale":"2024-09-13T19:19:20.089107+0000","last_undegraded":"2024-09-13T19:19:20.089107+0000","last_fullsized":"2024-09-13T19:19:20.089107+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:20.088934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:20.088934+0000","last_clean_scrub_stamp":"2024-09-13T19:19:20.088934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:25.257454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"36'36","reported_seq":92,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:41.951384+0000","last_change":"2024-09-13T19:19:41.951384+0000","last_active":"2024-09-13T19:19:41.951384+0000","last_peered":"2024-09-13T19:19:41.951384+0000","last_clean":"2024-09-13T19:19:41.951384+0000","last_became_active":"2024-09-13T19:16:01.906675+0000","last_became_peered":"2024-09-13T19:16:01.906675+0000","last_unstale":"2024-09-13T19:19:41.951384+0000","last_undegraded":"2024-09-13T19:19:41.951384+0000","last_fullsized":"2024-09-13T19:19:41.951384+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-13T19:19:41.951264+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-13T19:19:41.951264+0000","last_clean_scrub_stamp":"2024-09-13T19:19:41.951264+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:19.199178+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:35.864355+0000","last_change":"2024-09-13T19:19:35.864355+0000","last_active":"2024-09-13T19:19:35.864355+0000","last_peered":"2024-09-13T19:19:35.864355+0000","last_clean":"2024-09-13T19:19:35.864355+0000","last_became_active":"2024-09-13T19:16:03.914111+0000","last_became_peered":"2024-09-13T19:16:03.914111+0000","last_unstale":"2024-09-13T19:19:35.864355+0000","last_undegraded":"2024-09-13T19:19:35.864355+0000","last_fullsized":"2024-09-13T19:19:35.864355+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:35.864237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:35.864237+0000","last_clean_scrub_stamp":"2024-09-13T19:19:35.864237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:31:06.989608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"36'7","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:16.925360+0000","last_change":"2024-09-13T19:20:16.925360+0000","last_active":"2024-09-13T19:20:16.925360+0000","last_peered":"2024-09-13T19:20:16.925360+0000","last_clean":"2024-09-13T19:20:16.925360+0000","last_became_active":"2024-09-13T19:16:05.924829+0000","last_became_peered":"2024-09-13T19:16:05.924829+0000","last_unstale":"2024-09-13T19:20:16.925360+0000","last_undegraded":"2024-09-13T19:20:16.925360+0000","last_fullsized":"2024-09-13T19:20:16.925360+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'7","last_scrub_stamp":"2024-09-13T19:20:16.925225+0000","last_deep_scrub":"36'7","last_deep_scrub_stamp":"2024-09-13T19:20:16.925225+0000","last_clean_scrub_stamp":"2024-09-13T19:20:16.925225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:11.827893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"36'10","reported_seq":71,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:48.913853+0000","last_change":"2024-09-13T19:19:48.913853+0000","last_active":"2024-09-13T19:19:48.913853+0000","last_peered":"2024-09-13T19:19:48.913853+0000","last_clean":"2024-09-13T19:19:48.913853+0000","last_became_active":"2024-09-13T19:15:57.897928+0000","last_became_peered":"2024-09-13T19:15:57.897928+0000","last_unstale":"2024-09-13T19:19:48.913853+0000","last_undegraded":"2024-09-13T19:19:48.913853+0000","last_fullsized":"2024-09-13T19:19:48.913853+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-13T19:19:48.913742+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-13T19:19:48.913742+0000","last_clean_scrub_stamp":"2024-09-13T19:19:48.913742+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:09:14.046682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:03.557828+0000","last_change":"2024-09-13T19:20:03.557828+0000","last_active":"2024-09-13T19:20:03.557828+0000","last_peered":"2024-09-13T19:20:03.557828+0000","last_clean":"2024-09-13T19:20:03.557828+0000","last_became_active":"2024-09-13T19:15:55.891934+0000","last_became_peered":"2024-09-13T19:15:55.891934+0000","last_unstale":"2024-09-13T19:20:03.557828+0000","last_undegraded":"2024-09-13T19:20:03.557828+0000","last_fullsized":"2024-09-13T19:20:03.557828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:03.557697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:03.557697+0000","last_clean_scrub_stamp":"2024-09-13T19:20:03.557697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:16.166958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:39.498853+0000","last_change":"2024-09-13T19:19:39.498853+0000","last_active":"2024-09-13T19:19:39.498853+0000","last_peered":"2024-09-13T19:19:39.498853+0000","last_clean":"2024-09-13T19:19:39.498853+0000","last_became_active":"2024-09-13T19:15:59.892230+0000","last_became_peered":"2024-09-13T19:15:59.892230+0000","last_unstale":"2024-09-13T19:19:39.498853+0000","last_undegraded":"2024-09-13T19:19:39.498853+0000","last_fullsized":"2024-09-13T19:19:39.498853+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:39.498723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:39.498723+0000","last_clean_scrub_stamp":"2024-09-13T19:19:39.498723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:50.652003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"36'11","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:20.693258+0000","last_change":"2024-09-13T19:19:20.693258+0000","last_active":"2024-09-13T19:19:20.693258+0000","last_peered":"2024-09-13T19:19:20.693258+0000","last_clean":"2024-09-13T19:19:20.693258+0000","last_became_active":"2024-09-13T19:16:01.903371+0000","last_became_peered":"2024-09-13T19:16:01.903371+0000","last_unstale":"2024-09-13T19:19:20.693258+0000","last_undegraded":"2024-09-13T19:19:20.693258+0000","last_fullsized":"2024-09-13T19:19:20.693258+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'11","last_scrub_stamp":"2024-09-13T19:19:20.693140+0000","last_deep_scrub":"36'11","last_deep_scrub_stamp":"2024-09-13T19:19:20.693140+0000","last_clean_scrub_stamp":"2024-09-13T19:19:20.693140+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:19.872266+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:39.817552+0000","last_change":"2024-09-13T19:19:39.817552+0000","last_active":"2024-09-13T19:19:39.817552+0000","last_peered":"2024-09-13T19:19:39.817552+0000","last_clean":"2024-09-13T19:19:39.817552+0000","last_became_active":"2024-09-13T19:16:03.915538+0000","last_became_peered":"2024-09-13T19:16:03.915538+0000","last_unstale":"2024-09-13T19:19:39.817552+0000","last_undegraded":"2024-09-13T19:19:39.817552+0000","last_fullsized":"2024-09-13T19:19:39.817552+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:39.817428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:39.817428+0000","last_clean_scrub_stamp":"2024-09-13T19:19:39.817428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:06:06.681988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"34'2","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:41.520495+0000","last_change":"2024-09-13T19:19:41.520527+0000","last_active":"2024-09-13T19:19:41.520495+0000","last_peered":"2024-09-13T19:19:41.520495+0000","last_clean":"2024-09-13T19:19:41.520495+0000","last_became_active":"2024-09-13T19:16:05.911683+0000","last_became_peered":"2024-09-13T19:16:05.911683+0000","last_unstale":"2024-09-13T19:19:41.520495+0000","last_undegraded":"2024-09-13T19:19:41.520495+0000","last_fullsized":"2024-09-13T19:19:41.520495+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:19:41.520392+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:19:41.520392+0000","last_clean_scrub_stamp":"2024-09-13T19:19:41.520392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:23.565901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"36'4","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:53.901787+0000","last_change":"2024-09-13T19:19:53.901787+0000","last_active":"2024-09-13T19:19:53.901787+0000","last_peered":"2024-09-13T19:19:53.901787+0000","last_clean":"2024-09-13T19:19:53.901787+0000","last_became_active":"2024-09-13T19:15:57.896965+0000","last_became_peered":"2024-09-13T19:15:57.896965+0000","last_unstale":"2024-09-13T19:19:53.901787+0000","last_undegraded":"2024-09-13T19:19:53.901787+0000","last_fullsized":"2024-09-13T19:19:53.901787+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:19:53.901665+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:19:53.901665+0000","last_clean_scrub_stamp":"2024-09-13T19:19:53.901665+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:59.285297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"36'4","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:15.019334+0000","last_change":"2024-09-13T19:20:15.019334+0000","last_active":"2024-09-13T19:20:15.019334+0000","last_peered":"2024-09-13T19:20:15.019334+0000","last_clean":"2024-09-13T19:20:15.019334+0000","last_became_active":"2024-09-13T19:15:55.895444+0000","last_became_peered":"2024-09-13T19:15:55.895444+0000","last_unstale":"2024-09-13T19:20:15.019334+0000","last_undegraded":"2024-09-13T19:20:15.019334+0000","last_fullsized":"2024-09-13T19:20:15.019334+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:20:15.019221+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:20:15.019221+0000","last_clean_scrub_stamp":"2024-09-13T19:20:15.019221+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:26.009738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:35.477903+0000","last_change":"2024-09-13T19:19:35.477903+0000","last_active":"2024-09-13T19:19:35.477903+0000","last_peered":"2024-09-13T19:19:35.477903+0000","last_clean":"2024-09-13T19:19:35.477903+0000","last_became_active":"2024-09-13T19:15:59.895332+0000","last_became_peered":"2024-09-13T19:15:59.895332+0000","last_unstale":"2024-09-13T19:19:35.477903+0000","last_undegraded":"2024-09-13T19:19:35.477903+0000","last_fullsized":"2024-09-13T19:19:35.477903+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:35.477788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:35.477788+0000","last_clean_scrub_stamp":"2024-09-13T19:19:35.477788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:23:52.241441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"36'15","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:25.801012+0000","last_change":"2024-09-13T19:19:25.801012+0000","last_active":"2024-09-13T19:19:25.801012+0000","last_peered":"2024-09-13T19:19:25.801012+0000","last_clean":"2024-09-13T19:19:25.801012+0000","last_became_active":"2024-09-13T19:16:01.905457+0000","last_became_peered":"2024-09-13T19:16:01.905457+0000","last_unstale":"2024-09-13T19:19:25.801012+0000","last_undegraded":"2024-09-13T19:19:25.801012+0000","last_fullsized":"2024-09-13T19:19:25.801012+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'15","last_scrub_stamp":"2024-09-13T19:19:25.800877+0000","last_deep_scrub":"36'15","last_deep_scrub_stamp":"2024-09-13T19:19:25.800877+0000","last_clean_scrub_stamp":"2024-09-13T19:19:25.800877+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:36.670597+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"36'286","reported_seq":395,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:50.851047+0000","last_change":"2024-09-13T19:19:50.851047+0000","last_active":"2024-09-13T19:19:50.851047+0000","last_peered":"2024-09-13T19:19:50.851047+0000","last_clean":"2024-09-13T19:19:50.851047+0000","last_became_active":"2024-09-13T19:16:03.916853+0000","last_became_peered":"2024-09-13T19:16:03.916853+0000","last_unstale":"2024-09-13T19:19:50.851047+0000","last_undegraded":"2024-09-13T19:19:50.851047+0000","last_fullsized":"2024-09-13T19:19:50.851047+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'286","last_scrub_stamp":"2024-09-13T19:19:50.850910+0000","last_deep_scrub":"36'286","last_deep_scrub_stamp":"2024-09-13T19:19:50.850910+0000","last_clean_scrub_stamp":"2024-09-13T19:19:50.850910+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:27:51.431330+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"36'2","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:39.721687+0000","last_change":"2024-09-13T19:19:39.721711+0000","last_active":"2024-09-13T19:19:39.721687+0000","last_peered":"2024-09-13T19:19:39.721687+0000","last_clean":"2024-09-13T19:19:39.721687+0000","last_became_active":"2024-09-13T19:16:05.912191+0000","last_became_peered":"2024-09-13T19:16:05.912191+0000","last_unstale":"2024-09-13T19:19:39.721687+0000","last_undegraded":"2024-09-13T19:19:39.721687+0000","last_fullsized":"2024-09-13T19:19:39.721687+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:39.721599+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:39.721599+0000","last_clean_scrub_stamp":"2024-09-13T19:19:39.721599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:58:45.282753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:01.628913+0000","last_change":"2024-09-13T19:20:01.628913+0000","last_active":"2024-09-13T19:20:01.628913+0000","last_peered":"2024-09-13T19:20:01.628913+0000","last_clean":"2024-09-13T19:20:01.628913+0000","last_became_active":"2024-09-13T19:15:57.890015+0000","last_became_peered":"2024-09-13T19:15:57.890015+0000","last_unstale":"2024-09-13T19:20:01.628913+0000","last_undegraded":"2024-09-13T19:20:01.628913+0000","last_fullsized":"2024-09-13T19:20:01.628913+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:20:01.628788+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:20:01.628788+0000","last_clean_scrub_stamp":"2024-09-13T19:20:01.628788+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:21.086734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:06.088085+0000","last_change":"2024-09-13T19:20:06.088085+0000","last_active":"2024-09-13T19:20:06.088085+0000","last_peered":"2024-09-13T19:20:06.088085+0000","last_clean":"2024-09-13T19:20:06.088085+0000","last_became_active":"2024-09-13T19:15:55.894380+0000","last_became_peered":"2024-09-13T19:15:55.894380+0000","last_unstale":"2024-09-13T19:20:06.088085+0000","last_undegraded":"2024-09-13T19:20:06.088085+0000","last_fullsized":"2024-09-13T19:20:06.088085+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:06.087929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:06.087929+0000","last_clean_scrub_stamp":"2024-09-13T19:20:06.087929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:01.249205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:16.988819+0000","last_change":"2024-09-13T19:19:16.988819+0000","last_active":"2024-09-13T19:19:16.988819+0000","last_peered":"2024-09-13T19:19:16.988819+0000","last_clean":"2024-09-13T19:19:16.988819+0000","last_became_active":"2024-09-13T19:15:59.896572+0000","last_became_peered":"2024-09-13T19:15:59.896572+0000","last_unstale":"2024-09-13T19:19:16.988819+0000","last_undegraded":"2024-09-13T19:19:16.988819+0000","last_fullsized":"2024-09-13T19:19:16.988819+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:16.988701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:16.988701+0000","last_clean_scrub_stamp":"2024-09-13T19:19:16.988701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:14.282330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"36'36","reported_seq":92,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:22.777010+0000","last_change":"2024-09-13T19:19:22.777010+0000","last_active":"2024-09-13T19:19:22.777010+0000","last_peered":"2024-09-13T19:19:22.777010+0000","last_clean":"2024-09-13T19:19:22.777010+0000","last_became_active":"2024-09-13T19:16:01.906471+0000","last_became_peered":"2024-09-13T19:16:01.906471+0000","last_unstale":"2024-09-13T19:19:22.777010+0000","last_undegraded":"2024-09-13T19:19:22.777010+0000","last_fullsized":"2024-09-13T19:19:22.777010+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-13T19:19:22.776859+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-13T19:19:22.776859+0000","last_clean_scrub_stamp":"2024-09-13T19:19:22.776859+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:40.452064+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"36'285","reported_seq":423,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:20.301137+0000","last_change":"2024-09-13T19:19:20.301137+0000","last_active":"2024-09-13T19:19:20.301137+0000","last_peered":"2024-09-13T19:19:20.301137+0000","last_clean":"2024-09-13T19:19:20.301137+0000","last_became_active":"2024-09-13T19:16:03.909046+0000","last_became_peered":"2024-09-13T19:16:03.909046+0000","last_unstale":"2024-09-13T19:19:20.301137+0000","last_undegraded":"2024-09-13T19:19:20.301137+0000","last_fullsized":"2024-09-13T19:19:20.301137+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-13T19:19:20.301016+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-13T19:19:20.301016+0000","last_clean_scrub_stamp":"2024-09-13T19:19:20.301016+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:00.732319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"36'16","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:11.578670+0000","last_change":"2024-09-13T19:20:11.578670+0000","last_active":"2024-09-13T19:20:11.578670+0000","last_peered":"2024-09-13T19:20:11.578670+0000","last_clean":"2024-09-13T19:20:11.578670+0000","last_became_active":"2024-09-13T19:16:31.991055+0000","last_became_peered":"2024-09-13T19:16:31.991055+0000","last_unstale":"2024-09-13T19:20:11.578670+0000","last_undegraded":"2024-09-13T19:20:11.578670+0000","last_fullsized":"2024-09-13T19:20:11.578670+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-13T19:20:11.578543+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-13T19:20:11.578543+0000","last_clean_scrub_stamp":"2024-09-13T19:20:11.578543+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:35.701195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":73,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:54.641871+0000","last_change":"2024-09-13T19:19:54.641871+0000","last_active":"2024-09-13T19:19:54.641871+0000","last_peered":"2024-09-13T19:19:54.641871+0000","last_clean":"2024-09-13T19:19:54.641871+0000","last_became_active":"2024-09-13T19:15:55.893544+0000","last_became_peered":"2024-09-13T19:15:55.893544+0000","last_unstale":"2024-09-13T19:19:54.641871+0000","last_undegraded":"2024-09-13T19:19:54.641871+0000","last_fullsized":"2024-09-13T19:19:54.641871+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:54.641751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:54.641751+0000","last_clean_scrub_stamp":"2024-09-13T19:19:54.641751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:04.710009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:25.690504+0000","last_change":"2024-09-13T19:19:25.690504+0000","last_active":"2024-09-13T19:19:25.690504+0000","last_peered":"2024-09-13T19:19:25.690504+0000","last_clean":"2024-09-13T19:19:25.690504+0000","last_became_active":"2024-09-13T19:15:59.897435+0000","last_became_peered":"2024-09-13T19:15:59.897435+0000","last_unstale":"2024-09-13T19:19:25.690504+0000","last_undegraded":"2024-09-13T19:19:25.690504+0000","last_fullsized":"2024-09-13T19:19:25.690504+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:25.690361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:25.690361+0000","last_clean_scrub_stamp":"2024-09-13T19:19:25.690361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:23:10.242794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"36'52","reported_seq":113,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:26.852897+0000","last_change":"2024-09-13T19:19:26.852897+0000","last_active":"2024-09-13T19:19:26.852897+0000","last_peered":"2024-09-13T19:19:26.852897+0000","last_clean":"2024-09-13T19:19:26.852897+0000","last_became_active":"2024-09-13T19:16:01.904454+0000","last_became_peered":"2024-09-13T19:16:01.904454+0000","last_unstale":"2024-09-13T19:19:26.852897+0000","last_undegraded":"2024-09-13T19:19:26.852897+0000","last_fullsized":"2024-09-13T19:19:26.852897+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'52","last_scrub_stamp":"2024-09-13T19:19:26.852772+0000","last_deep_scrub":"36'52","last_deep_scrub_stamp":"2024-09-13T19:19:26.852772+0000","last_clean_scrub_stamp":"2024-09-13T19:19:26.852772+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:51.100890+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:25.339857+0000","last_change":"2024-09-13T19:19:25.339857+0000","last_active":"2024-09-13T19:19:25.339857+0000","last_peered":"2024-09-13T19:19:25.339857+0000","last_clean":"2024-09-13T19:19:25.339857+0000","last_became_active":"2024-09-13T19:16:03.912383+0000","last_became_peered":"2024-09-13T19:16:03.912383+0000","last_unstale":"2024-09-13T19:19:25.339857+0000","last_undegraded":"2024-09-13T19:19:25.339857+0000","last_fullsized":"2024-09-13T19:19:25.339857+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:25.339734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:25.339734+0000","last_clean_scrub_stamp":"2024-09-13T19:19:25.339734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:29.120530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"36'5","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:07.574709+0000","last_change":"2024-09-13T19:20:07.574709+0000","last_active":"2024-09-13T19:20:07.574709+0000","last_peered":"2024-09-13T19:20:07.574709+0000","last_clean":"2024-09-13T19:20:07.574709+0000","last_became_active":"2024-09-13T19:16:05.919154+0000","last_became_peered":"2024-09-13T19:16:05.919154+0000","last_unstale":"2024-09-13T19:20:07.574709+0000","last_undegraded":"2024-09-13T19:20:07.574709+0000","last_fullsized":"2024-09-13T19:20:07.574709+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-09-13T19:20:07.574573+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-09-13T19:20:07.574573+0000","last_clean_scrub_stamp":"2024-09-13T19:20:07.574573+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:56:34.868499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:54.102926+0000","last_change":"2024-09-13T19:19:54.102926+0000","last_active":"2024-09-13T19:19:54.102926+0000","last_peered":"2024-09-13T19:19:54.102926+0000","last_clean":"2024-09-13T19:19:54.102926+0000","last_became_active":"2024-09-13T19:15:57.890345+0000","last_became_peered":"2024-09-13T19:15:57.890345+0000","last_unstale":"2024-09-13T19:19:54.102926+0000","last_undegraded":"2024-09-13T19:19:54.102926+0000","last_fullsized":"2024-09-13T19:19:54.102926+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:19:54.102800+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:19:54.102800+0000","last_clean_scrub_stamp":"2024-09-13T19:19:54.102800+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:26.429123+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:01.536496+0000","last_change":"2024-09-13T19:20:01.536496+0000","last_active":"2024-09-13T19:20:01.536496+0000","last_peered":"2024-09-13T19:20:01.536496+0000","last_clean":"2024-09-13T19:20:01.536496+0000","last_became_active":"2024-09-13T19:15:55.891250+0000","last_became_peered":"2024-09-13T19:15:55.891250+0000","last_unstale":"2024-09-13T19:20:01.536496+0000","last_undegraded":"2024-09-13T19:20:01.536496+0000","last_fullsized":"2024-09-13T19:20:01.536496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:20:01.536373+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:20:01.536373+0000","last_clean_scrub_stamp":"2024-09-13T19:20:01.536373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:49:59.441969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:40.548760+0000","last_change":"2024-09-13T19:19:40.548760+0000","last_active":"2024-09-13T19:19:40.548760+0000","last_peered":"2024-09-13T19:19:40.548760+0000","last_clean":"2024-09-13T19:19:40.548760+0000","last_became_active":"2024-09-13T19:15:59.891028+0000","last_became_peered":"2024-09-13T19:15:59.891028+0000","last_unstale":"2024-09-13T19:19:40.548760+0000","last_undegraded":"2024-09-13T19:19:40.548760+0000","last_fullsized":"2024-09-13T19:19:40.548760+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:40.548634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:40.548634+0000","last_clean_scrub_stamp":"2024-09-13T19:19:40.548634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:18:54.086278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"36'36","reported_seq":92,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:29.094550+0000","last_change":"2024-09-13T19:19:29.094550+0000","last_active":"2024-09-13T19:19:29.094550+0000","last_peered":"2024-09-13T19:19:29.094550+0000","last_clean":"2024-09-13T19:19:29.094550+0000","last_became_active":"2024-09-13T19:16:01.904534+0000","last_became_peered":"2024-09-13T19:16:01.904534+0000","last_unstale":"2024-09-13T19:19:29.094550+0000","last_undegraded":"2024-09-13T19:19:29.094550+0000","last_fullsized":"2024-09-13T19:19:29.094550+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-13T19:19:29.094383+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-13T19:19:29.094383+0000","last_clean_scrub_stamp":"2024-09-13T19:19:29.094383+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:28:19.264538+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:33.431831+0000","last_change":"2024-09-13T19:19:33.431831+0000","last_active":"2024-09-13T19:19:33.431831+0000","last_peered":"2024-09-13T19:19:33.431831+0000","last_clean":"2024-09-13T19:19:33.431831+0000","last_became_active":"2024-09-13T19:16:03.913829+0000","last_became_peered":"2024-09-13T19:16:03.913829+0000","last_unstale":"2024-09-13T19:19:33.431831+0000","last_undegraded":"2024-09-13T19:19:33.431831+0000","last_fullsized":"2024-09-13T19:19:33.431831+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:33.431688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:33.431688+0000","last_clean_scrub_stamp":"2024-09-13T19:19:33.431688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:40:42.508968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"36'4","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:12.054063+0000","last_change":"2024-09-13T19:20:12.054063+0000","last_active":"2024-09-13T19:20:12.054063+0000","last_peered":"2024-09-13T19:20:12.054063+0000","last_clean":"2024-09-13T19:20:12.054063+0000","last_became_active":"2024-09-13T19:16:05.913578+0000","last_became_peered":"2024-09-13T19:16:05.913578+0000","last_unstale":"2024-09-13T19:20:12.054063+0000","last_undegraded":"2024-09-13T19:20:12.054063+0000","last_fullsized":"2024-09-13T19:20:12.054063+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:20:12.053936+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:20:12.053936+0000","last_clean_scrub_stamp":"2024-09-13T19:20:12.053936+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:13:39.847869+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:53.682379+0000","last_change":"2024-09-13T19:19:53.682379+0000","last_active":"2024-09-13T19:19:53.682379+0000","last_peered":"2024-09-13T19:19:53.682379+0000","last_clean":"2024-09-13T19:19:53.682379+0000","last_became_active":"2024-09-13T19:15:57.897468+0000","last_became_peered":"2024-09-13T19:15:57.897468+0000","last_unstale":"2024-09-13T19:19:53.682379+0000","last_undegraded":"2024-09-13T19:19:53.682379+0000","last_fullsized":"2024-09-13T19:19:53.682379+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:53.682234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:53.682234+0000","last_clean_scrub_stamp":"2024-09-13T19:19:53.682234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:20.626955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:30.972998+0000","last_change":"2024-09-13T19:20:30.973037+0000","last_active":"2024-09-13T19:20:30.972998+0000","last_peered":"2024-09-13T19:20:30.972998+0000","last_clean":"2024-09-13T19:20:30.972998+0000","last_became_active":"2024-09-13T19:15:55.893489+0000","last_became_peered":"2024-09-13T19:15:55.893489+0000","last_unstale":"2024-09-13T19:20:30.972998+0000","last_undegraded":"2024-09-13T19:20:30.972998+0000","last_fullsized":"2024-09-13T19:20:30.972998+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:30.972873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:30.972873+0000","last_clean_scrub_stamp":"2024-09-13T19:20:30.972873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:35.739544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:36.500258+0000","last_change":"2024-09-13T19:19:36.500258+0000","last_active":"2024-09-13T19:19:36.500258+0000","last_peered":"2024-09-13T19:19:36.500258+0000","last_clean":"2024-09-13T19:19:36.500258+0000","last_became_active":"2024-09-13T19:15:59.895291+0000","last_became_peered":"2024-09-13T19:15:59.895291+0000","last_unstale":"2024-09-13T19:19:36.500258+0000","last_undegraded":"2024-09-13T19:19:36.500258+0000","last_fullsized":"2024-09-13T19:19:36.500258+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:36.500113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:36.500113+0000","last_clean_scrub_stamp":"2024-09-13T19:19:36.500113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:16:46.762131+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"36'45","reported_seq":104,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:19.049589+0000","last_change":"2024-09-13T19:19:19.049589+0000","last_active":"2024-09-13T19:19:19.049589+0000","last_peered":"2024-09-13T19:19:19.049589+0000","last_clean":"2024-09-13T19:19:19.049589+0000","last_became_active":"2024-09-13T19:16:01.896507+0000","last_became_peered":"2024-09-13T19:16:01.896507+0000","last_unstale":"2024-09-13T19:19:19.049589+0000","last_undegraded":"2024-09-13T19:19:19.049589+0000","last_fullsized":"2024-09-13T19:19:19.049589+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'45","last_scrub_stamp":"2024-09-13T19:19:19.049456+0000","last_deep_scrub":"36'45","last_deep_scrub_stamp":"2024-09-13T19:19:19.049456+0000","last_clean_scrub_stamp":"2024-09-13T19:19:19.049456+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:40.433022+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"36'285","reported_seq":388,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:21.320904+0000","last_change":"2024-09-13T19:19:21.320904+0000","last_active":"2024-09-13T19:19:21.320904+0000","last_peered":"2024-09-13T19:19:21.320904+0000","last_clean":"2024-09-13T19:19:21.320904+0000","last_became_active":"2024-09-13T19:16:03.910504+0000","last_became_peered":"2024-09-13T19:16:03.910504+0000","last_unstale":"2024-09-13T19:19:21.320904+0000","last_undegraded":"2024-09-13T19:19:21.320904+0000","last_fullsized":"2024-09-13T19:19:21.320904+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-13T19:19:21.320768+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-13T19:19:21.320768+0000","last_clean_scrub_stamp":"2024-09-13T19:19:21.320768+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:21:36.601671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"36'4","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:14.493626+0000","last_change":"2024-09-13T19:20:14.493626+0000","last_active":"2024-09-13T19:20:14.493626+0000","last_peered":"2024-09-13T19:20:14.493626+0000","last_clean":"2024-09-13T19:20:14.493626+0000","last_became_active":"2024-09-13T19:16:05.912881+0000","last_became_peered":"2024-09-13T19:16:05.912881+0000","last_unstale":"2024-09-13T19:20:14.493626+0000","last_undegraded":"2024-09-13T19:20:14.493626+0000","last_fullsized":"2024-09-13T19:20:14.493626+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:20:14.493507+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:20:14.493507+0000","last_clean_scrub_stamp":"2024-09-13T19:20:14.493507+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:11:30.673524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"36'4","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:41.805515+0000","last_change":"2024-09-13T19:19:41.805515+0000","last_active":"2024-09-13T19:19:41.805515+0000","last_peered":"2024-09-13T19:19:41.805515+0000","last_clean":"2024-09-13T19:19:41.805515+0000","last_became_active":"2024-09-13T19:15:57.883675+0000","last_became_peered":"2024-09-13T19:15:57.883675+0000","last_unstale":"2024-09-13T19:19:41.805515+0000","last_undegraded":"2024-09-13T19:19:41.805515+0000","last_fullsized":"2024-09-13T19:19:41.805515+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:19:41.805394+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:19:41.805394+0000","last_clean_scrub_stamp":"2024-09-13T19:19:41.805394+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:11:49.618178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"36'7","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:29.975211+0000","last_change":"2024-09-13T19:20:29.975264+0000","last_active":"2024-09-13T19:20:29.975211+0000","last_peered":"2024-09-13T19:20:29.975211+0000","last_clean":"2024-09-13T19:20:29.975211+0000","last_became_active":"2024-09-13T19:15:55.891882+0000","last_became_peered":"2024-09-13T19:15:55.891882+0000","last_unstale":"2024-09-13T19:20:29.975211+0000","last_undegraded":"2024-09-13T19:20:29.975211+0000","last_fullsized":"2024-09-13T19:20:29.975211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'7","last_scrub_stamp":"2024-09-13T19:20:29.975084+0000","last_deep_scrub":"36'7","last_deep_scrub_stamp":"2024-09-13T19:20:29.975084+0000","last_clean_scrub_stamp":"2024-09-13T19:20:29.975084+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:31:43.005670+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":16,"num_write_kb":4722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:10.565263+0000","last_change":"2024-09-13T19:20:10.565263+0000","last_active":"2024-09-13T19:20:10.565263+0000","last_peered":"2024-09-13T19:20:10.565263+0000","last_clean":"2024-09-13T19:20:10.565263+0000","last_became_active":"2024-09-13T19:16:31.992122+0000","last_became_peered":"2024-09-13T19:16:31.992122+0000","last_unstale":"2024-09-13T19:20:10.565263+0000","last_undegraded":"2024-09-13T19:20:10.565263+0000","last_fullsized":"2024-09-13T19:20:10.565263+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:10.565140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:10.565140+0000","last_clean_scrub_stamp":"2024-09-13T19:20:10.565140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:36.265398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"36'66","reported_seq":140,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:44.917516+0000","last_change":"2024-09-13T19:19:44.917516+0000","last_active":"2024-09-13T19:19:44.917516+0000","last_peered":"2024-09-13T19:19:44.917516+0000","last_clean":"2024-09-13T19:19:44.917516+0000","last_became_active":"2024-09-13T19:16:01.906031+0000","last_became_peered":"2024-09-13T19:16:01.906031+0000","last_unstale":"2024-09-13T19:19:44.917516+0000","last_undegraded":"2024-09-13T19:19:44.917516+0000","last_fullsized":"2024-09-13T19:19:44.917516+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'66","last_scrub_stamp":"2024-09-13T19:19:44.917388+0000","last_deep_scrub":"36'66","last_deep_scrub_stamp":"2024-09-13T19:19:44.917388+0000","last_clean_scrub_stamp":"2024-09-13T19:19:44.917388+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:13:12.711321+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:23.383957+0000","last_change":"2024-09-13T19:19:23.383957+0000","last_active":"2024-09-13T19:19:23.383957+0000","last_peered":"2024-09-13T19:19:23.383957+0000","last_clean":"2024-09-13T19:19:23.383957+0000","last_became_active":"2024-09-13T19:16:03.908134+0000","last_became_peered":"2024-09-13T19:16:03.908134+0000","last_unstale":"2024-09-13T19:19:23.383957+0000","last_undegraded":"2024-09-13T19:19:23.383957+0000","last_fullsized":"2024-09-13T19:19:23.383957+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:23.383782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:23.383782+0000","last_clean_scrub_stamp":"2024-09-13T19:19:23.383782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:10.783386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"36'21","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:15.545652+0000","last_change":"2024-09-13T19:20:15.545652+0000","last_active":"2024-09-13T19:20:15.545652+0000","last_peered":"2024-09-13T19:20:15.545652+0000","last_clean":"2024-09-13T19:20:15.545652+0000","last_became_active":"2024-09-13T19:16:05.914853+0000","last_became_peered":"2024-09-13T19:16:05.914853+0000","last_unstale":"2024-09-13T19:20:15.545652+0000","last_undegraded":"2024-09-13T19:20:15.545652+0000","last_fullsized":"2024-09-13T19:20:15.545652+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'21","last_scrub_stamp":"2024-09-13T19:20:15.545533+0000","last_deep_scrub":"36'21","last_deep_scrub_stamp":"2024-09-13T19:20:15.545533+0000","last_clean_scrub_stamp":"2024-09-13T19:20:15.545533+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:59:00.701185+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"36'6","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:37.807504+0000","last_change":"2024-09-13T19:19:37.807504+0000","last_active":"2024-09-13T19:19:37.807504+0000","last_peered":"2024-09-13T19:19:37.807504+0000","last_clean":"2024-09-13T19:19:37.807504+0000","last_became_active":"2024-09-13T19:15:57.902955+0000","last_became_peered":"2024-09-13T19:15:57.902955+0000","last_unstale":"2024-09-13T19:19:37.807504+0000","last_undegraded":"2024-09-13T19:19:37.807504+0000","last_fullsized":"2024-09-13T19:19:37.807504+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:19:37.807394+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:19:37.807394+0000","last_clean_scrub_stamp":"2024-09-13T19:19:37.807394+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:23:23.699122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:05.537039+0000","last_change":"2024-09-13T19:20:05.537039+0000","last_active":"2024-09-13T19:20:05.537039+0000","last_peered":"2024-09-13T19:20:05.537039+0000","last_clean":"2024-09-13T19:20:05.537039+0000","last_became_active":"2024-09-13T19:15:55.890805+0000","last_became_peered":"2024-09-13T19:15:55.890805+0000","last_unstale":"2024-09-13T19:20:05.537039+0000","last_undegraded":"2024-09-13T19:20:05.537039+0000","last_fullsized":"2024-09-13T19:20:05.537039+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:05.536913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:05.536913+0000","last_clean_scrub_stamp":"2024-09-13T19:20:05.536913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:08:13.286175+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:32.806783+0000","last_change":"2024-09-13T19:19:32.806783+0000","last_active":"2024-09-13T19:19:32.806783+0000","last_peered":"2024-09-13T19:19:32.806783+0000","last_clean":"2024-09-13T19:19:32.806783+0000","last_became_active":"2024-09-13T19:15:59.897884+0000","last_became_peered":"2024-09-13T19:15:59.897884+0000","last_unstale":"2024-09-13T19:19:32.806783+0000","last_undegraded":"2024-09-13T19:19:32.806783+0000","last_fullsized":"2024-09-13T19:19:32.806783+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:32.806649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:32.806649+0000","last_clean_scrub_stamp":"2024-09-13T19:19:32.806649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:35.455381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"36'41","reported_seq":98,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:21.708485+0000","last_change":"2024-09-13T19:19:21.708485+0000","last_active":"2024-09-13T19:19:21.708485+0000","last_peered":"2024-09-13T19:19:21.708485+0000","last_clean":"2024-09-13T19:19:21.708485+0000","last_became_active":"2024-09-13T19:16:01.902657+0000","last_became_peered":"2024-09-13T19:16:01.902657+0000","last_unstale":"2024-09-13T19:19:21.708485+0000","last_undegraded":"2024-09-13T19:19:21.708485+0000","last_fullsized":"2024-09-13T19:19:21.708485+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'41","last_scrub_stamp":"2024-09-13T19:19:21.708338+0000","last_deep_scrub":"36'41","last_deep_scrub_stamp":"2024-09-13T19:19:21.708338+0000","last_clean_scrub_stamp":"2024-09-13T19:19:21.708338+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:24.621364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":44,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:38.960234+0000","last_change":"2024-09-13T19:19:38.960234+0000","last_active":"2024-09-13T19:19:38.960234+0000","last_peered":"2024-09-13T19:19:38.960234+0000","last_clean":"2024-09-13T19:19:38.960234+0000","last_became_active":"2024-09-13T19:16:03.915499+0000","last_became_peered":"2024-09-13T19:16:03.915499+0000","last_unstale":"2024-09-13T19:19:38.960234+0000","last_undegraded":"2024-09-13T19:19:38.960234+0000","last_fullsized":"2024-09-13T19:19:38.960234+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:38.960096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:38.960096+0000","last_clean_scrub_stamp":"2024-09-13T19:19:38.960096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:34.121371+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"36'4","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:06.957184+0000","last_change":"2024-09-13T19:20:06.957184+0000","last_active":"2024-09-13T19:20:06.957184+0000","last_peered":"2024-09-13T19:20:06.957184+0000","last_clean":"2024-09-13T19:20:06.957184+0000","last_became_active":"2024-09-13T19:16:05.920239+0000","last_became_peered":"2024-09-13T19:16:05.920239+0000","last_unstale":"2024-09-13T19:20:06.957184+0000","last_undegraded":"2024-09-13T19:20:06.957184+0000","last_fullsized":"2024-09-13T19:20:06.957184+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:20:06.957071+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:20:06.957071+0000","last_clean_scrub_stamp":"2024-09-13T19:20:06.957071+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:07:39.659763+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"36'8","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:33.099210+0000","last_change":"2024-09-13T19:19:33.099210+0000","last_active":"2024-09-13T19:19:33.099210+0000","last_peered":"2024-09-13T19:19:33.099210+0000","last_clean":"2024-09-13T19:19:33.099210+0000","last_became_active":"2024-09-13T19:15:57.901131+0000","last_became_peered":"2024-09-13T19:15:57.901131+0000","last_unstale":"2024-09-13T19:19:33.099210+0000","last_undegraded":"2024-09-13T19:19:33.099210+0000","last_fullsized":"2024-09-13T19:19:33.099210+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-13T19:19:33.099097+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-13T19:19:33.099097+0000","last_clean_scrub_stamp":"2024-09-13T19:19:33.099097+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:21:52.129989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:32.984053+0000","last_change":"2024-09-13T19:20:32.984127+0000","last_active":"2024-09-13T19:20:32.984053+0000","last_peered":"2024-09-13T19:20:32.984053+0000","last_clean":"2024-09-13T19:20:32.984053+0000","last_became_active":"2024-09-13T19:15:55.900143+0000","last_became_peered":"2024-09-13T19:15:55.900143+0000","last_unstale":"2024-09-13T19:20:32.984053+0000","last_undegraded":"2024-09-13T19:20:32.984053+0000","last_fullsized":"2024-09-13T19:20:32.984053+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:32.983958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:32.983958+0000","last_clean_scrub_stamp":"2024-09-13T19:20:32.983958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:48:14.336412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:38.478130+0000","last_change":"2024-09-13T19:19:38.478130+0000","last_active":"2024-09-13T19:19:38.478130+0000","last_peered":"2024-09-13T19:19:38.478130+0000","last_clean":"2024-09-13T19:19:38.478130+0000","last_became_active":"2024-09-13T19:15:59.894793+0000","last_became_peered":"2024-09-13T19:15:59.894793+0000","last_unstale":"2024-09-13T19:19:38.478130+0000","last_undegraded":"2024-09-13T19:19:38.478130+0000","last_fullsized":"2024-09-13T19:19:38.478130+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:38.477940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:38.477940+0000","last_clean_scrub_stamp":"2024-09-13T19:19:38.477940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:10.926294+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"36'45","reported_seq":104,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:30.838996+0000","last_change":"2024-09-13T19:19:30.838996+0000","last_active":"2024-09-13T19:19:30.838996+0000","last_peered":"2024-09-13T19:19:30.838996+0000","last_clean":"2024-09-13T19:19:30.838996+0000","last_became_active":"2024-09-13T19:16:01.897733+0000","last_became_peered":"2024-09-13T19:16:01.897733+0000","last_unstale":"2024-09-13T19:19:30.838996+0000","last_undegraded":"2024-09-13T19:19:30.838996+0000","last_fullsized":"2024-09-13T19:19:30.838996+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'45","last_scrub_stamp":"2024-09-13T19:19:30.838860+0000","last_deep_scrub":"36'45","last_deep_scrub_stamp":"2024-09-13T19:19:30.838860+0000","last_clean_scrub_stamp":"2024-09-13T19:19:30.838860+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:39:39.517349+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"36'285","reported_seq":422,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:23.814508+0000","last_change":"2024-09-13T19:19:23.814508+0000","last_active":"2024-09-13T19:19:23.814508+0000","last_peered":"2024-09-13T19:19:23.814508+0000","last_clean":"2024-09-13T19:19:23.814508+0000","last_became_active":"2024-09-13T19:16:03.915589+0000","last_became_peered":"2024-09-13T19:16:03.915589+0000","last_unstale":"2024-09-13T19:19:23.814508+0000","last_undegraded":"2024-09-13T19:19:23.814508+0000","last_fullsized":"2024-09-13T19:19:23.814508+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-13T19:19:23.814324+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-13T19:19:23.814324+0000","last_clean_scrub_stamp":"2024-09-13T19:19:23.814324+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:26.983039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"36'13","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:12.475238+0000","last_change":"2024-09-13T19:20:12.475238+0000","last_active":"2024-09-13T19:20:12.475238+0000","last_peered":"2024-09-13T19:20:12.475238+0000","last_clean":"2024-09-13T19:20:12.475238+0000","last_became_active":"2024-09-13T19:16:05.912339+0000","last_became_peered":"2024-09-13T19:16:05.912339+0000","last_unstale":"2024-09-13T19:20:12.475238+0000","last_undegraded":"2024-09-13T19:20:12.475238+0000","last_fullsized":"2024-09-13T19:20:12.475238+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'13","last_scrub_stamp":"2024-09-13T19:20:12.475107+0000","last_deep_scrub":"36'13","last_deep_scrub_stamp":"2024-09-13T19:20:12.475107+0000","last_clean_scrub_stamp":"2024-09-13T19:20:12.475107+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:23:20.507295+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"36'6","reported_seq":69,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:40.761706+0000","last_change":"2024-09-13T19:19:40.761706+0000","last_active":"2024-09-13T19:19:40.761706+0000","last_peered":"2024-09-13T19:19:40.761706+0000","last_clean":"2024-09-13T19:19:40.761706+0000","last_became_active":"2024-09-13T19:15:57.900560+0000","last_became_peered":"2024-09-13T19:15:57.900560+0000","last_unstale":"2024-09-13T19:19:40.761706+0000","last_undegraded":"2024-09-13T19:19:40.761706+0000","last_fullsized":"2024-09-13T19:19:40.761706+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:19:40.761587+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:19:40.761587+0000","last_clean_scrub_stamp":"2024-09-13T19:19:40.761587+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:45.661345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:16.041569+0000","last_change":"2024-09-13T19:20:16.041569+0000","last_active":"2024-09-13T19:20:16.041569+0000","last_peered":"2024-09-13T19:20:16.041569+0000","last_clean":"2024-09-13T19:20:16.041569+0000","last_became_active":"2024-09-13T19:15:55.895799+0000","last_became_peered":"2024-09-13T19:15:55.895799+0000","last_unstale":"2024-09-13T19:20:16.041569+0000","last_undegraded":"2024-09-13T19:20:16.041569+0000","last_fullsized":"2024-09-13T19:20:16.041569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:16.041444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:16.041444+0000","last_clean_scrub_stamp":"2024-09-13T19:20:16.041444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:27:11.582296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'5","reported_seq":429,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:28.767985+0000","last_change":"2024-09-13T19:19:28.767985+0000","last_active":"2024-09-13T19:19:28.767985+0000","last_peered":"2024-09-13T19:19:28.767985+0000","last_clean":"2024-09-13T19:19:28.767985+0000","last_became_active":"2024-09-13T19:15:59.894303+0000","last_became_peered":"2024-09-13T19:15:59.894303+0000","last_unstale":"2024-09-13T19:19:28.767985+0000","last_undegraded":"2024-09-13T19:19:28.767985+0000","last_fullsized":"2024-09-13T19:19:28.767985+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-09-13T19:19:28.767856+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-09-13T19:19:28.767856+0000","last_clean_scrub_stamp":"2024-09-13T19:19:28.767856+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:10.640290+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"36'15","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:43.951910+0000","last_change":"2024-09-13T19:19:43.951910+0000","last_active":"2024-09-13T19:19:43.951910+0000","last_peered":"2024-09-13T19:19:43.951910+0000","last_clean":"2024-09-13T19:19:43.951910+0000","last_became_active":"2024-09-13T19:16:01.906490+0000","last_became_peered":"2024-09-13T19:16:01.906490+0000","last_unstale":"2024-09-13T19:19:43.951910+0000","last_undegraded":"2024-09-13T19:19:43.951910+0000","last_fullsized":"2024-09-13T19:19:43.951910+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'15","last_scrub_stamp":"2024-09-13T19:19:43.951784+0000","last_deep_scrub":"36'15","last_deep_scrub_stamp":"2024-09-13T19:19:43.951784+0000","last_clean_scrub_stamp":"2024-09-13T19:19:43.951784+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:38.693730+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"36'285","reported_seq":512,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:19.722840+0000","last_change":"2024-09-13T19:19:19.722840+0000","last_active":"2024-09-13T19:19:19.722840+0000","last_peered":"2024-09-13T19:19:19.722840+0000","last_clean":"2024-09-13T19:19:19.722840+0000","last_became_active":"2024-09-13T19:16:03.905523+0000","last_became_peered":"2024-09-13T19:16:03.905523+0000","last_unstale":"2024-09-13T19:19:19.722840+0000","last_undegraded":"2024-09-13T19:19:19.722840+0000","last_fullsized":"2024-09-13T19:19:19.722840+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-13T19:19:19.722719+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-13T19:19:19.722719+0000","last_clean_scrub_stamp":"2024-09-13T19:19:19.722719+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:33.649384+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"36'4","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:27.846042+0000","last_change":"2024-09-13T19:19:27.846042+0000","last_active":"2024-09-13T19:19:27.846042+0000","last_peered":"2024-09-13T19:19:27.846042+0000","last_clean":"2024-09-13T19:19:27.846042+0000","last_became_active":"2024-09-13T19:16:05.910656+0000","last_became_peered":"2024-09-13T19:16:05.910656+0000","last_unstale":"2024-09-13T19:19:27.846042+0000","last_undegraded":"2024-09-13T19:19:27.846042+0000","last_fullsized":"2024-09-13T19:19:27.846042+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:19:27.845857+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:19:27.845857+0000","last_clean_scrub_stamp":"2024-09-13T19:19:27.845857+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:46.547978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"36'3","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:34.847663+0000","last_change":"2024-09-13T19:19:34.847663+0000","last_active":"2024-09-13T19:19:34.847663+0000","last_peered":"2024-09-13T19:19:34.847663+0000","last_clean":"2024-09-13T19:19:34.847663+0000","last_became_active":"2024-09-13T19:15:57.903761+0000","last_became_peered":"2024-09-13T19:15:57.903761+0000","last_unstale":"2024-09-13T19:19:34.847663+0000","last_undegraded":"2024-09-13T19:19:34.847663+0000","last_fullsized":"2024-09-13T19:19:34.847663+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-13T19:19:34.847491+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-13T19:19:34.847491+0000","last_clean_scrub_stamp":"2024-09-13T19:19:34.847491+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:49.358180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:21.001037+0000","last_change":"2024-09-13T19:20:21.001064+0000","last_active":"2024-09-13T19:20:21.001037+0000","last_peered":"2024-09-13T19:20:21.001037+0000","last_clean":"2024-09-13T19:20:21.001037+0000","last_became_active":"2024-09-13T19:15:55.899919+0000","last_became_peered":"2024-09-13T19:15:55.899919+0000","last_unstale":"2024-09-13T19:20:21.001037+0000","last_undegraded":"2024-09-13T19:20:21.001037+0000","last_fullsized":"2024-09-13T19:20:21.001037+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:21.000929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:21.000929+0000","last_clean_scrub_stamp":"2024-09-13T19:20:21.000929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:30.375003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"36'5","reported_seq":239,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:18.034914+0000","last_change":"2024-09-13T19:19:18.034914+0000","last_active":"2024-09-13T19:19:18.034914+0000","last_peered":"2024-09-13T19:19:18.034914+0000","last_clean":"2024-09-13T19:19:18.034914+0000","last_became_active":"2024-09-13T19:15:59.896081+0000","last_became_peered":"2024-09-13T19:15:59.896081+0000","last_unstale":"2024-09-13T19:19:18.034914+0000","last_undegraded":"2024-09-13T19:19:18.034914+0000","last_fullsized":"2024-09-13T19:19:18.034914+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-09-13T19:19:18.034798+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-09-13T19:19:18.034798+0000","last_clean_scrub_stamp":"2024-09-13T19:19:18.034798+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:47.783875+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"36'49","reported_seq":109,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:22.687872+0000","last_change":"2024-09-13T19:19:22.687872+0000","last_active":"2024-09-13T19:19:22.687872+0000","last_peered":"2024-09-13T19:19:22.687872+0000","last_clean":"2024-09-13T19:19:22.687872+0000","last_became_active":"2024-09-13T19:16:01.902532+0000","last_became_peered":"2024-09-13T19:16:01.902532+0000","last_unstale":"2024-09-13T19:19:22.687872+0000","last_undegraded":"2024-09-13T19:19:22.687872+0000","last_fullsized":"2024-09-13T19:19:22.687872+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'49","last_scrub_stamp":"2024-09-13T19:19:22.687725+0000","last_deep_scrub":"36'49","last_deep_scrub_stamp":"2024-09-13T19:19:22.687725+0000","last_clean_scrub_stamp":"2024-09-13T19:19:22.687725+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:20.499665+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:17.747855+0000","last_change":"2024-09-13T19:19:17.747855+0000","last_active":"2024-09-13T19:19:17.747855+0000","last_peered":"2024-09-13T19:19:17.747855+0000","last_clean":"2024-09-13T19:19:17.747855+0000","last_became_active":"2024-09-13T19:16:03.913019+0000","last_became_peered":"2024-09-13T19:16:03.913019+0000","last_unstale":"2024-09-13T19:19:17.747855+0000","last_undegraded":"2024-09-13T19:19:17.747855+0000","last_fullsized":"2024-09-13T19:19:17.747855+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:17.747683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:17.747683+0000","last_clean_scrub_stamp":"2024-09-13T19:19:17.747683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:01.675286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"36'9","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:43.841990+0000","last_change":"2024-09-13T19:19:43.841990+0000","last_active":"2024-09-13T19:19:43.841990+0000","last_peered":"2024-09-13T19:19:43.841990+0000","last_clean":"2024-09-13T19:19:43.841990+0000","last_became_active":"2024-09-13T19:16:05.911364+0000","last_became_peered":"2024-09-13T19:16:05.911364+0000","last_unstale":"2024-09-13T19:19:43.841990+0000","last_undegraded":"2024-09-13T19:19:43.841990+0000","last_fullsized":"2024-09-13T19:19:43.841990+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'9","last_scrub_stamp":"2024-09-13T19:19:43.841870+0000","last_deep_scrub":"36'9","last_deep_scrub_stamp":"2024-09-13T19:19:43.841870+0000","last_clean_scrub_stamp":"2024-09-13T19:19:43.841870+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:01.817243+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"36'13","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:32.054330+0000","last_change":"2024-09-13T19:19:32.054330+0000","last_active":"2024-09-13T19:19:32.054330+0000","last_peered":"2024-09-13T19:19:32.054330+0000","last_clean":"2024-09-13T19:19:32.054330+0000","last_became_active":"2024-09-13T19:15:57.900905+0000","last_became_peered":"2024-09-13T19:15:57.900905+0000","last_unstale":"2024-09-13T19:19:32.054330+0000","last_undegraded":"2024-09-13T19:19:32.054330+0000","last_fullsized":"2024-09-13T19:19:32.054330+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'13","last_scrub_stamp":"2024-09-13T19:19:32.054214+0000","last_deep_scrub":"36'13","last_deep_scrub_stamp":"2024-09-13T19:19:32.054214+0000","last_clean_scrub_stamp":"2024-09-13T19:19:32.054214+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:27.473875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"36'119","reported_seq":217,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:02.103919+0000","last_change":"2024-09-13T19:20:02.103971+0000","last_active":"2024-09-13T19:20:02.103919+0000","last_peered":"2024-09-13T19:20:02.103919+0000","last_clean":"2024-09-13T19:20:02.103919+0000","last_became_active":"2024-09-13T19:15:41.169707+0000","last_became_peered":"2024-09-13T19:15:41.169707+0000","last_unstale":"2024-09-13T19:20:02.103919+0000","last_undegraded":"2024-09-13T19:20:02.103919+0000","last_fullsized":"2024-09-13T19:20:02.103919+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'119","last_scrub_stamp":"2024-09-13T19:20:02.103817+0000","last_deep_scrub":"36'119","last_deep_scrub_stamp":"2024-09-13T19:20:02.103817+0000","last_clean_scrub_stamp":"2024-09-13T19:20:02.103817+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:35:48.526437+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"36'2","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:28.043602+0000","last_change":"2024-09-13T19:20:28.043630+0000","last_active":"2024-09-13T19:20:28.043602+0000","last_peered":"2024-09-13T19:20:28.043602+0000","last_clean":"2024-09-13T19:20:28.043602+0000","last_became_active":"2024-09-13T19:15:44.577382+0000","last_became_peered":"2024-09-13T19:15:44.577382+0000","last_unstale":"2024-09-13T19:20:28.043602+0000","last_undegraded":"2024-09-13T19:20:28.043602+0000","last_fullsized":"2024-09-13T19:20:28.043602+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:20:28.043510+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:20:28.043510+0000","last_clean_scrub_stamp":"2024-09-13T19:20:28.043510+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:09.474886+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00047916199999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:05.909175+0000","last_change":"2024-09-13T19:20:05.909175+0000","last_active":"2024-09-13T19:20:05.909175+0000","last_peered":"2024-09-13T19:20:05.909175+0000","last_clean":"2024-09-13T19:20:05.909175+0000","last_became_active":"2024-09-13T19:15:55.899672+0000","last_became_peered":"2024-09-13T19:15:55.899672+0000","last_unstale":"2024-09-13T19:20:05.909175+0000","last_undegraded":"2024-09-13T19:20:05.909175+0000","last_fullsized":"2024-09-13T19:20:05.909175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:05.909049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:05.909049+0000","last_clean_scrub_stamp":"2024-09-13T19:20:05.909049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:51.724581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:33.821056+0000","last_change":"2024-09-13T19:19:33.821056+0000","last_active":"2024-09-13T19:19:33.821056+0000","last_peered":"2024-09-13T19:19:33.821056+0000","last_clean":"2024-09-13T19:19:33.821056+0000","last_became_active":"2024-09-13T19:15:59.891615+0000","last_became_peered":"2024-09-13T19:15:59.891615+0000","last_unstale":"2024-09-13T19:19:33.821056+0000","last_undegraded":"2024-09-13T19:19:33.821056+0000","last_fullsized":"2024-09-13T19:19:33.821056+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:33.820938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:33.820938+0000","last_clean_scrub_stamp":"2024-09-13T19:19:33.820938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:08.178435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"36'87","reported_seq":178,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:35.064073+0000","last_change":"2024-09-13T19:19:35.064073+0000","last_active":"2024-09-13T19:19:35.064073+0000","last_peered":"2024-09-13T19:19:35.064073+0000","last_clean":"2024-09-13T19:19:35.064073+0000","last_became_active":"2024-09-13T19:16:01.905085+0000","last_became_peered":"2024-09-13T19:16:01.905085+0000","last_unstale":"2024-09-13T19:19:35.064073+0000","last_undegraded":"2024-09-13T19:19:35.064073+0000","last_fullsized":"2024-09-13T19:19:35.064073+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'87","last_scrub_stamp":"2024-09-13T19:19:35.063922+0000","last_deep_scrub":"36'87","last_deep_scrub_stamp":"2024-09-13T19:19:35.063922+0000","last_clean_scrub_stamp":"2024-09-13T19:19:35.063922+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:35:21.486542+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:29.339050+0000","last_change":"2024-09-13T19:19:29.339050+0000","last_active":"2024-09-13T19:19:29.339050+0000","last_peered":"2024-09-13T19:19:29.339050+0000","last_clean":"2024-09-13T19:19:29.339050+0000","last_became_active":"2024-09-13T19:16:03.913802+0000","last_became_peered":"2024-09-13T19:16:03.913802+0000","last_unstale":"2024-09-13T19:19:29.339050+0000","last_undegraded":"2024-09-13T19:19:29.339050+0000","last_fullsized":"2024-09-13T19:19:29.339050+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:29.338926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:29.338926+0000","last_clean_scrub_stamp":"2024-09-13T19:19:29.338926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:01.790473+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"36'89","reported_seq":197,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:35.858501+0000","last_change":"2024-09-13T19:19:35.858501+0000","last_active":"2024-09-13T19:19:35.858501+0000","last_peered":"2024-09-13T19:19:35.858501+0000","last_clean":"2024-09-13T19:19:35.858501+0000","last_became_active":"2024-09-13T19:16:05.911595+0000","last_became_peered":"2024-09-13T19:16:05.911595+0000","last_unstale":"2024-09-13T19:19:35.858501+0000","last_undegraded":"2024-09-13T19:19:35.858501+0000","last_fullsized":"2024-09-13T19:19:35.858501+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'89","last_scrub_stamp":"2024-09-13T19:19:35.858385+0000","last_deep_scrub":"36'89","last_deep_scrub_stamp":"2024-09-13T19:19:35.858385+0000","last_clean_scrub_stamp":"2024-09-13T19:19:35.858385+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:44:48.738301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":289,"num_read_kb":269,"num_write":182,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"36'4","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:51.888342+0000","last_change":"2024-09-13T19:19:51.888342+0000","last_active":"2024-09-13T19:19:51.888342+0000","last_peered":"2024-09-13T19:19:51.888342+0000","last_clean":"2024-09-13T19:19:51.888342+0000","last_became_active":"2024-09-13T19:15:57.897307+0000","last_became_peered":"2024-09-13T19:15:57.897307+0000","last_unstale":"2024-09-13T19:19:51.888342+0000","last_undegraded":"2024-09-13T19:19:51.888342+0000","last_fullsized":"2024-09-13T19:19:51.888342+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:19:51.888223+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:19:51.888223+0000","last_clean_scrub_stamp":"2024-09-13T19:19:51.888223+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:42:47.629919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:27.079687+0000","last_change":"2024-09-13T19:20:27.079712+0000","last_active":"2024-09-13T19:20:27.079687+0000","last_peered":"2024-09-13T19:20:27.079687+0000","last_clean":"2024-09-13T19:20:27.079687+0000","last_became_active":"2024-09-13T19:15:44.576304+0000","last_became_peered":"2024-09-13T19:15:44.576304+0000","last_unstale":"2024-09-13T19:20:27.079687+0000","last_undegraded":"2024-09-13T19:20:27.079687+0000","last_fullsized":"2024-09-13T19:20:27.079687+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:27.079602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:27.079602+0000","last_clean_scrub_stamp":"2024-09-13T19:20:27.079602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:43.029885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011332060000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"36'4","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:07.532251+0000","last_change":"2024-09-13T19:20:07.532331+0000","last_active":"2024-09-13T19:20:07.532251+0000","last_peered":"2024-09-13T19:20:07.532251+0000","last_clean":"2024-09-13T19:20:07.532251+0000","last_became_active":"2024-09-13T19:15:55.891377+0000","last_became_peered":"2024-09-13T19:15:55.891377+0000","last_unstale":"2024-09-13T19:20:07.532251+0000","last_undegraded":"2024-09-13T19:20:07.532251+0000","last_fullsized":"2024-09-13T19:20:07.532251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:20:07.532141+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:20:07.532141+0000","last_clean_scrub_stamp":"2024-09-13T19:20:07.532141+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:36.325943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:22.039024+0000","last_change":"2024-09-13T19:19:22.039024+0000","last_active":"2024-09-13T19:19:22.039024+0000","last_peered":"2024-09-13T19:19:22.039024+0000","last_clean":"2024-09-13T19:19:22.039024+0000","last_became_active":"2024-09-13T19:15:59.896248+0000","last_became_peered":"2024-09-13T19:15:59.896248+0000","last_unstale":"2024-09-13T19:19:22.039024+0000","last_undegraded":"2024-09-13T19:19:22.039024+0000","last_fullsized":"2024-09-13T19:19:22.039024+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:22.038847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:22.038847+0000","last_clean_scrub_stamp":"2024-09-13T19:19:22.038847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:43:03.494237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"36'291","reported_seq":517,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:17.746426+0000","last_change":"2024-09-13T19:19:17.746426+0000","last_active":"2024-09-13T19:19:17.746426+0000","last_peered":"2024-09-13T19:19:17.746426+0000","last_clean":"2024-09-13T19:19:17.746426+0000","last_became_active":"2024-09-13T19:16:01.907024+0000","last_became_peered":"2024-09-13T19:16:01.907024+0000","last_unstale":"2024-09-13T19:19:17.746426+0000","last_undegraded":"2024-09-13T19:19:17.746426+0000","last_fullsized":"2024-09-13T19:19:17.746426+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'291","last_scrub_stamp":"2024-09-13T19:19:17.746277+0000","last_deep_scrub":"36'291","last_deep_scrub_stamp":"2024-09-13T19:19:17.746277+0000","last_clean_scrub_stamp":"2024-09-13T19:19:17.746277+0000","objects_scrubbed":10,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:14.177663+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:42.977665+0000","last_change":"2024-09-13T19:19:42.977665+0000","last_active":"2024-09-13T19:19:42.977665+0000","last_peered":"2024-09-13T19:19:42.977665+0000","last_clean":"2024-09-13T19:19:42.977665+0000","last_became_active":"2024-09-13T19:16:03.915712+0000","last_became_peered":"2024-09-13T19:16:03.915712+0000","last_unstale":"2024-09-13T19:19:42.977665+0000","last_undegraded":"2024-09-13T19:19:42.977665+0000","last_fullsized":"2024-09-13T19:19:42.977665+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:42.977545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:42.977545+0000","last_clean_scrub_stamp":"2024-09-13T19:19:42.977545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:25.110230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"36'3","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:13.028953+0000","last_change":"2024-09-13T19:20:13.028953+0000","last_active":"2024-09-13T19:20:13.028953+0000","last_peered":"2024-09-13T19:20:13.028953+0000","last_clean":"2024-09-13T19:20:13.028953+0000","last_became_active":"2024-09-13T19:16:05.916999+0000","last_became_peered":"2024-09-13T19:16:05.916999+0000","last_unstale":"2024-09-13T19:20:13.028953+0000","last_undegraded":"2024-09-13T19:20:13.028953+0000","last_fullsized":"2024-09-13T19:20:13.028953+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-13T19:20:13.028808+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-13T19:20:13.028808+0000","last_clean_scrub_stamp":"2024-09-13T19:20:13.028808+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:31:31.828079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:59.635953+0000","last_change":"2024-09-13T19:19:59.635953+0000","last_active":"2024-09-13T19:19:59.635953+0000","last_peered":"2024-09-13T19:19:59.635953+0000","last_clean":"2024-09-13T19:19:59.635953+0000","last_became_active":"2024-09-13T19:15:57.889885+0000","last_became_peered":"2024-09-13T19:15:57.889885+0000","last_unstale":"2024-09-13T19:19:59.635953+0000","last_undegraded":"2024-09-13T19:19:59.635953+0000","last_fullsized":"2024-09-13T19:19:59.635953+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:19:59.635832+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:19:59.635832+0000","last_clean_scrub_stamp":"2024-09-13T19:19:59.635832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:11.239363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:57.558472+0000","last_change":"2024-09-13T19:19:57.558512+0000","last_active":"2024-09-13T19:19:57.558472+0000","last_peered":"2024-09-13T19:19:57.558472+0000","last_clean":"2024-09-13T19:19:57.558472+0000","last_became_active":"2024-09-13T19:15:44.575483+0000","last_became_peered":"2024-09-13T19:15:44.575483+0000","last_unstale":"2024-09-13T19:19:57.558472+0000","last_undegraded":"2024-09-13T19:19:57.558472+0000","last_fullsized":"2024-09-13T19:19:57.558472+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:57.558357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:57.558357+0000","last_clean_scrub_stamp":"2024-09-13T19:19:57.558357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:49.942957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036796000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"36'6","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:10.464777+0000","last_change":"2024-09-13T19:20:10.464804+0000","last_active":"2024-09-13T19:20:10.464777+0000","last_peered":"2024-09-13T19:20:10.464777+0000","last_clean":"2024-09-13T19:20:10.464777+0000","last_became_active":"2024-09-13T19:15:55.892629+0000","last_became_peered":"2024-09-13T19:15:55.892629+0000","last_unstale":"2024-09-13T19:20:10.464777+0000","last_undegraded":"2024-09-13T19:20:10.464777+0000","last_fullsized":"2024-09-13T19:20:10.464777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:20:10.464678+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:20:10.464678+0000","last_clean_scrub_stamp":"2024-09-13T19:20:10.464678+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:02:22.663147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:36.827027+0000","last_change":"2024-09-13T19:19:36.827027+0000","last_active":"2024-09-13T19:19:36.827027+0000","last_peered":"2024-09-13T19:19:36.827027+0000","last_clean":"2024-09-13T19:19:36.827027+0000","last_became_active":"2024-09-13T19:15:59.891588+0000","last_became_peered":"2024-09-13T19:15:59.891588+0000","last_unstale":"2024-09-13T19:19:36.827027+0000","last_undegraded":"2024-09-13T19:19:36.827027+0000","last_fullsized":"2024-09-13T19:19:36.827027+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:36.826862+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:36.826862+0000","last_clean_scrub_stamp":"2024-09-13T19:19:36.826862+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:13:00.231898+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'23","reported_seq":101,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:28.812189+0000","last_change":"2024-09-13T19:19:28.812189+0000","last_active":"2024-09-13T19:19:28.812189+0000","last_peered":"2024-09-13T19:19:28.812189+0000","last_clean":"2024-09-13T19:19:28.812189+0000","last_became_active":"2024-09-13T19:16:01.903947+0000","last_became_peered":"2024-09-13T19:16:01.903947+0000","last_unstale":"2024-09-13T19:19:28.812189+0000","last_undegraded":"2024-09-13T19:19:28.812189+0000","last_fullsized":"2024-09-13T19:19:28.812189+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'23","last_scrub_stamp":"2024-09-13T19:19:28.812026+0000","last_deep_scrub":"36'23","last_deep_scrub_stamp":"2024-09-13T19:19:28.812026+0000","last_clean_scrub_stamp":"2024-09-13T19:19:28.812026+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:37.761542+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:17.389541+0000","last_change":"2024-09-13T19:19:17.389541+0000","last_active":"2024-09-13T19:19:17.389541+0000","last_peered":"2024-09-13T19:19:17.389541+0000","last_clean":"2024-09-13T19:19:17.389541+0000","last_became_active":"2024-09-13T19:16:03.910776+0000","last_became_peered":"2024-09-13T19:16:03.910776+0000","last_unstale":"2024-09-13T19:19:17.389541+0000","last_undegraded":"2024-09-13T19:19:17.389541+0000","last_fullsized":"2024-09-13T19:19:17.389541+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:17.389460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:17.389460+0000","last_clean_scrub_stamp":"2024-09-13T19:19:17.389460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:17:14.265847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"36'2","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:02.956015+0000","last_change":"2024-09-13T19:20:02.956015+0000","last_active":"2024-09-13T19:20:02.956015+0000","last_peered":"2024-09-13T19:20:02.956015+0000","last_clean":"2024-09-13T19:20:02.956015+0000","last_became_active":"2024-09-13T19:16:05.920191+0000","last_became_peered":"2024-09-13T19:16:05.920191+0000","last_unstale":"2024-09-13T19:20:02.956015+0000","last_undegraded":"2024-09-13T19:20:02.956015+0000","last_fullsized":"2024-09-13T19:20:02.956015+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:20:02.955898+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:20:02.955898+0000","last_clean_scrub_stamp":"2024-09-13T19:20:02.955898+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:47:52.449314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"36'12","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:51.707637+0000","last_change":"2024-09-13T19:19:51.707637+0000","last_active":"2024-09-13T19:19:51.707637+0000","last_peered":"2024-09-13T19:19:51.707637+0000","last_clean":"2024-09-13T19:19:51.707637+0000","last_became_active":"2024-09-13T19:15:57.886273+0000","last_became_peered":"2024-09-13T19:15:57.886273+0000","last_unstale":"2024-09-13T19:19:51.707637+0000","last_undegraded":"2024-09-13T19:19:51.707637+0000","last_fullsized":"2024-09-13T19:19:51.707637+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-13T19:19:51.707517+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-13T19:19:51.707517+0000","last_clean_scrub_stamp":"2024-09-13T19:19:51.707517+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:13.558324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":44,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"36'3","reported_seq":68,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:26.056535+0000","last_change":"2024-09-13T19:20:26.056608+0000","last_active":"2024-09-13T19:20:26.056535+0000","last_peered":"2024-09-13T19:20:26.056535+0000","last_clean":"2024-09-13T19:20:26.056535+0000","last_became_active":"2024-09-13T19:15:44.576052+0000","last_became_peered":"2024-09-13T19:15:44.576052+0000","last_unstale":"2024-09-13T19:20:26.056535+0000","last_undegraded":"2024-09-13T19:20:26.056535+0000","last_fullsized":"2024-09-13T19:20:26.056535+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-13T19:20:26.056433+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-13T19:20:26.056433+0000","last_clean_scrub_stamp":"2024-09-13T19:20:26.056433+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:34:39.072899+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0012221599999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"36'4","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:04.539043+0000","last_change":"2024-09-13T19:20:04.539043+0000","last_active":"2024-09-13T19:20:04.539043+0000","last_peered":"2024-09-13T19:20:04.539043+0000","last_clean":"2024-09-13T19:20:04.539043+0000","last_became_active":"2024-09-13T19:15:55.892636+0000","last_became_peered":"2024-09-13T19:15:55.892636+0000","last_unstale":"2024-09-13T19:20:04.539043+0000","last_undegraded":"2024-09-13T19:20:04.539043+0000","last_fullsized":"2024-09-13T19:20:04.539043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:20:04.538913+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:20:04.538913+0000","last_clean_scrub_stamp":"2024-09-13T19:20:04.538913+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:59.958573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:34.461541+0000","last_change":"2024-09-13T19:19:34.461541+0000","last_active":"2024-09-13T19:19:34.461541+0000","last_peered":"2024-09-13T19:19:34.461541+0000","last_clean":"2024-09-13T19:19:34.461541+0000","last_became_active":"2024-09-13T19:15:59.896248+0000","last_became_peered":"2024-09-13T19:15:59.896248+0000","last_unstale":"2024-09-13T19:19:34.461541+0000","last_undegraded":"2024-09-13T19:19:34.461541+0000","last_fullsized":"2024-09-13T19:19:34.461541+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:34.461398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:34.461398+0000","last_clean_scrub_stamp":"2024-09-13T19:19:34.461398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:38.595301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'20","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:47.912445+0000","last_change":"2024-09-13T19:19:47.912445+0000","last_active":"2024-09-13T19:19:47.912445+0000","last_peered":"2024-09-13T19:19:47.912445+0000","last_clean":"2024-09-13T19:19:47.912445+0000","last_became_active":"2024-09-13T19:16:01.905280+0000","last_became_peered":"2024-09-13T19:16:01.905280+0000","last_unstale":"2024-09-13T19:19:47.912445+0000","last_undegraded":"2024-09-13T19:19:47.912445+0000","last_fullsized":"2024-09-13T19:19:47.912445+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'20","last_scrub_stamp":"2024-09-13T19:19:47.912299+0000","last_deep_scrub":"36'20","last_deep_scrub_stamp":"2024-09-13T19:19:47.912299+0000","last_clean_scrub_stamp":"2024-09-13T19:19:47.912299+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:39.230968+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:46.871092+0000","last_change":"2024-09-13T19:19:46.871092+0000","last_active":"2024-09-13T19:19:46.871092+0000","last_peered":"2024-09-13T19:19:46.871092+0000","last_clean":"2024-09-13T19:19:46.871092+0000","last_became_active":"2024-09-13T19:16:03.916344+0000","last_became_peered":"2024-09-13T19:16:03.916344+0000","last_unstale":"2024-09-13T19:19:46.871092+0000","last_undegraded":"2024-09-13T19:19:46.871092+0000","last_fullsized":"2024-09-13T19:19:46.871092+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:46.870973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:46.870973+0000","last_clean_scrub_stamp":"2024-09-13T19:19:46.870973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:23:10.637473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"36'4","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:13.996642+0000","last_change":"2024-09-13T19:20:13.996642+0000","last_active":"2024-09-13T19:20:13.996642+0000","last_peered":"2024-09-13T19:20:13.996642+0000","last_clean":"2024-09-13T19:20:13.996642+0000","last_became_active":"2024-09-13T19:16:05.919156+0000","last_became_peered":"2024-09-13T19:16:05.919156+0000","last_unstale":"2024-09-13T19:20:13.996642+0000","last_undegraded":"2024-09-13T19:20:13.996642+0000","last_fullsized":"2024-09-13T19:20:13.996642+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:20:13.996518+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:20:13.996518+0000","last_clean_scrub_stamp":"2024-09-13T19:20:13.996518+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:59:38.021261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"36'18","reported_seq":79,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:40.864674+0000","last_change":"2024-09-13T19:19:40.864674+0000","last_active":"2024-09-13T19:19:40.864674+0000","last_peered":"2024-09-13T19:19:40.864674+0000","last_clean":"2024-09-13T19:19:40.864674+0000","last_became_active":"2024-09-13T19:15:57.902819+0000","last_became_peered":"2024-09-13T19:15:57.902819+0000","last_unstale":"2024-09-13T19:19:40.864674+0000","last_undegraded":"2024-09-13T19:19:40.864674+0000","last_fullsized":"2024-09-13T19:19:40.864674+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'18","last_scrub_stamp":"2024-09-13T19:19:40.864526+0000","last_deep_scrub":"36'18","last_deep_scrub_stamp":"2024-09-13T19:19:40.864526+0000","last_clean_scrub_stamp":"2024-09-13T19:19:40.864526+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:41.407519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":50,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:56.588557+0000","last_change":"2024-09-13T19:19:56.588557+0000","last_active":"2024-09-13T19:19:56.588557+0000","last_peered":"2024-09-13T19:19:56.588557+0000","last_clean":"2024-09-13T19:19:56.588557+0000","last_became_active":"2024-09-13T19:15:55.893468+0000","last_became_peered":"2024-09-13T19:15:55.893468+0000","last_unstale":"2024-09-13T19:19:56.588557+0000","last_undegraded":"2024-09-13T19:19:56.588557+0000","last_fullsized":"2024-09-13T19:19:56.588557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:19:56.588443+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:19:56.588443+0000","last_clean_scrub_stamp":"2024-09-13T19:19:56.588443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:05.049618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:04.583147+0000","last_change":"2024-09-13T19:20:04.583169+0000","last_active":"2024-09-13T19:20:04.583147+0000","last_peered":"2024-09-13T19:20:04.583147+0000","last_clean":"2024-09-13T19:20:04.583147+0000","last_became_active":"2024-09-13T19:15:44.575726+0000","last_became_peered":"2024-09-13T19:15:44.575726+0000","last_unstale":"2024-09-13T19:20:04.583147+0000","last_undegraded":"2024-09-13T19:20:04.583147+0000","last_fullsized":"2024-09-13T19:20:04.583147+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:04.583059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:04.583059+0000","last_clean_scrub_stamp":"2024-09-13T19:20:04.583059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:35:00.459031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041430200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"36'2","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:08.533281+0000","last_change":"2024-09-13T19:20:08.533281+0000","last_active":"2024-09-13T19:20:08.533281+0000","last_peered":"2024-09-13T19:20:08.533281+0000","last_clean":"2024-09-13T19:20:08.533281+0000","last_became_active":"2024-09-13T19:16:31.990669+0000","last_became_peered":"2024-09-13T19:16:31.990669+0000","last_unstale":"2024-09-13T19:20:08.533281+0000","last_undegraded":"2024-09-13T19:20:08.533281+0000","last_fullsized":"2024-09-13T19:20:08.533281+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:20:08.533151+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:20:08.533151+0000","last_clean_scrub_stamp":"2024-09-13T19:20:08.533151+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:56:29.841704+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"36'73","reported_seq":150,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:28.341123+0000","last_change":"2024-09-13T19:19:28.341123+0000","last_active":"2024-09-13T19:19:28.341123+0000","last_peered":"2024-09-13T19:19:28.341123+0000","last_clean":"2024-09-13T19:19:28.341123+0000","last_became_active":"2024-09-13T19:16:01.902095+0000","last_became_peered":"2024-09-13T19:16:01.902095+0000","last_unstale":"2024-09-13T19:19:28.341123+0000","last_undegraded":"2024-09-13T19:19:28.341123+0000","last_fullsized":"2024-09-13T19:19:28.341123+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'73","last_scrub_stamp":"2024-09-13T19:19:28.340973+0000","last_deep_scrub":"36'73","last_deep_scrub_stamp":"2024-09-13T19:19:28.340973+0000","last_clean_scrub_stamp":"2024-09-13T19:19:28.340973+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:31:45.923087+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:21.760567+0000","last_change":"2024-09-13T19:19:21.760567+0000","last_active":"2024-09-13T19:19:21.760567+0000","last_peered":"2024-09-13T19:19:21.760567+0000","last_clean":"2024-09-13T19:19:21.760567+0000","last_became_active":"2024-09-13T19:16:03.909803+0000","last_became_peered":"2024-09-13T19:16:03.909803+0000","last_unstale":"2024-09-13T19:19:21.760567+0000","last_undegraded":"2024-09-13T19:19:21.760567+0000","last_fullsized":"2024-09-13T19:19:21.760567+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:21.760449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:21.760449+0000","last_clean_scrub_stamp":"2024-09-13T19:19:21.760449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:57.014320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"36'11","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:16.494500+0000","last_change":"2024-09-13T19:20:16.494500+0000","last_active":"2024-09-13T19:20:16.494500+0000","last_peered":"2024-09-13T19:20:16.494500+0000","last_clean":"2024-09-13T19:20:16.494500+0000","last_became_active":"2024-09-13T19:16:05.915672+0000","last_became_peered":"2024-09-13T19:16:05.915672+0000","last_unstale":"2024-09-13T19:20:16.494500+0000","last_undegraded":"2024-09-13T19:20:16.494500+0000","last_fullsized":"2024-09-13T19:20:16.494500+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'11","last_scrub_stamp":"2024-09-13T19:20:16.494379+0000","last_deep_scrub":"36'11","last_deep_scrub_stamp":"2024-09-13T19:20:16.494379+0000","last_clean_scrub_stamp":"2024-09-13T19:20:16.494379+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:31.484004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"36'10","reported_seq":69,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:38.781574+0000","last_change":"2024-09-13T19:19:38.781574+0000","last_active":"2024-09-13T19:19:38.781574+0000","last_peered":"2024-09-13T19:19:38.781574+0000","last_clean":"2024-09-13T19:19:38.781574+0000","last_became_active":"2024-09-13T19:15:57.902793+0000","last_became_peered":"2024-09-13T19:15:57.902793+0000","last_unstale":"2024-09-13T19:19:38.781574+0000","last_undegraded":"2024-09-13T19:19:38.781574+0000","last_fullsized":"2024-09-13T19:19:38.781574+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-13T19:19:38.781447+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-13T19:19:38.781447+0000","last_clean_scrub_stamp":"2024-09-13T19:19:38.781447+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:50.170162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:56.680541+0000","last_change":"2024-09-13T19:19:56.680541+0000","last_active":"2024-09-13T19:19:56.680541+0000","last_peered":"2024-09-13T19:19:56.680541+0000","last_clean":"2024-09-13T19:19:56.680541+0000","last_became_active":"2024-09-13T19:15:55.894340+0000","last_became_peered":"2024-09-13T19:15:55.894340+0000","last_unstale":"2024-09-13T19:19:56.680541+0000","last_undegraded":"2024-09-13T19:19:56.680541+0000","last_fullsized":"2024-09-13T19:19:56.680541+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:56.680427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:56.680427+0000","last_clean_scrub_stamp":"2024-09-13T19:19:56.680427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:52:19.982338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:25.096785+0000","last_change":"2024-09-13T19:20:25.096836+0000","last_active":"2024-09-13T19:20:25.096785+0000","last_peered":"2024-09-13T19:20:25.096785+0000","last_clean":"2024-09-13T19:20:25.096785+0000","last_became_active":"2024-09-13T19:15:44.576006+0000","last_became_peered":"2024-09-13T19:15:44.576006+0000","last_unstale":"2024-09-13T19:20:25.096785+0000","last_undegraded":"2024-09-13T19:20:25.096785+0000","last_fullsized":"2024-09-13T19:20:25.096785+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:25.096633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:25.096633+0000","last_clean_scrub_stamp":"2024-09-13T19:20:25.096633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:12.807745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013309299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:26.089170+0000","last_change":"2024-09-13T19:19:26.089170+0000","last_active":"2024-09-13T19:19:26.089170+0000","last_peered":"2024-09-13T19:19:26.089170+0000","last_clean":"2024-09-13T19:19:26.089170+0000","last_became_active":"2024-09-13T19:15:59.894761+0000","last_became_peered":"2024-09-13T19:15:59.894761+0000","last_unstale":"2024-09-13T19:19:26.089170+0000","last_undegraded":"2024-09-13T19:19:26.089170+0000","last_fullsized":"2024-09-13T19:19:26.089170+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:26.089011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:26.089011+0000","last_clean_scrub_stamp":"2024-09-13T19:19:26.089011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:08.982394+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"36'21","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:16.767496+0000","last_change":"2024-09-13T19:19:16.767496+0000","last_active":"2024-09-13T19:19:16.767496+0000","last_peered":"2024-09-13T19:19:16.767496+0000","last_clean":"2024-09-13T19:19:16.767496+0000","last_became_active":"2024-09-13T19:16:01.907419+0000","last_became_peered":"2024-09-13T19:16:01.907419+0000","last_unstale":"2024-09-13T19:19:16.767496+0000","last_undegraded":"2024-09-13T19:19:16.767496+0000","last_fullsized":"2024-09-13T19:19:16.767496+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'21","last_scrub_stamp":"2024-09-13T19:19:16.767339+0000","last_deep_scrub":"36'21","last_deep_scrub_stamp":"2024-09-13T19:19:16.767339+0000","last_clean_scrub_stamp":"2024-09-13T19:19:16.767339+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:34.127072+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"36'285","reported_seq":359,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:23.651260+0000","last_change":"2024-09-13T19:19:23.651260+0000","last_active":"2024-09-13T19:19:23.651260+0000","last_peered":"2024-09-13T19:19:23.651260+0000","last_clean":"2024-09-13T19:19:23.651260+0000","last_became_active":"2024-09-13T19:16:03.907957+0000","last_became_peered":"2024-09-13T19:16:03.907957+0000","last_unstale":"2024-09-13T19:19:23.651260+0000","last_undegraded":"2024-09-13T19:19:23.651260+0000","last_fullsized":"2024-09-13T19:19:23.651260+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-13T19:19:23.651077+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-13T19:19:23.651077+0000","last_clean_scrub_stamp":"2024-09-13T19:19:23.651077+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:39:32.329566+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"34'2","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:37.028070+0000","last_change":"2024-09-13T19:20:37.028070+0000","last_active":"2024-09-13T19:20:37.028070+0000","last_peered":"2024-09-13T19:20:37.028070+0000","last_clean":"2024-09-13T19:20:37.028070+0000","last_became_active":"2024-09-13T19:16:05.924162+0000","last_became_peered":"2024-09-13T19:16:05.924162+0000","last_unstale":"2024-09-13T19:20:37.028070+0000","last_undegraded":"2024-09-13T19:20:37.028070+0000","last_fullsized":"2024-09-13T19:20:37.028070+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:20:37.027913+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:20:37.027913+0000","last_clean_scrub_stamp":"2024-09-13T19:20:37.027913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:17:16.760709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"36'6","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:55.942806+0000","last_change":"2024-09-13T19:19:55.942806+0000","last_active":"2024-09-13T19:19:55.942806+0000","last_peered":"2024-09-13T19:19:55.942806+0000","last_clean":"2024-09-13T19:19:55.942806+0000","last_became_active":"2024-09-13T19:15:57.896078+0000","last_became_peered":"2024-09-13T19:15:57.896078+0000","last_unstale":"2024-09-13T19:19:55.942806+0000","last_undegraded":"2024-09-13T19:19:55.942806+0000","last_fullsized":"2024-09-13T19:19:55.942806+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:19:55.942686+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:19:55.942686+0000","last_clean_scrub_stamp":"2024-09-13T19:19:55.942686+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:37.569282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:07.952015+0000","last_change":"2024-09-13T19:20:07.952015+0000","last_active":"2024-09-13T19:20:07.952015+0000","last_peered":"2024-09-13T19:20:07.952015+0000","last_clean":"2024-09-13T19:20:07.952015+0000","last_became_active":"2024-09-13T19:15:55.895282+0000","last_became_peered":"2024-09-13T19:15:55.895282+0000","last_unstale":"2024-09-13T19:20:07.952015+0000","last_undegraded":"2024-09-13T19:20:07.952015+0000","last_fullsized":"2024-09-13T19:20:07.952015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:07.951873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:07.951873+0000","last_clean_scrub_stamp":"2024-09-13T19:20:07.951873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:24.347833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:03.610700+0000","last_change":"2024-09-13T19:20:03.610700+0000","last_active":"2024-09-13T19:20:03.610700+0000","last_peered":"2024-09-13T19:20:03.610700+0000","last_clean":"2024-09-13T19:20:03.610700+0000","last_became_active":"2024-09-13T19:15:44.574967+0000","last_became_peered":"2024-09-13T19:15:44.574967+0000","last_unstale":"2024-09-13T19:20:03.610700+0000","last_undegraded":"2024-09-13T19:20:03.610700+0000","last_fullsized":"2024-09-13T19:20:03.610700+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:03.610567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:03.610567+0000","last_clean_scrub_stamp":"2024-09-13T19:20:03.610567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:27.117889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049330999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"36'2","reported_seq":231,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:25.112490+0000","last_change":"2024-09-13T19:19:25.112490+0000","last_active":"2024-09-13T19:19:25.112490+0000","last_peered":"2024-09-13T19:19:25.112490+0000","last_clean":"2024-09-13T19:19:25.112490+0000","last_became_active":"2024-09-13T19:15:59.894966+0000","last_became_peered":"2024-09-13T19:15:59.894966+0000","last_unstale":"2024-09-13T19:19:25.112490+0000","last_undegraded":"2024-09-13T19:19:25.112490+0000","last_fullsized":"2024-09-13T19:19:25.112490+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:25.112380+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:25.112380+0000","last_clean_scrub_stamp":"2024-09-13T19:19:25.112380+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:41.200956+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"36'16","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:27.099288+0000","last_change":"2024-09-13T19:19:27.099288+0000","last_active":"2024-09-13T19:19:27.099288+0000","last_peered":"2024-09-13T19:19:27.099288+0000","last_clean":"2024-09-13T19:19:27.099288+0000","last_became_active":"2024-09-13T19:16:01.902739+0000","last_became_peered":"2024-09-13T19:16:01.902739+0000","last_unstale":"2024-09-13T19:19:27.099288+0000","last_undegraded":"2024-09-13T19:19:27.099288+0000","last_fullsized":"2024-09-13T19:19:27.099288+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-13T19:19:27.099139+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-13T19:19:27.099139+0000","last_clean_scrub_stamp":"2024-09-13T19:19:27.099139+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:22:57.737015+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"36'285","reported_seq":430,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:22.346094+0000","last_change":"2024-09-13T19:19:22.346094+0000","last_active":"2024-09-13T19:19:22.346094+0000","last_peered":"2024-09-13T19:19:22.346094+0000","last_clean":"2024-09-13T19:19:22.346094+0000","last_became_active":"2024-09-13T19:16:03.909038+0000","last_became_peered":"2024-09-13T19:16:03.909038+0000","last_unstale":"2024-09-13T19:19:22.346094+0000","last_undegraded":"2024-09-13T19:19:22.346094+0000","last_fullsized":"2024-09-13T19:19:22.346094+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-13T19:19:22.345954+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-13T19:19:22.345954+0000","last_clean_scrub_stamp":"2024-09-13T19:19:22.345954+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:07.575589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'3","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:15.955177+0000","last_change":"2024-09-13T19:20:15.955177+0000","last_active":"2024-09-13T19:20:15.955177+0000","last_peered":"2024-09-13T19:20:15.955177+0000","last_clean":"2024-09-13T19:20:15.955177+0000","last_became_active":"2024-09-13T19:16:05.923739+0000","last_became_peered":"2024-09-13T19:16:05.923739+0000","last_unstale":"2024-09-13T19:20:15.955177+0000","last_undegraded":"2024-09-13T19:20:15.955177+0000","last_fullsized":"2024-09-13T19:20:15.955177+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-13T19:20:15.955048+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-13T19:20:15.955048+0000","last_clean_scrub_stamp":"2024-09-13T19:20:15.955048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:09:41.087987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"36'6","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:51.725112+0000","last_change":"2024-09-13T19:19:51.725112+0000","last_active":"2024-09-13T19:19:51.725112+0000","last_peered":"2024-09-13T19:19:51.725112+0000","last_clean":"2024-09-13T19:19:51.725112+0000","last_became_active":"2024-09-13T19:15:57.897727+0000","last_became_peered":"2024-09-13T19:15:57.897727+0000","last_unstale":"2024-09-13T19:19:51.725112+0000","last_undegraded":"2024-09-13T19:19:51.725112+0000","last_fullsized":"2024-09-13T19:19:51.725112+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:19:51.724981+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:19:51.724981+0000","last_clean_scrub_stamp":"2024-09-13T19:19:51.724981+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:11:51.172869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:08.107270+0000","last_change":"2024-09-13T19:20:08.107270+0000","last_active":"2024-09-13T19:20:08.107270+0000","last_peered":"2024-09-13T19:20:08.107270+0000","last_clean":"2024-09-13T19:20:08.107270+0000","last_became_active":"2024-09-13T19:15:55.895394+0000","last_became_peered":"2024-09-13T19:15:55.895394+0000","last_unstale":"2024-09-13T19:20:08.107270+0000","last_undegraded":"2024-09-13T19:20:08.107270+0000","last_fullsized":"2024-09-13T19:20:08.107270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:08.107136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:08.107136+0000","last_clean_scrub_stamp":"2024-09-13T19:20:08.107136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:47.449474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:29.022277+0000","last_change":"2024-09-13T19:20:29.022303+0000","last_active":"2024-09-13T19:20:29.022277+0000","last_peered":"2024-09-13T19:20:29.022277+0000","last_clean":"2024-09-13T19:20:29.022277+0000","last_became_active":"2024-09-13T19:15:44.607248+0000","last_became_peered":"2024-09-13T19:15:44.607248+0000","last_unstale":"2024-09-13T19:20:29.022277+0000","last_undegraded":"2024-09-13T19:20:29.022277+0000","last_fullsized":"2024-09-13T19:20:29.022277+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:29.022179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:29.022179+0000","last_clean_scrub_stamp":"2024-09-13T19:20:29.022179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:15.924418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086245899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:40.107455+0000","last_change":"2024-09-13T19:20:40.107503+0000","last_active":"2024-09-13T19:20:40.107455+0000","last_peered":"2024-09-13T19:20:40.107455+0000","last_clean":"2024-09-13T19:20:40.107455+0000","last_became_active":"2024-09-13T19:16:31.992752+0000","last_became_peered":"2024-09-13T19:16:31.992752+0000","last_unstale":"2024-09-13T19:20:40.107455+0000","last_undegraded":"2024-09-13T19:20:40.107455+0000","last_fullsized":"2024-09-13T19:20:40.107455+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:40.107334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:40.107334+0000","last_clean_scrub_stamp":"2024-09-13T19:20:40.107334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:47.730571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"36'98","reported_seq":192,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:24.778390+0000","last_change":"2024-09-13T19:19:24.778390+0000","last_active":"2024-09-13T19:19:24.778390+0000","last_peered":"2024-09-13T19:19:24.778390+0000","last_clean":"2024-09-13T19:19:24.778390+0000","last_became_active":"2024-09-13T19:16:01.906317+0000","last_became_peered":"2024-09-13T19:16:01.906317+0000","last_unstale":"2024-09-13T19:19:24.778390+0000","last_undegraded":"2024-09-13T19:19:24.778390+0000","last_fullsized":"2024-09-13T19:19:24.778390+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'98","last_scrub_stamp":"2024-09-13T19:19:24.778260+0000","last_deep_scrub":"36'98","last_deep_scrub_stamp":"2024-09-13T19:19:24.778260+0000","last_clean_scrub_stamp":"2024-09-13T19:19:24.778260+0000","objects_scrubbed":8,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:51.569747+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":99,"num_read_kb":103,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:19.338010+0000","last_change":"2024-09-13T19:19:19.338010+0000","last_active":"2024-09-13T19:19:19.338010+0000","last_peered":"2024-09-13T19:19:19.338010+0000","last_clean":"2024-09-13T19:19:19.338010+0000","last_became_active":"2024-09-13T19:16:03.909941+0000","last_became_peered":"2024-09-13T19:16:03.909941+0000","last_unstale":"2024-09-13T19:19:19.338010+0000","last_undegraded":"2024-09-13T19:19:19.338010+0000","last_fullsized":"2024-09-13T19:19:19.338010+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:19.337887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:19.337887+0000","last_clean_scrub_stamp":"2024-09-13T19:19:19.337887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:59.954982+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:31.797143+0000","last_change":"2024-09-13T19:19:31.797143+0000","last_active":"2024-09-13T19:19:31.797143+0000","last_peered":"2024-09-13T19:19:31.797143+0000","last_clean":"2024-09-13T19:19:31.797143+0000","last_became_active":"2024-09-13T19:16:05.911465+0000","last_became_peered":"2024-09-13T19:16:05.911465+0000","last_unstale":"2024-09-13T19:19:31.797143+0000","last_undegraded":"2024-09-13T19:19:31.797143+0000","last_fullsized":"2024-09-13T19:19:31.797143+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:31.797033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:31.797033+0000","last_clean_scrub_stamp":"2024-09-13T19:19:31.797033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:28:44.716045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:06.551512+0000","last_change":"2024-09-13T19:20:06.551512+0000","last_active":"2024-09-13T19:20:06.551512+0000","last_peered":"2024-09-13T19:20:06.551512+0000","last_clean":"2024-09-13T19:20:06.551512+0000","last_became_active":"2024-09-13T19:16:05.917156+0000","last_became_peered":"2024-09-13T19:16:05.917156+0000","last_unstale":"2024-09-13T19:20:06.551512+0000","last_undegraded":"2024-09-13T19:20:06.551512+0000","last_fullsized":"2024-09-13T19:20:06.551512+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:06.551412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:06.551412+0000","last_clean_scrub_stamp":"2024-09-13T19:20:06.551412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:11.518642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"36'8","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:05.520506+0000","last_change":"2024-09-13T19:20:05.520506+0000","last_active":"2024-09-13T19:20:05.520506+0000","last_peered":"2024-09-13T19:20:05.520506+0000","last_clean":"2024-09-13T19:20:05.520506+0000","last_became_active":"2024-09-13T19:15:57.898761+0000","last_became_peered":"2024-09-13T19:15:57.898761+0000","last_unstale":"2024-09-13T19:20:05.520506+0000","last_undegraded":"2024-09-13T19:20:05.520506+0000","last_fullsized":"2024-09-13T19:20:05.520506+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-13T19:20:05.520357+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-13T19:20:05.520357+0000","last_clean_scrub_stamp":"2024-09-13T19:20:05.520357+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:27:43.542866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:09.992800+0000","last_change":"2024-09-13T19:20:09.992800+0000","last_active":"2024-09-13T19:20:09.992800+0000","last_peered":"2024-09-13T19:20:09.992800+0000","last_clean":"2024-09-13T19:20:09.992800+0000","last_became_active":"2024-09-13T19:15:55.892518+0000","last_became_peered":"2024-09-13T19:15:55.892518+0000","last_unstale":"2024-09-13T19:20:09.992800+0000","last_undegraded":"2024-09-13T19:20:09.992800+0000","last_fullsized":"2024-09-13T19:20:09.992800+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:09.992654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:09.992654+0000","last_clean_scrub_stamp":"2024-09-13T19:20:09.992654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:42.323390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:30.756383+0000","last_change":"2024-09-13T19:19:30.756383+0000","last_active":"2024-09-13T19:19:30.756383+0000","last_peered":"2024-09-13T19:19:30.756383+0000","last_clean":"2024-09-13T19:19:30.756383+0000","last_became_active":"2024-09-13T19:15:59.892690+0000","last_became_peered":"2024-09-13T19:15:59.892690+0000","last_unstale":"2024-09-13T19:19:30.756383+0000","last_undegraded":"2024-09-13T19:19:30.756383+0000","last_fullsized":"2024-09-13T19:19:30.756383+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:30.756223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:30.756223+0000","last_clean_scrub_stamp":"2024-09-13T19:19:30.756223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:04:11.520992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"36'40","reported_seq":97,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:31.067778+0000","last_change":"2024-09-13T19:19:31.067778+0000","last_active":"2024-09-13T19:19:31.067778+0000","last_peered":"2024-09-13T19:19:31.067778+0000","last_clean":"2024-09-13T19:19:31.067778+0000","last_became_active":"2024-09-13T19:16:01.904684+0000","last_became_peered":"2024-09-13T19:16:01.904684+0000","last_unstale":"2024-09-13T19:19:31.067778+0000","last_undegraded":"2024-09-13T19:19:31.067778+0000","last_fullsized":"2024-09-13T19:19:31.067778+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'40","last_scrub_stamp":"2024-09-13T19:19:31.067631+0000","last_deep_scrub":"36'40","last_deep_scrub_stamp":"2024-09-13T19:19:31.067631+0000","last_clean_scrub_stamp":"2024-09-13T19:19:31.067631+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:43.676892+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:38.002210+0000","last_change":"2024-09-13T19:19:38.002210+0000","last_active":"2024-09-13T19:19:38.002210+0000","last_peered":"2024-09-13T19:19:38.002210+0000","last_clean":"2024-09-13T19:19:38.002210+0000","last_became_active":"2024-09-13T19:16:03.912244+0000","last_became_peered":"2024-09-13T19:16:03.912244+0000","last_unstale":"2024-09-13T19:19:38.002210+0000","last_undegraded":"2024-09-13T19:19:38.002210+0000","last_fullsized":"2024-09-13T19:19:38.002210+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:38.002099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:38.002099+0000","last_clean_scrub_stamp":"2024-09-13T19:19:38.002099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:02.124751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"36'3","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:17.506199+0000","last_change":"2024-09-13T19:20:17.506229+0000","last_active":"2024-09-13T19:20:17.506199+0000","last_peered":"2024-09-13T19:20:17.506199+0000","last_clean":"2024-09-13T19:20:17.506199+0000","last_became_active":"2024-09-13T19:16:05.920951+0000","last_became_peered":"2024-09-13T19:16:05.920951+0000","last_unstale":"2024-09-13T19:20:17.506199+0000","last_undegraded":"2024-09-13T19:20:17.506199+0000","last_fullsized":"2024-09-13T19:20:17.506199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-13T19:20:17.506077+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-13T19:20:17.506077+0000","last_clean_scrub_stamp":"2024-09-13T19:20:17.506077+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:59:18.394157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"36'4","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:44.877430+0000","last_change":"2024-09-13T19:19:44.877430+0000","last_active":"2024-09-13T19:19:44.877430+0000","last_peered":"2024-09-13T19:19:44.877430+0000","last_clean":"2024-09-13T19:19:44.877430+0000","last_became_active":"2024-09-13T19:15:57.901732+0000","last_became_peered":"2024-09-13T19:15:57.901732+0000","last_unstale":"2024-09-13T19:19:44.877430+0000","last_undegraded":"2024-09-13T19:19:44.877430+0000","last_fullsized":"2024-09-13T19:19:44.877430+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:19:44.877311+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:19:44.877311+0000","last_clean_scrub_stamp":"2024-09-13T19:19:44.877311+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:11:44.325198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"36'4","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:52.675825+0000","last_change":"2024-09-13T19:19:52.675825+0000","last_active":"2024-09-13T19:19:52.675825+0000","last_peered":"2024-09-13T19:19:52.675825+0000","last_clean":"2024-09-13T19:19:52.675825+0000","last_became_active":"2024-09-13T19:15:55.894279+0000","last_became_peered":"2024-09-13T19:15:55.894279+0000","last_unstale":"2024-09-13T19:19:52.675825+0000","last_undegraded":"2024-09-13T19:19:52.675825+0000","last_fullsized":"2024-09-13T19:19:52.675825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:19:52.675686+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:19:52.675686+0000","last_clean_scrub_stamp":"2024-09-13T19:19:52.675686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:16.286898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:24.099278+0000","last_change":"2024-09-13T19:19:24.099278+0000","last_active":"2024-09-13T19:19:24.099278+0000","last_peered":"2024-09-13T19:19:24.099278+0000","last_clean":"2024-09-13T19:19:24.099278+0000","last_became_active":"2024-09-13T19:15:59.895325+0000","last_became_peered":"2024-09-13T19:15:59.895325+0000","last_unstale":"2024-09-13T19:19:24.099278+0000","last_undegraded":"2024-09-13T19:19:24.099278+0000","last_fullsized":"2024-09-13T19:19:24.099278+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:24.099164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:24.099164+0000","last_clean_scrub_stamp":"2024-09-13T19:19:24.099164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:16.483764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"36'8","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:30.333585+0000","last_change":"2024-09-13T19:19:30.333585+0000","last_active":"2024-09-13T19:19:30.333585+0000","last_peered":"2024-09-13T19:19:30.333585+0000","last_clean":"2024-09-13T19:19:30.333585+0000","last_became_active":"2024-09-13T19:16:01.901250+0000","last_became_peered":"2024-09-13T19:16:01.901250+0000","last_unstale":"2024-09-13T19:19:30.333585+0000","last_undegraded":"2024-09-13T19:19:30.333585+0000","last_fullsized":"2024-09-13T19:19:30.333585+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-13T19:19:30.333464+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-13T19:19:30.333464+0000","last_clean_scrub_stamp":"2024-09-13T19:19:30.333464+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:12:35.870136+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:16.732086+0000","last_change":"2024-09-13T19:19:16.732086+0000","last_active":"2024-09-13T19:19:16.732086+0000","last_peered":"2024-09-13T19:19:16.732086+0000","last_clean":"2024-09-13T19:19:16.732086+0000","last_became_active":"2024-09-13T19:16:03.913053+0000","last_became_peered":"2024-09-13T19:16:03.913053+0000","last_unstale":"2024-09-13T19:19:16.732086+0000","last_undegraded":"2024-09-13T19:19:16.732086+0000","last_fullsized":"2024-09-13T19:19:16.732086+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:16.731903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:16.731903+0000","last_clean_scrub_stamp":"2024-09-13T19:19:16.731903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:42.561076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"36'2","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:45.575337+0000","last_change":"2024-09-13T19:19:45.575382+0000","last_active":"2024-09-13T19:19:45.575337+0000","last_peered":"2024-09-13T19:19:45.575337+0000","last_clean":"2024-09-13T19:19:45.575337+0000","last_became_active":"2024-09-13T19:16:05.912428+0000","last_became_peered":"2024-09-13T19:16:05.912428+0000","last_unstale":"2024-09-13T19:19:45.575337+0000","last_undegraded":"2024-09-13T19:19:45.575337+0000","last_fullsized":"2024-09-13T19:19:45.575337+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:45.575217+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:45.575217+0000","last_clean_scrub_stamp":"2024-09-13T19:19:45.575217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:52:00.818473+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"36'8","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:44.570540+0000","last_change":"2024-09-13T19:19:44.570540+0000","last_active":"2024-09-13T19:19:44.570540+0000","last_peered":"2024-09-13T19:19:44.570540+0000","last_clean":"2024-09-13T19:19:44.570540+0000","last_became_active":"2024-09-13T19:15:57.896463+0000","last_became_peered":"2024-09-13T19:15:57.896463+0000","last_unstale":"2024-09-13T19:19:44.570540+0000","last_undegraded":"2024-09-13T19:19:44.570540+0000","last_fullsized":"2024-09-13T19:19:44.570540+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-13T19:19:44.570415+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-13T19:19:44.570415+0000","last_clean_scrub_stamp":"2024-09-13T19:19:44.570415+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:32:33.923357+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:58.515809+0000","last_change":"2024-09-13T19:19:58.515809+0000","last_active":"2024-09-13T19:19:58.515809+0000","last_peered":"2024-09-13T19:19:58.515809+0000","last_clean":"2024-09-13T19:19:58.515809+0000","last_became_active":"2024-09-13T19:15:55.888108+0000","last_became_peered":"2024-09-13T19:15:55.888108+0000","last_unstale":"2024-09-13T19:19:58.515809+0000","last_undegraded":"2024-09-13T19:19:58.515809+0000","last_fullsized":"2024-09-13T19:19:58.515809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:58.515690+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:58.515690+0000","last_clean_scrub_stamp":"2024-09-13T19:19:58.515690+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:14.604266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:34.858432+0000","last_change":"2024-09-13T19:19:34.858432+0000","last_active":"2024-09-13T19:19:34.858432+0000","last_peered":"2024-09-13T19:19:34.858432+0000","last_clean":"2024-09-13T19:19:34.858432+0000","last_became_active":"2024-09-13T19:15:59.892842+0000","last_became_peered":"2024-09-13T19:15:59.892842+0000","last_unstale":"2024-09-13T19:19:34.858432+0000","last_undegraded":"2024-09-13T19:19:34.858432+0000","last_fullsized":"2024-09-13T19:19:34.858432+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:34.858282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:34.858282+0000","last_clean_scrub_stamp":"2024-09-13T19:19:34.858282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:59.055511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"36'48","reported_seq":121,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:24.358526+0000","last_change":"2024-09-13T19:19:24.358526+0000","last_active":"2024-09-13T19:19:24.358526+0000","last_peered":"2024-09-13T19:19:24.358526+0000","last_clean":"2024-09-13T19:19:24.358526+0000","last_became_active":"2024-09-13T19:16:01.902991+0000","last_became_peered":"2024-09-13T19:16:01.902991+0000","last_unstale":"2024-09-13T19:19:24.358526+0000","last_undegraded":"2024-09-13T19:19:24.358526+0000","last_fullsized":"2024-09-13T19:19:24.358526+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'48","last_scrub_stamp":"2024-09-13T19:19:24.358388+0000","last_deep_scrub":"36'48","last_deep_scrub_stamp":"2024-09-13T19:19:24.358388+0000","last_clean_scrub_stamp":"2024-09-13T19:19:24.358388+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:23:15.090837+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:27.782128+0000","last_change":"2024-09-13T19:19:27.782128+0000","last_active":"2024-09-13T19:19:27.782128+0000","last_peered":"2024-09-13T19:19:27.782128+0000","last_clean":"2024-09-13T19:19:27.782128+0000","last_became_active":"2024-09-13T19:16:03.911917+0000","last_became_peered":"2024-09-13T19:16:03.911917+0000","last_unstale":"2024-09-13T19:19:27.782128+0000","last_undegraded":"2024-09-13T19:19:27.782128+0000","last_fullsized":"2024-09-13T19:19:27.782128+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:27.781937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:27.781937+0000","last_clean_scrub_stamp":"2024-09-13T19:19:27.781937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:51.979166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"36'4","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:35.994686+0000","last_change":"2024-09-13T19:20:35.994728+0000","last_active":"2024-09-13T19:20:35.994686+0000","last_peered":"2024-09-13T19:20:35.994686+0000","last_clean":"2024-09-13T19:20:35.994686+0000","last_became_active":"2024-09-13T19:16:05.923368+0000","last_became_peered":"2024-09-13T19:16:05.923368+0000","last_unstale":"2024-09-13T19:20:35.994686+0000","last_undegraded":"2024-09-13T19:20:35.994686+0000","last_fullsized":"2024-09-13T19:20:35.994686+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:20:35.994561+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:20:35.994561+0000","last_clean_scrub_stamp":"2024-09-13T19:20:35.994561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:40:42.792732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"36'16","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:12.626408+0000","last_change":"2024-09-13T19:20:12.626437+0000","last_active":"2024-09-13T19:20:12.626408+0000","last_peered":"2024-09-13T19:20:12.626408+0000","last_clean":"2024-09-13T19:20:12.626408+0000","last_became_active":"2024-09-13T19:16:31.991993+0000","last_became_peered":"2024-09-13T19:16:31.991993+0000","last_unstale":"2024-09-13T19:20:12.626408+0000","last_undegraded":"2024-09-13T19:20:12.626408+0000","last_fullsized":"2024-09-13T19:20:12.626408+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-13T19:20:12.626317+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-13T19:20:12.626317+0000","last_clean_scrub_stamp":"2024-09-13T19:20:12.626317+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:58:19.642331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:04.093337+0000","last_change":"2024-09-13T19:20:04.093337+0000","last_active":"2024-09-13T19:20:04.093337+0000","last_peered":"2024-09-13T19:20:04.093337+0000","last_clean":"2024-09-13T19:20:04.093337+0000","last_became_active":"2024-09-13T19:15:55.891711+0000","last_became_peered":"2024-09-13T19:15:55.891711+0000","last_unstale":"2024-09-13T19:20:04.093337+0000","last_undegraded":"2024-09-13T19:20:04.093337+0000","last_fullsized":"2024-09-13T19:20:04.093337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:20:04.093201+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:20:04.093201+0000","last_clean_scrub_stamp":"2024-09-13T19:20:04.093201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:39:33.862950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:28.138774+0000","last_change":"2024-09-13T19:19:28.138774+0000","last_active":"2024-09-13T19:19:28.138774+0000","last_peered":"2024-09-13T19:19:28.138774+0000","last_clean":"2024-09-13T19:19:28.138774+0000","last_became_active":"2024-09-13T19:15:59.891581+0000","last_became_peered":"2024-09-13T19:15:59.891581+0000","last_unstale":"2024-09-13T19:19:28.138774+0000","last_undegraded":"2024-09-13T19:19:28.138774+0000","last_fullsized":"2024-09-13T19:19:28.138774+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:28.138649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:28.138649+0000","last_clean_scrub_stamp":"2024-09-13T19:19:28.138649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:49.838315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"36'36","reported_seq":92,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:29.830588+0000","last_change":"2024-09-13T19:19:29.830588+0000","last_active":"2024-09-13T19:19:29.830588+0000","last_peered":"2024-09-13T19:19:29.830588+0000","last_clean":"2024-09-13T19:19:29.830588+0000","last_became_active":"2024-09-13T19:16:01.899438+0000","last_became_peered":"2024-09-13T19:16:01.899438+0000","last_unstale":"2024-09-13T19:19:29.830588+0000","last_undegraded":"2024-09-13T19:19:29.830588+0000","last_fullsized":"2024-09-13T19:19:29.830588+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-13T19:19:29.830469+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-13T19:19:29.830469+0000","last_clean_scrub_stamp":"2024-09-13T19:19:29.830469+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:27.642409+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:20.751502+0000","last_change":"2024-09-13T19:19:20.751502+0000","last_active":"2024-09-13T19:19:20.751502+0000","last_peered":"2024-09-13T19:19:20.751502+0000","last_clean":"2024-09-13T19:19:20.751502+0000","last_became_active":"2024-09-13T19:16:03.910319+0000","last_became_peered":"2024-09-13T19:16:03.910319+0000","last_unstale":"2024-09-13T19:19:20.751502+0000","last_undegraded":"2024-09-13T19:19:20.751502+0000","last_fullsized":"2024-09-13T19:19:20.751502+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:20.751392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:20.751392+0000","last_clean_scrub_stamp":"2024-09-13T19:19:20.751392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:18.995121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"36'10","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:52.862813+0000","last_change":"2024-09-13T19:19:52.862813+0000","last_active":"2024-09-13T19:19:52.862813+0000","last_peered":"2024-09-13T19:19:52.862813+0000","last_clean":"2024-09-13T19:19:52.862813+0000","last_became_active":"2024-09-13T19:15:57.897232+0000","last_became_peered":"2024-09-13T19:15:57.897232+0000","last_unstale":"2024-09-13T19:19:52.862813+0000","last_undegraded":"2024-09-13T19:19:52.862813+0000","last_fullsized":"2024-09-13T19:19:52.862813+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-13T19:19:52.862661+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-13T19:19:52.862661+0000","last_clean_scrub_stamp":"2024-09-13T19:19:52.862661+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:54.838456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:04.931320+0000","last_change":"2024-09-13T19:20:04.931320+0000","last_active":"2024-09-13T19:20:04.931320+0000","last_peered":"2024-09-13T19:20:04.931320+0000","last_clean":"2024-09-13T19:20:04.931320+0000","last_became_active":"2024-09-13T19:15:55.901257+0000","last_became_peered":"2024-09-13T19:15:55.901257+0000","last_unstale":"2024-09-13T19:20:04.931320+0000","last_undegraded":"2024-09-13T19:20:04.931320+0000","last_fullsized":"2024-09-13T19:20:04.931320+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:20:04.931174+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:20:04.931174+0000","last_clean_scrub_stamp":"2024-09-13T19:20:04.931174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:16:16.436095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:32.383184+0000","last_change":"2024-09-13T19:19:32.383184+0000","last_active":"2024-09-13T19:19:32.383184+0000","last_peered":"2024-09-13T19:19:32.383184+0000","last_clean":"2024-09-13T19:19:32.383184+0000","last_became_active":"2024-09-13T19:15:59.896339+0000","last_became_peered":"2024-09-13T19:15:59.896339+0000","last_unstale":"2024-09-13T19:19:32.383184+0000","last_undegraded":"2024-09-13T19:19:32.383184+0000","last_fullsized":"2024-09-13T19:19:32.383184+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:32.383058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:32.383058+0000","last_clean_scrub_stamp":"2024-09-13T19:19:32.383058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:00.272146+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"36'63","reported_seq":136,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:31.346681+0000","last_change":"2024-09-13T19:19:31.346722+0000","last_active":"2024-09-13T19:19:31.346681+0000","last_peered":"2024-09-13T19:19:31.346681+0000","last_clean":"2024-09-13T19:19:31.346681+0000","last_became_active":"2024-09-13T19:16:01.901092+0000","last_became_peered":"2024-09-13T19:16:01.901092+0000","last_unstale":"2024-09-13T19:19:31.346681+0000","last_undegraded":"2024-09-13T19:19:31.346681+0000","last_fullsized":"2024-09-13T19:19:31.346681+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'63","last_scrub_stamp":"2024-09-13T19:19:31.346567+0000","last_deep_scrub":"36'63","last_deep_scrub_stamp":"2024-09-13T19:19:31.346567+0000","last_clean_scrub_stamp":"2024-09-13T19:19:31.346567+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:48:17.500355+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:18.709566+0000","last_change":"2024-09-13T19:19:18.709589+0000","last_active":"2024-09-13T19:19:18.709566+0000","last_peered":"2024-09-13T19:19:18.709566+0000","last_clean":"2024-09-13T19:19:18.709566+0000","last_became_active":"2024-09-13T19:16:03.910305+0000","last_became_peered":"2024-09-13T19:16:03.910305+0000","last_unstale":"2024-09-13T19:19:18.709566+0000","last_undegraded":"2024-09-13T19:19:18.709566+0000","last_fullsized":"2024-09-13T19:19:18.709566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:18.709481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:18.709481+0000","last_clean_scrub_stamp":"2024-09-13T19:19:18.709481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:41.615886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"36'22","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:13.494661+0000","last_change":"2024-09-13T19:20:13.494661+0000","last_active":"2024-09-13T19:20:13.494661+0000","last_peered":"2024-09-13T19:20:13.494661+0000","last_clean":"2024-09-13T19:20:13.494661+0000","last_became_active":"2024-09-13T19:16:05.912675+0000","last_became_peered":"2024-09-13T19:16:05.912675+0000","last_unstale":"2024-09-13T19:20:13.494661+0000","last_undegraded":"2024-09-13T19:20:13.494661+0000","last_fullsized":"2024-09-13T19:20:13.494661+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'22","last_scrub_stamp":"2024-09-13T19:20:13.494529+0000","last_deep_scrub":"36'22","last_deep_scrub_stamp":"2024-09-13T19:20:13.494529+0000","last_clean_scrub_stamp":"2024-09-13T19:20:13.494529+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:42:34.844694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"36'6","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:57.642302+0000","last_change":"2024-09-13T19:19:57.642327+0000","last_active":"2024-09-13T19:19:57.642302+0000","last_peered":"2024-09-13T19:19:57.642302+0000","last_clean":"2024-09-13T19:19:57.642302+0000","last_became_active":"2024-09-13T19:15:57.889921+0000","last_became_peered":"2024-09-13T19:15:57.889921+0000","last_unstale":"2024-09-13T19:19:57.642302+0000","last_undegraded":"2024-09-13T19:19:57.642302+0000","last_fullsized":"2024-09-13T19:19:57.642302+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:19:57.642210+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:19:57.642210+0000","last_clean_scrub_stamp":"2024-09-13T19:19:57.642210+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:10:09.081946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:07.128831+0000","last_change":"2024-09-13T19:20:07.128831+0000","last_active":"2024-09-13T19:20:07.128831+0000","last_peered":"2024-09-13T19:20:07.128831+0000","last_clean":"2024-09-13T19:20:07.128831+0000","last_became_active":"2024-09-13T19:15:55.895344+0000","last_became_peered":"2024-09-13T19:15:55.895344+0000","last_unstale":"2024-09-13T19:20:07.128831+0000","last_undegraded":"2024-09-13T19:20:07.128831+0000","last_fullsized":"2024-09-13T19:20:07.128831+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:07.128707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:07.128707+0000","last_clean_scrub_stamp":"2024-09-13T19:20:07.128707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:25.121795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:38.765129+0000","last_change":"2024-09-13T19:19:38.765129+0000","last_active":"2024-09-13T19:19:38.765129+0000","last_peered":"2024-09-13T19:19:38.765129+0000","last_clean":"2024-09-13T19:19:38.765129+0000","last_became_active":"2024-09-13T19:15:59.888213+0000","last_became_peered":"2024-09-13T19:15:59.888213+0000","last_unstale":"2024-09-13T19:19:38.765129+0000","last_undegraded":"2024-09-13T19:19:38.765129+0000","last_fullsized":"2024-09-13T19:19:38.765129+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:38.764987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:38.764987+0000","last_clean_scrub_stamp":"2024-09-13T19:19:38.764987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:30.399476+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"36'45","reported_seq":103,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:40.991571+0000","last_change":"2024-09-13T19:19:40.991618+0000","last_active":"2024-09-13T19:19:40.991571+0000","last_peered":"2024-09-13T19:19:40.991571+0000","last_clean":"2024-09-13T19:19:40.991571+0000","last_became_active":"2024-09-13T19:16:01.908116+0000","last_became_peered":"2024-09-13T19:16:01.908116+0000","last_unstale":"2024-09-13T19:19:40.991571+0000","last_undegraded":"2024-09-13T19:19:40.991571+0000","last_fullsized":"2024-09-13T19:19:40.991571+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'45","last_scrub_stamp":"2024-09-13T19:19:40.991484+0000","last_deep_scrub":"36'45","last_deep_scrub_stamp":"2024-09-13T19:19:40.991484+0000","last_clean_scrub_stamp":"2024-09-13T19:19:40.991484+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:20.333822+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:31.769578+0000","last_change":"2024-09-13T19:19:31.769602+0000","last_active":"2024-09-13T19:19:31.769578+0000","last_peered":"2024-09-13T19:19:31.769578+0000","last_clean":"2024-09-13T19:19:31.769578+0000","last_became_active":"2024-09-13T19:16:03.914179+0000","last_became_peered":"2024-09-13T19:16:03.914179+0000","last_unstale":"2024-09-13T19:19:31.769578+0000","last_undegraded":"2024-09-13T19:19:31.769578+0000","last_fullsized":"2024-09-13T19:19:31.769578+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:31.769488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:31.769488+0000","last_clean_scrub_stamp":"2024-09-13T19:19:31.769488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:13.242003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"34'2","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:54.942494+0000","last_change":"2024-09-13T19:19:54.942494+0000","last_active":"2024-09-13T19:19:54.942494+0000","last_peered":"2024-09-13T19:19:54.942494+0000","last_clean":"2024-09-13T19:19:54.942494+0000","last_became_active":"2024-09-13T19:16:05.916822+0000","last_became_peered":"2024-09-13T19:16:05.916822+0000","last_unstale":"2024-09-13T19:19:54.942494+0000","last_undegraded":"2024-09-13T19:19:54.942494+0000","last_fullsized":"2024-09-13T19:19:54.942494+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:19:54.942324+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:19:54.942324+0000","last_clean_scrub_stamp":"2024-09-13T19:19:54.942324+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:41:03.981946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"36'22","reported_seq":83,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:30.102447+0000","last_change":"2024-09-13T19:19:30.102447+0000","last_active":"2024-09-13T19:19:30.102447+0000","last_peered":"2024-09-13T19:19:30.102447+0000","last_clean":"2024-09-13T19:19:30.102447+0000","last_became_active":"2024-09-13T19:15:57.901330+0000","last_became_peered":"2024-09-13T19:15:57.901330+0000","last_unstale":"2024-09-13T19:19:30.102447+0000","last_undegraded":"2024-09-13T19:19:30.102447+0000","last_fullsized":"2024-09-13T19:19:30.102447+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'22","last_scrub_stamp":"2024-09-13T19:19:30.102322+0000","last_deep_scrub":"36'22","last_deep_scrub_stamp":"2024-09-13T19:19:30.102322+0000","last_clean_scrub_stamp":"2024-09-13T19:19:30.102322+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:16.992227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":60,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:59.067896+0000","last_change":"2024-09-13T19:19:59.067896+0000","last_active":"2024-09-13T19:19:59.067896+0000","last_peered":"2024-09-13T19:19:59.067896+0000","last_clean":"2024-09-13T19:19:59.067896+0000","last_became_active":"2024-09-13T19:15:55.896196+0000","last_became_peered":"2024-09-13T19:15:55.896196+0000","last_unstale":"2024-09-13T19:19:59.067896+0000","last_undegraded":"2024-09-13T19:19:59.067896+0000","last_fullsized":"2024-09-13T19:19:59.067896+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:59.067754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:59.067754+0000","last_clean_scrub_stamp":"2024-09-13T19:19:59.067754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:11.124902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:37.784998+0000","last_change":"2024-09-13T19:19:37.784998+0000","last_active":"2024-09-13T19:19:37.784998+0000","last_peered":"2024-09-13T19:19:37.784998+0000","last_clean":"2024-09-13T19:19:37.784998+0000","last_became_active":"2024-09-13T19:15:59.891131+0000","last_became_peered":"2024-09-13T19:15:59.891131+0000","last_unstale":"2024-09-13T19:19:37.784998+0000","last_undegraded":"2024-09-13T19:19:37.784998+0000","last_fullsized":"2024-09-13T19:19:37.784998+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:37.784843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:37.784843+0000","last_clean_scrub_stamp":"2024-09-13T19:19:37.784843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:04:18.549612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"36'39","reported_seq":96,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:27.304502+0000","last_change":"2024-09-13T19:19:27.304502+0000","last_active":"2024-09-13T19:19:27.304502+0000","last_peered":"2024-09-13T19:19:27.304502+0000","last_clean":"2024-09-13T19:19:27.304502+0000","last_became_active":"2024-09-13T19:16:01.902251+0000","last_became_peered":"2024-09-13T19:16:01.902251+0000","last_unstale":"2024-09-13T19:19:27.304502+0000","last_undegraded":"2024-09-13T19:19:27.304502+0000","last_fullsized":"2024-09-13T19:19:27.304502+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'39","last_scrub_stamp":"2024-09-13T19:19:27.304335+0000","last_deep_scrub":"36'39","last_deep_scrub_stamp":"2024-09-13T19:19:27.304335+0000","last_clean_scrub_stamp":"2024-09-13T19:19:27.304335+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:19:17.836466+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:37.488048+0000","last_change":"2024-09-13T19:19:37.488048+0000","last_active":"2024-09-13T19:19:37.488048+0000","last_peered":"2024-09-13T19:19:37.488048+0000","last_clean":"2024-09-13T19:19:37.488048+0000","last_became_active":"2024-09-13T19:16:03.915225+0000","last_became_peered":"2024-09-13T19:16:03.915225+0000","last_unstale":"2024-09-13T19:19:37.488048+0000","last_undegraded":"2024-09-13T19:19:37.488048+0000","last_fullsized":"2024-09-13T19:19:37.488048+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:37.487953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:37.487953+0000","last_clean_scrub_stamp":"2024-09-13T19:19:37.487953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:42.911372+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"36'5","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:38.013877+0000","last_change":"2024-09-13T19:20:38.013877+0000","last_active":"2024-09-13T19:20:38.013877+0000","last_peered":"2024-09-13T19:20:38.013877+0000","last_clean":"2024-09-13T19:20:38.013877+0000","last_became_active":"2024-09-13T19:16:05.923235+0000","last_became_peered":"2024-09-13T19:16:05.923235+0000","last_unstale":"2024-09-13T19:20:38.013877+0000","last_undegraded":"2024-09-13T19:20:38.013877+0000","last_fullsized":"2024-09-13T19:20:38.013877+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-09-13T19:20:38.013760+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-09-13T19:20:38.013760+0000","last_clean_scrub_stamp":"2024-09-13T19:20:38.013760+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:44.567254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"36'8","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:47.641385+0000","last_change":"2024-09-13T19:19:47.641385+0000","last_active":"2024-09-13T19:19:47.641385+0000","last_peered":"2024-09-13T19:19:47.641385+0000","last_clean":"2024-09-13T19:19:47.641385+0000","last_became_active":"2024-09-13T19:15:57.886263+0000","last_became_peered":"2024-09-13T19:15:57.886263+0000","last_unstale":"2024-09-13T19:19:47.641385+0000","last_undegraded":"2024-09-13T19:19:47.641385+0000","last_fullsized":"2024-09-13T19:19:47.641385+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-13T19:19:47.641228+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-13T19:19:47.641228+0000","last_clean_scrub_stamp":"2024-09-13T19:19:47.641228+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:30.867550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:24.058883+0000","last_change":"2024-09-13T19:20:24.058883+0000","last_active":"2024-09-13T19:20:24.058883+0000","last_peered":"2024-09-13T19:20:24.058883+0000","last_clean":"2024-09-13T19:20:24.058883+0000","last_became_active":"2024-09-13T19:15:55.893629+0000","last_became_peered":"2024-09-13T19:15:55.893629+0000","last_unstale":"2024-09-13T19:20:24.058883+0000","last_undegraded":"2024-09-13T19:20:24.058883+0000","last_fullsized":"2024-09-13T19:20:24.058883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:24.058757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:24.058757+0000","last_clean_scrub_stamp":"2024-09-13T19:20:24.058757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:30:15.283806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:32.783543+0000","last_change":"2024-09-13T19:19:32.783543+0000","last_active":"2024-09-13T19:19:32.783543+0000","last_peered":"2024-09-13T19:19:32.783543+0000","last_clean":"2024-09-13T19:19:32.783543+0000","last_became_active":"2024-09-13T19:15:59.892445+0000","last_became_peered":"2024-09-13T19:15:59.892445+0000","last_unstale":"2024-09-13T19:19:32.783543+0000","last_undegraded":"2024-09-13T19:19:32.783543+0000","last_fullsized":"2024-09-13T19:19:32.783543+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:32.783411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:32.783411+0000","last_clean_scrub_stamp":"2024-09-13T19:19:32.783411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:00:48.438787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"36'16","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:45.872607+0000","last_change":"2024-09-13T19:19:45.872607+0000","last_active":"2024-09-13T19:19:45.872607+0000","last_peered":"2024-09-13T19:19:45.872607+0000","last_clean":"2024-09-13T19:19:45.872607+0000","last_became_active":"2024-09-13T19:16:01.905553+0000","last_became_peered":"2024-09-13T19:16:01.905553+0000","last_unstale":"2024-09-13T19:19:45.872607+0000","last_undegraded":"2024-09-13T19:19:45.872607+0000","last_fullsized":"2024-09-13T19:19:45.872607+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-13T19:19:45.872465+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-13T19:19:45.872465+0000","last_clean_scrub_stamp":"2024-09-13T19:19:45.872465+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:31:04.671736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"36'285","reported_seq":379,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:19.719772+0000","last_change":"2024-09-13T19:19:19.719772+0000","last_active":"2024-09-13T19:19:19.719772+0000","last_peered":"2024-09-13T19:19:19.719772+0000","last_clean":"2024-09-13T19:19:19.719772+0000","last_became_active":"2024-09-13T19:16:03.913170+0000","last_became_peered":"2024-09-13T19:16:03.913170+0000","last_unstale":"2024-09-13T19:19:19.719772+0000","last_undegraded":"2024-09-13T19:19:19.719772+0000","last_fullsized":"2024-09-13T19:19:19.719772+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-13T19:19:19.719650+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-13T19:19:19.719650+0000","last_clean_scrub_stamp":"2024-09-13T19:19:19.719650+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:13:51.353091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"36'4","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:58.931951+0000","last_change":"2024-09-13T19:19:58.931951+0000","last_active":"2024-09-13T19:19:58.931951+0000","last_peered":"2024-09-13T19:19:58.931951+0000","last_clean":"2024-09-13T19:19:58.931951+0000","last_became_active":"2024-09-13T19:16:05.918050+0000","last_became_peered":"2024-09-13T19:16:05.918050+0000","last_unstale":"2024-09-13T19:19:58.931951+0000","last_undegraded":"2024-09-13T19:19:58.931951+0000","last_fullsized":"2024-09-13T19:19:58.931951+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:19:58.931793+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:19:58.931793+0000","last_clean_scrub_stamp":"2024-09-13T19:19:58.931793+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:51.645100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"36'10","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:43.832987+0000","last_change":"2024-09-13T19:19:43.832987+0000","last_active":"2024-09-13T19:19:43.832987+0000","last_peered":"2024-09-13T19:19:43.832987+0000","last_clean":"2024-09-13T19:19:43.832987+0000","last_became_active":"2024-09-13T19:15:57.885711+0000","last_became_peered":"2024-09-13T19:15:57.885711+0000","last_unstale":"2024-09-13T19:19:43.832987+0000","last_undegraded":"2024-09-13T19:19:43.832987+0000","last_fullsized":"2024-09-13T19:19:43.832987+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-13T19:19:43.832854+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-13T19:19:43.832854+0000","last_clean_scrub_stamp":"2024-09-13T19:19:43.832854+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:23.636694+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:03.133898+0000","last_change":"2024-09-13T19:20:03.133898+0000","last_active":"2024-09-13T19:20:03.133898+0000","last_peered":"2024-09-13T19:20:03.133898+0000","last_clean":"2024-09-13T19:20:03.133898+0000","last_became_active":"2024-09-13T19:15:55.890670+0000","last_became_peered":"2024-09-13T19:15:55.890670+0000","last_unstale":"2024-09-13T19:20:03.133898+0000","last_undegraded":"2024-09-13T19:20:03.133898+0000","last_fullsized":"2024-09-13T19:20:03.133898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:20:03.133782+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:20:03.133782+0000","last_clean_scrub_stamp":"2024-09-13T19:20:03.133782+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:53:48.308748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:29.803524+0000","last_change":"2024-09-13T19:19:29.803524+0000","last_active":"2024-09-13T19:19:29.803524+0000","last_peered":"2024-09-13T19:19:29.803524+0000","last_clean":"2024-09-13T19:19:29.803524+0000","last_became_active":"2024-09-13T19:15:59.893905+0000","last_became_peered":"2024-09-13T19:15:59.893905+0000","last_unstale":"2024-09-13T19:19:29.803524+0000","last_undegraded":"2024-09-13T19:19:29.803524+0000","last_fullsized":"2024-09-13T19:19:29.803524+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:29.803399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:29.803399+0000","last_clean_scrub_stamp":"2024-09-13T19:19:29.803399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:13.674139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"36'46","reported_seq":105,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:18.724144+0000","last_change":"2024-09-13T19:19:18.724144+0000","last_active":"2024-09-13T19:19:18.724144+0000","last_peered":"2024-09-13T19:19:18.724144+0000","last_clean":"2024-09-13T19:19:18.724144+0000","last_became_active":"2024-09-13T19:16:01.903395+0000","last_became_peered":"2024-09-13T19:16:01.903395+0000","last_unstale":"2024-09-13T19:19:18.724144+0000","last_undegraded":"2024-09-13T19:19:18.724144+0000","last_fullsized":"2024-09-13T19:19:18.724144+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'46","last_scrub_stamp":"2024-09-13T19:19:18.723995+0000","last_deep_scrub":"36'46","last_deep_scrub_stamp":"2024-09-13T19:19:18.723995+0000","last_clean_scrub_stamp":"2024-09-13T19:19:18.723995+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:23.717143+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:18.382122+0000","last_change":"2024-09-13T19:19:18.382122+0000","last_active":"2024-09-13T19:19:18.382122+0000","last_peered":"2024-09-13T19:19:18.382122+0000","last_clean":"2024-09-13T19:19:18.382122+0000","last_became_active":"2024-09-13T19:16:03.910550+0000","last_became_peered":"2024-09-13T19:16:03.910550+0000","last_unstale":"2024-09-13T19:19:18.382122+0000","last_undegraded":"2024-09-13T19:19:18.382122+0000","last_fullsized":"2024-09-13T19:19:18.382122+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:18.381995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:18.381995+0000","last_clean_scrub_stamp":"2024-09-13T19:19:18.381995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:49.252007+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"36'3","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:11.045199+0000","last_change":"2024-09-13T19:20:11.045199+0000","last_active":"2024-09-13T19:20:11.045199+0000","last_peered":"2024-09-13T19:20:11.045199+0000","last_clean":"2024-09-13T19:20:11.045199+0000","last_became_active":"2024-09-13T19:16:05.913598+0000","last_became_peered":"2024-09-13T19:16:05.913598+0000","last_unstale":"2024-09-13T19:20:11.045199+0000","last_undegraded":"2024-09-13T19:20:11.045199+0000","last_fullsized":"2024-09-13T19:20:11.045199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-13T19:20:11.045091+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-13T19:20:11.045091+0000","last_clean_scrub_stamp":"2024-09-13T19:20:11.045091+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:05.787037+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:42.851396+0000","last_change":"2024-09-13T19:19:42.851396+0000","last_active":"2024-09-13T19:19:42.851396+0000","last_peered":"2024-09-13T19:19:42.851396+0000","last_clean":"2024-09-13T19:19:42.851396+0000","last_became_active":"2024-09-13T19:15:57.883463+0000","last_became_peered":"2024-09-13T19:15:57.883463+0000","last_unstale":"2024-09-13T19:19:42.851396+0000","last_undegraded":"2024-09-13T19:19:42.851396+0000","last_fullsized":"2024-09-13T19:19:42.851396+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:19:42.851247+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:19:42.851247+0000","last_clean_scrub_stamp":"2024-09-13T19:19:42.851247+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:47.003451+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:19.025184+0000","last_change":"2024-09-13T19:20:19.025184+0000","last_active":"2024-09-13T19:20:19.025184+0000","last_peered":"2024-09-13T19:20:19.025184+0000","last_clean":"2024-09-13T19:20:19.025184+0000","last_became_active":"2024-09-13T19:15:55.899847+0000","last_became_peered":"2024-09-13T19:15:55.899847+0000","last_unstale":"2024-09-13T19:20:19.025184+0000","last_undegraded":"2024-09-13T19:20:19.025184+0000","last_fullsized":"2024-09-13T19:20:19.025184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:19.025041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:19.025041+0000","last_clean_scrub_stamp":"2024-09-13T19:20:19.025041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:04:32.036977+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:33.840008+0000","last_change":"2024-09-13T19:19:33.840008+0000","last_active":"2024-09-13T19:19:33.840008+0000","last_peered":"2024-09-13T19:19:33.840008+0000","last_clean":"2024-09-13T19:19:33.840008+0000","last_became_active":"2024-09-13T19:15:59.895512+0000","last_became_peered":"2024-09-13T19:15:59.895512+0000","last_unstale":"2024-09-13T19:19:33.840008+0000","last_undegraded":"2024-09-13T19:19:33.840008+0000","last_fullsized":"2024-09-13T19:19:33.840008+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:33.839854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:33.839854+0000","last_clean_scrub_stamp":"2024-09-13T19:19:33.839854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:49.315701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"36'36","reported_seq":92,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:26.305329+0000","last_change":"2024-09-13T19:19:26.305329+0000","last_active":"2024-09-13T19:19:26.305329+0000","last_peered":"2024-09-13T19:19:26.305329+0000","last_clean":"2024-09-13T19:19:26.305329+0000","last_became_active":"2024-09-13T19:16:01.902285+0000","last_became_peered":"2024-09-13T19:16:01.902285+0000","last_unstale":"2024-09-13T19:19:26.305329+0000","last_undegraded":"2024-09-13T19:19:26.305329+0000","last_fullsized":"2024-09-13T19:19:26.305329+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-13T19:19:26.305171+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-13T19:19:26.305171+0000","last_clean_scrub_stamp":"2024-09-13T19:19:26.305171+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:15:14.766698+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:40.004237+0000","last_change":"2024-09-13T19:19:40.004237+0000","last_active":"2024-09-13T19:19:40.004237+0000","last_peered":"2024-09-13T19:19:40.004237+0000","last_clean":"2024-09-13T19:19:40.004237+0000","last_became_active":"2024-09-13T19:16:03.911587+0000","last_became_peered":"2024-09-13T19:16:03.911587+0000","last_unstale":"2024-09-13T19:19:40.004237+0000","last_undegraded":"2024-09-13T19:19:40.004237+0000","last_fullsized":"2024-09-13T19:19:40.004237+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:40.004104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:40.004104+0000","last_clean_scrub_stamp":"2024-09-13T19:19:40.004104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:57.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:33.976890+0000","last_change":"2024-09-13T19:20:33.976890+0000","last_active":"2024-09-13T19:20:33.976890+0000","last_peered":"2024-09-13T19:20:33.976890+0000","last_clean":"2024-09-13T19:20:33.976890+0000","last_became_active":"2024-09-13T19:16:05.923014+0000","last_became_peered":"2024-09-13T19:16:05.923014+0000","last_unstale":"2024-09-13T19:20:33.976890+0000","last_undegraded":"2024-09-13T19:20:33.976890+0000","last_fullsized":"2024-09-13T19:20:33.976890+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:33.976734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:33.976734+0000","last_clean_scrub_stamp":"2024-09-13T19:20:33.976734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:14.601296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"36'4","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:56.969818+0000","last_change":"2024-09-13T19:19:56.969818+0000","last_active":"2024-09-13T19:19:56.969818+0000","last_peered":"2024-09-13T19:19:56.969818+0000","last_clean":"2024-09-13T19:19:56.969818+0000","last_became_active":"2024-09-13T19:15:57.896310+0000","last_became_peered":"2024-09-13T19:15:57.896310+0000","last_unstale":"2024-09-13T19:19:56.969818+0000","last_undegraded":"2024-09-13T19:19:56.969818+0000","last_fullsized":"2024-09-13T19:19:56.969818+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:19:56.969709+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:19:56.969709+0000","last_clean_scrub_stamp":"2024-09-13T19:19:56.969709+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:00:10.970577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:58.684717+0000","last_change":"2024-09-13T19:19:58.684741+0000","last_active":"2024-09-13T19:19:58.684717+0000","last_peered":"2024-09-13T19:19:58.684717+0000","last_clean":"2024-09-13T19:19:58.684717+0000","last_became_active":"2024-09-13T19:15:55.893600+0000","last_became_peered":"2024-09-13T19:15:55.893600+0000","last_unstale":"2024-09-13T19:19:58.684717+0000","last_undegraded":"2024-09-13T19:19:58.684717+0000","last_fullsized":"2024-09-13T19:19:58.684717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:58.684635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:58.684635+0000","last_clean_scrub_stamp":"2024-09-13T19:19:58.684635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:42:25.367627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:26.734018+0000","last_change":"2024-09-13T19:19:26.734018+0000","last_active":"2024-09-13T19:19:26.734018+0000","last_peered":"2024-09-13T19:19:26.734018+0000","last_clean":"2024-09-13T19:19:26.734018+0000","last_became_active":"2024-09-13T19:15:59.896518+0000","last_became_peered":"2024-09-13T19:15:59.896518+0000","last_unstale":"2024-09-13T19:19:26.734018+0000","last_undegraded":"2024-09-13T19:19:26.734018+0000","last_fullsized":"2024-09-13T19:19:26.734018+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:26.733839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:26.733839+0000","last_clean_scrub_stamp":"2024-09-13T19:19:26.733839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:27.626320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"36'30","reported_seq":83,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:23.073612+0000","last_change":"2024-09-13T19:19:23.073664+0000","last_active":"2024-09-13T19:19:23.073612+0000","last_peered":"2024-09-13T19:19:23.073612+0000","last_clean":"2024-09-13T19:19:23.073612+0000","last_became_active":"2024-09-13T19:16:01.902699+0000","last_became_peered":"2024-09-13T19:16:01.902699+0000","last_unstale":"2024-09-13T19:19:23.073612+0000","last_undegraded":"2024-09-13T19:19:23.073612+0000","last_fullsized":"2024-09-13T19:19:23.073612+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'30","last_scrub_stamp":"2024-09-13T19:19:23.073511+0000","last_deep_scrub":"36'30","last_deep_scrub_stamp":"2024-09-13T19:19:23.073511+0000","last_clean_scrub_stamp":"2024-09-13T19:19:23.073511+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:54:35.654271+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:37.027586+0000","last_change":"2024-09-13T19:19:37.027611+0000","last_active":"2024-09-13T19:19:37.027586+0000","last_peered":"2024-09-13T19:19:37.027586+0000","last_clean":"2024-09-13T19:19:37.027586+0000","last_became_active":"2024-09-13T19:16:03.913228+0000","last_became_peered":"2024-09-13T19:16:03.913228+0000","last_unstale":"2024-09-13T19:19:37.027586+0000","last_undegraded":"2024-09-13T19:19:37.027586+0000","last_fullsized":"2024-09-13T19:19:37.027586+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:37.027487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:37.027487+0000","last_clean_scrub_stamp":"2024-09-13T19:19:37.027487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:39:06.797236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"36'4","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:39.062301+0000","last_change":"2024-09-13T19:20:39.062301+0000","last_active":"2024-09-13T19:20:39.062301+0000","last_peered":"2024-09-13T19:20:39.062301+0000","last_clean":"2024-09-13T19:20:39.062301+0000","last_became_active":"2024-09-13T19:16:05.925519+0000","last_became_peered":"2024-09-13T19:16:05.925519+0000","last_unstale":"2024-09-13T19:20:39.062301+0000","last_undegraded":"2024-09-13T19:20:39.062301+0000","last_fullsized":"2024-09-13T19:20:39.062301+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:20:39.062179+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:20:39.062179+0000","last_clean_scrub_stamp":"2024-09-13T19:20:39.062179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:21:58.632160+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"36'6","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:45.816379+0000","last_change":"2024-09-13T19:19:45.816379+0000","last_active":"2024-09-13T19:19:45.816379+0000","last_peered":"2024-09-13T19:19:45.816379+0000","last_clean":"2024-09-13T19:19:45.816379+0000","last_became_active":"2024-09-13T19:15:57.885993+0000","last_became_peered":"2024-09-13T19:15:57.885993+0000","last_unstale":"2024-09-13T19:19:45.816379+0000","last_undegraded":"2024-09-13T19:19:45.816379+0000","last_fullsized":"2024-09-13T19:19:45.816379+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:19:45.816207+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:19:45.816207+0000","last_clean_scrub_stamp":"2024-09-13T19:19:45.816207+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:58:05.931904+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:09.058802+0000","last_change":"2024-09-13T19:20:09.058844+0000","last_active":"2024-09-13T19:20:09.058802+0000","last_peered":"2024-09-13T19:20:09.058802+0000","last_clean":"2024-09-13T19:20:09.058802+0000","last_became_active":"2024-09-13T19:15:55.895040+0000","last_became_peered":"2024-09-13T19:15:55.895040+0000","last_unstale":"2024-09-13T19:20:09.058802+0000","last_undegraded":"2024-09-13T19:20:09.058802+0000","last_fullsized":"2024-09-13T19:20:09.058802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:09.058683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:09.058683+0000","last_clean_scrub_stamp":"2024-09-13T19:20:09.058683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:46.306597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"36'3","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:24.660340+0000","last_change":"2024-09-13T19:19:24.660340+0000","last_active":"2024-09-13T19:19:24.660340+0000","last_peered":"2024-09-13T19:19:24.660340+0000","last_clean":"2024-09-13T19:19:24.660340+0000","last_became_active":"2024-09-13T19:15:59.897609+0000","last_became_peered":"2024-09-13T19:15:59.897609+0000","last_unstale":"2024-09-13T19:19:24.660340+0000","last_undegraded":"2024-09-13T19:19:24.660340+0000","last_fullsized":"2024-09-13T19:19:24.660340+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-13T19:19:24.660188+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-13T19:19:24.660188+0000","last_clean_scrub_stamp":"2024-09-13T19:19:24.660188+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:56.245062+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"36'40","reported_seq":97,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:21.050539+0000","last_change":"2024-09-13T19:19:21.050618+0000","last_active":"2024-09-13T19:19:21.050539+0000","last_peered":"2024-09-13T19:19:21.050539+0000","last_clean":"2024-09-13T19:19:21.050539+0000","last_became_active":"2024-09-13T19:16:01.902042+0000","last_became_peered":"2024-09-13T19:16:01.902042+0000","last_unstale":"2024-09-13T19:19:21.050539+0000","last_undegraded":"2024-09-13T19:19:21.050539+0000","last_fullsized":"2024-09-13T19:19:21.050539+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'40","last_scrub_stamp":"2024-09-13T19:19:21.050438+0000","last_deep_scrub":"36'40","last_deep_scrub_stamp":"2024-09-13T19:19:21.050438+0000","last_clean_scrub_stamp":"2024-09-13T19:19:21.050438+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:19.019166+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:16.346297+0000","last_change":"2024-09-13T19:19:16.346321+0000","last_active":"2024-09-13T19:19:16.346297+0000","last_peered":"2024-09-13T19:19:16.346297+0000","last_clean":"2024-09-13T19:19:16.346297+0000","last_became_active":"2024-09-13T19:16:03.911052+0000","last_became_peered":"2024-09-13T19:16:03.911052+0000","last_unstale":"2024-09-13T19:19:16.346297+0000","last_undegraded":"2024-09-13T19:19:16.346297+0000","last_fullsized":"2024-09-13T19:19:16.346297+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:16.346224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:16.346224+0000","last_clean_scrub_stamp":"2024-09-13T19:19:16.346224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:31.215677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"36'2","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:34.977895+0000","last_change":"2024-09-13T19:20:34.977895+0000","last_active":"2024-09-13T19:20:34.977895+0000","last_peered":"2024-09-13T19:20:34.977895+0000","last_clean":"2024-09-13T19:20:34.977895+0000","last_became_active":"2024-09-13T19:16:05.922822+0000","last_became_peered":"2024-09-13T19:16:05.922822+0000","last_unstale":"2024-09-13T19:20:34.977895+0000","last_undegraded":"2024-09-13T19:20:34.977895+0000","last_fullsized":"2024-09-13T19:20:34.977895+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:20:34.977768+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:20:34.977768+0000","last_clean_scrub_stamp":"2024-09-13T19:20:34.977768+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:35:53.604348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"36'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:36.838417+0000","last_change":"2024-09-13T19:19:36.838417+0000","last_active":"2024-09-13T19:19:36.838417+0000","last_peered":"2024-09-13T19:19:36.838417+0000","last_clean":"2024-09-13T19:19:36.838417+0000","last_became_active":"2024-09-13T19:15:57.902883+0000","last_became_peered":"2024-09-13T19:15:57.902883+0000","last_unstale":"2024-09-13T19:19:36.838417+0000","last_undegraded":"2024-09-13T19:19:36.838417+0000","last_fullsized":"2024-09-13T19:19:36.838417+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:36.838299+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:36.838299+0000","last_clean_scrub_stamp":"2024-09-13T19:19:36.838299+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:44:59.482570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:46.836795+0000","last_change":"2024-09-13T19:19:46.836795+0000","last_active":"2024-09-13T19:19:46.836795+0000","last_peered":"2024-09-13T19:19:46.836795+0000","last_clean":"2024-09-13T19:19:46.836795+0000","last_became_active":"2024-09-13T19:15:55.898653+0000","last_became_peered":"2024-09-13T19:15:55.898653+0000","last_unstale":"2024-09-13T19:19:46.836795+0000","last_undegraded":"2024-09-13T19:19:46.836795+0000","last_fullsized":"2024-09-13T19:19:46.836795+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:46.836659+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:46.836659+0000","last_clean_scrub_stamp":"2024-09-13T19:19:46.836659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:47:36.269620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"36'8","reported_seq":69,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:49.674734+0000","last_change":"2024-09-13T19:19:49.674734+0000","last_active":"2024-09-13T19:19:49.674734+0000","last_peered":"2024-09-13T19:19:49.674734+0000","last_clean":"2024-09-13T19:19:49.674734+0000","last_became_active":"2024-09-13T19:15:57.886330+0000","last_became_peered":"2024-09-13T19:15:57.886330+0000","last_unstale":"2024-09-13T19:19:49.674734+0000","last_undegraded":"2024-09-13T19:19:49.674734+0000","last_fullsized":"2024-09-13T19:19:49.674734+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-13T19:19:49.674619+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-13T19:19:49.674619+0000","last_clean_scrub_stamp":"2024-09-13T19:19:49.674619+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:12:49.826958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:06.543134+0000","last_change":"2024-09-13T19:20:06.543134+0000","last_active":"2024-09-13T19:20:06.543134+0000","last_peered":"2024-09-13T19:20:06.543134+0000","last_clean":"2024-09-13T19:20:06.543134+0000","last_became_active":"2024-09-13T19:15:55.890821+0000","last_became_peered":"2024-09-13T19:15:55.890821+0000","last_unstale":"2024-09-13T19:20:06.543134+0000","last_undegraded":"2024-09-13T19:20:06.543134+0000","last_fullsized":"2024-09-13T19:20:06.543134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:20:06.543016+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:20:06.543016+0000","last_clean_scrub_stamp":"2024-09-13T19:20:06.543016+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:12.896542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"36'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:36.019627+0000","last_change":"2024-09-13T19:19:36.019627+0000","last_active":"2024-09-13T19:19:36.019627+0000","last_peered":"2024-09-13T19:19:36.019627+0000","last_clean":"2024-09-13T19:19:36.019627+0000","last_became_active":"2024-09-13T19:15:57.898295+0000","last_became_peered":"2024-09-13T19:15:57.898295+0000","last_unstale":"2024-09-13T19:19:36.019627+0000","last_undegraded":"2024-09-13T19:19:36.019627+0000","last_fullsized":"2024-09-13T19:19:36.019627+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:36.019516+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:36.019516+0000","last_clean_scrub_stamp":"2024-09-13T19:19:36.019516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:53:21.194483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:32.012347+0000","last_change":"2024-09-13T19:20:32.012399+0000","last_active":"2024-09-13T19:20:32.012347+0000","last_peered":"2024-09-13T19:20:32.012347+0000","last_clean":"2024-09-13T19:20:32.012347+0000","last_became_active":"2024-09-13T19:15:55.893191+0000","last_became_peered":"2024-09-13T19:15:55.893191+0000","last_unstale":"2024-09-13T19:20:32.012347+0000","last_undegraded":"2024-09-13T19:20:32.012347+0000","last_fullsized":"2024-09-13T19:20:32.012347+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:32.012227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:32.012227+0000","last_clean_scrub_stamp":"2024-09-13T19:20:32.012227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:49.790813+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"36'6","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:53.687759+0000","last_change":"2024-09-13T19:19:53.687759+0000","last_active":"2024-09-13T19:19:53.687759+0000","last_peered":"2024-09-13T19:19:53.687759+0000","last_clean":"2024-09-13T19:19:53.687759+0000","last_became_active":"2024-09-13T19:15:57.886670+0000","last_became_peered":"2024-09-13T19:15:57.886670+0000","last_unstale":"2024-09-13T19:19:53.687759+0000","last_undegraded":"2024-09-13T19:19:53.687759+0000","last_fullsized":"2024-09-13T19:19:53.687759+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:19:53.687608+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:19:53.687608+0000","last_clean_scrub_stamp":"2024-09-13T19:19:53.687608+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:17:16.127903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:02.618155+0000","last_change":"2024-09-13T19:20:02.618155+0000","last_active":"2024-09-13T19:20:02.618155+0000","last_peered":"2024-09-13T19:20:02.618155+0000","last_clean":"2024-09-13T19:20:02.618155+0000","last_became_active":"2024-09-13T19:15:55.893569+0000","last_became_peered":"2024-09-13T19:15:55.893569+0000","last_unstale":"2024-09-13T19:20:02.618155+0000","last_undegraded":"2024-09-13T19:20:02.618155+0000","last_fullsized":"2024-09-13T19:20:02.618155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:02.618037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:02.618037+0000","last_clean_scrub_stamp":"2024-09-13T19:20:02.618037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:22:59.114041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"36'6","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:43.530124+0000","last_change":"2024-09-13T19:19:43.530124+0000","last_active":"2024-09-13T19:19:43.530124+0000","last_peered":"2024-09-13T19:19:43.530124+0000","last_clean":"2024-09-13T19:19:43.530124+0000","last_became_active":"2024-09-13T19:15:57.896487+0000","last_became_peered":"2024-09-13T19:15:57.896487+0000","last_unstale":"2024-09-13T19:19:43.530124+0000","last_undegraded":"2024-09-13T19:19:43.530124+0000","last_fullsized":"2024-09-13T19:19:43.530124+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:19:43.529999+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:19:43.529999+0000","last_clean_scrub_stamp":"2024-09-13T19:19:43.529999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:03:46.729174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:09.501604+0000","last_change":"2024-09-13T19:20:09.501604+0000","last_active":"2024-09-13T19:20:09.501604+0000","last_peered":"2024-09-13T19:20:09.501604+0000","last_clean":"2024-09-13T19:20:09.501604+0000","last_became_active":"2024-09-13T19:15:55.892026+0000","last_became_peered":"2024-09-13T19:15:55.892026+0000","last_unstale":"2024-09-13T19:20:09.501604+0000","last_undegraded":"2024-09-13T19:20:09.501604+0000","last_fullsized":"2024-09-13T19:20:09.501604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:09.501488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:09.501488+0000","last_clean_scrub_stamp":"2024-09-13T19:20:09.501488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:11:22.750033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"36'16","reported_seq":89,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:41.888155+0000","last_change":"2024-09-13T19:19:41.888155+0000","last_active":"2024-09-13T19:19:41.888155+0000","last_peered":"2024-09-13T19:19:41.888155+0000","last_clean":"2024-09-13T19:19:41.888155+0000","last_became_active":"2024-09-13T19:15:57.902841+0000","last_became_peered":"2024-09-13T19:15:57.902841+0000","last_unstale":"2024-09-13T19:19:41.888155+0000","last_undegraded":"2024-09-13T19:19:41.888155+0000","last_fullsized":"2024-09-13T19:19:41.888155+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-13T19:19:41.887974+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-13T19:19:41.887974+0000","last_clean_scrub_stamp":"2024-09-13T19:19:41.887974+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:50:07.467247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":56,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:53.061149+0000","last_change":"2024-09-13T19:19:53.061149+0000","last_active":"2024-09-13T19:19:53.061149+0000","last_peered":"2024-09-13T19:19:53.061149+0000","last_clean":"2024-09-13T19:19:53.061149+0000","last_became_active":"2024-09-13T19:15:55.896490+0000","last_became_peered":"2024-09-13T19:15:55.896490+0000","last_unstale":"2024-09-13T19:19:53.061149+0000","last_undegraded":"2024-09-13T19:19:53.061149+0000","last_fullsized":"2024-09-13T19:19:53.061149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:53.061037+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:53.061037+0000","last_clean_scrub_stamp":"2024-09-13T19:19:53.061037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:29.265310+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"36'6","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:55.659165+0000","last_change":"2024-09-13T19:19:55.659165+0000","last_active":"2024-09-13T19:19:55.659165+0000","last_peered":"2024-09-13T19:19:55.659165+0000","last_clean":"2024-09-13T19:19:55.659165+0000","last_became_active":"2024-09-13T19:15:57.887810+0000","last_became_peered":"2024-09-13T19:15:57.887810+0000","last_unstale":"2024-09-13T19:19:55.659165+0000","last_undegraded":"2024-09-13T19:19:55.659165+0000","last_fullsized":"2024-09-13T19:19:55.659165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:19:55.659049+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:19:55.659049+0000","last_clean_scrub_stamp":"2024-09-13T19:19:55.659049+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:55.028329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:02.547135+0000","last_change":"2024-09-13T19:20:02.547135+0000","last_active":"2024-09-13T19:20:02.547135+0000","last_peered":"2024-09-13T19:20:02.547135+0000","last_clean":"2024-09-13T19:20:02.547135+0000","last_became_active":"2024-09-13T19:15:55.891422+0000","last_became_peered":"2024-09-13T19:15:55.891422+0000","last_unstale":"2024-09-13T19:20:02.547135+0000","last_undegraded":"2024-09-13T19:20:02.547135+0000","last_fullsized":"2024-09-13T19:20:02.547135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:02.547002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:02.547002+0000","last_clean_scrub_stamp":"2024-09-13T19:20:02.547002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:49.436907+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"36'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:56.048975+0000","last_change":"2024-09-13T19:19:56.048975+0000","last_active":"2024-09-13T19:19:56.048975+0000","last_peered":"2024-09-13T19:19:56.048975+0000","last_clean":"2024-09-13T19:19:56.048975+0000","last_became_active":"2024-09-13T19:15:57.890491+0000","last_became_peered":"2024-09-13T19:15:57.890491+0000","last_unstale":"2024-09-13T19:19:56.048975+0000","last_undegraded":"2024-09-13T19:19:56.048975+0000","last_fullsized":"2024-09-13T19:19:56.048975+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:56.048815+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:56.048815+0000","last_clean_scrub_stamp":"2024-09-13T19:19:56.048815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:28:46.218969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"36'4","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:08.490661+0000","last_change":"2024-09-13T19:20:08.490661+0000","last_active":"2024-09-13T19:20:08.490661+0000","last_peered":"2024-09-13T19:20:08.490661+0000","last_clean":"2024-09-13T19:20:08.490661+0000","last_became_active":"2024-09-13T19:15:55.891860+0000","last_became_peered":"2024-09-13T19:15:55.891860+0000","last_unstale":"2024-09-13T19:20:08.490661+0000","last_undegraded":"2024-09-13T19:20:08.490661+0000","last_fullsized":"2024-09-13T19:20:08.490661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:20:08.490539+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:20:08.490539+0000","last_clean_scrub_stamp":"2024-09-13T19:20:08.490539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:22:22.024813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"36'6","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:00.044411+0000","last_change":"2024-09-13T19:20:00.044411+0000","last_active":"2024-09-13T19:20:00.044411+0000","last_peered":"2024-09-13T19:20:00.044411+0000","last_clean":"2024-09-13T19:20:00.044411+0000","last_became_active":"2024-09-13T19:15:57.892073+0000","last_became_peered":"2024-09-13T19:15:57.892073+0000","last_unstale":"2024-09-13T19:20:00.044411+0000","last_undegraded":"2024-09-13T19:20:00.044411+0000","last_fullsized":"2024-09-13T19:20:00.044411+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:20:00.044289+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:20:00.044289+0000","last_clean_scrub_stamp":"2024-09-13T19:20:00.044289+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:22:19.075182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"36'4","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:13.985513+0000","last_change":"2024-09-13T19:20:13.985513+0000","last_active":"2024-09-13T19:20:13.985513+0000","last_peered":"2024-09-13T19:20:13.985513+0000","last_clean":"2024-09-13T19:20:13.985513+0000","last_became_active":"2024-09-13T19:15:55.895911+0000","last_became_peered":"2024-09-13T19:15:55.895911+0000","last_unstale":"2024-09-13T19:20:13.985513+0000","last_undegraded":"2024-09-13T19:20:13.985513+0000","last_fullsized":"2024-09-13T19:20:13.985513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:20:13.985390+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:20:13.985390+0000","last_clean_scrub_stamp":"2024-09-13T19:20:13.985390+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:37:10.319405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"36'6","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:18.474999+0000","last_change":"2024-09-13T19:20:18.475022+0000","last_active":"2024-09-13T19:20:18.474999+0000","last_peered":"2024-09-13T19:20:18.474999+0000","last_clean":"2024-09-13T19:20:18.474999+0000","last_became_active":"2024-09-13T19:16:31.993403+0000","last_became_peered":"2024-09-13T19:16:31.993403+0000","last_unstale":"2024-09-13T19:20:18.474999+0000","last_undegraded":"2024-09-13T19:20:18.474999+0000","last_fullsized":"2024-09-13T19:20:18.474999+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:20:18.474922+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:20:18.474922+0000","last_clean_scrub_stamp":"2024-09-13T19:20:18.474922+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:56:02.335870+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:54.652681+0000","last_change":"2024-09-13T19:19:54.652681+0000","last_active":"2024-09-13T19:19:54.652681+0000","last_peered":"2024-09-13T19:19:54.652681+0000","last_clean":"2024-09-13T19:19:54.652681+0000","last_became_active":"2024-09-13T19:15:55.894607+0000","last_became_peered":"2024-09-13T19:15:55.894607+0000","last_unstale":"2024-09-13T19:19:54.652681+0000","last_undegraded":"2024-09-13T19:19:54.652681+0000","last_fullsized":"2024-09-13T19:19:54.652681+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:54.652549+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:54.652549+0000","last_clean_scrub_stamp":"2024-09-13T19:19:54.652549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:13:55.710652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"36'2","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:42.516418+0000","last_change":"2024-09-13T19:19:42.516418+0000","last_active":"2024-09-13T19:19:42.516418+0000","last_peered":"2024-09-13T19:19:42.516418+0000","last_clean":"2024-09-13T19:19:42.516418+0000","last_became_active":"2024-09-13T19:15:57.900902+0000","last_became_peered":"2024-09-13T19:15:57.900902+0000","last_unstale":"2024-09-13T19:19:42.516418+0000","last_undegraded":"2024-09-13T19:19:42.516418+0000","last_fullsized":"2024-09-13T19:19:42.516418+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:42.516279+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:42.516279+0000","last_clean_scrub_stamp":"2024-09-13T19:19:42.516279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:17.797802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:51.003653+0000","last_change":"2024-09-13T19:19:51.003653+0000","last_active":"2024-09-13T19:19:51.003653+0000","last_peered":"2024-09-13T19:19:51.003653+0000","last_clean":"2024-09-13T19:19:51.003653+0000","last_became_active":"2024-09-13T19:15:55.905867+0000","last_became_peered":"2024-09-13T19:15:55.905867+0000","last_unstale":"2024-09-13T19:19:51.003653+0000","last_undegraded":"2024-09-13T19:19:51.003653+0000","last_fullsized":"2024-09-13T19:19:51.003653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:51.003475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:51.003475+0000","last_clean_scrub_stamp":"2024-09-13T19:19:51.003475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:43.388075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:45.895163+0000","last_change":"2024-09-13T19:19:45.895163+0000","last_active":"2024-09-13T19:19:45.895163+0000","last_peered":"2024-09-13T19:19:45.895163+0000","last_clean":"2024-09-13T19:19:45.895163+0000","last_became_active":"2024-09-13T19:15:57.889606+0000","last_became_peered":"2024-09-13T19:15:57.889606+0000","last_unstale":"2024-09-13T19:19:45.895163+0000","last_undegraded":"2024-09-13T19:19:45.895163+0000","last_fullsized":"2024-09-13T19:19:45.895163+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:19:45.895012+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:19:45.895012+0000","last_clean_scrub_stamp":"2024-09-13T19:19:45.895012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:09.506224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:01.092995+0000","last_change":"2024-09-13T19:20:01.092995+0000","last_active":"2024-09-13T19:20:01.092995+0000","last_peered":"2024-09-13T19:20:01.092995+0000","last_clean":"2024-09-13T19:20:01.092995+0000","last_became_active":"2024-09-13T19:15:55.896086+0000","last_became_peered":"2024-09-13T19:15:55.896086+0000","last_unstale":"2024-09-13T19:20:01.092995+0000","last_undegraded":"2024-09-13T19:20:01.092995+0000","last_fullsized":"2024-09-13T19:20:01.092995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:20:01.092860+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:20:01.092860+0000","last_clean_scrub_stamp":"2024-09-13T19:20:01.092860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:06.060089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"36'12","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:09.526035+0000","last_change":"2024-09-13T19:20:09.526086+0000","last_active":"2024-09-13T19:20:09.526035+0000","last_peered":"2024-09-13T19:20:09.526035+0000","last_clean":"2024-09-13T19:20:09.526035+0000","last_became_active":"2024-09-13T19:16:31.991965+0000","last_became_peered":"2024-09-13T19:16:31.991965+0000","last_unstale":"2024-09-13T19:20:09.526035+0000","last_undegraded":"2024-09-13T19:20:09.526035+0000","last_fullsized":"2024-09-13T19:20:09.526035+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-13T19:20:09.525926+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-13T19:20:09.525926+0000","last_clean_scrub_stamp":"2024-09-13T19:20:09.525926+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:11:08.529306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:22.027601+0000","last_change":"2024-09-13T19:20:22.027601+0000","last_active":"2024-09-13T19:20:22.027601+0000","last_peered":"2024-09-13T19:20:22.027601+0000","last_clean":"2024-09-13T19:20:22.027601+0000","last_became_active":"2024-09-13T19:15:55.894634+0000","last_became_peered":"2024-09-13T19:15:55.894634+0000","last_unstale":"2024-09-13T19:20:22.027601+0000","last_undegraded":"2024-09-13T19:20:22.027601+0000","last_fullsized":"2024-09-13T19:20:22.027601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:22.027480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:22.027480+0000","last_clean_scrub_stamp":"2024-09-13T19:20:22.027480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:17.531054+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"36'4","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:10.090669+0000","last_change":"2024-09-13T19:20:10.090669+0000","last_active":"2024-09-13T19:20:10.090669+0000","last_peered":"2024-09-13T19:20:10.090669+0000","last_clean":"2024-09-13T19:20:10.090669+0000","last_became_active":"2024-09-13T19:15:57.892558+0000","last_became_peered":"2024-09-13T19:15:57.892558+0000","last_unstale":"2024-09-13T19:20:10.090669+0000","last_undegraded":"2024-09-13T19:20:10.090669+0000","last_fullsized":"2024-09-13T19:20:10.090669+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-13T19:20:10.090552+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-13T19:20:10.090552+0000","last_clean_scrub_stamp":"2024-09-13T19:20:10.090552+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:34.228351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:20.021283+0000","last_change":"2024-09-13T19:20:20.021283+0000","last_active":"2024-09-13T19:20:20.021283+0000","last_peered":"2024-09-13T19:20:20.021283+0000","last_clean":"2024-09-13T19:20:20.021283+0000","last_became_active":"2024-09-13T19:15:55.894667+0000","last_became_peered":"2024-09-13T19:15:55.894667+0000","last_unstale":"2024-09-13T19:20:20.021283+0000","last_undegraded":"2024-09-13T19:20:20.021283+0000","last_fullsized":"2024-09-13T19:20:20.021283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:20:20.021150+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:20:20.021150+0000","last_clean_scrub_stamp":"2024-09-13T19:20:20.021150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:07.033446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"36'18","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:57.954953+0000","last_change":"2024-09-13T19:19:57.954953+0000","last_active":"2024-09-13T19:19:57.954953+0000","last_peered":"2024-09-13T19:19:57.954953+0000","last_clean":"2024-09-13T19:19:57.954953+0000","last_became_active":"2024-09-13T19:15:57.896200+0000","last_became_peered":"2024-09-13T19:15:57.896200+0000","last_unstale":"2024-09-13T19:19:57.954953+0000","last_undegraded":"2024-09-13T19:19:57.954953+0000","last_fullsized":"2024-09-13T19:19:57.954953+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'18","last_scrub_stamp":"2024-09-13T19:19:57.954831+0000","last_deep_scrub":"36'18","last_deep_scrub_stamp":"2024-09-13T19:19:57.954831+0000","last_clean_scrub_stamp":"2024-09-13T19:19:57.954831+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:03:45.500917+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":50,"num_read_kb":42,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:44.812086+0000","last_change":"2024-09-13T19:19:44.812086+0000","last_active":"2024-09-13T19:19:44.812086+0000","last_peered":"2024-09-13T19:19:44.812086+0000","last_clean":"2024-09-13T19:19:44.812086+0000","last_became_active":"2024-09-13T19:15:55.899104+0000","last_became_peered":"2024-09-13T19:15:55.899104+0000","last_unstale":"2024-09-13T19:19:44.812086+0000","last_undegraded":"2024-09-13T19:19:44.812086+0000","last_fullsized":"2024-09-13T19:19:44.812086+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-13T19:19:44.811952+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-13T19:19:44.811952+0000","last_clean_scrub_stamp":"2024-09-13T19:19:44.811952+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:20.375216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"36'12","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:49.979997+0000","last_change":"2024-09-13T19:19:49.979997+0000","last_active":"2024-09-13T19:19:49.979997+0000","last_peered":"2024-09-13T19:19:49.979997+0000","last_clean":"2024-09-13T19:19:49.979997+0000","last_became_active":"2024-09-13T19:15:57.889781+0000","last_became_peered":"2024-09-13T19:15:57.889781+0000","last_unstale":"2024-09-13T19:19:49.979997+0000","last_undegraded":"2024-09-13T19:19:49.979997+0000","last_fullsized":"2024-09-13T19:19:49.979997+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-13T19:19:49.979869+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-13T19:19:49.979869+0000","last_clean_scrub_stamp":"2024-09-13T19:19:49.979869+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:02:58.441045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:10.970073+0000","last_change":"2024-09-13T19:20:10.970073+0000","last_active":"2024-09-13T19:20:10.970073+0000","last_peered":"2024-09-13T19:20:10.970073+0000","last_clean":"2024-09-13T19:20:10.970073+0000","last_became_active":"2024-09-13T19:15:55.898627+0000","last_became_peered":"2024-09-13T19:15:55.898627+0000","last_unstale":"2024-09-13T19:20:10.970073+0000","last_undegraded":"2024-09-13T19:20:10.970073+0000","last_fullsized":"2024-09-13T19:20:10.970073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:10.969953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:10.969953+0000","last_clean_scrub_stamp":"2024-09-13T19:20:10.969953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:30.846775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:17.004553+0000","last_change":"2024-09-13T19:20:17.004553+0000","last_active":"2024-09-13T19:20:17.004553+0000","last_peered":"2024-09-13T19:20:17.004553+0000","last_clean":"2024-09-13T19:20:17.004553+0000","last_became_active":"2024-09-13T19:15:55.899225+0000","last_became_peered":"2024-09-13T19:15:55.899225+0000","last_unstale":"2024-09-13T19:20:17.004553+0000","last_undegraded":"2024-09-13T19:20:17.004553+0000","last_fullsized":"2024-09-13T19:20:17.004553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:20:17.004434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:20:17.004434+0000","last_clean_scrub_stamp":"2024-09-13T19:20:17.004434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:10:14.965615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"36'6","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:20:11.491091+0000","last_change":"2024-09-13T19:20:11.491091+0000","last_active":"2024-09-13T19:20:11.491091+0000","last_peered":"2024-09-13T19:20:11.491091+0000","last_clean":"2024-09-13T19:20:11.491091+0000","last_became_active":"2024-09-13T19:15:57.890325+0000","last_became_peered":"2024-09-13T19:15:57.890325+0000","last_unstale":"2024-09-13T19:20:11.491091+0000","last_undegraded":"2024-09-13T19:20:11.491091+0000","last_fullsized":"2024-09-13T19:20:11.491091+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-13T19:20:11.490910+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-13T19:20:11.490910+0000","last_clean_scrub_stamp":"2024-09-13T19:20:11.490910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:00:52.840106+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:52.700775+0000","last_change":"2024-09-13T19:19:52.700775+0000","last_active":"2024-09-13T19:19:52.700775+0000","last_peered":"2024-09-13T19:19:52.700775+0000","last_clean":"2024-09-13T19:19:52.700775+0000","last_became_active":"2024-09-13T19:15:55.894485+0000","last_became_peered":"2024-09-13T19:15:55.894485+0000","last_unstale":"2024-09-13T19:19:52.700775+0000","last_undegraded":"2024-09-13T19:19:52.700775+0000","last_fullsized":"2024-09-13T19:19:52.700775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:19:52.700644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:19:52.700644+0000","last_clean_scrub_stamp":"2024-09-13T19:19:52.700644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:49.700387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"36'8","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T19:19:42.871437+0000","last_change":"2024-09-13T19:19:42.871437+0000","last_active":"2024-09-13T19:19:42.871437+0000","last_peered":"2024-09-13T19:19:42.871437+0000","last_clean":"2024-09-13T19:19:42.871437+0000","last_became_active":"2024-09-13T19:15:57.902123+0000","last_became_peered":"2024-09-13T19:15:57.902123+0000","last_unstale":"2024-09-13T19:19:42.871437+0000","last_undegraded":"2024-09-13T19:19:42.871437+0000","last_fullsized":"2024-09-13T19:19:42.871437+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-13T19:19:42.871311+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-13T19:19:42.871311+0000","last_clean_scrub_stamp":"2024-09-13T19:19:42.871311+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:31.855620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1523,"ondisk_log_size":1523,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1595,"num_read_kb":1485,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":482,"ondisk_log_size":482,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640325,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39996,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331844,"statfs":{"total":96636764160,"available":96595808256,"internally_reserved":0,"allocated":503808,"data_stored":158624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640324,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40512,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331328,"statfs":{"total":96636764160,"available":96595279872,"internally_reserved":0,"allocated":1032192,"data_stored":746866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640324,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40528,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331312,"statfs":{"total":96636764160,"available":96595263488,"internally_reserved":0,"allocated":1048576,"data_stored":746030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705732,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31636,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340204,"statfs":{"total":96636764160,"available":96604368896,"internally_reserved":0,"allocated":462848,"data_stored":156440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T19:20:59.137 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-13T19:20:59.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.250+0000 7f2762065640 1 Processor -- start 2024-09-13T19:20:59.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.250+0000 7f2762065640 1 -- start start 2024-09-13T19:20:59.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.250+0000 7f2762065640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f275c06eda0 0x7f275c06f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:20:59.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.250+0000 7f2762065640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f275c06eba0 con 0x7f275c06f6c0 2024-09-13T19:20:59.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.250+0000 7f2762065640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f275c06d2f0 con 0x7f275c06eda0 2024-09-13T19:20:59.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.250+0000 7f275b7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f275c06eda0 0x7f275c06f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:20:59.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.250+0000 7f275affd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f275c06f6c0 0x7f275c121a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:38058/0 (socket says 172.21.15.53:38058) 2024-09-13T19:20:59.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.251+0000 7f275affd640 1 -- 172.21.15.53:0/2311720546 learned_addr learned my addr 172.21.15.53:0/2311720546 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T19:20:59.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.251+0000 7f275b7fe640 1 -- 172.21.15.53:0/2311720546 >> v1:172.21.15.53:6789/0 conn(0x7f275c06f6c0 legacy=0x7f275c121a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:20:59.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.251+0000 7f275b7fe640 1 -- 172.21.15.53:0/2311720546 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f275c070d50 con 0x7f275c06eda0 2024-09-13T19:20:59.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.251+0000 7f275b7fe640 1 --2- 172.21.15.53:0/2311720546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f275c06eda0 0x7f275c06f180 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f2750009720 tx=0x7f275002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b4bf930447c445c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:20:59.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.252+0000 7f275a7fc640 1 -- 172.21.15.53:0/2311720546 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2750037070 con 0x7f275c06eda0 2024-09-13T19:20:59.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.252+0000 7f275a7fc640 1 -- 172.21.15.53:0/2311720546 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f275002ae20 con 0x7f275c06eda0 2024-09-13T19:20:59.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.252+0000 7f275a7fc640 1 -- 172.21.15.53:0/2311720546 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2750032590 con 0x7f275c06eda0 2024-09-13T19:20:59.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.252+0000 7f2762065640 1 -- 172.21.15.53:0/2311720546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f275c06eda0 msgr2=0x7f275c06f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:20:59.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.252+0000 7f2762065640 1 --2- 172.21.15.53:0/2311720546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f275c06eda0 0x7f275c06f180 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f2750009720 tx=0x7f275002a1a0 comp rx=0 tx=0).stop 2024-09-13T19:20:59.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.252+0000 7f2762065640 1 -- 172.21.15.53:0/2311720546 shutdown_connections 2024-09-13T19:20:59.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.252+0000 7f2762065640 1 --2- 172.21.15.53:0/2311720546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f275c06eda0 0x7f275c06f180 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:20:59.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.252+0000 7f2762065640 1 -- 172.21.15.53:0/2311720546 >> 172.21.15.53:0/2311720546 conn(0x7f275c09a890 msgr2=0x7f275c09aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:20:59.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.252+0000 7f2762065640 1 -- 172.21.15.53:0/2311720546 shutdown_connections 2024-09-13T19:20:59.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.252+0000 7f2762065640 1 -- 172.21.15.53:0/2311720546 wait complete. 2024-09-13T19:20:59.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.253+0000 7f2762065640 1 Processor -- start 2024-09-13T19:20:59.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.253+0000 7f2762065640 1 -- start start 2024-09-13T19:20:59.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.254+0000 7f2762065640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f275c06eda0 0x7f275c12b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:20:59.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.254+0000 7f2762065640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f275c122160 con 0x7f275c06eda0 2024-09-13T19:20:59.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.254+0000 7f275b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f275c06eda0 0x7f275c12b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:20:59.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.254+0000 7f275b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f275c06eda0 0x7f275c12b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53988/0 (socket says 172.21.15.53:53988) 2024-09-13T19:20:59.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.254+0000 7f275b7fe640 1 -- 172.21.15.53:0/3642069726 learned_addr learned my addr 172.21.15.53:0/3642069726 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T19:20:59.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.254+0000 7f275b7fe640 1 -- 172.21.15.53:0/3642069726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f275c08b3a0 con 0x7f275c06eda0 2024-09-13T19:20:59.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.254+0000 7f275b7fe640 1 --2- 172.21.15.53:0/3642069726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f275c06eda0 0x7f275c12b060 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f275002a1e0 tx=0x7f27500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:20:59.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.254+0000 7f2743fff640 1 -- 172.21.15.53:0/3642069726 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2750042070 con 0x7f275c06eda0 2024-09-13T19:20:59.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.254+0000 7f2743fff640 1 -- 172.21.15.53:0/3642069726 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f275003e670 con 0x7f275c06eda0 2024-09-13T19:20:59.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.254+0000 7f2762065640 1 -- 172.21.15.53:0/3642069726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f275c08ba80 con 0x7f275c06eda0 2024-09-13T19:20:59.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.254+0000 7f2743fff640 1 -- 172.21.15.53:0/3642069726 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2750037040 con 0x7f275c06eda0 2024-09-13T19:20:59.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.254+0000 7f2762065640 1 -- 172.21.15.53:0/3642069726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f275c12b5a0 con 0x7f275c06eda0 2024-09-13T19:20:59.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.255+0000 7f2743fff640 1 -- 172.21.15.53:0/3642069726 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2750045070 con 0x7f275c06eda0 2024-09-13T19:20:59.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.255+0000 7f2762065640 1 -- 172.21.15.53:0/3642069726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f275c122670 con 0x7f275c06eda0 2024-09-13T19:20:59.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.255+0000 7f2743fff640 1 --2- 172.21.15.53:0/3642069726 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f27480382a0 0x7f274803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:20:59.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.255+0000 7f2743fff640 1 -- 172.21.15.53:0/3642069726 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6313+0+0 (secure 0 0 0) 0x7f275006c740 con 0x7f275c06eda0 2024-09-13T19:20:59.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.256+0000 7f275affd640 1 --2- 172.21.15.53:0/3642069726 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f27480382a0 0x7f274803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:20:59.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.256+0000 7f275affd640 1 --2- 172.21.15.53:0/3642069726 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f27480382a0 0x7f274803a760 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f274c000f60 tx=0x7f274c007a80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:20:59.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.260+0000 7f2743fff640 1 -- 172.21.15.53:0/3642069726 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f275004f990 con 0x7f275c06eda0 2024-09-13T19:20:59.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.435+0000 7f2762065640 1 -- 172.21.15.53:0/3642069726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f275c06bba0 con 0x7f275c06eda0 2024-09-13T19:20:59.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.438+0000 7f2743fff640 1 -- 172.21.15.53:0/3642069726 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7f275003c7b0 con 0x7f275c06eda0 2024-09-13T19:20:59.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.438+0000 7f2743fff640 1 -- 172.21.15.53:0/3642069726 <== mon.0 v2:172.21.15.53:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f275004fc50 con 0x7f275c06eda0 2024-09-13T19:20:59.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.440+0000 7f2762065640 1 -- 172.21.15.53:0/3642069726 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f27480382a0 msgr2=0x7f274803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:20:59.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.440+0000 7f2762065640 1 --2- 172.21.15.53:0/3642069726 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f27480382a0 0x7f274803a760 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f274c000f60 tx=0x7f274c007a80 comp rx=0 tx=0).stop 2024-09-13T19:20:59.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.440+0000 7f2762065640 1 -- 172.21.15.53:0/3642069726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f275c06eda0 msgr2=0x7f275c12b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:20:59.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.440+0000 7f2762065640 1 --2- 172.21.15.53:0/3642069726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f275c06eda0 0x7f275c12b060 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f275002a1e0 tx=0x7f27500046c0 comp rx=0 tx=0).stop 2024-09-13T19:20:59.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.440+0000 7f2762065640 1 -- 172.21.15.53:0/3642069726 shutdown_connections 2024-09-13T19:20:59.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.440+0000 7f2762065640 1 --2- 172.21.15.53:0/3642069726 >> [v2:172.21.15.102:6824/4283826432,v1:172.21.15.102:6825/4283826432] conn(0x7f27480382a0 0x7f274803a760 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:20:59.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.440+0000 7f2762065640 1 --2- 172.21.15.53:0/3642069726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f275c06eda0 0x7f275c12b060 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:20:59.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.440+0000 7f2762065640 1 -- 172.21.15.53:0/3642069726 >> 172.21.15.53:0/3642069726 conn(0x7f275c09a890 msgr2=0x7f275c097bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:20:59.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.440+0000 7f2762065640 1 -- 172.21.15.53:0/3642069726 shutdown_connections 2024-09-13T19:20:59.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T19:20:59.440+0000 7f2762065640 1 -- 172.21.15.53:0/3642069726 wait complete. 2024-09-13T19:20:59.454 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-13T19:20:59.454 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-13T19:20:59.455 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-13T19:20:59.455 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T19:20:59.488 INFO:tasks.ceph.osd.0:Stopped 2024-09-13T19:20:59.488 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-13T19:20:59.488 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T19:20:59.525 INFO:tasks.ceph.osd.1:Stopped 2024-09-13T19:20:59.526 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-13T19:20:59.526 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T19:20:59.597 INFO:tasks.ceph.osd.2:Stopped 2024-09-13T19:20:59.598 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-13T19:20:59.598 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T19:20:59.673 INFO:tasks.ceph.osd.3:Stopped 2024-09-13T19:20:59.673 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-13T19:20:59.674 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-13T19:20:59.674 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T19:20:59.744 INFO:tasks.ceph.mgr.x:Stopped 2024-09-13T19:20:59.745 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-13T19:20:59.749 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-13T19:20:59.749 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T19:20:59.761 INFO:tasks.ceph.mon.a:Stopped 2024-09-13T19:20:59.761 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-13T19:20:59.761 DEBUG:teuthology.orchestra.run.smithi053:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-09-13T19:20:59.830 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi053.front.sepia.ceph.com 2024-09-13T19:20:59.830 DEBUG:teuthology.orchestra.run.smithi053:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-13T19:20:59.965 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-13T19:20:59.965 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-13T19:21:00.083 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-13T19:21:00.083 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-13T19:21:00.162 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-13T19:21:00.163 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-13T19:21:00.219 INFO:tasks.ceph:Archiving mon data... 2024-09-13T19:21:00.221 DEBUG:teuthology.misc:Transferring archived files from smithi053:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-09-13_16:28:49-rgw-squid-distro-default-smithi/7904057/data/mon.a.tgz 2024-09-13T19:21:00.221 DEBUG:teuthology.orchestra.run.smithi053:> mktemp 2024-09-13T19:21:00.238 INFO:teuthology.orchestra.run.smithi053.stdout:/tmp/tmp.sF4cJDqgCN 2024-09-13T19:21:00.238 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.sF4cJDqgCN 2024-09-13T19:21:00.381 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0666 /tmp/tmp.sF4cJDqgCN 2024-09-13T19:21:00.467 DEBUG:teuthology.orchestra.remote:smithi053:/tmp/tmp.sF4cJDqgCN is 274KB 2024-09-13T19:21:00.566 DEBUG:teuthology.orchestra.run.smithi053:> rm -fr /tmp/tmp.sF4cJDqgCN 2024-09-13T19:21:00.582 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-13T19:21:00.582 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T19:21:00.624 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T19:21:00.704 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-13T19:21:00.722 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-13T19:21:00.722 INFO:tasks.ceph:Archiving crash dumps... 2024-09-13T19:21:00.724 DEBUG:teuthology.misc:Transferring archived files from smithi053:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-13_16:28:49-rgw-squid-distro-default-smithi/7904057/remote/smithi053/crash 2024-09-13T19:21:00.725 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T19:21:00.771 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-13_16:28:49-rgw-squid-distro-default-smithi/7904057/remote/smithi102/crash 2024-09-13T19:21:00.772 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T19:21:00.809 INFO:tasks.ceph:Compressing logs... 2024-09-13T19:21:00.810 DEBUG:teuthology.orchestra.run.smithi053:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-13T19:21:00.813 DEBUG:teuthology.orchestra.run.smithi102:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-13T19:21:00.836 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-13T19:21:00.836 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29051.log 2024-09-13T19:21:00.836 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31139.log 2024-09-13T19:21:00.854 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.29051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30987.log 2024-09-13T19:21:00.854 INFO:teuthology.orchestra.run.smithi053.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.29051.log.gz 2024-09-13T19:21:00.854 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30167.log 2024-09-13T19:21:00.855 INFO:teuthology.orchestra.run.smithi053.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.31139.log.gz 2024-09-13T19:21:00.855 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31529.log 2024-09-13T19:21:00.855 INFO:teuthology.orchestra.run.smithi053.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.30987.log.gz 2024-09-13T19:21:00.855 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30482.log 2024-09-13T19:21:00.855 INFO:teuthology.orchestra.run.smithi053.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.30167.log.gz 2024-09-13T19:21:00.855 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31951.log 2024-09-13T19:21:00.855 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30482.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.31529.log.gz 2024-09-13T19:21:00.855 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31319.log 2024-09-13T19:21:00.855 INFO:teuthology.orchestra.run.smithi053.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.30482.log.gz 2024-09-13T19:21:00.855 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30223.log 2024-09-13T19:21:00.855 INFO:teuthology.orchestra.run.smithi053.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.31951.log.gz 2024-09-13T19:21:00.856 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31361.log 2024-09-13T19:21:00.856 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30223.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.31319.log.gz 2024-09-13T19:21:00.856 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31866.log 2024-09-13T19:21:00.856 INFO:teuthology.orchestra.run.smithi053.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.30223.log.gz 2024-09-13T19:21:00.856 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31445.log 2024-09-13T19:21:00.856 INFO:teuthology.orchestra.run.smithi053.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.31361.log.gz 2024-09-13T19:21:00.856 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31235.log 2024-09-13T19:21:00.856 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31445.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.31866.log.gz 2024-09-13T19:21:00.856 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30929.log 2024-09-13T19:21:00.856 INFO:teuthology.orchestra.run.smithi053.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.31445.log.gz 2024-09-13T19:21:00.856 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30612.log 2024-09-13T19:21:00.856 INFO:teuthology.orchestra.run.smithi053.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.31235.log.gz 2024-09-13T19:21:00.856 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31781.log 2024-09-13T19:21:00.857 INFO:teuthology.orchestra.run.smithi053.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.30929.log.gz 2024-09-13T19:21:00.857 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30800.log 2024-09-13T19:21:00.857 INFO:teuthology.orchestra.run.smithi053.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.30612.log.gz 2024-09-13T19:21:00.857 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30988.log 2024-09-13T19:21:00.857 INFO:teuthology.orchestra.run.smithi053.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.31781.log.gz 2024-09-13T19:21:00.857 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30800.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-13T19:21:00.857 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30988.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.30800.log.gz 2024-09-13T19:21:00.857 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30613.log 2024-09-13T19:21:00.857 INFO:teuthology.orchestra.run.smithi053.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.30988.log.gz 2024-09-13T19:21:00.857 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31613.log 2024-09-13T19:21:00.857 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.30613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30989.log 2024-09-13T19:21:00.857 INFO:teuthology.orchestra.run.smithi053.stderr: 88.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-13T19:21:00.857 INFO:teuthology.orchestra.run.smithi053.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.30613.log.gz 2024-09-13T19:21:00.858 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30823.log 2024-09-13T19:21:00.858 INFO:teuthology.orchestra.run.smithi053.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.31613.log.gz 2024-09-13T19:21:00.858 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30652.log 2024-09-13T19:21:00.858 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31908.log 2024-09-13T19:21:00.858 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30823.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.30989.log.gz 2024-09-13T19:21:00.858 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30652.log: gzip -5 --verbose 86.1% -- /var/log/ceph/ceph-client.admin.31697.log -- replaced with /var/log/ceph/ceph-client.admin.30823.log.gz 2024-09-13T19:21:00.858 INFO:teuthology.orchestra.run.smithi053.stderr: 2024-09-13T19:21:00.858 INFO:teuthology.orchestra.run.smithi053.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.30652.log.gz 2024-09-13T19:21:00.858 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30383.log 2024-09-13T19:21:00.858 INFO:teuthology.orchestra.run.smithi053.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.31908.log.gz 2024-09-13T19:21:00.858 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31571.log 2024-09-13T19:21:00.858 INFO:teuthology.orchestra.run.smithi053.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.31697.log.gz 2024-09-13T19:21:00.858 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30383.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-13T19:21:00.858 INFO:teuthology.orchestra.run.smithi053.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.30383.log.gz 2024-09-13T19:21:00.859 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29009.log 2024-09-13T19:21:00.859 INFO:teuthology.orchestra.run.smithi053.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.31571.log.gz 2024-09-13T19:21:00.859 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31655.log 2024-09-13T19:21:00.859 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.29009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30341.log 2024-09-13T19:21:00.859 INFO:teuthology.orchestra.run.smithi053.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.29009.log.gz 2024-09-13T19:21:00.859 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30248.log 2024-09-13T19:21:00.859 INFO:teuthology.orchestra.run.smithi053.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.31655.log.gz 2024-09-13T19:21:00.859 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30801.log 2024-09-13T19:21:00.859 INFO:teuthology.orchestra.run.smithi053.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.30341.log.gz 2024-09-13T19:21:00.859 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30483.log 2024-09-13T19:21:00.859 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30801.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.30248.log.gz 2024-09-13T19:21:00.859 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-13T19:21:00.859 INFO:teuthology.orchestra.run.smithi053.stderr: 85.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.30801.log.gz 2024-09-13T19:21:00.859 INFO:teuthology.orchestra.run.smithi053.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.31277.log 2024-09-13T19:21:00.860 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30483.log: /var/log/ceph/ceph.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.30483.log.gz 2024-09-13T19:21:00.860 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30485.log 2024-09-13T19:21:00.860 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31487.log 2024-09-13T19:21:00.860 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30485.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.31277.log.gz 2024-09-13T19:21:00.860 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30653.log 2024-09-13T19:21:00.860 INFO:teuthology.orchestra.run.smithi053.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.30485.log.gz 2024-09-13T19:21:00.860 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31739.log 2024-09-13T19:21:00.860 INFO:teuthology.orchestra.run.smithi053.stderr: 86.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-13T19:21:00.860 INFO:teuthology.orchestra.run.smithi053.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.31487.log.gz/var/log/ceph/ceph-client.admin.30653.log: 2024-09-13T19:21:00.860 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31181.log 2024-09-13T19:21:00.860 INFO:teuthology.orchestra.run.smithi053.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.30653.log.gz 2024-09-13T19:21:00.860 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27168.log/var/log/ceph/ceph-client.admin.31739.log: 2024-09-13T19:21:00.861 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31181.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.31739.log.gz 2024-09-13T19:21:00.861 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30761.log 2024-09-13T19:21:00.861 INFO:teuthology.orchestra.run.smithi053.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.31181.log.gz 2024-09-13T19:21:00.861 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph.tmp-client.admin.27168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28891.log 2024-09-13T19:21:00.861 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27168.log.gz 2024-09-13T19:21:00.861 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31823.log 2024-09-13T19:21:00.861 INFO:teuthology.orchestra.run.smithi053.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.30761.log.gz 2024-09-13T19:21:00.861 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.28891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30101.log 2024-09-13T19:21:00.861 INFO:teuthology.orchestra.run.smithi053.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.28891.log.gz 2024-09-13T19:21:00.861 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31991.log 2024-09-13T19:21:00.861 INFO:teuthology.orchestra.run.smithi053.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.31823.log.gz 2024-09-13T19:21:00.861 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31097.log 2024-09-13T19:21:00.861 INFO:teuthology.orchestra.run.smithi053.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.30101.log.gz 2024-09-13T19:21:00.861 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30484.log 2024-09-13T19:21:00.862 INFO:teuthology.orchestra.run.smithi053.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.31991.log.gz 2024-09-13T19:21:00.862 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31403.log 2024-09-13T19:21:00.862 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31097.log: /var/log/ceph/ceph-client.admin.30484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30299.log 2024-09-13T19:21:00.862 INFO:teuthology.orchestra.run.smithi053.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.31097.log.gz 2024-09-13T19:21:00.862 INFO:teuthology.orchestra.run.smithi053.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.30484.log.gz 2024-09-13T19:21:00.862 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31403.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.31403.log.gz 2024-09-13T19:21:00.862 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30299.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.30299.log.gz 2024-09-13T19:21:00.890 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87738.log 2024-09-13T19:21:00.890 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.89547.log 2024-09-13T19:21:00.890 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65377.log 2024-09-13T19:21:00.890 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.87738.log: /var/log/ceph/ceph-client.0.89547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75057.log 2024-09-13T19:21:00.892 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.65377.log: 90.3% -- replaced with /var/log/ceph/ceph-client.0.87738.log.gz 2024-09-13T19:21:00.892 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84132.log 2024-09-13T19:21:00.892 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.75057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92572.log 2024-09-13T19:21:00.892 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.84132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84737.log 2024-09-13T19:21:00.892 INFO:teuthology.orchestra.run.smithi102.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.89547.log.gz 2024-09-13T19:21:00.892 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.92572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45412.log 2024-09-13T19:21:00.893 INFO:teuthology.orchestra.run.smithi102.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.65377.log.gz 2024-09-13T19:21:00.893 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.84737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51462.log 2024-09-13T19:21:00.893 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.45412.log: gzip -5 --verbose -- 91.7% /var/log/ceph/ceph-client.0.60537.log 2024-09-13T19:21:00.893 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.0.75057.log.gz 2024-09-13T19:21:00.907 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-13T19:21:00.907 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.51462.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.92572.log.gz 2024-09-13T19:21:00.907 INFO:teuthology.orchestra.run.smithi102.stderr: 91.4%gzip -- replaced with /var/log/ceph/ceph-client.0.84737.log.gz 2024-09-13T19:21:00.907 INFO:teuthology.orchestra.run.smithi102.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.82317.log 2024-09-13T19:21:00.907 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.60537.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.84132.log.gz 2024-09-13T19:21:00.907 INFO:teuthology.orchestra.run.smithi102.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.45412.log.gz 2024-09-13T19:21:00.907 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57512.log 2024-09-13T19:21:00.907 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-13T19:21:00.907 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.82317.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.51462.log.gz 2024-09-13T19:21:00.907 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.57512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86540.log 2024-09-13T19:21:00.907 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ops-log-ceph-client.0.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.60537.log.gz 2024-09-13T19:21:00.907 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41177.log 2024-09-13T19:21:00.908 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.86540.log: 91.8% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-13T19:21:00.908 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58722.log 2024-09-13T19:21:00.908 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47832.log 2024-09-13T19:21:00.908 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.41177.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.57512.log.gz 2024-09-13T19:21:00.908 INFO:teuthology.orchestra.run.smithi102.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.0.86540.log.gz 2024-09-13T19:21:00.908 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.58722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49647.log 2024-09-13T19:21:00.908 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79292.log 2024-09-13T19:21:00.908 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.47832.log: /var/log/ceph/ceph-client.0.49647.log: gzip -5 --verbose -- 91.3% -- replaced with /var/log/ceph/ceph-client.0.41177.log.gz 2024-09-13T19:21:00.908 INFO:teuthology.orchestra.run.smithi102.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.82317.log.gz 2024-09-13T19:21:00.908 INFO:teuthology.orchestra.run.smithi102.stderr: /var/log/ceph/ceph-client.0.55092.log 2024-09-13T19:21:00.908 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.79292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82922.log 2024-09-13T19:21:00.908 INFO:teuthology.orchestra.run.smithi102.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.58722.log.gz 2024-09-13T19:21:00.908 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.55092.log: gzip -5 91.3% -- replaced with /var/log/ceph/ceph-client.0.49647.log.gz 2024-09-13T19:21:00.909 INFO:teuthology.orchestra.run.smithi102.stderr: 91.1% --verbose -- -- replaced with /var/log/ceph/ceph-client.0.47832.log.gz 2024-09-13T19:21:00.909 INFO:teuthology.orchestra.run.smithi102.stderr: /var/log/ceph/ceph-client.0.56907.log 2024-09-13T19:21:00.909 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.82922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44807.log 2024-09-13T19:21:00.909 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.56907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91967.log 2024-09-13T19:21:00.909 INFO:teuthology.orchestra.run.smithi102.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.79292.log.gz 2024-09-13T19:21:00.909 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.44807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70217.log 2024-09-13T19:21:00.909 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.91967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87139.log 2024-09-13T19:21:00.909 INFO:teuthology.orchestra.run.smithi102.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.82922.log.gz 2024-09-13T19:21:00.909 INFO:teuthology.orchestra.run.smithi102.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.0.55092.log.gz 2024-09-13T19:21:00.909 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.70217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88337.log 2024-09-13T19:21:00.909 INFO:teuthology.orchestra.run.smithi102.stderr: 91.5% 91.1% -- replaced with /var/log/ceph/ceph-client.0.44807.log.gz 2024-09-13T19:21:00.909 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.0.56907.log.gz 2024-09-13T19:21:00.909 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.87139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.95597.log 2024-09-13T19:21:00.909 INFO:teuthology.orchestra.run.smithi102.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.91967.log.gz 2024-09-13T19:21:00.909 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39368.log 2024-09-13T19:21:00.910 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.88337.log: 90.5% -- replaced with /var/log/ceph/ceph-client.0.87139.log.gz 2024-09-13T19:21:00.910 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.95597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40572.log 2024-09-13T19:21:00.910 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.39368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73242.log 2024-09-13T19:21:00.910 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.40572.log: gzip -5 92.7% -- replaced with /var/log/ceph/ceph-client.0.70217.log.gz 2024-09-13T19:21:00.910 INFO:teuthology.orchestra.run.smithi102.stderr: --verbose -- /var/log/ceph/ceph-client.0.47227.log 2024-09-13T19:21:00.910 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.73242.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.88337.log.gz 2024-09-13T19:21:00.910 INFO:teuthology.orchestra.run.smithi102.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.95597.log.gz 2024-09-13T19:21:00.910 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35994.log 2024-09-13T19:21:00.910 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.47227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66587.log 2024-09-13T19:21:00.910 INFO:teuthology.orchestra.run.smithi102.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.39368.log.gz 2024-09-13T19:21:00.910 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.35994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67192.log 2024-09-13T19:21:00.910 INFO:teuthology.orchestra.run.smithi102.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.40572.log.gz 2024-09-13T19:21:00.910 INFO:teuthology.orchestra.run.smithi102.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.73242.log.gz 2024-09-13T19:21:00.910 INFO:teuthology.orchestra.run.smithi102.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.35994.log.gz 2024-09-13T19:21:00.911 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.66587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72032.log 2024-09-13T19:21:00.911 INFO:teuthology.orchestra.run.smithi102.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.47227.log.gz 2024-09-13T19:21:00.911 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.67192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.96859.log 2024-09-13T19:21:00.911 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.72032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77477.log 2024-09-13T19:21:00.911 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.96859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.96202.log 2024-09-13T19:21:00.911 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.77477.log: 91.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76267.log 2024-09-13T19:21:00.911 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.0.66587.log.gz 2024-09-13T19:21:00.911 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.96202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49042.log 2024-09-13T19:21:00.911 INFO:teuthology.orchestra.run.smithi102.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.72032.log.gz 2024-09-13T19:21:00.911 INFO:teuthology.orchestra.run.smithi102.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.67192.log.gz 2024-09-13T19:21:00.911 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38158.log 2024-09-13T19:21:00.911 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.76267.log: /var/log/ceph/ceph-client.0.49042.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.77477.log.gz 2024-09-13T19:21:00.911 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42992.log 2024-09-13T19:21:00.911 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.38158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94387.log 2024-09-13T19:21:00.912 INFO:teuthology.orchestra.run.smithi102.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.96202.log.gz 2024-09-13T19:21:00.912 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.42992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59932.log 2024-09-13T19:21:00.912 INFO:teuthology.orchestra.run.smithi102.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.76267.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.70822.log 2024-09-13T19:21:00.912 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-09-13T19:21:00.912 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.94387.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.49042.log.gz 2024-09-13T19:21:00.912 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.59932.log: 93.3% -- replaced with /var/log/ceph/ceph-client.0.96859.log.gz 2024-09-13T19:21:00.946 INFO:teuthology.orchestra.run.smithi102.stderr: 91.5% 91.3% -- replaced with /var/log/ceph/ceph-client.0.38158.log.gz -- replaced with /var/log/ceph/ceph-client.0.42992.log.gz 2024-09-13T19:21:00.947 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-09-13T19:21:00.947 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61142.log 2024-09-13T19:21:00.947 INFO:teuthology.orchestra.run.smithi102.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.94387.log.gz 2024-09-13T19:21:00.947 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.70822.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.59932.log.gz 2024-09-13T19:21:00.947 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69612.log 2024-09-13T19:21:00.947 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75662.log 2024-09-13T19:21:00.947 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.61142.log: /var/log/ceph/ceph-client.0.69612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36114.log 2024-09-13T19:21:00.947 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.75662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31551.log 2024-09-13T19:21:00.947 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.36114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42387.log 2024-09-13T19:21:00.947 INFO:teuthology.orchestra.run.smithi102.stderr: 91.4% 85.9% -- replaced with /var/log/ceph/ceph-client.admin.36114.log.gz 2024-09-13T19:21:00.947 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.31551.log: -- replaced with /var/log/ceph/ceph-client.0.70822.log.gz 2024-09-13T19:21:00.948 INFO:teuthology.orchestra.run.smithi102.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.61142.log.gz 2024-09-13T19:21:00.948 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79897.log 2024-09-13T19:21:00.948 INFO:teuthology.orchestra.run.smithi102.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.31551.log.gz 2024-09-13T19:21:00.948 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61747.log 2024-09-13T19:21:00.948 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.42387.log: 91.8% -- replaced with /var/log/ceph/ceph-client.0.75662.log.gz 2024-09-13T19:21:00.948 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.79897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36034.log 2024-09-13T19:21:00.948 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56302.log 2024-09-13T19:21:00.948 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.61747.log: /var/log/ceph/ceph-client.admin.36034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41782.log 2024-09-13T19:21:00.948 INFO:teuthology.orchestra.run.smithi102.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.36034.log.gz/var/log/ceph/ceph-client.0.56302.log: 2024-09-13T19:21:00.948 INFO:teuthology.orchestra.run.smithi102.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.42387.log.gz 2024-09-13T19:21:00.948 INFO:teuthology.orchestra.run.smithi102.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.0.69612.log.gz 2024-09-13T19:21:00.949 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93177.log 2024-09-13T19:21:00.949 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37553.log 2024-09-13T19:21:00.949 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.41782.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.79897.log.gz 2024-09-13T19:21:00.949 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.93177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69007.log 2024-09-13T19:21:00.949 INFO:teuthology.orchestra.run.smithi102.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.61747.log.gz 2024-09-13T19:21:00.949 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.37553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46622.log 2024-09-13T19:21:00.949 INFO:teuthology.orchestra.run.smithi102.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.56302.log.gz 2024-09-13T19:21:00.949 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.69007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38763.log 2024-09-13T19:21:00.949 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.46622.log: 91.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72637.log 2024-09-13T19:21:00.949 INFO:teuthology.orchestra.run.smithi102.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.93177.log.gz 2024-09-13T19:21:00.949 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.0.41782.log.gz 2024-09-13T19:21:00.949 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.38763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63562.log 2024-09-13T19:21:00.949 INFO:teuthology.orchestra.run.smithi102.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.37553.log.gz 2024-09-13T19:21:00.949 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.72637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93782.log 2024-09-13T19:21:00.950 INFO:teuthology.orchestra.run.smithi102.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.46622.log.gz 2024-09-13T19:21:00.950 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.63562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91362.log 2024-09-13T19:21:00.950 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5/var/log/ceph/ceph-client.0.93782.log: --verbose -- /var/log/ceph/ceph-client.0.50857.log 2024-09-13T19:21:00.950 INFO:teuthology.orchestra.run.smithi102.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.0.69007.log.gz 2024-09-13T19:21:00.950 INFO:teuthology.orchestra.run.smithi102.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.38763.log.gz 2024-09-13T19:21:00.950 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.91362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83527.log 2024-09-13T19:21:00.950 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.50857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58117.log 2024-09-13T19:21:00.950 INFO:teuthology.orchestra.run.smithi102.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.63562.log.gz 2024-09-13T19:21:00.950 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.83527.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.93782.log.gz 2024-09-13T19:21:00.950 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44202.log 2024-09-13T19:21:00.950 INFO:teuthology.orchestra.run.smithi102.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.72637.log.gz 2024-09-13T19:21:00.950 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.58117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55697.log 2024-09-13T19:21:00.950 INFO:teuthology.orchestra.run.smithi102.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.91362.log.gz 2024-09-13T19:21:00.950 INFO:teuthology.orchestra.run.smithi102.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.50857.log.gz 2024-09-13T19:21:00.951 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.44202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71427.log 2024-09-13T19:21:00.951 INFO:teuthology.orchestra.run.smithi102.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.83527.log.gz 2024-09-13T19:21:00.951 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.55697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50252.log 2024-09-13T19:21:00.951 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.71427.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-13T19:21:00.951 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.50252.log: 91.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81712.log 2024-09-13T19:21:00.951 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.0.58117.log.gz 2024-09-13T19:21:00.951 INFO:teuthology.orchestra.run.smithi102.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.44202.log.gz 2024-09-13T19:21:00.951 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43597.log 2024-09-13T19:21:00.951 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 91.5% -- replaced with /var/log/ceph/ceph-client.0.55697.log.gz 2024-09-13T19:21:00.951 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.81712.log: --verbose -- /var/log/ceph/ceph-client.0.62957.log 2024-09-13T19:21:00.951 INFO:teuthology.orchestra.run.smithi102.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.71427.log.gz 2024-09-13T19:21:00.951 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.43597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46017.log 2024-09-13T19:21:00.951 INFO:teuthology.orchestra.run.smithi102.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.50252.log.gz 2024-09-13T19:21:00.952 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.62957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36074.log 2024-09-13T19:21:00.952 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.46017.log: gzip -5 --verbose -- 91.0% -- replaced with /var/log/ceph/ceph-client.0.43597.log.gz 2024-09-13T19:21:00.952 INFO:teuthology.orchestra.run.smithi102.stderr: /var/log/ceph/ceph-client.0.65982.log 2024-09-13T19:21:00.952 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.36074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53277.log 2024-09-13T19:21:00.952 INFO:teuthology.orchestra.run.smithi102.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.36074.log.gz 2024-09-13T19:21:00.952 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.65982.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.62957.log.gz 2024-09-13T19:21:00.952 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62352.log 2024-09-13T19:21:00.952 INFO:teuthology.orchestra.run.smithi102.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.81712.log.gz 2024-09-13T19:21:00.952 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.53277.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.46017.log.gz 2024-09-13T19:21:00.952 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76872.log 2024-09-13T19:21:00.952 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.62352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36154.log 2024-09-13T19:21:00.952 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.76872.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.65982.log.gz 2024-09-13T19:21:00.952 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-13T19:21:00.953 INFO:teuthology.orchestra.run.smithi102.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.53277.log.gz 2024-09-13T19:21:00.953 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.36154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80502.log 2024-09-13T19:21:00.953 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mgr.x.log: 86.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74452.log 2024-09-13T19:21:00.953 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36154.log.gz 2024-09-13T19:21:00.953 INFO:teuthology.orchestra.run.smithi102.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.62352.log.gz 2024-09-13T19:21:00.953 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90152.log 2024-09-13T19:21:00.953 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.80502.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.76872.log.gz 2024-09-13T19:21:00.953 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54487.log 2024-09-13T19:21:00.953 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.74452.log: /var/log/ceph/ceph-client.0.90152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67797.log 2024-09-13T19:21:00.953 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.54487.log: 91.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78687.log 2024-09-13T19:21:00.953 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.0.80502.log.gz 2024-09-13T19:21:00.953 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73847.log 2024-09-13T19:21:00.953 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.67797.log: /var/log/ceph/ceph-client.0.78687.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.74452.log.gz 2024-09-13T19:21:00.953 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- 91.3% -- replaced with /var/log/ceph/ceph-client.0.90152.log.gz /var/log/ceph/ceph-client.0.59327.log 2024-09-13T19:21:00.954 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-09-13T19:21:00.954 INFO:teuthology.orchestra.run.smithi102.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.54487.log.gz 2024-09-13T19:21:00.954 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.73847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81107.log 2024-09-13T19:21:00.954 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.59327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85342.log 2024-09-13T19:21:00.954 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.81107.log: gzip 91.0% -- replaced with /var/log/ceph/ceph-client.0.67797.log.gz 2024-09-13T19:21:00.954 INFO:teuthology.orchestra.run.smithi102.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.31591.log 2024-09-13T19:21:00.954 INFO:teuthology.orchestra.run.smithi102.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.73847.log.gz 2024-09-13T19:21:00.954 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.85342.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.59327.log.gz 2024-09-13T19:21:00.954 INFO:teuthology.orchestra.run.smithi102.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.0.85342.log.gz 2024-09-13T19:21:00.954 INFO:teuthology.orchestra.run.smithi102.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.81107.log.gz 2024-09-13T19:21:00.954 INFO:teuthology.orchestra.run.smithi102.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.78687.log.gz 2024-09-13T19:21:00.954 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-13T19:21:00.954 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.31591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52067.log 2024-09-13T19:21:00.955 INFO:teuthology.orchestra.run.smithi102.stderr: 85.3%/var/log/ceph/rgw.ceph.client.0.log: -- replaced with /var/log/ceph/ceph-client.admin.31591.log.gz 2024-09-13T19:21:00.955 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36948.log 2024-09-13T19:21:00.955 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.52067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39973.log 2024-09-13T19:21:00.955 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.36948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94992.log 2024-09-13T19:21:00.955 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.39973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85941.log 2024-09-13T19:21:00.955 INFO:teuthology.orchestra.run.smithi102.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.0.39973.log.gz 91.1% -- replaced with /var/log/ceph/ceph-client.0.52067.log.gz 2024-09-13T19:21:00.955 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-09-13T19:21:00.955 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.94992.log: gzip 92.0% -5 --verbose -- /var/log/ceph/ceph-client.0.88942.log 2024-09-13T19:21:00.955 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.0.36948.log.gz 2024-09-13T19:21:00.955 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.85941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48437.log 2024-09-13T19:21:00.955 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.88942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64167.log 2024-09-13T19:21:00.955 INFO:teuthology.orchestra.run.smithi102.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.94992.log.gz 2024-09-13T19:21:00.955 INFO:teuthology.orchestra.run.smithi102.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.85941.log.gz 2024-09-13T19:21:00.955 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.48437.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.88942.log.gz 2024-09-13T19:21:00.956 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78082.log 2024-09-13T19:21:00.956 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.64167.log: gzip 91.1% -5 --verbose -- /var/log/ceph/ceph-client.0.90757.log 2024-09-13T19:21:00.956 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.0.48437.log.gz 2024-09-13T19:21:00.956 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.78082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53882.log 2024-09-13T19:21:00.956 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.90757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68402.log 2024-09-13T19:21:00.956 INFO:teuthology.orchestra.run.smithi102.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.64167.log.gz 2024-09-13T19:21:00.956 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.53882.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.78082.log.gz 2024-09-13T19:21:00.956 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-13T19:21:00.956 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.68402.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.90757.log.gz 2024-09-13T19:21:00.956 INFO:teuthology.orchestra.run.smithi102.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.53882.log.gz 2024-09-13T19:21:00.956 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31471.log 2024-09-13T19:21:00.956 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-osd.3.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.68402.log.gz 2024-09-13T19:21:00.956 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31511.log 2024-09-13T19:21:00.957 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.31471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64772.log 2024-09-13T19:21:00.957 INFO:teuthology.orchestra.run.smithi102.stderr: 85.4%/var/log/ceph/ceph-client.admin.31511.log: -- replaced with /var/log/ceph/ceph-client.admin.31471.log.gz 2024-09-13T19:21:00.957 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52672.log 2024-09-13T19:21:00.957 INFO:teuthology.orchestra.run.smithi102.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.31511.log.gz 2024-09-13T19:21:00.957 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.64772.log: /var/log/ceph/ceph-client.0.52672.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.64772.log.gz 2024-09-13T19:21:00.957 INFO:teuthology.orchestra.run.smithi102.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.52672.log.gz 2024-09-13T19:21:00.968 INFO:teuthology.orchestra.run.smithi102.stderr: 92.1% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-13T19:21:00.969 INFO:teuthology.orchestra.run.smithi102.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-13T19:21:01.027 INFO:teuthology.orchestra.run.smithi053.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-13T19:21:01.800 INFO:teuthology.orchestra.run.smithi102.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-13T19:21:01.826 INFO:teuthology.orchestra.run.smithi053.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-13T19:21:01.828 INFO:teuthology.orchestra.run.smithi053.stderr: 2024-09-13T19:21:01.828 INFO:teuthology.orchestra.run.smithi053.stderr:real 0m1.002s 2024-09-13T19:21:01.828 INFO:teuthology.orchestra.run.smithi053.stderr:user 0m1.165s 2024-09-13T19:21:01.828 INFO:teuthology.orchestra.run.smithi053.stderr:sys 0m0.077s 2024-09-13T19:21:01.864 INFO:teuthology.orchestra.run.smithi102.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-13T19:21:01.980 INFO:teuthology.orchestra.run.smithi102.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-13T19:21:01.981 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-09-13T19:21:01.981 INFO:teuthology.orchestra.run.smithi102.stderr:real 0m1.103s 2024-09-13T19:21:01.981 INFO:teuthology.orchestra.run.smithi102.stderr:user 0m3.007s 2024-09-13T19:21:01.981 INFO:teuthology.orchestra.run.smithi102.stderr:sys 0m0.226s 2024-09-13T19:21:01.982 INFO:tasks.ceph:Archiving logs... 2024-09-13T19:21:01.983 DEBUG:teuthology.misc:Transferring archived files from smithi053:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-13_16:28:49-rgw-squid-distro-default-smithi/7904057/remote/smithi053/log 2024-09-13T19:21:01.984 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T19:21:02.225 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-13_16:28:49-rgw-squid-distro-default-smithi/7904057/remote/smithi102/log 2024-09-13T19:21:02.226 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T19:21:02.773 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-13T19:21:02.783 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-13T19:21:02.783 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T19:21:02.786 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T19:21:02.879 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-13T19:21:02.888 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-13T19:21:02.888 DEBUG:teuthology.orchestra.run.smithi053:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T19:21:02.891 DEBUG:teuthology.orchestra.run.smithi102:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T19:21:02.905 INFO:teuthology.orchestra.run.smithi102.stderr:bash: line 1: ntpq: command not found 2024-09-13T19:21:02.906 INFO:teuthology.orchestra.run.smithi053.stderr:bash: line 1: ntpq: command not found 2024-09-13T19:21:02.910 INFO:teuthology.orchestra.run.smithi102.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T19:21:02.910 INFO:teuthology.orchestra.run.smithi102.stdout:=============================================================================== 2024-09-13T19:21:02.910 INFO:teuthology.orchestra.run.smithi102.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 34 -1684us[-1684us] +/- 47ms 2024-09-13T19:21:02.910 INFO:teuthology.orchestra.run.smithi102.stdout:^* hv02.front.sepia.ceph.com 3 6 377 35 +2735us[+2751us] +/- 47ms 2024-09-13T19:21:02.910 INFO:teuthology.orchestra.run.smithi102.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 34 -1775us[-1775us] +/- 78ms 2024-09-13T19:21:02.910 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T19:21:02.912 INFO:teuthology.orchestra.run.smithi053.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T19:21:02.912 INFO:teuthology.orchestra.run.smithi053.stdout:=============================================================================== 2024-09-13T19:21:02.912 INFO:teuthology.orchestra.run.smithi053.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 33 -1633us[-1633us] +/- 47ms 2024-09-13T19:21:02.912 INFO:teuthology.orchestra.run.smithi053.stdout:^* hv02.front.sepia.ceph.com 3 6 377 35 +2767us[+2737us] +/- 47ms 2024-09-13T19:21:02.912 INFO:teuthology.orchestra.run.smithi053.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 36 -1723us[-1752us] +/- 78ms 2024-09-13T19:21:02.912 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T19:21:02.912 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-13T19:21:02.921 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-13T19:21:02.921 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-13T19:21:02.930 DEBUG:teuthology.orchestra.run.smithi053:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T19:21:03.022 DEBUG:teuthology.orchestra.run.smithi102:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T19:21:03.083 DEBUG:teuthology.orchestra.run.smithi053:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T19:21:03.113 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T19:21:03.114 DEBUG:teuthology.orchestra.run.smithi102:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T19:21:03.141 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T19:21:03.141 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-13T19:21:03.150 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-13T19:21:03.159 INFO:teuthology.task.internal:Duration was 725.081898 seconds 2024-09-13T19:21:03.159 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-13T19:21:03.167 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-13T19:21:03.167 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T19:21:03.170 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T19:21:03.211 INFO:teuthology.orchestra.run.smithi053.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T19:21:03.220 INFO:teuthology.orchestra.run.smithi102.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T19:21:03.537 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-13T19:21:03.537 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi053.front.sepia.ceph.com 2024-09-13T19:21:03.537 DEBUG:teuthology.orchestra.run.smithi053:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T19:21:03.602 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi102.front.sepia.ceph.com 2024-09-13T19:21:03.602 DEBUG:teuthology.orchestra.run.smithi102:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T19:21:03.628 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-13T19:21:03.628 DEBUG:teuthology.orchestra.run.smithi053:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T19:21:03.645 DEBUG:teuthology.orchestra.run.smithi102:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T19:21:03.695 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-13T19:21:03.696 DEBUG:teuthology.orchestra.run.smithi053:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T19:21:03.715 DEBUG:teuthology.orchestra.run.smithi102:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T19:21:03.835 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-13T19:21:03.942 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-13T19:21:03.942 DEBUG:teuthology.orchestra.run.smithi053:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T19:21:03.969 DEBUG:teuthology.orchestra.run.smithi102:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T19:21:03.994 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-13T19:21:04.004 DEBUG:teuthology.orchestra.run.smithi053:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T19:21:04.012 DEBUG:teuthology.orchestra.run.smithi102:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T19:21:04.034 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern = core 2024-09-13T19:21:04.057 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern = core 2024-09-13T19:21:04.079 DEBUG:teuthology.orchestra.run.smithi053:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T19:21:04.111 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T19:21:04.112 DEBUG:teuthology.orchestra.run.smithi102:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T19:21:04.134 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T19:21:04.134 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-13T19:21:04.144 INFO:teuthology.task.internal:Transferring archived files... 2024-09-13T19:21:04.145 DEBUG:teuthology.misc:Transferring archived files from smithi053:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-13_16:28:49-rgw-squid-distro-default-smithi/7904057/remote/smithi053 2024-09-13T19:21:04.145 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T19:21:04.187 DEBUG:teuthology.misc:Transferring archived files from smithi102:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-13_16:28:49-rgw-squid-distro-default-smithi/7904057/remote/smithi102 2024-09-13T19:21:04.188 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T19:21:04.220 INFO:teuthology.task.internal:Removing archive directory... 2024-09-13T19:21:04.221 DEBUG:teuthology.orchestra.run.smithi053:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T19:21:04.224 DEBUG:teuthology.orchestra.run.smithi102:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T19:21:04.271 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-13T19:21:04.287 INFO:teuthology.task.internal:Not uploading archives. 2024-09-13T19:21:04.287 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-13T19:21:04.297 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-13T19:21:04.297 DEBUG:teuthology.orchestra.run.smithi053:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T19:21:04.299 DEBUG:teuthology.orchestra.run.smithi102:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T19:21:04.312 INFO:teuthology.orchestra.run.smithi053.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 19:21 /home/ubuntu/cephtest 2024-09-13T19:21:04.325 INFO:teuthology.orchestra.run.smithi102.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 19:21 /home/ubuntu/cephtest 2024-09-13T19:21:04.326 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-13T19:21:04.336 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-13T19:21:04.358 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{centos_latest}} duration: 725.0818977355957 flavor: default owner: scheduled_cbodley@teuthology success: true 2024-09-13T19:21:04.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T19:21:04.445 INFO:teuthology.run:pass